2024-09-13T18:10:44.343 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:10:44.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:10:44.461 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972 branch: wip-rishabh-testing-20240910.100730-reef description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7903972' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBhBGb619GGW+l7GsHUAPRvJlPsadux97l96n0URqcVlzSYXpNQdUcszoYp/dMtrzo1Qabktyo+9ZTtn4PvdRA= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa3PKakE4Sm5bO1yQrMVqPavRLD6wNyUSkZEbFDZRE1Hz2LeXp9IylwZvbBJv0Ssbf+BNAMslgNbPiTP0nOgUw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:10:44.461 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:10:44.462 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:10:44.462 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:10:44.464 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:10:44.485 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:10:44.485 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:10:44.485 INFO:teuthology.packaging:ref: None 2024-09-13T18:10:44.485 INFO:teuthology.packaging:tag: None 2024-09-13T18:10:44.485 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:10:44.485 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:10:44.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:10:44.636 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:10:44.639 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:10:44.645 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:10:44.645 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:10:44.650 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:10:44.667 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:10:44.673 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:10:44.707 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:05:24.200399', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMweyHpvVIuK0eQ6WVdsPBgXMwOtRMGLW+E2wIY0aO21'} 2024-09-13T18:10:44.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:05:24.201942', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH/tRTAL3xEQzdlVS0bpyS+sG7ET7cg+NZrld9yXhIyG'} 2024-09-13T18:10:44.758 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:10:44.763 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T18:10:44.763 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T18:10:44.763 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:10:44.840 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe83e6dfbe0>, signals=[15]) 2024-09-13T18:10:44.840 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:10:44.845 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:10:44.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:10:44.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:10:44.953 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:10:44.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:10:45.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:10:45.045 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-09-13T18:10:45.050 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-09-13T18:10:45.050 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-09-13T18:10:45.097 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="22.04" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=jammy 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:10:45.098 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=jammy 2024-09-13T18:10:45.099 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-09-13T18:10:45.134 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-09-13T18:10:45.139 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-09-13T18:10:45.139 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-09-13T18:10:45.185 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T18:10:45.185 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2024-09-13T18:10:45.185 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:10:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2024-09-13T18:10:45.186 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-09-13T18:10:45.225 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:10:45.234 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:10:45.239 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:10:45.239 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:10:45.242 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:10:45.246 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:10:45.252 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:10:45.252 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:10:45.291 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:10:45.300 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:10:45.363 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:10:45.377 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:10:45.378 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T18:10:45.378 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:10:45.378 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:10:45.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:45.383 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-13T18:10:45.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:45.384 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-13T18:10:45.430 INFO:teuthology.orchestra.run.smithi087.stdout:5.15.0-56-generic 2024-09-13T18:10:45.430 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.15.0-56-generic 2024-09-13T18:10:45.430 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-09-13T18:10:45.431 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-56-generic 2024-09-13T18:10:45.432 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.15.0-56-generic 2024-09-13T18:10:45.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-09-13T18:10:45.561 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-09-13T18:10:45.565 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-13T18:10:45.692 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:10:45.693 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T18:10:45.718 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T18:10:45.781 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T18:10:45.800 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:10:45.810 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T18:10:45.882 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T18:10:45.894 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T18:10:45.921 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T18:10:45.982 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T18:10:46.010 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T18:10:46.015 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T18:10:46.016 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T18:10:46.019 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T18:10:46.019 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T18:10:46.019 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T18:10:46.020 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T18:10:46.020 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T18:10:46.038 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T18:10:46.040 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T18:10:46.041 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T18:10:46.041 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T18:10:46.042 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T18:10:46.046 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T18:10:46.046 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T18:10:46.050 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T18:10:46.054 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T18:10:46.055 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T18:10:46.057 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T18:10:46.057 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T18:10:46.059 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T18:10:46.061 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T18:10:46.061 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T18:10:46.061 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T18:10:46.069 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T18:10:46.069 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T18:10:46.090 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T18:10:46.090 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T18:10:46.091 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T18:10:46.091 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T18:10:46.092 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T18:10:46.092 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T18:10:46.092 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T18:10:46.092 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T18:10:46.107 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T18:10:46.124 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T18:10:46.124 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T18:10:46.238 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T18:10:46.251 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T18:10:46.376 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T18:10:46.570 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T18:10:46.674 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T18:10:46.690 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T18:10:46.698 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T18:10:46.699 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T18:10:46.729 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T18:10:46.743 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T18:10:46.744 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T18:10:46.796 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T18:10:46.797 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T18:10:46.808 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T18:10:46.808 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T18:10:46.813 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T18:10:46.814 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T18:10:46.830 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T18:10:46.831 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T18:10:46.831 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T18:10:46.853 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T18:10:46.856 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T18:10:46.859 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T18:10:46.860 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T18:10:46.861 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T18:10:46.881 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T18:10:46.885 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T18:10:46.893 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T18:10:46.893 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T18:10:46.936 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T18:10:46.936 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T18:10:46.965 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T18:10:46.966 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T18:10:46.966 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T18:10:46.967 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T18:10:46.969 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T18:10:46.974 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T18:10:46.974 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T18:10:46.975 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T18:10:47.055 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T18:10:47.056 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T18:10:52.202 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 16.0 MB in 2s (7,635 kB/s) 2024-09-13T18:10:52.656 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 16.0 MB in 2s (7,276 kB/s) 2024-09-13T18:10:53.645 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T18:10:53.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:10:53.731 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T18:10:53.941 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-13T18:10:53.941 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-13T18:10:54.130 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:10:54.130 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:10:54.130 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:10:54.131 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:10:54.131 INFO:teuthology.orchestra.run.smithi087.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T18:10:54.131 INFO:teuthology.orchestra.run.smithi087.stdout: python2.7-minimal 2024-09-13T18:10:54.131 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:10:54.132 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-09-13T18:10:54.132 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:10:54.132 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T18:10:54.133 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T18:10:54.134 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-09-13T18:10:54.134 INFO:teuthology.orchestra.run.smithi087.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T18:10:54.134 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-09-13T18:10:54.134 INFO:teuthology.orchestra.run.smithi087.stdout: thermald 2024-09-13T18:10:54.186 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-09-13T18:10:54.186 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:10:54.187 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T18:10:54.187 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T18:10:54.188 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-09-13T18:10:54.189 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T18:10:54.240 INFO:teuthology.orchestra.run.smithi087.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:10:54.240 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 113 MB of archives. 2024-09-13T18:10:54.240 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T18:10:54.240 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T18:10:54.358 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-13T18:10:54.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:10:54.433 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-13T18:10:54.624 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-09-13T18:10:54.624 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-09-13T18:10:54.664 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T18:10:54.764 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T18:10:54.799 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:10:54.799 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:10:54.799 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:10:54.800 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:10:54.800 INFO:teuthology.orchestra.run.smithi053.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T18:10:54.800 INFO:teuthology.orchestra.run.smithi053.stdout: python2.7-minimal 2024-09-13T18:10:54.800 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:10:54.801 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-09-13T18:10:54.801 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:10:54.802 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T18:10:54.802 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T18:10:54.803 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-09-13T18:10:54.803 INFO:teuthology.orchestra.run.smithi053.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T18:10:54.803 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2024-09-13T18:10:54.803 INFO:teuthology.orchestra.run.smithi053.stdout: thermald 2024-09-13T18:10:54.846 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-09-13T18:10:54.846 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:10:54.847 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T18:10:54.847 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T18:10:54.847 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2024-09-13T18:10:54.848 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T18:10:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:10:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 113 MB of archives. 2024-09-13T18:10:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T18:10:54.899 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T18:10:55.359 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T18:10:55.471 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T18:10:55.581 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T18:10:55.581 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T18:10:55.581 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T18:10:55.710 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T18:10:55.738 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T18:10:56.117 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 113 MB in 2s (73.5 MB/s) 2024-09-13T18:10:56.301 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T18:10:56.326 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T18:10:56.326 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T18:10:56.327 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T18:10:56.468 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T18:10:56.560 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T18:10:57.009 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 113 MB in 2s (66.4 MB/s) 2024-09-13T18:10:57.185 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T18:10:58.347 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T18:10:58.351 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:10:58.430 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:10:59.173 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T18:10:59.177 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:10:59.242 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:01.130 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T18:11:01.152 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:11:01.237 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:01.386 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T18:11:01.407 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:11:01.493 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:01.692 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T18:11:01.712 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:11:01.758 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:01.939 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T18:11:01.960 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:11:01.997 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:08.062 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:11:08.189 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:11:08.530 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:11:08.659 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:11:08.726 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:11:08.853 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:11:08.962 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T18:11:08.973 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T18:11:09.003 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:11:09.211 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:11:09.339 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:11:09.584 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T18:11:09.595 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T18:11:09.625 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:11:14.209 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T18:11:14.246 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:11:14.284 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:15.383 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T18:11:15.420 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:11:15.457 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:17.522 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:11:17.620 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:11:17.928 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:11:18.050 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:18.117 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:11:18.176 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T18:11:18.242 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:11:18.279 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:18.592 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:11:18.721 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:18.847 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T18:11:18.975 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:19.585 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:11:19.586 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T18:11:19.586 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:11:19.586 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:19.740 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:20.339 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:11:20.339 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T18:11:20.339 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:11:20.339 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:20.496 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:21.533 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:22.406 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:23.384 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T18:11:23.510 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T18:11:23.636 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:23.700 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T18:11:23.701 INFO:teuthology.orchestra.run.smithi087.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:23.857 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T18:11:23.982 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T18:11:24.109 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:11:24.169 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T18:11:24.169 INFO:teuthology.orchestra.run.smithi053.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:38.295 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T18:11:38.295 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub' 2024-09-13T18:11:38.315 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:11:38.334 INFO:teuthology.orchestra.run.smithi087.stdout:Generating grub configuration file ... 2024-09-13T18:11:38.622 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:11:38.650 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:38.692 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T18:11:38.692 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub' 2024-09-13T18:11:38.700 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:11:38.723 INFO:teuthology.orchestra.run.smithi053.stdout:Generating grub configuration file ... 2024-09-13T18:11:38.946 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:11:38.951 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:11:39.003 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:11:39.014 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:11:39.019 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:11:39.020 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:39.169 INFO:teuthology.orchestra.run.smithi087.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:11:39.170 INFO:teuthology.orchestra.run.smithi087.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:11:39.170 INFO:teuthology.orchestra.run.smithi087.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:11:39.212 INFO:teuthology.orchestra.run.smithi087.stdout:done 2024-09-13T18:11:39.312 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:11:39.318 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:11:39.382 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:11:39.388 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:11:39.544 INFO:teuthology.orchestra.run.smithi053.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:11:39.544 INFO:teuthology.orchestra.run.smithi053.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:11:39.544 INFO:teuthology.orchestra.run.smithi053.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:11:39.586 INFO:teuthology.orchestra.run.smithi053.stdout:done 2024-09-13T18:11:39.664 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-09-13T18:11:39.689 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-09-13T18:11:39.689 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-09-13T18:11:39.689 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-09-13T18:11:39.689 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-09-13T18:11:39.689 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 21 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.15.0.121.121 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:11:39.690 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-09-13T18:11:39.690 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T18:11:39.691 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:11:39.691 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:11:39.691 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T18:11:39.691 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:11:39.691 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2024-09-13T18:11:39.869 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-13T18:11:39.982 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T18:11:39.982 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:11:39.991 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T18:11:40.008 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T18:11:40.111 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2024-09-13T18:11:40.137 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2024-09-13T18:11:40.137 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-09-13T18:11:40.137 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.121.121 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:11:40.138 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-09-13T18:11:40.139 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T18:11:40.139 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:11:40.139 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:11:40.140 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T18:11:40.140 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:11:40.140 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-09-13T18:11:40.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-09-13T18:11:40.435 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T18:11:40.435 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:11:40.444 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T18:11:40.461 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T18:11:41.298 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T18:11:41.316 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:11:41.382 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T18:11:41.597 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-13T18:11:41.598 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-13T18:11:41.791 INFO:teuthology.orchestra.run.smithi087.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T18:11:41.792 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:11:41.792 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:11:41.792 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:11:41.792 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:11:41.792 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:11:41.792 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:11:41.793 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:11:41.836 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:11:41.838 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2024-09-13T18:11:41.853 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2024-09-13T18:11:41.853 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2024-09-13T18:11:41.853 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2024-09-13T18:11:41.853 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2024-09-13T18:11:41.853 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 21 2024-09-13T18:11:41.853 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.15.0.121.121 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:11:41.854 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2024-09-13T18:11:41.855 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-13T18:11:41.884 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-13T18:11:41.903 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:11:41.910 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.5vQUIlsZLi 2024-09-13T18:11:41.910 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5vQUIlsZLi 2024-09-13T18:11:41.958 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-13T18:11:41.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.5vQUIlsZLi 2024-09-13T18:11:42.109 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.5vQUIlsZLi is 10KB 2024-09-13T18:11:42.122 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.5vQUIlsZLi 2024-09-13T18:11:42.128 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T18:11:42.148 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-09-13T18:11:42.149 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-09-13T18:11:42.180 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:11:42.180 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T18:11:42.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T18:11:42.248 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T18:11:42.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo update-grub 2024-09-13T18:11:42.324 INFO:teuthology.orchestra.run.smithi053.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T18:11:42.324 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:11:42.324 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:11:42.324 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:11:42.324 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:11:42.325 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:11:42.325 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:11:42.325 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:11:42.366 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:11:42.368 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2024-09-13T18:11:42.424 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.121.121 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-09-13T18:11:42.425 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-09-13T18:11:42.426 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:11:42.426 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-09-13T18:11:42.426 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-13T18:11:42.477 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.p7WN7Rjysw 2024-09-13T18:11:42.477 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub/grub.cfg /tmp/tmp.p7WN7Rjysw 2024-09-13T18:11:42.533 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.p7WN7Rjysw 2024-09-13T18:11:42.647 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.p7WN7Rjysw is 10KB 2024-09-13T18:11:42.660 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.p7WN7Rjysw 2024-09-13T18:11:42.665 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T18:11:42.721 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:11:42.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T18:11:42.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T18:11:42.789 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T18:11:42.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo update-grub 2024-09-13T18:11:43.444 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:11:43.446 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:11:43.448 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-09-13T18:11:43.631 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:11:43.637 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:11:43.875 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:11:43.918 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:11:43.923 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:11:44.001 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:11:44.002 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:11:44.005 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-09-13T18:11:44.042 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:11:44.042 INFO:teuthology.orchestra.run.smithi087.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:11:44.042 INFO:teuthology.orchestra.run.smithi087.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:11:44.061 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-09-13T18:11:44.063 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-09-13T18:11:44.194 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:11:44.200 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:11:44.436 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:11:44.441 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:11:44.485 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:11:44.490 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:11:44.627 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:11:44.628 INFO:teuthology.orchestra.run.smithi053.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:11:44.628 INFO:teuthology.orchestra.run.smithi053.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:11:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-09-13T18:11:44.654 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-09-13T18:12:14.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T18:12:14.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T18:12:14.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:12:14.658 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T18:12:14.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T18:12:14.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:13:14.161 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:13:14.669 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:13:23.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T18:13:23.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:13:23.179 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-09-13T18:13:23.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T18:13:23.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:13:24.020 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-13T18:13:24.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T18:13:24.679 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T18:13:24.679 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-13T18:13:24.726 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-121-generic 2024-09-13T18:13:24.726 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T18:13:24.726 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:13:24.727 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:13:25.728 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T18:13:25.728 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:13:25.793 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-09-13T18:13:25.827 DEBUG:teuthology.parallel:result is None 2024-09-13T18:13:35.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T18:13:35.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:13:35.478 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-13T18:13:36.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T18:13:36.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-13T18:13:36.112 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-09-13T18:13:36.159 INFO:teuthology.orchestra.run.smithi087.stdout:5.15.0-121-generic 2024-09-13T18:13:36.159 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T18:13:36.159 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:13:36.160 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:13:37.161 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T18:13:37.161 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:13:37.543 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-09-13T18:13:37.565 DEBUG:teuthology.parallel:result is None 2024-09-13T18:13:37.565 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:13:37.572 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:13:37.572 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:13:37.577 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:13:37.583 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:13:37.589 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:13:37.596 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:13:37.597 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:13:37.627 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:13:37.648 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:13:37.654 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:13:37.654 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:13:37.687 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:13:37.703 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:13:37.708 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:13:37.712 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:13:37.716 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:13:37.717 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:13:37.724 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:13:37.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:13:37.759 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:13:37.772 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:13:37.786 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:13:37.786 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:13:37.815 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:13:37.820 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:13:37.866 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:13:37.914 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:13:37.914 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:13:37.974 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:13:37.980 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:13:38.027 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:13:38.027 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:13:38.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-09-13T18:13:38.107 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-09-13T18:13:38.181 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:13:38.189 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:13:38.189 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:13:38.245 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:13:38.252 DEBUG:teuthology.task.selinux:Excluding smithi053: OS 'ubuntu' does not support SELinux 2024-09-13T18:13:38.252 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2024-09-13T18:13:38.253 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:13:38.253 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T18:13:38.253 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:13:38.253 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:13:38.260 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:13:38.272 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:13:38.273 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi087.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:21:12.005 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com')] 2024-09-13T18:21:12.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T18:21:12.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:21:12.119 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-13T18:21:12.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-13T18:21:12.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T18:21:12.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:21:12.286 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-09-13T18:21:12.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-09-13T18:21:12.365 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:21:12.375 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:21:12.375 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:21:12.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:21:12.378 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:21:12.378 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:21:12.407 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T18:21:12.408 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Command line: ntpd -gq 2024-09-13T18:21:12.408 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: ---------------------------------------------------- 2024-09-13T18:21:12.408 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T18:21:12.408 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T18:21:12.408 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: corporation. Support and training for ntp-4 are 2024-09-13T18:21:12.408 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: available at https://www.nwtime.org/support 2024-09-13T18:21:12.408 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: ---------------------------------------------------- 2024-09-13T18:21:12.409 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: proto: precision = 0.046 usec (-24) 2024-09-13T18:21:12.409 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: basedate set to 2022-02-04 2024-09-13T18:21:12.409 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: gps base set to 2022-02-06 (week 2196) 2024-09-13T18:21:12.409 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:21:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:21:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:21:12.410 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:21:12.410 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:21:12.411 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:21:12.411 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:21:12.411 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Listen normally on 3 ens1f0 172.21.15.53:123 2024-09-13T18:21:12.411 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Listen normally on 4 lo [::1]:123 2024-09-13T18:21:12.411 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:3718%3]:123 2024-09-13T18:21:12.411 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:12 ntpd[18354]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:21:12.431 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T18:21:12.431 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Command line: ntpd -gq 2024-09-13T18:21:12.431 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: ---------------------------------------------------- 2024-09-13T18:21:12.431 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T18:21:12.431 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T18:21:12.431 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: corporation. Support and training for ntp-4 are 2024-09-13T18:21:12.431 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: available at https://www.nwtime.org/support 2024-09-13T18:21:12.432 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: ---------------------------------------------------- 2024-09-13T18:21:12.432 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: proto: precision = 0.043 usec (-24) 2024-09-13T18:21:12.432 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: basedate set to 2022-02-04 2024-09-13T18:21:12.432 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: gps base set to 2022-02-06 (week 2196) 2024-09-13T18:21:12.433 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:21:12.433 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:21:12.433 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:21:12.434 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:21:12.434 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:21:12.434 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:21:12.434 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:21:12.434 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2024-09-13T18:21:12.435 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Listen normally on 4 lo [::1]:123 2024-09-13T18:21:12.435 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2024-09-13T18:21:12.435 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:12 ntpd[18474]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:21:13.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:13.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:13.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:13.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:13 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:15 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:15 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:15 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:15 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:15 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:15 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:15.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:15.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:15 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:16.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:16 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:16.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:16 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:16.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:16 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:16.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:16 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:16 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:16 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:17.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:17.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:17.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:17 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:17.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:17 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:18 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:18.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:18 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:18 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:18 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:18 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:18 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:19 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.432 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stdout:13 Sep 18:21:19 ntpd[18474]: ntpd: time slew -0.001968 s 2024-09-13T18:21:19.433 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew -0.001968s 2024-09-13T18:21:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:21:19.434 INFO:teuthology.orchestra.run.smithi087.stderr:13 Sep 18:21:19 ntpd[18474]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:21:19.484 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:21:19.484 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-09-13T18:21:19.484 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:19.484 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:19.484 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:19.484 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:20 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:20 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:20 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:20 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:20 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:20 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:21:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:21:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:21:21.410 INFO:teuthology.orchestra.run.smithi053.stdout:13 Sep 18:21:21 ntpd[18354]: ntpd: time slew -0.000331 s 2024-09-13T18:21:21.410 INFO:teuthology.orchestra.run.smithi053.stdout:ntpd: time slew -0.000331s 2024-09-13T18:21:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:21:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:13 Sep 18:21:21 ntpd[18354]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:21:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:21:21.463 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-09-13T18:21:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:21.463 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T18:21:21.463 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:21:21.472 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:21:21.472 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:21:21.473 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:21:21.473 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:21:21.481 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:21:21.481 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:21:21.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-key list | grep Ceph 2024-09-13T18:21:21.483 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2024-09-13T18:21:21.547 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T18:21:21.565 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T18:21:21.577 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:21:21.577 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:21:21.578 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:21:21.578 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:21:21.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:21:21.592 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:21:21.592 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:21:21.593 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:21:21.593 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:21:21.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:21:21.735 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default/ 2024-09-13T18:21:21.735 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:21:21.750 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default/ 2024-09-13T18:21:21.751 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:21:21.860 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:21:21.860 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:21:21.873 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:21:21.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:21:21.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2024-09-13T18:21:21.889 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-09-13T18:21:22.043 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:21:22.044 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T18:21:22.054 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T18:21:22.057 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:21:22.067 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T18:21:22.072 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T18:21:22.085 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T18:21:22.100 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T18:21:22.114 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T18:21:22.125 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T18:21:22.138 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T18:21:22.147 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T18:21:22.159 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T18:21:22.169 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-09-13T18:21:22.179 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T18:21:22.180 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-09-13T18:21:22.196 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T18:21:22.207 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T18:21:22.401 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 28.8 kB in 0s (83.4 kB/s) 2024-09-13T18:21:22.649 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 158 kB in 1s (282 kB/s) 2024-09-13T18:21:23.412 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T18:21:23.429 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1jammy cephadm=18.2.4-860-g6c6b083f-1jammy ceph-mds=18.2.4-860-g6c6b083f-1jammy ceph-mgr=18.2.4-860-g6c6b083f-1jammy ceph-common=18.2.4-860-g6c6b083f-1jammy ceph-fuse=18.2.4-860-g6c6b083f-1jammy ceph-test=18.2.4-860-g6c6b083f-1jammy ceph-volume=18.2.4-860-g6c6b083f-1jammy radosgw=18.2.4-860-g6c6b083f-1jammy python3-rados=18.2.4-860-g6c6b083f-1jammy python3-rgw=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy python3-rbd=18.2.4-860-g6c6b083f-1jammy libcephfs2=18.2.4-860-g6c6b083f-1jammy libcephfs-dev=18.2.4-860-g6c6b083f-1jammy librados2=18.2.4-860-g6c6b083f-1jammy librbd1=18.2.4-860-g6c6b083f-1jammy rbd-fuse=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy cephfs-shell=18.2.4-860-g6c6b083f-1jammy cephfs-top=18.2.4-860-g6c6b083f-1jammy cephfs-mirror=18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:21:23.483 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T18:21:23.674 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-13T18:21:23.674 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-13T18:21:23.691 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-13T18:21:23.709 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1jammy cephadm=18.2.4-860-g6c6b083f-1jammy ceph-mds=18.2.4-860-g6c6b083f-1jammy ceph-mgr=18.2.4-860-g6c6b083f-1jammy ceph-common=18.2.4-860-g6c6b083f-1jammy ceph-fuse=18.2.4-860-g6c6b083f-1jammy ceph-test=18.2.4-860-g6c6b083f-1jammy ceph-volume=18.2.4-860-g6c6b083f-1jammy radosgw=18.2.4-860-g6c6b083f-1jammy python3-rados=18.2.4-860-g6c6b083f-1jammy python3-rgw=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy python3-rbd=18.2.4-860-g6c6b083f-1jammy libcephfs2=18.2.4-860-g6c6b083f-1jammy libcephfs-dev=18.2.4-860-g6c6b083f-1jammy librados2=18.2.4-860-g6c6b083f-1jammy librbd1=18.2.4-860-g6c6b083f-1jammy rbd-fuse=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy cephfs-shell=18.2.4-860-g6c6b083f-1jammy cephfs-top=18.2.4-860-g6c6b083f-1jammy cephfs-mirror=18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:21:23.766 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-13T18:21:23.857 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:21:23.857 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:21:23.857 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:21:23.857 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:21:23.858 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:21:23.858 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:21:23.858 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:21:23.858 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-09-13T18:21:23.858 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:21:23.858 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T18:21:23.859 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T18:21:23.859 INFO:teuthology.orchestra.run.smithi087.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T18:21:23.859 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T18:21:23.859 INFO:teuthology.orchestra.run.smithi087.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T18:21:23.859 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T18:21:23.860 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T18:21:23.861 INFO:teuthology.orchestra.run.smithi087.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T18:21:23.862 INFO:teuthology.orchestra.run.smithi087.stdout: python3-watchdog 2024-09-13T18:21:23.862 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2024-09-13T18:21:23.862 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2024-09-13T18:21:23.956 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-09-13T18:21:23.956 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-09-13T18:21:23.967 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-09-13T18:21:23.967 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:21:23.967 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:21:23.968 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:21:23.968 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T18:21:23.968 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T18:21:23.968 INFO:teuthology.orchestra.run.smithi087.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T18:21:23.968 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T18:21:23.969 INFO:teuthology.orchestra.run.smithi087.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T18:21:23.969 INFO:teuthology.orchestra.run.smithi087.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T18:21:23.969 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T18:21:23.969 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T18:21:23.969 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T18:21:23.969 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T18:21:23.970 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T18:21:23.971 INFO:teuthology.orchestra.run.smithi087.stdout: socat xmlstarlet 2024-09-13T18:21:24.029 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 115 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T18:21:24.029 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 163 MB of archives. 2024-09-13T18:21:24.029 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 748 MB of additional disk space will be used. 2024-09-13T18:21:24.029 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T18:21:24.047 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T18:21:24.057 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T18:21:24.098 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T18:21:24.107 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T18:21:24.112 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1jammy [3,453 kB] 2024-09-13T18:21:24.123 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T18:21:24.125 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T18:21:24.135 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T18:21:24.146 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:21:24.146 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:21:24.146 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:21:24.146 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:21:24.147 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:21:24.147 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:21:24.147 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:21:24.148 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-09-13T18:21:24.148 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:21:24.148 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T18:21:24.148 INFO:teuthology.orchestra.run.smithi053.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T18:21:24.148 INFO:teuthology.orchestra.run.smithi053.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T18:21:24.149 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T18:21:24.150 INFO:teuthology.orchestra.run.smithi053.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: python3-watchdog 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2024-09-13T18:21:24.151 INFO:teuthology.orchestra.run.smithi053.stdout: btrfs-tools 2024-09-13T18:21:24.181 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T18:21:24.185 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T18:21:24.196 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T18:21:24.200 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T18:21:24.200 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T18:21:24.208 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T18:21:24.209 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T18:21:24.209 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T18:21:24.210 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T18:21:24.210 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T18:21:24.219 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T18:21:24.219 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T18:21:24.236 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T18:21:24.236 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T18:21:24.236 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T18:21:24.240 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T18:21:24.240 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T18:21:24.240 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T18:21:24.241 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T18:21:24.241 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:21:24.253 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T18:21:24.253 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T18:21:24.263 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T18:21:24.265 INFO:teuthology.orchestra.run.smithi053.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T18:21:24.265 INFO:teuthology.orchestra.run.smithi053.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T18:21:24.265 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T18:21:24.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T18:21:24.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T18:21:24.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T18:21:24.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T18:21:24.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T18:21:24.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:21:24.267 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T18:21:24.267 INFO:teuthology.orchestra.run.smithi053.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T18:21:24.268 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:21:24.268 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T18:21:24.268 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:21:24.268 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T18:21:24.268 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T18:21:24.268 INFO:teuthology.orchestra.run.smithi053.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T18:21:24.269 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T18:21:24.269 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T18:21:24.269 INFO:teuthology.orchestra.run.smithi053.stdout: socat xmlstarlet 2024-09-13T18:21:24.270 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T18:21:24.271 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T18:21:24.271 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T18:21:24.276 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T18:21:24.277 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T18:21:24.277 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T18:21:24.278 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T18:21:24.279 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T18:21:24.287 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T18:21:24.288 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T18:21:24.296 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1jammy [3,108 kB] 2024-09-13T18:21:24.298 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T18:21:24.299 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T18:21:24.301 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T18:21:24.302 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T18:21:24.303 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T18:21:24.305 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T18:21:24.342 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1jammy [684 kB] 2024-09-13T18:21:24.350 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1jammy [357 kB] 2024-09-13T18:21:24.355 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1jammy [32.8 kB] 2024-09-13T18:21:24.356 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T18:21:24.356 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1jammy [180 kB] 2024-09-13T18:21:24.356 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T18:21:24.357 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T18:21:24.358 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T18:21:24.359 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1jammy [63.7 kB] 2024-09-13T18:21:24.359 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T18:21:24.359 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T18:21:24.359 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T18:21:24.360 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1jammy [334 kB] 2024-09-13T18:21:24.361 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:21:24.362 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T18:21:24.365 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1jammy [5,933 kB] 2024-09-13T18:21:24.374 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T18:21:24.391 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T18:21:24.393 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T18:21:24.394 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T18:21:24.409 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T18:21:24.409 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T18:21:24.410 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T18:21:24.410 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T18:21:24.410 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T18:21:24.411 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T18:21:24.411 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T18:21:24.442 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T18:21:24.445 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T18:21:24.447 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T18:21:24.449 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T18:21:24.449 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T18:21:24.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T18:21:24.454 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 115 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T18:21:24.454 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 163 MB of archives. 2024-09-13T18:21:24.454 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 748 MB of additional disk space will be used. 2024-09-13T18:21:24.454 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T18:21:24.454 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T18:21:24.455 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T18:21:24.461 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T18:21:24.464 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1jammy [112 kB] 2024-09-13T18:21:24.465 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1jammy [445 kB] 2024-09-13T18:21:24.472 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1jammy [22.1 MB] 2024-09-13T18:21:24.478 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:21:24.479 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T18:21:24.480 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T18:21:24.487 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T18:21:24.487 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T18:21:24.487 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T18:21:24.497 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1jammy [3,453 kB] 2024-09-13T18:21:24.536 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T18:21:24.582 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T18:21:24.777 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T18:21:24.815 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T18:21:24.888 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T18:21:24.899 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T18:21:24.908 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1jammy [5,006 kB] 2024-09-13T18:21:24.943 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T18:21:24.961 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1jammy [242 kB] 2024-09-13T18:21:24.963 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1jammy [130 kB] 2024-09-13T18:21:24.964 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1jammy [1,496 kB] 2024-09-13T18:21:24.977 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1jammy [6,085 kB] 2024-09-13T18:21:25.082 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1jammy [22.4 MB] 2024-09-13T18:21:25.108 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T18:21:25.116 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T18:21:25.143 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T18:21:25.151 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T18:21:25.152 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T18:21:25.170 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T18:21:25.171 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T18:21:25.172 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T18:21:25.174 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T18:21:25.192 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T18:21:25.257 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T18:21:25.257 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T18:21:25.259 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T18:21:25.259 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T18:21:25.260 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T18:21:25.265 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T18:21:25.272 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T18:21:25.272 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T18:21:25.273 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T18:21:25.353 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:21:25.354 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T18:21:25.354 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T18:21:25.357 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T18:21:25.359 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T18:21:25.360 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T18:21:25.434 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T18:21:25.435 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T18:21:25.436 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T18:21:25.437 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T18:21:25.516 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T18:21:25.520 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T18:21:25.522 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T18:21:25.525 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T18:21:25.526 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T18:21:25.530 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T18:21:25.548 INFO:teuthology.orchestra.run.smithi087.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1jammy [14.2 kB] 2024-09-13T18:21:25.548 INFO:teuthology.orchestra.run.smithi087.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1jammy [835 kB] 2024-09-13T18:21:25.559 INFO:teuthology.orchestra.run.smithi087.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1jammy [2,159 kB] 2024-09-13T18:21:25.584 INFO:teuthology.orchestra.run.smithi087.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1jammy [240 kB] 2024-09-13T18:21:25.586 INFO:teuthology.orchestra.run.smithi087.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1jammy [145 kB] 2024-09-13T18:21:25.589 INFO:teuthology.orchestra.run.smithi087.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1jammy [2,233 kB] 2024-09-13T18:21:25.590 INFO:teuthology.orchestra.run.smithi053.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1jammy [3,108 kB] 2024-09-13T18:21:25.606 INFO:teuthology.orchestra.run.smithi053.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T18:21:25.607 INFO:teuthology.orchestra.run.smithi053.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T18:21:25.611 INFO:teuthology.orchestra.run.smithi087.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1jammy [8,625 kB] 2024-09-13T18:21:25.612 INFO:teuthology.orchestra.run.smithi053.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T18:21:25.753 INFO:teuthology.orchestra.run.smithi087.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1jammy [14.3 kB] 2024-09-13T18:21:25.753 INFO:teuthology.orchestra.run.smithi087.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1jammy [42.9 MB] 2024-09-13T18:21:25.776 INFO:teuthology.orchestra.run.smithi053.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T18:21:25.778 INFO:teuthology.orchestra.run.smithi053.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T18:21:25.780 INFO:teuthology.orchestra.run.smithi053.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T18:21:25.781 INFO:teuthology.orchestra.run.smithi053.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T18:21:25.783 INFO:teuthology.orchestra.run.smithi053.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T18:21:25.783 INFO:teuthology.orchestra.run.smithi053.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T18:21:25.784 INFO:teuthology.orchestra.run.smithi053.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T18:21:25.788 INFO:teuthology.orchestra.run.smithi053.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:21:25.789 INFO:teuthology.orchestra.run.smithi053.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T18:21:25.862 INFO:teuthology.orchestra.run.smithi053.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T18:21:25.907 INFO:teuthology.orchestra.run.smithi053.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T18:21:25.911 INFO:teuthology.orchestra.run.smithi053.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T18:21:25.912 INFO:teuthology.orchestra.run.smithi053.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T18:21:25.964 INFO:teuthology.orchestra.run.smithi053.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T18:21:25.964 INFO:teuthology.orchestra.run.smithi053.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T18:21:25.965 INFO:teuthology.orchestra.run.smithi053.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T18:21:25.966 INFO:teuthology.orchestra.run.smithi053.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T18:21:25.967 INFO:teuthology.orchestra.run.smithi053.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T18:21:25.968 INFO:teuthology.orchestra.run.smithi053.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T18:21:26.025 INFO:teuthology.orchestra.run.smithi053.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T18:21:26.025 INFO:teuthology.orchestra.run.smithi053.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T18:21:26.032 INFO:teuthology.orchestra.run.smithi053.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T18:21:26.067 INFO:teuthology.orchestra.run.smithi053.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1jammy [684 kB] 2024-09-13T18:21:26.106 INFO:teuthology.orchestra.run.smithi053.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T18:21:26.110 INFO:teuthology.orchestra.run.smithi053.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T18:21:26.112 INFO:teuthology.orchestra.run.smithi053.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T18:21:26.121 INFO:teuthology.orchestra.run.smithi053.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T18:21:26.128 INFO:teuthology.orchestra.run.smithi053.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T18:21:26.128 INFO:teuthology.orchestra.run.smithi053.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T18:21:26.139 INFO:teuthology.orchestra.run.smithi053.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T18:21:26.178 INFO:teuthology.orchestra.run.smithi053.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1jammy [357 kB] 2024-09-13T18:21:26.188 INFO:teuthology.orchestra.run.smithi053.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:21:26.189 INFO:teuthology.orchestra.run.smithi053.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T18:21:26.193 INFO:teuthology.orchestra.run.smithi053.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T18:21:26.234 INFO:teuthology.orchestra.run.smithi053.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1jammy [32.8 kB] 2024-09-13T18:21:26.236 INFO:teuthology.orchestra.run.smithi053.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1jammy [180 kB] 2024-09-13T18:21:26.240 INFO:teuthology.orchestra.run.smithi053.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1jammy [63.7 kB] 2024-09-13T18:21:26.244 INFO:teuthology.orchestra.run.smithi053.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1jammy [334 kB] 2024-09-13T18:21:26.269 INFO:teuthology.orchestra.run.smithi053.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T18:21:26.270 INFO:teuthology.orchestra.run.smithi053.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T18:21:26.272 INFO:teuthology.orchestra.run.smithi053.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T18:21:26.295 INFO:teuthology.orchestra.run.smithi053.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1jammy [5,933 kB] 2024-09-13T18:21:26.704 INFO:teuthology.orchestra.run.smithi053.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1jammy [112 kB] 2024-09-13T18:21:26.707 INFO:teuthology.orchestra.run.smithi053.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1jammy [445 kB] 2024-09-13T18:21:26.719 INFO:teuthology.orchestra.run.smithi053.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1jammy [22.1 MB] 2024-09-13T18:21:26.770 INFO:teuthology.orchestra.run.smithi087.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1jammy [122 kB] 2024-09-13T18:21:26.773 INFO:teuthology.orchestra.run.smithi087.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1jammy [233 kB] 2024-09-13T18:21:26.777 INFO:teuthology.orchestra.run.smithi087.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1jammy [34.0 kB] 2024-09-13T18:21:26.778 INFO:teuthology.orchestra.run.smithi087.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1jammy [23.5 kB] 2024-09-13T18:21:26.779 INFO:teuthology.orchestra.run.smithi087.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1jammy [38.3 kB] 2024-09-13T18:21:26.781 INFO:teuthology.orchestra.run.smithi087.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1jammy [11.7 MB] 2024-09-13T18:21:26.993 INFO:teuthology.orchestra.run.smithi087.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1jammy [93.0 kB] 2024-09-13T18:21:27.310 INFO:teuthology.orchestra.run.smithi053.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1jammy [5,006 kB] 2024-09-13T18:21:27.369 INFO:teuthology.orchestra.run.smithi053.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1jammy [242 kB] 2024-09-13T18:21:27.371 INFO:teuthology.orchestra.run.smithi053.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1jammy [130 kB] 2024-09-13T18:21:27.373 INFO:teuthology.orchestra.run.smithi053.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1jammy [1,496 kB] 2024-09-13T18:21:27.386 INFO:teuthology.orchestra.run.smithi053.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1jammy [6,085 kB] 2024-09-13T18:21:27.477 INFO:teuthology.orchestra.run.smithi053.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1jammy [22.4 MB] 2024-09-13T18:21:27.564 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 163 MB in 3s (54.1 MB/s) 2024-09-13T18:21:27.699 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:21:27.787 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T18:21:27.793 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T18:21:27.831 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T18:21:27.944 INFO:teuthology.orchestra.run.smithi053.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1jammy [14.2 kB] 2024-09-13T18:21:27.945 INFO:teuthology.orchestra.run.smithi053.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1jammy [835 kB] 2024-09-13T18:21:27.956 INFO:teuthology.orchestra.run.smithi053.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1jammy [2,159 kB] 2024-09-13T18:21:27.986 INFO:teuthology.orchestra.run.smithi053.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1jammy [240 kB] 2024-09-13T18:21:27.990 INFO:teuthology.orchestra.run.smithi053.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1jammy [145 kB] 2024-09-13T18:21:27.992 INFO:teuthology.orchestra.run.smithi053.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1jammy [2,233 kB] 2024-09-13T18:21:28.016 INFO:teuthology.orchestra.run.smithi053.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1jammy [8,625 kB] 2024-09-13T18:21:28.133 INFO:teuthology.orchestra.run.smithi053.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1jammy [14.3 kB] 2024-09-13T18:21:28.133 INFO:teuthology.orchestra.run.smithi053.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1jammy [42.9 MB] 2024-09-13T18:21:28.133 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:21:28.160 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T18:21:28.200 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T18:21:28.512 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:21:28.538 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T18:21:28.578 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T18:21:28.881 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T18:21:28.907 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T18:21:28.973 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T18:21:29.016 INFO:teuthology.orchestra.run.smithi053.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1jammy [122 kB] 2024-09-13T18:21:29.018 INFO:teuthology.orchestra.run.smithi053.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1jammy [233 kB] 2024-09-13T18:21:29.023 INFO:teuthology.orchestra.run.smithi053.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1jammy [34.0 kB] 2024-09-13T18:21:29.024 INFO:teuthology.orchestra.run.smithi053.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1jammy [23.5 kB] 2024-09-13T18:21:29.025 INFO:teuthology.orchestra.run.smithi053.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1jammy [38.3 kB] 2024-09-13T18:21:29.026 INFO:teuthology.orchestra.run.smithi053.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1jammy [11.7 MB] 2024-09-13T18:21:29.186 INFO:teuthology.orchestra.run.smithi053.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1jammy [93.0 kB] 2024-09-13T18:21:29.309 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T18:21:29.335 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T18:21:29.375 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T18:21:29.712 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:21:29.738 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T18:21:29.779 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T18:21:29.795 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 163 MB in 5s (33.2 MB/s) 2024-09-13T18:21:30.061 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:21:30.099 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:21:30.125 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T18:21:30.165 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T18:21:30.165 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T18:21:30.171 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T18:21:30.209 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T18:21:30.512 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:21:30.539 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T18:21:30.579 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T18:21:30.865 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:21:30.892 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T18:21:31.015 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T18:21:31.119 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:21:31.146 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T18:21:31.193 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:21:31.343 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T18:21:31.369 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T18:21:31.452 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T18:21:31.580 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:21:31.606 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T18:21:31.647 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:21:31.773 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T18:21:31.800 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T18:21:31.840 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T18:21:31.966 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:21:31.992 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T18:21:32.033 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:21:32.185 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:21:32.211 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T18:21:32.251 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T18:21:32.361 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T18:21:32.387 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T18:21:32.427 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T18:21:32.596 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:21:32.623 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T18:21:32.663 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T18:21:32.772 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librados2. 2024-09-13T18:21:32.798 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:32.838 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:33.058 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:21:33.085 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T18:21:33.133 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:21:33.216 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librbd1. 2024-09-13T18:21:33.231 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../012-librbd1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:33.536 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:21:33.563 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T18:21:33.603 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:21:33.702 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:21:33.728 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:33.777 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:33.939 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:21:33.965 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T18:21:34.005 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:21:34.055 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:21:34.081 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../014-python3-rados_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:34.121 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:34.300 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T18:21:34.316 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T18:21:34.358 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T18:21:34.433 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:21:34.459 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:21:34.499 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:34.695 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librados2. 2024-09-13T18:21:34.721 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:34.726 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:21:34.742 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:34.761 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:34.776 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:35.088 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:21:35.114 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:21:35.154 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:35.465 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:21:35.489 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librbd1. 2024-09-13T18:21:35.492 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T18:21:35.516 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../012-librbd1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T18:21:35.564 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:35.784 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:21:35.808 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:35.851 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:36.009 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:21:36.035 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:36.075 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:36.361 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:21:36.377 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../014-python3-rados_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:36.419 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:36.446 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:21:36.472 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T18:21:36.504 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T18:21:36.706 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:21:36.732 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:21:36.764 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:36.815 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:21:36.841 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../021-librgw2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:36.882 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:37.008 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:21:37.024 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:37.066 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:37.376 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:21:37.386 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:21:37.402 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:37.412 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:21:37.442 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:37.452 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:37.780 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:21:37.787 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T18:21:37.807 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T18:21:37.813 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T18:21:37.847 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T18:21:37.854 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T18:21:38.098 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:21:38.107 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:21:38.113 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:38.123 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:38.156 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:38.166 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:38.511 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:21:38.537 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T18:21:38.559 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:21:38.568 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T18:21:38.586 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../025-ceph-common_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:38.626 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:38.888 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:21:38.915 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../021-librgw2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:38.955 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:39.441 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:21:39.457 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:39.490 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:39.799 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:21:39.818 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T18:21:39.825 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../026-ceph-base_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:39.845 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T18:21:39.866 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:39.885 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T18:21:40.230 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:21:40.257 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:40.344 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T18:21:40.371 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T18:21:40.411 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T18:21:40.437 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:40.716 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T18:21:40.742 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T18:21:40.782 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T18:21:40.791 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:21:40.818 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../025-ceph-common_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:40.849 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:41.270 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T18:21:41.297 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T18:21:41.352 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T18:21:41.605 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T18:21:41.622 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T18:21:41.654 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T18:21:41.958 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T18:21:41.984 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T18:21:42.024 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T18:21:42.146 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:21:42.173 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../026-ceph-base_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:42.223 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:42.352 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T18:21:42.418 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T18:21:42.730 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-portend. 2024-09-13T18:21:42.756 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T18:21:42.796 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T18:21:42.843 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T18:21:42.869 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T18:21:42.909 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T18:21:43.057 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T18:21:43.073 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T18:21:43.107 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T18:21:43.212 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T18:21:43.238 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T18:21:43.278 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T18:21:43.410 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:21:43.437 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T18:21:43.477 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T18:21:43.598 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T18:21:43.625 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T18:21:43.664 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T18:21:43.830 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:21:43.857 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T18:21:43.897 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T18:21:43.967 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T18:21:43.994 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T18:21:44.034 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T18:21:44.208 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:21:44.223 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T18:21:44.266 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T18:21:44.286 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T18:21:44.303 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T18:21:44.345 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T18:21:44.544 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:21:44.560 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T18:21:44.594 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T18:21:44.648 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T18:21:44.675 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T18:21:44.714 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T18:21:44.864 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:21:44.890 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T18:21:44.930 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T18:21:45.017 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-portend. 2024-09-13T18:21:45.044 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T18:21:45.084 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T18:21:45.250 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:21:45.277 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:21:45.317 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:21:45.370 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T18:21:45.397 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T18:21:45.436 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T18:21:45.619 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:21:45.646 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T18:21:45.686 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T18:21:45.739 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:21:45.766 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T18:21:45.806 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T18:21:45.981 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:21:46.007 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T18:21:46.047 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T18:21:46.176 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:21:46.203 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T18:21:46.243 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T18:21:46.359 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:21:46.374 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T18:21:46.411 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T18:21:46.529 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:21:46.556 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T18:21:46.595 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T18:21:46.711 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:21:46.738 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T18:21:46.778 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T18:21:46.881 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:21:46.909 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T18:21:46.948 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T18:21:47.081 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:21:47.108 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T18:21:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T18:21:47.259 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:21:47.286 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T18:21:47.326 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T18:21:47.426 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:21:47.452 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T18:21:47.492 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T18:21:47.654 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:21:47.681 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:21:47.721 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:21:47.795 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:21:47.822 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T18:21:47.861 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T18:21:47.982 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:21:48.008 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T18:21:48.048 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T18:21:48.164 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:21:48.191 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T18:21:48.231 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T18:21:48.351 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:21:48.378 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T18:21:48.418 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T18:21:48.542 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:21:48.569 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T18:21:48.609 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T18:21:48.771 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:21:48.798 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T18:21:48.840 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T18:21:48.963 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T18:21:48.990 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T18:21:49.030 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T18:21:49.148 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:21:49.176 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T18:21:49.215 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T18:21:49.333 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-idna. 2024-09-13T18:21:49.360 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T18:21:49.399 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T18:21:49.493 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:21:49.509 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T18:21:49.543 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T18:21:49.711 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T18:21:49.738 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T18:21:49.777 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T18:21:49.854 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:21:49.882 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T18:21:49.921 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T18:21:50.105 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests. 2024-09-13T18:21:50.132 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T18:21:50.172 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T18:21:50.240 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:21:50.267 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T18:21:50.307 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T18:21:50.483 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:21:50.510 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T18:21:50.550 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T18:21:50.760 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:21:50.787 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T18:21:50.827 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T18:21:50.861 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:21:50.888 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:21:50.928 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:51.088 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:21:51.104 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T18:21:51.138 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T18:21:51.258 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:21:51.284 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:51.316 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:51.543 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T18:21:51.570 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T18:21:51.609 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T18:21:51.610 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:21:51.637 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T18:21:51.676 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T18:21:51.937 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-idna. 2024-09-13T18:21:51.964 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T18:21:51.979 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:21:52.003 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T18:21:52.006 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T18:21:52.046 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T18:21:52.323 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T18:21:52.350 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T18:21:52.382 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:21:52.389 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T18:21:52.408 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:52.449 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:52.693 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests. 2024-09-13T18:21:52.720 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T18:21:52.759 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T18:21:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:21:52.820 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:52.860 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:53.021 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:21:53.048 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T18:21:53.078 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T18:21:53.382 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:21:53.399 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:21:53.440 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:53.472 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:21:53.499 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:53.538 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:53.878 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:21:53.906 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:53.945 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:54.256 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:21:54.283 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T18:21:54.322 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T18:21:54.567 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2024-09-13T18:21:54.593 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../062-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:54.600 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:21:54.627 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T18:21:54.633 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:54.658 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T18:21:54.970 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:21:54.994 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:21:54.997 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:55.021 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:55.036 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:55.069 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:55.431 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:21:55.459 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:55.497 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:56.065 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:21:56.091 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:56.243 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:21:56.270 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:56.309 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:56.364 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:57.010 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:21:57.036 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../065-cephadm_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:57.076 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:57.421 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:21:57.447 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T18:21:57.496 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T18:21:57.816 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T18:21:57.842 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T18:21:57.882 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T18:21:58.313 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph. 2024-09-13T18:21:58.341 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../062-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:58.380 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:58.699 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:21:58.726 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:58.765 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:58.895 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-babel. 2024-09-13T18:21:58.924 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T18:21:58.962 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T18:21:59.061 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:21:59.077 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:59.119 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:59.282 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:21:59.309 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T18:21:59.348 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T18:21:59.505 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:21:59.533 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../065-cephadm_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:21:59.572 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:59.702 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:21:59.729 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:21:59.768 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:21:59.900 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:21:59.927 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T18:21:59.966 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T18:22:00.088 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:22:00.114 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T18:22:00.146 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T18:22:00.303 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T18:22:00.330 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T18:22:00.369 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T18:22:00.433 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:22:00.460 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T18:22:00.499 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T18:22:00.794 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T18:22:00.821 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T18:22:00.861 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T18:22:01.163 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-toml. 2024-09-13T18:22:01.191 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T18:22:01.230 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T18:22:01.542 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:22:01.569 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T18:22:01.608 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T18:22:01.616 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-babel. 2024-09-13T18:22:01.644 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T18:22:01.675 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T18:22:01.954 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:22:01.969 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:22:01.981 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:22:01.996 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T18:22:02.020 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:22:02.036 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T18:22:02.331 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:22:02.356 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:22:02.358 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T18:22:02.383 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:02.397 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T18:22:02.414 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:02.700 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:22:02.716 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T18:22:02.734 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:22:02.750 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T18:22:02.762 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:02.801 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:03.062 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:22:03.089 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T18:22:03.128 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T18:22:03.465 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T18:22:03.492 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T18:22:03.531 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T18:22:03.843 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-toml. 2024-09-13T18:22:03.870 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T18:22:03.909 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T18:22:03.997 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T18:22:04.013 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T18:22:04.055 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T18:22:04.187 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:22:04.214 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T18:22:04.254 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T18:22:04.551 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:22:04.578 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T18:22:04.599 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:22:04.617 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T18:22:04.626 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:22:04.665 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:22:04.921 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T18:22:04.948 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T18:22:04.951 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:22:04.968 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T18:22:04.987 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T18:22:05.010 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T18:22:05.290 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:22:05.317 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T18:22:05.356 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T18:22:05.371 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:22:05.399 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:05.438 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:06.159 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:22:06.187 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:06.225 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:06.660 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T18:22:06.688 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T18:22:06.726 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T18:22:07.104 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:22:08.014 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:22:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T18:22:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T18:22:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T18:22:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T18:22:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T18:22:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:22:08.015 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T18:22:08.016 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T18:22:08.016 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:22:08.016 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T18:22:08.016 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T18:22:08.016 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:22:08.016 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T18:22:08.016 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T18:22:08.030 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T18:22:08.069 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T18:22:08.255 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:22:08.282 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T18:22:08.329 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T18:22:08.641 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:22:08.668 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T18:22:08.707 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T18:22:08.854 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:22:08.882 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:08.920 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:08.993 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:22:09.009 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T18:22:09.043 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T18:22:09.338 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:22:09.365 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T18:22:09.404 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T18:22:09.716 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:22:09.743 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T18:22:09.791 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T18:22:09.890 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:22:09.918 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T18:22:09.957 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T18:22:10.220 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:22:10.248 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T18:22:10.278 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T18:22:10.455 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:22:10.471 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:10.513 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:10.590 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:22:10.618 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T18:22:10.656 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T18:22:10.841 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:22:10.868 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T18:22:10.907 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T18:22:10.968 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:22:10.996 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T18:22:11.034 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T18:22:11.169 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:22:11.196 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T18:22:11.227 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T18:22:11.321 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:22:11.349 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T18:22:11.388 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T18:22:11.471 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2024-09-13T18:22:11.487 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T18:22:11.529 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T18:22:11.782 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2024-09-13T18:22:11.810 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T18:22:11.848 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T18:22:11.899 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:22:11.927 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T18:22:11.966 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T18:22:12.160 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:22:12.176 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T18:22:12.218 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T18:22:12.252 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:22:12.280 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T18:22:12.327 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T18:22:12.605 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:22:12.633 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T18:22:12.672 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T18:22:12.881 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:22:12.897 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../098-ceph-test_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:12.939 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:13.377 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:22:13.405 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:13.444 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:13.721 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:22:13.738 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T18:22:13.771 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T18:22:14.083 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:22:14.111 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T18:22:14.149 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T18:22:14.419 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package jq. 2024-09-13T18:22:14.446 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T18:22:14.485 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T18:22:14.738 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package socat. 2024-09-13T18:22:14.766 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T18:22:14.804 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T18:22:14.835 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:22:14.863 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:14.901 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:15.091 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:22:15.119 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T18:22:15.149 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T18:22:15.264 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:22:15.280 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:15.314 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:15.528 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:22:15.545 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../098-ceph-test_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:15.587 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:15.609 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:22:15.636 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T18:22:15.675 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T18:22:15.936 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:22:15.964 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:16.003 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:16.280 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:22:16.296 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:16.338 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:16.574 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:22:16.590 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:16.624 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:17.153 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:22:17.180 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T18:22:17.219 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T18:22:17.549 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:22:17.576 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T18:22:17.599 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:22:17.615 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T18:22:17.615 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:17.649 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:17.969 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:22:17.995 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:22:17.996 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:22:18.011 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:18.027 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:22:18.045 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:18.355 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:22:18.356 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:22:18.383 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T18:22:18.384 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T18:22:18.421 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T18:22:18.422 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T18:22:18.667 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:22:18.684 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:18.725 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:18.750 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T18:22:18.777 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T18:22:18.824 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T18:22:18.995 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:22:19.011 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T18:22:19.053 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:19.228 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:22:19.245 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T18:22:19.278 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T18:22:19.281 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:22:19.308 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:19.339 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:19.581 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:22:19.608 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T18:22:19.647 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T18:22:19.675 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:22:19.703 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T18:22:19.741 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T18:22:19.917 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:22:19.944 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T18:22:19.983 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T18:22:20.080 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:22:20.105 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T18:22:20.146 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T18:22:20.591 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:22:20.619 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:22:20.657 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:22:20.681 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:22:20.708 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../113-radosgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:20.739 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:20.969 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:22:20.997 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T18:22:21.027 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T18:22:21.364 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T18:22:21.392 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T18:22:21.430 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T18:22:21.466 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:22:21.494 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:21.533 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:21.829 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T18:22:21.884 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:22:21.912 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T18:22:21.950 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T18:22:22.079 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T18:22:22.205 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T18:22:22.262 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:22:22.290 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T18:22:22.328 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T18:22:22.444 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T18:22:22.656 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:22:22.672 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T18:22:22.714 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T18:22:22.767 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T18:22:23.224 INFO:teuthology.orchestra.run.smithi087.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T18:22:23.281 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:23.443 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:22:23.471 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../113-radosgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:23.509 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:23.764 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2024-09-13T18:22:23.921 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T18:22:24.205 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T18:22:24.396 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:22:24.413 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T18:22:24.454 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:24.456 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T18:22:24.557 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T18:22:24.766 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T18:22:24.791 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:22:25.025 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T18:22:25.042 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T18:22:25.134 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T18:22:25.177 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T18:22:25.389 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T18:22:25.478 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T18:22:25.722 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T18:22:25.838 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T18:22:26.081 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T18:22:26.180 INFO:teuthology.orchestra.run.smithi053.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T18:22:26.245 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:26.307 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T18:22:26.550 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T18:22:26.801 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T18:22:27.077 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T18:22:27.345 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:27.446 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user cephadm....done 2024-09-13T18:22:27.594 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T18:22:27.605 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T18:22:27.863 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T18:22:27.887 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T18:22:28.131 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T18:22:28.138 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T18:22:28.264 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T18:22:28.365 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T18:22:28.466 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T18:22:28.615 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:22:28.809 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T18:22:28.883 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T18:22:28.935 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T18:22:29.009 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T18:22:29.203 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T18:22:29.335 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T18:22:29.470 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T18:22:29.687 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T18:22:29.780 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T18:22:29.947 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T18:22:30.208 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T18:22:30.432 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T18:22:30.591 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T18:22:30.674 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T18:22:30.792 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T18:22:30.850 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T18:22:30.918 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T18:22:31.109 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T18:22:31.211 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T18:22:31.344 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:31.595 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T18:22:31.596 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T18:22:31.721 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T18:22:31.846 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T18:22:31.989 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T18:22:32.214 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T18:22:32.273 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T18:22:32.399 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T18:22:32.490 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T18:22:32.775 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T18:22:32.917 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T18:22:33.018 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T18:22:33.270 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T18:22:33.393 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T18:22:33.538 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T18:22:33.652 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T18:22:33.778 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:33.864 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T18:22:34.088 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T18:22:34.397 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T18:22:34.582 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T18:22:34.850 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T18:22:34.968 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T18:22:35.086 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T18:22:35.395 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T18:22:35.511 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:22:35.645 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T18:22:35.805 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T18:22:35.913 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T18:22:36.014 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T18:22:36.071 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T18:22:36.115 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T18:22:36.399 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T18:22:36.466 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T18:22:36.650 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T18:22:36.784 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T18:22:36.893 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:22:37.027 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T18:22:37.077 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T18:22:37.154 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T18:22:37.428 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T18:22:37.455 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T18:22:37.679 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T18:22:37.697 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T18:22:37.805 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:37.932 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T18:22:38.107 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T18:22:38.169 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:22:38.409 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T18:22:38.458 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T18:22:38.684 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T18:22:38.844 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T18:22:39.137 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T18:22:39.263 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T18:22:39.547 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T18:22:39.689 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:22:39.823 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T18:22:39.839 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T18:22:40.057 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T18:22:40.124 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T18:22:40.250 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T18:22:40.368 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T18:22:40.442 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T18:22:40.644 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T18:22:40.693 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T18:22:40.828 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T18:22:40.887 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T18:22:41.138 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:22:41.204 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T18:22:41.264 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T18:22:41.390 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T18:22:41.464 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T18:22:41.690 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:22:41.708 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T18:22:41.790 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T18:22:41.951 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T18:22:42.092 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T18:22:42.185 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T18:22:42.393 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T18:22:42.470 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:22:42.669 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T18:22:42.729 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T18:22:42.795 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T18:22:42.997 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T18:22:43.088 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T18:22:43.123 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T18:22:43.347 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T18:22:43.408 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T18:22:43.526 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T18:22:43.581 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T18:22:43.810 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T18:22:43.941 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:22:44.112 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T18:22:44.234 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T18:22:44.371 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T18:22:44.569 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T18:22:44.695 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:44.737 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T18:22:44.821 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:44.982 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T18:22:45.017 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:45.108 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T18:22:45.133 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:45.259 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:45.385 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T18:22:45.493 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T18:22:45.670 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:45.727 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T18:22:45.796 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:45.897 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:45.987 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T18:22:46.096 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:22:46.097 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:22:46.113 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T18:22:46.464 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T18:22:46.581 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:46.682 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:46.782 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T18:22:46.800 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:46.926 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T18:22:47.058 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T18:22:47.159 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T18:22:47.402 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T18:22:47.670 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T18:22:47.929 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T18:22:48.163 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:48.264 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:48.365 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:48.371 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:22:48.474 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:48.600 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:48.674 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T18:22:48.726 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:49.009 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T18:22:49.110 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:49.245 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:49.277 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2024-09-13T18:22:49.456 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:49.562 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2024-09-13T18:22:49.582 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:49.708 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:49.730 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2024-09-13T18:22:49.743 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:22:49.826 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T18:22:49.879 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:22:50.094 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:50.218 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:22:50.220 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:50.346 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:50.568 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:22:50.568 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:22:50.710 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:50.928 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:22:50.928 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:22:51.039 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:51.165 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:51.291 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:51.428 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:51.438 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T18:22:51.554 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:52.006 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:22:52.006 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:22:52.455 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:52.713 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:52.770 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:22:52.839 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:52.965 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:53.091 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:53.217 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:53.232 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:53.326 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:53.455 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:22:53.456 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:22:53.887 INFO:teuthology.orchestra.run.smithi053.stdout:Adding group ceph....done 2024-09-13T18:22:53.917 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:54.133 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:22:54.133 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:22:54.288 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user ceph....done 2024-09-13T18:22:54.457 INFO:teuthology.orchestra.run.smithi053.stdout:Setting system user ceph properties....done 2024-09-13T18:22:54.473 INFO:teuthology.orchestra.run.smithi053.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:22:54.610 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:54.620 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:22:54.873 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:22:54.873 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:22:54.983 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:22:55.354 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:55.461 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:55.463 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:55.597 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:55.689 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:22:55.689 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:22:55.809 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:22:55.809 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:22:56.179 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:56.265 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:56.305 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:56.399 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:56.525 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:56.768 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:56.799 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:22:56.799 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:22:57.121 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T18:22:57.290 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:57.643 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:22:58.109 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:58.263 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T18:22:58.346 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:22:58.347 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:22:58.704 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:22:58.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:22:58.806 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2024-09-13T18:22:58.852 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:59.018 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2024-09-13T18:22:59.019 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2024-09-13T18:22:59.064 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:22:59.064 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:22:59.205 INFO:teuthology.orchestra.run.smithi087.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T18:22:59.205 INFO:teuthology.orchestra.run.smithi087.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T18:22:59.205 INFO:teuthology.orchestra.run.smithi087.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T18:22:59.205 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:22:59.205 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:22:59.205 INFO:teuthology.orchestra.run.smithi087.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:22:59.205 INFO:teuthology.orchestra.run.smithi087.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:22:59.206 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:22:59.206 INFO:teuthology.orchestra.run.smithi087.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:22:59.207 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:22:59.207 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2024-09-13T18:22:59.207 INFO:teuthology.orchestra.run.smithi087.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T18:22:59.207 INFO:teuthology.orchestra.run.smithi087.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T18:22:59.207 INFO:teuthology.orchestra.run.smithi087.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T18:22:59.207 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T18:22:59.208 INFO:teuthology.orchestra.run.smithi087.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:22:59.209 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2024-09-13T18:22:59.209 INFO:teuthology.orchestra.run.smithi087.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T18:22:59.209 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T18:22:59.209 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T18:22:59.251 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2024-09-13T18:22:59.251 INFO:teuthology.orchestra.run.smithi087.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T18:22:59.252 INFO:teuthology.orchestra.run.smithi087.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T18:22:59.252 INFO:teuthology.orchestra.run.smithi087.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T18:22:59.252 INFO:teuthology.orchestra.run.smithi087.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T18:22:59.253 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T18:22:59.253 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T18:22:59.253 INFO:teuthology.orchestra.run.smithi087.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:22:59.254 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2024-09-13T18:22:59.254 INFO:teuthology.orchestra.run.smithi087.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T18:22:59.436 INFO:teuthology.orchestra.run.smithi087.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-13T18:22:59.436 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 55.8 MB of archives. 2024-09-13T18:22:59.437 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T18:22:59.437 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T18:22:59.570 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:22:59.855 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:22:59.855 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:23:00.058 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T18:23:00.074 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T18:23:00.198 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T18:23:00.200 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T18:23:00.201 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T18:23:00.229 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T18:23:00.230 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T18:23:00.234 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T18:23:00.236 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T18:23:00.237 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T18:23:00.240 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T18:23:00.302 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T18:23:00.303 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T18:23:00.303 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T18:23:00.305 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:23:00.384 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T18:23:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:23:00.583 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:23:00.801 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:23:00.801 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:23:01.156 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T18:23:01.160 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T18:23:01.161 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T18:23:01.167 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T18:23:01.168 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T18:23:01.179 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T18:23:01.182 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T18:23:01.199 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T18:23:01.199 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T18:23:01.274 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T18:23:01.285 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T18:23:01.300 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T18:23:01.309 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:23:01.375 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T18:23:01.382 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T18:23:01.383 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T18:23:01.384 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T18:23:01.384 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T18:23:01.416 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T18:23:01.419 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T18:23:01.443 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:23:01.569 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:23:01.722 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T18:23:01.962 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T18:23:01.962 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T18:23:01.963 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T18:23:01.963 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T18:23:01.963 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T18:23:01.964 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T18:23:01.992 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T18:23:01.993 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T18:23:02.092 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T18:23:02.391 INFO:teuthology.orchestra.run.smithi087.stdout:Preconfiguring packages ... 2024-09-13T18:23:02.539 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 55.8 MB in 3s (20.4 MB/s) 2024-09-13T18:23:02.857 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T18:23:02.863 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T18:23:03.018 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T18:23:03.252 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T18:23:03.611 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T18:23:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:23:03.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:23:03.929 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-13T18:23:04.143 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-09-13T18:23:04.144 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-09-13T18:23:04.360 INFO:teuthology.orchestra.run.smithi053.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T18:23:04.360 INFO:teuthology.orchestra.run.smithi053.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:23:04.361 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:23:04.362 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-09-13T18:23:04.362 INFO:teuthology.orchestra.run.smithi053.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T18:23:04.362 INFO:teuthology.orchestra.run.smithi053.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T18:23:04.363 INFO:teuthology.orchestra.run.smithi053.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T18:23:04.363 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T18:23:04.363 INFO:teuthology.orchestra.run.smithi053.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:23:04.364 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-09-13T18:23:04.364 INFO:teuthology.orchestra.run.smithi053.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T18:23:04.364 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T18:23:04.365 INFO:teuthology.orchestra.run.smithi053.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T18:23:04.408 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-09-13T18:23:04.409 INFO:teuthology.orchestra.run.smithi053.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T18:23:04.409 INFO:teuthology.orchestra.run.smithi053.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T18:23:04.410 INFO:teuthology.orchestra.run.smithi053.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T18:23:04.410 INFO:teuthology.orchestra.run.smithi053.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T18:23:04.410 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T18:23:04.410 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T18:23:04.410 INFO:teuthology.orchestra.run.smithi053.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:23:04.411 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2024-09-13T18:23:04.412 INFO:teuthology.orchestra.run.smithi053.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T18:23:04.551 INFO:teuthology.orchestra.run.smithi087.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T18:23:04.593 INFO:teuthology.orchestra.run.smithi053.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-13T18:23:04.593 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 55.8 MB of archives. 2024-09-13T18:23:04.593 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T18:23:04.593 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T18:23:04.789 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package flex. 2024-09-13T18:23:04.878 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T18:23:04.884 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T18:23:04.929 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T18:23:05.213 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T18:23:05.229 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T18:23:05.354 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T18:23:05.354 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T18:23:05.356 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T18:23:05.384 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T18:23:05.385 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T18:23:05.386 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T18:23:05.389 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T18:23:05.392 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T18:23:05.392 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T18:23:05.395 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T18:23:05.457 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T18:23:05.457 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T18:23:05.458 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T18:23:05.538 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T18:23:05.559 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T18:23:05.969 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T18:23:06.324 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T18:23:06.328 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T18:23:06.329 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T18:23:06.336 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T18:23:06.336 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T18:23:06.347 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T18:23:06.351 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T18:23:06.368 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T18:23:06.368 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T18:23:06.429 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T18:23:06.454 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T18:23:06.477 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T18:23:06.479 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T18:23:06.485 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T18:23:06.543 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T18:23:06.549 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T18:23:06.550 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T18:23:06.551 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T18:23:06.552 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T18:23:06.580 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T18:23:06.583 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T18:23:06.616 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T18:23:07.041 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T18:23:07.131 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T18:23:07.131 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T18:23:07.131 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T18:23:07.131 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T18:23:07.132 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T18:23:07.132 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T18:23:07.157 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T18:23:07.163 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T18:23:07.163 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T18:23:07.481 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T18:23:07.594 INFO:teuthology.orchestra.run.smithi053.stdout:Preconfiguring packages ... 2024-09-13T18:23:07.757 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 55.8 MB in 3s (20.3 MB/s) 2024-09-13T18:23:07.839 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package bison. 2024-09-13T18:23:07.940 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T18:23:07.945 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T18:23:07.991 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T18:23:08.084 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T18:23:08.090 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T18:23:08.244 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T18:23:08.392 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:23:08.420 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T18:23:08.458 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T18:23:08.744 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package dump. 2024-09-13T18:23:08.772 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T18:23:08.819 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T18:23:09.001 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T18:23:09.089 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package indent. 2024-09-13T18:23:09.106 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:09.148 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T18:23:09.535 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:23:09.551 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T18:23:09.593 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T18:23:09.880 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:23:09.908 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T18:23:09.955 INFO:teuthology.orchestra.run.smithi053.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T18:23:09.963 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T18:23:10.208 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:23:10.225 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package flex. 2024-09-13T18:23:10.236 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T18:23:10.274 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T18:23:10.330 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173232 files and directories currently installed.) 2024-09-13T18:23:10.336 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T18:23:10.381 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T18:23:10.611 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T18:23:10.639 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T18:23:10.677 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:10.882 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T18:23:10.915 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T18:23:10.931 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T18:23:10.965 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:11.029 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T18:23:11.209 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T18:23:11.225 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T18:23:11.267 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T18:23:11.456 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T18:23:11.579 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T18:23:11.606 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T18:23:11.645 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T18:23:12.026 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T18:23:12.032 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T18:23:12.137 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T18:23:12.555 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T18:23:12.686 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T18:23:13.071 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T18:23:13.315 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:23:13.342 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:23:13.381 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:13.387 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package bison. 2024-09-13T18:23:13.493 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173305 files and directories currently installed.) 2024-09-13T18:23:13.498 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T18:23:13.539 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T18:23:13.625 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:23:13.641 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:23:13.675 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:13.994 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:23:14.022 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T18:23:14.061 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:14.092 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:23:14.120 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T18:23:14.158 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T18:23:14.440 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:23:14.467 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T18:23:14.503 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package dump. 2024-09-13T18:23:14.506 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T18:23:14.531 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T18:23:14.570 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T18:23:14.817 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:23:14.845 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T18:23:14.865 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package indent. 2024-09-13T18:23:14.875 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T18:23:14.882 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:14.924 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T18:23:15.202 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:23:15.211 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:23:15.218 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T18:23:15.239 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:15.260 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T18:23:15.278 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:15.572 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:23:15.600 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T18:23:15.614 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:23:15.639 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T18:23:15.642 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:15.681 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:15.900 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:23:15.917 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T18:23:15.958 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T18:23:15.983 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:23:16.011 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:16.050 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:16.269 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:23:16.296 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T18:23:16.329 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T18:23:16.335 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T18:23:16.357 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T18:23:16.395 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:16.648 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T18:23:16.676 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T18:23:16.715 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:16.881 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:23:16.908 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T18:23:16.951 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T18:23:16.969 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T18:23:17.001 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T18:23:17.074 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T18:23:17.287 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T18:23:17.304 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T18:23:17.346 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T18:23:17.409 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:23:17.436 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T18:23:17.475 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:18.140 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:23:18.167 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T18:23:18.215 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T18:23:18.788 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ppp. 2024-09-13T18:23:18.816 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T18:23:19.049 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:23:19.077 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:23:19.109 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T18:23:19.115 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:19.540 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:23:19.567 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T18:23:19.579 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:23:19.597 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:23:19.603 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T18:23:19.649 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:19.856 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:23:19.884 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T18:23:19.923 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T18:23:19.930 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:23:19.958 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T18:23:19.996 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:20.225 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:23:20.253 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T18:23:20.292 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T18:23:20.570 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T18:23:20.586 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:20.629 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:20.826 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:23:20.855 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T18:23:20.893 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T18:23:21.171 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:23:21.199 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T18:23:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:23:21.229 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T18:23:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T18:23:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:23:21.331 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-common (238) ... 2024-09-13T18:23:21.608 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:23:21.636 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:21.677 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:21.790 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T18:23:21.818 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:21.859 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:22.027 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:23:22.055 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:22.094 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:22.380 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:23:22.396 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:22.430 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:22.724 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:23:22.741 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T18:23:22.782 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T18:23:23.234 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:23:23.251 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T18:23:23.261 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:23:23.278 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T18:23:23.292 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql (14+238) ... 2024-09-13T18:23:23.311 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T18:23:23.536 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:23:23.564 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T18:23:23.602 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T18:23:23.664 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:23:23.693 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T18:23:23.731 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:23.846 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:23:23.862 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T18:23:23.904 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T18:23:24.198 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T18:23:24.215 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T18:23:24.257 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T18:23:24.355 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:23:24.383 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T18:23:24.431 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T18:23:24.517 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package tcl. 2024-09-13T18:23:24.534 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T18:23:24.580 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T18:23:24.912 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:23:24.940 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T18:23:24.978 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T18:23:25.054 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ppp. 2024-09-13T18:23:25.083 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T18:23:25.333 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:23:25.349 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T18:23:25.357 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T18:23:25.390 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T18:23:25.651 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:23:25.668 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T18:23:25.701 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T18:23:25.719 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:23:25.747 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T18:23:25.785 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T18:23:26.063 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T18:23:26.106 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:23:26.134 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T18:23:26.173 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T18:23:26.274 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T18:23:26.400 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T18:23:26.476 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:23:26.504 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T18:23:26.526 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:26.550 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T18:23:26.668 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T18:23:26.803 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T18:23:26.920 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:26.938 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T18:23:26.966 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:27.004 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:27.447 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:23:27.534 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T18:23:27.610 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:23:27.638 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T18:23:27.695 INFO:teuthology.orchestra.run.smithi053.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:23:27.725 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-common (238) ... 2024-09-13T18:23:27.880 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:23:27.880 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:23:28.151 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T18:23:28.179 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T18:23:28.212 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:28.403 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T18:23:28.529 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T18:23:28.655 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T18:23:28.797 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T18:23:28.924 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T18:23:29.049 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:29.175 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T18:23:29.301 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T18:23:29.513 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:23:29.530 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T18:23:29.562 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql (14+238) ... 2024-09-13T18:23:29.798 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:23:29.827 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T18:23:29.873 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T18:23:30.126 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:23:30.155 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T18:23:30.192 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T18:23:30.290 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T18:23:30.416 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T18:23:30.509 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:23:30.520 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T18:23:30.549 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T18:23:30.576 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:30.586 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T18:23:30.702 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T18:23:30.814 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package tcl. 2024-09-13T18:23:30.819 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T18:23:30.831 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T18:23:30.877 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T18:23:30.962 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T18:23:31.063 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T18:23:31.145 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T18:23:31.214 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T18:23:31.225 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:23:31.254 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T18:23:31.293 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T18:23:31.340 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T18:23:31.516 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T18:23:31.642 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:31.663 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:23:31.689 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T18:23:31.729 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T18:23:31.768 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T18:23:31.936 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T18:23:32.041 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:23:32.045 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T18:23:32.058 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T18:23:32.109 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T18:23:32.412 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T18:23:32.480 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:32.480 INFO:teuthology.orchestra.run.smithi087.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:23:32.480 INFO:teuthology.orchestra.run.smithi087.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:23:32.480 INFO:teuthology.orchestra.run.smithi087.stdout:- enp3s0f1 2024-09-13T18:23:32.480 INFO:teuthology.orchestra.run.smithi087.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:23:32.481 INFO:teuthology.orchestra.run.smithi087.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:23:32.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:32.581 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T18:23:32.604 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:23:32.698 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T18:23:32.825 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:32.909 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:23:32.951 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T18:23:33.077 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T18:23:33.203 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:33.227 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:23:33.739 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:33.751 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:23:33.834 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T18:23:33.899 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:34.017 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T18:23:34.134 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-common (238) ... 2024-09-13T18:23:34.224 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:23:34.224 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:23:34.754 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T18:23:34.871 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T18:23:34.964 INFO:teuthology.orchestra.run.smithi087.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:23:34.972 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T18:23:35.090 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T18:23:35.224 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T18:23:35.310 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:35.311 INFO:teuthology.orchestra.run.smithi087.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:23:35.359 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:35.485 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T18:23:35.507 INFO:teuthology.orchestra.run.smithi087.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:23:35.507 INFO:teuthology.orchestra.run.smithi087.stdout:Removing obsolete dictionary files: 2024-09-13T18:23:35.619 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T18:23:36.072 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:23:36.460 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:36.675 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T18:23:36.793 INFO:teuthology.orchestra.run.smithi087.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T18:23:36.801 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T18:23:36.809 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T18:23:36.866 INFO:teuthology.orchestra.run.smithi087.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:23:36.866 INFO:teuthology.orchestra.run.smithi087.stdout:This user must also own the server process. 2024-09-13T18:23:36.866 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:36.866 INFO:teuthology.orchestra.run.smithi087.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout:The default text search configuration will be set to "english". 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout:Data page checksums are disabled. 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout:creating subdirectories ... ok 2024-09-13T18:23:36.867 INFO:teuthology.orchestra.run.smithi087.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:23:36.882 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default max_connections ... 100 2024-09-13T18:23:36.895 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:23:36.904 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:23:36.914 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:23:36.914 INFO:teuthology.orchestra.run.smithi087.stdout:creating configuration files ... ok 2024-09-13T18:23:36.961 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:37.029 INFO:teuthology.orchestra.run.smithi087.stdout:running bootstrap script ... ok 2024-09-13T18:23:37.196 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T18:23:37.322 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T18:23:37.448 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T18:23:37.599 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T18:23:37.676 INFO:teuthology.orchestra.run.smithi087.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:23:37.689 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T18:23:37.768 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T18:23:37.869 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T18:23:38.028 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T18:23:38.154 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:38.280 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T18:23:38.329 INFO:teuthology.orchestra.run.smithi087.stdout:syncing data to disk ... ok 2024-09-13T18:23:38.449 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T18:23:38.574 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T18:23:38.699 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:23:39.057 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:39.057 INFO:teuthology.orchestra.run.smithi053.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:23:39.057 INFO:teuthology.orchestra.run.smithi053.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:23:39.057 INFO:teuthology.orchestra.run.smithi053.stdout:- ens1f0 2024-09-13T18:23:39.057 INFO:teuthology.orchestra.run.smithi053.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:23:39.057 INFO:teuthology.orchestra.run.smithi053.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:23:39.057 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:39.172 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:23:39.482 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:23:39.832 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:23:40.362 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T18:23:41.141 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T18:23:41.141 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T18:23:41.141 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-common (238) ... 2024-09-13T18:23:41.449 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:41.575 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T18:23:41.676 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql (14+238) ... 2024-09-13T18:23:41.733 INFO:teuthology.orchestra.run.smithi053.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:23:41.794 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:41.920 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:41.971 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:41.971 INFO:teuthology.orchestra.run.smithi053.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:23:42.146 INFO:teuthology.orchestra.run.smithi053.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:23:42.146 INFO:teuthology.orchestra.run.smithi053.stdout:Removing obsolete dictionary files: 2024-09-13T18:23:42.175 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:23:42.175 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:23:42.718 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:23:42.747 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T18:23:42.973 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:23:43.125 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T18:23:43.300 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T18:23:43.435 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T18:23:43.449 INFO:teuthology.orchestra.run.smithi053.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T18:23:43.466 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout:This user must also own the server process. 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout:The default text search configuration will be set to "english". 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout:Data page checksums are disabled. 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:43.517 INFO:teuthology.orchestra.run.smithi053.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T18:23:43.518 INFO:teuthology.orchestra.run.smithi053.stdout:creating subdirectories ... ok 2024-09-13T18:23:43.518 INFO:teuthology.orchestra.run.smithi053.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:23:43.530 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default max_connections ... 100 2024-09-13T18:23:43.553 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:23:43.564 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:23:43.564 INFO:teuthology.orchestra.run.smithi053.stdout:creating configuration files ... ok 2024-09-13T18:23:43.682 INFO:teuthology.orchestra.run.smithi053.stdout:running bootstrap script ... ok 2024-09-13T18:23:44.317 INFO:teuthology.orchestra.run.smithi053.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:23:44.796 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T18:23:44.896 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T18:23:45.103 INFO:teuthology.orchestra.run.smithi053.stdout:syncing data to disk ... ok 2024-09-13T18:23:45.481 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:23:45.534 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:23:45.541 DEBUG:teuthology.parallel:result is None 2024-09-13T18:23:48.265 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:48.391 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T18:23:48.500 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql (14+238) ... 2024-09-13T18:23:48.610 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T18:23:48.727 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T18:23:48.988 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:23:48.988 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:23:49.547 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T18:23:49.773 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:23:50.066 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T18:23:50.227 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T18:23:51.629 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T18:23:51.737 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T18:23:52.926 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:23:52.931 DEBUG:teuthology.parallel:result is None 2024-09-13T18:23:52.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:23:53.101 DEBUG:teuthology.orchestra.run.smithi053:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:23:53.120 INFO:teuthology.orchestra.run.smithi053.stdout:18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:23:53.121 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:23:53.121 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1jammy is installed. 2024-09-13T18:23:53.123 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:23:53.271 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:23:53.291 INFO:teuthology.orchestra.run.smithi087.stdout:18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:23:53.291 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T18:23:53.291 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1jammy is installed. 2024-09-13T18:23:53.293 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:23:53.293 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:53.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:23:53.308 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:53.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:23:53.346 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:23:53.346 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:53.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:23:53.363 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:23:53.419 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:53.419 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:23:53.432 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:23:53.485 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:23:53.485 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:53.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:23:53.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:23:53.554 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:53.554 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:23:53.567 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:23:53.620 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:23:53.621 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:53.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:23:53.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:23:53.690 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:53.690 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:23:53.703 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:23:53.757 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:23:53.838 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:23:53.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-09-13T18:23:53.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-09-13T18:23:53.854 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:23:53.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:23:53.896 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:23:53.908 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:23:53.908 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:23:53.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:23:53.969 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:23:53.970 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:23:53.970 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:23:53.970 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:53.970 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:23:54.011 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:23:54.088 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:54.088 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:23:54.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:23:54.175 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:23:54.175 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:23:54.175 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7903972', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBhBGb619GGW+l7GsHUAPRvJlPsadux97l96n0URqcVlzSYXpNQdUcszoYp/dMtrzo1Qabktyo+9ZTtn4PvdRA=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCa3PKakE4Sm5bO1yQrMVqPavRLD6wNyUSkZEbFDZRE1Hz2LeXp9IylwZvbBJv0Ssbf+BNAMslgNbPiTP0nOgUw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:23:54.176 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:23:54.178 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:23:54.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:23:54.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:23:54.274 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:54.274 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:23:54.287 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:23:54.287 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-09-13T18:23:54.335 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:23:54.335 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:54.335 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-13T18:23:54.335 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:54.335 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 18:17:40.246736215 +0000 2024-09-13T18:23:54.336 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 18:17:39.986738537 +0000 2024-09-13T18:23:54.336 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 18:17:39.986738537 +0000 2024-09-13T18:23:54.336 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-13T18:23:54.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:23:54.389 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:23:54.390 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:23:54.390 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000326424 s, 1.6 MB/s 2024-09-13T18:23:54.391 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:23:54.440 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-09-13T18:23:54.486 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:23:54.487 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:54.487 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-13T18:23:54.487 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:54.487 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 18:17:40.802731248 +0000 2024-09-13T18:23:54.487 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 18:17:40.514733821 +0000 2024-09-13T18:23:54.488 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 18:17:40.514733821 +0000 2024-09-13T18:23:54.488 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-13T18:23:54.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:23:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:23:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:23:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000301728 s, 1.7 MB/s 2024-09-13T18:23:54.543 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:23:54.592 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-09-13T18:23:54.638 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:23:54.639 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:54.639 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-13T18:23:54.639 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:54.639 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 18:17:41.038729140 +0000 2024-09-13T18:23:54.639 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 18:17:41.034729176 +0000 2024-09-13T18:23:54.639 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 18:17:41.034729176 +0000 2024-09-13T18:23:54.639 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-13T18:23:54.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:23:54.694 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:23:54.694 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:23:54.694 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000203148 s, 2.5 MB/s 2024-09-13T18:23:54.696 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:23:54.744 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-13 18:17:41.778722531 +0000 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-13 18:17:41.530724746 +0000 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-13 18:17:41.530724746 +0000 2024-09-13T18:23:54.791 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-13T18:23:54.792 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:23:54.845 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:23:54.846 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:23:54.846 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000239776 s, 2.1 MB/s 2024-09-13T18:23:54.847 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:23:54.896 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:23:54.896 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:54.896 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:23:54.902 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:23:54.902 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-09-13T18:23:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:23:54.950 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:54.950 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-13T18:23:54.950 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:54.950 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 18:17:37.012095434 +0000 2024-09-13T18:23:54.951 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 18:17:37.008095470 +0000 2024-09-13T18:23:54.951 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 18:17:37.008095470 +0000 2024-09-13T18:23:54.951 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T18:23:54.951 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:23:55.005 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T18:23:55.005 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T18:23:55.005 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000445828 s, 1.1 MB/s 2024-09-13T18:23:55.006 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:23:55.055 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-09-13T18:23:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:23:55.101 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:55.102 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-13T18:23:55.102 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:55.102 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 18:17:37.776088610 +0000 2024-09-13T18:23:55.102 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 18:17:37.512090968 +0000 2024-09-13T18:23:55.102 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 18:17:37.512090968 +0000 2024-09-13T18:23:55.102 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T18:23:55.102 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:23:55.154 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T18:23:55.154 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T18:23:55.154 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000315038 s, 1.6 MB/s 2024-09-13T18:23:55.156 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:23:55.204 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-09-13T18:23:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:23:55.249 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:55.250 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-13T18:23:55.250 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:55.250 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 18:17:38.252084358 +0000 2024-09-13T18:23:55.250 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 18:17:38.012086502 +0000 2024-09-13T18:23:55.250 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 18:17:38.012086502 +0000 2024-09-13T18:23:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T18:23:55.250 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:23:55.302 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T18:23:55.302 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T18:23:55.303 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000432038 s, 1.2 MB/s 2024-09-13T18:23:55.303 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:23:55.351 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-09-13T18:23:55.397 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:23:55.397 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:55.398 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-09-13T18:23:55.398 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:55.398 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-09-13 18:17:38.788079570 +0000 2024-09-13T18:23:55.398 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-09-13 18:17:38.536081821 +0000 2024-09-13T18:23:55.398 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-09-13 18:17:38.536081821 +0000 2024-09-13T18:23:55.398 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-09-13T18:23:55.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:23:55.450 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-09-13T18:23:55.450 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-09-13T18:23:55.450 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000273366 s, 1.9 MB/s 2024-09-13T18:23:55.451 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:23:55.499 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:23:55.499 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:23:55.499 INFO:tasks.ceph:Generating config... 2024-09-13T18:23:55.501 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:23:55.501 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:23:55.501 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:23:55.501 INFO:tasks.ceph:[client] pid file = 2024-09-13T18:23:55.501 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:23:55.501 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:23:55.501 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:23:55.501 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:23:55.501 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:23:55.501 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:23:55.501 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:23:55.501 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:23:55.501 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:23:55.502 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:23:55.502 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T18:23:55.502 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T18:23:55.502 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:23:55.503 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:23:55.504 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:23:55.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:23:55.538 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:23:55.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:23:55.629 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:23:55.682 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53'), ('mon.b', '172.21.15.87'), ('mon.c', '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]')] 2024-09-13T18:23:55.683 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:23:55.684 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:55.684 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:23:55.732 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --add b 172.21.15.87 --addv c '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:23:55.822 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:23:55.822 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 21cb0879-c92b-403a-9019-7dc078f2eb89 2024-09-13T18:23:55.822 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = pacific 2024-09-13T18:23:55.822 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-09-13T18:23:55.822 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 21cb0879-c92b-403a-9019-7dc078f2eb89 2024-09-13T18:23:55.822 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-09-13T18:23:55.823623+0000 2024-09-13T18:23:55.822 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-09-13T18:23:55.823623+0000 2024-09-13T18:23:55.823 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 16 (pacific) 2024-09-13T18:23:55.823 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-09-13T18:23:55.823 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-09-13T18:23:55.823 INFO:teuthology.orchestra.run.smithi053.stdout:1: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-09-13T18:23:55.823 INFO:teuthology.orchestra.run.smithi053.stdout:2: [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] mon.c 2024-09-13T18:23:55.823 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:23:55.825 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:23:55.837 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 21cb0879-c92b-403a-9019-7dc078f2eb89... 2024-09-13T18:23:55.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:23:55.880 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:23:55.908 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.909 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:23:55.910 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.911 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.53,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 21cb0879-c92b-403a-9019-7dc078f2eb89 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:23:55.912 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.913 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-09-13T18:23:55.914 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-09-13T18:23:55.915 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug finisher = 20 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-09-13T18:23:55.916 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:23:55.917 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on pool no app = False 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-09-13T18:23:55.918 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = "" 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2024-09-13T18:23:55.919 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds balancer = 20 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2024-09-13T18:23:55.920 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-09-13T18:23:55.921 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.922 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:23:55.923 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.53,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 21cb0879-c92b-403a-9019-7dc078f2eb89 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-09-13T18:23:55.925 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = bitmap 2024-09-13T18:23:55.926 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-09-13T18:23:55.927 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug finisher = 20 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-09-13T18:23:55.928 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:23:55.929 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on pool no app = False 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:23:55.930 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = "" 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-09-13T18:23:55.931 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-09-13T18:23:55.932 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-09-13T18:23:55.934 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:23:55.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:23:56.028 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:23:56.028 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:56.028 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:23:56.034 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:56.034 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:23:56.084 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:23:56.084 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:56.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:23:56.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:23:56.149 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:23:56.150 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:23:56.199 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:23:56.199 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:56.199 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:23:56.199 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:23:56.221 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:23:56.222 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:23:56.270 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:23:56.271 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:23:56.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:23:56.316 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:23:56.319 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:23:56.362 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:23:56.377 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:23:56.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:23:56.419 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:23:56.422 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:23:56.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:23:56.563 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:23:56.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:23:56.622 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:23:56.666 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:23:56.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:23:56.724 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:23:56.807 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:23:56.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:23:56.871 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:23:56.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:23:56.908 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:23:56.919 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T18:23:56.995 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T18:23:57.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T18:23:57.041 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T18:23:57.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T18:23:57.123 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T18:23:57.134 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:23:57.134 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:23:57.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:23:57.150 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:23:57.150 INFO:tasks.ceph:role: osd.0 2024-09-13T18:23:57.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:23:57.150 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:23:57.207 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:23:57.208 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:23:57.208 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:23:57.230 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-09-13T18:23:57.233 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-09-13T18:23:57.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:23:57.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:23:57.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:23:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:23:57.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:23:57.403 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:23:57.403 INFO:tasks.ceph:role: osd.1 2024-09-13T18:23:57.403 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:23:57.403 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:23:57.458 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:23:57.458 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:23:57.458 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:23:57.458 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:23:57.458 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:23:57.458 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:23:57.459 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:23:57.459 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:23:57.459 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:23:57.459 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:23:57.482 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-09-13T18:23:57.483 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-09-13T18:23:57.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:23:57.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:23:57.595 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:23:57.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:23:57.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:23:57.650 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:23:57.650 INFO:tasks.ceph:role: osd.2 2024-09-13T18:23:57.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:23:57.651 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:23:57.709 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:23:57.709 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:23:57.709 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:23:57.709 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:23:57.709 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:23:57.709 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:23:57.710 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:23:57.710 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:23:57.710 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:23:57.710 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:23:57.733 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-09-13T18:23:57.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-09-13T18:23:57.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:23:57.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:23:57.847 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:23:57.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:23:57.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:23:57.903 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:23:57.904 INFO:tasks.ceph:role: osd.3 2024-09-13T18:23:57.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:23:57.904 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:23:57.959 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:23:57.960 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:23:57.982 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-09-13T18:23:57.984 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-09-13T18:23:57.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:23:58.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:23:58.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:23:58.096 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:23:58.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:23:58.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:23:58.291+0000 7fc0fc6d57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:23:58.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:23:58.291+0000 7fc0fc6d57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:23:58.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:23:58.291+0000 7fc0fc6d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:23:58.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:23:58.291+0000 7fc0fc6d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:23:58.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:23:58.291+0000 7fc0fc6d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:23:58.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:23:58.291+0000 7fc0fc6d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:24:01.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:24:01.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:01.383+0000 7f31dfb927c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:24:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:01.383+0000 7f31dfb927c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:24:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:01.383+0000 7f31dfb927c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:24:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:01.383+0000 7f31dfb927c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:24:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:01.383+0000 7f31dfb927c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:24:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:01.383+0000 7f31dfb927c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:24:04.363 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:24:04.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:04.503+0000 7f18da4af7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:24:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:04.503+0000 7f18da4af7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:24:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:04.503+0000 7f18da4af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:24:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:04.503+0000 7f18da4af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:24:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:04.503+0000 7f18da4af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:24:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:04.503+0000 7f18da4af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:24:07.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:24:07.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:07.615+0000 7fc0426937c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:24:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:07.615+0000 7fc0426937c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:24:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:07.615+0000 7fc0426937c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:24:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:07.615+0000 7fc0426937c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:24:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:07.615+0000 7fc0426937c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:24:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:07.615+0000 7fc0426937c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:24:10.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:24:10.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:24:10.677 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:24:10.677 INFO:tasks.ceph:role: osd.4 2024-09-13T18:24:10.677 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:24:10.678 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:24:10.741 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:24:10.742 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:24:11.203 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-13T18:24:11.255 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-13T18:24:11.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:24:11.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:24:11.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:24:11.364 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:24:11.364 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:24:11.417 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:24:11.417 INFO:tasks.ceph:role: osd.5 2024-09-13T18:24:11.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:24:11.418 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:24:11.480 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:24:11.481 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:24:11.975 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-13T18:24:11.977 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-13T18:24:11.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:24:12.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:24:12.124 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:24:12.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:24:12.125 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:24:12.180 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:24:12.180 INFO:tasks.ceph:role: osd.6 2024-09-13T18:24:12.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:24:12.181 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:24:12.240 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:24:12.241 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:24:12.242 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:24:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-13T18:24:12.734 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-13T18:24:12.734 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:24:12.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:24:12.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:24:12.893 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:24:12.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:24:12.951 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:24:12.952 INFO:tasks.ceph:role: osd.7 2024-09-13T18:24:12.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:24:12.952 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:24:13.013 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:24:13.013 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:24:13.013 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:24:13.013 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T18:24:13.013 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:24:13.013 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:24:13.014 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:24:13.014 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:24:13.014 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:24:13.014 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:24:13.458 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-09-13T18:24:13.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-09-13T18:24:13.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:24:13.549 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:24:13.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:24:13.559 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:24:13.560 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:13.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:13.657+0000 7ff55bfd77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:24:13.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:13.657+0000 7ff55bfd77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:24:13.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:13.657+0000 7ff55bfd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:24:13.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:13.657+0000 7ff55bfd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:24:13.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:13.657+0000 7ff55bfd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:24:13.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:13.657+0000 7ff55bfd77c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:24:16.658 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:24:16.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:16.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:16.749+0000 7ffb60e817c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:24:16.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:16.749+0000 7ffb60e817c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:24:16.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:16.749+0000 7ffb60e817c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:24:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:16.749+0000 7ffb60e817c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:24:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:16.749+0000 7ffb60e817c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:24:16.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:16.749+0000 7ffb60e817c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:24:19.723 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:24:19.779 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:19.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:19.853+0000 7f07e83207c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:24:19.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:19.853+0000 7f07e83207c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:24:19.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:19.853+0000 7f07e83207c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:24:19.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:19.853+0000 7f07e83207c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:24:19.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:19.853+0000 7f07e83207c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:24:19.861 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:19.853+0000 7f07e83207c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:24:22.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:24:22.898 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:22.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:22.973+0000 7f4b872c67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:24:22.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:22.973+0000 7f4b872c67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:24:22.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:22.973+0000 7f4b872c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:24:22.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:22.973+0000 7f4b872c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:24:22.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:22.973+0000 7f4b872c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:24:22.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:22.973+0000 7f4b872c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:24:24.178 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:24:24.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:24:25.973 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:24:25.987 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:24:25.988 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:25.988 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:24:26.002 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:24:26.058 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:24:26.114 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:24:26.173 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:24:26.230 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:24:26.285 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:24:26.342 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.342 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:24:26.356 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.356 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:24:26.409 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:24:26.465 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.465 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:24:26.522 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:24:26.576 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.576 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:24:26.628 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.629 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:24:26.684 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.684 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:24:26.690 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:26.690 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T18:24:26.739 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.739 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T18:24:26.744 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:26.744 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T18:24:26.794 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:24:26.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:24:26.796 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:24:26.839 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2024-09-13T18:24:26.839 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw== 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA== 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA== 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg== 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw== 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-09-13T18:24:26.840 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg== 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA== 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw== 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw== 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg== 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg== 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2024-09-13T18:24:26.841 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA== 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q== 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg== 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A== 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:[client.2] 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A== 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2024-09-13T18:24:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q== 2024-09-13T18:24:26.843 INFO:teuthology.orchestra.run.smithi053.stdout:[client.3] 2024-09-13T18:24:26.843 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A== 2024-09-13T18:24:26.847 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw== 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA== 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA== 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg== 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw== 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-09-13T18:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg== 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA== 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw== 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw== 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg== 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg== 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA== 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2024-09-13T18:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q== 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg== 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A== 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout:[client.2] 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A== 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q== 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout:[client.3] 2024-09-13T18:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A== 2024-09-13T18:24:26.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:24:26.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:24:26.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:26.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:27.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:27.034 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:27.120 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.208 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.291 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:24:27.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:24:27.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:27.506 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:27.592 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:27.594 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:24:27.640 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.728 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.816 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.899 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:24:27.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:27.983 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:28.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:28.034 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:28.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:28.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:28.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:28.201 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:24:28.289 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:24:28.290 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:24:28.304 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:24:28.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:24:28.408 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:24:28.423 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:24:28.514 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:24:28.526 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:24:28.578 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:24:28.673 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:24:28.685 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:28.688 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:24:28.737 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:24:28.737 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:24:28.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:24:28.739 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:24:28.739 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:24:28.740 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:24:28.782 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:24:28.782 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:24:28.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:24:28.784 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:24:28.785 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:24:28.785 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:24:28.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:24:28.787 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:24:28.787 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:24:28.788 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:24:28.790 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:24:28.790 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:24:28.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:24:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90c02b3640 1 Processor -- start 2024-09-13T18:24:28.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90c02b3640 1 -- start start 2024-09-13T18:24:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90c02b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90c02b3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90c02b3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b80b7db0 con 0x7f90b815c830 2024-09-13T18:24:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90c02b3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b80d3670 con 0x7f90b80d2c80 2024-09-13T18:24:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90c02b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80d0650 con 0x7f90b80ccd10 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90be04f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f90b815c830 0x7f90b80d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37088/0 (socket says 172.21.15.53:37088) 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90be04f640 1 -- 172.21.15.53:0/3843821967 learned_addr learned my addr 172.21.15.53:0/3843821967 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:24:28.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:28.907+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:24:29.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:29.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.111+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:24:29.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:29.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:29.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:29.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:29.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:29.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:24:29.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:29.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:24:29.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:29.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:29.515+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:24:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:24:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:30.319+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:24:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80cd150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:24:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90b80cd150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 msgr2=0x7f90b80d3130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.87:3300/0 conn(0x7f90b80d2c80 0x7f90b80d3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 -- 172.21.15.53:0/3843821967 >> v1:172.21.15.53:6789/0 conn(0x7f90b815c830 legacy=0x7f90b80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 -- 172.21.15.53:0/3843821967 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b80d0c10 con 0x7f909c0036f0 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90affff640 1 -- 172.21.15.53:0/3843821967 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b80d3670 con 0x7f909c007360 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:31.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:31.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.907+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:31.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:31.911+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:24:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.115+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.115+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.115+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.115+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:32.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.115+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:24:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.519+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.519+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.519+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.519+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:32.519+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:24:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:33.323+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:33.323+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:24:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:33.323+0000 7f90bd84e640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:24:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:33.323+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:24:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:33.323+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:24:34.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.203+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197039450 0 0) 0x7f90b80d0c10 con 0x7f909c0036f0 2024-09-13T18:24:34.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.203+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a4003530 con 0x7f909c0036f0 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3387230697 0 0) 0x7f90a4003530 con 0x7f909c0036f0 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 msgr2=0x7f909c009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 --2- 172.21.15.53:0/3843821967 >> v2:172.21.15.53:3300/0 conn(0x7f909c007360 0x7f909c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c00afe0 con 0x7f909c0036f0 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f90b4001700 con 0x7f909c0036f0 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 >> v1:172.21.15.87:6789/0 conn(0x7f909c0036f0 legacy=0x7f909c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be850640 1 -- 172.21.15.53:0/3843821967 reap_dead start 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a40047d0 0x7f90a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80d3670 con 0x7f90a40047d0 2024-09-13T18:24:34.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a4005600 con 0x7f90a40039d0 2024-09-13T18:24:34.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a400bed0 con 0x7f90b80ccd10 2024-09-13T18:24:34.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be04f640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a40047d0 0x7f90a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be850640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be04f640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 msgr2=0x7f90a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:34.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be04f640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be04f640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a40047d0 msgr2=0x7f90a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:34.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be04f640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a40047d0 0x7f90a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90be04f640 1 -- 172.21.15.53:0/3843821967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a4003530 con 0x7f90a40039d0 2024-09-13T18:24:34.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.211+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a40047d0 0x7f90a4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:24:34.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.215+0000 7f90be04f640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90a4003dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c190 tx=0x7f90b401cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668056b1cd779531 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:34.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4005ae0 con 0x7f90a40039d0 2024-09-13T18:24:34.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4005c60 con 0x7f90a40039d0 2024-09-13T18:24:34.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90bd04d640 1 -- 172.21.15.53:0/3843821967 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b40a5890 con 0x7f90a40039d0 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 -- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 msgr2=0x7f90a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90a4003dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c190 tx=0x7f90b401cc20 comp rx=0 tx=0).stop 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 -- 172.21.15.53:0/3843821967 shutdown_connections 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90b80ccd10 0x7f90a400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a40047d0 0x7f90a4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3843821967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90a4003dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 -- 172.21.15.53:0/3843821967 >> 172.21.15.53:0/3843821967 conn(0x7f90b8070970 msgr2=0x7f90b8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 -- 172.21.15.53:0/3843821967 shutdown_connections 2024-09-13T18:24:34.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.219+0000 7f90c02b3640 1 -- 172.21.15.53:0/3843821967 wait complete. 2024-09-13T18:24:34.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 Processor -- start 2024-09-13T18:24:34.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 -- start start 2024-09-13T18:24:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90b814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a40047d0 0x7f90b80b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90b80ccd10 0x7f90b80b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80cc030 con 0x7f90b80ccd10 2024-09-13T18:24:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80cb420 con 0x7f90a40039d0 2024-09-13T18:24:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80cb700 con 0x7f90a40047d0 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90b80ccd10 0x7f90b80b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be04f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90b814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90b80ccd10 0x7f90b80b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43682/0 (socket says 172.21.15.53:43682) 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 -- 172.21.15.53:0/3272169874 learned_addr learned my addr 172.21.15.53:0/3272169874 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a40047d0 0x7f90b80b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 -- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a40047d0 msgr2=0x7f90b80b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a40047d0 0x7f90b80b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 -- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 msgr2=0x7f90b814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90b814df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 -- 172.21.15.53:0/3272169874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b80cb9e0 con 0x7f90b80ccd10 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90bd84e640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a40047d0 0x7f90b80b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:24:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90be850640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90b80ccd10 0x7f90b80b3700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f909c0072d0 tx=0x7f90b0015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90aeffd640 1 -- 172.21.15.53:0/3272169874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00046f0 con 0x7f90b80ccd10 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90aeffd640 1 -- 172.21.15.53:0/3272169874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b000f040 con 0x7f90b80ccd10 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b80cbcc0 con 0x7f90b80ccd10 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90aeffd640 1 -- 172.21.15.53:0/3272169874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0021650 con 0x7f90b80ccd10 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b814e480 con 0x7f90b80ccd10 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90aeffd640 1 -- 172.21.15.53:0/3272169874 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f90b0021ab0 con 0x7f90b80ccd10 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.223+0000 7f90aeffd640 1 -- 172.21.15.53:0/3272169874 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f90b0017e10 con 0x7f90b80ccd10 2024-09-13T18:24:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.227+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b80cc1a0 con 0x7f90b80ccd10 2024-09-13T18:24:34.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.235+0000 7f90aeffd640 1 -- 172.21.15.53:0/3272169874 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f90b001c030 con 0x7f90b80ccd10 2024-09-13T18:24:34.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.299+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f90b80d3130 con 0x7f90b80ccd10 2024-09-13T18:24:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.303+0000 7f90aeffd640 1 -- 172.21.15.53:0/3272169874 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f90b0004870 con 0x7f90b80ccd10 2024-09-13T18:24:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-09-13T18:24:34.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90b80ccd10 msgr2=0x7f90b80b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90b80ccd10 0x7f90b80b3700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f909c0072d0 tx=0x7f90b0015700 comp rx=0 tx=0).stop 2024-09-13T18:24:34.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 shutdown_connections 2024-09-13T18:24:34.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a40047d0 0x7f90b80b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90b80ccd10 0x7f90b80b3700 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 --2- 172.21.15.53:0/3272169874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90a40039d0 0x7f90b814df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 >> 172.21.15.53:0/3272169874 conn(0x7f90b8070970 msgr2=0x7f90b80d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:34.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 shutdown_connections 2024-09-13T18:24:34.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:34.307+0000 7f90c02b3640 1 -- 172.21.15.53:0/3272169874 wait complete. 2024-09-13T18:24:34.325 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:24:34.325 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:24:34.325 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:34.325 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:24:34.338 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:34.340 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:24:34.393 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:34.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:24:34.445 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:24:34.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:24:34.455 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:34.455+0000 7f2691b3b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:24:34.466 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:34.467 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:24:34.479 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:34.480 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:24:34.484 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:34.476+0000 7f3f169a3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:24:34.496 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:34.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:24:34.548 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:24:34.548 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:24:34.601 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 39241a34-8dad-4376-91ca-3af581f83ff2 0 2024-09-13T18:24:34.764 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.756+0000 7fb51b69d640 1 Processor -- start 2024-09-13T18:24:34.765 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.756+0000 7fb51b69d640 1 -- start start 2024-09-13T18:24:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb51b69d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb5141590a0 0x7fb5140b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb51b69d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb514159480 0x7fb5140aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb51b69d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5141599f0 con 0x7fb5140cf8f0 2024-09-13T18:24:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb51b69d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb514159cd0 con 0x7fb514159480 2024-09-13T18:24:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb51b69d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb514159fb0 con 0x7fb5141590a0 2024-09-13T18:24:34.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb519439640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb5141590a0 0x7fb5140b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb519c3a640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb5140cf8f0 0x7fb51415cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46816/0 (socket says 172.21.15.87:46816) 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb519c3a640 1 -- 172.21.15.87:0/3284234270 learned_addr learned my addr 172.21.15.87:0/3284234270 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb518c38640 1 --2- 172.21.15.87:0/3284234270 >> v2:172.21.15.53:3300/0 conn(0x7fb514159480 0x7fb5140aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb519439640 1 -- 172.21.15.87:0/3284234270 >> v2:172.21.15.53:3300/0 conn(0x7fb514159480 msgr2=0x7fb5140aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb519439640 1 --2- 172.21.15.87:0/3284234270 >> v2:172.21.15.53:3300/0 conn(0x7fb514159480 0x7fb5140aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb519439640 1 -- 172.21.15.87:0/3284234270 >> v1:172.21.15.87:6789/0 conn(0x7fb5140cf8f0 legacy=0x7fb51415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb50bfff640 1 -- 172.21.15.87:0/3284234270 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950756672 0 0) 0x7fb5141599f0 con 0x7fb5140cf8f0 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb519439640 1 -- 172.21.15.87:0/3284234270 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51415a290 con 0x7fb5141590a0 2024-09-13T18:24:34.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.760+0000 7fb518c38640 1 --2- 172.21.15.87:0/3284234270 >> v2:172.21.15.53:3300/0 conn(0x7fb514159480 0x7fb5140aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:34.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519439640 1 --2- 172.21.15.87:0/3284234270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5141590a0 0x7fb5140b30a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5140b2390 tx=0x7fb50c01e660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab02ad6d4d87a51c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:34.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb50bfff640 1 -- 172.21.15.87:0/3284234270 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0ac620 con 0x7fb5141590a0 2024-09-13T18:24:34.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb50bfff640 1 -- 172.21.15.87:0/3284234270 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c0ac780 con 0x7fb5141590a0 2024-09-13T18:24:34.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb50bfff640 1 -- 172.21.15.87:0/3284234270 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0acb10 con 0x7fb5141590a0 2024-09-13T18:24:34.770 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- 172.21.15.87:0/3284234270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5141590a0 msgr2=0x7fb5140b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 --2- 172.21.15.87:0/3284234270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5141590a0 0x7fb5140b30a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5140b2390 tx=0x7fb50c01e660 comp rx=0 tx=0).stop 2024-09-13T18:24:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- 172.21.15.87:0/3284234270 shutdown_connections 2024-09-13T18:24:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 --2- 172.21.15.87:0/3284234270 >> v2:172.21.15.53:3300/0 conn(0x7fb514159480 0x7fb5140aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 --2- 172.21.15.87:0/3284234270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5141590a0 0x7fb5140b30a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- 172.21.15.87:0/3284234270 >> 172.21.15.87:0/3284234270 conn(0x7fb51406a120 msgr2=0x7fb51406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- 172.21.15.87:0/3284234270 shutdown_connections 2024-09-13T18:24:34.771 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- 172.21.15.87:0/3284234270 wait complete. 2024-09-13T18:24:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 Processor -- start 2024-09-13T18:24:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- start start 2024-09-13T18:24:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5140cf8f0 0x7fb5140b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5141590a0 0x7fb51414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb514159480 0x7fb51414be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51414efc0 con 0x7fb5140cf8f0 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51414e340 con 0x7fb514159480 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb51b69d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51414e620 con 0x7fb5141590a0 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb514159480 0x7fb51414be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb518c38640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5141590a0 0x7fb51414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb514159480 0x7fb51414be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51582/0 (socket says 172.21.15.87:51582) 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 -- 172.21.15.87:0/3704191242 learned_addr learned my addr 172.21.15.87:0/3704191242 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519439640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5140cf8f0 0x7fb5140b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 -- 172.21.15.87:0/3704191242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5141590a0 msgr2=0x7fb51414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5141590a0 0x7fb51414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 -- 172.21.15.87:0/3704191242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5140cf8f0 msgr2=0x7fb5140b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5140cf8f0 0x7fb5140b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.764+0000 7fb519c3a640 1 -- 172.21.15.87:0/3704191242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c009420 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb519c3a640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb514159480 0x7fb51414be10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb510001570 tx=0x7fb51000cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb509ffb640 1 -- 172.21.15.87:0/3704191242 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000a640 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb509ffb640 1 -- 172.21.15.87:0/3704191242 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51000a7c0 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51414e900 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51414c830 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb509ffb640 1 -- 172.21.15.87:0/3704191242 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000ab30 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb509ffb640 1 -- 172.21.15.87:0/3704191242 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb51000ad50 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb509ffb640 1 -- 172.21.15.87:0/3704191242 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb510012540 con 0x7fb514159480 2024-09-13T18:24:34.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5140b30a0 con 0x7fb514159480 2024-09-13T18:24:34.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.768+0000 7fb509ffb640 1 -- 172.21.15.87:0/3704191242 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb510021060 con 0x7fb514159480 2024-09-13T18:24:34.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.836+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39241a34-8dad-4376-91ca-3af581f83ff2", "id": 0} v 0) v1 -- 0x7fb51406d8b0 con 0x7fb514159480 2024-09-13T18:24:34.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb509ffb640 1 -- 172.21.15.87:0/3704191242 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39241a34-8dad-4376-91ca-3af581f83ff2", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb510018070 con 0x7fb514159480 2024-09-13T18:24:34.851 INFO:teuthology.orchestra.run.smithi087.stdout:0 2024-09-13T18:24:34.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb514159480 msgr2=0x7fb51414be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb514159480 0x7fb51414be10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb510001570 tx=0x7fb51000cca0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 shutdown_connections 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5141590a0 0x7fb51414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb514159480 0x7fb51414be10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 --2- 172.21.15.87:0/3704191242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5140cf8f0 0x7fb5140b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 >> 172.21.15.87:0/3704191242 conn(0x7fb51406a120 msgr2=0x7fb51406cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 shutdown_connections 2024-09-13T18:24:34.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.844+0000 7fb51b69d640 1 -- 172.21.15.87:0/3704191242 wait complete. 2024-09-13T18:24:34.869 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new fd62939e-f82f-4f73-8db2-2c4710fd424f 1 2024-09-13T18:24:34.965 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:34.963+0000 7f2691b3b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:24:34.973 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:34.968+0000 7f3f169a3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:24:34.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.980+0000 7ff44d15f640 1 Processor -- start 2024-09-13T18:24:34.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.980+0000 7ff44d15f640 1 -- start start 2024-09-13T18:24:34.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44d15f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff44815a6c0 0x7ff4480c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44d15f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4480b2c90 0x7ff44806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44d15f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44d15f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44806e3a0 con 0x7ff4480b2c90 2024-09-13T18:24:34.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44d15f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480cf1c0 con 0x7ff44815a6c0 2024-09-13T18:24:34.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44d15f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480cf4a0 con 0x7ff44806df70 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff446d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff44815a6c0 0x7ff4480c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff446d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff44815a6c0 0x7ff4480c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51584/0 (socket says 172.21.15.87:51584) 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:35930/0 (socket says 172.21.15.87:35930) 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff446d9d640 1 -- 172.21.15.87:0/641191635 learned_addr learned my addr 172.21.15.87:0/641191635 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44659c640 1 --2- 172.21.15.87:0/641191635 >> v2:172.21.15.53:3300/0 conn(0x7ff4480b2c90 0x7ff44806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 -- 172.21.15.87:0/641191635 >> v2:172.21.15.87:3300/0 conn(0x7ff44815a6c0 msgr2=0x7ff4480c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 --2- 172.21.15.87:0/641191635 >> v2:172.21.15.87:3300/0 conn(0x7ff44815a6c0 0x7ff4480c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 -- 172.21.15.87:0/641191635 >> v2:172.21.15.53:3300/0 conn(0x7ff4480b2c90 msgr2=0x7ff44806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 --2- 172.21.15.87:0/641191635 >> v2:172.21.15.53:3300/0 conn(0x7ff4480b2c90 0x7ff44806da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 -- 172.21.15.87:0/641191635 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480cf780 con 0x7ff44806df70 2024-09-13T18:24:34.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff44759e640 1 --2- 172.21.15.87:0/641191635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480ccde0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff44806cec0 tx=0x7ff44001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e698048d72497812 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:34.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff445d9b640 1 -- 172.21.15.87:0/641191635 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400a9670 con 0x7ff44806df70 2024-09-13T18:24:34.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff445d9b640 1 -- 172.21.15.87:0/641191635 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4400a97d0 con 0x7ff44806df70 2024-09-13T18:24:34.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.984+0000 7ff445d9b640 1 -- 172.21.15.87:0/641191635 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400a9ba0 con 0x7ff44806df70 2024-09-13T18:24:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- 172.21.15.87:0/641191635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 msgr2=0x7ff4480ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 --2- 172.21.15.87:0/641191635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480ccde0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff44806cec0 tx=0x7ff44001c540 comp rx=0 tx=0).stop 2024-09-13T18:24:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- 172.21.15.87:0/641191635 shutdown_connections 2024-09-13T18:24:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 --2- 172.21.15.87:0/641191635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480ccde0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 --2- 172.21.15.87:0/641191635 >> v2:172.21.15.53:3300/0 conn(0x7ff4480b2c90 0x7ff44806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 --2- 172.21.15.87:0/641191635 >> v2:172.21.15.87:3300/0 conn(0x7ff44815a6c0 0x7ff4480c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- 172.21.15.87:0/641191635 >> 172.21.15.87:0/641191635 conn(0x7ff4480b2170 msgr2=0x7ff4480b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- 172.21.15.87:0/641191635 shutdown_connections 2024-09-13T18:24:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- 172.21.15.87:0/641191635 wait complete. 2024-09-13T18:24:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 Processor -- start 2024-09-13T18:24:34.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- start start 2024-09-13T18:24:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480b2c90 0x7ff4480b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff44815a6c0 0x7ff4481500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448156dd0 con 0x7ff4480b2c90 2024-09-13T18:24:34.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448156850 con 0x7ff44815a6c0 2024-09-13T18:24:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff448158240 con 0x7ff44806df70 2024-09-13T18:24:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:35946/0 (socket says 172.21.15.87:35946) 2024-09-13T18:24:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 -- 172.21.15.87:0/3096079801 learned_addr learned my addr 172.21.15.87:0/3096079801 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44759e640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff44815a6c0 0x7ff4481500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44659c640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480b2c90 0x7ff4480b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:34.998 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 -- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff44815a6c0 msgr2=0x7ff4481500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff44815a6c0 0x7ff4481500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 -- 172.21.15.87:0/3096079801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480b2c90 msgr2=0x7ff4480b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480b2c90 0x7ff4480b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 -- 172.21.15.87:0/3096079801 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009a70 con 0x7ff44806df70 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff446d9d640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480aefe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e7f0 tx=0x7ff43800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff42f7fe640 1 -- 172.21.15.87:0/3096079801 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438009580 con 0x7ff44806df70 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff42f7fe640 1 -- 172.21.15.87:0/3096079801 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800c940 con 0x7ff44806df70 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff42f7fe640 1 -- 172.21.15.87:0/3096079801 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800ccf0 con 0x7ff44806df70 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.988+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4480b0d20 con 0x7ff44806df70 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.992+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff448156af0 con 0x7ff44806df70 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.992+0000 7ff42f7fe640 1 -- 172.21.15.87:0/3096079801 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff438005ca0 con 0x7ff44806df70 2024-09-13T18:24:34.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.992+0000 7ff42f7fe640 1 -- 172.21.15.87:0/3096079801 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff438013820 con 0x7ff44806df70 2024-09-13T18:24:35.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:34.992+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44806da30 con 0x7ff44806df70 2024-09-13T18:24:35.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.000+0000 7ff42f7fe640 1 -- 172.21.15.87:0/3096079801 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff438021060 con 0x7ff44806df70 2024-09-13T18:24:35.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.084+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd62939e-f82f-4f73-8db2-2c4710fd424f", "id": 1} v 0) v1 -- 0x7ff4480b26f0 con 0x7ff44806df70 2024-09-13T18:24:35.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff42f7fe640 1 -- 172.21.15.87:0/3096079801 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd62939e-f82f-4f73-8db2-2c4710fd424f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff438017070 con 0x7ff44806df70 2024-09-13T18:24:35.098 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:24:35.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 msgr2=0x7ff4480aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480aefe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e7f0 tx=0x7ff43800ecb0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 shutdown_connections 2024-09-13T18:24:35.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff44815a6c0 0x7ff4481500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480b2c90 0x7ff4480b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 --2- 172.21.15.87:0/3096079801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff44806df70 0x7ff4480aefe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 >> 172.21.15.87:0/3096079801 conn(0x7ff4480b2170 msgr2=0x7ff4480cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 shutdown_connections 2024-09-13T18:24:35.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.092+0000 7ff44d15f640 1 -- 172.21.15.87:0/3096079801 wait complete. 2024-09-13T18:24:35.116 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new f642b9a8-64f4-4099-beac-c89a8f61e876 2 2024-09-13T18:24:35.193 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:35.184+0000 7f3f169a3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:24:35.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.220+0000 7f720b3b3640 1 Processor -- start 2024-09-13T18:24:35.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.220+0000 7f720b3b3640 1 -- start start 2024-09-13T18:24:35.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.220+0000 7f720b3b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7204066390 0x7f72040b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.220+0000 7f720b3b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f72040ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.220+0000 7f720b3b3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040acf30 con 0x7f7204146150 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.220+0000 7f720b3b3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720406db90 con 0x7f7204066390 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.220+0000 7f720b3b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720406de70 con 0x7f720406d420 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f72040ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f72040ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:35954/0 (socket says 172.21.15.87:35954) 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 -- 172.21.15.87:0/3153017038 learned_addr learned my addr 172.21.15.87:0/3153017038 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720894e640 1 --2- 172.21.15.87:0/3153017038 >> v2:172.21.15.53:3300/0 conn(0x7f7204066390 0x7f72040b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 -- 172.21.15.87:0/3153017038 >> v2:172.21.15.53:3300/0 conn(0x7f7204066390 msgr2=0x7f72040b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 --2- 172.21.15.87:0/3153017038 >> v2:172.21.15.53:3300/0 conn(0x7f7204066390 0x7f72040b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 -- 172.21.15.87:0/3153017038 >> v1:172.21.15.53:6789/0 conn(0x7f7204146150 legacy=0x7f7204065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:35.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 -- 172.21.15.87:0/3153017038 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720406e150 con 0x7f720406d420 2024-09-13T18:24:35.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f7209950640 1 --2- 172.21.15.87:0/3153017038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f72040ad3c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009e50 tx=0x7f71fc01c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66a7760fddd3c085 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f71fbfff640 1 -- 172.21.15.87:0/3153017038 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0a5780 con 0x7f720406d420 2024-09-13T18:24:35.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f71fbfff640 1 -- 172.21.15.87:0/3153017038 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc0a58e0 con 0x7f720406d420 2024-09-13T18:24:35.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f71fbfff640 1 -- 172.21.15.87:0/3153017038 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0a5c70 con 0x7f720406d420 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 -- 172.21.15.87:0/3153017038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 msgr2=0x7f72040ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 --2- 172.21.15.87:0/3153017038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f72040ad3c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009e50 tx=0x7f71fc01c9f0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 -- 172.21.15.87:0/3153017038 shutdown_connections 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 --2- 172.21.15.87:0/3153017038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f72040ad3c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 --2- 172.21.15.87:0/3153017038 >> v2:172.21.15.53:3300/0 conn(0x7f7204066390 0x7f72040b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 -- 172.21.15.87:0/3153017038 >> 172.21.15.87:0/3153017038 conn(0x7f72040b1310 msgr2=0x7f72040b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 -- 172.21.15.87:0/3153017038 shutdown_connections 2024-09-13T18:24:35.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.224+0000 7f720b3b3640 1 -- 172.21.15.87:0/3153017038 wait complete. 2024-09-13T18:24:35.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 Processor -- start 2024-09-13T18:24:35.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 -- start start 2024-09-13T18:24:35.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7204066390 0x7f720415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f720413e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204146150 0x7f72040cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720415f6e0 con 0x7f7204066390 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720413f8f0 con 0x7f7204146150 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720413ece0 con 0x7f720406d420 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204146150 0x7f72040cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720894e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f720413e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204146150 0x7f72040cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51600/0 (socket says 172.21.15.87:51600) 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 -- 172.21.15.87:0/3329328720 learned_addr learned my addr 172.21.15.87:0/3329328720 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720914f640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7204066390 0x7f720415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 -- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 msgr2=0x7f720413e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f720413e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 -- 172.21.15.87:0/3329328720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7204066390 msgr2=0x7f720415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7204066390 0x7f720415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 -- 172.21.15.87:0/3329328720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009b30 con 0x7f7204146150 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720914f640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7204066390 0x7f720415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720894e640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f720413e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f7209950640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204146150 0x7f72040cd410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0af040 tx=0x7f71fc019790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f71f9ffb640 1 -- 172.21.15.87:0/3329328720 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0b8670 con 0x7f7204146150 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f71f9ffb640 1 -- 172.21.15.87:0/3329328720 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc0b87f0 con 0x7f7204146150 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f71f9ffb640 1 -- 172.21.15.87:0/3329328720 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0b8ba0 con 0x7f7204146150 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720413efc0 con 0x7f7204146150 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.228+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720413f580 con 0x7f7204146150 2024-09-13T18:24:35.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.232+0000 7f71f9ffb640 1 -- 172.21.15.87:0/3329328720 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f71fc0039a0 con 0x7f7204146150 2024-09-13T18:24:35.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.232+0000 7f71f9ffb640 1 -- 172.21.15.87:0/3329328720 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f71fc0c2410 con 0x7f7204146150 2024-09-13T18:24:35.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.232+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7204137c90 con 0x7f7204146150 2024-09-13T18:24:35.240 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.232+0000 7f71f9ffb640 1 -- 172.21.15.87:0/3329328720 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7204137c90 con 0x7f7204146150 2024-09-13T18:24:35.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.296+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f642b9a8-64f4-4099-beac-c89a8f61e876", "id": 2} v 0) v1 -- 0x7f720413cd90 con 0x7f7204146150 2024-09-13T18:24:35.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.300+0000 7f71f9ffb640 1 -- 172.21.15.87:0/3329328720 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f642b9a8-64f4-4099-beac-c89a8f61e876", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f71fc004570 con 0x7f7204146150 2024-09-13T18:24:35.309 INFO:teuthology.orchestra.run.smithi087.stdout:2 2024-09-13T18:24:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204146150 msgr2=0x7f72040cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204146150 0x7f72040cd410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0af040 tx=0x7f71fc019790 comp rx=0 tx=0).stop 2024-09-13T18:24:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 shutdown_connections 2024-09-13T18:24:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f720406d420 0x7f720413e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7204146150 0x7f72040cd410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 --2- 172.21.15.87:0/3329328720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7204066390 0x7f720415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 >> 172.21.15.87:0/3329328720 conn(0x7f72040b1310 msgr2=0x7f720413d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 shutdown_connections 2024-09-13T18:24:35.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.304+0000 7f720b3b3640 1 -- 172.21.15.87:0/3329328720 wait complete. 2024-09-13T18:24:35.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 1e31b766-00e6-4bc7-84a5-213d85588afd 3 2024-09-13T18:24:35.345 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:35.343+0000 7f2691b3b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:24:35.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf2de6640 1 Processor -- start 2024-09-13T18:24:35.432 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf2de6640 1 -- start start 2024-09-13T18:24:35.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf2de6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9cec066390 0x7f9cec167350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf2de6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0b39d0 con 0x7f9cec06d4b0 2024-09-13T18:24:35.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf2de6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec06da20 con 0x7f9cec146010 2024-09-13T18:24:35.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf2de6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0acdf0 con 0x7f9cec066390 2024-09-13T18:24:35.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf0b82640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9cec146010 0x7f9cec0b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46828/0 (socket says 172.21.15.87:46828) 2024-09-13T18:24:35.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.424+0000 7f9cf0b82640 1 -- 172.21.15.87:0/2515215474 learned_addr learned my addr 172.21.15.87:0/2515215474 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T18:24:35.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697571217 0 0) 0x7f9cec06da20 con 0x7f9cec146010 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cdc003530 con 0x7f9cec146010 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf1383640 1 --2- 172.21.15.87:0/2515215474 >> v2:172.21.15.53:3300/0 conn(0x7f9cec066390 0x7f9cec167350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1912887863 0 0) 0x7f9cdc003530 con 0x7f9cec146010 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 >> v2:172.21.15.53:3300/0 conn(0x7f9cec066390 msgr2=0x7f9cec167350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 --2- 172.21.15.87:0/2515215474 >> v2:172.21.15.53:3300/0 conn(0x7f9cec066390 0x7f9cec167350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 >> v1:172.21.15.53:6789/0 conn(0x7f9cec06d4b0 legacy=0x7f9cec065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec06dd00 con 0x7f9cec146010 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9ce0001680 con 0x7f9cec146010 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 >> v1:172.21.15.87:6789/0 conn(0x7f9cec146010 legacy=0x7f9cec0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cdc003980 0x7f9cdc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cdc0047d0 0x7f9cdc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc005190 0x7f9cdc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0acdf0 con 0x7f9cdc005190 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc00c0e0 con 0x7f9cdc0047d0 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc00c2a0 con 0x7f9cdc003980 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf0b82640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cdc003980 0x7f9cdc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cdc0047d0 0x7f9cdc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf1383640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc005190 0x7f9cdc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cebfff640 1 -- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cdc003980 msgr2=0x7f9cdc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cdc003980 0x7f9cdc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cebfff640 1 -- 172.21.15.87:0/2515215474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc005190 msgr2=0x7f9cdc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc005190 0x7f9cdc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf1383640 1 -- 172.21.15.87:0/2515215474 reap_dead start 2024-09-13T18:24:35.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cebfff640 1 -- 172.21.15.87:0/2515215474 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc003530 con 0x7f9cdc0047d0 2024-09-13T18:24:35.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cdc0047d0 0x7f9cdc004c50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8001780 tx=0x7f9cd801c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eafcd7834f723ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80052d0 con 0x7f9cdc0047d0 2024-09-13T18:24:35.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80a7050 con 0x7f9cdc0047d0 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9ceb7fe640 1 -- 172.21.15.87:0/2515215474 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8003600 con 0x7f9cdc0047d0 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cdc0047d0 msgr2=0x7f9cdc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf2de6640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cdc0047d0 0x7f9cdc004c50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8001780 tx=0x7f9cd801c400 comp rx=0 tx=0).stop 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2515215474 shutdown_connections 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf2de6640 1 --2- 172.21.15.87:0/2515215474 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cdc0047d0 0x7f9cdc004c50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2515215474 >> 172.21.15.87:0/2515215474 conn(0x7f9cec0b1380 msgr2=0x7f9cec0b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.428+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2515215474 shutdown_connections 2024-09-13T18:24:35.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2515215474 wait complete. 2024-09-13T18:24:35.440 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 Processor -- start 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- start start 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc0047d0 0x7f9cec1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0c5b90 0x7f9cec15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cec0c45f0 0x7f9cec0c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec15fa50 con 0x7f9cdc0047d0 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0c5700 con 0x7f9cec0c5b90 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec1f2f50 con 0x7f9cec0c45f0 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0c5b90 0x7f9cec15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf1383640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cec0c45f0 0x7f9cec0c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0c5b90 0x7f9cec15c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51608/0 (socket says 172.21.15.87:51608) 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 -- 172.21.15.87:0/2240316602 learned_addr learned my addr 172.21.15.87:0/2240316602 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf0b82640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc0047d0 0x7f9cec1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 -- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cec0c45f0 msgr2=0x7f9cec0c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cec0c45f0 0x7f9cec0c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 -- 172.21.15.87:0/2240316602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc0047d0 msgr2=0x7f9cec1f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc0047d0 0x7f9cec1f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 -- 172.21.15.87:0/2240316602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0c4af0 con 0x7f9cec0c5b90 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf1383640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cec0c45f0 0x7f9cec0c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cebfff640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0c5b90 0x7f9cec15c0c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9cd801c230 tx=0x7f9cdc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2240316602 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8007500 con 0x7f9cec0c5b90 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2240316602 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd8007660 con 0x7f9cec0c5b90 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec0c4dd0 con 0x7f9cec0c5b90 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2240316602 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8006a00 con 0x7f9cec0c5b90 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec0c5390 con 0x7f9cec0c5b90 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2240316602 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9cd8003600 con 0x7f9cec0c5b90 2024-09-13T18:24:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2240316602 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f9cd80bf8f0 con 0x7f9cec0c5b90 2024-09-13T18:24:35.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.432+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec0c58b0 con 0x7f9cec0c5b90 2024-09-13T18:24:35.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.436+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2240316602 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f9cd80013a0 con 0x7f9cec0c5b90 2024-09-13T18:24:35.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.500+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e31b766-00e6-4bc7-84a5-213d85588afd", "id": 3} v 0) v1 -- 0x7f9cec066010 con 0x7f9cec0c5b90 2024-09-13T18:24:35.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9ce97fa640 1 -- 172.21.15.87:0/2240316602 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e31b766-00e6-4bc7-84a5-213d85588afd", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9cd80bf460 con 0x7f9cec0c5b90 2024-09-13T18:24:35.514 INFO:teuthology.orchestra.run.smithi087.stdout:3 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0c5b90 msgr2=0x7f9cec15c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0c5b90 0x7f9cec15c0c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9cd801c230 tx=0x7f9cdc005800 comp rx=0 tx=0).stop 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 shutdown_connections 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cec0c45f0 0x7f9cec0c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cec0c5b90 0x7f9cec15c0c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 --2- 172.21.15.87:0/2240316602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cdc0047d0 0x7f9cec1f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 >> 172.21.15.87:0/2240316602 conn(0x7f9cec0b1380 msgr2=0x7f9cec0af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 shutdown_connections 2024-09-13T18:24:35.515 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.508+0000 7f9cf2de6640 1 -- 172.21.15.87:0/2240316602 wait complete. 2024-09-13T18:24:35.529 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new fa6d18b2-7162-473a-bc00-a4afa0ec5d68 4 2024-09-13T18:24:35.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b2b8e640 1 Processor -- start 2024-09-13T18:24:35.637 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b2b8e640 1 -- start start 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b2b8e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24ac0b2c90 0x7f24ac06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b2b8e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac06e380 con 0x7f24ac15a6c0 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b2b8e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0cf1c0 con 0x7f24ac06df70 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b2b8e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac0cf4a0 con 0x7f24ac0b2c90 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24abfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24ac0b2c90 0x7f24ac06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b112b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f24ac06df70 0x7f24ac0c57c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47458/0 (socket says 172.21.15.87:47458) 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24b112b640 1 -- 172.21.15.87:0/4130614821 learned_addr learned my addr 172.21.15.87:0/4130614821 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24abfff640 1 -- 172.21.15.87:0/4130614821 >> v1:172.21.15.87:6789/0 conn(0x7f24ac06df70 legacy=0x7f24ac0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24abfff640 1 -- 172.21.15.87:0/4130614821 >> v1:172.21.15.53:6789/0 conn(0x7f24ac15a6c0 legacy=0x7f24ac0c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24abfff640 1 -- 172.21.15.87:0/4130614821 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0cf780 con 0x7f24ac0b2c90 2024-09-13T18:24:35.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.632+0000 7f24ab7fe640 1 -- 172.21.15.87:0/4130614821 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519545686 0 0) 0x7f24ac0cf1c0 con 0x7f24ac06df70 2024-09-13T18:24:35.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24abfff640 1 --2- 172.21.15.87:0/4130614821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac0b2c90 0x7f24ac06da30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f24940097c0 tx=0x7f249401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64ea01fceaaa783e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.641 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24ab7fe640 1 -- 172.21.15.87:0/4130614821 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940ab600 con 0x7f24ac0b2c90 2024-09-13T18:24:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24ab7fe640 1 -- 172.21.15.87:0/4130614821 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940a7050 con 0x7f24ac0b2c90 2024-09-13T18:24:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24ab7fe640 1 -- 172.21.15.87:0/4130614821 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940ab980 con 0x7f24ac0b2c90 2024-09-13T18:24:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- 172.21.15.87:0/4130614821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac0b2c90 msgr2=0x7f24ac06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 --2- 172.21.15.87:0/4130614821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac0b2c90 0x7f24ac06da30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f24940097c0 tx=0x7f249401c310 comp rx=0 tx=0).stop 2024-09-13T18:24:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- 172.21.15.87:0/4130614821 shutdown_connections 2024-09-13T18:24:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 --2- 172.21.15.87:0/4130614821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac0b2c90 0x7f24ac06da30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- 172.21.15.87:0/4130614821 >> 172.21.15.87:0/4130614821 conn(0x7f24ac0b2170 msgr2=0x7f24ac0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- 172.21.15.87:0/4130614821 shutdown_connections 2024-09-13T18:24:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- 172.21.15.87:0/4130614821 wait complete. 2024-09-13T18:24:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 Processor -- start 2024-09-13T18:24:35.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- start start 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24ac06df70 0x7f24ac0aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24ac0b2c90 0x7f24ac1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac15a6c0 0x7f24ac1630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac164e00 con 0x7f24ac0b2c90 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac1625d0 con 0x7f24ac15a6c0 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b2b8e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac1628b0 con 0x7f24ac06df70 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b112b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac15a6c0 0x7f24ac1630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b092a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24ac06df70 0x7f24ac0aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b112b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac15a6c0 0x7f24ac1630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56296/0 (socket says 172.21.15.87:56296) 2024-09-13T18:24:35.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.636+0000 7f24b112b640 1 -- 172.21.15.87:0/2949839282 learned_addr learned my addr 172.21.15.87:0/2949839282 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24abfff640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24ac0b2c90 0x7f24ac1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b112b640 1 -- 172.21.15.87:0/2949839282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24ac06df70 msgr2=0x7f24ac0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b112b640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24ac06df70 0x7f24ac0aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b112b640 1 -- 172.21.15.87:0/2949839282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24ac0b2c90 msgr2=0x7f24ac1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b112b640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24ac0b2c90 0x7f24ac1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b112b640 1 -- 172.21.15.87:0/2949839282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009420 con 0x7f24ac15a6c0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b112b640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac15a6c0 0x7f24ac1630b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c780 tx=0x7f24a400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24a97fa640 1 -- 172.21.15.87:0/2949839282 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400ce90 con 0x7f24ac15a6c0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24a97fa640 1 -- 172.21.15.87:0/2949839282 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a400a640 con 0x7f24ac15a6c0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac162b90 con 0x7f24ac15a6c0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24a97fa640 1 -- 172.21.15.87:0/2949839282 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400a9d0 con 0x7f24ac15a6c0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac0af450 con 0x7f24ac15a6c0 2024-09-13T18:24:35.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24a97fa640 1 -- 172.21.15.87:0/2949839282 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f24a40070d0 con 0x7f24ac15a6c0 2024-09-13T18:24:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24a97fa640 1 -- 172.21.15.87:0/2949839282 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f24a4012910 con 0x7f24ac15a6c0 2024-09-13T18:24:35.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.640+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac06da30 con 0x7f24ac15a6c0 2024-09-13T18:24:35.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.644+0000 7f24a97fa640 1 -- 172.21.15.87:0/2949839282 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f24a4018070 con 0x7f24ac15a6c0 2024-09-13T18:24:35.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.712+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa6d18b2-7162-473a-bc00-a4afa0ec5d68", "id": 4} v 0) v1 -- 0x7f24ac162d80 con 0x7f24ac15a6c0 2024-09-13T18:24:35.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.716+0000 7f24a97fa640 1 -- 172.21.15.87:0/2949839282 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa6d18b2-7162-473a-bc00-a4afa0ec5d68", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24a4012c10 con 0x7f24ac15a6c0 2024-09-13T18:24:35.724 INFO:teuthology.orchestra.run.smithi087.stdout:4 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac15a6c0 msgr2=0x7f24ac1630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac15a6c0 0x7f24ac1630b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c780 tx=0x7f24a400cc40 comp rx=0 tx=0).stop 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 shutdown_connections 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac15a6c0 0x7f24ac1630b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24ac0b2c90 0x7f24ac1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 --2- 172.21.15.87:0/2949839282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24ac06df70 0x7f24ac0aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 >> 172.21.15.87:0/2949839282 conn(0x7f24ac0b2170 msgr2=0x7f24ac0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 shutdown_connections 2024-09-13T18:24:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.720+0000 7f24b2b8e640 1 -- 172.21.15.87:0/2949839282 wait complete. 2024-09-13T18:24:35.741 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 9580adcc-abf7-47c1-96f8-e75a689d958d 5 2024-09-13T18:24:35.768 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:35.760+0000 7f3f169a3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:24:35.823 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:35.816+0000 7f3f169a3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:24:35.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019a2a1640 1 Processor -- start 2024-09-13T18:24:35.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019a2a1640 1 -- start start 2024-09-13T18:24:35.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019a2a1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f019415c750 0x7f019406e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019a2a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01940cbbb0 0x7f019415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019a2a1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0194071560 con 0x7f019406bbc0 2024-09-13T18:24:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019a2a1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0194071840 con 0x7f019415c750 2024-09-13T18:24:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019a2a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0194071b20 con 0x7f01940cbbb0 2024-09-13T18:24:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019883e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01940cbbb0 0x7f019415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f0193fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f019415c750 0x7f019406e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f018bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f019406bbc0 0x7f01940cb4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47474/0 (socket says 172.21.15.87:47474) 2024-09-13T18:24:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019883e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01940cbbb0 0x7f019415d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:48038/0 (socket says 172.21.15.87:48038) 2024-09-13T18:24:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f018bfff640 1 -- 172.21.15.87:0/2575673717 learned_addr learned my addr 172.21.15.87:0/2575673717 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T18:24:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f0193fff640 1 --2- 172.21.15.87:0/2575673717 >> v2:172.21.15.87:3300/0 conn(0x7f019415c750 0x7f019406e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56300/0 (socket says 172.21.15.87:56300) 2024-09-13T18:24:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f0193fff640 1 -- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01940cbbb0 msgr2=0x7f019415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f0193fff640 1 --2- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01940cbbb0 0x7f019415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f0193fff640 1 -- 172.21.15.87:0/2575673717 >> v1:172.21.15.87:6789/0 conn(0x7f019406bbc0 legacy=0x7f01940cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f0193fff640 1 -- 172.21.15.87:0/2575673717 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194071e00 con 0x7f019415c750 2024-09-13T18:24:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f019883e640 1 --2- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01940cbbb0 0x7f019415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:24:35.860 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.848+0000 7f01937fe640 1 -- 172.21.15.87:0/2575673717 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075503715 0 0) 0x7f0194071560 con 0x7f019406bbc0 2024-09-13T18:24:35.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f0193fff640 1 --2- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019415c750 0x7f019406e080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f01840097c0 tx=0x7f018401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b420feb673e3ca36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f01937fe640 1 -- 172.21.15.87:0/2575673717 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01840aa620 con 0x7f019415c750 2024-09-13T18:24:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f01937fe640 1 -- 172.21.15.87:0/2575673717 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01840aa780 con 0x7f019415c750 2024-09-13T18:24:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f01937fe640 1 -- 172.21.15.87:0/2575673717 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01840aab10 con 0x7f019415c750 2024-09-13T18:24:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 -- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019415c750 msgr2=0x7f019406e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 --2- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019415c750 0x7f019406e080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f01840097c0 tx=0x7f018401c460 comp rx=0 tx=0).stop 2024-09-13T18:24:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 -- 172.21.15.87:0/2575673717 shutdown_connections 2024-09-13T18:24:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 --2- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01940cbbb0 0x7f019415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 --2- 172.21.15.87:0/2575673717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019415c750 0x7f019406e080 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 -- 172.21.15.87:0/2575673717 >> 172.21.15.87:0/2575673717 conn(0x7f01940ceb80 msgr2=0x7f01940cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 -- 172.21.15.87:0/2575673717 shutdown_connections 2024-09-13T18:24:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 -- 172.21.15.87:0/2575673717 wait complete. 2024-09-13T18:24:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 Processor -- start 2024-09-13T18:24:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.852+0000 7f019a2a1640 1 -- start start 2024-09-13T18:24:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019406bbc0 0x7f01941418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01940cbbb0 0x7f01941599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f019415c750 0x7f0194153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01941424e0 con 0x7f019406bbc0 2024-09-13T18:24:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194141e20 con 0x7f01940cbbb0 2024-09-13T18:24:35.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01941421b0 con 0x7f019415c750 2024-09-13T18:24:35.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01940cbbb0 0x7f01941599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019883e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f019415c750 0x7f0194153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01940cbbb0 0x7f01941599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56316/0 (socket says 172.21.15.87:56316) 2024-09-13T18:24:35.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019883e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f019415c750 0x7f0194153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:48050/0 (socket says 172.21.15.87:48050) 2024-09-13T18:24:35.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 -- 172.21.15.87:0/2906728608 learned_addr learned my addr 172.21.15.87:0/2906728608 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:35.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f0193fff640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019406bbc0 0x7f01941418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:35.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 -- 172.21.15.87:0/2906728608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f019415c750 msgr2=0x7f0194153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f019415c750 0x7f0194153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 -- 172.21.15.87:0/2906728608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019406bbc0 msgr2=0x7f01941418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.872 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019406bbc0 0x7f01941418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 -- 172.21.15.87:0/2906728608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009a70 con 0x7f01940cbbb0 2024-09-13T18:24:35.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f018bfff640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01940cbbb0 0x7f01941599a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f017c0011f0 tx=0x7f017c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:35.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f01917fa640 1 -- 172.21.15.87:0/2906728608 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0074e0 con 0x7f01940cbbb0 2024-09-13T18:24:35.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f01917fa640 1 -- 172.21.15.87:0/2906728608 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c007640 con 0x7f01940cbbb0 2024-09-13T18:24:35.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0184009420 con 0x7f01940cbbb0 2024-09-13T18:24:35.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f01917fa640 1 -- 172.21.15.87:0/2906728608 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0049f0 con 0x7f01940cbbb0 2024-09-13T18:24:35.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0194151ea0 con 0x7f01940cbbb0 2024-09-13T18:24:35.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f01917fa640 1 -- 172.21.15.87:0/2906728608 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f017c01d3f0 con 0x7f01940cbbb0 2024-09-13T18:24:35.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f01917fa640 1 -- 172.21.15.87:0/2906728608 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f017c013940 con 0x7f01940cbbb0 2024-09-13T18:24:35.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.856+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0194142010 con 0x7f01940cbbb0 2024-09-13T18:24:35.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.860+0000 7f01917fa640 1 -- 172.21.15.87:0/2906728608 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0194142010 con 0x7f01940cbbb0 2024-09-13T18:24:35.878 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:35.872+0000 7f3f169a3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:24:35.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.924+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9580adcc-abf7-47c1-96f8-e75a689d958d", "id": 5} v 0) v1 -- 0x7f019415d1b0 con 0x7f01940cbbb0 2024-09-13T18:24:35.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f01917fa640 1 -- 172.21.15.87:0/2906728608 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9580adcc-abf7-47c1-96f8-e75a689d958d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f017c013de0 con 0x7f01940cbbb0 2024-09-13T18:24:35.935 INFO:teuthology.orchestra.run.smithi087.stdout:5 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01940cbbb0 msgr2=0x7f01941599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01940cbbb0 0x7f01941599a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f017c0011f0 tx=0x7f017c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 shutdown_connections 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f019415c750 0x7f0194153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01940cbbb0 0x7f01941599a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 --2- 172.21.15.87:0/2906728608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019406bbc0 0x7f01941418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 >> 172.21.15.87:0/2906728608 conn(0x7f01940ceb80 msgr2=0x7f0194143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:35.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 shutdown_connections 2024-09-13T18:24:35.938 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:35.928+0000 7f019a2a1640 1 -- 172.21.15.87:0/2906728608 wait complete. 2024-09-13T18:24:35.951 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 78e61f4b-6f58-4b3a-af88-3e81bc0ff09f 6 2024-09-13T18:24:35.957 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:35.952+0000 7f3f169a3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:24:35.966 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:35.967+0000 7f2691b3b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:24:36.011 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:36.004+0000 7f3f169a3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:24:36.026 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.027+0000 7f2691b3b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:24:36.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.056+0000 7fa450bf1640 1 Processor -- start 2024-09-13T18:24:36.065 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.056+0000 7fa450bf1640 1 -- start start 2024-09-13T18:24:36.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa450bf1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa44c0b2c90 0x7fa44c06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa450bf1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c06e380 con 0x7fa44c06df70 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa450bf1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c0cf1c0 con 0x7fa44c15a6c0 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa450bf1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c0cf4a0 con 0x7fa44c0b2c90 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa44c15a6c0 0x7fa44c0c6e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:47482/0 (socket says 172.21.15.87:47482) 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 -- 172.21.15.87:0/4059829497 learned_addr learned my addr 172.21.15.87:0/4059829497 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898772622 0 0) 0x7fa44c0cf1c0 con 0x7fa44c15a6c0 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa434003530 con 0x7fa44c15a6c0 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa449d9b640 1 --2- 172.21.15.87:0/4059829497 >> v2:172.21.15.53:3300/0 conn(0x7fa44c0b2c90 0x7fa44c06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2954561624 0 0) 0x7fa434003530 con 0x7fa44c15a6c0 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 >> v2:172.21.15.53:3300/0 conn(0x7fa44c0b2c90 msgr2=0x7fa44c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:36.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 --2- 172.21.15.87:0/4059829497 >> v2:172.21.15.53:3300/0 conn(0x7fa44c0b2c90 0x7fa44c06da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 >> v1:172.21.15.53:6789/0 conn(0x7fa44c06df70 legacy=0x7fa44c0c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c0cf780 con 0x7fa44c15a6c0 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa43c001680 con 0x7fa44c15a6c0 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 >> v1:172.21.15.87:6789/0 conn(0x7fa44c15a6c0 legacy=0x7fa44c0c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa434003980 0x7fa434003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340047d0 0x7fa434004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434005390 0x7fa43400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0cf4a0 con 0x7fa434005390 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43400c220 con 0x7fa434003980 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43400c3e0 con 0x7fa4340047d0 2024-09-13T18:24:36.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa434003980 0x7fa434003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa449d9b640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340047d0 0x7fa434004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44ad9d640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434005390 0x7fa43400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 -- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340047d0 msgr2=0x7fa434004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4340047d0 0x7fa434004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 -- 172.21.15.87:0/4059829497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434005390 msgr2=0x7fa43400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434005390 0x7fa43400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 -- 172.21.15.87:0/4059829497 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434003530 con 0x7fa434003980 2024-09-13T18:24:36.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44ad9d640 1 -- 172.21.15.87:0/4059829497 reap_dead start 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44a59c640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa434003980 0x7fa434003da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c240 tx=0x7fa43c01cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6c3c8b1844ea710 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c005ae0 con 0x7fa434003980 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c005c40 con 0x7fa434003980 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.060+0000 7fa44959a640 1 -- 172.21.15.87:0/4059829497 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0a5a60 con 0x7fa434003980 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa434003980 msgr2=0x7fa434003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa434003980 0x7fa434003da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c240 tx=0x7fa43c01cc30 comp rx=0 tx=0).stop 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- 172.21.15.87:0/4059829497 shutdown_connections 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 --2- 172.21.15.87:0/4059829497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa434003980 0x7fa434003da0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- 172.21.15.87:0/4059829497 >> 172.21.15.87:0/4059829497 conn(0x7fa44c0b2170 msgr2=0x7fa44c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- 172.21.15.87:0/4059829497 shutdown_connections 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- 172.21.15.87:0/4059829497 wait complete. 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 Processor -- start 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- start start 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434003980 0x7fa44c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c0b3470 0x7fa44c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa44c140f70 0x7fa44c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c156380 con 0x7fa434003980 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c157580 con 0x7fa44c0b3470 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c156190 con 0x7fa44c140f70 2024-09-13T18:24:36.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c0b3470 0x7fa44c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa44ad9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa44c140f70 0x7fa44c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c0b3470 0x7fa44c155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56330/0 (socket says 172.21.15.87:56330) 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa44ad9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa44c140f70 0x7fa44c0d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:48080/0 (socket says 172.21.15.87:48080) 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 -- 172.21.15.87:0/1821812234 learned_addr learned my addr 172.21.15.87:0/1821812234 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa44a59c640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434003980 0x7fa44c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 -- 172.21.15.87:0/1821812234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa44c140f70 msgr2=0x7fa44c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa44c140f70 0x7fa44c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 -- 172.21.15.87:0/1821812234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434003980 msgr2=0x7fa44c157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434003980 0x7fa44c157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 -- 172.21.15.87:0/1821812234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c152f30 con 0x7fa44c0b3470 2024-09-13T18:24:36.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa449d9b640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c0b3470 0x7fa44c155c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa44000b720 tx=0x7fa44000bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa43affd640 1 -- 172.21.15.87:0/1821812234 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440010830 con 0x7fa44c0b3470 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c153210 con 0x7fa44c0b3470 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa43affd640 1 -- 172.21.15.87:0/1821812234 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440010990 con 0x7fa44c0b3470 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa43affd640 1 -- 172.21.15.87:0/1821812234 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440010d20 con 0x7fa44c0b3470 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c1537d0 con 0x7fa44c0b3470 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa43affd640 1 -- 172.21.15.87:0/1821812234 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa44001d750 con 0x7fa44c0b3470 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.064+0000 7fa43affd640 1 -- 172.21.15.87:0/1821812234 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa440014b10 con 0x7fa44c0b3470 2024-09-13T18:24:36.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.068+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c0cd5f0 con 0x7fa44c0b3470 2024-09-13T18:24:36.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.068+0000 7fa43affd640 1 -- 172.21.15.87:0/1821812234 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa44003ce30 con 0x7fa44c0b3470 2024-09-13T18:24:36.083 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.083+0000 7f2691b3b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:24:36.092 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:36.084+0000 7f3f169a3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:24:36.139 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.132+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "78e61f4b-6f58-4b3a-af88-3e81bc0ff09f", "id": 6} v 0) v1 -- 0x7fa44c074100 con 0x7fa44c0b3470 2024-09-13T18:24:36.144 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:36.136+0000 7f3f169a3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:24:36.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa43affd640 1 -- 172.21.15.87:0/1821812234 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "78e61f4b-6f58-4b3a-af88-3e81bc0ff09f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa44002b030 con 0x7fa44c0b3470 2024-09-13T18:24:36.145 INFO:teuthology.orchestra.run.smithi087.stdout:6 2024-09-13T18:24:36.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c0b3470 msgr2=0x7fa44c155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c0b3470 0x7fa44c155c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa44000b720 tx=0x7fa44000bbe0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 shutdown_connections 2024-09-13T18:24:36.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa44c140f70 0x7fa44c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa44c0b3470 0x7fa44c155c50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 --2- 172.21.15.87:0/1821812234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa434003980 0x7fa44c157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 >> 172.21.15.87:0/1821812234 conn(0x7fa44c0b2170 msgr2=0x7fa44c0ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:36.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 shutdown_connections 2024-09-13T18:24:36.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.140+0000 7fa450bf1640 1 -- 172.21.15.87:0/1821812234 wait complete. 2024-09-13T18:24:36.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new c798335c-3ff3-4bdb-afbb-13d9c08bf549 7 2024-09-13T18:24:36.165 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.163+0000 7f2691b3b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:24:36.221 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.219+0000 7f2691b3b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:24:36.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ec1a53640 1 Processor -- start 2024-09-13T18:24:36.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ec1a53640 1 -- start start 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ec1a53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ebc15a6d0 0x7f4ebc072d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ec1a53640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ec1a53640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc0713f0 con 0x7f4ebc0cd5a0 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ec1a53640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc0cc040 con 0x7f4ebc15a6d0 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ec1a53640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc071f90 con 0x7f4ebc0cb670 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebb7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebb7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc0cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:48090/0 (socket says 172.21.15.87:48090) 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebb7fe640 1 -- 172.21.15.87:0/3041579580 learned_addr learned my addr 172.21.15.87:0/3041579580 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebaffd640 1 --2- 172.21.15.87:0/3041579580 >> v2:172.21.15.53:3300/0 conn(0x7f4ebc15a6d0 0x7f4ebc072d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebb7fe640 1 -- 172.21.15.87:0/3041579580 >> v2:172.21.15.53:3300/0 conn(0x7f4ebc15a6d0 msgr2=0x7f4ebc072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebb7fe640 1 --2- 172.21.15.87:0/3041579580 >> v2:172.21.15.53:3300/0 conn(0x7f4ebc15a6d0 0x7f4ebc072d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebb7fe640 1 -- 172.21.15.87:0/3041579580 >> v1:172.21.15.53:6789/0 conn(0x7f4ebc0cd5a0 legacy=0x7f4ebc071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:36.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.264+0000 7f4ebb7fe640 1 -- 172.21.15.87:0/3041579580 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc15aab0 con 0x7f4ebc0cb670 2024-09-13T18:24:36.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ebb7fe640 1 --2- 172.21.15.87:0/3041579580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc0cbb00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009e50 tx=0x7f4eb401c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=372530ce78ba830e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:36.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4eb9ffb640 1 -- 172.21.15.87:0/3041579580 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40a5760 con 0x7f4ebc0cb670 2024-09-13T18:24:36.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4eb9ffb640 1 -- 172.21.15.87:0/3041579580 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb40a58c0 con 0x7f4ebc0cb670 2024-09-13T18:24:36.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4eb9ffb640 1 -- 172.21.15.87:0/3041579580 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40a5c50 con 0x7f4ebc0cb670 2024-09-13T18:24:36.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 -- 172.21.15.87:0/3041579580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 msgr2=0x7f4ebc0cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 --2- 172.21.15.87:0/3041579580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc0cbb00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009e50 tx=0x7f4eb401c9f0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 -- 172.21.15.87:0/3041579580 shutdown_connections 2024-09-13T18:24:36.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 --2- 172.21.15.87:0/3041579580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc0cbb00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 --2- 172.21.15.87:0/3041579580 >> v2:172.21.15.53:3300/0 conn(0x7f4ebc15a6d0 0x7f4ebc072d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.276 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 -- 172.21.15.87:0/3041579580 >> 172.21.15.87:0/3041579580 conn(0x7f4ebc0b0a30 msgr2=0x7f4ebc0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:36.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 -- 172.21.15.87:0/3041579580 shutdown_connections 2024-09-13T18:24:36.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.268+0000 7f4ec1a53640 1 -- 172.21.15.87:0/3041579580 wait complete. 2024-09-13T18:24:36.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 Processor -- start 2024-09-13T18:24:36.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 -- start start 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc099e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ebc0cd5a0 0x7f4ebc158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ebc15a6d0 0x7f4ebc158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc15b420 con 0x7f4ebc15a6d0 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc158520 con 0x7f4ebc0cd5a0 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc15b140 con 0x7f4ebc0cb670 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:48092/0 (socket says 172.21.15.87:48092) 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 -- 172.21.15.87:0/2086668250 learned_addr learned my addr 172.21.15.87:0/2086668250 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-09-13T18:24:36.280 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4eba7fc640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ebc0cd5a0 0x7f4ebc158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebb7fe640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ebc15a6d0 0x7f4ebc158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 -- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ebc0cd5a0 msgr2=0x7f4ebc158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ebc0cd5a0 0x7f4ebc158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 -- 172.21.15.87:0/2086668250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ebc15a6d0 msgr2=0x7f4ebc158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ebc15a6d0 0x7f4ebc158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 -- 172.21.15.87:0/2086668250 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4009b30 con 0x7f4ebc0cb670 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebb7fe640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ebc15a6d0 0x7f4ebc158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ebaffd640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc099e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00d620 tx=0x7f4eac00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4eb3fff640 1 -- 172.21.15.87:0/2086668250 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00b620 con 0x7f4ebc0cb670 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4eb3fff640 1 -- 172.21.15.87:0/2086668250 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00b780 con 0x7f4ebc0cb670 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ebc157e60 con 0x7f4ebc0cb670 2024-09-13T18:24:36.281 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4eb3fff640 1 -- 172.21.15.87:0/2086668250 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00bb10 con 0x7f4ebc0cb670 2024-09-13T18:24:36.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc149980 con 0x7f4ebc0cb670 2024-09-13T18:24:36.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4eb3fff640 1 -- 172.21.15.87:0/2086668250 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4eac01e460 con 0x7f4ebc0cb670 2024-09-13T18:24:36.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4eb3fff640 1 -- 172.21.15.87:0/2086668250 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4eac014b30 con 0x7f4ebc0cb670 2024-09-13T18:24:36.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.272+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ebc157cc0 con 0x7f4ebc0cb670 2024-09-13T18:24:36.282 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.276+0000 7f4eb3fff640 1 -- 172.21.15.87:0/2086668250 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4ebc157cc0 con 0x7f4ebc0cb670 2024-09-13T18:24:36.301 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.299+0000 7f2691b3b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:24:36.302 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:36.296+0000 7f3f169a3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:24:36.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.344+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c798335c-3ff3-4bdb-afbb-13d9c08bf549", "id": 7} v 0) v1 -- 0x7f4ebc0cbb00 con 0x7f4ebc0cb670 2024-09-13T18:24:36.355 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.355+0000 7f2691b3b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:24:36.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.348+0000 7f4eb3fff640 1 -- 172.21.15.87:0/2086668250 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c798335c-3ff3-4bdb-afbb-13d9c08bf549", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4eac0144d0 con 0x7f4ebc0cb670 2024-09-13T18:24:36.356 INFO:teuthology.orchestra.run.smithi087.stdout:7 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 msgr2=0x7f4ebc099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc099e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00d620 tx=0x7f4eac00dae0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 shutdown_connections 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ebc15a6d0 0x7f4ebc158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ebc0cd5a0 0x7f4ebc158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 --2- 172.21.15.87:0/2086668250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ebc0cb670 0x7f4ebc099e40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 >> 172.21.15.87:0/2086668250 conn(0x7f4ebc0b0a30 msgr2=0x7f4ebc149eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 shutdown_connections 2024-09-13T18:24:36.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-09-13T18:24:36.352+0000 7f4ec1a53640 1 -- 172.21.15.87:0/2086668250 wait complete. 2024-09-13T18:24:36.364 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:36.356+0000 7f3f169a3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:24:36.373 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:24:36.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:24:36.376 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:24:36.376 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:24:36.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:24:36.379 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:24:36.379 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:24:36.379 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:24:36.382 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:24:36.382 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:24:36.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:24:36.384 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:24:36.385 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:24:36.385 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:24:36.387 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:24:36.387 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:24:36.387 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:24:36.389 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:24:36.389 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:24:36.389 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:24:36.391 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:24:36.391 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:24:36.391 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:24:36.393 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:24:36.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:36.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e8436640 1 Processor -- start 2024-09-13T18:24:36.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e8436640 1 -- start start 2024-09-13T18:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e8436640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e015c980 0x7fd2e006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e8436640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd2e006a660 0x7fd2e0070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e8436640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e015cd60 con 0x7fd2e006d550 2024-09-13T18:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e8436640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e006d1a0 con 0x7fd2e006a660 2024-09-13T18:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e8436640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00cccd0 con 0x7fd2e015c980 2024-09-13T18:24:36.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e61d2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e015c980 0x7fd2e006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e69d3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd2e006a660 0x7fd2e0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e61d2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e015c980 0x7fd2e006cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:39614/0 (socket says 172.21.15.53:39614) 2024-09-13T18:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.519+0000 7fd2e61d2640 1 -- 172.21.15.53:0/700621431 learned_addr learned my addr 172.21.15.53:0/700621431 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e61d2640 1 -- 172.21.15.53:0/700621431 >> v2:172.21.15.87:3300/0 conn(0x7fd2e006a660 msgr2=0x7fd2e0070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e61d2640 1 --2- 172.21.15.53:0/700621431 >> v2:172.21.15.87:3300/0 conn(0x7fd2e006a660 0x7fd2e0070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e61d2640 1 -- 172.21.15.53:0/700621431 >> v1:172.21.15.87:6789/0 conn(0x7fd2e006d550 legacy=0x7fd2e0069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e61d2640 1 -- 172.21.15.53:0/700621431 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00ccfb0 con 0x7fd2e015c980 2024-09-13T18:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e61d2640 1 --2- 172.21.15.53:0/700621431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e015c980 0x7fd2e006cc60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009870 tx=0x7fd2d001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a4142b81c383bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e51d0640 1 -- 172.21.15.53:0/700621431 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00ab660 con 0x7fd2e015c980 2024-09-13T18:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e51d0640 1 -- 172.21.15.53:0/700621431 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00ab7c0 con 0x7fd2e015c980 2024-09-13T18:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e51d0640 1 -- 172.21.15.53:0/700621431 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00abb50 con 0x7fd2e015c980 2024-09-13T18:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 -- 172.21.15.53:0/700621431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e015c980 msgr2=0x7fd2e006cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 --2- 172.21.15.53:0/700621431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e015c980 0x7fd2e006cc60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009870 tx=0x7fd2d001c440 comp rx=0 tx=0).stop 2024-09-13T18:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 -- 172.21.15.53:0/700621431 shutdown_connections 2024-09-13T18:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 --2- 172.21.15.53:0/700621431 >> v2:172.21.15.87:3300/0 conn(0x7fd2e006a660 0x7fd2e0070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 --2- 172.21.15.53:0/700621431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e015c980 0x7fd2e006cc60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 -- 172.21.15.53:0/700621431 >> 172.21.15.53:0/700621431 conn(0x7fd2e00b0a30 msgr2=0x7fd2e00b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 -- 172.21.15.53:0/700621431 shutdown_connections 2024-09-13T18:24:36.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.523+0000 7fd2e8436640 1 -- 172.21.15.53:0/700621431 wait complete. 2024-09-13T18:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 Processor -- start 2024-09-13T18:24:36.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 -- start start 2024-09-13T18:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e006a660 0x7fd2e00ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e006d550 0x7fd2e006c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2e015c980 0x7fd2e015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:36.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e015b190 con 0x7fd2e006d550 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e015abd0 con 0x7fd2e015c980 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e015aeb0 con 0x7fd2e006a660 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e006d550 0x7fd2e006c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e006d550 0x7fd2e006c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43710/0 (socket says 172.21.15.53:43710) 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 -- 172.21.15.53:0/429703450 learned_addr learned my addr 172.21.15.53:0/429703450 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e61d2640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e006a660 0x7fd2e00ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e69d3640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2e015c980 0x7fd2e015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 -- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e006a660 msgr2=0x7fd2e00ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e006a660 0x7fd2e00ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 -- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2e015c980 msgr2=0x7fd2e015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2e015c980 0x7fd2e015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 -- 172.21.15.53:0/429703450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00094d0 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e59d1640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e006d550 0x7fd2e006c450 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c450 tx=0x7fd2dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2d6ffd640 1 -- 172.21.15.53:0/429703450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0052d0 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2d6ffd640 1 -- 172.21.15.53:0/429703450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc005430 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e014e8f0 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2d6ffd640 1 -- 172.21.15.53:0/429703450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc003890 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e014ff70 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2d6ffd640 1 -- 172.21.15.53:0/429703450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd2dc003cf0 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2d6ffd640 1 -- 172.21.15.53:0/429703450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd2dc01bad0 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.527+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e0070310 con 0x7fd2e006d550 2024-09-13T18:24:36.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.531+0000 7fd2d6ffd640 1 -- 172.21.15.53:0/429703450 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd2dc01b400 con 0x7fd2e006d550 2024-09-13T18:24:36.539 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.539+0000 7f2691b3b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:24:36.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.587+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2e00cc1e0 con 0x7fd2e006d550 2024-09-13T18:24:36.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.587+0000 7fd2d6ffd640 1 -- 172.21.15.53:0/429703450 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd2dc02a090 con 0x7fd2e006d550 2024-09-13T18:24:36.589 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:36.589 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:36.352339+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e006d550 msgr2=0x7fd2e006c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e006d550 0x7fd2e006c450 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c450 tx=0x7fd2dc00c910 comp rx=0 tx=0).stop 2024-09-13T18:24:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 shutdown_connections 2024-09-13T18:24:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd2e015c980 0x7fd2e015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e006d550 0x7fd2e006c450 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 --2- 172.21.15.53:0/429703450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2e006a660 0x7fd2e00ac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:36.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 >> 172.21.15.53:0/429703450 conn(0x7fd2e00b0a30 msgr2=0x7fd2e00b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:36.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 shutdown_connections 2024-09-13T18:24:36.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:36.591+0000 7fd2e8436640 1 -- 172.21.15.53:0/429703450 wait complete. 2024-09-13T18:24:36.602 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:36.603+0000 7f2691b3b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:24:36.606 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:24:36.606 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:24:36.990 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-09-13T18:24:36.984+0000 7feb7485d7c0 -1 Falling back to public interface 2024-09-13T18:24:37.002 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-09-13T18:24:37.003+0000 7fee42ce17c0 -1 Falling back to public interface 2024-09-13T18:24:37.003 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-09-13T18:24:36.996+0000 7effc7c887c0 -1 Falling back to public interface 2024-09-13T18:24:37.005 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-13T18:24:37.000+0000 7f2d080867c0 -1 Falling back to public interface 2024-09-13T18:24:37.018 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-09-13T18:24:37.019+0000 7f8e5c2007c0 -1 Falling back to public interface 2024-09-13T18:24:37.025 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-09-13T18:24:37.020+0000 7fdaa47447c0 -1 Falling back to public interface 2024-09-13T18:24:37.034 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T18:24:37.035+0000 7f4faf9bb7c0 -1 Falling back to public interface 2024-09-13T18:24:37.035 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-09-13T18:24:37.035+0000 7fdefa8d97c0 -1 Falling back to public interface 2024-09-13T18:24:37.035 INFO:tasks.ceph.mgr.x.smithi087.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T18:24:37.036 INFO:tasks.ceph.mgr.x.smithi087.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T18:24:37.036 INFO:tasks.ceph.mgr.x.smithi087.stderr: from numpy import show_config as show_numpy_config 2024-09-13T18:24:37.085 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:37.080+0000 7f3f169a3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:24:37.220 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:37.212+0000 7f3f169a3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:24:37.229 INFO:tasks.ceph.mgr.y.smithi053.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T18:24:37.229 INFO:tasks.ceph.mgr.y.smithi053.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T18:24:37.230 INFO:tasks.ceph.mgr.y.smithi053.stderr: from numpy import show_config as show_numpy_config 2024-09-13T18:24:37.287 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:37.287+0000 7f2691b3b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:24:37.382 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:37.376+0000 7f3f169a3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:24:37.413 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:37.445 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:37.436+0000 7f3f169a3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:24:37.456 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:37.455+0000 7f2691b3b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:24:37.526 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879f3a0640 1 Processor -- start 2024-09-13T18:24:37.526 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879f3a0640 1 -- start start 2024-09-13T18:24:37.527 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879f3a0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8798160320 0x7f8798160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879f3a0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8798160ee0 0x7f8798072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879f3a0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879806bc90 con 0x7f87980ccb80 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879f3a0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980b2e90 con 0x7f8798160ee0 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879f3a0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8798160c40 con 0x7f8798160320 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879c93b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8798160ee0 0x7f8798072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879d93d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f87980ccb80 0x7f87980ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59306/0 (socket says 172.21.15.53:59306) 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879c93b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8798160ee0 0x7f8798072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39802/0 (socket says 172.21.15.53:39802) 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879d93d640 1 -- 172.21.15.53:0/905701819 learned_addr learned my addr 172.21.15.53:0/905701819 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879d13c640 1 --2- 172.21.15.53:0/905701819 >> v2:172.21.15.87:3300/0 conn(0x7f8798160320 0x7f8798160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879c93b640 1 -- 172.21.15.53:0/905701819 >> v2:172.21.15.87:3300/0 conn(0x7f8798160320 msgr2=0x7f8798160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879c93b640 1 --2- 172.21.15.53:0/905701819 >> v2:172.21.15.87:3300/0 conn(0x7f8798160320 0x7f8798160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.528 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879c93b640 1 -- 172.21.15.53:0/905701819 >> v1:172.21.15.53:6789/0 conn(0x7f87980ccb80 legacy=0x7f87980ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:37.529 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f878ffff640 1 -- 172.21.15.53:0/905701819 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699888200 0 0) 0x7f879806bc90 con 0x7f87980ccb80 2024-09-13T18:24:37.529 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.527+0000 7f879c93b640 1 -- 172.21.15.53:0/905701819 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87980b3080 con 0x7f8798160ee0 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 --2- 172.21.15.53:0/905701819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160ee0 0x7f8798072ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f879806af60 tx=0x7f878801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd2405101b36bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f878ffff640 1 -- 172.21.15.53:0/905701819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880ab650 con 0x7f8798160ee0 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f878ffff640 1 -- 172.21.15.53:0/905701819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880ab7b0 con 0x7f8798160ee0 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f878ffff640 1 -- 172.21.15.53:0/905701819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880abb40 con 0x7f8798160ee0 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- 172.21.15.53:0/905701819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160ee0 msgr2=0x7f8798072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 --2- 172.21.15.53:0/905701819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160ee0 0x7f8798072ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f879806af60 tx=0x7f878801c450 comp rx=0 tx=0).stop 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- 172.21.15.53:0/905701819 shutdown_connections 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 --2- 172.21.15.53:0/905701819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160ee0 0x7f8798072ff0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 --2- 172.21.15.53:0/905701819 >> v2:172.21.15.87:3300/0 conn(0x7f8798160320 0x7f8798160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- 172.21.15.53:0/905701819 >> 172.21.15.53:0/905701819 conn(0x7f87980b0a30 msgr2=0x7f87980b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:37.531 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- 172.21.15.53:0/905701819 shutdown_connections 2024-09-13T18:24:37.532 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- 172.21.15.53:0/905701819 wait complete. 2024-09-13T18:24:37.534 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 Processor -- start 2024-09-13T18:24:37.534 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- start start 2024-09-13T18:24:37.534 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87980ccb80 0x7f8798151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:37.534 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160320 0x7f87980ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8798160ee0 0x7f8798150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87980705d0 con 0x7f8798160320 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798070d00 con 0x7f8798160ee0 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879f3a0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87980ac970 con 0x7f87980ccb80 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160320 0x7f87980ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160320 0x7f87980ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39804/0 (socket says 172.21.15.53:39804) 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 -- 172.21.15.53:0/2056590912 learned_addr learned my addr 172.21.15.53:0/2056590912 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879d93d640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8798160ee0 0x7f8798150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879d13c640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87980ccb80 0x7f8798151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 -- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87980ccb80 msgr2=0x7f8798151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87980ccb80 0x7f8798151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 -- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8798160ee0 msgr2=0x7f8798150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:37.535 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8798160ee0 0x7f8798150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.531+0000 7f879c93b640 1 -- 172.21.15.53:0/2056590912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788009420 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f879c93b640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160320 0x7f87980ac000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8788019060 tx=0x7f878801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f878dffb640 1 -- 172.21.15.53:0/2056590912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880b5810 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f878dffb640 1 -- 172.21.15.53:0/2056590912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880b5990 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87980acc50 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f878dffb640 1 -- 172.21.15.53:0/2056590912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880b5d40 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87980b05c0 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f878dffb640 1 -- 172.21.15.53:0/2056590912 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f87880bf710 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f878dffb640 1 -- 172.21.15.53:0/2056590912 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f87880b4b50 con 0x7f8798160320 2024-09-13T18:24:37.536 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87980ace40 con 0x7f8798160320 2024-09-13T18:24:37.537 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.535+0000 7f878dffb640 1 -- 172.21.15.53:0/2056590912 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f87980ace40 con 0x7f8798160320 2024-09-13T18:24:37.576 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:37.568+0000 7f3f169a3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:24:37.593 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8798160700 con 0x7f8798160320 2024-09-13T18:24:37.594 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f878dffb640 1 -- 172.21.15.53:0/2056590912 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f87880d0090 con 0x7f8798160320 2024-09-13T18:24:37.594 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-13T18:24:37.594 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":10,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:36.352339+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160320 msgr2=0x7f87980ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160320 0x7f87980ac000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8788019060 tx=0x7f878801ac90 comp rx=0 tx=0).stop 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 shutdown_connections 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8798160ee0 0x7f8798150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8798160320 0x7f87980ac000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 --2- 172.21.15.53:0/2056590912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87980ccb80 0x7f8798151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 >> 172.21.15.53:0/2056590912 conn(0x7f87980b0a30 msgr2=0x7f87980ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 shutdown_connections 2024-09-13T18:24:37.596 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:37.595+0000 7f879f3a0640 1 -- 172.21.15.53:0/2056590912 wait complete. 2024-09-13T18:24:37.610 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:24:37.615 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:37.615+0000 7f2691b3b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:24:37.684 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:37.683+0000 7f2691b3b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:24:37.833 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:37.831+0000 7f2691b3b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:24:38.187 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:38.180+0000 7f3f169a3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:24:38.263 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:38.256+0000 7f3f169a3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:24:38.444 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:38.436+0000 7f3f169a3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:24:38.479 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:38.479+0000 7f2691b3b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:24:38.515 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:38.508+0000 7f3f169a3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:24:38.557 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:38.555+0000 7f2691b3b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:24:38.745 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:38.743+0000 7f2691b3b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:24:38.803 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:38.796+0000 7f3f169a3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:24:38.821 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:38.819+0000 7f2691b3b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:24:38.865 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:38.856+0000 7f3f169a3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:24:39.132 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:39.131+0000 7f2691b3b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:24:39.196 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:24:39.195+0000 7f2691b3b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:24:39.914 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:39.908+0000 7f3ebde59640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:24:39.914 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:24:39.908+0000 7f3ebde59640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:24:40.732 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-09-13T18:24:40.731+0000 7fee42ce17c0 -1 osd.1 0 log_to_monitors true 2024-09-13T18:24:40.844 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-09-13T18:24:40.843+0000 7fdefa8d97c0 -1 osd.2 0 log_to_monitors true 2024-09-13T18:24:40.852 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T18:24:40.851+0000 7f4faf9bb7c0 -1 osd.0 0 log_to_monitors true 2024-09-13T18:24:40.855 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-09-13T18:24:40.848+0000 7feb7485d7c0 -1 osd.7 0 log_to_monitors true 2024-09-13T18:24:40.859 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-09-13T18:24:40.859+0000 7f8e5c2007c0 -1 osd.3 0 log_to_monitors true 2024-09-13T18:24:40.861 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-09-13T18:24:40.856+0000 7effc7c887c0 -1 osd.5 0 log_to_monitors true 2024-09-13T18:24:40.880 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-13T18:24:40.872+0000 7f2d080867c0 -1 osd.4 0 log_to_monitors true 2024-09-13T18:24:40.956 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-09-13T18:24:40.948+0000 7fdaa47447c0 -1 osd.6 0 log_to_monitors true 2024-09-13T18:24:43.806 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-09-13T18:24:43.807+0000 7f8e57982640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:24:43.830 INFO:tasks.ceph.osd.3.smithi053.stderr:2024-09-13T18:24:43.831+0000 7f8e4ffc7640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:43.837 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-09-13T18:24:43.835+0000 7fdef605b640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:24:43.842 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T18:24:43.843+0000 7f4fab13d640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:24:43.866 INFO:tasks.ceph.osd.2.smithi053.stderr:2024-09-13T18:24:43.867+0000 7fdeee6a0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:43.867 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-09-13T18:24:43.867+0000 7f4fa3782640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:43.879 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-09-13T18:24:43.879+0000 7fee3fc9e640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:24:43.907 INFO:tasks.ceph.osd.1.smithi053.stderr:2024-09-13T18:24:43.907+0000 7fee36aa8640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:44.417 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:44.441 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-09-13T18:24:44.436+0000 7effc340a640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:24:44.448 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-09-13T18:24:44.440+0000 7fda9fec6640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:24:44.451 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-13T18:24:44.444+0000 7f2d03808640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:24:44.465 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-09-13T18:24:44.460+0000 7effbba4f640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:44.473 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-09-13T18:24:44.468+0000 7f2cfbe4d640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:44.474 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-09-13T18:24:44.468+0000 7fda9850b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:44.479 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-09-13T18:24:44.472+0000 7feb7181a640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:24:44.518 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-09-13T18:24:44.512+0000 7feb68624640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:44.542 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7faded211640 1 Processor -- start 2024-09-13T18:24:44.542 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7faded211640 1 -- start start 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7faded211640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fade8070440 0x7fade8070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7faded211640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 0x7fade815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7faded211640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade80cc270 con 0x7fade815af10 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7faded211640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade815a860 con 0x7fade8070440 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7faded211640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade8070d60 con 0x7fade815daf0 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade759e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fade815af10 0x7fade8159790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59314/0 (socket says 172.21.15.53:59314) 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade759e640 1 -- 172.21.15.53:0/2229169102 learned_addr learned my addr 172.21.15.53:0/2229169102 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:44.546 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade659c640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 0x7fade815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2229169102 >> v2:172.21.15.87:3300/0 conn(0x7fade8070440 0x7fade8070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644710238 0 0) 0x7fade80cc270 con 0x7fade815af10 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd4003530 con 0x7fade815af10 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3048839449 0 0) 0x7fadd4003530 con 0x7fade815af10 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 msgr2=0x7fade815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 0x7fade815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 >> v2:172.21.15.87:3300/0 conn(0x7fade8070440 msgr2=0x7fade8070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 --2- 172.21.15.53:0/2229169102 >> v2:172.21.15.87:3300/0 conn(0x7fade8070440 0x7fade8070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade815a2a0 con 0x7fade815af10 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fade0001680 con 0x7fade815af10 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 >> v1:172.21.15.53:6789/0 conn(0x7fade815af10 legacy=0x7fade8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadd4003980 0x7fadd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.547 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 0x7fadd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadd4004d10 0x7fadd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade815a860 con 0x7fadd4003980 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade8070d60 con 0x7fadd4004d10 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd400b990 con 0x7fade815daf0 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadd4003980 0x7fadd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade759e640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadd4004d10 0x7fadd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade659c640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 0x7fadd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade6d9d640 1 -- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 msgr2=0x7fadd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:44.548 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 0x7fadd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.549 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade6d9d640 1 -- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadd4004d10 msgr2=0x7fadd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:44.549 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadd4004d10 0x7fadd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.549 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade6d9d640 1 -- 172.21.15.53:0/2229169102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4003530 con 0x7fadd4003980 2024-09-13T18:24:44.549 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.543+0000 7fade659c640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fade815daf0 0x7fadd40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadd4003980 0x7fadd4003da0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009fc0 tx=0x7fadd801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce4771962fd2b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80a5b90 con 0x7fadd4003980 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800f040 con 0x7fadd4003980 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7fade5d9b640 1 -- 172.21.15.53:0/2229169102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80ad440 con 0x7fadd4003980 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 -- 172.21.15.53:0/2229169102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadd4003980 msgr2=0x7fadd4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 --2- 172.21.15.53:0/2229169102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadd4003980 0x7fadd4003da0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009fc0 tx=0x7fadd801cc90 comp rx=0 tx=0).stop 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7fade759e640 1 -- 172.21.15.53:0/2229169102 reap_dead start 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 -- 172.21.15.53:0/2229169102 shutdown_connections 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 -- 172.21.15.53:0/2229169102 >> 172.21.15.53:0/2229169102 conn(0x7fade80b0200 msgr2=0x7fade80b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:44.552 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 -- 172.21.15.53:0/2229169102 shutdown_connections 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 -- 172.21.15.53:0/2229169102 wait complete. 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 Processor -- start 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.547+0000 7faded211640 1 -- start start 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadd4003980 0x7fade813f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fade813d770 0x7fade80aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fade80af530 0x7fade8155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80af9e0 con 0x7fade813d770 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade8140660 con 0x7fade80af530 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade813fa50 con 0x7fadd4003980 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fade813d770 0x7fade80aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fade813d770 0x7fade80aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39860/0 (socket says 172.21.15.53:39860) 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 -- 172.21.15.53:0/2694416888 learned_addr learned my addr 172.21.15.53:0/2694416888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:44.553 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadd4003980 0x7fade813f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade759e640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fade80af530 0x7fade8155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 -- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadd4003980 msgr2=0x7fade813f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadd4003980 0x7fade813f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 -- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fade80af530 msgr2=0x7fade8155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fade80af530 0x7fade8155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 -- 172.21.15.53:0/2694416888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade813fd30 con 0x7fade813d770 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadd4003980 0x7fade813f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade659c640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fade813d770 0x7fade80aeff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009fd0 tx=0x7fadd0011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faddf7fe640 1 -- 172.21.15.53:0/2694416888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004220 con 0x7fade813d770 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faddf7fe640 1 -- 172.21.15.53:0/2694416888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd0004380 con 0x7fade813d770 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade8140010 con 0x7fade813d770 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faddf7fe640 1 -- 172.21.15.53:0/2694416888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0015890 con 0x7fade813d770 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade813f730 con 0x7fade813d770 2024-09-13T18:24:44.554 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade8070820 con 0x7fade813d770 2024-09-13T18:24:44.555 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faddf7fe640 1 -- 172.21.15.53:0/2694416888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fadd00159f0 con 0x7fade813d770 2024-09-13T18:24:44.555 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faddf7fe640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fadc8066630 0x7fadc8068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:44.555 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7faddf7fe640 1 -- 172.21.15.53:0/2694416888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fadd0083760 con 0x7fade813d770 2024-09-13T18:24:44.555 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fadc8066630 0x7fadc8068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:44.556 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.551+0000 7fade6d9d640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fadc8066630 0x7fadc8068af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd80a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:44.558 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.555+0000 7faddf7fe640 1 -- 172.21.15.53:0/2694416888 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fadd00519f0 con 0x7fade813d770 2024-09-13T18:24:44.712 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.711+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fade80caa00 con 0x7fade813d770 2024-09-13T18:24:44.712 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.711+0000 7faddf7fe640 1 -- 172.21.15.53:0/2694416888 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fadd0022020 con 0x7fade813d770 2024-09-13T18:24:44.712 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-13T18:24:44.713 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":12,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:42.217486+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:44.714 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fadc8066630 msgr2=0x7fadc8068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fadc8066630 0x7fadc8068af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd80a7040 comp rx=0 tx=0).stop 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fade813d770 msgr2=0x7fade80aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fade813d770 0x7fade80aeff0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009fd0 tx=0x7fadd0011a70 comp rx=0 tx=0).stop 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 shutdown_connections 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fadc8066630 0x7fadc8068af0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fade80af530 0x7fade8155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fade813d770 0x7fade80aeff0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 --2- 172.21.15.53:0/2694416888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadd4003980 0x7fade813f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 >> 172.21.15.53:0/2694416888 conn(0x7fade80b0200 msgr2=0x7fade815cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 shutdown_connections 2024-09-13T18:24:44.715 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:44.715+0000 7faded211640 1 -- 172.21.15.53:0/2694416888 wait complete. 2024-09-13T18:24:44.729 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:24:51.535 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:51.662 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0b6053640 1 Processor -- start 2024-09-13T18:24:51.663 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0b6053640 1 -- start start 2024-09-13T18:24:51.664 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0b6053640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 0x7fb0b015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.664 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0b6053640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0b006b080 0x7fb0b015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.664 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0b6053640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b006b860 con 0x7fb0b00b41f0 2024-09-13T18:24:51.664 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0b6053640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00b5b10 con 0x7fb0b006b080 2024-09-13T18:24:51.664 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0b6053640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b5680 con 0x7fb0b015c9d0 2024-09-13T18:24:51.664 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0aeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0b00b41f0 0x7fb0b006a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55798/0 (socket says 172.21.15.53:55798) 2024-09-13T18:24:51.664 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0aeffd640 1 -- 172.21.15.53:0/3076033633 learned_addr learned my addr 172.21.15.53:0/3076033633 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:51.665 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0affff640 1 --2- 172.21.15.53:0/3076033633 >> v2:172.21.15.87:3300/0 conn(0x7fb0b006b080 0x7fb0b015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.665 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0af7fe640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 0x7fb0b015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.665 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775792387 0 0) 0x7fb0b006b860 con 0x7fb0b00b41f0 2024-09-13T18:24:51.665 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb098003530 con 0x7fb0b00b41f0 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3607711369 0 0) 0x7fb098003530 con 0x7fb0b00b41f0 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 msgr2=0x7fb0b015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 0x7fb0b015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 >> v2:172.21.15.87:3300/0 conn(0x7fb0b006b080 msgr2=0x7fb0b015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 --2- 172.21.15.53:0/3076033633 >> v2:172.21.15.87:3300/0 conn(0x7fb0b006b080 0x7fb0b015dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00b4a70 con 0x7fb0b00b41f0 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb0a4001680 con 0x7fb0b00b41f0 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 >> v1:172.21.15.53:6789/0 conn(0x7fb0b00b41f0 legacy=0x7fb0b006a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 0x7fb098003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098003f00 0x7fb0980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb098004d10 0x7fb098005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.667 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b5b10 con 0x7fb098004d10 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b5680 con 0x7fb098003f00 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09800b990 con 0x7fb0b015c9d0 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0affff640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb098004d10 0x7fb098005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0af7fe640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 0x7fb098003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0aeffd640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098003f00 0x7fb0980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0affff640 1 -- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 msgr2=0x7fb098003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0affff640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015c9d0 0x7fb098003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0affff640 1 -- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098003f00 msgr2=0x7fb0980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:51.668 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0affff640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb098003f00 0x7fb0980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.669 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.662+0000 7fb0affff640 1 -- 172.21.15.53:0/3076033633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098003530 con 0x7fb098004d10 2024-09-13T18:24:51.670 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0affff640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb098004d10 0x7fb098005190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0b006cd60 tx=0x7fb0a801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb1cfe27eca70d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:51.670 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a5c30 con 0x7fb098004d10 2024-09-13T18:24:51.670 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800f040 con 0x7fb098004d10 2024-09-13T18:24:51.670 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0ae7fc640 1 -- 172.21.15.53:0/3076033633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80ad440 con 0x7fb098004d10 2024-09-13T18:24:51.670 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0b6053640 1 -- 172.21.15.53:0/3076033633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb098004d10 msgr2=0x7fb098005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.670 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0b6053640 1 --2- 172.21.15.53:0/3076033633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb098004d10 0x7fb098005190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0b006cd60 tx=0x7fb0a801cbc0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.671 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0affff640 1 -- 172.21.15.53:0/3076033633 reap_dead start 2024-09-13T18:24:51.671 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0b6053640 1 -- 172.21.15.53:0/3076033633 shutdown_connections 2024-09-13T18:24:51.671 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0b6053640 1 -- 172.21.15.53:0/3076033633 >> 172.21.15.53:0/3076033633 conn(0x7fb0b0071a70 msgr2=0x7fb0b0099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:51.671 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0b6053640 1 -- 172.21.15.53:0/3076033633 shutdown_connections 2024-09-13T18:24:51.671 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.666+0000 7fb0b6053640 1 -- 172.21.15.53:0/3076033633 wait complete. 2024-09-13T18:24:51.671 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 Processor -- start 2024-09-13T18:24:51.671 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 -- start start 2024-09-13T18:24:51.673 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0b01521c0 0x7fb0b00d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b0154ca0 0x7fb0b015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015b3a0 0x7fb0b0152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b009b250 con 0x7fb0b01521c0 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b015b820 con 0x7fb0b0154ca0 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b009a660 con 0x7fb0b015b3a0 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0b01521c0 0x7fb0b00d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0b01521c0 0x7fb0b00d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44882/0 (socket says 172.21.15.53:44882) 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 -- 172.21.15.53:0/2268787138 learned_addr learned my addr 172.21.15.53:0/2268787138 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0aeffd640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b0154ca0 0x7fb0b015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0affff640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015b3a0 0x7fb0b0152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 -- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015b3a0 msgr2=0x7fb0b0152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.674 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015b3a0 0x7fb0b0152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 -- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b0154ca0 msgr2=0x7fb0b015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b0154ca0 0x7fb0b015ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 -- 172.21.15.53:0/2268787138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b009a8b0 con 0x7fb0b01521c0 2024-09-13T18:24:51.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0affff640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015b3a0 0x7fb0b0152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:51.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0af7fe640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0b01521c0 0x7fb0b00d0bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0011610 tx=0x7fb0a0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:51.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb097fff640 1 -- 172.21.15.53:0/2268787138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0015870 con 0x7fb0b01521c0 2024-09-13T18:24:51.675 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb097fff640 1 -- 172.21.15.53:0/2268787138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a00159d0 con 0x7fb0b01521c0 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b009ab90 con 0x7fb0b01521c0 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb097fff640 1 -- 172.21.15.53:0/2268787138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0015d40 con 0x7fb0b01521c0 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b00d1100 con 0x7fb0b01521c0 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b009a180 con 0x7fb0b01521c0 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb097fff640 1 -- 172.21.15.53:0/2268787138 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0a00143e0 con 0x7fb0b01521c0 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb097fff640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb09c066690 0x7fb09c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb097fff640 1 -- 172.21.15.53:0/2268787138 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0a0084650 con 0x7fb0b01521c0 2024-09-13T18:24:51.676 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.670+0000 7fb0aeffd640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb09c066690 0x7fb09c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.677 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.674+0000 7fb0aeffd640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb09c066690 0x7fb09c068b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4000fc0 tx=0x7fb0a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:51.678 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.678+0000 7fb097fff640 1 -- 172.21.15.53:0/2268787138 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0a0051d10 con 0x7fb0b01521c0 2024-09-13T18:24:51.842 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.842+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b015cdb0 con 0x7fb0b01521c0 2024-09-13T18:24:51.844 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.842+0000 7fb097fff640 1 -- 172.21.15.53:0/2268787138 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7fb0a0055330 con 0x7fb0b01521c0 2024-09-13T18:24:51.844 INFO:teuthology.misc.health.smithi053.stdout: 2024-09-13T18:24:51.844 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":16,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:47.829665+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:51.846 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb09c066690 msgr2=0x7fb09c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.846 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb09c066690 0x7fb09c068b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4000fc0 tx=0x7fb0a4009040 comp rx=0 tx=0).stop 2024-09-13T18:24:51.846 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0b01521c0 msgr2=0x7fb0b00d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0b01521c0 0x7fb0b00d0bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0011610 tx=0x7fb0a0011ad0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 shutdown_connections 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb09c066690 0x7fb09c068b50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0b015b3a0 0x7fb0b0152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0b0154ca0 0x7fb0b015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 --2- 172.21.15.53:0/2268787138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0b01521c0 0x7fb0b00d0bc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 >> 172.21.15.53:0/2268787138 conn(0x7fb0b0071a70 msgr2=0x7fb0b015bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 shutdown_connections 2024-09-13T18:24:51.847 INFO:teuthology.misc.health.smithi053.stderr:2024-09-13T18:24:51.846+0000 7fb0b6053640 1 -- 172.21.15.53:0/2268787138 wait complete. 2024-09-13T18:24:51.863 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:24:51.863 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:24:51.864 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:24:51.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:24:51.867 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:24:51.867 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:24:51.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:24:51.869 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:24:51.869 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:24:51.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:24:51.872 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:24:51.872 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:24:51.872 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:24:51.874 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:24:51.875 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:24:51.875 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:51.950 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:24:51.950 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:24:51.960 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:24:51.965 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:24:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff323e7a640 1 Processor -- start 2024-09-13T18:24:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff323e7a640 1 -- start start 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff323e7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff31c0d19c0 0x7ff31c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff323e7a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0d2400 con 0x7ff31c15cab0 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff323e7a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0d1530 con 0x7ff31c0cf600 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff323e7a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0cfa90 con 0x7ff31c0d19c0 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff321415640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff31c0d19c0 0x7ff31c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff321c16640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff31c15cab0 0x7ff31c0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55822/0 (socket says 172.21.15.53:55822) 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff321c16640 1 -- 172.21.15.53:0/2673005709 learned_addr learned my addr 172.21.15.53:0/2673005709 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff321415640 1 -- 172.21.15.53:0/2673005709 >> v1:172.21.15.87:6789/0 conn(0x7ff31c0cf600 legacy=0x7ff31c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff320c14640 1 -- 172.21.15.53:0/2673005709 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523379109 0 0) 0x7ff31c0d2400 con 0x7ff31c15cab0 2024-09-13T18:24:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff321415640 1 -- 172.21.15.53:0/2673005709 >> v1:172.21.15.53:6789/0 conn(0x7ff31c15cab0 legacy=0x7ff31c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.986+0000 7ff321415640 1 -- 172.21.15.53:0/2673005709 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0cddd0 con 0x7ff31c0d19c0 2024-09-13T18:24:51.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff321415640 1 --2- 172.21.15.53:0/2673005709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0d19c0 0x7ff31c0cf0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff3180097c0 tx=0x7ff31801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc77a522f4400bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff320c14640 1 -- 172.21.15.53:0/2673005709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318004230 con 0x7ff31c0d19c0 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff320c14640 1 -- 172.21.15.53:0/2673005709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3180a7050 con 0x7ff31c0d19c0 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff320c14640 1 -- 172.21.15.53:0/2673005709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318003620 con 0x7ff31c0d19c0 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- 172.21.15.53:0/2673005709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0d19c0 msgr2=0x7ff31c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 --2- 172.21.15.53:0/2673005709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0d19c0 0x7ff31c0cf0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff3180097c0 tx=0x7ff31801c460 comp rx=0 tx=0).stop 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- 172.21.15.53:0/2673005709 shutdown_connections 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 --2- 172.21.15.53:0/2673005709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0d19c0 0x7ff31c0cf0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- 172.21.15.53:0/2673005709 >> 172.21.15.53:0/2673005709 conn(0x7ff31c065c80 msgr2=0x7ff31c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- 172.21.15.53:0/2673005709 shutdown_connections 2024-09-13T18:24:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- 172.21.15.53:0/2673005709 wait complete. 2024-09-13T18:24:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 Processor -- start 2024-09-13T18:24:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- start start 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0cf600 0x7ff31c0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0d19c0 0x7ff31c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c15cab0 0x7ff31c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c15b170 con 0x7ff31c0cf600 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c15b450 con 0x7ff31c15cab0 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff323e7a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c15b730 con 0x7ff31c0d19c0 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.990+0000 7ff321c16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0cf600 0x7ff31c0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0cf600 0x7ff31c0ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44922/0 (socket says 172.21.15.53:44922) 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 -- 172.21.15.53:0/3150138578 learned_addr learned my addr 172.21.15.53:0/3150138578 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff322417640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c15cab0 0x7ff31c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321415640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0d19c0 0x7ff31c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 -- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0d19c0 msgr2=0x7ff31c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0d19c0 0x7ff31c153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 -- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c15cab0 msgr2=0x7ff31c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c15cab0 0x7ff31c156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 -- 172.21.15.53:0/3150138578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318009420 con 0x7ff31c0cf600 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321c16640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0cf600 0x7ff31c0ca130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00c480 tx=0x7ff30c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff3127fc640 1 -- 172.21.15.53:0/3150138578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c0074e0 con 0x7ff31c0cf600 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff3127fc640 1 -- 172.21.15.53:0/3150138578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c007660 con 0x7ff31c0cf600 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c15ba10 con 0x7ff31c0cf600 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff3127fc640 1 -- 172.21.15.53:0/3150138578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c004a30 con 0x7ff31c0cf600 2024-09-13T18:24:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c1537d0 con 0x7ff31c0cf600 2024-09-13T18:24:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c153a50 con 0x7ff31c0cf600 2024-09-13T18:24:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff3127fc640 1 -- 172.21.15.53:0/3150138578 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff30c004b90 con 0x7ff31c0cf600 2024-09-13T18:24:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff3127fc640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff300066690 0x7ff300068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff3127fc640 1 -- 172.21.15.53:0/3150138578 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff30c0832d0 con 0x7ff31c0cf600 2024-09-13T18:24:51.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321415640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff300066690 0x7ff300068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:51.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.994+0000 7ff321415640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff300066690 0x7ff300068b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff3180ad000 tx=0x7ff3180a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:51.998+0000 7ff3127fc640 1 -- 172.21.15.53:0/3150138578 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff30c0544b0 con 0x7ff31c0cf600 2024-09-13T18:24:52.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.150+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff31c0cf0c0 con 0x7ff31c0cf600 2024-09-13T18:24:52.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.154+0000 7ff3127fc640 1 -- 172.21.15.53:0/3150138578 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7ff30c054040 con 0x7ff31c0cf600 2024-09-13T18:24:52.155 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:52.156 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:47.829665+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:52.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff300066690 msgr2=0x7ff300068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff300066690 0x7ff300068b50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff3180ad000 tx=0x7ff3180a6000 comp rx=0 tx=0).stop 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0cf600 msgr2=0x7ff31c0ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0cf600 0x7ff31c0ca130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00c480 tx=0x7ff30c00c940 comp rx=0 tx=0).stop 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 shutdown_connections 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff300066690 0x7ff300068b50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff31c0d19c0 0x7ff31c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff31c15cab0 0x7ff31c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 --2- 172.21.15.53:0/3150138578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff31c0cf600 0x7ff31c0ca130 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 >> 172.21.15.53:0/3150138578 conn(0x7ff31c065c80 msgr2=0x7ff31c15f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 shutdown_connections 2024-09-13T18:24:52.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.158+0000 7ff323e7a640 1 -- 172.21.15.53:0/3150138578 wait complete. 2024-09-13T18:24:52.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:24:52.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:24:52.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0eb8ff640 1 Processor -- start 2024-09-13T18:24:52.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0eb8ff640 1 -- start start 2024-09-13T18:24:52.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0eb8ff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40b2bf0 0x7fc0e40cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0eb8ff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc0e40ced50 0x7fc0e40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0eb8ff640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e40ccd60 con 0x7fc0e40ccf10 2024-09-13T18:24:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0eb8ff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e40cc190 con 0x7fc0e40ced50 2024-09-13T18:24:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0eb8ff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40ce270 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e9e9c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc0e40ced50 0x7fc0e40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e8e9a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40b2bf0 0x7fc0e40cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e969b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc0e40ccf10 0x7fc0e40cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:39016/0 (socket says 172.21.15.53:39016) 2024-09-13T18:24:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e969b640 1 -- 172.21.15.53:0/1420313767 learned_addr learned my addr 172.21.15.53:0/1420313767 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e9e9c640 1 -- 172.21.15.53:0/1420313767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40b2bf0 msgr2=0x7fc0e40cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e9e9c640 1 --2- 172.21.15.53:0/1420313767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40b2bf0 0x7fc0e40cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e9e9c640 1 -- 172.21.15.53:0/1420313767 >> v1:172.21.15.87:6789/0 conn(0x7fc0e40ccf10 legacy=0x7fc0e40cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.286+0000 7fc0e9e9c640 1 -- 172.21.15.53:0/1420313767 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e40ce550 con 0x7fc0e40ced50 2024-09-13T18:24:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0e9e9c640 1 --2- 172.21.15.53:0/1420313767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ced50 0x7fc0e40b33d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009d90 tx=0x7fc0dc01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4584cd2f0d987e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0dbfff640 1 -- 172.21.15.53:0/1420313767 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0a58d0 con 0x7fc0e40ced50 2024-09-13T18:24:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0dbfff640 1 -- 172.21.15.53:0/1420313767 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc0a5a30 con 0x7fc0e40ced50 2024-09-13T18:24:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0dbfff640 1 -- 172.21.15.53:0/1420313767 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0a5dc0 con 0x7fc0e40ced50 2024-09-13T18:24:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1420313767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ced50 msgr2=0x7fc0e40b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1420313767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ced50 0x7fc0e40b33d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009d90 tx=0x7fc0dc01c8b0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1420313767 shutdown_connections 2024-09-13T18:24:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1420313767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ced50 0x7fc0e40b33d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1420313767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40b2bf0 0x7fc0e40cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1420313767 >> 172.21.15.53:0/1420313767 conn(0x7fc0e40b20d0 msgr2=0x7fc0e40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1420313767 shutdown_connections 2024-09-13T18:24:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1420313767 wait complete. 2024-09-13T18:24:52.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 Processor -- start 2024-09-13T18:24:52.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.290+0000 7fc0eb8ff640 1 -- start start 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e40b2bf0 0x7fc0e41523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ccf10 0x7fc0e415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40ced50 0x7fc0e415e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4152bf0 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e415af10 con 0x7fc0e40ccf10 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e415b1f0 con 0x7fc0e40ced50 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e40b2bf0 0x7fc0e41523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e40b2bf0 0x7fc0e41523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44924/0 (socket says 172.21.15.53:44924) 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 -- 172.21.15.53:0/1523010791 learned_addr learned my addr 172.21.15.53:0/1523010791 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e9e9c640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40ced50 0x7fc0e415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e8e9a640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ccf10 0x7fc0e415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 -- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40ced50 msgr2=0x7fc0e415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40ced50 0x7fc0e415e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 -- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ccf10 msgr2=0x7fc0e415e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ccf10 0x7fc0e415e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 -- 172.21.15.53:0/1523010791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc009a70 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e8e9a640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ccf10 0x7fc0e415e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e969b640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e40b2bf0 0x7fc0e41523c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400c500 tx=0x7fc0d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0d9ffb640 1 -- 172.21.15.53:0/1523010791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4005cf0 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0d9ffb640 1 -- 172.21.15.53:0/1523010791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d4005e50 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e415b4d0 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0d9ffb640 1 -- 172.21.15.53:0/1523010791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40072f0 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e4152ed0 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e40b33d0 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0d9ffb640 1 -- 172.21.15.53:0/1523010791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0d4007450 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0d9ffb640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c80666c0 0x7fc0c8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0d9ffb640 1 -- 172.21.15.53:0/1523010791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc0d40832a0 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.294+0000 7fc0e8e9a640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c80666c0 0x7fc0c8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.298+0000 7fc0e8e9a640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c80666c0 0x7fc0c8068b80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0e41653d0 tx=0x7fc0e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.298+0000 7fc0d9ffb640 1 -- 172.21.15.53:0/1523010791 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc0d4050a20 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.454+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0e40b6480 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.454+0000 7fc0d9ffb640 1 -- 172.21.15.53:0/1523010791 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0d4054040 con 0x7fc0e40b2bf0 2024-09-13T18:24:52.457 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:24:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c80666c0 msgr2=0x7fc0c8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c80666c0 0x7fc0c8068b80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0e41653d0 tx=0x7fc0e0008040 comp rx=0 tx=0).stop 2024-09-13T18:24:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e40b2bf0 msgr2=0x7fc0e41523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e40b2bf0 0x7fc0e41523c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400c500 tx=0x7fc0d400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 shutdown_connections 2024-09-13T18:24:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c80666c0 0x7fc0c8068b80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e40ced50 0x7fc0e415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e40ccf10 0x7fc0e415e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 --2- 172.21.15.53:0/1523010791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e40b2bf0 0x7fc0e41523c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 >> 172.21.15.53:0/1523010791 conn(0x7fc0e40b20d0 msgr2=0x7fc0e40b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 shutdown_connections 2024-09-13T18:24:52.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.458+0000 7fc0eb8ff640 1 -- 172.21.15.53:0/1523010791 wait complete. 2024-09-13T18:24:52.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:24:52.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e46cf640 1 Processor -- start 2024-09-13T18:24:52.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e46cf640 1 -- start start 2024-09-13T18:24:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e46cf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc15a470 0x7f69dc0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e46cf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69dc0b1c10 0x7f69dc0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e46cf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc06f550 con 0x7f69dc15cc60 2024-09-13T18:24:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e46cf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc06f880 con 0x7f69dc0b1c10 2024-09-13T18:24:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e46cf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0b2600 con 0x7f69dc15a470 2024-09-13T18:24:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e2c6c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69dc0b1c10 0x7f69dc0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e246b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc15a470 0x7f69dc0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e1c6a640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f69dc15cc60 0x7f69dc071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:39020/0 (socket says 172.21.15.53:39020) 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e2c6c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69dc0b1c10 0x7f69dc0b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:55622/0 (socket says 172.21.15.53:55622) 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e1c6a640 1 -- 172.21.15.53:0/2650895057 learned_addr learned my addr 172.21.15.53:0/2650895057 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e246b640 1 -- 172.21.15.53:0/2650895057 >> v2:172.21.15.87:3300/0 conn(0x7f69dc0b1c10 msgr2=0x7f69dc0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e246b640 1 --2- 172.21.15.53:0/2650895057 >> v2:172.21.15.87:3300/0 conn(0x7f69dc0b1c10 0x7f69dc0b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e246b640 1 -- 172.21.15.53:0/2650895057 >> v1:172.21.15.87:6789/0 conn(0x7f69dc15cc60 legacy=0x7f69dc071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e246b640 1 -- 172.21.15.53:0/2650895057 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc15dc40 con 0x7f69dc15a470 2024-09-13T18:24:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.582+0000 7f69e2c6c640 1 --2- 172.21.15.53:0/2650895057 >> v2:172.21.15.87:3300/0 conn(0x7f69dc0b1c10 0x7f69dc0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:24:52.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e246b640 1 --2- 172.21.15.53:0/2650895057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc15a470 0x7f69dc0cc270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69d80097c0 tx=0x7f69d801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=585cca0486341409 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e1469640 1 -- 172.21.15.53:0/2650895057 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80a6040 con 0x7f69dc15a470 2024-09-13T18:24:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e1469640 1 -- 172.21.15.53:0/2650895057 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d80aa600 con 0x7f69dc15a470 2024-09-13T18:24:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e1469640 1 -- 172.21.15.53:0/2650895057 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80aa990 con 0x7f69dc15a470 2024-09-13T18:24:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 -- 172.21.15.53:0/2650895057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc15a470 msgr2=0x7f69dc0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 --2- 172.21.15.53:0/2650895057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc15a470 0x7f69dc0cc270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69d80097c0 tx=0x7f69d801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 -- 172.21.15.53:0/2650895057 shutdown_connections 2024-09-13T18:24:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 --2- 172.21.15.53:0/2650895057 >> v2:172.21.15.87:3300/0 conn(0x7f69dc0b1c10 0x7f69dc0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 --2- 172.21.15.53:0/2650895057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc15a470 0x7f69dc0cc270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 -- 172.21.15.53:0/2650895057 >> 172.21.15.53:0/2650895057 conn(0x7f69dc065c80 msgr2=0x7f69dc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 -- 172.21.15.53:0/2650895057 shutdown_connections 2024-09-13T18:24:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 -- 172.21.15.53:0/2650895057 wait complete. 2024-09-13T18:24:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 Processor -- start 2024-09-13T18:24:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.586+0000 7f69e46cf640 1 -- start start 2024-09-13T18:24:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc0b1c10 0x7f69dc1485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc15a470 0x7f69dc158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69dc15cc60 0x7f69dc06b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc15a8f0 con 0x7f69dc15a470 2024-09-13T18:24:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc15abd0 con 0x7f69dc15cc60 2024-09-13T18:24:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc15aeb0 con 0x7f69dc0b1c10 2024-09-13T18:24:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc15a470 0x7f69dc158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc15a470 0x7f69dc158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44940/0 (socket says 172.21.15.53:44940) 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 -- 172.21.15.53:0/725951324 learned_addr learned my addr 172.21.15.53:0/725951324 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e2c6c640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69dc15cc60 0x7f69dc06b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e246b640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc0b1c10 0x7f69dc1485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 -- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc0b1c10 msgr2=0x7f69dc1485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc0b1c10 0x7f69dc1485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 -- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69dc15cc60 msgr2=0x7f69dc06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69dc15cc60 0x7f69dc06b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 -- 172.21.15.53:0/725951324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4009a70 con 0x7f69dc15a470 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e1c6a640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc15a470 0x7f69dc158680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69d000c340 tx=0x7f69d000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69ceffd640 1 -- 172.21.15.53:0/725951324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0005cf0 con 0x7f69dc15a470 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69ceffd640 1 -- 172.21.15.53:0/725951324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d0005e50 con 0x7f69dc15a470 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d8009420 con 0x7f69dc15a470 2024-09-13T18:24:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69ceffd640 1 -- 172.21.15.53:0/725951324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d00072f0 con 0x7f69dc15a470 2024-09-13T18:24:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc15b470 con 0x7f69dc15a470 2024-09-13T18:24:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc067400 con 0x7f69dc15a470 2024-09-13T18:24:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69ceffd640 1 -- 172.21.15.53:0/725951324 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69d0007450 con 0x7f69dc15a470 2024-09-13T18:24:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69ceffd640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69c0066690 0x7f69c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69ceffd640 1 -- 172.21.15.53:0/725951324 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69d00833c0 con 0x7f69dc15a470 2024-09-13T18:24:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.590+0000 7f69e246b640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69c0066690 0x7f69c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.594+0000 7f69e246b640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69c0066690 0x7f69c0068b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69d80ae000 tx=0x7f69d80a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.594+0000 7f69ceffd640 1 -- 172.21.15.53:0/725951324 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69d0050a70 con 0x7f69dc15a470 2024-09-13T18:24:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.782+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69dc0665d0 con 0x7f69dc15a470 2024-09-13T18:24:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.782+0000 7f69ceffd640 1 -- 172.21.15.53:0/725951324 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f69d0017500 con 0x7f69dc15a470 2024-09-13T18:24:52.785 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:52.785 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:24:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 2 2024-09-13T18:24:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69c0066690 msgr2=0x7f69c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69c0066690 0x7f69c0068b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69d80ae000 tx=0x7f69d80a7000 comp rx=0 tx=0).stop 2024-09-13T18:24:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc15a470 msgr2=0x7f69dc158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc15a470 0x7f69dc158680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69d000c340 tx=0x7f69d000c800 comp rx=0 tx=0).stop 2024-09-13T18:24:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 shutdown_connections 2024-09-13T18:24:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69c0066690 0x7f69c0068b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69dc15cc60 0x7f69dc06b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69dc15a470 0x7f69dc158680 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 --2- 172.21.15.53:0/725951324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69dc0b1c10 0x7f69dc1485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 >> 172.21.15.53:0/725951324 conn(0x7f69dc065c80 msgr2=0x7f69dc06ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 shutdown_connections 2024-09-13T18:24:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:52.786+0000 7f69e46cf640 1 -- 172.21.15.53:0/725951324 wait complete. 2024-09-13T18:24:54.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:24:54.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:24:54.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:24:54.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.934+0000 7f6d21094640 1 Processor -- start 2024-09-13T18:24:54.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.934+0000 7f6d21094640 1 -- start start 2024-09-13T18:24:54.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d21094640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 0x7f6d1c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d21094640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1c0b1ac0 con 0x7f6d1c0cb980 2024-09-13T18:24:54.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d21094640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1c159ac0 con 0x7f6d1c0cbd60 2024-09-13T18:24:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d21094640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c159da0 con 0x7f6d1c06b850 2024-09-13T18:24:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6d1c0cb980 0x7f6d1c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55832/0 (socket says 172.21.15.53:55832) 2024-09-13T18:24:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1ad9d640 1 -- 172.21.15.53:0/1734201971 learned_addr learned my addr 172.21.15.53:0/1734201971 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1a59c640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 0x7f6d1c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560242496 0 0) 0x7f6d1c0b1ac0 con 0x7f6d1c0cb980 2024-09-13T18:24:54.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d04005740 con 0x7f6d1c0cb980 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3856663834 0 0) 0x7f6d04005740 con 0x7f6d1c0cb980 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 msgr2=0x7f6d1c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 0x7f6d1c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 >> v1:172.21.15.87:6789/0 conn(0x7f6d1c0cbd60 legacy=0x7f6d1c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c15a080 con 0x7f6d1c0cb980 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6d0c001680 con 0x7f6d1c0cb980 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 >> v1:172.21.15.53:6789/0 conn(0x7f6d1c0cb980 legacy=0x7f6d1c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 0x7f6d04005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d04006140 0x7f6d040069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d04006f20 0x7f6d040073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c159da0 con 0x7f6d04006140 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0400dd30 con 0x7f6d04006f20 2024-09-13T18:24:54.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0400def0 con 0x7f6d1c06b850 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1a59c640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d04006140 0x7f6d040069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1ad9d640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 0x7f6d04005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1b59e640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d04006f20 0x7f6d040073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1a59c640 1 -- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 msgr2=0x7f6d04005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1a59c640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d1c06b850 0x7f6d04005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1a59c640 1 -- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d04006f20 msgr2=0x7f6d040073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1a59c640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d04006f20 0x7f6d040073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:54.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.938+0000 7f6d1a59c640 1 -- 172.21.15.53:0/1734201971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04005740 con 0x7f6d04006140 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d1a59c640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d04006140 0x7f6d040069e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009ab0 tx=0x7f6d1001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9f666a2387f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a55f0 con 0x7f6d04006140 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d100a5750 con 0x7f6d04006140 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d19d9b640 1 -- 172.21.15.53:0/1734201971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a5b00 con 0x7f6d04006140 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- 172.21.15.53:0/1734201971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d04006140 msgr2=0x7f6d040069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 --2- 172.21.15.53:0/1734201971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d04006140 0x7f6d040069e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009ab0 tx=0x7f6d1001ca20 comp rx=0 tx=0).stop 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d1b59e640 1 -- 172.21.15.53:0/1734201971 reap_dead start 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- 172.21.15.53:0/1734201971 shutdown_connections 2024-09-13T18:24:54.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- 172.21.15.53:0/1734201971 >> 172.21.15.53:0/1734201971 conn(0x7f6d1c065c80 msgr2=0x7f6d1c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:54.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- 172.21.15.53:0/1734201971 shutdown_connections 2024-09-13T18:24:54.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- 172.21.15.53:0/1734201971 wait complete. 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 Processor -- start 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- start start 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d04006140 0x7f6d1c15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d1c14d940 0x7f6d1c146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d1c15c1e0 0x7f6d1c15c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c0ad4e0 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c15b140 con 0x7f6d1c14d940 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d21094640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c15b420 con 0x7f6d04006140 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d1b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d1c15c1e0 0x7f6d1c15c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d1b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d1c15c1e0 0x7f6d1c15c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44954/0 (socket says 172.21.15.53:44954) 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d1b59e640 1 -- 172.21.15.53:0/3682154569 learned_addr learned my addr 172.21.15.53:0/3682154569 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d1ad9d640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d04006140 0x7f6d1c15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.942+0000 7f6d1a59c640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d1c14d940 0x7f6d1c146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1b59e640 1 -- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d04006140 msgr2=0x7f6d1c15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1b59e640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d04006140 0x7f6d1c15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1b59e640 1 -- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d1c14d940 msgr2=0x7f6d1c146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1b59e640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d1c14d940 0x7f6d1c146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1b59e640 1 -- 172.21.15.53:0/3682154569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c15b700 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1ad9d640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d04006140 0x7f6d1c15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1b59e640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d1c15c1e0 0x7f6d1c15c640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c071520 tx=0x7f6d1400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d037fe640 1 -- 172.21.15.53:0/3682154569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14003980 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d037fe640 1 -- 172.21.15.53:0/3682154569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d14003ae0 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d037fe640 1 -- 172.21.15.53:0/3682154569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14003e90 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1c15b9e0 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c146f90 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c067400 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d037fe640 1 -- 172.21.15.53:0/3682154569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d140050d0 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d037fe640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d080666c0 0x7f6d08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d037fe640 1 -- 172.21.15.53:0/3682154569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d14083ca0 con 0x7f6d1c15c1e0 2024-09-13T18:24:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1ad9d640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d080666c0 0x7f6d08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.946+0000 7f6d1ad9d640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d080666c0 0x7f6d08068b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c001ec0 tx=0x7f6d0c000ee0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:54.950+0000 7f6d037fe640 1 -- 172.21.15.53:0/3682154569 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d140512d0 con 0x7f6d1c15c1e0 2024-09-13T18:24:55.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.142+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d1c074370 con 0x7f6d1c15c1e0 2024-09-13T18:24:55.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d037fe640 1 -- 172.21.15.53:0/3682154569 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f6d140548f0 con 0x7f6d1c15c1e0 2024-09-13T18:24:55.147 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:55.147 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:24:55.147 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 3 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d080666c0 msgr2=0x7f6d08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d080666c0 0x7f6d08068b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c001ec0 tx=0x7f6d0c000ee0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d1c15c1e0 msgr2=0x7f6d1c15c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d1c15c1e0 0x7f6d1c15c640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c071520 tx=0x7f6d1400ec10 comp rx=0 tx=0).stop 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 shutdown_connections 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d080666c0 0x7f6d08068b80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d1c15c1e0 0x7f6d1c15c640 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d1c14d940 0x7f6d1c146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 --2- 172.21.15.53:0/3682154569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d04006140 0x7f6d1c15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 >> 172.21.15.53:0/3682154569 conn(0x7f6d1c065c80 msgr2=0x7f6d1c14bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:55.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 shutdown_connections 2024-09-13T18:24:55.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.146+0000 7f6d21094640 1 -- 172.21.15.53:0/3682154569 wait complete. 2024-09-13T18:24:55.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:55.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabeb8af640 1 Processor -- start 2024-09-13T18:24:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabeb8af640 1 -- start start 2024-09-13T18:24:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabeb8af640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fabe40cf7d0 0x7fabe40b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabeb8af640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe40d2400 con 0x7fabe415cab0 2024-09-13T18:24:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabeb8af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe40d1530 con 0x7fabe40d19c0 2024-09-13T18:24:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabeb8af640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe40cddd0 con 0x7fabe40cf7d0 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe964b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fabe415cab0 0x7fabe40cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55846/0 (socket says 172.21.15.53:55846) 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe964b640 1 -- 172.21.15.53:0/3135522136 learned_addr learned my addr 172.21.15.53:0/3135522136 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761571949 0 0) 0x7fabe40d2400 con 0x7fabe415cab0 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd0003530 con 0x7fabe415cab0 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe9e4c640 1 --2- 172.21.15.53:0/3135522136 >> v2:172.21.15.87:3300/0 conn(0x7fabe40cf7d0 0x7fabe40b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2101276121 0 0) 0x7fabd0003530 con 0x7fabe415cab0 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 >> v2:172.21.15.87:3300/0 conn(0x7fabe40cf7d0 msgr2=0x7fabe40b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 --2- 172.21.15.53:0/3135522136 >> v2:172.21.15.87:3300/0 conn(0x7fabe40cf7d0 0x7fabe40b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 >> v1:172.21.15.87:6789/0 conn(0x7fabe40d19c0 legacy=0x7fabe40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40d1e30 con 0x7fabe415cab0 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fabe0001680 con 0x7fabe415cab0 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 >> v1:172.21.15.53:6789/0 conn(0x7fabe415cab0 legacy=0x7fabe40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0003980 0x7fabd0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabd00047d0 0x7fabd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabd0005190 0x7fabd000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40cddd0 con 0x7fabd0005190 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd000c030 con 0x7fabd00047d0 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd000c1f0 con 0x7fabd0003980 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe9e4c640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabd0005190 0x7fabd000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe8e4a640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabd00047d0 0x7fabd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe964b640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0003980 0x7fabd0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe9e4c640 1 -- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0003980 msgr2=0x7fabd0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe9e4c640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0003980 0x7fabd0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe9e4c640 1 -- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabd00047d0 msgr2=0x7fabd0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe9e4c640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabd00047d0 0x7fabd0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe9e4c640 1 -- 172.21.15.53:0/3135522136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0003530 con 0x7fabd0005190 2024-09-13T18:24:55.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.278+0000 7fabe964b640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0003980 0x7fabd0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabe9e4c640 1 -- 172.21.15.53:0/3135522136 reap_dead start 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabe9e4c640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabd0005190 0x7fabd000b990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fabe40b51d0 tx=0x7fabdc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c51d6f5b0a97ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0a5c70 con 0x7fabd0005190 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc00f040 con 0x7fabd0005190 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabdbfff640 1 -- 172.21.15.53:0/3135522136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0039a0 con 0x7fabd0005190 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- 172.21.15.53:0/3135522136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabd0005190 msgr2=0x7fabd000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabd0005190 0x7fabd000b990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fabe40b51d0 tx=0x7fabdc01cc60 comp rx=0 tx=0).stop 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- 172.21.15.53:0/3135522136 shutdown_connections 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 --2- 172.21.15.53:0/3135522136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabd0005190 0x7fabd000b990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- 172.21.15.53:0/3135522136 >> 172.21.15.53:0/3135522136 conn(0x7fabe4065c80 msgr2=0x7fabe4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- 172.21.15.53:0/3135522136 shutdown_connections 2024-09-13T18:24:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- 172.21.15.53:0/3135522136 wait complete. 2024-09-13T18:24:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 Processor -- start 2024-09-13T18:24:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- start start 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0005190 0x7fabe41559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabe40c9780 0x7fabe40b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe40b5d70 0x7fabe40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe41f63a0 con 0x7fabe40c9780 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe4155ef0 con 0x7fabe40b5d70 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabeb8af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40b61f0 con 0x7fabd0005190 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabe8e4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabe40c9780 0x7fabe40b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabe8e4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabe40c9780 0x7fabe40b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44972/0 (socket says 172.21.15.53:44972) 2024-09-13T18:24:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.282+0000 7fabe8e4a640 1 -- 172.21.15.53:0/2718468570 learned_addr learned my addr 172.21.15.53:0/2718468570 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe9e4c640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe40b5d70 0x7fabe40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe964b640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0005190 0x7fabe41559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe8e4a640 1 -- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0005190 msgr2=0x7fabe41559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe8e4a640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0005190 0x7fabe41559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe8e4a640 1 -- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe40b5d70 msgr2=0x7fabe40ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe8e4a640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe40b5d70 0x7fabe40ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe8e4a640 1 -- 172.21.15.53:0/2718468570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe41f5760 con 0x7fabe40c9780 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe8e4a640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabe40c9780 0x7fabe40b5830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fabd400e4d0 tx=0x7fabd400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabd9ffb640 1 -- 172.21.15.53:0/2718468570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40052e0 con 0x7fabe40c9780 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabd9ffb640 1 -- 172.21.15.53:0/2718468570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4005440 con 0x7fabe40c9780 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabd9ffb640 1 -- 172.21.15.53:0/2718468570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4003820 con 0x7fabe40c9780 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe41f5a00 con 0x7fabe40c9780 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe41f5fc0 con 0x7fabe40c9780 2024-09-13T18:24:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe40d0940 con 0x7fabe40c9780 2024-09-13T18:24:55.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabd9ffb640 1 -- 172.21.15.53:0/2718468570 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fabd4003980 con 0x7fabe40c9780 2024-09-13T18:24:55.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabd9ffb640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabc80666c0 0x7fabc8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabd9ffb640 1 -- 172.21.15.53:0/2718468570 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fabd4083b20 con 0x7fabe40c9780 2024-09-13T18:24:55.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe964b640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabc80666c0 0x7fabc8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.286+0000 7fabe964b640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabc80666c0 0x7fabc8068b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fabe00017b0 tx=0x7fabe0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.290+0000 7fabd9ffb640 1 -- 172.21.15.53:0/2718468570 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fabd4051270 con 0x7fabe40c9780 2024-09-13T18:24:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.450+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabe415dd20 con 0x7fabe40c9780 2024-09-13T18:24:55.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.450+0000 7fabd9ffb640 1 -- 172.21.15.53:0/2718468570 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12790 (secure 0 0 0) 0x7fabd4054890 con 0x7fabe40c9780 2024-09-13T18:24:55.453 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:55.453 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:47.829665+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabc80666c0 msgr2=0x7fabc8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabc80666c0 0x7fabc8068b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fabe00017b0 tx=0x7fabe0009040 comp rx=0 tx=0).stop 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabe40c9780 msgr2=0x7fabe40b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabe40c9780 0x7fabe40b5830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fabd400e4d0 tx=0x7fabd400e990 comp rx=0 tx=0).stop 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 shutdown_connections 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabc80666c0 0x7fabc8068b80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabe40b5d70 0x7fabe40ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabe40c9780 0x7fabe40b5830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 --2- 172.21.15.53:0/2718468570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabd0005190 0x7fabe41559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 >> 172.21.15.53:0/2718468570 conn(0x7fabe4065c80 msgr2=0x7fabe415f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 shutdown_connections 2024-09-13T18:24:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.454+0000 7fabeb8af640 1 -- 172.21.15.53:0/2718468570 wait complete. 2024-09-13T18:24:55.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:24:55.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:24:55.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef41b4640 1 Processor -- start 2024-09-13T18:24:55.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef41b4640 1 -- start start 2024-09-13T18:24:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef41b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 0x7f3eec1677f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef41b4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec160ca0 con 0x7f3eec0cf0a0 2024-09-13T18:24:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef41b4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec161130 con 0x7f3eec15fd60 2024-09-13T18:24:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef41b4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec160370 con 0x7f3eec165400 2024-09-13T18:24:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3eec0cf0a0 0x7f3eec0cf4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55860/0 (socket says 172.21.15.53:55860) 2024-09-13T18:24:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 -- 172.21.15.53:0/4091517110 learned_addr learned my addr 172.21.15.53:0/4091517110 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef2751640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 0x7f3eec1677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022099410 0 0) 0x7f3eec160ca0 con 0x7f3eec0cf0a0 2024-09-13T18:24:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003530 con 0x7f3eec0cf0a0 2024-09-13T18:24:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 923383990 0 0) 0x7f3ed8003530 con 0x7f3eec0cf0a0 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 msgr2=0x7f3eec1677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 0x7f3eec1677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 >> v1:172.21.15.87:6789/0 conn(0x7f3eec15fd60 legacy=0x7f3eec0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec160650 con 0x7f3eec0cf0a0 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3edc001680 con 0x7f3eec0cf0a0 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 >> v1:172.21.15.53:6789/0 conn(0x7f3eec0cf0a0 legacy=0x7f3eec0cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 0x7f3ed80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3ed80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed8004d10 0x7f3ed8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec160370 con 0x7f3ed8003f30 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800ba70 con 0x7f3ed8004d10 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800bc30 con 0x7f3eec165400 2024-09-13T18:24:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3ed80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef1f50640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 0x7f3ed80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef2751640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed8004d10 0x7f3ed8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 -- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 msgr2=0x7f3ed80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec165400 0x7f3ed80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 -- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed8004d10 msgr2=0x7f3ed8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ed8004d10 0x7f3ed8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.598+0000 7f3ef174f640 1 -- 172.21.15.53:0/4091517110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8003530 con 0x7f3ed8003f30 2024-09-13T18:24:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef174f640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3ed80047d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c240 tx=0x7f3edc01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78b6805e48af3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc005ae0 con 0x7f3ed8003f30 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc0ab070 con 0x7f3ed8003f30 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef0f4e640 1 -- 172.21.15.53:0/4091517110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc005ea0 con 0x7f3ed8003f30 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 -- 172.21.15.53:0/4091517110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 msgr2=0x7f3ed80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 --2- 172.21.15.53:0/4091517110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3ed80047d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c240 tx=0x7f3edc01f3d0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef2751640 1 -- 172.21.15.53:0/4091517110 reap_dead start 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 -- 172.21.15.53:0/4091517110 shutdown_connections 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 -- 172.21.15.53:0/4091517110 >> 172.21.15.53:0/4091517110 conn(0x7f3eec070970 msgr2=0x7f3eec070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 -- 172.21.15.53:0/4091517110 shutdown_connections 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 -- 172.21.15.53:0/4091517110 wait complete. 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 Processor -- start 2024-09-13T18:24:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.602+0000 7f3ef41b4640 1 -- start start 2024-09-13T18:24:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3eec0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec0cbd60 0x7f3eec0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec159460 0x7f3eec159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0ccb00 con 0x7f3ed8003f30 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0cc260 con 0x7f3eec0cbd60 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0cc540 con 0x7f3eec159460 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3eec0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3eec0b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44996/0 (socket says 172.21.15.53:44996) 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 -- 172.21.15.53:0/1839067777 learned_addr learned my addr 172.21.15.53:0/1839067777 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef174f640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec0cbd60 0x7f3eec0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef2751640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec159460 0x7f3eec159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 -- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec159460 msgr2=0x7f3eec159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec159460 0x7f3eec159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 -- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec0cbd60 msgr2=0x7f3eec0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec0cbd60 0x7f3eec0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 -- 172.21.15.53:0/1839067777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0cc820 con 0x7f3ed8003f30 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef2751640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec159460 0x7f3eec159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef1f50640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3eec0b41e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800e550 tx=0x7f3ee800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ee27fc640 1 -- 172.21.15.53:0/1839067777 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80052e0 con 0x7f3ed8003f30 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ee27fc640 1 -- 172.21.15.53:0/1839067777 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8005440 con 0x7f3ed8003f30 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec15a870 con 0x7f3ed8003f30 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ee27fc640 1 -- 172.21.15.53:0/1839067777 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8003820 con 0x7f3ed8003f30 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec165070 con 0x7f3ed8003f30 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec165260 con 0x7f3ed8003f30 2024-09-13T18:24:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ee27fc640 1 -- 172.21.15.53:0/1839067777 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ee8003980 con 0x7f3ed8003f30 2024-09-13T18:24:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ee27fc640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ed00666c0 0x7f3ed0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ee27fc640 1 -- 172.21.15.53:0/1839067777 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ee8083bd0 con 0x7f3ed8003f30 2024-09-13T18:24:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.606+0000 7f3ef174f640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ed00666c0 0x7f3ed0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.610+0000 7f3ef174f640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ed00666c0 0x7f3ed0068b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0af000 tx=0x7f3edc0aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.610+0000 7f3ee27fc640 1 -- 172.21.15.53:0/1839067777 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3eec165260 con 0x7f3ed8003f30 2024-09-13T18:24:55.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3eec165260 con 0x7f3ed8003f30 2024-09-13T18:24:55.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ee27fc640 1 -- 172.21.15.53:0/1839067777 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3eec165260 con 0x7f3ed8003f30 2024-09-13T18:24:55.768 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ed00666c0 msgr2=0x7f3ed0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ed00666c0 0x7f3ed0068b80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0af000 tx=0x7f3edc0aa000 comp rx=0 tx=0).stop 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 msgr2=0x7f3eec0b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3eec0b41e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800e550 tx=0x7f3ee800ea10 comp rx=0 tx=0).stop 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 shutdown_connections 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ed00666c0 0x7f3ed0068b80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec159460 0x7f3eec159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec0cbd60 0x7f3eec0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 --2- 172.21.15.53:0/1839067777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ed8003f30 0x7f3eec0b41e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 >> 172.21.15.53:0/1839067777 conn(0x7f3eec070970 msgr2=0x7f3eec15f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 shutdown_connections 2024-09-13T18:24:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.766+0000 7f3ef41b4640 1 -- 172.21.15.53:0/1839067777 wait complete. 2024-09-13T18:24:55.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:24:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f8044141640 1 Processor -- start 2024-09-13T18:24:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f8044141640 1 -- start start 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f8044141640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f803c06fa80 0x7f803c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f8044141640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0b2860 con 0x7f803c0cbb60 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f8044141640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c158f80 con 0x7f803c158ba0 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f8044141640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c0b2580 con 0x7f803c06fa80 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f80416dc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f803c06fa80 0x7f803c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f80426de640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f803c0cbb60 0x7f803c0cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55872/0 (socket says 172.21.15.53:55872) 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f80426de640 1 -- 172.21.15.53:0/1797282221 learned_addr learned my addr 172.21.15.53:0/1797282221 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f80416dc640 1 -- 172.21.15.53:0/1797282221 >> v1:172.21.15.87:6789/0 conn(0x7f803c158ba0 legacy=0x7f803c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f80416dc640 1 -- 172.21.15.53:0/1797282221 >> v1:172.21.15.53:6789/0 conn(0x7f803c0cbb60 legacy=0x7f803c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f80416dc640 1 -- 172.21.15.53:0/1797282221 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0cc3a0 con 0x7f803c06fa80 2024-09-13T18:24:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.906+0000 7f8040edb640 1 -- 172.21.15.53:0/1797282221 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555701942 0 0) 0x7f803c0b2860 con 0x7f803c0cbb60 2024-09-13T18:24:55.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 --2- 172.21.15.53:0/1797282221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c06fa80 0x7f803c06b390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f802c00ba60 tx=0x7f802c01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edd4091440096e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8040edb640 1 -- 172.21.15.53:0/1797282221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0a7bb0 con 0x7f803c06fa80 2024-09-13T18:24:55.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8040edb640 1 -- 172.21.15.53:0/1797282221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c0a7d10 con 0x7f803c06fa80 2024-09-13T18:24:55.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8040edb640 1 -- 172.21.15.53:0/1797282221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0af660 con 0x7f803c06fa80 2024-09-13T18:24:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- 172.21.15.53:0/1797282221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c06fa80 msgr2=0x7f803c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 --2- 172.21.15.53:0/1797282221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c06fa80 0x7f803c06b390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f802c00ba60 tx=0x7f802c01eae0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- 172.21.15.53:0/1797282221 shutdown_connections 2024-09-13T18:24:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 --2- 172.21.15.53:0/1797282221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c06fa80 0x7f803c06b390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- 172.21.15.53:0/1797282221 >> 172.21.15.53:0/1797282221 conn(0x7f803c065c80 msgr2=0x7f803c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- 172.21.15.53:0/1797282221 shutdown_connections 2024-09-13T18:24:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- 172.21.15.53:0/1797282221 wait complete. 2024-09-13T18:24:55.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 Processor -- start 2024-09-13T18:24:55.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- start start 2024-09-13T18:24:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f803c06fa80 0x7f803c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c0cbb60 0x7f803c14d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f803c158ba0 0x7f803c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c14dd10 con 0x7f803c0cbb60 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c158270 con 0x7f803c06fa80 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c151db0 con 0x7f803c158ba0 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c0cbb60 0x7f803c14d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c0cbb60 0x7f803c14d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45014/0 (socket says 172.21.15.53:45014) 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 -- 172.21.15.53:0/301674168 learned_addr learned my addr 172.21.15.53:0/301674168 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80426de640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f803c158ba0 0x7f803c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8041edd640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f803c06fa80 0x7f803c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 -- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f803c158ba0 msgr2=0x7f803c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f803c158ba0 0x7f803c152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 -- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f803c06fa80 msgr2=0x7f803c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f803c06fa80 0x7f803c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 -- 172.21.15.53:0/301674168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c00b6c0 con 0x7f803c0cbb60 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8041edd640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f803c06fa80 0x7f803c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80416dc640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c0cbb60 0x7f803c14d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f802c0b2040 tx=0x7f802c01b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80327fc640 1 -- 172.21.15.53:0/301674168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0b8660 con 0x7f803c0cbb60 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80327fc640 1 -- 172.21.15.53:0/301674168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c0b87e0 con 0x7f803c0cbb60 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c152090 con 0x7f803c0cbb60 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f80327fc640 1 -- 172.21.15.53:0/301674168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0b8b90 con 0x7f803c0cbb60 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.910+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c152650 con 0x7f803c0cbb60 2024-09-13T18:24:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.914+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c067400 con 0x7f803c0cbb60 2024-09-13T18:24:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.914+0000 7f80327fc640 1 -- 172.21.15.53:0/301674168 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f802c0b6070 con 0x7f803c0cbb60 2024-09-13T18:24:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.914+0000 7f80327fc640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8020066690 0x7f8020068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.914+0000 7f80327fc640 1 -- 172.21.15.53:0/301674168 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f802c11f8e0 con 0x7f803c0cbb60 2024-09-13T18:24:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.914+0000 7f8041edd640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8020066690 0x7f8020068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.914+0000 7f8041edd640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8020066690 0x7f8020068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8038000f70 tx=0x7f8038009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:55.918+0000 7f80327fc640 1 -- 172.21.15.53:0/301674168 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f802c0ed010 con 0x7f803c0cbb60 2024-09-13T18:24:56.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.078+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f803c151ef0 con 0x7f803c0cbb60 2024-09-13T18:24:56.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f80327fc640 1 -- 172.21.15.53:0/301674168 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f802c0b4060 con 0x7f803c0cbb60 2024-09-13T18:24:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:56.083 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:24:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:24:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:24:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:24:56.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:24:56.084 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8020066690 msgr2=0x7f8020068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8020066690 0x7f8020068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8038000f70 tx=0x7f8038009040 comp rx=0 tx=0).stop 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c0cbb60 msgr2=0x7f803c14d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c0cbb60 0x7f803c14d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f802c0b2040 tx=0x7f802c01b880 comp rx=0 tx=0).stop 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 shutdown_connections 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8020066690 0x7f8020068b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f803c158ba0 0x7f803c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f803c0cbb60 0x7f803c14d7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 --2- 172.21.15.53:0/301674168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f803c06fa80 0x7f803c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 >> 172.21.15.53:0/301674168 conn(0x7f803c065c80 msgr2=0x7f803c0b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:56.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 shutdown_connections 2024-09-13T18:24:56.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.082+0000 7f8044141640 1 -- 172.21.15.53:0/301674168 wait complete. 2024-09-13T18:24:56.101 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:24:56.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:24:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff646dd0640 1 Processor -- start 2024-09-13T18:24:56.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff646dd0640 1 -- start start 2024-09-13T18:24:56.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff646dd0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6400cfc20 0x7ff640160da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:56.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff646dd0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6401612e0 con 0x7ff64015ca30 2024-09-13T18:24:56.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff646dd0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6400b1b90 con 0x7ff6400ccd80 2024-09-13T18:24:56.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff646dd0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6400cd280 con 0x7ff6400cfc20 2024-09-13T18:24:56.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff63ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6400cfc20 0x7ff640160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:56.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff644b6c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff64015ca30 0x7ff6400cf510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55884/0 (socket says 172.21.15.53:55884) 2024-09-13T18:24:56.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff644b6c640 1 -- 172.21.15.53:0/1294839621 learned_addr learned my addr 172.21.15.53:0/1294839621 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:56.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff63ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6400cfc20 0x7ff640160da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45024/0 (socket says 172.21.15.53:45024) 2024-09-13T18:24:56.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff63ffff640 1 -- 172.21.15.53:0/1294839621 >> v1:172.21.15.87:6789/0 conn(0x7ff6400ccd80 legacy=0x7ff6400d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:56.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff63ffff640 1 -- 172.21.15.53:0/1294839621 >> v1:172.21.15.53:6789/0 conn(0x7ff64015ca30 legacy=0x7ff6400cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff63ffff640 1 -- 172.21.15.53:0/1294839621 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400cd560 con 0x7ff6400cfc20 2024-09-13T18:24:56.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.230+0000 7ff63f7fe640 1 -- 172.21.15.53:0/1294839621 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184329099 0 0) 0x7ff630001120 con 0x7ff64015ca30 2024-09-13T18:24:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff63ffff640 1 --2- 172.21.15.53:0/1294839621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400cfc20 0x7ff640160da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6340097a0 tx=0x7ff63401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d2133e66944890 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff63f7fe640 1 -- 172.21.15.53:0/1294839621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340a8930 con 0x7ff6400cfc20 2024-09-13T18:24:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff63f7fe640 1 -- 172.21.15.53:0/1294839621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6340a8a90 con 0x7ff6400cfc20 2024-09-13T18:24:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff63f7fe640 1 -- 172.21.15.53:0/1294839621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340a8e20 con 0x7ff6400cfc20 2024-09-13T18:24:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 -- 172.21.15.53:0/1294839621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400cfc20 msgr2=0x7ff640160da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 --2- 172.21.15.53:0/1294839621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400cfc20 0x7ff640160da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6340097a0 tx=0x7ff63401ec30 comp rx=0 tx=0).stop 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 -- 172.21.15.53:0/1294839621 shutdown_connections 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 --2- 172.21.15.53:0/1294839621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400cfc20 0x7ff640160da0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 -- 172.21.15.53:0/1294839621 >> 172.21.15.53:0/1294839621 conn(0x7ff640065e50 msgr2=0x7ff640066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 -- 172.21.15.53:0/1294839621 shutdown_connections 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 -- 172.21.15.53:0/1294839621 wait complete. 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 Processor -- start 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.234+0000 7ff646dd0640 1 -- start start 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400ccd80 0x7ff64015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6400cfc20 0x7ff6400b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6400b6500 0x7ff6401f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400b6990 con 0x7ff6400ccd80 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400b1470 con 0x7ff6400cfc20 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6401e7bb0 con 0x7ff6400b6500 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400ccd80 0x7ff64015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400ccd80 0x7ff64015a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45030/0 (socket says 172.21.15.53:45030) 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 -- 172.21.15.53:0/2707964837 learned_addr learned my addr 172.21.15.53:0/2707964837 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff64536d640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6400b6500 0x7ff6401f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff63ffff640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6400cfc20 0x7ff6400b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 -- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6400b6500 msgr2=0x7ff6401f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6400b6500 0x7ff6401f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 -- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6400cfc20 msgr2=0x7ff6400b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6400cfc20 0x7ff6400b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 -- 172.21.15.53:0/2707964837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340093b0 con 0x7ff6400ccd80 2024-09-13T18:24:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff63ffff640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6400cfc20 0x7ff6400b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff644b6c640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400ccd80 0x7ff64015a5c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c4b0 tx=0x7ff63000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff63d7fa640 1 -- 172.21.15.53:0/2707964837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300074e0 con 0x7ff6400ccd80 2024-09-13T18:24:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff63d7fa640 1 -- 172.21.15.53:0/2707964837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630007660 con 0x7ff6400ccd80 2024-09-13T18:24:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6401f6d30 con 0x7ff6400ccd80 2024-09-13T18:24:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff63d7fa640 1 -- 172.21.15.53:0/2707964837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630004a30 con 0x7ff6400ccd80 2024-09-13T18:24:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6401e7560 con 0x7ff6400ccd80 2024-09-13T18:24:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff640160da0 con 0x7ff6400ccd80 2024-09-13T18:24:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff63d7fa640 1 -- 172.21.15.53:0/2707964837 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff630004b90 con 0x7ff6400ccd80 2024-09-13T18:24:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.238+0000 7ff63d7fa640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff62c066690 0x7ff62c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.242+0000 7ff63d7fa640 1 -- 172.21.15.53:0/2707964837 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff630083230 con 0x7ff6400ccd80 2024-09-13T18:24:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.242+0000 7ff63ffff640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff62c066690 0x7ff62c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.242+0000 7ff63ffff640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff62c066690 0x7ff62c068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff6340b2000 tx=0x7ff634008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.242+0000 7ff63d7fa640 1 -- 172.21.15.53:0/2707964837 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff6300542e0 con 0x7ff6400ccd80 2024-09-13T18:24:56.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.406+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff6401612e0 con 0x7ff6400ccd80 2024-09-13T18:24:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.986+0000 7ff63d7fa640 1 -- 172.21.15.53:0/2707964837 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff6401612e0 con 0x7ff6400ccd80 2024-09-13T18:24:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:24:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff62c066690 msgr2=0x7ff62c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff62c066690 0x7ff62c068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff6340b2000 tx=0x7ff634008040 comp rx=0 tx=0).stop 2024-09-13T18:24:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400ccd80 msgr2=0x7ff64015a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400ccd80 0x7ff64015a5c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c4b0 tx=0x7ff63000c970 comp rx=0 tx=0).stop 2024-09-13T18:24:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 shutdown_connections 2024-09-13T18:24:56.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff62c066690 0x7ff62c068b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6400b6500 0x7ff6401f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6400cfc20 0x7ff6400b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 --2- 172.21.15.53:0/2707964837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6400ccd80 0x7ff64015a5c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 >> 172.21.15.53:0/2707964837 conn(0x7ff640065e50 msgr2=0x7ff6400b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 shutdown_connections 2024-09-13T18:24:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:56.990+0000 7ff646dd0640 1 -- 172.21.15.53:0/2707964837 wait complete. 2024-09-13T18:24:57.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:24:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94d06bc640 1 Processor -- start 2024-09-13T18:24:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94d06bc640 1 -- start start 2024-09-13T18:24:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94d06bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94c81460d0 0x7f94c80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94d06bc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c8065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94d06bc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c806d600 con 0x7f94c80661c0 2024-09-13T18:24:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94d06bc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c8066650 con 0x7f94c81460d0 2024-09-13T18:24:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94d06bc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c806d8e0 con 0x7f94c806d080 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94ce458640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94c81460d0 0x7f94c80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94cec59640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f94c80661c0 0x7f94c8070610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48474/0 (socket says 172.21.15.53:48474) 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94cec59640 1 -- 172.21.15.53:0/3075949963 learned_addr learned my addr 172.21.15.53:0/3075949963 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94cdc57640 1 --2- 172.21.15.53:0/3075949963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c8065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94ce458640 1 -- 172.21.15.53:0/3075949963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 msgr2=0x7f94c8065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94ce458640 1 --2- 172.21.15.53:0/3075949963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c8065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94ce458640 1 -- 172.21.15.53:0/3075949963 >> v1:172.21.15.53:6789/0 conn(0x7f94c80661c0 legacy=0x7f94c8070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94cd456640 1 -- 172.21.15.53:0/3075949963 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987999412 0 0) 0x7f94c806d600 con 0x7f94c80661c0 2024-09-13T18:24:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.150+0000 7f94ce458640 1 -- 172.21.15.53:0/3075949963 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c806dbc0 con 0x7f94c81460d0 2024-09-13T18:24:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94ce458640 1 --2- 172.21.15.53:0/3075949963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c81460d0 0x7f94c80b36f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94c40097c0 tx=0x7f94c401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15356e4df8e423f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94cd456640 1 -- 172.21.15.53:0/3075949963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40ac640 con 0x7f94c81460d0 2024-09-13T18:24:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94cd456640 1 -- 172.21.15.53:0/3075949963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c40ac7a0 con 0x7f94c81460d0 2024-09-13T18:24:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94cd456640 1 -- 172.21.15.53:0/3075949963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40acb30 con 0x7f94c81460d0 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- 172.21.15.53:0/3075949963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c81460d0 msgr2=0x7f94c80b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 --2- 172.21.15.53:0/3075949963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c81460d0 0x7f94c80b36f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94c40097c0 tx=0x7f94c401c3e0 comp rx=0 tx=0).stop 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- 172.21.15.53:0/3075949963 shutdown_connections 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 --2- 172.21.15.53:0/3075949963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c8065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 --2- 172.21.15.53:0/3075949963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c81460d0 0x7f94c80b36f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- 172.21.15.53:0/3075949963 >> 172.21.15.53:0/3075949963 conn(0x7f94c8069f50 msgr2=0x7f94c806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- 172.21.15.53:0/3075949963 shutdown_connections 2024-09-13T18:24:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- 172.21.15.53:0/3075949963 wait complete. 2024-09-13T18:24:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 Processor -- start 2024-09-13T18:24:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- start start 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c80661c0 0x7f94c8142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c81416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94c81460d0 0x7f94c80c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8141290 con 0x7f94c80661c0 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8140610 con 0x7f94c81460d0 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94d06bc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c81408f0 con 0x7f94c806d080 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94ce458640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c80661c0 0x7f94c8142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94ce458640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c80661c0 0x7f94c8142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32830/0 (socket says 172.21.15.53:32830) 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.154+0000 7f94ce458640 1 -- 172.21.15.53:0/2871625643 learned_addr learned my addr 172.21.15.53:0/2871625643 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94cdc57640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c81416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94cec59640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94c81460d0 0x7f94c80c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94ce458640 1 -- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 msgr2=0x7f94c81416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94ce458640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c81416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94ce458640 1 -- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94c81460d0 msgr2=0x7f94c80c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94ce458640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94c81460d0 0x7f94c80c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94ce458640 1 -- 172.21.15.53:0/2871625643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4009420 con 0x7f94c80661c0 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94cdc57640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c81416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94cec59640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94c81460d0 0x7f94c80c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94ce458640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c80661c0 0x7f94c8142d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f94c401a010 tx=0x7f94c401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94beffd640 1 -- 172.21.15.53:0/2871625643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40b7650 con 0x7f94c80661c0 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94beffd640 1 -- 172.21.15.53:0/2871625643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c40b77b0 con 0x7f94c80661c0 2024-09-13T18:24:57.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c8140bd0 con 0x7f94c80661c0 2024-09-13T18:24:57.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94beffd640 1 -- 172.21.15.53:0/2871625643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40b7b60 con 0x7f94c80661c0 2024-09-13T18:24:57.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8141bf0 con 0x7f94c80661c0 2024-09-13T18:24:57.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c806aee0 con 0x7f94c80661c0 2024-09-13T18:24:57.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94beffd640 1 -- 172.21.15.53:0/2871625643 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94c40b3070 con 0x7f94c80661c0 2024-09-13T18:24:57.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94beffd640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f94ac066690 0x7f94ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:57.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94beffd640 1 -- 172.21.15.53:0/2871625643 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f94c411e9d0 con 0x7f94c80661c0 2024-09-13T18:24:57.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94cdc57640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f94ac066690 0x7f94ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:57.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.158+0000 7f94cdc57640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f94ac066690 0x7f94ac068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94c81422d0 tx=0x7f94b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:57.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.162+0000 7f94beffd640 1 -- 172.21.15.53:0/2871625643 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94c40ebfb0 con 0x7f94c80661c0 2024-09-13T18:24:57.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.322+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f94c8065c80 con 0x7f94c80661c0 2024-09-13T18:24:57.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:57.994+0000 7f94beffd640 1 -- 172.21.15.53:0/2871625643 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f94c40bb0d0 con 0x7f94c80661c0 2024-09-13T18:24:57.997 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:24:58.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f94ac066690 msgr2=0x7f94ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f94ac066690 0x7f94ac068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94c81422d0 tx=0x7f94b8008040 comp rx=0 tx=0).stop 2024-09-13T18:24:58.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c80661c0 msgr2=0x7f94c8142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c80661c0 0x7f94c8142d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f94c401a010 tx=0x7f94c401ac20 comp rx=0 tx=0).stop 2024-09-13T18:24:58.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 shutdown_connections 2024-09-13T18:24:58.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f94ac066690 0x7f94ac068b50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94c806d080 0x7f94c81416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94c81460d0 0x7f94c80c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 --2- 172.21.15.53:0/2871625643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94c80661c0 0x7f94c8142d50 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f94c401a010 tx=0x7f94c401ac20 comp rx=0 tx=0).stop 2024-09-13T18:24:58.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 >> 172.21.15.53:0/2871625643 conn(0x7f94c8069f50 msgr2=0x7f94c81437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 shutdown_connections 2024-09-13T18:24:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.014+0000 7f94d06bc640 1 -- 172.21.15.53:0/2871625643 wait complete. 2024-09-13T18:24:58.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:24:58.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4e499640 1 Processor -- start 2024-09-13T18:24:58.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4e499640 1 -- start start 2024-09-13T18:24:58.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4e499640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7f4806d410 0x7f7f48167460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4e499640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4806bc90 con 0x7f7f48160320 2024-09-13T18:24:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4e499640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f480b3080 con 0x7f7f48160f30 2024-09-13T18:24:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4e499640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480b2e90 con 0x7f7f4806d410 2024-09-13T18:24:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f47fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f48160320 0x7f7f48160700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48484/0 (socket says 172.21.15.53:48484) 2024-09-13T18:24:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f47fff640 1 -- 172.21.15.53:0/2761642475 learned_addr learned my addr 172.21.15.53:0/2761642475 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:58.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4ca36640 1 --2- 172.21.15.53:0/2761642475 >> v2:172.21.15.53:3300/0 conn(0x7f7f4806d410 0x7f7f48167460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f46ffd640 1 -- 172.21.15.53:0/2761642475 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114276904 0 0) 0x7f7f4806bc90 con 0x7f7f48160320 2024-09-13T18:24:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f46ffd640 1 -- 172.21.15.53:0/2761642475 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f34003530 con 0x7f7f48160320 2024-09-13T18:24:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4ca36640 1 -- 172.21.15.53:0/2761642475 >> v1:172.21.15.87:6789/0 conn(0x7f7f48160f30 legacy=0x7f7f48072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4ca36640 1 -- 172.21.15.53:0/2761642475 >> v1:172.21.15.53:6789/0 conn(0x7f7f48160320 legacy=0x7f7f48160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f46ffd640 1 -- 172.21.15.53:0/2761642475 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3370763235 0 0) 0x7f7f34003530 con 0x7f7f48160320 2024-09-13T18:24:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.166+0000 7f7f4ca36640 1 -- 172.21.15.53:0/2761642475 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480b3360 con 0x7f7f4806d410 2024-09-13T18:24:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4ca36640 1 --2- 172.21.15.53:0/2761642475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f4806d410 0x7f7f48167460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f380097c0 tx=0x7f7f3801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57662dd10cfc91a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f46ffd640 1 -- 172.21.15.53:0/2761642475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40001a00 con 0x7f7f4806d410 2024-09-13T18:24:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f46ffd640 1 -- 172.21.15.53:0/2761642475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f380ac440 con 0x7f7f4806d410 2024-09-13T18:24:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f46ffd640 1 -- 172.21.15.53:0/2761642475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380ac7b0 con 0x7f7f4806d410 2024-09-13T18:24:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4e499640 1 -- 172.21.15.53:0/2761642475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f4806d410 msgr2=0x7f7f48167460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4e499640 1 --2- 172.21.15.53:0/2761642475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f4806d410 0x7f7f48167460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f380097c0 tx=0x7f7f3801c390 comp rx=0 tx=0).stop 2024-09-13T18:24:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4e499640 1 -- 172.21.15.53:0/2761642475 shutdown_connections 2024-09-13T18:24:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4e499640 1 --2- 172.21.15.53:0/2761642475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f4806d410 0x7f7f48167460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4e499640 1 -- 172.21.15.53:0/2761642475 >> 172.21.15.53:0/2761642475 conn(0x7f7f480b0a30 msgr2=0x7f7f480b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4e499640 1 -- 172.21.15.53:0/2761642475 shutdown_connections 2024-09-13T18:24:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.170+0000 7f7f4e499640 1 -- 172.21.15.53:0/2761642475 wait complete. 2024-09-13T18:24:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 Processor -- start 2024-09-13T18:24:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 -- start start 2024-09-13T18:24:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f4806d410 0x7f7f48139660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f48160320 0x7f7f4815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f48160f30 0x7f7f4815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48139ba0 con 0x7f7f48160f30 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48070de0 con 0x7f7f48160320 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f480710c0 con 0x7f7f4806d410 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f48160f30 0x7f7f4815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f48160f30 0x7f7f4815e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32854/0 (socket says 172.21.15.53:32854) 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 -- 172.21.15.53:0/3288633875 learned_addr learned my addr 172.21.15.53:0/3288633875 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f47fff640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f4806d410 0x7f7f48139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f477fe640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f48160320 0x7f7f4815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 -- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f4806d410 msgr2=0x7f7f48139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f4806d410 0x7f7f48139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 -- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f48160320 msgr2=0x7f7f4815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f48160320 0x7f7f4815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 -- 172.21.15.53:0/3288633875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38009420 con 0x7f7f48160f30 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4ca36640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f48160f30 0x7f7f4815e930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f38018fa0 tx=0x7f7f38019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f44ff9640 1 -- 172.21.15.53:0/3288633875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380b5600 con 0x7f7f48160f30 2024-09-13T18:24:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f44ff9640 1 -- 172.21.15.53:0/3288633875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f380b5760 con 0x7f7f48160f30 2024-09-13T18:24:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f44ff9640 1 -- 172.21.15.53:0/3288633875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380b5b10 con 0x7f7f48160f30 2024-09-13T18:24:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f480713a0 con 0x7f7f48160f30 2024-09-13T18:24:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f48150650 con 0x7f7f48160f30 2024-09-13T18:24:58.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f48160700 con 0x7f7f48160f30 2024-09-13T18:24:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.174+0000 7f7f44ff9640 1 -- 172.21.15.53:0/3288633875 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f380b3040 con 0x7f7f48160f30 2024-09-13T18:24:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.178+0000 7f7f44ff9640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f280666c0 0x7f7f28068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.178+0000 7f7f44ff9640 1 -- 172.21.15.53:0/3288633875 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7f3811e350 con 0x7f7f48160f30 2024-09-13T18:24:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.178+0000 7f7f47fff640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f280666c0 0x7f7f28068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.178+0000 7f7f47fff640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f280666c0 0x7f7f28068b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f40005c10 tx=0x7f7f40009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.182+0000 7f7f44ff9640 1 -- 172.21.15.53:0/3288633875 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f380eb7b0 con 0x7f7f48160f30 2024-09-13T18:24:58.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.374+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f480ad230 con 0x7f7f48160f30 2024-09-13T18:24:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.386+0000 7f7f44ff9640 1 -- 172.21.15.53:0/3288633875 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7f380eedd0 con 0x7f7f48160f30 2024-09-13T18:24:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:24:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f280666c0 msgr2=0x7f7f28068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f280666c0 0x7f7f28068b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f40005c10 tx=0x7f7f40009040 comp rx=0 tx=0).stop 2024-09-13T18:24:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f48160f30 msgr2=0x7f7f4815e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f48160f30 0x7f7f4815e930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f38018fa0 tx=0x7f7f38019130 comp rx=0 tx=0).stop 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 shutdown_connections 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f280666c0 0x7f7f28068b80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f48160f30 0x7f7f4815e930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f48160320 0x7f7f4815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 --2- 172.21.15.53:0/3288633875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f4806d410 0x7f7f48139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 >> 172.21.15.53:0/3288633875 conn(0x7f7f480b0a30 msgr2=0x7f7f480b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 shutdown_connections 2024-09-13T18:24:58.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.402+0000 7f7f4e499640 1 -- 172.21.15.53:0/3288633875 wait complete. 2024-09-13T18:24:58.428 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:58.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.542+0000 7f1259ad7640 1 Processor -- start 2024-09-13T18:24:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.542+0000 7f1259ad7640 1 -- start start 2024-09-13T18:24:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1259ad7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125415c830 0x7f12540cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1259ad7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12540b7b40 0x7f12540cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1259ad7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125415cc10 con 0x7f12540d1be0 2024-09-13T18:24:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1259ad7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540b50c0 con 0x7f12540b7b40 2024-09-13T18:24:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1259ad7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b41d0 con 0x7f125415c830 2024-09-13T18:24:58.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1252ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12540b7b40 0x7f12540cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f12537fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125415c830 0x7f12540cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1253fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f12540d1be0 0x7f12540d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33718/0 (socket says 172.21.15.53:33718) 2024-09-13T18:24:58.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1252ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12540b7b40 0x7f12540cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33102/0 (socket says 172.21.15.53:33102) 2024-09-13T18:24:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1253fff640 1 -- 172.21.15.53:0/1779654947 learned_addr learned my addr 172.21.15.53:0/1779654947 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1252ffd640 1 -- 172.21.15.53:0/1779654947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125415c830 msgr2=0x7f12540cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1252ffd640 1 --2- 172.21.15.53:0/1779654947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125415c830 0x7f12540cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1252ffd640 1 -- 172.21.15.53:0/1779654947 >> v1:172.21.15.87:6789/0 conn(0x7f12540d1be0 legacy=0x7f12540d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1252ffd640 1 -- 172.21.15.53:0/1779654947 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540b44b0 con 0x7f12540b7b40 2024-09-13T18:24:58.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f1252ffd640 1 --2- 172.21.15.53:0/1779654947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 0x7f12540cf0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12440097a0 tx=0x7f124401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b14f028caf42d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.546+0000 7f12527fc640 1 -- 172.21.15.53:0/1779654947 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440a8970 con 0x7f12540b7b40 2024-09-13T18:24:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f12527fc640 1 -- 172.21.15.53:0/1779654947 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12440a8ad0 con 0x7f12540b7b40 2024-09-13T18:24:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f12527fc640 1 -- 172.21.15.53:0/1779654947 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440a8e60 con 0x7f12540b7b40 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- 172.21.15.53:0/1779654947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 msgr2=0x7f12540cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 --2- 172.21.15.53:0/1779654947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 0x7f12540cf0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12440097a0 tx=0x7f124401ec70 comp rx=0 tx=0).stop 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- 172.21.15.53:0/1779654947 shutdown_connections 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 --2- 172.21.15.53:0/1779654947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 0x7f12540cf0f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 --2- 172.21.15.53:0/1779654947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125415c830 0x7f12540cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- 172.21.15.53:0/1779654947 >> 172.21.15.53:0/1779654947 conn(0x7f1254070970 msgr2=0x7f1254070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- 172.21.15.53:0/1779654947 shutdown_connections 2024-09-13T18:24:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- 172.21.15.53:0/1779654947 wait complete. 2024-09-13T18:24:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 Processor -- start 2024-09-13T18:24:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- start start 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 0x7f1254152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540d1be0 0x7f1254158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125415c830 0x7f12540cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254157c30 con 0x7f125415c830 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254157e40 con 0x7f12540b7b40 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1254158120 con 0x7f12540d1be0 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125415c830 0x7f12540cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125415c830 0x7f12540cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32860/0 (socket says 172.21.15.53:32860) 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 -- 172.21.15.53:0/193891691 learned_addr learned my addr 172.21.15.53:0/193891691 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f12537fe640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 0x7f1254152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1252ffd640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540d1be0 0x7f1254158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 -- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540d1be0 msgr2=0x7f1254158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540d1be0 0x7f1254158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 -- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 msgr2=0x7f1254152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 0x7f1254152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 -- 172.21.15.53:0/193891691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12440093b0 con 0x7f125415c830 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1253fff640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125415c830 0x7f12540cb8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f124c00cbc0 tx=0x7f124c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f123bfff640 1 -- 172.21.15.53:0/193891691 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00ad40 con 0x7f125415c830 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f123bfff640 1 -- 172.21.15.53:0/193891691 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c012400 con 0x7f125415c830 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1254158400 con 0x7f125415c830 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f123bfff640 1 -- 172.21.15.53:0/193891691 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00aea0 con 0x7f125415c830 2024-09-13T18:24:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.550+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12541589c0 con 0x7f125415c830 2024-09-13T18:24:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.554+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1254158bb0 con 0x7f125415c830 2024-09-13T18:24:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.554+0000 7f123bfff640 1 -- 172.21.15.53:0/193891691 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f124c007070 con 0x7f125415c830 2024-09-13T18:24:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.554+0000 7f123bfff640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066690 0x7f1240068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.554+0000 7f123bfff640 1 -- 172.21.15.53:0/193891691 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f124c083ea0 con 0x7f125415c830 2024-09-13T18:24:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.554+0000 7f12537fe640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066690 0x7f1240068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.554+0000 7f12537fe640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066690 0x7f1240068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1248009ac0 tx=0x7f1248009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.558+0000 7f123bfff640 1 -- 172.21.15.53:0/193891691 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f124c0512d0 con 0x7f125415c830 2024-09-13T18:24:58.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.718+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12540cf0f0 con 0x7f125415c830 2024-09-13T18:24:58.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f123bfff640 1 -- 172.21.15.53:0/193891691 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16458 (secure 0 0 0) 0x7f124c0548f0 con 0x7f125415c830 2024-09-13T18:24:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:58.723 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":19,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:58.379187+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:58.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066690 msgr2=0x7f1240068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066690 0x7f1240068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1248009ac0 tx=0x7f1248009190 comp rx=0 tx=0).stop 2024-09-13T18:24:58.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125415c830 msgr2=0x7f12540cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125415c830 0x7f12540cb8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f124c00cbc0 tx=0x7f124c00a430 comp rx=0 tx=0).stop 2024-09-13T18:24:58.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 shutdown_connections 2024-09-13T18:24:58.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066690 0x7f1240068b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540d1be0 0x7f1254158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125415c830 0x7f12540cb8a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 --2- 172.21.15.53:0/193891691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12540b7b40 0x7f1254152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 >> 172.21.15.53:0/193891691 conn(0x7f1254070970 msgr2=0x7f12540cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:58.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 shutdown_connections 2024-09-13T18:24:58.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.722+0000 7f1259ad7640 1 -- 172.21.15.53:0/193891691 wait complete. 2024-09-13T18:24:58.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:24:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.854+0000 7fe462368640 1 Processor -- start 2024-09-13T18:24:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.854+0000 7fe462368640 1 -- start start 2024-09-13T18:24:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe45c15c750 0x7fe45c0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe45c0ae980 0x7fe45c065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c0ad230 con 0x7fe45c0661c0 2024-09-13T18:24:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c066630 con 0x7fe45c0ae980 2024-09-13T18:24:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0ad510 con 0x7fe45c15c750 2024-09-13T18:24:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe460905640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe45c0661c0 0x7fe45c070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48500/0 (socket says 172.21.15.53:48500) 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe460905640 1 -- 172.21.15.53:0/2256506065 learned_addr learned my addr 172.21.15.53:0/2256506065 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45b7fe640 1 --2- 172.21.15.53:0/2256506065 >> v2:172.21.15.53:3300/0 conn(0x7fe45c0ae980 0x7fe45c065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45bfff640 1 --2- 172.21.15.53:0/2256506065 >> v2:172.21.15.87:3300/0 conn(0x7fe45c15c750 0x7fe45c0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45b7fe640 1 -- 172.21.15.53:0/2256506065 >> v2:172.21.15.87:3300/0 conn(0x7fe45c15c750 msgr2=0x7fe45c0acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45b7fe640 1 --2- 172.21.15.53:0/2256506065 >> v2:172.21.15.87:3300/0 conn(0x7fe45c15c750 0x7fe45c0acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45b7fe640 1 -- 172.21.15.53:0/2256506065 >> v1:172.21.15.53:6789/0 conn(0x7fe45c0661c0 legacy=0x7fe45c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45b7fe640 1 -- 172.21.15.53:0/2256506065 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0ad7f0 con 0x7fe45c0ae980 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45affd640 1 -- 172.21.15.53:0/2256506065 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619613149 0 0) 0x7fe45c0ad230 con 0x7fe45c0661c0 2024-09-13T18:24:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45bfff640 1 --2- 172.21.15.53:0/2256506065 >> v2:172.21.15.87:3300/0 conn(0x7fe45c15c750 0x7fe45c0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45b7fe640 1 --2- 172.21.15.53:0/2256506065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0ae980 0x7fe45c065c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe45c066d70 tx=0x7fe45001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f27589303b531e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45affd640 1 -- 172.21.15.53:0/2256506065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500ab5f0 con 0x7fe45c0ae980 2024-09-13T18:24:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45affd640 1 -- 172.21.15.53:0/2256506065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4500ab750 con 0x7fe45c0ae980 2024-09-13T18:24:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe45affd640 1 -- 172.21.15.53:0/2256506065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500abae0 con 0x7fe45c0ae980 2024-09-13T18:24:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 -- 172.21.15.53:0/2256506065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0ae980 msgr2=0x7fe45c065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 --2- 172.21.15.53:0/2256506065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0ae980 0x7fe45c065c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe45c066d70 tx=0x7fe45001c3f0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 -- 172.21.15.53:0/2256506065 shutdown_connections 2024-09-13T18:24:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 --2- 172.21.15.53:0/2256506065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0ae980 0x7fe45c065c80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 --2- 172.21.15.53:0/2256506065 >> v2:172.21.15.87:3300/0 conn(0x7fe45c15c750 0x7fe45c0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 -- 172.21.15.53:0/2256506065 >> 172.21.15.53:0/2256506065 conn(0x7fe45c0b1310 msgr2=0x7fe45c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.858+0000 7fe462368640 1 -- 172.21.15.53:0/2256506065 shutdown_connections 2024-09-13T18:24:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- 172.21.15.53:0/2256506065 wait complete. 2024-09-13T18:24:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 Processor -- start 2024-09-13T18:24:58.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- start start 2024-09-13T18:24:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0661c0 0x7fe45c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c0ae980 0x7fe45c14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c15c750 0x7fe45c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c14e3f0 con 0x7fe45c0661c0 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c152150 con 0x7fe45c0ae980 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c152360 con 0x7fe45c15c750 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0661c0 0x7fe45c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0661c0 0x7fe45c151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32872/0 (socket says 172.21.15.53:32872) 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 -- 172.21.15.53:0/1649613072 learned_addr learned my addr 172.21.15.53:0/1649613072 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 -- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c15c750 msgr2=0x7fe45c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe460905640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c15c750 0x7fe45c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45b7fe640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c0ae980 0x7fe45c14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c15c750 0x7fe45c153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 -- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c0ae980 msgr2=0x7fe45c14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c0ae980 0x7fe45c14d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 -- 172.21.15.53:0/1649613072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450009420 con 0x7fe45c0661c0 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe45bfff640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0661c0 0x7fe45c151c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00c7f0 tx=0x7fe44c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe458ff9640 1 -- 172.21.15.53:0/1649613072 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c007820 con 0x7fe45c0661c0 2024-09-13T18:24:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe458ff9640 1 -- 172.21.15.53:0/1649613072 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c007980 con 0x7fe45c0661c0 2024-09-13T18:24:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c152640 con 0x7fe45c0661c0 2024-09-13T18:24:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe458ff9640 1 -- 172.21.15.53:0/1649613072 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c007d30 con 0x7fe45c0661c0 2024-09-13T18:24:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c1556d0 con 0x7fe45c0661c0 2024-09-13T18:24:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.862+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c152b60 con 0x7fe45c0661c0 2024-09-13T18:24:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.866+0000 7fe458ff9640 1 -- 172.21.15.53:0/1649613072 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe44c0113f0 con 0x7fe45c0661c0 2024-09-13T18:24:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.866+0000 7fe458ff9640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4480666c0 0x7fe448068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.866+0000 7fe458ff9640 1 -- 172.21.15.53:0/1649613072 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe44c0843d0 con 0x7fe45c0661c0 2024-09-13T18:24:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.866+0000 7fe45b7fe640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4480666c0 0x7fe448068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.866+0000 7fe45b7fe640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4480666c0 0x7fe448068b80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4500af000 tx=0x7fe4500a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:58.870+0000 7fe458ff9640 1 -- 172.21.15.53:0/1649613072 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe45c152b60 con 0x7fe45c0661c0 2024-09-13T18:24:59.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.030+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe45c155530 con 0x7fe45c0661c0 2024-09-13T18:24:59.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe458ff9640 1 -- 172.21.15.53:0/1649613072 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16458 (secure 0 0 0) 0x7fe45c155530 con 0x7fe45c0661c0 2024-09-13T18:24:59.035 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:24:59.035 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":19,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:58.379187+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:24:59.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4480666c0 msgr2=0x7fe448068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4480666c0 0x7fe448068b80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4500af000 tx=0x7fe4500a7000 comp rx=0 tx=0).stop 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0661c0 msgr2=0x7fe45c151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0661c0 0x7fe45c151c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe44c00c7f0 tx=0x7fe44c00ccb0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 shutdown_connections 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4480666c0 0x7fe448068b80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c15c750 0x7fe45c153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c0ae980 0x7fe45c14d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 --2- 172.21.15.53:0/1649613072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0661c0 0x7fe45c151c10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 >> 172.21.15.53:0/1649613072 conn(0x7fe45c0b1310 msgr2=0x7fe45c159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 shutdown_connections 2024-09-13T18:24:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.034+0000 7fe462368640 1 -- 172.21.15.53:0/1649613072 wait complete. 2024-09-13T18:24:59.055 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:24:59.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.182+0000 7feb853ba640 1 Processor -- start 2024-09-13T18:24:59.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.182+0000 7feb853ba640 1 -- start start 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb853ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb80156bc0 0x7feb800b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb853ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb800b2730 0x7feb8006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb853ba640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb800b2b90 con 0x7feb8006bfb0 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb853ba640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8006d340 con 0x7feb80156bc0 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb853ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8006c7c0 con 0x7feb800b2730 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb80156bc0 0x7feb800b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb80156bc0 0x7feb800b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32886/0 (socket says 172.21.15.53:32886) 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 -- 172.21.15.53:0/3291993499 learned_addr learned my addr 172.21.15.53:0/3291993499 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb767fc640 1 --2- 172.21.15.53:0/3291993499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb800b2730 0x7feb8006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 -- 172.21.15.53:0/3291993499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb800b2730 msgr2=0x7feb8006ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 --2- 172.21.15.53:0/3291993499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb800b2730 0x7feb8006ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 -- 172.21.15.53:0/3291993499 >> v1:172.21.15.87:6789/0 conn(0x7feb8006bfb0 legacy=0x7feb80160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:24:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 -- 172.21.15.53:0/3291993499 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8006caa0 con 0x7feb80156bc0 2024-09-13T18:24:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb767fc640 1 --2- 172.21.15.53:0/3291993499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb800b2730 0x7feb8006ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7effd640 1 --2- 172.21.15.53:0/3291993499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb800b21f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb70009870 tx=0x7feb7001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f925feadf65279ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7e7fc640 1 -- 172.21.15.53:0/3291993499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700ab620 con 0x7feb80156bc0 2024-09-13T18:24:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7e7fc640 1 -- 172.21.15.53:0/3291993499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb700ab780 con 0x7feb80156bc0 2024-09-13T18:24:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.186+0000 7feb7e7fc640 1 -- 172.21.15.53:0/3291993499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700abb10 con 0x7feb80156bc0 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- 172.21.15.53:0/3291993499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 msgr2=0x7feb800b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 --2- 172.21.15.53:0/3291993499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb800b21f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb70009870 tx=0x7feb7001c460 comp rx=0 tx=0).stop 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- 172.21.15.53:0/3291993499 shutdown_connections 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 --2- 172.21.15.53:0/3291993499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb800b2730 0x7feb8006ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 --2- 172.21.15.53:0/3291993499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb800b21f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- 172.21.15.53:0/3291993499 >> 172.21.15.53:0/3291993499 conn(0x7feb80069f50 msgr2=0x7feb8006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- 172.21.15.53:0/3291993499 shutdown_connections 2024-09-13T18:24:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- 172.21.15.53:0/3291993499 wait complete. 2024-09-13T18:24:59.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 Processor -- start 2024-09-13T18:24:59.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- start start 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8006bfb0 0x7feb8015f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb800b2730 0x7feb8015ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb8009c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8014a280 con 0x7feb80156bc0 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800ae8a0 con 0x7feb800b2730 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb853ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb800aeb80 con 0x7feb8006bfb0 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb8009c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb8009c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32898/0 (socket says 172.21.15.53:32898) 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb7f7fe640 1 -- 172.21.15.53:0/2094905053 learned_addr learned my addr 172.21.15.53:0/2094905053 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.190+0000 7feb767fc640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb800b2730 0x7feb8015ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7f7fe640 1 -- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8006bfb0 msgr2=0x7feb8015f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7effd640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8006bfb0 0x7feb8015f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7f7fe640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8006bfb0 0x7feb8015f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7f7fe640 1 -- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb800b2730 msgr2=0x7feb8015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7f7fe640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb800b2730 0x7feb8015ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7f7fe640 1 -- 172.21.15.53:0/2094905053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700094d0 con 0x7feb80156bc0 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb767fc640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb800b2730 0x7feb8015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7effd640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8006bfb0 0x7feb8015f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7f7fe640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb8009c0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c780 tx=0x7feb7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb77fff640 1 -- 172.21.15.53:0/2094905053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78004b70 con 0x7feb80156bc0 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb77fff640 1 -- 172.21.15.53:0/2094905053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800ce90 con 0x7feb80156bc0 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb77fff640 1 -- 172.21.15.53:0/2094905053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800a850 con 0x7feb80156bc0 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb800aee60 con 0x7feb80156bc0 2024-09-13T18:24:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb800af420 con 0x7feb80156bc0 2024-09-13T18:24:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8006ba70 con 0x7feb80156bc0 2024-09-13T18:24:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb77fff640 1 -- 172.21.15.53:0/2094905053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb7800a9b0 con 0x7feb80156bc0 2024-09-13T18:24:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb77fff640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb60066690 0x7feb60068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb77fff640 1 -- 172.21.15.53:0/2094905053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb78084340 con 0x7feb80156bc0 2024-09-13T18:24:59.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7effd640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb60066690 0x7feb60068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.194+0000 7feb7effd640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb60066690 0x7feb60068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb700af000 tx=0x7feb70008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.198+0000 7feb77fff640 1 -- 172.21.15.53:0/2094905053 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb780516b0 con 0x7feb80156bc0 2024-09-13T18:24:59.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:24:59.394+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feb800ac740 con 0x7feb80156bc0 2024-09-13T18:25:00.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.386+0000 7feb77fff640 1 -- 172.21.15.53:0/2094905053 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7feb78054cd0 con 0x7feb80156bc0 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb60066690 msgr2=0x7feb60068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb60066690 0x7feb60068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb700af000 tx=0x7feb70008040 comp rx=0 tx=0).stop 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 msgr2=0x7feb8009c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb8009c0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c780 tx=0x7feb7800cc40 comp rx=0 tx=0).stop 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 shutdown_connections 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb60066690 0x7feb60068b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb80156bc0 0x7feb8009c0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb800b2730 0x7feb8015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 --2- 172.21.15.53:0/2094905053 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb8006bfb0 0x7feb8015f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 >> 172.21.15.53:0/2094905053 conn(0x7feb80069f50 msgr2=0x7feb8006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 shutdown_connections 2024-09-13T18:25:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.390+0000 7feb853ba640 1 -- 172.21.15.53:0/2094905053 wait complete. 2024-09-13T18:25:00.409 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:25:00.410 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:25:00.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.530+0000 7fd445b29640 1 Processor -- start 2024-09-13T18:25:00.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.530+0000 7fd445b29640 1 -- start start 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd445b29640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd440143f80 0x7fd4400ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd445b29640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd440066390 0x7fd44015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd445b29640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44006d170 con 0x7fd44006c990 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd445b29640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd440144360 con 0x7fd440066390 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd445b29640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44006d450 con 0x7fd440143f80 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43f7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd440143f80 0x7fd4400ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43f7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd440143f80 0x7fd4400ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52106/0 (socket says 172.21.15.53:52106) 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43f7fe640 1 -- 172.21.15.53:0/3272688318 learned_addr learned my addr 172.21.15.53:0/3272688318 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43ffff640 1 --2- 172.21.15.53:0/3272688318 >> v2:172.21.15.87:3300/0 conn(0x7fd440066390 0x7fd44015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43f7fe640 1 -- 172.21.15.53:0/3272688318 >> v2:172.21.15.87:3300/0 conn(0x7fd440066390 msgr2=0x7fd44015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43f7fe640 1 --2- 172.21.15.53:0/3272688318 >> v2:172.21.15.87:3300/0 conn(0x7fd440066390 0x7fd44015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43f7fe640 1 -- 172.21.15.53:0/3272688318 >> v1:172.21.15.87:6789/0 conn(0x7fd44006c990 legacy=0x7fd440065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:00.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43f7fe640 1 -- 172.21.15.53:0/3272688318 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44006d730 con 0x7fd440143f80 2024-09-13T18:25:00.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.534+0000 7fd43ffff640 1 --2- 172.21.15.53:0/3272688318 >> v2:172.21.15.87:3300/0 conn(0x7fd440066390 0x7fd44015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:00.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd43f7fe640 1 --2- 172.21.15.53:0/3272688318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd440143f80 0x7fd4400ccd10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd430009870 tx=0x7fd43001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a564bf935d2a5055 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:00.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd43e7fc640 1 -- 172.21.15.53:0/3272688318 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300a8a50 con 0x7fd440143f80 2024-09-13T18:25:00.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd43e7fc640 1 -- 172.21.15.53:0/3272688318 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4300a8bb0 con 0x7fd440143f80 2024-09-13T18:25:00.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd43e7fc640 1 -- 172.21.15.53:0/3272688318 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300b0440 con 0x7fd440143f80 2024-09-13T18:25:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- 172.21.15.53:0/3272688318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd440143f80 msgr2=0x7fd4400ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 --2- 172.21.15.53:0/3272688318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd440143f80 0x7fd4400ccd10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd430009870 tx=0x7fd43001ed50 comp rx=0 tx=0).stop 2024-09-13T18:25:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- 172.21.15.53:0/3272688318 shutdown_connections 2024-09-13T18:25:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 --2- 172.21.15.53:0/3272688318 >> v2:172.21.15.87:3300/0 conn(0x7fd440066390 0x7fd44015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 --2- 172.21.15.53:0/3272688318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd440143f80 0x7fd4400ccd10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- 172.21.15.53:0/3272688318 >> 172.21.15.53:0/3272688318 conn(0x7fd4400b1310 msgr2=0x7fd4400b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:00.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- 172.21.15.53:0/3272688318 shutdown_connections 2024-09-13T18:25:00.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- 172.21.15.53:0/3272688318 wait complete. 2024-09-13T18:25:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 Processor -- start 2024-09-13T18:25:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- start start 2024-09-13T18:25:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd440066390 0x7fd44014fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd44006c990 0x7fd44013d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd44013dcb0 0x7fd440070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44013ee30 con 0x7fd44006c990 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44013e220 con 0x7fd440066390 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd445b29640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44013e500 con 0x7fd44013dcb0 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.538+0000 7fd43effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd44006c990 0x7fd44013d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd44006c990 0x7fd44013d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32906/0 (socket says 172.21.15.53:32906) 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 -- 172.21.15.53:0/4030024094 learned_addr learned my addr 172.21.15.53:0/4030024094 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43f7fe640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd440066390 0x7fd44014fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43ffff640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd44013dcb0 0x7fd440070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 -- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd44013dcb0 msgr2=0x7fd440070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd44013dcb0 0x7fd440070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 -- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd440066390 msgr2=0x7fd44014fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd440066390 0x7fd44014fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 -- 172.21.15.53:0/4030024094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd438009a70 con 0x7fd44006c990 2024-09-13T18:25:00.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43effd640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd44006c990 0x7fd44013d410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c3c0 tx=0x7fd43400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd427fff640 1 -- 172.21.15.53:0/4030024094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340052d0 con 0x7fd44006c990 2024-09-13T18:25:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd427fff640 1 -- 172.21.15.53:0/4030024094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434005430 con 0x7fd44006c990 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300094d0 con 0x7fd44006c990 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd427fff640 1 -- 172.21.15.53:0/4030024094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434003840 con 0x7fd44006c990 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44006e390 con 0x7fd44006c990 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44013efe0 con 0x7fd44006c990 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd427fff640 1 -- 172.21.15.53:0/4030024094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4340039a0 con 0x7fd44006c990 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd427fff640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd42c0666c0 0x7fd42c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd427fff640 1 -- 172.21.15.53:0/4030024094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4340836b0 con 0x7fd44006c990 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.542+0000 7fd43f7fe640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd42c0666c0 0x7fd42c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.546+0000 7fd43f7fe640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd42c0666c0 0x7fd42c068b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4300b2000 tx=0x7fd430009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:00.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.546+0000 7fd427fff640 1 -- 172.21.15.53:0/4030024094 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd44013efe0 con 0x7fd44006c990 2024-09-13T18:25:00.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:00.742+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd44006cdb0 con 0x7fd44006c990 2024-09-13T18:25:01.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.390+0000 7fd427fff640 1 -- 172.21.15.53:0/4030024094 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd434050a50 con 0x7fd44006c990 2024-09-13T18:25:01.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd42c0666c0 msgr2=0x7fd42c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd42c0666c0 0x7fd42c068b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4300b2000 tx=0x7fd430009040 comp rx=0 tx=0).stop 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd44006c990 msgr2=0x7fd44013d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd44006c990 0x7fd44013d410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd43400c3c0 tx=0x7fd43400c7c0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 shutdown_connections 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd42c0666c0 0x7fd42c068b80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd44013dcb0 0x7fd440070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd44006c990 0x7fd44013d410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 --2- 172.21.15.53:0/4030024094 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd440066390 0x7fd44014fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 >> 172.21.15.53:0/4030024094 conn(0x7fd4400b1310 msgr2=0x7fd44015aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 shutdown_connections 2024-09-13T18:25:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.394+0000 7fd445b29640 1 -- 172.21.15.53:0/4030024094 wait complete. 2024-09-13T18:25:01.417 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:25:01.417 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:01.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9743936640 1 Processor -- start 2024-09-13T18:25:01.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9743936640 1 -- start start 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9743936640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 0x7f973c0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9743936640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c15dfc0 con 0x7f973c0b4d10 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9743936640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0d12f0 con 0x7f973c06e560 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9743936640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c06f670 con 0x7f973c15dbe0 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9741ed3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f973c0b4d10 0x7f973c0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48502/0 (socket says 172.21.15.53:48502) 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9741ed3640 1 -- 172.21.15.53:0/1923357321 learned_addr learned my addr 172.21.15.53:0/1923357321 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f97416d2640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 0x7f973c0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99483559 0 0) 0x7f973c15dfc0 con 0x7f973c0b4d10 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9728003530 con 0x7f973c0b4d10 2024-09-13T18:25:01.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199377544 0 0) 0x7f9728003530 con 0x7f973c0b4d10 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 msgr2=0x7f973c0b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 0x7f973c0b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 >> v1:172.21.15.87:6789/0 conn(0x7f973c06e560 legacy=0x7f973c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c06e9f0 con 0x7f973c0b4d10 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9734001a00 con 0x7f973c0b4d10 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 >> v1:172.21.15.53:6789/0 conn(0x7f973c0b4d10 legacy=0x7f973c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97280039b0 0x7f9728003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280047d0 0x7f9728004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 0x7f9728005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c06f670 con 0x7f97280039b0 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972800bb50 con 0x7f97280047d0 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972800bd10 con 0x7f973c15dbe0 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f97416d2640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97280039b0 0x7f9728003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9740ed1640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280047d0 0x7f9728004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9741ed3640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 0x7f9728005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f97416d2640 1 -- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 msgr2=0x7f9728005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f97416d2640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 0x7f9728005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f97416d2640 1 -- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280047d0 msgr2=0x7f9728004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f97416d2640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280047d0 0x7f9728004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f97416d2640 1 -- 172.21.15.53:0/1923357321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728003530 con 0x7f97280039b0 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9740ed1640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280047d0 0x7f9728004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:01.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.542+0000 7f9741ed3640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c15dbe0 0x7f9728005260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f97416d2640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97280039b0 0x7f9728003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9738009ae0 tx=0x7f973801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5831389b2e335083 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380a5610 con 0x7f97280039b0 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97380a5770 con 0x7f97280039b0 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9733fff640 1 -- 172.21.15.53:0/1923357321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97380a5b20 con 0x7f97280039b0 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 -- 172.21.15.53:0/1923357321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97280039b0 msgr2=0x7f9728003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 --2- 172.21.15.53:0/1923357321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97280039b0 0x7f9728003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9738009ae0 tx=0x7f973801ca40 comp rx=0 tx=0).stop 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9741ed3640 1 -- 172.21.15.53:0/1923357321 reap_dead start 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 -- 172.21.15.53:0/1923357321 shutdown_connections 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 -- 172.21.15.53:0/1923357321 >> 172.21.15.53:0/1923357321 conn(0x7f973c071ae0 msgr2=0x7f973c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:01.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 -- 172.21.15.53:0/1923357321 shutdown_connections 2024-09-13T18:25:01.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 -- 172.21.15.53:0/1923357321 wait complete. 2024-09-13T18:25:01.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 Processor -- start 2024-09-13T18:25:01.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.546+0000 7f9743936640 1 -- start start 2024-09-13T18:25:01.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280039b0 0x7f973c0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c14e5a0 0x7f973c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f973c158530 0x7f973c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c158ef0 con 0x7f973c158530 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0cdd30 con 0x7f97280039b0 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c14ea20 con 0x7f973c14e5a0 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f973c158530 0x7f973c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f973c158530 0x7f973c1589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32916/0 (socket says 172.21.15.53:32916) 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 -- 172.21.15.53:0/2162300095 learned_addr learned my addr 172.21.15.53:0/2162300095 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f97416d2640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280039b0 0x7f973c0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9740ed1640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c14e5a0 0x7f973c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 -- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c14e5a0 msgr2=0x7f973c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c14e5a0 0x7f973c1522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 -- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280039b0 msgr2=0x7f973c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280039b0 0x7f973c0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 -- 172.21.15.53:0/2162300095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0cda30 con 0x7f973c158530 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9741ed3640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f973c158530 0x7f973c1589b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f973c09a220 tx=0x7f973400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9731ffb640 1 -- 172.21.15.53:0/2162300095 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734004d70 con 0x7f973c158530 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9731ffb640 1 -- 172.21.15.53:0/2162300095 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400bbb0 con 0x7f973c158530 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9731ffb640 1 -- 172.21.15.53:0/2162300095 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734007070 con 0x7f973c158530 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c14fc00 con 0x7f973c158530 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c1501c0 con 0x7f973c158530 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c0d0c90 con 0x7f973c158530 2024-09-13T18:25:01.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9731ffb640 1 -- 172.21.15.53:0/2162300095 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97340071d0 con 0x7f973c158530 2024-09-13T18:25:01.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9731ffb640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9720066690 0x7f9720068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f9731ffb640 1 -- 172.21.15.53:0/2162300095 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9734084570 con 0x7f973c158530 2024-09-13T18:25:01.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.550+0000 7f97416d2640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9720066690 0x7f9720068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.554+0000 7f97416d2640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9720066690 0x7f9720068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97380af000 tx=0x7f97380046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:01.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.554+0000 7f9731ffb640 1 -- 172.21.15.53:0/2162300095 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f97340518e0 con 0x7f973c158530 2024-09-13T18:25:01.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f973c15d3f0 con 0x7f973c158530 2024-09-13T18:25:01.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9731ffb640 1 -- 172.21.15.53:0/2162300095 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7f9734054f00 con 0x7f973c158530 2024-09-13T18:25:01.752 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:01.752 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:01.752 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:01.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9720066690 msgr2=0x7f9720068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9720066690 0x7f9720068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97380af000 tx=0x7f97380046d0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f973c158530 msgr2=0x7f973c1589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f973c158530 0x7f973c1589b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f973c09a220 tx=0x7f973400b4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 shutdown_connections 2024-09-13T18:25:01.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9720066690 0x7f9720068b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f973c14e5a0 0x7f973c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f973c158530 0x7f973c1589b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 --2- 172.21.15.53:0/2162300095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97280039b0 0x7f973c0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 >> 172.21.15.53:0/2162300095 conn(0x7f973c071ae0 msgr2=0x7f973c15be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:01.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 shutdown_connections 2024-09-13T18:25:01.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.750+0000 7f9743936640 1 -- 172.21.15.53:0/2162300095 wait complete. 2024-09-13T18:25:01.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:01.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f924b640 1 Processor -- start 2024-09-13T18:25:01.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f924b640 1 -- start start 2024-09-13T18:25:01.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f924b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f4158ba0 0x7fb7f406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f924b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb7f40cbb60 0x7fb7f40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f924b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40b2340 con 0x7fb7f406f370 2024-09-13T18:25:01.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f924b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f40b2860 con 0x7fb7f40cbb60 2024-09-13T18:25:01.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f924b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f4158f80 con 0x7fb7f4158ba0 2024-09-13T18:25:01.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f2d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f4158ba0 0x7fb7f406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb7f40cbb60 0x7fb7f40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f359e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb7f406f370 0x7fb7f40cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33754/0 (socket says 172.21.15.53:33754) 2024-09-13T18:25:01.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f2d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f4158ba0 0x7fb7f406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52160/0 (socket says 172.21.15.53:52160) 2024-09-13T18:25:01.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f359e640 1 -- 172.21.15.53:0/1373533114 learned_addr learned my addr 172.21.15.53:0/1373533114 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:01.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f2d9d640 1 -- 172.21.15.53:0/1373533114 >> v2:172.21.15.87:3300/0 conn(0x7fb7f40cbb60 msgr2=0x7fb7f40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:01.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f2d9d640 1 --2- 172.21.15.53:0/1373533114 >> v2:172.21.15.87:3300/0 conn(0x7fb7f40cbb60 0x7fb7f40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f2d9d640 1 -- 172.21.15.53:0/1373533114 >> v1:172.21.15.87:6789/0 conn(0x7fb7f406f370 legacy=0x7fb7f40cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f2d9d640 1 -- 172.21.15.53:0/1373533114 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40b2580 con 0x7fb7f4158ba0 2024-09-13T18:25:01.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.890+0000 7fb7f259c640 1 --2- 172.21.15.53:0/1373533114 >> v2:172.21.15.87:3300/0 conn(0x7fb7f40cbb60 0x7fb7f40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:01.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f2d9d640 1 --2- 172.21.15.53:0/1373533114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f4158ba0 0x7fb7f406b390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40097c0 tx=0x7fb7e401e620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a142b85bc1c3e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:01.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f1d9b640 1 -- 172.21.15.53:0/1373533114 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40aa650 con 0x7fb7f4158ba0 2024-09-13T18:25:01.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f1d9b640 1 -- 172.21.15.53:0/1373533114 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e40aa7b0 con 0x7fb7f4158ba0 2024-09-13T18:25:01.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f1d9b640 1 -- 172.21.15.53:0/1373533114 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40aab40 con 0x7fb7f4158ba0 2024-09-13T18:25:01.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- 172.21.15.53:0/1373533114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f4158ba0 msgr2=0x7fb7f406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1373533114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f4158ba0 0x7fb7f406b390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40097c0 tx=0x7fb7e401e620 comp rx=0 tx=0).stop 2024-09-13T18:25:01.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- 172.21.15.53:0/1373533114 shutdown_connections 2024-09-13T18:25:01.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1373533114 >> v2:172.21.15.87:3300/0 conn(0x7fb7f40cbb60 0x7fb7f40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1373533114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f4158ba0 0x7fb7f406b390 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- 172.21.15.53:0/1373533114 >> 172.21.15.53:0/1373533114 conn(0x7fb7f4065c80 msgr2=0x7fb7f4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:01.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- 172.21.15.53:0/1373533114 shutdown_connections 2024-09-13T18:25:01.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- 172.21.15.53:0/1373533114 wait complete. 2024-09-13T18:25:01.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 Processor -- start 2024-09-13T18:25:01.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- start start 2024-09-13T18:25:01.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f406f370 0x7fb7f415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7f40cbb60 0x7fb7f415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7f4158ba0 0x7fb7f415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415bb00 con 0x7fb7f4158ba0 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f4159c90 con 0x7fb7f40cbb60 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f924b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f4159f70 con 0x7fb7f406f370 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7f4158ba0 0x7fb7f415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7f4158ba0 0x7fb7f415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32930/0 (socket says 172.21.15.53:32930) 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.894+0000 7fb7f359e640 1 -- 172.21.15.53:0/1478601004 learned_addr learned my addr 172.21.15.53:0/1478601004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f2d9d640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f406f370 0x7fb7f415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f259c640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7f40cbb60 0x7fb7f415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f359e640 1 -- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f406f370 msgr2=0x7fb7f415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f359e640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f406f370 0x7fb7f415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f359e640 1 -- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7f40cbb60 msgr2=0x7fb7f415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f359e640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7f40cbb60 0x7fb7f415e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f359e640 1 -- 172.21.15.53:0/1478601004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8009420 con 0x7fb7f4158ba0 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f2d9d640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f406f370 0x7fb7f415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f359e640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7f4158ba0 0x7fb7f415e540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00ca80 tx=0x7fb7ec00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7db7fe640 1 -- 172.21.15.53:0/1478601004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00ac30 con 0x7fb7f4158ba0 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e4009420 con 0x7fb7f4158ba0 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7db7fe640 1 -- 172.21.15.53:0/1478601004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00ad90 con 0x7fb7f4158ba0 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7db7fe640 1 -- 172.21.15.53:0/1478601004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec012600 con 0x7fb7f4158ba0 2024-09-13T18:25:01.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f415a530 con 0x7fb7f4158ba0 2024-09-13T18:25:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f4067400 con 0x7fb7f4158ba0 2024-09-13T18:25:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7db7fe640 1 -- 172.21.15.53:0/1478601004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7ec007070 con 0x7fb7f4158ba0 2024-09-13T18:25:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7db7fe640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7e0066690 0x7fb7e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7db7fe640 1 -- 172.21.15.53:0/1478601004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7ec083db0 con 0x7fb7f4158ba0 2024-09-13T18:25:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.898+0000 7fb7f2d9d640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7e0066690 0x7fb7e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.902+0000 7fb7f2d9d640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7e0066690 0x7fb7e0068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40b1000 tx=0x7fb7e40b4040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:01.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:01.902+0000 7fb7db7fe640 1 -- 172.21.15.53:0/1478601004 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7ec0511e0 con 0x7fb7f4158ba0 2024-09-13T18:25:01.965 INFO:tasks.ceph.mds.a.smithi053.stderr:2024-09-13T18:25:01.958+0000 7fd75025a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:25:02.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.062+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f40b2340 con 0x7fb7f4158ba0 2024-09-13T18:25:02.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7db7fe640 1 -- 172.21.15.53:0/1478601004 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fb7f40b2340 con 0x7fb7f4158ba0 2024-09-13T18:25:02.067 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:02.068 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:02.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7e0066690 msgr2=0x7fb7e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7e0066690 0x7fb7e0068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40b1000 tx=0x7fb7e40b4040 comp rx=0 tx=0).stop 2024-09-13T18:25:02.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7f4158ba0 msgr2=0x7fb7f415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7f4158ba0 0x7fb7f415e540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00ca80 tx=0x7fb7ec00cf40 comp rx=0 tx=0).stop 2024-09-13T18:25:02.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 shutdown_connections 2024-09-13T18:25:02.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7e0066690 0x7fb7e0068b50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7f4158ba0 0x7fb7f415e540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7f40cbb60 0x7fb7f415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 --2- 172.21.15.53:0/1478601004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7f406f370 0x7fb7f415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 >> 172.21.15.53:0/1478601004 conn(0x7fb7f4065c80 msgr2=0x7fb7f4067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:02.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 shutdown_connections 2024-09-13T18:25:02.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.066+0000 7fb7f924b640 1 -- 172.21.15.53:0/1478601004 wait complete. 2024-09-13T18:25:02.087 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:25:02.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:25:02.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.210+0000 7f09c8106640 1 Processor -- start 2024-09-13T18:25:02.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.210+0000 7f09c8106640 1 -- start start 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c8106640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f09c00ae330 0x7f09c00ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c8106640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09c015cb40 0x7f09c00ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c8106640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c0157040 con 0x7f09c0065c80 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c8106640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00aec50 con 0x7f09c015cb40 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c8106640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c015d450 con 0x7f09c00ae330 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c56a1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f09c0065c80 0x7f09c006c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48506/0 (socket says 172.21.15.53:48506) 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c56a1640 1 -- 172.21.15.53:0/1033805337 learned_addr learned my addr 172.21.15.53:0/1033805337 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c66a3640 1 --2- 172.21.15.53:0/1033805337 >> v2:172.21.15.53:3300/0 conn(0x7f09c015cb40 0x7f09c00ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c5ea2640 1 --2- 172.21.15.53:0/1033805337 >> v2:172.21.15.87:3300/0 conn(0x7f09c00ae330 0x7f09c00ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c4ea0640 1 -- 172.21.15.53:0/1033805337 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465226666 0 0) 0x7f09c0157040 con 0x7f09c0065c80 2024-09-13T18:25:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c4ea0640 1 -- 172.21.15.53:0/1033805337 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09ac003530 con 0x7f09c0065c80 2024-09-13T18:25:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c66a3640 1 -- 172.21.15.53:0/1033805337 >> v2:172.21.15.87:3300/0 conn(0x7f09c00ae330 msgr2=0x7f09c00ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c66a3640 1 --2- 172.21.15.53:0/1033805337 >> v2:172.21.15.87:3300/0 conn(0x7f09c00ae330 0x7f09c00ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c66a3640 1 -- 172.21.15.53:0/1033805337 >> v1:172.21.15.53:6789/0 conn(0x7f09c0065c80 legacy=0x7f09c006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c66a3640 1 -- 172.21.15.53:0/1033805337 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c015d730 con 0x7f09c015cb40 2024-09-13T18:25:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c66a3640 1 --2- 172.21.15.53:0/1033805337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c015cb40 0x7f09c00ad410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c00b22b0 tx=0x7f09b801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c98094f90b90d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c4ea0640 1 -- 172.21.15.53:0/1033805337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80a59c0 con 0x7f09c015cb40 2024-09-13T18:25:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c4ea0640 1 -- 172.21.15.53:0/1033805337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b80a5b20 con 0x7f09c015cb40 2024-09-13T18:25:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.214+0000 7f09c4ea0640 1 -- 172.21.15.53:0/1033805337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80ad440 con 0x7f09c015cb40 2024-09-13T18:25:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- 172.21.15.53:0/1033805337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c015cb40 msgr2=0x7f09c00ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 --2- 172.21.15.53:0/1033805337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c015cb40 0x7f09c00ad410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c00b22b0 tx=0x7f09b801c900 comp rx=0 tx=0).stop 2024-09-13T18:25:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- 172.21.15.53:0/1033805337 shutdown_connections 2024-09-13T18:25:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 --2- 172.21.15.53:0/1033805337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c015cb40 0x7f09c00ad410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 --2- 172.21.15.53:0/1033805337 >> v2:172.21.15.87:3300/0 conn(0x7f09c00ae330 0x7f09c00ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- 172.21.15.53:0/1033805337 >> 172.21.15.53:0/1033805337 conn(0x7f09c0073130 msgr2=0x7f09c0069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- 172.21.15.53:0/1033805337 shutdown_connections 2024-09-13T18:25:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- 172.21.15.53:0/1033805337 wait complete. 2024-09-13T18:25:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 Processor -- start 2024-09-13T18:25:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- start start 2024-09-13T18:25:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c0065c80 0x7f09c014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c00ae330 0x7f09c014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c015cb40 0x7f09c014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c013a660 con 0x7f09c0065c80 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c01545a0 con 0x7f09c00ae330 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0153c70 con 0x7f09c015cb40 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c0065c80 0x7f09c014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c0065c80 0x7f09c014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32942/0 (socket says 172.21.15.53:32942) 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 -- 172.21.15.53:0/2662062106 learned_addr learned my addr 172.21.15.53:0/2662062106 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 -- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c015cb40 msgr2=0x7f09c014c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c015cb40 0x7f09c014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 -- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c00ae330 msgr2=0x7f09c014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c00ae330 0x7f09c014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 -- 172.21.15.53:0/2662062106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b8009a70 con 0x7f09c0065c80 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c5ea2640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c0065c80 0x7f09c014b720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09b000d800 tx=0x7f09b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09b67fc640 1 -- 172.21.15.53:0/2662062106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000b6c0 con 0x7f09c0065c80 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09b67fc640 1 -- 172.21.15.53:0/2662062106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b000b820 con 0x7f09c0065c80 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c0153f50 con 0x7f09c0065c80 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09b67fc640 1 -- 172.21.15.53:0/2662062106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000bbb0 con 0x7f09c0065c80 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.218+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c0154a30 con 0x7f09c0065c80 2024-09-13T18:25:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.222+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c00ae710 con 0x7f09c0065c80 2024-09-13T18:25:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.222+0000 7f09b67fc640 1 -- 172.21.15.53:0/2662062106 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09b000bd10 con 0x7f09c0065c80 2024-09-13T18:25:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.222+0000 7f09b67fc640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09a4066690 0x7f09a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.222+0000 7f09b67fc640 1 -- 172.21.15.53:0/2662062106 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09b0085120 con 0x7f09c0065c80 2024-09-13T18:25:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.222+0000 7f09c56a1640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09a4066690 0x7f09a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.222+0000 7f09c56a1640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09a4066690 0x7f09a4068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09bc007fd0 tx=0x7f09bc007940 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.226+0000 7f09b67fc640 1 -- 172.21.15.53:0/2662062106 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09b0052570 con 0x7f09c0065c80 2024-09-13T18:25:02.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.378+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09c0153de0 con 0x7f09a4066690 2024-09-13T18:25:02.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.398+0000 7f09b67fc640 1 -- 172.21.15.53:0/2662062106 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264649 (secure 0 0 0) 0x7f09c0153de0 con 0x7f09a4066690 2024-09-13T18:25:02.405 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:02.406 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:25:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09a4066690 msgr2=0x7f09a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09a4066690 0x7f09a4068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09bc007fd0 tx=0x7f09bc007940 comp rx=0 tx=0).stop 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c0065c80 msgr2=0x7f09c014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c0065c80 0x7f09c014b720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09b000d800 tx=0x7f09b000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 shutdown_connections 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09a4066690 0x7f09a4068b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c015cb40 0x7f09c014c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c00ae330 0x7f09c014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 --2- 172.21.15.53:0/2662062106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c0065c80 0x7f09c014b720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 >> 172.21.15.53:0/2662062106 conn(0x7f09c0073130 msgr2=0x7f09c006c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 shutdown_connections 2024-09-13T18:25:02.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.402+0000 7f09c8106640 1 -- 172.21.15.53:0/2662062106 wait complete. 2024-09-13T18:25:02.421 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:25:00.900651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235364,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739356,"statfs":{"total":773094113280,"available":772853100544,"internally_reserved":0,"allocated":2842624,"data_stored":1727444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001150"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.434555+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.432500+0000","last_became_peered":"2024-09-13T18:24:58.432500+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388010+0000","last_change":"2024-09-13T18:24:58.396126+0000","last_active":"2024-09-13T18:24:59.388010+0000","last_peered":"2024-09-13T18:24:59.388010+0000","last_clean":"2024-09-13T18:24:59.388010+0000","last_became_active":"2024-09-13T18:24:58.395863+0000","last_became_peered":"2024-09-13T18:24:58.395863+0000","last_unstale":"2024-09-13T18:24:59.388010+0000","last_undegraded":"2024-09-13T18:24:59.388010+0000","last_fullsized":"2024-09-13T18:24:59.388010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396239+0000","last_change":"2024-09-13T18:24:58.393804+0000","last_active":"2024-09-13T18:24:58.396239+0000","last_peered":"2024-09-13T18:24:58.396239+0000","last_clean":"2024-09-13T18:24:58.396239+0000","last_became_active":"2024-09-13T18:24:58.393534+0000","last_became_peered":"2024-09-13T18:24:58.393534+0000","last_unstale":"2024-09-13T18:24:58.396239+0000","last_undegraded":"2024-09-13T18:24:58.396239+0000","last_fullsized":"2024-09-13T18:24:58.396239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.441877+0000","last_change":"2024-09-13T18:24:58.416846+0000","last_active":"2024-09-13T18:24:58.441877+0000","last_peered":"2024-09-13T18:24:58.441877+0000","last_clean":"2024-09-13T18:24:58.441877+0000","last_became_active":"2024-09-13T18:24:58.415742+0000","last_became_peered":"2024-09-13T18:24:58.415742+0000","last_unstale":"2024-09-13T18:24:58.441877+0000","last_undegraded":"2024-09-13T18:24:58.441877+0000","last_fullsized":"2024-09-13T18:24:58.441877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463377+0000","last_change":"2024-09-13T18:24:58.413407+0000","last_active":"2024-09-13T18:24:59.463377+0000","last_peered":"2024-09-13T18:24:59.463377+0000","last_clean":"2024-09-13T18:24:59.463377+0000","last_became_active":"2024-09-13T18:24:58.412683+0000","last_became_peered":"2024-09-13T18:24:58.412683+0000","last_unstale":"2024-09-13T18:24:59.463377+0000","last_undegraded":"2024-09-13T18:24:59.463377+0000","last_fullsized":"2024-09-13T18:24:59.463377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442493+0000","last_change":"2024-09-13T18:24:58.419676+0000","last_active":"2024-09-13T18:24:58.442493+0000","last_peered":"2024-09-13T18:24:58.442493+0000","last_clean":"2024-09-13T18:24:58.442493+0000","last_became_active":"2024-09-13T18:24:58.418305+0000","last_became_peered":"2024-09-13T18:24:58.418305+0000","last_unstale":"2024-09-13T18:24:58.442493+0000","last_undegraded":"2024-09-13T18:24:58.442493+0000","last_fullsized":"2024-09-13T18:24:58.442493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.878378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462710+0000","last_change":"2024-09-13T18:24:58.409783+0000","last_active":"2024-09-13T18:24:59.462710+0000","last_peered":"2024-09-13T18:24:59.462710+0000","last_clean":"2024-09-13T18:24:59.462710+0000","last_became_active":"2024-09-13T18:24:58.409053+0000","last_became_peered":"2024-09-13T18:24:58.409053+0000","last_unstale":"2024-09-13T18:24:59.462710+0000","last_undegraded":"2024-09-13T18:24:59.462710+0000","last_fullsized":"2024-09-13T18:24:59.462710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:30.448126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669414+0000","last_change":"2024-09-13T18:24:58.420831+0000","last_active":"2024-09-13T18:24:59.669414+0000","last_peered":"2024-09-13T18:24:59.669414+0000","last_clean":"2024-09-13T18:24:59.669414+0000","last_became_active":"2024-09-13T18:24:58.420490+0000","last_became_peered":"2024-09-13T18:24:58.420490+0000","last_unstale":"2024-09-13T18:24:59.669414+0000","last_undegraded":"2024-09-13T18:24:59.669414+0000","last_fullsized":"2024-09-13T18:24:59.669414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.429947+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.429214+0000","last_became_peered":"2024-09-13T18:24:58.429214+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.433224+0000","last_change":"2024-09-13T18:24:58.426881+0000","last_active":"2024-09-13T18:24:58.433224+0000","last_peered":"2024-09-13T18:24:58.433224+0000","last_clean":"2024-09-13T18:24:58.433224+0000","last_became_active":"2024-09-13T18:24:58.425419+0000","last_became_peered":"2024-09-13T18:24:58.425419+0000","last_unstale":"2024-09-13T18:24:58.433224+0000","last_undegraded":"2024-09-13T18:24:58.433224+0000","last_fullsized":"2024-09-13T18:24:58.433224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.435534+0000","last_change":"2024-09-13T18:24:58.430550+0000","last_active":"2024-09-13T18:24:58.435534+0000","last_peered":"2024-09-13T18:24:58.435534+0000","last_clean":"2024-09-13T18:24:58.435534+0000","last_became_active":"2024-09-13T18:24:58.425963+0000","last_became_peered":"2024-09-13T18:24:58.425963+0000","last_unstale":"2024-09-13T18:24:58.435534+0000","last_undegraded":"2024-09-13T18:24:58.435534+0000","last_fullsized":"2024-09-13T18:24:58.435534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389497+0000","last_change":"2024-09-13T18:24:58.431749+0000","last_active":"2024-09-13T18:24:59.389497+0000","last_peered":"2024-09-13T18:24:59.389497+0000","last_clean":"2024-09-13T18:24:59.389497+0000","last_became_active":"2024-09-13T18:24:58.431519+0000","last_became_peered":"2024-09-13T18:24:58.431519+0000","last_unstale":"2024-09-13T18:24:59.389497+0000","last_undegraded":"2024-09-13T18:24:59.389497+0000","last_fullsized":"2024-09-13T18:24:59.389497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670053+0000","last_change":"2024-09-13T18:24:58.423558+0000","last_active":"2024-09-13T18:24:59.670053+0000","last_peered":"2024-09-13T18:24:59.670053+0000","last_clean":"2024-09-13T18:24:59.670053+0000","last_became_active":"2024-09-13T18:24:58.423300+0000","last_became_peered":"2024-09-13T18:24:58.423300+0000","last_unstale":"2024-09-13T18:24:59.670053+0000","last_undegraded":"2024-09-13T18:24:59.670053+0000","last_fullsized":"2024-09-13T18:24:59.670053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.397864+0000","last_change":"2024-09-13T18:24:58.396798+0000","last_active":"2024-09-13T18:24:58.397864+0000","last_peered":"2024-09-13T18:24:58.397864+0000","last_clean":"2024-09-13T18:24:58.397864+0000","last_became_active":"2024-09-13T18:24:58.396451+0000","last_became_peered":"2024-09-13T18:24:58.396451+0000","last_unstale":"2024-09-13T18:24:58.397864+0000","last_undegraded":"2024-09-13T18:24:58.397864+0000","last_fullsized":"2024-09-13T18:24:58.397864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387596+0000","last_change":"2024-09-13T18:24:58.394756+0000","last_active":"2024-09-13T18:24:59.387596+0000","last_peered":"2024-09-13T18:24:59.387596+0000","last_clean":"2024-09-13T18:24:59.387596+0000","last_became_active":"2024-09-13T18:24:58.394413+0000","last_became_peered":"2024-09-13T18:24:58.394413+0000","last_unstale":"2024-09-13T18:24:59.387596+0000","last_undegraded":"2024-09-13T18:24:59.387596+0000","last_fullsized":"2024-09-13T18:24:59.387596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442040+0000","last_change":"2024-09-13T18:24:58.417787+0000","last_active":"2024-09-13T18:24:58.442040+0000","last_peered":"2024-09-13T18:24:58.442040+0000","last_clean":"2024-09-13T18:24:58.442040+0000","last_became_active":"2024-09-13T18:24:58.416849+0000","last_became_peered":"2024-09-13T18:24:58.416849+0000","last_unstale":"2024-09-13T18:24:58.442040+0000","last_undegraded":"2024-09-13T18:24:58.442040+0000","last_fullsized":"2024-09-13T18:24:58.442040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444721+0000","last_change":"2024-09-13T18:24:58.433843+0000","last_active":"2024-09-13T18:24:58.444721+0000","last_peered":"2024-09-13T18:24:58.444721+0000","last_clean":"2024-09-13T18:24:58.444721+0000","last_became_active":"2024-09-13T18:24:58.433147+0000","last_became_peered":"2024-09-13T18:24:58.433147+0000","last_unstale":"2024-09-13T18:24:58.444721+0000","last_undegraded":"2024-09-13T18:24:58.444721+0000","last_fullsized":"2024-09-13T18:24:58.444721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155018+0000","last_change":"2024-09-13T18:24:58.424087+0000","last_active":"2024-09-13T18:25:00.155018+0000","last_peered":"2024-09-13T18:25:00.155018+0000","last_clean":"2024-09-13T18:25:00.155018+0000","last_became_active":"2024-09-13T18:24:58.423760+0000","last_became_peered":"2024-09-13T18:24:58.423760+0000","last_unstale":"2024-09-13T18:25:00.155018+0000","last_undegraded":"2024-09-13T18:25:00.155018+0000","last_fullsized":"2024-09-13T18:25:00.155018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:28.685985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463428+0000","last_change":"2024-09-13T18:24:58.426709+0000","last_active":"2024-09-13T18:24:59.463428+0000","last_peered":"2024-09-13T18:24:59.463428+0000","last_clean":"2024-09-13T18:24:59.463428+0000","last_became_active":"2024-09-13T18:24:58.426073+0000","last_became_peered":"2024-09-13T18:24:58.426073+0000","last_unstale":"2024-09-13T18:24:59.463428+0000","last_undegraded":"2024-09-13T18:24:59.463428+0000","last_fullsized":"2024-09-13T18:24:59.463428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442927+0000","last_change":"2024-09-13T18:24:58.436173+0000","last_active":"2024-09-13T18:24:58.442927+0000","last_peered":"2024-09-13T18:24:58.442927+0000","last_clean":"2024-09-13T18:24:58.442927+0000","last_became_active":"2024-09-13T18:24:58.435428+0000","last_became_peered":"2024-09-13T18:24:58.435428+0000","last_unstale":"2024-09-13T18:24:58.442927+0000","last_undegraded":"2024-09-13T18:24:58.442927+0000","last_fullsized":"2024-09-13T18:24:58.442927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.415405+0000","last_change":"2024-09-13T18:24:58.414497+0000","last_active":"2024-09-13T18:24:58.415405+0000","last_peered":"2024-09-13T18:24:58.415405+0000","last_clean":"2024-09-13T18:24:58.415405+0000","last_became_active":"2024-09-13T18:24:58.414205+0000","last_became_peered":"2024-09-13T18:24:58.414205+0000","last_unstale":"2024-09-13T18:24:58.415405+0000","last_undegraded":"2024-09-13T18:24:58.415405+0000","last_fullsized":"2024-09-13T18:24:58.415405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444674+0000","last_change":"2024-09-13T18:24:58.433694+0000","last_active":"2024-09-13T18:24:58.444674+0000","last_peered":"2024-09-13T18:24:58.444674+0000","last_clean":"2024-09-13T18:24:58.444674+0000","last_became_active":"2024-09-13T18:24:58.432977+0000","last_became_peered":"2024-09-13T18:24:58.432977+0000","last_unstale":"2024-09-13T18:24:58.444674+0000","last_undegraded":"2024-09-13T18:24:58.444674+0000","last_fullsized":"2024-09-13T18:24:58.444674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:20.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669635+0000","last_change":"2024-09-13T18:24:58.399324+0000","last_active":"2024-09-13T18:24:59.669635+0000","last_peered":"2024-09-13T18:24:59.669635+0000","last_clean":"2024-09-13T18:24:59.669635+0000","last_became_active":"2024-09-13T18:24:58.398728+0000","last_became_peered":"2024-09-13T18:24:58.398728+0000","last_unstale":"2024-09-13T18:24:59.669635+0000","last_undegraded":"2024-09-13T18:24:59.669635+0000","last_fullsized":"2024-09-13T18:24:59.669635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442089+0000","last_change":"2024-09-13T18:24:58.418319+0000","last_active":"2024-09-13T18:24:58.442089+0000","last_peered":"2024-09-13T18:24:58.442089+0000","last_clean":"2024-09-13T18:24:58.442089+0000","last_became_active":"2024-09-13T18:24:58.417600+0000","last_became_peered":"2024-09-13T18:24:58.417600+0000","last_unstale":"2024-09-13T18:24:58.442089+0000","last_undegraded":"2024-09-13T18:24:58.442089+0000","last_fullsized":"2024-09-13T18:24:58.442089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670260+0000","last_change":"2024-09-13T18:24:58.434929+0000","last_active":"2024-09-13T18:24:59.670260+0000","last_peered":"2024-09-13T18:24:59.670260+0000","last_clean":"2024-09-13T18:24:59.670260+0000","last_became_active":"2024-09-13T18:24:58.434692+0000","last_became_peered":"2024-09-13T18:24:58.434692+0000","last_unstale":"2024-09-13T18:24:59.670260+0000","last_undegraded":"2024-09-13T18:24:59.670260+0000","last_fullsized":"2024-09-13T18:24:59.670260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.438174+0000","last_change":"2024-09-13T18:24:58.434112+0000","last_active":"2024-09-13T18:24:58.438174+0000","last_peered":"2024-09-13T18:24:58.438174+0000","last_clean":"2024-09-13T18:24:58.438174+0000","last_became_active":"2024-09-13T18:24:58.433715+0000","last_became_peered":"2024-09-13T18:24:58.433715+0000","last_unstale":"2024-09-13T18:24:58.438174+0000","last_undegraded":"2024-09-13T18:24:58.438174+0000","last_fullsized":"2024-09-13T18:24:58.438174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388052+0000","last_change":"2024-09-13T18:24:58.398414+0000","last_active":"2024-09-13T18:24:59.388052+0000","last_peered":"2024-09-13T18:24:59.388052+0000","last_clean":"2024-09-13T18:24:59.388052+0000","last_became_active":"2024-09-13T18:24:58.398137+0000","last_became_peered":"2024-09-13T18:24:58.398137+0000","last_unstale":"2024-09-13T18:24:59.388052+0000","last_undegraded":"2024-09-13T18:24:59.388052+0000","last_fullsized":"2024-09-13T18:24:59.388052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670643+0000","last_change":"2024-09-13T18:24:58.416857+0000","last_active":"2024-09-13T18:24:59.670643+0000","last_peered":"2024-09-13T18:24:59.670643+0000","last_clean":"2024-09-13T18:24:59.670643+0000","last_became_active":"2024-09-13T18:24:58.416500+0000","last_became_peered":"2024-09-13T18:24:58.416500+0000","last_unstale":"2024-09-13T18:24:59.670643+0000","last_undegraded":"2024-09-13T18:24:59.670643+0000","last_fullsized":"2024-09-13T18:24:59.670643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.405217+0000","last_change":"2024-09-13T18:24:58.399395+0000","last_active":"2024-09-13T18:24:58.405217+0000","last_peered":"2024-09-13T18:24:58.405217+0000","last_clean":"2024-09-13T18:24:58.405217+0000","last_became_active":"2024-09-13T18:24:58.399156+0000","last_became_peered":"2024-09-13T18:24:58.399156+0000","last_unstale":"2024-09-13T18:24:58.405217+0000","last_undegraded":"2024-09-13T18:24:58.405217+0000","last_fullsized":"2024-09-13T18:24:58.405217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442443+0000","last_change":"2024-09-13T18:24:58.419100+0000","last_active":"2024-09-13T18:24:58.442443+0000","last_peered":"2024-09-13T18:24:58.442443+0000","last_clean":"2024-09-13T18:24:58.442443+0000","last_became_active":"2024-09-13T18:24:58.416656+0000","last_became_peered":"2024-09-13T18:24:58.416656+0000","last_unstale":"2024-09-13T18:24:58.442443+0000","last_undegraded":"2024-09-13T18:24:58.442443+0000","last_fullsized":"2024-09-13T18:24:58.442443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154711+0000","last_change":"2024-09-13T18:24:58.417573+0000","last_active":"2024-09-13T18:25:00.154711+0000","last_peered":"2024-09-13T18:25:00.154711+0000","last_clean":"2024-09-13T18:25:00.154711+0000","last_became_active":"2024-09-13T18:24:58.417375+0000","last_became_peered":"2024-09-13T18:24:58.417375+0000","last_unstale":"2024-09-13T18:25:00.154711+0000","last_undegraded":"2024-09-13T18:25:00.154711+0000","last_fullsized":"2024-09-13T18:25:00.154711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.426224+0000","last_change":"2024-09-13T18:24:58.420326+0000","last_active":"2024-09-13T18:24:58.426224+0000","last_peered":"2024-09-13T18:24:58.426224+0000","last_clean":"2024-09-13T18:24:58.426224+0000","last_became_active":"2024-09-13T18:24:58.419405+0000","last_became_peered":"2024-09-13T18:24:58.419405+0000","last_unstale":"2024-09-13T18:24:58.426224+0000","last_undegraded":"2024-09-13T18:24:58.426224+0000","last_fullsized":"2024-09-13T18:24:58.426224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389034+0000","last_change":"2024-09-13T18:24:58.395983+0000","last_active":"2024-09-13T18:24:59.389034+0000","last_peered":"2024-09-13T18:24:59.389034+0000","last_clean":"2024-09-13T18:24:59.389034+0000","last_became_active":"2024-09-13T18:24:58.394785+0000","last_became_peered":"2024-09-13T18:24:58.394785+0000","last_unstale":"2024-09-13T18:24:59.389034+0000","last_undegraded":"2024-09-13T18:24:59.389034+0000","last_fullsized":"2024-09-13T18:24:59.389034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.033774+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.033412+0000","last_became_peered":"2024-09-13T18:24:58.033412+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396636+0000","last_change":"2024-09-13T18:24:58.395023+0000","last_active":"2024-09-13T18:24:58.396636+0000","last_peered":"2024-09-13T18:24:58.396636+0000","last_clean":"2024-09-13T18:24:58.396636+0000","last_became_active":"2024-09-13T18:24:58.394639+0000","last_became_peered":"2024-09-13T18:24:58.394639+0000","last_unstale":"2024-09-13T18:24:58.396636+0000","last_undegraded":"2024-09-13T18:24:58.396636+0000","last_fullsized":"2024-09-13T18:24:58.396636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.434921+0000","last_change":"2024-09-13T18:24:58.020182+0000","last_active":"2024-09-13T18:24:58.434921+0000","last_peered":"2024-09-13T18:24:58.434921+0000","last_clean":"2024-09-13T18:24:58.434921+0000","last_became_active":"2024-09-13T18:24:58.019266+0000","last_became_peered":"2024-09-13T18:24:58.019266+0000","last_unstale":"2024-09-13T18:24:58.434921+0000","last_undegraded":"2024-09-13T18:24:58.434921+0000","last_fullsized":"2024-09-13T18:24:58.434921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669944+0000","last_change":"2024-09-13T18:24:58.042697+0000","last_active":"2024-09-13T18:24:59.669944+0000","last_peered":"2024-09-13T18:24:59.669944+0000","last_clean":"2024-09-13T18:24:59.669944+0000","last_became_active":"2024-09-13T18:24:58.042383+0000","last_became_peered":"2024-09-13T18:24:58.042383+0000","last_unstale":"2024-09-13T18:24:59.669944+0000","last_undegraded":"2024-09-13T18:24:59.669944+0000","last_fullsized":"2024-09-13T18:24:59.669944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669716+0000","last_change":"2024-09-13T18:24:58.397945+0000","last_active":"2024-09-13T18:24:59.669716+0000","last_peered":"2024-09-13T18:24:59.669716+0000","last_clean":"2024-09-13T18:24:59.669716+0000","last_became_active":"2024-09-13T18:24:58.397684+0000","last_became_peered":"2024-09-13T18:24:58.397684+0000","last_unstale":"2024-09-13T18:24:59.669716+0000","last_undegraded":"2024-09-13T18:24:59.669716+0000","last_fullsized":"2024-09-13T18:24:59.669716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.402011+0000","last_change":"2024-09-13T18:24:58.025483+0000","last_active":"2024-09-13T18:24:58.402011+0000","last_peered":"2024-09-13T18:24:58.402011+0000","last_clean":"2024-09-13T18:24:58.402011+0000","last_became_active":"2024-09-13T18:24:58.024711+0000","last_became_peered":"2024-09-13T18:24:58.024711+0000","last_unstale":"2024-09-13T18:24:58.402011+0000","last_undegraded":"2024-09-13T18:24:58.402011+0000","last_fullsized":"2024-09-13T18:24:58.402011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387452+0000","last_change":"2024-09-13T18:24:58.398740+0000","last_active":"2024-09-13T18:24:59.387452+0000","last_peered":"2024-09-13T18:24:59.387452+0000","last_clean":"2024-09-13T18:24:59.387452+0000","last_became_active":"2024-09-13T18:24:58.397892+0000","last_became_peered":"2024-09-13T18:24:58.397892+0000","last_unstale":"2024-09-13T18:24:59.387452+0000","last_undegraded":"2024-09-13T18:24:59.387452+0000","last_fullsized":"2024-09-13T18:24:59.387452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.403397+0000","last_change":"2024-09-13T18:24:58.041368+0000","last_active":"2024-09-13T18:24:58.403397+0000","last_peered":"2024-09-13T18:24:58.403397+0000","last_clean":"2024-09-13T18:24:58.403397+0000","last_became_active":"2024-09-13T18:24:58.040649+0000","last_became_peered":"2024-09-13T18:24:58.040649+0000","last_unstale":"2024-09-13T18:24:58.403397+0000","last_undegraded":"2024-09-13T18:24:58.403397+0000","last_fullsized":"2024-09-13T18:24:58.403397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444564+0000","last_change":"2024-09-13T18:24:58.431883+0000","last_active":"2024-09-13T18:24:58.444564+0000","last_peered":"2024-09-13T18:24:58.444564+0000","last_clean":"2024-09-13T18:24:58.444564+0000","last_became_active":"2024-09-13T18:24:58.431214+0000","last_became_peered":"2024-09-13T18:24:58.431214+0000","last_unstale":"2024-09-13T18:24:58.444564+0000","last_undegraded":"2024-09-13T18:24:58.444564+0000","last_fullsized":"2024-09-13T18:24:58.444564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.404236+0000","last_change":"2024-09-13T18:24:58.042813+0000","last_active":"2024-09-13T18:24:58.404236+0000","last_peered":"2024-09-13T18:24:58.404236+0000","last_clean":"2024-09-13T18:24:58.404236+0000","last_became_active":"2024-09-13T18:24:58.042035+0000","last_became_peered":"2024-09-13T18:24:58.042035+0000","last_unstale":"2024-09-13T18:24:58.404236+0000","last_undegraded":"2024-09-13T18:24:58.404236+0000","last_fullsized":"2024-09-13T18:24:58.404236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.418957+0000","last_change":"2024-09-13T18:24:58.418140+0000","last_active":"2024-09-13T18:24:58.418957+0000","last_peered":"2024-09-13T18:24:58.418957+0000","last_clean":"2024-09-13T18:24:58.418957+0000","last_became_active":"2024-09-13T18:24:58.417892+0000","last_became_peered":"2024-09-13T18:24:58.417892+0000","last_unstale":"2024-09-13T18:24:58.418957+0000","last_undegraded":"2024-09-13T18:24:58.418957+0000","last_fullsized":"2024-09-13T18:24:58.418957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388168+0000","last_change":"2024-09-13T18:24:58.031378+0000","last_active":"2024-09-13T18:24:59.388168+0000","last_peered":"2024-09-13T18:24:59.388168+0000","last_clean":"2024-09-13T18:24:59.388168+0000","last_became_active":"2024-09-13T18:24:58.031086+0000","last_became_peered":"2024-09-13T18:24:58.031086+0000","last_unstale":"2024-09-13T18:24:59.388168+0000","last_undegraded":"2024-09-13T18:24:59.388168+0000","last_fullsized":"2024-09-13T18:24:59.388168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389663+0000","last_change":"2024-09-13T18:24:58.430392+0000","last_active":"2024-09-13T18:24:59.389663+0000","last_peered":"2024-09-13T18:24:59.389663+0000","last_clean":"2024-09-13T18:24:59.389663+0000","last_became_active":"2024-09-13T18:24:58.429654+0000","last_became_peered":"2024-09-13T18:24:58.429654+0000","last_unstale":"2024-09-13T18:24:59.389663+0000","last_undegraded":"2024-09-13T18:24:59.389663+0000","last_fullsized":"2024-09-13T18:24:59.389663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:27.851864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.443064+0000","last_change":"2024-09-13T18:24:58.039451+0000","last_active":"2024-09-13T18:24:58.443064+0000","last_peered":"2024-09-13T18:24:58.443064+0000","last_clean":"2024-09-13T18:24:58.443064+0000","last_became_active":"2024-09-13T18:24:58.032328+0000","last_became_peered":"2024-09-13T18:24:58.032328+0000","last_unstale":"2024-09-13T18:24:58.443064+0000","last_undegraded":"2024-09-13T18:24:58.443064+0000","last_fullsized":"2024-09-13T18:24:58.443064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463120+0000","last_change":"2024-09-13T18:24:58.409551+0000","last_active":"2024-09-13T18:24:59.463120+0000","last_peered":"2024-09-13T18:24:59.463120+0000","last_clean":"2024-09-13T18:24:59.463120+0000","last_became_active":"2024-09-13T18:24:58.407831+0000","last_became_peered":"2024-09-13T18:24:58.407831+0000","last_unstale":"2024-09-13T18:24:59.463120+0000","last_undegraded":"2024-09-13T18:24:59.463120+0000","last_fullsized":"2024-09-13T18:24:59.463120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442504+0000","last_change":"2024-09-13T18:24:58.027528+0000","last_active":"2024-09-13T18:24:58.442504+0000","last_peered":"2024-09-13T18:24:58.442504+0000","last_clean":"2024-09-13T18:24:58.442504+0000","last_became_active":"2024-09-13T18:24:58.027248+0000","last_became_peered":"2024-09-13T18:24:58.027248+0000","last_unstale":"2024-09-13T18:24:58.442504+0000","last_undegraded":"2024-09-13T18:24:58.442504+0000","last_fullsized":"2024-09-13T18:24:58.442504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.415417+0000","last_change":"2024-09-13T18:24:58.414607+0000","last_active":"2024-09-13T18:24:58.415417+0000","last_peered":"2024-09-13T18:24:58.415417+0000","last_clean":"2024-09-13T18:24:58.415417+0000","last_became_active":"2024-09-13T18:24:58.414310+0000","last_became_peered":"2024-09-13T18:24:58.414310+0000","last_unstale":"2024-09-13T18:24:58.415417+0000","last_undegraded":"2024-09-13T18:24:58.415417+0000","last_fullsized":"2024-09-13T18:24:58.415417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.407667+0000","last_change":"2024-09-13T18:24:58.032711+0000","last_active":"2024-09-13T18:24:58.407667+0000","last_peered":"2024-09-13T18:24:58.407667+0000","last_clean":"2024-09-13T18:24:58.407667+0000","last_became_active":"2024-09-13T18:24:58.030671+0000","last_became_peered":"2024-09-13T18:24:58.030671+0000","last_unstale":"2024-09-13T18:24:58.407667+0000","last_undegraded":"2024-09-13T18:24:58.407667+0000","last_fullsized":"2024-09-13T18:24:58.407667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:21.674116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463490+0000","last_change":"2024-09-13T18:24:58.439918+0000","last_active":"2024-09-13T18:24:59.463490+0000","last_peered":"2024-09-13T18:24:59.463490+0000","last_clean":"2024-09-13T18:24:59.463490+0000","last_became_active":"2024-09-13T18:24:58.439353+0000","last_became_peered":"2024-09-13T18:24:58.439353+0000","last_unstale":"2024-09-13T18:24:59.463490+0000","last_undegraded":"2024-09-13T18:24:59.463490+0000","last_fullsized":"2024-09-13T18:24:59.463490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.403230+0000","last_change":"2024-09-13T18:24:58.028233+0000","last_active":"2024-09-13T18:24:58.403230+0000","last_peered":"2024-09-13T18:24:58.403230+0000","last_clean":"2024-09-13T18:24:58.403230+0000","last_became_active":"2024-09-13T18:24:58.027484+0000","last_became_peered":"2024-09-13T18:24:58.027484+0000","last_unstale":"2024-09-13T18:24:58.403230+0000","last_undegraded":"2024-09-13T18:24:58.403230+0000","last_fullsized":"2024-09-13T18:24:58.403230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.427722+0000","last_change":"2024-09-13T18:24:58.425519+0000","last_active":"2024-09-13T18:24:58.427722+0000","last_peered":"2024-09-13T18:24:58.427722+0000","last_clean":"2024-09-13T18:24:58.427722+0000","last_became_active":"2024-09-13T18:24:58.421201+0000","last_became_peered":"2024-09-13T18:24:58.421201+0000","last_unstale":"2024-09-13T18:24:58.427722+0000","last_undegraded":"2024-09-13T18:24:58.427722+0000","last_fullsized":"2024-09-13T18:24:58.427722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154679+0000","last_change":"2024-09-13T18:24:58.015803+0000","last_active":"2024-09-13T18:25:00.154679+0000","last_peered":"2024-09-13T18:25:00.154679+0000","last_clean":"2024-09-13T18:25:00.154679+0000","last_became_active":"2024-09-13T18:24:58.015460+0000","last_became_peered":"2024-09-13T18:24:58.015460+0000","last_unstale":"2024-09-13T18:25:00.154679+0000","last_undegraded":"2024-09-13T18:25:00.154679+0000","last_fullsized":"2024-09-13T18:25:00.154679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463015+0000","last_change":"2024-09-13T18:24:58.439925+0000","last_active":"2024-09-13T18:24:59.463015+0000","last_peered":"2024-09-13T18:24:59.463015+0000","last_clean":"2024-09-13T18:24:59.463015+0000","last_became_active":"2024-09-13T18:24:58.439310+0000","last_became_peered":"2024-09-13T18:24:58.439310+0000","last_unstale":"2024-09-13T18:24:59.463015+0000","last_undegraded":"2024-09-13T18:24:59.463015+0000","last_fullsized":"2024-09-13T18:24:59.463015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389428+0000","last_change":"2024-09-13T18:24:58.024579+0000","last_active":"2024-09-13T18:24:59.389428+0000","last_peered":"2024-09-13T18:24:59.389428+0000","last_clean":"2024-09-13T18:24:59.389428+0000","last_became_active":"2024-09-13T18:24:58.023234+0000","last_became_peered":"2024-09-13T18:24:58.023234+0000","last_unstale":"2024-09-13T18:24:59.389428+0000","last_undegraded":"2024-09-13T18:24:59.389428+0000","last_fullsized":"2024-09-13T18:24:59.389428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463655+0000","last_change":"2024-09-13T18:24:58.439656+0000","last_active":"2024-09-13T18:24:59.463655+0000","last_peered":"2024-09-13T18:24:59.463655+0000","last_clean":"2024-09-13T18:24:59.463655+0000","last_became_active":"2024-09-13T18:24:58.439013+0000","last_became_peered":"2024-09-13T18:24:58.439013+0000","last_unstale":"2024-09-13T18:24:59.463655+0000","last_undegraded":"2024-09-13T18:24:59.463655+0000","last_fullsized":"2024-09-13T18:24:59.463655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155004+0000","last_change":"2024-09-13T18:24:58.013601+0000","last_active":"2024-09-13T18:25:00.155004+0000","last_peered":"2024-09-13T18:25:00.155004+0000","last_clean":"2024-09-13T18:25:00.155004+0000","last_became_active":"2024-09-13T18:24:58.012977+0000","last_became_peered":"2024-09-13T18:24:58.012977+0000","last_unstale":"2024-09-13T18:25:00.155004+0000","last_undegraded":"2024-09-13T18:25:00.155004+0000","last_fullsized":"2024-09-13T18:25:00.155004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.464058+0000","last_change":"2024-09-13T18:24:58.440756+0000","last_active":"2024-09-13T18:24:59.464058+0000","last_peered":"2024-09-13T18:24:59.464058+0000","last_clean":"2024-09-13T18:24:59.464058+0000","last_became_active":"2024-09-13T18:24:58.440064+0000","last_became_peered":"2024-09-13T18:24:58.440064+0000","last_unstale":"2024-09-13T18:24:59.464058+0000","last_undegraded":"2024-09-13T18:24:59.464058+0000","last_fullsized":"2024-09-13T18:24:59.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388284+0000","last_change":"2024-09-13T18:24:58.021101+0000","last_active":"2024-09-13T18:24:59.388284+0000","last_peered":"2024-09-13T18:24:59.388284+0000","last_clean":"2024-09-13T18:24:59.388284+0000","last_became_active":"2024-09-13T18:24:58.020782+0000","last_became_peered":"2024-09-13T18:24:58.020782+0000","last_unstale":"2024-09-13T18:24:59.388284+0000","last_undegraded":"2024-09-13T18:24:59.388284+0000","last_fullsized":"2024-09-13T18:24:59.388284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.441907+0000","last_change":"2024-09-13T18:24:58.417213+0000","last_active":"2024-09-13T18:24:58.441907+0000","last_peered":"2024-09-13T18:24:58.441907+0000","last_clean":"2024-09-13T18:24:58.441907+0000","last_became_active":"2024-09-13T18:24:58.415708+0000","last_became_peered":"2024-09-13T18:24:58.415708+0000","last_unstale":"2024-09-13T18:24:58.441907+0000","last_undegraded":"2024-09-13T18:24:58.441907+0000","last_fullsized":"2024-09-13T18:24:58.441907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155281+0000","last_change":"2024-09-13T18:24:58.017225+0000","last_active":"2024-09-13T18:25:00.155281+0000","last_peered":"2024-09-13T18:25:00.155281+0000","last_clean":"2024-09-13T18:25:00.155281+0000","last_became_active":"2024-09-13T18:24:58.016815+0000","last_became_peered":"2024-09-13T18:24:58.016815+0000","last_unstale":"2024-09-13T18:25:00.155281+0000","last_undegraded":"2024-09-13T18:25:00.155281+0000","last_fullsized":"2024-09-13T18:25:00.155281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463041+0000","last_change":"2024-09-13T18:24:58.425095+0000","last_active":"2024-09-13T18:24:59.463041+0000","last_peered":"2024-09-13T18:24:59.463041+0000","last_clean":"2024-09-13T18:24:59.463041+0000","last_became_active":"2024-09-13T18:24:58.424483+0000","last_became_peered":"2024-09-13T18:24:58.424483+0000","last_unstale":"2024-09-13T18:24:59.463041+0000","last_undegraded":"2024-09-13T18:24:59.463041+0000","last_fullsized":"2024-09-13T18:24:59.463041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396354+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:24:58.396354+0000","last_peered":"2024-09-13T18:24:58.396354+0000","last_clean":"2024-09-13T18:24:58.396354+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:24:58.396354+0000","last_undegraded":"2024-09-13T18:24:58.396354+0000","last_fullsized":"2024-09-13T18:24:58.396354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.400246+0000","last_change":"2024-09-13T18:24:58.029698+0000","last_active":"2024-09-13T18:24:58.400246+0000","last_peered":"2024-09-13T18:24:58.400246+0000","last_clean":"2024-09-13T18:24:58.400246+0000","last_became_active":"2024-09-13T18:24:58.028952+0000","last_became_peered":"2024-09-13T18:24:58.028952+0000","last_unstale":"2024-09-13T18:24:58.400246+0000","last_undegraded":"2024-09-13T18:24:58.400246+0000","last_fullsized":"2024-09-13T18:24:58.400246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670059+0000","last_change":"2024-09-13T18:24:58.421648+0000","last_active":"2024-09-13T18:24:59.670059+0000","last_peered":"2024-09-13T18:24:59.670059+0000","last_clean":"2024-09-13T18:24:59.670059+0000","last_became_active":"2024-09-13T18:24:58.421356+0000","last_became_peered":"2024-09-13T18:24:58.421356+0000","last_unstale":"2024-09-13T18:24:59.670059+0000","last_undegraded":"2024-09-13T18:24:59.670059+0000","last_fullsized":"2024-09-13T18:24:59.670059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462728+0000","last_change":"2024-09-13T18:24:58.034925+0000","last_active":"2024-09-13T18:24:59.462728+0000","last_peered":"2024-09-13T18:24:59.462728+0000","last_clean":"2024-09-13T18:24:59.462728+0000","last_became_active":"2024-09-13T18:24:58.033842+0000","last_became_peered":"2024-09-13T18:24:58.033842+0000","last_unstale":"2024-09-13T18:24:59.462728+0000","last_undegraded":"2024-09-13T18:24:59.462728+0000","last_fullsized":"2024-09-13T18:24:59.462728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396346+0000","last_change":"2024-09-13T18:24:58.394853+0000","last_active":"2024-09-13T18:24:58.396346+0000","last_peered":"2024-09-13T18:24:58.396346+0000","last_clean":"2024-09-13T18:24:58.396346+0000","last_became_active":"2024-09-13T18:24:58.394595+0000","last_became_peered":"2024-09-13T18:24:58.394595+0000","last_unstale":"2024-09-13T18:24:58.396346+0000","last_undegraded":"2024-09-13T18:24:58.396346+0000","last_fullsized":"2024-09-13T18:24:58.396346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154842+0000","last_change":"2024-09-13T18:24:58.012966+0000","last_active":"2024-09-13T18:25:00.154842+0000","last_peered":"2024-09-13T18:25:00.154842+0000","last_clean":"2024-09-13T18:25:00.154842+0000","last_became_active":"2024-09-13T18:24:58.012406+0000","last_became_peered":"2024-09-13T18:24:58.012406+0000","last_unstale":"2024-09-13T18:25:00.154842+0000","last_undegraded":"2024-09-13T18:25:00.154842+0000","last_fullsized":"2024-09-13T18:25:00.154842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387622+0000","last_change":"2024-09-13T18:24:58.395770+0000","last_active":"2024-09-13T18:24:59.387622+0000","last_peered":"2024-09-13T18:24:59.387622+0000","last_clean":"2024-09-13T18:24:59.387622+0000","last_became_active":"2024-09-13T18:24:58.395459+0000","last_became_peered":"2024-09-13T18:24:58.395459+0000","last_unstale":"2024-09-13T18:24:59.387622+0000","last_undegraded":"2024-09-13T18:24:59.387622+0000","last_fullsized":"2024-09-13T18:24:59.387622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.408012+0000","last_change":"2024-09-13T18:24:58.033195+0000","last_active":"2024-09-13T18:24:58.408012+0000","last_peered":"2024-09-13T18:24:58.408012+0000","last_clean":"2024-09-13T18:24:58.408012+0000","last_became_active":"2024-09-13T18:24:58.032049+0000","last_became_peered":"2024-09-13T18:24:58.032049+0000","last_unstale":"2024-09-13T18:24:58.408012+0000","last_undegraded":"2024-09-13T18:24:58.408012+0000","last_fullsized":"2024-09-13T18:24:58.408012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389525+0000","last_change":"2024-09-13T18:24:58.392965+0000","last_active":"2024-09-13T18:24:59.389525+0000","last_peered":"2024-09-13T18:24:59.389525+0000","last_clean":"2024-09-13T18:24:59.389525+0000","last_became_active":"2024-09-13T18:24:58.392228+0000","last_became_peered":"2024-09-13T18:24:58.392228+0000","last_unstale":"2024-09-13T18:24:59.389525+0000","last_undegraded":"2024-09-13T18:24:59.389525+0000","last_fullsized":"2024-09-13T18:24:59.389525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387904+0000","last_change":"2024-09-13T18:24:58.014413+0000","last_active":"2024-09-13T18:24:59.387904+0000","last_peered":"2024-09-13T18:24:59.387904+0000","last_clean":"2024-09-13T18:24:59.387904+0000","last_became_active":"2024-09-13T18:24:58.013907+0000","last_became_peered":"2024-09-13T18:24:58.013907+0000","last_unstale":"2024-09-13T18:24:59.387904+0000","last_undegraded":"2024-09-13T18:24:59.387904+0000","last_fullsized":"2024-09-13T18:24:59.387904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442349+0000","last_change":"2024-09-13T18:24:58.416160+0000","last_active":"2024-09-13T18:24:58.442349+0000","last_peered":"2024-09-13T18:24:58.442349+0000","last_clean":"2024-09-13T18:24:58.442349+0000","last_became_active":"2024-09-13T18:24:58.415331+0000","last_became_peered":"2024-09-13T18:24:58.415331+0000","last_unstale":"2024-09-13T18:24:58.442349+0000","last_undegraded":"2024-09-13T18:24:58.442349+0000","last_fullsized":"2024-09-13T18:24:58.442349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463346+0000","last_change":"2024-09-13T18:24:58.038596+0000","last_active":"2024-09-13T18:24:59.463346+0000","last_peered":"2024-09-13T18:24:59.463346+0000","last_clean":"2024-09-13T18:24:59.463346+0000","last_became_active":"2024-09-13T18:24:58.037754+0000","last_became_peered":"2024-09-13T18:24:58.037754+0000","last_unstale":"2024-09-13T18:24:59.463346+0000","last_undegraded":"2024-09-13T18:24:59.463346+0000","last_fullsized":"2024-09-13T18:24:59.463346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387779+0000","last_change":"2024-09-13T18:24:58.395308+0000","last_active":"2024-09-13T18:24:59.387779+0000","last_peered":"2024-09-13T18:24:59.387779+0000","last_clean":"2024-09-13T18:24:59.387779+0000","last_became_active":"2024-09-13T18:24:58.394989+0000","last_became_peered":"2024-09-13T18:24:58.394989+0000","last_unstale":"2024-09-13T18:24:59.387779+0000","last_undegraded":"2024-09-13T18:24:59.387779+0000","last_fullsized":"2024-09-13T18:24:59.387779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388196+0000","last_change":"2024-09-13T18:24:58.043141+0000","last_active":"2024-09-13T18:24:59.388196+0000","last_peered":"2024-09-13T18:24:59.388196+0000","last_clean":"2024-09-13T18:24:59.388196+0000","last_became_active":"2024-09-13T18:24:58.042796+0000","last_became_peered":"2024-09-13T18:24:58.042796+0000","last_unstale":"2024-09-13T18:24:59.388196+0000","last_undegraded":"2024-09-13T18:24:59.388196+0000","last_fullsized":"2024-09-13T18:24:59.388196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670417+0000","last_change":"2024-09-13T18:24:58.415075+0000","last_active":"2024-09-13T18:24:59.670417+0000","last_peered":"2024-09-13T18:24:59.670417+0000","last_clean":"2024-09-13T18:24:59.670417+0000","last_became_active":"2024-09-13T18:24:58.414794+0000","last_became_peered":"2024-09-13T18:24:58.414794+0000","last_unstale":"2024-09-13T18:24:59.670417+0000","last_undegraded":"2024-09-13T18:24:59.670417+0000","last_fullsized":"2024-09-13T18:24:59.670417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:02.097074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442490+0000","last_change":"2024-09-13T18:24:58.040550+0000","last_active":"2024-09-13T18:24:58.442490+0000","last_peered":"2024-09-13T18:24:58.442490+0000","last_clean":"2024-09-13T18:24:58.442490+0000","last_became_active":"2024-09-13T18:24:58.039933+0000","last_became_peered":"2024-09-13T18:24:58.039933+0000","last_unstale":"2024-09-13T18:24:58.442490+0000","last_undegraded":"2024-09-13T18:24:58.442490+0000","last_fullsized":"2024-09-13T18:24:58.442490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.398949+0000","last_change":"2024-09-13T18:24:58.397002+0000","last_active":"2024-09-13T18:24:58.398949+0000","last_peered":"2024-09-13T18:24:58.398949+0000","last_clean":"2024-09-13T18:24:58.398949+0000","last_became_active":"2024-09-13T18:24:58.396735+0000","last_became_peered":"2024-09-13T18:24:58.396735+0000","last_unstale":"2024-09-13T18:24:58.398949+0000","last_undegraded":"2024-09-13T18:24:58.398949+0000","last_fullsized":"2024-09-13T18:24:58.398949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462686+0000","last_change":"2024-09-13T18:24:58.033754+0000","last_active":"2024-09-13T18:24:59.462686+0000","last_peered":"2024-09-13T18:24:59.462686+0000","last_clean":"2024-09-13T18:24:59.462686+0000","last_became_active":"2024-09-13T18:24:58.031165+0000","last_became_peered":"2024-09-13T18:24:58.031165+0000","last_unstale":"2024-09-13T18:24:59.462686+0000","last_undegraded":"2024-09-13T18:24:59.462686+0000","last_fullsized":"2024-09-13T18:24:59.462686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389086+0000","last_change":"2024-09-13T18:24:58.394401+0000","last_active":"2024-09-13T18:24:59.389086+0000","last_peered":"2024-09-13T18:24:59.389086+0000","last_clean":"2024-09-13T18:24:59.389086+0000","last_became_active":"2024-09-13T18:24:58.392351+0000","last_became_peered":"2024-09-13T18:24:58.392351+0000","last_unstale":"2024-09-13T18:24:59.389086+0000","last_undegraded":"2024-09-13T18:24:59.389086+0000","last_fullsized":"2024-09-13T18:24:59.389086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387555+0000","last_change":"2024-09-13T18:24:58.034526+0000","last_active":"2024-09-13T18:24:59.387555+0000","last_peered":"2024-09-13T18:24:59.387555+0000","last_clean":"2024-09-13T18:24:59.387555+0000","last_became_active":"2024-09-13T18:24:58.034217+0000","last_became_peered":"2024-09-13T18:24:58.034217+0000","last_unstale":"2024-09-13T18:24:59.387555+0000","last_undegraded":"2024-09-13T18:24:59.387555+0000","last_fullsized":"2024-09-13T18:24:59.387555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669724+0000","last_change":"2024-09-13T18:24:58.398957+0000","last_active":"2024-09-13T18:24:59.669724+0000","last_peered":"2024-09-13T18:24:59.669724+0000","last_clean":"2024-09-13T18:24:59.669724+0000","last_became_active":"2024-09-13T18:24:58.398692+0000","last_became_peered":"2024-09-13T18:24:58.398692+0000","last_unstale":"2024-09-13T18:24:59.669724+0000","last_undegraded":"2024-09-13T18:24:59.669724+0000","last_fullsized":"2024-09-13T18:24:59.669724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388073+0000","last_change":"2024-09-13T18:24:58.013615+0000","last_active":"2024-09-13T18:24:59.388073+0000","last_peered":"2024-09-13T18:24:59.388073+0000","last_clean":"2024-09-13T18:24:59.388073+0000","last_became_active":"2024-09-13T18:24:58.013286+0000","last_became_peered":"2024-09-13T18:24:58.013286+0000","last_unstale":"2024-09-13T18:24:59.388073+0000","last_undegraded":"2024-09-13T18:24:59.388073+0000","last_fullsized":"2024-09-13T18:24:59.388073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670318+0000","last_change":"2024-09-13T18:24:58.400483+0000","last_active":"2024-09-13T18:24:59.670318+0000","last_peered":"2024-09-13T18:24:59.670318+0000","last_clean":"2024-09-13T18:24:59.670318+0000","last_became_active":"2024-09-13T18:24:58.400227+0000","last_became_peered":"2024-09-13T18:24:58.400227+0000","last_unstale":"2024-09-13T18:24:59.670318+0000","last_undegraded":"2024-09-13T18:24:59.670318+0000","last_fullsized":"2024-09-13T18:24:59.670318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463603+0000","last_change":"2024-09-13T18:24:58.041646+0000","last_active":"2024-09-13T18:24:59.463603+0000","last_peered":"2024-09-13T18:24:59.463603+0000","last_clean":"2024-09-13T18:24:59.463603+0000","last_became_active":"2024-09-13T18:24:58.040973+0000","last_became_peered":"2024-09-13T18:24:58.040973+0000","last_unstale":"2024-09-13T18:24:59.463603+0000","last_undegraded":"2024-09-13T18:24:59.463603+0000","last_fullsized":"2024-09-13T18:24:59.463603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.435609+0000","last_change":"2024-09-13T18:24:58.432390+0000","last_active":"2024-09-13T18:24:58.435609+0000","last_peered":"2024-09-13T18:24:58.435609+0000","last_clean":"2024-09-13T18:24:58.435609+0000","last_became_active":"2024-09-13T18:24:58.431733+0000","last_became_peered":"2024-09-13T18:24:58.431733+0000","last_unstale":"2024-09-13T18:24:58.435609+0000","last_undegraded":"2024-09-13T18:24:58.435609+0000","last_fullsized":"2024-09-13T18:24:58.435609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444836+0000","last_change":"2024-09-13T18:24:58.437372+0000","last_active":"2024-09-13T18:24:58.444836+0000","last_peered":"2024-09-13T18:24:58.444836+0000","last_clean":"2024-09-13T18:24:58.444836+0000","last_became_active":"2024-09-13T18:24:58.436708+0000","last_became_peered":"2024-09-13T18:24:58.436708+0000","last_unstale":"2024-09-13T18:24:58.444836+0000","last_undegraded":"2024-09-13T18:24:58.444836+0000","last_fullsized":"2024-09-13T18:24:58.444836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463101+0000","last_change":"2024-09-13T18:24:58.037424+0000","last_active":"2024-09-13T18:24:59.463101+0000","last_peered":"2024-09-13T18:24:59.463101+0000","last_clean":"2024-09-13T18:24:59.463101+0000","last_became_active":"2024-09-13T18:24:58.036405+0000","last_became_peered":"2024-09-13T18:24:58.036405+0000","last_unstale":"2024-09-13T18:24:59.463101+0000","last_undegraded":"2024-09-13T18:24:59.463101+0000","last_fullsized":"2024-09-13T18:24:59.463101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444767+0000","last_change":"2024-09-13T18:24:58.435968+0000","last_active":"2024-09-13T18:24:58.444767+0000","last_peered":"2024-09-13T18:24:58.444767+0000","last_clean":"2024-09-13T18:24:58.444767+0000","last_became_active":"2024-09-13T18:24:58.435619+0000","last_became_peered":"2024-09-13T18:24:58.435619+0000","last_unstale":"2024-09-13T18:24:58.444767+0000","last_undegraded":"2024-09-13T18:24:58.444767+0000","last_fullsized":"2024-09-13T18:24:58.444767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463214+0000","last_change":"2024-09-13T18:24:58.044836+0000","last_active":"2024-09-13T18:24:59.463214+0000","last_peered":"2024-09-13T18:24:59.463214+0000","last_clean":"2024-09-13T18:24:59.463214+0000","last_became_active":"2024-09-13T18:24:58.044091+0000","last_became_peered":"2024-09-13T18:24:58.044091+0000","last_unstale":"2024-09-13T18:24:59.463214+0000","last_undegraded":"2024-09-13T18:24:59.463214+0000","last_fullsized":"2024-09-13T18:24:59.463214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.419167+0000","last_change":"2024-09-13T18:24:58.418359+0000","last_active":"2024-09-13T18:24:58.419167+0000","last_peered":"2024-09-13T18:24:58.419167+0000","last_clean":"2024-09-13T18:24:58.419167+0000","last_became_active":"2024-09-13T18:24:58.418071+0000","last_became_peered":"2024-09-13T18:24:58.418071+0000","last_unstale":"2024-09-13T18:24:58.419167+0000","last_undegraded":"2024-09-13T18:24:58.419167+0000","last_fullsized":"2024-09-13T18:24:58.419167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670596+0000","last_change":"2024-09-13T18:24:58.016894+0000","last_active":"2024-09-13T18:24:59.670596+0000","last_peered":"2024-09-13T18:24:59.670596+0000","last_clean":"2024-09-13T18:24:59.670596+0000","last_became_active":"2024-09-13T18:24:58.016172+0000","last_became_peered":"2024-09-13T18:24:58.016172+0000","last_unstale":"2024-09-13T18:24:59.670596+0000","last_undegraded":"2024-09-13T18:24:59.670596+0000","last_fullsized":"2024-09-13T18:24:59.670596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.426766+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.426470+0000","last_became_peered":"2024-09-13T18:24:58.426470+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442980+0000","last_change":"2024-09-13T18:24:58.025191+0000","last_active":"2024-09-13T18:24:58.442980+0000","last_peered":"2024-09-13T18:24:58.442980+0000","last_clean":"2024-09-13T18:24:58.442980+0000","last_became_active":"2024-09-13T18:24:58.024847+0000","last_became_peered":"2024-09-13T18:24:58.024847+0000","last_unstale":"2024-09-13T18:24:58.442980+0000","last_undegraded":"2024-09-13T18:24:58.442980+0000","last_fullsized":"2024-09-13T18:24:58.442980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:05.912577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31308,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340532,"statfs":{"total":96636764160,"available":96604704768,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":655604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:25:02.426 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:25:02.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc03bfae640 1 Processor -- start 2024-09-13T18:25:02.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc03bfae640 1 -- start start 2024-09-13T18:25:02.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc03bfae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc03415b7c0 0x7fc034070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc03bfae640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc0340711d0 0x7fc0341640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc03bfae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03406d480 con 0x7fc0341582a0 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc03bfae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc034071680 con 0x7fc03415b7c0 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc03bfae640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03415aaf0 con 0x7fc0340711d0 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.582+0000 7fc039d4a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0341582a0 0x7fc03406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48516/0 (socket says 172.21.15.53:48516) 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc039d4a640 1 -- 172.21.15.53:0/540218835 learned_addr learned my addr 172.21.15.53:0/540218835 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc039549640 1 --2- 172.21.15.53:0/540218835 >> v2:172.21.15.53:3300/0 conn(0x7fc03415b7c0 0x7fc034070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc03a54b640 1 --2- 172.21.15.53:0/540218835 >> v2:172.21.15.87:3300/0 conn(0x7fc0340711d0 0x7fc0341640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc038d48640 1 -- 172.21.15.53:0/540218835 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106029897 0 0) 0x7fc03406d480 con 0x7fc0341582a0 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc038d48640 1 -- 172.21.15.53:0/540218835 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc020003530 con 0x7fc0341582a0 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc039549640 1 -- 172.21.15.53:0/540218835 >> v2:172.21.15.87:3300/0 conn(0x7fc0340711d0 msgr2=0x7fc0341640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc039549640 1 --2- 172.21.15.53:0/540218835 >> v2:172.21.15.87:3300/0 conn(0x7fc0340711d0 0x7fc0341640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc039549640 1 -- 172.21.15.53:0/540218835 >> v1:172.21.15.53:6789/0 conn(0x7fc0341582a0 legacy=0x7fc03406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc039549640 1 -- 172.21.15.53:0/540218835 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03415ace0 con 0x7fc03415b7c0 2024-09-13T18:25:02.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc039549640 1 --2- 172.21.15.53:0/540218835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc03415b7c0 0x7fc034070c90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc034158680 tx=0x7fc02401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e319a99bc73ef8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc038d48640 1 -- 172.21.15.53:0/540218835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240ab600 con 0x7fc03415b7c0 2024-09-13T18:25:02.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc038d48640 1 -- 172.21.15.53:0/540218835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0240a7050 con 0x7fc03415b7c0 2024-09-13T18:25:02.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.586+0000 7fc038d48640 1 -- 172.21.15.53:0/540218835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240ab980 con 0x7fc03415b7c0 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- 172.21.15.53:0/540218835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc03415b7c0 msgr2=0x7fc034070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 --2- 172.21.15.53:0/540218835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc03415b7c0 0x7fc034070c90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc034158680 tx=0x7fc02401c480 comp rx=0 tx=0).stop 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- 172.21.15.53:0/540218835 shutdown_connections 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 --2- 172.21.15.53:0/540218835 >> v2:172.21.15.87:3300/0 conn(0x7fc0340711d0 0x7fc0341640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 --2- 172.21.15.53:0/540218835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc03415b7c0 0x7fc034070c90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- 172.21.15.53:0/540218835 >> 172.21.15.53:0/540218835 conn(0x7fc034065c80 msgr2=0x7fc034066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- 172.21.15.53:0/540218835 shutdown_connections 2024-09-13T18:25:02.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- 172.21.15.53:0/540218835 wait complete. 2024-09-13T18:25:02.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 Processor -- start 2024-09-13T18:25:02.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- start start 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340711d0 0x7fc034156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0341582a0 0x7fc034152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03415b7c0 0x7fc034139800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03414b9a0 con 0x7fc0340711d0 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0341571f0 con 0x7fc0341582a0 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc034154220 con 0x7fc03415b7c0 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340711d0 0x7fc034156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340711d0 0x7fc034156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32948/0 (socket says 172.21.15.53:32948) 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 -- 172.21.15.53:0/783380248 learned_addr learned my addr 172.21.15.53:0/783380248 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039549640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0341582a0 0x7fc034152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03a54b640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03415b7c0 0x7fc034139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 -- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03415b7c0 msgr2=0x7fc034139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03415b7c0 0x7fc034139800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 -- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0341582a0 msgr2=0x7fc034152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0341582a0 0x7fc034152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 -- 172.21.15.53:0/783380248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009420 con 0x7fc0340711d0 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039549640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0341582a0 0x7fc034152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc039d4a640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340711d0 0x7fc034156290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c500 tx=0x7fc03000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc02a7fc640 1 -- 172.21.15.53:0/783380248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030005cf0 con 0x7fc0340711d0 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc02a7fc640 1 -- 172.21.15.53:0/783380248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030005e50 con 0x7fc0340711d0 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc034156950 con 0x7fc0340711d0 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc02a7fc640 1 -- 172.21.15.53:0/783380248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300072f0 con 0x7fc0340711d0 2024-09-13T18:25:02.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.590+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc034156f10 con 0x7fc0340711d0 2024-09-13T18:25:02.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.594+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc034067400 con 0x7fc0340711d0 2024-09-13T18:25:02.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.594+0000 7fc02a7fc640 1 -- 172.21.15.53:0/783380248 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc030007450 con 0x7fc0340711d0 2024-09-13T18:25:02.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.594+0000 7fc02a7fc640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc018066690 0x7fc018068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.594+0000 7fc02a7fc640 1 -- 172.21.15.53:0/783380248 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc030083660 con 0x7fc0340711d0 2024-09-13T18:25:02.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.594+0000 7fc039549640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc018066690 0x7fc018068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.594+0000 7fc039549640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc018066690 0x7fc018068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0240ad000 tx=0x7fc024008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.598+0000 7fc02a7fc640 1 -- 172.21.15.53:0/783380248 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc030050b10 con 0x7fc0340711d0 2024-09-13T18:25:02.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.750+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc034166e50 con 0x7fc018066690 2024-09-13T18:25:02.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.770+0000 7fc02a7fc640 1 -- 172.21.15.53:0/783380248 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264649 (secure 0 0 0) 0x7fc0240b7430 con 0x7fc018066690 2024-09-13T18:25:02.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:02.774 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:25:02.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc018066690 msgr2=0x7fc018068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc018066690 0x7fc018068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0240ad000 tx=0x7fc024008040 comp rx=0 tx=0).stop 2024-09-13T18:25:02.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340711d0 msgr2=0x7fc034156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340711d0 0x7fc034156290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c500 tx=0x7fc03000c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 shutdown_connections 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc018066690 0x7fc018068b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03415b7c0 0x7fc034139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0341582a0 0x7fc034152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 --2- 172.21.15.53:0/783380248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340711d0 0x7fc034156290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 >> 172.21.15.53:0/783380248 conn(0x7fc034065c80 msgr2=0x7fc034154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 shutdown_connections 2024-09-13T18:25:02.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.774+0000 7fc03bfae640 1 -- 172.21.15.53:0/783380248 wait complete. 2024-09-13T18:25:02.791 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:25:00.900651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235364,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739356,"statfs":{"total":773094113280,"available":772853100544,"internally_reserved":0,"allocated":2842624,"data_stored":1727444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001150"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.434555+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.432500+0000","last_became_peered":"2024-09-13T18:24:58.432500+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388010+0000","last_change":"2024-09-13T18:24:58.396126+0000","last_active":"2024-09-13T18:24:59.388010+0000","last_peered":"2024-09-13T18:24:59.388010+0000","last_clean":"2024-09-13T18:24:59.388010+0000","last_became_active":"2024-09-13T18:24:58.395863+0000","last_became_peered":"2024-09-13T18:24:58.395863+0000","last_unstale":"2024-09-13T18:24:59.388010+0000","last_undegraded":"2024-09-13T18:24:59.388010+0000","last_fullsized":"2024-09-13T18:24:59.388010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396239+0000","last_change":"2024-09-13T18:24:58.393804+0000","last_active":"2024-09-13T18:24:58.396239+0000","last_peered":"2024-09-13T18:24:58.396239+0000","last_clean":"2024-09-13T18:24:58.396239+0000","last_became_active":"2024-09-13T18:24:58.393534+0000","last_became_peered":"2024-09-13T18:24:58.393534+0000","last_unstale":"2024-09-13T18:24:58.396239+0000","last_undegraded":"2024-09-13T18:24:58.396239+0000","last_fullsized":"2024-09-13T18:24:58.396239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.441877+0000","last_change":"2024-09-13T18:24:58.416846+0000","last_active":"2024-09-13T18:24:58.441877+0000","last_peered":"2024-09-13T18:24:58.441877+0000","last_clean":"2024-09-13T18:24:58.441877+0000","last_became_active":"2024-09-13T18:24:58.415742+0000","last_became_peered":"2024-09-13T18:24:58.415742+0000","last_unstale":"2024-09-13T18:24:58.441877+0000","last_undegraded":"2024-09-13T18:24:58.441877+0000","last_fullsized":"2024-09-13T18:24:58.441877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463377+0000","last_change":"2024-09-13T18:24:58.413407+0000","last_active":"2024-09-13T18:24:59.463377+0000","last_peered":"2024-09-13T18:24:59.463377+0000","last_clean":"2024-09-13T18:24:59.463377+0000","last_became_active":"2024-09-13T18:24:58.412683+0000","last_became_peered":"2024-09-13T18:24:58.412683+0000","last_unstale":"2024-09-13T18:24:59.463377+0000","last_undegraded":"2024-09-13T18:24:59.463377+0000","last_fullsized":"2024-09-13T18:24:59.463377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442493+0000","last_change":"2024-09-13T18:24:58.419676+0000","last_active":"2024-09-13T18:24:58.442493+0000","last_peered":"2024-09-13T18:24:58.442493+0000","last_clean":"2024-09-13T18:24:58.442493+0000","last_became_active":"2024-09-13T18:24:58.418305+0000","last_became_peered":"2024-09-13T18:24:58.418305+0000","last_unstale":"2024-09-13T18:24:58.442493+0000","last_undegraded":"2024-09-13T18:24:58.442493+0000","last_fullsized":"2024-09-13T18:24:58.442493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.878378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462710+0000","last_change":"2024-09-13T18:24:58.409783+0000","last_active":"2024-09-13T18:24:59.462710+0000","last_peered":"2024-09-13T18:24:59.462710+0000","last_clean":"2024-09-13T18:24:59.462710+0000","last_became_active":"2024-09-13T18:24:58.409053+0000","last_became_peered":"2024-09-13T18:24:58.409053+0000","last_unstale":"2024-09-13T18:24:59.462710+0000","last_undegraded":"2024-09-13T18:24:59.462710+0000","last_fullsized":"2024-09-13T18:24:59.462710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:30.448126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669414+0000","last_change":"2024-09-13T18:24:58.420831+0000","last_active":"2024-09-13T18:24:59.669414+0000","last_peered":"2024-09-13T18:24:59.669414+0000","last_clean":"2024-09-13T18:24:59.669414+0000","last_became_active":"2024-09-13T18:24:58.420490+0000","last_became_peered":"2024-09-13T18:24:58.420490+0000","last_unstale":"2024-09-13T18:24:59.669414+0000","last_undegraded":"2024-09-13T18:24:59.669414+0000","last_fullsized":"2024-09-13T18:24:59.669414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.429947+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.429214+0000","last_became_peered":"2024-09-13T18:24:58.429214+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.433224+0000","last_change":"2024-09-13T18:24:58.426881+0000","last_active":"2024-09-13T18:24:58.433224+0000","last_peered":"2024-09-13T18:24:58.433224+0000","last_clean":"2024-09-13T18:24:58.433224+0000","last_became_active":"2024-09-13T18:24:58.425419+0000","last_became_peered":"2024-09-13T18:24:58.425419+0000","last_unstale":"2024-09-13T18:24:58.433224+0000","last_undegraded":"2024-09-13T18:24:58.433224+0000","last_fullsized":"2024-09-13T18:24:58.433224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.435534+0000","last_change":"2024-09-13T18:24:58.430550+0000","last_active":"2024-09-13T18:24:58.435534+0000","last_peered":"2024-09-13T18:24:58.435534+0000","last_clean":"2024-09-13T18:24:58.435534+0000","last_became_active":"2024-09-13T18:24:58.425963+0000","last_became_peered":"2024-09-13T18:24:58.425963+0000","last_unstale":"2024-09-13T18:24:58.435534+0000","last_undegraded":"2024-09-13T18:24:58.435534+0000","last_fullsized":"2024-09-13T18:24:58.435534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389497+0000","last_change":"2024-09-13T18:24:58.431749+0000","last_active":"2024-09-13T18:24:59.389497+0000","last_peered":"2024-09-13T18:24:59.389497+0000","last_clean":"2024-09-13T18:24:59.389497+0000","last_became_active":"2024-09-13T18:24:58.431519+0000","last_became_peered":"2024-09-13T18:24:58.431519+0000","last_unstale":"2024-09-13T18:24:59.389497+0000","last_undegraded":"2024-09-13T18:24:59.389497+0000","last_fullsized":"2024-09-13T18:24:59.389497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670053+0000","last_change":"2024-09-13T18:24:58.423558+0000","last_active":"2024-09-13T18:24:59.670053+0000","last_peered":"2024-09-13T18:24:59.670053+0000","last_clean":"2024-09-13T18:24:59.670053+0000","last_became_active":"2024-09-13T18:24:58.423300+0000","last_became_peered":"2024-09-13T18:24:58.423300+0000","last_unstale":"2024-09-13T18:24:59.670053+0000","last_undegraded":"2024-09-13T18:24:59.670053+0000","last_fullsized":"2024-09-13T18:24:59.670053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.397864+0000","last_change":"2024-09-13T18:24:58.396798+0000","last_active":"2024-09-13T18:24:58.397864+0000","last_peered":"2024-09-13T18:24:58.397864+0000","last_clean":"2024-09-13T18:24:58.397864+0000","last_became_active":"2024-09-13T18:24:58.396451+0000","last_became_peered":"2024-09-13T18:24:58.396451+0000","last_unstale":"2024-09-13T18:24:58.397864+0000","last_undegraded":"2024-09-13T18:24:58.397864+0000","last_fullsized":"2024-09-13T18:24:58.397864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387596+0000","last_change":"2024-09-13T18:24:58.394756+0000","last_active":"2024-09-13T18:24:59.387596+0000","last_peered":"2024-09-13T18:24:59.387596+0000","last_clean":"2024-09-13T18:24:59.387596+0000","last_became_active":"2024-09-13T18:24:58.394413+0000","last_became_peered":"2024-09-13T18:24:58.394413+0000","last_unstale":"2024-09-13T18:24:59.387596+0000","last_undegraded":"2024-09-13T18:24:59.387596+0000","last_fullsized":"2024-09-13T18:24:59.387596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442040+0000","last_change":"2024-09-13T18:24:58.417787+0000","last_active":"2024-09-13T18:24:58.442040+0000","last_peered":"2024-09-13T18:24:58.442040+0000","last_clean":"2024-09-13T18:24:58.442040+0000","last_became_active":"2024-09-13T18:24:58.416849+0000","last_became_peered":"2024-09-13T18:24:58.416849+0000","last_unstale":"2024-09-13T18:24:58.442040+0000","last_undegraded":"2024-09-13T18:24:58.442040+0000","last_fullsized":"2024-09-13T18:24:58.442040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444721+0000","last_change":"2024-09-13T18:24:58.433843+0000","last_active":"2024-09-13T18:24:58.444721+0000","last_peered":"2024-09-13T18:24:58.444721+0000","last_clean":"2024-09-13T18:24:58.444721+0000","last_became_active":"2024-09-13T18:24:58.433147+0000","last_became_peered":"2024-09-13T18:24:58.433147+0000","last_unstale":"2024-09-13T18:24:58.444721+0000","last_undegraded":"2024-09-13T18:24:58.444721+0000","last_fullsized":"2024-09-13T18:24:58.444721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155018+0000","last_change":"2024-09-13T18:24:58.424087+0000","last_active":"2024-09-13T18:25:00.155018+0000","last_peered":"2024-09-13T18:25:00.155018+0000","last_clean":"2024-09-13T18:25:00.155018+0000","last_became_active":"2024-09-13T18:24:58.423760+0000","last_became_peered":"2024-09-13T18:24:58.423760+0000","last_unstale":"2024-09-13T18:25:00.155018+0000","last_undegraded":"2024-09-13T18:25:00.155018+0000","last_fullsized":"2024-09-13T18:25:00.155018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:28.685985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463428+0000","last_change":"2024-09-13T18:24:58.426709+0000","last_active":"2024-09-13T18:24:59.463428+0000","last_peered":"2024-09-13T18:24:59.463428+0000","last_clean":"2024-09-13T18:24:59.463428+0000","last_became_active":"2024-09-13T18:24:58.426073+0000","last_became_peered":"2024-09-13T18:24:58.426073+0000","last_unstale":"2024-09-13T18:24:59.463428+0000","last_undegraded":"2024-09-13T18:24:59.463428+0000","last_fullsized":"2024-09-13T18:24:59.463428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442927+0000","last_change":"2024-09-13T18:24:58.436173+0000","last_active":"2024-09-13T18:24:58.442927+0000","last_peered":"2024-09-13T18:24:58.442927+0000","last_clean":"2024-09-13T18:24:58.442927+0000","last_became_active":"2024-09-13T18:24:58.435428+0000","last_became_peered":"2024-09-13T18:24:58.435428+0000","last_unstale":"2024-09-13T18:24:58.442927+0000","last_undegraded":"2024-09-13T18:24:58.442927+0000","last_fullsized":"2024-09-13T18:24:58.442927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.415405+0000","last_change":"2024-09-13T18:24:58.414497+0000","last_active":"2024-09-13T18:24:58.415405+0000","last_peered":"2024-09-13T18:24:58.415405+0000","last_clean":"2024-09-13T18:24:58.415405+0000","last_became_active":"2024-09-13T18:24:58.414205+0000","last_became_peered":"2024-09-13T18:24:58.414205+0000","last_unstale":"2024-09-13T18:24:58.415405+0000","last_undegraded":"2024-09-13T18:24:58.415405+0000","last_fullsized":"2024-09-13T18:24:58.415405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444674+0000","last_change":"2024-09-13T18:24:58.433694+0000","last_active":"2024-09-13T18:24:58.444674+0000","last_peered":"2024-09-13T18:24:58.444674+0000","last_clean":"2024-09-13T18:24:58.444674+0000","last_became_active":"2024-09-13T18:24:58.432977+0000","last_became_peered":"2024-09-13T18:24:58.432977+0000","last_unstale":"2024-09-13T18:24:58.444674+0000","last_undegraded":"2024-09-13T18:24:58.444674+0000","last_fullsized":"2024-09-13T18:24:58.444674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:20.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669635+0000","last_change":"2024-09-13T18:24:58.399324+0000","last_active":"2024-09-13T18:24:59.669635+0000","last_peered":"2024-09-13T18:24:59.669635+0000","last_clean":"2024-09-13T18:24:59.669635+0000","last_became_active":"2024-09-13T18:24:58.398728+0000","last_became_peered":"2024-09-13T18:24:58.398728+0000","last_unstale":"2024-09-13T18:24:59.669635+0000","last_undegraded":"2024-09-13T18:24:59.669635+0000","last_fullsized":"2024-09-13T18:24:59.669635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442089+0000","last_change":"2024-09-13T18:24:58.418319+0000","last_active":"2024-09-13T18:24:58.442089+0000","last_peered":"2024-09-13T18:24:58.442089+0000","last_clean":"2024-09-13T18:24:58.442089+0000","last_became_active":"2024-09-13T18:24:58.417600+0000","last_became_peered":"2024-09-13T18:24:58.417600+0000","last_unstale":"2024-09-13T18:24:58.442089+0000","last_undegraded":"2024-09-13T18:24:58.442089+0000","last_fullsized":"2024-09-13T18:24:58.442089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670260+0000","last_change":"2024-09-13T18:24:58.434929+0000","last_active":"2024-09-13T18:24:59.670260+0000","last_peered":"2024-09-13T18:24:59.670260+0000","last_clean":"2024-09-13T18:24:59.670260+0000","last_became_active":"2024-09-13T18:24:58.434692+0000","last_became_peered":"2024-09-13T18:24:58.434692+0000","last_unstale":"2024-09-13T18:24:59.670260+0000","last_undegraded":"2024-09-13T18:24:59.670260+0000","last_fullsized":"2024-09-13T18:24:59.670260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.438174+0000","last_change":"2024-09-13T18:24:58.434112+0000","last_active":"2024-09-13T18:24:58.438174+0000","last_peered":"2024-09-13T18:24:58.438174+0000","last_clean":"2024-09-13T18:24:58.438174+0000","last_became_active":"2024-09-13T18:24:58.433715+0000","last_became_peered":"2024-09-13T18:24:58.433715+0000","last_unstale":"2024-09-13T18:24:58.438174+0000","last_undegraded":"2024-09-13T18:24:58.438174+0000","last_fullsized":"2024-09-13T18:24:58.438174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388052+0000","last_change":"2024-09-13T18:24:58.398414+0000","last_active":"2024-09-13T18:24:59.388052+0000","last_peered":"2024-09-13T18:24:59.388052+0000","last_clean":"2024-09-13T18:24:59.388052+0000","last_became_active":"2024-09-13T18:24:58.398137+0000","last_became_peered":"2024-09-13T18:24:58.398137+0000","last_unstale":"2024-09-13T18:24:59.388052+0000","last_undegraded":"2024-09-13T18:24:59.388052+0000","last_fullsized":"2024-09-13T18:24:59.388052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670643+0000","last_change":"2024-09-13T18:24:58.416857+0000","last_active":"2024-09-13T18:24:59.670643+0000","last_peered":"2024-09-13T18:24:59.670643+0000","last_clean":"2024-09-13T18:24:59.670643+0000","last_became_active":"2024-09-13T18:24:58.416500+0000","last_became_peered":"2024-09-13T18:24:58.416500+0000","last_unstale":"2024-09-13T18:24:59.670643+0000","last_undegraded":"2024-09-13T18:24:59.670643+0000","last_fullsized":"2024-09-13T18:24:59.670643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.405217+0000","last_change":"2024-09-13T18:24:58.399395+0000","last_active":"2024-09-13T18:24:58.405217+0000","last_peered":"2024-09-13T18:24:58.405217+0000","last_clean":"2024-09-13T18:24:58.405217+0000","last_became_active":"2024-09-13T18:24:58.399156+0000","last_became_peered":"2024-09-13T18:24:58.399156+0000","last_unstale":"2024-09-13T18:24:58.405217+0000","last_undegraded":"2024-09-13T18:24:58.405217+0000","last_fullsized":"2024-09-13T18:24:58.405217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442443+0000","last_change":"2024-09-13T18:24:58.419100+0000","last_active":"2024-09-13T18:24:58.442443+0000","last_peered":"2024-09-13T18:24:58.442443+0000","last_clean":"2024-09-13T18:24:58.442443+0000","last_became_active":"2024-09-13T18:24:58.416656+0000","last_became_peered":"2024-09-13T18:24:58.416656+0000","last_unstale":"2024-09-13T18:24:58.442443+0000","last_undegraded":"2024-09-13T18:24:58.442443+0000","last_fullsized":"2024-09-13T18:24:58.442443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154711+0000","last_change":"2024-09-13T18:24:58.417573+0000","last_active":"2024-09-13T18:25:00.154711+0000","last_peered":"2024-09-13T18:25:00.154711+0000","last_clean":"2024-09-13T18:25:00.154711+0000","last_became_active":"2024-09-13T18:24:58.417375+0000","last_became_peered":"2024-09-13T18:24:58.417375+0000","last_unstale":"2024-09-13T18:25:00.154711+0000","last_undegraded":"2024-09-13T18:25:00.154711+0000","last_fullsized":"2024-09-13T18:25:00.154711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.426224+0000","last_change":"2024-09-13T18:24:58.420326+0000","last_active":"2024-09-13T18:24:58.426224+0000","last_peered":"2024-09-13T18:24:58.426224+0000","last_clean":"2024-09-13T18:24:58.426224+0000","last_became_active":"2024-09-13T18:24:58.419405+0000","last_became_peered":"2024-09-13T18:24:58.419405+0000","last_unstale":"2024-09-13T18:24:58.426224+0000","last_undegraded":"2024-09-13T18:24:58.426224+0000","last_fullsized":"2024-09-13T18:24:58.426224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389034+0000","last_change":"2024-09-13T18:24:58.395983+0000","last_active":"2024-09-13T18:24:59.389034+0000","last_peered":"2024-09-13T18:24:59.389034+0000","last_clean":"2024-09-13T18:24:59.389034+0000","last_became_active":"2024-09-13T18:24:58.394785+0000","last_became_peered":"2024-09-13T18:24:58.394785+0000","last_unstale":"2024-09-13T18:24:59.389034+0000","last_undegraded":"2024-09-13T18:24:59.389034+0000","last_fullsized":"2024-09-13T18:24:59.389034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.033774+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.033412+0000","last_became_peered":"2024-09-13T18:24:58.033412+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396636+0000","last_change":"2024-09-13T18:24:58.395023+0000","last_active":"2024-09-13T18:24:58.396636+0000","last_peered":"2024-09-13T18:24:58.396636+0000","last_clean":"2024-09-13T18:24:58.396636+0000","last_became_active":"2024-09-13T18:24:58.394639+0000","last_became_peered":"2024-09-13T18:24:58.394639+0000","last_unstale":"2024-09-13T18:24:58.396636+0000","last_undegraded":"2024-09-13T18:24:58.396636+0000","last_fullsized":"2024-09-13T18:24:58.396636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.434921+0000","last_change":"2024-09-13T18:24:58.020182+0000","last_active":"2024-09-13T18:24:58.434921+0000","last_peered":"2024-09-13T18:24:58.434921+0000","last_clean":"2024-09-13T18:24:58.434921+0000","last_became_active":"2024-09-13T18:24:58.019266+0000","last_became_peered":"2024-09-13T18:24:58.019266+0000","last_unstale":"2024-09-13T18:24:58.434921+0000","last_undegraded":"2024-09-13T18:24:58.434921+0000","last_fullsized":"2024-09-13T18:24:58.434921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669944+0000","last_change":"2024-09-13T18:24:58.042697+0000","last_active":"2024-09-13T18:24:59.669944+0000","last_peered":"2024-09-13T18:24:59.669944+0000","last_clean":"2024-09-13T18:24:59.669944+0000","last_became_active":"2024-09-13T18:24:58.042383+0000","last_became_peered":"2024-09-13T18:24:58.042383+0000","last_unstale":"2024-09-13T18:24:59.669944+0000","last_undegraded":"2024-09-13T18:24:59.669944+0000","last_fullsized":"2024-09-13T18:24:59.669944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669716+0000","last_change":"2024-09-13T18:24:58.397945+0000","last_active":"2024-09-13T18:24:59.669716+0000","last_peered":"2024-09-13T18:24:59.669716+0000","last_clean":"2024-09-13T18:24:59.669716+0000","last_became_active":"2024-09-13T18:24:58.397684+0000","last_became_peered":"2024-09-13T18:24:58.397684+0000","last_unstale":"2024-09-13T18:24:59.669716+0000","last_undegraded":"2024-09-13T18:24:59.669716+0000","last_fullsized":"2024-09-13T18:24:59.669716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.402011+0000","last_change":"2024-09-13T18:24:58.025483+0000","last_active":"2024-09-13T18:24:58.402011+0000","last_peered":"2024-09-13T18:24:58.402011+0000","last_clean":"2024-09-13T18:24:58.402011+0000","last_became_active":"2024-09-13T18:24:58.024711+0000","last_became_peered":"2024-09-13T18:24:58.024711+0000","last_unstale":"2024-09-13T18:24:58.402011+0000","last_undegraded":"2024-09-13T18:24:58.402011+0000","last_fullsized":"2024-09-13T18:24:58.402011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387452+0000","last_change":"2024-09-13T18:24:58.398740+0000","last_active":"2024-09-13T18:24:59.387452+0000","last_peered":"2024-09-13T18:24:59.387452+0000","last_clean":"2024-09-13T18:24:59.387452+0000","last_became_active":"2024-09-13T18:24:58.397892+0000","last_became_peered":"2024-09-13T18:24:58.397892+0000","last_unstale":"2024-09-13T18:24:59.387452+0000","last_undegraded":"2024-09-13T18:24:59.387452+0000","last_fullsized":"2024-09-13T18:24:59.387452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.403397+0000","last_change":"2024-09-13T18:24:58.041368+0000","last_active":"2024-09-13T18:24:58.403397+0000","last_peered":"2024-09-13T18:24:58.403397+0000","last_clean":"2024-09-13T18:24:58.403397+0000","last_became_active":"2024-09-13T18:24:58.040649+0000","last_became_peered":"2024-09-13T18:24:58.040649+0000","last_unstale":"2024-09-13T18:24:58.403397+0000","last_undegraded":"2024-09-13T18:24:58.403397+0000","last_fullsized":"2024-09-13T18:24:58.403397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444564+0000","last_change":"2024-09-13T18:24:58.431883+0000","last_active":"2024-09-13T18:24:58.444564+0000","last_peered":"2024-09-13T18:24:58.444564+0000","last_clean":"2024-09-13T18:24:58.444564+0000","last_became_active":"2024-09-13T18:24:58.431214+0000","last_became_peered":"2024-09-13T18:24:58.431214+0000","last_unstale":"2024-09-13T18:24:58.444564+0000","last_undegraded":"2024-09-13T18:24:58.444564+0000","last_fullsized":"2024-09-13T18:24:58.444564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.404236+0000","last_change":"2024-09-13T18:24:58.042813+0000","last_active":"2024-09-13T18:24:58.404236+0000","last_peered":"2024-09-13T18:24:58.404236+0000","last_clean":"2024-09-13T18:24:58.404236+0000","last_became_active":"2024-09-13T18:24:58.042035+0000","last_became_peered":"2024-09-13T18:24:58.042035+0000","last_unstale":"2024-09-13T18:24:58.404236+0000","last_undegraded":"2024-09-13T18:24:58.404236+0000","last_fullsized":"2024-09-13T18:24:58.404236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.418957+0000","last_change":"2024-09-13T18:24:58.418140+0000","last_active":"2024-09-13T18:24:58.418957+0000","last_peered":"2024-09-13T18:24:58.418957+0000","last_clean":"2024-09-13T18:24:58.418957+0000","last_became_active":"2024-09-13T18:24:58.417892+0000","last_became_peered":"2024-09-13T18:24:58.417892+0000","last_unstale":"2024-09-13T18:24:58.418957+0000","last_undegraded":"2024-09-13T18:24:58.418957+0000","last_fullsized":"2024-09-13T18:24:58.418957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388168+0000","last_change":"2024-09-13T18:24:58.031378+0000","last_active":"2024-09-13T18:24:59.388168+0000","last_peered":"2024-09-13T18:24:59.388168+0000","last_clean":"2024-09-13T18:24:59.388168+0000","last_became_active":"2024-09-13T18:24:58.031086+0000","last_became_peered":"2024-09-13T18:24:58.031086+0000","last_unstale":"2024-09-13T18:24:59.388168+0000","last_undegraded":"2024-09-13T18:24:59.388168+0000","last_fullsized":"2024-09-13T18:24:59.388168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389663+0000","last_change":"2024-09-13T18:24:58.430392+0000","last_active":"2024-09-13T18:24:59.389663+0000","last_peered":"2024-09-13T18:24:59.389663+0000","last_clean":"2024-09-13T18:24:59.389663+0000","last_became_active":"2024-09-13T18:24:58.429654+0000","last_became_peered":"2024-09-13T18:24:58.429654+0000","last_unstale":"2024-09-13T18:24:59.389663+0000","last_undegraded":"2024-09-13T18:24:59.389663+0000","last_fullsized":"2024-09-13T18:24:59.389663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:27.851864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.443064+0000","last_change":"2024-09-13T18:24:58.039451+0000","last_active":"2024-09-13T18:24:58.443064+0000","last_peered":"2024-09-13T18:24:58.443064+0000","last_clean":"2024-09-13T18:24:58.443064+0000","last_became_active":"2024-09-13T18:24:58.032328+0000","last_became_peered":"2024-09-13T18:24:58.032328+0000","last_unstale":"2024-09-13T18:24:58.443064+0000","last_undegraded":"2024-09-13T18:24:58.443064+0000","last_fullsized":"2024-09-13T18:24:58.443064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463120+0000","last_change":"2024-09-13T18:24:58.409551+0000","last_active":"2024-09-13T18:24:59.463120+0000","last_peered":"2024-09-13T18:24:59.463120+0000","last_clean":"2024-09-13T18:24:59.463120+0000","last_became_active":"2024-09-13T18:24:58.407831+0000","last_became_peered":"2024-09-13T18:24:58.407831+0000","last_unstale":"2024-09-13T18:24:59.463120+0000","last_undegraded":"2024-09-13T18:24:59.463120+0000","last_fullsized":"2024-09-13T18:24:59.463120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442504+0000","last_change":"2024-09-13T18:24:58.027528+0000","last_active":"2024-09-13T18:24:58.442504+0000","last_peered":"2024-09-13T18:24:58.442504+0000","last_clean":"2024-09-13T18:24:58.442504+0000","last_became_active":"2024-09-13T18:24:58.027248+0000","last_became_peered":"2024-09-13T18:24:58.027248+0000","last_unstale":"2024-09-13T18:24:58.442504+0000","last_undegraded":"2024-09-13T18:24:58.442504+0000","last_fullsized":"2024-09-13T18:24:58.442504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.415417+0000","last_change":"2024-09-13T18:24:58.414607+0000","last_active":"2024-09-13T18:24:58.415417+0000","last_peered":"2024-09-13T18:24:58.415417+0000","last_clean":"2024-09-13T18:24:58.415417+0000","last_became_active":"2024-09-13T18:24:58.414310+0000","last_became_peered":"2024-09-13T18:24:58.414310+0000","last_unstale":"2024-09-13T18:24:58.415417+0000","last_undegraded":"2024-09-13T18:24:58.415417+0000","last_fullsized":"2024-09-13T18:24:58.415417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.407667+0000","last_change":"2024-09-13T18:24:58.032711+0000","last_active":"2024-09-13T18:24:58.407667+0000","last_peered":"2024-09-13T18:24:58.407667+0000","last_clean":"2024-09-13T18:24:58.407667+0000","last_became_active":"2024-09-13T18:24:58.030671+0000","last_became_peered":"2024-09-13T18:24:58.030671+0000","last_unstale":"2024-09-13T18:24:58.407667+0000","last_undegraded":"2024-09-13T18:24:58.407667+0000","last_fullsized":"2024-09-13T18:24:58.407667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:21.674116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463490+0000","last_change":"2024-09-13T18:24:58.439918+0000","last_active":"2024-09-13T18:24:59.463490+0000","last_peered":"2024-09-13T18:24:59.463490+0000","last_clean":"2024-09-13T18:24:59.463490+0000","last_became_active":"2024-09-13T18:24:58.439353+0000","last_became_peered":"2024-09-13T18:24:58.439353+0000","last_unstale":"2024-09-13T18:24:59.463490+0000","last_undegraded":"2024-09-13T18:24:59.463490+0000","last_fullsized":"2024-09-13T18:24:59.463490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.403230+0000","last_change":"2024-09-13T18:24:58.028233+0000","last_active":"2024-09-13T18:24:58.403230+0000","last_peered":"2024-09-13T18:24:58.403230+0000","last_clean":"2024-09-13T18:24:58.403230+0000","last_became_active":"2024-09-13T18:24:58.027484+0000","last_became_peered":"2024-09-13T18:24:58.027484+0000","last_unstale":"2024-09-13T18:24:58.403230+0000","last_undegraded":"2024-09-13T18:24:58.403230+0000","last_fullsized":"2024-09-13T18:24:58.403230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.427722+0000","last_change":"2024-09-13T18:24:58.425519+0000","last_active":"2024-09-13T18:24:58.427722+0000","last_peered":"2024-09-13T18:24:58.427722+0000","last_clean":"2024-09-13T18:24:58.427722+0000","last_became_active":"2024-09-13T18:24:58.421201+0000","last_became_peered":"2024-09-13T18:24:58.421201+0000","last_unstale":"2024-09-13T18:24:58.427722+0000","last_undegraded":"2024-09-13T18:24:58.427722+0000","last_fullsized":"2024-09-13T18:24:58.427722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154679+0000","last_change":"2024-09-13T18:24:58.015803+0000","last_active":"2024-09-13T18:25:00.154679+0000","last_peered":"2024-09-13T18:25:00.154679+0000","last_clean":"2024-09-13T18:25:00.154679+0000","last_became_active":"2024-09-13T18:24:58.015460+0000","last_became_peered":"2024-09-13T18:24:58.015460+0000","last_unstale":"2024-09-13T18:25:00.154679+0000","last_undegraded":"2024-09-13T18:25:00.154679+0000","last_fullsized":"2024-09-13T18:25:00.154679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463015+0000","last_change":"2024-09-13T18:24:58.439925+0000","last_active":"2024-09-13T18:24:59.463015+0000","last_peered":"2024-09-13T18:24:59.463015+0000","last_clean":"2024-09-13T18:24:59.463015+0000","last_became_active":"2024-09-13T18:24:58.439310+0000","last_became_peered":"2024-09-13T18:24:58.439310+0000","last_unstale":"2024-09-13T18:24:59.463015+0000","last_undegraded":"2024-09-13T18:24:59.463015+0000","last_fullsized":"2024-09-13T18:24:59.463015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389428+0000","last_change":"2024-09-13T18:24:58.024579+0000","last_active":"2024-09-13T18:24:59.389428+0000","last_peered":"2024-09-13T18:24:59.389428+0000","last_clean":"2024-09-13T18:24:59.389428+0000","last_became_active":"2024-09-13T18:24:58.023234+0000","last_became_peered":"2024-09-13T18:24:58.023234+0000","last_unstale":"2024-09-13T18:24:59.389428+0000","last_undegraded":"2024-09-13T18:24:59.389428+0000","last_fullsized":"2024-09-13T18:24:59.389428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463655+0000","last_change":"2024-09-13T18:24:58.439656+0000","last_active":"2024-09-13T18:24:59.463655+0000","last_peered":"2024-09-13T18:24:59.463655+0000","last_clean":"2024-09-13T18:24:59.463655+0000","last_became_active":"2024-09-13T18:24:58.439013+0000","last_became_peered":"2024-09-13T18:24:58.439013+0000","last_unstale":"2024-09-13T18:24:59.463655+0000","last_undegraded":"2024-09-13T18:24:59.463655+0000","last_fullsized":"2024-09-13T18:24:59.463655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155004+0000","last_change":"2024-09-13T18:24:58.013601+0000","last_active":"2024-09-13T18:25:00.155004+0000","last_peered":"2024-09-13T18:25:00.155004+0000","last_clean":"2024-09-13T18:25:00.155004+0000","last_became_active":"2024-09-13T18:24:58.012977+0000","last_became_peered":"2024-09-13T18:24:58.012977+0000","last_unstale":"2024-09-13T18:25:00.155004+0000","last_undegraded":"2024-09-13T18:25:00.155004+0000","last_fullsized":"2024-09-13T18:25:00.155004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.464058+0000","last_change":"2024-09-13T18:24:58.440756+0000","last_active":"2024-09-13T18:24:59.464058+0000","last_peered":"2024-09-13T18:24:59.464058+0000","last_clean":"2024-09-13T18:24:59.464058+0000","last_became_active":"2024-09-13T18:24:58.440064+0000","last_became_peered":"2024-09-13T18:24:58.440064+0000","last_unstale":"2024-09-13T18:24:59.464058+0000","last_undegraded":"2024-09-13T18:24:59.464058+0000","last_fullsized":"2024-09-13T18:24:59.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388284+0000","last_change":"2024-09-13T18:24:58.021101+0000","last_active":"2024-09-13T18:24:59.388284+0000","last_peered":"2024-09-13T18:24:59.388284+0000","last_clean":"2024-09-13T18:24:59.388284+0000","last_became_active":"2024-09-13T18:24:58.020782+0000","last_became_peered":"2024-09-13T18:24:58.020782+0000","last_unstale":"2024-09-13T18:24:59.388284+0000","last_undegraded":"2024-09-13T18:24:59.388284+0000","last_fullsized":"2024-09-13T18:24:59.388284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.441907+0000","last_change":"2024-09-13T18:24:58.417213+0000","last_active":"2024-09-13T18:24:58.441907+0000","last_peered":"2024-09-13T18:24:58.441907+0000","last_clean":"2024-09-13T18:24:58.441907+0000","last_became_active":"2024-09-13T18:24:58.415708+0000","last_became_peered":"2024-09-13T18:24:58.415708+0000","last_unstale":"2024-09-13T18:24:58.441907+0000","last_undegraded":"2024-09-13T18:24:58.441907+0000","last_fullsized":"2024-09-13T18:24:58.441907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155281+0000","last_change":"2024-09-13T18:24:58.017225+0000","last_active":"2024-09-13T18:25:00.155281+0000","last_peered":"2024-09-13T18:25:00.155281+0000","last_clean":"2024-09-13T18:25:00.155281+0000","last_became_active":"2024-09-13T18:24:58.016815+0000","last_became_peered":"2024-09-13T18:24:58.016815+0000","last_unstale":"2024-09-13T18:25:00.155281+0000","last_undegraded":"2024-09-13T18:25:00.155281+0000","last_fullsized":"2024-09-13T18:25:00.155281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463041+0000","last_change":"2024-09-13T18:24:58.425095+0000","last_active":"2024-09-13T18:24:59.463041+0000","last_peered":"2024-09-13T18:24:59.463041+0000","last_clean":"2024-09-13T18:24:59.463041+0000","last_became_active":"2024-09-13T18:24:58.424483+0000","last_became_peered":"2024-09-13T18:24:58.424483+0000","last_unstale":"2024-09-13T18:24:59.463041+0000","last_undegraded":"2024-09-13T18:24:59.463041+0000","last_fullsized":"2024-09-13T18:24:59.463041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396354+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:24:58.396354+0000","last_peered":"2024-09-13T18:24:58.396354+0000","last_clean":"2024-09-13T18:24:58.396354+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:24:58.396354+0000","last_undegraded":"2024-09-13T18:24:58.396354+0000","last_fullsized":"2024-09-13T18:24:58.396354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.400246+0000","last_change":"2024-09-13T18:24:58.029698+0000","last_active":"2024-09-13T18:24:58.400246+0000","last_peered":"2024-09-13T18:24:58.400246+0000","last_clean":"2024-09-13T18:24:58.400246+0000","last_became_active":"2024-09-13T18:24:58.028952+0000","last_became_peered":"2024-09-13T18:24:58.028952+0000","last_unstale":"2024-09-13T18:24:58.400246+0000","last_undegraded":"2024-09-13T18:24:58.400246+0000","last_fullsized":"2024-09-13T18:24:58.400246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670059+0000","last_change":"2024-09-13T18:24:58.421648+0000","last_active":"2024-09-13T18:24:59.670059+0000","last_peered":"2024-09-13T18:24:59.670059+0000","last_clean":"2024-09-13T18:24:59.670059+0000","last_became_active":"2024-09-13T18:24:58.421356+0000","last_became_peered":"2024-09-13T18:24:58.421356+0000","last_unstale":"2024-09-13T18:24:59.670059+0000","last_undegraded":"2024-09-13T18:24:59.670059+0000","last_fullsized":"2024-09-13T18:24:59.670059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462728+0000","last_change":"2024-09-13T18:24:58.034925+0000","last_active":"2024-09-13T18:24:59.462728+0000","last_peered":"2024-09-13T18:24:59.462728+0000","last_clean":"2024-09-13T18:24:59.462728+0000","last_became_active":"2024-09-13T18:24:58.033842+0000","last_became_peered":"2024-09-13T18:24:58.033842+0000","last_unstale":"2024-09-13T18:24:59.462728+0000","last_undegraded":"2024-09-13T18:24:59.462728+0000","last_fullsized":"2024-09-13T18:24:59.462728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396346+0000","last_change":"2024-09-13T18:24:58.394853+0000","last_active":"2024-09-13T18:24:58.396346+0000","last_peered":"2024-09-13T18:24:58.396346+0000","last_clean":"2024-09-13T18:24:58.396346+0000","last_became_active":"2024-09-13T18:24:58.394595+0000","last_became_peered":"2024-09-13T18:24:58.394595+0000","last_unstale":"2024-09-13T18:24:58.396346+0000","last_undegraded":"2024-09-13T18:24:58.396346+0000","last_fullsized":"2024-09-13T18:24:58.396346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154842+0000","last_change":"2024-09-13T18:24:58.012966+0000","last_active":"2024-09-13T18:25:00.154842+0000","last_peered":"2024-09-13T18:25:00.154842+0000","last_clean":"2024-09-13T18:25:00.154842+0000","last_became_active":"2024-09-13T18:24:58.012406+0000","last_became_peered":"2024-09-13T18:24:58.012406+0000","last_unstale":"2024-09-13T18:25:00.154842+0000","last_undegraded":"2024-09-13T18:25:00.154842+0000","last_fullsized":"2024-09-13T18:25:00.154842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387622+0000","last_change":"2024-09-13T18:24:58.395770+0000","last_active":"2024-09-13T18:24:59.387622+0000","last_peered":"2024-09-13T18:24:59.387622+0000","last_clean":"2024-09-13T18:24:59.387622+0000","last_became_active":"2024-09-13T18:24:58.395459+0000","last_became_peered":"2024-09-13T18:24:58.395459+0000","last_unstale":"2024-09-13T18:24:59.387622+0000","last_undegraded":"2024-09-13T18:24:59.387622+0000","last_fullsized":"2024-09-13T18:24:59.387622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.408012+0000","last_change":"2024-09-13T18:24:58.033195+0000","last_active":"2024-09-13T18:24:58.408012+0000","last_peered":"2024-09-13T18:24:58.408012+0000","last_clean":"2024-09-13T18:24:58.408012+0000","last_became_active":"2024-09-13T18:24:58.032049+0000","last_became_peered":"2024-09-13T18:24:58.032049+0000","last_unstale":"2024-09-13T18:24:58.408012+0000","last_undegraded":"2024-09-13T18:24:58.408012+0000","last_fullsized":"2024-09-13T18:24:58.408012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389525+0000","last_change":"2024-09-13T18:24:58.392965+0000","last_active":"2024-09-13T18:24:59.389525+0000","last_peered":"2024-09-13T18:24:59.389525+0000","last_clean":"2024-09-13T18:24:59.389525+0000","last_became_active":"2024-09-13T18:24:58.392228+0000","last_became_peered":"2024-09-13T18:24:58.392228+0000","last_unstale":"2024-09-13T18:24:59.389525+0000","last_undegraded":"2024-09-13T18:24:59.389525+0000","last_fullsized":"2024-09-13T18:24:59.389525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387904+0000","last_change":"2024-09-13T18:24:58.014413+0000","last_active":"2024-09-13T18:24:59.387904+0000","last_peered":"2024-09-13T18:24:59.387904+0000","last_clean":"2024-09-13T18:24:59.387904+0000","last_became_active":"2024-09-13T18:24:58.013907+0000","last_became_peered":"2024-09-13T18:24:58.013907+0000","last_unstale":"2024-09-13T18:24:59.387904+0000","last_undegraded":"2024-09-13T18:24:59.387904+0000","last_fullsized":"2024-09-13T18:24:59.387904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442349+0000","last_change":"2024-09-13T18:24:58.416160+0000","last_active":"2024-09-13T18:24:58.442349+0000","last_peered":"2024-09-13T18:24:58.442349+0000","last_clean":"2024-09-13T18:24:58.442349+0000","last_became_active":"2024-09-13T18:24:58.415331+0000","last_became_peered":"2024-09-13T18:24:58.415331+0000","last_unstale":"2024-09-13T18:24:58.442349+0000","last_undegraded":"2024-09-13T18:24:58.442349+0000","last_fullsized":"2024-09-13T18:24:58.442349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463346+0000","last_change":"2024-09-13T18:24:58.038596+0000","last_active":"2024-09-13T18:24:59.463346+0000","last_peered":"2024-09-13T18:24:59.463346+0000","last_clean":"2024-09-13T18:24:59.463346+0000","last_became_active":"2024-09-13T18:24:58.037754+0000","last_became_peered":"2024-09-13T18:24:58.037754+0000","last_unstale":"2024-09-13T18:24:59.463346+0000","last_undegraded":"2024-09-13T18:24:59.463346+0000","last_fullsized":"2024-09-13T18:24:59.463346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387779+0000","last_change":"2024-09-13T18:24:58.395308+0000","last_active":"2024-09-13T18:24:59.387779+0000","last_peered":"2024-09-13T18:24:59.387779+0000","last_clean":"2024-09-13T18:24:59.387779+0000","last_became_active":"2024-09-13T18:24:58.394989+0000","last_became_peered":"2024-09-13T18:24:58.394989+0000","last_unstale":"2024-09-13T18:24:59.387779+0000","last_undegraded":"2024-09-13T18:24:59.387779+0000","last_fullsized":"2024-09-13T18:24:59.387779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388196+0000","last_change":"2024-09-13T18:24:58.043141+0000","last_active":"2024-09-13T18:24:59.388196+0000","last_peered":"2024-09-13T18:24:59.388196+0000","last_clean":"2024-09-13T18:24:59.388196+0000","last_became_active":"2024-09-13T18:24:58.042796+0000","last_became_peered":"2024-09-13T18:24:58.042796+0000","last_unstale":"2024-09-13T18:24:59.388196+0000","last_undegraded":"2024-09-13T18:24:59.388196+0000","last_fullsized":"2024-09-13T18:24:59.388196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670417+0000","last_change":"2024-09-13T18:24:58.415075+0000","last_active":"2024-09-13T18:24:59.670417+0000","last_peered":"2024-09-13T18:24:59.670417+0000","last_clean":"2024-09-13T18:24:59.670417+0000","last_became_active":"2024-09-13T18:24:58.414794+0000","last_became_peered":"2024-09-13T18:24:58.414794+0000","last_unstale":"2024-09-13T18:24:59.670417+0000","last_undegraded":"2024-09-13T18:24:59.670417+0000","last_fullsized":"2024-09-13T18:24:59.670417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:02.097074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442490+0000","last_change":"2024-09-13T18:24:58.040550+0000","last_active":"2024-09-13T18:24:58.442490+0000","last_peered":"2024-09-13T18:24:58.442490+0000","last_clean":"2024-09-13T18:24:58.442490+0000","last_became_active":"2024-09-13T18:24:58.039933+0000","last_became_peered":"2024-09-13T18:24:58.039933+0000","last_unstale":"2024-09-13T18:24:58.442490+0000","last_undegraded":"2024-09-13T18:24:58.442490+0000","last_fullsized":"2024-09-13T18:24:58.442490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.398949+0000","last_change":"2024-09-13T18:24:58.397002+0000","last_active":"2024-09-13T18:24:58.398949+0000","last_peered":"2024-09-13T18:24:58.398949+0000","last_clean":"2024-09-13T18:24:58.398949+0000","last_became_active":"2024-09-13T18:24:58.396735+0000","last_became_peered":"2024-09-13T18:24:58.396735+0000","last_unstale":"2024-09-13T18:24:58.398949+0000","last_undegraded":"2024-09-13T18:24:58.398949+0000","last_fullsized":"2024-09-13T18:24:58.398949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462686+0000","last_change":"2024-09-13T18:24:58.033754+0000","last_active":"2024-09-13T18:24:59.462686+0000","last_peered":"2024-09-13T18:24:59.462686+0000","last_clean":"2024-09-13T18:24:59.462686+0000","last_became_active":"2024-09-13T18:24:58.031165+0000","last_became_peered":"2024-09-13T18:24:58.031165+0000","last_unstale":"2024-09-13T18:24:59.462686+0000","last_undegraded":"2024-09-13T18:24:59.462686+0000","last_fullsized":"2024-09-13T18:24:59.462686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389086+0000","last_change":"2024-09-13T18:24:58.394401+0000","last_active":"2024-09-13T18:24:59.389086+0000","last_peered":"2024-09-13T18:24:59.389086+0000","last_clean":"2024-09-13T18:24:59.389086+0000","last_became_active":"2024-09-13T18:24:58.392351+0000","last_became_peered":"2024-09-13T18:24:58.392351+0000","last_unstale":"2024-09-13T18:24:59.389086+0000","last_undegraded":"2024-09-13T18:24:59.389086+0000","last_fullsized":"2024-09-13T18:24:59.389086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387555+0000","last_change":"2024-09-13T18:24:58.034526+0000","last_active":"2024-09-13T18:24:59.387555+0000","last_peered":"2024-09-13T18:24:59.387555+0000","last_clean":"2024-09-13T18:24:59.387555+0000","last_became_active":"2024-09-13T18:24:58.034217+0000","last_became_peered":"2024-09-13T18:24:58.034217+0000","last_unstale":"2024-09-13T18:24:59.387555+0000","last_undegraded":"2024-09-13T18:24:59.387555+0000","last_fullsized":"2024-09-13T18:24:59.387555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669724+0000","last_change":"2024-09-13T18:24:58.398957+0000","last_active":"2024-09-13T18:24:59.669724+0000","last_peered":"2024-09-13T18:24:59.669724+0000","last_clean":"2024-09-13T18:24:59.669724+0000","last_became_active":"2024-09-13T18:24:58.398692+0000","last_became_peered":"2024-09-13T18:24:58.398692+0000","last_unstale":"2024-09-13T18:24:59.669724+0000","last_undegraded":"2024-09-13T18:24:59.669724+0000","last_fullsized":"2024-09-13T18:24:59.669724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388073+0000","last_change":"2024-09-13T18:24:58.013615+0000","last_active":"2024-09-13T18:24:59.388073+0000","last_peered":"2024-09-13T18:24:59.388073+0000","last_clean":"2024-09-13T18:24:59.388073+0000","last_became_active":"2024-09-13T18:24:58.013286+0000","last_became_peered":"2024-09-13T18:24:58.013286+0000","last_unstale":"2024-09-13T18:24:59.388073+0000","last_undegraded":"2024-09-13T18:24:59.388073+0000","last_fullsized":"2024-09-13T18:24:59.388073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670318+0000","last_change":"2024-09-13T18:24:58.400483+0000","last_active":"2024-09-13T18:24:59.670318+0000","last_peered":"2024-09-13T18:24:59.670318+0000","last_clean":"2024-09-13T18:24:59.670318+0000","last_became_active":"2024-09-13T18:24:58.400227+0000","last_became_peered":"2024-09-13T18:24:58.400227+0000","last_unstale":"2024-09-13T18:24:59.670318+0000","last_undegraded":"2024-09-13T18:24:59.670318+0000","last_fullsized":"2024-09-13T18:24:59.670318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463603+0000","last_change":"2024-09-13T18:24:58.041646+0000","last_active":"2024-09-13T18:24:59.463603+0000","last_peered":"2024-09-13T18:24:59.463603+0000","last_clean":"2024-09-13T18:24:59.463603+0000","last_became_active":"2024-09-13T18:24:58.040973+0000","last_became_peered":"2024-09-13T18:24:58.040973+0000","last_unstale":"2024-09-13T18:24:59.463603+0000","last_undegraded":"2024-09-13T18:24:59.463603+0000","last_fullsized":"2024-09-13T18:24:59.463603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.435609+0000","last_change":"2024-09-13T18:24:58.432390+0000","last_active":"2024-09-13T18:24:58.435609+0000","last_peered":"2024-09-13T18:24:58.435609+0000","last_clean":"2024-09-13T18:24:58.435609+0000","last_became_active":"2024-09-13T18:24:58.431733+0000","last_became_peered":"2024-09-13T18:24:58.431733+0000","last_unstale":"2024-09-13T18:24:58.435609+0000","last_undegraded":"2024-09-13T18:24:58.435609+0000","last_fullsized":"2024-09-13T18:24:58.435609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444836+0000","last_change":"2024-09-13T18:24:58.437372+0000","last_active":"2024-09-13T18:24:58.444836+0000","last_peered":"2024-09-13T18:24:58.444836+0000","last_clean":"2024-09-13T18:24:58.444836+0000","last_became_active":"2024-09-13T18:24:58.436708+0000","last_became_peered":"2024-09-13T18:24:58.436708+0000","last_unstale":"2024-09-13T18:24:58.444836+0000","last_undegraded":"2024-09-13T18:24:58.444836+0000","last_fullsized":"2024-09-13T18:24:58.444836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463101+0000","last_change":"2024-09-13T18:24:58.037424+0000","last_active":"2024-09-13T18:24:59.463101+0000","last_peered":"2024-09-13T18:24:59.463101+0000","last_clean":"2024-09-13T18:24:59.463101+0000","last_became_active":"2024-09-13T18:24:58.036405+0000","last_became_peered":"2024-09-13T18:24:58.036405+0000","last_unstale":"2024-09-13T18:24:59.463101+0000","last_undegraded":"2024-09-13T18:24:59.463101+0000","last_fullsized":"2024-09-13T18:24:59.463101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.444767+0000","last_change":"2024-09-13T18:24:58.435968+0000","last_active":"2024-09-13T18:24:58.444767+0000","last_peered":"2024-09-13T18:24:58.444767+0000","last_clean":"2024-09-13T18:24:58.444767+0000","last_became_active":"2024-09-13T18:24:58.435619+0000","last_became_peered":"2024-09-13T18:24:58.435619+0000","last_unstale":"2024-09-13T18:24:58.444767+0000","last_undegraded":"2024-09-13T18:24:58.444767+0000","last_fullsized":"2024-09-13T18:24:58.444767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463214+0000","last_change":"2024-09-13T18:24:58.044836+0000","last_active":"2024-09-13T18:24:59.463214+0000","last_peered":"2024-09-13T18:24:59.463214+0000","last_clean":"2024-09-13T18:24:59.463214+0000","last_became_active":"2024-09-13T18:24:58.044091+0000","last_became_peered":"2024-09-13T18:24:58.044091+0000","last_unstale":"2024-09-13T18:24:59.463214+0000","last_undegraded":"2024-09-13T18:24:59.463214+0000","last_fullsized":"2024-09-13T18:24:59.463214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.419167+0000","last_change":"2024-09-13T18:24:58.418359+0000","last_active":"2024-09-13T18:24:58.419167+0000","last_peered":"2024-09-13T18:24:58.419167+0000","last_clean":"2024-09-13T18:24:58.419167+0000","last_became_active":"2024-09-13T18:24:58.418071+0000","last_became_peered":"2024-09-13T18:24:58.418071+0000","last_unstale":"2024-09-13T18:24:58.419167+0000","last_undegraded":"2024-09-13T18:24:58.419167+0000","last_fullsized":"2024-09-13T18:24:58.419167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670596+0000","last_change":"2024-09-13T18:24:58.016894+0000","last_active":"2024-09-13T18:24:59.670596+0000","last_peered":"2024-09-13T18:24:59.670596+0000","last_clean":"2024-09-13T18:24:59.670596+0000","last_became_active":"2024-09-13T18:24:58.016172+0000","last_became_peered":"2024-09-13T18:24:58.016172+0000","last_unstale":"2024-09-13T18:24:59.670596+0000","last_undegraded":"2024-09-13T18:24:59.670596+0000","last_fullsized":"2024-09-13T18:24:59.670596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.426766+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.426470+0000","last_became_peered":"2024-09-13T18:24:58.426470+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.442980+0000","last_change":"2024-09-13T18:24:58.025191+0000","last_active":"2024-09-13T18:24:58.442980+0000","last_peered":"2024-09-13T18:24:58.442980+0000","last_clean":"2024-09-13T18:24:58.442980+0000","last_became_active":"2024-09-13T18:24:58.024847+0000","last_became_peered":"2024-09-13T18:24:58.024847+0000","last_unstale":"2024-09-13T18:24:58.442980+0000","last_undegraded":"2024-09-13T18:24:58.442980+0000","last_fullsized":"2024-09-13T18:24:58.442980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:05.912577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31308,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340532,"statfs":{"total":96636764160,"available":96604704768,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":798720,"data_stored":655604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:25:02.796 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:25:02.796 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:25:02.796 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:25:02.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:25:02.797 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:25:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.954+0000 7f2b7e071640 1 Processor -- start 2024-09-13T18:25:02.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.954+0000 7f2b7e071640 1 -- start start 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b7e071640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b78158ba0 0x7f2b7806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b7e071640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2b7806fa80 0x7f2b780b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b7e071640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b780b2340 con 0x7f2b780cbb60 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b7e071640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b780b2860 con 0x7f2b7806fa80 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b7e071640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b78158f80 con 0x7f2b78158ba0 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b76ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2b780cbb60 0x7f2b7806f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48518/0 (socket says 172.21.15.53:48518) 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b76ffd640 1 -- 172.21.15.53:0/793140139 learned_addr learned my addr 172.21.15.53:0/793140139 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b77fff640 1 --2- 172.21.15.53:0/793140139 >> v2:172.21.15.53:3300/0 conn(0x7f2b7806fa80 0x7f2b780b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b777fe640 1 --2- 172.21.15.53:0/793140139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b78158ba0 0x7f2b7806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b767fc640 1 -- 172.21.15.53:0/793140139 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316050400 0 0) 0x7f2b68001120 con 0x7f2b780cbb60 2024-09-13T18:25:02.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b767fc640 1 -- 172.21.15.53:0/793140139 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b60003530 con 0x7f2b780cbb60 2024-09-13T18:25:02.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b77fff640 1 -- 172.21.15.53:0/793140139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b78158ba0 msgr2=0x7f2b7806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:02.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b77fff640 1 --2- 172.21.15.53:0/793140139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b78158ba0 0x7f2b7806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b77fff640 1 -- 172.21.15.53:0/793140139 >> v1:172.21.15.53:6789/0 conn(0x7f2b780cbb60 legacy=0x7f2b7806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b77fff640 1 -- 172.21.15.53:0/793140139 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b780b2580 con 0x7f2b7806fa80 2024-09-13T18:25:02.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.958+0000 7f2b777fe640 1 --2- 172.21.15.53:0/793140139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b78158ba0 0x7f2b7806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:02.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 --2- 172.21.15.53:0/793140139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7806fa80 0x7f2b780b1e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009d90 tx=0x7f2b7001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2d65c0f6348db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b767fc640 1 -- 172.21.15.53:0/793140139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700a5810 con 0x7f2b7806fa80 2024-09-13T18:25:02.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b767fc640 1 -- 172.21.15.53:0/793140139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700a5970 con 0x7f2b7806fa80 2024-09-13T18:25:02.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b767fc640 1 -- 172.21.15.53:0/793140139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700a5d00 con 0x7f2b7806fa80 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- 172.21.15.53:0/793140139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7806fa80 msgr2=0x7f2b780b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 --2- 172.21.15.53:0/793140139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7806fa80 0x7f2b780b1e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009d90 tx=0x7f2b7001c8e0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- 172.21.15.53:0/793140139 shutdown_connections 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 --2- 172.21.15.53:0/793140139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b7806fa80 0x7f2b780b1e00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 --2- 172.21.15.53:0/793140139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b78158ba0 0x7f2b7806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- 172.21.15.53:0/793140139 >> 172.21.15.53:0/793140139 conn(0x7f2b78065c80 msgr2=0x7f2b78066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- 172.21.15.53:0/793140139 shutdown_connections 2024-09-13T18:25:02.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- 172.21.15.53:0/793140139 wait complete. 2024-09-13T18:25:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 Processor -- start 2024-09-13T18:25:02.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- start start 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b7806fa80 0x7f2b7814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b780cbb60 0x7f2b7806b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b78158ba0 0x7f2b7806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7814ec10 con 0x7f2b78158ba0 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7815da80 con 0x7f2b780cbb60 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b78161640 con 0x7f2b7806fa80 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b78158ba0 0x7f2b7806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b78158ba0 0x7f2b7806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32962/0 (socket says 172.21.15.53:32962) 2024-09-13T18:25:02.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 -- 172.21.15.53:0/1591879187 learned_addr learned my addr 172.21.15.53:0/1591879187 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b76ffd640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b780cbb60 0x7f2b7806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b777fe640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b7806fa80 0x7f2b7814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 -- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b7806fa80 msgr2=0x7f2b7814e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b7806fa80 0x7f2b7814e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 -- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b780cbb60 msgr2=0x7f2b7806b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b780cbb60 0x7f2b7806b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 -- 172.21.15.53:0/1591879187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009a70 con 0x7f2b78158ba0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b76ffd640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b780cbb60 0x7f2b7806b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b77fff640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b78158ba0 0x7f2b7806b8b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001af90 tx=0x7f2b70019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b5ffff640 1 -- 172.21.15.53:0/1591879187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700b9650 con 0x7f2b78158ba0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b5ffff640 1 -- 172.21.15.53:0/1591879187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b700b97b0 con 0x7f2b78158ba0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b78161920 con 0x7f2b78158ba0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b5ffff640 1 -- 172.21.15.53:0/1591879187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b700b9b20 con 0x7f2b78158ba0 2024-09-13T18:25:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.962+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b78161ee0 con 0x7f2b78158ba0 2024-09-13T18:25:02.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.966+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b78067400 con 0x7f2b78158ba0 2024-09-13T18:25:02.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.966+0000 7f2b5ffff640 1 -- 172.21.15.53:0/1591879187 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b700b9c80 con 0x7f2b78158ba0 2024-09-13T18:25:02.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.966+0000 7f2b5ffff640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2b64066690 0x7f2b64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:02.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.966+0000 7f2b5ffff640 1 -- 172.21.15.53:0/1591879187 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b7011f390 con 0x7f2b78158ba0 2024-09-13T18:25:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.966+0000 7f2b777fe640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2b64066690 0x7f2b64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.966+0000 7f2b777fe640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2b64066690 0x7f2b64068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0096d0 tx=0x7f2b6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:02.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:02.970+0000 7f2b5ffff640 1 -- 172.21.15.53:0/1591879187 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b700ec710 con 0x7f2b78158ba0 2024-09-13T18:25:03.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.162+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2b780b1e00 con 0x7f2b78158ba0 2024-09-13T18:25:03.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.170+0000 7f2b5ffff640 1 -- 172.21.15.53:0/1591879187 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164895 (secure 0 0 0) 0x7f2b700efd30 con 0x7f2b78158ba0 2024-09-13T18:25:03.172 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:03.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.170+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2b64066690 msgr2=0x7f2b64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.170+0000 7f2b7e071640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2b64066690 0x7f2b64068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0096d0 tx=0x7f2b6c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:03.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.170+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b78158ba0 msgr2=0x7f2b7806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.170+0000 7f2b7e071640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b78158ba0 0x7f2b7806b8b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b7001af90 tx=0x7f2b70019680 comp rx=0 tx=0).stop 2024-09-13T18:25:03.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.170+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 shutdown_connections 2024-09-13T18:25:03.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.170+0000 7f2b7e071640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2b64066690 0x7f2b64068b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.174+0000 7f2b7e071640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b78158ba0 0x7f2b7806b8b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.174+0000 7f2b7e071640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b780cbb60 0x7f2b7806b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.174+0000 7f2b7e071640 1 --2- 172.21.15.53:0/1591879187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2b7806fa80 0x7f2b7814e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.174+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 >> 172.21.15.53:0/1591879187 conn(0x7f2b78065c80 msgr2=0x7f2b7815abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:03.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.174+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 shutdown_connections 2024-09-13T18:25:03.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.174+0000 7f2b7e071640 1 -- 172.21.15.53:0/1591879187 wait complete. 2024-09-13T18:25:03.194 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":133103669},{"type":"v1","addr":"172.21.15.87:6833","nonce":133103669}]},"active_addr":"172.21.15.87:6833/133103669","active_change":"2024-09-13T18:24:38.889085+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4098,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":88211871}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1598969345}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2827842914}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2413981801}]}]} 2024-09-13T18:25:03.197 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:25:03.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:25:03.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.314+0000 7fbcf5194640 1 Processor -- start 2024-09-13T18:25:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.314+0000 7fbcf5194640 1 -- start start 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcf5194640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf01582a0 0x7fbcf006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcf5194640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcf015b7c0 0x7fbcf006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcf5194640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf006d480 con 0x7fbcf0070c90 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcf5194640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf015aaf0 con 0x7fbcf015b7c0 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcf5194640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf006d760 con 0x7fbcf01582a0 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcf015b7c0 0x7fbcf006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcf015b7c0 0x7fbcf006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32966/0 (socket says 172.21.15.53:32966) 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 -- 172.21.15.53:0/857908310 learned_addr learned my addr 172.21.15.53:0/857908310 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbceed9d640 1 --2- 172.21.15.53:0/857908310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf01582a0 0x7fbcf006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 -- 172.21.15.53:0/857908310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf01582a0 msgr2=0x7fbcf006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 --2- 172.21.15.53:0/857908310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf01582a0 0x7fbcf006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 -- 172.21.15.53:0/857908310 >> v1:172.21.15.87:6789/0 conn(0x7fbcf0070c90 legacy=0x7fbcf006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 -- 172.21.15.53:0/857908310 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf015ace0 con 0x7fbcf015b7c0 2024-09-13T18:25:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcee59c640 1 --2- 172.21.15.53:0/857908310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf015b7c0 0x7fbcf006ce40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009870 tx=0x7fbce401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c810d7f27363230 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcedd9b640 1 -- 172.21.15.53:0/857908310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40ac410 con 0x7fbcf015b7c0 2024-09-13T18:25:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcedd9b640 1 -- 172.21.15.53:0/857908310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce40ac570 con 0x7fbcf015b7c0 2024-09-13T18:25:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.318+0000 7fbcedd9b640 1 -- 172.21.15.53:0/857908310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40ac900 con 0x7fbcf015b7c0 2024-09-13T18:25:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/857908310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf015b7c0 msgr2=0x7fbcf006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 --2- 172.21.15.53:0/857908310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf015b7c0 0x7fbcf006ce40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009870 tx=0x7fbce401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/857908310 shutdown_connections 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 --2- 172.21.15.53:0/857908310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf015b7c0 0x7fbcf006ce40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 --2- 172.21.15.53:0/857908310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf01582a0 0x7fbcf006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/857908310 >> 172.21.15.53:0/857908310 conn(0x7fbcf0065c80 msgr2=0x7fbcf0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/857908310 shutdown_connections 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/857908310 wait complete. 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 Processor -- start 2024-09-13T18:25:03.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- start start 2024-09-13T18:25:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf0070c90 0x7fbcf00acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf01582a0 0x7fbcf013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcf015b7c0 0x7fbcf0151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0140230 con 0x7fbcf01582a0 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0151f70 con 0x7fbcf015b7c0 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00aa4e0 con 0x7fbcf0070c90 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf01582a0 0x7fbcf013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf01582a0 0x7fbcf013fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32972/0 (socket says 172.21.15.53:32972) 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 -- 172.21.15.53:0/409951521 learned_addr learned my addr 172.21.15.53:0/409951521 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 -- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf0070c90 msgr2=0x7fbcf00acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf0070c90 0x7fbcf00acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 -- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcf015b7c0 msgr2=0x7fbcf0151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcf015b7c0 0x7fbcf0151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 -- 172.21.15.53:0/409951521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40094d0 con 0x7fbcf01582a0 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcee59c640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf01582a0 0x7fbcf013fcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbce401cd90 tx=0x7fbce4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcd77fe640 1 -- 172.21.15.53:0/409951521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40ac410 con 0x7fbcf01582a0 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcd77fe640 1 -- 172.21.15.53:0/409951521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce40b45c0 con 0x7fbcf01582a0 2024-09-13T18:25:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf01521a0 con 0x7fbcf01582a0 2024-09-13T18:25:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcd77fe640 1 -- 172.21.15.53:0/409951521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40b4990 con 0x7fbcf01582a0 2024-09-13T18:25:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf00aaa10 con 0x7fbcf01582a0 2024-09-13T18:25:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.322+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf0067400 con 0x7fbcf01582a0 2024-09-13T18:25:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.326+0000 7fbcd77fe640 1 -- 172.21.15.53:0/409951521 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbce40b4af0 con 0x7fbcf01582a0 2024-09-13T18:25:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.326+0000 7fbcd77fe640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbcdc0666c0 0x7fbcdc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.326+0000 7fbcd77fe640 1 -- 172.21.15.53:0/409951521 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbce411f150 con 0x7fbcf01582a0 2024-09-13T18:25:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.326+0000 7fbceed9d640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbcdc0666c0 0x7fbcdc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.326+0000 7fbceed9d640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbcdc0666c0 0x7fbcdc068b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbce00098f0 tx=0x7fbce0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.330+0000 7fbcd77fe640 1 -- 172.21.15.53:0/409951521 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbce40ec5a0 con 0x7fbcf01582a0 2024-09-13T18:25:03.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.490+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcf006f370 con 0x7fbcf01582a0 2024-09-13T18:25:03.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcd77fe640 1 -- 172.21.15.53:0/409951521 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fbce40efbc0 con 0x7fbcf01582a0 2024-09-13T18:25:03.495 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:03.495 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbcdc0666c0 msgr2=0x7fbcdc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbcdc0666c0 0x7fbcdc068b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbce00098f0 tx=0x7fbce0008040 comp rx=0 tx=0).stop 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf01582a0 msgr2=0x7fbcf013fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf01582a0 0x7fbcf013fcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbce401cd90 tx=0x7fbce4019290 comp rx=0 tx=0).stop 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 shutdown_connections 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbcdc0666c0 0x7fbcdc068b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcf015b7c0 0x7fbcf0151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf01582a0 0x7fbcf013fcf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 --2- 172.21.15.53:0/409951521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcf0070c90 0x7fbcf00acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 >> 172.21.15.53:0/409951521 conn(0x7fbcf0065c80 msgr2=0x7fbcf00cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 shutdown_connections 2024-09-13T18:25:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.494+0000 7fbcf5194640 1 -- 172.21.15.53:0/409951521 wait complete. 2024-09-13T18:25:03.514 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:25:03.514 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:03.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.630+0000 7f93b42e5640 1 Processor -- start 2024-09-13T18:25:03.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.630+0000 7f93b42e5640 1 -- start start 2024-09-13T18:25:03.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b42e5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac15c830 0x7f93ac0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b42e5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b7b40 0x7f93ac0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b42e5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac15cc10 con 0x7f93ac0d1be0 2024-09-13T18:25:03.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b42e5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0b50c0 con 0x7f93ac0b7b40 2024-09-13T18:25:03.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b42e5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0b41d0 con 0x7f93ac15c830 2024-09-13T18:25:03.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b1880640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b7b40 0x7f93ac0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2081640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac15c830 0x7f93ac0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2882640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f93ac0d1be0 0x7f93ac0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33786/0 (socket says 172.21.15.53:33786) 2024-09-13T18:25:03.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2882640 1 -- 172.21.15.53:0/3211982319 learned_addr learned my addr 172.21.15.53:0/3211982319 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2081640 1 -- 172.21.15.53:0/3211982319 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b7b40 msgr2=0x7f93ac0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2081640 1 --2- 172.21.15.53:0/3211982319 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b7b40 0x7f93ac0cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2081640 1 -- 172.21.15.53:0/3211982319 >> v1:172.21.15.87:6789/0 conn(0x7f93ac0d1be0 legacy=0x7f93ac0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2081640 1 -- 172.21.15.53:0/3211982319 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0b44b0 con 0x7f93ac15c830 2024-09-13T18:25:03.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b1880640 1 --2- 172.21.15.53:0/3211982319 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b7b40 0x7f93ac0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:03.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.634+0000 7f93b2081640 1 --2- 172.21.15.53:0/3211982319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac15c830 0x7f93ac0cd930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93a80097c0 tx=0x7f93a801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c562f62cb2c4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:03.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b107f640 1 -- 172.21.15.53:0/3211982319 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a8990 con 0x7f93ac15c830 2024-09-13T18:25:03.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b107f640 1 -- 172.21.15.53:0/3211982319 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a80a8af0 con 0x7f93ac15c830 2024-09-13T18:25:03.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b107f640 1 -- 172.21.15.53:0/3211982319 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a8e80 con 0x7f93ac15c830 2024-09-13T18:25:03.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- 172.21.15.53:0/3211982319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac15c830 msgr2=0x7f93ac0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 --2- 172.21.15.53:0/3211982319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac15c830 0x7f93ac0cd930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93a80097c0 tx=0x7f93a801ec90 comp rx=0 tx=0).stop 2024-09-13T18:25:03.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- 172.21.15.53:0/3211982319 shutdown_connections 2024-09-13T18:25:03.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 --2- 172.21.15.53:0/3211982319 >> v2:172.21.15.87:3300/0 conn(0x7f93ac0b7b40 0x7f93ac0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 --2- 172.21.15.53:0/3211982319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac15c830 0x7f93ac0cd930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- 172.21.15.53:0/3211982319 >> 172.21.15.53:0/3211982319 conn(0x7f93ac070970 msgr2=0x7f93ac070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:03.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- 172.21.15.53:0/3211982319 shutdown_connections 2024-09-13T18:25:03.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- 172.21.15.53:0/3211982319 wait complete. 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 Processor -- start 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- start start 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0b7b40 0x7f93ac1f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0d1be0 0x7f93ac0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac15c830 0x7f93ac0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cb950 con 0x7f93ac0b7b40 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cbc30 con 0x7f93ac15c830 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b42e5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cbf10 con 0x7f93ac0d1be0 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0b7b40 0x7f93ac1f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0b7b40 0x7f93ac1f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32984/0 (socket says 172.21.15.53:32984) 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 -- 172.21.15.53:0/821821556 learned_addr learned my addr 172.21.15.53:0/821821556 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b1880640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0d1be0 0x7f93ac0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2882640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac15c830 0x7f93ac0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 -- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0d1be0 msgr2=0x7f93ac0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0d1be0 0x7f93ac0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 -- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac15c830 msgr2=0x7f93ac0c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac15c830 0x7f93ac0c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 -- 172.21.15.53:0/821821556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c0093b0 con 0x7f93ac0b7b40 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b1880640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0d1be0 0x7f93ac0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2882640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac15c830 0x7f93ac0c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93b2081640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0b7b40 0x7f93ac1f5040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93a801d340 tx=0x7f93a801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93a2ffd640 1 -- 172.21.15.53:0/821821556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80bf070 con 0x7f93ac0b7b40 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93a2ffd640 1 -- 172.21.15.53:0/821821556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8006e20 con 0x7f93ac0b7b40 2024-09-13T18:25:03.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.638+0000 7f93a2ffd640 1 -- 172.21.15.53:0/821821556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80b1e20 con 0x7f93ac0b7b40 2024-09-13T18:25:03.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a8009420 con 0x7f93ac0b7b40 2024-09-13T18:25:03.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0cc4d0 con 0x7f93ac0b7b40 2024-09-13T18:25:03.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac0cfa20 con 0x7f93ac0b7b40 2024-09-13T18:25:03.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93a2ffd640 1 -- 172.21.15.53:0/821821556 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93a80b7040 con 0x7f93ac0b7b40 2024-09-13T18:25:03.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93a2ffd640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066690 0x7f9390068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:03.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93a2ffd640 1 -- 172.21.15.53:0/821821556 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93a8121370 con 0x7f93ac0b7b40 2024-09-13T18:25:03.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93b1880640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066690 0x7f9390068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:03.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.642+0000 7f93b1880640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066690 0x7f9390068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93ac15dad0 tx=0x7f939c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:03.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.646+0000 7f93a2ffd640 1 -- 172.21.15.53:0/821821556 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93a80ee770 con 0x7f93ac0b7b40 2024-09-13T18:25:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.806+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93ac0cc6c0 con 0x7f93ac0b7b40 2024-09-13T18:25:03.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93a2ffd640 1 -- 172.21.15.53:0/821821556 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f93a80f1d90 con 0x7f93ac0b7b40 2024-09-13T18:25:03.811 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:03.811 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:03.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066690 msgr2=0x7f9390068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066690 0x7f9390068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93ac15dad0 tx=0x7f939c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0b7b40 msgr2=0x7f93ac1f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0b7b40 0x7f93ac1f5040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93a801d340 tx=0x7f93a801ba30 comp rx=0 tx=0).stop 2024-09-13T18:25:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 shutdown_connections 2024-09-13T18:25:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066690 0x7f9390068b50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0d1be0 0x7f93ac0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac15c830 0x7f93ac0c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 --2- 172.21.15.53:0/821821556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0b7b40 0x7f93ac1f5040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 >> 172.21.15.53:0/821821556 conn(0x7f93ac070970 msgr2=0x7f93ac0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 shutdown_connections 2024-09-13T18:25:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:03.810+0000 7f93b42e5640 1 -- 172.21.15.53:0/821821556 wait complete. 2024-09-13T18:25:03.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:25:03.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:25:03.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:25:03.833 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:25:03.834 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:25:03.834 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:25:03.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:25:03.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:25:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.014+0000 7fe13c897640 1 Processor -- start 2024-09-13T18:25:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.014+0000 7fe13c897640 1 -- start start 2024-09-13T18:25:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.014+0000 7f77e7e35640 1 Processor -- start 2024-09-13T18:25:04.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.014+0000 7f77e7e35640 1 -- start start 2024-09-13T18:25:04.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13c897640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1380b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13c897640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13815c120 con 0x7fe13806cfe0 2024-09-13T18:25:04.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13c897640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1380b1d00 con 0x7fe13815bd40 2024-09-13T18:25:04.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13c897640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13806c330 con 0x7fe138071cf0 2024-09-13T18:25:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13759e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe13806cfe0 0x7fe1380abe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48532/0 (socket says 172.21.15.53:48532) 2024-09-13T18:25:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13759e640 1 -- 172.21.15.53:0/981236306 learned_addr learned my addr 172.21.15.53:0/981236306 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13659c640 1 --2- 172.21.15.53:0/981236306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1380b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e7e35640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77e015a290 0x7f77e00705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e7e35640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77e00ab8e0 0x7f77e00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e7e35640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e015ac00 con 0x7f77e00b0a10 2024-09-13T18:25:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e7e35640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e015b880 con 0x7f77e00ab8e0 2024-09-13T18:25:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e7e35640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e015aee0 con 0x7f77e015a290 2024-09-13T18:25:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e63d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77e00ab8e0 0x7f77e00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e63d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77e00ab8e0 0x7f77e00cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32996/0 (socket says 172.21.15.53:32996) 2024-09-13T18:25:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e63d2640 1 -- 172.21.15.53:0/22557106 learned_addr learned my addr 172.21.15.53:0/22557106 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13659c640 1 -- 172.21.15.53:0/981236306 >> v1:172.21.15.87:6789/0 conn(0x7fe13815bd40 legacy=0x7fe1380715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13659c640 1 -- 172.21.15.53:0/981236306 >> v1:172.21.15.53:6789/0 conn(0x7fe13806cfe0 legacy=0x7fe1380abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7fe13659c640 1 -- 172.21.15.53:0/981236306 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13806c610 con 0x7fe138071cf0 2024-09-13T18:25:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f0974d1a640 1 Processor -- start 2024-09-13T18:25:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f0974d1a640 1 -- start start 2024-09-13T18:25:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e63d2640 1 -- 172.21.15.53:0/22557106 >> v2:172.21.15.87:3300/0 conn(0x7f77e015a290 msgr2=0x7f77e00705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e63d2640 1 --2- 172.21.15.53:0/22557106 >> v2:172.21.15.87:3300/0 conn(0x7f77e015a290 0x7f77e00705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e63d2640 1 -- 172.21.15.53:0/22557106 >> v1:172.21.15.87:6789/0 conn(0x7f77e00b0a10 legacy=0x7f77e00ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f77e63d2640 1 -- 172.21.15.53:0/22557106 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e015b1c0 con 0x7f77e00ab8e0 2024-09-13T18:25:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f0974d1a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f097015c8e0 0x7f09700cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f0974d1a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09700d0340 0x7f09700b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f0974d1a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097015ccc0 con 0x7f09700b5d40 2024-09-13T18:25:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f0974d1a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09700d1e10 con 0x7f097015c8e0 2024-09-13T18:25:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f0974d1a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700d20f0 con 0x7f09700d0340 2024-09-13T18:25:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f096ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f09700b5d40 0x7f09700cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48534/0 (socket says 172.21.15.53:48534) 2024-09-13T18:25:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f096ed9d640 1 -- 172.21.15.53:0/4101982911 learned_addr learned my addr 172.21.15.53:0/4101982911 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f16f1a29640 1 Processor -- start 2024-09-13T18:25:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f370d59f640 1 Processor -- start 2024-09-13T18:25:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f370d59f640 1 -- start start 2024-09-13T18:25:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.018+0000 7f16f1a29640 1 -- start start 2024-09-13T18:25:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f370d59f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3708071450 0x7f37080cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f370d59f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37080b2400 con 0x7f37080b0c40 2024-09-13T18:25:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f370d59f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37080b2c10 con 0x7f370806f370 2024-09-13T18:25:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f370d59f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37080cc4a0 con 0x7f3708071450 2024-09-13T18:25:04.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f0967fff640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09700d0340 0x7f09700b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096e59c640 1 --2- 172.21.15.53:0/4101982911 >> v2:172.21.15.87:3300/0 conn(0x7f097015c8e0 0x7f09700cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f36fffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3708071450 0x7f37080cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340943056 0 0) 0x7f097015ccc0 con 0x7f09700b5d40 2024-09-13T18:25:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f095c003530 con 0x7f09700b5d40 2024-09-13T18:25:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f3706ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f370806f370 0x7f370806f750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33818/0 (socket says 172.21.15.53:33818) 2024-09-13T18:25:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f3706ffd640 1 -- 172.21.15.53:0/2927141106 learned_addr learned my addr 172.21.15.53:0/2927141106 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13659c640 1 --2- 172.21.15.53:0/981236306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1380b2200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0087f0 tx=0x7fe12c01e3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3a36f986f5cc592 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 Processor -- start 2024-09-13T18:25:04.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f9174f09640 1 Processor -- start 2024-09-13T18:25:04.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3564229674 0 0) 0x7f095c003530 con 0x7f09700b5d40 2024-09-13T18:25:04.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09700d0340 msgr2=0x7f09700b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09700d0340 0x7f09700b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 >> v2:172.21.15.87:3300/0 conn(0x7f097015c8e0 msgr2=0x7f09700cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 --2- 172.21.15.53:0/4101982911 >> v2:172.21.15.87:3300/0 conn(0x7f097015c8e0 0x7f09700cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700d23d0 con 0x7f09700b5d40 2024-09-13T18:25:04.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0968001680 con 0x7f09700b5d40 2024-09-13T18:25:04.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16f1a29640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16e40e6f20 0x7f16e40520c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16f1a29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16e4047670 0x7f16e404eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16f1a29640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e4005b30 con 0x7f16e4053910 2024-09-13T18:25:04.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16f1a29640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e4005dd0 con 0x7f16e4047670 2024-09-13T18:25:04.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16f1a29640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e40060b0 con 0x7f16e40e6f20 2024-09-13T18:25:04.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 -- start start 2024-09-13T18:25:04.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 >> v1:172.21.15.53:6789/0 conn(0x7f09700b5d40 legacy=0x7f09700cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09700d0340 0x7f095c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f095c003f00 0x7f095c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f095c004d10 0x7f095c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700d1e10 con 0x7f095c003f00 2024-09-13T18:25:04.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700d20f0 con 0x7f095c004d10 2024-09-13T18:25:04.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c00b990 con 0x7f09700d0340 2024-09-13T18:25:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e63d2640 1 --2- 172.21.15.53:0/22557106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00ab8e0 0x7f77e00cdb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009e50 tx=0x7f77d801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5916a59258e456 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe135d9b640 1 -- 172.21.15.53:0/981236306 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0a6cb0 con 0x7fe138071cf0 2024-09-13T18:25:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f0967fff640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f095c003f00 0x7f095c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe135d9b640 1 -- 172.21.15.53:0/981236306 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c0aa070 con 0x7fe138071cf0 2024-09-13T18:25:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe135d9b640 1 -- 172.21.15.53:0/981236306 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0b0620 con 0x7fe138071cf0 2024-09-13T18:25:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f9174f09640 1 -- start start 2024-09-13T18:25:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16ebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16e4047670 0x7f16e404eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16ebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16e4047670 0x7f16e404eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33002/0 (socket says 172.21.15.53:33002) 2024-09-13T18:25:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16ebfff640 1 -- 172.21.15.53:0/1697856415 learned_addr learned my addr 172.21.15.53:0/1697856415 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f096ed9d640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f095c004d10 0x7f095c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f0967fff640 1 -- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09700d0340 msgr2=0x7f095c003980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:25:04.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f0967fff640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09700d0340 0x7f095c003980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204291123 0 0) 0x7f37080b2400 con 0x7f37080b0c40 2024-09-13T18:25:04.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f4003530 con 0x7f37080b0c40 2024-09-13T18:25:04.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f0967fff640 1 -- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f095c004d10 msgr2=0x7f095c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16f0a27640 1 --2- 172.21.15.53:0/1697856415 >> v2:172.21.15.87:3300/0 conn(0x7f16e40e6f20 0x7f16e40520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16ebfff640 1 -- 172.21.15.53:0/1697856415 >> v2:172.21.15.87:3300/0 conn(0x7f16e40e6f20 msgr2=0x7f16e40520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16ebfff640 1 --2- 172.21.15.53:0/1697856415 >> v2:172.21.15.87:3300/0 conn(0x7f16e40e6f20 0x7f16e40520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16ebfff640 1 -- 172.21.15.53:0/1697856415 >> v1:172.21.15.87:6789/0 conn(0x7f16e4053910 legacy=0x7f16e4053da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f16ebfff640 1 -- 172.21.15.53:0/1697856415 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4006390 con 0x7f16e4047670 2024-09-13T18:25:04.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e4bcf640 1 -- 172.21.15.53:0/22557106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80090d0 con 0x7f77e00ab8e0 2024-09-13T18:25:04.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e4bcf640 1 -- 172.21.15.53:0/22557106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d8009230 con 0x7f77e00ab8e0 2024-09-13T18:25:04.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4062203737 0 0) 0x7f36f4003530 con 0x7f37080b0c40 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 >> v2:172.21.15.87:3300/0 conn(0x7f3708071450 msgr2=0x7f37080cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 --2- 172.21.15.53:0/2927141106 >> v2:172.21.15.87:3300/0 conn(0x7f3708071450 0x7f37080cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 >> v1:172.21.15.87:6789/0 conn(0x7f370806f370 legacy=0x7f370806f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080b2650 con 0x7f37080b0c40 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3700001a00 con 0x7f37080b0c40 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 >> v1:172.21.15.53:6789/0 conn(0x7f37080b0c40 legacy=0x7f37080cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f4003980 0x7f36f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f40047d0 0x7f36f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f4005190 0x7f36f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37080cc4a0 con 0x7f36f4003980 2024-09-13T18:25:04.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f400c130 con 0x7f36f40047d0 2024-09-13T18:25:04.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f400c2f0 con 0x7f36f4005190 2024-09-13T18:25:04.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13c897640 1 -- 172.21.15.53:0/981236306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 msgr2=0x7fe1380b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13c897640 1 --2- 172.21.15.53:0/981236306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1380b2200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0087f0 tx=0x7fe12c01e3e0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8868071840 0x7f8868164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88680b09a0 0x7f886815df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f886815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8868072460 con 0x7f8868071840 2024-09-13T18:25:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88681654f0 con 0x7f88680b09a0 2024-09-13T18:25:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886d57d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886815e9f0 con 0x7f8868071c20 2024-09-13T18:25:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13c897640 1 -- 172.21.15.53:0/981236306 shutdown_connections 2024-09-13T18:25:04.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13c897640 1 --2- 172.21.15.53:0/981236306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1380b2200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13c897640 1 -- 172.21.15.53:0/981236306 >> 172.21.15.53:0/981236306 conn(0x7fe13806f720 msgr2=0x7fe1380afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f37077fe640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f4005190 0x7f36f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f36fffff640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f40047d0 0x7f36f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f88677fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88680b09a0 0x7f886815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f88677fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88680b09a0 0x7f886815df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33310/0 (socket says 172.21.15.53:33310) 2024-09-13T18:25:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f88677fe640 1 -- 172.21.15.53:0/177293142 learned_addr learned my addr 172.21.15.53:0/177293142 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f8867fff640 1 --2- 172.21.15.53:0/177293142 >> v2:172.21.15.53:3300/0 conn(0x7f8868071840 0x7f8868164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f886cd7c640 1 --2- 172.21.15.53:0/177293142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f886815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f9174f09640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91701587e0 0x7f91700b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f9174f09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91700acea0 0x7f91700b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f9174f09640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91700aba00 con 0x7f91700720e0 2024-09-13T18:25:04.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 -- 172.21.15.53:0/22557106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00ab8e0 msgr2=0x7f77e00cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 --2- 172.21.15.53:0/22557106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00ab8e0 0x7f77e00cdb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009e50 tx=0x7f77d801c980 comp rx=0 tx=0).stop 2024-09-13T18:25:04.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f9174f09640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91700b1390 con 0x7f91700acea0 2024-09-13T18:25:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f9174f09640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91700b1630 con 0x7f91701587e0 2024-09-13T18:25:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f8867fff640 1 -- 172.21.15.53:0/177293142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 msgr2=0x7f886815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13c897640 1 -- 172.21.15.53:0/981236306 shutdown_connections 2024-09-13T18:25:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7fe13c897640 1 -- 172.21.15.53:0/981236306 wait complete. 2024-09-13T18:25:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f8867fff640 1 --2- 172.21.15.53:0/177293142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f886815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f8867fff640 1 -- 172.21.15.53:0/177293142 >> v2:172.21.15.87:3300/0 conn(0x7f88680b09a0 msgr2=0x7f886815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f8867fff640 1 --2- 172.21.15.53:0/177293142 >> v2:172.21.15.87:3300/0 conn(0x7f88680b09a0 0x7f886815df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f8867fff640 1 -- 172.21.15.53:0/177293142 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868161cd0 con 0x7f8868071840 2024-09-13T18:25:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f88677fe640 1 --2- 172.21.15.53:0/177293142 >> v2:172.21.15.87:3300/0 conn(0x7f88680b09a0 0x7f886815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 -- 172.21.15.53:0/22557106 shutdown_connections 2024-09-13T18:25:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 --2- 172.21.15.53:0/22557106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00ab8e0 0x7f77e00cdb30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 --2- 172.21.15.53:0/22557106 >> v2:172.21.15.87:3300/0 conn(0x7f77e015a290 0x7f77e00705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 -- 172.21.15.53:0/22557106 >> 172.21.15.53:0/22557106 conn(0x7f77e00afef0 msgr2=0x7f77e00b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 -- 172.21.15.53:0/22557106 shutdown_connections 2024-09-13T18:25:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16ebfff640 1 --2- 172.21.15.53:0/1697856415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4047670 0x7f16e404eb40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16e4007fa0 tx=0x7f16e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ec3e0e2e0c6a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f77e7e35640 1 -- 172.21.15.53:0/22557106 wait complete. 2024-09-13T18:25:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f0967fff640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f095c004d10 0x7f095c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f0967fff640 1 -- 172.21.15.53:0/4101982911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700d23d0 con 0x7f095c003f00 2024-09-13T18:25:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f096ed9d640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f095c004d10 0x7f095c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16eb7fe640 1 -- 172.21.15.53:0/1697856415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00ab670 con 0x7f16e4047670 2024-09-13T18:25:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16eb7fe640 1 -- 172.21.15.53:0/1697856415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e00ab7d0 con 0x7f16e4047670 2024-09-13T18:25:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 Processor -- start 2024-09-13T18:25:04.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f36fffff640 1 -- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f4005190 msgr2=0x7f36f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f36fffff640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f4005190 0x7f36f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f36fffff640 1 -- 172.21.15.53:0/2927141106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f4003980 msgr2=0x7f36f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f36fffff640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f4003980 0x7f36f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 Processor -- start 2024-09-13T18:25:04.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f36fffff640 1 -- 172.21.15.53:0/2927141106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080b2650 con 0x7f36f40047d0 2024-09-13T18:25:04.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f37077fe640 1 -- 172.21.15.53:0/2927141106 reap_dead start 2024-09-13T18:25:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f916ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91700acea0 0x7f91700b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f916ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91700acea0 0x7f91700b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33042/0 (socket says 172.21.15.53:33042) 2024-09-13T18:25:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f916ed9d640 1 -- 172.21.15.53:0/2426712582 learned_addr learned my addr 172.21.15.53:0/2426712582 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f916ed9d640 1 -- 172.21.15.53:0/2426712582 >> v2:172.21.15.87:3300/0 conn(0x7f91701587e0 msgr2=0x7f91700b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f916ed9d640 1 --2- 172.21.15.53:0/2426712582 >> v2:172.21.15.87:3300/0 conn(0x7f91701587e0 0x7f91700b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f916ed9d640 1 -- 172.21.15.53:0/2426712582 >> v1:172.21.15.87:6789/0 conn(0x7f91700720e0 legacy=0x7f91700705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.022+0000 7f916ed9d640 1 -- 172.21.15.53:0/2426712582 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700ab690 con 0x7f91700acea0 2024-09-13T18:25:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16eb7fe640 1 -- 172.21.15.53:0/1697856415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00abb60 con 0x7f16e4047670 2024-09-13T18:25:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f0967fff640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f095c003f00 0x7f095c0047d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0958009ae0 tx=0x7f095801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b247abb435978217 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 -- 172.21.15.53:0/1697856415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4047670 msgr2=0x7f16e404eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 --2- 172.21.15.53:0/1697856415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4047670 0x7f16e404eb40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16e4007fa0 tx=0x7f16e001c450 comp rx=0 tx=0).stop 2024-09-13T18:25:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580a5680 con 0x7f095c003f00 2024-09-13T18:25:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09580a57e0 con 0x7f095c003f00 2024-09-13T18:25:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f096dd9b640 1 -- 172.21.15.53:0/4101982911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580a5bd0 con 0x7f095c003f00 2024-09-13T18:25:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 -- start start 2024-09-13T18:25:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00b0a10 0x7f77e01feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77e015a290 0x7f77e009b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77e009bed0 0x7f77e006c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0202a20 con 0x7f77e00b0a10 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0201ea0 con 0x7f77e015a290 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e7e35640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0202180 con 0x7f77e009bed0 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00b0a10 0x7f77e01feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00b0a10 0x7f77e01feec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33054/0 (socket says 172.21.15.53:33054) 2024-09-13T18:25:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 -- 172.21.15.53:0/542729966 learned_addr learned my addr 172.21.15.53:0/542729966 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f8867fff640 1 --2- 172.21.15.53:0/177293142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868071840 0x7f8868164fb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8868161c40 tx=0x7f885c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e0a9433d8f86b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e53d0640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77e015a290 0x7f77e009b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e63d2640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77e009bed0 0x7f77e006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f8866ffd640 1 -- 172.21.15.53:0/177293142 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0ab610 con 0x7f8868071840 2024-09-13T18:25:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 -- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77e009bed0 msgr2=0x7f77e006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77e009bed0 0x7f77e006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 -- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77e015a290 msgr2=0x7f77e009b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77e015a290 0x7f77e009b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 -- 172.21.15.53:0/542729966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009b30 con 0x7f77e00b0a10 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f8866ffd640 1 -- 172.21.15.53:0/177293142 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0ab770 con 0x7f8868071840 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f8866ffd640 1 -- 172.21.15.53:0/177293142 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0abb00 con 0x7f8868071840 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 -- start start 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe13806cfe0 0x7fe13809b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1381f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe13815bd40 0x7fe13814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13809a3b0 con 0x7fe13815bd40 2024-09-13T18:25:04.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13809aef0 con 0x7fe13806cfe0 2024-09-13T18:25:04.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f0974d1a640 1 -- 172.21.15.53:0/4101982911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f095c003f00 msgr2=0x7f095c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13c897640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13809a5c0 con 0x7fe138071cf0 2024-09-13T18:25:04.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f0974d1a640 1 --2- 172.21.15.53:0/4101982911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f095c003f00 0x7f095c0047d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0958009ae0 tx=0x7f095801ca30 comp rx=0 tx=0).stop 2024-09-13T18:25:04.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f096ed9d640 1 -- 172.21.15.53:0/4101982911 reap_dead start 2024-09-13T18:25:04.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f0974d1a640 1 -- 172.21.15.53:0/4101982911 shutdown_connections 2024-09-13T18:25:04.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f0974d1a640 1 -- 172.21.15.53:0/4101982911 >> 172.21.15.53:0/4101982911 conn(0x7f0970070970 msgr2=0x7f0970070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe13815bd40 0x7fe13814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe13815bd40 0x7fe13814ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33070/0 (socket says 172.21.15.53:33070) 2024-09-13T18:25:04.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 -- 172.21.15.53:0/3864479514 learned_addr learned my addr 172.21.15.53:0/3864479514 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13659c640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1381f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe136d9d640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe13806cfe0 0x7fe13809b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 -- 172.21.15.53:0/1697856415 shutdown_connections 2024-09-13T18:25:04.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 --2- 172.21.15.53:0/1697856415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4047670 0x7f16e404eb40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 --2- 172.21.15.53:0/1697856415 >> v2:172.21.15.87:3300/0 conn(0x7f16e40e6f20 0x7f16e40520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 -- 172.21.15.53:0/1697856415 >> 172.21.15.53:0/1697856415 conn(0x7f16e4036070 msgr2=0x7f16e4036450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e53d0640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77e015a290 0x7f77e009b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:04.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77e5bd1640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00b0a10 0x7f77e01feec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00b410 tx=0x7f77dc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f916ed9d640 1 --2- 172.21.15.53:0/2426712582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91700acea0 0x7f91700b1f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f917006df30 tx=0x7f9164024f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fa74d07a31083 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 -- 172.21.15.53:0/1697856415 shutdown_connections 2024-09-13T18:25:04.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fcfd3143640 1 Processor -- start 2024-09-13T18:25:04.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f916d59a640 1 -- 172.21.15.53:0/2426712582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640b6410 con 0x7f91700acea0 2024-09-13T18:25:04.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f916d59a640 1 -- 172.21.15.53:0/2426712582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640b0030 con 0x7f91700acea0 2024-09-13T18:25:04.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f916d59a640 1 -- 172.21.15.53:0/2426712582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640b6790 con 0x7f91700acea0 2024-09-13T18:25:04.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc011830 con 0x7f77e00b0a10 2024-09-13T18:25:04.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc011990 con 0x7f77e00b0a10 2024-09-13T18:25:04.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc011d40 con 0x7f77e00b0a10 2024-09-13T18:25:04.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 -- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 msgr2=0x7fe1381f7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe138071cf0 0x7fe1381f7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 -- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe13806cfe0 msgr2=0x7fe13809b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe13806cfe0 0x7fe13809b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7fe13759e640 1 -- 172.21.15.53:0/3864479514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c0084a0 con 0x7fe13815bd40 2024-09-13T18:25:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd3143640 1 -- start start 2024-09-13T18:25:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f886d57d640 1 -- 172.21.15.53:0/177293142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868071840 msgr2=0x7f8868164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 --2- 172.21.15.53:0/177293142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868071840 0x7f8868164fb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8868161c40 tx=0x7f885c01c470 comp rx=0 tx=0).stop 2024-09-13T18:25:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- 172.21.15.53:0/177293142 shutdown_connections 2024-09-13T18:25:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 --2- 172.21.15.53:0/177293142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f886815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 --2- 172.21.15.53:0/177293142 >> v2:172.21.15.87:3300/0 conn(0x7f88680b09a0 0x7f886815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 --2- 172.21.15.53:0/177293142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8868071840 0x7f8868164fb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- 172.21.15.53:0/177293142 >> 172.21.15.53:0/177293142 conn(0x7f886806f720 msgr2=0x7f88680afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- 172.21.15.53:0/177293142 shutdown_connections 2024-09-13T18:25:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77e7e35640 1 -- 172.21.15.53:0/542729966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e0202460 con 0x7f77e00b0a10 2024-09-13T18:25:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77e7e35640 1 -- 172.21.15.53:0/542729966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e01ff400 con 0x7f77e00b0a10 2024-09-13T18:25:04.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 -- 172.21.15.53:0/4101982911 shutdown_connections 2024-09-13T18:25:04.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fe13759e640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe13815bd40 0x7fe13814ec20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe13000e780 tx=0x7fe13000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd3143640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd3143640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc403bb30 con 0x7fcfc40e5f60 2024-09-13T18:25:04.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd3143640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc4057cb0 con 0x7fcfc4056d10 2024-09-13T18:25:04.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd3143640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc4057f90 con 0x7fcfc403d5e0 2024-09-13T18:25:04.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.026+0000 7f16f1a29640 1 -- 172.21.15.53:0/1697856415 wait complete. 2024-09-13T18:25:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 Processor -- start 2024-09-13T18:25:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd0edf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcfc40e5f60 0x7fcfc40539d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48546/0 (socket says 172.21.15.53:48546) 2024-09-13T18:25:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd0edf640 1 -- 172.21.15.53:0/394449791 learned_addr learned my addr 172.21.15.53:0/394449791 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f9174f09640 1 -- 172.21.15.53:0/2426712582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91700acea0 msgr2=0x7f91700b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f9174f09640 1 --2- 172.21.15.53:0/2426712582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91700acea0 0x7f91700b1f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f917006df30 tx=0x7f9164024f00 comp rx=0 tx=0).stop 2024-09-13T18:25:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 -- 172.21.15.53:0/4101982911 wait complete. 2024-09-13T18:25:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd16e0640 1 --2- 172.21.15.53:0/394449791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 Processor -- start 2024-09-13T18:25:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- 172.21.15.53:0/177293142 wait complete. 2024-09-13T18:25:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 Processor -- start 2024-09-13T18:25:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f36fffff640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f40047d0 0x7f36f4004c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009ae0 tx=0x7f37080cdd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23a1f894af068046 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd16e0640 1 -- 172.21.15.53:0/394449791 >> v1:172.21.15.87:6789/0 conn(0x7fcfc4056d10 legacy=0x7fcfc4057180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:25:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd16e0640 1 -- 172.21.15.53:0/394449791 >> v1:172.21.15.53:6789/0 conn(0x7fcfc40e5f60 legacy=0x7fcfc40539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfd16e0640 1 -- 172.21.15.53:0/394449791 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc403bdd0 con 0x7fcfc403d5e0 2024-09-13T18:25:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77e7e35640 1 -- 172.21.15.53:0/542729966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77e00cdb30 con 0x7f77e00b0a10 2024-09-13T18:25:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f9174f09640 1 -- 172.21.15.53:0/2426712582 shutdown_connections 2024-09-13T18:25:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f9174f09640 1 --2- 172.21.15.53:0/2426712582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91700acea0 0x7f91700b1f30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f9174f09640 1 --2- 172.21.15.53:0/2426712582 >> v2:172.21.15.87:3300/0 conn(0x7f91701587e0 0x7f91700b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f9174f09640 1 -- 172.21.15.53:0/2426712582 >> 172.21.15.53:0/2426712582 conn(0x7f91700afef0 msgr2=0x7f91700b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f77dc01a400 con 0x7f77e00b0a10 2024-09-13T18:25:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80a55b0 con 0x7f36f40047d0 2024-09-13T18:25:04.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f80a5710 con 0x7f36f40047d0 2024-09-13T18:25:04.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f37067fc640 1 -- 172.21.15.53:0/2927141106 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80a5b00 con 0x7f36f40047d0 2024-09-13T18:25:04.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 -- start start 2024-09-13T18:25:04.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0970159220 0x7f09701f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09700c7ad0 0x7f09700c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0970159600 0x7f09700d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c85c0 con 0x7f09700c7ad0 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09701f73f0 con 0x7f0970159600 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0974d1a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c8000 con 0x7f0970159220 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000f930 con 0x7fe13815bd40 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13000fa90 con 0x7fe13815bd40 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000fe40 con 0x7fe13815bd40 2024-09-13T18:25:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13809a8a0 con 0x7fe13815bd40 2024-09-13T18:25:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe138098ec0 con 0x7fe13815bd40 2024-09-13T18:25:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77d67fc640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f77c4066690 0x7f77c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f096ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0970159600 0x7f09700d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77dc0842d0 con 0x7f77e00b0a10 2024-09-13T18:25:04.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f096ed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0970159600 0x7f09700d0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33370/0 (socket says 172.21.15.53:33370) 2024-09-13T18:25:04.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f096ed9d640 1 -- 172.21.15.53:0/1733226096 learned_addr learned my addr 172.21.15.53:0/1733226096 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77d67fc640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f77c406e830 0x7f77c4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 --> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77c4071300 con 0x7f77c406e830 2024-09-13T18:25:04.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- start start 2024-09-13T18:25:04.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8868071840 0x7f886815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f88680aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680b09a0 0x7f88680992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88680982e0 con 0x7f88680b09a0 2024-09-13T18:25:04.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8868098530 con 0x7f8868071840 2024-09-13T18:25:04.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f886d57d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868098810 con 0x7f8868071c20 2024-09-13T18:25:04.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 -- start start 2024-09-13T18:25:04.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16e4047670 0x7f16e400b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4053910 0x7f16e404d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16e40e6f20 0x7f16e40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40377f0 con 0x7f16e4053910 2024-09-13T18:25:04.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e404d620 con 0x7f16e40e6f20 2024-09-13T18:25:04.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f16f1a29640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40d4670 con 0x7f16e4047670 2024-09-13T18:25:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f370d59f640 1 -- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f40047d0 msgr2=0x7f36f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f370d59f640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f40047d0 0x7f36f4004c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009ae0 tx=0x7f37080cdd20 comp rx=0 tx=0).stop 2024-09-13T18:25:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f096e59c640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0970159220 0x7f09701f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f88677fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f88680aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f88677fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f88680aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52320/0 (socket says 172.21.15.53:52320) 2024-09-13T18:25:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f88677fe640 1 -- 172.21.15.53:0/1945304864 learned_addr learned my addr 172.21.15.53:0/1945304864 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f8867fff640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8868071840 0x7f886815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f77e53d0640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f77c4066690 0x7f77c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7f0967fff640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09700c7ad0 0x7f09700c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 -- 172.21.15.53:0/2426712582 shutdown_connections 2024-09-13T18:25:04.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f77e63d2640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f77c406e830 0x7f77c4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16f0a27640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16e4047670 0x7f16e400b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16f1228640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16e40e6f20 0x7f16e40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16f0a27640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16e4047670 0x7f16e400b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52344/0 (socket says 172.21.15.53:52344) 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16f0a27640 1 -- 172.21.15.53:0/4119957120 learned_addr learned my addr 172.21.15.53:0/4119957120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16ebfff640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4053910 0x7f16e404d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f096ed9d640 1 -- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0970159220 msgr2=0x7f09701f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f096ed9d640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0970159220 0x7f09701f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f096ed9d640 1 -- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09700c7ad0 msgr2=0x7f09700c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f096ed9d640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09700c7ad0 0x7f09700c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f096ed9d640 1 -- 172.21.15.53:0/1733226096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700c82e0 con 0x7f0970159600 2024-09-13T18:25:04.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe138067210 con 0x7fe13815bd40 2024-09-13T18:25:04.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f096ed9d640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0970159600 0x7f09700d0a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0968000fc0 tx=0x7f096800fe40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16ebfff640 1 -- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16e4047670 msgr2=0x7f16e400b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16ebfff640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16e4047670 0x7f16e400b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16ebfff640 1 -- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16e40e6f20 msgr2=0x7f16e40d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16ebfff640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16e40e6f20 0x7f16e40d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16ebfff640 1 -- 172.21.15.53:0/4119957120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00094d0 con 0x7f16e4053910 2024-09-13T18:25:04.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f88677fe640 1 -- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8868071840 msgr2=0x7f886815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f88677fe640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8868071840 0x7f886815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f88677fe640 1 -- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680b09a0 msgr2=0x7f88680992f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:25:04.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968004cc0 con 0x7f0970159600 2024-09-13T18:25:04.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09700c6400 con 0x7f0970159600 2024-09-13T18:25:04.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f77e63d2640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f77c406e830 0x7f77c4070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09700c7140 con 0x7f0970159600 2024-09-13T18:25:04.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16ebfff640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4053910 0x7f16e404d0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16e00ac000 tx=0x7f16e001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f370d59f640 1 -- 172.21.15.53:0/2927141106 shutdown_connections 2024-09-13T18:25:04.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f370d59f640 1 --2- 172.21.15.53:0/2927141106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36f40047d0 0x7f36f4004c50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f370d59f640 1 -- 172.21.15.53:0/2927141106 >> 172.21.15.53:0/2927141106 conn(0x7f37080b0120 msgr2=0x7f37080b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00b4800 con 0x7f16e4053910 2024-09-13T18:25:04.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f886cd7c640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680b09a0 0x7f88680992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e00b4980 con 0x7f16e4053910 2024-09-13T18:25:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00b4d30 con 0x7f16e4053910 2024-09-13T18:25:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e40397d0 con 0x7f16e4053910 2024-09-13T18:25:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e4037a40 con 0x7f16e4053910 2024-09-13T18:25:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 -- 172.21.15.53:0/2426712582 wait complete. 2024-09-13T18:25:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 Processor -- start 2024-09-13T18:25:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77dc011ea0 con 0x7f77e00b0a10 2024-09-13T18:25:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f88677fe640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680b09a0 0x7f88680992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f88677fe640 1 -- 172.21.15.53:0/1945304864 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009b30 con 0x7f8868071c20 2024-09-13T18:25:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0968004e40 con 0x7f0970159600 2024-09-13T18:25:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09680072b0 con 0x7f0970159600 2024-09-13T18:25:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.030+0000 7fcfcb7fe640 1 -- 172.21.15.53:0/394449791 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971490648 0 0) 0x7fcfc403bb30 con 0x7fcfc40e5f60 2024-09-13T18:25:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== osd.1 v2:172.21.15.53:6800/3812387586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f77c4071300 con 0x7f77c406e830 2024-09-13T18:25:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0954000fd0 con 0x7f0970159600 2024-09-13T18:25:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f370d59f640 1 -- 172.21.15.53:0/2927141106 shutdown_connections 2024-09-13T18:25:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe130015070 con 0x7fe13815bd40 2024-09-13T18:25:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7fe11f7fe640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe124066790 0x7fe124068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe130086a70 con 0x7fe13815bd40 2024-09-13T18:25:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7fe11f7fe640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7fe12406e930 0x7fe124070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 --> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe124071400 con 0x7fe12406e930 2024-09-13T18:25:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 -- start start 2024-09-13T18:25:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91700720e0 0x7f917009b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91700acea0 0x7f917006c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91701587e0 0x7f917006cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170203550 con 0x7f91701587e0 2024-09-13T18:25:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91701fc8b0 con 0x7f91700720e0 2024-09-13T18:25:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f9174f09640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91702028e0 con 0x7f91700acea0 2024-09-13T18:25:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16e4047a70 con 0x7f16e4053910 2024-09-13T18:25:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f370d59f640 1 -- 172.21.15.53:0/2927141106 wait complete. 2024-09-13T18:25:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f886cd7c640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680b09a0 0x7f88680992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f88677fe640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f88680aca00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f886000efc0 tx=0x7f886000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91700acea0 0x7f917006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000ce60 con 0x7f8868071c20 2024-09-13T18:25:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000f040 con 0x7f8868071c20 2024-09-13T18:25:04.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860014680 con 0x7f8868071c20 2024-09-13T18:25:04.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c009420 con 0x7f8868071c20 2024-09-13T18:25:04.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.034+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8868098dd0 con 0x7f8868071c20 2024-09-13T18:25:04.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd16e0640 1 --2- 172.21.15.53:0/394449791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40ed6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009820 tx=0x7fcfc001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0fe9b57f31c011 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8868161960 con 0x7f8868071c20 2024-09-13T18:25:04.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916e59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91700720e0 0x7f917009b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 Processor -- start 2024-09-13T18:25:04.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe130053e70 con 0x7fe13815bd40 2024-09-13T18:25:04.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fe13659c640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7fe12406e930 0x7fe124070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91700acea0 0x7f917006c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52356/0 (socket says 172.21.15.53:52356) 2024-09-13T18:25:04.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 -- 172.21.15.53:0/1757450110 learned_addr learned my addr 172.21.15.53:0/1757450110 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfcb7fe640 1 -- 172.21.15.53:0/394449791 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00ab610 con 0x7fcfc403d5e0 2024-09-13T18:25:04.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfcb7fe640 1 -- 172.21.15.53:0/394449791 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc00ab770 con 0x7fcfc403d5e0 2024-09-13T18:25:04.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfcb7fe640 1 -- 172.21.15.53:0/394449791 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00abb00 con 0x7fcfc403d5e0 2024-09-13T18:25:04.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16e00c7390 con 0x7f16e4053910 2024-09-13T18:25:04.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916ed9d640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91701587e0 0x7f917006cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fe136d9d640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe124066790 0x7fe124068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 -- start start 2024-09-13T18:25:04.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f77e53d0640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f77c4066690 0x7f77c4068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77e006d240 tx=0x7f77d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0968007410 con 0x7f0970159600 2024-09-13T18:25:04.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 -- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91700720e0 msgr2=0x7f917009b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91700720e0 0x7f917009b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 -- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91701587e0 msgr2=0x7f917006cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91701587e0 0x7f917006cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 -- 172.21.15.53:0/1757450110 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916400a570 con 0x7f91700acea0 2024-09-13T18:25:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16e97fa640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f16d0066760 0x7f16d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e011ec90 con 0x7f16e4053910 2024-09-13T18:25:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16e97fa640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f16d006e980 0x7f16d0070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 --> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16d0071450 con 0x7f16d006e980 2024-09-13T18:25:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e01242a0 con 0x7f16e4053910 2024-09-13T18:25:04.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- 172.21.15.53:0/394449791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 msgr2=0x7fcfc40ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 --2- 172.21.15.53:0/394449791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40ed6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009820 tx=0x7fcfc001c470 comp rx=0 tx=0).stop 2024-09-13T18:25:04.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- 172.21.15.53:0/394449791 shutdown_connections 2024-09-13T18:25:04.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 --2- 172.21.15.53:0/394449791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40ed6a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- 172.21.15.53:0/394449791 >> 172.21.15.53:0/394449791 conn(0x7fcfc403a480 msgr2=0x7fcfc403a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- 172.21.15.53:0/394449791 shutdown_connections 2024-09-13T18:25:04.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16f0a27640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f16d0066760 0x7f16d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f16f1228640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f16d006e980 0x7f16d0070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f40047d0 0x7f3708145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370814ae60 0x7f3708145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- 172.21.15.53:0/394449791 wait complete. 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0966ffd640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0950066690 0x7f0950068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0968087180 con 0x7f0970159600 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0966ffd640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f095006e8b0 0x7f0950070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 --> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0950071380 con 0x7f095006e8b0 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0968087530 con 0x7f0970159600 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0967fff640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f095006e8b0 0x7f0950070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f096e59c640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0950066690 0x7f0950068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f0967fff640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f095006e8b0 0x7f0950070cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708146090 0x7f3708148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37081487b0 con 0x7f3708146090 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370814e120 con 0x7f370814ae60 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f370d59f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3708143230 con 0x7f36f40047d0 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370814ae60 0x7f3708145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370814ae60 0x7f3708145b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33396/0 (socket says 172.21.15.53:33396) 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 -- 172.21.15.53:0/598700891 learned_addr learned my addr 172.21.15.53:0/598700891 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f3706ffd640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f40047d0 0x7f3708145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f37077fe640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708146090 0x7f3708148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 -- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f40047d0 msgr2=0x7f3708145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36f40047d0 0x7f3708145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 -- 172.21.15.53:0/598700891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708146090 msgr2=0x7f3708148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708146090 0x7f3708148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 -- 172.21.15.53:0/598700891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708146520 con 0x7f370814ae60 2024-09-13T18:25:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fe136d9d640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe124066790 0x7fe124068c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe128007fd0 tx=0x7fe128009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 Processor -- start 2024-09-13T18:25:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f916dd9b640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91700acea0 0x7f917006c690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f916000b3e0 tx=0x7f916000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fe13659c640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7fe12406e930 0x7fe124070d50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- start start 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40dd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfc4056d10 0x7fcfc40d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfc40e5f60 0x7fcfc4052610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40dd540 con 0x7fcfc40e5f60 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40d4a40 con 0x7fcfc4056d10 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd3143640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40dbf60 con 0x7fcfc403d5e0 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd16e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfc40e5f60 0x7fcfc4052610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd16e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfc40e5f60 0x7fcfc4052610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33126/0 (socket says 172.21.15.53:33126) 2024-09-13T18:25:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7fcfd16e0640 1 -- 172.21.15.53:0/1899849980 learned_addr learned my addr 172.21.15.53:0/1899849980 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f16f0a27640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f16d0066760 0x7f16d0068c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f16d8006fd0 tx=0x7f16d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160011830 con 0x7f91700acea0 2024-09-13T18:25:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91600119b0 con 0x7f91700acea0 2024-09-13T18:25:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160011d60 con 0x7f91700acea0 2024-09-13T18:25:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd0edf640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f16f1228640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f16d006e980 0x7f16d0070da0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfcbfff640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfc4056d10 0x7fcfc40d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f36fffff640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370814ae60 0x7f3708145b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36f801c8d0 tx=0x7f36f8019840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f37077fe640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3708146090 0x7f3708148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:04.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.038+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88600147e0 con 0x7f8868071c20 2024-09-13T18:25:04.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8864ff9640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8854066690 0x7f8854068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8860085440 con 0x7f8868071c20 2024-09-13T18:25:04.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8864ff9640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f885406e830 0x7f8854070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 --> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8854071300 con 0x7f885406e830 2024-09-13T18:25:04.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88600857b0 con 0x7f8868071c20 2024-09-13T18:25:04.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8867fff640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8854066690 0x7f8854068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd16e0640 1 -- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 msgr2=0x7fcfc40dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd16e0640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfc403d5e0 0x7fcfc40dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd16e0640 1 -- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfc4056d10 msgr2=0x7fcfc40d3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd16e0640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcfc4056d10 0x7fcfc40d3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80ad440 con 0x7f370814ae60 2024-09-13T18:25:04.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd16e0640 1 -- 172.21.15.53:0/1899849980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0009420 con 0x7fcfc40e5f60 2024-09-13T18:25:04.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370814db60 con 0x7f370814ae60 2024-09-13T18:25:04.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3708148440 con 0x7f370814ae60 2024-09-13T18:25:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f096e59c640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0950066690 0x7f0950068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f09600074a0 tx=0x7f096000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== osd.2 v2:172.21.15.53:6817/483943031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0950071380 con 0x7f095006e8b0 2024-09-13T18:25:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f80ad5a0 con 0x7f370814ae60 2024-09-13T18:25:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80ad950 con 0x7f370814ae60 2024-09-13T18:25:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd16e0640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfc40e5f60 0x7fcfc4052610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00ad040 tx=0x7fcfc001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9170202bc0 con 0x7f91700acea0 2024-09-13T18:25:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9170203180 con 0x7f91700acea0 2024-09-13T18:25:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00b5810 con 0x7fcfc40e5f60 2024-09-13T18:25:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc00b5970 con 0x7fcfc40e5f60 2024-09-13T18:25:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00b5d20 con 0x7fcfc40e5f60 2024-09-13T18:25:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc40dc240 con 0x7fcfc40e5f60 2024-09-13T18:25:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91700b04e0 con 0x7f91700acea0 2024-09-13T18:25:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8867fff640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8854066690 0x7f8854068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f885c0af000 tx=0x7f885c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f886cd7c640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f885406e830 0x7f8854070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc40dc800 con 0x7fcfc40e5f60 2024-09-13T18:25:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f886cd7c640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f885406e830 0x7f8854070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfc4010030 con 0x7fcfc40e5f60 2024-09-13T18:25:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== osd.6 v2:172.21.15.87:6824/2962233579 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe124071400 con 0x7fe12406e930 2024-09-13T18:25:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== osd.5 v2:172.21.15.87:6808/4170330072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f16d0071450 con 0x7f16d006e980 2024-09-13T18:25:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== osd.0 v2:172.21.15.53:6816/4131236486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8854071300 con 0x7f885406e830 2024-09-13T18:25:04.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.042+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36ec000fd0 con 0x7f370814ae60 2024-09-13T18:25:04.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36f80b4040 con 0x7f370814ae60 2024-09-13T18:25:04.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f36ff7fe640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f36e80666c0 0x7f36e8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36f811e3f0 con 0x7f370814ae60 2024-09-13T18:25:04.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f36ff7fe640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f36e806e860 0x7f36e8070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 --> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36e8071330 con 0x7f36e806e860 2024-09-13T18:25:04.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f80eb780 con 0x7f370814ae60 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcfc00bf410 con 0x7fcfc40e5f60 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfc97fa640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcfb0066760 0x7fcfb0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfc011f810 con 0x7fcfc40e5f60 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfc97fa640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fcfb006e980 0x7fcfb0070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 --> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfb0071450 con 0x7fcfb006e980 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc011fbc0 con 0x7fcfc40e5f60 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfcbfff640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fcfb006e980 0x7fcfb0070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfd0edf640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcfb0066760 0x7fcfb0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f916001a400 con 0x7f91700acea0 2024-09-13T18:25:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f915effd640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9150066760 0x7f9150068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91600847d0 con 0x7f91700acea0 2024-09-13T18:25:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f915effd640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f915006e980 0x7f9150070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 --> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9150071450 con 0x7f915006e980 2024-09-13T18:25:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9160084b80 con 0x7f91700acea0 2024-09-13T18:25:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f916e59c640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9150066760 0x7f9150068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfcbfff640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fcfb006e980 0x7fcfb0070da0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7fcfd0edf640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcfb0066760 0x7fcfb0068c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0687f0 tx=0x7fcfcc06c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.046+0000 7f916e59c640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9150066760 0x7f9150068c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f916800a400 tx=0x7f916800d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.050+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== osd.7 v2:172.21.15.87:6800/3723126663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcfb0071450 con 0x7fcfb006e980 2024-09-13T18:25:04.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.050+0000 7f3706ffd640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f36e80666c0 0x7f36e8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.050+0000 7f3706ffd640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f36e80666c0 0x7f36e8068b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36f0000f70 tx=0x7f36f0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.054+0000 7f916ed9d640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f915006e980 0x7f9150070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.054+0000 7f37077fe640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f36e806e860 0x7f36e8070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.054+0000 7f916ed9d640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f915006e980 0x7f9150070da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.054+0000 7f37077fe640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f36e806e860 0x7f36e8070c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.054+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== osd.3 v2:172.21.15.53:6808/205095619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9150071450 con 0x7f915006e980 2024-09-13T18:25:04.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.058+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== osd.4 v2:172.21.15.87:6816/2745365769 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f36e8071330 con 0x7f36e806e860 2024-09-13T18:25:04.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.058+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 --> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16e404eb40 con 0x7f16d006e980 2024-09-13T18:25:04.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.058+0000 7f16e97fa640 1 -- 172.21.15.53:0/4119957120 <== osd.5 v2:172.21.15.87:6808/4170330072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16e404eb40 con 0x7f16d006e980 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f16d006e980 msgr2=0x7f16d0070da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f16d006e980 0x7f16d0070da0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f16d0066760 msgr2=0x7f16d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f16d0066760 0x7f16d0068c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f16d8006fd0 tx=0x7f16d8008040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4053910 msgr2=0x7f16e404d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 --2- 172.21.15.53:0/4119957120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16e4053910 0x7f16e404d0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16e00ac000 tx=0x7f16e001ac90 comp rx=0 tx=0).stop 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1228640 1 -- 172.21.15.53:0/4119957120 reap_dead start 2024-09-13T18:25:04.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 shutdown_connections 2024-09-13T18:25:04.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 >> 172.21.15.53:0/4119957120 conn(0x7f16e4036070 msgr2=0x7f16e4035260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 shutdown_connections 2024-09-13T18:25:04.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f16f1a29640 1 -- 172.21.15.53:0/4119957120 wait complete. 2024-09-13T18:25:04.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 --> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8868164fb0 con 0x7f885406e830 2024-09-13T18:25:04.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.062+0000 7f77e7e35640 1 -- 172.21.15.53:0/542729966 --> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77e006aee0 con 0x7f77c406e830 2024-09-13T18:25:04.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f8864ff9640 1 -- 172.21.15.53:0/1945304864 <== osd.0 v2:172.21.15.53:6816/4131236486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8868164fb0 con 0x7f885406e830 2024-09-13T18:25:04.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f77d67fc640 1 -- 172.21.15.53:0/542729966 <== osd.1 v2:172.21.15.53:6800/3812387586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77e006aee0 con 0x7f77c406e830 2024-09-13T18:25:04.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f885406e830 msgr2=0x7f8854070c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f885406e830 0x7f8854070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8854066690 msgr2=0x7f8854068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8854066690 0x7f8854068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f885c0af000 tx=0x7f885c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 msgr2=0x7f88680aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 --2- 172.21.15.53:0/1945304864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8868071c20 0x7f88680aca00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f886000efc0 tx=0x7f886000c490 comp rx=0 tx=0).stop 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886cd7c640 1 -- 172.21.15.53:0/1945304864 reap_dead start 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 shutdown_connections 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 >> 172.21.15.53:0/1945304864 conn(0x7f886806f720 msgr2=0x7f88680971e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 shutdown_connections 2024-09-13T18:25:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.066+0000 7f886d57d640 1 -- 172.21.15.53:0/1945304864 wait complete. 2024-09-13T18:25:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 --> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0954002cc0 con 0x7f095006e8b0 2024-09-13T18:25:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f0966ffd640 1 -- 172.21.15.53:0/1733226096 <== osd.2 v2:172.21.15.53:6817/483943031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0954002cc0 con 0x7f095006e8b0 2024-09-13T18:25:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 --> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe13809b030 con 0x7fe12406e930 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 -- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f77c406e830 msgr2=0x7f77c4070c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f77c406e830 0x7f77c4070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 -- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f77c4066690 msgr2=0x7f77c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f77c4066690 0x7f77c4068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77e006d240 tx=0x7f77d0008040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 -- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00b0a10 msgr2=0x7f77e01feec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 --2- 172.21.15.53:0/542729966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e00b0a10 0x7f77e01feec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00b410 tx=0x7f77dc00b8d0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77e63d2640 1 -- 172.21.15.53:0/542729966 reap_dead start 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 -- 172.21.15.53:0/542729966 shutdown_connections 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 -- 172.21.15.53:0/542729966 >> 172.21.15.53:0/542729966 conn(0x7f77e00afef0 msgr2=0x7f77e00af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 -- 172.21.15.53:0/542729966 shutdown_connections 2024-09-13T18:25:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7f77c3fff640 1 -- 172.21.15.53:0/542729966 wait complete. 2024-09-13T18:25:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.070+0000 7fe11f7fe640 1 -- 172.21.15.53:0/3864479514 <== osd.6 v2:172.21.15.87:6824/2962233579 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe13809b030 con 0x7fe12406e930 2024-09-13T18:25:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f095006e8b0 msgr2=0x7f0950070cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7f0974d1a640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f095006e8b0 0x7f0950070cd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7fe12406e930 msgr2=0x7fe124070d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fe13c897640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7fe12406e930 0x7fe124070d50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0950066690 msgr2=0x7f0950068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7f0974d1a640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0950066690 0x7f0950068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f09600074a0 tx=0x7f096000b040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0970159600 msgr2=0x7f09700d0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7f0974d1a640 1 --2- 172.21.15.53:0/1733226096 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0970159600 0x7f09700d0a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0968000fc0 tx=0x7f096800fe40 comp rx=0 tx=0).stop 2024-09-13T18:25:04.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7f096ed9d640 1 -- 172.21.15.53:0/1733226096 reap_dead start 2024-09-13T18:25:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 --> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfc40f0400 con 0x7fcfb006e980 2024-09-13T18:25:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfc97fa640 1 -- 172.21.15.53:0/1899849980 <== osd.7 v2:172.21.15.87:6800/3723126663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfb8009480 con 0x7fcfb006e980 2024-09-13T18:25:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fcfb006e980 msgr2=0x7fcfb0070da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd3143640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fcfb006e980 0x7fcfb0070da0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcfb0066760 msgr2=0x7fcfb0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd3143640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcfb0066760 0x7fcfb0068c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0687f0 tx=0x7fcfcc06c040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfc40e5f60 msgr2=0x7fcfc4052610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd3143640 1 --2- 172.21.15.53:0/1899849980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfc40e5f60 0x7fcfc4052610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00ad040 tx=0x7fcfc001acb0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe124066790 msgr2=0x7fe124068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe124066790 0x7fe124068c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe128007fd0 tx=0x7fe128009040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe13815bd40 msgr2=0x7fe13814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 --2- 172.21.15.53:0/3864479514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe13815bd40 0x7fe13814ec20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe13000e780 tx=0x7fe13000ec40 comp rx=0 tx=0).stop 2024-09-13T18:25:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.074+0000 7fcfd16e0640 1 -- 172.21.15.53:0/1899849980 reap_dead start 2024-09-13T18:25:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 shutdown_connections 2024-09-13T18:25:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 >> 172.21.15.53:0/1899849980 conn(0x7fcfc403a480 msgr2=0x7fcfc40e1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13759e640 1 -- 172.21.15.53:0/3864479514 reap_dead start 2024-09-13T18:25:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 shutdown_connections 2024-09-13T18:25:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 >> 172.21.15.53:0/3864479514 conn(0x7fe13806f720 msgr2=0x7fe13815ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 shutdown_connections 2024-09-13T18:25:04.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 >> 172.21.15.53:0/1733226096 conn(0x7f0970070970 msgr2=0x7f09700cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 shutdown_connections 2024-09-13T18:25:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7f0974d1a640 1 -- 172.21.15.53:0/1733226096 wait complete. 2024-09-13T18:25:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 shutdown_connections 2024-09-13T18:25:04.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 shutdown_connections 2024-09-13T18:25:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fe13c897640 1 -- 172.21.15.53:0/3864479514 wait complete. 2024-09-13T18:25:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.078+0000 7fcfd3143640 1 -- 172.21.15.53:0/1899849980 wait complete. 2024-09-13T18:25:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.086+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 --> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9170071700 con 0x7f915006e980 2024-09-13T18:25:04.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.086+0000 7f915effd640 1 -- 172.21.15.53:0/1757450110 <== osd.3 v2:172.21.15.53:6808/205095619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9164019330 con 0x7f915006e980 2024-09-13T18:25:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.086+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 --> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36ec002cc0 con 0x7f36e806e860 2024-09-13T18:25:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.086+0000 7f36ff7fe640 1 -- 172.21.15.53:0/598700891 <== osd.4 v2:172.21.15.87:6816/2745365769 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36ec002cc0 con 0x7f36e806e860 2024-09-13T18:25:04.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.086+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f36e806e860 msgr2=0x7f36e8070c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.086+0000 7f370d59f640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f36e806e860 0x7f36e8070c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.086+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f36e80666c0 msgr2=0x7f36e8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f370d59f640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f36e80666c0 0x7f36e8068b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f36f0000f70 tx=0x7f36f0009040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370814ae60 msgr2=0x7f3708145b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f370d59f640 1 --2- 172.21.15.53:0/598700891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f370814ae60 0x7f3708145b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36f801c8d0 tx=0x7f36f8019840 comp rx=0 tx=0).stop 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f37077fe640 1 -- 172.21.15.53:0/598700891 reap_dead start 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 shutdown_connections 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 >> 172.21.15.53:0/598700891 conn(0x7f37080b0120 msgr2=0x7f3708163b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 shutdown_connections 2024-09-13T18:25:04.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.090+0000 7f370d59f640 1 -- 172.21.15.53:0/598700891 wait complete. 2024-09-13T18:25:04.146 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2024-09-13T18:25:04.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:25:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f915006e980 msgr2=0x7f9150070da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f915006e980 0x7f9150070da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.148 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2024-09-13T18:25:04.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:25:04.149 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9150066760 msgr2=0x7f9150068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9150066760 0x7f9150068c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f916800a400 tx=0x7f916800d040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:25:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91700acea0 msgr2=0x7f917006c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 --2- 172.21.15.53:0/1757450110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91700acea0 0x7f917006c690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f916000b3e0 tx=0x7f916000b8a0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f916ed9d640 1 -- 172.21.15.53:0/1757450110 reap_dead start 2024-09-13T18:25:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 shutdown_connections 2024-09-13T18:25:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 >> 172.21.15.53:0/1757450110 conn(0x7f91700afef0 msgr2=0x7f9170155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 shutdown_connections 2024-09-13T18:25:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.098+0000 7f9174f09640 1 -- 172.21.15.53:0/1757450110 wait complete. 2024-09-13T18:25:04.152 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:04.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:25:04.153 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:04.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:25:04.154 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:04.155 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:25:04.155 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:04.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:25:04.156 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2024-09-13T18:25:04.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:25:04.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93c55c1640 1 Processor -- start 2024-09-13T18:25:04.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93c55c1640 1 -- start start 2024-09-13T18:25:04.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d5236640 1 Processor -- start 2024-09-13T18:25:04.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f71fbfff640 1 Processor -- start 2024-09-13T18:25:04.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f71fbfff640 1 -- start start 2024-09-13T18:25:04.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93c55c1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c015bd40 0x7f93c00b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93c55c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f93c006cfe0 0x7f93c00715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93c55c1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c015c120 con 0x7f93c006ca90 2024-09-13T18:25:04.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93c55c1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c00b1d00 con 0x7f93c006cfe0 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93c55c1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c006c330 con 0x7f93c015bd40 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bf7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f93c006cfe0 0x7f93c00715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bf7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f93c006cfe0 0x7f93c00715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33134/0 (socket says 172.21.15.53:33134) 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bf7fe640 1 -- 172.21.15.53:0/3620891811 learned_addr learned my addr 172.21.15.53:0/3620891811 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bffff640 1 --2- 172.21.15.53:0/3620891811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c015bd40 0x7f93c00b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bf7fe640 1 -- 172.21.15.53:0/3620891811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c015bd40 msgr2=0x7f93c00b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bf7fe640 1 --2- 172.21.15.53:0/3620891811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c015bd40 0x7f93c00b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bf7fe640 1 -- 172.21.15.53:0/3620891811 >> v1:172.21.15.87:6789/0 conn(0x7f93c006ca90 legacy=0x7f93c00abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f93bf7fe640 1 -- 172.21.15.53:0/3620891811 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c006c610 con 0x7f93c006cfe0 2024-09-13T18:25:04.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7fa11359e640 1 Processor -- start 2024-09-13T18:25:04.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d5236640 1 -- start start 2024-09-13T18:25:04.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d5236640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d009b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d5236640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08d00b4740 0x7f08d00cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d5236640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00b1990 con 0x7f08d00b5400 2024-09-13T18:25:04.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d5236640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00d19f0 con 0x7f08d00b4740 2024-09-13T18:25:04.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d5236640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00d1cd0 con 0x7f08d0160d40 2024-09-13T18:25:04.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7fa11359e640 1 -- start start 2024-09-13T18:25:04.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08cffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d009b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08d4a35640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08d00b4740 0x7f08d00cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08cffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d009b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52402/0 (socket says 172.21.15.53:52402) 2024-09-13T18:25:04.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f08cffff640 1 -- 172.21.15.53:0/1106846799 learned_addr learned my addr 172.21.15.53:0/1106846799 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f71fbfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f40073e0 0x7f71f4036450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f71fbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71f4036990 0x7f71f404ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f71faffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f71f40deab0 0x7f71f4006b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33858/0 (socket says 172.21.15.53:33858) 2024-09-13T18:25:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f71fa7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f40073e0 0x7f71f4036450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fa7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f40073e0 0x7f71f4036450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52414/0 (socket says 172.21.15.53:52414) 2024-09-13T18:25:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f06c99b7640 1 Processor -- start 2024-09-13T18:25:04.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f06c99b7640 1 -- start start 2024-09-13T18:25:04.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71faffd640 1 -- 172.21.15.53:0/2259948982 learned_addr learned my addr 172.21.15.53:0/2259948982 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f4055890 con 0x7f71f40deab0 2024-09-13T18:25:04.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fb7fe640 1 --2- 172.21.15.53:0/2259948982 >> v2:172.21.15.87:3300/0 conn(0x7f71f4036990 0x7f71f404ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f4036e00 con 0x7f71f4036990 2024-09-13T18:25:04.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa11359e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa10c052fa0 0x7fa10c0533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa11359e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c0ea680 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa11359e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c0578b0 con 0x7fa10c037d70 2024-09-13T18:25:04.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa11359e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c0381e0 con 0x7fa10c052fa0 2024-09-13T18:25:04.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4055280 con 0x7f71f40073e0 2024-09-13T18:25:04.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71f9ffb640 1 -- 172.21.15.53:0/2259948982 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584711504 0 0) 0x7f71f4055890 con 0x7f71f40deab0 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f08d4a35640 1 -- 172.21.15.53:0/1106846799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 msgr2=0x7f08d009b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f08d4a35640 1 --2- 172.21.15.53:0/1106846799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d009b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f08d4a35640 1 -- 172.21.15.53:0/1106846799 >> v1:172.21.15.87:6789/0 conn(0x7f08d00b5400 legacy=0x7f08d00b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f08d4a35640 1 -- 172.21.15.53:0/1106846799 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00d1fb0 con 0x7f08d00b4740 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c99b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06c406d2d0 0x7f06c40acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c99b7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06c40b1b90 0x7f06c406c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c99b7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c41590a0 con 0x7f06c40b2f10 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c99b7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c4159900 con 0x7f06c406d2d0 2024-09-13T18:25:04.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c99b7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c4159340 con 0x7f06c40b1b90 2024-09-13T18:25:04.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c89b5640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f06c40b2f10 0x7f06c4158990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33870/0 (socket says 172.21.15.53:33870) 2024-09-13T18:25:04.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c89b5640 1 -- 172.21.15.53:0/371109242 learned_addr learned my addr 172.21.15.53:0/371109242 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71f9ffb640 1 -- 172.21.15.53:0/2259948982 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e4003530 con 0x7f71f40deab0 2024-09-13T18:25:04.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa112d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa10c052fa0 0x7fa10c0533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa112d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa10c052fa0 0x7fa10c0533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33430/0 (socket says 172.21.15.53:33430) 2024-09-13T18:25:04.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa112d9d640 1 -- 172.21.15.53:0/2881928161 learned_addr learned my addr 172.21.15.53:0/2881928161 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 Processor -- start 2024-09-13T18:25:04.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.366+0000 7f2748ace640 1 Processor -- start 2024-09-13T18:25:04.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f2748ace640 1 -- start start 2024-09-13T18:25:04.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fa7fc640 1 -- 172.21.15.53:0/2259948982 >> v2:172.21.15.87:3300/0 conn(0x7f71f4036990 msgr2=0x7f71f404ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fa7fc640 1 --2- 172.21.15.53:0/2259948982 >> v2:172.21.15.87:3300/0 conn(0x7f71f4036990 0x7f71f404ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fa7fc640 1 -- 172.21.15.53:0/2259948982 >> v1:172.21.15.87:6789/0 conn(0x7f71f40deab0 legacy=0x7f71f4006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f71fa7fc640 1 -- 172.21.15.53:0/2259948982 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f400a680 con 0x7f71f40073e0 2024-09-13T18:25:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 -- start start 2024-09-13T18:25:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c91b6640 1 --2- 172.21.15.53:0/371109242 >> v2:172.21.15.87:3300/0 conn(0x7f06c40b1b90 0x7f06c406c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c3fff640 1 --2- 172.21.15.53:0/371109242 >> v2:172.21.15.53:3300/0 conn(0x7f06c406d2d0 0x7f06c40acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f2748ace640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2744071840 0x7f2744164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f2748ace640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2744161cd0 con 0x7f274415e680 2024-09-13T18:25:04.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f2748ace640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27441610c0 con 0x7f27440b09a0 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f2748ace640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2744072460 con 0x7f2744071840 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f2743fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f274415e680 0x7f27440cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48566/0 (socket says 172.21.15.53:48566) 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f2743fff640 1 -- 172.21.15.53:0/1138119168 learned_addr learned my addr 172.21.15.53:0/1138119168 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c37fe640 1 -- 172.21.15.53:0/371109242 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822431579 0 0) 0x7f06c41590a0 con 0x7f06c40b2f10 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c37fe640 1 -- 172.21.15.53:0/371109242 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ac003530 con 0x7f06c40b2f10 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c3fff640 1 -- 172.21.15.53:0/371109242 >> v2:172.21.15.87:3300/0 conn(0x7f06c40b1b90 msgr2=0x7f06c406c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c3fff640 1 --2- 172.21.15.53:0/371109242 >> v2:172.21.15.87:3300/0 conn(0x7f06c40b1b90 0x7f06c406c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c3fff640 1 -- 172.21.15.53:0/371109242 >> v1:172.21.15.87:6789/0 conn(0x7f06c40b2f10 legacy=0x7f06c4158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f06c3fff640 1 -- 172.21.15.53:0/371109242 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4159620 con 0x7f06c406d2d0 2024-09-13T18:25:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f27437fe640 1 --2- 172.21.15.53:0/1138119168 >> v2:172.21.15.87:3300/0 conn(0x7f2744071840 0x7f2744164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f27427fc640 1 -- 172.21.15.53:0/1138119168 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718346968 0 0) 0x7f27441610c0 con 0x7f27440b09a0 2024-09-13T18:25:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f27427fc640 1 -- 172.21.15.53:0/1138119168 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f272c003530 con 0x7f27440b09a0 2024-09-13T18:25:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa112d9d640 1 -- 172.21.15.53:0/2881928161 >> v1:172.21.15.87:6789/0 conn(0x7fa10c037d70 legacy=0x7fa10c03b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa112d9d640 1 -- 172.21.15.53:0/2881928161 >> v1:172.21.15.53:6789/0 conn(0x7fa10c0ea2a0 legacy=0x7fa10c0570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7fa112d9d640 1 -- 172.21.15.53:0/2881928161 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c005e40 con 0x7fa10c052fa0 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27427fc640 1 -- 172.21.15.53:0/1138119168 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960902473 0 0) 0x7f2744161cd0 con 0x7f274415e680 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27437fe640 1 -- 172.21.15.53:0/1138119168 >> v1:172.21.15.87:6789/0 conn(0x7f27440b09a0 legacy=0x7f274415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27437fe640 1 -- 172.21.15.53:0/1138119168 >> v1:172.21.15.53:6789/0 conn(0x7f274415e680 legacy=0x7f27440cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27437fe640 1 -- 172.21.15.53:0/1138119168 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27441613a0 con 0x7f2744071840 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3f2c054c90 0x7f3f2c006440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c050be0 0x7f3f2c0de850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f2c009b70 0x7f3f2c009fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c00a520 con 0x7f3f2c009b70 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c0e6650 con 0x7f3f2c054c90 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3b492640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c039860 con 0x7f3f2c050be0 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f2c009b70 0x7f3f2c009fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f2c009b70 0x7f3f2c009fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33156/0 (socket says 172.21.15.53:33156) 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 -- 172.21.15.53:0/1230492707 learned_addr learned my addr 172.21.15.53:0/1230492707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f39c8f640 1 --2- 172.21.15.53:0/1230492707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c050be0 0x7f3f2c0de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3a490640 1 --2- 172.21.15.53:0/1230492707 >> v2:172.21.15.87:3300/0 conn(0x7f3f2c054c90 0x7f3f2c006440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 -- 172.21.15.53:0/1230492707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c050be0 msgr2=0x7f3f2c0de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 --2- 172.21.15.53:0/1230492707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c050be0 0x7f3f2c0de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 -- 172.21.15.53:0/1230492707 >> v2:172.21.15.87:3300/0 conn(0x7f3f2c054c90 msgr2=0x7f3f2c006440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 --2- 172.21.15.53:0/1230492707 >> v2:172.21.15.87:3300/0 conn(0x7f3f2c054c90 0x7f3f2c006440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f3f3ac91640 1 -- 172.21.15.53:0/1230492707 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c039b40 con 0x7f3f2c009b70 2024-09-13T18:25:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d4a35640 1 --2- 172.21.15.53:0/1106846799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b4740 0x7f08d00cfb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08c80097c0 tx=0x7f08c801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eed803eb94766bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f14450ea640 1 Processor -- start 2024-09-13T18:25:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f14450ea640 1 -- start start 2024-09-13T18:25:04.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.370+0000 7f93bf7fe640 1 --2- 172.21.15.53:0/3620891811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c006cfe0 0x7f93c00715e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93b00090e0 tx=0x7f93b001e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ac6d38cdbf867c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fa7fc640 1 --2- 172.21.15.53:0/2259948982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f40073e0 0x7f71f4036450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0097c0 tx=0x7f71ec01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3039c5f681011185 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08ceffd640 1 -- 172.21.15.53:0/1106846799 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c80ab600 con 0x7f08d00b4740 2024-09-13T18:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f14450ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f144006cbd0 0x7f14400b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f14450ea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1440164520 con 0x7f1440072120 2024-09-13T18:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f14450ea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1440164dc0 con 0x7f14400b0a10 2024-09-13T18:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f14450ea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1440161d70 con 0x7f144006cbd0 2024-09-13T18:25:04.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f143ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1440072120 0x7f144006c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48572/0 (socket says 172.21.15.53:48572) 2024-09-13T18:25:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f143ed9d640 1 -- 172.21.15.53:0/3966961528 learned_addr learned my addr 172.21.15.53:0/3966961528 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f143f59e640 1 --2- 172.21.15.53:0/3966961528 >> v2:172.21.15.53:3300/0 conn(0x7f144006cbd0 0x7f14400b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08ceffd640 1 -- 172.21.15.53:0/1106846799 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c80a7050 con 0x7f08d00b4740 2024-09-13T18:25:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08ceffd640 1 -- 172.21.15.53:0/1106846799 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c80ab980 con 0x7f08d00b4740 2024-09-13T18:25:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71f9ffb640 1 -- 172.21.15.53:0/2259948982 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0ad640 con 0x7f71f40073e0 2024-09-13T18:25:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71f9ffb640 1 -- 172.21.15.53:0/2259948982 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec0ad7a0 con 0x7f71f40073e0 2024-09-13T18:25:04.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71f9ffb640 1 -- 172.21.15.53:0/2259948982 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0adb30 con 0x7f71f40073e0 2024-09-13T18:25:04.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa112d9d640 1 --2- 172.21.15.53:0/2881928161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c052fa0 0x7fa10c0533f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa108009870 tx=0x7fa10801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a658f17c994b3b4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f143f59e640 1 -- 172.21.15.53:0/3966961528 >> v1:172.21.15.87:6789/0 conn(0x7f14400b0a10 legacy=0x7f14400b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:04.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f143f59e640 1 -- 172.21.15.53:0/3966961528 >> v1:172.21.15.53:6789/0 conn(0x7f1440072120 legacy=0x7f144006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f143f59e640 1 -- 172.21.15.53:0/3966961528 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440164770 con 0x7f144006cbd0 2024-09-13T18:25:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 -- 172.21.15.53:0/1106846799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b4740 msgr2=0x7f08d00cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 --2- 172.21.15.53:0/1106846799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b4740 0x7f08d00cfb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08c80097c0 tx=0x7f08c801c410 comp rx=0 tx=0).stop 2024-09-13T18:25:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 -- 172.21.15.53:0/1106846799 shutdown_connections 2024-09-13T18:25:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 --2- 172.21.15.53:0/1106846799 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b4740 0x7f08d00cfb50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 --2- 172.21.15.53:0/1106846799 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d009b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 -- 172.21.15.53:0/1106846799 >> 172.21.15.53:0/1106846799 conn(0x7f08d00cf030 msgr2=0x7f08d00cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11159a640 1 -- 172.21.15.53:0/2881928161 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080aa620 con 0x7fa10c052fa0 2024-09-13T18:25:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11159a640 1 -- 172.21.15.53:0/2881928161 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1080aa780 con 0x7fa10c052fa0 2024-09-13T18:25:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11159a640 1 -- 172.21.15.53:0/2881928161 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080aab10 con 0x7fa10c052fa0 2024-09-13T18:25:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 -- 172.21.15.53:0/1106846799 shutdown_connections 2024-09-13T18:25:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93beffd640 1 -- 172.21.15.53:0/3620891811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00a8690 con 0x7f93c006cfe0 2024-09-13T18:25:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93beffd640 1 -- 172.21.15.53:0/3620891811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b00a87f0 con 0x7f93c006cfe0 2024-09-13T18:25:04.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93beffd640 1 -- 172.21.15.53:0/3620891811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00a8b80 con 0x7f93c006cfe0 2024-09-13T18:25:04.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f40073e0 msgr2=0x7f71f4036450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 --2- 172.21.15.53:0/2259948982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f40073e0 0x7f71f4036450 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0097c0 tx=0x7f71ec01c4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 shutdown_connections 2024-09-13T18:25:04.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 --2- 172.21.15.53:0/2259948982 >> v2:172.21.15.87:3300/0 conn(0x7f71f4036990 0x7f71f404ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 --2- 172.21.15.53:0/2259948982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f40073e0 0x7f71f4036450 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0097c0 tx=0x7f71ec01c4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 >> 172.21.15.53:0/2259948982 conn(0x7f71f401dd60 msgr2=0x7f71f40549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 shutdown_connections 2024-09-13T18:25:04.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93c55c1640 1 -- 172.21.15.53:0/3620891811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c006cfe0 msgr2=0x7f93c00715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3620891811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c006cfe0 0x7f93c00715e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93b00090e0 tx=0x7f93b001e6c0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f06c3fff640 1 --2- 172.21.15.53:0/371109242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c406d2d0 0x7f06c40acfc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06c4152f60 tx=0x7f06b401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184b167ff2385b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27437fe640 1 --2- 172.21.15.53:0/1138119168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 0x7f2744164fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f27380097c0 tx=0x7f273801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1609f94b79740a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11359e640 1 -- 172.21.15.53:0/2881928161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c052fa0 msgr2=0x7fa10c0533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11359e640 1 --2- 172.21.15.53:0/2881928161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c052fa0 0x7fa10c0533f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa108009870 tx=0x7fa10801c4e0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 -- 172.21.15.53:0/1106846799 wait complete. 2024-09-13T18:25:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 Processor -- start 2024-09-13T18:25:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f06c37fe640 1 -- 172.21.15.53:0/371109242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40a8970 con 0x7f06c406d2d0 2024-09-13T18:25:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f06c37fe640 1 -- 172.21.15.53:0/371109242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b40a8ad0 con 0x7f06c406d2d0 2024-09-13T18:25:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11359e640 1 -- 172.21.15.53:0/2881928161 shutdown_connections 2024-09-13T18:25:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11359e640 1 --2- 172.21.15.53:0/2881928161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c052fa0 0x7fa10c0533f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11359e640 1 -- 172.21.15.53:0/2881928161 >> 172.21.15.53:0/2881928161 conn(0x7fa10c03a4d0 msgr2=0x7fa10c03a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27427fc640 1 -- 172.21.15.53:0/1138119168 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380a8050 con 0x7f2744071840 2024-09-13T18:25:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93c55c1640 1 -- 172.21.15.53:0/3620891811 shutdown_connections 2024-09-13T18:25:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3620891811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c006cfe0 0x7f93c00715e0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93b00090e0 tx=0x7f93b001e6c0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3620891811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c015bd40 0x7f93c00b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f93c55c1640 1 -- 172.21.15.53:0/3620891811 >> 172.21.15.53:0/3620891811 conn(0x7f93c006f720 msgr2=0x7f93c00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27427fc640 1 -- 172.21.15.53:0/1138119168 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380ac5f0 con 0x7f2744071840 2024-09-13T18:25:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f27427fc640 1 -- 172.21.15.53:0/1138119168 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380ac960 con 0x7f2744071840 2024-09-13T18:25:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11359e640 1 -- 172.21.15.53:0/2881928161 shutdown_connections 2024-09-13T18:25:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7fa11359e640 1 -- 172.21.15.53:0/2881928161 wait complete. 2024-09-13T18:25:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- 172.21.15.53:0/1138119168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 msgr2=0x7f2744164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 --2- 172.21.15.53:0/1138119168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 0x7f2744164fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f27380097c0 tx=0x7f273801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- 172.21.15.53:0/1138119168 shutdown_connections 2024-09-13T18:25:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 --2- 172.21.15.53:0/1138119168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 0x7f2744164fb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- 172.21.15.53:0/1138119168 >> 172.21.15.53:0/1138119168 conn(0x7f274406f720 msgr2=0x7f27440afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- 172.21.15.53:0/1138119168 shutdown_connections 2024-09-13T18:25:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- 172.21.15.53:0/1138119168 wait complete. 2024-09-13T18:25:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f143f59e640 1 --2- 172.21.15.53:0/3966961528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f14400b2ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f14300097c0 tx=0x7f143001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feba984a9de23e1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f08d5236640 1 -- start start 2024-09-13T18:25:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f71fbfff640 1 -- 172.21.15.53:0/2259948982 wait complete. 2024-09-13T18:25:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08d5236640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08d00b4740 0x7f08d00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08d5236640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b5400 0x7f08d00a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08d5236640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d00b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08d5236640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00ca040 con 0x7f08d00b4740 2024-09-13T18:25:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08d5236640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00c97b0 con 0x7f08d00b5400 2024-09-13T18:25:04.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08d5236640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0154f30 con 0x7f08d0160d40 2024-09-13T18:25:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 -- 172.21.15.53:0/371109242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c406d2d0 msgr2=0x7f06c40acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 --2- 172.21.15.53:0/371109242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c406d2d0 0x7f06c40acfc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06c4152f60 tx=0x7f06b401ec90 comp rx=0 tx=0).stop 2024-09-13T18:25:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 -- 172.21.15.53:0/371109242 shutdown_connections 2024-09-13T18:25:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 --2- 172.21.15.53:0/371109242 >> v2:172.21.15.87:3300/0 conn(0x7f06c40b1b90 0x7f06c406c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 --2- 172.21.15.53:0/371109242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c406d2d0 0x7f06c40acfc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 -- 172.21.15.53:0/371109242 >> 172.21.15.53:0/371109242 conn(0x7f06c40afef0 msgr2=0x7f06c40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 Processor -- start 2024-09-13T18:25:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 -- 172.21.15.53:0/371109242 shutdown_connections 2024-09-13T18:25:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 -- 172.21.15.53:0/371109242 wait complete. 2024-09-13T18:25:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 Processor -- start 2024-09-13T18:25:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08d00b4740 0x7f08d00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08d00b4740 0x7f08d00c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33180/0 (socket says 172.21.15.53:33180) 2024-09-13T18:25:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 -- 172.21.15.53:0/764648050 learned_addr learned my addr 172.21.15.53:0/764648050 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f3f3ac91640 1 --2- 172.21.15.53:0/1230492707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c009fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f340687f0 tx=0x7f3f340a9f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ea35614707165f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.374+0000 7f3f3948e640 1 -- 172.21.15.53:0/1230492707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34133be0 con 0x7f3f2c009b70 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3948e640 1 -- 172.21.15.53:0/1230492707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34133d80 con 0x7f3f2c009b70 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3948e640 1 -- 172.21.15.53:0/1230492707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3413b640 con 0x7f3f2c009b70 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 -- 172.21.15.53:0/1230492707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 msgr2=0x7f3f2c009fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1230492707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c009fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f340687f0 tx=0x7f3f340a9f00 comp rx=0 tx=0).stop 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 -- 172.21.15.53:0/1230492707 shutdown_connections 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1230492707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c050be0 0x7f3f2c0de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1230492707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c009fe0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1230492707 >> v2:172.21.15.87:3300/0 conn(0x7f3f2c054c90 0x7f3f2c006440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 -- 172.21.15.53:0/1230492707 >> 172.21.15.53:0/1230492707 conn(0x7f3f2c01d910 msgr2=0x7f3f2c054580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 -- start start 2024-09-13T18:25:04.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cf7fe640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b5400 0x7f08d00a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 -- 172.21.15.53:0/3620891811 shutdown_connections 2024-09-13T18:25:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 -- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 msgr2=0x7f08d00b32c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:25:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d00b32c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 -- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b5400 msgr2=0x7f08d00a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b5400 0x7f08d00a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 -- 172.21.15.53:0/764648050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8009420 con 0x7f08d00b4740 2024-09-13T18:25:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f08cffff640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08d00b4740 0x7f08d00c8e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f08c00070b0 tx=0x7f08c000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c037d70 0x7fa10c03bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa10c052fa0 0x7fa10c04fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c0ea2a0 0x7fa10c03cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c03c080 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c03c2c0 con 0x7fa10c037d70 2024-09-13T18:25:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11359e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c04ff60 con 0x7fa10c052fa0 2024-09-13T18:25:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 -- start start 2024-09-13T18:25:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f4036990 0x7f71f4187a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 Processor -- start 2024-09-13T18:25:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 -- 172.21.15.53:0/1230492707 shutdown_connections 2024-09-13T18:25:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71f40deab0 0x7f71f404a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f404aaa0 0x7f71f4048470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- start start 2024-09-13T18:25:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c0ea2a0 0x7fa10c03cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c0ea2a0 0x7fa10c03cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33192/0 (socket says 172.21.15.53:33192) 2024-09-13T18:25:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 -- 172.21.15.53:0/1268093432 learned_addr learned my addr 172.21.15.53:0/1268093432 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 -- 172.21.15.53:0/3620891811 wait complete. 2024-09-13T18:25:04.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa111d9b640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa10c052fa0 0x7fa10c04fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa11259c640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c037d70 0x7fa10c03bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71f40deab0 0x7f71f404a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 Processor -- start 2024-09-13T18:25:04.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f4036990 0x7f71f4187a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71f40deab0 0x7f71f404a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33208/0 (socket says 172.21.15.53:33208) 2024-09-13T18:25:04.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f404af30 con 0x7f71f40deab0 2024-09-13T18:25:04.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40e1e00 con 0x7f71f4036990 2024-09-13T18:25:04.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fbfff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40498f0 con 0x7f71f404aaa0 2024-09-13T18:25:04.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71faffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f4036990 0x7f71f4187a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33476/0 (socket says 172.21.15.53:33476) 2024-09-13T18:25:04.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71faffd640 1 -- 172.21.15.53:0/4235148146 learned_addr learned my addr 172.21.15.53:0/4235148146 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fb7fe640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f404aaa0 0x7f71f4048470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 Processor -- start 2024-09-13T18:25:04.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 -- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa10c052fa0 msgr2=0x7fa10c04fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa10c052fa0 0x7fa10c04fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 -- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c037d70 msgr2=0x7fa10c03bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c037d70 0x7fa10c03bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 -- 172.21.15.53:0/1268093432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1080094d0 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 -- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f404aaa0 msgr2=0x7f71f4048470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f404aaa0 0x7f71f4048470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 -- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f4036990 msgr2=0x7f71f4187a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f4036990 0x7f71f4187a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 -- 172.21.15.53:0/4235148146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec009420 con 0x7f71f40deab0 2024-09-13T18:25:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 0x7f274415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27440b09a0 0x7f27440ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274415e680 0x7f27441461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2744095910 con 0x7f274415e680 2024-09-13T18:25:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274415d160 con 0x7f2744071840 2024-09-13T18:25:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2748ace640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2744095250 con 0x7f27440b09a0 2024-09-13T18:25:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7fa112d9d640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c0ea2a0 0x7fa10c03cd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ac040 tx=0x7fa10801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 -- start start 2024-09-13T18:25:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c006ca90 0x7f93c014c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c015bd40 0x7f93c006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c0143350 0x7f93c01526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00cacf0 con 0x7f93c015bd40 2024-09-13T18:25:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00cafd0 con 0x7f93c0143350 2024-09-13T18:25:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f93c55c1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00cb2b0 con 0x7f93c006ca90 2024-09-13T18:25:04.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f3f3b492640 1 -- 172.21.15.53:0/1230492707 wait complete. 2024-09-13T18:25:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f2742ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27440b09a0 0x7f27440ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f71fa7fc640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71f40deab0 0x7f71f404a560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f71f40553c0 tx=0x7f71ec019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2742ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27440b09a0 0x7f27440ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52472/0 (socket says 172.21.15.53:52472) 2024-09-13T18:25:04.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2742ffd640 1 -- 172.21.15.53:0/4031638195 learned_addr learned my addr 172.21.15.53:0/4031638195 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2743fff640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274415e680 0x7f27441461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f27437fe640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 0x7f274415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f08ccff9640 1 -- 172.21.15.53:0/764648050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c000dd80 con 0x7f08d00b4740 2024-09-13T18:25:04.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f08ccff9640 1 -- 172.21.15.53:0/764648050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c000f040 con 0x7f08d00b4740 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7fa102ffd640 1 -- 172.21.15.53:0/1268093432 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080aae00 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7fa102ffd640 1 -- 172.21.15.53:0/1268093432 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1080bd3f0 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7fa102ffd640 1 -- 172.21.15.53:0/1268093432 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080bd7a0 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7fa11359e640 1 -- 172.21.15.53:0/1268093432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c052710 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7fa11359e640 1 -- 172.21.15.53:0/1268093432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c03c840 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2743fff640 1 -- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27440b09a0 msgr2=0x7f27440ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2743fff640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27440b09a0 0x7f27440ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2743fff640 1 -- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 msgr2=0x7f274415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2743fff640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 0x7f274415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2743fff640 1 -- 172.21.15.53:0/4031638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009420 con 0x7f274415e680 2024-09-13T18:25:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f71e37fe640 1 -- 172.21.15.53:0/4235148146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec004230 con 0x7f71f40deab0 2024-09-13T18:25:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2743fff640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274415e680 0x7f27441461b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f273c00c780 tx=0x7f273c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.378+0000 7f06c99b7640 1 -- start start 2024-09-13T18:25:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c40b1b90 0x7f06c41417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c40b2f10 0x7f06c41461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40cceb0 0x7f06c40ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c41690b0 con 0x7f06c40cceb0 2024-09-13T18:25:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40cd620 con 0x7f06c40b2f10 2024-09-13T18:25:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c41698d0 con 0x7f06c40b1b90 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f08ccff9640 1 -- 172.21.15.53:0/764648050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0015640 con 0x7f08d00b4740 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f08d5236640 1 -- 172.21.15.53:0/764648050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d0155210 con 0x7f08d00b4740 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f08d5236640 1 -- 172.21.15.53:0/764648050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d00ca570 con 0x7f08d00b4740 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c40b2f10 0x7f06c41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c89b5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c40b1b90 0x7f06c41417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c40b2f10 0x7f06c41461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33498/0 (socket says 172.21.15.53:33498) 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 -- 172.21.15.53:0/3372658843 learned_addr learned my addr 172.21.15.53:0/3372658843 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c91b6640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40cceb0 0x7f06c40ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f71fbfff640 1 -- 172.21.15.53:0/4235148146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f404c6d0 con 0x7f71f40deab0 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f71e37fe640 1 -- 172.21.15.53:0/4235148146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec0a6050 con 0x7f71f40deab0 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f71fbfff640 1 -- 172.21.15.53:0/4235148146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f4049050 con 0x7f71f40deab0 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f71e37fe640 1 -- 172.21.15.53:0/4235148146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec003620 con 0x7f71f40deab0 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f93bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c015bd40 0x7f93c006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f93bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c015bd40 0x7f93c006b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33224/0 (socket says 172.21.15.53:33224) 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f93bf7fe640 1 -- 172.21.15.53:0/3042444219 learned_addr learned my addr 172.21.15.53:0/3042444219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f93bffff640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c006ca90 0x7f93c014c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f93c4dc0640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c0143350 0x7f93c01526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 -- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c40b1b90 msgr2=0x7f06c41417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c40b1b90 0x7f06c41417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 -- 172.21.15.53:0/3372658843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40cceb0 msgr2=0x7f06c40ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40cceb0 0x7f06c40ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 -- 172.21.15.53:0/3372658843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b4009420 con 0x7f06c40b2f10 2024-09-13T18:25:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f71fbfff640 1 -- 172.21.15.53:0/4235148146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc005260 con 0x7f71f40deab0 2024-09-13T18:25:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c3fff640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c40b2f10 0x7f06c41461f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06b401c8c0 tx=0x7f06b401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f143dd9b640 1 -- 172.21.15.53:0/3966961528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300ab600 con 0x7f144006cbd0 2024-09-13T18:25:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f143dd9b640 1 -- 172.21.15.53:0/3966961528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14300a7050 con 0x7f144006cbd0 2024-09-13T18:25:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f143dd9b640 1 -- 172.21.15.53:0/3966961528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300ab980 con 0x7f144006cbd0 2024-09-13T18:25:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c17fa640 1 -- 172.21.15.53:0/3372658843 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40b0a10 con 0x7f06c40b2f10 2024-09-13T18:25:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c17fa640 1 -- 172.21.15.53:0/3372658843 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b40b0b70 con 0x7f06c40b2f10 2024-09-13T18:25:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c17fa640 1 -- 172.21.15.53:0/3372658843 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40b9400 con 0x7f06c40b2f10 2024-09-13T18:25:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f08d5236640 1 -- 172.21.15.53:0/764648050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d009b9f0 con 0x7f08d00b4740 2024-09-13T18:25:04.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f3f3b492640 1 Processor -- start 2024-09-13T18:25:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7fa11359e640 1 -- 172.21.15.53:0/1268093432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c007a40 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f272bfff640 1 -- 172.21.15.53:0/4031638195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00ce30 con 0x7f274415e680 2024-09-13T18:25:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f272bfff640 1 -- 172.21.15.53:0/4031638195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c00a640 con 0x7f274415e680 2024-09-13T18:25:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f272bfff640 1 -- 172.21.15.53:0/4031638195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00a9f0 con 0x7f274415e680 2024-09-13T18:25:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 -- 172.21.15.53:0/3372658843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c41692c0 con 0x7f06c40b2f10 2024-09-13T18:25:04.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06c99b7640 1 -- 172.21.15.53:0/3372658843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c4169560 con 0x7f06c40b2f10 2024-09-13T18:25:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f14450ea640 1 -- 172.21.15.53:0/3966961528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 msgr2=0x7f14400b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f14450ea640 1 --2- 172.21.15.53:0/3966961528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f14400b2ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f14300097c0 tx=0x7f143001c460 comp rx=0 tx=0).stop 2024-09-13T18:25:04.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c41438b0 con 0x7f06c40b2f10 2024-09-13T18:25:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2744095530 con 0x7f274415e680 2024-09-13T18:25:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2744094e90 con 0x7f274415e680 2024-09-13T18:25:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f14450ea640 1 -- 172.21.15.53:0/3966961528 shutdown_connections 2024-09-13T18:25:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f14450ea640 1 --2- 172.21.15.53:0/3966961528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f14400b2ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f14450ea640 1 -- 172.21.15.53:0/3966961528 >> 172.21.15.53:0/3966961528 conn(0x7f14400afef0 msgr2=0x7f14400b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7f3f3b492640 1 -- start start 2024-09-13T18:25:04.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3b492640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c0d69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3b492640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f2c050be0 0x7f3f2c0357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3b492640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c054c90 0x7f3f2c0d84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3b492640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c036270 con 0x7f3f2c009b70 2024-09-13T18:25:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3b492640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c036550 con 0x7f3f2c050be0 2024-09-13T18:25:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3b492640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c036830 con 0x7f3f2c054c90 2024-09-13T18:25:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.382+0000 7fa102ffd640 1 -- 172.21.15.53:0/1268093432 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1080b33f0 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7fa102ffd640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0f4066760 0x7fa0f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7fa102ffd640 1 -- 172.21.15.53:0/1268093432 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa10811e8e0 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f08ccff9640 1 -- 172.21.15.53:0/764648050 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08c00157a0 con 0x7f08d00b4740 2024-09-13T18:25:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f39c8f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f2c050be0 0x7f3f2c0357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f39c8f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f2c050be0 0x7f3f2c0357b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33510/0 (socket says 172.21.15.53:33510) 2024-09-13T18:25:04.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f39c8f640 1 -- 172.21.15.53:0/1761286586 learned_addr learned my addr 172.21.15.53:0/1761286586 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f08ccff9640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f08b0066760 0x7f08b0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bffff640 1 -- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c0143350 msgr2=0x7f93c01526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bffff640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c0143350 0x7f93c01526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bffff640 1 -- 172.21.15.53:0/3042444219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c015bd40 msgr2=0x7f93c006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bffff640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c015bd40 0x7f93c006b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bffff640 1 -- 172.21.15.53:0/3042444219 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0009d60 con 0x7f93c006ca90 2024-09-13T18:25:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3a490640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c0d69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2724005260 con 0x7f274415e680 2024-09-13T18:25:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f06c17fa640 1 -- 172.21.15.53:0/3372658843 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06b40b7040 con 0x7f06c40b2f10 2024-09-13T18:25:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f08ccff9640 1 -- 172.21.15.53:0/764648050 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08c0084750 con 0x7f08d00b4740 2024-09-13T18:25:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f08cf7fe640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f08b0066760 0x7f08b0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bffff640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c006ca90 0x7f93c014c550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f93b8007db0 tx=0x7f93b800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3a490640 1 -- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c054c90 msgr2=0x7f3f2c0d84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3a490640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c054c90 0x7f3f2c0d84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3a490640 1 -- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f2c050be0 msgr2=0x7f3f2c0357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3a490640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f2c050be0 0x7f3f2c0357b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3a490640 1 -- 172.21.15.53:0/1761286586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3404f1b0 con 0x7f3f2c009b70 2024-09-13T18:25:04.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f06c17fa640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06b0066690 0x7f06b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bcff9640 1 -- 172.21.15.53:0/3042444219 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8018070 con 0x7f93c006ca90 2024-09-13T18:25:04.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f3f3a490640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c0d69a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d5a0 tx=0x7f3f2400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f06c17fa640 1 -- 172.21.15.53:0/3372658843 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06b4121b60 con 0x7f06c40b2f10 2024-09-13T18:25:04.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c00cb590 con 0x7f93c006ca90 2024-09-13T18:25:04.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c014ca90 con 0x7f93c006ca90 2024-09-13T18:25:04.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bcff9640 1 -- 172.21.15.53:0/3042444219 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b800edd0 con 0x7f93c006ca90 2024-09-13T18:25:04.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93bcff9640 1 -- 172.21.15.53:0/3042444219 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8003be0 con 0x7f93c006ca90 2024-09-13T18:25:04.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f06c89b5640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06b0066690 0x7f06b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f08cf7fe640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f08b0066760 0x7f08b0068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08d0066f90 tx=0x7f08b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7fa11259c640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0f4066760 0x7fa0f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f71e37fe640 1 -- 172.21.15.53:0/4235148146 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71ec0b4040 con 0x7f71f40deab0 2024-09-13T18:25:04.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a0005260 con 0x7f93c006ca90 2024-09-13T18:25:04.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f06c89b5640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06b0066690 0x7f06b0068b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06bc001570 tx=0x7f06bc001a00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f14450ea640 1 -- 172.21.15.53:0/3966961528 shutdown_connections 2024-09-13T18:25:04.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f71e37fe640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f71e8066760 0x7f71e8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7fa11259c640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0f4066760 0x7fa0f4068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa11404fb60 tx=0x7fa11406c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f71e37fe640 1 -- 172.21.15.53:0/4235148146 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71ec11db60 con 0x7f71f40deab0 2024-09-13T18:25:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f14450ea640 1 -- 172.21.15.53:0/3966961528 wait complete. 2024-09-13T18:25:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.386+0000 7f71faffd640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f71e8066760 0x7f71e8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f93bcff9640 1 -- 172.21.15.53:0/3042444219 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93b8014420 con 0x7f93c006ca90 2024-09-13T18:25:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f71faffd640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f71e8066760 0x7f71e8068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71f0004c10 tx=0x7f71f0007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f93bcff9640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f93ac066690 0x7f93ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f93bcff9640 1 -- 172.21.15.53:0/3042444219 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93b8085160 con 0x7f93c006ca90 2024-09-13T18:25:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 Processor -- start 2024-09-13T18:25:04.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f93bf7fe640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f93ac066690 0x7f93ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 -- start start 2024-09-13T18:25:04.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f71e37fe640 1 -- 172.21.15.53:0/4235148146 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71ec0eaf60 con 0x7f71f40deab0 2024-09-13T18:25:04.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f93bf7fe640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f93ac066690 0x7f93ac068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f93c0143770 tx=0x7f93b00a9000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f144014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f144014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f144014ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33236/0 (socket says 172.21.15.53:33236) 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 -- 172.21.15.53:0/3028072569 learned_addr learned my addr 172.21.15.53:0/3028072569 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1440072120 0x7f144014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14400b0a10 0x7f1440163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144015b010 con 0x7f144006cbd0 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440160450 con 0x7f14400b0a10 2024-09-13T18:25:04.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144015a390 con 0x7f1440072120 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143e59c640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1440072120 0x7f144014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143f59e640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14400b0a10 0x7f1440163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 -- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1440072120 msgr2=0x7f144014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1440072120 0x7f144014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 -- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14400b0a10 msgr2=0x7f1440163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14400b0a10 0x7f1440163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009420 con 0x7f144006cbd0 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.390+0000 7f143ed9d640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f144014ebc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f143800cba0 tx=0x7f143800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.394+0000 7f08ccff9640 1 -- 172.21.15.53:0/764648050 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f08c0051be0 con 0x7f08d00b4740 2024-09-13T18:25:04.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7fa102ffd640 1 -- 172.21.15.53:0/1268093432 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1080ebd70 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f3f2affd640 1 -- 172.21.15.53:0/1761286586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24005bb0 con 0x7f3f2c009b70 2024-09-13T18:25:04.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f3f2affd640 1 -- 172.21.15.53:0/1761286586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24005d10 con 0x7f3f2c009b70 2024-09-13T18:25:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f3f2affd640 1 -- 172.21.15.53:0/1761286586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24006290 con 0x7f3f2c009b70 2024-09-13T18:25:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f272bfff640 1 -- 172.21.15.53:0/4031638195 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f273c00ab50 con 0x7f274415e680 2024-09-13T18:25:04.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c01e400 con 0x7f3f2c009b70 2024-09-13T18:25:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f14277fe640 1 -- 172.21.15.53:0/3028072569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800ad40 con 0x7f144006cbd0 2024-09-13T18:25:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f14277fe640 1 -- 172.21.15.53:0/3028072569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438012400 con 0x7f144006cbd0 2024-09-13T18:25:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f14277fe640 1 -- 172.21.15.53:0/3028072569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800aea0 con 0x7f144006cbd0 2024-09-13T18:25:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14401606f0 con 0x7f144006cbd0 2024-09-13T18:25:04.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144015a670 con 0x7f144006cbd0 2024-09-13T18:25:04.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c0d6ee0 con 0x7f3f2c009b70 2024-09-13T18:25:04.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c005260 con 0x7f3f2c009b70 2024-09-13T18:25:04.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f272bfff640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2730066690 0x7f2730068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.398+0000 7f272bfff640 1 -- 172.21.15.53:0/4031638195 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f273c083880 con 0x7f274415e680 2024-09-13T18:25:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.402+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440160880 con 0x7f144006cbd0 2024-09-13T18:25:04.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.402+0000 7f06c17fa640 1 -- 172.21.15.53:0/3372658843 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06b40ef190 con 0x7f06c40b2f10 2024-09-13T18:25:04.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.402+0000 7f27437fe640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2730066690 0x7f2730068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.402+0000 7f27437fe640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2730066690 0x7f2730068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27380ae000 tx=0x7f27380a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.402+0000 7f93bcff9640 1 -- 172.21.15.53:0/3042444219 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93b80525b0 con 0x7f93c006ca90 2024-09-13T18:25:04.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.406+0000 7f272bfff640 1 -- 172.21.15.53:0/4031638195 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f273c050c80 con 0x7f274415e680 2024-09-13T18:25:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.406+0000 7f14277fe640 1 -- 172.21.15.53:0/3028072569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1438012770 con 0x7f144006cbd0 2024-09-13T18:25:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.406+0000 7f14277fe640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f142c066790 0x7f142c068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.406+0000 7f14277fe640 1 -- 172.21.15.53:0/3028072569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1438084890 con 0x7f144006cbd0 2024-09-13T18:25:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.406+0000 7f143e59c640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f142c066790 0x7f142c068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.410+0000 7f143e59c640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f142c066790 0x7f142c068c50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14400afe80 tx=0x7f1434009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.410+0000 7f3f2affd640 1 -- 172.21.15.53:0/1761286586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f240063f0 con 0x7f3f2c009b70 2024-09-13T18:25:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.410+0000 7f3f2affd640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f180666e0 0x7f3f18068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.410+0000 7f3f2affd640 1 -- 172.21.15.53:0/1761286586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f24084bd0 con 0x7f3f2c009b70 2024-09-13T18:25:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.410+0000 7f3f39c8f640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f180666e0 0x7f3f18068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:04.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.410+0000 7f3f39c8f640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f180666e0 0x7f3f18068ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005e30 tx=0x7f3f30009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:04.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.414+0000 7f3f2affd640 1 -- 172.21.15.53:0/1761286586 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f240520b0 con 0x7f3f2c009b70 2024-09-13T18:25:04.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.422+0000 7f14277fe640 1 -- 172.21.15.53:0/3028072569 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1438051c90 con 0x7f144006cbd0 2024-09-13T18:25:04.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.710+0000 7f71fbfff640 1 -- 172.21.15.53:0/4235148146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71dc0057e0 con 0x7f71f40deab0 2024-09-13T18:25:04.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.710+0000 7f71e37fe640 1 -- 172.21.15.53:0/4235148146 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71ec0b2090 con 0x7f71f40deab0 2024-09-13T18:25:04.714 INFO:teuthology.orchestra.run.smithi053.stdout:55834574852 2024-09-13T18:25:04.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 -- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f71e8066760 msgr2=0x7f71e8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f71e8066760 0x7f71e8068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71f0004c10 tx=0x7f71f0007d40 comp rx=0 tx=0).stop 2024-09-13T18:25:04.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 -- 172.21.15.53:0/4235148146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71f40deab0 msgr2=0x7f71f404a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71f40deab0 0x7f71f404a560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f71f40553c0 tx=0x7f71ec019250 comp rx=0 tx=0).stop 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 -- 172.21.15.53:0/4235148146 shutdown_connections 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f71e8066760 0x7f71e8068c20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71f404aaa0 0x7f71f4048470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71f40deab0 0x7f71f404a560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 --2- 172.21.15.53:0/4235148146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71f4036990 0x7f71f4187a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 -- 172.21.15.53:0/4235148146 >> 172.21.15.53:0/4235148146 conn(0x7f71f401dd60 msgr2=0x7f71f40346a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 -- 172.21.15.53:0/4235148146 shutdown_connections 2024-09-13T18:25:04.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.714+0000 7f71e17fa640 1 -- 172.21.15.53:0/4235148146 wait complete. 2024-09-13T18:25:04.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.718+0000 7f08d5236640 1 -- 172.21.15.53:0/764648050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f08d0151c00 con 0x7f08d00b4740 2024-09-13T18:25:04.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.722+0000 7f08ccff9640 1 -- 172.21.15.53:0/764648050 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08c001a090 con 0x7f08d00b4740 2024-09-13T18:25:04.725 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2024-09-13T18:25:04.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93a00057e0 con 0x7f93c006ca90 2024-09-13T18:25:04.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7fa11359e640 1 -- 172.21.15.53:0/1268093432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa10c03ca30 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 -- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f08b0066760 msgr2=0x7f08b0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f08b0066760 0x7f08b0068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08d0066f90 tx=0x7f08b8009040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 -- 172.21.15.53:0/764648050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08d00b4740 msgr2=0x7f08d00c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08d00b4740 0x7f08d00c8e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f08c00070b0 tx=0x7f08c000d4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f93bcff9640 1 -- 172.21.15.53:0/3042444219 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93b8055bd0 con 0x7f93c006ca90 2024-09-13T18:25:04.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7fa102ffd640 1 -- 172.21.15.53:0/1268093432 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1080ef390 con 0x7fa10c0ea2a0 2024-09-13T18:25:04.728 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2024-09-13T18:25:04.728 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2024-09-13T18:25:04.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 -- 172.21.15.53:0/764648050 shutdown_connections 2024-09-13T18:25:04.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f08b0066760 0x7f08b0068c20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08d0160d40 0x7f08d00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08d00b5400 0x7f08d00a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 --2- 172.21.15.53:0/764648050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08d00b4740 0x7f08d00c8e00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 -- 172.21.15.53:0/764648050 >> 172.21.15.53:0/764648050 conn(0x7f08d00cf030 msgr2=0x7f08d00af310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 -- 172.21.15.53:0/764648050 shutdown_connections 2024-09-13T18:25:04.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7f08c67fc640 1 -- 172.21.15.53:0/764648050 wait complete. 2024-09-13T18:25:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7fa100ff9640 1 -- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0f4066760 msgr2=0x7fa0f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7fa100ff9640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0f4066760 0x7fa0f4068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa11404fb60 tx=0x7fa11406c040 comp rx=0 tx=0).stop 2024-09-13T18:25:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7fa100ff9640 1 -- 172.21.15.53:0/1268093432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c0ea2a0 msgr2=0x7fa10c03cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.726+0000 7fa100ff9640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c0ea2a0 0x7fa10c03cd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ac040 tx=0x7fa10801ad20 comp rx=0 tx=0).stop 2024-09-13T18:25:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 -- 172.21.15.53:0/1268093432 shutdown_connections 2024-09-13T18:25:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0f4066760 0x7fa0f4068c20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa10c052fa0 0x7fa10c04fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa10c0ea2a0 0x7fa10c03cd60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 --2- 172.21.15.53:0/1268093432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa10c037d70 0x7fa10c03bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 -- 172.21.15.53:0/1268093432 >> 172.21.15.53:0/1268093432 conn(0x7fa10c03a4d0 msgr2=0x7fa10c0dede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f93ac066690 msgr2=0x7f93ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f93ac066690 0x7f93ac068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f93c0143770 tx=0x7f93b00a9000 comp rx=0 tx=0).stop 2024-09-13T18:25:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c006ca90 msgr2=0x7f93c014c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c006ca90 0x7f93c014c550 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f93b8007db0 tx=0x7f93b800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f06c4158200 con 0x7f06c40b2f10 2024-09-13T18:25:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 shutdown_connections 2024-09-13T18:25:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f93ac066690 0x7f93ac068b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 -- 172.21.15.53:0/1268093432 shutdown_connections 2024-09-13T18:25:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c0143350 0x7f93c01526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93c015bd40 0x7f93c006b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 --2- 172.21.15.53:0/3042444219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93c006ca90 0x7f93c014c550 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 >> 172.21.15.53:0/3042444219 conn(0x7f93c006f720 msgr2=0x7f93c00af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7fa100ff9640 1 -- 172.21.15.53:0/1268093432 wait complete. 2024-09-13T18:25:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 shutdown_connections 2024-09-13T18:25:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.730+0000 7f93c55c1640 1 -- 172.21.15.53:0/3042444219 wait complete. 2024-09-13T18:25:04.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.734+0000 7f06c17fa640 1 -- 172.21.15.53:0/3372658843 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06b40f27b0 con 0x7f06c40b2f10 2024-09-13T18:25:04.736 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2024-09-13T18:25:04.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.734+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f27240057e0 con 0x7f274415e680 2024-09-13T18:25:04.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.734+0000 7f272bfff640 1 -- 172.21.15.53:0/4031638195 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f273c018090 con 0x7f274415e680 2024-09-13T18:25:04.737 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:04.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.734+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3f1c0057e0 con 0x7f3f2c009b70 2024-09-13T18:25:04.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.734+0000 7f3f2affd640 1 -- 172.21.15.53:0/1761286586 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f240556d0 con 0x7f3f2c009b70 2024-09-13T18:25:04.738 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2024-09-13T18:25:04.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06b0066690 msgr2=0x7f06b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06b0066690 0x7f06b0068b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06bc001570 tx=0x7f06bc001a00 comp rx=0 tx=0).stop 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c40b2f10 msgr2=0x7f06c41461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c40b2f10 0x7f06c41461f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06b401c8c0 tx=0x7f06b401ba30 comp rx=0 tx=0).stop 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 shutdown_connections 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06b0066690 0x7f06b0068b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40cceb0 0x7f06c40ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06c40b2f10 0x7f06c41461f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 --2- 172.21.15.53:0/3372658843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06c40b1b90 0x7f06c41417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 >> 172.21.15.53:0/3372658843 conn(0x7f06c40afef0 msgr2=0x7f06c40b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 shutdown_connections 2024-09-13T18:25:04.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f06aaffd640 1 -- 172.21.15.53:0/3372658843 wait complete. 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f180666e0 msgr2=0x7f3f18068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f180666e0 0x7f3f18068ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005e30 tx=0x7f3f30009190 comp rx=0 tx=0).stop 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 msgr2=0x7f3f2c0d69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c0d69a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d5a0 tx=0x7f3f2400da60 comp rx=0 tx=0).stop 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 shutdown_connections 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f180666e0 0x7f3f18068ba0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f2c054c90 0x7f3f2c0d84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f2c050be0 0x7f3f2c0357b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 --2- 172.21.15.53:0/1761286586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f2c009b70 0x7f3f2c0d69a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 >> 172.21.15.53:0/1761286586 conn(0x7f3f2c01d910 msgr2=0x7f3f2c004930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 shutdown_connections 2024-09-13T18:25:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f3f3b492640 1 -- 172.21.15.53:0/1761286586 wait complete. 2024-09-13T18:25:04.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2730066690 msgr2=0x7f2730068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2730066690 0x7f2730068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f27380ae000 tx=0x7f27380a7000 comp rx=0 tx=0).stop 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274415e680 msgr2=0x7f27441461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274415e680 0x7f27441461b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f273c00c780 tx=0x7f273c00cc40 comp rx=0 tx=0).stop 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 shutdown_connections 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2730066690 0x7f2730068b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27440b09a0 0x7f27440ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f274415e680 0x7f27441461b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 --2- 172.21.15.53:0/4031638195 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2744071840 0x7f274415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 >> 172.21.15.53:0/4031638195 conn(0x7f274406f720 msgr2=0x7f27440aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 shutdown_connections 2024-09-13T18:25:04.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.738+0000 7f2748ace640 1 -- 172.21.15.53:0/4031638195 wait complete. 2024-09-13T18:25:04.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.746+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f144015ad30 con 0x7f144006cbd0 2024-09-13T18:25:04.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.746+0000 7f14277fe640 1 -- 172.21.15.53:0/3028072569 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14380552b0 con 0x7f144006cbd0 2024-09-13T18:25:04.748 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:04.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f142c066790 msgr2=0x7f142c068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f142c066790 0x7f142c068c50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14400afe80 tx=0x7f1434009060 comp rx=0 tx=0).stop 2024-09-13T18:25:04.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 msgr2=0x7f144014ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:04.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f144014ebc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f143800cba0 tx=0x7f143800a430 comp rx=0 tx=0).stop 2024-09-13T18:25:04.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 shutdown_connections 2024-09-13T18:25:04.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f142c066790 0x7f142c068c50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1440072120 0x7f144014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14400b0a10 0x7f1440163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 --2- 172.21.15.53:0/3028072569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f144006cbd0 0x7f144014ebc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:04.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 >> 172.21.15.53:0/3028072569 conn(0x7f14400afef0 msgr2=0x7f14400714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:04.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 shutdown_connections 2024-09-13T18:25:04.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:04.750+0000 7f14450ea640 1 -- 172.21.15.53:0/3028072569 wait complete. 2024-09-13T18:25:04.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-09-13T18:25:04.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-09-13T18:25:04.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-09-13T18:25:04.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-09-13T18:25:04.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-09-13T18:25:04.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-09-13T18:25:04.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-09-13T18:25:05.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:25:05.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:25:05.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:25:05.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:25:05.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:25:05.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:25:05.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:25:05.779 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:25:05.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.922+0000 7fb0f9c52640 1 Processor -- start 2024-09-13T18:25:05.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.922+0000 7fb0f9c52640 1 -- start start 2024-09-13T18:25:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f9c52640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0f40b2100 0x7fb0f40abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f9c52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0f40720e0 0x7fb0f40ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f9c52640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f40aba00 con 0x7fb0f41587e0 2024-09-13T18:25:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f9c52640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f40b1390 con 0x7fb0f40720e0 2024-09-13T18:25:05.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f9c52640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f40b1630 con 0x7fb0f40b2100 2024-09-13T18:25:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0f40720e0 0x7fb0f40ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f2ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb0f40b2100 0x7fb0f40abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0f40720e0 0x7fb0f40ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33252/0 (socket says 172.21.15.53:33252) 2024-09-13T18:25:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f3fff640 1 -- 172.21.15.53:0/3707477713 learned_addr learned my addr 172.21.15.53:0/3707477713 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f3fff640 1 -- 172.21.15.53:0/3707477713 >> v2:172.21.15.87:3300/0 conn(0x7fb0f40b2100 msgr2=0x7fb0f40abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f3fff640 1 --2- 172.21.15.53:0/3707477713 >> v2:172.21.15.87:3300/0 conn(0x7fb0f40b2100 0x7fb0f40abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f3fff640 1 -- 172.21.15.53:0/3707477713 >> v1:172.21.15.53:6789/0 conn(0x7fb0f41587e0 legacy=0x7fb0f40b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f3fff640 1 -- 172.21.15.53:0/3707477713 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40ab690 con 0x7fb0f40720e0 2024-09-13T18:25:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.926+0000 7fb0f2ffd640 1 --2- 172.21.15.53:0/3707477713 >> v2:172.21.15.87:3300/0 conn(0x7fb0f40b2100 0x7fb0f40abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:05.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f3fff640 1 --2- 172.21.15.53:0/3707477713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40720e0 0x7fb0f40ac3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb0f406b050 tx=0x7fb0e401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e10b223dbfc9cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:05.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f27fc640 1 -- 172.21.15.53:0/3707477713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40a5c80 con 0x7fb0f40720e0 2024-09-13T18:25:05.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f27fc640 1 -- 172.21.15.53:0/3707477713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e40a5de0 con 0x7fb0f40720e0 2024-09-13T18:25:05.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f27fc640 1 -- 172.21.15.53:0/3707477713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40ad660 con 0x7fb0f40720e0 2024-09-13T18:25:05.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f9c52640 1 -- 172.21.15.53:0/3707477713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40720e0 msgr2=0x7fb0f40ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/3707477713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40720e0 0x7fb0f40ac3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb0f406b050 tx=0x7fb0e401cca0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f9c52640 1 -- 172.21.15.53:0/3707477713 shutdown_connections 2024-09-13T18:25:05.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/3707477713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40720e0 0x7fb0f40ac3d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/3707477713 >> v2:172.21.15.87:3300/0 conn(0x7fb0f40b2100 0x7fb0f40abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.930+0000 7fb0f9c52640 1 -- 172.21.15.53:0/3707477713 >> 172.21.15.53:0/3707477713 conn(0x7fb0f40afef0 msgr2=0x7fb0f40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:05.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 -- 172.21.15.53:0/3707477713 shutdown_connections 2024-09-13T18:25:05.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 -- 172.21.15.53:0/3707477713 wait complete. 2024-09-13T18:25:05.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 Processor -- start 2024-09-13T18:25:05.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 -- start start 2024-09-13T18:25:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0f40720e0 0x7fb0f414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40b2100 0x7fb0f4158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0f41587e0 0x7fb0f4159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f414f0a0 con 0x7fb0f40b2100 2024-09-13T18:25:05.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f414e1e0 con 0x7fb0f40720e0 2024-09-13T18:25:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f9c52640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f414eae0 con 0x7fb0f41587e0 2024-09-13T18:25:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0f40720e0 0x7fb0f414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40b2100 0x7fb0f4158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.934+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0f40720e0 0x7fb0f414fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33532/0 (socket says 172.21.15.53:33532) 2024-09-13T18:25:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f37fe640 1 -- 172.21.15.53:0/1755411872 learned_addr learned my addr 172.21.15.53:0/1755411872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f2ffd640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40b2100 0x7fb0f4158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33264/0 (socket says 172.21.15.53:33264) 2024-09-13T18:25:05.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f3fff640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0f41587e0 0x7fb0f4159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f37fe640 1 -- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0f41587e0 msgr2=0x7fb0f4159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f37fe640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0f41587e0 0x7fb0f4159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f37fe640 1 -- 172.21.15.53:0/1755411872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40b2100 msgr2=0x7fb0f4158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f37fe640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40b2100 0x7fb0f4158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f37fe640 1 -- 172.21.15.53:0/1755411872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009a70 con 0x7fb0f40720e0 2024-09-13T18:25:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f37fe640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0f40720e0 0x7fb0f414fda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800c3f0 tx=0x7fb0e800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:05.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0e3fff640 1 -- 172.21.15.53:0/1755411872 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80052d0 con 0x7fb0f40720e0 2024-09-13T18:25:05.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e4009d60 con 0x7fb0f40720e0 2024-09-13T18:25:05.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0e3fff640 1 -- 172.21.15.53:0/1755411872 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e8005430 con 0x7fb0f40720e0 2024-09-13T18:25:05.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0e3fff640 1 -- 172.21.15.53:0/1755411872 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8003840 con 0x7fb0f40720e0 2024-09-13T18:25:05.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.938+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f414d9e0 con 0x7fb0f40720e0 2024-09-13T18:25:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.942+0000 7fb0e3fff640 1 -- 172.21.15.53:0/1755411872 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0e80039a0 con 0x7fb0f40720e0 2024-09-13T18:25:05.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.942+0000 7fb0e3fff640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0d8066690 0x7fb0d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.942+0000 7fb0e3fff640 1 -- 172.21.15.53:0/1755411872 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0e80835f0 con 0x7fb0f40720e0 2024-09-13T18:25:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.942+0000 7fb0f2ffd640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0d8066690 0x7fb0d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.942+0000 7fb0f2ffd640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0d8066690 0x7fb0d8068b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0114e0 tx=0x7fb0ec00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:05.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.946+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40b19f0 con 0x7fb0f40720e0 2024-09-13T18:25:05.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.962+0000 7fb0e3fff640 1 -- 172.21.15.53:0/1755411872 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0e8050a00 con 0x7fb0f40720e0 2024-09-13T18:25:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece7e67640 1 Processor -- start 2024-09-13T18:25:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f355ddb2640 1 Processor -- start 2024-09-13T18:25:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece7e67640 1 -- start start 2024-09-13T18:25:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece7e67640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fece0160b80 0x7fece01645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece7e67640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece00b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece7e67640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00b2b50 con 0x7fece00cc340 2024-09-13T18:25:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece7e67640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece0160f60 con 0x7fece0160b80 2024-09-13T18:25:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece7e67640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece0165460 con 0x7fece00b3790 2024-09-13T18:25:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece5402640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fece00cc340 0x7fece00b3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48588/0 (socket says 172.21.15.53:48588) 2024-09-13T18:25:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece5402640 1 -- 172.21.15.53:0/200173994 learned_addr learned my addr 172.21.15.53:0/200173994 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f355ddb2640 1 -- start start 2024-09-13T18:25:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece6404640 1 --2- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece00b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece5c03640 1 --2- 172.21.15.53:0/200173994 >> v2:172.21.15.87:3300/0 conn(0x7fece0160b80 0x7fece01645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece4c01640 1 -- 172.21.15.53:0/200173994 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601478589 0 0) 0x7fecdc001120 con 0x7fece00cc340 2024-09-13T18:25:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece4c01640 1 -- 172.21.15.53:0/200173994 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feccc003530 con 0x7fece00cc340 2024-09-13T18:25:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc357a50640 1 Processor -- start 2024-09-13T18:25:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc357a50640 1 -- start start 2024-09-13T18:25:05.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece4c01640 1 -- 172.21.15.53:0/200173994 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3831932153 0 0) 0x7feccc003530 con 0x7fece00cc340 2024-09-13T18:25:05.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece5c03640 1 -- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 msgr2=0x7fece00b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece5c03640 1 --2- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece00b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece5c03640 1 -- 172.21.15.53:0/200173994 >> v1:172.21.15.53:6789/0 conn(0x7fece00cc340 legacy=0x7fece00b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fece5c03640 1 -- 172.21.15.53:0/200173994 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece006db00 con 0x7fece0160b80 2024-09-13T18:25:05.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f355ddb2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f35580af8a0 0x7f35580adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f355ddb2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580ad3e0 con 0x7f35580d0bf0 2024-09-13T18:25:05.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f355ddb2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35580d11d0 con 0x7f3558160c70 2024-09-13T18:25:05.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f355ddb2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355806b270 con 0x7f35580af8a0 2024-09-13T18:25:05.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f563e01e640 1 Processor -- start 2024-09-13T18:25:05.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f3556ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f35580d0bf0 0x7f35580ad870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48596/0 (socket says 172.21.15.53:48596) 2024-09-13T18:25:05.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f3556ffd640 1 -- 172.21.15.53:0/2488385701 learned_addr learned my addr 172.21.15.53:0/2488385701 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f3557fff640 1 --2- 172.21.15.53:0/2488385701 >> v2:172.21.15.53:3300/0 conn(0x7f35580af8a0 0x7f35580adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc357a50640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc350143f30 0x7fc35015b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc357a50640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc35006b390 0x7fc3500706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc357a50640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc350144310 con 0x7fc350070c20 2024-09-13T18:25:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc357a50640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35015bb80 con 0x7fc350143f30 2024-09-13T18:25:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc357a50640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc350070250 con 0x7fc35006b390 2024-09-13T18:25:05.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc355fed640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc350070c20 0x7fc3500cc270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48600/0 (socket says 172.21.15.53:48600) 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7fc355fed640 1 -- 172.21.15.53:0/1700969852 learned_addr learned my addr 172.21.15.53:0/1700969852 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904984985 0 0) 0x7f35580d11d0 con 0x7f3558160c70 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003530 con 0x7f3558160c70 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2793982040 0 0) 0x7f3540003530 con 0x7f3558160c70 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 >> v2:172.21.15.53:3300/0 conn(0x7f35580af8a0 msgr2=0x7f35580adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 --2- 172.21.15.53:0/2488385701 >> v2:172.21.15.53:3300/0 conn(0x7f35580af8a0 0x7f35580adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 >> v1:172.21.15.53:6789/0 conn(0x7f35580d0bf0 legacy=0x7f35580ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580b4fc0 con 0x7f3558160c70 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.970+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f354c001680 con 0x7f3558160c70 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 >> v1:172.21.15.87:6789/0 conn(0x7f3558160c70 legacy=0x7f35580d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35567fc640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f3540003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35567fc640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35400047d0 0x7f3540004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35567fc640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3540005190 0x7f354000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355806b270 con 0x7f3540005190 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354000c090 con 0x7f35400039d0 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354000c250 con 0x7f35400047d0 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782112579 0 0) 0x7fc340001120 con 0x7fc350070c20 2024-09-13T18:25:05.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc33c003530 con 0x7fc350070c20 2024-09-13T18:25:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35577fe640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f3540003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f3556ffd640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35400047d0 0x7f3540004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585368756 0 0) 0x7fc33c003530 con 0x7fc350070c20 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 >> v2:172.21.15.87:3300/0 conn(0x7fc35006b390 msgr2=0x7fc3500706e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 --2- 172.21.15.53:0/1700969852 >> v2:172.21.15.87:3300/0 conn(0x7fc35006b390 0x7fc3500706e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 >> v2:172.21.15.53:3300/0 conn(0x7fc350143f30 msgr2=0x7fc35015b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 --2- 172.21.15.53:0/1700969852 >> v2:172.21.15.53:3300/0 conn(0x7fc350143f30 0x7fc35015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35006bae0 con 0x7fc350070c20 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc340001810 con 0x7fc350070c20 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 >> v1:172.21.15.53:6789/0 conn(0x7fc350070c20 legacy=0x7fc3500cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c003980 0x7fc33c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc33c0047d0 0x7fc33c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc33c0052b0 0x7fc33c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc350070250 con 0x7fc33c0047d0 2024-09-13T18:25:05.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c00c1a0 con 0x7fc33c003980 2024-09-13T18:25:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c00c360 con 0x7fc33c0052b0 2024-09-13T18:25:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f3557fff640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3540005190 0x7f354000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35577fe640 1 -- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35400047d0 msgr2=0x7f3540004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35577fe640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35400047d0 0x7f3540004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35577fe640 1 -- 172.21.15.53:0/2488385701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3540005190 msgr2=0x7f354000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35577fe640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3540005190 0x7f354000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f35577fe640 1 -- 172.21.15.53:0/2488385701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540003530 con 0x7f35400039d0 2024-09-13T18:25:05.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc355fed640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc33c0052b0 0x7fc33c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc354feb640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc33c0047d0 0x7fc33c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece5c03640 1 --2- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0160b80 0x7fece01645e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fecd00097c0 tx=0x7fecd001c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70e1d2492fe3e022 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:05.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc354feb640 1 -- 172.21.15.53:0/1700969852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc33c0052b0 msgr2=0x7fc33c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc354feb640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc33c0052b0 0x7fc33c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc354feb640 1 -- 172.21.15.53:0/1700969852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c003980 msgr2=0x7fc33c003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:25:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc354feb640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c003980 0x7fc33c003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc354feb640 1 -- 172.21.15.53:0/1700969852 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35006bae0 con 0x7fc33c0047d0 2024-09-13T18:25:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fc355fed640 1 -- 172.21.15.53:0/1700969852 reap_dead start 2024-09-13T18:25:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece4c01640 1 -- 172.21.15.53:0/200173994 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc001810 con 0x7fece0160b80 2024-09-13T18:25:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f3557fff640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3540005190 0x7f354000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:05.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f3557fff640 1 -- 172.21.15.53:0/2488385701 reap_dead start 2024-09-13T18:25:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563e01e640 1 -- start start 2024-09-13T18:25:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563e01e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56380715f0 0x7f56380c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563e01e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 0x7f56380719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563e01e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563806c7f0 con 0x7f5638071f10 2024-09-13T18:25:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563e01e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563815c1f0 con 0x7f56380715f0 2024-09-13T18:25:05.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563e01e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380cca20 con 0x7f563806c3d0 2024-09-13T18:25:05.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad516ff640 1 Processor -- start 2024-09-13T18:25:05.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad516ff640 1 -- start start 2024-09-13T18:25:05.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad516ff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad440ea440 0x7fad440537f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563d81d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5638071f10 0x7f56380cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33906/0 (socket says 172.21.15.53:33906) 2024-09-13T18:25:05.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563d81d640 1 -- 172.21.15.53:0/48372181 learned_addr learned my addr 172.21.15.53:0/48372181 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:05.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad516ff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad440070f0 0x7fad44053d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad516ff640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4401de60 con 0x7fad4401c500 2024-09-13T18:25:05.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad516ff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad44054270 con 0x7fad440070f0 2024-09-13T18:25:05.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad516ff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4401d3c0 con 0x7fad440ea440 2024-09-13T18:25:05.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad4b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fad4401c500 0x7fad440eab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33912/0 (socket says 172.21.15.53:33912) 2024-09-13T18:25:05.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad4b7fe640 1 -- 172.21.15.53:0/3346197410 learned_addr learned my addr 172.21.15.53:0/3346197410 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece4c01640 1 -- 172.21.15.53:0/200173994 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd00a7050 con 0x7fece0160b80 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece4c01640 1 -- 172.21.15.53:0/200173994 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00ab600 con 0x7fece0160b80 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 -- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0160b80 msgr2=0x7fece01645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 --2- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0160b80 0x7fece01645e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fecd00097c0 tx=0x7fecd001c300 comp rx=0 tx=0).stop 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 -- 172.21.15.53:0/200173994 shutdown_connections 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 --2- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece00b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 --2- 172.21.15.53:0/200173994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0160b80 0x7fece01645e0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fecd00097c0 tx=0x7fecd001c300 comp rx=0 tx=0).stop 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 -- 172.21.15.53:0/200173994 >> 172.21.15.53:0/200173994 conn(0x7fece00b1310 msgr2=0x7fece00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:05.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563d01c640 1 --2- 172.21.15.53:0/48372181 >> v2:172.21.15.53:3300/0 conn(0x7f56380715f0 0x7f56380c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 -- 172.21.15.53:0/200173994 shutdown_connections 2024-09-13T18:25:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad50efe640 1 --2- 172.21.15.53:0/3346197410 >> v2:172.21.15.87:3300/0 conn(0x7fad440070f0 0x7fad44053d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad4affd640 1 -- 172.21.15.53:0/3346197410 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840916045 0 0) 0x7fad4401de60 con 0x7fad4401c500 2024-09-13T18:25:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad4affd640 1 -- 172.21.15.53:0/3346197410 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c003530 con 0x7fad4401c500 2024-09-13T18:25:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad50efe640 1 -- 172.21.15.53:0/3346197410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad440ea440 msgr2=0x7fad440537f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:25:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad50efe640 1 --2- 172.21.15.53:0/3346197410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad440ea440 0x7fad440537f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad50efe640 1 -- 172.21.15.53:0/3346197410 >> v1:172.21.15.87:6789/0 conn(0x7fad4401c500 legacy=0x7fad440eab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fad50efe640 1 -- 172.21.15.53:0/3346197410 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440323a0 con 0x7fad440070f0 2024-09-13T18:25:05.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7fece7e67640 1 -- 172.21.15.53:0/200173994 wait complete. 2024-09-13T18:25:05.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f562ffff640 1 -- 172.21.15.53:0/48372181 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061888745 0 0) 0x7f563806c7f0 con 0x7f5638071f10 2024-09-13T18:25:05.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f562ffff640 1 -- 172.21.15.53:0/48372181 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5624003530 con 0x7f5638071f10 2024-09-13T18:25:05.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f35577fe640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f3540003df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f354c007f40 tx=0x7f354c01cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12ae3bb70eec3cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:05.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0a5930 con 0x7f35400039d0 2024-09-13T18:25:05.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0a5a90 con 0x7f35400039d0 2024-09-13T18:25:05.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f35567fc640 1 -- 172.21.15.53:0/2488385701 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0a5e80 con 0x7f35400039d0 2024-09-13T18:25:05.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563d01c640 1 -- 172.21.15.53:0/48372181 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 msgr2=0x7f56380719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:05.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563d01c640 1 --2- 172.21.15.53:0/48372181 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 0x7f56380719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563d01c640 1 -- 172.21.15.53:0/48372181 >> v1:172.21.15.87:6789/0 conn(0x7f5638071f10 legacy=0x7f56380cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.974+0000 7f563d01c640 1 -- 172.21.15.53:0/48372181 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563806ca20 con 0x7f56380715f0 2024-09-13T18:25:05.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc354feb640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc33c0047d0 0x7fc33c004c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0097e0 tx=0x7fc34c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2e702986d2ae40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:05.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0ab600 con 0x7fc33c0047d0 2024-09-13T18:25:05.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c0a7050 con 0x7fc33c0047d0 2024-09-13T18:25:05.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc347fff640 1 -- 172.21.15.53:0/1700969852 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0aba00 con 0x7fc33c0047d0 2024-09-13T18:25:05.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 Processor -- start 2024-09-13T18:25:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad50efe640 1 --2- 172.21.15.53:0/3346197410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 0x7fad44053d30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad4c068e50 tx=0x7fad4c0965e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b3eb1973501a2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad4affd640 1 -- 172.21.15.53:0/3346197410 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c125600 con 0x7fad440070f0 2024-09-13T18:25:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad4affd640 1 -- 172.21.15.53:0/3346197410 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c125760 con 0x7fad440070f0 2024-09-13T18:25:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad4affd640 1 -- 172.21.15.53:0/3346197410 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c125b50 con 0x7fad440070f0 2024-09-13T18:25:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f5ae1569640 1 Processor -- start 2024-09-13T18:25:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f5ae1569640 1 -- start start 2024-09-13T18:25:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 -- 172.21.15.53:0/1700969852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc33c0047d0 msgr2=0x7fc33c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc33c0047d0 0x7fc33c004c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0097e0 tx=0x7fc34c01c2e0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 -- 172.21.15.53:0/1700969852 shutdown_connections 2024-09-13T18:25:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 --2- 172.21.15.53:0/1700969852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc33c0047d0 0x7fc33c004c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 -- 172.21.15.53:0/1700969852 >> 172.21.15.53:0/1700969852 conn(0x7fc3500b0120 msgr2=0x7fc3500b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 -- 172.21.15.53:0/1700969852 shutdown_connections 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 -- start start 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece014d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece00cc340 0x7fece01675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece014d5d0 0x7fece0167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0152970 con 0x7fece00cc340 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0151cf0 con 0x7fece014d5d0 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece7e67640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece0151fd0 con 0x7fece00b3790 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece5c03640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece014d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece014d5d0 0x7fece0167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 -- 172.21.15.53:0/3346197410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 msgr2=0x7fad44053d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 --2- 172.21.15.53:0/3346197410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 0x7fad44053d30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad4c068e50 tx=0x7fad4c0965e0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 -- 172.21.15.53:0/3346197410 shutdown_connections 2024-09-13T18:25:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 --2- 172.21.15.53:0/3346197410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 0x7fad44053d30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 --2- 172.21.15.53:0/3346197410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad440ea440 0x7fad440537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece014d5d0 0x7fece0167ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33558/0 (socket says 172.21.15.53:33558) 2024-09-13T18:25:05.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 -- 172.21.15.53:0/4122692099 learned_addr learned my addr 172.21.15.53:0/4122692099 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:05.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 -- 172.21.15.53:0/3346197410 >> 172.21.15.53:0/3346197410 conn(0x7fad44036070 msgr2=0x7fad44036450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:05.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 -- 172.21.15.53:0/3346197410 shutdown_connections 2024-09-13T18:25:05.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fad516ff640 1 -- 172.21.15.53:0/3346197410 wait complete. 2024-09-13T18:25:05.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece5402640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece00cc340 0x7fece01675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f355ddb2640 1 -- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 msgr2=0x7f3540003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f355ddb2640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f3540003df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f354c007f40 tx=0x7f354c01cac0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 -- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 msgr2=0x7fece014d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece014d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 -- 172.21.15.53:0/4122692099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece00cc340 msgr2=0x7fece01675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece00cc340 0x7fece01675a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 -- 172.21.15.53:0/4122692099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009420 con 0x7fece014d5d0 2024-09-13T18:25:05.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f355ddb2640 1 -- 172.21.15.53:0/2488385701 shutdown_connections 2024-09-13T18:25:05.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f355ddb2640 1 --2- 172.21.15.53:0/2488385701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f3540003df0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:05.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f355ddb2640 1 -- 172.21.15.53:0/2488385701 >> 172.21.15.53:0/2488385701 conn(0x7f35580b5920 msgr2=0x7f35580b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:05.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7efc8dad3640 1 Processor -- start 2024-09-13T18:25:05.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f355ddb2640 1 -- 172.21.15.53:0/2488385701 shutdown_connections 2024-09-13T18:25:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7efc8dad3640 1 -- start start 2024-09-13T18:25:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 -- 172.21.15.53:0/1700969852 wait complete. 2024-09-13T18:25:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fc357a50640 1 Processor -- start 2024-09-13T18:25:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7fece6404640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece014d5d0 0x7fece0167ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fecd800efc0 tx=0x7fecd800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ae1569640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5adc155fc0 0x7f5adc0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ae1569640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc1563a0 0x7f5adc159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ae1569640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5adc0cade0 0x7f5adc0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fecd67fc640 1 -- 172.21.15.53:0/4122692099 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8014480 con 0x7fece014d5d0 2024-09-13T18:25:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece01522b0 con 0x7fece014d5d0 2024-09-13T18:25:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece01519e0 con 0x7fece014d5d0 2024-09-13T18:25:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f563d01c640 1 --2- 172.21.15.53:0/48372181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f56380c8760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56340097f0 tx=0x7f563401e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4209c6a017b621 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc1563a0 0x7f5adc159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc1563a0 0x7f5adc159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52576/0 (socket says 172.21.15.53:52576) 2024-09-13T18:25:06.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fecd67fc640 1 -- 172.21.15.53:0/4122692099 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd800f040 con 0x7fece014d5d0 2024-09-13T18:25:06.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fecd67fc640 1 -- 172.21.15.53:0/4122692099 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8014820 con 0x7fece014d5d0 2024-09-13T18:25:06.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ad3fff640 1 -- 172.21.15.53:0/3057571005 learned_addr learned my addr 172.21.15.53:0/3057571005 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5adb7fe640 1 --2- 172.21.15.53:0/3057571005 >> v2:172.21.15.87:3300/0 conn(0x7f5adc0cade0 0x7f5adc0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc159bb0 con 0x7f5adc155fc0 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0cb7b0 con 0x7f5adc0cade0 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0b36f0 con 0x7f5adc1563a0 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8dad3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc880d0af0 0x7efc880d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8dad3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc88160b40 0x7efc880d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8dad3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc880d2440 con 0x7efc880cecd0 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8dad3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc880d1410 con 0x7efc88160b40 2024-09-13T18:25:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8dad3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc880d0560 con 0x7efc880d0af0 2024-09-13T18:25:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 Processor -- start 2024-09-13T18:25:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 -- start start 2024-09-13T18:25:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8cad1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc880d0af0 0x7efc880d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8cad1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc880d0af0 0x7efc880d2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33588/0 (socket says 172.21.15.53:33588) 2024-09-13T18:25:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc8cad1640 1 -- 172.21.15.53:0/4141724393 learned_addr learned my addr 172.21.15.53:0/4141724393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc87fff640 1 --2- 172.21.15.53:0/4141724393 >> v2:172.21.15.53:3300/0 conn(0x7efc88160b40 0x7efc880d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.978+0000 7f355ddb2640 1 -- 172.21.15.53:0/2488385701 wait complete. 2024-09-13T18:25:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 Processor -- start 2024-09-13T18:25:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc87fff640 1 -- 172.21.15.53:0/4141724393 >> v2:172.21.15.87:3300/0 conn(0x7efc880d0af0 msgr2=0x7efc880d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc87fff640 1 --2- 172.21.15.53:0/4141724393 >> v2:172.21.15.87:3300/0 conn(0x7efc880d0af0 0x7efc880d2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc87fff640 1 -- 172.21.15.53:0/4141724393 >> v1:172.21.15.87:6789/0 conn(0x7efc880cecd0 legacy=0x7efc880cf140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:25:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7efc87fff640 1 -- 172.21.15.53:0/4141724393 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc880d26b0 con 0x7efc88160b40 2024-09-13T18:25:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f562ffff640 1 -- 172.21.15.53:0/48372181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340a7880 con 0x7f56380715f0 2024-09-13T18:25:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f562ffff640 1 -- 172.21.15.53:0/48372181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56340a79e0 con 0x7f56380715f0 2024-09-13T18:25:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f562ffff640 1 -- 172.21.15.53:0/48372181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340a7d70 con 0x7f56380715f0 2024-09-13T18:25:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f563e01e640 1 -- 172.21.15.53:0/48372181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 msgr2=0x7f56380c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f563e01e640 1 --2- 172.21.15.53:0/48372181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f56380c8760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56340097f0 tx=0x7f563401e7e0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc357a50640 1 -- start start 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc357a50640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c0047d0 0x7fc35015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc357a50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc350132f00 0x7fc3501fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc357a50640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3500ae170 0x7fc3501ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc357a50640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc350139de0 con 0x7fc350132f00 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc357a50640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35015c6d0 con 0x7fc33c0047d0 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc357a50640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35015b3d0 con 0x7fc3500ae170 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc8005260 con 0x7fece014d5d0 2024-09-13T18:25:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc355fed640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3500ae170 0x7fc3501ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 -- start start 2024-09-13T18:25:06.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc3557ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c0047d0 0x7fc35015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc3557ec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c0047d0 0x7fc35015c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33600/0 (socket says 172.21.15.53:33600) 2024-09-13T18:25:06.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fc3557ec640 1 -- 172.21.15.53:0/3191211122 learned_addr learned my addr 172.21.15.53:0/3191211122 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f35581638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35581623a0 0x7f355809a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f355809aa30 0x7f3558153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355809aee0 con 0x7f35581623a0 2024-09-13T18:25:06.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558162830 con 0x7f35400039d0 2024-09-13T18:25:06.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f355ddb2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3558162b10 con 0x7f355809aa30 2024-09-13T18:25:06.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fecd67fc640 1 -- 172.21.15.53:0/4122692099 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fecd8014980 con 0x7fece014d5d0 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5adb7fe640 1 -- 172.21.15.53:0/3057571005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc1563a0 msgr2=0x7f5adc159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5adb7fe640 1 --2- 172.21.15.53:0/3057571005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc1563a0 0x7f5adc159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5adb7fe640 1 -- 172.21.15.53:0/3057571005 >> v2:172.21.15.53:3300/0 conn(0x7f5adc155fc0 msgr2=0x7f5adc0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5adb7fe640 1 --2- 172.21.15.53:0/3057571005 >> v2:172.21.15.53:3300/0 conn(0x7f5adc155fc0 0x7f5adc0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 0x7fad4403a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad4401c500 0x7fad4400a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad440ea440 0x7fad4400a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440cd270 con 0x7fad440ea440 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4400b7f0 con 0x7fad440070f0 2024-09-13T18:25:06.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad516ff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4400bad0 con 0x7fad4401c500 2024-09-13T18:25:06.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f5adb7fe640 1 -- 172.21.15.53:0/3057571005 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0b14c0 con 0x7f5adc0cade0 2024-09-13T18:25:06.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad4401c500 0x7fad4400a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad4401c500 0x7fad4400a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52598/0 (socket says 172.21.15.53:52598) 2024-09-13T18:25:06.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 -- 172.21.15.53:0/1668929529 learned_addr learned my addr 172.21.15.53:0/1668929529 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4bfff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 0x7fad4403a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 -- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 msgr2=0x7fad4403a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 0x7fad4403a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 -- 172.21.15.53:0/1668929529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad440ea440 msgr2=0x7fad4400a5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:25:06.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad440ea440 0x7fad4400a5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 -- 172.21.15.53:0/1668929529 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c073e70 con 0x7fad4401c500 2024-09-13T18:25:06.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f3557fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f355809aa30 0x7f3558153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7fad4b7fe640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad4401c500 0x7fad4400a0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad3800c450 tx=0x7fad3800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- 172.21.15.53:0/48372181 shutdown_connections 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 --2- 172.21.15.53:0/48372181 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 0x7f56380719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 --2- 172.21.15.53:0/48372181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f56380c8760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- 172.21.15.53:0/48372181 >> 172.21.15.53:0/48372181 conn(0x7f56380ce110 msgr2=0x7f56380ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc355fed640 1 -- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c0047d0 msgr2=0x7fc35015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc355fed640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c0047d0 0x7fc35015c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc355fed640 1 -- 172.21.15.53:0/3191211122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc350132f00 msgr2=0x7fc3501fee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc355fed640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc350132f00 0x7fc3501fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc355fed640 1 -- 172.21.15.53:0/3191211122 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35015b6b0 con 0x7fc3500ae170 2024-09-13T18:25:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- 172.21.15.53:0/48372181 shutdown_connections 2024-09-13T18:25:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.982+0000 7f3557fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f355809aa30 0x7f3558153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52600/0 (socket says 172.21.15.53:52600) 2024-09-13T18:25:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3557fff640 1 -- 172.21.15.53:0/654501559 learned_addr learned my addr 172.21.15.53:0/654501559 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f35577fe640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f35581638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f5adb7fe640 1 --2- 172.21.15.53:0/3057571005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc0cade0 0x7f5adc0cb270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b2bc0 tx=0x7f5ad401ddb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c1307769a53d4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad48ff9640 1 -- 172.21.15.53:0/1668929529 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38005db0 con 0x7fad4401c500 2024-09-13T18:25:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- 172.21.15.53:0/48372181 wait complete. 2024-09-13T18:25:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3556ffd640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35581623a0 0x7f355809a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad48ff9640 1 -- 172.21.15.53:0/1668929529 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad38007070 con 0x7fad4401c500 2024-09-13T18:25:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fecd67fc640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc4066690 0x7fecc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fecd67fc640 1 -- 172.21.15.53:0/4122692099 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecd8084f70 con 0x7fece014d5d0 2024-09-13T18:25:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4400bdb0 con 0x7fad4401c500 2024-09-13T18:25:06.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad44033fa0 con 0x7fad4401c500 2024-09-13T18:25:06.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc87fff640 1 --2- 172.21.15.53:0/4141724393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880d0ed0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc8808baa0 tx=0x7efc8001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfd3e8f223aa61e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad48ff9640 1 -- 172.21.15.53:0/1668929529 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380073e0 con 0x7fad4401c500 2024-09-13T18:25:06.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fece5c03640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc4066690 0x7fecc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3557fff640 1 -- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 msgr2=0x7f35581638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3557fff640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f35581638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3557fff640 1 -- 172.21.15.53:0/654501559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35581623a0 msgr2=0x7f355809a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3557fff640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35581623a0 0x7f355809a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3557fff640 1 -- 172.21.15.53:0/654501559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558162df0 con 0x7f355809aa30 2024-09-13T18:25:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc877fe640 1 -- 172.21.15.53:0/4141724393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800a59a0 con 0x7efc88160b40 2024-09-13T18:25:06.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc877fe640 1 -- 172.21.15.53:0/4141724393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc800a5b00 con 0x7efc88160b40 2024-09-13T18:25:06.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f3557fff640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f355809aa30 0x7f3558153c50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3558072710 tx=0x7f355000f520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f353ffff640 1 -- 172.21.15.53:0/654501559 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355001a070 con 0x7f355809aa30 2024-09-13T18:25:06.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc355fed640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3500ae170 0x7fc3501ff3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc350071000 tx=0x7fc340007720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c005260 con 0x7fad4401c500 2024-09-13T18:25:06.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fece5c03640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc4066690 0x7fecc4068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecd00ad000 tx=0x7fecd00a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f353ffff640 1 -- 172.21.15.53:0/654501559 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000fd30 con 0x7f355809aa30 2024-09-13T18:25:06.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f353ffff640 1 -- 172.21.15.53:0/654501559 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000fee0 con 0x7f355809aa30 2024-09-13T18:25:06.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 Processor -- start 2024-09-13T18:25:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 -- 172.21.15.53:0/4141724393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 msgr2=0x7efc880d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 --2- 172.21.15.53:0/4141724393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880d0ed0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc8808baa0 tx=0x7efc8001c8e0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 -- 172.21.15.53:0/4141724393 shutdown_connections 2024-09-13T18:25:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 --2- 172.21.15.53:0/4141724393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880d0ed0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 --2- 172.21.15.53:0/4141724393 >> v2:172.21.15.87:3300/0 conn(0x7efc880d0af0 0x7efc880d2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 -- 172.21.15.53:0/4141724393 >> 172.21.15.53:0/4141724393 conn(0x7efc8808bad0 msgr2=0x7efc88070570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc345ffb640 1 -- 172.21.15.53:0/3191211122 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000f910 con 0x7fc3500ae170 2024-09-13T18:25:06.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc345ffb640 1 -- 172.21.15.53:0/3191211122 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34000fa70 con 0x7fc3500ae170 2024-09-13T18:25:06.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc345ffb640 1 -- 172.21.15.53:0/3191211122 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000fe20 con 0x7fc3500ae170 2024-09-13T18:25:06.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35015b990 con 0x7fc3500ae170 2024-09-13T18:25:06.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc350139a20 con 0x7fc3500ae170 2024-09-13T18:25:06.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35581630d0 con 0x7f355809aa30 2024-09-13T18:25:06.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3558154190 con 0x7f355809aa30 2024-09-13T18:25:06.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- start start 2024-09-13T18:25:06.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc350067400 con 0x7fc3500ae170 2024-09-13T18:25:06.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3558069f50 con 0x7f355809aa30 2024-09-13T18:25:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 -- 172.21.15.53:0/4141724393 shutdown_connections 2024-09-13T18:25:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7efc8dad3640 1 -- 172.21.15.53:0/4141724393 wait complete. 2024-09-13T18:25:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 0x7f56381523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f5638150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5638071f10 0x7f56381581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5638152b30 con 0x7f56380715f0 2024-09-13T18:25:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5638154680 con 0x7f5638071f10 2024-09-13T18:25:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563e01e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5638154960 con 0x7f563806c3d0 2024-09-13T18:25:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad48ff9640 1 -- 172.21.15.53:0/1668929529 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad38007540 con 0x7fad4401c500 2024-09-13T18:25:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad48ff9640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad30066690 0x7fad30068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7fad48ff9640 1 -- 172.21.15.53:0/1668929529 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad38083a80 con 0x7fad4401c500 2024-09-13T18:25:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563c81b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f5638150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563c81b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f5638150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33358/0 (socket says 172.21.15.53:33358) 2024-09-13T18:25:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.986+0000 7f563c81b640 1 -- 172.21.15.53:0/3456017527 learned_addr learned my addr 172.21.15.53:0/3456017527 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563d01c640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 0x7f56381523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563d81d640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5638071f10 0x7f56381581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7fad4bfff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad30066690 0x7fad30068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563c81b640 1 -- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 msgr2=0x7f56381523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563c81b640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 0x7f56381523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563c81b640 1 -- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5638071f10 msgr2=0x7f56381581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563c81b640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5638071f10 0x7f56381581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563c81b640 1 -- 172.21.15.53:0/3456017527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634009420 con 0x7f56380715f0 2024-09-13T18:25:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563c81b640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f5638150630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f562800b480 tx=0x7f562800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f353ffff640 1 -- 172.21.15.53:0/654501559 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3550016420 con 0x7f355809aa30 2024-09-13T18:25:06.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 Processor -- start 2024-09-13T18:25:06.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 -- start start 2024-09-13T18:25:06.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f353ffff640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3544066690 0x7f3544068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f353ffff640 1 -- 172.21.15.53:0/654501559 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35500856b0 con 0x7f355809aa30 2024-09-13T18:25:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7fad4bfff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad30066690 0x7fad30068b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fad440509f0 tx=0x7fad40009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f562dffb640 1 -- 172.21.15.53:0/3456017527 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628010870 con 0x7f56380715f0 2024-09-13T18:25:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f562dffb640 1 -- 172.21.15.53:0/3456017527 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56280109f0 con 0x7f56380715f0 2024-09-13T18:25:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f562dffb640 1 -- 172.21.15.53:0/3456017527 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628010da0 con 0x7f56380715f0 2024-09-13T18:25:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563e01e640 1 -- 172.21.15.53:0/3456017527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5638154c40 con 0x7f56380715f0 2024-09-13T18:25:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563e01e640 1 -- 172.21.15.53:0/3456017527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5638154330 con 0x7f56380715f0 2024-09-13T18:25:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f35577fe640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3544066690 0x7f3544068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc880cecd0 0x7efc88152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc880d0af0 0x7efc880c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc88152370 con 0x7efc88160b40 2024-09-13T18:25:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc88152cd0 con 0x7efc880cecd0 2024-09-13T18:25:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8dad3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc88151d20 con 0x7efc880d0af0 2024-09-13T18:25:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33368/0 (socket says 172.21.15.53:33368) 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 -- 172.21.15.53:0/175478606 learned_addr learned my addr 172.21.15.53:0/175478606 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8cad1640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc880cecd0 0x7efc88152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc87fff640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc880d0af0 0x7efc880c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 -- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc880d0af0 msgr2=0x7efc880c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc880d0af0 0x7efc880c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 -- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc880cecd0 msgr2=0x7efc88152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc880cecd0 0x7efc88152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 -- 172.21.15.53:0/175478606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80009a70 con 0x7efc88160b40 2024-09-13T18:25:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f563e01e640 1 -- 172.21.15.53:0/3456017527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5638067400 con 0x7f56380715f0 2024-09-13T18:25:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7f35577fe640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3544066690 0x7f3544068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f354c0af000 tx=0x7f354c005040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8cad1640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc880cecd0 0x7efc88152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.990+0000 7efc8d2d2640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880b2c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00b440 tx=0x7efc7c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.994+0000 7efc857fa640 1 -- 172.21.15.53:0/175478606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011830 con 0x7efc88160b40 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.994+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc880b0e20 con 0x7efc88160b40 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.994+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc880b1100 con 0x7efc88160b40 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.994+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc881524b0 con 0x7efc88160b40 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.994+0000 7efc857fa640 1 -- 172.21.15.53:0/175478606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c009190 con 0x7efc88160b40 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.994+0000 7efc857fa640 1 -- 172.21.15.53:0/175478606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011bb0 con 0x7efc88160b40 2024-09-13T18:25:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7efc857fa640 1 -- 172.21.15.53:0/175478606 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc7c011d10 con 0x7efc88160b40 2024-09-13T18:25:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7fecd67fc640 1 -- 172.21.15.53:0/4122692099 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fecd8052420 con 0x7fece014d5d0 2024-09-13T18:25:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ada7fc640 1 -- 172.21.15.53:0/3057571005 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40a6e30 con 0x7f5adc0cade0 2024-09-13T18:25:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ada7fc640 1 -- 172.21.15.53:0/3057571005 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad400a0d0 con 0x7f5adc0cade0 2024-09-13T18:25:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ada7fc640 1 -- 172.21.15.53:0/3057571005 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400a460 con 0x7f5adc0cade0 2024-09-13T18:25:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7efc857fa640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efc74066690 0x7efc74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7efc857fa640 1 -- 172.21.15.53:0/175478606 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc7c084790 con 0x7efc88160b40 2024-09-13T18:25:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7efc8cad1640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efc74066690 0x7efc74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f562dffb640 1 -- 172.21.15.53:0/3456017527 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5628023480 con 0x7f56380715f0 2024-09-13T18:25:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f562dffb640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f561c0666e0 0x7f561c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f562dffb640 1 -- 172.21.15.53:0/3456017527 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56280845e0 con 0x7f56380715f0 2024-09-13T18:25:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f562dffb640 1 -- 172.21.15.53:0/3456017527 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56280848f0 con 0x7f56380715f0 2024-09-13T18:25:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f563d01c640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f561c0666e0 0x7f561c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7efc8cad1640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efc74066690 0x7efc74068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc88153280 tx=0x7efc78008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc0cade0 msgr2=0x7f5adc0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 --2- 172.21.15.53:0/3057571005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc0cade0 0x7f5adc0cb270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b2bc0 tx=0x7f5ad401ddb0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 shutdown_connections 2024-09-13T18:25:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 --2- 172.21.15.53:0/3057571005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc1563a0 0x7f5adc159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 --2- 172.21.15.53:0/3057571005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc0cade0 0x7f5adc0cb270 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 --2- 172.21.15.53:0/3057571005 >> v2:172.21.15.53:3300/0 conn(0x7f5adc155fc0 0x7f5adc0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 >> 172.21.15.53:0/3057571005 conn(0x7f5adc065c80 msgr2=0x7f5adc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 shutdown_connections 2024-09-13T18:25:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f563d01c640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f561c0666e0 0x7f561c068ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56340b1000 tx=0x7f56340a9070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:05.998+0000 7f5ae1569640 1 -- 172.21.15.53:0/3057571005 wait complete. 2024-09-13T18:25:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7efc857fa640 1 -- 172.21.15.53:0/175478606 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc7c051b50 con 0x7efc88160b40 2024-09-13T18:25:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 Processor -- start 2024-09-13T18:25:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 -- start start 2024-09-13T18:25:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7fc345ffb640 1 -- 172.21.15.53:0/3191211122 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc34001d360 con 0x7fc3500ae170 2024-09-13T18:25:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7fc345ffb640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc334066710 0x7fc334068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc0cade0 0x7f5adc0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc155fc0 0x7f5adc152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1563a0 0x7f5adc152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc14b900 con 0x7f5adc155fc0 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc15b590 con 0x7f5adc1563a0 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ae1569640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc15b870 con 0x7f5adc0cade0 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc155fc0 0x7f5adc152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc155fc0 0x7f5adc152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33382/0 (socket says 172.21.15.53:33382) 2024-09-13T18:25:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5ad3fff640 1 -- 172.21.15.53:0/644143486 learned_addr learned my addr 172.21.15.53:0/644143486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5adb7fe640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1563a0 0x7f5adc152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7f5adaffd640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc0cade0 0x7f5adc0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7fc3557ec640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc334066710 0x7fc334068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.002+0000 7fad48ff9640 1 -- 172.21.15.53:0/1668929529 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad38050f10 con 0x7fad4401c500 2024-09-13T18:25:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.006+0000 7f5adaffd640 1 -- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1563a0 msgr2=0x7f5adc152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.006+0000 7f5adaffd640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1563a0 0x7f5adc152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.006+0000 7f5adaffd640 1 -- 172.21.15.53:0/644143486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc155fc0 msgr2=0x7f5adc152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.006+0000 7f5adaffd640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc155fc0 0x7f5adc152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.006+0000 7f5adaffd640 1 -- 172.21.15.53:0/644143486 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad400c050 con 0x7f5adc0cade0 2024-09-13T18:25:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.006+0000 7f5adaffd640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc0cade0 0x7f5adc0acb40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00b3f0 tx=0x7f5acc00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.006+0000 7fc3557ec640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc334066710 0x7fc334068bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc3500cded0 tx=0x7fc34800d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.014+0000 7fc345ffb640 1 -- 172.21.15.53:0/3191211122 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3400550a0 con 0x7fc3500ae170 2024-09-13T18:25:06.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.014+0000 7f5ad37fe640 1 -- 172.21.15.53:0/644143486 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc011830 con 0x7f5adc0cade0 2024-09-13T18:25:06.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.014+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc15bb50 con 0x7f5adc0cade0 2024-09-13T18:25:06.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.014+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc15b1b0 con 0x7f5adc0cade0 2024-09-13T18:25:06.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.014+0000 7f353ffff640 1 -- 172.21.15.53:0/654501559 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3550052b90 con 0x7f355809aa30 2024-09-13T18:25:06.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.014+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc067400 con 0x7f5adc0cade0 2024-09-13T18:25:06.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.026+0000 7f5ad37fe640 1 -- 172.21.15.53:0/644143486 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc011990 con 0x7f5adc0cade0 2024-09-13T18:25:06.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.026+0000 7f5ad37fe640 1 -- 172.21.15.53:0/644143486 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc011d20 con 0x7f5adc0cade0 2024-09-13T18:25:06.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.026+0000 7fc345ffb640 1 -- 172.21.15.53:0/3191211122 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3400513e0 con 0x7fc3500ae170 2024-09-13T18:25:06.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.038+0000 7f5ad37fe640 1 -- 172.21.15.53:0/644143486 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5acc01a400 con 0x7f5adc0cade0 2024-09-13T18:25:06.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.038+0000 7f5ad37fe640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5abc066690 0x7f5abc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.038+0000 7f5ad37fe640 1 -- 172.21.15.53:0/644143486 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5acc0846e0 con 0x7f5adc0cade0 2024-09-13T18:25:06.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.038+0000 7f5ad3fff640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5abc066690 0x7f5abc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.038+0000 7f5ad3fff640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5abc066690 0x7f5abc068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5adc14db00 tx=0x7f5ac4009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.038+0000 7f5ad37fe640 1 -- 172.21.15.53:0/644143486 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5acc051b70 con 0x7f5adc0cade0 2024-09-13T18:25:06.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.282+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0f414c740 con 0x7fb0f40720e0 2024-09-13T18:25:06.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fecc80057e0 con 0x7fece014d5d0 2024-09-13T18:25:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0e3fff640 1 -- 172.21.15.53:0/1755411872 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0e8017070 con 0x7fb0f40720e0 2024-09-13T18:25:06.289 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2024-09-13T18:25:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fecd67fc640 1 -- 172.21.15.53:0/4122692099 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fecd8055a40 con 0x7fece014d5d0 2024-09-13T18:25:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0d8066690 msgr2=0x7fb0d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.290 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0d8066690 0x7fb0d8068b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0114e0 tx=0x7fb0ec00b040 comp rx=0 tx=0).stop 2024-09-13T18:25:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0f40720e0 msgr2=0x7fb0f414fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0f40720e0 0x7fb0f414fda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800c3f0 tx=0x7fb0e800c8b0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 shutdown_connections 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0d8066690 0x7fb0d8068b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.286+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0f41587e0 0x7fb0f4159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.290+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40b2100 0x7fb0f4158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.290+0000 7fb0f9c52640 1 --2- 172.21.15.53:0/1755411872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0f40720e0 0x7fb0f414fda0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.290+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 >> 172.21.15.53:0/1755411872 conn(0x7fb0f40afef0 msgr2=0x7fb0f4153020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.290+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 shutdown_connections 2024-09-13T18:25:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.290+0000 7fb0f9c52640 1 -- 172.21.15.53:0/1755411872 wait complete. 2024-09-13T18:25:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc4066690 msgr2=0x7fecc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc4066690 0x7fecc4068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecd00ad000 tx=0x7fecd00a6000 comp rx=0 tx=0).stop 2024-09-13T18:25:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece014d5d0 msgr2=0x7fece0167ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece014d5d0 0x7fece0167ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fecd800efc0 tx=0x7fecd800c490 comp rx=0 tx=0).stop 2024-09-13T18:25:06.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 shutdown_connections 2024-09-13T18:25:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc4066690 0x7fecc4068b50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece014d5d0 0x7fece0167ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece00cc340 0x7fece01675a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 --2- 172.21.15.53:0/4122692099 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece00b3790 0x7fece014d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 >> 172.21.15.53:0/4122692099 conn(0x7fece00b1310 msgr2=0x7fece0070440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 shutdown_connections 2024-09-13T18:25:06.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.294+0000 7fece7e67640 1 -- 172.21.15.53:0/4122692099 wait complete. 2024-09-13T18:25:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.302+0000 7f563e01e640 1 -- 172.21.15.53:0/3456017527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5638157b00 con 0x7f56380715f0 2024-09-13T18:25:06.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.302+0000 7f562dffb640 1 -- 172.21.15.53:0/3456017527 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5638157b00 con 0x7f56380715f0 2024-09-13T18:25:06.304 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 -- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f561c0666e0 msgr2=0x7f561c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f561c0666e0 0x7f561c068ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56340b1000 tx=0x7f56340a9070 comp rx=0 tx=0).stop 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 -- 172.21.15.53:0/3456017527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 msgr2=0x7f5638150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f5638150630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f562800b480 tx=0x7f562800b940 comp rx=0 tx=0).stop 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 -- 172.21.15.53:0/3456017527 shutdown_connections 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f561c0666e0 0x7f561c068ba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5638071f10 0x7f56381581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56380715f0 0x7f5638150630 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 --2- 172.21.15.53:0/3456017527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f563806c3d0 0x7f56381523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 -- 172.21.15.53:0/3456017527 >> 172.21.15.53:0/3456017527 conn(0x7f56380ce110 msgr2=0x7f56380ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 -- 172.21.15.53:0/3456017527 shutdown_connections 2024-09-13T18:25:06.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.306+0000 7f561b7fe640 1 -- 172.21.15.53:0/3456017527 wait complete. 2024-09-13T18:25:06.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-13T18:25:06.318 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-13T18:25:06.324 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.326+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3558163580 con 0x7f355809aa30 2024-09-13T18:25:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.326+0000 7f353ffff640 1 -- 172.21.15.53:0/654501559 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35500561b0 con 0x7f355809aa30 2024-09-13T18:25:06.329 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3544066690 msgr2=0x7f3544068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3544066690 0x7f3544068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f354c0af000 tx=0x7f354c005040 comp rx=0 tx=0).stop 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f355809aa30 msgr2=0x7f3558153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f355809aa30 0x7f3558153c50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3558072710 tx=0x7f355000f520 comp rx=0 tx=0).stop 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 shutdown_connections 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3544066690 0x7f3544068b50 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f354c0af000 tx=0x7f354c005040 comp rx=0 tx=0).stop 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f355809aa30 0x7f3558153c50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35581623a0 0x7f355809a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 --2- 172.21.15.53:0/654501559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35400039d0 0x7f35581638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 >> 172.21.15.53:0/654501559 conn(0x7f35580b5920 msgr2=0x7f355806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 shutdown_connections 2024-09-13T18:25:06.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.330+0000 7f355ddb2640 1 -- 172.21.15.53:0/654501559 wait complete. 2024-09-13T18:25:06.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-13T18:25:06.334 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fad2c0050d0 con 0x7fad4401c500 2024-09-13T18:25:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc8815c920 con 0x7efc88160b40 2024-09-13T18:25:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7fad48ff9640 1 -- 172.21.15.53:0/1668929529 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad38021090 con 0x7fad4401c500 2024-09-13T18:25:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7efc857fa640 1 -- 172.21.15.53:0/175478606 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc7c055170 con 0x7efc88160b40 2024-09-13T18:25:06.340 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2024-09-13T18:25:06.340 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2024-09-13T18:25:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efc74066690 msgr2=0x7efc74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7efc8dad3640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efc74066690 0x7efc74068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc88153280 tx=0x7efc78008040 comp rx=0 tx=0).stop 2024-09-13T18:25:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 msgr2=0x7efc880b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.338+0000 7efc8dad3640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880b2c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00b440 tx=0x7efc7c00b900 comp rx=0 tx=0).stop 2024-09-13T18:25:06.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 shutdown_connections 2024-09-13T18:25:06.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efc74066690 0x7efc74068b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc880d0af0 0x7efc880c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc88160b40 0x7efc880b2c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 --2- 172.21.15.53:0/175478606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc880cecd0 0x7efc88152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 >> 172.21.15.53:0/175478606 conn(0x7efc8808bad0 msgr2=0x7efc8806ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 shutdown_connections 2024-09-13T18:25:06.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7efc8dad3640 1 -- 172.21.15.53:0/175478606 wait complete. 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad30066690 msgr2=0x7fad30068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad30066690 0x7fad30068b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fad440509f0 tx=0x7fad40009060 comp rx=0 tx=0).stop 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad4401c500 msgr2=0x7fad4400a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad4401c500 0x7fad4400a0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad3800c450 tx=0x7fad3800c910 comp rx=0 tx=0).stop 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 shutdown_connections 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad30066690 0x7fad30068b50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad4401c500 0x7fad4400a0a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad440ea440 0x7fad4400a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 --2- 172.21.15.53:0/1668929529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad440070f0 0x7fad4403a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 >> 172.21.15.53:0/1668929529 conn(0x7fad44036070 msgr2=0x7fad440e9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 shutdown_connections 2024-09-13T18:25:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fad516ff640 1 -- 172.21.15.53:0/1668929529 wait complete. 2024-09-13T18:25:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc350144310 con 0x7fc3500ae170 2024-09-13T18:25:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.342+0000 7fc345ffb640 1 -- 172.21.15.53:0/3191211122 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc350144310 con 0x7fc3500ae170 2024-09-13T18:25:06.345 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:06.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc334066710 msgr2=0x7fc334068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc334066710 0x7fc334068bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc3500cded0 tx=0x7fc34800d040 comp rx=0 tx=0).stop 2024-09-13T18:25:06.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3500ae170 msgr2=0x7fc3501ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3500ae170 0x7fc3501ff3a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc350071000 tx=0x7fc340007720 comp rx=0 tx=0).stop 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 shutdown_connections 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc334066710 0x7fc334068bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3500ae170 0x7fc3501ff3a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc350132f00 0x7fc3501fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 --2- 172.21.15.53:0/3191211122 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc33c0047d0 0x7fc35015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 >> 172.21.15.53:0/3191211122 conn(0x7fc3500b0120 msgr2=0x7fc3501359c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 shutdown_connections 2024-09-13T18:25:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.346+0000 7fc357a50640 1 -- 172.21.15.53:0/3191211122 wait complete. 2024-09-13T18:25:06.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-13T18:25:06.350 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.354+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5adc15b9b0 con 0x7f5adc0cade0 2024-09-13T18:25:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.354+0000 7f5ad37fe640 1 -- 172.21.15.53:0/644143486 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5adc15b9b0 con 0x7f5adc0cade0 2024-09-13T18:25:06.357 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2024-09-13T18:25:06.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5abc066690 msgr2=0x7f5abc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5abc066690 0x7f5abc068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5adc14db00 tx=0x7f5ac4009240 comp rx=0 tx=0).stop 2024-09-13T18:25:06.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc0cade0 msgr2=0x7f5adc0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc0cade0 0x7f5adc0acb40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00b3f0 tx=0x7f5acc00b8b0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 shutdown_connections 2024-09-13T18:25:06.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5abc066690 0x7f5abc068b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5adc1563a0 0x7f5adc152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5adc155fc0 0x7f5adc152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 --2- 172.21.15.53:0/644143486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5adc0cade0 0x7f5adc0acb40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 >> 172.21.15.53:0/644143486 conn(0x7f5adc065c80 msgr2=0x7f5adc0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 shutdown_connections 2024-09-13T18:25:06.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.358+0000 7f5ae1569640 1 -- 172.21.15.53:0/644143486 wait complete. 2024-09-13T18:25:06.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-09-13T18:25:06.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-09-13T18:25:06.365 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.366 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-13T18:25:06.375 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-09-13T18:25:06.381 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:06.381 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:25:06.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:25:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 Processor -- start 2024-09-13T18:25:06.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 -- start start 2024-09-13T18:25:06.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3980cb980 0x7fb3980b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb39806b850 0x7fb3980cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3980cbd60 0x7fb39806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3980b1ac0 con 0x7fb3980cbd60 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb398159ac0 con 0x7fb3980cb980 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb39dbbc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb398159da0 con 0x7fb39806b850 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3980cbd60 0x7fb39806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3980cbd60 0x7fb39806fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33392/0 (socket says 172.21.15.53:33392) 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 -- 172.21.15.53:0/2686149031 learned_addr learned my addr 172.21.15.53:0/2686149031 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb396ffd640 1 --2- 172.21.15.53:0/2686149031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb39806b850 0x7fb3980cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb3977fe640 1 --2- 172.21.15.53:0/2686149031 >> v2:172.21.15.87:3300/0 conn(0x7fb3980cb980 0x7fb3980b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 -- 172.21.15.53:0/2686149031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb39806b850 msgr2=0x7fb3980cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 --2- 172.21.15.53:0/2686149031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb39806b850 0x7fb3980cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 -- 172.21.15.53:0/2686149031 >> v2:172.21.15.87:3300/0 conn(0x7fb3980cb980 msgr2=0x7fb3980b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 --2- 172.21.15.53:0/2686149031 >> v2:172.21.15.87:3300/0 conn(0x7fb3980cb980 0x7fb3980b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.530+0000 7fb397fff640 1 -- 172.21.15.53:0/2686149031 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39815a080 con 0x7fb3980cbd60 2024-09-13T18:25:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb397fff640 1 --2- 172.21.15.53:0/2686149031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3980cbd60 0x7fb39806fcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb390009e50 tx=0x7fb39001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63c456bc4f5c176 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3967fc640 1 -- 172.21.15.53:0/2686149031 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3900a56c0 con 0x7fb3980cbd60 2024-09-13T18:25:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3967fc640 1 -- 172.21.15.53:0/2686149031 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3900a5820 con 0x7fb3980cbd60 2024-09-13T18:25:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3967fc640 1 -- 172.21.15.53:0/2686149031 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3900a5bb0 con 0x7fb3980cbd60 2024-09-13T18:25:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- 172.21.15.53:0/2686149031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3980cbd60 msgr2=0x7fb39806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/2686149031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3980cbd60 0x7fb39806fcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb390009e50 tx=0x7fb39001c930 comp rx=0 tx=0).stop 2024-09-13T18:25:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- 172.21.15.53:0/2686149031 shutdown_connections 2024-09-13T18:25:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/2686149031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb39806b850 0x7fb3980cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/2686149031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3980cbd60 0x7fb39806fcd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/2686149031 >> v2:172.21.15.87:3300/0 conn(0x7fb3980cb980 0x7fb3980b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- 172.21.15.53:0/2686149031 >> 172.21.15.53:0/2686149031 conn(0x7fb398065c80 msgr2=0x7fb398066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- 172.21.15.53:0/2686149031 shutdown_connections 2024-09-13T18:25:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- 172.21.15.53:0/2686149031 wait complete. 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 Processor -- start 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- start start 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39806b850 0x7fb39815f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3980cb980 0x7fb3980ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3980cbd60 0x7fb39814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39815fbe0 con 0x7fb39806b850 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39815fec0 con 0x7fb3980cb980 2024-09-13T18:25:06.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3981601a0 con 0x7fb3980cbd60 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39806b850 0x7fb39815f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39806b850 0x7fb39815f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33400/0 (socket says 172.21.15.53:33400) 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 -- 172.21.15.53:0/3473232795 learned_addr learned my addr 172.21.15.53:0/3473232795 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb396ffd640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3980cb980 0x7fb3980ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb397fff640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3980cbd60 0x7fb39814f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 -- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3980cbd60 msgr2=0x7fb39814f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3980cbd60 0x7fb39814f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 -- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3980cb980 msgr2=0x7fb3980ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3980cb980 0x7fb3980ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 -- 172.21.15.53:0/3473232795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390009b30 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb396ffd640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3980cb980 0x7fb3980ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb3977fe640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39806b850 0x7fb39815f600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb38800d800 tx=0x7fb38800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb37ffff640 1 -- 172.21.15.53:0/3473232795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800b6c0 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb37ffff640 1 -- 172.21.15.53:0/3473232795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38800b820 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb398160480 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb37ffff640 1 -- 172.21.15.53:0/3473232795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800bb90 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.534+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3981f30c0 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.538+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb398067400 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.538+0000 7fb37ffff640 1 -- 172.21.15.53:0/3473232795 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb38800bcf0 con 0x7fb39806b850 2024-09-13T18:25:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.538+0000 7fb37ffff640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb384066690 0x7fb384068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.538+0000 7fb37ffff640 1 -- 172.21.15.53:0/3473232795 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb388084670 con 0x7fb39806b850 2024-09-13T18:25:06.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.538+0000 7fb396ffd640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb384066690 0x7fb384068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.538+0000 7fb396ffd640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb384066690 0x7fb384068b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb398158f80 tx=0x7fb38c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.542+0000 7fb37ffff640 1 -- 172.21.15.53:0/3473232795 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3880519e0 con 0x7fb39806b850 2024-09-13T18:25:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.702+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3980b33b0 con 0x7fb384066690 2024-09-13T18:25:06.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.722+0000 7fb37ffff640 1 -- 172.21.15.53:0/3473232795 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264563 (secure 0 0 0) 0x7fb3980b33b0 con 0x7fb384066690 2024-09-13T18:25:06.728 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:06.730 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:25:06.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb384066690 msgr2=0x7fb384068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb384066690 0x7fb384068b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb398158f80 tx=0x7fb38c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39806b850 msgr2=0x7fb39815f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39806b850 0x7fb39815f600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb38800d800 tx=0x7fb38800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 shutdown_connections 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb384066690 0x7fb384068b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3980cbd60 0x7fb39814f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3980cb980 0x7fb3980ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 --2- 172.21.15.53:0/3473232795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb39806b850 0x7fb39815f600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 >> 172.21.15.53:0/3473232795 conn(0x7fb398065c80 msgr2=0x7fb3980ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 shutdown_connections 2024-09-13T18:25:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.726+0000 7fb39dbbc640 1 -- 172.21.15.53:0/3473232795 wait complete. 2024-09-13T18:25:06.744 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-13T18:25:04.902072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235408,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739312,"statfs":{"total":773094113280,"available":772853055488,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.913255"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.434555+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.432500+0000","last_became_peered":"2024-09-13T18:24:58.432500+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388010+0000","last_change":"2024-09-13T18:24:58.396126+0000","last_active":"2024-09-13T18:24:59.388010+0000","last_peered":"2024-09-13T18:24:59.388010+0000","last_clean":"2024-09-13T18:24:59.388010+0000","last_became_active":"2024-09-13T18:24:58.395863+0000","last_became_peered":"2024-09-13T18:24:58.395863+0000","last_unstale":"2024-09-13T18:24:59.388010+0000","last_undegraded":"2024-09-13T18:24:59.388010+0000","last_fullsized":"2024-09-13T18:24:59.388010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240106+0000","last_change":"2024-09-13T18:24:58.393804+0000","last_active":"2024-09-13T18:25:00.240106+0000","last_peered":"2024-09-13T18:25:00.240106+0000","last_clean":"2024-09-13T18:25:00.240106+0000","last_became_active":"2024-09-13T18:24:58.393534+0000","last_became_peered":"2024-09-13T18:24:58.393534+0000","last_unstale":"2024-09-13T18:25:00.240106+0000","last_undegraded":"2024-09-13T18:25:00.240106+0000","last_fullsized":"2024-09-13T18:25:00.240106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239709+0000","last_change":"2024-09-13T18:24:58.416846+0000","last_active":"2024-09-13T18:25:00.239709+0000","last_peered":"2024-09-13T18:25:00.239709+0000","last_clean":"2024-09-13T18:25:00.239709+0000","last_became_active":"2024-09-13T18:24:58.415742+0000","last_became_peered":"2024-09-13T18:24:58.415742+0000","last_unstale":"2024-09-13T18:25:00.239709+0000","last_undegraded":"2024-09-13T18:25:00.239709+0000","last_fullsized":"2024-09-13T18:25:00.239709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463377+0000","last_change":"2024-09-13T18:24:58.413407+0000","last_active":"2024-09-13T18:24:59.463377+0000","last_peered":"2024-09-13T18:24:59.463377+0000","last_clean":"2024-09-13T18:24:59.463377+0000","last_became_active":"2024-09-13T18:24:58.412683+0000","last_became_peered":"2024-09-13T18:24:58.412683+0000","last_unstale":"2024-09-13T18:24:59.463377+0000","last_undegraded":"2024-09-13T18:24:59.463377+0000","last_fullsized":"2024-09-13T18:24:59.463377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239438+0000","last_change":"2024-09-13T18:24:58.419676+0000","last_active":"2024-09-13T18:25:00.239438+0000","last_peered":"2024-09-13T18:25:00.239438+0000","last_clean":"2024-09-13T18:25:00.239438+0000","last_became_active":"2024-09-13T18:24:58.418305+0000","last_became_peered":"2024-09-13T18:24:58.418305+0000","last_unstale":"2024-09-13T18:25:00.239438+0000","last_undegraded":"2024-09-13T18:25:00.239438+0000","last_fullsized":"2024-09-13T18:25:00.239438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.878378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462710+0000","last_change":"2024-09-13T18:24:58.409783+0000","last_active":"2024-09-13T18:24:59.462710+0000","last_peered":"2024-09-13T18:24:59.462710+0000","last_clean":"2024-09-13T18:24:59.462710+0000","last_became_active":"2024-09-13T18:24:58.409053+0000","last_became_peered":"2024-09-13T18:24:58.409053+0000","last_unstale":"2024-09-13T18:24:59.462710+0000","last_undegraded":"2024-09-13T18:24:59.462710+0000","last_fullsized":"2024-09-13T18:24:59.462710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:30.448126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669414+0000","last_change":"2024-09-13T18:24:58.420831+0000","last_active":"2024-09-13T18:24:59.669414+0000","last_peered":"2024-09-13T18:24:59.669414+0000","last_clean":"2024-09-13T18:24:59.669414+0000","last_became_active":"2024-09-13T18:24:58.420490+0000","last_became_peered":"2024-09-13T18:24:58.420490+0000","last_unstale":"2024-09-13T18:24:59.669414+0000","last_undegraded":"2024-09-13T18:24:59.669414+0000","last_fullsized":"2024-09-13T18:24:59.669414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.429947+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.429214+0000","last_became_peered":"2024-09-13T18:24:58.429214+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240311+0000","last_change":"2024-09-13T18:24:58.426881+0000","last_active":"2024-09-13T18:25:00.240311+0000","last_peered":"2024-09-13T18:25:00.240311+0000","last_clean":"2024-09-13T18:25:00.240311+0000","last_became_active":"2024-09-13T18:24:58.425419+0000","last_became_peered":"2024-09-13T18:24:58.425419+0000","last_unstale":"2024-09-13T18:25:00.240311+0000","last_undegraded":"2024-09-13T18:25:00.240311+0000","last_fullsized":"2024-09-13T18:25:00.240311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240288+0000","last_change":"2024-09-13T18:24:58.430550+0000","last_active":"2024-09-13T18:25:00.240288+0000","last_peered":"2024-09-13T18:25:00.240288+0000","last_clean":"2024-09-13T18:25:00.240288+0000","last_became_active":"2024-09-13T18:24:58.425963+0000","last_became_peered":"2024-09-13T18:24:58.425963+0000","last_unstale":"2024-09-13T18:25:00.240288+0000","last_undegraded":"2024-09-13T18:25:00.240288+0000","last_fullsized":"2024-09-13T18:25:00.240288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389497+0000","last_change":"2024-09-13T18:24:58.431749+0000","last_active":"2024-09-13T18:24:59.389497+0000","last_peered":"2024-09-13T18:24:59.389497+0000","last_clean":"2024-09-13T18:24:59.389497+0000","last_became_active":"2024-09-13T18:24:58.431519+0000","last_became_peered":"2024-09-13T18:24:58.431519+0000","last_unstale":"2024-09-13T18:24:59.389497+0000","last_undegraded":"2024-09-13T18:24:59.389497+0000","last_fullsized":"2024-09-13T18:24:59.389497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670053+0000","last_change":"2024-09-13T18:24:58.423558+0000","last_active":"2024-09-13T18:24:59.670053+0000","last_peered":"2024-09-13T18:24:59.670053+0000","last_clean":"2024-09-13T18:24:59.670053+0000","last_became_active":"2024-09-13T18:24:58.423300+0000","last_became_peered":"2024-09-13T18:24:58.423300+0000","last_unstale":"2024-09-13T18:24:59.670053+0000","last_undegraded":"2024-09-13T18:24:59.670053+0000","last_fullsized":"2024-09-13T18:24:59.670053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239986+0000","last_change":"2024-09-13T18:24:58.396798+0000","last_active":"2024-09-13T18:25:00.239986+0000","last_peered":"2024-09-13T18:25:00.239986+0000","last_clean":"2024-09-13T18:25:00.239986+0000","last_became_active":"2024-09-13T18:24:58.396451+0000","last_became_peered":"2024-09-13T18:24:58.396451+0000","last_unstale":"2024-09-13T18:25:00.239986+0000","last_undegraded":"2024-09-13T18:25:00.239986+0000","last_fullsized":"2024-09-13T18:25:00.239986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387596+0000","last_change":"2024-09-13T18:24:58.394756+0000","last_active":"2024-09-13T18:24:59.387596+0000","last_peered":"2024-09-13T18:24:59.387596+0000","last_clean":"2024-09-13T18:24:59.387596+0000","last_became_active":"2024-09-13T18:24:58.394413+0000","last_became_peered":"2024-09-13T18:24:58.394413+0000","last_unstale":"2024-09-13T18:24:59.387596+0000","last_undegraded":"2024-09-13T18:24:59.387596+0000","last_fullsized":"2024-09-13T18:24:59.387596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239309+0000","last_change":"2024-09-13T18:24:58.417787+0000","last_active":"2024-09-13T18:25:00.239309+0000","last_peered":"2024-09-13T18:25:00.239309+0000","last_clean":"2024-09-13T18:25:00.239309+0000","last_became_active":"2024-09-13T18:24:58.416849+0000","last_became_peered":"2024-09-13T18:24:58.416849+0000","last_unstale":"2024-09-13T18:25:00.239309+0000","last_undegraded":"2024-09-13T18:25:00.239309+0000","last_fullsized":"2024-09-13T18:25:00.239309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239863+0000","last_change":"2024-09-13T18:24:58.433843+0000","last_active":"2024-09-13T18:25:00.239863+0000","last_peered":"2024-09-13T18:25:00.239863+0000","last_clean":"2024-09-13T18:25:00.239863+0000","last_became_active":"2024-09-13T18:24:58.433147+0000","last_became_peered":"2024-09-13T18:24:58.433147+0000","last_unstale":"2024-09-13T18:25:00.239863+0000","last_undegraded":"2024-09-13T18:25:00.239863+0000","last_fullsized":"2024-09-13T18:25:00.239863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155018+0000","last_change":"2024-09-13T18:24:58.424087+0000","last_active":"2024-09-13T18:25:00.155018+0000","last_peered":"2024-09-13T18:25:00.155018+0000","last_clean":"2024-09-13T18:25:00.155018+0000","last_became_active":"2024-09-13T18:24:58.423760+0000","last_became_peered":"2024-09-13T18:24:58.423760+0000","last_unstale":"2024-09-13T18:25:00.155018+0000","last_undegraded":"2024-09-13T18:25:00.155018+0000","last_fullsized":"2024-09-13T18:25:00.155018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:28.685985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463428+0000","last_change":"2024-09-13T18:24:58.426709+0000","last_active":"2024-09-13T18:24:59.463428+0000","last_peered":"2024-09-13T18:24:59.463428+0000","last_clean":"2024-09-13T18:24:59.463428+0000","last_became_active":"2024-09-13T18:24:58.426073+0000","last_became_peered":"2024-09-13T18:24:58.426073+0000","last_unstale":"2024-09-13T18:24:59.463428+0000","last_undegraded":"2024-09-13T18:24:59.463428+0000","last_fullsized":"2024-09-13T18:24:59.463428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240239+0000","last_change":"2024-09-13T18:24:58.436173+0000","last_active":"2024-09-13T18:25:00.240239+0000","last_peered":"2024-09-13T18:25:00.240239+0000","last_clean":"2024-09-13T18:25:00.240239+0000","last_became_active":"2024-09-13T18:24:58.435428+0000","last_became_peered":"2024-09-13T18:24:58.435428+0000","last_unstale":"2024-09-13T18:25:00.240239+0000","last_undegraded":"2024-09-13T18:25:00.240239+0000","last_fullsized":"2024-09-13T18:25:00.240239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240023+0000","last_change":"2024-09-13T18:24:58.414497+0000","last_active":"2024-09-13T18:25:00.240023+0000","last_peered":"2024-09-13T18:25:00.240023+0000","last_clean":"2024-09-13T18:25:00.240023+0000","last_became_active":"2024-09-13T18:24:58.414205+0000","last_became_peered":"2024-09-13T18:24:58.414205+0000","last_unstale":"2024-09-13T18:25:00.240023+0000","last_undegraded":"2024-09-13T18:25:00.240023+0000","last_fullsized":"2024-09-13T18:25:00.240023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239499+0000","last_change":"2024-09-13T18:24:58.433694+0000","last_active":"2024-09-13T18:25:00.239499+0000","last_peered":"2024-09-13T18:25:00.239499+0000","last_clean":"2024-09-13T18:25:00.239499+0000","last_became_active":"2024-09-13T18:24:58.432977+0000","last_became_peered":"2024-09-13T18:24:58.432977+0000","last_unstale":"2024-09-13T18:25:00.239499+0000","last_undegraded":"2024-09-13T18:25:00.239499+0000","last_fullsized":"2024-09-13T18:25:00.239499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:20.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669635+0000","last_change":"2024-09-13T18:24:58.399324+0000","last_active":"2024-09-13T18:24:59.669635+0000","last_peered":"2024-09-13T18:24:59.669635+0000","last_clean":"2024-09-13T18:24:59.669635+0000","last_became_active":"2024-09-13T18:24:58.398728+0000","last_became_peered":"2024-09-13T18:24:58.398728+0000","last_unstale":"2024-09-13T18:24:59.669635+0000","last_undegraded":"2024-09-13T18:24:59.669635+0000","last_fullsized":"2024-09-13T18:24:59.669635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239363+0000","last_change":"2024-09-13T18:24:58.418319+0000","last_active":"2024-09-13T18:25:00.239363+0000","last_peered":"2024-09-13T18:25:00.239363+0000","last_clean":"2024-09-13T18:25:00.239363+0000","last_became_active":"2024-09-13T18:24:58.417600+0000","last_became_peered":"2024-09-13T18:24:58.417600+0000","last_unstale":"2024-09-13T18:25:00.239363+0000","last_undegraded":"2024-09-13T18:25:00.239363+0000","last_fullsized":"2024-09-13T18:25:00.239363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670260+0000","last_change":"2024-09-13T18:24:58.434929+0000","last_active":"2024-09-13T18:24:59.670260+0000","last_peered":"2024-09-13T18:24:59.670260+0000","last_clean":"2024-09-13T18:24:59.670260+0000","last_became_active":"2024-09-13T18:24:58.434692+0000","last_became_peered":"2024-09-13T18:24:58.434692+0000","last_unstale":"2024-09-13T18:24:59.670260+0000","last_undegraded":"2024-09-13T18:24:59.670260+0000","last_fullsized":"2024-09-13T18:24:59.670260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240346+0000","last_change":"2024-09-13T18:24:58.434112+0000","last_active":"2024-09-13T18:25:00.240346+0000","last_peered":"2024-09-13T18:25:00.240346+0000","last_clean":"2024-09-13T18:25:00.240346+0000","last_became_active":"2024-09-13T18:24:58.433715+0000","last_became_peered":"2024-09-13T18:24:58.433715+0000","last_unstale":"2024-09-13T18:25:00.240346+0000","last_undegraded":"2024-09-13T18:25:00.240346+0000","last_fullsized":"2024-09-13T18:25:00.240346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388052+0000","last_change":"2024-09-13T18:24:58.398414+0000","last_active":"2024-09-13T18:24:59.388052+0000","last_peered":"2024-09-13T18:24:59.388052+0000","last_clean":"2024-09-13T18:24:59.388052+0000","last_became_active":"2024-09-13T18:24:58.398137+0000","last_became_peered":"2024-09-13T18:24:58.398137+0000","last_unstale":"2024-09-13T18:24:59.388052+0000","last_undegraded":"2024-09-13T18:24:59.388052+0000","last_fullsized":"2024-09-13T18:24:59.388052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670643+0000","last_change":"2024-09-13T18:24:58.416857+0000","last_active":"2024-09-13T18:24:59.670643+0000","last_peered":"2024-09-13T18:24:59.670643+0000","last_clean":"2024-09-13T18:24:59.670643+0000","last_became_active":"2024-09-13T18:24:58.416500+0000","last_became_peered":"2024-09-13T18:24:58.416500+0000","last_unstale":"2024-09-13T18:24:59.670643+0000","last_undegraded":"2024-09-13T18:24:59.670643+0000","last_fullsized":"2024-09-13T18:24:59.670643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240041+0000","last_change":"2024-09-13T18:24:58.399395+0000","last_active":"2024-09-13T18:25:00.240041+0000","last_peered":"2024-09-13T18:25:00.240041+0000","last_clean":"2024-09-13T18:25:00.240041+0000","last_became_active":"2024-09-13T18:24:58.399156+0000","last_became_peered":"2024-09-13T18:24:58.399156+0000","last_unstale":"2024-09-13T18:25:00.240041+0000","last_undegraded":"2024-09-13T18:25:00.240041+0000","last_fullsized":"2024-09-13T18:25:00.240041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239547+0000","last_change":"2024-09-13T18:24:58.419100+0000","last_active":"2024-09-13T18:25:00.239547+0000","last_peered":"2024-09-13T18:25:00.239547+0000","last_clean":"2024-09-13T18:25:00.239547+0000","last_became_active":"2024-09-13T18:24:58.416656+0000","last_became_peered":"2024-09-13T18:24:58.416656+0000","last_unstale":"2024-09-13T18:25:00.239547+0000","last_undegraded":"2024-09-13T18:25:00.239547+0000","last_fullsized":"2024-09-13T18:25:00.239547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154711+0000","last_change":"2024-09-13T18:24:58.417573+0000","last_active":"2024-09-13T18:25:00.154711+0000","last_peered":"2024-09-13T18:25:00.154711+0000","last_clean":"2024-09-13T18:25:00.154711+0000","last_became_active":"2024-09-13T18:24:58.417375+0000","last_became_peered":"2024-09-13T18:24:58.417375+0000","last_unstale":"2024-09-13T18:25:00.154711+0000","last_undegraded":"2024-09-13T18:25:00.154711+0000","last_fullsized":"2024-09-13T18:25:00.154711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240046+0000","last_change":"2024-09-13T18:24:58.420326+0000","last_active":"2024-09-13T18:25:00.240046+0000","last_peered":"2024-09-13T18:25:00.240046+0000","last_clean":"2024-09-13T18:25:00.240046+0000","last_became_active":"2024-09-13T18:24:58.419405+0000","last_became_peered":"2024-09-13T18:24:58.419405+0000","last_unstale":"2024-09-13T18:25:00.240046+0000","last_undegraded":"2024-09-13T18:25:00.240046+0000","last_fullsized":"2024-09-13T18:25:00.240046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389034+0000","last_change":"2024-09-13T18:24:58.395983+0000","last_active":"2024-09-13T18:24:59.389034+0000","last_peered":"2024-09-13T18:24:59.389034+0000","last_clean":"2024-09-13T18:24:59.389034+0000","last_became_active":"2024-09-13T18:24:58.394785+0000","last_became_peered":"2024-09-13T18:24:58.394785+0000","last_unstale":"2024-09-13T18:24:59.389034+0000","last_undegraded":"2024-09-13T18:24:59.389034+0000","last_fullsized":"2024-09-13T18:24:59.389034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.033774+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.033412+0000","last_became_peered":"2024-09-13T18:24:58.033412+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240057+0000","last_change":"2024-09-13T18:24:58.395023+0000","last_active":"2024-09-13T18:25:00.240057+0000","last_peered":"2024-09-13T18:25:00.240057+0000","last_clean":"2024-09-13T18:25:00.240057+0000","last_became_active":"2024-09-13T18:24:58.394639+0000","last_became_peered":"2024-09-13T18:24:58.394639+0000","last_unstale":"2024-09-13T18:25:00.240057+0000","last_undegraded":"2024-09-13T18:25:00.240057+0000","last_fullsized":"2024-09-13T18:25:00.240057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240216+0000","last_change":"2024-09-13T18:24:58.020182+0000","last_active":"2024-09-13T18:25:00.240216+0000","last_peered":"2024-09-13T18:25:00.240216+0000","last_clean":"2024-09-13T18:25:00.240216+0000","last_became_active":"2024-09-13T18:24:58.019266+0000","last_became_peered":"2024-09-13T18:24:58.019266+0000","last_unstale":"2024-09-13T18:25:00.240216+0000","last_undegraded":"2024-09-13T18:25:00.240216+0000","last_fullsized":"2024-09-13T18:25:00.240216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669944+0000","last_change":"2024-09-13T18:24:58.042697+0000","last_active":"2024-09-13T18:24:59.669944+0000","last_peered":"2024-09-13T18:24:59.669944+0000","last_clean":"2024-09-13T18:24:59.669944+0000","last_became_active":"2024-09-13T18:24:58.042383+0000","last_became_peered":"2024-09-13T18:24:58.042383+0000","last_unstale":"2024-09-13T18:24:59.669944+0000","last_undegraded":"2024-09-13T18:24:59.669944+0000","last_fullsized":"2024-09-13T18:24:59.669944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669716+0000","last_change":"2024-09-13T18:24:58.397945+0000","last_active":"2024-09-13T18:24:59.669716+0000","last_peered":"2024-09-13T18:24:59.669716+0000","last_clean":"2024-09-13T18:24:59.669716+0000","last_became_active":"2024-09-13T18:24:58.397684+0000","last_became_peered":"2024-09-13T18:24:58.397684+0000","last_unstale":"2024-09-13T18:24:59.669716+0000","last_undegraded":"2024-09-13T18:24:59.669716+0000","last_fullsized":"2024-09-13T18:24:59.669716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239398+0000","last_change":"2024-09-13T18:24:58.025483+0000","last_active":"2024-09-13T18:25:00.239398+0000","last_peered":"2024-09-13T18:25:00.239398+0000","last_clean":"2024-09-13T18:25:00.239398+0000","last_became_active":"2024-09-13T18:24:58.024711+0000","last_became_peered":"2024-09-13T18:24:58.024711+0000","last_unstale":"2024-09-13T18:25:00.239398+0000","last_undegraded":"2024-09-13T18:25:00.239398+0000","last_fullsized":"2024-09-13T18:25:00.239398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387452+0000","last_change":"2024-09-13T18:24:58.398740+0000","last_active":"2024-09-13T18:24:59.387452+0000","last_peered":"2024-09-13T18:24:59.387452+0000","last_clean":"2024-09-13T18:24:59.387452+0000","last_became_active":"2024-09-13T18:24:58.397892+0000","last_became_peered":"2024-09-13T18:24:58.397892+0000","last_unstale":"2024-09-13T18:24:59.387452+0000","last_undegraded":"2024-09-13T18:24:59.387452+0000","last_fullsized":"2024-09-13T18:24:59.387452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240367+0000","last_change":"2024-09-13T18:24:58.041368+0000","last_active":"2024-09-13T18:25:00.240367+0000","last_peered":"2024-09-13T18:25:00.240367+0000","last_clean":"2024-09-13T18:25:00.240367+0000","last_became_active":"2024-09-13T18:24:58.040649+0000","last_became_peered":"2024-09-13T18:24:58.040649+0000","last_unstale":"2024-09-13T18:25:00.240367+0000","last_undegraded":"2024-09-13T18:25:00.240367+0000","last_fullsized":"2024-09-13T18:25:00.240367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239820+0000","last_change":"2024-09-13T18:24:58.431883+0000","last_active":"2024-09-13T18:25:00.239820+0000","last_peered":"2024-09-13T18:25:00.239820+0000","last_clean":"2024-09-13T18:25:00.239820+0000","last_became_active":"2024-09-13T18:24:58.431214+0000","last_became_peered":"2024-09-13T18:24:58.431214+0000","last_unstale":"2024-09-13T18:25:00.239820+0000","last_undegraded":"2024-09-13T18:25:00.239820+0000","last_fullsized":"2024-09-13T18:25:00.239820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239840+0000","last_change":"2024-09-13T18:24:58.042813+0000","last_active":"2024-09-13T18:25:00.239840+0000","last_peered":"2024-09-13T18:25:00.239840+0000","last_clean":"2024-09-13T18:25:00.239840+0000","last_became_active":"2024-09-13T18:24:58.042035+0000","last_became_peered":"2024-09-13T18:24:58.042035+0000","last_unstale":"2024-09-13T18:25:00.239840+0000","last_undegraded":"2024-09-13T18:25:00.239840+0000","last_fullsized":"2024-09-13T18:25:00.239840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240157+0000","last_change":"2024-09-13T18:24:58.418140+0000","last_active":"2024-09-13T18:25:00.240157+0000","last_peered":"2024-09-13T18:25:00.240157+0000","last_clean":"2024-09-13T18:25:00.240157+0000","last_became_active":"2024-09-13T18:24:58.417892+0000","last_became_peered":"2024-09-13T18:24:58.417892+0000","last_unstale":"2024-09-13T18:25:00.240157+0000","last_undegraded":"2024-09-13T18:25:00.240157+0000","last_fullsized":"2024-09-13T18:25:00.240157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388168+0000","last_change":"2024-09-13T18:24:58.031378+0000","last_active":"2024-09-13T18:24:59.388168+0000","last_peered":"2024-09-13T18:24:59.388168+0000","last_clean":"2024-09-13T18:24:59.388168+0000","last_became_active":"2024-09-13T18:24:58.031086+0000","last_became_peered":"2024-09-13T18:24:58.031086+0000","last_unstale":"2024-09-13T18:24:59.388168+0000","last_undegraded":"2024-09-13T18:24:59.388168+0000","last_fullsized":"2024-09-13T18:24:59.388168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389663+0000","last_change":"2024-09-13T18:24:58.430392+0000","last_active":"2024-09-13T18:24:59.389663+0000","last_peered":"2024-09-13T18:24:59.389663+0000","last_clean":"2024-09-13T18:24:59.389663+0000","last_became_active":"2024-09-13T18:24:58.429654+0000","last_became_peered":"2024-09-13T18:24:58.429654+0000","last_unstale":"2024-09-13T18:24:59.389663+0000","last_undegraded":"2024-09-13T18:24:59.389663+0000","last_fullsized":"2024-09-13T18:24:59.389663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:27.851864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240263+0000","last_change":"2024-09-13T18:24:58.039451+0000","last_active":"2024-09-13T18:25:00.240263+0000","last_peered":"2024-09-13T18:25:00.240263+0000","last_clean":"2024-09-13T18:25:00.240263+0000","last_became_active":"2024-09-13T18:24:58.032328+0000","last_became_peered":"2024-09-13T18:24:58.032328+0000","last_unstale":"2024-09-13T18:25:00.240263+0000","last_undegraded":"2024-09-13T18:25:00.240263+0000","last_fullsized":"2024-09-13T18:25:00.240263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463120+0000","last_change":"2024-09-13T18:24:58.409551+0000","last_active":"2024-09-13T18:24:59.463120+0000","last_peered":"2024-09-13T18:24:59.463120+0000","last_clean":"2024-09-13T18:24:59.463120+0000","last_became_active":"2024-09-13T18:24:58.407831+0000","last_became_peered":"2024-09-13T18:24:58.407831+0000","last_unstale":"2024-09-13T18:24:59.463120+0000","last_undegraded":"2024-09-13T18:24:59.463120+0000","last_fullsized":"2024-09-13T18:24:59.463120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240074+0000","last_change":"2024-09-13T18:24:58.027528+0000","last_active":"2024-09-13T18:25:00.240074+0000","last_peered":"2024-09-13T18:25:00.240074+0000","last_clean":"2024-09-13T18:25:00.240074+0000","last_became_active":"2024-09-13T18:24:58.027248+0000","last_became_peered":"2024-09-13T18:24:58.027248+0000","last_unstale":"2024-09-13T18:25:00.240074+0000","last_undegraded":"2024-09-13T18:25:00.240074+0000","last_fullsized":"2024-09-13T18:25:00.240074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240005+0000","last_change":"2024-09-13T18:24:58.414607+0000","last_active":"2024-09-13T18:25:00.240005+0000","last_peered":"2024-09-13T18:25:00.240005+0000","last_clean":"2024-09-13T18:25:00.240005+0000","last_became_active":"2024-09-13T18:24:58.414310+0000","last_became_peered":"2024-09-13T18:24:58.414310+0000","last_unstale":"2024-09-13T18:25:00.240005+0000","last_undegraded":"2024-09-13T18:25:00.240005+0000","last_fullsized":"2024-09-13T18:25:00.240005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239585+0000","last_change":"2024-09-13T18:24:58.032711+0000","last_active":"2024-09-13T18:25:00.239585+0000","last_peered":"2024-09-13T18:25:00.239585+0000","last_clean":"2024-09-13T18:25:00.239585+0000","last_became_active":"2024-09-13T18:24:58.030671+0000","last_became_peered":"2024-09-13T18:24:58.030671+0000","last_unstale":"2024-09-13T18:25:00.239585+0000","last_undegraded":"2024-09-13T18:25:00.239585+0000","last_fullsized":"2024-09-13T18:25:00.239585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:21.674116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463490+0000","last_change":"2024-09-13T18:24:58.439918+0000","last_active":"2024-09-13T18:24:59.463490+0000","last_peered":"2024-09-13T18:24:59.463490+0000","last_clean":"2024-09-13T18:24:59.463490+0000","last_became_active":"2024-09-13T18:24:58.439353+0000","last_became_peered":"2024-09-13T18:24:58.439353+0000","last_unstale":"2024-09-13T18:24:59.463490+0000","last_undegraded":"2024-09-13T18:24:59.463490+0000","last_fullsized":"2024-09-13T18:24:59.463490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240163+0000","last_change":"2024-09-13T18:24:58.028233+0000","last_active":"2024-09-13T18:25:00.240163+0000","last_peered":"2024-09-13T18:25:00.240163+0000","last_clean":"2024-09-13T18:25:00.240163+0000","last_became_active":"2024-09-13T18:24:58.027484+0000","last_became_peered":"2024-09-13T18:24:58.027484+0000","last_unstale":"2024-09-13T18:25:00.240163+0000","last_undegraded":"2024-09-13T18:25:00.240163+0000","last_fullsized":"2024-09-13T18:25:00.240163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240107+0000","last_change":"2024-09-13T18:24:58.425519+0000","last_active":"2024-09-13T18:25:00.240107+0000","last_peered":"2024-09-13T18:25:00.240107+0000","last_clean":"2024-09-13T18:25:00.240107+0000","last_became_active":"2024-09-13T18:24:58.421201+0000","last_became_peered":"2024-09-13T18:24:58.421201+0000","last_unstale":"2024-09-13T18:25:00.240107+0000","last_undegraded":"2024-09-13T18:25:00.240107+0000","last_fullsized":"2024-09-13T18:25:00.240107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154679+0000","last_change":"2024-09-13T18:24:58.015803+0000","last_active":"2024-09-13T18:25:00.154679+0000","last_peered":"2024-09-13T18:25:00.154679+0000","last_clean":"2024-09-13T18:25:00.154679+0000","last_became_active":"2024-09-13T18:24:58.015460+0000","last_became_peered":"2024-09-13T18:24:58.015460+0000","last_unstale":"2024-09-13T18:25:00.154679+0000","last_undegraded":"2024-09-13T18:25:00.154679+0000","last_fullsized":"2024-09-13T18:25:00.154679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463015+0000","last_change":"2024-09-13T18:24:58.439925+0000","last_active":"2024-09-13T18:24:59.463015+0000","last_peered":"2024-09-13T18:24:59.463015+0000","last_clean":"2024-09-13T18:24:59.463015+0000","last_became_active":"2024-09-13T18:24:58.439310+0000","last_became_peered":"2024-09-13T18:24:58.439310+0000","last_unstale":"2024-09-13T18:24:59.463015+0000","last_undegraded":"2024-09-13T18:24:59.463015+0000","last_fullsized":"2024-09-13T18:24:59.463015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389428+0000","last_change":"2024-09-13T18:24:58.024579+0000","last_active":"2024-09-13T18:24:59.389428+0000","last_peered":"2024-09-13T18:24:59.389428+0000","last_clean":"2024-09-13T18:24:59.389428+0000","last_became_active":"2024-09-13T18:24:58.023234+0000","last_became_peered":"2024-09-13T18:24:58.023234+0000","last_unstale":"2024-09-13T18:24:59.389428+0000","last_undegraded":"2024-09-13T18:24:59.389428+0000","last_fullsized":"2024-09-13T18:24:59.389428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463655+0000","last_change":"2024-09-13T18:24:58.439656+0000","last_active":"2024-09-13T18:24:59.463655+0000","last_peered":"2024-09-13T18:24:59.463655+0000","last_clean":"2024-09-13T18:24:59.463655+0000","last_became_active":"2024-09-13T18:24:58.439013+0000","last_became_peered":"2024-09-13T18:24:58.439013+0000","last_unstale":"2024-09-13T18:24:59.463655+0000","last_undegraded":"2024-09-13T18:24:59.463655+0000","last_fullsized":"2024-09-13T18:24:59.463655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155004+0000","last_change":"2024-09-13T18:24:58.013601+0000","last_active":"2024-09-13T18:25:00.155004+0000","last_peered":"2024-09-13T18:25:00.155004+0000","last_clean":"2024-09-13T18:25:00.155004+0000","last_became_active":"2024-09-13T18:24:58.012977+0000","last_became_peered":"2024-09-13T18:24:58.012977+0000","last_unstale":"2024-09-13T18:25:00.155004+0000","last_undegraded":"2024-09-13T18:25:00.155004+0000","last_fullsized":"2024-09-13T18:25:00.155004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.464058+0000","last_change":"2024-09-13T18:24:58.440756+0000","last_active":"2024-09-13T18:24:59.464058+0000","last_peered":"2024-09-13T18:24:59.464058+0000","last_clean":"2024-09-13T18:24:59.464058+0000","last_became_active":"2024-09-13T18:24:58.440064+0000","last_became_peered":"2024-09-13T18:24:58.440064+0000","last_unstale":"2024-09-13T18:24:59.464058+0000","last_undegraded":"2024-09-13T18:24:59.464058+0000","last_fullsized":"2024-09-13T18:24:59.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388284+0000","last_change":"2024-09-13T18:24:58.021101+0000","last_active":"2024-09-13T18:24:59.388284+0000","last_peered":"2024-09-13T18:24:59.388284+0000","last_clean":"2024-09-13T18:24:59.388284+0000","last_became_active":"2024-09-13T18:24:58.020782+0000","last_became_peered":"2024-09-13T18:24:58.020782+0000","last_unstale":"2024-09-13T18:24:59.388284+0000","last_undegraded":"2024-09-13T18:24:59.388284+0000","last_fullsized":"2024-09-13T18:24:59.388284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239751+0000","last_change":"2024-09-13T18:24:58.417213+0000","last_active":"2024-09-13T18:25:00.239751+0000","last_peered":"2024-09-13T18:25:00.239751+0000","last_clean":"2024-09-13T18:25:00.239751+0000","last_became_active":"2024-09-13T18:24:58.415708+0000","last_became_peered":"2024-09-13T18:24:58.415708+0000","last_unstale":"2024-09-13T18:25:00.239751+0000","last_undegraded":"2024-09-13T18:25:00.239751+0000","last_fullsized":"2024-09-13T18:25:00.239751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155281+0000","last_change":"2024-09-13T18:24:58.017225+0000","last_active":"2024-09-13T18:25:00.155281+0000","last_peered":"2024-09-13T18:25:00.155281+0000","last_clean":"2024-09-13T18:25:00.155281+0000","last_became_active":"2024-09-13T18:24:58.016815+0000","last_became_peered":"2024-09-13T18:24:58.016815+0000","last_unstale":"2024-09-13T18:25:00.155281+0000","last_undegraded":"2024-09-13T18:25:00.155281+0000","last_fullsized":"2024-09-13T18:25:00.155281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463041+0000","last_change":"2024-09-13T18:24:58.425095+0000","last_active":"2024-09-13T18:24:59.463041+0000","last_peered":"2024-09-13T18:24:59.463041+0000","last_clean":"2024-09-13T18:24:59.463041+0000","last_became_active":"2024-09-13T18:24:58.424483+0000","last_became_peered":"2024-09-13T18:24:58.424483+0000","last_unstale":"2024-09-13T18:24:59.463041+0000","last_undegraded":"2024-09-13T18:24:59.463041+0000","last_fullsized":"2024-09-13T18:24:59.463041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396354+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:24:58.396354+0000","last_peered":"2024-09-13T18:24:58.396354+0000","last_clean":"2024-09-13T18:24:58.396354+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:24:58.396354+0000","last_undegraded":"2024-09-13T18:24:58.396354+0000","last_fullsized":"2024-09-13T18:24:58.396354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239666+0000","last_change":"2024-09-13T18:24:58.029698+0000","last_active":"2024-09-13T18:25:00.239666+0000","last_peered":"2024-09-13T18:25:00.239666+0000","last_clean":"2024-09-13T18:25:00.239666+0000","last_became_active":"2024-09-13T18:24:58.028952+0000","last_became_peered":"2024-09-13T18:24:58.028952+0000","last_unstale":"2024-09-13T18:25:00.239666+0000","last_undegraded":"2024-09-13T18:25:00.239666+0000","last_fullsized":"2024-09-13T18:25:00.239666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670059+0000","last_change":"2024-09-13T18:24:58.421648+0000","last_active":"2024-09-13T18:24:59.670059+0000","last_peered":"2024-09-13T18:24:59.670059+0000","last_clean":"2024-09-13T18:24:59.670059+0000","last_became_active":"2024-09-13T18:24:58.421356+0000","last_became_peered":"2024-09-13T18:24:58.421356+0000","last_unstale":"2024-09-13T18:24:59.670059+0000","last_undegraded":"2024-09-13T18:24:59.670059+0000","last_fullsized":"2024-09-13T18:24:59.670059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462728+0000","last_change":"2024-09-13T18:24:58.034925+0000","last_active":"2024-09-13T18:24:59.462728+0000","last_peered":"2024-09-13T18:24:59.462728+0000","last_clean":"2024-09-13T18:24:59.462728+0000","last_became_active":"2024-09-13T18:24:58.033842+0000","last_became_peered":"2024-09-13T18:24:58.033842+0000","last_unstale":"2024-09-13T18:24:59.462728+0000","last_undegraded":"2024-09-13T18:24:59.462728+0000","last_fullsized":"2024-09-13T18:24:59.462728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239960+0000","last_change":"2024-09-13T18:24:58.394853+0000","last_active":"2024-09-13T18:25:00.239960+0000","last_peered":"2024-09-13T18:25:00.239960+0000","last_clean":"2024-09-13T18:25:00.239960+0000","last_became_active":"2024-09-13T18:24:58.394595+0000","last_became_peered":"2024-09-13T18:24:58.394595+0000","last_unstale":"2024-09-13T18:25:00.239960+0000","last_undegraded":"2024-09-13T18:25:00.239960+0000","last_fullsized":"2024-09-13T18:25:00.239960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154842+0000","last_change":"2024-09-13T18:24:58.012966+0000","last_active":"2024-09-13T18:25:00.154842+0000","last_peered":"2024-09-13T18:25:00.154842+0000","last_clean":"2024-09-13T18:25:00.154842+0000","last_became_active":"2024-09-13T18:24:58.012406+0000","last_became_peered":"2024-09-13T18:24:58.012406+0000","last_unstale":"2024-09-13T18:25:00.154842+0000","last_undegraded":"2024-09-13T18:25:00.154842+0000","last_fullsized":"2024-09-13T18:25:00.154842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387622+0000","last_change":"2024-09-13T18:24:58.395770+0000","last_active":"2024-09-13T18:24:59.387622+0000","last_peered":"2024-09-13T18:24:59.387622+0000","last_clean":"2024-09-13T18:24:59.387622+0000","last_became_active":"2024-09-13T18:24:58.395459+0000","last_became_peered":"2024-09-13T18:24:58.395459+0000","last_unstale":"2024-09-13T18:24:59.387622+0000","last_undegraded":"2024-09-13T18:24:59.387622+0000","last_fullsized":"2024-09-13T18:24:59.387622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239627+0000","last_change":"2024-09-13T18:24:58.033195+0000","last_active":"2024-09-13T18:25:00.239627+0000","last_peered":"2024-09-13T18:25:00.239627+0000","last_clean":"2024-09-13T18:25:00.239627+0000","last_became_active":"2024-09-13T18:24:58.032049+0000","last_became_peered":"2024-09-13T18:24:58.032049+0000","last_unstale":"2024-09-13T18:25:00.239627+0000","last_undegraded":"2024-09-13T18:25:00.239627+0000","last_fullsized":"2024-09-13T18:25:00.239627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389525+0000","last_change":"2024-09-13T18:24:58.392965+0000","last_active":"2024-09-13T18:24:59.389525+0000","last_peered":"2024-09-13T18:24:59.389525+0000","last_clean":"2024-09-13T18:24:59.389525+0000","last_became_active":"2024-09-13T18:24:58.392228+0000","last_became_peered":"2024-09-13T18:24:58.392228+0000","last_unstale":"2024-09-13T18:24:59.389525+0000","last_undegraded":"2024-09-13T18:24:59.389525+0000","last_fullsized":"2024-09-13T18:24:59.389525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387904+0000","last_change":"2024-09-13T18:24:58.014413+0000","last_active":"2024-09-13T18:24:59.387904+0000","last_peered":"2024-09-13T18:24:59.387904+0000","last_clean":"2024-09-13T18:24:59.387904+0000","last_became_active":"2024-09-13T18:24:58.013907+0000","last_became_peered":"2024-09-13T18:24:58.013907+0000","last_unstale":"2024-09-13T18:24:59.387904+0000","last_undegraded":"2024-09-13T18:24:59.387904+0000","last_fullsized":"2024-09-13T18:24:59.387904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239800+0000","last_change":"2024-09-13T18:24:58.416160+0000","last_active":"2024-09-13T18:25:00.239800+0000","last_peered":"2024-09-13T18:25:00.239800+0000","last_clean":"2024-09-13T18:25:00.239800+0000","last_became_active":"2024-09-13T18:24:58.415331+0000","last_became_peered":"2024-09-13T18:24:58.415331+0000","last_unstale":"2024-09-13T18:25:00.239800+0000","last_undegraded":"2024-09-13T18:25:00.239800+0000","last_fullsized":"2024-09-13T18:25:00.239800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463346+0000","last_change":"2024-09-13T18:24:58.038596+0000","last_active":"2024-09-13T18:24:59.463346+0000","last_peered":"2024-09-13T18:24:59.463346+0000","last_clean":"2024-09-13T18:24:59.463346+0000","last_became_active":"2024-09-13T18:24:58.037754+0000","last_became_peered":"2024-09-13T18:24:58.037754+0000","last_unstale":"2024-09-13T18:24:59.463346+0000","last_undegraded":"2024-09-13T18:24:59.463346+0000","last_fullsized":"2024-09-13T18:24:59.463346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387779+0000","last_change":"2024-09-13T18:24:58.395308+0000","last_active":"2024-09-13T18:24:59.387779+0000","last_peered":"2024-09-13T18:24:59.387779+0000","last_clean":"2024-09-13T18:24:59.387779+0000","last_became_active":"2024-09-13T18:24:58.394989+0000","last_became_peered":"2024-09-13T18:24:58.394989+0000","last_unstale":"2024-09-13T18:24:59.387779+0000","last_undegraded":"2024-09-13T18:24:59.387779+0000","last_fullsized":"2024-09-13T18:24:59.387779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.246647+0000","last_change":"2024-09-13T18:24:58.043141+0000","last_active":"2024-09-13T18:25:00.246647+0000","last_peered":"2024-09-13T18:25:00.246647+0000","last_clean":"2024-09-13T18:25:00.246647+0000","last_became_active":"2024-09-13T18:24:58.042796+0000","last_became_peered":"2024-09-13T18:24:58.042796+0000","last_unstale":"2024-09-13T18:25:00.246647+0000","last_undegraded":"2024-09-13T18:25:00.246647+0000","last_fullsized":"2024-09-13T18:25:00.246647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670417+0000","last_change":"2024-09-13T18:24:58.415075+0000","last_active":"2024-09-13T18:24:59.670417+0000","last_peered":"2024-09-13T18:24:59.670417+0000","last_clean":"2024-09-13T18:24:59.670417+0000","last_became_active":"2024-09-13T18:24:58.414794+0000","last_became_peered":"2024-09-13T18:24:58.414794+0000","last_unstale":"2024-09-13T18:24:59.670417+0000","last_undegraded":"2024-09-13T18:24:59.670417+0000","last_fullsized":"2024-09-13T18:24:59.670417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:02.097074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240393+0000","last_change":"2024-09-13T18:24:58.040550+0000","last_active":"2024-09-13T18:25:00.240393+0000","last_peered":"2024-09-13T18:25:00.240393+0000","last_clean":"2024-09-13T18:25:00.240393+0000","last_became_active":"2024-09-13T18:24:58.039933+0000","last_became_peered":"2024-09-13T18:24:58.039933+0000","last_unstale":"2024-09-13T18:25:00.240393+0000","last_undegraded":"2024-09-13T18:25:00.240393+0000","last_fullsized":"2024-09-13T18:25:00.240393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240124+0000","last_change":"2024-09-13T18:24:58.397002+0000","last_active":"2024-09-13T18:25:00.240124+0000","last_peered":"2024-09-13T18:25:00.240124+0000","last_clean":"2024-09-13T18:25:00.240124+0000","last_became_active":"2024-09-13T18:24:58.396735+0000","last_became_peered":"2024-09-13T18:24:58.396735+0000","last_unstale":"2024-09-13T18:25:00.240124+0000","last_undegraded":"2024-09-13T18:25:00.240124+0000","last_fullsized":"2024-09-13T18:25:00.240124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462686+0000","last_change":"2024-09-13T18:24:58.033754+0000","last_active":"2024-09-13T18:24:59.462686+0000","last_peered":"2024-09-13T18:24:59.462686+0000","last_clean":"2024-09-13T18:24:59.462686+0000","last_became_active":"2024-09-13T18:24:58.031165+0000","last_became_peered":"2024-09-13T18:24:58.031165+0000","last_unstale":"2024-09-13T18:24:59.462686+0000","last_undegraded":"2024-09-13T18:24:59.462686+0000","last_fullsized":"2024-09-13T18:24:59.462686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389086+0000","last_change":"2024-09-13T18:24:58.394401+0000","last_active":"2024-09-13T18:24:59.389086+0000","last_peered":"2024-09-13T18:24:59.389086+0000","last_clean":"2024-09-13T18:24:59.389086+0000","last_became_active":"2024-09-13T18:24:58.392351+0000","last_became_peered":"2024-09-13T18:24:58.392351+0000","last_unstale":"2024-09-13T18:24:59.389086+0000","last_undegraded":"2024-09-13T18:24:59.389086+0000","last_fullsized":"2024-09-13T18:24:59.389086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387555+0000","last_change":"2024-09-13T18:24:58.034526+0000","last_active":"2024-09-13T18:24:59.387555+0000","last_peered":"2024-09-13T18:24:59.387555+0000","last_clean":"2024-09-13T18:24:59.387555+0000","last_became_active":"2024-09-13T18:24:58.034217+0000","last_became_peered":"2024-09-13T18:24:58.034217+0000","last_unstale":"2024-09-13T18:24:59.387555+0000","last_undegraded":"2024-09-13T18:24:59.387555+0000","last_fullsized":"2024-09-13T18:24:59.387555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669724+0000","last_change":"2024-09-13T18:24:58.398957+0000","last_active":"2024-09-13T18:24:59.669724+0000","last_peered":"2024-09-13T18:24:59.669724+0000","last_clean":"2024-09-13T18:24:59.669724+0000","last_became_active":"2024-09-13T18:24:58.398692+0000","last_became_peered":"2024-09-13T18:24:58.398692+0000","last_unstale":"2024-09-13T18:24:59.669724+0000","last_undegraded":"2024-09-13T18:24:59.669724+0000","last_fullsized":"2024-09-13T18:24:59.669724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388073+0000","last_change":"2024-09-13T18:24:58.013615+0000","last_active":"2024-09-13T18:24:59.388073+0000","last_peered":"2024-09-13T18:24:59.388073+0000","last_clean":"2024-09-13T18:24:59.388073+0000","last_became_active":"2024-09-13T18:24:58.013286+0000","last_became_peered":"2024-09-13T18:24:58.013286+0000","last_unstale":"2024-09-13T18:24:59.388073+0000","last_undegraded":"2024-09-13T18:24:59.388073+0000","last_fullsized":"2024-09-13T18:24:59.388073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670318+0000","last_change":"2024-09-13T18:24:58.400483+0000","last_active":"2024-09-13T18:24:59.670318+0000","last_peered":"2024-09-13T18:24:59.670318+0000","last_clean":"2024-09-13T18:24:59.670318+0000","last_became_active":"2024-09-13T18:24:58.400227+0000","last_became_peered":"2024-09-13T18:24:58.400227+0000","last_unstale":"2024-09-13T18:24:59.670318+0000","last_undegraded":"2024-09-13T18:24:59.670318+0000","last_fullsized":"2024-09-13T18:24:59.670318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463603+0000","last_change":"2024-09-13T18:24:58.041646+0000","last_active":"2024-09-13T18:24:59.463603+0000","last_peered":"2024-09-13T18:24:59.463603+0000","last_clean":"2024-09-13T18:24:59.463603+0000","last_became_active":"2024-09-13T18:24:58.040973+0000","last_became_peered":"2024-09-13T18:24:58.040973+0000","last_unstale":"2024-09-13T18:24:59.463603+0000","last_undegraded":"2024-09-13T18:24:59.463603+0000","last_fullsized":"2024-09-13T18:24:59.463603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240186+0000","last_change":"2024-09-13T18:24:58.432390+0000","last_active":"2024-09-13T18:25:00.240186+0000","last_peered":"2024-09-13T18:25:00.240186+0000","last_clean":"2024-09-13T18:25:00.240186+0000","last_became_active":"2024-09-13T18:24:58.431733+0000","last_became_peered":"2024-09-13T18:24:58.431733+0000","last_unstale":"2024-09-13T18:25:00.240186+0000","last_undegraded":"2024-09-13T18:25:00.240186+0000","last_fullsized":"2024-09-13T18:25:00.240186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239780+0000","last_change":"2024-09-13T18:24:58.437372+0000","last_active":"2024-09-13T18:25:00.239780+0000","last_peered":"2024-09-13T18:25:00.239780+0000","last_clean":"2024-09-13T18:25:00.239780+0000","last_became_active":"2024-09-13T18:24:58.436708+0000","last_became_peered":"2024-09-13T18:24:58.436708+0000","last_unstale":"2024-09-13T18:25:00.239780+0000","last_undegraded":"2024-09-13T18:25:00.239780+0000","last_fullsized":"2024-09-13T18:25:00.239780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463101+0000","last_change":"2024-09-13T18:24:58.037424+0000","last_active":"2024-09-13T18:24:59.463101+0000","last_peered":"2024-09-13T18:24:59.463101+0000","last_clean":"2024-09-13T18:24:59.463101+0000","last_became_active":"2024-09-13T18:24:58.036405+0000","last_became_peered":"2024-09-13T18:24:58.036405+0000","last_unstale":"2024-09-13T18:24:59.463101+0000","last_undegraded":"2024-09-13T18:24:59.463101+0000","last_fullsized":"2024-09-13T18:24:59.463101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239730+0000","last_change":"2024-09-13T18:24:58.435968+0000","last_active":"2024-09-13T18:25:00.239730+0000","last_peered":"2024-09-13T18:25:00.239730+0000","last_clean":"2024-09-13T18:25:00.239730+0000","last_became_active":"2024-09-13T18:24:58.435619+0000","last_became_peered":"2024-09-13T18:24:58.435619+0000","last_unstale":"2024-09-13T18:25:00.239730+0000","last_undegraded":"2024-09-13T18:25:00.239730+0000","last_fullsized":"2024-09-13T18:25:00.239730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463214+0000","last_change":"2024-09-13T18:24:58.044836+0000","last_active":"2024-09-13T18:24:59.463214+0000","last_peered":"2024-09-13T18:24:59.463214+0000","last_clean":"2024-09-13T18:24:59.463214+0000","last_became_active":"2024-09-13T18:24:58.044091+0000","last_became_peered":"2024-09-13T18:24:58.044091+0000","last_unstale":"2024-09-13T18:24:59.463214+0000","last_undegraded":"2024-09-13T18:24:59.463214+0000","last_fullsized":"2024-09-13T18:24:59.463214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240141+0000","last_change":"2024-09-13T18:24:58.418359+0000","last_active":"2024-09-13T18:25:00.240141+0000","last_peered":"2024-09-13T18:25:00.240141+0000","last_clean":"2024-09-13T18:25:00.240141+0000","last_became_active":"2024-09-13T18:24:58.418071+0000","last_became_peered":"2024-09-13T18:24:58.418071+0000","last_unstale":"2024-09-13T18:25:00.240141+0000","last_undegraded":"2024-09-13T18:25:00.240141+0000","last_fullsized":"2024-09-13T18:25:00.240141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670596+0000","last_change":"2024-09-13T18:24:58.016894+0000","last_active":"2024-09-13T18:24:59.670596+0000","last_peered":"2024-09-13T18:24:59.670596+0000","last_clean":"2024-09-13T18:24:59.670596+0000","last_became_active":"2024-09-13T18:24:58.016172+0000","last_became_peered":"2024-09-13T18:24:58.016172+0000","last_unstale":"2024-09-13T18:24:59.670596+0000","last_undegraded":"2024-09-13T18:24:59.670596+0000","last_fullsized":"2024-09-13T18:24:59.670596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.426766+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.426470+0000","last_became_peered":"2024-09-13T18:24:58.426470+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240175+0000","last_change":"2024-09-13T18:24:58.025191+0000","last_active":"2024-09-13T18:25:00.240175+0000","last_peered":"2024-09-13T18:25:00.240175+0000","last_clean":"2024-09-13T18:25:00.240175+0000","last_became_active":"2024-09-13T18:24:58.024847+0000","last_became_peered":"2024-09-13T18:24:58.024847+0000","last_unstale":"2024-09-13T18:25:00.240175+0000","last_undegraded":"2024-09-13T18:25:00.240175+0000","last_fullsized":"2024-09-13T18:25:00.240175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:05.912577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:25:06.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:25:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbea97a640 1 Processor -- start 2024-09-13T18:25:06.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbea97a640 1 -- start start 2024-09-13T18:25:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbea97a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdbe40713a0 0x7fdbe4165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbea97a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe406d480 con 0x7fdbe415b7c0 2024-09-13T18:25:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbea97a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe415ace0 con 0x7fdbe41582a0 2024-09-13T18:25:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbea97a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe415aaf0 con 0x7fdbe40713a0 2024-09-13T18:25:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbe37fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdbe415b7c0 0x7fdbe4070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46528/0 (socket says 172.21.15.53:46528) 2024-09-13T18:25:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbe37fe640 1 -- 172.21.15.53:0/1039941410 learned_addr learned my addr 172.21.15.53:0/1039941410 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:06.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbe8f17640 1 --2- 172.21.15.53:0/1039941410 >> v2:172.21.15.87:3300/0 conn(0x7fdbe40713a0 0x7fdbe4165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217618651 0 0) 0x7fdbe406d480 con 0x7fdbe415b7c0 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbcc003530 con 0x7fdbe415b7c0 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.894+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621957616 0 0) 0x7fdbcc003530 con 0x7fdbe415b7c0 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 >> v2:172.21.15.87:3300/0 conn(0x7fdbe40713a0 msgr2=0x7fdbe4165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 --2- 172.21.15.53:0/1039941410 >> v2:172.21.15.87:3300/0 conn(0x7fdbe40713a0 0x7fdbe4165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 >> v1:172.21.15.87:6789/0 conn(0x7fdbe41582a0 legacy=0x7fdbe406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe415afc0 con 0x7fdbe415b7c0 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdbd8001680 con 0x7fdbe415b7c0 2024-09-13T18:25:06.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 >> v1:172.21.15.53:6789/0 conn(0x7fdbe415b7c0 legacy=0x7fdbe4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbcc003980 0x7fdbcc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbcc0047d0 0x7fdbcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc005190 0x7fdbcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc00c000 con 0x7fdbcc003980 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc00c170 con 0x7fdbcc0047d0 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc00c330 con 0x7fdbcc005190 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbcc003980 0x7fdbcc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbcc0047d0 0x7fdbcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe3fff640 1 -- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc005190 msgr2=0x7fdbcc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc005190 0x7fdbcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe3fff640 1 -- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbcc0047d0 msgr2=0x7fdbcc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbcc0047d0 0x7fdbcc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe3fff640 1 -- 172.21.15.53:0/1039941410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc003530 con 0x7fdbcc003980 2024-09-13T18:25:06.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe8f17640 1 -- 172.21.15.53:0/1039941410 reap_dead start 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbcc0047d0 0x7fdbcc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbcc003980 0x7fdbcc003da0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001780 tx=0x7fdbd401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb33395bd33c210 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40052d0 con 0x7fdbcc003980 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd40a7050 con 0x7fdbcc003980 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbe2ffd640 1 -- 172.21.15.53:0/1039941410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4003600 con 0x7fdbcc003980 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbea97a640 1 -- 172.21.15.53:0/1039941410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbcc003980 msgr2=0x7fdbcc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbcc003980 0x7fdbcc003da0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001780 tx=0x7fdbd401c400 comp rx=0 tx=0).stop 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbea97a640 1 -- 172.21.15.53:0/1039941410 shutdown_connections 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1039941410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbcc003980 0x7fdbcc003da0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbea97a640 1 -- 172.21.15.53:0/1039941410 >> 172.21.15.53:0/1039941410 conn(0x7fdbe4065c80 msgr2=0x7fdbe4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbea97a640 1 -- 172.21.15.53:0/1039941410 shutdown_connections 2024-09-13T18:25:06.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.898+0000 7fdbea97a640 1 -- 172.21.15.53:0/1039941410 wait complete. 2024-09-13T18:25:06.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 Processor -- start 2024-09-13T18:25:06.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 -- start start 2024-09-13T18:25:06.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc003980 0x7fdbe40ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4153830 0x7fdbe4153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe41543b0 0x7fdbe413e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4154830 con 0x7fdbe4153830 2024-09-13T18:25:06.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40af380 con 0x7fdbe41543b0 2024-09-13T18:25:06.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40af0a0 con 0x7fdbcc003980 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4153830 0x7fdbe4153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4153830 0x7fdbe4153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57496/0 (socket says 172.21.15.53:57496) 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 -- 172.21.15.53:0/1884996507 learned_addr learned my addr 172.21.15.53:0/1884996507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe8f17640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe41543b0 0x7fdbe413e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc003980 0x7fdbe40ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 -- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc003980 msgr2=0x7fdbe40ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc003980 0x7fdbe40ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 -- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe41543b0 msgr2=0x7fdbe413e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe41543b0 0x7fdbe413e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 -- 172.21.15.53:0/1884996507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe413c130 con 0x7fdbe4153830 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe37fe640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4153830 0x7fdbe4153e70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800d7a0 tx=0x7fdbd800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe0ff9640 1 -- 172.21.15.53:0/1884996507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80074e0 con 0x7fdbe4153830 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe0ff9640 1 -- 172.21.15.53:0/1884996507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8007640 con 0x7fdbe4153830 2024-09-13T18:25:06.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe413c410 con 0x7fdbe4153830 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbe0ff9640 1 -- 172.21.15.53:0/1884996507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8004a30 con 0x7fdbe4153830 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe413bb90 con 0x7fdbe4153830 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.902+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe4067400 con 0x7fdbe4153830 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.906+0000 7fdbe0ff9640 1 -- 172.21.15.53:0/1884996507 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdbd800b6b0 con 0x7fdbe4153830 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.906+0000 7fdbe0ff9640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbd0066690 0x7fdbd0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.906+0000 7fdbe0ff9640 1 -- 172.21.15.53:0/1884996507 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbd8084090 con 0x7fdbe4153830 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.906+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbd0066690 0x7fdbd0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.906+0000 7fdbe3fff640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbd0066690 0x7fdbd0068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001750 tx=0x7fdbd40011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:06.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:06.906+0000 7fdbe0ff9640 1 -- 172.21.15.53:0/1884996507 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdbd8051570 con 0x7fdbe4153830 2024-09-13T18:25:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.054+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbe413c8c0 con 0x7fdbd0066690 2024-09-13T18:25:07.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.074+0000 7fdbe0ff9640 1 -- 172.21.15.53:0/1884996507 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264540 (secure 0 0 0) 0x7fdbd4005310 con 0x7fdbd0066690 2024-09-13T18:25:07.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:07.082 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:25:07.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbd0066690 msgr2=0x7fdbd0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbd0066690 0x7fdbd0068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001750 tx=0x7fdbd40011a0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4153830 msgr2=0x7fdbe4153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4153830 0x7fdbe4153e70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800d7a0 tx=0x7fdbd800dc60 comp rx=0 tx=0).stop 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 shutdown_connections 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbd0066690 0x7fdbd0068b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe41543b0 0x7fdbe413e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe4153830 0x7fdbe4153e70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 --2- 172.21.15.53:0/1884996507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbcc003980 0x7fdbe40ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 >> 172.21.15.53:0/1884996507 conn(0x7fdbe4065c80 msgr2=0x7fdbe415d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 shutdown_connections 2024-09-13T18:25:07.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.078+0000 7fdbea97a640 1 -- 172.21.15.53:0/1884996507 wait complete. 2024-09-13T18:25:07.098 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-13T18:25:06.902986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235408,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739312,"statfs":{"total":773094113280,"available":772853055488,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.521185"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.434555+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.432500+0000","last_became_peered":"2024-09-13T18:24:58.432500+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388010+0000","last_change":"2024-09-13T18:24:58.396126+0000","last_active":"2024-09-13T18:24:59.388010+0000","last_peered":"2024-09-13T18:24:59.388010+0000","last_clean":"2024-09-13T18:24:59.388010+0000","last_became_active":"2024-09-13T18:24:58.395863+0000","last_became_peered":"2024-09-13T18:24:58.395863+0000","last_unstale":"2024-09-13T18:24:59.388010+0000","last_undegraded":"2024-09-13T18:24:59.388010+0000","last_fullsized":"2024-09-13T18:24:59.388010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240106+0000","last_change":"2024-09-13T18:24:58.393804+0000","last_active":"2024-09-13T18:25:00.240106+0000","last_peered":"2024-09-13T18:25:00.240106+0000","last_clean":"2024-09-13T18:25:00.240106+0000","last_became_active":"2024-09-13T18:24:58.393534+0000","last_became_peered":"2024-09-13T18:24:58.393534+0000","last_unstale":"2024-09-13T18:25:00.240106+0000","last_undegraded":"2024-09-13T18:25:00.240106+0000","last_fullsized":"2024-09-13T18:25:00.240106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239709+0000","last_change":"2024-09-13T18:24:58.416846+0000","last_active":"2024-09-13T18:25:00.239709+0000","last_peered":"2024-09-13T18:25:00.239709+0000","last_clean":"2024-09-13T18:25:00.239709+0000","last_became_active":"2024-09-13T18:24:58.415742+0000","last_became_peered":"2024-09-13T18:24:58.415742+0000","last_unstale":"2024-09-13T18:25:00.239709+0000","last_undegraded":"2024-09-13T18:25:00.239709+0000","last_fullsized":"2024-09-13T18:25:00.239709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463377+0000","last_change":"2024-09-13T18:24:58.413407+0000","last_active":"2024-09-13T18:24:59.463377+0000","last_peered":"2024-09-13T18:24:59.463377+0000","last_clean":"2024-09-13T18:24:59.463377+0000","last_became_active":"2024-09-13T18:24:58.412683+0000","last_became_peered":"2024-09-13T18:24:58.412683+0000","last_unstale":"2024-09-13T18:24:59.463377+0000","last_undegraded":"2024-09-13T18:24:59.463377+0000","last_fullsized":"2024-09-13T18:24:59.463377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239438+0000","last_change":"2024-09-13T18:24:58.419676+0000","last_active":"2024-09-13T18:25:00.239438+0000","last_peered":"2024-09-13T18:25:00.239438+0000","last_clean":"2024-09-13T18:25:00.239438+0000","last_became_active":"2024-09-13T18:24:58.418305+0000","last_became_peered":"2024-09-13T18:24:58.418305+0000","last_unstale":"2024-09-13T18:25:00.239438+0000","last_undegraded":"2024-09-13T18:25:00.239438+0000","last_fullsized":"2024-09-13T18:25:00.239438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.878378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462710+0000","last_change":"2024-09-13T18:24:58.409783+0000","last_active":"2024-09-13T18:24:59.462710+0000","last_peered":"2024-09-13T18:24:59.462710+0000","last_clean":"2024-09-13T18:24:59.462710+0000","last_became_active":"2024-09-13T18:24:58.409053+0000","last_became_peered":"2024-09-13T18:24:58.409053+0000","last_unstale":"2024-09-13T18:24:59.462710+0000","last_undegraded":"2024-09-13T18:24:59.462710+0000","last_fullsized":"2024-09-13T18:24:59.462710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:30.448126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669414+0000","last_change":"2024-09-13T18:24:58.420831+0000","last_active":"2024-09-13T18:24:59.669414+0000","last_peered":"2024-09-13T18:24:59.669414+0000","last_clean":"2024-09-13T18:24:59.669414+0000","last_became_active":"2024-09-13T18:24:58.420490+0000","last_became_peered":"2024-09-13T18:24:58.420490+0000","last_unstale":"2024-09-13T18:24:59.669414+0000","last_undegraded":"2024-09-13T18:24:59.669414+0000","last_fullsized":"2024-09-13T18:24:59.669414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463928+0000","last_change":"2024-09-13T18:24:58.429947+0000","last_active":"2024-09-13T18:24:59.463928+0000","last_peered":"2024-09-13T18:24:59.463928+0000","last_clean":"2024-09-13T18:24:59.463928+0000","last_became_active":"2024-09-13T18:24:58.429214+0000","last_became_peered":"2024-09-13T18:24:58.429214+0000","last_unstale":"2024-09-13T18:24:59.463928+0000","last_undegraded":"2024-09-13T18:24:59.463928+0000","last_fullsized":"2024-09-13T18:24:59.463928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240311+0000","last_change":"2024-09-13T18:24:58.426881+0000","last_active":"2024-09-13T18:25:00.240311+0000","last_peered":"2024-09-13T18:25:00.240311+0000","last_clean":"2024-09-13T18:25:00.240311+0000","last_became_active":"2024-09-13T18:24:58.425419+0000","last_became_peered":"2024-09-13T18:24:58.425419+0000","last_unstale":"2024-09-13T18:25:00.240311+0000","last_undegraded":"2024-09-13T18:25:00.240311+0000","last_fullsized":"2024-09-13T18:25:00.240311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240288+0000","last_change":"2024-09-13T18:24:58.430550+0000","last_active":"2024-09-13T18:25:00.240288+0000","last_peered":"2024-09-13T18:25:00.240288+0000","last_clean":"2024-09-13T18:25:00.240288+0000","last_became_active":"2024-09-13T18:24:58.425963+0000","last_became_peered":"2024-09-13T18:24:58.425963+0000","last_unstale":"2024-09-13T18:25:00.240288+0000","last_undegraded":"2024-09-13T18:25:00.240288+0000","last_fullsized":"2024-09-13T18:25:00.240288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389497+0000","last_change":"2024-09-13T18:24:58.431749+0000","last_active":"2024-09-13T18:24:59.389497+0000","last_peered":"2024-09-13T18:24:59.389497+0000","last_clean":"2024-09-13T18:24:59.389497+0000","last_became_active":"2024-09-13T18:24:58.431519+0000","last_became_peered":"2024-09-13T18:24:58.431519+0000","last_unstale":"2024-09-13T18:24:59.389497+0000","last_undegraded":"2024-09-13T18:24:59.389497+0000","last_fullsized":"2024-09-13T18:24:59.389497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670053+0000","last_change":"2024-09-13T18:24:58.423558+0000","last_active":"2024-09-13T18:24:59.670053+0000","last_peered":"2024-09-13T18:24:59.670053+0000","last_clean":"2024-09-13T18:24:59.670053+0000","last_became_active":"2024-09-13T18:24:58.423300+0000","last_became_peered":"2024-09-13T18:24:58.423300+0000","last_unstale":"2024-09-13T18:24:59.670053+0000","last_undegraded":"2024-09-13T18:24:59.670053+0000","last_fullsized":"2024-09-13T18:24:59.670053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239986+0000","last_change":"2024-09-13T18:24:58.396798+0000","last_active":"2024-09-13T18:25:00.239986+0000","last_peered":"2024-09-13T18:25:00.239986+0000","last_clean":"2024-09-13T18:25:00.239986+0000","last_became_active":"2024-09-13T18:24:58.396451+0000","last_became_peered":"2024-09-13T18:24:58.396451+0000","last_unstale":"2024-09-13T18:25:00.239986+0000","last_undegraded":"2024-09-13T18:25:00.239986+0000","last_fullsized":"2024-09-13T18:25:00.239986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387596+0000","last_change":"2024-09-13T18:24:58.394756+0000","last_active":"2024-09-13T18:24:59.387596+0000","last_peered":"2024-09-13T18:24:59.387596+0000","last_clean":"2024-09-13T18:24:59.387596+0000","last_became_active":"2024-09-13T18:24:58.394413+0000","last_became_peered":"2024-09-13T18:24:58.394413+0000","last_unstale":"2024-09-13T18:24:59.387596+0000","last_undegraded":"2024-09-13T18:24:59.387596+0000","last_fullsized":"2024-09-13T18:24:59.387596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239309+0000","last_change":"2024-09-13T18:24:58.417787+0000","last_active":"2024-09-13T18:25:00.239309+0000","last_peered":"2024-09-13T18:25:00.239309+0000","last_clean":"2024-09-13T18:25:00.239309+0000","last_became_active":"2024-09-13T18:24:58.416849+0000","last_became_peered":"2024-09-13T18:24:58.416849+0000","last_unstale":"2024-09-13T18:25:00.239309+0000","last_undegraded":"2024-09-13T18:25:00.239309+0000","last_fullsized":"2024-09-13T18:25:00.239309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:12.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239863+0000","last_change":"2024-09-13T18:24:58.433843+0000","last_active":"2024-09-13T18:25:00.239863+0000","last_peered":"2024-09-13T18:25:00.239863+0000","last_clean":"2024-09-13T18:25:00.239863+0000","last_became_active":"2024-09-13T18:24:58.433147+0000","last_became_peered":"2024-09-13T18:24:58.433147+0000","last_unstale":"2024-09-13T18:25:00.239863+0000","last_undegraded":"2024-09-13T18:25:00.239863+0000","last_fullsized":"2024-09-13T18:25:00.239863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:07.824416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155018+0000","last_change":"2024-09-13T18:24:58.424087+0000","last_active":"2024-09-13T18:25:00.155018+0000","last_peered":"2024-09-13T18:25:00.155018+0000","last_clean":"2024-09-13T18:25:00.155018+0000","last_became_active":"2024-09-13T18:24:58.423760+0000","last_became_peered":"2024-09-13T18:24:58.423760+0000","last_unstale":"2024-09-13T18:25:00.155018+0000","last_undegraded":"2024-09-13T18:25:00.155018+0000","last_fullsized":"2024-09-13T18:25:00.155018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:28.685985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463428+0000","last_change":"2024-09-13T18:24:58.426709+0000","last_active":"2024-09-13T18:24:59.463428+0000","last_peered":"2024-09-13T18:24:59.463428+0000","last_clean":"2024-09-13T18:24:59.463428+0000","last_became_active":"2024-09-13T18:24:58.426073+0000","last_became_peered":"2024-09-13T18:24:58.426073+0000","last_unstale":"2024-09-13T18:24:59.463428+0000","last_undegraded":"2024-09-13T18:24:59.463428+0000","last_fullsized":"2024-09-13T18:24:59.463428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240239+0000","last_change":"2024-09-13T18:24:58.436173+0000","last_active":"2024-09-13T18:25:00.240239+0000","last_peered":"2024-09-13T18:25:00.240239+0000","last_clean":"2024-09-13T18:25:00.240239+0000","last_became_active":"2024-09-13T18:24:58.435428+0000","last_became_peered":"2024-09-13T18:24:58.435428+0000","last_unstale":"2024-09-13T18:25:00.240239+0000","last_undegraded":"2024-09-13T18:25:00.240239+0000","last_fullsized":"2024-09-13T18:25:00.240239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240023+0000","last_change":"2024-09-13T18:24:58.414497+0000","last_active":"2024-09-13T18:25:00.240023+0000","last_peered":"2024-09-13T18:25:00.240023+0000","last_clean":"2024-09-13T18:25:00.240023+0000","last_became_active":"2024-09-13T18:24:58.414205+0000","last_became_peered":"2024-09-13T18:24:58.414205+0000","last_unstale":"2024-09-13T18:25:00.240023+0000","last_undegraded":"2024-09-13T18:25:00.240023+0000","last_fullsized":"2024-09-13T18:25:00.240023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239499+0000","last_change":"2024-09-13T18:24:58.433694+0000","last_active":"2024-09-13T18:25:00.239499+0000","last_peered":"2024-09-13T18:25:00.239499+0000","last_clean":"2024-09-13T18:25:00.239499+0000","last_became_active":"2024-09-13T18:24:58.432977+0000","last_became_peered":"2024-09-13T18:24:58.432977+0000","last_unstale":"2024-09-13T18:25:00.239499+0000","last_undegraded":"2024-09-13T18:25:00.239499+0000","last_fullsized":"2024-09-13T18:25:00.239499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:20.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669635+0000","last_change":"2024-09-13T18:24:58.399324+0000","last_active":"2024-09-13T18:24:59.669635+0000","last_peered":"2024-09-13T18:24:59.669635+0000","last_clean":"2024-09-13T18:24:59.669635+0000","last_became_active":"2024-09-13T18:24:58.398728+0000","last_became_peered":"2024-09-13T18:24:58.398728+0000","last_unstale":"2024-09-13T18:24:59.669635+0000","last_undegraded":"2024-09-13T18:24:59.669635+0000","last_fullsized":"2024-09-13T18:24:59.669635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239363+0000","last_change":"2024-09-13T18:24:58.418319+0000","last_active":"2024-09-13T18:25:00.239363+0000","last_peered":"2024-09-13T18:25:00.239363+0000","last_clean":"2024-09-13T18:25:00.239363+0000","last_became_active":"2024-09-13T18:24:58.417600+0000","last_became_peered":"2024-09-13T18:24:58.417600+0000","last_unstale":"2024-09-13T18:25:00.239363+0000","last_undegraded":"2024-09-13T18:25:00.239363+0000","last_fullsized":"2024-09-13T18:25:00.239363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670260+0000","last_change":"2024-09-13T18:24:58.434929+0000","last_active":"2024-09-13T18:24:59.670260+0000","last_peered":"2024-09-13T18:24:59.670260+0000","last_clean":"2024-09-13T18:24:59.670260+0000","last_became_active":"2024-09-13T18:24:58.434692+0000","last_became_peered":"2024-09-13T18:24:58.434692+0000","last_unstale":"2024-09-13T18:24:59.670260+0000","last_undegraded":"2024-09-13T18:24:59.670260+0000","last_fullsized":"2024-09-13T18:24:59.670260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240346+0000","last_change":"2024-09-13T18:24:58.434112+0000","last_active":"2024-09-13T18:25:00.240346+0000","last_peered":"2024-09-13T18:25:00.240346+0000","last_clean":"2024-09-13T18:25:00.240346+0000","last_became_active":"2024-09-13T18:24:58.433715+0000","last_became_peered":"2024-09-13T18:24:58.433715+0000","last_unstale":"2024-09-13T18:25:00.240346+0000","last_undegraded":"2024-09-13T18:25:00.240346+0000","last_fullsized":"2024-09-13T18:25:00.240346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388052+0000","last_change":"2024-09-13T18:24:58.398414+0000","last_active":"2024-09-13T18:24:59.388052+0000","last_peered":"2024-09-13T18:24:59.388052+0000","last_clean":"2024-09-13T18:24:59.388052+0000","last_became_active":"2024-09-13T18:24:58.398137+0000","last_became_peered":"2024-09-13T18:24:58.398137+0000","last_unstale":"2024-09-13T18:24:59.388052+0000","last_undegraded":"2024-09-13T18:24:59.388052+0000","last_fullsized":"2024-09-13T18:24:59.388052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670643+0000","last_change":"2024-09-13T18:24:58.416857+0000","last_active":"2024-09-13T18:24:59.670643+0000","last_peered":"2024-09-13T18:24:59.670643+0000","last_clean":"2024-09-13T18:24:59.670643+0000","last_became_active":"2024-09-13T18:24:58.416500+0000","last_became_peered":"2024-09-13T18:24:58.416500+0000","last_unstale":"2024-09-13T18:24:59.670643+0000","last_undegraded":"2024-09-13T18:24:59.670643+0000","last_fullsized":"2024-09-13T18:24:59.670643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240041+0000","last_change":"2024-09-13T18:24:58.399395+0000","last_active":"2024-09-13T18:25:00.240041+0000","last_peered":"2024-09-13T18:25:00.240041+0000","last_clean":"2024-09-13T18:25:00.240041+0000","last_became_active":"2024-09-13T18:24:58.399156+0000","last_became_peered":"2024-09-13T18:24:58.399156+0000","last_unstale":"2024-09-13T18:25:00.240041+0000","last_undegraded":"2024-09-13T18:25:00.240041+0000","last_fullsized":"2024-09-13T18:25:00.240041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239547+0000","last_change":"2024-09-13T18:24:58.419100+0000","last_active":"2024-09-13T18:25:00.239547+0000","last_peered":"2024-09-13T18:25:00.239547+0000","last_clean":"2024-09-13T18:25:00.239547+0000","last_became_active":"2024-09-13T18:24:58.416656+0000","last_became_peered":"2024-09-13T18:24:58.416656+0000","last_unstale":"2024-09-13T18:25:00.239547+0000","last_undegraded":"2024-09-13T18:25:00.239547+0000","last_fullsized":"2024-09-13T18:25:00.239547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154711+0000","last_change":"2024-09-13T18:24:58.417573+0000","last_active":"2024-09-13T18:25:00.154711+0000","last_peered":"2024-09-13T18:25:00.154711+0000","last_clean":"2024-09-13T18:25:00.154711+0000","last_became_active":"2024-09-13T18:24:58.417375+0000","last_became_peered":"2024-09-13T18:24:58.417375+0000","last_unstale":"2024-09-13T18:25:00.154711+0000","last_undegraded":"2024-09-13T18:25:00.154711+0000","last_fullsized":"2024-09-13T18:25:00.154711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240046+0000","last_change":"2024-09-13T18:24:58.420326+0000","last_active":"2024-09-13T18:25:00.240046+0000","last_peered":"2024-09-13T18:25:00.240046+0000","last_clean":"2024-09-13T18:25:00.240046+0000","last_became_active":"2024-09-13T18:24:58.419405+0000","last_became_peered":"2024-09-13T18:24:58.419405+0000","last_unstale":"2024-09-13T18:25:00.240046+0000","last_undegraded":"2024-09-13T18:25:00.240046+0000","last_fullsized":"2024-09-13T18:25:00.240046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:33.563308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389034+0000","last_change":"2024-09-13T18:24:58.395983+0000","last_active":"2024-09-13T18:24:59.389034+0000","last_peered":"2024-09-13T18:24:59.389034+0000","last_clean":"2024-09-13T18:24:59.389034+0000","last_became_active":"2024-09-13T18:24:58.394785+0000","last_became_peered":"2024-09-13T18:24:58.394785+0000","last_unstale":"2024-09-13T18:24:59.389034+0000","last_undegraded":"2024-09-13T18:24:59.389034+0000","last_fullsized":"2024-09-13T18:24:59.389034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:22.685152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.033774+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.033412+0000","last_became_peered":"2024-09-13T18:24:58.033412+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240057+0000","last_change":"2024-09-13T18:24:58.395023+0000","last_active":"2024-09-13T18:25:00.240057+0000","last_peered":"2024-09-13T18:25:00.240057+0000","last_clean":"2024-09-13T18:25:00.240057+0000","last_became_active":"2024-09-13T18:24:58.394639+0000","last_became_peered":"2024-09-13T18:24:58.394639+0000","last_unstale":"2024-09-13T18:25:00.240057+0000","last_undegraded":"2024-09-13T18:25:00.240057+0000","last_fullsized":"2024-09-13T18:25:00.240057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240216+0000","last_change":"2024-09-13T18:24:58.020182+0000","last_active":"2024-09-13T18:25:00.240216+0000","last_peered":"2024-09-13T18:25:00.240216+0000","last_clean":"2024-09-13T18:25:00.240216+0000","last_became_active":"2024-09-13T18:24:58.019266+0000","last_became_peered":"2024-09-13T18:24:58.019266+0000","last_unstale":"2024-09-13T18:25:00.240216+0000","last_undegraded":"2024-09-13T18:25:00.240216+0000","last_fullsized":"2024-09-13T18:25:00.240216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669944+0000","last_change":"2024-09-13T18:24:58.042697+0000","last_active":"2024-09-13T18:24:59.669944+0000","last_peered":"2024-09-13T18:24:59.669944+0000","last_clean":"2024-09-13T18:24:59.669944+0000","last_became_active":"2024-09-13T18:24:58.042383+0000","last_became_peered":"2024-09-13T18:24:58.042383+0000","last_unstale":"2024-09-13T18:24:59.669944+0000","last_undegraded":"2024-09-13T18:24:59.669944+0000","last_fullsized":"2024-09-13T18:24:59.669944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669716+0000","last_change":"2024-09-13T18:24:58.397945+0000","last_active":"2024-09-13T18:24:59.669716+0000","last_peered":"2024-09-13T18:24:59.669716+0000","last_clean":"2024-09-13T18:24:59.669716+0000","last_became_active":"2024-09-13T18:24:58.397684+0000","last_became_peered":"2024-09-13T18:24:58.397684+0000","last_unstale":"2024-09-13T18:24:59.669716+0000","last_undegraded":"2024-09-13T18:24:59.669716+0000","last_fullsized":"2024-09-13T18:24:59.669716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239398+0000","last_change":"2024-09-13T18:24:58.025483+0000","last_active":"2024-09-13T18:25:00.239398+0000","last_peered":"2024-09-13T18:25:00.239398+0000","last_clean":"2024-09-13T18:25:00.239398+0000","last_became_active":"2024-09-13T18:24:58.024711+0000","last_became_peered":"2024-09-13T18:24:58.024711+0000","last_unstale":"2024-09-13T18:25:00.239398+0000","last_undegraded":"2024-09-13T18:25:00.239398+0000","last_fullsized":"2024-09-13T18:25:00.239398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387452+0000","last_change":"2024-09-13T18:24:58.398740+0000","last_active":"2024-09-13T18:24:59.387452+0000","last_peered":"2024-09-13T18:24:59.387452+0000","last_clean":"2024-09-13T18:24:59.387452+0000","last_became_active":"2024-09-13T18:24:58.397892+0000","last_became_peered":"2024-09-13T18:24:58.397892+0000","last_unstale":"2024-09-13T18:24:59.387452+0000","last_undegraded":"2024-09-13T18:24:59.387452+0000","last_fullsized":"2024-09-13T18:24:59.387452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240367+0000","last_change":"2024-09-13T18:24:58.041368+0000","last_active":"2024-09-13T18:25:00.240367+0000","last_peered":"2024-09-13T18:25:00.240367+0000","last_clean":"2024-09-13T18:25:00.240367+0000","last_became_active":"2024-09-13T18:24:58.040649+0000","last_became_peered":"2024-09-13T18:24:58.040649+0000","last_unstale":"2024-09-13T18:25:00.240367+0000","last_undegraded":"2024-09-13T18:25:00.240367+0000","last_fullsized":"2024-09-13T18:25:00.240367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239820+0000","last_change":"2024-09-13T18:24:58.431883+0000","last_active":"2024-09-13T18:25:00.239820+0000","last_peered":"2024-09-13T18:25:00.239820+0000","last_clean":"2024-09-13T18:25:00.239820+0000","last_became_active":"2024-09-13T18:24:58.431214+0000","last_became_peered":"2024-09-13T18:24:58.431214+0000","last_unstale":"2024-09-13T18:25:00.239820+0000","last_undegraded":"2024-09-13T18:25:00.239820+0000","last_fullsized":"2024-09-13T18:25:00.239820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:56.513958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239840+0000","last_change":"2024-09-13T18:24:58.042813+0000","last_active":"2024-09-13T18:25:00.239840+0000","last_peered":"2024-09-13T18:25:00.239840+0000","last_clean":"2024-09-13T18:25:00.239840+0000","last_became_active":"2024-09-13T18:24:58.042035+0000","last_became_peered":"2024-09-13T18:24:58.042035+0000","last_unstale":"2024-09-13T18:25:00.239840+0000","last_undegraded":"2024-09-13T18:25:00.239840+0000","last_fullsized":"2024-09-13T18:25:00.239840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240157+0000","last_change":"2024-09-13T18:24:58.418140+0000","last_active":"2024-09-13T18:25:00.240157+0000","last_peered":"2024-09-13T18:25:00.240157+0000","last_clean":"2024-09-13T18:25:00.240157+0000","last_became_active":"2024-09-13T18:24:58.417892+0000","last_became_peered":"2024-09-13T18:24:58.417892+0000","last_unstale":"2024-09-13T18:25:00.240157+0000","last_undegraded":"2024-09-13T18:25:00.240157+0000","last_fullsized":"2024-09-13T18:25:00.240157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:31.267072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388168+0000","last_change":"2024-09-13T18:24:58.031378+0000","last_active":"2024-09-13T18:24:59.388168+0000","last_peered":"2024-09-13T18:24:59.388168+0000","last_clean":"2024-09-13T18:24:59.388168+0000","last_became_active":"2024-09-13T18:24:58.031086+0000","last_became_peered":"2024-09-13T18:24:58.031086+0000","last_unstale":"2024-09-13T18:24:59.388168+0000","last_undegraded":"2024-09-13T18:24:59.388168+0000","last_fullsized":"2024-09-13T18:24:59.388168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389663+0000","last_change":"2024-09-13T18:24:58.430392+0000","last_active":"2024-09-13T18:24:59.389663+0000","last_peered":"2024-09-13T18:24:59.389663+0000","last_clean":"2024-09-13T18:24:59.389663+0000","last_became_active":"2024-09-13T18:24:58.429654+0000","last_became_peered":"2024-09-13T18:24:58.429654+0000","last_unstale":"2024-09-13T18:24:59.389663+0000","last_undegraded":"2024-09-13T18:24:59.389663+0000","last_fullsized":"2024-09-13T18:24:59.389663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:27.851864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240263+0000","last_change":"2024-09-13T18:24:58.039451+0000","last_active":"2024-09-13T18:25:00.240263+0000","last_peered":"2024-09-13T18:25:00.240263+0000","last_clean":"2024-09-13T18:25:00.240263+0000","last_became_active":"2024-09-13T18:24:58.032328+0000","last_became_peered":"2024-09-13T18:24:58.032328+0000","last_unstale":"2024-09-13T18:25:00.240263+0000","last_undegraded":"2024-09-13T18:25:00.240263+0000","last_fullsized":"2024-09-13T18:25:00.240263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463120+0000","last_change":"2024-09-13T18:24:58.409551+0000","last_active":"2024-09-13T18:24:59.463120+0000","last_peered":"2024-09-13T18:24:59.463120+0000","last_clean":"2024-09-13T18:24:59.463120+0000","last_became_active":"2024-09-13T18:24:58.407831+0000","last_became_peered":"2024-09-13T18:24:58.407831+0000","last_unstale":"2024-09-13T18:24:59.463120+0000","last_undegraded":"2024-09-13T18:24:59.463120+0000","last_fullsized":"2024-09-13T18:24:59.463120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240074+0000","last_change":"2024-09-13T18:24:58.027528+0000","last_active":"2024-09-13T18:25:00.240074+0000","last_peered":"2024-09-13T18:25:00.240074+0000","last_clean":"2024-09-13T18:25:00.240074+0000","last_became_active":"2024-09-13T18:24:58.027248+0000","last_became_peered":"2024-09-13T18:24:58.027248+0000","last_unstale":"2024-09-13T18:25:00.240074+0000","last_undegraded":"2024-09-13T18:25:00.240074+0000","last_fullsized":"2024-09-13T18:25:00.240074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:47.371298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240005+0000","last_change":"2024-09-13T18:24:58.414607+0000","last_active":"2024-09-13T18:25:00.240005+0000","last_peered":"2024-09-13T18:25:00.240005+0000","last_clean":"2024-09-13T18:25:00.240005+0000","last_became_active":"2024-09-13T18:24:58.414310+0000","last_became_peered":"2024-09-13T18:24:58.414310+0000","last_unstale":"2024-09-13T18:25:00.240005+0000","last_undegraded":"2024-09-13T18:25:00.240005+0000","last_fullsized":"2024-09-13T18:25:00.240005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239585+0000","last_change":"2024-09-13T18:24:58.032711+0000","last_active":"2024-09-13T18:25:00.239585+0000","last_peered":"2024-09-13T18:25:00.239585+0000","last_clean":"2024-09-13T18:25:00.239585+0000","last_became_active":"2024-09-13T18:24:58.030671+0000","last_became_peered":"2024-09-13T18:24:58.030671+0000","last_unstale":"2024-09-13T18:25:00.239585+0000","last_undegraded":"2024-09-13T18:25:00.239585+0000","last_fullsized":"2024-09-13T18:25:00.239585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:21.674116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463490+0000","last_change":"2024-09-13T18:24:58.439918+0000","last_active":"2024-09-13T18:24:59.463490+0000","last_peered":"2024-09-13T18:24:59.463490+0000","last_clean":"2024-09-13T18:24:59.463490+0000","last_became_active":"2024-09-13T18:24:58.439353+0000","last_became_peered":"2024-09-13T18:24:58.439353+0000","last_unstale":"2024-09-13T18:24:59.463490+0000","last_undegraded":"2024-09-13T18:24:59.463490+0000","last_fullsized":"2024-09-13T18:24:59.463490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:36.375304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240163+0000","last_change":"2024-09-13T18:24:58.028233+0000","last_active":"2024-09-13T18:25:00.240163+0000","last_peered":"2024-09-13T18:25:00.240163+0000","last_clean":"2024-09-13T18:25:00.240163+0000","last_became_active":"2024-09-13T18:24:58.027484+0000","last_became_peered":"2024-09-13T18:24:58.027484+0000","last_unstale":"2024-09-13T18:25:00.240163+0000","last_undegraded":"2024-09-13T18:25:00.240163+0000","last_fullsized":"2024-09-13T18:25:00.240163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240107+0000","last_change":"2024-09-13T18:24:58.425519+0000","last_active":"2024-09-13T18:25:00.240107+0000","last_peered":"2024-09-13T18:25:00.240107+0000","last_clean":"2024-09-13T18:25:00.240107+0000","last_became_active":"2024-09-13T18:24:58.421201+0000","last_became_peered":"2024-09-13T18:24:58.421201+0000","last_unstale":"2024-09-13T18:25:00.240107+0000","last_undegraded":"2024-09-13T18:25:00.240107+0000","last_fullsized":"2024-09-13T18:25:00.240107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154679+0000","last_change":"2024-09-13T18:24:58.015803+0000","last_active":"2024-09-13T18:25:00.154679+0000","last_peered":"2024-09-13T18:25:00.154679+0000","last_clean":"2024-09-13T18:25:00.154679+0000","last_became_active":"2024-09-13T18:24:58.015460+0000","last_became_peered":"2024-09-13T18:24:58.015460+0000","last_unstale":"2024-09-13T18:25:00.154679+0000","last_undegraded":"2024-09-13T18:25:00.154679+0000","last_fullsized":"2024-09-13T18:25:00.154679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463015+0000","last_change":"2024-09-13T18:24:58.439925+0000","last_active":"2024-09-13T18:24:59.463015+0000","last_peered":"2024-09-13T18:24:59.463015+0000","last_clean":"2024-09-13T18:24:59.463015+0000","last_became_active":"2024-09-13T18:24:58.439310+0000","last_became_peered":"2024-09-13T18:24:58.439310+0000","last_unstale":"2024-09-13T18:24:59.463015+0000","last_undegraded":"2024-09-13T18:24:59.463015+0000","last_fullsized":"2024-09-13T18:24:59.463015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389428+0000","last_change":"2024-09-13T18:24:58.024579+0000","last_active":"2024-09-13T18:24:59.389428+0000","last_peered":"2024-09-13T18:24:59.389428+0000","last_clean":"2024-09-13T18:24:59.389428+0000","last_became_active":"2024-09-13T18:24:58.023234+0000","last_became_peered":"2024-09-13T18:24:58.023234+0000","last_unstale":"2024-09-13T18:24:59.389428+0000","last_undegraded":"2024-09-13T18:24:59.389428+0000","last_fullsized":"2024-09-13T18:24:59.389428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463655+0000","last_change":"2024-09-13T18:24:58.439656+0000","last_active":"2024-09-13T18:24:59.463655+0000","last_peered":"2024-09-13T18:24:59.463655+0000","last_clean":"2024-09-13T18:24:59.463655+0000","last_became_active":"2024-09-13T18:24:58.439013+0000","last_became_peered":"2024-09-13T18:24:58.439013+0000","last_unstale":"2024-09-13T18:24:59.463655+0000","last_undegraded":"2024-09-13T18:24:59.463655+0000","last_fullsized":"2024-09-13T18:24:59.463655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155004+0000","last_change":"2024-09-13T18:24:58.013601+0000","last_active":"2024-09-13T18:25:00.155004+0000","last_peered":"2024-09-13T18:25:00.155004+0000","last_clean":"2024-09-13T18:25:00.155004+0000","last_became_active":"2024-09-13T18:24:58.012977+0000","last_became_peered":"2024-09-13T18:24:58.012977+0000","last_unstale":"2024-09-13T18:25:00.155004+0000","last_undegraded":"2024-09-13T18:25:00.155004+0000","last_fullsized":"2024-09-13T18:25:00.155004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.464058+0000","last_change":"2024-09-13T18:24:58.440756+0000","last_active":"2024-09-13T18:24:59.464058+0000","last_peered":"2024-09-13T18:24:59.464058+0000","last_clean":"2024-09-13T18:24:59.464058+0000","last_became_active":"2024-09-13T18:24:58.440064+0000","last_became_peered":"2024-09-13T18:24:58.440064+0000","last_unstale":"2024-09-13T18:24:59.464058+0000","last_undegraded":"2024-09-13T18:24:59.464058+0000","last_fullsized":"2024-09-13T18:24:59.464058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388284+0000","last_change":"2024-09-13T18:24:58.021101+0000","last_active":"2024-09-13T18:24:59.388284+0000","last_peered":"2024-09-13T18:24:59.388284+0000","last_clean":"2024-09-13T18:24:59.388284+0000","last_became_active":"2024-09-13T18:24:58.020782+0000","last_became_peered":"2024-09-13T18:24:58.020782+0000","last_unstale":"2024-09-13T18:24:59.388284+0000","last_undegraded":"2024-09-13T18:24:59.388284+0000","last_fullsized":"2024-09-13T18:24:59.388284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239751+0000","last_change":"2024-09-13T18:24:58.417213+0000","last_active":"2024-09-13T18:25:00.239751+0000","last_peered":"2024-09-13T18:25:00.239751+0000","last_clean":"2024-09-13T18:25:00.239751+0000","last_became_active":"2024-09-13T18:24:58.415708+0000","last_became_peered":"2024-09-13T18:24:58.415708+0000","last_unstale":"2024-09-13T18:25:00.239751+0000","last_undegraded":"2024-09-13T18:25:00.239751+0000","last_fullsized":"2024-09-13T18:25:00.239751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.155281+0000","last_change":"2024-09-13T18:24:58.017225+0000","last_active":"2024-09-13T18:25:00.155281+0000","last_peered":"2024-09-13T18:25:00.155281+0000","last_clean":"2024-09-13T18:25:00.155281+0000","last_became_active":"2024-09-13T18:24:58.016815+0000","last_became_peered":"2024-09-13T18:24:58.016815+0000","last_unstale":"2024-09-13T18:25:00.155281+0000","last_undegraded":"2024-09-13T18:25:00.155281+0000","last_fullsized":"2024-09-13T18:25:00.155281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463041+0000","last_change":"2024-09-13T18:24:58.425095+0000","last_active":"2024-09-13T18:24:59.463041+0000","last_peered":"2024-09-13T18:24:59.463041+0000","last_clean":"2024-09-13T18:24:59.463041+0000","last_became_active":"2024-09-13T18:24:58.424483+0000","last_became_peered":"2024-09-13T18:24:58.424483+0000","last_unstale":"2024-09-13T18:24:59.463041+0000","last_undegraded":"2024-09-13T18:24:59.463041+0000","last_fullsized":"2024-09-13T18:24:59.463041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:39.388070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:24:58.396354+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:24:58.396354+0000","last_peered":"2024-09-13T18:24:58.396354+0000","last_clean":"2024-09-13T18:24:58.396354+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:24:58.396354+0000","last_undegraded":"2024-09-13T18:24:58.396354+0000","last_fullsized":"2024-09-13T18:24:58.396354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239666+0000","last_change":"2024-09-13T18:24:58.029698+0000","last_active":"2024-09-13T18:25:00.239666+0000","last_peered":"2024-09-13T18:25:00.239666+0000","last_clean":"2024-09-13T18:25:00.239666+0000","last_became_active":"2024-09-13T18:24:58.028952+0000","last_became_peered":"2024-09-13T18:24:58.028952+0000","last_unstale":"2024-09-13T18:25:00.239666+0000","last_undegraded":"2024-09-13T18:25:00.239666+0000","last_fullsized":"2024-09-13T18:25:00.239666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670059+0000","last_change":"2024-09-13T18:24:58.421648+0000","last_active":"2024-09-13T18:24:59.670059+0000","last_peered":"2024-09-13T18:24:59.670059+0000","last_clean":"2024-09-13T18:24:59.670059+0000","last_became_active":"2024-09-13T18:24:58.421356+0000","last_became_peered":"2024-09-13T18:24:58.421356+0000","last_unstale":"2024-09-13T18:24:59.670059+0000","last_undegraded":"2024-09-13T18:24:59.670059+0000","last_fullsized":"2024-09-13T18:24:59.670059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:24.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462728+0000","last_change":"2024-09-13T18:24:58.034925+0000","last_active":"2024-09-13T18:24:59.462728+0000","last_peered":"2024-09-13T18:24:59.462728+0000","last_clean":"2024-09-13T18:24:59.462728+0000","last_became_active":"2024-09-13T18:24:58.033842+0000","last_became_peered":"2024-09-13T18:24:58.033842+0000","last_unstale":"2024-09-13T18:24:59.462728+0000","last_undegraded":"2024-09-13T18:24:59.462728+0000","last_fullsized":"2024-09-13T18:24:59.462728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:46.562194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239960+0000","last_change":"2024-09-13T18:24:58.394853+0000","last_active":"2024-09-13T18:25:00.239960+0000","last_peered":"2024-09-13T18:25:00.239960+0000","last_clean":"2024-09-13T18:25:00.239960+0000","last_became_active":"2024-09-13T18:24:58.394595+0000","last_became_peered":"2024-09-13T18:24:58.394595+0000","last_unstale":"2024-09-13T18:25:00.239960+0000","last_undegraded":"2024-09-13T18:25:00.239960+0000","last_fullsized":"2024-09-13T18:25:00.239960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:58.942887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.154842+0000","last_change":"2024-09-13T18:24:58.012966+0000","last_active":"2024-09-13T18:25:00.154842+0000","last_peered":"2024-09-13T18:25:00.154842+0000","last_clean":"2024-09-13T18:25:00.154842+0000","last_became_active":"2024-09-13T18:24:58.012406+0000","last_became_peered":"2024-09-13T18:24:58.012406+0000","last_unstale":"2024-09-13T18:25:00.154842+0000","last_undegraded":"2024-09-13T18:25:00.154842+0000","last_fullsized":"2024-09-13T18:25:00.154842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:48.894008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387622+0000","last_change":"2024-09-13T18:24:58.395770+0000","last_active":"2024-09-13T18:24:59.387622+0000","last_peered":"2024-09-13T18:24:59.387622+0000","last_clean":"2024-09-13T18:24:59.387622+0000","last_became_active":"2024-09-13T18:24:58.395459+0000","last_became_peered":"2024-09-13T18:24:58.395459+0000","last_unstale":"2024-09-13T18:24:59.387622+0000","last_undegraded":"2024-09-13T18:24:59.387622+0000","last_fullsized":"2024-09-13T18:24:59.387622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:57.523513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239627+0000","last_change":"2024-09-13T18:24:58.033195+0000","last_active":"2024-09-13T18:25:00.239627+0000","last_peered":"2024-09-13T18:25:00.239627+0000","last_clean":"2024-09-13T18:25:00.239627+0000","last_became_active":"2024-09-13T18:24:58.032049+0000","last_became_peered":"2024-09-13T18:24:58.032049+0000","last_unstale":"2024-09-13T18:25:00.239627+0000","last_undegraded":"2024-09-13T18:25:00.239627+0000","last_fullsized":"2024-09-13T18:25:00.239627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389525+0000","last_change":"2024-09-13T18:24:58.392965+0000","last_active":"2024-09-13T18:24:59.389525+0000","last_peered":"2024-09-13T18:24:59.389525+0000","last_clean":"2024-09-13T18:24:59.389525+0000","last_became_active":"2024-09-13T18:24:58.392228+0000","last_became_peered":"2024-09-13T18:24:58.392228+0000","last_unstale":"2024-09-13T18:24:59.389525+0000","last_undegraded":"2024-09-13T18:24:59.389525+0000","last_fullsized":"2024-09-13T18:24:59.389525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:41.080535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387904+0000","last_change":"2024-09-13T18:24:58.014413+0000","last_active":"2024-09-13T18:24:59.387904+0000","last_peered":"2024-09-13T18:24:59.387904+0000","last_clean":"2024-09-13T18:24:59.387904+0000","last_became_active":"2024-09-13T18:24:58.013907+0000","last_became_peered":"2024-09-13T18:24:58.013907+0000","last_unstale":"2024-09-13T18:24:59.387904+0000","last_undegraded":"2024-09-13T18:24:59.387904+0000","last_fullsized":"2024-09-13T18:24:59.387904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239800+0000","last_change":"2024-09-13T18:24:58.416160+0000","last_active":"2024-09-13T18:25:00.239800+0000","last_peered":"2024-09-13T18:25:00.239800+0000","last_clean":"2024-09-13T18:25:00.239800+0000","last_became_active":"2024-09-13T18:24:58.415331+0000","last_became_peered":"2024-09-13T18:24:58.415331+0000","last_unstale":"2024-09-13T18:25:00.239800+0000","last_undegraded":"2024-09-13T18:25:00.239800+0000","last_fullsized":"2024-09-13T18:25:00.239800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:42.531032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463346+0000","last_change":"2024-09-13T18:24:58.038596+0000","last_active":"2024-09-13T18:24:59.463346+0000","last_peered":"2024-09-13T18:24:59.463346+0000","last_clean":"2024-09-13T18:24:59.463346+0000","last_became_active":"2024-09-13T18:24:58.037754+0000","last_became_peered":"2024-09-13T18:24:58.037754+0000","last_unstale":"2024-09-13T18:24:59.463346+0000","last_undegraded":"2024-09-13T18:24:59.463346+0000","last_fullsized":"2024-09-13T18:24:59.463346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:16.826662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387779+0000","last_change":"2024-09-13T18:24:58.395308+0000","last_active":"2024-09-13T18:24:59.387779+0000","last_peered":"2024-09-13T18:24:59.387779+0000","last_clean":"2024-09-13T18:24:59.387779+0000","last_became_active":"2024-09-13T18:24:58.394989+0000","last_became_peered":"2024-09-13T18:24:58.394989+0000","last_unstale":"2024-09-13T18:24:59.387779+0000","last_undegraded":"2024-09-13T18:24:59.387779+0000","last_fullsized":"2024-09-13T18:24:59.387779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.246647+0000","last_change":"2024-09-13T18:24:58.043141+0000","last_active":"2024-09-13T18:25:00.246647+0000","last_peered":"2024-09-13T18:25:00.246647+0000","last_clean":"2024-09-13T18:25:00.246647+0000","last_became_active":"2024-09-13T18:24:58.042796+0000","last_became_peered":"2024-09-13T18:24:58.042796+0000","last_unstale":"2024-09-13T18:25:00.246647+0000","last_undegraded":"2024-09-13T18:25:00.246647+0000","last_fullsized":"2024-09-13T18:25:00.246647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670417+0000","last_change":"2024-09-13T18:24:58.415075+0000","last_active":"2024-09-13T18:24:59.670417+0000","last_peered":"2024-09-13T18:24:59.670417+0000","last_clean":"2024-09-13T18:24:59.670417+0000","last_became_active":"2024-09-13T18:24:58.414794+0000","last_became_peered":"2024-09-13T18:24:58.414794+0000","last_unstale":"2024-09-13T18:24:59.670417+0000","last_undegraded":"2024-09-13T18:24:59.670417+0000","last_fullsized":"2024-09-13T18:24:59.670417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:02.097074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240393+0000","last_change":"2024-09-13T18:24:58.040550+0000","last_active":"2024-09-13T18:25:00.240393+0000","last_peered":"2024-09-13T18:25:00.240393+0000","last_clean":"2024-09-13T18:25:00.240393+0000","last_became_active":"2024-09-13T18:24:58.039933+0000","last_became_peered":"2024-09-13T18:24:58.039933+0000","last_unstale":"2024-09-13T18:25:00.240393+0000","last_undegraded":"2024-09-13T18:25:00.240393+0000","last_fullsized":"2024-09-13T18:25:00.240393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:12.475688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240124+0000","last_change":"2024-09-13T18:24:58.397002+0000","last_active":"2024-09-13T18:25:00.240124+0000","last_peered":"2024-09-13T18:25:00.240124+0000","last_clean":"2024-09-13T18:25:00.240124+0000","last_became_active":"2024-09-13T18:24:58.396735+0000","last_became_peered":"2024-09-13T18:24:58.396735+0000","last_unstale":"2024-09-13T18:25:00.240124+0000","last_undegraded":"2024-09-13T18:25:00.240124+0000","last_fullsized":"2024-09-13T18:25:00.240124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.128134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.462686+0000","last_change":"2024-09-13T18:24:58.033754+0000","last_active":"2024-09-13T18:24:59.462686+0000","last_peered":"2024-09-13T18:24:59.462686+0000","last_clean":"2024-09-13T18:24:59.462686+0000","last_became_active":"2024-09-13T18:24:58.031165+0000","last_became_peered":"2024-09-13T18:24:58.031165+0000","last_unstale":"2024-09-13T18:24:59.462686+0000","last_undegraded":"2024-09-13T18:24:59.462686+0000","last_fullsized":"2024-09-13T18:24:59.462686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.389086+0000","last_change":"2024-09-13T18:24:58.394401+0000","last_active":"2024-09-13T18:24:59.389086+0000","last_peered":"2024-09-13T18:24:59.389086+0000","last_clean":"2024-09-13T18:24:59.389086+0000","last_became_active":"2024-09-13T18:24:58.392351+0000","last_became_peered":"2024-09-13T18:24:58.392351+0000","last_unstale":"2024-09-13T18:24:59.389086+0000","last_undegraded":"2024-09-13T18:24:59.389086+0000","last_fullsized":"2024-09-13T18:24:59.389086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:17.837698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.387555+0000","last_change":"2024-09-13T18:24:58.034526+0000","last_active":"2024-09-13T18:24:59.387555+0000","last_peered":"2024-09-13T18:24:59.387555+0000","last_clean":"2024-09-13T18:24:59.387555+0000","last_became_active":"2024-09-13T18:24:58.034217+0000","last_became_peered":"2024-09-13T18:24:58.034217+0000","last_unstale":"2024-09-13T18:24:59.387555+0000","last_undegraded":"2024-09-13T18:24:59.387555+0000","last_fullsized":"2024-09-13T18:24:59.387555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:23.097403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.669724+0000","last_change":"2024-09-13T18:24:58.398957+0000","last_active":"2024-09-13T18:24:59.669724+0000","last_peered":"2024-09-13T18:24:59.669724+0000","last_clean":"2024-09-13T18:24:59.669724+0000","last_became_active":"2024-09-13T18:24:58.398692+0000","last_became_peered":"2024-09-13T18:24:58.398692+0000","last_unstale":"2024-09-13T18:24:59.669724+0000","last_undegraded":"2024-09-13T18:24:59.669724+0000","last_fullsized":"2024-09-13T18:24:59.669724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.388073+0000","last_change":"2024-09-13T18:24:58.013615+0000","last_active":"2024-09-13T18:24:59.388073+0000","last_peered":"2024-09-13T18:24:59.388073+0000","last_clean":"2024-09-13T18:24:59.388073+0000","last_became_active":"2024-09-13T18:24:58.013286+0000","last_became_peered":"2024-09-13T18:24:58.013286+0000","last_unstale":"2024-09-13T18:24:59.388073+0000","last_undegraded":"2024-09-13T18:24:59.388073+0000","last_fullsized":"2024-09-13T18:24:59.388073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:36.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670318+0000","last_change":"2024-09-13T18:24:58.400483+0000","last_active":"2024-09-13T18:24:59.670318+0000","last_peered":"2024-09-13T18:24:59.670318+0000","last_clean":"2024-09-13T18:24:59.670318+0000","last_became_active":"2024-09-13T18:24:58.400227+0000","last_became_peered":"2024-09-13T18:24:58.400227+0000","last_unstale":"2024-09-13T18:24:59.670318+0000","last_undegraded":"2024-09-13T18:24:59.670318+0000","last_fullsized":"2024-09-13T18:24:59.670318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:46.419528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463603+0000","last_change":"2024-09-13T18:24:58.041646+0000","last_active":"2024-09-13T18:24:59.463603+0000","last_peered":"2024-09-13T18:24:59.463603+0000","last_clean":"2024-09-13T18:24:59.463603+0000","last_became_active":"2024-09-13T18:24:58.040973+0000","last_became_peered":"2024-09-13T18:24:58.040973+0000","last_unstale":"2024-09-13T18:24:59.463603+0000","last_undegraded":"2024-09-13T18:24:59.463603+0000","last_fullsized":"2024-09-13T18:24:59.463603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:44.008929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240186+0000","last_change":"2024-09-13T18:24:58.432390+0000","last_active":"2024-09-13T18:25:00.240186+0000","last_peered":"2024-09-13T18:25:00.240186+0000","last_clean":"2024-09-13T18:25:00.240186+0000","last_became_active":"2024-09-13T18:24:58.431733+0000","last_became_peered":"2024-09-13T18:24:58.431733+0000","last_unstale":"2024-09-13T18:25:00.240186+0000","last_undegraded":"2024-09-13T18:25:00.240186+0000","last_fullsized":"2024-09-13T18:25:00.240186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:53.785419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239780+0000","last_change":"2024-09-13T18:24:58.437372+0000","last_active":"2024-09-13T18:25:00.239780+0000","last_peered":"2024-09-13T18:25:00.239780+0000","last_clean":"2024-09-13T18:25:00.239780+0000","last_became_active":"2024-09-13T18:24:58.436708+0000","last_became_peered":"2024-09-13T18:24:58.436708+0000","last_unstale":"2024-09-13T18:25:00.239780+0000","last_undegraded":"2024-09-13T18:25:00.239780+0000","last_fullsized":"2024-09-13T18:25:00.239780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:31.309464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463101+0000","last_change":"2024-09-13T18:24:58.037424+0000","last_active":"2024-09-13T18:24:59.463101+0000","last_peered":"2024-09-13T18:24:59.463101+0000","last_clean":"2024-09-13T18:24:59.463101+0000","last_became_active":"2024-09-13T18:24:58.036405+0000","last_became_peered":"2024-09-13T18:24:58.036405+0000","last_unstale":"2024-09-13T18:24:59.463101+0000","last_undegraded":"2024-09-13T18:24:59.463101+0000","last_fullsized":"2024-09-13T18:24:59.463101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:27.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.239730+0000","last_change":"2024-09-13T18:24:58.435968+0000","last_active":"2024-09-13T18:25:00.239730+0000","last_peered":"2024-09-13T18:25:00.239730+0000","last_clean":"2024-09-13T18:25:00.239730+0000","last_became_active":"2024-09-13T18:24:58.435619+0000","last_became_peered":"2024-09-13T18:24:58.435619+0000","last_unstale":"2024-09-13T18:25:00.239730+0000","last_undegraded":"2024-09-13T18:25:00.239730+0000","last_fullsized":"2024-09-13T18:25:00.239730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:03.082788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.463214+0000","last_change":"2024-09-13T18:24:58.044836+0000","last_active":"2024-09-13T18:24:59.463214+0000","last_peered":"2024-09-13T18:24:59.463214+0000","last_clean":"2024-09-13T18:24:59.463214+0000","last_became_active":"2024-09-13T18:24:58.044091+0000","last_became_peered":"2024-09-13T18:24:58.044091+0000","last_unstale":"2024-09-13T18:24:59.463214+0000","last_undegraded":"2024-09-13T18:24:59.463214+0000","last_fullsized":"2024-09-13T18:24:59.463214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:40.069499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240141+0000","last_change":"2024-09-13T18:24:58.418359+0000","last_active":"2024-09-13T18:25:00.240141+0000","last_peered":"2024-09-13T18:25:00.240141+0000","last_clean":"2024-09-13T18:25:00.240141+0000","last_became_active":"2024-09-13T18:24:58.418071+0000","last_became_peered":"2024-09-13T18:24:58.418071+0000","last_unstale":"2024-09-13T18:25:00.240141+0000","last_undegraded":"2024-09-13T18:25:00.240141+0000","last_fullsized":"2024-09-13T18:25:00.240141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:49.873382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670596+0000","last_change":"2024-09-13T18:24:58.016894+0000","last_active":"2024-09-13T18:24:59.670596+0000","last_peered":"2024-09-13T18:24:59.670596+0000","last_clean":"2024-09-13T18:24:59.670596+0000","last_became_active":"2024-09-13T18:24:58.016172+0000","last_became_peered":"2024-09-13T18:24:58.016172+0000","last_unstale":"2024-09-13T18:24:59.670596+0000","last_undegraded":"2024-09-13T18:24:59.670596+0000","last_fullsized":"2024-09-13T18:24:59.670596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:36.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:24:59.670403+0000","last_change":"2024-09-13T18:24:58.426766+0000","last_active":"2024-09-13T18:24:59.670403+0000","last_peered":"2024-09-13T18:24:59.670403+0000","last_clean":"2024-09-13T18:24:59.670403+0000","last_became_active":"2024-09-13T18:24:58.426470+0000","last_became_peered":"2024-09-13T18:24:58.426470+0000","last_unstale":"2024-09-13T18:24:59.670403+0000","last_undegraded":"2024-09-13T18:24:59.670403+0000","last_fullsized":"2024-09-13T18:24:59.670403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:57.983650+0000","last_clean_scrub_stamp":"2024-09-13T18:24:57.983650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:01.560336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:25:00.240175+0000","last_change":"2024-09-13T18:24:58.025191+0000","last_active":"2024-09-13T18:25:00.240175+0000","last_peered":"2024-09-13T18:25:00.240175+0000","last_clean":"2024-09-13T18:25:00.240175+0000","last_became_active":"2024-09-13T18:24:58.024847+0000","last_became_peered":"2024-09-13T18:24:58.024847+0000","last_unstale":"2024-09-13T18:25:00.240175+0000","last_undegraded":"2024-09-13T18:25:00.240175+0000","last_fullsized":"2024-09-13T18:25:00.240175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:56.972614+0000","last_clean_scrub_stamp":"2024-09-13T18:24:56.972614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:05.912577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7869999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:25:07.105 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:25:07.105 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:25:07.105 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:25:07.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:25:07.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.257+0000 7f2322e98640 1 Processor -- start 2024-09-13T18:25:07.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.257+0000 7f2322e98640 1 -- start start 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2322e98640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c15a470 0x7f231c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2322e98640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f231c15cc60 0x7f231c071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2322e98640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f231c0b1c10 0x7f231c0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2322e98640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c06f880 con 0x7f231c15cc60 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2322e98640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0b2600 con 0x7f231c0b1c10 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2322e98640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c06f550 con 0x7f231c15a470 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f231c15cc60 0x7f231c071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f231c15cc60 0x7f231c071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57508/0 (socket says 172.21.15.53:57508) 2024-09-13T18:25:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 -- 172.21.15.53:0/2128397870 learned_addr learned my addr 172.21.15.53:0/2128397870 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2321435640 1 --2- 172.21.15.53:0/2128397870 >> v2:172.21.15.87:3300/0 conn(0x7f231c0b1c10 0x7f231c0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2320c34640 1 --2- 172.21.15.53:0/2128397870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c15a470 0x7f231c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 -- 172.21.15.53:0/2128397870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c15a470 msgr2=0x7f231c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 --2- 172.21.15.53:0/2128397870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c15a470 0x7f231c0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 -- 172.21.15.53:0/2128397870 >> v2:172.21.15.87:3300/0 conn(0x7f231c0b1c10 msgr2=0x7f231c0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 --2- 172.21.15.53:0/2128397870 >> v2:172.21.15.87:3300/0 conn(0x7f231c0b1c10 0x7f231c0b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f231bfff640 1 -- 172.21.15.53:0/2128397870 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c15dc40 con 0x7f231c15cc60 2024-09-13T18:25:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.261+0000 7f2320c34640 1 --2- 172.21.15.53:0/2128397870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c15a470 0x7f231c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f231bfff640 1 --2- 172.21.15.53:0/2128397870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c071060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f231c0cbe60 tx=0x7f231001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adb6fb18d988832 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f231b7fe640 1 -- 172.21.15.53:0/2128397870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100aa640 con 0x7f231c15cc60 2024-09-13T18:25:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f231b7fe640 1 -- 172.21.15.53:0/2128397870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23100aa7a0 con 0x7f231c15cc60 2024-09-13T18:25:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f231b7fe640 1 -- 172.21.15.53:0/2128397870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100aab30 con 0x7f231c15cc60 2024-09-13T18:25:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- 172.21.15.53:0/2128397870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 msgr2=0x7f231c071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 --2- 172.21.15.53:0/2128397870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c071060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f231c0cbe60 tx=0x7f231001c520 comp rx=0 tx=0).stop 2024-09-13T18:25:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- 172.21.15.53:0/2128397870 shutdown_connections 2024-09-13T18:25:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 --2- 172.21.15.53:0/2128397870 >> v2:172.21.15.87:3300/0 conn(0x7f231c0b1c10 0x7f231c0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 --2- 172.21.15.53:0/2128397870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c071060 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 --2- 172.21.15.53:0/2128397870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c15a470 0x7f231c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- 172.21.15.53:0/2128397870 >> 172.21.15.53:0/2128397870 conn(0x7f231c065c80 msgr2=0x7f231c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:07.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- 172.21.15.53:0/2128397870 shutdown_connections 2024-09-13T18:25:07.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- 172.21.15.53:0/2128397870 wait complete. 2024-09-13T18:25:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 Processor -- start 2024-09-13T18:25:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- start start 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0b1c10 0x7f231c153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c15a470 0x7f231c14d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c153370 con 0x7f231c15cc60 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c1593b0 con 0x7f231c15a470 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c152410 con 0x7f231c0b1c10 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57516/0 (socket says 172.21.15.53:57516) 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 -- 172.21.15.53:0/692212846 learned_addr learned my addr 172.21.15.53:0/692212846 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2320c34640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0b1c10 0x7f231c153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f231bfff640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c15a470 0x7f231c14d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 -- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0b1c10 msgr2=0x7f231c153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0b1c10 0x7f231c153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 -- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c15a470 msgr2=0x7f231c14d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c15a470 0x7f231c14d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 -- 172.21.15.53:0/692212846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23100094d0 con 0x7f231c15cc60 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2320c34640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0b1c10 0x7f231c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2321435640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c155070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2314007e60 tx=0x7f231400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f23197fa640 1 -- 172.21.15.53:0/692212846 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314014620 con 0x7f231c15cc60 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f23197fa640 1 -- 172.21.15.53:0/692212846 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231400ee90 con 0x7f231c15cc60 2024-09-13T18:25:07.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c1526f0 con 0x7f231c15cc60 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f23197fa640 1 -- 172.21.15.53:0/692212846 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140149e0 con 0x7f231c15cc60 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.265+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c152cb0 con 0x7f231c15cc60 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.269+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c067400 con 0x7f231c15cc60 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.269+0000 7f23197fa640 1 -- 172.21.15.53:0/692212846 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2314014b40 con 0x7f231c15cc60 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.269+0000 7f23197fa640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2308066690 0x7f2308068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.269+0000 7f23197fa640 1 -- 172.21.15.53:0/692212846 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2314084a60 con 0x7f231c15cc60 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.269+0000 7f2320c34640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2308066690 0x7f2308068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.269+0000 7f2320c34640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2308066690 0x7f2308068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f230c008930 tx=0x7f230c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.273+0000 7f23197fa640 1 -- 172.21.15.53:0/692212846 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2314051e60 con 0x7f231c15cc60 2024-09-13T18:25:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.461+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f231c070870 con 0x7f231c15cc60 2024-09-13T18:25:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.461+0000 7f23197fa640 1 -- 172.21.15.53:0/692212846 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2314055480 con 0x7f231c15cc60 2024-09-13T18:25:07.466 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:07.466 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:25:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2308066690 msgr2=0x7f2308068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2308066690 0x7f2308068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f230c008930 tx=0x7f230c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 msgr2=0x7f231c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c155070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2314007e60 tx=0x7f231400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 shutdown_connections 2024-09-13T18:25:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2308066690 0x7f2308068b50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f231c15cc60 0x7f231c155070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f231c15a470 0x7f231c14d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 --2- 172.21.15.53:0/692212846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f231c0b1c10 0x7f231c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 >> 172.21.15.53:0/692212846 conn(0x7f231c065c80 msgr2=0x7f231c066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 shutdown_connections 2024-09-13T18:25:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.465+0000 7f2322e98640 1 -- 172.21.15.53:0/692212846 wait complete. 2024-09-13T18:25:07.483 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:25:07.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:07.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.593+0000 7f662be35640 1 Processor -- start 2024-09-13T18:25:07.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.593+0000 7f662be35640 1 -- start start 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662be35640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f662415cab0 0x7f66240d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662be35640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 0x7f66240cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662be35640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66240d2400 con 0x7f66240cdb00 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662be35640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66240d1530 con 0x7f662415cab0 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662be35640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240d0920 con 0x7f66240cd6c0 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662a3d2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66240cdb00 0x7f66240b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46538/0 (socket says 172.21.15.53:46538) 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662a3d2640 1 -- 172.21.15.53:0/703082467 learned_addr learned my addr 172.21.15.53:0/703082467 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6629bd1640 1 --2- 172.21.15.53:0/703082467 >> v2:172.21.15.87:3300/0 conn(0x7f662415cab0 0x7f66240d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f66293d0640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 0x7f66240cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137331054 0 0) 0x7f66240d2400 con 0x7f66240cdb00 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f660c003530 con 0x7f66240cdb00 2024-09-13T18:25:07.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2993418287 0 0) 0x7f660c003530 con 0x7f66240cdb00 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 msgr2=0x7f66240cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 0x7f66240cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 >> v2:172.21.15.87:3300/0 conn(0x7f662415cab0 msgr2=0x7f66240d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 --2- 172.21.15.53:0/703082467 >> v2:172.21.15.87:3300/0 conn(0x7f662415cab0 0x7f66240d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240d0c00 con 0x7f66240cdb00 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f661c001680 con 0x7f66240cdb00 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 >> v1:172.21.15.53:6789/0 conn(0x7f66240cdb00 legacy=0x7f66240b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c003980 0x7f660c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 0x7f660c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c004d10 0x7f660c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66240d1530 con 0x7f660c003980 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66240d0920 con 0x7f660c004d10 2024-09-13T18:25:07.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c00b990 con 0x7f66240cd6c0 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6629bd1640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c003980 0x7f660c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662a3d2640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c004d10 0x7f660c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6629bd1640 1 -- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 msgr2=0x7f660c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f66293d0640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 0x7f660c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6629bd1640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 0x7f660c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6629bd1640 1 -- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c004d10 msgr2=0x7f660c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6629bd1640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c004d10 0x7f660c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f6629bd1640 1 -- 172.21.15.53:0/703082467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c003530 con 0x7f660c003980 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f662a3d2640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c004d10 0x7f660c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:07.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.597+0000 7f66293d0640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66240cd6c0 0x7f660c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:07.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f6629bd1640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c003980 0x7f660c003da0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f661400e170 tx=0x7f661401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad80def119820ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66140a5c60 con 0x7f660c003980 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661400f040 con 0x7f660c003980 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f6628bcf640 1 -- 172.21.15.53:0/703082467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66140ad440 con 0x7f660c003980 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- 172.21.15.53:0/703082467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c003980 msgr2=0x7f660c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 --2- 172.21.15.53:0/703082467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f660c003980 0x7f660c003da0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f661400e170 tx=0x7f661401cc70 comp rx=0 tx=0).stop 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 -- 172.21.15.53:0/703082467 reap_dead start 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- 172.21.15.53:0/703082467 shutdown_connections 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- 172.21.15.53:0/703082467 >> 172.21.15.53:0/703082467 conn(0x7f6624065c80 msgr2=0x7f6624066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- 172.21.15.53:0/703082467 shutdown_connections 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- 172.21.15.53:0/703082467 wait complete. 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 Processor -- start 2024-09-13T18:25:07.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- start start 2024-09-13T18:25:07.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c003980 0x7f6624147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6624148e10 0x7f6624149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662414ac80 0x7f662414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662414b640 con 0x7f662414ac80 2024-09-13T18:25:07.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624147d70 con 0x7f660c003980 2024-09-13T18:25:07.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662be35640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6624148050 con 0x7f6624148e10 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662414ac80 0x7f662414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662414ac80 0x7f662414b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57548/0 (socket says 172.21.15.53:57548) 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 -- 172.21.15.53:0/1017009361 learned_addr learned my addr 172.21.15.53:0/1017009361 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f6629bd1640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c003980 0x7f6624147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f66293d0640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6624148e10 0x7f6624149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 -- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6624148e10 msgr2=0x7f6624149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6624148e10 0x7f6624149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 -- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c003980 msgr2=0x7f6624147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c003980 0x7f6624147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 -- 172.21.15.53:0/1017009361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624148330 con 0x7f662414ac80 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f6629bd1640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c003980 0x7f6624147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.601+0000 7f662a3d2640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662414ac80 0x7f662414b100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f661c000fc0 tx=0x7f661c00d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f66227fc640 1 -- 172.21.15.53:0/1017009361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c007440 con 0x7f662414ac80 2024-09-13T18:25:07.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f66227fc640 1 -- 172.21.15.53:0/1017009361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c0075a0 con 0x7f662414ac80 2024-09-13T18:25:07.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6624148610 con 0x7f662414ac80 2024-09-13T18:25:07.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f66227fc640 1 -- 172.21.15.53:0/1017009361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c004a30 con 0x7f662414ac80 2024-09-13T18:25:07.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66240b76e0 con 0x7f662414ac80 2024-09-13T18:25:07.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662415c560 con 0x7f662414ac80 2024-09-13T18:25:07.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f66227fc640 1 -- 172.21.15.53:0/1017009361 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f661c004b90 con 0x7f662414ac80 2024-09-13T18:25:07.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f66227fc640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66100666c0 0x7f6610068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f66227fc640 1 -- 172.21.15.53:0/1017009361 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f661c083dc0 con 0x7f662414ac80 2024-09-13T18:25:07.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f6629bd1640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66100666c0 0x7f6610068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.605+0000 7f6629bd1640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66100666c0 0x7f6610068b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f66140af000 tx=0x7f66140a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.609+0000 7f66227fc640 1 -- 172.21.15.53:0/1017009361 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f661c0510a0 con 0x7f662414ac80 2024-09-13T18:25:07.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.769+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66240d19a0 con 0x7f662414ac80 2024-09-13T18:25:07.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.769+0000 7f66227fc640 1 -- 172.21.15.53:0/1017009361 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f661c0546c0 con 0x7f662414ac80 2024-09-13T18:25:07.773 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:07.773 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66100666c0 msgr2=0x7f6610068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66100666c0 0x7f6610068b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f66140af000 tx=0x7f66140a7040 comp rx=0 tx=0).stop 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662414ac80 msgr2=0x7f662414b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662414ac80 0x7f662414b100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f661c000fc0 tx=0x7f661c00d950 comp rx=0 tx=0).stop 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 shutdown_connections 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66100666c0 0x7f6610068b80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6624148e10 0x7f6624149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f662414ac80 0x7f662414b100 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 --2- 172.21.15.53:0/1017009361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f660c003980 0x7f6624147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 >> 172.21.15.53:0/1017009361 conn(0x7f6624065c80 msgr2=0x7f66240b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:07.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 shutdown_connections 2024-09-13T18:25:07.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.773+0000 7f662be35640 1 -- 172.21.15.53:0/1017009361 wait complete. 2024-09-13T18:25:07.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:07.793 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898fcad640 1 Processor -- start 2024-09-13T18:25:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898fcad640 1 -- start start 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898fcad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8988143e80 0x7f898806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898fcad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 0x7f89880cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898fcad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898806f7a0 con 0x7f89880caee0 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898fcad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898806fd60 con 0x7f8988143e80 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898fcad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89880cb960 con 0x7f89880cda30 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898d248640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f89880caee0 0x7f89880cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46546/0 (socket says 172.21.15.53:46546) 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898d248640 1 -- 172.21.15.53:0/3215695248 learned_addr learned my addr 172.21.15.53:0/3215695248 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898da49640 1 --2- 172.21.15.53:0/3215695248 >> v2:172.21.15.87:3300/0 conn(0x7f8988143e80 0x7f898806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898e24a640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 0x7f89880cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259871910 0 0) 0x7f898806f7a0 con 0x7f89880caee0 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8974003530 con 0x7f89880caee0 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1015271434 0 0) 0x7f8974003530 con 0x7f89880caee0 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 msgr2=0x7f89880cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 0x7f89880cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 >> v2:172.21.15.87:3300/0 conn(0x7f8988143e80 msgr2=0x7f898806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 --2- 172.21.15.53:0/3215695248 >> v2:172.21.15.87:3300/0 conn(0x7f8988143e80 0x7f898806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880cbc40 con 0x7f89880caee0 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8978001680 con 0x7f89880caee0 2024-09-13T18:25:07.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 >> v1:172.21.15.53:6789/0 conn(0x7f89880caee0 legacy=0x7f89880cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8974003980 0x7f8974003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 0x7f89740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8974004d10 0x7f8974005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898806fd60 con 0x7f8974003980 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89880cb960 con 0x7f8974004d10 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897400ba10 con 0x7f89880cda30 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898da49640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8974003980 0x7f8974003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898e24a640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8974004d10 0x7f8974005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898d248640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 0x7f89740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898da49640 1 -- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 msgr2=0x7f89740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898da49640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89880cda30 0x7f89740047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898da49640 1 -- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8974004d10 msgr2=0x7f8974005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898da49640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8974004d10 0x7f8974005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898da49640 1 -- 172.21.15.53:0/3215695248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974003530 con 0x7f8974003980 2024-09-13T18:25:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.917+0000 7f898e24a640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8974004d10 0x7f8974005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898da49640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8974003980 0x7f8974003da0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8984009ae0 tx=0x7f898401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3786be2602dc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840a5560 con 0x7f8974003980 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89840a56c0 con 0x7f8974003980 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898ca47640 1 -- 172.21.15.53:0/3215695248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840a5a70 con 0x7f8974003980 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898fcad640 1 -- 172.21.15.53:0/3215695248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8974003980 msgr2=0x7f8974003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898fcad640 1 --2- 172.21.15.53:0/3215695248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8974003980 0x7f8974003da0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8984009ae0 tx=0x7f898401ca80 comp rx=0 tx=0).stop 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898e24a640 1 -- 172.21.15.53:0/3215695248 reap_dead start 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898fcad640 1 -- 172.21.15.53:0/3215695248 shutdown_connections 2024-09-13T18:25:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898fcad640 1 -- 172.21.15.53:0/3215695248 >> 172.21.15.53:0/3215695248 conn(0x7f8988065c80 msgr2=0x7f8988066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898fcad640 1 -- 172.21.15.53:0/3215695248 shutdown_connections 2024-09-13T18:25:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.921+0000 7f898fcad640 1 -- 172.21.15.53:0/3215695248 wait complete. 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 Processor -- start 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 -- start start 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8988143000 0x7f89880aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89881433e0 0x7f89880a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898815a710 0x7f898815aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89880a94d0 con 0x7f898815a710 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898815b0e0 con 0x7f89881433e0 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89880abd40 con 0x7f8988143000 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898815a710 0x7f898815aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898815a710 0x7f898815aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57572/0 (socket says 172.21.15.53:57572) 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 -- 172.21.15.53:0/3606186215 learned_addr learned my addr 172.21.15.53:0/3606186215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898da49640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8988143000 0x7f89880aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898d248640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89881433e0 0x7f89880a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 -- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8988143000 msgr2=0x7f89880aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8988143000 0x7f89880aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 -- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89881433e0 msgr2=0x7f89880a8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89881433e0 0x7f89880a8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 -- 172.21.15.53:0/3606186215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880aaf70 con 0x7f898815a710 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898d248640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89881433e0 0x7f89880a8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898e24a640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898815a710 0x7f898815aba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89880cc510 tx=0x7f898000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f897e7fc640 1 -- 172.21.15.53:0/3606186215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980017400 con 0x7f898815a710 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f897e7fc640 1 -- 172.21.15.53:0/3606186215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980011040 con 0x7f898815a710 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89880ab250 con 0x7f898815a710 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f897e7fc640 1 -- 172.21.15.53:0/3606186215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800177e0 con 0x7f898815a710 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89880ab810 con 0x7f898815a710 2024-09-13T18:25:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89880abf00 con 0x7f898815a710 2024-09-13T18:25:07.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f897e7fc640 1 -- 172.21.15.53:0/3606186215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8980017940 con 0x7f898815a710 2024-09-13T18:25:07.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f897e7fc640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f896c0666c0 0x7f896c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:07.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.925+0000 7f897e7fc640 1 -- 172.21.15.53:0/3606186215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8980084550 con 0x7f898815a710 2024-09-13T18:25:07.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.929+0000 7f898da49640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f896c0666c0 0x7f896c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:07.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.929+0000 7f898da49640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f896c0666c0 0x7f896c068b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f89840af000 tx=0x7f8984008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:07.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:07.933+0000 7f897e7fc640 1 -- 172.21.15.53:0/3606186215 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8980051950 con 0x7f898815a710 2024-09-13T18:25:08.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.089+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f898815c520 con 0x7f898815a710 2024-09-13T18:25:08.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f897e7fc640 1 -- 172.21.15.53:0/3606186215 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8980054f70 con 0x7f898815a710 2024-09-13T18:25:08.095 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f896c0666c0 msgr2=0x7f896c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f896c0666c0 0x7f896c068b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f89840af000 tx=0x7f8984008040 comp rx=0 tx=0).stop 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898815a710 msgr2=0x7f898815aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898815a710 0x7f898815aba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89880cc510 tx=0x7f898000f4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 shutdown_connections 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f896c0666c0 0x7f896c068b80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898815a710 0x7f898815aba0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89881433e0 0x7f89880a8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 --2- 172.21.15.53:0/3606186215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8988143000 0x7f89880aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 >> 172.21.15.53:0/3606186215 conn(0x7f8988065c80 msgr2=0x7f8988162380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 shutdown_connections 2024-09-13T18:25:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.093+0000 7f898fcad640 1 -- 172.21.15.53:0/3606186215 wait complete. 2024-09-13T18:25:08.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.225+0000 7f89417f5640 1 Processor -- start 2024-09-13T18:25:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.225+0000 7f89417f5640 1 -- start start 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f89417f5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f893c15c830 0x7f893c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f89417f5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c0b7db0 con 0x7f893c0ccd10 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f89417f5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c0d0650 con 0x7f893c0d3390 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f89417f5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c0d0c10 con 0x7f893c15c830 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893a7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f893c0ccd10 0x7f893c0d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46550/0 (socket says 172.21.15.53:46550) 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893a7fc640 1 -- 172.21.15.53:0/2269391242 learned_addr learned my addr 172.21.15.53:0/2269391242 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893affd640 1 --2- 172.21.15.53:0/2269391242 >> v2:172.21.15.87:3300/0 conn(0x7f893c15c830 0x7f893c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546454983 0 0) 0x7f893c0b7db0 con 0x7f893c0ccd10 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8928003530 con 0x7f893c0ccd10 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070024275 0 0) 0x7f8928003530 con 0x7f893c0ccd10 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 >> v2:172.21.15.87:3300/0 conn(0x7f893c15c830 msgr2=0x7f893c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 --2- 172.21.15.53:0/2269391242 >> v2:172.21.15.87:3300/0 conn(0x7f893c15c830 0x7f893c0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 >> v1:172.21.15.87:6789/0 conn(0x7f893c0d3390 legacy=0x7f893c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0cd7d0 con 0x7f893c0ccd10 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8924001680 con 0x7f893c0ccd10 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 >> v1:172.21.15.53:6789/0 conn(0x7f893c0ccd10 legacy=0x7f893c0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f8928003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89280047d0 0x7f8928004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8928005190 0x7f892800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c0d0c10 con 0x7f8928003980 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892800c030 con 0x7f89280047d0 2024-09-13T18:25:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892800c1f0 con 0x7f8928005190 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893affd640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f8928003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893a7fc640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89280047d0 0x7f8928004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893affd640 1 -- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8928005190 msgr2=0x7f892800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893affd640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8928005190 0x7f892800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893affd640 1 -- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89280047d0 msgr2=0x7f8928004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893affd640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89280047d0 0x7f8928004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893affd640 1 -- 172.21.15.53:0/2269391242 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928003530 con 0x7f8928003980 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893b7fe640 1 -- 172.21.15.53:0/2269391242 reap_dead start 2024-09-13T18:25:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.229+0000 7f893a7fc640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89280047d0 0x7f8928004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:08.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f8928003da0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f892c009ae0 tx=0x7f892c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f062d7901443b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0a5570 con 0x7f8928003980 2024-09-13T18:25:08.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c0a56d0 con 0x7f8928003980 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f8939ffb640 1 -- 172.21.15.53:0/2269391242 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0a5a80 con 0x7f8928003980 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- 172.21.15.53:0/2269391242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 msgr2=0x7f8928003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f8928003da0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f892c009ae0 tx=0x7f892c01cab0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- 172.21.15.53:0/2269391242 shutdown_connections 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 --2- 172.21.15.53:0/2269391242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f8928003da0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- 172.21.15.53:0/2269391242 >> 172.21.15.53:0/2269391242 conn(0x7f893c070970 msgr2=0x7f893c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- 172.21.15.53:0/2269391242 shutdown_connections 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- 172.21.15.53:0/2269391242 wait complete. 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 Processor -- start 2024-09-13T18:25:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- start start 2024-09-13T18:25:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f893c153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f893c1554e0 0x7f893c155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f893c0c61f0 0x7f893c0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c15b840 con 0x7f8928003980 2024-09-13T18:25:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c155e80 con 0x7f893c1554e0 2024-09-13T18:25:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89417f5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c1541a0 con 0x7f893c0c61f0 2024-09-13T18:25:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f893c153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f893c153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57592/0 (socket says 172.21.15.53:57592) 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 -- 172.21.15.53:0/2237556426 learned_addr learned my addr 172.21.15.53:0/2237556426 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893a7fc640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f893c1554e0 0x7f893c155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893b7fe640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f893c0c61f0 0x7f893c0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 -- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f893c0c61f0 msgr2=0x7f893c0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f893c0c61f0 0x7f893c0c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 -- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f893c1554e0 msgr2=0x7f893c155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f893c1554e0 0x7f893c155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 -- 172.21.15.53:0/2237556426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0c6bb0 con 0x7f8928003980 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893a7fc640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f893c1554e0 0x7f893c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f893affd640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f893c153c60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f892c01c8e0 tx=0x7f8928005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.233+0000 7f89337fe640 1 -- 172.21.15.53:0/2237556426 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0be070 con 0x7f8928003980 2024-09-13T18:25:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89337fe640 1 -- 172.21.15.53:0/2237556426 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c00f000 con 0x7f8928003980 2024-09-13T18:25:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c0c6e40 con 0x7f8928003980 2024-09-13T18:25:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89337fe640 1 -- 172.21.15.53:0/2237556426 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0a5570 con 0x7f8928003980 2024-09-13T18:25:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c0c7400 con 0x7f8928003980 2024-09-13T18:25:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c0b56a0 con 0x7f8928003980 2024-09-13T18:25:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89337fe640 1 -- 172.21.15.53:0/2237556426 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f892c0b4040 con 0x7f8928003980 2024-09-13T18:25:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89337fe640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f891c066690 0x7f891c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f89337fe640 1 -- 172.21.15.53:0/2237556426 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f892c11e3b0 con 0x7f8928003980 2024-09-13T18:25:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f893a7fc640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f891c066690 0x7f891c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.237+0000 7f893a7fc640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f891c066690 0x7f891c068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f893c15b440 tx=0x7f8924009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.241+0000 7f89337fe640 1 -- 172.21.15.53:0/2237556426 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f892c0eb820 con 0x7f8928003980 2024-09-13T18:25:08.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.389+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f893c0b66d0 con 0x7f8928003980 2024-09-13T18:25:08.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89337fe640 1 -- 172.21.15.53:0/2237556426 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f892c0eee40 con 0x7f8928003980 2024-09-13T18:25:08.394 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f891c066690 msgr2=0x7f891c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f891c066690 0x7f891c068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f893c15b440 tx=0x7f8924009040 comp rx=0 tx=0).stop 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 msgr2=0x7f893c153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f893c153c60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f892c01c8e0 tx=0x7f8928005800 comp rx=0 tx=0).stop 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 shutdown_connections 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f891c066690 0x7f891c068b50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f893c0c61f0 0x7f893c0c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f893c1554e0 0x7f893c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 --2- 172.21.15.53:0/2237556426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8928003980 0x7f893c153c60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 >> 172.21.15.53:0/2237556426 conn(0x7f893c070970 msgr2=0x7f893c0d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:08.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 shutdown_connections 2024-09-13T18:25:08.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.393+0000 7f89417f5640 1 -- 172.21.15.53:0/2237556426 wait complete. 2024-09-13T18:25:08.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:08.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc8dbf640 1 Processor -- start 2024-09-13T18:25:08.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc8dbf640 1 -- start start 2024-09-13T18:25:08.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc8dbf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbfc4156c40 0x7fbfc4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc8dbf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbfc4157020 0x7fbfc406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc8dbf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc406d6e0 con 0x7fbfc406d270 2024-09-13T18:25:08.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc8dbf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc4070340 con 0x7fbfc4156c40 2024-09-13T18:25:08.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc8dbf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc40b15a0 con 0x7fbfc4157020 2024-09-13T18:25:08.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbfc4156c40 0x7fbfc4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbfc4156c40 0x7fbfc4070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57598/0 (socket says 172.21.15.53:57598) 2024-09-13T18:25:08.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 -- 172.21.15.53:0/3015698878 learned_addr learned my addr 172.21.15.53:0/3015698878 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:08.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfb9d9b640 1 --2- 172.21.15.53:0/3015698878 >> v2:172.21.15.87:3300/0 conn(0x7fbfc4157020 0x7fbfc406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 -- 172.21.15.53:0/3015698878 >> v2:172.21.15.87:3300/0 conn(0x7fbfc4157020 msgr2=0x7fbfc406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:08.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 --2- 172.21.15.53:0/3015698878 >> v2:172.21.15.87:3300/0 conn(0x7fbfc4157020 0x7fbfc406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 -- 172.21.15.53:0/3015698878 >> v1:172.21.15.87:6789/0 conn(0x7fbfc406d270 legacy=0x7fbfc415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 -- 172.21.15.53:0/3015698878 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40b1880 con 0x7fbfc4156c40 2024-09-13T18:25:08.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc259c640 1 --2- 172.21.15.53:0/3015698878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc4156c40 0x7fbfc4070ee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40cae90 tx=0x7fbfb401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a519bb93e48014e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.525+0000 7fbfc1d9b640 1 -- 172.21.15.53:0/3015698878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40ab610 con 0x7fbfc4156c40 2024-09-13T18:25:08.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc1d9b640 1 -- 172.21.15.53:0/3015698878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40ab770 con 0x7fbfc4156c40 2024-09-13T18:25:08.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc1d9b640 1 -- 172.21.15.53:0/3015698878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40abb00 con 0x7fbfc4156c40 2024-09-13T18:25:08.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/3015698878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc4156c40 msgr2=0x7fbfc4070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/3015698878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc4156c40 0x7fbfc4070ee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40cae90 tx=0x7fbfb401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/3015698878 shutdown_connections 2024-09-13T18:25:08.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/3015698878 >> v2:172.21.15.87:3300/0 conn(0x7fbfc4157020 0x7fbfc406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/3015698878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc4156c40 0x7fbfc4070ee0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/3015698878 >> 172.21.15.53:0/3015698878 conn(0x7fbfc4065c80 msgr2=0x7fbfc4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:08.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/3015698878 shutdown_connections 2024-09-13T18:25:08.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/3015698878 wait complete. 2024-09-13T18:25:08.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 Processor -- start 2024-09-13T18:25:08.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- start start 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc406d270 0x7fbfc4147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfc4156c40 0x7fbfc415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfc41426b0 0x7fbfc4142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc41435e0 con 0x7fbfc406d270 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc41476b0 con 0x7fbfc4156c40 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc8dbf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc41533d0 con 0x7fbfc41426b0 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc406d270 0x7fbfc4147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc406d270 0x7fbfc4147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57602/0 (socket says 172.21.15.53:57602) 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 -- 172.21.15.53:0/2239249186 learned_addr learned my addr 172.21.15.53:0/2239249186 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 -- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfc41426b0 msgr2=0x7fbfc4142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfc41426b0 0x7fbfc4142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 -- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfc4156c40 msgr2=0x7fbfc415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfc4156c40 0x7fbfc415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.529+0000 7fbfc259c640 1 -- 172.21.15.53:0/2239249186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40094d0 con 0x7fbfc406d270 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfc259c640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc406d270 0x7fbfc4147ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4019100 tx=0x7fbfb401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfbb7fe640 1 -- 172.21.15.53:0/2239249186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40ab610 con 0x7fbfc406d270 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfbb7fe640 1 -- 172.21.15.53:0/2239249186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40b4800 con 0x7fbfc406d270 2024-09-13T18:25:08.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfbb7fe640 1 -- 172.21.15.53:0/2239249186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40b4b90 con 0x7fbfc406d270 2024-09-13T18:25:08.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc41430a0 con 0x7fbfc406d270 2024-09-13T18:25:08.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc4146ff0 con 0x7fbfc406d270 2024-09-13T18:25:08.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc4146e50 con 0x7fbfc406d270 2024-09-13T18:25:08.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfbb7fe640 1 -- 172.21.15.53:0/2239249186 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbfb40b4cf0 con 0x7fbfc406d270 2024-09-13T18:25:08.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfbb7fe640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbfa4066690 0x7fbfa4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfbb7fe640 1 -- 172.21.15.53:0/2239249186 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfb411e800 con 0x7fbfc406d270 2024-09-13T18:25:08.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfb9d9b640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbfa4066690 0x7fbfa4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.533+0000 7fbfb9d9b640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbfa4066690 0x7fbfa4068b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4156470 tx=0x7fbfac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.537+0000 7fbfbb7fe640 1 -- 172.21.15.53:0/2239249186 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbfc4146e50 con 0x7fbfc406d270 2024-09-13T18:25:08.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.689+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfc4146e50 con 0x7fbfc406d270 2024-09-13T18:25:08.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfbb7fe640 1 -- 172.21.15.53:0/2239249186 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbfc4146e50 con 0x7fbfc406d270 2024-09-13T18:25:08.694 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbfa4066690 msgr2=0x7fbfa4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbfa4066690 0x7fbfa4068b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4156470 tx=0x7fbfac008040 comp rx=0 tx=0).stop 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc406d270 msgr2=0x7fbfc4147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc406d270 0x7fbfc4147ad0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4019100 tx=0x7fbfb401ad30 comp rx=0 tx=0).stop 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 shutdown_connections 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbfa4066690 0x7fbfa4068b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfc41426b0 0x7fbfc4142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfc4156c40 0x7fbfc415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 --2- 172.21.15.53:0/2239249186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbfc406d270 0x7fbfc4147ad0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 >> 172.21.15.53:0/2239249186 conn(0x7fbfc4065c80 msgr2=0x7fbfc40ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 shutdown_connections 2024-09-13T18:25:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.693+0000 7fbfc8dbf640 1 -- 172.21.15.53:0/2239249186 wait complete. 2024-09-13T18:25:08.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f691da59640 1 Processor -- start 2024-09-13T18:25:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f691da59640 1 -- start start 2024-09-13T18:25:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f691da59640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69181582a0 0x7f691806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f691da59640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69180713a0 0x7f691806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f691da59640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691806d480 con 0x7f691815b7c0 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f691da59640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691815aaf0 con 0x7f69181582a0 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f691da59640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691806d760 con 0x7f69180713a0 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f6916ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69181582a0 0x7f691806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f69167fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f691815b7c0 0x7f6918070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46558/0 (socket says 172.21.15.53:46558) 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f6916ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f69181582a0 0x7f691806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57614/0 (socket says 172.21.15.53:57614) 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f69167fc640 1 -- 172.21.15.53:0/164522227 learned_addr learned my addr 172.21.15.53:0/164522227 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f69177fe640 1 --2- 172.21.15.53:0/164522227 >> v2:172.21.15.87:3300/0 conn(0x7f69180713a0 0x7f691806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f6916ffd640 1 -- 172.21.15.53:0/164522227 >> v2:172.21.15.87:3300/0 conn(0x7f69180713a0 msgr2=0x7f691806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f6916ffd640 1 --2- 172.21.15.53:0/164522227 >> v2:172.21.15.87:3300/0 conn(0x7f69180713a0 0x7f691806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f6916ffd640 1 -- 172.21.15.53:0/164522227 >> v1:172.21.15.53:6789/0 conn(0x7f691815b7c0 legacy=0x7f6918070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f6915ffb640 1 -- 172.21.15.53:0/164522227 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206780695 0 0) 0x7f691806d480 con 0x7f691815b7c0 2024-09-13T18:25:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.837+0000 7f6916ffd640 1 -- 172.21.15.53:0/164522227 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691815ace0 con 0x7f69181582a0 2024-09-13T18:25:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f6916ffd640 1 --2- 172.21.15.53:0/164522227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f691806c900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6918158680 tx=0x7f690801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcd32d40a538b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f6915ffb640 1 -- 172.21.15.53:0/164522227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080a7070 con 0x7f69181582a0 2024-09-13T18:25:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f6915ffb640 1 -- 172.21.15.53:0/164522227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69080ab430 con 0x7f69181582a0 2024-09-13T18:25:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f6915ffb640 1 -- 172.21.15.53:0/164522227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080ab7c0 con 0x7f69181582a0 2024-09-13T18:25:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- 172.21.15.53:0/164522227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 msgr2=0x7f691806c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 --2- 172.21.15.53:0/164522227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f691806c900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6918158680 tx=0x7f690801c430 comp rx=0 tx=0).stop 2024-09-13T18:25:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- 172.21.15.53:0/164522227 shutdown_connections 2024-09-13T18:25:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 --2- 172.21.15.53:0/164522227 >> v2:172.21.15.87:3300/0 conn(0x7f69180713a0 0x7f691806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 --2- 172.21.15.53:0/164522227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f691806c900 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- 172.21.15.53:0/164522227 >> 172.21.15.53:0/164522227 conn(0x7f6918065c80 msgr2=0x7f6918066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- 172.21.15.53:0/164522227 shutdown_connections 2024-09-13T18:25:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- 172.21.15.53:0/164522227 wait complete. 2024-09-13T18:25:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 Processor -- start 2024-09-13T18:25:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- start start 2024-09-13T18:25:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69180713a0 0x7f69181530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f6918135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f691815b7c0 0x7f691814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691814ea70 con 0x7f69181582a0 2024-09-13T18:25:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918152320 con 0x7f691815b7c0 2024-09-13T18:25:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f691da59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6918152600 con 0x7f69180713a0 2024-09-13T18:25:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f69167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f6918135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f69167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f6918135540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57622/0 (socket says 172.21.15.53:57622) 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.841+0000 7f69167fc640 1 -- 172.21.15.53:0/1636607790 learned_addr learned my addr 172.21.15.53:0/1636607790 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69177fe640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f691815b7c0 0x7f691814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f6916ffd640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69180713a0 0x7f69181530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69167fc640 1 -- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69180713a0 msgr2=0x7f69181530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69167fc640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69180713a0 0x7f69181530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69167fc640 1 -- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f691815b7c0 msgr2=0x7f691814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69167fc640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f691815b7c0 0x7f691814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69167fc640 1 -- 172.21.15.53:0/1636607790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009420 con 0x7f69181582a0 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69177fe640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f691815b7c0 0x7f691814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f6916ffd640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69180713a0 0x7f69181530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f69167fc640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f6918135540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f690c00c480 tx=0x7f690c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f68fffff640 1 -- 172.21.15.53:0/1636607790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c0074e0 con 0x7f69181582a0 2024-09-13T18:25:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f68fffff640 1 -- 172.21.15.53:0/1636607790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c007660 con 0x7f69181582a0 2024-09-13T18:25:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f68fffff640 1 -- 172.21.15.53:0/1636607790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c004a30 con 0x7f69181582a0 2024-09-13T18:25:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69181528e0 con 0x7f69181582a0 2024-09-13T18:25:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6918135a80 con 0x7f69181582a0 2024-09-13T18:25:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6918067400 con 0x7f69181582a0 2024-09-13T18:25:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f68fffff640 1 -- 172.21.15.53:0/1636607790 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f690c004b90 con 0x7f69181582a0 2024-09-13T18:25:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f68fffff640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6904066690 0x7f6904068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f68fffff640 1 -- 172.21.15.53:0/1636607790 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f690c0832c0 con 0x7f69181582a0 2024-09-13T18:25:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f6916ffd640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6904066690 0x7f6904068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.845+0000 7f6916ffd640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6904066690 0x7f6904068b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69080af000 tx=0x7f6908008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:08.849+0000 7f68fffff640 1 -- 172.21.15.53:0/1636607790 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f690c054150 con 0x7f69181582a0 2024-09-13T18:25:09.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.041+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6918152e00 con 0x7f69181582a0 2024-09-13T18:25:09.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f68fffff640 1 -- 172.21.15.53:0/1636607790 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7f6918152e00 con 0x7f69181582a0 2024-09-13T18:25:09.047 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:09.047 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:09.047 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6904066690 msgr2=0x7f6904068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6904066690 0x7f6904068b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f69080af000 tx=0x7f6908008040 comp rx=0 tx=0).stop 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 msgr2=0x7f6918135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f6918135540 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f690c00c480 tx=0x7f690c00c940 comp rx=0 tx=0).stop 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 shutdown_connections 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6904066690 0x7f6904068b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f691815b7c0 0x7f691814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69181582a0 0x7f6918135540 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 --2- 172.21.15.53:0/1636607790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69180713a0 0x7f69181530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 >> 172.21.15.53:0/1636607790 conn(0x7f6918065c80 msgr2=0x7f691815a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:09.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 shutdown_connections 2024-09-13T18:25:09.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.045+0000 7f691da59640 1 -- 172.21.15.53:0/1636607790 wait complete. 2024-09-13T18:25:09.065 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f8e0e640 1 Processor -- start 2024-09-13T18:25:09.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f8e0e640 1 -- start start 2024-09-13T18:25:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f8e0e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6f40713a0 0x7fd6f4165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f8e0e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f406d480 con 0x7fd6f41582a0 2024-09-13T18:25:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f8e0e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f415ace0 con 0x7fd6f415b7c0 2024-09-13T18:25:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f8e0e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f415aaf0 con 0x7fd6f40713a0 2024-09-13T18:25:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd6f41582a0 0x7fd6f406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46570/0 (socket says 172.21.15.53:46570) 2024-09-13T18:25:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f259c640 1 -- 172.21.15.53:0/973674968 learned_addr learned my addr 172.21.15.53:0/973674968 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f2d9d640 1 --2- 172.21.15.53:0/973674968 >> v2:172.21.15.53:3300/0 conn(0x7fd6f40713a0 0x7fd6f4165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f159a640 1 -- 172.21.15.53:0/973674968 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585321232 0 0) 0x7fd6f406d480 con 0x7fd6f41582a0 2024-09-13T18:25:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f159a640 1 -- 172.21.15.53:0/973674968 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6dc003530 con 0x7fd6f41582a0 2024-09-13T18:25:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f2d9d640 1 -- 172.21.15.53:0/973674968 >> v1:172.21.15.87:6789/0 conn(0x7fd6f415b7c0 legacy=0x7fd6f4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f2d9d640 1 -- 172.21.15.53:0/973674968 >> v1:172.21.15.53:6789/0 conn(0x7fd6f41582a0 legacy=0x7fd6f406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.177+0000 7fd6f2d9d640 1 -- 172.21.15.53:0/973674968 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f415afc0 con 0x7fd6f40713a0 2024-09-13T18:25:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f2d9d640 1 --2- 172.21.15.53:0/973674968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f40713a0 0x7fd6f4165100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0097c0 tx=0x7fd6ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e7c7826819e4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f159a640 1 -- 172.21.15.53:0/973674968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0ac410 con 0x7fd6f40713a0 2024-09-13T18:25:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f159a640 1 -- 172.21.15.53:0/973674968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec0ac570 con 0x7fd6f40713a0 2024-09-13T18:25:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f159a640 1 -- 172.21.15.53:0/973674968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0ac900 con 0x7fd6f40713a0 2024-09-13T18:25:09.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/973674968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f40713a0 msgr2=0x7fd6f4165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/973674968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f40713a0 0x7fd6f4165100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0097c0 tx=0x7fd6ec01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/973674968 shutdown_connections 2024-09-13T18:25:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/973674968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f40713a0 0x7fd6f4165100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/973674968 >> 172.21.15.53:0/973674968 conn(0x7fd6f4065c80 msgr2=0x7fd6f4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/973674968 shutdown_connections 2024-09-13T18:25:09.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/973674968 wait complete. 2024-09-13T18:25:09.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 Processor -- start 2024-09-13T18:25:09.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- start start 2024-09-13T18:25:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6f40713a0 0x7fd6f4139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6f41582a0 0x7fd6f41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f415b7c0 0x7fd6f40af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f4152340 con 0x7fd6f415b7c0 2024-09-13T18:25:09.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f4150140 con 0x7fd6f41582a0 2024-09-13T18:25:09.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f8e0e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f414f530 con 0x7fd6f40713a0 2024-09-13T18:25:09.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.181+0000 7fd6f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f415b7c0 0x7fd6f40af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f415b7c0 0x7fd6f40af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57630/0 (socket says 172.21.15.53:57630) 2024-09-13T18:25:09.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 -- 172.21.15.53:0/516342177 learned_addr learned my addr 172.21.15.53:0/516342177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:09.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f259c640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6f40713a0 0x7fd6f4139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f1d9b640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6f41582a0 0x7fd6f41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 -- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6f40713a0 msgr2=0x7fd6f4139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6f40713a0 0x7fd6f4139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 -- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6f41582a0 msgr2=0x7fd6f41505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6f41582a0 0x7fd6f41505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 -- 172.21.15.53:0/516342177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009420 con 0x7fd6f415b7c0 2024-09-13T18:25:09.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f1d9b640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6f41582a0 0x7fd6f41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:09.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f2d9d640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f415b7c0 0x7fd6f40af080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0190b0 tx=0x7fd6ec019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6e2ffd640 1 -- 172.21.15.53:0/516342177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec006e20 con 0x7fd6f415b7c0 2024-09-13T18:25:09.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6e2ffd640 1 -- 172.21.15.53:0/516342177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec0b5410 con 0x7fd6f415b7c0 2024-09-13T18:25:09.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f414f810 con 0x7fd6f415b7c0 2024-09-13T18:25:09.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6e2ffd640 1 -- 172.21.15.53:0/516342177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0b57a0 con 0x7fd6f415b7c0 2024-09-13T18:25:09.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f414fdd0 con 0x7fd6f415b7c0 2024-09-13T18:25:09.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f4067400 con 0x7fd6f415b7c0 2024-09-13T18:25:09.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6e2ffd640 1 -- 172.21.15.53:0/516342177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd6ec0b3040 con 0x7fd6f415b7c0 2024-09-13T18:25:09.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6e2ffd640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6d4066690 0x7fd6d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6e2ffd640 1 -- 172.21.15.53:0/516342177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6ec11e1c0 con 0x7fd6f415b7c0 2024-09-13T18:25:09.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.185+0000 7fd6f259c640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6d4066690 0x7fd6d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.189+0000 7fd6f259c640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6d4066690 0x7fd6d4068b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4001570 tx=0x7fd6e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.189+0000 7fd6e2ffd640 1 -- 172.21.15.53:0/516342177 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6ec0eb640 con 0x7fd6f415b7c0 2024-09-13T18:25:09.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.349+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6f41502d0 con 0x7fd6f415b7c0 2024-09-13T18:25:09.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6e2ffd640 1 -- 172.21.15.53:0/516342177 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fd6ec0eec60 con 0x7fd6f415b7c0 2024-09-13T18:25:09.356 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:09.356 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6d4066690 msgr2=0x7fd6d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6d4066690 0x7fd6d4068b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4001570 tx=0x7fd6e4009040 comp rx=0 tx=0).stop 2024-09-13T18:25:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f415b7c0 msgr2=0x7fd6f40af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f415b7c0 0x7fd6f40af080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0190b0 tx=0x7fd6ec019240 comp rx=0 tx=0).stop 2024-09-13T18:25:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 shutdown_connections 2024-09-13T18:25:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6d4066690 0x7fd6d4068b50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f415b7c0 0x7fd6f40af080 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6f41582a0 0x7fd6f41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 --2- 172.21.15.53:0/516342177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6f40713a0 0x7fd6f4139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 >> 172.21.15.53:0/516342177 conn(0x7fd6f4065c80 msgr2=0x7fd6f406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:09.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.353+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 shutdown_connections 2024-09-13T18:25:09.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.357+0000 7fd6f8e0e640 1 -- 172.21.15.53:0/516342177 wait complete. 2024-09-13T18:25:09.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:09.377 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:09.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ef5a640 1 Processor -- start 2024-09-13T18:25:09.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ef5a640 1 -- start start 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ef5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f21280caee0 0x7f21280cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ef5a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21280cd320 0x7f21280cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ef5a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212806f7a0 con 0x7f2128143e80 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ef5a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212806baa0 con 0x7f21280cd320 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ef5a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212806fd60 con 0x7f21280caee0 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212d4f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21280cd320 0x7f21280cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ccf6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2128143e80 0x7f212806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46574/0 (socket says 172.21.15.53:46574) 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212ccf6640 1 -- 172.21.15.53:0/189813911 learned_addr learned my addr 172.21.15.53:0/189813911 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f2127fff640 1 --2- 172.21.15.53:0/189813911 >> v2:172.21.15.87:3300/0 conn(0x7f21280caee0 0x7f21280cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212d4f7640 1 -- 172.21.15.53:0/189813911 >> v2:172.21.15.87:3300/0 conn(0x7f21280caee0 msgr2=0x7f21280cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:09.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212d4f7640 1 --2- 172.21.15.53:0/189813911 >> v2:172.21.15.87:3300/0 conn(0x7f21280caee0 0x7f21280cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f21277fe640 1 -- 172.21.15.53:0/189813911 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919024428 0 0) 0x7f212806f7a0 con 0x7f2128143e80 2024-09-13T18:25:09.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212d4f7640 1 -- 172.21.15.53:0/189813911 >> v1:172.21.15.53:6789/0 conn(0x7f2128143e80 legacy=0x7f212806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212d4f7640 1 -- 172.21.15.53:0/189813911 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280cb960 con 0x7f21280cd320 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.505+0000 7f212d4f7640 1 --2- 172.21.15.53:0/189813911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f21280cd780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2120009d90 tx=0x7f212001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43931589cc8ae228 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f21277fe640 1 -- 172.21.15.53:0/189813911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200a5930 con 0x7f21280cd320 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f21277fe640 1 -- 172.21.15.53:0/189813911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21200a5a90 con 0x7f21280cd320 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f21277fe640 1 -- 172.21.15.53:0/189813911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200a5e20 con 0x7f21280cd320 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- 172.21.15.53:0/189813911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 msgr2=0x7f21280cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 --2- 172.21.15.53:0/189813911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f21280cd780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2120009d90 tx=0x7f212001c870 comp rx=0 tx=0).stop 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- 172.21.15.53:0/189813911 shutdown_connections 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 --2- 172.21.15.53:0/189813911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f21280cd780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 --2- 172.21.15.53:0/189813911 >> v2:172.21.15.87:3300/0 conn(0x7f21280caee0 0x7f21280cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- 172.21.15.53:0/189813911 >> 172.21.15.53:0/189813911 conn(0x7f2128065c80 msgr2=0x7f2128066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:09.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- 172.21.15.53:0/189813911 shutdown_connections 2024-09-13T18:25:09.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- 172.21.15.53:0/189813911 wait complete. 2024-09-13T18:25:09.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 Processor -- start 2024-09-13T18:25:09.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- start start 2024-09-13T18:25:09.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21280caee0 0x7f2128140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f2128153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2128143e80 0x7f212813d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2128154480 con 0x7f21280cd320 2024-09-13T18:25:09.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2128141220 con 0x7f21280caee0 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2128140c60 con 0x7f2128143e80 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f2128153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f2128153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57642/0 (socket says 172.21.15.53:57642) 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 -- 172.21.15.53:0/1717514161 learned_addr learned my addr 172.21.15.53:0/1717514161 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ccf6640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21280caee0 0x7f2128140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212d4f7640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2128143e80 0x7f212813d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 -- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2128143e80 msgr2=0x7f212813d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2128143e80 0x7f212813d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 -- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21280caee0 msgr2=0x7f2128140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21280caee0 0x7f2128140630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 -- 172.21.15.53:0/1717514161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009a70 con 0x7f21280cd320 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f2127fff640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f2128153f40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f211400d7d0 tx=0x7f211400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f21257fa640 1 -- 172.21.15.53:0/1717514161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114018070 con 0x7f21280cd320 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f21257fa640 1 -- 172.21.15.53:0/1717514161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114004020 con 0x7f21280cd320 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2128140f40 con 0x7f21280cd320 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f21257fa640 1 -- 172.21.15.53:0/1717514161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140041d0 con 0x7f21280cd320 2024-09-13T18:25:09.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.509+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2128158950 con 0x7f21280cd320 2024-09-13T18:25:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.513+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2128158b10 con 0x7f21280cd320 2024-09-13T18:25:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.513+0000 7f21257fa640 1 -- 172.21.15.53:0/1717514161 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2114004330 con 0x7f21280cd320 2024-09-13T18:25:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.513+0000 7f21257fa640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f210c066690 0x7f210c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.513+0000 7f21257fa640 1 -- 172.21.15.53:0/1717514161 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21140849c0 con 0x7f21280cd320 2024-09-13T18:25:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.513+0000 7f212ccf6640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f210c066690 0x7f210c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.513+0000 7f212ccf6640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f210c066690 0x7f210c068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f70 tx=0x7f211c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.517+0000 7f21257fa640 1 -- 172.21.15.53:0/1717514161 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2114051ea0 con 0x7f21280cd320 2024-09-13T18:25:09.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.669+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21280cb350 con 0x7f21280cd320 2024-09-13T18:25:09.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.669+0000 7f21257fa640 1 -- 172.21.15.53:0/1717514161 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21140554c0 con 0x7f21280cd320 2024-09-13T18:25:09.674 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:09.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f210c066690 msgr2=0x7f210c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f210c066690 0x7f210c068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f70 tx=0x7f211c009040 comp rx=0 tx=0).stop 2024-09-13T18:25:09.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 msgr2=0x7f2128153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f2128153f40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f211400d7d0 tx=0x7f211400dc90 comp rx=0 tx=0).stop 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 shutdown_connections 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f210c066690 0x7f210c068b50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2128143e80 0x7f212813d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21280cd320 0x7f2128153f40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 --2- 172.21.15.53:0/1717514161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21280caee0 0x7f2128140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 >> 172.21.15.53:0/1717514161 conn(0x7f2128065c80 msgr2=0x7f2128157660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 shutdown_connections 2024-09-13T18:25:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.673+0000 7f212ef5a640 1 -- 172.21.15.53:0/1717514161 wait complete. 2024-09-13T18:25:09.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:09.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b83e0a640 1 Processor -- start 2024-09-13T18:25:09.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b83e0a640 1 -- start start 2024-09-13T18:25:09.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b83e0a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b7c0b21f0 0x7f6b7c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b83e0a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 0x7f6b7c06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b83e0a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c0b2b10 con 0x7f6b7c160180 2024-09-13T18:25:09.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b83e0a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c06c840 con 0x7f6b7c0b21f0 2024-09-13T18:25:09.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b83e0a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06cb20 con 0x7f6b7c06bad0 2024-09-13T18:25:09.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b7c160180 0x7f6b7c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46584/0 (socket says 172.21.15.53:46584) 2024-09-13T18:25:09.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 -- 172.21.15.53:0/3142568588 learned_addr learned my addr 172.21.15.53:0/3142568588 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:09.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b813a5640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 0x7f6b7c06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b81ba6640 1 --2- 172.21.15.53:0/3142568588 >> v2:172.21.15.87:3300/0 conn(0x7f6b7c0b21f0 0x7f6b7c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050410642 0 0) 0x7f6b7c0b2b10 con 0x7f6b7c160180 2024-09-13T18:25:09.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b68003530 con 0x7f6b7c160180 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137915138 0 0) 0x7f6b68003530 con 0x7f6b7c160180 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 msgr2=0x7f6b7c06bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 0x7f6b7c06bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 >> v2:172.21.15.87:3300/0 conn(0x7f6b7c0b21f0 msgr2=0x7f6b7c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 --2- 172.21.15.53:0/3142568588 >> v2:172.21.15.87:3300/0 conn(0x7f6b7c0b21f0 0x7f6b7c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c06ce00 con 0x7f6b7c160180 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6b74001a00 con 0x7f6b7c160180 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 >> v1:172.21.15.53:6789/0 conn(0x7f6b7c160180 legacy=0x7f6b7c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 0x7f6b68003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b68003f00 0x7f6b680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06c840 con 0x7f6b68004d10 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06cb20 con 0x7f6b68003f00 2024-09-13T18:25:09.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6800b990 con 0x7f6b7c06bad0 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b81ba6640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 0x7f6b68003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b813a5640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b68003f00 0x7f6b680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 -- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 msgr2=0x7f6b68003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c06bad0 0x7f6b68003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 -- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b68003f00 msgr2=0x7f6b680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b68003f00 0x7f6b680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.817+0000 7f6b823a7640 1 -- 172.21.15.53:0/3142568588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68003530 con 0x7f6b68004d10 2024-09-13T18:25:09.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b823a7640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b68005190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400a860 tx=0x7f6b7401d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3031a423585754 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740ad630 con 0x7f6b68004d10 2024-09-13T18:25:09.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b740a8070 con 0x7f6b68004d10 2024-09-13T18:25:09.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b80ba4640 1 -- 172.21.15.53:0/3142568588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740ada50 con 0x7f6b68004d10 2024-09-13T18:25:09.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 -- 172.21.15.53:0/3142568588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 msgr2=0x7f6b68005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 --2- 172.21.15.53:0/3142568588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b68005190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400a860 tx=0x7f6b7401d320 comp rx=0 tx=0).stop 2024-09-13T18:25:09.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b823a7640 1 -- 172.21.15.53:0/3142568588 reap_dead start 2024-09-13T18:25:09.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 -- 172.21.15.53:0/3142568588 shutdown_connections 2024-09-13T18:25:09.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 -- 172.21.15.53:0/3142568588 >> 172.21.15.53:0/3142568588 conn(0x7f6b7c069f50 msgr2=0x7f6b7c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:09.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 -- 172.21.15.53:0/3142568588 shutdown_connections 2024-09-13T18:25:09.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 -- 172.21.15.53:0/3142568588 wait complete. 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 Processor -- start 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.821+0000 7f6b83e0a640 1 -- start start 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b7c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b7c0ad610 0x7f6b7c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c152050 0x7f6b7c1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c152a10 con 0x7f6b68004d10 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0add80 con 0x7f6b7c0ad610 2024-09-13T18:25:09.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0ae060 con 0x7f6b7c152050 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b7c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b7c0b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57658/0 (socket says 172.21.15.53:57658) 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 -- 172.21.15.53:0/834226031 learned_addr learned my addr 172.21.15.53:0/834226031 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b823a7640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c152050 0x7f6b7c1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b813a5640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b7c0ad610 0x7f6b7c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 -- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c152050 msgr2=0x7f6b7c1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c152050 0x7f6b7c1524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 -- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b7c0ad610 msgr2=0x7f6b7c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b7c0ad610 0x7f6b7c150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 -- 172.21.15.53:0/834226031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c0ae340 con 0x7f6b68004d10 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b81ba6640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b7c0b04f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b78011600 tx=0x7f6b78011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b727fc640 1 -- 172.21.15.53:0/834226031 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78009510 con 0x7f6b68004d10 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b727fc640 1 -- 172.21.15.53:0/834226031 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7800f920 con 0x7f6b68004d10 2024-09-13T18:25:09.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c0ae620 con 0x7f6b68004d10 2024-09-13T18:25:09.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b727fc640 1 -- 172.21.15.53:0/834226031 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800fc90 con 0x7f6b68004d10 2024-09-13T18:25:09.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c0ada90 con 0x7f6b68004d10 2024-09-13T18:25:09.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c160630 con 0x7f6b68004d10 2024-09-13T18:25:09.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b727fc640 1 -- 172.21.15.53:0/834226031 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b78015460 con 0x7f6b68004d10 2024-09-13T18:25:09.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b727fc640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b60066690 0x7f6b60068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:09.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b727fc640 1 -- 172.21.15.53:0/834226031 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b780845c0 con 0x7f6b68004d10 2024-09-13T18:25:09.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.825+0000 7f6b813a5640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b60066690 0x7f6b60068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:09.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.829+0000 7f6b813a5640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b60066690 0x7f6b60068b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c09c9c0 tx=0x7f6b6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:09.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.829+0000 7f6b727fc640 1 -- 172.21.15.53:0/834226031 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b780519a0 con 0x7f6b68004d10 2024-09-13T18:25:09.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b7c071a00 con 0x7f6b68004d10 2024-09-13T18:25:09.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b727fc640 1 -- 172.21.15.53:0/834226031 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b7800fdf0 con 0x7f6b68004d10 2024-09-13T18:25:09.988 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b60066690 msgr2=0x7f6b60068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b60066690 0x7f6b60068b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c09c9c0 tx=0x7f6b6c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 msgr2=0x7f6b7c0b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b7c0b04f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b78011600 tx=0x7f6b78011ac0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 shutdown_connections 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b60066690 0x7f6b60068b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b7c152050 0x7f6b7c1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b7c0ad610 0x7f6b7c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 --2- 172.21.15.53:0/834226031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b68004d10 0x7f6b7c0b04f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:09.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 >> 172.21.15.53:0/834226031 conn(0x7f6b7c069f50 msgr2=0x7f6b7c1510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:09.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 shutdown_connections 2024-09-13T18:25:09.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:09.985+0000 7f6b83e0a640 1 -- 172.21.15.53:0/834226031 wait complete. 2024-09-13T18:25:10.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:10.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ce862640 1 Processor -- start 2024-09-13T18:25:10.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ce862640 1 -- start start 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ce862640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c80cf040 0x7fb0c8070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ce862640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0c80709a0 0x7fb0c80cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ce862640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c806d690 con 0x7fb0c81592d0 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ce862640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c8070e30 con 0x7fb0c80709a0 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ce862640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c806c5f0 con 0x7fb0c80cf040 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0c7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0c81592d0 0x7fb0c806dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46600/0 (socket says 172.21.15.53:46600) 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0c7fff640 1 -- 172.21.15.53:0/914279464 learned_addr learned my addr 172.21.15.53:0/914279464 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:10.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ccdff640 1 --2- 172.21.15.53:0/914279464 >> v2:172.21.15.53:3300/0 conn(0x7fb0c80709a0 0x7fb0c80cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0c77fe640 1 --2- 172.21.15.53:0/914279464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c80cf040 0x7fb0c8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0c6ffd640 1 -- 172.21.15.53:0/914279464 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107234820 0 0) 0x7fb0c806d690 con 0x7fb0c81592d0 2024-09-13T18:25:10.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0c6ffd640 1 -- 172.21.15.53:0/914279464 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b0005740 con 0x7fb0c81592d0 2024-09-13T18:25:10.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ccdff640 1 -- 172.21.15.53:0/914279464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c80cf040 msgr2=0x7fb0c8070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:10.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ccdff640 1 --2- 172.21.15.53:0/914279464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c80cf040 0x7fb0c8070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ccdff640 1 -- 172.21.15.53:0/914279464 >> v1:172.21.15.53:6789/0 conn(0x7fb0c81592d0 legacy=0x7fb0c806dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.129+0000 7fb0ccdff640 1 -- 172.21.15.53:0/914279464 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c806c8d0 con 0x7fb0c80709a0 2024-09-13T18:25:10.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ccdff640 1 --2- 172.21.15.53:0/914279464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80709a0 0x7fb0c80cd410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097c0 tx=0x7fb0b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4e826b6f6f1650 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0c6ffd640 1 -- 172.21.15.53:0/914279464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80ab600 con 0x7fb0c80709a0 2024-09-13T18:25:10.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0c6ffd640 1 -- 172.21.15.53:0/914279464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b80a7050 con 0x7fb0c80709a0 2024-09-13T18:25:10.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0c6ffd640 1 -- 172.21.15.53:0/914279464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80ab980 con 0x7fb0c80709a0 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 -- 172.21.15.53:0/914279464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80709a0 msgr2=0x7fb0c80cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 --2- 172.21.15.53:0/914279464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80709a0 0x7fb0c80cd410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097c0 tx=0x7fb0b801c410 comp rx=0 tx=0).stop 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 -- 172.21.15.53:0/914279464 shutdown_connections 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 --2- 172.21.15.53:0/914279464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80709a0 0x7fb0c80cd410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 --2- 172.21.15.53:0/914279464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c80cf040 0x7fb0c8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 -- 172.21.15.53:0/914279464 >> 172.21.15.53:0/914279464 conn(0x7fb0c80b1310 msgr2=0x7fb0c80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 -- 172.21.15.53:0/914279464 shutdown_connections 2024-09-13T18:25:10.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 -- 172.21.15.53:0/914279464 wait complete. 2024-09-13T18:25:10.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 Processor -- start 2024-09-13T18:25:10.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.133+0000 7fb0ce862640 1 -- start start 2024-09-13T18:25:10.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80709a0 0x7fb0c81450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80cf040 0x7fb0c814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c81592d0 0x7fb0c815b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c814b890 con 0x7fb0c80cf040 2024-09-13T18:25:10.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c81455f0 con 0x7fb0c80709a0 2024-09-13T18:25:10.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c814ac10 con 0x7fb0c81592d0 2024-09-13T18:25:10.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80cf040 0x7fb0c814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80cf040 0x7fb0c814bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57672/0 (socket says 172.21.15.53:57672) 2024-09-13T18:25:10.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 -- 172.21.15.53:0/1418120335 learned_addr learned my addr 172.21.15.53:0/1418120335 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 -- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c81592d0 msgr2=0x7fb0c815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c81592d0 0x7fb0c815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c7fff640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80709a0 0x7fb0c81450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 -- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80709a0 msgr2=0x7fb0c81450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80709a0 0x7fb0c81450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 -- 172.21.15.53:0/1418120335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b8009420 con 0x7fb0c80cf040 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c77fe640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80cf040 0x7fb0c814bcb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00efc0 tx=0x7fb0bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c4ff9640 1 -- 172.21.15.53:0/1418120335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc009be0 con 0x7fb0c80cf040 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c4ff9640 1 -- 172.21.15.53:0/1418120335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc00f040 con 0x7fb0c80cf040 2024-09-13T18:25:10.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c814aef0 con 0x7fb0c80cf040 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c4ff9640 1 -- 172.21.15.53:0/1418120335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc014680 con 0x7fb0c80cf040 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c814b4b0 con 0x7fb0c80cf040 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c80cec90 con 0x7fb0c80cf040 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c4ff9640 1 -- 172.21.15.53:0/1418120335 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0bc0147e0 con 0x7fb0c80cf040 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c4ff9640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0b4066690 0x7fb0b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c4ff9640 1 -- 172.21.15.53:0/1418120335 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0bc084fc0 con 0x7fb0c80cf040 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.137+0000 7fb0c7fff640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0b4066690 0x7fb0b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.141+0000 7fb0c7fff640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0b4066690 0x7fb0b4068b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00011f0 tx=0x7fb0c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.141+0000 7fb0c4ff9640 1 -- 172.21.15.53:0/1418120335 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0bc0b6db0 con 0x7fb0c80cf040 2024-09-13T18:25:10.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.301+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0c80cd410 con 0x7fb0c80cf040 2024-09-13T18:25:10.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.301+0000 7fb0c4ff9640 1 -- 172.21.15.53:0/1418120335 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0bc055e30 con 0x7fb0c80cf040 2024-09-13T18:25:10.304 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0b4066690 msgr2=0x7fb0b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0b4066690 0x7fb0b4068b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00011f0 tx=0x7fb0c0009040 comp rx=0 tx=0).stop 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80cf040 msgr2=0x7fb0c814bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80cf040 0x7fb0c814bcb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00efc0 tx=0x7fb0bc00c490 comp rx=0 tx=0).stop 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 shutdown_connections 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0b4066690 0x7fb0b4068b50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0c81592d0 0x7fb0c815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0c80cf040 0x7fb0c814bcb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 --2- 172.21.15.53:0/1418120335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0c80709a0 0x7fb0c81450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 >> 172.21.15.53:0/1418120335 conn(0x7fb0c80b1310 msgr2=0x7fb0c81596b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:10.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 shutdown_connections 2024-09-13T18:25:10.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.305+0000 7fb0ce862640 1 -- 172.21.15.53:0/1418120335 wait complete. 2024-09-13T18:25:10.324 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:10.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 Processor -- start 2024-09-13T18:25:10.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 -- start start 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae481582a0 0x7fae4806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fae4815b7c0 0x7fae4806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae48071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4815aaf0 con 0x7fae481582a0 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4806d760 con 0x7fae4815b7c0 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.445+0000 7fae4e038640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae48071650 con 0x7fae48070c90 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae481582a0 0x7fae4806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae481582a0 0x7fae4806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57676/0 (socket says 172.21.15.53:57676) 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 -- 172.21.15.53:0/1131578855 learned_addr learned my addr 172.21.15.53:0/1131578855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae46ffd640 1 --2- 172.21.15.53:0/1131578855 >> v2:172.21.15.87:3300/0 conn(0x7fae4815b7c0 0x7fae4806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae47fff640 1 --2- 172.21.15.53:0/1131578855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae48071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 -- 172.21.15.53:0/1131578855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 msgr2=0x7fae48071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:10.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 --2- 172.21.15.53:0/1131578855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae48071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 -- 172.21.15.53:0/1131578855 >> v2:172.21.15.87:3300/0 conn(0x7fae4815b7c0 msgr2=0x7fae4806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:10.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 --2- 172.21.15.53:0/1131578855 >> v2:172.21.15.87:3300/0 conn(0x7fae4815b7c0 0x7fae4806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 -- 172.21.15.53:0/1131578855 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4806d480 con 0x7fae481582a0 2024-09-13T18:25:10.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae47fff640 1 --2- 172.21.15.53:0/1131578855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae48071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:10.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae477fe640 1 --2- 172.21.15.53:0/1131578855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae4806c900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae480ce220 tx=0x7fae3801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15051302ac325f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae467fc640 1 -- 172.21.15.53:0/1131578855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380a5840 con 0x7fae481582a0 2024-09-13T18:25:10.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae467fc640 1 -- 172.21.15.53:0/1131578855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae380a59a0 con 0x7fae481582a0 2024-09-13T18:25:10.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae467fc640 1 -- 172.21.15.53:0/1131578855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380a5d30 con 0x7fae481582a0 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 -- 172.21.15.53:0/1131578855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 msgr2=0x7fae4806c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 --2- 172.21.15.53:0/1131578855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae4806c900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae480ce220 tx=0x7fae3801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 -- 172.21.15.53:0/1131578855 shutdown_connections 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 --2- 172.21.15.53:0/1131578855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae48071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 --2- 172.21.15.53:0/1131578855 >> v2:172.21.15.87:3300/0 conn(0x7fae4815b7c0 0x7fae4806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 --2- 172.21.15.53:0/1131578855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae4806c900 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 -- 172.21.15.53:0/1131578855 >> 172.21.15.53:0/1131578855 conn(0x7fae48065c80 msgr2=0x7fae48066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:10.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 -- 172.21.15.53:0/1131578855 shutdown_connections 2024-09-13T18:25:10.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.449+0000 7fae4e038640 1 -- 172.21.15.53:0/1131578855 wait complete. 2024-09-13T18:25:10.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 Processor -- start 2024-09-13T18:25:10.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 -- start start 2024-09-13T18:25:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae481f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae480cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae4815b7c0 0x7fae480cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae481f3700 con 0x7fae481582a0 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae481524b0 con 0x7fae4815b7c0 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae48152790 con 0x7fae48070c90 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae480cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae480cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57678/0 (socket says 172.21.15.53:57678) 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 -- 172.21.15.53:0/2264619908 learned_addr learned my addr 172.21.15.53:0/2264619908 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae477fe640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae481f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae47fff640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae4815b7c0 0x7fae480cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 -- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 msgr2=0x7fae481f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae481f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 -- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae4815b7c0 msgr2=0x7fae480cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae4815b7c0 0x7fae480cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 -- 172.21.15.53:0/2264619908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38009b30 con 0x7fae481582a0 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae47fff640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae4815b7c0 0x7fae480cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae46ffd640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae480cc270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00e870 tx=0x7fae3c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae2ffff640 1 -- 172.21.15.53:0/2264619908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c009510 con 0x7fae481582a0 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae48152a70 con 0x7fae481582a0 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae2ffff640 1 -- 172.21.15.53:0/2264619908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c00eec0 con 0x7fae481582a0 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae2ffff640 1 -- 172.21.15.53:0/2264619908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00cb40 con 0x7fae481582a0 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.453+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae48153030 con 0x7fae481582a0 2024-09-13T18:25:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.457+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae48067400 con 0x7fae481582a0 2024-09-13T18:25:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.457+0000 7fae2ffff640 1 -- 172.21.15.53:0/2264619908 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae3c00cca0 con 0x7fae481582a0 2024-09-13T18:25:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.457+0000 7fae2ffff640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fae34066690 0x7fae34068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.457+0000 7fae2ffff640 1 -- 172.21.15.53:0/2264619908 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae3c0841d0 con 0x7fae481582a0 2024-09-13T18:25:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.457+0000 7fae477fe640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fae34066690 0x7fae34068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.457+0000 7fae477fe640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fae34066690 0x7fae34068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae380ae000 tx=0x7fae380a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.461+0000 7fae2ffff640 1 -- 172.21.15.53:0/2264619908 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fae3c051600 con 0x7fae481582a0 2024-09-13T18:25:10.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae480700e0 con 0x7fae481582a0 2024-09-13T18:25:10.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae2ffff640 1 -- 172.21.15.53:0/2264619908 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7fae3c054c20 con 0x7fae481582a0 2024-09-13T18:25:10.655 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:10.656 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:10.656 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fae34066690 msgr2=0x7fae34068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fae34066690 0x7fae34068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae380ae000 tx=0x7fae380a7070 comp rx=0 tx=0).stop 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 msgr2=0x7fae480cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae480cc270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00e870 tx=0x7fae3c00ec70 comp rx=0 tx=0).stop 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 shutdown_connections 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fae34066690 0x7fae34068b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae4815b7c0 0x7fae480cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae481582a0 0x7fae480cc270 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 --2- 172.21.15.53:0/2264619908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae48070c90 0x7fae481f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 >> 172.21.15.53:0/2264619908 conn(0x7fae48065c80 msgr2=0x7fae480af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 shutdown_connections 2024-09-13T18:25:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.653+0000 7fae4e038640 1 -- 172.21.15.53:0/2264619908 wait complete. 2024-09-13T18:25:10.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:10.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 Processor -- start 2024-09-13T18:25:10.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 -- start start 2024-09-13T18:25:10.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cb980 0x7fec600b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fec6006b850 0x7fec600cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec600cbd60 0x7fec6006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600b1ac0 con 0x7fec600cbd60 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec60159ac0 con 0x7fec6006b850 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec64f66640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60159da0 con 0x7fec600cb980 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec600cbd60 0x7fec6006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec600cbd60 0x7fec6006fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57680/0 (socket says 172.21.15.53:57680) 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 -- 172.21.15.53:0/1584364179 learned_addr learned my addr 172.21.15.53:0/1584364179 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec55d9b640 1 --2- 172.21.15.53:0/1584364179 >> v2:172.21.15.87:3300/0 conn(0x7fec6006b850 0x7fec600cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5e59c640 1 --2- 172.21.15.53:0/1584364179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cb980 0x7fec600b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 -- 172.21.15.53:0/1584364179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cb980 msgr2=0x7fec600b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 --2- 172.21.15.53:0/1584364179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cb980 0x7fec600b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 -- 172.21.15.53:0/1584364179 >> v2:172.21.15.87:3300/0 conn(0x7fec6006b850 msgr2=0x7fec600cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 --2- 172.21.15.53:0/1584364179 >> v2:172.21.15.87:3300/0 conn(0x7fec6006b850 0x7fec600cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec5ed9d640 1 -- 172.21.15.53:0/1584364179 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6015a080 con 0x7fec600cbd60 2024-09-13T18:25:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.793+0000 7fec55d9b640 1 --2- 172.21.15.53:0/1584364179 >> v2:172.21.15.87:3300/0 conn(0x7fec6006b850 0x7fec600cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:10.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec5ed9d640 1 --2- 172.21.15.53:0/1584364179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cbd60 0x7fec6006fcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec58009e50 tx=0x7fec5801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96df42ccdbba9c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec5dd9b640 1 -- 172.21.15.53:0/1584364179 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580a56c0 con 0x7fec600cbd60 2024-09-13T18:25:10.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec5dd9b640 1 -- 172.21.15.53:0/1584364179 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec580a5820 con 0x7fec600cbd60 2024-09-13T18:25:10.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec5dd9b640 1 -- 172.21.15.53:0/1584364179 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580a5bb0 con 0x7fec600cbd60 2024-09-13T18:25:10.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 -- 172.21.15.53:0/1584364179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cbd60 msgr2=0x7fec6006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 --2- 172.21.15.53:0/1584364179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cbd60 0x7fec6006fcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec58009e50 tx=0x7fec5801c930 comp rx=0 tx=0).stop 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 -- 172.21.15.53:0/1584364179 shutdown_connections 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 --2- 172.21.15.53:0/1584364179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cbd60 0x7fec6006fcd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 --2- 172.21.15.53:0/1584364179 >> v2:172.21.15.87:3300/0 conn(0x7fec6006b850 0x7fec600cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 --2- 172.21.15.53:0/1584364179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cb980 0x7fec600b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 -- 172.21.15.53:0/1584364179 >> 172.21.15.53:0/1584364179 conn(0x7fec60065c80 msgr2=0x7fec60066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 -- 172.21.15.53:0/1584364179 shutdown_connections 2024-09-13T18:25:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 -- 172.21.15.53:0/1584364179 wait complete. 2024-09-13T18:25:10.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.797+0000 7fec64f66640 1 Processor -- start 2024-09-13T18:25:10.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 -- start start 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6006b850 0x7fec60158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cb980 0x7fec60143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cbd60 0x7fec601624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec601585c0 con 0x7fec600cb980 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60156ef0 con 0x7fec6006b850 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60155e50 con 0x7fec600cbd60 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cb980 0x7fec60143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cb980 0x7fec60143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57682/0 (socket says 172.21.15.53:57682) 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 -- 172.21.15.53:0/1461895914 learned_addr learned my addr 172.21.15.53:0/1461895914 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec5e59c640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6006b850 0x7fec60158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec5ed9d640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cbd60 0x7fec601624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 -- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cbd60 msgr2=0x7fec601624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cbd60 0x7fec601624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 -- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6006b850 msgr2=0x7fec60158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6006b850 0x7fec60158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 -- 172.21.15.53:0/1461895914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009b30 con 0x7fec600cb980 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec5e59c640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6006b850 0x7fec60158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec55d9b640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cb980 0x7fec60143b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec4800d7d0 tx=0x7fec4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec577fe640 1 -- 172.21.15.53:0/1461895914 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800b6c0 con 0x7fec600cb980 2024-09-13T18:25:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec577fe640 1 -- 172.21.15.53:0/1461895914 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4800b820 con 0x7fec600cb980 2024-09-13T18:25:10.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60156130 con 0x7fec600cb980 2024-09-13T18:25:10.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec577fe640 1 -- 172.21.15.53:0/1461895914 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800bb90 con 0x7fec600cb980 2024-09-13T18:25:10.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec601566f0 con 0x7fec600cb980 2024-09-13T18:25:10.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec60067400 con 0x7fec600cb980 2024-09-13T18:25:10.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec577fe640 1 -- 172.21.15.53:0/1461895914 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec4800bcf0 con 0x7fec600cb980 2024-09-13T18:25:10.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.801+0000 7fec577fe640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec40066690 0x7fec40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:10.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.805+0000 7fec577fe640 1 -- 172.21.15.53:0/1461895914 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec48084650 con 0x7fec600cb980 2024-09-13T18:25:10.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.805+0000 7fec5e59c640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec40066690 0x7fec40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:10.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.805+0000 7fec5e59c640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec40066690 0x7fec40068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec60155970 tx=0x7fec50008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.809+0000 7fec577fe640 1 -- 172.21.15.53:0/1461895914 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec480519c0 con 0x7fec600cb980 2024-09-13T18:25:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.969+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec600b33b0 con 0x7fec600cb980 2024-09-13T18:25:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.969+0000 7fec577fe640 1 -- 172.21.15.53:0/1461895914 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fec48054fe0 con 0x7fec600cb980 2024-09-13T18:25:10.974 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:10.974 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec40066690 msgr2=0x7fec40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec40066690 0x7fec40068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec60155970 tx=0x7fec50008040 comp rx=0 tx=0).stop 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cb980 msgr2=0x7fec60143b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cb980 0x7fec60143b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec4800d7d0 tx=0x7fec4800dc90 comp rx=0 tx=0).stop 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 shutdown_connections 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec40066690 0x7fec40068b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec600cbd60 0x7fec601624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec600cb980 0x7fec60143b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 --2- 172.21.15.53:0/1461895914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6006b850 0x7fec60158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 >> 172.21.15.53:0/1461895914 conn(0x7fec60065c80 msgr2=0x7fec600ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 shutdown_connections 2024-09-13T18:25:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:10.973+0000 7fec64f66640 1 -- 172.21.15.53:0/1461895914 wait complete. 2024-09-13T18:25:10.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.105+0000 7f06f276d640 1 Processor -- start 2024-09-13T18:25:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.105+0000 7f06f276d640 1 -- start start 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06f276d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06ec0cb980 0x7f06ec0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06f276d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec0b1ac0 con 0x7f06ec06b850 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06f276d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec159ac0 con 0x7f06ec0cbd60 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06f276d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec159da0 con 0x7f06ec0cb980 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06ebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06ec0cb980 0x7f06ec0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06eb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f06ec06b850 0x7f06ec06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46614/0 (socket says 172.21.15.53:46614) 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06eb7fe640 1 -- 172.21.15.53:0/3807699057 learned_addr learned my addr 172.21.15.53:0/3807699057 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06eaffd640 1 -- 172.21.15.53:0/3807699057 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570064687 0 0) 0x7f06ec0b1ac0 con 0x7f06ec06b850 2024-09-13T18:25:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06eaffd640 1 -- 172.21.15.53:0/3807699057 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d4003530 con 0x7f06ec06b850 2024-09-13T18:25:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06ebfff640 1 -- 172.21.15.53:0/3807699057 >> v1:172.21.15.87:6789/0 conn(0x7f06ec0cbd60 legacy=0x7f06ec0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06ebfff640 1 -- 172.21.15.53:0/3807699057 >> v1:172.21.15.53:6789/0 conn(0x7f06ec06b850 legacy=0x7f06ec06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06ebfff640 1 -- 172.21.15.53:0/3807699057 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec15a080 con 0x7f06ec0cb980 2024-09-13T18:25:11.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06ebfff640 1 --2- 172.21.15.53:0/3807699057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec0cb980 0x7f06ec0b33b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0097c0 tx=0x7f06dc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dced9c75761891 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06eaffd640 1 -- 172.21.15.53:0/3807699057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0ac640 con 0x7f06ec0cb980 2024-09-13T18:25:11.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06eaffd640 1 -- 172.21.15.53:0/3807699057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0ac7a0 con 0x7f06ec0cb980 2024-09-13T18:25:11.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06eaffd640 1 -- 172.21.15.53:0/3807699057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0acb30 con 0x7f06ec0cb980 2024-09-13T18:25:11.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06f276d640 1 -- 172.21.15.53:0/3807699057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec0cb980 msgr2=0x7f06ec0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06f276d640 1 --2- 172.21.15.53:0/3807699057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec0cb980 0x7f06ec0b33b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0097c0 tx=0x7f06dc01c3e0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.109+0000 7f06f276d640 1 -- 172.21.15.53:0/3807699057 shutdown_connections 2024-09-13T18:25:11.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 --2- 172.21.15.53:0/3807699057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec0cb980 0x7f06ec0b33b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- 172.21.15.53:0/3807699057 >> 172.21.15.53:0/3807699057 conn(0x7f06ec065c80 msgr2=0x7f06ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- 172.21.15.53:0/3807699057 shutdown_connections 2024-09-13T18:25:11.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- 172.21.15.53:0/3807699057 wait complete. 2024-09-13T18:25:11.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 Processor -- start 2024-09-13T18:25:11.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- start start 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec06b850 0x7f06ec149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06ec0cb980 0x7f06ec0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06ec0cbd60 0x7f06ec13d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec147620 con 0x7f06ec06b850 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec151660 con 0x7f06ec0cb980 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec147df0 con 0x7f06ec0cbd60 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec06b850 0x7f06ec149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec06b850 0x7f06ec149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57700/0 (socket says 172.21.15.53:57700) 2024-09-13T18:25:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 -- 172.21.15.53:0/1067239112 learned_addr learned my addr 172.21.15.53:0/1067239112 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06eb7fe640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06ec0cb980 0x7f06ec0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f0d0a640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06ec0cbd60 0x7f06ec13d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 -- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06ec0cbd60 msgr2=0x7f06ec13d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06ec0cbd60 0x7f06ec13d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 -- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06ec0cb980 msgr2=0x7f06ec0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06ec0cb980 0x7f06ec0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 -- 172.21.15.53:0/1067239112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc009420 con 0x7f06ec06b850 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f0d0a640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06ec0cbd60 0x7f06ec13d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06ebfff640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec06b850 0x7f06ec149270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06dc018ff0 tx=0x7f06dc01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06e8ff9640 1 -- 172.21.15.53:0/1067239112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0b8650 con 0x7f06ec06b850 2024-09-13T18:25:11.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06e8ff9640 1 -- 172.21.15.53:0/1067239112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0b87b0 con 0x7f06ec06b850 2024-09-13T18:25:11.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06e8ff9640 1 -- 172.21.15.53:0/1067239112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0b8b40 con 0x7f06ec06b850 2024-09-13T18:25:11.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec147830 con 0x7f06ec06b850 2024-09-13T18:25:11.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.113+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec13dcc0 con 0x7f06ec06b850 2024-09-13T18:25:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.117+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec067400 con 0x7f06ec06b850 2024-09-13T18:25:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.117+0000 7f06e8ff9640 1 -- 172.21.15.53:0/1067239112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06dc0b8ca0 con 0x7f06ec06b850 2024-09-13T18:25:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.117+0000 7f06e8ff9640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.117+0000 7f06e8ff9640 1 -- 172.21.15.53:0/1067239112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06dc11eda0 con 0x7f06ec06b850 2024-09-13T18:25:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.117+0000 7f06eb7fe640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.117+0000 7f06eb7fe640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06d8066690 0x7f06d8068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06ec1fc7c0 tx=0x7f06e0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.121+0000 7f06e8ff9640 1 -- 172.21.15.53:0/1067239112 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06dc0ec230 con 0x7f06ec06b850 2024-09-13T18:25:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.313+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06ec0ccb00 con 0x7f06ec06b850 2024-09-13T18:25:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.313+0000 7f06e8ff9640 1 -- 172.21.15.53:0/1067239112 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7f06ec0ccb00 con 0x7f06ec06b850 2024-09-13T18:25:11.318 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:11.318 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:11.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06d8066690 msgr2=0x7f06d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06d8066690 0x7f06d8068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06ec1fc7c0 tx=0x7f06e0009040 comp rx=0 tx=0).stop 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec06b850 msgr2=0x7f06ec149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec06b850 0x7f06ec149270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06dc018ff0 tx=0x7f06dc01ac20 comp rx=0 tx=0).stop 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 shutdown_connections 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06ec0cbd60 0x7f06ec13d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06ec0cb980 0x7f06ec0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 --2- 172.21.15.53:0/1067239112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec06b850 0x7f06ec149270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 >> 172.21.15.53:0/1067239112 conn(0x7f06ec065c80 msgr2=0x7f06ec0cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 shutdown_connections 2024-09-13T18:25:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.317+0000 7f06f276d640 1 -- 172.21.15.53:0/1067239112 wait complete. 2024-09-13T18:25:11.740 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:24:58.379517+0000', 'modified': '2024-09-13T18:25:01.385979+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4242}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/2656724921', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6832', 'nonce': 2656724921}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 2656724921}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:25:11.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:25:11.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:25:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dce570640 1 Processor -- start 2024-09-13T18:25:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dce570640 1 -- start start 2024-09-13T18:25:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dce570640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc815b300 0x7f3dc80cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dce570640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3dc8161170 0x7f3dc8162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dce570640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc80cc3f0 con 0x7f3dc8162850 2024-09-13T18:25:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dce570640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc8161930 con 0x7f3dc8161170 2024-09-13T18:25:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dce570640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8161c10 con 0x7f3dc815b300 2024-09-13T18:25:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3dc8161170 0x7f3dc8162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3dc8161170 0x7f3dc8162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57704/0 (socket says 172.21.15.53:57704) 2024-09-13T18:25:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc77fe640 1 -- 172.21.15.53:0/2133545461 learned_addr learned my addr 172.21.15.53:0/2133545461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/2133545461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc815b300 0x7f3dc80cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc77fe640 1 -- 172.21.15.53:0/2133545461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc815b300 msgr2=0x7f3dc80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/2133545461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc815b300 0x7f3dc80cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc77fe640 1 -- 172.21.15.53:0/2133545461 >> v1:172.21.15.87:6789/0 conn(0x7f3dc8162850 legacy=0x7f3dc80cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.873+0000 7f3dc77fe640 1 -- 172.21.15.53:0/2133545461 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8161ef0 con 0x7f3dc8161170 2024-09-13T18:25:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/2133545461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8161170 0x7f3dc8162310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009870 tx=0x7f3dbc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11f14483a600b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dc6ffd640 1 -- 172.21.15.53:0/2133545461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0ab5f0 con 0x7f3dc8161170 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dc6ffd640 1 -- 172.21.15.53:0/2133545461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0ab750 con 0x7f3dc8161170 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dc6ffd640 1 -- 172.21.15.53:0/2133545461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0abae0 con 0x7f3dc8161170 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 -- 172.21.15.53:0/2133545461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8161170 msgr2=0x7f3dc8162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 --2- 172.21.15.53:0/2133545461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8161170 0x7f3dc8162310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009870 tx=0x7f3dbc01c520 comp rx=0 tx=0).stop 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 -- 172.21.15.53:0/2133545461 shutdown_connections 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 --2- 172.21.15.53:0/2133545461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8161170 0x7f3dc8162310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 --2- 172.21.15.53:0/2133545461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc815b300 0x7f3dc80cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 -- 172.21.15.53:0/2133545461 >> 172.21.15.53:0/2133545461 conn(0x7f3dc8065c80 msgr2=0x7f3dc8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 -- 172.21.15.53:0/2133545461 shutdown_connections 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 -- 172.21.15.53:0/2133545461 wait complete. 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 Processor -- start 2024-09-13T18:25:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.877+0000 7f3dce570640 1 -- start start 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dc815b300 0x7f3dc8158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc8161170 0x7f3dc8156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8162850 0x7f3dc80aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc815cde0 con 0x7f3dc8162850 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc80aad50 con 0x7f3dc815b300 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc80ab030 con 0x7f3dc8161170 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8162850 0x7f3dc80aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8162850 0x7f3dc80aa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57714/0 (socket says 172.21.15.53:57714) 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 -- 172.21.15.53:0/4172611769 learned_addr learned my addr 172.21.15.53:0/4172611769 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dc815b300 0x7f3dc8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc8161170 0x7f3dc8156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 -- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc8161170 msgr2=0x7f3dc8156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc8161170 0x7f3dc8156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 -- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dc815b300 msgr2=0x7f3dc8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dc815b300 0x7f3dc8158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 -- 172.21.15.53:0/4172611769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc0094d0 con 0x7f3dc8162850 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8162850 0x7f3dc80aa4e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c780 tx=0x7f3dc000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc4ff9640 1 -- 172.21.15.53:0/4172611769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000a9f0 con 0x7f3dc8162850 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc4ff9640 1 -- 172.21.15.53:0/4172611769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc000ce90 con 0x7f3dc8162850 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc80cd210 con 0x7f3dc8162850 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc4ff9640 1 -- 172.21.15.53:0/4172611769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000add0 con 0x7f3dc8162850 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc815d030 con 0x7f3dc8162850 2024-09-13T18:25:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc4ff9640 1 -- 172.21.15.53:0/4172611769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3dc0012420 con 0x7f3dc8162850 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc4ff9640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3db4066690 0x7f3db4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc4ff9640 1 -- 172.21.15.53:0/4172611769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3dc00843f0 con 0x7f3dc8162850 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3db4066690 0x7f3db4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.881+0000 7f3dd16b9000 1 Processor -- start 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- start start 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3db4066690 0x7f3db4068b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80cbb30 tx=0x7f3db8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e0900bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0900bcb10 0x55e090072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e090072740 0x55e090072b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08ff3ae80 con 0x55e0900bcb10 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08fec8af0 con 0x55e0900bc1f0 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e08fec60c0 con 0x55e090072740 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0900bcb10 0x55e090072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0900bcb10 0x55e090072200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57722/0 (socket says 172.21.15.53:57722) 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 -- 172.21.15.53:0/3379930750 learned_addr learned my addr 172.21.15.53:0/3379930750 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e0900bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e090072740 0x55e090072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 -- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e090072740 msgr2=0x55e090072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e090072740 0x55e090072b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 -- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 msgr2=0x55e0900bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e0900bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 -- 172.21.15.53:0/3379930750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e08fbbd890 con 0x55e0900bcb10 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0900bcb10 0x55e090072200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0ad040 tx=0x7f3dbc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe884bb0d2254b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dadffb640 1 -- 172.21.15.53:0/3379930750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0abac0 con 0x55e0900bcb10 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dadffb640 1 -- 172.21.15.53:0/3379930750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0abc20 con 0x55e0900bcb10 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dadffb640 1 -- 172.21.15.53:0/3379930750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0be3f0 con 0x55e0900bcb10 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- 172.21.15.53:0/3379930750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0900bcb10 msgr2=0x55e090072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0900bcb10 0x55e090072200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0ad040 tx=0x7f3dbc004740 comp rx=0 tx=0).stop 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- 172.21.15.53:0/3379930750 shutdown_connections 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e090072740 0x55e090072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0900bcb10 0x55e090072200 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/3379930750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e0900bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- 172.21.15.53:0/3379930750 >> 172.21.15.53:0/3379930750 conn(0x55e090078fb0 msgr2=0x55e090079390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- 172.21.15.53:0/3379930750 shutdown_connections 2024-09-13T18:25:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- 172.21.15.53:0/3379930750 wait complete. 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- start start 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 Processor -- start 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09007dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09007e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e09007ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08fec19b0 con 0x55e090072740 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08fe60c00 con 0x55e0900bcb10 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e08fe7f070 con 0x55e0900bc1f0 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.885+0000 7f3dd16b9000 10 client.0 _ll_register_callbacks cb 0x55e09005eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09007dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09007dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57730/0 (socket says 172.21.15.53:57730) 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 -- 172.21.15.53:0/656717100 learned_addr learned my addr 172.21.15.53:0/656717100 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09007e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e09007ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 -- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 msgr2=0x55e09007e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09007e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 -- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 msgr2=0x55e09007ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e09007ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 -- 172.21.15.53:0/656717100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc8161ef0 con 0x55e090072740 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e09007ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:11.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09007dfb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3db8014710 tx=0x7f3db8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420265d74ecfbf74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 1 -- 172.21.15.53:0/656717100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80159a0 con 0x55e090072740 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 1 -- 172.21.15.53:0/656717100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3db8015b00 con 0x55e090072740 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e08fe7e5f0 con 0x55e090072740 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 1 -- 172.21.15.53:0/656717100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3db8015cc0 con 0x55e090072740 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 10 client.4641 fetch_fsmap learned FSMap version 7 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e08fe86ab0 con 0x55e090072740 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 1 -- 172.21.15.53:0/656717100 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e08fe7e5f0 con 0x55e090072740 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 1 -- 172.21.15.53:0/656717100 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3db8021420 con 0x55e090072740 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 10 client.4641 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 10 client.4641 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 20 client.4641 populate_metadata read hostname 'smithi053' 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e09007f440 0x55e0900ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 4 client.4641 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:25:11.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 --> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e08febe790 con 0x55e09007f440 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e09007f440 0x55e0900ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e09007f440 0x55e0900ce2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642fc30ce69f761f server_cookie=5551d028072c01ad in_seq=0 out_seq=0 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 10 client.4641 ms_handle_connect on v2:172.21.15.53:6832/2656724921 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 1 -- 172.21.15.53:0/656717100 <== mds.0 v2:172.21.15.53:6832/2656724921 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55e08febe790 con 0x55e09007f440 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 10 client.4641 handle_command_reply: tid=0 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 client.4641 shutdown 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 msgr2=0x55e09007dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09007dfb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3db8014710 tx=0x7f3db8004740 comp rx=0 tx=0).stop 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 shutdown_connections 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09007e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e09007f440 0x55e0900ce2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e09007ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/656717100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09007dfb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3da6ffd640 0 client.4641 ms_handle_reset on v2:172.21.15.53:6832/2656724921 2024-09-13T18:25:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 >> 172.21.15.53:0/656717100 conn(0x55e090078fb0 msgr2=0x55e0900711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 shutdown_connections 2024-09-13T18:25:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 1 -- 172.21.15.53:0/656717100 wait complete. 2024-09-13T18:25:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.889+0000 7f3dd16b9000 20 client.4641 trim_cache size 0 max 16384 2024-09-13T18:25:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 Processor -- start 2024-09-13T18:25:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 -- start start 2024-09-13T18:25:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e090118330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e090118870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bcb10 0x55e090118db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08fb7e940 con 0x55e090072740 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e090075e80 con 0x55e0900bc1f0 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e08feb64d0 con 0x55e0900bcb10 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e090118330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e090118330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57746/0 (socket says 172.21.15.53:57746) 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 -- 172.21.15.53:0/2391477878 learned_addr learned my addr 172.21.15.53:0/2391477878 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e090118870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bcb10 0x55e090118db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 -- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bcb10 msgr2=0x55e090118db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bcb10 0x55e090118db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 -- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 msgr2=0x55e090118870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e090118870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.905+0000 7f3dc7fff640 1 -- 172.21.15.53:0/2391477878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e08fe6cc00 con 0x55e090072740 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bcb10 0x55e090118db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e090118870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e090118330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3db80146e0 tx=0x7f3db8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a246abf1126e444 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dae7fc640 1 -- 172.21.15.53:0/2391477878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8021980 con 0x55e090072740 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dae7fc640 1 -- 172.21.15.53:0/2391477878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db800b5c0 con 0x55e090072740 2024-09-13T18:25:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dae7fc640 1 -- 172.21.15.53:0/2391477878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800fec0 con 0x55e090072740 2024-09-13T18:25:11.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/2391477878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 msgr2=0x55e090118330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e090118330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3db80146e0 tx=0x7f3db8020000 comp rx=0 tx=0).stop 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/2391477878 shutdown_connections 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bcb10 0x55e090118db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bc1f0 0x55e090118870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/2391477878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e090118330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/2391477878 >> 172.21.15.53:0/2391477878 conn(0x55e090078fb0 msgr2=0x55e0900709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/2391477878 shutdown_connections 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/2391477878 wait complete. 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- start start 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 Processor -- start 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09011dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09011e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e090101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08fec0840 con 0x55e090072740 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09006a6d0 con 0x55e0900bcb10 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e08febf1c0 con 0x55e0900bc1f0 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 10 client.0 _ll_register_callbacks cb 0x7f3dbc0a6040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09011dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09011dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57758/0 (socket says 172.21.15.53:57758) 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 -- 172.21.15.53:0/37095037 learned_addr learned my addr 172.21.15.53:0/37095037 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dccb0d640 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e090101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09011e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 -- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 msgr2=0x55e09011e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09011e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 -- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 msgr2=0x55e090101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e090101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 -- 172.21.15.53:0/37095037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e08fe86ab0 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc7fff640 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09011dc20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55e08fe83530 tx=0x7f3db8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240ffaff9a0ff4a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3da6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3da6ffd640 1 -- 172.21.15.53:0/37095037 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8021db0 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3da6ffd640 1 -- 172.21.15.53:0/37095037 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3db8021980 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e08fe8a9c0 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3da6ffd640 1 -- 172.21.15.53:0/37095037 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3db800feb0 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 10 client.4647 fetch_fsmap learned FSMap version 7 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55e08fbbdcc0 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3da6ffd640 1 -- 172.21.15.53:0/37095037 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e08fe8a9c0 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3da6ffd640 1 -- 172.21.15.53:0/37095037 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3db80157a0 con 0x55e090072740 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 10 client.4647 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:25:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 10 client.4647 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 20 client.4647 populate_metadata read hostname 'smithi053' 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e090102230 0x55e090102610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 4 client.4647 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 --> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e08feba470 con 0x55e090102230 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.909+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e090102230 0x55e090102610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dc77fe640 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e090102230 0x55e090102610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def7018ed9361588 server_cookie=18b375e77935e668 in_seq=0 out_seq=0 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3da6ffd640 10 client.4647 ms_handle_connect on v2:172.21.15.53:6832/2656724921 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3da6ffd640 1 -- 172.21.15.53:0/37095037 <== mds.0 v2:172.21.15.53:6832/2656724921 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e08feba470 con 0x55e090102230 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3da6ffd640 10 client.4647 handle_command_reply: tid=0 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 client.4647 shutdown 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 msgr2=0x55e09011dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09011dc20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55e08fe83530 tx=0x7f3db8014000 comp rx=0 tx=0).stop 2024-09-13T18:25:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 shutdown_connections 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e0900bc1f0 0x55e09011e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:6832/2656724921,v1:172.21.15.53:6835/2656724921] conn(0x55e090102230 0x55e090102610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e0900bcb10 0x55e090101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 --2- 172.21.15.53:0/37095037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e090072740 0x55e09011dc20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3da6ffd640 0 client.4647 ms_handle_reset on v2:172.21.15.53:6832/2656724921 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 >> 172.21.15.53:0/37095037 conn(0x55e090078fb0 msgr2=0x55e0900711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 shutdown_connections 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 1 -- 172.21.15.53:0/37095037 wait complete. 2024-09-13T18:25:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dd16b9000 20 client.4647 trim_cache size 0 max 16384 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4242, 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 13.533881048, 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 7, 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 20, 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T18:25:11.922 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 19.962482303000002 2024-09-13T18:25:11.923 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:25:11.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3db4066690 msgr2=0x7f3db4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3db4066690 0x7f3db4068b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80cbb30 tx=0x7f3db8008040 comp rx=0 tx=0).stop 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8162850 msgr2=0x7f3dc80aa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8162850 0x7f3dc80aa4e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c780 tx=0x7f3dc000cc40 comp rx=0 tx=0).stop 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 shutdown_connections 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3db4066690 0x7f3db4068b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3dc8161170 0x7f3dc8156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dc8162850 0x7f3dc80aa4e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 --2- 172.21.15.53:0/4172611769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3dc815b300 0x7f3dc8158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 >> 172.21.15.53:0/4172611769 conn(0x7f3dc8065c80 msgr2=0x7f3dc8066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 shutdown_connections 2024-09-13T18:25:11.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:11.913+0000 7f3dce570640 1 -- 172.21.15.53:0/4172611769 wait complete. 2024-09-13T18:25:11.932 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:25:11.944 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:25:11.944 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:25:11.945 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:25:11.945 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:25:11.978 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:25:11.978 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T18:25:11.978 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T18:25:11.978 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:25:11.978 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:11.978 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-13T18:25:11.979 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:25:11.979 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:11.979 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T18:25:11.979 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:25:11.979 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:11.979 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-13T18:25:11.979 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:25:11.979 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:11.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:11.979 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:25:11.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:11.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-09-13T18:25:12.049 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2024-09-13T18:25:12.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:25:12.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.050 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:25:12.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-09-13T18:25:12.123 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-09-13T18:25:12.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:25:12.124 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:25:12.124 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:25:12.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:25:12.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 Processor -- start 2024-09-13T18:25:12.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 -- start start 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ca015cab0 0x7f3ca00d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ca00cdb00 0x7f3ca00cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca00d2400 con 0x7f3ca00cdb00 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca00d1530 con 0x7f3ca015cab0 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3ca519e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca00d0920 con 0x7f3ca00cd6c0 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ca00cdb00 0x7f3ca00cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:12.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ca00cdb00 0x7f3ca00cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57768/0 (socket says 172.21.15.53:57768) 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 -- 172.21.15.53:0/3141480376 learned_addr learned my addr 172.21.15.53:0/3141480376 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9ed9d640 1 --2- 172.21.15.53:0/3141480376 >> v2:172.21.15.87:3300/0 conn(0x7f3ca015cab0 0x7f3ca00d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9e59c640 1 --2- 172.21.15.53:0/3141480376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 -- 172.21.15.53:0/3141480376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 msgr2=0x7f3ca00cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 --2- 172.21.15.53:0/3141480376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 -- 172.21.15.53:0/3141480376 >> v2:172.21.15.87:3300/0 conn(0x7f3ca015cab0 msgr2=0x7f3ca00d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 --2- 172.21.15.53:0/3141480376 >> v2:172.21.15.87:3300/0 conn(0x7f3ca015cab0 0x7f3ca00d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.257+0000 7f3c9f59e640 1 -- 172.21.15.53:0/3141480376 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca00d0c00 con 0x7f3ca00cdb00 2024-09-13T18:25:12.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3c9f59e640 1 --2- 172.21.15.53:0/3141480376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca00cf600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0066930 tx=0x7f3c9801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e688657aef5f0529 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:12.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3c9dd9b640 1 -- 172.21.15.53:0/3141480376 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980aa610 con 0x7f3ca00cdb00 2024-09-13T18:25:12.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3c9dd9b640 1 -- 172.21.15.53:0/3141480376 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980a6040 con 0x7f3ca00cdb00 2024-09-13T18:25:12.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3c9dd9b640 1 -- 172.21.15.53:0/3141480376 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980aa990 con 0x7f3ca00cdb00 2024-09-13T18:25:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 -- 172.21.15.53:0/3141480376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 msgr2=0x7f3ca00cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 --2- 172.21.15.53:0/3141480376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca00cf600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0066930 tx=0x7f3c9801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 -- 172.21.15.53:0/3141480376 shutdown_connections 2024-09-13T18:25:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 --2- 172.21.15.53:0/3141480376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 --2- 172.21.15.53:0/3141480376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca00cf600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 --2- 172.21.15.53:0/3141480376 >> v2:172.21.15.87:3300/0 conn(0x7f3ca015cab0 0x7f3ca00d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 -- 172.21.15.53:0/3141480376 >> 172.21.15.53:0/3141480376 conn(0x7f3ca0065c80 msgr2=0x7f3ca0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 -- 172.21.15.53:0/3141480376 shutdown_connections 2024-09-13T18:25:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 -- 172.21.15.53:0/3141480376 wait complete. 2024-09-13T18:25:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 Processor -- start 2024-09-13T18:25:12.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.261+0000 7f3ca519e640 1 -- start start 2024-09-13T18:25:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca0154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:12.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ca015cab0 0x7f3ca0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca00cc6d0 con 0x7f3ca00cdb00 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca0154fb0 con 0x7f3ca015cab0 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca00cba50 con 0x7f3ca00cd6c0 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca0154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca0154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57776/0 (socket says 172.21.15.53:57776) 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 -- 172.21.15.53:0/211268628 learned_addr learned my addr 172.21.15.53:0/211268628 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9f59e640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ca015cab0 0x7f3ca0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9ed9d640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 -- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 msgr2=0x7f3ca00cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 -- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ca015cab0 msgr2=0x7f3ca0152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ca015cab0 0x7f3ca0152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 -- 172.21.15.53:0/211268628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980094d0 con 0x7f3ca00cdb00 2024-09-13T18:25:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9e59c640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca0154a70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800d620 tx=0x7f3c8800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c977fe640 1 -- 172.21.15.53:0/211268628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88018070 con 0x7f3ca00cdb00 2024-09-13T18:25:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c977fe640 1 -- 172.21.15.53:0/211268628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88004240 con 0x7f3ca00cdb00 2024-09-13T18:25:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca00cbd30 con 0x7f3ca00cdb00 2024-09-13T18:25:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c977fe640 1 -- 172.21.15.53:0/211268628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c880043d0 con 0x7f3ca00cdb00 2024-09-13T18:25:12.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca00cc2f0 con 0x7f3ca00cdb00 2024-09-13T18:25:12.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c977fe640 1 -- 172.21.15.53:0/211268628 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c88003620 con 0x7f3ca00cdb00 2024-09-13T18:25:12.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca00cc480 con 0x7f3ca00cdb00 2024-09-13T18:25:12.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c977fe640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3c80066690 0x7f3c80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:12.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c977fe640 1 -- 172.21.15.53:0/211268628 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c88083f20 con 0x7f3ca00cdb00 2024-09-13T18:25:12.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.265+0000 7f3c9ed9d640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3c80066690 0x7f3c80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:12.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.269+0000 7f3c9ed9d640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3c80066690 0x7f3c80068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c90003fd0 tx=0x7f3c900039a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:12.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.273+0000 7f3c977fe640 1 -- 172.21.15.53:0/211268628 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c88051320 con 0x7f3ca00cdb00 2024-09-13T18:25:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ca00d19a0 con 0x7f3ca00cdb00 2024-09-13T18:25:12.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3c977fe640 1 -- 172.21.15.53:0/211268628 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3c88054940 con 0x7f3ca00cdb00 2024-09-13T18:25:12.467 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:25:12.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3c80066690 msgr2=0x7f3c80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:12.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3c80066690 0x7f3c80068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c90003fd0 tx=0x7f3c900039a0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 msgr2=0x7f3ca0154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:12.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca0154a70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800d620 tx=0x7f3c8800dae0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 shutdown_connections 2024-09-13T18:25:12.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3c80066690 0x7f3c80068b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ca015cab0 0x7f3ca0152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ca00cdb00 0x7f3ca0154a70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 --2- 172.21.15.53:0/211268628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ca00cd6c0 0x7f3ca00cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:12.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 >> 172.21.15.53:0/211268628 conn(0x7f3ca0065c80 msgr2=0x7f3ca01562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:12.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 shutdown_connections 2024-09-13T18:25:12.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:12.465+0000 7f3ca519e640 1 -- 172.21.15.53:0/211268628 wait complete. 2024-09-13T18:25:12.485 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:25:12.485 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:25:12.485 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:25:12.485 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:25:12.485 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:12.485 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:25:12.485 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:25:12.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:25:12.486 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:25:12.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.486 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:25:12.492 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:12.492 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:12.492 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:12.492 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:12.492 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:12.492 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42484sec preferred_lft 42484sec 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:25:12.493 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:12.494 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:12.494 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:25:12.494 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:25:12.494 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:12.494 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:25:12.494 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:12.494 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:25:12.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.495 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:12.495 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:12.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:25:12.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2024-09-13T18:25:12.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2024-09-13T18:25:12.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:25:12.495 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:12.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.571 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:25:12.626 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:25:12.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.627 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:25:12.692 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:25:12.693 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:25:12.693 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:25:12.693 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:25:12.693 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:25:12.693 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:25:12.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.693 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:12.693 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:12.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:25:12.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:25:12.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:25:12.694 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:12.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.770 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:25:12.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.819 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-09-13T18:25:12.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.867 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:12.867 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:12.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:25:12.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:25:12.868 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:12.939 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:25:12.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:25:12.940 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:13.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:13.053 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:13.053 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:13.053 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:25:13.053 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:25:13.053 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:13.072 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:25:13.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:13.072 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:13.118 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:25:13.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:13.119 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:13.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:25:13.225 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:13.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:13.276 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:13.277 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:13.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:13.277 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:25:13.322 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:25:13.322 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:25:13.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:25:13.381 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:13.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:13.439 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:13.440 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:13.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:13.440 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:25:13.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:25:13.445+0000 7f74090de580 -1 init, newargv = 0x5618122cc380 newargc=15 2024-09-13T18:25:13.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[35709]: starting ceph client 2024-09-13T18:25:13.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[35709]: starting fuse 2024-09-13T18:25:14.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:25:14.569 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:14.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:14.624 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:14.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:14.624 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:25:14.671 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:25:14.671 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:14.672 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:14.673 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:25:14.674 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:25:14.796 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.35709.asok 2024-09-13T18:25:14.977 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35709.asok 2024-09-13T18:25:14.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:14.977 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35709.asok status 2024-09-13T18:25:15.138 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:25:15.138 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:25:15.138 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:25:15.138 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:25:15.138 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "35709", 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4656, 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4656 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:25:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3798335796 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3798335796 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4656 192.168.0.1:0/3798335796", 2024-09-13T18:25:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3798335796", 2024-09-13T18:25:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:25:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 7, 2024-09-13T18:25:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 20, 2024-09-13T18:25:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:25:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:25:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:25:15.141 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:25:15.152 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:25:15.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:25:15.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f69a021c640 1 Processor -- start 2024-09-13T18:25:15.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f69a021c640 1 -- start start 2024-09-13T18:25:15.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f69a021c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69980cb980 0x7f69980b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f69a021c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69980b1ac0 con 0x7f69980cbd60 2024-09-13T18:25:15.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f69a021c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6998159ac0 con 0x7f699806b850 2024-09-13T18:25:15.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f69a021c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6998159da0 con 0x7f69980cb980 2024-09-13T18:25:15.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699e7b9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f69980cbd60 0x7f69980b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46618/0 (socket says 172.21.15.53:46618) 2024-09-13T18:25:15.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699e7b9640 1 -- 172.21.15.53:0/3759157585 learned_addr learned my addr 172.21.15.53:0/3759157585 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:15.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699dfb8640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69980cb980 0x7f69980b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753204699 0 0) 0x7f69980b1ac0 con 0x7f69980cbd60 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6984003530 con 0x7f69980cbd60 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3028951895 0 0) 0x7f6984003530 con 0x7f69980cbd60 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69980cb980 msgr2=0x7f69980b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69980cb980 0x7f69980b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 >> v1:172.21.15.87:6789/0 conn(0x7f699806b850 legacy=0x7f699806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699815a080 con 0x7f69980cbd60 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6990001a00 con 0x7f69980cbd60 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 >> v1:172.21.15.53:6789/0 conn(0x7f69980cbd60 legacy=0x7f69980b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69840039b0 0x7f6984003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69980cb980 0x7f69840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6984004d10 0x7f6984005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6998159da0 con 0x7f69840039b0 2024-09-13T18:25:15.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698400bac0 con 0x7f6984004d10 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698400bc80 con 0x7f69980cb980 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699dfb8640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69840039b0 0x7f6984003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699e7b9640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6984004d10 0x7f6984005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699dfb8640 1 -- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69980cb980 msgr2=0x7f69840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699dfb8640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69980cb980 0x7f69840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699dfb8640 1 -- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6984004d10 msgr2=0x7f6984005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699dfb8640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6984004d10 0x7f6984005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.277+0000 7f699dfb8640 1 -- 172.21.15.53:0/3759157585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6984003530 con 0x7f69840039b0 2024-09-13T18:25:15.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f699dfb8640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69840039b0 0x7f6984003dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6988009ae0 tx=0x7f698801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684296b3365edbee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:15.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69880a5590 con 0x7f69840039b0 2024-09-13T18:25:15.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69880a56f0 con 0x7f69840039b0 2024-09-13T18:25:15.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f699cfb6640 1 -- 172.21.15.53:0/3759157585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69880a5aa0 con 0x7f69840039b0 2024-09-13T18:25:15.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 -- 172.21.15.53:0/3759157585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69840039b0 msgr2=0x7f6984003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:15.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 --2- 172.21.15.53:0/3759157585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69840039b0 0x7f6984003dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6988009ae0 tx=0x7f698801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f699e7b9640 1 -- 172.21.15.53:0/3759157585 reap_dead start 2024-09-13T18:25:15.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 -- 172.21.15.53:0/3759157585 shutdown_connections 2024-09-13T18:25:15.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 -- 172.21.15.53:0/3759157585 >> 172.21.15.53:0/3759157585 conn(0x7f6998065c80 msgr2=0x7f6998066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:15.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 -- 172.21.15.53:0/3759157585 shutdown_connections 2024-09-13T18:25:15.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 -- 172.21.15.53:0/3759157585 wait complete. 2024-09-13T18:25:15.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 Processor -- start 2024-09-13T18:25:15.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.281+0000 7f69a021c640 1 -- start start 2024-09-13T18:25:15.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69840039b0 0x7f699813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69981458c0 0x7f6998145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699815d4d0 0x7f699815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699815dec0 con 0x7f699815d4d0 2024-09-13T18:25:15.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699813f220 con 0x7f69840039b0 2024-09-13T18:25:15.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6998146380 con 0x7f69981458c0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699815d4d0 0x7f699815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699815d4d0 0x7f699815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57784/0 (socket says 172.21.15.53:57784) 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 -- 172.21.15.53:0/2519871743 learned_addr learned my addr 172.21.15.53:0/2519871743 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699d7b7640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69981458c0 0x7f6998145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699dfb8640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69840039b0 0x7f699813ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 -- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69981458c0 msgr2=0x7f6998145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69981458c0 0x7f6998145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 -- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69840039b0 msgr2=0x7f699813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69840039b0 0x7f699813ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 -- 172.21.15.53:0/2519871743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6998146660 con 0x7f699815d4d0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699e7b9640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699815d4d0 0x7f699815d980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f69980cc140 tx=0x7f699000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f698e7fc640 1 -- 172.21.15.53:0/2519871743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000bb20 con 0x7f699815d4d0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f698e7fc640 1 -- 172.21.15.53:0/2519871743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699000bc80 con 0x7f699815d4d0 2024-09-13T18:25:15.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6998146940 con 0x7f699815d4d0 2024-09-13T18:25:15.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f698e7fc640 1 -- 172.21.15.53:0/2519871743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990007110 con 0x7f699815d4d0 2024-09-13T18:25:15.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6998146f00 con 0x7f699815d4d0 2024-09-13T18:25:15.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6998067400 con 0x7f699815d4d0 2024-09-13T18:25:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f698e7fc640 1 -- 172.21.15.53:0/2519871743 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6990007290 con 0x7f699815d4d0 2024-09-13T18:25:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f698e7fc640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f697c066690 0x7f697c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f698e7fc640 1 -- 172.21.15.53:0/2519871743 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6990084650 con 0x7f699815d4d0 2024-09-13T18:25:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.285+0000 7f699dfb8640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f697c066690 0x7f697c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.289+0000 7f699dfb8640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f697c066690 0x7f697c068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69880af000 tx=0x7f69880046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.289+0000 7f698e7fc640 1 -- 172.21.15.53:0/2519871743 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6990051a50 con 0x7f699815d4d0 2024-09-13T18:25:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.489+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6998147090 con 0x7f699815d4d0 2024-09-13T18:25:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.489+0000 7f698e7fc640 1 -- 172.21.15.53:0/2519871743 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6990055070 con 0x7f699815d4d0 2024-09-13T18:25:15.492 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:25:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.489+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f697c066690 msgr2=0x7f697c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.489+0000 7f69a021c640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f697c066690 0x7f697c068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69880af000 tx=0x7f69880046d0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699815d4d0 msgr2=0x7f699815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699815d4d0 0x7f699815d980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f69980cc140 tx=0x7f699000b4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 shutdown_connections 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f697c066690 0x7f697c068b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69981458c0 0x7f6998145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699815d4d0 0x7f699815d980 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 --2- 172.21.15.53:0/2519871743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69840039b0 0x7f699813ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 >> 172.21.15.53:0/2519871743 conn(0x7f6998065c80 msgr2=0x7f699806c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 shutdown_connections 2024-09-13T18:25:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:15.493+0000 7f69a021c640 1 -- 172.21.15.53:0/2519871743 wait complete. 2024-09-13T18:25:15.511 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:25:15.511 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:25:15.511 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:25:15.511 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T18:25:15.512 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:15.512 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:25:15.512 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:25:15.512 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:25:15.512 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:25:15.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.512 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:25:15.518 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:15.518 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42481sec preferred_lft 42481sec 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.519 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.520 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:25:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.521 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:25:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:25:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:25:15.521 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.521 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:25:15.572 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:25:15.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.574 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:25:15.624 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:25:15.625 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:25:15.625 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:25:15.625 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:25:15.625 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:25:15.625 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:25:15.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.625 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:15.625 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:15.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:25:15.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:25:15.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:25:15.626 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:15.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.702 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:25:15.747 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:25:15.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.747 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2024-09-13T18:25:15.795 INFO:teuthology.orchestra.run.smithi053.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T18:25:15.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.796 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:15.796 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:15.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:25:15.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T18:25:15.796 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:15.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.865 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:25:15.919 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:15.919 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:15.919 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:15.919 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.919 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:15.919 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.919 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:25:15.920 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 86:a6:3f:a2:2b:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:25:15.920 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:25:15.920 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.920 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::84a6:3fff:fea2:2b17/64 scope link 2024-09-13T18:25:15.920 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:25:15.976 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 86:a6:3f:a2:2b:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:25:15.977 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:25:15.977 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.977 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::84a6:3fff:fea2:2b17/64 scope link 2024-09-13T18:25:15.977 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:15.978 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T18:25:15.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:15.978 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:15.978 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:15.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T18:25:15.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:25:15.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T18:25:15.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T18:25:15.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T18:25:15.979 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:16.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:16.079 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:25:16.079 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:25:16.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.1 up 2024-09-13T18:25:16.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:25:16.079 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:25:16.099 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-13T18:25:16.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:16.099 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:16.151 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:25:16.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:16.151 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:16.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:25:16.259 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:16.260 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:16.314 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:16.316 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:16.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:16.316 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:25:16.363 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:25:16.364 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-13T18:25:16.364 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-13T18:25:16.408 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:25:16.423 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:16.423 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:16.478 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:16.479 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:16.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:16.480 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:25:16.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi053.stderr:2024-09-13T18:25:16.489+0000 7f9efe02d580 -1 init, newargv = 0x55cc6454acd0 newargc=15 2024-09-13T18:25:16.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi053.stderr:ceph-fuse[35848]: starting ceph client 2024-09-13T18:25:16.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi053.stderr:ceph-fuse[35848]: starting fuse 2024-09-13T18:25:16.500 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:25:16.501 INFO:teuthology.orchestra.run.smithi053.stdout:46 2024-09-13T18:25:16.501 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:25:16.501 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:25:16.502 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:25:16.503 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:25:16.503 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:25:16.503 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.2")) 2024-09-13T18:25:16.503 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:25:16.604 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.2.35848.asok 2024-09-13T18:25:16.793 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35848.asok 2024-09-13T18:25:16.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:16.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35848.asok status 2024-09-13T18:25:16.956 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:25:16.956 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:25:16.956 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:25:16.956 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:25:16.956 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "2", 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "35848", 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4668, 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4668 2024-09-13T18:25:16.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1041480747 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1041480747 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4668 192.168.0.2:0/1041480747", 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.2:0/1041480747", 2024-09-13T18:25:16.958 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:25:16.959 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 7, 2024-09-13T18:25:16.959 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 20, 2024-09-13T18:25:16.959 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:25:16.959 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:25:16.959 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:25:16.959 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:25:16.971 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:25:16.971 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:25:17.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143d1c7640 1 Processor -- start 2024-09-13T18:25:17.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143d1c7640 1 -- start start 2024-09-13T18:25:17.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143d1c7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 0x7f14380b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143d1c7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14380ae5d0 0x7f14380aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143d1c7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14380ad530 con 0x7f143815db40 2024-09-13T18:25:17.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143d1c7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14380ae1b0 con 0x7f14380ae5d0 2024-09-13T18:25:17.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143d1c7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14380ad810 con 0x7f14380b1960 2024-09-13T18:25:17.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1436d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f143815db40 0x7f14380afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39696/0 (socket says 172.21.15.53:39696) 2024-09-13T18:25:17.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1436d9d640 1 -- 172.21.15.53:0/3278339415 learned_addr learned my addr 172.21.15.53:0/3278339415 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:17.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143659c640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 0x7f14380b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143759e640 1 --2- 172.21.15.53:0/3278339415 >> v2:172.21.15.87:3300/0 conn(0x7f14380ae5d0 0x7f14380aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577291654 0 0) 0x7f14380ad530 con 0x7f143815db40 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1420003530 con 0x7f143815db40 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2054276981 0 0) 0x7f1420003530 con 0x7f143815db40 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 msgr2=0x7f14380b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 0x7f14380b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 >> v2:172.21.15.87:3300/0 conn(0x7f14380ae5d0 msgr2=0x7f14380aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 --2- 172.21.15.53:0/3278339415 >> v2:172.21.15.87:3300/0 conn(0x7f14380ae5d0 0x7f14380aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380adaf0 con 0x7f143815db40 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f1428001680 con 0x7f143815db40 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 >> v1:172.21.15.53:6789/0 conn(0x7f143815db40 legacy=0x7f14380afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1420003980 0x7f1420003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14200047d0 0x7f1420004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 0x7f1420005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380ae1b0 con 0x7f14200047d0 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380ad810 con 0x7f1420003980 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142000b9c0 con 0x7f14380b1960 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143659c640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14200047d0 0x7f1420004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143759e640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 0x7f1420005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f1436d9d640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1420003980 0x7f1420003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143659c640 1 -- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 msgr2=0x7f1420005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143659c640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14380b1960 0x7f1420005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143659c640 1 -- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1420003980 msgr2=0x7f1420003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143659c640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1420003980 0x7f1420003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.097+0000 7f143659c640 1 -- 172.21.15.53:0/3278339415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420003530 con 0x7f14200047d0 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143659c640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14200047d0 0x7f1420004c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f142c009ae0 tx=0x7f142c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8adf49f0681a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0a6420 con 0x7f14200047d0 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c0a6580 con 0x7f14200047d0 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f1435d9b640 1 -- 172.21.15.53:0/3278339415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0a6930 con 0x7f14200047d0 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 -- 172.21.15.53:0/3278339415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14200047d0 msgr2=0x7f1420004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 --2- 172.21.15.53:0/3278339415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14200047d0 0x7f1420004c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f142c009ae0 tx=0x7f142c01c9e0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143759e640 1 -- 172.21.15.53:0/3278339415 reap_dead start 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 -- 172.21.15.53:0/3278339415 shutdown_connections 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 -- 172.21.15.53:0/3278339415 >> 172.21.15.53:0/3278339415 conn(0x7f14380b20d0 msgr2=0x7f14380b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 -- 172.21.15.53:0/3278339415 shutdown_connections 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 -- 172.21.15.53:0/3278339415 wait complete. 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 Processor -- start 2024-09-13T18:25:17.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.101+0000 7f143d1c7640 1 -- start start 2024-09-13T18:25:17.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14200047d0 0x7f1438156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14380c9390 0x7f14380c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143815bbf0 0x7f143815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14381f5f60 con 0x7f143815bbf0 2024-09-13T18:25:17.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14381f63d0 con 0x7f14380c9390 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143815c5b0 con 0x7f14200047d0 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143815bbf0 0x7f143815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143815bbf0 0x7f143815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50466/0 (socket says 172.21.15.53:50466) 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 -- 172.21.15.53:0/3487713607 learned_addr learned my addr 172.21.15.53:0/3487713607 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143659c640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14380c9390 0x7f14380c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f1436d9d640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14200047d0 0x7f1438156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 -- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14200047d0 msgr2=0x7f1438156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14200047d0 0x7f1438156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 -- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14380c9390 msgr2=0x7f14380c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14380c9390 0x7f14380c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 -- 172.21.15.53:0/3487713607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14381f5320 con 0x7f143815bbf0 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f1436d9d640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14200047d0 0x7f1438156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143759e640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143815bbf0 0x7f143815c070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14380cf990 tx=0x7f14300115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f141f7fe640 1 -- 172.21.15.53:0/3487713607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000e070 con 0x7f143815bbf0 2024-09-13T18:25:17.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f141f7fe640 1 -- 172.21.15.53:0/3487713607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430011ed0 con 0x7f143815bbf0 2024-09-13T18:25:17.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14381f55c0 con 0x7f143815bbf0 2024-09-13T18:25:17.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f141f7fe640 1 -- 172.21.15.53:0/3487713607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300039a0 con 0x7f143815bbf0 2024-09-13T18:25:17.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14381f5b80 con 0x7f143815bbf0 2024-09-13T18:25:17.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14380ad530 con 0x7f143815bbf0 2024-09-13T18:25:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f141f7fe640 1 -- 172.21.15.53:0/3487713607 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1430003b20 con 0x7f143815bbf0 2024-09-13T18:25:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f141f7fe640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1424066690 0x7f1424068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f141f7fe640 1 -- 172.21.15.53:0/3487713607 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1430084a00 con 0x7f143815bbf0 2024-09-13T18:25:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.105+0000 7f1436d9d640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1424066690 0x7f1424068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.109+0000 7f1436d9d640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1424066690 0x7f1424068b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f14280058c0 tx=0x7f1428000f60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.109+0000 7f141f7fe640 1 -- 172.21.15.53:0/3487713607 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1430051e00 con 0x7f143815bbf0 2024-09-13T18:25:17.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.309+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14380c7370 con 0x7f143815bbf0 2024-09-13T18:25:17.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.309+0000 7f141f7fe640 1 -- 172.21.15.53:0/3487713607 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1430055420 con 0x7f143815bbf0 2024-09-13T18:25:17.313 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:25:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1424066690 msgr2=0x7f1424068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:17.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1424066690 0x7f1424068b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f14280058c0 tx=0x7f1428000f60 comp rx=0 tx=0).stop 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143815bbf0 msgr2=0x7f143815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143815bbf0 0x7f143815c070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14380cf990 tx=0x7f14300115a0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 shutdown_connections 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1424066690 0x7f1424068b50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143815bbf0 0x7f143815c070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14380c9390 0x7f14380c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 --2- 172.21.15.53:0/3487713607 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14200047d0 0x7f1438156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 >> 172.21.15.53:0/3487713607 conn(0x7f14380b20d0 msgr2=0x7f14380b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 shutdown_connections 2024-09-13T18:25:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:17.313+0000 7f143d1c7640 1 -- 172.21.15.53:0/3487713607 wait complete. 2024-09-13T18:25:17.332 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:25:17.332 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:25:17.333 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:25:17.333 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:25:17.333 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:17.333 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:25:17.333 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:25:17.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:25:17.333 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:25:17.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.333 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:25:17.340 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:17.340 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:17.340 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:25:17.341 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42485sec preferred_lft 42485sec 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:17.342 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:25:17.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.343 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:17.343 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:17.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:25:17.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-09-13T18:25:17.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-09-13T18:25:17.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:25:17.343 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:17.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.429 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:25:17.483 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:25:17.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.484 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:25:17.557 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:25:17.557 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:25:17.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.559 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:17.559 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:17.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:25:17.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:25:17.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:25:17.559 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:17.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.632 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:25:17.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.677 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-09-13T18:25:17.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.731 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:17.731 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:17.731 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:25:17.731 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T18:25:17.731 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:17.799 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T18:25:17.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.799 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:17.800 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:17.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T18:25:17.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:25:17.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T18:25:17.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T18:25:17.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T18:25:17.800 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:17.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:17.908 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:17.908 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:17.908 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:25:17.908 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:25:17.908 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:17.928 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:25:17.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:17.928 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:17.973 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:25:17.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:17.973 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:18.021 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:25:18.078 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:18.078 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:18.131 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:18.132 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:18.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:18.137 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:25:18.182 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:25:18.182 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:25:18.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:25:18.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:18.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:18.296 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:18.297 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:18.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:18.297 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:25:18.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:25:18.304+0000 7f4253a71580 -1 init, newargv = 0x558063bb4670 newargc=15 2024-09-13T18:25:18.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[34897]: starting ceph client 2024-09-13T18:25:18.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[34897]: starting fuse 2024-09-13T18:25:19.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:25:19.430 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:19.431 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:19.484 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:19.485 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:19.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:19.486 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:25:19.533 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:25:19.533 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:25:19.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:25:19.534 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:25:19.535 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:25:19.653 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.34897.asok 2024-09-13T18:25:19.836 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34897.asok 2024-09-13T18:25:19.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:19.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34897.asok status 2024-09-13T18:25:19.995 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:25:19.995 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:25:19.995 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:25:19.995 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "34897", 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4478, 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:25:19.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4478 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2476721613 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2476721613 2024-09-13T18:25:19.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4478 192.168.0.1:0/2476721613", 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/2476721613", 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 7, 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 20, 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:25:19.998 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:25:20.009 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:25:20.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:25:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff2d9b0640 1 Processor -- start 2024-09-13T18:25:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff2d9b0640 1 -- start start 2024-09-13T18:25:20.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff2d9b0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff280b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:20.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff2d9b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7eff2806b850 0x7eff280cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:20.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff2d9b0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff280b1ac0 con 0x7eff280cbd60 2024-09-13T18:25:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff2d9b0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280b3010 con 0x7eff2806b850 2024-09-13T18:25:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff2d9b0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff28159ac0 con 0x7eff280cb980 2024-09-13T18:25:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff1ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7eff2806b850 0x7eff280cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff1ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7eff2806b850 0x7eff280cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50468/0 (socket says 172.21.15.53:50468) 2024-09-13T18:25:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff1ffff640 1 -- 172.21.15.53:0/2615385284 learned_addr learned my addr 172.21.15.53:0/2615385284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff26ffd640 1 --2- 172.21.15.53:0/2615385284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff280b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:20.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff1ffff640 1 -- 172.21.15.53:0/2615385284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 msgr2=0x7eff280b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff1ffff640 1 --2- 172.21.15.53:0/2615385284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff280b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff1ffff640 1 -- 172.21.15.53:0/2615385284 >> v1:172.21.15.87:6789/0 conn(0x7eff280cbd60 legacy=0x7eff2806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:20.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.141+0000 7eff1ffff640 1 -- 172.21.15.53:0/2615385284 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28159da0 con 0x7eff2806b850 2024-09-13T18:25:20.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff1ffff640 1 --2- 172.21.15.53:0/2615385284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff280cdd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff100098a0 tx=0x7eff1001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3498292d110ea741 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:20.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff267fc640 1 -- 172.21.15.53:0/2615385284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100ab600 con 0x7eff2806b850 2024-09-13T18:25:20.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff267fc640 1 -- 172.21.15.53:0/2615385284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100ab760 con 0x7eff2806b850 2024-09-13T18:25:20.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff267fc640 1 -- 172.21.15.53:0/2615385284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100abaf0 con 0x7eff2806b850 2024-09-13T18:25:20.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- 172.21.15.53:0/2615385284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 msgr2=0x7eff280cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:20.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/2615385284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff280cdd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff100098a0 tx=0x7eff1001c440 comp rx=0 tx=0).stop 2024-09-13T18:25:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- 172.21.15.53:0/2615385284 shutdown_connections 2024-09-13T18:25:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/2615385284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff280cdd40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/2615385284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff280b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- 172.21.15.53:0/2615385284 >> 172.21.15.53:0/2615385284 conn(0x7eff28065c80 msgr2=0x7eff28066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- 172.21.15.53:0/2615385284 shutdown_connections 2024-09-13T18:25:20.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- 172.21.15.53:0/2615385284 wait complete. 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 Processor -- start 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- start start 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff28156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff2814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff280cbd60 0x7eff2806f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281571c0 con 0x7eff2806b850 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2814d3a0 con 0x7eff280cbd60 2024-09-13T18:25:20.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff2d9b0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2814d680 con 0x7eff280cb980 2024-09-13T18:25:20.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff28156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:20.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff28156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50484/0 (socket says 172.21.15.53:50484) 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 -- 172.21.15.53:0/1914978226 learned_addr learned my addr 172.21.15.53:0/1914978226 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff1ffff640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff2814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff277fe640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff280cbd60 0x7eff2806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 -- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 msgr2=0x7eff2814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff2814a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 -- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff280cbd60 msgr2=0x7eff2806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff280cbd60 0x7eff2806f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff26ffd640 1 -- 172.21.15.53:0/1914978226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100094d0 con 0x7eff2806b850 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.145+0000 7eff1ffff640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff2814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff277fe640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff280cbd60 0x7eff2806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:20.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff26ffd640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff28156c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff1800d800 tx=0x7eff1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:20.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff24ff9640 1 -- 172.21.15.53:0/1914978226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800b6c0 con 0x7eff2806b850 2024-09-13T18:25:20.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff24ff9640 1 -- 172.21.15.53:0/1914978226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1800b820 con 0x7eff2806b850 2024-09-13T18:25:20.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2814d960 con 0x7eff2806b850 2024-09-13T18:25:20.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff24ff9640 1 -- 172.21.15.53:0/1914978226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800bb90 con 0x7eff2806b850 2024-09-13T18:25:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2814df20 con 0x7eff2806b850 2024-09-13T18:25:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff28067400 con 0x7eff2806b850 2024-09-13T18:25:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff24ff9640 1 -- 172.21.15.53:0/1914978226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff1800bcf0 con 0x7eff2806b850 2024-09-13T18:25:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff24ff9640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7eff08066690 0x7eff08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff24ff9640 1 -- 172.21.15.53:0/1914978226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff18084690 con 0x7eff2806b850 2024-09-13T18:25:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff1ffff640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7eff08066690 0x7eff08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.149+0000 7eff1ffff640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7eff08066690 0x7eff08068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff100af000 tx=0x7eff10008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:20.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.153+0000 7eff24ff9640 1 -- 172.21.15.53:0/1914978226 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff18051a90 con 0x7eff2806b850 2024-09-13T18:25:20.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff280b2be0 con 0x7eff2806b850 2024-09-13T18:25:20.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff24ff9640 1 -- 172.21.15.53:0/1914978226 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff18011340 con 0x7eff2806b850 2024-09-13T18:25:20.352 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7eff08066690 msgr2=0x7eff08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7eff08066690 0x7eff08068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff100af000 tx=0x7eff10008040 comp rx=0 tx=0).stop 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 msgr2=0x7eff28156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff28156c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff1800d800 tx=0x7eff1800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 shutdown_connections 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7eff08066690 0x7eff08068b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff280cb980 0x7eff2814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff280cbd60 0x7eff2806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 --2- 172.21.15.53:0/1914978226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff2806b850 0x7eff28156c80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 >> 172.21.15.53:0/1914978226 conn(0x7eff28065c80 msgr2=0x7eff280cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 shutdown_connections 2024-09-13T18:25:20.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:20.349+0000 7eff2d9b0640 1 -- 172.21.15.53:0/1914978226 wait complete. 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:25:20.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:25:20.370 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:25:20.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.370 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42482sec preferred_lft 42482sec 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.378 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:25:20.379 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.380 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:25:20.436 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:25:20.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.438 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:25:20.489 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:25:20.490 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:25:20.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.491 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:20.491 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:20.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:25:20.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:25:20.491 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:25:20.491 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:20.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.566 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:25:20.614 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:25:20.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.614 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-09-13T18:25:20.662 INFO:teuthology.orchestra.run.smithi087.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T18:25:20.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.662 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:20.662 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:20.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:25:20.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T18:25:20.663 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:20.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.729 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 6a:4d:a5:9d:23:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:25:20.786 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:25:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::684d:a5ff:fe9d:23d1/64 scope link 2024-09-13T18:25:20.787 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.788 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:25:20.841 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 6a:4d:a5:9d:23:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:25:20.842 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:25:20.842 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.842 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::684d:a5ff:fe9d:23d1/64 scope link 2024-09-13T18:25:20.842 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:25:20.843 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T18:25:20.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.843 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:20.844 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:20.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T18:25:20.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:25:20.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T18:25:20.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T18:25:20.844 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T18:25:20.844 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:20.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:20.941 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:25:20.941 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:25:20.941 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.1 up 2024-09-13T18:25:20.941 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:25:20.941 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:25:20.962 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-13T18:25:20.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:20.962 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:21.011 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:25:21.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:25:21.012 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:21.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:25:21.112 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:21.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:21.168 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:21.169 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:21.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:21.169 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:25:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:25:21.218 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-13T18:25:21.218 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-13T18:25:21.262 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:25:21.276 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:21.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:21.335 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:21.336 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:21.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:21.336 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:25:21.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi087.stderr:2024-09-13T18:25:21.332+0000 7f8007f47580 -1 init, newargv = 0x5594b641e210 newargc=15 2024-09-13T18:25:21.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi087.stderr:ceph-fuse[35010]: starting ceph client 2024-09-13T18:25:21.343 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:25:21.346 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi087.stderr:ceph-fuse[35010]: starting fuse 2024-09-13T18:25:22.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:25:22.459 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:25:22.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:25:22.514 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:25:22.514 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:25:22.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:22.515 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:25:22.562 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:25:22.562 INFO:teuthology.orchestra.run.smithi087.stdout:46 2024-09-13T18:25:22.562 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-13T18:25:22.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:25:22.562 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:25:22.562 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:25:22.562 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:25:22.563 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.3")) 2024-09-13T18:25:22.564 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:25:22.681 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.3.35010.asok 2024-09-13T18:25:22.864 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.35010.asok 2024-09-13T18:25:22.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:22.864 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.35010.asok status 2024-09-13T18:25:23.026 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:25:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:25:23.026 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "3", 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35010", 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4487, 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:25:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4487 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 131738593 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.2:0", 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 131738593 2024-09-13T18:25:23.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4487 192.168.0.2:0/131738593", 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.2:0/131738593", 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 7, 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 20, 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:25:23.029 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:25:23.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.040 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:25:23.040 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:23.048 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:25:23.048 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:23.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:23.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.107 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:25:23.107 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:23.157 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:25:23.157 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:23.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:23.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.217 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:25:23.217 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:23.226 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:25:23.226 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:23.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:23.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.281 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:25:23.281 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:23.330 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:25:23.330 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:23.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:23.331 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:23.385 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T18:25:23.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:23.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae94b4640 1 Processor -- start 2024-09-13T18:25:23.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae94b4640 1 -- start start 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae94b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae40b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae94b4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1ae40cbd60 0x7f1ae40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae94b4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae40b1ac0 con 0x7f1ae40cb980 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae94b4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae40b3010 con 0x7f1ae40cbd60 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae94b4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae4159ac0 con 0x7f1ae406b850 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae2ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1ae40cb980 0x7f1ae406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39708/0 (socket says 172.21.15.53:39708) 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae2ffd640 1 -- 172.21.15.53:0/3143957066 learned_addr learned my addr 172.21.15.53:0/3143957066 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae27fc640 1 --2- 172.21.15.53:0/3143957066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae40b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae37fe640 1 --2- 172.21.15.53:0/3143957066 >> v2:172.21.15.87:3300/0 conn(0x7f1ae40cbd60 0x7f1ae40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae1ffb640 1 -- 172.21.15.53:0/3143957066 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799879618 0 0) 0x7f1ae40b1ac0 con 0x7f1ae40cb980 2024-09-13T18:25:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae1ffb640 1 -- 172.21.15.53:0/3143957066 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1acc003530 con 0x7f1ae40cb980 2024-09-13T18:25:23.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae27fc640 1 -- 172.21.15.53:0/3143957066 >> v2:172.21.15.87:3300/0 conn(0x7f1ae40cbd60 msgr2=0x7f1ae40cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:23.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae27fc640 1 --2- 172.21.15.53:0/3143957066 >> v2:172.21.15.87:3300/0 conn(0x7f1ae40cbd60 0x7f1ae40cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae1ffb640 1 -- 172.21.15.53:0/3143957066 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2380464174 0 0) 0x7f1acc003530 con 0x7f1ae40cb980 2024-09-13T18:25:23.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae27fc640 1 -- 172.21.15.53:0/3143957066 >> v1:172.21.15.53:6789/0 conn(0x7f1ae40cb980 legacy=0x7f1ae406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.533+0000 7f1ae27fc640 1 -- 172.21.15.53:0/3143957066 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae4159da0 con 0x7f1ae406b850 2024-09-13T18:25:23.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae27fc640 1 --2- 172.21.15.53:0/3143957066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae40b33b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80097c0 tx=0x7f1ad801c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f963284fd5bde4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:23.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae1ffb640 1 -- 172.21.15.53:0/3143957066 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4001680 con 0x7f1ae406b850 2024-09-13T18:25:23.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae1ffb640 1 -- 172.21.15.53:0/3143957066 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad80a7050 con 0x7f1ae406b850 2024-09-13T18:25:23.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae1ffb640 1 -- 172.21.15.53:0/3143957066 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80ab620 con 0x7f1ae406b850 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 -- 172.21.15.53:0/3143957066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 msgr2=0x7f1ae40b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/3143957066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae40b33b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80097c0 tx=0x7f1ad801c300 comp rx=0 tx=0).stop 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 -- 172.21.15.53:0/3143957066 shutdown_connections 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/3143957066 >> v2:172.21.15.87:3300/0 conn(0x7f1ae40cbd60 0x7f1ae40cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/3143957066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae40b33b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 -- 172.21.15.53:0/3143957066 >> 172.21.15.53:0/3143957066 conn(0x7f1ae4065c80 msgr2=0x7f1ae4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 -- 172.21.15.53:0/3143957066 shutdown_connections 2024-09-13T18:25:23.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 -- 172.21.15.53:0/3143957066 wait complete. 2024-09-13T18:25:23.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 Processor -- start 2024-09-13T18:25:23.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.537+0000 7f1ae94b4640 1 -- start start 2024-09-13T18:25:23.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae4150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ae40cb980 0x7f1ae414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ae40cbd60 0x7f1ae414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae4152840 con 0x7f1ae40cbd60 2024-09-13T18:25:23.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae41517c0 con 0x7f1ae40cb980 2024-09-13T18:25:23.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae4151aa0 con 0x7f1ae406b850 2024-09-13T18:25:23.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ae40cbd60 0x7f1ae414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ae40cbd60 0x7f1ae414ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50496/0 (socket says 172.21.15.53:50496) 2024-09-13T18:25:23.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 -- 172.21.15.53:0/1573238339 learned_addr learned my addr 172.21.15.53:0/1573238339 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:23.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae2ffd640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae4150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae27fc640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ae40cb980 0x7f1ae414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 -- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 msgr2=0x7f1ae4150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae4150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 -- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ae40cb980 msgr2=0x7f1ae414b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ae40cb980 0x7f1ae414b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 -- 172.21.15.53:0/1573238339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8009420 con 0x7f1ae40cbd60 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae2ffd640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae4150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae37fe640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ae40cbd60 0x7f1ae414ee90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00efc0 tx=0x7f1adc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1acb7fe640 1 -- 172.21.15.53:0/1573238339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc014480 con 0x7f1ae40cbd60 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1acb7fe640 1 -- 172.21.15.53:0/1573238339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc00f040 con 0x7f1ae40cbd60 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae4151d80 con 0x7f1ae40cbd60 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1acb7fe640 1 -- 172.21.15.53:0/1573238339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc014820 con 0x7f1ae40cbd60 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae4152340 con 0x7f1ae40cbd60 2024-09-13T18:25:23.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae4067400 con 0x7f1ae40cbd60 2024-09-13T18:25:23.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1acb7fe640 1 -- 172.21.15.53:0/1573238339 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1adc014980 con 0x7f1ae40cbd60 2024-09-13T18:25:23.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1acb7fe640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1ad00666c0 0x7f1ad0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1acb7fe640 1 -- 172.21.15.53:0/1573238339 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1adc084ca0 con 0x7f1ae40cbd60 2024-09-13T18:25:23.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.541+0000 7f1ae2ffd640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1ad00666c0 0x7f1ad0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.545+0000 7f1ae2ffd640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1ad00666c0 0x7f1ad0068b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4005890 tx=0x7f1ad4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:23.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.545+0000 7f1acb7fe640 1 -- 172.21.15.53:0/1573238339 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1adc052010 con 0x7f1ae40cbd60 2024-09-13T18:25:23.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.709+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ae40b2c40 con 0x7f1ae40cbd60 2024-09-13T18:25:23.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.709+0000 7f1acb7fe640 1 -- 172.21.15.53:0/1573238339 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f1adc018090 con 0x7f1ae40cbd60 2024-09-13T18:25:23.714 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:23.714 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:23.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1ad00666c0 msgr2=0x7f1ad0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1ad00666c0 0x7f1ad0068b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4005890 tx=0x7f1ad4009040 comp rx=0 tx=0).stop 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ae40cbd60 msgr2=0x7f1ae414ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ae40cbd60 0x7f1ae414ee90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00efc0 tx=0x7f1adc00c490 comp rx=0 tx=0).stop 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 shutdown_connections 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1ad00666c0 0x7f1ad0068b80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ae40cbd60 0x7f1ae414ee90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ae40cb980 0x7f1ae414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 --2- 172.21.15.53:0/1573238339 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ae406b850 0x7f1ae4150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 >> 172.21.15.53:0/1573238339 conn(0x7f1ae4065c80 msgr2=0x7f1ae40cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 shutdown_connections 2024-09-13T18:25:23.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.713+0000 7f1ae94b4640 1 -- 172.21.15.53:0/1573238339 wait complete. 2024-09-13T18:25:23.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:23.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:23.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc2821c8640 1 Processor -- start 2024-09-13T18:25:23.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc2821c8640 1 -- start start 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc2821c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c15a4a0 0x7fc27c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc2821c8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc27c066390 0x7fc27c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc2821c8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c06d080 con 0x7fc27c0cf1f0 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc2821c8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c0ccd20 con 0x7fc27c066390 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc2821c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c06d2b0 con 0x7fc27c15a4a0 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc27c066390 0x7fc27c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc27c066390 0x7fc27c15a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50506/0 (socket says 172.21.15.53:50506) 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc27c0cf1f0 0x7fc27c065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39718/0 (socket says 172.21.15.53:39718) 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27bfff640 1 -- 172.21.15.53:0/1867476793 learned_addr learned my addr 172.21.15.53:0/1867476793 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:23.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27b7fe640 1 --2- 172.21.15.53:0/1867476793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c15a4a0 0x7fc27c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27bfff640 1 -- 172.21.15.53:0/1867476793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c15a4a0 msgr2=0x7fc27c06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:23.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27bfff640 1 --2- 172.21.15.53:0/1867476793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c15a4a0 0x7fc27c06cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27bfff640 1 -- 172.21.15.53:0/1867476793 >> v1:172.21.15.53:6789/0 conn(0x7fc27c0cf1f0 legacy=0x7fc27c065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27bfff640 1 -- 172.21.15.53:0/1867476793 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c06d590 con 0x7fc27c066390 2024-09-13T18:25:23.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.861+0000 7fc27a7fc640 1 -- 172.21.15.53:0/1867476793 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874964160 0 0) 0x7fc27c06d080 con 0x7fc27c0cf1f0 2024-09-13T18:25:23.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc27bfff640 1 --2- 172.21.15.53:0/1867476793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c15a880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc274009e50 tx=0x7fc27401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459684ce23791b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:23.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc27a7fc640 1 -- 172.21.15.53:0/1867476793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740a58d0 con 0x7fc27c066390 2024-09-13T18:25:23.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc27a7fc640 1 -- 172.21.15.53:0/1867476793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2740a5a30 con 0x7fc27c066390 2024-09-13T18:25:23.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc27a7fc640 1 -- 172.21.15.53:0/1867476793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740a5dc0 con 0x7fc27c066390 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 -- 172.21.15.53:0/1867476793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 msgr2=0x7fc27c15a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 --2- 172.21.15.53:0/1867476793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c15a880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc274009e50 tx=0x7fc27401ca00 comp rx=0 tx=0).stop 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 -- 172.21.15.53:0/1867476793 shutdown_connections 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 --2- 172.21.15.53:0/1867476793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c15a880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 --2- 172.21.15.53:0/1867476793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c15a4a0 0x7fc27c06cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 -- 172.21.15.53:0/1867476793 >> 172.21.15.53:0/1867476793 conn(0x7fc27c069f50 msgr2=0x7fc27c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 -- 172.21.15.53:0/1867476793 shutdown_connections 2024-09-13T18:25:23.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 -- 172.21.15.53:0/1867476793 wait complete. 2024-09-13T18:25:23.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 Processor -- start 2024-09-13T18:25:23.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.865+0000 7fc2821c8640 1 -- start start 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c0cf1f0 0x7fc27c145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc27c15a4a0 0x7fc27c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c14f7c0 con 0x7fc27c066390 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c14faa0 con 0x7fc27c15a4a0 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c14fd80 con 0x7fc27c0cf1f0 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50512/0 (socket says 172.21.15.53:50512) 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 -- 172.21.15.53:0/763004662 learned_addr learned my addr 172.21.15.53:0/763004662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27affd640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c0cf1f0 0x7fc27c145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 -- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c0cf1f0 msgr2=0x7fc27c145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c0cf1f0 0x7fc27c145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27bfff640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc27c15a4a0 0x7fc27c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 -- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc27c15a4a0 msgr2=0x7fc27c148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc27c15a4a0 0x7fc27c148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 -- 172.21.15.53:0/763004662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009b30 con 0x7fc27c066390 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27b7fe640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c147160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00e870 tx=0x7fc26c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc263fff640 1 -- 172.21.15.53:0/763004662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c009510 con 0x7fc27c066390 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc263fff640 1 -- 172.21.15.53:0/763004662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c00eec0 con 0x7fc27c066390 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc263fff640 1 -- 172.21.15.53:0/763004662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00cb40 con 0x7fc27c066390 2024-09-13T18:25:23.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c150060 con 0x7fc27c066390 2024-09-13T18:25:23.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c1494f0 con 0x7fc27c066390 2024-09-13T18:25:23.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c15b950 con 0x7fc27c066390 2024-09-13T18:25:23.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc263fff640 1 -- 172.21.15.53:0/763004662 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc26c00cca0 con 0x7fc27c066390 2024-09-13T18:25:23.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc263fff640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc2680666c0 0x7fc268068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:23.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc263fff640 1 -- 172.21.15.53:0/763004662 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc26c0849e0 con 0x7fc27c066390 2024-09-13T18:25:23.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.869+0000 7fc27affd640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc2680666c0 0x7fc268068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:23.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.873+0000 7fc27affd640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc2680666c0 0x7fc268068b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0cbc50 tx=0x7fc270009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:23.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:23.873+0000 7fc263fff640 1 -- 172.21.15.53:0/763004662 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc26c051e40 con 0x7fc27c066390 2024-09-13T18:25:24.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.033+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc27c154cb0 con 0x7fc27c066390 2024-09-13T18:25:24.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc263fff640 1 -- 172.21.15.53:0/763004662 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc26c0170a0 con 0x7fc27c066390 2024-09-13T18:25:24.038 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc2680666c0 msgr2=0x7fc268068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc2680666c0 0x7fc268068b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0cbc50 tx=0x7fc270009040 comp rx=0 tx=0).stop 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 msgr2=0x7fc27c147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c147160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00e870 tx=0x7fc26c00ec70 comp rx=0 tx=0).stop 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 shutdown_connections 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc2680666c0 0x7fc268068b80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc27c0cf1f0 0x7fc27c145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc27c15a4a0 0x7fc27c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 --2- 172.21.15.53:0/763004662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc27c066390 0x7fc27c147160 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 >> 172.21.15.53:0/763004662 conn(0x7fc27c069f50 msgr2=0x7fc27c0cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:24.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 shutdown_connections 2024-09-13T18:25:24.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.037+0000 7fc2821c8640 1 -- 172.21.15.53:0/763004662 wait complete. 2024-09-13T18:25:24.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:24.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 Processor -- start 2024-09-13T18:25:24.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 -- start start 2024-09-13T18:25:24.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c415c830 0x7f99c40d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f99c40ccd10 0x7f99c40cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c40d3650 con 0x7f99c415c830 2024-09-13T18:25:24.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c40b7db0 con 0x7f99c40ccd10 2024-09-13T18:25:24.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99cb4b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40d0650 con 0x7f99c40d2c80 2024-09-13T18:25:24.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c415c830 0x7f99c40d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c415c830 0x7f99c40d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50526/0 (socket says 172.21.15.53:50526) 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 -- 172.21.15.53:0/123065473 learned_addr learned my addr 172.21.15.53:0/123065473 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c8a4e640 1 --2- 172.21.15.53:0/123065473 >> v2:172.21.15.87:3300/0 conn(0x7f99c40ccd10 0x7f99c40cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c9a50640 1 --2- 172.21.15.53:0/123065473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 -- 172.21.15.53:0/123065473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 msgr2=0x7f99c40d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 --2- 172.21.15.53:0/123065473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 -- 172.21.15.53:0/123065473 >> v2:172.21.15.87:3300/0 conn(0x7f99c40ccd10 msgr2=0x7f99c40cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 --2- 172.21.15.53:0/123065473 >> v2:172.21.15.87:3300/0 conn(0x7f99c40ccd10 0x7f99c40cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.185+0000 7f99c924f640 1 -- 172.21.15.53:0/123065473 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c40d0c10 con 0x7f99c415c830 2024-09-13T18:25:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99c924f640 1 --2- 172.21.15.53:0/123065473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40d10a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f99c40b43f0 tx=0x7f99c001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90767186de5745c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99bbfff640 1 -- 172.21.15.53:0/123065473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00a89d0 con 0x7f99c415c830 2024-09-13T18:25:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99bbfff640 1 -- 172.21.15.53:0/123065473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c00a8b30 con 0x7f99c415c830 2024-09-13T18:25:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99bbfff640 1 -- 172.21.15.53:0/123065473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00b0440 con 0x7f99c415c830 2024-09-13T18:25:24.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- 172.21.15.53:0/123065473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 msgr2=0x7f99c40d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/123065473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40d10a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f99c40b43f0 tx=0x7f99c001ed10 comp rx=0 tx=0).stop 2024-09-13T18:25:24.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- 172.21.15.53:0/123065473 shutdown_connections 2024-09-13T18:25:24.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/123065473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/123065473 >> v2:172.21.15.87:3300/0 conn(0x7f99c40ccd10 0x7f99c40cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/123065473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40d10a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- 172.21.15.53:0/123065473 >> 172.21.15.53:0/123065473 conn(0x7f99c4070970 msgr2=0x7f99c4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- 172.21.15.53:0/123065473 shutdown_connections 2024-09-13T18:25:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- 172.21.15.53:0/123065473 wait complete. 2024-09-13T18:25:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 Processor -- start 2024-09-13T18:25:24.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- start start 2024-09-13T18:25:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40ccd10 0x7f99c4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c415efe0 con 0x7f99c415c830 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40ccb40 con 0x7f99c40ccd10 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.189+0000 7f99cb4b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40cbfc0 con 0x7f99c40d2c80 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c8a4e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50540/0 (socket says 172.21.15.53:50540) 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 -- 172.21.15.53:0/1286820640 learned_addr learned my addr 172.21.15.53:0/1286820640 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c924f640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40ccd10 0x7f99c4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 -- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 msgr2=0x7f99c40b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 -- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40ccd10 msgr2=0x7f99c4155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40ccd10 0x7f99c4155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 -- 172.21.15.53:0/1286820640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c00094d0 con 0x7f99c415c830 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c924f640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40ccd10 0x7f99c4155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c9a50640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40b3960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f99bc007e70 tx=0x7f99bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99b9ffb640 1 -- 172.21.15.53:0/1286820640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc014620 con 0x7f99c415c830 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99b9ffb640 1 -- 172.21.15.53:0/1286820640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc0147a0 con 0x7f99c415c830 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c40cc2a0 con 0x7f99c415c830 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99b9ffb640 1 -- 172.21.15.53:0/1286820640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc014b50 con 0x7f99c415c830 2024-09-13T18:25:24.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c40cc860 con 0x7f99c415c830 2024-09-13T18:25:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c4156640 con 0x7f99c415c830 2024-09-13T18:25:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99b9ffb640 1 -- 172.21.15.53:0/1286820640 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99bc014cb0 con 0x7f99c415c830 2024-09-13T18:25:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99b9ffb640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f99a8066690 0x7f99a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99b9ffb640 1 -- 172.21.15.53:0/1286820640 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99bc084a20 con 0x7f99c415c830 2024-09-13T18:25:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.193+0000 7f99c924f640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f99a8066690 0x7f99a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.197+0000 7f99c924f640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f99a8066690 0x7f99a8068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99c00b2000 tx=0x7f99c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.197+0000 7f99b9ffb640 1 -- 172.21.15.53:0/1286820640 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99c4156640 con 0x7f99c415c830 2024-09-13T18:25:24.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:25:24.291 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:25:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.357+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99c4156640 con 0x7f99c415c830 2024-09-13T18:25:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99b9ffb640 1 -- 172.21.15.53:0/1286820640 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99c4156640 con 0x7f99c415c830 2024-09-13T18:25:24.363 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f99a8066690 msgr2=0x7f99a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f99a8066690 0x7f99a8068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99c00b2000 tx=0x7f99c0009040 comp rx=0 tx=0).stop 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 msgr2=0x7f99c40b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40b3960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f99bc007e70 tx=0x7f99bc00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 shutdown_connections 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f99a8066690 0x7f99a8068b50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40d2c80 0x7f99c40b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c415c830 0x7f99c40b3960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 --2- 172.21.15.53:0/1286820640 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40ccd10 0x7f99c4155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 >> 172.21.15.53:0/1286820640 conn(0x7f99c4070970 msgr2=0x7f99c40b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 shutdown_connections 2024-09-13T18:25:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.361+0000 7f99cb4b3640 1 -- 172.21.15.53:0/1286820640 wait complete. 2024-09-13T18:25:24.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:24.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.545+0000 7fcab4b60640 1 Processor -- start 2024-09-13T18:25:24.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.545+0000 7fcab4b60640 1 -- start start 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcab4b60640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcab0143e80 0x7fcab006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcab4b60640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcab00cda30 0x7fcab00cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcab4b60640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab006f7a0 con 0x7fcab00caee0 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcab4b60640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab006fd60 con 0x7fcab00cda30 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcab4b60640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab00cb960 con 0x7fcab0143e80 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcab00cda30 0x7fcab00cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcab00cda30 0x7fcab00cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50542/0 (socket says 172.21.15.53:50542) 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 -- 172.21.15.53:0/947198322 learned_addr learned my addr 172.21.15.53:0/947198322 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaae59c640 1 --2- 172.21.15.53:0/947198322 >> v2:172.21.15.87:3300/0 conn(0x7fcab0143e80 0x7fcab006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 -- 172.21.15.53:0/947198322 >> v2:172.21.15.87:3300/0 conn(0x7fcab0143e80 msgr2=0x7fcab006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 --2- 172.21.15.53:0/947198322 >> v2:172.21.15.87:3300/0 conn(0x7fcab0143e80 0x7fcab006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 -- 172.21.15.53:0/947198322 >> v1:172.21.15.87:6789/0 conn(0x7fcab00caee0 legacy=0x7fcab00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 -- 172.21.15.53:0/947198322 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00cbc40 con 0x7fcab00cda30 2024-09-13T18:25:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaaed9d640 1 --2- 172.21.15.53:0/947198322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00cda30 0x7fcab00cb350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcab00676d0 tx=0x7fcaa801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de2b28ce4e78d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaad59a640 1 -- 172.21.15.53:0/947198322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80a5740 con 0x7fcab00cda30 2024-09-13T18:25:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaad59a640 1 -- 172.21.15.53:0/947198322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80a58a0 con 0x7fcab00cda30 2024-09-13T18:25:24.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.549+0000 7fcaad59a640 1 -- 172.21.15.53:0/947198322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80a5c30 con 0x7fcab00cda30 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- 172.21.15.53:0/947198322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00cda30 msgr2=0x7fcab00cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 --2- 172.21.15.53:0/947198322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00cda30 0x7fcab00cb350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcab00676d0 tx=0x7fcaa801c8a0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- 172.21.15.53:0/947198322 shutdown_connections 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 --2- 172.21.15.53:0/947198322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00cda30 0x7fcab00cb350 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 --2- 172.21.15.53:0/947198322 >> v2:172.21.15.87:3300/0 conn(0x7fcab0143e80 0x7fcab006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- 172.21.15.53:0/947198322 >> 172.21.15.53:0/947198322 conn(0x7fcab0065c80 msgr2=0x7fcab0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- 172.21.15.53:0/947198322 shutdown_connections 2024-09-13T18:25:24.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- 172.21.15.53:0/947198322 wait complete. 2024-09-13T18:25:24.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 Processor -- start 2024-09-13T18:25:24.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- start start 2024-09-13T18:25:24.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00caee0 0x7fcab01f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab00cda30 0x7fcab01f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcab0143e80 0x7fcab00c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab01f4ae0 con 0x7fcab00caee0 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00c3ca0 con 0x7fcab00cda30 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00c3f80 con 0x7fcab0143e80 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00caee0 0x7fcab01f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00caee0 0x7fcab01f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50558/0 (socket says 172.21.15.53:50558) 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 -- 172.21.15.53:0/1549090782 learned_addr learned my addr 172.21.15.53:0/1549090782 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaaed9d640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcab0143e80 0x7fcab00c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaadd9b640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab00cda30 0x7fcab01f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 -- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcab0143e80 msgr2=0x7fcab00c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcab0143e80 0x7fcab00c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 -- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab00cda30 msgr2=0x7fcab01f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab00cda30 0x7fcab01f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 -- 172.21.15.53:0/1549090782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa8009b30 con 0x7fcab00caee0 2024-09-13T18:25:24.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcaae59c640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00caee0 0x7fcab01f5880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400d5f0 tx=0x7fcaa400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fca9effd640 1 -- 172.21.15.53:0/1549090782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40125f0 con 0x7fcab00caee0 2024-09-13T18:25:24.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fca9effd640 1 -- 172.21.15.53:0/1549090782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4012750 con 0x7fcab00caee0 2024-09-13T18:25:24.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab00c4260 con 0x7fcab00caee0 2024-09-13T18:25:24.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fca9effd640 1 -- 172.21.15.53:0/1549090782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4012ae0 con 0x7fcab00caee0 2024-09-13T18:25:24.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.553+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab00c4820 con 0x7fcab00caee0 2024-09-13T18:25:24.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.557+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab00cb350 con 0x7fcab00caee0 2024-09-13T18:25:24.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.557+0000 7fca9effd640 1 -- 172.21.15.53:0/1549090782 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcaa4012c40 con 0x7fcab00caee0 2024-09-13T18:25:24.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.557+0000 7fca9effd640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca90066690 0x7fca90068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.557+0000 7fca9effd640 1 -- 172.21.15.53:0/1549090782 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaa40844e0 con 0x7fcab00caee0 2024-09-13T18:25:24.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.557+0000 7fcaadd9b640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca90066690 0x7fca90068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.557+0000 7fcaadd9b640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca90066690 0x7fca90068b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcab013f930 tx=0x7fcaa0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.561+0000 7fca9effd640 1 -- 172.21.15.53:0/1549090782 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcaa4051990 con 0x7fcab00caee0 2024-09-13T18:25:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcab00b3030 con 0x7fcab00caee0 2024-09-13T18:25:24.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fca9effd640 1 -- 172.21.15.53:0/1549090782 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcaa4054fb0 con 0x7fcab00caee0 2024-09-13T18:25:24.728 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca90066690 msgr2=0x7fca90068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca90066690 0x7fca90068b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcab013f930 tx=0x7fcaa0009040 comp rx=0 tx=0).stop 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00caee0 msgr2=0x7fcab01f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00caee0 0x7fcab01f5880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400d5f0 tx=0x7fcaa400dab0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 shutdown_connections 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca90066690 0x7fca90068b50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcab0143e80 0x7fcab00c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcab00cda30 0x7fcab01f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 --2- 172.21.15.53:0/1549090782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcab00caee0 0x7fcab01f5880 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 >> 172.21.15.53:0/1549090782 conn(0x7fcab0065c80 msgr2=0x7fcab00cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:24.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 shutdown_connections 2024-09-13T18:25:24.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.725+0000 7fcab4b60640 1 -- 172.21.15.53:0/1549090782 wait complete. 2024-09-13T18:25:24.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:24.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.861+0000 7ff8de472640 1 Processor -- start 2024-09-13T18:25:24.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8de472640 1 -- start start 2024-09-13T18:25:24.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8de472640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff8d80cb980 0x7ff8d80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8de472640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d806b850 0x7ff8d80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8de472640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8d80cbd60 0x7ff8d806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8de472640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80b1ac0 con 0x7ff8d80cbd60 2024-09-13T18:25:24.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8de472640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d8159ac0 con 0x7ff8d80cb980 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8de472640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8159da0 con 0x7ff8d806b850 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8d80cbd60 0x7ff8d806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8d80cbd60 0x7ff8d806fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50572/0 (socket says 172.21.15.53:50572) 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 -- 172.21.15.53:0/865268034 learned_addr learned my addr 172.21.15.53:0/865268034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8d7fff640 1 --2- 172.21.15.53:0/865268034 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80cb980 0x7ff8d80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8cffff640 1 --2- 172.21.15.53:0/865268034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d806b850 0x7ff8d80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 -- 172.21.15.53:0/865268034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d806b850 msgr2=0x7ff8d80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 --2- 172.21.15.53:0/865268034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d806b850 0x7ff8d80cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 -- 172.21.15.53:0/865268034 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80cb980 msgr2=0x7ff8d80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 --2- 172.21.15.53:0/865268034 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80cb980 0x7ff8d80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8dca0f640 1 -- 172.21.15.53:0/865268034 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d815a080 con 0x7ff8d80cbd60 2024-09-13T18:25:24.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.865+0000 7ff8d7fff640 1 --2- 172.21.15.53:0/865268034 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80cb980 0x7ff8d80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8dca0f640 1 --2- 172.21.15.53:0/865268034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cbd60 0x7ff8d806fcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009e50 tx=0x7ff8d001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af09b70d917d9323 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8d77fe640 1 -- 172.21.15.53:0/865268034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00a56c0 con 0x7ff8d80cbd60 2024-09-13T18:25:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8d77fe640 1 -- 172.21.15.53:0/865268034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d00a5820 con 0x7ff8d80cbd60 2024-09-13T18:25:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8d77fe640 1 -- 172.21.15.53:0/865268034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00a5bb0 con 0x7ff8d80cbd60 2024-09-13T18:25:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- 172.21.15.53:0/865268034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cbd60 msgr2=0x7ff8d806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 --2- 172.21.15.53:0/865268034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cbd60 0x7ff8d806fcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009e50 tx=0x7ff8d001c930 comp rx=0 tx=0).stop 2024-09-13T18:25:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- 172.21.15.53:0/865268034 shutdown_connections 2024-09-13T18:25:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 --2- 172.21.15.53:0/865268034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d806b850 0x7ff8d80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 --2- 172.21.15.53:0/865268034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cbd60 0x7ff8d806fcd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 --2- 172.21.15.53:0/865268034 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80cb980 0x7ff8d80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- 172.21.15.53:0/865268034 >> 172.21.15.53:0/865268034 conn(0x7ff8d8065c80 msgr2=0x7ff8d8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:24.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- 172.21.15.53:0/865268034 shutdown_connections 2024-09-13T18:25:24.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- 172.21.15.53:0/865268034 wait complete. 2024-09-13T18:25:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 Processor -- start 2024-09-13T18:25:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- start start 2024-09-13T18:25:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d806b850 0x7ff8d80abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cb980 0x7ff8d8143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d80cbd60 0x7ff8d81624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80ac6e0 con 0x7ff8d80cb980 2024-09-13T18:25:24.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80ac9c0 con 0x7ff8d806b850 2024-09-13T18:25:24.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8de472640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80acca0 con 0x7ff8d80cbd60 2024-09-13T18:25:24.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cb980 0x7ff8d8143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cb980 0x7ff8d8143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50584/0 (socket says 172.21.15.53:50584) 2024-09-13T18:25:24.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 -- 172.21.15.53:0/3849930897 learned_addr learned my addr 172.21.15.53:0/3849930897 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:24.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8dca0f640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d80cbd60 0x7ff8d81624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8d7fff640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d806b850 0x7ff8d80abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 -- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d80cbd60 msgr2=0x7ff8d81624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d80cbd60 0x7ff8d81624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 -- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d806b850 msgr2=0x7ff8d80abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:24.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d806b850 0x7ff8d80abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:24.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.869+0000 7ff8cffff640 1 -- 172.21.15.53:0/3849930897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0009b30 con 0x7ff8d80cb980 2024-09-13T18:25:24.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8cffff640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cb980 0x7ff8d8143a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000d5d0 tx=0x7ff8c000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d57fa640 1 -- 172.21.15.53:0/3849930897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c00125f0 con 0x7ff8d80cb980 2024-09-13T18:25:24.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d57fa640 1 -- 172.21.15.53:0/3849930897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c0012750 con 0x7ff8d80cb980 2024-09-13T18:25:24.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d80acf80 con 0x7ff8d80cb980 2024-09-13T18:25:24.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d57fa640 1 -- 172.21.15.53:0/3849930897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0012ae0 con 0x7ff8d80cb980 2024-09-13T18:25:24.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d80ac3e0 con 0x7ff8d80cb980 2024-09-13T18:25:24.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d8067400 con 0x7ff8d80cb980 2024-09-13T18:25:24.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d57fa640 1 -- 172.21.15.53:0/3849930897 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff8c0012c40 con 0x7ff8d80cb980 2024-09-13T18:25:24.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d57fa640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff8b8066690 0x7ff8b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:24.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d57fa640 1 -- 172.21.15.53:0/3849930897 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8c00846c0 con 0x7ff8d80cb980 2024-09-13T18:25:24.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d7fff640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff8b8066690 0x7ff8b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:24.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.873+0000 7ff8d7fff640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff8b8066690 0x7ff8b8068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009830 tx=0x7ff8c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:24.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:24.877+0000 7ff8d57fa640 1 -- 172.21.15.53:0/3849930897 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8c0051990 con 0x7ff8d80cb980 2024-09-13T18:25:25.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.041+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8d80b33b0 con 0x7ff8d80cb980 2024-09-13T18:25:25.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.041+0000 7ff8d57fa640 1 -- 172.21.15.53:0/3849930897 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7ff8c0054fb0 con 0x7ff8d80cb980 2024-09-13T18:25:25.046 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:25.046 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:25.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff8b8066690 msgr2=0x7ff8b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff8b8066690 0x7ff8b8068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009830 tx=0x7ff8c8008040 comp rx=0 tx=0).stop 2024-09-13T18:25:25.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cb980 msgr2=0x7ff8d8143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cb980 0x7ff8d8143a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000d5d0 tx=0x7ff8c000da90 comp rx=0 tx=0).stop 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 shutdown_connections 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff8b8066690 0x7ff8b8068b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d80cbd60 0x7ff8d81624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80cb980 0x7ff8d8143a70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 --2- 172.21.15.53:0/3849930897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d806b850 0x7ff8d80abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 >> 172.21.15.53:0/3849930897 conn(0x7ff8d8065c80 msgr2=0x7ff8d80af940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 shutdown_connections 2024-09-13T18:25:25.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.045+0000 7ff8de472640 1 -- 172.21.15.53:0/3849930897 wait complete. 2024-09-13T18:25:25.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:25.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 Processor -- start 2024-09-13T18:25:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 -- start start 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66881457c0 0x7f66880b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66880b1a40 0x7f6688070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6688071220 0x7f668806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880702d0 con 0x7f6688071220 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6688146180 con 0x7f66881457c0 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668f4b6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668806c4c0 con 0x7f66880b1a40 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6688071220 0x7f668806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6688071220 0x7f668806b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50586/0 (socket says 172.21.15.53:50586) 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 -- 172.21.15.53:0/3352170734 learned_addr learned my addr 172.21.15.53:0/3352170734 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668ca51640 1 --2- 172.21.15.53:0/3352170734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66880b1a40 0x7f6688070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668d252640 1 --2- 172.21.15.53:0/3352170734 >> v2:172.21.15.87:3300/0 conn(0x7f66881457c0 0x7f66880b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 -- 172.21.15.53:0/3352170734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66880b1a40 msgr2=0x7f6688070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 --2- 172.21.15.53:0/3352170734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66880b1a40 0x7f6688070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 -- 172.21.15.53:0/3352170734 >> v2:172.21.15.87:3300/0 conn(0x7f66881457c0 msgr2=0x7f66880b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 --2- 172.21.15.53:0/3352170734 >> v2:172.21.15.87:3300/0 conn(0x7f66881457c0 0x7f66880b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668da53640 1 -- 172.21.15.53:0/3352170734 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668806bf00 con 0x7f6688071220 2024-09-13T18:25:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.357+0000 7f668d252640 1 --2- 172.21.15.53:0/3352170734 >> v2:172.21.15.87:3300/0 conn(0x7f66881457c0 0x7f66880b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 --2- 172.21.15.53:0/3352170734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6688071220 0x7f668806b390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f668806f000 tx=0x7f668001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a879d12d894379a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:25.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f667ffff640 1 -- 172.21.15.53:0/3352170734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800a5750 con 0x7f6688071220 2024-09-13T18:25:25.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f667ffff640 1 -- 172.21.15.53:0/3352170734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66800a58b0 con 0x7f6688071220 2024-09-13T18:25:25.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f667ffff640 1 -- 172.21.15.53:0/3352170734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800a5c40 con 0x7f6688071220 2024-09-13T18:25:25.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- 172.21.15.53:0/3352170734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6688071220 msgr2=0x7f668806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 --2- 172.21.15.53:0/3352170734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6688071220 0x7f668806b390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f668806f000 tx=0x7f668001c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- 172.21.15.53:0/3352170734 shutdown_connections 2024-09-13T18:25:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 --2- 172.21.15.53:0/3352170734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66880b1a40 0x7f6688070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 --2- 172.21.15.53:0/3352170734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6688071220 0x7f668806b390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 --2- 172.21.15.53:0/3352170734 >> v2:172.21.15.87:3300/0 conn(0x7f66881457c0 0x7f66880b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- 172.21.15.53:0/3352170734 >> 172.21.15.53:0/3352170734 conn(0x7f6688065c80 msgr2=0x7f6688066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- 172.21.15.53:0/3352170734 shutdown_connections 2024-09-13T18:25:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- 172.21.15.53:0/3352170734 wait complete. 2024-09-13T18:25:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 Processor -- start 2024-09-13T18:25:25.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- start start 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6688071220 0x7f668815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66880b1a40 0x7f6688160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66881457c0 0x7f6688161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66881f5460 con 0x7f66881457c0 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66881f5f70 con 0x7f66880b1a40 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668f4b6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668815fe60 con 0x7f6688071220 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66881457c0 0x7f6688161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66881457c0 0x7f6688161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50600/0 (socket says 172.21.15.53:50600) 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 -- 172.21.15.53:0/488753903 learned_addr learned my addr 172.21.15.53:0/488753903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668ca51640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66880b1a40 0x7f6688160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668d252640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6688071220 0x7f668815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 -- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6688071220 msgr2=0x7f668815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6688071220 0x7f668815bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 -- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66880b1a40 msgr2=0x7f6688160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66880b1a40 0x7f6688160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.361+0000 7f668da53640 1 -- 172.21.15.53:0/488753903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680009b30 con 0x7f66881457c0 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f668da53640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66881457c0 0x7f6688161280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66800af040 tx=0x7f6680019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f667dffb640 1 -- 172.21.15.53:0/488753903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800b8670 con 0x7f66881457c0 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f667dffb640 1 -- 172.21.15.53:0/488753903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66800b87f0 con 0x7f66881457c0 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66881f5640 con 0x7f66881457c0 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f667dffb640 1 -- 172.21.15.53:0/488753903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800b8ba0 con 0x7f66881457c0 2024-09-13T18:25:25.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66881f5c00 con 0x7f66881457c0 2024-09-13T18:25:25.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66881f60e0 con 0x7f66881457c0 2024-09-13T18:25:25.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f667dffb640 1 -- 172.21.15.53:0/488753903 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66800b8d00 con 0x7f66881457c0 2024-09-13T18:25:25.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f667dffb640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f666c066690 0x7f666c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f667dffb640 1 -- 172.21.15.53:0/488753903 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f668011f740 con 0x7f66881457c0 2024-09-13T18:25:25.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f668d252640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f666c066690 0x7f666c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.365+0000 7f668d252640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f666c066690 0x7f666c068b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6678006fd0 tx=0x7f6678008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:25.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.369+0000 7f667dffb640 1 -- 172.21.15.53:0/488753903 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66800ecc90 con 0x7f66881457c0 2024-09-13T18:25:25.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.521+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6688070ce0 con 0x7f66881457c0 2024-09-13T18:25:25.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f667dffb640 1 -- 172.21.15.53:0/488753903 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66800f02b0 con 0x7f66881457c0 2024-09-13T18:25:25.527 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:25.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f666c066690 msgr2=0x7f666c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f666c066690 0x7f666c068b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6678006fd0 tx=0x7f6678008040 comp rx=0 tx=0).stop 2024-09-13T18:25:25.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66881457c0 msgr2=0x7f6688161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66881457c0 0x7f6688161280 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66800af040 tx=0x7f6680019760 comp rx=0 tx=0).stop 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 shutdown_connections 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f666c066690 0x7f666c068b50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66881457c0 0x7f6688161280 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66880b1a40 0x7f6688160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 --2- 172.21.15.53:0/488753903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6688071220 0x7f668815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 >> 172.21.15.53:0/488753903 conn(0x7f6688065c80 msgr2=0x7f668806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 shutdown_connections 2024-09-13T18:25:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.525+0000 7f668f4b6640 1 -- 172.21.15.53:0/488753903 wait complete. 2024-09-13T18:25:25.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1df1735640 1 Processor -- start 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1df1735640 1 -- start start 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1df1735640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1dec15c8d0 0x7f1dec0b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1df1735640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec0d05f0 0x7f1dec06a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1df1735640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec0b4880 con 0x7f1dec0b4370 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1df1735640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dec0b4b60 con 0x7f1dec15c8d0 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1df1735640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0b4e40 con 0x7f1dec0d05f0 2024-09-13T18:25:25.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1deaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1dec15c8d0 0x7f1dec0b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1deaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1dec15c8d0 0x7f1dec0b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50608/0 (socket says 172.21.15.53:50608) 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1deaffd640 1 -- 172.21.15.53:0/3663777722 learned_addr learned my addr 172.21.15.53:0/3663777722 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1dea7fc640 1 --2- 172.21.15.53:0/3663777722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec0d05f0 0x7f1dec06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1deaffd640 1 -- 172.21.15.53:0/3663777722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec0d05f0 msgr2=0x7f1dec06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1deaffd640 1 --2- 172.21.15.53:0/3663777722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec0d05f0 0x7f1dec06a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1deaffd640 1 -- 172.21.15.53:0/3663777722 >> v1:172.21.15.87:6789/0 conn(0x7f1dec0b4370 legacy=0x7f1dec160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.669+0000 7f1deaffd640 1 -- 172.21.15.53:0/3663777722 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec0b5120 con 0x7f1dec15c8d0 2024-09-13T18:25:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1deaffd640 1 --2- 172.21.15.53:0/3663777722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec15c8d0 0x7f1dec0b3e30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0707e0 tx=0x7f1ddc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe554f192c5da1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1de9ffb640 1 -- 172.21.15.53:0/3663777722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0aa5f0 con 0x7f1dec15c8d0 2024-09-13T18:25:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1de9ffb640 1 -- 172.21.15.53:0/3663777722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc0aa750 con 0x7f1dec15c8d0 2024-09-13T18:25:25.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1de9ffb640 1 -- 172.21.15.53:0/3663777722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0aaae0 con 0x7f1dec15c8d0 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- 172.21.15.53:0/3663777722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec15c8d0 msgr2=0x7f1dec0b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 --2- 172.21.15.53:0/3663777722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec15c8d0 0x7f1dec0b3e30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0707e0 tx=0x7f1ddc01c4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- 172.21.15.53:0/3663777722 shutdown_connections 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 --2- 172.21.15.53:0/3663777722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec0d05f0 0x7f1dec06a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 --2- 172.21.15.53:0/3663777722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec15c8d0 0x7f1dec0b3e30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- 172.21.15.53:0/3663777722 >> 172.21.15.53:0/3663777722 conn(0x7f1dec0b59b0 msgr2=0x7f1dec0b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- 172.21.15.53:0/3663777722 shutdown_connections 2024-09-13T18:25:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- 172.21.15.53:0/3663777722 wait complete. 2024-09-13T18:25:25.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 Processor -- start 2024-09-13T18:25:25.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- start start 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0b4370 0x7f1dec0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec0d05f0 0x7f1dec154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec15c8d0 0x7f1dec0b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec154fb0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec155250 con 0x7f1dec0b4370 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1df1735640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec15aa10 con 0x7f1dec15c8d0 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec0d05f0 0x7f1dec154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec0d05f0 0x7f1dec154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50618/0 (socket says 172.21.15.53:50618) 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 -- 172.21.15.53:0/2132686893 learned_addr learned my addr 172.21.15.53:0/2132686893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1deaffd640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0b4370 0x7f1dec0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1deb7fe640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec15c8d0 0x7f1dec0b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 -- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec15c8d0 msgr2=0x7f1dec0b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec15c8d0 0x7f1dec0b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 -- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0b4370 msgr2=0x7f1dec0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0b4370 0x7f1dec0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.673+0000 7f1dea7fc640 1 -- 172.21.15.53:0/2132686893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0094d0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1dea7fc640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec0d05f0 0x7f1dec154a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400d800 tx=0x7f1dd400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1de37fe640 1 -- 172.21.15.53:0/2132686893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400b6c0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1de37fe640 1 -- 172.21.15.53:0/2132686893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400b820 con 0x7f1dec0d05f0 2024-09-13T18:25:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec15acf0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1de37fe640 1 -- 172.21.15.53:0/2132686893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400bb90 con 0x7f1dec0d05f0 2024-09-13T18:25:25.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec15b2b0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec155400 con 0x7f1dec0d05f0 2024-09-13T18:25:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1de37fe640 1 -- 172.21.15.53:0/2132686893 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1dd400bcf0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1de37fe640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1dcc066690 0x7f1dcc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1de37fe640 1 -- 172.21.15.53:0/2132686893 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dd40846e0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1deaffd640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1dcc066690 0x7f1dcc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.677+0000 7f1deaffd640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1dcc066690 0x7f1dcc068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0ae000 tx=0x7f1ddc0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:25.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.681+0000 7f1de37fe640 1 -- 172.21.15.53:0/2132686893 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1dec155400 con 0x7f1dec0d05f0 2024-09-13T18:25:25.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.841+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1dec1553c0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1de37fe640 1 -- 172.21.15.53:0/2132686893 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1dd40554e0 con 0x7f1dec0d05f0 2024-09-13T18:25:25.847 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:25.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1dcc066690 msgr2=0x7f1dcc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1dcc066690 0x7f1dcc068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0ae000 tx=0x7f1ddc0a7000 comp rx=0 tx=0).stop 2024-09-13T18:25:25.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec0d05f0 msgr2=0x7f1dec154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec0d05f0 0x7f1dec154a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400d800 tx=0x7f1dd400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 shutdown_connections 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1dcc066690 0x7f1dcc068b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dec15c8d0 0x7f1dec0b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dec0d05f0 0x7f1dec154a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 --2- 172.21.15.53:0/2132686893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dec0b4370 0x7f1dec0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 >> 172.21.15.53:0/2132686893 conn(0x7f1dec0b59b0 msgr2=0x7f1dec15ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 shutdown_connections 2024-09-13T18:25:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.845+0000 7f1df1735640 1 -- 172.21.15.53:0/2132686893 wait complete. 2024-09-13T18:25:25.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:25.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f85856d3640 1 Processor -- start 2024-09-13T18:25:25.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f85856d3640 1 -- start start 2024-09-13T18:25:25.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f85856d3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85800ce420 0x7f8580164010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f85856d3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858006d690 con 0x7f85801592d0 2024-09-13T18:25:25.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f85856d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858006c5f0 con 0x7f85800cf040 2024-09-13T18:25:25.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f85856d3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858006c8d0 con 0x7f85800ce420 2024-09-13T18:25:25.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f85801592d0 0x7f858006dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39720/0 (socket says 172.21.15.53:39720) 2024-09-13T18:25:25.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857effd640 1 -- 172.21.15.53:0/4147599361 learned_addr learned my addr 172.21.15.53:0/4147599361 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:25.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857f7fe640 1 --2- 172.21.15.53:0/4147599361 >> v2:172.21.15.87:3300/0 conn(0x7f85800ce420 0x7f8580164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:25.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962906157 0 0) 0x7f858006d690 con 0x7f85801592d0 2024-09-13T18:25:25.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f856c003530 con 0x7f85801592d0 2024-09-13T18:25:25.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703913291 0 0) 0x7f856c003530 con 0x7f85801592d0 2024-09-13T18:25:25.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 >> v2:172.21.15.87:3300/0 conn(0x7f85800ce420 msgr2=0x7f8580164010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:25.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 --2- 172.21.15.53:0/4147599361 >> v2:172.21.15.87:3300/0 conn(0x7f85800ce420 0x7f8580164010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:25.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 >> v1:172.21.15.87:6789/0 conn(0x7f85800cf040 legacy=0x7f8580070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858006cbb0 con 0x7f85801592d0 2024-09-13T18:25:25.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f85680016a0 con 0x7f85801592d0 2024-09-13T18:25:25.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 >> v1:172.21.15.53:6789/0 conn(0x7f85801592d0 legacy=0x7f858006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:25.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c003980 0x7f856c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f856c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:25.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c005190 0x7f856c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858006c8d0 con 0x7f856c0047d0 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c00c130 con 0x7f856c005190 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c00c2f0 con 0x7f856c003980 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857e7fc640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f856c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857f7fe640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c005190 0x7f856c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857effd640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c003980 0x7f856c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857e7fc640 1 -- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c003980 msgr2=0x7f856c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857e7fc640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c003980 0x7f856c003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857e7fc640 1 -- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c005190 msgr2=0x7f856c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857e7fc640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c005190 0x7f856c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857e7fc640 1 -- 172.21.15.53:0/4147599361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c003530 con 0x7f856c0047d0 2024-09-13T18:25:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857f7fe640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c005190 0x7f856c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.993+0000 7f857f7fe640 1 -- 172.21.15.53:0/4147599361 reap_dead start 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f857e7fc640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f856c004c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8570001750 tx=0x7f857001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7fd88348c36397 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700052d0 con 0x7f856c0047d0 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85700a7050 con 0x7f856c0047d0 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f857dffb640 1 -- 172.21.15.53:0/4147599361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570003600 con 0x7f856c0047d0 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- 172.21.15.53:0/4147599361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 msgr2=0x7f856c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f856c004c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8570001750 tx=0x7f857001c360 comp rx=0 tx=0).stop 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- 172.21.15.53:0/4147599361 shutdown_connections 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 --2- 172.21.15.53:0/4147599361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f856c004c50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- 172.21.15.53:0/4147599361 >> 172.21.15.53:0/4147599361 conn(0x7f85800b1310 msgr2=0x7f85800b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- 172.21.15.53:0/4147599361 shutdown_connections 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- 172.21.15.53:0/4147599361 wait complete. 2024-09-13T18:25:26.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 Processor -- start 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- start start 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f858015c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85801f1a80 0x7f8580149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858014a420 0x7f858014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858014d240 con 0x7f856c0047d0 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858014d520 con 0x7f858014a420 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:25.997+0000 7f85856d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858015a2b0 con 0x7f85801f1a80 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f858015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f858015c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50634/0 (socket says 172.21.15.53:50634) 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 -- 172.21.15.53:0/3182350963 learned_addr learned my addr 172.21.15.53:0/3182350963 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857e7fc640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85801f1a80 0x7f8580149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857f7fe640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858014a420 0x7f858014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 -- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85801f1a80 msgr2=0x7f8580149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85801f1a80 0x7f8580149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 -- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858014a420 msgr2=0x7f858014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858014a420 0x7f858014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 -- 172.21.15.53:0/3182350963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858015a590 con 0x7f856c0047d0 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857effd640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f858015c120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f856800f960 tx=0x7f856800fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85777fe640 1 -- 172.21.15.53:0/3182350963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800dd90 con 0x7f856c0047d0 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85777fe640 1 -- 172.21.15.53:0/3182350963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85680070d0 con 0x7f856c0047d0 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858014d800 con 0x7f856c0047d0 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85777fe640 1 -- 172.21.15.53:0/3182350963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568007480 con 0x7f856c0047d0 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858014f220 con 0x7f856c0047d0 2024-09-13T18:25:26.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8580070d80 con 0x7f856c0047d0 2024-09-13T18:25:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85777fe640 1 -- 172.21.15.53:0/3182350963 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85680047f0 con 0x7f856c0047d0 2024-09-13T18:25:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85777fe640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8560066690 0x7f8560068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f85777fe640 1 -- 172.21.15.53:0/3182350963 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8568086820 con 0x7f856c0047d0 2024-09-13T18:25:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.001+0000 7f857e7fc640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8560066690 0x7f8560068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.005+0000 7f857e7fc640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8560066690 0x7f8560068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85800cf420 tx=0x7f85700011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.005+0000 7f85777fe640 1 -- 172.21.15.53:0/3182350963 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8568053c20 con 0x7f856c0047d0 2024-09-13T18:25:26.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8580153f20 con 0x7f856c0047d0 2024-09-13T18:25:26.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85777fe640 1 -- 172.21.15.53:0/3182350963 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85680200a0 con 0x7f856c0047d0 2024-09-13T18:25:26.168 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8560066690 msgr2=0x7f8560068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8560066690 0x7f8560068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85800cf420 tx=0x7f85700011a0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 msgr2=0x7f858015c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f858015c120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f856800f960 tx=0x7f856800fe20 comp rx=0 tx=0).stop 2024-09-13T18:25:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 shutdown_connections 2024-09-13T18:25:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8560066690 0x7f8560068b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85801f1a80 0x7f8580149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f858014a420 0x7f858014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 --2- 172.21.15.53:0/3182350963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c0047d0 0x7f858015c120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 >> 172.21.15.53:0/3182350963 conn(0x7f85800b1310 msgr2=0x7f85800cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 shutdown_connections 2024-09-13T18:25:26.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.165+0000 7f85856d3640 1 -- 172.21.15.53:0/3182350963 wait complete. 2024-09-13T18:25:26.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:26.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e99c0a640 1 Processor -- start 2024-09-13T18:25:26.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e99c0a640 1 -- start start 2024-09-13T18:25:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e99c0a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 0x7f8e940b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e99c0a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e940b1ac0 con 0x7f8e940cbd60 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e99c0a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e94159ac0 con 0x7f8e9406b850 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e99c0a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94159da0 con 0x7f8e940cb980 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e93fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8e940cbd60 0x7f8e940b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39728/0 (socket says 172.21.15.53:39728) 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e93fff640 1 -- 172.21.15.53:0/4277425893 learned_addr learned my addr 172.21.15.53:0/4277425893 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e937fe640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 0x7f8e940b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396345971 0 0) 0x7f8e940b1ac0 con 0x7f8e940cbd60 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e80003530 con 0x7f8e940cbd60 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 245633062 0 0) 0x7f8e80003530 con 0x7f8e940cbd60 2024-09-13T18:25:26.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 msgr2=0x7f8e940b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 0x7f8e940b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 >> v1:172.21.15.87:6789/0 conn(0x7f8e9406b850 legacy=0x7f8e9406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9415a080 con 0x7f8e940cbd60 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8e8c001a00 con 0x7f8e940cbd60 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 >> v1:172.21.15.53:6789/0 conn(0x7f8e940cbd60 legacy=0x7f8e940b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800039b0 0x7f8e80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e800047d0 0x7f8e80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 0x7f8e800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94159da0 con 0x7f8e800047d0 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8000bac0 con 0x7f8e800039b0 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8000bc80 con 0x7f8e940cb980 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e8affd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e800047d0 0x7f8e80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e937fe640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800039b0 0x7f8e80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e93fff640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 0x7f8e800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e8affd640 1 -- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 msgr2=0x7f8e800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e8affd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 0x7f8e800051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e8affd640 1 -- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800039b0 msgr2=0x7f8e80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e8affd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800039b0 0x7f8e80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e8affd640 1 -- 172.21.15.53:0/4277425893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e80003530 con 0x7f8e800047d0 2024-09-13T18:25:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.293+0000 7f8e93fff640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e940cb980 0x7f8e800051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:26.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e8affd640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e800047d0 0x7f8e80004c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e940b38f0 tx=0x7f8e7c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ed30e0aa9452c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0052d0 con 0x7f8e800047d0 2024-09-13T18:25:26.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0a7050 con 0x7f8e800047d0 2024-09-13T18:25:26.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e92ffd640 1 -- 172.21.15.53:0/4277425893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c003600 con 0x7f8e800047d0 2024-09-13T18:25:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- 172.21.15.53:0/4277425893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e800047d0 msgr2=0x7f8e80004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 --2- 172.21.15.53:0/4277425893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e800047d0 0x7f8e80004c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e940b38f0 tx=0x7f8e7c01c390 comp rx=0 tx=0).stop 2024-09-13T18:25:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e93fff640 1 -- 172.21.15.53:0/4277425893 reap_dead start 2024-09-13T18:25:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- 172.21.15.53:0/4277425893 shutdown_connections 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- 172.21.15.53:0/4277425893 >> 172.21.15.53:0/4277425893 conn(0x7f8e94065c80 msgr2=0x7f8e94066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- 172.21.15.53:0/4277425893 shutdown_connections 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- 172.21.15.53:0/4277425893 wait complete. 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 Processor -- start 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- start start 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800047d0 0x7f8e9415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e94144ee0 0x7f8e94144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e9415bec0 0x7f8e941583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9415c7c0 con 0x7f8e9415bec0 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9415ac80 con 0x7f8e800047d0 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e99c0a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9415af60 con 0x7f8e94144ee0 2024-09-13T18:25:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e9415bec0 0x7f8e941583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e93fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e9415bec0 0x7f8e941583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50646/0 (socket says 172.21.15.53:50646) 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.297+0000 7f8e93fff640 1 -- 172.21.15.53:0/1556099172 learned_addr learned my addr 172.21.15.53:0/1556099172 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e8affd640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e94144ee0 0x7f8e94144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e937fe640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800047d0 0x7f8e9415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e93fff640 1 -- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e94144ee0 msgr2=0x7f8e94144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e93fff640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e94144ee0 0x7f8e94144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e93fff640 1 -- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800047d0 msgr2=0x7f8e9415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e93fff640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800047d0 0x7f8e9415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e93fff640 1 -- 172.21.15.53:0/1556099172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9415b240 con 0x7f8e9415bec0 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e8affd640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e94144ee0 0x7f8e94144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e93fff640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e9415bec0 0x7f8e941583f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8e94071550 tx=0x7f8e8c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e90ff9640 1 -- 172.21.15.53:0/1556099172 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c004d70 con 0x7f8e9415bec0 2024-09-13T18:25:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e90ff9640 1 -- 172.21.15.53:0/1556099172 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c00bb80 con 0x7f8e9415bec0 2024-09-13T18:25:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e94144b40 con 0x7f8e9415bec0 2024-09-13T18:25:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e90ff9640 1 -- 172.21.15.53:0/1556099172 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c007070 con 0x7f8e9415bec0 2024-09-13T18:25:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9415c510 con 0x7f8e9415bec0 2024-09-13T18:25:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e94067400 con 0x7f8e9415bec0 2024-09-13T18:25:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e90ff9640 1 -- 172.21.15.53:0/1556099172 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e8c0071d0 con 0x7f8e9415bec0 2024-09-13T18:25:26.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e90ff9640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e74066690 0x7f8e74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e90ff9640 1 -- 172.21.15.53:0/1556099172 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e8c084360 con 0x7f8e9415bec0 2024-09-13T18:25:26.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e937fe640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e74066690 0x7f8e74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.301+0000 7f8e937fe640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e74066690 0x7f8e74068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400bad0 tx=0x7f8e84008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.305+0000 7f8e90ff9640 1 -- 172.21.15.53:0/1556099172 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e8c0516d0 con 0x7f8e9415bec0 2024-09-13T18:25:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.457+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e9415aab0 con 0x7f8e9415bec0 2024-09-13T18:25:26.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.461+0000 7f8e90ff9640 1 -- 172.21.15.53:0/1556099172 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f8e8c054cf0 con 0x7f8e9415bec0 2024-09-13T18:25:26.465 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:26.465 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.461+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e74066690 msgr2=0x7f8e74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.461+0000 7f8e99c0a640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e74066690 0x7f8e74068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400bad0 tx=0x7f8e84008040 comp rx=0 tx=0).stop 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e9415bec0 msgr2=0x7f8e941583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e9415bec0 0x7f8e941583f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8e94071550 tx=0x7f8e8c00b4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 shutdown_connections 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e74066690 0x7f8e74068b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e94144ee0 0x7f8e94144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e9415bec0 0x7f8e941583f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 --2- 172.21.15.53:0/1556099172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e800047d0 0x7f8e9415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 >> 172.21.15.53:0/1556099172 conn(0x7f8e94065c80 msgr2=0x7f8e940adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 shutdown_connections 2024-09-13T18:25:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.465+0000 7f8e99c0a640 1 -- 172.21.15.53:0/1556099172 wait complete. 2024-09-13T18:25:26.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:26.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:26.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.593+0000 7f3b5331b640 1 Processor -- start 2024-09-13T18:25:26.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.593+0000 7f3b5331b640 1 -- start start 2024-09-13T18:25:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b5331b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b4c156c40 0x7f3b4c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b5331b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b4c157020 0x7f3b4c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b5331b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c06d6e0 con 0x7f3b4c06d270 2024-09-13T18:25:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b5331b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c070340 con 0x7f3b4c156c40 2024-09-13T18:25:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b5331b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c0b15a0 con 0x7f3b4c157020 2024-09-13T18:25:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b4c156c40 0x7f3b4c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b4c156c40 0x7f3b4c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43804/0 (socket says 172.21.15.53:43804) 2024-09-13T18:25:26.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 -- 172.21.15.53:0/1824437226 learned_addr learned my addr 172.21.15.53:0/1824437226 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:26.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b508b6640 1 --2- 172.21.15.53:0/1824437226 >> v2:172.21.15.87:3300/0 conn(0x7f3b4c157020 0x7f3b4c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 -- 172.21.15.53:0/1824437226 >> v2:172.21.15.87:3300/0 conn(0x7f3b4c157020 msgr2=0x7f3b4c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:26.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 --2- 172.21.15.53:0/1824437226 >> v2:172.21.15.87:3300/0 conn(0x7f3b4c157020 0x7f3b4c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 -- 172.21.15.53:0/1824437226 >> v1:172.21.15.87:6789/0 conn(0x7f3b4c06d270 legacy=0x7f3b4c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 -- 172.21.15.53:0/1824437226 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0b1880 con 0x7f3b4c156c40 2024-09-13T18:25:26.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.597+0000 7f3b510b7640 1 --2- 172.21.15.53:0/1824437226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c070ee0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0cae90 tx=0x7f3b4801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d657c292de0e95e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b43fff640 1 -- 172.21.15.53:0/1824437226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480a57a0 con 0x7f3b4c156c40 2024-09-13T18:25:26.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b43fff640 1 -- 172.21.15.53:0/1824437226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b480a5900 con 0x7f3b4c156c40 2024-09-13T18:25:26.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b43fff640 1 -- 172.21.15.53:0/1824437226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480a5c90 con 0x7f3b4c156c40 2024-09-13T18:25:26.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- 172.21.15.53:0/1824437226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 msgr2=0x7f3b4c070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1824437226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c070ee0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0cae90 tx=0x7f3b4801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- 172.21.15.53:0/1824437226 shutdown_connections 2024-09-13T18:25:26.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1824437226 >> v2:172.21.15.87:3300/0 conn(0x7f3b4c157020 0x7f3b4c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1824437226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c070ee0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- 172.21.15.53:0/1824437226 >> 172.21.15.53:0/1824437226 conn(0x7f3b4c065c80 msgr2=0x7f3b4c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:26.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- 172.21.15.53:0/1824437226 shutdown_connections 2024-09-13T18:25:26.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- 172.21.15.53:0/1824437226 wait complete. 2024-09-13T18:25:26.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 Processor -- start 2024-09-13T18:25:26.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- start start 2024-09-13T18:25:26.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b4c06d270 0x7f3b4c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c12e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4c141760 0x7f3b4c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c12c8b0 con 0x7f3b4c156c40 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c141bf0 con 0x7f3b4c141760 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c142100 con 0x7f3b4c06d270 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c12e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c12e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43812/0 (socket says 172.21.15.53:43812) 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 -- 172.21.15.53:0/1475547610 learned_addr learned my addr 172.21.15.53:0/1475547610 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b518b8640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4c141760 0x7f3b4c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b510b7640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b4c06d270 0x7f3b4c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 -- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b4c06d270 msgr2=0x7f3b4c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b4c06d270 0x7f3b4c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 -- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4c141760 msgr2=0x7f3b4c15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4c141760 0x7f3b4c15bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 -- 172.21.15.53:0/1475547610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009b30 con 0x7f3b4c156c40 2024-09-13T18:25:26.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b508b6640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c12e7d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d5f0 tx=0x7f3b3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b41ffb640 1 -- 172.21.15.53:0/1475547610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0125f0 con 0x7f3b4c156c40 2024-09-13T18:25:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b41ffb640 1 -- 172.21.15.53:0/1475547610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c012750 con 0x7f3b4c156c40 2024-09-13T18:25:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c12ee60 con 0x7f3b4c156c40 2024-09-13T18:25:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b41ffb640 1 -- 172.21.15.53:0/1475547610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c012b00 con 0x7f3b4c156c40 2024-09-13T18:25:26.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.601+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c12f420 con 0x7f3b4c156c40 2024-09-13T18:25:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.605+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c15cde0 con 0x7f3b4c156c40 2024-09-13T18:25:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.605+0000 7f3b41ffb640 1 -- 172.21.15.53:0/1475547610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b3c012c60 con 0x7f3b4c156c40 2024-09-13T18:25:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.605+0000 7f3b41ffb640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b300666c0 0x7f3b30068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.605+0000 7f3b41ffb640 1 -- 172.21.15.53:0/1475547610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c0846f0 con 0x7f3b4c156c40 2024-09-13T18:25:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.605+0000 7f3b510b7640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b300666c0 0x7f3b30068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.605+0000 7f3b510b7640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b300666c0 0x7f3b30068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b480ae000 tx=0x7f3b480a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.609+0000 7f3b41ffb640 1 -- 172.21.15.53:0/1475547610 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b3c051a60 con 0x7f3b4c156c40 2024-09-13T18:25:26.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.769+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b4c148640 con 0x7f3b4c156c40 2024-09-13T18:25:26.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.769+0000 7f3b41ffb640 1 -- 172.21.15.53:0/1475547610 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b3c055080 con 0x7f3b4c156c40 2024-09-13T18:25:26.773 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.769+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b300666c0 msgr2=0x7f3b30068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b300666c0 0x7f3b30068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b480ae000 tx=0x7f3b480a7070 comp rx=0 tx=0).stop 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 msgr2=0x7f3b4c12e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c12e7d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d5f0 tx=0x7f3b3c00dab0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 shutdown_connections 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b300666c0 0x7f3b30068b80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b4c141760 0x7f3b4c15bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b4c156c40 0x7f3b4c12e7d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 --2- 172.21.15.53:0/1475547610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b4c06d270 0x7f3b4c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 >> 172.21.15.53:0/1475547610 conn(0x7f3b4c065c80 msgr2=0x7f3b4c06baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:26.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 shutdown_connections 2024-09-13T18:25:26.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.773+0000 7f3b5331b640 1 -- 172.21.15.53:0/1475547610 wait complete. 2024-09-13T18:25:26.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:26.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb260b640 1 Processor -- start 2024-09-13T18:25:26.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb260b640 1 -- start start 2024-09-13T18:25:26.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb260b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb260b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1eac0709a0 0x7f1eac0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb260b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac06d690 con 0x7f1eac1592d0 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb260b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac070e30 con 0x7f1eac0709a0 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb260b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac06c5f0 con 0x7f1eac0cf040 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eabfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1eac1592d0 0x7f1eac06dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39558/0 (socket says 172.21.15.53:39558) 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eabfff640 1 -- 172.21.15.53:0/3624790596 learned_addr learned my addr 172.21.15.53:0/3624790596 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb0ba8640 1 --2- 172.21.15.53:0/3624790596 >> v2:172.21.15.53:3300/0 conn(0x7f1eac0709a0 0x7f1eac0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eab7fe640 1 --2- 172.21.15.53:0/3624790596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eaaffd640 1 -- 172.21.15.53:0/3624790596 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864396650 0 0) 0x7f1eac06d690 con 0x7f1eac1592d0 2024-09-13T18:25:26.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eaaffd640 1 -- 172.21.15.53:0/3624790596 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e94003530 con 0x7f1eac1592d0 2024-09-13T18:25:26.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb0ba8640 1 -- 172.21.15.53:0/3624790596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 msgr2=0x7f1eac070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:26.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb0ba8640 1 --2- 172.21.15.53:0/3624790596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb0ba8640 1 -- 172.21.15.53:0/3624790596 >> v1:172.21.15.53:6789/0 conn(0x7f1eac1592d0 legacy=0x7f1eac06dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.917+0000 7f1eb0ba8640 1 -- 172.21.15.53:0/3624790596 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac06c8d0 con 0x7f1eac0709a0 2024-09-13T18:25:26.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb0ba8640 1 --2- 172.21.15.53:0/3624790596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac0cd410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0097c0 tx=0x7f1e9c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7006f99ff3fcf9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eaaffd640 1 -- 172.21.15.53:0/3624790596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c0ab600 con 0x7f1eac0709a0 2024-09-13T18:25:26.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eaaffd640 1 -- 172.21.15.53:0/3624790596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c0a7050 con 0x7f1eac0709a0 2024-09-13T18:25:26.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eaaffd640 1 -- 172.21.15.53:0/3624790596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c0ab960 con 0x7f1eac0709a0 2024-09-13T18:25:26.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 -- 172.21.15.53:0/3624790596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 msgr2=0x7f1eac0cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 --2- 172.21.15.53:0/3624790596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac0cd410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0097c0 tx=0x7f1e9c01c410 comp rx=0 tx=0).stop 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 -- 172.21.15.53:0/3624790596 shutdown_connections 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 --2- 172.21.15.53:0/3624790596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac0cd410 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 --2- 172.21.15.53:0/3624790596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 -- 172.21.15.53:0/3624790596 >> 172.21.15.53:0/3624790596 conn(0x7f1eac0b1310 msgr2=0x7f1eac0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 -- 172.21.15.53:0/3624790596 shutdown_connections 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 -- 172.21.15.53:0/3624790596 wait complete. 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 Processor -- start 2024-09-13T18:25:26.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 -- start start 2024-09-13T18:25:26.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.921+0000 7f1eb260b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb260b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1eac1592d0 0x7f1eac154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb260b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac15b1b0 con 0x7f1eac0709a0 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb260b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac15bfc0 con 0x7f1eac1592d0 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb260b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac15a840 con 0x7f1eac0cf040 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac14bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43832/0 (socket says 172.21.15.53:43832) 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 -- 172.21.15.53:0/242327766 learned_addr learned my addr 172.21.15.53:0/242327766 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:26.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb0ba8640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1eac1592d0 0x7f1eac154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eab7fe640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 -- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 msgr2=0x7f1eac154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 -- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1eac1592d0 msgr2=0x7f1eac154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1eac1592d0 0x7f1eac154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 -- 172.21.15.53:0/242327766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c009420 con 0x7f1eac0709a0 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eabfff640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac14bf90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400cad0 tx=0x7f1ea400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1ea8ff9640 1 -- 172.21.15.53:0/242327766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400ac30 con 0x7f1eac0709a0 2024-09-13T18:25:26.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1ea8ff9640 1 -- 172.21.15.53:0/242327766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea400ad90 con 0x7f1eac0709a0 2024-09-13T18:25:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac14c4d0 con 0x7f1eac0709a0 2024-09-13T18:25:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1ea8ff9640 1 -- 172.21.15.53:0/242327766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4012620 con 0x7f1eac0709a0 2024-09-13T18:25:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac15aa90 con 0x7f1eac0709a0 2024-09-13T18:25:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac0cd410 con 0x7f1eac0709a0 2024-09-13T18:25:26.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1ea8ff9640 1 -- 172.21.15.53:0/242327766 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ea4007070 con 0x7f1eac0709a0 2024-09-13T18:25:26.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1ea8ff9640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e98066690 0x7f1e98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:26.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1ea8ff9640 1 -- 172.21.15.53:0/242327766 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ea40840e0 con 0x7f1eac0709a0 2024-09-13T18:25:26.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.925+0000 7f1eab7fe640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e98066690 0x7f1e98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.929+0000 7f1eab7fe640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e98066690 0x7f1e98068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0b0840 tx=0x7f1ea0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:26.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:26.929+0000 7f1ea8ff9640 1 -- 172.21.15.53:0/242327766 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ea4051460 con 0x7f1eac0709a0 2024-09-13T18:25:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.085+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1eac0663e0 con 0x7f1eac0709a0 2024-09-13T18:25:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.085+0000 7f1ea8ff9640 1 -- 172.21.15.53:0/242327766 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ea4001b70 con 0x7f1eac0709a0 2024-09-13T18:25:27.087 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e98066690 msgr2=0x7f1e98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e98066690 0x7f1e98068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0b0840 tx=0x7f1ea0009190 comp rx=0 tx=0).stop 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 msgr2=0x7f1eac14bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac14bf90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400cad0 tx=0x7f1ea400cf90 comp rx=0 tx=0).stop 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 shutdown_connections 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e98066690 0x7f1e98068b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1eac0cf040 0x7f1eac154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1eac1592d0 0x7f1eac154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 --2- 172.21.15.53:0/242327766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1eac0709a0 0x7f1eac14bf90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 >> 172.21.15.53:0/242327766 conn(0x7f1eac0b1310 msgr2=0x7f1eac15ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:27.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 shutdown_connections 2024-09-13T18:25:27.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.089+0000 7f1eb260b640 1 -- 172.21.15.53:0/242327766 wait complete. 2024-09-13T18:25:27.107 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fcebd7cf640 1 Processor -- start 2024-09-13T18:25:27.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fcebd7cf640 1 -- start start 2024-09-13T18:25:27.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fcebd7cf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fceb80caee0 0x7fceb80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fcebd7cf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb806f7a0 con 0x7fceb8143e80 2024-09-13T18:25:27.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fcebd7cf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb806fd60 con 0x7fceb80cd320 2024-09-13T18:25:27.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fcebd7cf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb806baa0 con 0x7fceb80caee0 2024-09-13T18:25:27.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fceb8143e80 0x7fceb806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39562/0 (socket says 172.21.15.53:39562) 2024-09-13T18:25:27.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb6ffd640 1 -- 172.21.15.53:0/1748028708 learned_addr learned my addr 172.21.15.53:0/1748028708 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb67fc640 1 --2- 172.21.15.53:0/1748028708 >> v2:172.21.15.87:3300/0 conn(0x7fceb80caee0 0x7fceb80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228071939 0 0) 0x7fceb806f7a0 con 0x7fceb8143e80 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea4003530 con 0x7fceb8143e80 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56208209 0 0) 0x7fcea4003530 con 0x7fceb8143e80 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 >> v2:172.21.15.87:3300/0 conn(0x7fceb80caee0 msgr2=0x7fceb80cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 --2- 172.21.15.53:0/1748028708 >> v2:172.21.15.87:3300/0 conn(0x7fceb80caee0 0x7fceb80cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 >> v1:172.21.15.87:6789/0 conn(0x7fceb80cd320 legacy=0x7fceb80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80cb960 con 0x7fceb8143e80 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fcea8001a00 con 0x7fceb8143e80 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 >> v1:172.21.15.53:6789/0 conn(0x7fceb8143e80 legacy=0x7fceb806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea40039b0 0x7fcea4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea40047d0 0x7fcea4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4005190 0x7fcea400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb806baa0 con 0x7fcea4005190 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea400c0c0 con 0x7fcea40047d0 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea400c280 con 0x7fcea40039b0 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb77fe640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4005190 0x7fcea400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb6ffd640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea40039b0 0x7fcea4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb77fe640 1 -- 172.21.15.53:0/1748028708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea40039b0 msgr2=0x7fcea4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb77fe640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea40039b0 0x7fcea4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb77fe640 1 -- 172.21.15.53:0/1748028708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea40047d0 msgr2=0x7fcea4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb77fe640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea40047d0 0x7fcea4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.221+0000 7fceb77fe640 1 -- 172.21.15.53:0/1748028708 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4003530 con 0x7fcea4005190 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fceb77fe640 1 -- 172.21.15.53:0/1748028708 reap_dead start 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fceb77fe640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4005190 0x7fcea400b990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fceb0007fd0 tx=0x7fceb001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509c00a9a17046c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb00050d0 con 0x7fcea4005190 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0005230 con 0x7fcea4005190 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fceb5ffb640 1 -- 172.21.15.53:0/1748028708 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0003600 con 0x7fcea4005190 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 -- 172.21.15.53:0/1748028708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4005190 msgr2=0x7fcea400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4005190 0x7fcea400b990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fceb0007fd0 tx=0x7fceb001c490 comp rx=0 tx=0).stop 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 -- 172.21.15.53:0/1748028708 shutdown_connections 2024-09-13T18:25:27.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/1748028708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcea4005190 0x7fcea400b990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 -- 172.21.15.53:0/1748028708 >> 172.21.15.53:0/1748028708 conn(0x7fceb8065c80 msgr2=0x7fceb8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:27.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 -- 172.21.15.53:0/1748028708 shutdown_connections 2024-09-13T18:25:27.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 -- 172.21.15.53:0/1748028708 wait complete. 2024-09-13T18:25:27.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 Processor -- start 2024-09-13T18:25:27.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.225+0000 7fcebd7cf640 1 -- start start 2024-09-13T18:25:27.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea4005190 0x7fceb81383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb813dbe0 0x7fceb813e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb80a8de0 0x7fceb80a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb813fb40 con 0x7fceb813dbe0 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80a97a0 con 0x7fceb80a8de0 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb813f580 con 0x7fcea4005190 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb813dbe0 0x7fceb813e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb813dbe0 0x7fceb813e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43848/0 (socket says 172.21.15.53:43848) 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 -- 172.21.15.53:0/3622407349 learned_addr learned my addr 172.21.15.53:0/3622407349 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb77fe640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb80a8de0 0x7fceb80a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb6ffd640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea4005190 0x7fceb81383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 -- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea4005190 msgr2=0x7fceb81383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea4005190 0x7fceb81383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 -- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb80a8de0 msgr2=0x7fceb80a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb80a8de0 0x7fceb80a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 -- 172.21.15.53:0/3622407349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb813f860 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb67fc640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb813dbe0 0x7fceb813e060 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcea000e7c0 tx=0x7fcea000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceaf7fe640 1 -- 172.21.15.53:0/3622407349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000c730 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceaf7fe640 1 -- 172.21.15.53:0/3622407349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea000c890 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb813d6c0 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceaf7fe640 1 -- 172.21.15.53:0/3622407349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000cc40 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb8142cb0 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb813d880 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceaf7fe640 1 -- 172.21.15.53:0/3622407349 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcea0013470 con 0x7fceb813dbe0 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceaf7fe640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fce980666c0 0x7fce98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceaf7fe640 1 -- 172.21.15.53:0/3622407349 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcea0084060 con 0x7fceb813dbe0 2024-09-13T18:25:27.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.229+0000 7fceb6ffd640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fce980666c0 0x7fce98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.233+0000 7fceb6ffd640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fce980666c0 0x7fce98068b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001360 tx=0x7fcea8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.233+0000 7fceaf7fe640 1 -- 172.21.15.53:0/3622407349 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcea0051460 con 0x7fceb813dbe0 2024-09-13T18:25:27.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.389+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fceb813d520 con 0x7fceb813dbe0 2024-09-13T18:25:27.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fceaf7fe640 1 -- 172.21.15.53:0/3622407349 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fceb813d520 con 0x7fceb813dbe0 2024-09-13T18:25:27.395 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:27.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fce980666c0 msgr2=0x7fce98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fce980666c0 0x7fce98068b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001360 tx=0x7fcea8009040 comp rx=0 tx=0).stop 2024-09-13T18:25:27.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb813dbe0 msgr2=0x7fceb813e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb813dbe0 0x7fceb813e060 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcea000e7c0 tx=0x7fcea000ec80 comp rx=0 tx=0).stop 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 shutdown_connections 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fce980666c0 0x7fce98068b80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb80a8de0 0x7fceb80a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb813dbe0 0x7fceb813e060 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 --2- 172.21.15.53:0/3622407349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcea4005190 0x7fceb81383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 >> 172.21.15.53:0/3622407349 conn(0x7fceb8065c80 msgr2=0x7fceb8157340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 shutdown_connections 2024-09-13T18:25:27.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.393+0000 7fcebd7cf640 1 -- 172.21.15.53:0/3622407349 wait complete. 2024-09-13T18:25:27.414 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9fc3d640 1 Processor -- start 2024-09-13T18:25:27.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9fc3d640 1 -- start start 2024-09-13T18:25:27.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9fc3d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 0x7f5f980b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9fc3d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5f980b1af0 0x7f5f98069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9fc3d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f980cfe80 con 0x7f5f9806a490 2024-09-13T18:25:27.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9fc3d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f980d0120 con 0x7f5f980b1af0 2024-09-13T18:25:27.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9fc3d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9806ac20 con 0x7f5f980cd630 2024-09-13T18:25:27.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9e1da640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5f9806a490 0x7f5f980ad3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39574/0 (socket says 172.21.15.53:39574) 2024-09-13T18:25:27.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9e1da640 1 -- 172.21.15.53:0/3567853206 learned_addr learned my addr 172.21.15.53:0/3567853206 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:27.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d1d8640 1 --2- 172.21.15.53:0/3567853206 >> v2:172.21.15.87:3300/0 conn(0x7f5f980b1af0 0x7f5f98069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d9d9640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 0x7f5f980b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255784357 0 0) 0x7f5f980cfe80 con 0x7f5f9806a490 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f84003530 con 0x7f5f9806a490 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 261261640 0 0) 0x7f5f84003530 con 0x7f5f9806a490 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 msgr2=0x7f5f980b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 0x7f5f980b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 >> v2:172.21.15.87:3300/0 conn(0x7f5f980b1af0 msgr2=0x7f5f98069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 --2- 172.21.15.53:0/3567853206 >> v2:172.21.15.87:3300/0 conn(0x7f5f980b1af0 0x7f5f98069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9806af00 con 0x7f5f9806a490 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5f90001a00 con 0x7f5f9806a490 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 >> v1:172.21.15.53:6789/0 conn(0x7f5f9806a490 legacy=0x7f5f980ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f84003980 0x7f5f84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f840047d0 0x7f5f84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 0x7f5f84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980d0120 con 0x7f5f840047d0 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9806ac20 con 0x7f5f84003980 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8400ba10 con 0x7f5f980cd630 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d1d8640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f840047d0 0x7f5f84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d9d9640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f84003980 0x7f5f84003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9e1da640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 0x7f5f84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d1d8640 1 -- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 msgr2=0x7f5f84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d1d8640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f980cd630 0x7f5f84005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d1d8640 1 -- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f84003980 msgr2=0x7f5f84003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d1d8640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f84003980 0x7f5f84003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d1d8640 1 -- 172.21.15.53:0/3567853206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84003530 con 0x7f5f840047d0 2024-09-13T18:25:27.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.529+0000 7f5f9d9d9640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f84003980 0x7f5f84003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9d1d8640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f840047d0 0x7f5f84004c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009ae0 tx=0x7f5f8801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8a93fa13c86647 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880a6490 con 0x7f5f840047d0 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f880a65f0 con 0x7f5f840047d0 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9c9d7640 1 -- 172.21.15.53:0/3567853206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880a69a0 con 0x7f5f840047d0 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/3567853206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f840047d0 msgr2=0x7f5f84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 --2- 172.21.15.53:0/3567853206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f840047d0 0x7f5f84004c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009ae0 tx=0x7f5f8801cab0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9e1da640 1 -- 172.21.15.53:0/3567853206 reap_dead start 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/3567853206 shutdown_connections 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/3567853206 >> 172.21.15.53:0/3567853206 conn(0x7f5f980b20d0 msgr2=0x7f5f980b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/3567853206 shutdown_connections 2024-09-13T18:25:27.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/3567853206 wait complete. 2024-09-13T18:25:27.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 Processor -- start 2024-09-13T18:25:27.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.533+0000 7f5f9fc3d640 1 -- start start 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f840047d0 0x7f5f980c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f9815d880 0x7f5f9815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f9815fa80 0x7f5f980c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9815ff30 con 0x7f5f9815fa80 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980b58f0 con 0x7f5f9815d880 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9815ef00 con 0x7f5f840047d0 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f9815fa80 0x7f5f980c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f9815fa80 0x7f5f980c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43862/0 (socket says 172.21.15.53:43862) 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 -- 172.21.15.53:0/2570427098 learned_addr learned my addr 172.21.15.53:0/2570427098 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9d9d9640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f840047d0 0x7f5f980c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9d1d8640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f9815d880 0x7f5f9815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 -- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f840047d0 msgr2=0x7f5f980c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f840047d0 0x7f5f980c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 -- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f9815d880 msgr2=0x7f5f9815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f9815d880 0x7f5f9815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 -- 172.21.15.53:0/2570427098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9815f1e0 con 0x7f5f9815fa80 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9e1da640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f9815fa80 0x7f5f980c5200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f900013e0 tx=0x7f5f9000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f8e7fc640 1 -- 172.21.15.53:0/2570427098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90004d70 con 0x7f5f9815fa80 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f8e7fc640 1 -- 172.21.15.53:0/2570427098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000bb00 con 0x7f5f9815fa80 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f980c7650 con 0x7f5f9815fa80 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f8e7fc640 1 -- 172.21.15.53:0/2570427098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000beb0 con 0x7f5f9815fa80 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f980c7c10 con 0x7f5f9815fa80 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f980c7e30 con 0x7f5f9815fa80 2024-09-13T18:25:27.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f8e7fc640 1 -- 172.21.15.53:0/2570427098 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f90007070 con 0x7f5f9815fa80 2024-09-13T18:25:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f8e7fc640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f7c066690 0x7f5f7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f8e7fc640 1 -- 172.21.15.53:0/2570427098 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f90084450 con 0x7f5f9815fa80 2024-09-13T18:25:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.537+0000 7f5f9d9d9640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f7c066690 0x7f5f7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.541+0000 7f5f9d9d9640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f7c066690 0x7f5f7c068b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5f980af670 tx=0x7f5f94008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.541+0000 7f5f8e7fc640 1 -- 172.21.15.53:0/2570427098 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f900517c0 con 0x7f5f9815fa80 2024-09-13T18:25:27.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.697+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f980afcc0 con 0x7f5f9815fa80 2024-09-13T18:25:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.697+0000 7f5f8e7fc640 1 -- 172.21.15.53:0/2570427098 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f5f90054de0 con 0x7f5f9815fa80 2024-09-13T18:25:27.703 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:27.703 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f7c066690 msgr2=0x7f5f7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f7c066690 0x7f5f7c068b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5f980af670 tx=0x7f5f94008040 comp rx=0 tx=0).stop 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f9815fa80 msgr2=0x7f5f980c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f9815fa80 0x7f5f980c5200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5f900013e0 tx=0x7f5f9000b4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 shutdown_connections 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f7c066690 0x7f5f7c068b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f9815fa80 0x7f5f980c5200 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f9815d880 0x7f5f9815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 --2- 172.21.15.53:0/2570427098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f840047d0 0x7f5f980c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 >> 172.21.15.53:0/2570427098 conn(0x7f5f980b20d0 msgr2=0x7f5f980aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 shutdown_connections 2024-09-13T18:25:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.701+0000 7f5f9fc3d640 1 -- 172.21.15.53:0/2570427098 wait complete. 2024-09-13T18:25:27.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:27.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:27.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa481761640 1 Processor -- start 2024-09-13T18:25:27.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa481761640 1 -- start start 2024-09-13T18:25:27.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa481761640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa47c0b22c0 0x7fa47c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa481761640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c15b0d0 con 0x7fa47c0b26a0 2024-09-13T18:25:27.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa481761640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c15baa0 con 0x7fa47c06e060 2024-09-13T18:25:27.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa481761640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47c15ab70 con 0x7fa47c0b22c0 2024-09-13T18:25:27.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa47c0b26a0 0x7fa47c0b2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39590/0 (socket says 172.21.15.53:39590) 2024-09-13T18:25:27.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 -- 172.21.15.53:0/3776823911 learned_addr learned my addr 172.21.15.53:0/3776823911 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:27.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47affd640 1 --2- 172.21.15.53:0/3776823911 >> v2:172.21.15.87:3300/0 conn(0x7fa47c0b22c0 0x7fa47c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835884806 0 0) 0x7fa47c15b0d0 con 0x7fa47c0b26a0 2024-09-13T18:25:27.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa464003530 con 0x7fa47c0b26a0 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903181519 0 0) 0x7fa464003530 con 0x7fa47c0b26a0 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 >> v2:172.21.15.87:3300/0 conn(0x7fa47c0b22c0 msgr2=0x7fa47c15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 --2- 172.21.15.53:0/3776823911 >> v2:172.21.15.87:3300/0 conn(0x7fa47c0b22c0 0x7fa47c15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 >> v1:172.21.15.87:6789/0 conn(0x7fa47c06e060 legacy=0x7fa47c0cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c0b33d0 con 0x7fa47c0b26a0 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa470001680 con 0x7fa47c0b26a0 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 >> v1:172.21.15.53:6789/0 conn(0x7fa47c0b26a0 legacy=0x7fa47c0b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464003980 0x7fa464003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa464004380 0x7fa464004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa464005050 0x7fa46400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46400bf80 con 0x7fa464004380 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46400c0f0 con 0x7fa464003980 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46400c2b0 con 0x7fa464005050 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa464004380 0x7fa464004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47affd640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464003980 0x7fa464003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa464005050 0x7fa46400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 -- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa464005050 msgr2=0x7fa46400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa464005050 0x7fa46400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 -- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464003980 msgr2=0x7fa464003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464003980 0x7fa464003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47b7fe640 1 -- 172.21.15.53:0/3776823911 reap_dead start 2024-09-13T18:25:27.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47a7fc640 1 -- 172.21.15.53:0/3776823911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464003530 con 0x7fa464004380 2024-09-13T18:25:27.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.845+0000 7fa47affd640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464003980 0x7fa464003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:27.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa47a7fc640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa464004380 0x7fa464004850 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0b2a80 tx=0x7fa47001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f08d0837b40f897 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700a5b80 con 0x7fa464004380 2024-09-13T18:25:27.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700a5d00 con 0x7fa464004380 2024-09-13T18:25:27.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa479ffb640 1 -- 172.21.15.53:0/3776823911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470005b20 con 0x7fa464004380 2024-09-13T18:25:27.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa481761640 1 -- 172.21.15.53:0/3776823911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa464004380 msgr2=0x7fa464004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa481761640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa464004380 0x7fa464004850 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0b2a80 tx=0x7fa47001cbf0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa481761640 1 -- 172.21.15.53:0/3776823911 shutdown_connections 2024-09-13T18:25:27.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa481761640 1 --2- 172.21.15.53:0/3776823911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa464004380 0x7fa464004850 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa481761640 1 -- 172.21.15.53:0/3776823911 >> 172.21.15.53:0/3776823911 conn(0x7fa47c0ceb80 msgr2=0x7fa47c0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:27.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa481761640 1 -- 172.21.15.53:0/3776823911 shutdown_connections 2024-09-13T18:25:27.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.849+0000 7fa481761640 1 -- 172.21.15.53:0/3776823911 wait complete. 2024-09-13T18:25:27.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 Processor -- start 2024-09-13T18:25:27.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 -- start start 2024-09-13T18:25:27.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464004380 0x7fa47c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0717b0 0x7fa47c14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c14fd00 0x7fa47c150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c1506d0 con 0x7fa47c14fd00 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c14f930 con 0x7fa464004380 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c14b280 con 0x7fa47c0717b0 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c14fd00 0x7fa47c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c14fd00 0x7fa47c150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43884/0 (socket says 172.21.15.53:43884) 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 -- 172.21.15.53:0/1741567722 learned_addr learned my addr 172.21.15.53:0/1741567722 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47a7fc640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0717b0 0x7fa47c14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47affd640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464004380 0x7fa47c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 -- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0717b0 msgr2=0x7fa47c14a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0717b0 0x7fa47c14a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 -- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464004380 msgr2=0x7fa47c14e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464004380 0x7fa47c14e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:27.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 -- 172.21.15.53:0/1741567722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c071c30 con 0x7fa47c14fd00 2024-09-13T18:25:27.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c14fd00 0x7fa47c150190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0cc5c0 tx=0x7fa47400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa4637fe640 1 -- 172.21.15.53:0/1741567722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474003980 con 0x7fa47c14fd00 2024-09-13T18:25:27.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa4637fe640 1 -- 172.21.15.53:0/1741567722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa474003ae0 con 0x7fa47c14fd00 2024-09-13T18:25:27.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c14ae00 con 0x7fa47c14fd00 2024-09-13T18:25:27.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa4637fe640 1 -- 172.21.15.53:0/1741567722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474003e90 con 0x7fa47c14fd00 2024-09-13T18:25:27.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c14f000 con 0x7fa47c14fd00 2024-09-13T18:25:27.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.853+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c15b950 con 0x7fa47c14fd00 2024-09-13T18:25:27.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.857+0000 7fa4637fe640 1 -- 172.21.15.53:0/1741567722 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4740050d0 con 0x7fa47c14fd00 2024-09-13T18:25:27.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.857+0000 7fa4637fe640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa4680666c0 0x7fa468068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:27.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.857+0000 7fa4637fe640 1 -- 172.21.15.53:0/1741567722 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa474084080 con 0x7fa47c14fd00 2024-09-13T18:25:27.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.857+0000 7fa47affd640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa4680666c0 0x7fa468068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:27.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.857+0000 7fa47affd640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa4680666c0 0x7fa468068b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0cb480 tx=0x7fa46c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:27.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:27.861+0000 7fa4637fe640 1 -- 172.21.15.53:0/1741567722 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa474051480 con 0x7fa47c14fd00 2024-09-13T18:25:28.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.021+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa47c154a30 con 0x7fa47c14fd00 2024-09-13T18:25:28.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.021+0000 7fa4637fe640 1 -- 172.21.15.53:0/1741567722 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa474054aa0 con 0x7fa47c14fd00 2024-09-13T18:25:28.024 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa4680666c0 msgr2=0x7fa468068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa4680666c0 0x7fa468068b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0cb480 tx=0x7fa46c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c14fd00 msgr2=0x7fa47c150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c14fd00 0x7fa47c150190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0cc5c0 tx=0x7fa47400eb70 comp rx=0 tx=0).stop 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 shutdown_connections 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa4680666c0 0x7fa468068b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0717b0 0x7fa47c14a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c14fd00 0x7fa47c150190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 --2- 172.21.15.53:0/1741567722 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa464004380 0x7fa47c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 >> 172.21.15.53:0/1741567722 conn(0x7fa47c0ceb80 msgr2=0x7fa47c153650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:28.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 shutdown_connections 2024-09-13T18:25:28.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.025+0000 7fa481761640 1 -- 172.21.15.53:0/1741567722 wait complete. 2024-09-13T18:25:28.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:28.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.169+0000 7f15e046d640 1 Processor -- start 2024-09-13T18:25:28.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.169+0000 7f15e046d640 1 -- start start 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15e046d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15d8158ba0 0x7f15d80cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15e046d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d80b1dd0 0x7f15d80b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15e046d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f15d806ff40 0x7f15d8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15e046d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d806c530 con 0x7f15d8158ba0 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15e046d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d806bc20 con 0x7f15d806ff40 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15e046d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80708b0 con 0x7f15d80b1dd0 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15d8158ba0 0x7f15d80cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15d8158ba0 0x7f15d80cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43898/0 (socket says 172.21.15.53:43898) 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 -- 172.21.15.53:0/148285292 learned_addr learned my addr 172.21.15.53:0/148285292 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15dea0a640 1 --2- 172.21.15.53:0/148285292 >> v2:172.21.15.87:3300/0 conn(0x7f15d806ff40 0x7f15d8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15dda08640 1 --2- 172.21.15.53:0/148285292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d80b1dd0 0x7f15d80b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 -- 172.21.15.53:0/148285292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d80b1dd0 msgr2=0x7f15d80b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:28.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 --2- 172.21.15.53:0/148285292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d80b1dd0 0x7f15d80b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 -- 172.21.15.53:0/148285292 >> v2:172.21.15.87:3300/0 conn(0x7f15d806ff40 msgr2=0x7f15d8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:28.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 --2- 172.21.15.53:0/148285292 >> v2:172.21.15.87:3300/0 conn(0x7f15d806ff40 0x7f15d8070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 -- 172.21.15.53:0/148285292 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d8158f80 con 0x7f15d8158ba0 2024-09-13T18:25:28.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15de209640 1 --2- 172.21.15.53:0/148285292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d8158ba0 0x7f15d80cb9d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f15d8071670 tx=0x7f15d401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315128e3c96333cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15dd207640 1 -- 172.21.15.53:0/148285292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40ac640 con 0x7f15d8158ba0 2024-09-13T18:25:28.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15dd207640 1 -- 172.21.15.53:0/148285292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d40ac7a0 con 0x7f15d8158ba0 2024-09-13T18:25:28.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.173+0000 7f15dd207640 1 -- 172.21.15.53:0/148285292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40acb30 con 0x7f15d8158ba0 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- 172.21.15.53:0/148285292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d8158ba0 msgr2=0x7f15d80cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 --2- 172.21.15.53:0/148285292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d8158ba0 0x7f15d80cb9d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f15d8071670 tx=0x7f15d401c3d0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- 172.21.15.53:0/148285292 shutdown_connections 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 --2- 172.21.15.53:0/148285292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d80b1dd0 0x7f15d80b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 --2- 172.21.15.53:0/148285292 >> v2:172.21.15.87:3300/0 conn(0x7f15d806ff40 0x7f15d8070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 --2- 172.21.15.53:0/148285292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d8158ba0 0x7f15d80cb9d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- 172.21.15.53:0/148285292 >> 172.21.15.53:0/148285292 conn(0x7f15d8065c80 msgr2=0x7f15d8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- 172.21.15.53:0/148285292 shutdown_connections 2024-09-13T18:25:28.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- 172.21.15.53:0/148285292 wait complete. 2024-09-13T18:25:28.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 Processor -- start 2024-09-13T18:25:28.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- start start 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d806ff40 0x7f15d81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d80b1dd0 0x7f15d80acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d8158ba0 0x7f15d8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80ad0b0 con 0x7f15d80b1dd0 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80abb40 con 0x7f15d806ff40 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80abdb0 con 0x7f15d8158ba0 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d80b1dd0 0x7f15d80acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d80b1dd0 0x7f15d80acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43910/0 (socket says 172.21.15.53:43910) 2024-09-13T18:25:28.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 -- 172.21.15.53:0/3377544461 learned_addr learned my addr 172.21.15.53:0/3377544461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dea0a640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d8158ba0 0x7f15d8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15de209640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d806ff40 0x7f15d81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 -- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d8158ba0 msgr2=0x7f15d8156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d8158ba0 0x7f15d8156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 -- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d806ff40 msgr2=0x7f15d81501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d806ff40 0x7f15d81501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 -- 172.21.15.53:0/3377544461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40094d0 con 0x7f15d80b1dd0 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15dda08640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d80b1dd0 0x7f15d80acb70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15c800d830 tx=0x7f15c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15ceffd640 1 -- 172.21.15.53:0/3377544461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c800b6c0 con 0x7f15d80b1dd0 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15ceffd640 1 -- 172.21.15.53:0/3377544461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c800b820 con 0x7f15d80b1dd0 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d80ac090 con 0x7f15d80b1dd0 2024-09-13T18:25:28.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15ceffd640 1 -- 172.21.15.53:0/3377544461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c800bb90 con 0x7f15d80b1dd0 2024-09-13T18:25:28.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.177+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d80ac650 con 0x7f15d80b1dd0 2024-09-13T18:25:28.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.181+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d80b3120 con 0x7f15d80b1dd0 2024-09-13T18:25:28.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.181+0000 7f15ceffd640 1 -- 172.21.15.53:0/3377544461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f15c800bcf0 con 0x7f15d80b1dd0 2024-09-13T18:25:28.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.181+0000 7f15ceffd640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f15bc066690 0x7f15bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.181+0000 7f15ceffd640 1 -- 172.21.15.53:0/3377544461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15c8084650 con 0x7f15d80b1dd0 2024-09-13T18:25:28.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.181+0000 7f15de209640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f15bc066690 0x7f15bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.181+0000 7f15de209640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f15bc066690 0x7f15bc068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ae000 tx=0x7f15d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.185+0000 7f15ceffd640 1 -- 172.21.15.53:0/3377544461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15c8051a50 con 0x7f15d80b1dd0 2024-09-13T18:25:28.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.341+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15d80ade50 con 0x7f15d80b1dd0 2024-09-13T18:25:28.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15ceffd640 1 -- 172.21.15.53:0/3377544461 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15c8055070 con 0x7f15d80b1dd0 2024-09-13T18:25:28.350 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f15bc066690 msgr2=0x7f15bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f15bc066690 0x7f15bc068b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ae000 tx=0x7f15d4008040 comp rx=0 tx=0).stop 2024-09-13T18:25:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d80b1dd0 msgr2=0x7f15d80acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d80b1dd0 0x7f15d80acb70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15c800d830 tx=0x7f15c800dcf0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 shutdown_connections 2024-09-13T18:25:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f15bc066690 0x7f15bc068b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15d8158ba0 0x7f15d8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15d80b1dd0 0x7f15d80acb70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 --2- 172.21.15.53:0/3377544461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d806ff40 0x7f15d81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 >> 172.21.15.53:0/3377544461 conn(0x7f15d8065c80 msgr2=0x7f15d80ae390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 shutdown_connections 2024-09-13T18:25:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.345+0000 7f15e046d640 1 -- 172.21.15.53:0/3377544461 wait complete. 2024-09-13T18:25:28.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:28.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 Processor -- start 2024-09-13T18:25:28.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 -- start start 2024-09-13T18:25:28.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f96e006cfd0 0x7f96e015b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96e00b3c60 0x7f96e00b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e00ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00b2900 con 0x7f96e00b3c60 2024-09-13T18:25:28.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00adf80 con 0x7f96e006cfd0 2024-09-13T18:25:28.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96e6011640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00ae730 con 0x7f96e00abda0 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96e00b3c60 0x7f96e00b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96e00b3c60 0x7f96e00b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43912/0 (socket says 172.21.15.53:43912) 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 -- 172.21.15.53:0/731867251 learned_addr learned my addr 172.21.15.53:0/731867251 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96dffff640 1 --2- 172.21.15.53:0/731867251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e00ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96df7fe640 1 --2- 172.21.15.53:0/731867251 >> v2:172.21.15.87:3300/0 conn(0x7f96e006cfd0 0x7f96e015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 -- 172.21.15.53:0/731867251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 msgr2=0x7f96e00ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 --2- 172.21.15.53:0/731867251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e00ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 -- 172.21.15.53:0/731867251 >> v2:172.21.15.87:3300/0 conn(0x7f96e006cfd0 msgr2=0x7f96e015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 --2- 172.21.15.53:0/731867251 >> v2:172.21.15.87:3300/0 conn(0x7f96e006cfd0 0x7f96e015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96d6ffd640 1 -- 172.21.15.53:0/731867251 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e006d3b0 con 0x7f96e00b3c60 2024-09-13T18:25:28.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.493+0000 7f96df7fe640 1 --2- 172.21.15.53:0/731867251 >> v2:172.21.15.87:3300/0 conn(0x7f96e006cfd0 0x7f96e015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:28.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96d6ffd640 1 --2- 172.21.15.53:0/731867251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e00b3c60 0x7f96e00b2d20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96e00ae890 tx=0x7f96c801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a926d251c44ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96deffd640 1 -- 172.21.15.53:0/731867251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80ad660 con 0x7f96e00b3c60 2024-09-13T18:25:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96deffd640 1 -- 172.21.15.53:0/731867251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c80ad7c0 con 0x7f96e00b3c60 2024-09-13T18:25:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96deffd640 1 -- 172.21.15.53:0/731867251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80adb50 con 0x7f96e00b3c60 2024-09-13T18:25:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- 172.21.15.53:0/731867251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e00b3c60 msgr2=0x7f96e00b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 --2- 172.21.15.53:0/731867251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e00b3c60 0x7f96e00b2d20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96e00ae890 tx=0x7f96c801c490 comp rx=0 tx=0).stop 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- 172.21.15.53:0/731867251 shutdown_connections 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 --2- 172.21.15.53:0/731867251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e00ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 --2- 172.21.15.53:0/731867251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e00b3c60 0x7f96e00b2d20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 --2- 172.21.15.53:0/731867251 >> v2:172.21.15.87:3300/0 conn(0x7f96e006cfd0 0x7f96e015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- 172.21.15.53:0/731867251 >> 172.21.15.53:0/731867251 conn(0x7f96e0069f50 msgr2=0x7f96e006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- 172.21.15.53:0/731867251 shutdown_connections 2024-09-13T18:25:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- 172.21.15.53:0/731867251 wait complete. 2024-09-13T18:25:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 Processor -- start 2024-09-13T18:25:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- start start 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e006cfd0 0x7f96e0156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e0153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e00b3c60 0x7f96e0099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01561a0 con 0x7f96e006cfd0 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0157e20 con 0x7f96e00b3c60 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96e6011640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01583a0 con 0x7f96e00abda0 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e006cfd0 0x7f96e0156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e006cfd0 0x7f96e0156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43914/0 (socket says 172.21.15.53:43914) 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 -- 172.21.15.53:0/3011146104 learned_addr learned my addr 172.21.15.53:0/3011146104 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96dffff640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e00b3c60 0x7f96e0099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96d6ffd640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e0153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 -- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 msgr2=0x7f96e0153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e0153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 -- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e00b3c60 msgr2=0x7f96e0099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e00b3c60 0x7f96e0099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96df7fe640 1 -- 172.21.15.53:0/3011146104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80094d0 con 0x7f96e006cfd0 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.497+0000 7f96dffff640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e00b3c60 0x7f96e0099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96df7fe640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e006cfd0 0x7f96e0156630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c7c0 tx=0x7f96d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96dcff9640 1 -- 172.21.15.53:0/3011146104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0007a30 con 0x7f96e006cfd0 2024-09-13T18:25:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96dcff9640 1 -- 172.21.15.53:0/3011146104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0007b90 con 0x7f96e006cfd0 2024-09-13T18:25:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96dcff9640 1 -- 172.21.15.53:0/3011146104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000ce70 con 0x7f96e006cfd0 2024-09-13T18:25:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e01580c0 con 0x7f96e006cfd0 2024-09-13T18:25:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0155e30 con 0x7f96e006cfd0 2024-09-13T18:25:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e00ac210 con 0x7f96e006cfd0 2024-09-13T18:25:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96dcff9640 1 -- 172.21.15.53:0/3011146104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f96d00113f0 con 0x7f96e006cfd0 2024-09-13T18:25:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96dcff9640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96c0066690 0x7f96c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96dcff9640 1 -- 172.21.15.53:0/3011146104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96d0084290 con 0x7f96e006cfd0 2024-09-13T18:25:28.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96d6ffd640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96c0066690 0x7f96c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.501+0000 7f96d6ffd640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96c0066690 0x7f96c0068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96c80af000 tx=0x7f96c80a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.505+0000 7f96dcff9640 1 -- 172.21.15.53:0/3011146104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96d00516b0 con 0x7f96e006cfd0 2024-09-13T18:25:28.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.657+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96e00b2dc0 con 0x7f96e006cfd0 2024-09-13T18:25:28.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.657+0000 7f96dcff9640 1 -- 172.21.15.53:0/3011146104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96d0054cd0 con 0x7f96e006cfd0 2024-09-13T18:25:28.661 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96c0066690 msgr2=0x7f96c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96c0066690 0x7f96c0068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96c80af000 tx=0x7f96c80a7000 comp rx=0 tx=0).stop 2024-09-13T18:25:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e006cfd0 msgr2=0x7f96e0156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e006cfd0 0x7f96e0156630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c7c0 tx=0x7f96d000cc80 comp rx=0 tx=0).stop 2024-09-13T18:25:28.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 shutdown_connections 2024-09-13T18:25:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96c0066690 0x7f96c0068b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96e00abda0 0x7f96e0153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96e00b3c60 0x7f96e0099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 --2- 172.21.15.53:0/3011146104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e006cfd0 0x7f96e0156630 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 >> 172.21.15.53:0/3011146104 conn(0x7f96e0069f50 msgr2=0x7f96e00716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 shutdown_connections 2024-09-13T18:25:28.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.661+0000 7f96e6011640 1 -- 172.21.15.53:0/3011146104 wait complete. 2024-09-13T18:25:28.758 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2024-09-13T18:25:28.758 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:25:28.758 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b74a6640 1 Processor -- start 2024-09-13T18:25:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b74a6640 1 -- start start 2024-09-13T18:25:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b74a6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa6b015cab0 0x7fa6b00d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b74a6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6b00cd6c0 0x7fa6b00cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b74a6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00d2400 con 0x7fa6b00cdb30 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b74a6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00d1530 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b74a6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00d0920 con 0x7fa6b015cab0 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b4a41640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6b00cd6c0 0x7fa6b00cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b4a41640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6b00cd6c0 0x7fa6b00cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43924/0 (socket says 172.21.15.53:43924) 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b4a41640 1 -- 172.21.15.53:0/1908494352 learned_addr learned my addr 172.21.15.53:0/1908494352 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b5242640 1 --2- 172.21.15.53:0/1908494352 >> v2:172.21.15.87:3300/0 conn(0x7fa6b015cab0 0x7fa6b00d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b4a41640 1 -- 172.21.15.53:0/1908494352 >> v2:172.21.15.87:3300/0 conn(0x7fa6b015cab0 msgr2=0x7fa6b00d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b4a41640 1 --2- 172.21.15.53:0/1908494352 >> v2:172.21.15.87:3300/0 conn(0x7fa6b015cab0 0x7fa6b00d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b4a41640 1 -- 172.21.15.53:0/1908494352 >> v1:172.21.15.87:6789/0 conn(0x7fa6b00cdb30 legacy=0x7fa6b00b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:28.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.885+0000 7fa6b4a41640 1 -- 172.21.15.53:0/1908494352 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b00d0c00 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b4a41640 1 --2- 172.21.15.53:0/1908494352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b00cf0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0066930 tx=0x7fa6a001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b355fc58d94fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6a7fff640 1 -- 172.21.15.53:0/1908494352 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00ac620 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6a7fff640 1 -- 172.21.15.53:0/1908494352 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a00ac780 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6a7fff640 1 -- 172.21.15.53:0/1908494352 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00acb10 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- 172.21.15.53:0/1908494352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 msgr2=0x7fa6b00cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/1908494352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b00cf0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0066930 tx=0x7fa6a001c4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- 172.21.15.53:0/1908494352 shutdown_connections 2024-09-13T18:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/1908494352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b00cf0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/1908494352 >> v2:172.21.15.87:3300/0 conn(0x7fa6b015cab0 0x7fa6b00d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- 172.21.15.53:0/1908494352 >> 172.21.15.53:0/1908494352 conn(0x7fa6b0065c80 msgr2=0x7fa6b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:28.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- 172.21.15.53:0/1908494352 shutdown_connections 2024-09-13T18:25:28.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- 172.21.15.53:0/1908494352 wait complete. 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 Processor -- start 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- start start 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b0140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b00cdb30 0x7fa6b0158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6b015cab0 0x7fa6b0158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00c8cf0 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b01578e0 con 0x7fa6b00cdb30 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b74a6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0157bc0 con 0x7fa6b015cab0 2024-09-13T18:25:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b0140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b0140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43930/0 (socket says 172.21.15.53:43930) 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 -- 172.21.15.53:0/3185889043 learned_addr learned my addr 172.21.15.53:0/3185889043 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5a43640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6b015cab0 0x7fa6b0158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b4a41640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b00cdb30 0x7fa6b0158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 -- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6b015cab0 msgr2=0x7fa6b0158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6b015cab0 0x7fa6b0158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 -- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b00cdb30 msgr2=0x7fa6b0158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b00cdb30 0x7fa6b0158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.889+0000 7fa6b5242640 1 -- 172.21.15.53:0/3185889043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00094d0 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6b5242640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b0140590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac007ef0 tx=0x7fa6ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6a5ffb640 1 -- 172.21.15.53:0/3185889043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac014620 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6a5ffb640 1 -- 172.21.15.53:0/3185889043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac014780 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b0157ea0 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6a5ffb640 1 -- 172.21.15.53:0/3185889043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac014b30 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b0158460 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b00cf0c0 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6a5ffb640 1 -- 172.21.15.53:0/3185889043 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6ac014c90 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6a5ffb640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6940666c0 0x7fa694068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6a5ffb640 1 -- 172.21.15.53:0/3185889043 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6ac084bd0 con 0x7fa6b00cd6c0 2024-09-13T18:25:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6b4a41640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6940666c0 0x7fa694068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.893+0000 7fa6b4a41640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6940666c0 0x7fa694068b80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00ae000 tx=0x7fa6a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:28.897+0000 7fa6a5ffb640 1 -- 172.21.15.53:0/3185889043 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa6ac051ea0 con 0x7fa6b00cd6c0 2024-09-13T18:25:29.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.053+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6b00b7a20 con 0x7fa6b00cd6c0 2024-09-13T18:25:29.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6a5ffb640 1 -- 172.21.15.53:0/3185889043 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa6ac0554c0 con 0x7fa6b00cd6c0 2024-09-13T18:25:29.059 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:29.059 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:29.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6940666c0 msgr2=0x7fa694068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6940666c0 0x7fa694068b80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00ae000 tx=0x7fa6a0008040 comp rx=0 tx=0).stop 2024-09-13T18:25:29.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 msgr2=0x7fa6b0140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b0140590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac007ef0 tx=0x7fa6ac00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 shutdown_connections 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6940666c0 0x7fa694068b80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6b015cab0 0x7fa6b0158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6b00cdb30 0x7fa6b0158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 --2- 172.21.15.53:0/3185889043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b00cd6c0 0x7fa6b0140590 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 >> 172.21.15.53:0/3185889043 conn(0x7fa6b0065c80 msgr2=0x7fa6b00b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 shutdown_connections 2024-09-13T18:25:29.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.057+0000 7fa6b74a6640 1 -- 172.21.15.53:0/3185889043 wait complete. 2024-09-13T18:25:29.077 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:29.078 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:29.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.189+0000 7f5a25653640 1 Processor -- start 2024-09-13T18:25:29.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.189+0000 7f5a25653640 1 -- start start 2024-09-13T18:25:29.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a25653640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a2015b470 0x7f5a200abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a25653640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a200ac2e0 0x7f5a200b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a25653640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2006c980 con 0x7f5a20154a50 2024-09-13T18:25:29.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a25653640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a200ac770 con 0x7f5a2015b470 2024-09-13T18:25:29.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a25653640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2006bd70 con 0x7f5a200ac2e0 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a200ac2e0 0x7f5a200b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a2015b470 0x7f5a200abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1effd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5a20154a50 0x7f5a2006ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:51204/0 (socket says 172.21.15.53:51204) 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1effd640 1 -- 172.21.15.53:0/3996011731 learned_addr learned my addr 172.21.15.53:0/3996011731 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1f7fe640 1 -- 172.21.15.53:0/3996011731 >> v2:172.21.15.87:3300/0 conn(0x7f5a2015b470 msgr2=0x7f5a200abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1f7fe640 1 --2- 172.21.15.53:0/3996011731 >> v2:172.21.15.87:3300/0 conn(0x7f5a2015b470 0x7f5a200abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1f7fe640 1 -- 172.21.15.53:0/3996011731 >> v1:172.21.15.87:6789/0 conn(0x7f5a20154a50 legacy=0x7f5a2006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1f7fe640 1 -- 172.21.15.53:0/3996011731 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2006c050 con 0x7f5a200ac2e0 2024-09-13T18:25:29.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1f7fe640 1 --2- 172.21.15.53:0/3996011731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a200ac2e0 0x7f5a200b20e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a180097c0 tx=0x7f5a1801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a3a89ae0962400a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.193+0000 7f5a1dffb640 1 -- 172.21.15.53:0/3996011731 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a180a7070 con 0x7f5a200ac2e0 2024-09-13T18:25:29.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1dffb640 1 -- 172.21.15.53:0/3996011731 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a180ab430 con 0x7f5a200ac2e0 2024-09-13T18:25:29.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1dffb640 1 -- 172.21.15.53:0/3996011731 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a180ab7c0 con 0x7f5a200ac2e0 2024-09-13T18:25:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- 172.21.15.53:0/3996011731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a200ac2e0 msgr2=0x7f5a200b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 --2- 172.21.15.53:0/3996011731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a200ac2e0 0x7f5a200b20e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a180097c0 tx=0x7f5a1801c470 comp rx=0 tx=0).stop 2024-09-13T18:25:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- 172.21.15.53:0/3996011731 shutdown_connections 2024-09-13T18:25:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 --2- 172.21.15.53:0/3996011731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a200ac2e0 0x7f5a200b20e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 --2- 172.21.15.53:0/3996011731 >> v2:172.21.15.87:3300/0 conn(0x7f5a2015b470 0x7f5a200abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- 172.21.15.53:0/3996011731 >> 172.21.15.53:0/3996011731 conn(0x7f5a20069f50 msgr2=0x7f5a2006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- 172.21.15.53:0/3996011731 shutdown_connections 2024-09-13T18:25:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- 172.21.15.53:0/3996011731 wait complete. 2024-09-13T18:25:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 Processor -- start 2024-09-13T18:25:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- start start 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a200ac2e0 0x7f5a201481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a20154a50 0x7f5a20159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2015b470 0x7f5a20159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20159280 con 0x7f5a2015b470 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200b00b0 con 0x7f5a200ac2e0 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200b18b0 con 0x7f5a20154a50 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2015b470 0x7f5a20159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2015b470 0x7f5a20159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43946/0 (socket says 172.21.15.53:43946) 2024-09-13T18:25:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 -- 172.21.15.53:0/3023017665 learned_addr learned my addr 172.21.15.53:0/3023017665 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1effd640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a200ac2e0 0x7f5a201481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1e7fc640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a20154a50 0x7f5a20159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 -- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a20154a50 msgr2=0x7f5a20159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a20154a50 0x7f5a20159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 -- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a200ac2e0 msgr2=0x7f5a201481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a200ac2e0 0x7f5a201481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 -- 172.21.15.53:0/3023017665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18009420 con 0x7f5a2015b470 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1effd640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a200ac2e0 0x7f5a201481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a1f7fe640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2015b470 0x7f5a20159c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a180ad040 tx=0x7f5a18019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a077fe640 1 -- 172.21.15.53:0/3023017665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a180bb070 con 0x7f5a2015b470 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a077fe640 1 -- 172.21.15.53:0/3023017665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18006e20 con 0x7f5a2015b470 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a077fe640 1 -- 172.21.15.53:0/3023017665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a180b4600 con 0x7f5a2015b470 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a200b0370 con 0x7f5a2015b470 2024-09-13T18:25:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.197+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a20148720 con 0x7f5a2015b470 2024-09-13T18:25:29.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.201+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a201593f0 con 0x7f5a2015b470 2024-09-13T18:25:29.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.201+0000 7f5a077fe640 1 -- 172.21.15.53:0/3023017665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a180b4780 con 0x7f5a2015b470 2024-09-13T18:25:29.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.201+0000 7f5a077fe640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a0c066690 0x7f5a0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.201+0000 7f5a077fe640 1 -- 172.21.15.53:0/3023017665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a1811dbf0 con 0x7f5a2015b470 2024-09-13T18:25:29.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.201+0000 7f5a1effd640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a0c066690 0x7f5a0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.201+0000 7f5a1effd640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a0c066690 0x7f5a0c068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a100012f0 tx=0x7f5a10009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.205+0000 7f5a077fe640 1 -- 172.21.15.53:0/3023017665 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5a180eaf60 con 0x7f5a2015b470 2024-09-13T18:25:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.361+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a2015b880 con 0x7f5a2015b470 2024-09-13T18:25:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a077fe640 1 -- 172.21.15.53:0/3023017665 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a180ee580 con 0x7f5a2015b470 2024-09-13T18:25:29.367 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a0c066690 msgr2=0x7f5a0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a0c066690 0x7f5a0c068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a100012f0 tx=0x7f5a10009040 comp rx=0 tx=0).stop 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2015b470 msgr2=0x7f5a20159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2015b470 0x7f5a20159c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a180ad040 tx=0x7f5a18019210 comp rx=0 tx=0).stop 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 shutdown_connections 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a0c066690 0x7f5a0c068b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a20154a50 0x7f5a20159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2015b470 0x7f5a20159c50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 --2- 172.21.15.53:0/3023017665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a200ac2e0 0x7f5a201481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 >> 172.21.15.53:0/3023017665 conn(0x7f5a20069f50 msgr2=0x7f5a20153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 shutdown_connections 2024-09-13T18:25:29.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.365+0000 7f5a25653640 1 -- 172.21.15.53:0/3023017665 wait complete. 2024-09-13T18:25:29.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:29.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafbe034640 1 Processor -- start 2024-09-13T18:25:29.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafbe034640 1 -- start start 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafbe034640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafb80caee0 0x7fafb80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafbe034640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb806f7a0 con 0x7fafb8143e80 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafbe034640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb806fd60 con 0x7fafb80cd320 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafbe034640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb806baa0 con 0x7fafb80caee0 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafb6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafb80caee0 0x7fafb80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafb6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafb80caee0 0x7fafb80cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43960/0 (socket says 172.21.15.53:43960) 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafb77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fafb8143e80 0x7fafb806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39604/0 (socket says 172.21.15.53:39604) 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafb6ffd640 1 -- 172.21.15.53:0/465148546 learned_addr learned my addr 172.21.15.53:0/465148546 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:29.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafb6ffd640 1 -- 172.21.15.53:0/465148546 >> v1:172.21.15.87:6789/0 conn(0x7fafb80cd320 legacy=0x7fafb80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafb6ffd640 1 -- 172.21.15.53:0/465148546 >> v1:172.21.15.53:6789/0 conn(0x7fafb8143e80 legacy=0x7fafb806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.513+0000 7fafb6ffd640 1 -- 172.21.15.53:0/465148546 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80cb960 con 0x7fafb80caee0 2024-09-13T18:25:29.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafb6ffd640 1 --2- 172.21.15.53:0/465148546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80caee0 0x7fafb80cb350 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fafa80098a0 tx=0x7fafa801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2ec6e6b54f2957 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafb67fc640 1 -- 172.21.15.53:0/465148546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80ab600 con 0x7fafb80caee0 2024-09-13T18:25:29.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafb67fc640 1 -- 172.21.15.53:0/465148546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa80a7050 con 0x7fafb80caee0 2024-09-13T18:25:29.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafb67fc640 1 -- 172.21.15.53:0/465148546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80ab980 con 0x7fafb80caee0 2024-09-13T18:25:29.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 -- 172.21.15.53:0/465148546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80caee0 msgr2=0x7fafb80cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 --2- 172.21.15.53:0/465148546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80caee0 0x7fafb80cb350 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fafa80098a0 tx=0x7fafa801c310 comp rx=0 tx=0).stop 2024-09-13T18:25:29.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 -- 172.21.15.53:0/465148546 shutdown_connections 2024-09-13T18:25:29.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 --2- 172.21.15.53:0/465148546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80caee0 0x7fafb80cb350 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 -- 172.21.15.53:0/465148546 >> 172.21.15.53:0/465148546 conn(0x7fafb8065c80 msgr2=0x7fafb8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:29.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 -- 172.21.15.53:0/465148546 shutdown_connections 2024-09-13T18:25:29.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 -- 172.21.15.53:0/465148546 wait complete. 2024-09-13T18:25:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 Processor -- start 2024-09-13T18:25:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.517+0000 7fafbe034640 1 -- start start 2024-09-13T18:25:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafb80caee0 0x7fafb80b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80cd320 0x7fafb8154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafb8143e80 0x7fafb813ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81548d0 con 0x7fafb80cd320 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81404a0 con 0x7fafb80caee0 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80b1d10 con 0x7fafb8143e80 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80cd320 0x7fafb8154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80cd320 0x7fafb8154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43976/0 (socket says 172.21.15.53:43976) 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 -- 172.21.15.53:0/361707836 learned_addr learned my addr 172.21.15.53:0/361707836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb77fe640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafb80caee0 0x7fafb80b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb7fff640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafb8143e80 0x7fafb813ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 -- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafb8143e80 msgr2=0x7fafb813ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafb8143e80 0x7fafb813ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 -- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafb80caee0 msgr2=0x7fafb80b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafb80caee0 0x7fafb80b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 -- 172.21.15.53:0/361707836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa80094d0 con 0x7fafb80cd320 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb6ffd640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80cd320 0x7fafb8154390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fafa8018f20 tx=0x7fafa80190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafaffff640 1 -- 172.21.15.53:0/361707836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80b6670 con 0x7fafb80cd320 2024-09-13T18:25:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafaffff640 1 -- 172.21.15.53:0/361707836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa80b67d0 con 0x7fafb80cd320 2024-09-13T18:25:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb813e800 con 0x7fafb80cd320 2024-09-13T18:25:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafaffff640 1 -- 172.21.15.53:0/361707836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80b6b80 con 0x7fafb80cd320 2024-09-13T18:25:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb80b2240 con 0x7fafb80cd320 2024-09-13T18:25:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb80cb350 con 0x7fafb80cd320 2024-09-13T18:25:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafaffff640 1 -- 172.21.15.53:0/361707836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fafa80b2070 con 0x7fafb80cd320 2024-09-13T18:25:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafaffff640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faf98066690 0x7faf98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafaffff640 1 -- 172.21.15.53:0/361707836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafa811e8b0 con 0x7fafb80cd320 2024-09-13T18:25:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.521+0000 7fafb77fe640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faf98066690 0x7faf98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.525+0000 7fafb77fe640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faf98066690 0x7faf98068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafa0007fd0 tx=0x7fafa0005b80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.525+0000 7fafaffff640 1 -- 172.21.15.53:0/361707836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafa80ebcb0 con 0x7fafb80cd320 2024-09-13T18:25:29.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.685+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafb80b1af0 con 0x7fafb80cd320 2024-09-13T18:25:29.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafaffff640 1 -- 172.21.15.53:0/361707836 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafa80b0020 con 0x7fafb80cd320 2024-09-13T18:25:29.691 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faf98066690 msgr2=0x7faf98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faf98066690 0x7faf98068b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafa0007fd0 tx=0x7fafa0005b80 comp rx=0 tx=0).stop 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80cd320 msgr2=0x7fafb8154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80cd320 0x7fafb8154390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fafa8018f20 tx=0x7fafa80190b0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 shutdown_connections 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faf98066690 0x7faf98068b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafb8143e80 0x7fafb813ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafb80cd320 0x7fafb8154390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 --2- 172.21.15.53:0/361707836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafb80caee0 0x7fafb80b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 >> 172.21.15.53:0/361707836 conn(0x7fafb8065c80 msgr2=0x7fafb815bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:29.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 shutdown_connections 2024-09-13T18:25:29.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.689+0000 7fafbe034640 1 -- 172.21.15.53:0/361707836 wait complete. 2024-09-13T18:25:29.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:29.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe6dd5640 1 Processor -- start 2024-09-13T18:25:29.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe6dd5640 1 -- start start 2024-09-13T18:25:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe6dd5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdbe015c830 0x7fdbe00d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe6dd5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbe00d3390 0x7fdbe00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe6dd5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00b7db0 con 0x7fdbe00ccd10 2024-09-13T18:25:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe6dd5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe00d0650 con 0x7fdbe015c830 2024-09-13T18:25:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe6dd5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00d0c10 con 0x7fdbe00d3390 2024-09-13T18:25:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbdffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdbe00ccd10 0x7fdbe00d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39616/0 (socket says 172.21.15.53:39616) 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbdffff640 1 -- 172.21.15.53:0/3338742400 learned_addr learned my addr 172.21.15.53:0/3338742400 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbe00d3390 0x7fdbe00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbe4b71640 1 --2- 172.21.15.53:0/3338742400 >> v2:172.21.15.87:3300/0 conn(0x7fdbe015c830 0x7fdbe00d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625687227 0 0) 0x7fdbe00b7db0 con 0x7fdbe00ccd10 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd0003530 con 0x7fdbe00ccd10 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.821+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037611564 0 0) 0x7fdbd0003530 con 0x7fdbe00ccd10 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbe00d3390 msgr2=0x7fdbe00cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbe00d3390 0x7fdbe00cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 >> v2:172.21.15.87:3300/0 conn(0x7fdbe015c830 msgr2=0x7fdbe00d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 --2- 172.21.15.53:0/3338742400 >> v2:172.21.15.87:3300/0 conn(0x7fdbe015c830 0x7fdbe00d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe00cd7d0 con 0x7fdbe00ccd10 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdbcc001680 con 0x7fdbe00ccd10 2024-09-13T18:25:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 >> v1:172.21.15.53:6789/0 conn(0x7fdbe00ccd10 legacy=0x7fdbe00d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbe00d3390 0x7fdbd0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd0003f00 0x7fdbd00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbd0004d10 0x7fdbd0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00d0650 con 0x7fdbd0004d10 2024-09-13T18:25:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00d0c10 con 0x7fdbd0003f00 2024-09-13T18:25:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd000b990 con 0x7fdbe00d3390 2024-09-13T18:25:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbd0004d10 0x7fdbd0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdffff640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd0003f00 0x7fdbd00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 -- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbe00d3390 msgr2=0x7fdbd0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbe00d3390 0x7fdbd0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 -- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd0003f00 msgr2=0x7fdbd00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd0003f00 0x7fdbd00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 -- 172.21.15.53:0/3338742400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0003530 con 0x7fdbd0004d10 2024-09-13T18:25:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdffff640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd0003f00 0x7fdbd00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbd0004d10 0x7fdbd0005190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009fc0 tx=0x7fdbd801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7ce8f67151daa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80a5cd0 con 0x7fdbd0004d10 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800f040 con 0x7fdbd0004d10 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbdf7fe640 1 -- 172.21.15.53:0/3338742400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80ad680 con 0x7fdbd0004d10 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3338742400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbd0004d10 msgr2=0x7fdbd0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe6dd5640 1 --2- 172.21.15.53:0/3338742400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbd0004d10 0x7fdbd0005190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009fc0 tx=0x7fdbd801cc60 comp rx=0 tx=0).stop 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe5372640 1 -- 172.21.15.53:0/3338742400 reap_dead start 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3338742400 shutdown_connections 2024-09-13T18:25:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3338742400 >> 172.21.15.53:0/3338742400 conn(0x7fdbe0070970 msgr2=0x7fdbe0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3338742400 shutdown_connections 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.825+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3338742400 wait complete. 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 Processor -- start 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 -- start start 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbd0004d10 0x7fdbe015fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe015e340 0x7fdbe00c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe014fbb0 0x7fdbe00cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe015e7c0 con 0x7fdbe014fbb0 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00c7ad0 con 0x7fdbe015e340 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe015e9b0 con 0x7fdbd0004d10 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe014fbb0 0x7fdbe00cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe014fbb0 0x7fdbe00cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43992/0 (socket says 172.21.15.53:43992) 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 -- 172.21.15.53:0/3888995479 learned_addr learned my addr 172.21.15.53:0/3888995479 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe4b71640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbd0004d10 0x7fdbe015fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbdffff640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe015e340 0x7fdbe00c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 -- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbd0004d10 msgr2=0x7fdbe015fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbd0004d10 0x7fdbe015fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 -- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe015e340 msgr2=0x7fdbe00c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe015e340 0x7fdbe00c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 -- 172.21.15.53:0/3888995479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe015ec90 con 0x7fdbe014fbb0 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe5372640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe014fbb0 0x7fdbe00cb240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8002240 tx=0x7fdbd8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbdd7fa640 1 -- 172.21.15.53:0/3888995479 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80039a0 con 0x7fdbe014fbb0 2024-09-13T18:25:29.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbdd7fa640 1 -- 172.21.15.53:0/3888995479 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8003b00 con 0x7fdbe014fbb0 2024-09-13T18:25:29.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe015ef70 con 0x7fdbe014fbb0 2024-09-13T18:25:29.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbdd7fa640 1 -- 172.21.15.53:0/3888995479 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8003e90 con 0x7fdbe014fbb0 2024-09-13T18:25:29.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe015f530 con 0x7fdbe014fbb0 2024-09-13T18:25:29.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe015f720 con 0x7fdbe014fbb0 2024-09-13T18:25:29.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbdd7fa640 1 -- 172.21.15.53:0/3888995479 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdbd80b4040 con 0x7fdbe014fbb0 2024-09-13T18:25:29.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.829+0000 7fdbdd7fa640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc40666c0 0x7fdbc4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:29.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.833+0000 7fdbdd7fa640 1 -- 172.21.15.53:0/3888995479 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbd811e0b0 con 0x7fdbe014fbb0 2024-09-13T18:25:29.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.833+0000 7fdbe4b71640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc40666c0 0x7fdbc4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:29.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.833+0000 7fdbe4b71640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc40666c0 0x7fdbc4068b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40047c0 tx=0x7fdbd4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:29.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.837+0000 7fdbdd7fa640 1 -- 172.21.15.53:0/3888995479 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdbd80eb560 con 0x7fdbe014fbb0 2024-09-13T18:25:29.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.993+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbe00d1670 con 0x7fdbe014fbb0 2024-09-13T18:25:29.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.993+0000 7fdbdd7fa640 1 -- 172.21.15.53:0/3888995479 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbd80eeb80 con 0x7fdbe014fbb0 2024-09-13T18:25:29.998 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc40666c0 msgr2=0x7fdbc4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc40666c0 0x7fdbc4068b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40047c0 tx=0x7fdbd4008040 comp rx=0 tx=0).stop 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe014fbb0 msgr2=0x7fdbe00cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe014fbb0 0x7fdbe00cb240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8002240 tx=0x7fdbd8009750 comp rx=0 tx=0).stop 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 shutdown_connections 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc40666c0 0x7fdbc4068b80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbe014fbb0 0x7fdbe00cb240 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbe015e340 0x7fdbe00c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 --2- 172.21.15.53:0/3888995479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbd0004d10 0x7fdbe015fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 >> 172.21.15.53:0/3888995479 conn(0x7fdbe0070970 msgr2=0x7fdbe00b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 shutdown_connections 2024-09-13T18:25:30.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:29.997+0000 7fdbe6dd5640 1 -- 172.21.15.53:0/3888995479 wait complete. 2024-09-13T18:25:30.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-13T18:25:30.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ede79c640 1 Processor -- start 2024-09-13T18:25:30.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ede79c640 1 -- start start 2024-09-13T18:25:30.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ede79c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ed80662c0 0x7f0ed81605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:30.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ede79c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed806c7a0 con 0x7f0ed8065ee0 2024-09-13T18:25:30.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ede79c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed806d600 con 0x7f0ed8160b20 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ede79c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed8160f90 con 0x7f0ed80662c0 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ed80662c0 0x7f0ed81605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ed80662c0 0x7f0ed81605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43996/0 (socket says 172.21.15.53:43996) 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0ed8065ee0 0x7f0ed806dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39620/0 (socket says 172.21.15.53:39620) 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed77fe640 1 -- 172.21.15.53:0/3382624350 learned_addr learned my addr 172.21.15.53:0/3382624350 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed77fe640 1 -- 172.21.15.53:0/3382624350 >> v1:172.21.15.87:6789/0 conn(0x7f0ed8160b20 legacy=0x7f0ed80cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed77fe640 1 -- 172.21.15.53:0/3382624350 >> v1:172.21.15.53:6789/0 conn(0x7f0ed8065ee0 legacy=0x7f0ed806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed77fe640 1 -- 172.21.15.53:0/3382624350 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed806c9f0 con 0x7f0ed80662c0 2024-09-13T18:25:30.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.129+0000 7f0ed6ffd640 1 -- 172.21.15.53:0/3382624350 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349904549 0 0) 0x7f0ed806c7a0 con 0x7f0ed8065ee0 2024-09-13T18:25:30.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ed77fe640 1 --2- 172.21.15.53:0/3382624350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed80662c0 0x7f0ed81605e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00098a0 tx=0x7f0ec001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f976820bc0d6f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:30.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ed6ffd640 1 -- 172.21.15.53:0/3382624350 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00a89f0 con 0x7f0ed80662c0 2024-09-13T18:25:30.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ed6ffd640 1 -- 172.21.15.53:0/3382624350 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec00a8b50 con 0x7f0ed80662c0 2024-09-13T18:25:30.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ed6ffd640 1 -- 172.21.15.53:0/3382624350 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00b0440 con 0x7f0ed80662c0 2024-09-13T18:25:30.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- 172.21.15.53:0/3382624350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed80662c0 msgr2=0x7f0ed81605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:30.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 --2- 172.21.15.53:0/3382624350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed80662c0 0x7f0ed81605e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00098a0 tx=0x7f0ec001ecf0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- 172.21.15.53:0/3382624350 shutdown_connections 2024-09-13T18:25:30.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 --2- 172.21.15.53:0/3382624350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed80662c0 0x7f0ed81605e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- 172.21.15.53:0/3382624350 >> 172.21.15.53:0/3382624350 conn(0x7f0ed80b1310 msgr2=0x7f0ed80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:30.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- 172.21.15.53:0/3382624350 shutdown_connections 2024-09-13T18:25:30.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- 172.21.15.53:0/3382624350 wait complete. 2024-09-13T18:25:30.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 Processor -- start 2024-09-13T18:25:30.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- start start 2024-09-13T18:25:30.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed8065ee0 0x7f0ed81e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ed80662c0 0x7f0ed81f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8160b20 0x7f0ed81f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81eb380 con 0x7f0ed8160b20 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81ea770 con 0x7f0ed8065ee0 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ede79c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81eaa50 con 0x7f0ed80662c0 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8160b20 0x7f0ed81f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8160b20 0x7f0ed81f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43998/0 (socket says 172.21.15.53:43998) 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 -- 172.21.15.53:0/1625279386 learned_addr learned my addr 172.21.15.53:0/1625279386 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ed77fe640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ed80662c0 0x7f0ed81f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 -- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ed80662c0 msgr2=0x7f0ed81f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0ed7fff640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed8065ee0 0x7f0ed81e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ed80662c0 0x7f0ed81f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 -- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed8065ee0 msgr2=0x7f0ed81e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed8065ee0 0x7f0ed81e9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.133+0000 7f0edcd39640 1 -- 172.21.15.53:0/1625279386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00094d0 con 0x7f0ed8160b20 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0edcd39640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8160b20 0x7f0ed81f6660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b410 tx=0x7f0ec800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed4ff9640 1 -- 172.21.15.53:0/1625279386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8011830 con 0x7f0ed8160b20 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed4ff9640 1 -- 172.21.15.53:0/1625279386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec80119d0 con 0x7f0ed8160b20 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed4ff9640 1 -- 172.21.15.53:0/1625279386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8011d80 con 0x7f0ed8160b20 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed81ead30 con 0x7f0ed8160b20 2024-09-13T18:25:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed81ec0d0 con 0x7f0ed8160b20 2024-09-13T18:25:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed81622a0 con 0x7f0ed8160b20 2024-09-13T18:25:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed4ff9640 1 -- 172.21.15.53:0/1625279386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ec801a400 con 0x7f0ed8160b20 2024-09-13T18:25:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed4ff9640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eb80666c0 0x7f0eb8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed4ff9640 1 -- 172.21.15.53:0/1625279386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ec8084250 con 0x7f0ed8160b20 2024-09-13T18:25:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed7fff640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eb80666c0 0x7f0eb8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.137+0000 7f0ed7fff640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eb80666c0 0x7f0eb8068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00012f0 tx=0x7f0ed0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.141+0000 7f0ed4ff9640 1 -- 172.21.15.53:0/1625279386 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0ec80515b0 con 0x7f0ed8160b20 2024-09-13T18:25:30.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:30.353+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f0ed81605e0 con 0x7f0ed8160b20 2024-09-13T18:25:31.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.021+0000 7f0ed4ff9640 1 -- 172.21.15.53:0/1625279386 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0ec8054bd0 con 0x7f0ed8160b20 2024-09-13T18:25:31.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eb80666c0 msgr2=0x7f0eb8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eb80666c0 0x7f0eb8068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00012f0 tx=0x7f0ed0009040 comp rx=0 tx=0).stop 2024-09-13T18:25:31.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8160b20 msgr2=0x7f0ed81f6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8160b20 0x7f0ed81f6660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b410 tx=0x7f0ec800b8d0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 shutdown_connections 2024-09-13T18:25:31.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eb80666c0 0x7f0eb8068b80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ed80662c0 0x7f0ed81f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8160b20 0x7f0ed81f6660 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 --2- 172.21.15.53:0/1625279386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed8065ee0 0x7f0ed81e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 >> 172.21.15.53:0/1625279386 conn(0x7f0ed80b1310 msgr2=0x7f0ed80ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:31.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 shutdown_connections 2024-09-13T18:25:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.025+0000 7f0ede79c640 1 -- 172.21.15.53:0/1625279386 wait complete. 2024-09-13T18:25:31.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:25:31.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cee24640 1 Processor -- start 2024-09-13T18:25:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cee24640 1 -- start start 2024-09-13T18:25:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cee24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2c80ceaf0 0x7fa2c80ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cee24640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c80b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cee24640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c806c110 con 0x7fa2c8160bb0 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cee24640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c80abf00 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cee24640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c806b290 con 0x7fa2c80aba50 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2c7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2c80ceaf0 0x7fa2c80ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2c7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2c80ceaf0 0x7fa2c80ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44002/0 (socket says 172.21.15.53:44002) 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2c7fff640 1 -- 172.21.15.53:0/992856261 learned_addr learned my addr 172.21.15.53:0/992856261 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2cd3c1640 1 --2- 172.21.15.53:0/992856261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c80b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2c7fff640 1 -- 172.21.15.53:0/992856261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 msgr2=0x7fa2c80b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/992856261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c80b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2c7fff640 1 -- 172.21.15.53:0/992856261 >> v1:172.21.15.87:6789/0 conn(0x7fa2c8160bb0 legacy=0x7fa2c80ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.177+0000 7fa2c7fff640 1 -- 172.21.15.53:0/992856261 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c806b500 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/992856261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c80ab510 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009e50 tx=0x7fa2bc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2ff63746deb1ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2c77fe640 1 -- 172.21.15.53:0/992856261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0a58d0 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2c77fe640 1 -- 172.21.15.53:0/992856261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc0a5a30 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2c77fe640 1 -- 172.21.15.53:0/992856261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0a5dc0 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 -- 172.21.15.53:0/992856261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 msgr2=0x7fa2c80ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 --2- 172.21.15.53:0/992856261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c80ab510 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009e50 tx=0x7fa2bc01ca00 comp rx=0 tx=0).stop 2024-09-13T18:25:31.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 -- 172.21.15.53:0/992856261 shutdown_connections 2024-09-13T18:25:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 --2- 172.21.15.53:0/992856261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c80b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 --2- 172.21.15.53:0/992856261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c80ab510 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 -- 172.21.15.53:0/992856261 >> 172.21.15.53:0/992856261 conn(0x7fa2c8065e50 msgr2=0x7fa2c8066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 -- 172.21.15.53:0/992856261 shutdown_connections 2024-09-13T18:25:31.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.181+0000 7fa2cee24640 1 -- 172.21.15.53:0/992856261 wait complete. 2024-09-13T18:25:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 Processor -- start 2024-09-13T18:25:31.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 -- start start 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c8071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c8157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8161e70 0x7fa2c8162300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8071fb0 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8162840 con 0x7fa2c8161e70 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81f97c0 con 0x7fa2c80aba50 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c8157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c8157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44018/0 (socket says 172.21.15.53:44018) 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 -- 172.21.15.53:0/3023198486 learned_addr learned my addr 172.21.15.53:0/3023198486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2ccbc0640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c8071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cd3c1640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8161e70 0x7fa2c8162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 -- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 msgr2=0x7fa2c8071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c8071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 -- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8161e70 msgr2=0x7fa2c8162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8161e70 0x7fa2c8162300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 -- 172.21.15.53:0/3023198486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc009b30 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2ccbc0640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c8071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cd3c1640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8161e70 0x7fa2c8162300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c8157670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0af040 tx=0x7fa2bc0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c57fa640 1 -- 172.21.15.53:0/3023198486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0b8680 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c57fa640 1 -- 172.21.15.53:0/3023198486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc0b8800 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c8099960 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2c57fa640 1 -- 172.21.15.53:0/3023198486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0b8bb0 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c8099f20 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.185+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c81f9900 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.189+0000 7fa2c57fa640 1 -- 172.21.15.53:0/3023198486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2bc0b8d10 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.189+0000 7fa2c57fa640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2b4066690 0x7fa2b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.189+0000 7fa2c57fa640 1 -- 172.21.15.53:0/3023198486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2bc11f3c0 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.189+0000 7fa2ccbc0640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2b4066690 0x7fa2b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.189+0000 7fa2ccbc0640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2b4066690 0x7fa2b4068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80016f0 tx=0x7fa2b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.193+0000 7fa2c57fa640 1 -- 172.21.15.53:0/3023198486 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2bc0ec710 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.353+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa2c80adc40 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.361+0000 7fa2c57fa640 1 -- 172.21.15.53:0/3023198486 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa2bc0bd0c0 con 0x7fa2c80ceaf0 2024-09-13T18:25:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.361+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2b4066690 msgr2=0x7fa2b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.361+0000 7fa2cee24640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2b4066690 0x7fa2b4068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80016f0 tx=0x7fa2b8009040 comp rx=0 tx=0).stop 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.361+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 msgr2=0x7fa2c8157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.361+0000 7fa2cee24640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c8157670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0af040 tx=0x7fa2bc0197a0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 shutdown_connections 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2b4066690 0x7fa2b4068b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2c8161e70 0x7fa2c8162300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c80ceaf0 0x7fa2c8157670 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 --2- 172.21.15.53:0/3023198486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2c80aba50 0x7fa2c8071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 >> 172.21.15.53:0/3023198486 conn(0x7fa2c8065e50 msgr2=0x7fa2c81644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 shutdown_connections 2024-09-13T18:25:31.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.365+0000 7fa2cee24640 1 -- 172.21.15.53:0/3023198486 wait complete. 2024-09-13T18:25:31.384 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:25:31.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:25:31.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:25:31.550 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:25:31.550 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:25:31.550 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:31.556 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:25:31.557 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:31.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.773+0000 7fb2c61a5640 1 Processor -- start 2024-09-13T18:25:31.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.773+0000 7fb2c61a5640 1 -- start start 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2c61a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2c015c840 0x7fb2c0160220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2c61a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b1650 0x7fb2c00b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2c61a5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c00b50b0 con 0x7fb2c00b4c80 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2c61a5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00cdd80 con 0x7fb2c015c840 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2c61a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0160a70 con 0x7fb2c00b1650 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2beffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b1650 0x7fb2c00b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2bf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2c015c840 0x7fb2c0160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2beffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b1650 0x7fb2c00b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:49212/0 (socket says 172.21.15.53:49212) 2024-09-13T18:25:31.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2beffd640 1 -- 172.21.15.53:0/2188905131 learned_addr learned my addr 172.21.15.53:0/2188905131 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:31.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2bf7fe640 1 -- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b1650 msgr2=0x7fb2c00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:31.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2bf7fe640 1 --2- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b1650 0x7fb2c00b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2bf7fe640 1 -- 172.21.15.53:0/2188905131 >> v1:172.21.15.87:6789/0 conn(0x7fb2c00b4c80 legacy=0x7fb2c00cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2bf7fe640 1 -- 172.21.15.53:0/2188905131 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0160d50 con 0x7fb2c015c840 2024-09-13T18:25:31.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.777+0000 7fb2beffd640 1 --2- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b1650 0x7fb2c00b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:31.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2bf7fe640 1 --2- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 0x7fb2c0160220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00097c0 tx=0x7fb2b001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a36734db0c00427 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2be7fc640 1 -- 172.21.15.53:0/2188905131 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00ab670 con 0x7fb2c015c840 2024-09-13T18:25:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2be7fc640 1 -- 172.21.15.53:0/2188905131 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b00ab7d0 con 0x7fb2c015c840 2024-09-13T18:25:31.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2be7fc640 1 -- 172.21.15.53:0/2188905131 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00abb60 con 0x7fb2c015c840 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 msgr2=0x7fb2c0160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 0x7fb2c0160220 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00097c0 tx=0x7fb2b001c470 comp rx=0 tx=0).stop 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- 172.21.15.53:0/2188905131 shutdown_connections 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b1650 0x7fb2c00b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/2188905131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 0x7fb2c0160220 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- 172.21.15.53:0/2188905131 >> 172.21.15.53:0/2188905131 conn(0x7fb2c0066080 msgr2=0x7fb2c0066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- 172.21.15.53:0/2188905131 shutdown_connections 2024-09-13T18:25:31.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- 172.21.15.53:0/2188905131 wait complete. 2024-09-13T18:25:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 Processor -- start 2024-09-13T18:25:31.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- start start 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2c00b1650 0x7fb2c0166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b4c80 0x7fb2c0158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 0x7fb2c00cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0159e80 con 0x7fb2c00b1650 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c01598c0 con 0x7fb2c015c840 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2c61a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0159ba0 con 0x7fb2c00b4c80 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2c00b1650 0x7fb2c0166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2c00b1650 0x7fb2c0166d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44020/0 (socket says 172.21.15.53:44020) 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2bf7fe640 1 -- 172.21.15.53:0/1148169090 learned_addr learned my addr 172.21.15.53:0/1148169090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:31.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2beffd640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b4c80 0x7fb2c0158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.781+0000 7fb2bffff640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 0x7fb2c00cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2bf7fe640 1 -- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b4c80 msgr2=0x7fb2c0158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2bf7fe640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b4c80 0x7fb2c0158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2bf7fe640 1 -- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 msgr2=0x7fb2c00cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2bf7fe640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 0x7fb2c00cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2bf7fe640 1 -- 172.21.15.53:0/1148169090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40094d0 con 0x7fb2c00b1650 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2bf7fe640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2c00b1650 0x7fb2c0166d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00ad040 tx=0x7fb2b001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2a7fff640 1 -- 172.21.15.53:0/1148169090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00bf610 con 0x7fb2c00b1650 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2a7fff640 1 -- 172.21.15.53:0/1148169090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b00bf7b0 con 0x7fb2c00b1650 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b0009420 con 0x7fb2c00b1650 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2a7fff640 1 -- 172.21.15.53:0/1148169090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00bfb60 con 0x7fb2c00b1650 2024-09-13T18:25:31.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c00c6680 con 0x7fb2c00b1650 2024-09-13T18:25:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c00b4740 con 0x7fb2c00b1650 2024-09-13T18:25:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2a7fff640 1 -- 172.21.15.53:0/1148169090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb2b00b5400 con 0x7fb2c00b1650 2024-09-13T18:25:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2a7fff640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2ac066690 0x7fb2ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2a7fff640 1 -- 172.21.15.53:0/1148169090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2b011ef90 con 0x7fb2c00b1650 2024-09-13T18:25:31.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2beffd640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2ac066690 0x7fb2ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:31.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.785+0000 7fb2beffd640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2ac066690 0x7fb2ac068b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2c015c1d0 tx=0x7fb2b4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:31.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.789+0000 7fb2a7fff640 1 -- 172.21.15.53:0/1148169090 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb2b00ec390 con 0x7fb2c00b1650 2024-09-13T18:25:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.949+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c0159ce0 con 0x7fb2c00b1650 2024-09-13T18:25:31.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2a7fff640 1 -- 172.21.15.53:0/1148169090 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fb2c0159ce0 con 0x7fb2c00b1650 2024-09-13T18:25:31.956 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:31.956 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2ac066690 msgr2=0x7fb2ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2ac066690 0x7fb2ac068b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2c015c1d0 tx=0x7fb2b4008040 comp rx=0 tx=0).stop 2024-09-13T18:25:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2c00b1650 msgr2=0x7fb2c0166d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2c00b1650 0x7fb2c0166d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00ad040 tx=0x7fb2b001acb0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 shutdown_connections 2024-09-13T18:25:31.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2ac066690 0x7fb2ac068b50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2c00b4c80 0x7fb2c0158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2c015c840 0x7fb2c00cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 --2- 172.21.15.53:0/1148169090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2c00b1650 0x7fb2c0166d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:31.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 >> 172.21.15.53:0/1148169090 conn(0x7fb2c0066080 msgr2=0x7fb2c00d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:31.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 shutdown_connections 2024-09-13T18:25:31.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:31.953+0000 7fb2c61a5640 1 -- 172.21.15.53:0/1148169090 wait complete. 2024-09-13T18:25:31.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:31.977 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:32.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.105+0000 7f26db2cc640 1 Processor -- start 2024-09-13T18:25:32.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.105+0000 7f26db2cc640 1 -- start start 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.105+0000 7f26db2cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f26d415c830 0x7f26d40d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26d40ccd10 0x7f26d40cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d40b7db0 con 0x7f26d40d2c80 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d40d0650 con 0x7f26d40ccd10 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d40d0c10 con 0x7f26d415c830 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26d40ccd10 0x7f26d40cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26d40ccd10 0x7f26d40cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44032/0 (socket says 172.21.15.53:44032) 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 -- 172.21.15.53:0/3289917164 learned_addr learned my addr 172.21.15.53:0/3289917164 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d9068640 1 --2- 172.21.15.53:0/3289917164 >> v2:172.21.15.87:3300/0 conn(0x7f26d415c830 0x7f26d40d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 -- 172.21.15.53:0/3289917164 >> v2:172.21.15.87:3300/0 conn(0x7f26d415c830 msgr2=0x7f26d40d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 --2- 172.21.15.53:0/3289917164 >> v2:172.21.15.87:3300/0 conn(0x7f26d415c830 0x7f26d40d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 -- 172.21.15.53:0/3289917164 >> v1:172.21.15.87:6789/0 conn(0x7f26d40d2c80 legacy=0x7f26d40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:32.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 -- 172.21.15.53:0/3289917164 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40cd7d0 con 0x7f26d40ccd10 2024-09-13T18:25:32.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26d8867640 1 --2- 172.21.15.53:0/3289917164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40cd180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f26d40d0240 tx=0x7f26c401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9458ace0424445e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26cbfff640 1 -- 172.21.15.53:0/3289917164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40ab600 con 0x7f26d40ccd10 2024-09-13T18:25:32.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26cbfff640 1 -- 172.21.15.53:0/3289917164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c40a7050 con 0x7f26d40ccd10 2024-09-13T18:25:32.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26cbfff640 1 -- 172.21.15.53:0/3289917164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c40ab980 con 0x7f26d40ccd10 2024-09-13T18:25:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- 172.21.15.53:0/3289917164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 msgr2=0x7f26d40cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 --2- 172.21.15.53:0/3289917164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40cd180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f26d40d0240 tx=0x7f26c401c4e0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- 172.21.15.53:0/3289917164 shutdown_connections 2024-09-13T18:25:32.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 --2- 172.21.15.53:0/3289917164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40cd180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 --2- 172.21.15.53:0/3289917164 >> v2:172.21.15.87:3300/0 conn(0x7f26d415c830 0x7f26d40d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- 172.21.15.53:0/3289917164 >> 172.21.15.53:0/3289917164 conn(0x7f26d4070970 msgr2=0x7f26d4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:32.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- 172.21.15.53:0/3289917164 shutdown_connections 2024-09-13T18:25:32.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.109+0000 7f26db2cc640 1 -- 172.21.15.53:0/3289917164 wait complete. 2024-09-13T18:25:32.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 Processor -- start 2024-09-13T18:25:32.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 -- start start 2024-09-13T18:25:32.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26d40d2c80 0x7f26d415f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26d415c830 0x7f26d4153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d415dd90 con 0x7f26d40ccd10 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d414fd30 con 0x7f26d40d2c80 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d413abe0 con 0x7f26d415c830 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44042/0 (socket says 172.21.15.53:44042) 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 -- 172.21.15.53:0/259234475 learned_addr learned my addr 172.21.15.53:0/259234475 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d8867640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26d40d2c80 0x7f26d415f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9869640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26d415c830 0x7f26d4153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 -- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26d415c830 msgr2=0x7f26d4153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26d415c830 0x7f26d4153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 -- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26d40d2c80 msgr2=0x7f26d415f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26d40d2c80 0x7f26d415f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 -- 172.21.15.53:0/259234475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40094d0 con 0x7f26d40ccd10 2024-09-13T18:25:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26d9068640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40c8c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f26d000d830 tx=0x7f26d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26c9ffb640 1 -- 172.21.15.53:0/259234475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000b660 con 0x7f26d40ccd10 2024-09-13T18:25:32.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26c9ffb640 1 -- 172.21.15.53:0/259234475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000b7c0 con 0x7f26d40ccd10 2024-09-13T18:25:32.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d415dfe0 con 0x7f26d40ccd10 2024-09-13T18:25:32.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26c9ffb640 1 -- 172.21.15.53:0/259234475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000bb30 con 0x7f26d40ccd10 2024-09-13T18:25:32.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d415e5a0 con 0x7f26d40ccd10 2024-09-13T18:25:32.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.113+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d40cd180 con 0x7f26d40ccd10 2024-09-13T18:25:32.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.117+0000 7f26c9ffb640 1 -- 172.21.15.53:0/259234475 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26d001e460 con 0x7f26d40ccd10 2024-09-13T18:25:32.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.117+0000 7f26c9ffb640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f26b8066690 0x7f26b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.117+0000 7f26c9ffb640 1 -- 172.21.15.53:0/259234475 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26d00848b0 con 0x7f26d40ccd10 2024-09-13T18:25:32.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.117+0000 7f26d8867640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f26b8066690 0x7f26b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.117+0000 7f26d8867640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f26b8066690 0x7f26b8068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ad000 tx=0x7f26c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.121+0000 7f26c9ffb640 1 -- 172.21.15.53:0/259234475 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26d0051c10 con 0x7f26d40ccd10 2024-09-13T18:25:32.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.277+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26d40b8320 con 0x7f26d40ccd10 2024-09-13T18:25:32.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.277+0000 7f26c9ffb640 1 -- 172.21.15.53:0/259234475 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26d0055230 con 0x7f26d40ccd10 2024-09-13T18:25:32.282 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f26b8066690 msgr2=0x7f26b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f26b8066690 0x7f26b8068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ad000 tx=0x7f26c4008040 comp rx=0 tx=0).stop 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 msgr2=0x7f26d40c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40c8c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f26d000d830 tx=0x7f26d000dcf0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 shutdown_connections 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f26b8066690 0x7f26b8068b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f26d415c830 0x7f26d4153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26d40d2c80 0x7f26d415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 --2- 172.21.15.53:0/259234475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26d40ccd10 0x7f26d40c8c00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 >> 172.21.15.53:0/259234475 conn(0x7f26d4070970 msgr2=0x7f26d40cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:32.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 shutdown_connections 2024-09-13T18:25:32.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.281+0000 7f26db2cc640 1 -- 172.21.15.53:0/259234475 wait complete. 2024-09-13T18:25:32.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea9f80640 1 Processor -- start 2024-09-13T18:25:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea9f80640 1 -- start start 2024-09-13T18:25:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea9f80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 0x7f8ea40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea9f80640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea406f7a0 con 0x7f8ea40cd320 2024-09-13T18:25:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea9f80640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea406fd60 con 0x7f8ea4143e80 2024-09-13T18:25:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea9f80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea406baa0 con 0x7f8ea40caee0 2024-09-13T18:25:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8ea40cd320 0x7f8ea40cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39632/0 (socket says 172.21.15.53:39632) 2024-09-13T18:25:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 -- 172.21.15.53:0/4064195104 learned_addr learned my addr 172.21.15.53:0/4064195104 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea2ffd640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 0x7f8ea40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106801923 0 0) 0x7f8ea406f7a0 con 0x7f8ea40cd320 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e8c003530 con 0x7f8ea40cd320 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136782575 0 0) 0x7f8e8c003530 con 0x7f8ea40cd320 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 msgr2=0x7f8ea40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 0x7f8ea40cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 >> v1:172.21.15.87:6789/0 conn(0x7f8ea4143e80 legacy=0x7f8ea406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40cb960 con 0x7f8ea40cd320 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8e9c001a00 con 0x7f8ea40cd320 2024-09-13T18:25:32.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 >> v1:172.21.15.53:6789/0 conn(0x7f8ea40cd320 legacy=0x7f8ea40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c0039b0 0x7f8e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 0x7f8e8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e8c004d10 0x7f8e8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea406baa0 con 0x7f8e8c004d10 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c00baf0 con 0x7f8e8c0039b0 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c00bcb0 con 0x7f8ea40caee0 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e8c004d10 0x7f8e8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea2ffd640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 0x7f8e8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea37fe640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c0039b0 0x7f8e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 -- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 msgr2=0x7f8e8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:32.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 0x7f8e8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 -- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c0039b0 msgr2=0x7f8e8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:32.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c0039b0 0x7f8e8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea3fff640 1 -- 172.21.15.53:0/4064195104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c003530 con 0x7f8e8c004d10 2024-09-13T18:25:32.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.429+0000 7f8ea2ffd640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea40caee0 0x7f8e8c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:32.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e8c004d10 0x7f8e8c005190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00a830 tx=0x7f8e9c01fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703a4c04c5c243cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0aa6f0 con 0x7f8e8c004d10 2024-09-13T18:25:32.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0aa850 con 0x7f8e8c004d10 2024-09-13T18:25:32.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea27fc640 1 -- 172.21.15.53:0/4064195104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0aabe0 con 0x7f8e8c004d10 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 -- 172.21.15.53:0/4064195104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e8c004d10 msgr2=0x7f8e8c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 --2- 172.21.15.53:0/4064195104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e8c004d10 0x7f8e8c005190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00a830 tx=0x7f8e9c01fac0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea3fff640 1 -- 172.21.15.53:0/4064195104 reap_dead start 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 -- 172.21.15.53:0/4064195104 shutdown_connections 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 -- 172.21.15.53:0/4064195104 >> 172.21.15.53:0/4064195104 conn(0x7f8ea4065c80 msgr2=0x7f8ea4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 -- 172.21.15.53:0/4064195104 shutdown_connections 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 -- 172.21.15.53:0/4064195104 wait complete. 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 Processor -- start 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.433+0000 7f8ea9f80640 1 -- start start 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c004d10 0x7f8ea41f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea4153ac0 0x7f8ea4153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea40c4530 0x7f8ea40c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c5260 con 0x7f8ea40c4530 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c5540 con 0x7f8e8c004d10 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40c5820 con 0x7f8ea4153ac0 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea40c4530 0x7f8ea40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea40c4530 0x7f8ea40c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44060/0 (socket says 172.21.15.53:44060) 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2048984403 learned_addr learned my addr 172.21.15.53:0/2048984403 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea2ffd640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea4153ac0 0x7f8ea4153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea37fe640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c004d10 0x7f8ea41f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea4153ac0 msgr2=0x7f8ea4153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea4153ac0 0x7f8ea4153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c004d10 msgr2=0x7f8ea41f0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c004d10 0x7f8ea41f0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 -- 172.21.15.53:0/2048984403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40c5b00 con 0x7f8ea40c4530 2024-09-13T18:25:32.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea2ffd640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea4153ac0 0x7f8ea4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea3fff640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea40c4530 0x7f8ea40c49c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c007040 tx=0x7f8e9c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8e8bfff640 1 -- 172.21.15.53:0/2048984403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0b9040 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8e8bfff640 1 -- 172.21.15.53:0/2048984403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0017c0 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea40c5de0 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8e8bfff640 1 -- 172.21.15.53:0/2048984403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0aa6f0 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea40c4f00 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea40cb320 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8e8bfff640 1 -- 172.21.15.53:0/2048984403 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e9c0aa9c0 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8e8bfff640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e900666c0 0x7f8e90068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8e8bfff640 1 -- 172.21.15.53:0/2048984403 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e9c121900 con 0x7f8ea40c4530 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.437+0000 7f8ea37fe640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e900666c0 0x7f8e90068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.441+0000 7f8ea37fe640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e900666c0 0x7f8e90068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e94000c10 tx=0x7f8e94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.441+0000 7f8e8bfff640 1 -- 172.21.15.53:0/2048984403 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e9c0eec90 con 0x7f8ea40c4530 2024-09-13T18:25:32.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.601+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ea40a91c0 con 0x7f8ea40c4530 2024-09-13T18:25:32.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8e8bfff640 1 -- 172.21.15.53:0/2048984403 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e9c0f22b0 con 0x7f8ea40c4530 2024-09-13T18:25:32.607 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e900666c0 msgr2=0x7f8e90068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e900666c0 0x7f8e90068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e94000c10 tx=0x7f8e94009040 comp rx=0 tx=0).stop 2024-09-13T18:25:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea40c4530 msgr2=0x7f8ea40c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea40c4530 0x7f8ea40c49c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c007040 tx=0x7f8e9c01c860 comp rx=0 tx=0).stop 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 shutdown_connections 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e900666c0 0x7f8e90068b80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ea4153ac0 0x7f8ea4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ea40c4530 0x7f8ea40c49c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 --2- 172.21.15.53:0/2048984403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e8c004d10 0x7f8ea41f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 >> 172.21.15.53:0/2048984403 conn(0x7f8ea4065c80 msgr2=0x7f8ea40a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.605+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 shutdown_connections 2024-09-13T18:25:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.609+0000 7f8ea9f80640 1 -- 172.21.15.53:0/2048984403 wait complete. 2024-09-13T18:25:32.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:32.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e9d4ae640 1 Processor -- start 2024-09-13T18:25:32.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e9d4ae640 1 -- start start 2024-09-13T18:25:32.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e9d4ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e9806d440 0x7f1e98163e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e9d4ae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980715f0 con 0x7f1e98157020 2024-09-13T18:25:32.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e9d4ae640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980b15a0 con 0x7f1e98156c40 2024-09-13T18:25:32.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e9d4ae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e98070340 con 0x7f1e9806d440 2024-09-13T18:25:32.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e977fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e9806d440 0x7f1e98163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e967fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e98157020 0x7f1e9806cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39644/0 (socket says 172.21.15.53:39644) 2024-09-13T18:25:32.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.757+0000 7f1e967fc640 1 -- 172.21.15.53:0/7142708 learned_addr learned my addr 172.21.15.53:0/7142708 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:32.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e977fe640 1 -- 172.21.15.53:0/7142708 >> v1:172.21.15.87:6789/0 conn(0x7f1e98156c40 legacy=0x7f1e98070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e977fe640 1 -- 172.21.15.53:0/7142708 >> v1:172.21.15.53:6789/0 conn(0x7f1e98157020 legacy=0x7f1e9806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e977fe640 1 -- 172.21.15.53:0/7142708 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980b1880 con 0x7f1e9806d440 2024-09-13T18:25:32.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e95ffb640 1 -- 172.21.15.53:0/7142708 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776700829 0 0) 0x7f1e980715f0 con 0x7f1e98157020 2024-09-13T18:25:32.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e977fe640 1 --2- 172.21.15.53:0/7142708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e98163e90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009dc0 tx=0x7f1e9001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78234278c536e574 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e95ffb640 1 -- 172.21.15.53:0/7142708 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900a59e0 con 0x7f1e9806d440 2024-09-13T18:25:32.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e95ffb640 1 -- 172.21.15.53:0/7142708 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e900a5b40 con 0x7f1e9806d440 2024-09-13T18:25:32.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e95ffb640 1 -- 172.21.15.53:0/7142708 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900ad440 con 0x7f1e9806d440 2024-09-13T18:25:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/7142708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 msgr2=0x7f1e98163e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/7142708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e98163e90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009dc0 tx=0x7f1e9001c920 comp rx=0 tx=0).stop 2024-09-13T18:25:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/7142708 shutdown_connections 2024-09-13T18:25:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/7142708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e98163e90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/7142708 >> 172.21.15.53:0/7142708 conn(0x7f1e98065c80 msgr2=0x7f1e98066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/7142708 shutdown_connections 2024-09-13T18:25:32.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.761+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/7142708 wait complete. 2024-09-13T18:25:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 Processor -- start 2024-09-13T18:25:32.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 -- start start 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e981587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e98156c40 0x7f1e98140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e9815a990 0x7f1e98145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9814a100 con 0x7f1e9806d440 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98158d00 con 0x7f1e9815a990 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e981454b0 con 0x7f1e98156c40 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e981587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e981587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44076/0 (socket says 172.21.15.53:44076) 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 -- 172.21.15.53:0/311311294 learned_addr learned my addr 172.21.15.53:0/311311294 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e977fe640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e9815a990 0x7f1e98145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e967fc640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e98156c40 0x7f1e98140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 -- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e98156c40 msgr2=0x7f1e98140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e98156c40 0x7f1e98140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 -- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e9815a990 msgr2=0x7f1e98145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e9815a990 0x7f1e98145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 -- 172.21.15.53:0/311311294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009a70 con 0x7f1e9806d440 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e96ffd640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e981587c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c500 tx=0x7f1e8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e7f7fe640 1 -- 172.21.15.53:0/311311294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88005220 con 0x7f1e9806d440 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e7f7fe640 1 -- 172.21.15.53:0/311311294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88005380 con 0x7f1e9806d440 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9815c500 con 0x7f1e9806d440 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e7f7fe640 1 -- 172.21.15.53:0/311311294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88007270 con 0x7f1e9806d440 2024-09-13T18:25:32.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e98145700 con 0x7f1e9806d440 2024-09-13T18:25:32.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.765+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9806cd30 con 0x7f1e9806d440 2024-09-13T18:25:32.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.769+0000 7f1e7f7fe640 1 -- 172.21.15.53:0/311311294 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e880073d0 con 0x7f1e9806d440 2024-09-13T18:25:32.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.769+0000 7f1e7f7fe640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e84066690 0x7f1e84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:32.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.769+0000 7f1e7f7fe640 1 -- 172.21.15.53:0/311311294 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e88083740 con 0x7f1e9806d440 2024-09-13T18:25:32.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.769+0000 7f1e967fc640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e84066690 0x7f1e84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:32.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.769+0000 7f1e967fc640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e84066690 0x7f1e84068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e98159420 tx=0x7f1e8c007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:32.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.773+0000 7f1e7f7fe640 1 -- 172.21.15.53:0/311311294 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e88050ac0 con 0x7f1e9806d440 2024-09-13T18:25:32.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.933+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e980b0df0 con 0x7f1e9806d440 2024-09-13T18:25:32.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.933+0000 7f1e7f7fe640 1 -- 172.21.15.53:0/311311294 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e880540e0 con 0x7f1e9806d440 2024-09-13T18:25:32.938 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:32.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e84066690 msgr2=0x7f1e84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e84066690 0x7f1e84068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e98159420 tx=0x7f1e8c007d10 comp rx=0 tx=0).stop 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 msgr2=0x7f1e981587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e981587c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c500 tx=0x7f1e8800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 shutdown_connections 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e84066690 0x7f1e84068b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e98156c40 0x7f1e98140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e9815a990 0x7f1e98145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 --2- 172.21.15.53:0/311311294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e9806d440 0x7f1e981587c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 >> 172.21.15.53:0/311311294 conn(0x7f1e98065c80 msgr2=0x7f1e9814a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 shutdown_connections 2024-09-13T18:25:32.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:32.937+0000 7f1e9d4ae640 1 -- 172.21.15.53:0/311311294 wait complete. 2024-09-13T18:25:32.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2007473640 1 Processor -- start 2024-09-13T18:25:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2007473640 1 -- start start 2024-09-13T18:25:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2007473640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2000070f00 0x7f2000065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2007473640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20000661c0 0x7f200015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2007473640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200015ed30 con 0x7f200015e500 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2007473640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200015b970 con 0x7f2000070f00 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2007473640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2000066630 con 0x7f20000661c0 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f200520f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2000070f00 0x7f2000065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2005a10640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f200015e500 0x7f20000ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39650/0 (socket says 172.21.15.53:39650) 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.073+0000 7f2005a10640 1 -- 172.21.15.53:0/2237161597 learned_addr learned my addr 172.21.15.53:0/2237161597 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f200520f640 1 -- 172.21.15.53:0/2237161597 >> v2:172.21.15.87:3300/0 conn(0x7f20000661c0 msgr2=0x7f200015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2004a0e640 1 --2- 172.21.15.53:0/2237161597 >> v2:172.21.15.87:3300/0 conn(0x7f20000661c0 0x7f200015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f200520f640 1 --2- 172.21.15.53:0/2237161597 >> v2:172.21.15.87:3300/0 conn(0x7f20000661c0 0x7f200015dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f200520f640 1 -- 172.21.15.53:0/2237161597 >> v1:172.21.15.53:6789/0 conn(0x7f200015e500 legacy=0x7f20000ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f1ff7fff640 1 -- 172.21.15.53:0/2237161597 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791453282 0 0) 0x7f200015ed30 con 0x7f200015e500 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f200520f640 1 -- 172.21.15.53:0/2237161597 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000cbf60 con 0x7f2000070f00 2024-09-13T18:25:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2004a0e640 1 --2- 172.21.15.53:0/2237161597 >> v2:172.21.15.87:3300/0 conn(0x7f20000661c0 0x7f200015dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:33.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f200520f640 1 --2- 172.21.15.53:0/2237161597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f2000065c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f200006c4d0 tx=0x7f1ffc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1392a92cb4f743bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f1ff7fff640 1 -- 172.21.15.53:0/2237161597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0a7070 con 0x7f2000070f00 2024-09-13T18:25:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f1ff7fff640 1 -- 172.21.15.53:0/2237161597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc0ab430 con 0x7f2000070f00 2024-09-13T18:25:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f1ff7fff640 1 -- 172.21.15.53:0/2237161597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0ab7c0 con 0x7f2000070f00 2024-09-13T18:25:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 -- 172.21.15.53:0/2237161597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 msgr2=0x7f2000065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 --2- 172.21.15.53:0/2237161597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f2000065c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f200006c4d0 tx=0x7f1ffc01c430 comp rx=0 tx=0).stop 2024-09-13T18:25:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 -- 172.21.15.53:0/2237161597 shutdown_connections 2024-09-13T18:25:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 --2- 172.21.15.53:0/2237161597 >> v2:172.21.15.87:3300/0 conn(0x7f20000661c0 0x7f200015dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 --2- 172.21.15.53:0/2237161597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f2000065c80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 -- 172.21.15.53:0/2237161597 >> 172.21.15.53:0/2237161597 conn(0x7f20000b1680 msgr2=0x7f20000b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 -- 172.21.15.53:0/2237161597 shutdown_connections 2024-09-13T18:25:33.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.077+0000 7f2007473640 1 -- 172.21.15.53:0/2237161597 wait complete. 2024-09-13T18:25:33.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 Processor -- start 2024-09-13T18:25:33.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 -- start start 2024-09-13T18:25:33.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20000661c0 0x7f200015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f20001451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f200015e500 0x7f2000153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20001333f0 con 0x7f2000070f00 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20001327e0 con 0x7f200015e500 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2000132ac0 con 0x7f20000661c0 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f20001451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f20001451f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44090/0 (socket says 172.21.15.53:44090) 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 -- 172.21.15.53:0/4185265205 learned_addr learned my addr 172.21.15.53:0/4185265205 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f200520f640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20000661c0 0x7f200015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2005a10640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f200015e500 0x7f2000153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 -- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20000661c0 msgr2=0x7f200015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20000661c0 0x7f200015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 -- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f200015e500 msgr2=0x7f2000153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f200015e500 0x7f2000153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 -- 172.21.15.53:0/4185265205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc009420 con 0x7f2000070f00 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f200520f640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20000661c0 0x7f200015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2005a10640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f200015e500 0x7f2000153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2004a0e640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f20001451f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c7c0 tx=0x7f1ff000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f1ff5ffb640 1 -- 172.21.15.53:0/4185265205 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0007a30 con 0x7f2000070f00 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f1ff5ffb640 1 -- 172.21.15.53:0/4185265205 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0007b90 con 0x7f2000070f00 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20000ccea0 con 0x7f2000070f00 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f1ff5ffb640 1 -- 172.21.15.53:0/4185265205 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000ce70 con 0x7f2000070f00 2024-09-13T18:25:33.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2000133080 con 0x7f2000070f00 2024-09-13T18:25:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200015dd40 con 0x7f2000070f00 2024-09-13T18:25:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.081+0000 7f1ff5ffb640 1 -- 172.21.15.53:0/4185265205 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ff00113f0 con 0x7f2000070f00 2024-09-13T18:25:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.085+0000 7f1ff5ffb640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1fe4066690 0x7f1fe4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.085+0000 7f1ff5ffb640 1 -- 172.21.15.53:0/4185265205 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ff0084690 con 0x7f2000070f00 2024-09-13T18:25:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.085+0000 7f200520f640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1fe4066690 0x7f1fe4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.085+0000 7f200520f640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1fe4066690 0x7f1fe4068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0af000 tx=0x7f1ffc0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.089+0000 7f1ff5ffb640 1 -- 172.21.15.53:0/4185265205 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f200015dd40 con 0x7f2000070f00 2024-09-13T18:25:33.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.261+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f200015dd40 con 0x7f2000070f00 2024-09-13T18:25:33.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.261+0000 7f1ff5ffb640 1 -- 172.21.15.53:0/4185265205 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f200015dd40 con 0x7f2000070f00 2024-09-13T18:25:33.264 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:33.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.261+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1fe4066690 msgr2=0x7f1fe4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.261+0000 7f2007473640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1fe4066690 0x7f1fe4068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0af000 tx=0x7f1ffc0a7000 comp rx=0 tx=0).stop 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.261+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 msgr2=0x7f20001451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.261+0000 7f2007473640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f20001451f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c7c0 tx=0x7f1ff000cc80 comp rx=0 tx=0).stop 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 shutdown_connections 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1fe4066690 0x7f1fe4068b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f200015e500 0x7f2000153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2000070f00 0x7f20001451f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 --2- 172.21.15.53:0/4185265205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20000661c0 0x7f200015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 >> 172.21.15.53:0/4185265205 conn(0x7f20000b1680 msgr2=0x7f20000b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 shutdown_connections 2024-09-13T18:25:33.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.265+0000 7f2007473640 1 -- 172.21.15.53:0/4185265205 wait complete. 2024-09-13T18:25:33.283 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:25:33.283 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:33.290 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:33.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2df1110640 1 Processor -- start 2024-09-13T18:25:33.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2df1110640 1 -- start start 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2df1110640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2dec143da0 0x7f2dec06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2df1110640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2dec06b320 0x7f2dec0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2df1110640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec144180 con 0x7f2dec0cd1d0 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2df1110640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec06c510 con 0x7f2dec06b320 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2df1110640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec06b890 con 0x7f2dec143da0 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2deb59e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2dec0cd1d0 0x7f2dec0cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39666/0 (socket says 172.21.15.53:39666) 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2deb59e640 1 -- 172.21.15.53:0/4201763222 learned_addr learned my addr 172.21.15.53:0/4201763222 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:33.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2dea59c640 1 --2- 172.21.15.53:0/4201763222 >> v2:172.21.15.53:3300/0 conn(0x7f2dec06b320 0x7f2dec0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2dead9d640 1 --2- 172.21.15.53:0/4201763222 >> v2:172.21.15.87:3300/0 conn(0x7f2dec143da0 0x7f2dec06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2dea59c640 1 -- 172.21.15.53:0/4201763222 >> v2:172.21.15.87:3300/0 conn(0x7f2dec143da0 msgr2=0x7f2dec06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2dea59c640 1 --2- 172.21.15.53:0/4201763222 >> v2:172.21.15.87:3300/0 conn(0x7f2dec143da0 0x7f2dec06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2dea59c640 1 -- 172.21.15.53:0/4201763222 >> v1:172.21.15.53:6789/0 conn(0x7f2dec0cd1d0 legacy=0x7f2dec0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2de9d9b640 1 -- 172.21.15.53:0/4201763222 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265214324 0 0) 0x7f2dec144180 con 0x7f2dec0cd1d0 2024-09-13T18:25:33.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.453+0000 7f2dea59c640 1 -- 172.21.15.53:0/4201763222 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec06bb70 con 0x7f2dec06b320 2024-09-13T18:25:33.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2dea59c640 1 --2- 172.21.15.53:0/4201763222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec0b2a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2dec071650 tx=0x7f2de001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16178e6170ab64ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2de9d9b640 1 -- 172.21.15.53:0/4201763222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00ab600 con 0x7f2dec06b320 2024-09-13T18:25:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2de9d9b640 1 -- 172.21.15.53:0/4201763222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de00a7050 con 0x7f2dec06b320 2024-09-13T18:25:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2de9d9b640 1 -- 172.21.15.53:0/4201763222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00ab980 con 0x7f2dec06b320 2024-09-13T18:25:33.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 -- 172.21.15.53:0/4201763222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 msgr2=0x7f2dec0b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 --2- 172.21.15.53:0/4201763222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec0b2a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2dec071650 tx=0x7f2de001c3f0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 -- 172.21.15.53:0/4201763222 shutdown_connections 2024-09-13T18:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 --2- 172.21.15.53:0/4201763222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec0b2a80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 --2- 172.21.15.53:0/4201763222 >> v2:172.21.15.87:3300/0 conn(0x7f2dec143da0 0x7f2dec06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 -- 172.21.15.53:0/4201763222 >> 172.21.15.53:0/4201763222 conn(0x7f2dec073130 msgr2=0x7f2dec065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 -- 172.21.15.53:0/4201763222 shutdown_connections 2024-09-13T18:25:33.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 -- 172.21.15.53:0/4201763222 wait complete. 2024-09-13T18:25:33.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 Processor -- start 2024-09-13T18:25:33.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 -- start start 2024-09-13T18:25:33.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dec0cd1d0 0x7f2dec140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dec143da0 0x7f2dec0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.457+0000 7f2df1110640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec1410b0 con 0x7f2dec06b320 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2df1110640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0ac290 con 0x7f2dec0cd1d0 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2df1110640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0ac570 con 0x7f2dec143da0 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44104/0 (socket says 172.21.15.53:44104) 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 -- 172.21.15.53:0/3106750367 learned_addr learned my addr 172.21.15.53:0/3106750367 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 -- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dec143da0 msgr2=0x7f2dec0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dec143da0 0x7f2dec0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 -- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dec0cd1d0 msgr2=0x7f2dec140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dec0cd1d0 0x7f2dec140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 -- 172.21.15.53:0/3106750367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009420 con 0x7f2dec06b320 2024-09-13T18:25:33.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dead9d640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec159620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d5f0 tx=0x7f2ddc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dd37fe640 1 -- 172.21.15.53:0/3106750367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0125f0 con 0x7f2dec06b320 2024-09-13T18:25:33.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dd37fe640 1 -- 172.21.15.53:0/3106750367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc012750 con 0x7f2dec06b320 2024-09-13T18:25:33.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec0ac850 con 0x7f2dec06b320 2024-09-13T18:25:33.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dd37fe640 1 -- 172.21.15.53:0/3106750367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc012ae0 con 0x7f2dec06b320 2024-09-13T18:25:33.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec0ace10 con 0x7f2dec06b320 2024-09-13T18:25:33.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec0b2a80 con 0x7f2dec06b320 2024-09-13T18:25:33.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dd37fe640 1 -- 172.21.15.53:0/3106750367 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ddc012c40 con 0x7f2dec06b320 2024-09-13T18:25:33.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dd37fe640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dd8066690 0x7f2dd8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dd37fe640 1 -- 172.21.15.53:0/3106750367 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ddc0846d0 con 0x7f2dec06b320 2024-09-13T18:25:33.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dea59c640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dd8066690 0x7f2dd8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.461+0000 7f2dea59c640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dd8066690 0x7f2dd8068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ad000 tx=0x7f2de0004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.465+0000 7f2dd37fe640 1 -- 172.21.15.53:0/3106750367 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ddc051a30 con 0x7f2dec06b320 2024-09-13T18:25:33.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.625+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2dec0a9af0 con 0x7f2dec06b320 2024-09-13T18:25:33.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2dd37fe640 1 -- 172.21.15.53:0/3106750367 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f2ddc055050 con 0x7f2dec06b320 2024-09-13T18:25:33.631 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:33.632 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:33.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dd8066690 msgr2=0x7f2dd8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dd8066690 0x7f2dd8068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ad000 tx=0x7f2de0004740 comp rx=0 tx=0).stop 2024-09-13T18:25:33.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 msgr2=0x7f2dec159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec159620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d5f0 tx=0x7f2ddc00dab0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 shutdown_connections 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dd8066690 0x7f2dd8068b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dec143da0 0x7f2dec0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dec0cd1d0 0x7f2dec140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 --2- 172.21.15.53:0/3106750367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dec06b320 0x7f2dec159620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 >> 172.21.15.53:0/3106750367 conn(0x7f2dec073130 msgr2=0x7f2dec0ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 shutdown_connections 2024-09-13T18:25:33.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.629+0000 7f2df1110640 1 -- 172.21.15.53:0/3106750367 wait complete. 2024-09-13T18:25:33.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:33.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:33.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.769+0000 7fbcbe317640 1 Processor -- start 2024-09-13T18:25:33.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.769+0000 7fbcbe317640 1 -- start start 2024-09-13T18:25:33.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbe317640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 0x7fbcb80cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbe317640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbcb806ff40 0x7fbcb8070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbe317640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb80b3830 con 0x7fbcb80b1dd0 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbe317640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb806c530 con 0x7fbcb806ff40 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbe317640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8070890 con 0x7fbcb8158ba0 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcaf7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbcb80b1dd0 0x7fbcb80b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39672/0 (socket says 172.21.15.53:39672) 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcaf7fe640 1 -- 172.21.15.53:0/2190251636 learned_addr learned my addr 172.21.15.53:0/2190251636 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb7fff640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 0x7fbcb80cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/2190251636 >> v2:172.21.15.87:3300/0 conn(0x7fbcb806ff40 0x7fbcb8070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107289120 0 0) 0x7fbca0001120 con 0x7fbcb80b1dd0 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca4003530 con 0x7fbcb80b1dd0 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2292593176 0 0) 0x7fbca4003530 con 0x7fbcb80b1dd0 2024-09-13T18:25:33.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 msgr2=0x7fbcb80cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 0x7fbcb80cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 >> v2:172.21.15.87:3300/0 conn(0x7fbcb806ff40 msgr2=0x7fbcb8070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 --2- 172.21.15.53:0/2190251636 >> v2:172.21.15.87:3300/0 conn(0x7fbcb806ff40 0x7fbcb8070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8158f80 con 0x7fbcb80b1dd0 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fbca0001810 con 0x7fbcb80b1dd0 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 >> v1:172.21.15.53:6789/0 conn(0x7fbcb80b1dd0 legacy=0x7fbcb80b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbca4003980 0x7fbca4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 0x7fbca40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4004d10 0x7fbca4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb806c530 con 0x7fbca4004d10 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8070890 con 0x7fbca4003980 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca400ba10 con 0x7fbcb8158ba0 2024-09-13T18:25:33.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4004d10 0x7fbca4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb7fff640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbca4003980 0x7fbca4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcaf7fe640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 0x7fbca40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 msgr2=0x7fbca40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbcb8158ba0 0x7fbca40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbca4003980 msgr2=0x7fbca4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbca4003980 0x7fbca4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/2190251636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4003530 con 0x7fbca4004d10 2024-09-13T18:25:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.773+0000 7fbcb7fff640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbca4003980 0x7fbca4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:33.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4004d10 0x7fbca4005190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009fc0 tx=0x7fbcb001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41e549f9615e125 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00a5ca0 con 0x7fbca4004d10 2024-09-13T18:25:33.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb000f040 con 0x7fbca4004d10 2024-09-13T18:25:33.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcb77fe640 1 -- 172.21.15.53:0/2190251636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00ad440 con 0x7fbca4004d10 2024-09-13T18:25:33.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- 172.21.15.53:0/2190251636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4004d10 msgr2=0x7fbca4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 --2- 172.21.15.53:0/2190251636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbca4004d10 0x7fbca4005190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009fc0 tx=0x7fbcb001cc90 comp rx=0 tx=0).stop 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/2190251636 reap_dead start 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- 172.21.15.53:0/2190251636 shutdown_connections 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- 172.21.15.53:0/2190251636 >> 172.21.15.53:0/2190251636 conn(0x7fbcb8065c80 msgr2=0x7fbcb8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- 172.21.15.53:0/2190251636 shutdown_connections 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- 172.21.15.53:0/2190251636 wait complete. 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 Processor -- start 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- start start 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbca4004d10 0x7fbcb81f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcb8154c70 0x7fbcb8153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcb81540c0 0x7fbcb8154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8157710 con 0x7fbcb81540c0 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb81579f0 con 0x7fbcb8154c70 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbe317640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8157cd0 con 0x7fbca4004d10 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbc8b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcb81540c0 0x7fbcb8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbc8b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcb81540c0 0x7fbcb8154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44118/0 (socket says 172.21.15.53:44118) 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/1710084387 learned_addr learned my addr 172.21.15.53:0/1710084387 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcaf7fe640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcb8154c70 0x7fbcb8153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.777+0000 7fbcb7fff640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbca4004d10 0x7fbcb81f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbca4004d10 msgr2=0x7fbcb81f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbca4004d10 0x7fbcb81f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcb8154c70 msgr2=0x7fbcb8153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcb8154c70 0x7fbcb8153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbc8b4640 1 -- 172.21.15.53:0/1710084387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8157fb0 con 0x7fbcb81540c0 2024-09-13T18:25:33.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbc8b4640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcb81540c0 0x7fbcb8154540 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0002240 tx=0x7fbcb0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb57fa640 1 -- 172.21.15.53:0/1710084387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00039a0 con 0x7fbcb81540c0 2024-09-13T18:25:33.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb57fa640 1 -- 172.21.15.53:0/1710084387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb0003b00 con 0x7fbcb81540c0 2024-09-13T18:25:33.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb8158290 con 0x7fbcb81540c0 2024-09-13T18:25:33.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb57fa640 1 -- 172.21.15.53:0/1710084387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0003e70 con 0x7fbcb81540c0 2024-09-13T18:25:33.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb81f4e40 con 0x7fbcb81540c0 2024-09-13T18:25:33.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb80cd400 con 0x7fbcb81540c0 2024-09-13T18:25:33.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb57fa640 1 -- 172.21.15.53:0/1710084387 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbcb00b4040 con 0x7fbcb81540c0 2024-09-13T18:25:33.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb57fa640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbc980666c0 0x7fbc98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:33.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb57fa640 1 -- 172.21.15.53:0/1710084387 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcb011dc60 con 0x7fbcb81540c0 2024-09-13T18:25:33.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb7fff640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbc980666c0 0x7fbc98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:33.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.781+0000 7fbcb7fff640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbc980666c0 0x7fbc98068b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbca80099b0 tx=0x7fbca8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:33.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.785+0000 7fbcb57fa640 1 -- 172.21.15.53:0/1710084387 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbcb00eaff0 con 0x7fbcb81540c0 2024-09-13T18:25:33.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.937+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbcb81f5030 con 0x7fbcb81540c0 2024-09-13T18:25:33.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.937+0000 7fbcb57fa640 1 -- 172.21.15.53:0/1710084387 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbcb00b2020 con 0x7fbcb81540c0 2024-09-13T18:25:33.942 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbc980666c0 msgr2=0x7fbc98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbc980666c0 0x7fbc98068b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbca80099b0 tx=0x7fbca8008040 comp rx=0 tx=0).stop 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcb81540c0 msgr2=0x7fbcb8154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcb81540c0 0x7fbcb8154540 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0002240 tx=0x7fbcb0009750 comp rx=0 tx=0).stop 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 shutdown_connections 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbc980666c0 0x7fbc98068b80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcb81540c0 0x7fbcb8154540 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbcb8154c70 0x7fbcb8153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 --2- 172.21.15.53:0/1710084387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbca4004d10 0x7fbcb81f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 >> 172.21.15.53:0/1710084387 conn(0x7fbcb8065c80 msgr2=0x7fbcb815a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 shutdown_connections 2024-09-13T18:25:33.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:33.941+0000 7fbcbe317640 1 -- 172.21.15.53:0/1710084387 wait complete. 2024-09-13T18:25:33.960 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:34.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6f5140640 1 Processor -- start 2024-09-13T18:25:34.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6f5140640 1 -- start start 2024-09-13T18:25:34.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6f5140640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6f00d2b50 0x7ff6f00ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6f5140640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff6f00b49a0 0x7ff6f00d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6f5140640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f0165480 con 0x7ff6f00cf160 2024-09-13T18:25:34.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6f5140640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f0161f00 con 0x7ff6f00d2b50 2024-09-13T18:25:34.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6f5140640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f00d3470 con 0x7ff6f00b49a0 2024-09-13T18:25:34.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6eed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6f00d2b50 0x7ff6f00ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6ef59e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff6f00cf160 0x7ff6f00cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39680/0 (socket says 172.21.15.53:39680) 2024-09-13T18:25:34.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6ef59e640 1 -- 172.21.15.53:0/886544832 learned_addr learned my addr 172.21.15.53:0/886544832 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:34.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6ee59c640 1 --2- 172.21.15.53:0/886544832 >> v2:172.21.15.87:3300/0 conn(0x7ff6f00b49a0 0x7ff6f00d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6eed9d640 1 -- 172.21.15.53:0/886544832 >> v2:172.21.15.87:3300/0 conn(0x7ff6f00b49a0 msgr2=0x7ff6f00d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:34.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6eed9d640 1 --2- 172.21.15.53:0/886544832 >> v2:172.21.15.87:3300/0 conn(0x7ff6f00b49a0 0x7ff6f00d2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6eed9d640 1 -- 172.21.15.53:0/886544832 >> v1:172.21.15.53:6789/0 conn(0x7ff6f00cf160 legacy=0x7ff6f00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6eed9d640 1 -- 172.21.15.53:0/886544832 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f00d0290 con 0x7ff6f00d2b50 2024-09-13T18:25:34.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.077+0000 7ff6ee59c640 1 --2- 172.21.15.53:0/886544832 >> v2:172.21.15.87:3300/0 conn(0x7ff6f00b49a0 0x7ff6f00d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:34.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6eed9d640 1 --2- 172.21.15.53:0/886544832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f00ceaa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff6f006bd20 tx=0x7ff6e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2318f71bebd3ede server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6edd9b640 1 -- 172.21.15.53:0/886544832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e00ad660 con 0x7ff6f00d2b50 2024-09-13T18:25:34.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6edd9b640 1 -- 172.21.15.53:0/886544832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e00ad7c0 con 0x7ff6f00d2b50 2024-09-13T18:25:34.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6edd9b640 1 -- 172.21.15.53:0/886544832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e00adb50 con 0x7ff6f00d2b50 2024-09-13T18:25:34.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- 172.21.15.53:0/886544832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 msgr2=0x7ff6f00ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 --2- 172.21.15.53:0/886544832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f00ceaa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff6f006bd20 tx=0x7ff6e001c450 comp rx=0 tx=0).stop 2024-09-13T18:25:34.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- 172.21.15.53:0/886544832 shutdown_connections 2024-09-13T18:25:34.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 --2- 172.21.15.53:0/886544832 >> v2:172.21.15.87:3300/0 conn(0x7ff6f00b49a0 0x7ff6f00d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 --2- 172.21.15.53:0/886544832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f00ceaa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- 172.21.15.53:0/886544832 >> 172.21.15.53:0/886544832 conn(0x7ff6f0070970 msgr2=0x7ff6f0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:34.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- 172.21.15.53:0/886544832 shutdown_connections 2024-09-13T18:25:34.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- 172.21.15.53:0/886544832 wait complete. 2024-09-13T18:25:34.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 Processor -- start 2024-09-13T18:25:34.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- start start 2024-09-13T18:25:34.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6f00b49a0 0x7ff6f0162aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6f00cf160 0x7ff6f0163970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00b62a0 con 0x7ff6f00d2b50 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00b5620 con 0x7ff6f00b49a0 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6f5140640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00b5900 con 0x7ff6f00cf160 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6ef59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6ef59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f015a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44138/0 (socket says 172.21.15.53:44138) 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.081+0000 7ff6ef59e640 1 -- 172.21.15.53:0/3485910792 learned_addr learned my addr 172.21.15.53:0/3485910792 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6eed9d640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6f00b49a0 0x7ff6f0162aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ee59c640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6f00cf160 0x7ff6f0163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ef59e640 1 -- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6f00cf160 msgr2=0x7ff6f0163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ef59e640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6f00cf160 0x7ff6f0163970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ef59e640 1 -- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6f00b49a0 msgr2=0x7ff6f0162aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ef59e640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6f00b49a0 0x7ff6f0162aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ef59e640 1 -- 172.21.15.53:0/3485910792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009420 con 0x7ff6f00d2b50 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ee59c640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6f00cf160 0x7ff6f0163970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6ef59e640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f015a0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800ca80 tx=0x7ff6e800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6e77fe640 1 -- 172.21.15.53:0/3485910792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e800ac30 con 0x7ff6f00d2b50 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6e77fe640 1 -- 172.21.15.53:0/3485910792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e800ad90 con 0x7ff6f00d2b50 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f00d2120 con 0x7ff6f00d2b50 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6e77fe640 1 -- 172.21.15.53:0/3485910792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8012600 con 0x7ff6f00d2b50 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f00b5c90 con 0x7ff6f00d2b50 2024-09-13T18:25:34.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f00b63e0 con 0x7ff6f00d2b50 2024-09-13T18:25:34.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6e77fe640 1 -- 172.21.15.53:0/3485910792 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6e8007070 con 0x7ff6f00d2b50 2024-09-13T18:25:34.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6e77fe640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff6d0066690 0x7ff6d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6e77fe640 1 -- 172.21.15.53:0/3485910792 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6e8083ff0 con 0x7ff6f00d2b50 2024-09-13T18:25:34.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6eed9d640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff6d0066690 0x7ff6d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.085+0000 7ff6eed9d640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff6d0066690 0x7ff6d0068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00af000 tx=0x7ff6e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.089+0000 7ff6e77fe640 1 -- 172.21.15.53:0/3485910792 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff6f00b63e0 con 0x7ff6f00d2b50 2024-09-13T18:25:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.249+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6f00b63e0 con 0x7ff6f00d2b50 2024-09-13T18:25:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.249+0000 7ff6e77fe640 1 -- 172.21.15.53:0/3485910792 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6f00b63e0 con 0x7ff6f00d2b50 2024-09-13T18:25:34.254 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff6d0066690 msgr2=0x7ff6d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff6d0066690 0x7ff6d0068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00af000 tx=0x7ff6e0008040 comp rx=0 tx=0).stop 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 msgr2=0x7ff6f015a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f015a0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800ca80 tx=0x7ff6e800cf40 comp rx=0 tx=0).stop 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 shutdown_connections 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff6d0066690 0x7ff6d0068b50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff6f00cf160 0x7ff6f0163970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6f00d2b50 0x7ff6f015a0c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 --2- 172.21.15.53:0/3485910792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff6f00b49a0 0x7ff6f0162aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 >> 172.21.15.53:0/3485910792 conn(0x7ff6f0070970 msgr2=0x7ff6f0160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 shutdown_connections 2024-09-13T18:25:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.253+0000 7ff6f5140640 1 -- 172.21.15.53:0/3485910792 wait complete. 2024-09-13T18:25:34.275 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:34.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1458e00640 1 Processor -- start 2024-09-13T18:25:34.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1458e00640 1 -- start start 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1458e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 0x7f145406bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1458e00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145406c840 con 0x7f145415e0c0 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1458e00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145406cb20 con 0x7f14540b21f0 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1458e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145406ce00 con 0x7f145406bad0 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f145415e0c0 0x7f145415e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39688/0 (socket says 172.21.15.53:39688) 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 -- 172.21.15.53:0/2896367021 learned_addr learned my addr 172.21.15.53:0/2896367021 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1451d9b640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 0x7f145406bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705043957 0 0) 0x7f145406c840 con 0x7f145415e0c0 2024-09-13T18:25:34.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f143c003530 con 0x7f145415e0c0 2024-09-13T18:25:34.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384358205 0 0) 0x7f143c003530 con 0x7f145415e0c0 2024-09-13T18:25:34.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 msgr2=0x7f145406bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:34.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 0x7f145406bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 >> v1:172.21.15.87:6789/0 conn(0x7f14540b21f0 legacy=0x7f14540b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145406d0e0 con 0x7f145415e0c0 2024-09-13T18:25:34.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f144c001a00 con 0x7f145415e0c0 2024-09-13T18:25:34.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 >> v1:172.21.15.53:6789/0 conn(0x7f145415e0c0 legacy=0x7f145415e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143c0039b0 0x7f143c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 0x7f143c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f143c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145406ce00 con 0x7f143c004d10 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c00ba40 con 0x7f143c0039b0 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c00bc00 con 0x7f145406bad0 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f143c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145259c640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143c0039b0 0x7f143c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1451d9b640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 0x7f143c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 -- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 msgr2=0x7f143c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:34.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f145406bad0 0x7f143c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 -- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143c0039b0 msgr2=0x7f143c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:34.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143c0039b0 0x7f143c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f1452d9d640 1 -- 172.21.15.53:0/2896367021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c003530 con 0x7f143c004d10 2024-09-13T18:25:34.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.393+0000 7f145259c640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f143c0039b0 0x7f143c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1452d9d640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f143c005190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f144c00a800 tx=0x7f144c01d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cdbb42004b3d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0072d0 con 0x7f143c004d10 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c0a8070 con 0x7f143c004d10 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f145159a640 1 -- 172.21.15.53:0/2896367021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0076b0 con 0x7f143c004d10 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 -- 172.21.15.53:0/2896367021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 msgr2=0x7f143c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 --2- 172.21.15.53:0/2896367021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f143c005190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f144c00a800 tx=0x7f144c01d320 comp rx=0 tx=0).stop 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1452d9d640 1 -- 172.21.15.53:0/2896367021 reap_dead start 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 -- 172.21.15.53:0/2896367021 shutdown_connections 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 -- 172.21.15.53:0/2896367021 >> 172.21.15.53:0/2896367021 conn(0x7f1454069f50 msgr2=0x7f145406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 -- 172.21.15.53:0/2896367021 shutdown_connections 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 -- 172.21.15.53:0/2896367021 wait complete. 2024-09-13T18:25:34.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 Processor -- start 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.397+0000 7f1458e00640 1 -- start start 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f145409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1454150880 0x7f145409a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14541f2230 0x7f1454155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454153b50 con 0x7f143c004d10 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454153da0 con 0x7f1454150880 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1454154080 con 0x7f14541f2230 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f145409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f145409bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44164/0 (socket says 172.21.15.53:44164) 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 -- 172.21.15.53:0/3787503469 learned_addr learned my addr 172.21.15.53:0/3787503469 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1452d9d640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14541f2230 0x7f1454155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1451d9b640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1454150880 0x7f145409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 -- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14541f2230 msgr2=0x7f1454155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14541f2230 0x7f1454155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 -- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1454150880 msgr2=0x7f145409a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1454150880 0x7f145409a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 -- 172.21.15.53:0/3787503469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454154360 con 0x7f143c004d10 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f145259c640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f145409bee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f144400e550 tx=0x7f144400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1442ffd640 1 -- 172.21.15.53:0/3787503469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440052e0 con 0x7f143c004d10 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1442ffd640 1 -- 172.21.15.53:0/3787503469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444005440 con 0x7f143c004d10 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1454154640 con 0x7f143c004d10 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1442ffd640 1 -- 172.21.15.53:0/3787503469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444003840 con 0x7f143c004d10 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1454150d00 con 0x7f143c004d10 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145406c650 con 0x7f143c004d10 2024-09-13T18:25:34.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1442ffd640 1 -- 172.21.15.53:0/3787503469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14440039a0 con 0x7f143c004d10 2024-09-13T18:25:34.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1442ffd640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f14340666c0 0x7f1434068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1442ffd640 1 -- 172.21.15.53:0/3787503469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1444083ff0 con 0x7f143c004d10 2024-09-13T18:25:34.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.401+0000 7f1451d9b640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f14340666c0 0x7f1434068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.405+0000 7f1451d9b640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f14340666c0 0x7f1434068b80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1454156f50 tx=0x7f1448008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.405+0000 7f1442ffd640 1 -- 172.21.15.53:0/3787503469 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1444051350 con 0x7f143c004d10 2024-09-13T18:25:34.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.565+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14541547d0 con 0x7f143c004d10 2024-09-13T18:25:34.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.565+0000 7f1442ffd640 1 -- 172.21.15.53:0/3787503469 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1444054970 con 0x7f143c004d10 2024-09-13T18:25:34.569 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f14340666c0 msgr2=0x7f1434068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f14340666c0 0x7f1434068b80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1454156f50 tx=0x7f1448008040 comp rx=0 tx=0).stop 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 msgr2=0x7f145409bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f145409bee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f144400e550 tx=0x7f144400ea10 comp rx=0 tx=0).stop 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 shutdown_connections 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f14340666c0 0x7f1434068b80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14541f2230 0x7f1454155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1454150880 0x7f145409a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 --2- 172.21.15.53:0/3787503469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f143c004d10 0x7f145409bee0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 >> 172.21.15.53:0/3787503469 conn(0x7f1454069f50 msgr2=0x7f1454151950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:34.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 shutdown_connections 2024-09-13T18:25:34.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.569+0000 7f1458e00640 1 -- 172.21.15.53:0/3787503469 wait complete. 2024-09-13T18:25:34.586 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:34.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d320a9640 1 Processor -- start 2024-09-13T18:25:34.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d320a9640 1 -- start start 2024-09-13T18:25:34.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d320a9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4d2c15b7c0 0x7f4d2c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d320a9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c06d480 con 0x7f4d2c0711d0 2024-09-13T18:25:34.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d320a9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c15ace0 con 0x7f4d2c1582a0 2024-09-13T18:25:34.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d320a9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c071680 con 0x7f4d2c15b7c0 2024-09-13T18:25:34.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4d2c0711d0 0x7f4d2c1640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39698/0 (socket says 172.21.15.53:39698) 2024-09-13T18:25:34.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 -- 172.21.15.53:0/2965986008 learned_addr learned my addr 172.21.15.53:0/2965986008 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:34.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d23fff640 1 --2- 172.21.15.53:0/2965986008 >> v2:172.21.15.87:3300/0 conn(0x7f4d2c15b7c0 0x7f4d2c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069042702 0 0) 0x7f4d2c06d480 con 0x7f4d2c0711d0 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d18003530 con 0x7f4d2c0711d0 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744474239 0 0) 0x7f4d18003530 con 0x7f4d2c0711d0 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 >> v2:172.21.15.87:3300/0 conn(0x7f4d2c15b7c0 msgr2=0x7f4d2c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 --2- 172.21.15.53:0/2965986008 >> v2:172.21.15.87:3300/0 conn(0x7f4d2c15b7c0 0x7f4d2c070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 >> v1:172.21.15.87:6789/0 conn(0x7f4d2c1582a0 legacy=0x7f4d2c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c15afc0 con 0x7f4d2c0711d0 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f4d24001a00 con 0x7f4d2c0711d0 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 >> v1:172.21.15.53:6789/0 conn(0x7f4d2c0711d0 legacy=0x7f4d2c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18003980 0x7f4d18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d180047d0 0x7f4d18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d18005190 0x7f4d1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c071680 con 0x7f4d18005190 2024-09-13T18:25:34.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1800c030 con 0x7f4d180047d0 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1800c1f0 con 0x7f4d18003980 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d18005190 0x7f4d1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2b7fe640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18003980 0x7f4d18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 -- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18003980 msgr2=0x7f4d18003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18003980 0x7f4d18003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 -- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d180047d0 msgr2=0x7f4d18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d180047d0 0x7f4d18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2bfff640 1 -- 172.21.15.53:0/2965986008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18003530 con 0x7f4d18005190 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.705+0000 7f4d2b7fe640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18003980 0x7f4d18003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d2bfff640 1 -- 172.21.15.53:0/2965986008 reap_dead start 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d2bfff640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d18005190 0x7f4d1800b990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400a830 tx=0x7f4d2401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8c9c9a68cb1465 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240072d0 con 0x7f4d18005190 2024-09-13T18:25:34.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d240a8070 con 0x7f4d18005190 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d2affd640 1 -- 172.21.15.53:0/2965986008 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24007690 con 0x7f4d18005190 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 -- 172.21.15.53:0/2965986008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d18005190 msgr2=0x7f4d1800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d18005190 0x7f4d1800b990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400a830 tx=0x7f4d2401d360 comp rx=0 tx=0).stop 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 -- 172.21.15.53:0/2965986008 shutdown_connections 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 --2- 172.21.15.53:0/2965986008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d18005190 0x7f4d1800b990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 -- 172.21.15.53:0/2965986008 >> 172.21.15.53:0/2965986008 conn(0x7f4d2c065c80 msgr2=0x7f4d2c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 -- 172.21.15.53:0/2965986008 shutdown_connections 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 -- 172.21.15.53:0/2965986008 wait complete. 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 Processor -- start 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.709+0000 7f4d320a9640 1 -- start start 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18005190 0x7f4d2c145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d2c0a9710 0x7f4d2c0aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d2c0aa840 0x7f4d2c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c146200 con 0x7f4d2c0aa840 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0a8670 con 0x7f4d2c0a9710 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0a8950 con 0x7f4d18005190 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d2c0aa840 0x7f4d2c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d2c0aa840 0x7f4d2c0ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44194/0 (socket says 172.21.15.53:44194) 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 -- 172.21.15.53:0/334916880 learned_addr learned my addr 172.21.15.53:0/334916880 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2b7fe640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18005190 0x7f4d2c145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d23fff640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d2c0a9710 0x7f4d2c0aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 -- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18005190 msgr2=0x7f4d2c145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18005190 0x7f4d2c145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 -- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d2c0a9710 msgr2=0x7f4d2c0aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d2c0a9710 0x7f4d2c0aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 -- 172.21.15.53:0/334916880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0a8c30 con 0x7f4d2c0aa840 2024-09-13T18:25:34.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d23fff640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d2c0a9710 0x7f4d2c0aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:34.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2bfff640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d2c0aa840 0x7f4d2c0ccef0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4d24007040 tx=0x7f4d18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d28ff9640 1 -- 172.21.15.53:0/334916880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24001bd0 con 0x7f4d2c0aa840 2024-09-13T18:25:34.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d28ff9640 1 -- 172.21.15.53:0/334916880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d240070d0 con 0x7f4d2c0aa840 2024-09-13T18:25:34.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c0a8f10 con 0x7f4d2c0aa840 2024-09-13T18:25:34.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d28ff9640 1 -- 172.21.15.53:0/334916880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24007480 con 0x7f4d2c0aa840 2024-09-13T18:25:34.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0a9f80 con 0x7f4d2c0aa840 2024-09-13T18:25:34.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c067400 con 0x7f4d2c0aa840 2024-09-13T18:25:34.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d28ff9640 1 -- 172.21.15.53:0/334916880 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d240aa070 con 0x7f4d2c0aa840 2024-09-13T18:25:34.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d28ff9640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d0c0666c0 0x7f4d0c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:34.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d28ff9640 1 -- 172.21.15.53:0/334916880 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d2411d780 con 0x7f4d2c0aa840 2024-09-13T18:25:34.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.713+0000 7f4d2b7fe640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d0c0666c0 0x7f4d0c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:34.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.717+0000 7f4d2b7fe640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d0c0666c0 0x7f4d0c068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c000f70 tx=0x7f4d1c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:34.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.717+0000 7f4d28ff9640 1 -- 172.21.15.53:0/334916880 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d240eaaf0 con 0x7f4d2c0aa840 2024-09-13T18:25:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.889+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4d2c0a8a90 con 0x7f4d2c0aa840 2024-09-13T18:25:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.889+0000 7f4d28ff9640 1 -- 172.21.15.53:0/334916880 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4d2c0a8a90 con 0x7f4d2c0aa840 2024-09-13T18:25:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d0c0666c0 msgr2=0x7f4d0c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d0c0666c0 0x7f4d0c068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c000f70 tx=0x7f4d1c009040 comp rx=0 tx=0).stop 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d2c0aa840 msgr2=0x7f4d2c0ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d2c0aa840 0x7f4d2c0ccef0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4d24007040 tx=0x7f4d18005800 comp rx=0 tx=0).stop 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 shutdown_connections 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d0c0666c0 0x7f4d0c068b80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d2c0aa840 0x7f4d2c0ccef0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4d2c0a9710 0x7f4d2c0aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 --2- 172.21.15.53:0/334916880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4d18005190 0x7f4d2c145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 >> 172.21.15.53:0/334916880 conn(0x7f4d2c065c80 msgr2=0x7f4d2c1570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 shutdown_connections 2024-09-13T18:25:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:34.893+0000 7f4d320a9640 1 -- 172.21.15.53:0/334916880 wait complete. 2024-09-13T18:25:34.912 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:25:34.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:34.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:25:34.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:34.943 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:25:34.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:34.943 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:25:35.000 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:25:35.000 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:35.006 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:25:35.007 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:35.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:35.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404c599640 1 Processor -- start 2024-09-13T18:25:35.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404c599640 1 -- start start 2024-09-13T18:25:35.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404c599640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40441582a0 0x7f404406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404c599640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f404415b7c0 0x7f404406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404c599640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404406d480 con 0x7f4044070c90 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404c599640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404415aaf0 con 0x7f40441582a0 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404c599640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404406d760 con 0x7f404415b7c0 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404ab36640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4044070c90 0x7f404406f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39710/0 (socket says 172.21.15.53:39710) 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404ab36640 1 -- 172.21.15.53:0/3003661710 learned_addr learned my addr 172.21.15.53:0/3003661710 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404a335640 1 --2- 172.21.15.53:0/3003661710 >> v2:172.21.15.53:3300/0 conn(0x7f40441582a0 0x7f404406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f4049333640 1 -- 172.21.15.53:0/3003661710 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320892945 0 0) 0x7f404406d480 con 0x7f4044070c90 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f4049b34640 1 --2- 172.21.15.53:0/3003661710 >> v2:172.21.15.87:3300/0 conn(0x7f404415b7c0 0x7f404406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f4049333640 1 -- 172.21.15.53:0/3003661710 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4030003530 con 0x7f4044070c90 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404a335640 1 -- 172.21.15.53:0/3003661710 >> v2:172.21.15.87:3300/0 conn(0x7f404415b7c0 msgr2=0x7f404406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404a335640 1 --2- 172.21.15.53:0/3003661710 >> v2:172.21.15.87:3300/0 conn(0x7f404415b7c0 0x7f404406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404a335640 1 -- 172.21.15.53:0/3003661710 >> v1:172.21.15.53:6789/0 conn(0x7f4044070c90 legacy=0x7f404406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f4049333640 1 -- 172.21.15.53:0/3003661710 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 843592225 0 0) 0x7f4030003530 con 0x7f4044070c90 2024-09-13T18:25:35.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f404a335640 1 -- 172.21.15.53:0/3003661710 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404415ace0 con 0x7f40441582a0 2024-09-13T18:25:35.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.181+0000 7f4049b34640 1 --2- 172.21.15.53:0/3003661710 >> v2:172.21.15.87:3300/0 conn(0x7f404415b7c0 0x7f404406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:35.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404a335640 1 --2- 172.21.15.53:0/3003661710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f404406c900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f40440ce220 tx=0x7f403c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137d2d8a307d1d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f4049333640 1 -- 172.21.15.53:0/3003661710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040001680 con 0x7f40441582a0 2024-09-13T18:25:35.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f4049333640 1 -- 172.21.15.53:0/3003661710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c0a5560 con 0x7f40441582a0 2024-09-13T18:25:35.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f4049333640 1 -- 172.21.15.53:0/3003661710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a58f0 con 0x7f40441582a0 2024-09-13T18:25:35.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 -- 172.21.15.53:0/3003661710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 msgr2=0x7f404406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 --2- 172.21.15.53:0/3003661710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f404406c900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f40440ce220 tx=0x7f403c01c820 comp rx=0 tx=0).stop 2024-09-13T18:25:35.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 -- 172.21.15.53:0/3003661710 shutdown_connections 2024-09-13T18:25:35.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 --2- 172.21.15.53:0/3003661710 >> v2:172.21.15.87:3300/0 conn(0x7f404415b7c0 0x7f404406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 --2- 172.21.15.53:0/3003661710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f404406c900 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 -- 172.21.15.53:0/3003661710 >> 172.21.15.53:0/3003661710 conn(0x7f4044065c80 msgr2=0x7f4044066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:35.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 -- 172.21.15.53:0/3003661710 shutdown_connections 2024-09-13T18:25:35.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.185+0000 7f404c599640 1 -- 172.21.15.53:0/3003661710 wait complete. 2024-09-13T18:25:35.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 Processor -- start 2024-09-13T18:25:35.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 -- start start 2024-09-13T18:25:35.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4044070c90 0x7f4044155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f4044157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404415b7c0 0x7f404413ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044156a80 con 0x7f40441582a0 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044157a90 con 0x7f404415b7c0 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404413b1c0 con 0x7f4044070c90 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f4044157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f4044157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44206/0 (socket says 172.21.15.53:44206) 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 -- 172.21.15.53:0/1799110082 learned_addr learned my addr 172.21.15.53:0/1799110082 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404ab36640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404415b7c0 0x7f404413ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404a335640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4044070c90 0x7f4044155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 -- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4044070c90 msgr2=0x7f4044155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4044070c90 0x7f4044155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 -- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404415b7c0 msgr2=0x7f404413ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404415b7c0 0x7f404413ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 -- 172.21.15.53:0/1799110082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c009a70 con 0x7f40441582a0 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404ab36640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404415b7c0 0x7f404413ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f4049b34640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f4044157550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f403400d800 tx=0x7f403400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f403affd640 1 -- 172.21.15.53:0/1799110082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340096c0 con 0x7f40441582a0 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f403affd640 1 -- 172.21.15.53:0/1799110082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4034009820 con 0x7f40441582a0 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f403affd640 1 -- 172.21.15.53:0/1799110082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034009bd0 con 0x7f40441582a0 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4044155e00 con 0x7f40441582a0 2024-09-13T18:25:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40441563c0 con 0x7f40441582a0 2024-09-13T18:25:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4044067400 con 0x7f40441582a0 2024-09-13T18:25:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f403affd640 1 -- 172.21.15.53:0/1799110082 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4034009d30 con 0x7f40441582a0 2024-09-13T18:25:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.189+0000 7f403affd640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4028066690 0x7f4028068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.193+0000 7f403affd640 1 -- 172.21.15.53:0/1799110082 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40340848f0 con 0x7f40441582a0 2024-09-13T18:25:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.193+0000 7f404a335640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4028066690 0x7f4028068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.193+0000 7f404a335640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4028066690 0x7f4028068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f403c0af000 tx=0x7f403c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.197+0000 7f403affd640 1 -- 172.21.15.53:0/1799110082 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4034051c60 con 0x7f40441582a0 2024-09-13T18:25:35.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.353+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4044156bc0 con 0x7f40441582a0 2024-09-13T18:25:35.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.353+0000 7f403affd640 1 -- 172.21.15.53:0/1799110082 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4034055280 con 0x7f40441582a0 2024-09-13T18:25:35.358 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:35.358 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:35.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4028066690 msgr2=0x7f4028068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4028066690 0x7f4028068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f403c0af000 tx=0x7f403c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:25:35.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 msgr2=0x7f4044157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f4044157550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f403400d800 tx=0x7f403400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 shutdown_connections 2024-09-13T18:25:35.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4028066690 0x7f4028068b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404415b7c0 0x7f404413ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40441582a0 0x7f4044157550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 --2- 172.21.15.53:0/1799110082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4044070c90 0x7f4044155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 >> 172.21.15.53:0/1799110082 conn(0x7f4044065c80 msgr2=0x7f40440af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:35.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 shutdown_connections 2024-09-13T18:25:35.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.357+0000 7f404c599640 1 -- 172.21.15.53:0/1799110082 wait complete. 2024-09-13T18:25:35.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:35.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:35.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.489+0000 7f1e43f38640 1 Processor -- start 2024-09-13T18:25:35.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.489+0000 7f1e43f38640 1 -- start start 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e43f38640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1e3c0caee0 0x7f1e3c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e43f38640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e3c0cd320 0x7f1e3c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e43f38640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c06f7a0 con 0x7f1e3c143e80 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e43f38640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c06baa0 con 0x7f1e3c0cd320 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e43f38640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c06fd60 con 0x7f1e3c0caee0 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e41cd4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e3c143e80 0x7f1e3c06b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39714/0 (socket says 172.21.15.53:39714) 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e41cd4640 1 -- 172.21.15.53:0/2193932471 learned_addr learned my addr 172.21.15.53:0/2193932471 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e424d5640 1 --2- 172.21.15.53:0/2193932471 >> v2:172.21.15.53:3300/0 conn(0x7f1e3c0cd320 0x7f1e3c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e414d3640 1 --2- 172.21.15.53:0/2193932471 >> v2:172.21.15.87:3300/0 conn(0x7f1e3c0caee0 0x7f1e3c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e424d5640 1 -- 172.21.15.53:0/2193932471 >> v2:172.21.15.87:3300/0 conn(0x7f1e3c0caee0 msgr2=0x7f1e3c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:35.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e424d5640 1 --2- 172.21.15.53:0/2193932471 >> v2:172.21.15.87:3300/0 conn(0x7f1e3c0caee0 0x7f1e3c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e424d5640 1 -- 172.21.15.53:0/2193932471 >> v1:172.21.15.53:6789/0 conn(0x7f1e3c143e80 legacy=0x7f1e3c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e424d5640 1 -- 172.21.15.53:0/2193932471 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0cb960 con 0x7f1e3c0cd320 2024-09-13T18:25:35.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.493+0000 7f1e424d5640 1 --2- 172.21.15.53:0/2193932471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0cd320 0x7f1e3c0cd780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009d90 tx=0x7f1e3401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449afe8a250f7edc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e40cd2640 1 -- 172.21.15.53:0/2193932471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340a5930 con 0x7f1e3c0cd320 2024-09-13T18:25:35.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e40cd2640 1 -- 172.21.15.53:0/2193932471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e340a5a90 con 0x7f1e3c0cd320 2024-09-13T18:25:35.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e40cd2640 1 -- 172.21.15.53:0/2193932471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340a5e20 con 0x7f1e3c0cd320 2024-09-13T18:25:35.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- 172.21.15.53:0/2193932471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0cd320 msgr2=0x7f1e3c0cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 --2- 172.21.15.53:0/2193932471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0cd320 0x7f1e3c0cd780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009d90 tx=0x7f1e3401c870 comp rx=0 tx=0).stop 2024-09-13T18:25:35.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- 172.21.15.53:0/2193932471 shutdown_connections 2024-09-13T18:25:35.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 --2- 172.21.15.53:0/2193932471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0cd320 0x7f1e3c0cd780 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 --2- 172.21.15.53:0/2193932471 >> v2:172.21.15.87:3300/0 conn(0x7f1e3c0caee0 0x7f1e3c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- 172.21.15.53:0/2193932471 >> 172.21.15.53:0/2193932471 conn(0x7f1e3c065c80 msgr2=0x7f1e3c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:35.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- 172.21.15.53:0/2193932471 shutdown_connections 2024-09-13T18:25:35.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- 172.21.15.53:0/2193932471 wait complete. 2024-09-13T18:25:35.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 Processor -- start 2024-09-13T18:25:35.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- start start 2024-09-13T18:25:35.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0caee0 0x7f1e3c0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c0cd320 0x7f1e3c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c143e80 0x7f1e3c154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b2c90 con 0x7f1e3c0caee0 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0af980 con 0x7f1e3c0cd320 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b35f0 con 0x7f1e3c143e80 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0caee0 0x7f1e3c0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0caee0 0x7f1e3c0b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44224/0 (socket says 172.21.15.53:44224) 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 -- 172.21.15.53:0/622814410 learned_addr learned my addr 172.21.15.53:0/622814410 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:35.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 -- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c143e80 msgr2=0x7f1e3c154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c143e80 0x7f1e3c154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 -- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c0cd320 msgr2=0x7f1e3c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c0cd320 0x7f1e3c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 -- 172.21.15.53:0/622814410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009a70 con 0x7f1e3c0caee0 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e41cd4640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0caee0 0x7f1e3c0b30b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800c430 tx=0x7f1e3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e327fc640 1 -- 172.21.15.53:0/622814410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38005cf0 con 0x7f1e3c0caee0 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e327fc640 1 -- 172.21.15.53:0/622814410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38005e50 con 0x7f1e3c0caee0 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c0ae080 con 0x7f1e3c0caee0 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e327fc640 1 -- 172.21.15.53:0/622814410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380072d0 con 0x7f1e3c0caee0 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.497+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c0b2310 con 0x7f1e3c0caee0 2024-09-13T18:25:35.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.501+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c0b2dd0 con 0x7f1e3c0caee0 2024-09-13T18:25:35.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.501+0000 7f1e327fc640 1 -- 172.21.15.53:0/622814410 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e38007430 con 0x7f1e3c0caee0 2024-09-13T18:25:35.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.501+0000 7f1e327fc640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e20066690 0x7f1e20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.501+0000 7f1e327fc640 1 -- 172.21.15.53:0/622814410 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e38083880 con 0x7f1e3c0caee0 2024-09-13T18:25:35.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.501+0000 7f1e414d3640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e20066690 0x7f1e20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.501+0000 7f1e414d3640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e20066690 0x7f1e20068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0ae880 tx=0x7f1e2c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.505+0000 7f1e327fc640 1 -- 172.21.15.53:0/622814410 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e38050d90 con 0x7f1e3c0caee0 2024-09-13T18:25:35.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e3c0b2dd0 con 0x7f1e3c0caee0 2024-09-13T18:25:35.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e327fc640 1 -- 172.21.15.53:0/622814410 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e38021020 con 0x7f1e3c0caee0 2024-09-13T18:25:35.660 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e20066690 msgr2=0x7f1e20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e20066690 0x7f1e20068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0ae880 tx=0x7f1e2c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0caee0 msgr2=0x7f1e3c0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0caee0 0x7f1e3c0b30b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800c430 tx=0x7f1e3800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 shutdown_connections 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e20066690 0x7f1e20068b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c143e80 0x7f1e3c154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c0cd320 0x7f1e3c0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 --2- 172.21.15.53:0/622814410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c0caee0 0x7f1e3c0b30b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 >> 172.21.15.53:0/622814410 conn(0x7f1e3c065c80 msgr2=0x7f1e3c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 shutdown_connections 2024-09-13T18:25:35.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.657+0000 7f1e43f38640 1 -- 172.21.15.53:0/622814410 wait complete. 2024-09-13T18:25:35.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:35.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.805+0000 7fb73863d640 1 Processor -- start 2024-09-13T18:25:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.805+0000 7fb73863d640 1 -- start start 2024-09-13T18:25:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb73863d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb730158180 0x7fb73006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb73863d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb7300714a0 0x7fb73015b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb73863d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7300cc8c0 con 0x7fb7300cc350 2024-09-13T18:25:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb73863d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73015ac10 con 0x7fb7300714a0 2024-09-13T18:25:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb73863d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300ae210 con 0x7fb730158180 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb736bda640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb7300714a0 0x7fb73015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb7363d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb730158180 0x7fb73006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb735bd8640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb7300cc350 0x7fb730070d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:51284/0 (socket says 172.21.15.53:51284) 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb736bda640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb7300714a0 0x7fb73015b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:46960/0 (socket says 172.21.15.53:46960) 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb735bd8640 1 -- 172.21.15.53:0/697855394 learned_addr learned my addr 172.21.15.53:0/697855394 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb736bda640 1 -- 172.21.15.53:0/697855394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb730158180 msgr2=0x7fb73006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb736bda640 1 --2- 172.21.15.53:0/697855394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb730158180 0x7fb73006bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb736bda640 1 -- 172.21.15.53:0/697855394 >> v1:172.21.15.87:6789/0 conn(0x7fb7300cc350 legacy=0x7fb730070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.809+0000 7fb736bda640 1 -- 172.21.15.53:0/697855394 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300ae4f0 con 0x7fb7300714a0 2024-09-13T18:25:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb736bda640 1 --2- 172.21.15.53:0/697855394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300714a0 0x7fb73015b030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb728009d90 tx=0x7fb72801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a097b72e128fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb7353d7640 1 -- 172.21.15.53:0/697855394 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280a5830 con 0x7fb7300714a0 2024-09-13T18:25:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb7353d7640 1 -- 172.21.15.53:0/697855394 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7280a5990 con 0x7fb7300714a0 2024-09-13T18:25:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb7353d7640 1 -- 172.21.15.53:0/697855394 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280a5d20 con 0x7fb7300714a0 2024-09-13T18:25:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- 172.21.15.53:0/697855394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300714a0 msgr2=0x7fb73015b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 --2- 172.21.15.53:0/697855394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300714a0 0x7fb73015b030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb728009d90 tx=0x7fb72801c970 comp rx=0 tx=0).stop 2024-09-13T18:25:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- 172.21.15.53:0/697855394 shutdown_connections 2024-09-13T18:25:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 --2- 172.21.15.53:0/697855394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300714a0 0x7fb73015b030 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 --2- 172.21.15.53:0/697855394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb730158180 0x7fb73006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- 172.21.15.53:0/697855394 >> 172.21.15.53:0/697855394 conn(0x7fb7300b0c60 msgr2=0x7fb7300b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- 172.21.15.53:0/697855394 shutdown_connections 2024-09-13T18:25:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- 172.21.15.53:0/697855394 wait complete. 2024-09-13T18:25:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 Processor -- start 2024-09-13T18:25:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- start start 2024-09-13T18:25:35.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7300714a0 0x7fb730153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300cc350 0x7fb730156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb730158180 0x7fb730150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301569b0 con 0x7fb730158180 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730156c90 con 0x7fb7300cc350 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.813+0000 7fb73863d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb730150b00 con 0x7fb7300714a0 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb730158180 0x7fb730150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb730158180 0x7fb730150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44238/0 (socket says 172.21.15.53:44238) 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 -- 172.21.15.53:0/585959468 learned_addr learned my addr 172.21.15.53:0/585959468 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb735bd8640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300cc350 0x7fb730156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb7363d9640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7300714a0 0x7fb730153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 -- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7300714a0 msgr2=0x7fb730153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7300714a0 0x7fb730153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 -- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300cc350 msgr2=0x7fb730156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300cc350 0x7fb730156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 -- 172.21.15.53:0/585959468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728009a70 con 0x7fb730158180 2024-09-13T18:25:35.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb736bda640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb730158180 0x7fb730150200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb72801b020 tx=0x7fb728019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb726ffd640 1 -- 172.21.15.53:0/585959468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280b9650 con 0x7fb730158180 2024-09-13T18:25:35.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb726ffd640 1 -- 172.21.15.53:0/585959468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7280b97b0 con 0x7fb730158180 2024-09-13T18:25:35.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb730150de0 con 0x7fb730158180 2024-09-13T18:25:35.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb726ffd640 1 -- 172.21.15.53:0/585959468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280b9b20 con 0x7fb730158180 2024-09-13T18:25:35.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7301566a0 con 0x7fb730158180 2024-09-13T18:25:35.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb730151300 con 0x7fb730158180 2024-09-13T18:25:35.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb726ffd640 1 -- 172.21.15.53:0/585959468 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7280b9c80 con 0x7fb730158180 2024-09-13T18:25:35.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb726ffd640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb714066690 0x7fb714068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:35.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb726ffd640 1 -- 172.21.15.53:0/585959468 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb72811f410 con 0x7fb730158180 2024-09-13T18:25:35.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.817+0000 7fb7363d9640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb714066690 0x7fb714068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:35.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.821+0000 7fb7363d9640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb714066690 0x7fb714068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009b60 tx=0x7fb72c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:35.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.821+0000 7fb726ffd640 1 -- 172.21.15.53:0/585959468 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb730151300 con 0x7fb730158180 2024-09-13T18:25:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb730151300 con 0x7fb730158180 2024-09-13T18:25:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb726ffd640 1 -- 172.21.15.53:0/585959468 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb730151300 con 0x7fb730158180 2024-09-13T18:25:35.980 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:35.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb714066690 msgr2=0x7fb714068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb714066690 0x7fb714068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009b60 tx=0x7fb72c009190 comp rx=0 tx=0).stop 2024-09-13T18:25:35.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb730158180 msgr2=0x7fb730150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:35.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb730158180 0x7fb730150200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb72801b020 tx=0x7fb728019710 comp rx=0 tx=0).stop 2024-09-13T18:25:35.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 shutdown_connections 2024-09-13T18:25:35.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb714066690 0x7fb714068b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb730158180 0x7fb730150200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7300cc350 0x7fb730156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 --2- 172.21.15.53:0/585959468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7300714a0 0x7fb730153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:35.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 >> 172.21.15.53:0/585959468 conn(0x7fb7300b0c60 msgr2=0x7fb73015d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:35.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 shutdown_connections 2024-09-13T18:25:35.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:35.977+0000 7fb73863d640 1 -- 172.21.15.53:0/585959468 wait complete. 2024-09-13T18:25:35.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:36.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4f5da9640 1 Processor -- start 2024-09-13T18:25:36.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4f5da9640 1 -- start start 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4f5da9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4f015a6c0 0x7fe4f00c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4f5da9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe4f00b2c90 0x7fe4f006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4f5da9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f006e380 con 0x7fe4f006df70 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4f5da9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00cf1c0 con 0x7fe4f015a6c0 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4f5da9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00cf4a0 con 0x7fe4f00b2c90 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4ef7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4f015a6c0 0x7fe4f00c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4ef7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4f015a6c0 0x7fe4f00c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44242/0 (socket says 172.21.15.53:44242) 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4ef7fe640 1 -- 172.21.15.53:0/3979098891 learned_addr learned my addr 172.21.15.53:0/3979098891 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:36.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/3979098891 >> v2:172.21.15.87:3300/0 conn(0x7fe4f00b2c90 0x7fe4f006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4ef7fe640 1 -- 172.21.15.53:0/3979098891 >> v2:172.21.15.87:3300/0 conn(0x7fe4f00b2c90 msgr2=0x7fe4f006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/3979098891 >> v2:172.21.15.87:3300/0 conn(0x7fe4f00b2c90 0x7fe4f006da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4ef7fe640 1 -- 172.21.15.53:0/3979098891 >> v1:172.21.15.87:6789/0 conn(0x7fe4f006df70 legacy=0x7fe4f00ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.121+0000 7fe4ef7fe640 1 -- 172.21.15.53:0/3979098891 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00cf780 con 0x7fe4f015a6c0 2024-09-13T18:25:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/3979098891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f00c6e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00d04f0 tx=0x7fe4e001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc2804dd5e3c206 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4ee7fc640 1 -- 172.21.15.53:0/3979098891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00ab600 con 0x7fe4f015a6c0 2024-09-13T18:25:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4ee7fc640 1 -- 172.21.15.53:0/3979098891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e00a7050 con 0x7fe4f015a6c0 2024-09-13T18:25:36.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4ee7fc640 1 -- 172.21.15.53:0/3979098891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00ab980 con 0x7fe4f015a6c0 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 -- 172.21.15.53:0/3979098891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 msgr2=0x7fe4f00c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/3979098891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f00c6e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00d04f0 tx=0x7fe4e001c3d0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 -- 172.21.15.53:0/3979098891 shutdown_connections 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/3979098891 >> v2:172.21.15.87:3300/0 conn(0x7fe4f00b2c90 0x7fe4f006da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/3979098891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f00c6e40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 -- 172.21.15.53:0/3979098891 >> 172.21.15.53:0/3979098891 conn(0x7fe4f00b2170 msgr2=0x7fe4f00b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 -- 172.21.15.53:0/3979098891 shutdown_connections 2024-09-13T18:25:36.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 -- 172.21.15.53:0/3979098891 wait complete. 2024-09-13T18:25:36.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 Processor -- start 2024-09-13T18:25:36.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.125+0000 7fe4f5da9640 1 -- start start 2024-09-13T18:25:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f006df70 0x7fe4f01586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00b2c90 0x7fe4f0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01524b0 con 0x7fe4f015a6c0 2024-09-13T18:25:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0158dd0 con 0x7fe4f00b2c90 2024-09-13T18:25:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01590b0 con 0x7fe4f006df70 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f014d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44248/0 (socket says 172.21.15.53:44248) 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 -- 172.21.15.53:0/332192984 learned_addr learned my addr 172.21.15.53:0/332192984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00b2c90 0x7fe4f0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 -- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f006df70 msgr2=0x7fe4f01586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f006df70 0x7fe4f01586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f006df70 0x7fe4f01586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 -- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00b2c90 msgr2=0x7fe4f0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00b2c90 0x7fe4f0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 -- 172.21.15.53:0/332192984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e00094d0 con 0x7fe4f015a6c0 2024-09-13T18:25:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00b2c90 0x7fe4f0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4effff640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f014d2e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c340 tx=0x7fe4e800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4e7fff640 1 -- 172.21.15.53:0/332192984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8005220 con 0x7fe4f015a6c0 2024-09-13T18:25:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4e7fff640 1 -- 172.21.15.53:0/332192984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e8005380 con 0x7fe4f015a6c0 2024-09-13T18:25:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4e7fff640 1 -- 172.21.15.53:0/332192984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8007270 con 0x7fe4f015a6c0 2024-09-13T18:25:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f0159390 con 0x7fe4f015a6c0 2024-09-13T18:25:36.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f014d820 con 0x7fe4f015a6c0 2024-09-13T18:25:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f014da40 con 0x7fe4f015a6c0 2024-09-13T18:25:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4e7fff640 1 -- 172.21.15.53:0/332192984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4e80073d0 con 0x7fe4f015a6c0 2024-09-13T18:25:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4e7fff640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4d00666c0 0x7fe4d0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4e7fff640 1 -- 172.21.15.53:0/332192984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4e8083580 con 0x7fe4f015a6c0 2024-09-13T18:25:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.129+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4d00666c0 0x7fe4d0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.133+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4d00666c0 0x7fe4d0068b80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00ad000 tx=0x7fe4e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.133+0000 7fe4e7fff640 1 -- 172.21.15.53:0/332192984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4e80508e0 con 0x7fe4f015a6c0 2024-09-13T18:25:36.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4f0159840 con 0x7fe4f015a6c0 2024-09-13T18:25:36.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4e7fff640 1 -- 172.21.15.53:0/332192984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4e8053f00 con 0x7fe4f015a6c0 2024-09-13T18:25:36.296 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:36.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4d00666c0 msgr2=0x7fe4d0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4d00666c0 0x7fe4d0068b80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00ad000 tx=0x7fe4e0008040 comp rx=0 tx=0).stop 2024-09-13T18:25:36.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 msgr2=0x7fe4f014d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f014d2e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c340 tx=0x7fe4e800c800 comp rx=0 tx=0).stop 2024-09-13T18:25:36.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 shutdown_connections 2024-09-13T18:25:36.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4d00666c0 0x7fe4d0068b80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f015a6c0 0x7fe4f014d2e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4f00b2c90 0x7fe4f0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 --2- 172.21.15.53:0/332192984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4f006df70 0x7fe4f01586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 >> 172.21.15.53:0/332192984 conn(0x7fe4f00b2170 msgr2=0x7fe4f00c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:36.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 shutdown_connections 2024-09-13T18:25:36.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.293+0000 7fe4f5da9640 1 -- 172.21.15.53:0/332192984 wait complete. 2024-09-13T18:25:36.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:36.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef9848b640 1 Processor -- start 2024-09-13T18:25:36.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef9848b640 1 -- start start 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef9848b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 0x7fef900b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef9848b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef900b1ac0 con 0x7fef900cbd60 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef9848b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef90159ac0 con 0x7fef9006b850 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef9848b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef90159da0 con 0x7fef900cb980 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef96a28640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fef900cbd60 0x7fef900b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39726/0 (socket says 172.21.15.53:39726) 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef96a28640 1 -- 172.21.15.53:0/2674936536 learned_addr learned my addr 172.21.15.53:0/2674936536 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef96227640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 0x7fef900b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997245355 0 0) 0x7fef900b1ac0 con 0x7fef900cbd60 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef7c005740 con 0x7fef900cbd60 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 891820625 0 0) 0x7fef7c005740 con 0x7fef900cbd60 2024-09-13T18:25:36.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 msgr2=0x7fef900b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 0x7fef900b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 >> v1:172.21.15.87:6789/0 conn(0x7fef9006b850 legacy=0x7fef9006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9015a080 con 0x7fef900cbd60 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fef88001a00 con 0x7fef900cbd60 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 >> v1:172.21.15.53:6789/0 conn(0x7fef900cbd60 legacy=0x7fef900b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 0x7fef7c005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef7c006100 0x7fef7c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef7c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90159da0 con 0x7fef7c006f20 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c00dcb0 con 0x7fef7c006100 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c00de70 con 0x7fef900cb980 2024-09-13T18:25:36.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.441+0000 7fef96a28640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef7c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96227640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 0x7fef7c005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef95a26640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef7c006100 0x7fef7c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96a28640 1 -- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 msgr2=0x7fef7c005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96a28640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef900cb980 0x7fef7c005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96a28640 1 -- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef7c006100 msgr2=0x7fef7c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96a28640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef7c006100 0x7fef7c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96a28640 1 -- 172.21.15.53:0/2674936536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c005740 con 0x7fef7c006f20 2024-09-13T18:25:36.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96a28640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef7c0073a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fef8800a830 tx=0x7fef8801d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77cc1f5415328cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef880ad630 con 0x7fef7c006f20 2024-09-13T18:25:36.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef880a8070 con 0x7fef7c006f20 2024-09-13T18:25:36.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef95225640 1 -- 172.21.15.53:0/2674936536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef880ada30 con 0x7fef7c006f20 2024-09-13T18:25:36.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef9848b640 1 -- 172.21.15.53:0/2674936536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 msgr2=0x7fef7c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef9848b640 1 --2- 172.21.15.53:0/2674936536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef7c0073a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fef8800a830 tx=0x7fef8801d330 comp rx=0 tx=0).stop 2024-09-13T18:25:36.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef96a28640 1 -- 172.21.15.53:0/2674936536 reap_dead start 2024-09-13T18:25:36.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef9848b640 1 -- 172.21.15.53:0/2674936536 shutdown_connections 2024-09-13T18:25:36.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef9848b640 1 -- 172.21.15.53:0/2674936536 >> 172.21.15.53:0/2674936536 conn(0x7fef90065c80 msgr2=0x7fef90066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:36.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef9848b640 1 -- 172.21.15.53:0/2674936536 shutdown_connections 2024-09-13T18:25:36.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.445+0000 7fef9848b640 1 -- 172.21.15.53:0/2674936536 wait complete. 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 Processor -- start 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 -- start start 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef90152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef90152810 0x7fef9014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef90153180 0x7fef900a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90152680 con 0x7fef7c006f20 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90151450 con 0x7fef90153180 2024-09-13T18:25:36.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9014d3e0 con 0x7fef90152810 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef90152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef90152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44270/0 (socket says 172.21.15.53:44270) 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 -- 172.21.15.53:0/1244451479 learned_addr learned my addr 172.21.15.53:0/1244451479 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96a28640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef90153180 0x7fef900a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef95a26640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef90152810 0x7fef9014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 -- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef90152810 msgr2=0x7fef9014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef90152810 0x7fef9014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 -- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef90153180 msgr2=0x7fef900a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef90153180 0x7fef900a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 -- 172.21.15.53:0/1244451479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90152d40 con 0x7fef7c006f20 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef95a26640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef90152810 0x7fef9014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96a28640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef90153180 0x7fef900a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:36.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef96227640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef90152140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0115e0 tx=0x7fef8c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef86ffd640 1 -- 172.21.15.53:0/1244451479 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00f8f0 con 0x7fef7c006f20 2024-09-13T18:25:36.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef86ffd640 1 -- 172.21.15.53:0/1244451479 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00fa50 con 0x7fef7c006f20 2024-09-13T18:25:36.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90151660 con 0x7fef7c006f20 2024-09-13T18:25:36.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef86ffd640 1 -- 172.21.15.53:0/1244451479 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00fdc0 con 0x7fef7c006f20 2024-09-13T18:25:36.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef90151c20 con 0x7fef7c006f20 2024-09-13T18:25:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef90067400 con 0x7fef7c006f20 2024-09-13T18:25:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.449+0000 7fef86ffd640 1 -- 172.21.15.53:0/1244451479 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef8c015460 con 0x7fef7c006f20 2024-09-13T18:25:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.453+0000 7fef86ffd640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef74066690 0x7fef74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.453+0000 7fef86ffd640 1 -- 172.21.15.53:0/1244451479 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef8c084a20 con 0x7fef7c006f20 2024-09-13T18:25:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.453+0000 7fef95a26640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef74066690 0x7fef74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.453+0000 7fef95a26640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef74066690 0x7fef74068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef80007ad0 tx=0x7fef80007a60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.457+0000 7fef86ffd640 1 -- 172.21.15.53:0/1244451479 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef8c051d90 con 0x7fef7c006f20 2024-09-13T18:25:36.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.625+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef90070210 con 0x7fef7c006f20 2024-09-13T18:25:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef86ffd640 1 -- 172.21.15.53:0/1244451479 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef8c0553b0 con 0x7fef7c006f20 2024-09-13T18:25:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef74066690 msgr2=0x7fef74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef74066690 0x7fef74068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fef80007ad0 tx=0x7fef80007a60 comp rx=0 tx=0).stop 2024-09-13T18:25:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 msgr2=0x7fef90152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef90152140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0115e0 tx=0x7fef8c011aa0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 shutdown_connections 2024-09-13T18:25:36.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef74066690 0x7fef74068b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef90152810 0x7fef9014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef90153180 0x7fef900a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 --2- 172.21.15.53:0/1244451479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef7c006f20 0x7fef90152140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 >> 172.21.15.53:0/1244451479 conn(0x7fef90065c80 msgr2=0x7fef900cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:36.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 shutdown_connections 2024-09-13T18:25:36.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.629+0000 7fef9848b640 1 -- 172.21.15.53:0/1244451479 wait complete. 2024-09-13T18:25:36.650 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:25:36.650 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:36.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.777+0000 7f034220a640 1 Processor -- start 2024-09-13T18:25:36.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.777+0000 7f034220a640 1 -- start start 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.777+0000 7f034220a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f033c1582a0 0x7f033c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.777+0000 7f034220a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f033c15b7c0 0x7f033c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c06d480 con 0x7f033c070c90 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c15aaf0 con 0x7f033c15b7c0 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c06d760 con 0x7f033c1582a0 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f033c15b7c0 0x7f033c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f033c15b7c0 0x7f033c06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41402/0 (socket says 172.21.15.53:41402) 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 -- 172.21.15.53:0/2177374054 learned_addr learned my addr 172.21.15.53:0/2177374054 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033b7fe640 1 --2- 172.21.15.53:0/2177374054 >> v2:172.21.15.87:3300/0 conn(0x7f033c1582a0 0x7f033c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 -- 172.21.15.53:0/2177374054 >> v2:172.21.15.87:3300/0 conn(0x7f033c1582a0 msgr2=0x7f033c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 --2- 172.21.15.53:0/2177374054 >> v2:172.21.15.87:3300/0 conn(0x7f033c1582a0 0x7f033c06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 -- 172.21.15.53:0/2177374054 >> v1:172.21.15.87:6789/0 conn(0x7f033c070c90 legacy=0x7f033c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 -- 172.21.15.53:0/2177374054 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c15ace0 con 0x7f033c15b7c0 2024-09-13T18:25:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033affd640 1 --2- 172.21.15.53:0/2177374054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c06ce40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f033c069f50 tx=0x7f033001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc79f30ae2d8918 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033a7fc640 1 -- 172.21.15.53:0/2177374054 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03300a5780 con 0x7f033c15b7c0 2024-09-13T18:25:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033a7fc640 1 -- 172.21.15.53:0/2177374054 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03300a58e0 con 0x7f033c15b7c0 2024-09-13T18:25:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f033a7fc640 1 -- 172.21.15.53:0/2177374054 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03300a5c70 con 0x7f033c15b7c0 2024-09-13T18:25:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- 172.21.15.53:0/2177374054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 msgr2=0x7f033c06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 --2- 172.21.15.53:0/2177374054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c06ce40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f033c069f50 tx=0x7f033001c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- 172.21.15.53:0/2177374054 shutdown_connections 2024-09-13T18:25:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 --2- 172.21.15.53:0/2177374054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c06ce40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 --2- 172.21.15.53:0/2177374054 >> v2:172.21.15.87:3300/0 conn(0x7f033c1582a0 0x7f033c06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- 172.21.15.53:0/2177374054 >> 172.21.15.53:0/2177374054 conn(0x7f033c065c80 msgr2=0x7f033c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- 172.21.15.53:0/2177374054 shutdown_connections 2024-09-13T18:25:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.781+0000 7f034220a640 1 -- 172.21.15.53:0/2177374054 wait complete. 2024-09-13T18:25:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 Processor -- start 2024-09-13T18:25:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 -- start start 2024-09-13T18:25:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033c070c90 0x7f033c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033c1582a0 0x7f033c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c13dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c14ecc0 con 0x7f033c15b7c0 2024-09-13T18:25:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0b21f0 con 0x7f033c070c90 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0b24d0 con 0x7f033c1582a0 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c13dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c13dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41404/0 (socket says 172.21.15.53:41404) 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 -- 172.21.15.53:0/596347289 learned_addr learned my addr 172.21.15.53:0/596347289 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 -- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033c1582a0 msgr2=0x7f033c14ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033c1582a0 0x7f033c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 -- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033c070c90 msgr2=0x7f033c0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033c070c90 0x7f033c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 -- 172.21.15.53:0/596347289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0330009b30 con 0x7f033c15b7c0 2024-09-13T18:25:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f033bfff640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c13dbb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c430 tx=0x7f032c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f0323fff640 1 -- 172.21.15.53:0/596347289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c005220 con 0x7f033c15b7c0 2024-09-13T18:25:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f0323fff640 1 -- 172.21.15.53:0/596347289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c005380 con 0x7f033c15b7c0 2024-09-13T18:25:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c0b27b0 con 0x7f033c15b7c0 2024-09-13T18:25:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f0323fff640 1 -- 172.21.15.53:0/596347289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c007270 con 0x7f033c15b7c0 2024-09-13T18:25:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c0b2d70 con 0x7f033c15b7c0 2024-09-13T18:25:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c067400 con 0x7f033c15b7c0 2024-09-13T18:25:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f0323fff640 1 -- 172.21.15.53:0/596347289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f032c0073d0 con 0x7f033c15b7c0 2024-09-13T18:25:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.785+0000 7f0323fff640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f03280666c0 0x7f0328068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.789+0000 7f0323fff640 1 -- 172.21.15.53:0/596347289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f032c083560 con 0x7f033c15b7c0 2024-09-13T18:25:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.789+0000 7f033b7fe640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f03280666c0 0x7f0328068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.789+0000 7f033b7fe640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f03280666c0 0x7f0328068b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03340098f0 tx=0x7f0334008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.793+0000 7f0323fff640 1 -- 172.21.15.53:0/596347289 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f032c050960 con 0x7f033c15b7c0 2024-09-13T18:25:36.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.953+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f033c06f370 con 0x7f033c15b7c0 2024-09-13T18:25:36.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.953+0000 7f0323fff640 1 -- 172.21.15.53:0/596347289 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f032c053f80 con 0x7f033c15b7c0 2024-09-13T18:25:36.957 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:36.958 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f03280666c0 msgr2=0x7f0328068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f03280666c0 0x7f0328068b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03340098f0 tx=0x7f0334008040 comp rx=0 tx=0).stop 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 msgr2=0x7f033c13dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c13dbb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f032c00c430 tx=0x7f032c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 shutdown_connections 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f03280666c0 0x7f0328068b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033c1582a0 0x7f033c14ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f033c15b7c0 0x7f033c13dbb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 --2- 172.21.15.53:0/596347289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033c070c90 0x7f033c0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:36.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 >> 172.21.15.53:0/596347289 conn(0x7f033c065c80 msgr2=0x7f033c06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:36.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 shutdown_connections 2024-09-13T18:25:36.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:36.957+0000 7f034220a640 1 -- 172.21.15.53:0/596347289 wait complete. 2024-09-13T18:25:36.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:36.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989edad640 1 Processor -- start 2024-09-13T18:25:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989edad640 1 -- start start 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989edad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f98980b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989edad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f989806cb70 0x7f989806cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989edad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898159c30 con 0x7f98981593a0 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989edad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989806d520 con 0x7f989806cb70 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989edad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9898159f10 con 0x7f9898159780 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989cb49640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98981593a0 0x7f9898071010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52830/0 (socket says 172.21.15.53:52830) 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989cb49640 1 -- 172.21.15.53:0/1339909723 learned_addr learned my addr 172.21.15.53:0/1339909723 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989d34a640 1 --2- 172.21.15.53:0/1339909723 >> v2:172.21.15.53:3300/0 conn(0x7f989806cb70 0x7f989806cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f98977fe640 1 -- 172.21.15.53:0/1339909723 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605025367 0 0) 0x7f9898159c30 con 0x7f98981593a0 2024-09-13T18:25:37.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f9897fff640 1 --2- 172.21.15.53:0/1339909723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f98980b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f98977fe640 1 -- 172.21.15.53:0/1339909723 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9880005740 con 0x7f98981593a0 2024-09-13T18:25:37.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989d34a640 1 -- 172.21.15.53:0/1339909723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 msgr2=0x7f98980b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:37.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989d34a640 1 --2- 172.21.15.53:0/1339909723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f98980b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989d34a640 1 -- 172.21.15.53:0/1339909723 >> v1:172.21.15.53:6789/0 conn(0x7f98981593a0 legacy=0x7f9898071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.093+0000 7f989d34a640 1 -- 172.21.15.53:0/1339909723 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989815a1f0 con 0x7f989806cb70 2024-09-13T18:25:37.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989d34a640 1 --2- 172.21.15.53:0/1339909723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989806cb70 0x7f989806cfe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99a1a3e61fd5352 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f98977fe640 1 -- 172.21.15.53:0/1339909723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900a59c0 con 0x7f989806cb70 2024-09-13T18:25:37.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f98977fe640 1 -- 172.21.15.53:0/1339909723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98900a5b20 con 0x7f989806cb70 2024-09-13T18:25:37.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f98977fe640 1 -- 172.21.15.53:0/1339909723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900ad440 con 0x7f989806cb70 2024-09-13T18:25:37.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- 172.21.15.53:0/1339909723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989806cb70 msgr2=0x7f989806cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 --2- 172.21.15.53:0/1339909723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989806cb70 0x7f989806cfe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9890009d90 tx=0x7f989001c970 comp rx=0 tx=0).stop 2024-09-13T18:25:37.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- 172.21.15.53:0/1339909723 shutdown_connections 2024-09-13T18:25:37.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 --2- 172.21.15.53:0/1339909723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989806cb70 0x7f989806cfe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 --2- 172.21.15.53:0/1339909723 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f98980b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- 172.21.15.53:0/1339909723 >> 172.21.15.53:0/1339909723 conn(0x7f9898069f50 msgr2=0x7f989806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:37.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- 172.21.15.53:0/1339909723 shutdown_connections 2024-09-13T18:25:37.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- 172.21.15.53:0/1339909723 wait complete. 2024-09-13T18:25:37.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 Processor -- start 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- start start 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f989806cb70 0x7f9898142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98981593a0 0x7f9898145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f9898146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898153420 con 0x7f98981593a0 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898146750 con 0x7f989806cb70 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989edad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989814d960 con 0x7f9898159780 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98981593a0 0x7f9898145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98981593a0 0x7f9898145cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41414/0 (socket says 172.21.15.53:41414) 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 -- 172.21.15.53:0/2966100586 learned_addr learned my addr 172.21.15.53:0/2966100586 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:37.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989d34a640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f9898146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f989cb49640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f989806cb70 0x7f9898142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 -- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 msgr2=0x7f9898146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f9898146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 -- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f989806cb70 msgr2=0x7f9898142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f989806cb70 0x7f9898142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 -- 172.21.15.53:0/2966100586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009a70 con 0x7f98981593a0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.097+0000 7f9897fff640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98981593a0 0x7f9898145cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f988c00d800 tx=0x7f988c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f98957fa640 1 -- 172.21.15.53:0/2966100586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c00b6c0 con 0x7f98981593a0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f98957fa640 1 -- 172.21.15.53:0/2966100586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c00b820 con 0x7f98981593a0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989814d0a0 con 0x7f98981593a0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f98957fa640 1 -- 172.21.15.53:0/2966100586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c00bb90 con 0x7f98981593a0 2024-09-13T18:25:37.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989814d5f0 con 0x7f98981593a0 2024-09-13T18:25:37.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980cb610 con 0x7f98981593a0 2024-09-13T18:25:37.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f98957fa640 1 -- 172.21.15.53:0/2966100586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f988c00bcf0 con 0x7f98981593a0 2024-09-13T18:25:37.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f98957fa640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f98840666c0 0x7f9884068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f98957fa640 1 -- 172.21.15.53:0/2966100586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f988c084680 con 0x7f98981593a0 2024-09-13T18:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f989cb49640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f98840666c0 0x7f9884068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.101+0000 7f989cb49640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f98840666c0 0x7f9884068b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98880011f0 tx=0x7f9888009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.105+0000 7f98957fa640 1 -- 172.21.15.53:0/2966100586 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f988c0519f0 con 0x7f98981593a0 2024-09-13T18:25:37.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f989806cfe0 con 0x7f98981593a0 2024-09-13T18:25:37.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f98957fa640 1 -- 172.21.15.53:0/2966100586 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f988c055010 con 0x7f98981593a0 2024-09-13T18:25:37.264 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:37.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f98840666c0 msgr2=0x7f9884068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f98840666c0 0x7f9884068b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f98880011f0 tx=0x7f9888009040 comp rx=0 tx=0).stop 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98981593a0 msgr2=0x7f9898145cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98981593a0 0x7f9898145cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f988c00d800 tx=0x7f988c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 shutdown_connections 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f98840666c0 0x7f9884068b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9898159780 0x7f9898146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98981593a0 0x7f9898145cd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 --2- 172.21.15.53:0/2966100586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f989806cb70 0x7f9898142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 >> 172.21.15.53:0/2966100586 conn(0x7f9898069f50 msgr2=0x7f989806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:37.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 shutdown_connections 2024-09-13T18:25:37.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.261+0000 7f989edad640 1 -- 172.21.15.53:0/2966100586 wait complete. 2024-09-13T18:25:37.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:37.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.401+0000 7ff2ba84f640 1 Processor -- start 2024-09-13T18:25:37.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.401+0000 7ff2ba84f640 1 -- start start 2024-09-13T18:25:37.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2ba84f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2b4143e80 0x7ff2b406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2ba84f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2b40cda30 0x7ff2b40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2ba84f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b406f7a0 con 0x7ff2b40caee0 2024-09-13T18:25:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2ba84f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b406fd60 con 0x7ff2b4143e80 2024-09-13T18:25:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2ba84f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b40cb960 con 0x7ff2b40cda30 2024-09-13T18:25:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2b4143e80 0x7ff2b406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2b4143e80 0x7ff2b406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41428/0 (socket says 172.21.15.53:41428) 2024-09-13T18:25:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 -- 172.21.15.53:0/4103867511 learned_addr learned my addr 172.21.15.53:0/4103867511 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b8dec640 1 --2- 172.21.15.53:0/4103867511 >> v2:172.21.15.87:3300/0 conn(0x7ff2b40cda30 0x7ff2b40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 -- 172.21.15.53:0/4103867511 >> v2:172.21.15.87:3300/0 conn(0x7ff2b40cda30 msgr2=0x7ff2b40cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/4103867511 >> v2:172.21.15.87:3300/0 conn(0x7ff2b40cda30 0x7ff2b40cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 -- 172.21.15.53:0/4103867511 >> v1:172.21.15.87:6789/0 conn(0x7ff2b40caee0 legacy=0x7ff2b40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 -- 172.21.15.53:0/4103867511 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40cbc40 con 0x7ff2b4143e80 2024-09-13T18:25:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b8dec640 1 --2- 172.21.15.53:0/4103867511 >> v2:172.21.15.87:3300/0 conn(0x7ff2b40cda30 0x7ff2b40cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:37.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/4103867511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b4143e80 0x7ff2b406b390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2b406d370 tx=0x7ff2a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6caeb6b8d23ce72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/4103867511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40ac410 con 0x7ff2b4143e80 2024-09-13T18:25:37.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/4103867511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a40ac570 con 0x7ff2b4143e80 2024-09-13T18:25:37.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.405+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/4103867511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40ac900 con 0x7ff2b4143e80 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- 172.21.15.53:0/4103867511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b4143e80 msgr2=0x7ff2b406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/4103867511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b4143e80 0x7ff2b406b390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2b406d370 tx=0x7ff2a401c3d0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- 172.21.15.53:0/4103867511 shutdown_connections 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/4103867511 >> v2:172.21.15.87:3300/0 conn(0x7ff2b40cda30 0x7ff2b40cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/4103867511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b4143e80 0x7ff2b406b390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- 172.21.15.53:0/4103867511 >> 172.21.15.53:0/4103867511 conn(0x7ff2b4065c80 msgr2=0x7ff2b4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- 172.21.15.53:0/4103867511 shutdown_connections 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- 172.21.15.53:0/4103867511 wait complete. 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 Processor -- start 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- start start 2024-09-13T18:25:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b40caee0 0x7ff2b40a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40cda30 0x7ff2b41585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2b4143e80 0x7ff2b4158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b413f8a0 con 0x7ff2b40cda30 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4159040 con 0x7ff2b40caee0 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40a8d30 con 0x7ff2b4143e80 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40cda30 0x7ff2b41585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40cda30 0x7ff2b41585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41434/0 (socket says 172.21.15.53:41434) 2024-09-13T18:25:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 -- 172.21.15.53:0/3351801584 learned_addr learned my addr 172.21.15.53:0/3351801584 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b8dec640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2b4143e80 0x7ff2b4158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b40caee0 0x7ff2b40a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 -- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2b4143e80 msgr2=0x7ff2b4158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2b4143e80 0x7ff2b4158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 -- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b40caee0 msgr2=0x7ff2b40a87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b40caee0 0x7ff2b40a87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 -- 172.21.15.53:0/3351801584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40094d0 con 0x7ff2b40cda30 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40cda30 0x7ff2b41585c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c500 tx=0x7ff2a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/3351801584 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8005220 con 0x7ff2b40cda30 2024-09-13T18:25:37.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/3351801584 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8005380 con 0x7ff2b40cda30 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b413ef40 con 0x7ff2b40cda30 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/3351801584 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8007270 con 0x7ff2b40cda30 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.409+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b413f4c0 con 0x7ff2b40cda30 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.413+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b413f9e0 con 0x7ff2b40cda30 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.413+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/3351801584 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2a80073d0 con 0x7ff2b40cda30 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.413+0000 7ff2b0ff9640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff2a0066690 0x7ff2a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.413+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/3351801584 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2a8083ad0 con 0x7ff2b40cda30 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.413+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff2a0066690 0x7ff2a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.413+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff2a0066690 0x7ff2a0068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40ae000 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.417+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/3351801584 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2b413f9e0 con 0x7ff2b40cda30 2024-09-13T18:25:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.573+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2b413f9e0 con 0x7ff2b40cda30 2024-09-13T18:25:37.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.573+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/3351801584 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2b413f9e0 con 0x7ff2b40cda30 2024-09-13T18:25:37.578 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff2a0066690 msgr2=0x7ff2a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff2a0066690 0x7ff2a0068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40ae000 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40cda30 msgr2=0x7ff2b41585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40cda30 0x7ff2b41585c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c500 tx=0x7ff2a800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 shutdown_connections 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff2a0066690 0x7ff2a0068b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2b4143e80 0x7ff2b4158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40cda30 0x7ff2b41585c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 --2- 172.21.15.53:0/3351801584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b40caee0 0x7ff2b40a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 >> 172.21.15.53:0/3351801584 conn(0x7ff2b4065c80 msgr2=0x7ff2b413d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:37.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 shutdown_connections 2024-09-13T18:25:37.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.577+0000 7ff2ba84f640 1 -- 172.21.15.53:0/3351801584 wait complete. 2024-09-13T18:25:37.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:37.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2594bb640 1 Processor -- start 2024-09-13T18:25:37.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2594bb640 1 -- start start 2024-09-13T18:25:37.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2594bb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2540d3390 0x7fa2540cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2594bb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540b7db0 con 0x7fa2540ccd10 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2594bb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540d0650 con 0x7fa25415c830 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2594bb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540d0c10 con 0x7fa2540d3390 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa2540ccd10 0x7fa2540d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52846/0 (socket says 172.21.15.53:52846) 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 -- 172.21.15.53:0/1879753381 learned_addr learned my addr 172.21.15.53:0/1879753381 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2537fe640 1 --2- 172.21.15.53:0/1879753381 >> v2:172.21.15.87:3300/0 conn(0x7fa2540d3390 0x7fa2540cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642863892 0 0) 0x7fa2540b7db0 con 0x7fa2540ccd10 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa240003530 con 0x7fa2540ccd10 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609866417 0 0) 0x7fa240003530 con 0x7fa2540ccd10 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 >> v2:172.21.15.87:3300/0 conn(0x7fa2540d3390 msgr2=0x7fa2540cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 --2- 172.21.15.53:0/1879753381 >> v2:172.21.15.87:3300/0 conn(0x7fa2540d3390 0x7fa2540cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 >> v1:172.21.15.87:6789/0 conn(0x7fa25415c830 legacy=0x7fa2540d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2540d17b0 con 0x7fa2540ccd10 2024-09-13T18:25:37.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa23c001680 con 0x7fa2540ccd10 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 >> v1:172.21.15.53:6789/0 conn(0x7fa2540ccd10 legacy=0x7fa2540d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa240004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa240005050 0x7fa24000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540d0c10 con 0x7fa240004380 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24000bfb0 con 0x7fa240003980 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24000c170 con 0x7fa240005050 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa240004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa252ffd640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2537fe640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa240005050 0x7fa24000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 -- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa240005050 msgr2=0x7fa24000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa240005050 0x7fa24000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 -- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa240003980 msgr2=0x7fa240003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:37.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2527fc640 1 -- 172.21.15.53:0/1879753381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240003530 con 0x7fa240004380 2024-09-13T18:25:37.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa2537fe640 1 -- 172.21.15.53:0/1879753381 reap_dead start 2024-09-13T18:25:37.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.717+0000 7fa252ffd640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa240003980 0x7fa240003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:37.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2527fc640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa240004850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c1c0 tx=0x7fa23c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16b5486f54aeb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0058e0 con 0x7fa240004380 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c005a60 con 0x7fa240004380 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa251ffb640 1 -- 172.21.15.53:0/1879753381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c005e10 con 0x7fa240004380 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 -- 172.21.15.53:0/1879753381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 msgr2=0x7fa240004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa240004850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c1c0 tx=0x7fa23c01cba0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 -- 172.21.15.53:0/1879753381 shutdown_connections 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1879753381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa240004850 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 -- 172.21.15.53:0/1879753381 >> 172.21.15.53:0/1879753381 conn(0x7fa254070970 msgr2=0x7fa254070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 -- 172.21.15.53:0/1879753381 shutdown_connections 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 -- 172.21.15.53:0/1879753381 wait complete. 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 Processor -- start 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.721+0000 7fa2594bb640 1 -- start start 2024-09-13T18:25:37.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa25414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa25414f900 0x7fa2541f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2541f1a70 0x7fa2541f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa254150d70 con 0x7fa240004380 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541500f0 con 0x7fa2541f1a70 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541503d0 con 0x7fa25414f900 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa25414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa25414f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41456/0 (socket says 172.21.15.53:41456) 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 -- 172.21.15.53:0/1784327165 learned_addr learned my addr 172.21.15.53:0/1784327165 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2537fe640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2541f1a70 0x7fa2541f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2527fc640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa25414f900 0x7fa2541f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 -- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa25414f900 msgr2=0x7fa2541f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa25414f900 0x7fa2541f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 -- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2541f1a70 msgr2=0x7fa2541f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2541f1a70 0x7fa2541f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 -- 172.21.15.53:0/1784327165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2541506b0 con 0x7fa240004380 2024-09-13T18:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa252ffd640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa25414f3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa24400e120 tx=0x7fa24400e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa24b7fe640 1 -- 172.21.15.53:0/1784327165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244015630 con 0x7fa240004380 2024-09-13T18:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa24b7fe640 1 -- 172.21.15.53:0/1784327165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244015790 con 0x7fa240004380 2024-09-13T18:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa254150990 con 0x7fa240004380 2024-09-13T18:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa24b7fe640 1 -- 172.21.15.53:0/1784327165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244015b40 con 0x7fa240004380 2024-09-13T18:25:37.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa254151190 con 0x7fa240004380 2024-09-13T18:25:37.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2540cd180 con 0x7fa240004380 2024-09-13T18:25:37.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa24b7fe640 1 -- 172.21.15.53:0/1784327165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa244015ca0 con 0x7fa240004380 2024-09-13T18:25:37.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa24b7fe640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2340666c0 0x7fa234068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:37.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa24b7fe640 1 -- 172.21.15.53:0/1784327165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa244087aa0 con 0x7fa240004380 2024-09-13T18:25:37.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2527fc640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2340666c0 0x7fa234068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:37.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.725+0000 7fa2527fc640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2340666c0 0x7fa234068b80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0aa000 tx=0x7fa23c0b0040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:37.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.729+0000 7fa24b7fe640 1 -- 172.21.15.53:0/1784327165 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa244054d80 con 0x7fa240004380 2024-09-13T18:25:37.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.885+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2540cfa80 con 0x7fa240004380 2024-09-13T18:25:37.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa24b7fe640 1 -- 172.21.15.53:0/1784327165 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa244005780 con 0x7fa240004380 2024-09-13T18:25:37.890 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:37.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2340666c0 msgr2=0x7fa234068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2340666c0 0x7fa234068b80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0aa000 tx=0x7fa23c0b0040 comp rx=0 tx=0).stop 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 msgr2=0x7fa25414f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa25414f3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa24400e120 tx=0x7fa24400e5e0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 shutdown_connections 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa2340666c0 0x7fa234068b80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa25414f900 0x7fa2541f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2541f1a70 0x7fa2541f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 --2- 172.21.15.53:0/1784327165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa240004380 0x7fa25414f3c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 >> 172.21.15.53:0/1784327165 conn(0x7fa254070970 msgr2=0x7fa2540b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 shutdown_connections 2024-09-13T18:25:37.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:37.889+0000 7fa2594bb640 1 -- 172.21.15.53:0/1784327165 wait complete. 2024-09-13T18:25:37.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:38.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc14e2bf640 1 Processor -- start 2024-09-13T18:25:38.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc14e2bf640 1 -- start start 2024-09-13T18:25:38.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc14e2bf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14815a4f0 0x7fc14806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc14e2bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc14806d640 0x7fc1480cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc14e2bf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14815e0c0 con 0x7fc14806bc20 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc14e2bf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14815ef90 con 0x7fc14806d640 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc14e2bf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480b4b30 con 0x7fc14815a4f0 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc1477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc14806d640 0x7fc1480cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc1477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc14806d640 0x7fc1480cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41466/0 (socket says 172.21.15.53:41466) 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.029+0000 7fc1477fe640 1 -- 172.21.15.53:0/3853241717 learned_addr learned my addr 172.21.15.53:0/3853241717 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc147fff640 1 --2- 172.21.15.53:0/3853241717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14815a4f0 0x7fc14806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc1477fe640 1 -- 172.21.15.53:0/3853241717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14815a4f0 msgr2=0x7fc14806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc1477fe640 1 --2- 172.21.15.53:0/3853241717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14815a4f0 0x7fc14806d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc1477fe640 1 -- 172.21.15.53:0/3853241717 >> v1:172.21.15.87:6789/0 conn(0x7fc14806bc20 legacy=0x7fc1480ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc1477fe640 1 -- 172.21.15.53:0/3853241717 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14815e310 con 0x7fc14806d640 2024-09-13T18:25:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc1477fe640 1 --2- 172.21.15.53:0/3853241717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14806d640 0x7fc1480cb560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098a0 tx=0x7fc13001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4a1a6b38f21b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc146ffd640 1 -- 172.21.15.53:0/3853241717 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300ad660 con 0x7fc14806d640 2024-09-13T18:25:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc146ffd640 1 -- 172.21.15.53:0/3853241717 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300ad7c0 con 0x7fc14806d640 2024-09-13T18:25:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc146ffd640 1 -- 172.21.15.53:0/3853241717 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300adb50 con 0x7fc14806d640 2024-09-13T18:25:38.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 -- 172.21.15.53:0/3853241717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14806d640 msgr2=0x7fc1480cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/3853241717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14806d640 0x7fc1480cb560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098a0 tx=0x7fc13001c480 comp rx=0 tx=0).stop 2024-09-13T18:25:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 -- 172.21.15.53:0/3853241717 shutdown_connections 2024-09-13T18:25:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/3853241717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14806d640 0x7fc1480cb560 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/3853241717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14815a4f0 0x7fc14806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 -- 172.21.15.53:0/3853241717 >> 172.21.15.53:0/3853241717 conn(0x7fc1480b0840 msgr2=0x7fc1480b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 -- 172.21.15.53:0/3853241717 shutdown_connections 2024-09-13T18:25:38.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.033+0000 7fc14e2bf640 1 -- 172.21.15.53:0/3853241717 wait complete. 2024-09-13T18:25:38.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 Processor -- start 2024-09-13T18:25:38.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 -- start start 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14806bc20 0x7fc148155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc14806d640 0x7fc14814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14815a4f0 0x7fc148152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148156f60 con 0x7fc14815a4f0 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480b0670 con 0x7fc14806d640 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc148156090 con 0x7fc14806bc20 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14815a4f0 0x7fc148152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14815a4f0 0x7fc148152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41474/0 (socket says 172.21.15.53:41474) 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 -- 172.21.15.53:0/2103337587 learned_addr learned my addr 172.21.15.53:0/2103337587 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc147fff640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14806bc20 0x7fc148155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc1477fe640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc14806d640 0x7fc14814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 -- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14806bc20 msgr2=0x7fc148155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14806bc20 0x7fc148155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 -- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc14806d640 msgr2=0x7fc14814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc14806d640 0x7fc14814d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 -- 172.21.15.53:0/2103337587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300094d0 con 0x7fc14815a4f0 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc1477fe640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc14806d640 0x7fc14814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14c85c640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14815a4f0 0x7fc148152400 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c400 tx=0x7fc14000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc144ff9640 1 -- 172.21.15.53:0/2103337587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1400052d0 con 0x7fc14815a4f0 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc144ff9640 1 -- 172.21.15.53:0/2103337587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc140005430 con 0x7fc14815a4f0 2024-09-13T18:25:38.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1481562e0 con 0x7fc14815a4f0 2024-09-13T18:25:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc144ff9640 1 -- 172.21.15.53:0/2103337587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140003800 con 0x7fc14815a4f0 2024-09-13T18:25:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1481568a0 con 0x7fc14815a4f0 2024-09-13T18:25:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1481570a0 con 0x7fc14815a4f0 2024-09-13T18:25:38.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc144ff9640 1 -- 172.21.15.53:0/2103337587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc140003960 con 0x7fc14815a4f0 2024-09-13T18:25:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.037+0000 7fc144ff9640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1280666c0 0x7fc128068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.041+0000 7fc144ff9640 1 -- 172.21.15.53:0/2103337587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc140083590 con 0x7fc14815a4f0 2024-09-13T18:25:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.041+0000 7fc147fff640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1280666c0 0x7fc128068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.041+0000 7fc147fff640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1280666c0 0x7fc128068b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc14814dde0 tx=0x7fc13800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.045+0000 7fc144ff9640 1 -- 172.21.15.53:0/2103337587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1400509b0 con 0x7fc14815a4f0 2024-09-13T18:25:38.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.213+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1480cb560 con 0x7fc14815a4f0 2024-09-13T18:25:38.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.213+0000 7fc144ff9640 1 -- 172.21.15.53:0/2103337587 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc140053fd0 con 0x7fc14815a4f0 2024-09-13T18:25:38.217 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1280666c0 msgr2=0x7fc128068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1280666c0 0x7fc128068b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc14814dde0 tx=0x7fc13800b040 comp rx=0 tx=0).stop 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14815a4f0 msgr2=0x7fc148152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14815a4f0 0x7fc148152400 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c400 tx=0x7fc14000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 shutdown_connections 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1280666c0 0x7fc128068b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc14815a4f0 0x7fc148152400 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc14806d640 0x7fc14814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 --2- 172.21.15.53:0/2103337587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc14806bc20 0x7fc148155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 >> 172.21.15.53:0/2103337587 conn(0x7fc1480b0840 msgr2=0x7fc148153800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:38.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 shutdown_connections 2024-09-13T18:25:38.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.217+0000 7fc14e2bf640 1 -- 172.21.15.53:0/2103337587 wait complete. 2024-09-13T18:25:38.234 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:25:38.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:38.235 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:25:38.264 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:38.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:25:38.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:38.265 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:25:38.319 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:25:38.320 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:38.326 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:25:38.326 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:38.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe30d5640 1 Processor -- start 2024-09-13T18:25:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe30d5640 1 -- start start 2024-09-13T18:25:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe30d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 0x7fdbdc0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe30d5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc0d2400 con 0x7fdbdc15cab0 2024-09-13T18:25:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe30d5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc0d1530 con 0x7fdbdc0cf600 2024-09-13T18:25:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe30d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0cfab0 con 0x7fdbdc0d19c0 2024-09-13T18:25:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdbdc15cab0 0x7fdbdc0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52850/0 (socket says 172.21.15.53:52850) 2024-09-13T18:25:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 -- 172.21.15.53:0/3455694077 learned_addr learned my addr 172.21.15.53:0/3455694077 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd3fff640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 0x7fdbdc0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324249427 0 0) 0x7fdbdc0d2400 con 0x7fdbdc15cab0 2024-09-13T18:25:38.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc4003530 con 0x7fdbdc15cab0 2024-09-13T18:25:38.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701559153 0 0) 0x7fdbc4003530 con 0x7fdbdc15cab0 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 msgr2=0x7fdbdc0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 0x7fdbdc0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 >> v1:172.21.15.87:6789/0 conn(0x7fdbdc0cf600 legacy=0x7fdbdc0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0cddd0 con 0x7fdbdc15cab0 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdbd8001680 con 0x7fdbdc15cab0 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 >> v1:172.21.15.53:6789/0 conn(0x7fdbdc15cab0 legacy=0x7fdbdc0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbc40039b0 0x7fdbc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40047d0 0x7fdbc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 0x7fdbc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0cfab0 con 0x7fdbc40039b0 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc400ba70 con 0x7fdbc40047d0 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc400bc30 con 0x7fdbdc0d19c0 2024-09-13T18:25:38.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbc40039b0 0x7fdbc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbd3fff640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40047d0 0x7fdbc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe1672640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 0x7fdbc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 -- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 msgr2=0x7fdbc4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 0x7fdbc4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 -- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40047d0 msgr2=0x7fdbc4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40047d0 0x7fdbc4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe0e71640 1 -- 172.21.15.53:0/3455694077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4003530 con 0x7fdbc40039b0 2024-09-13T18:25:38.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.545+0000 7fdbe1672640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc0d19c0 0x7fdbc4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbc40039b0 0x7fdbc4003dd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c210 tx=0x7fdbd801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c0d3d9f8271616 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8005ae0 con 0x7fdbc40039b0 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8005c40 con 0x7fdbc40039b0 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbd37fe640 1 -- 172.21.15.53:0/3455694077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8007070 con 0x7fdbc40039b0 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- 172.21.15.53:0/3455694077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbc40039b0 msgr2=0x7fdbc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 --2- 172.21.15.53:0/3455694077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbc40039b0 0x7fdbc4003dd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c210 tx=0x7fdbd801cc20 comp rx=0 tx=0).stop 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe1672640 1 -- 172.21.15.53:0/3455694077 reap_dead start 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- 172.21.15.53:0/3455694077 shutdown_connections 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- 172.21.15.53:0/3455694077 >> 172.21.15.53:0/3455694077 conn(0x7fdbdc065c80 msgr2=0x7fdbdc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- 172.21.15.53:0/3455694077 shutdown_connections 2024-09-13T18:25:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- 172.21.15.53:0/3455694077 wait complete. 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 Processor -- start 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- start start 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40039b0 0x7fdbdc1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc150b90 0x7fdbdc15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbdc1503f0 0x7fdbdc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc152e00 con 0x7fdbdc1503f0 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc15b0a0 con 0x7fdbc40039b0 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe30d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc15a6d0 con 0x7fdbdc150b90 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe1672640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbdc1503f0 0x7fdbdc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe1672640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbdc1503f0 0x7fdbdc0b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41488/0 (socket says 172.21.15.53:41488) 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.549+0000 7fdbe1672640 1 -- 172.21.15.53:0/2415861408 learned_addr learned my addr 172.21.15.53:0/2415861408 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40039b0 0x7fdbdc1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbd3fff640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc150b90 0x7fdbdc15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe1672640 1 -- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc150b90 msgr2=0x7fdbdc15ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe1672640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc150b90 0x7fdbdc15ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe1672640 1 -- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40039b0 msgr2=0x7fdbdc1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe1672640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40039b0 0x7fdbdc1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe1672640 1 -- 172.21.15.53:0/2415861408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc159ac0 con 0x7fdbdc1503f0 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40039b0 0x7fdbdc1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe1672640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbdc1503f0 0x7fdbdc0b2210 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc06b5b0 tx=0x7fdbd400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbd17fa640 1 -- 172.21.15.53:0/2415861408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4006d60 con 0x7fdbdc1503f0 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbd17fa640 1 -- 172.21.15.53:0/2415861408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd4003980 con 0x7fdbdc1503f0 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc159da0 con 0x7fdbdc1503f0 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbd17fa640 1 -- 172.21.15.53:0/2415861408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4003d30 con 0x7fdbdc1503f0 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc15a360 con 0x7fdbdc1503f0 2024-09-13T18:25:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc0b5870 con 0x7fdbdc1503f0 2024-09-13T18:25:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbd17fa640 1 -- 172.21.15.53:0/2415861408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdbd4005070 con 0x7fdbdc1503f0 2024-09-13T18:25:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbd17fa640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc8066690 0x7fdbc8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbd17fa640 1 -- 172.21.15.53:0/2415861408 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbd4083f50 con 0x7fdbdc1503f0 2024-09-13T18:25:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc8066690 0x7fdbc8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.553+0000 7fdbe0e71640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc8066690 0x7fdbc8068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80ab000 tx=0x7fdbd80a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.557+0000 7fdbd17fa640 1 -- 172.21.15.53:0/2415861408 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdbd4051350 con 0x7fdbdc1503f0 2024-09-13T18:25:38.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.709+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbdc15a810 con 0x7fdbdc1503f0 2024-09-13T18:25:38.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbd17fa640 1 -- 172.21.15.53:0/2415861408 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fdbd4054970 con 0x7fdbdc1503f0 2024-09-13T18:25:38.715 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:38.716 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:24:59.381489+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc8066690 msgr2=0x7fdbc8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc8066690 0x7fdbc8068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80ab000 tx=0x7fdbd80a7070 comp rx=0 tx=0).stop 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbdc1503f0 msgr2=0x7fdbdc0b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbdc1503f0 0x7fdbdc0b2210 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc06b5b0 tx=0x7fdbd400dc00 comp rx=0 tx=0).stop 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 shutdown_connections 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdbc8066690 0x7fdbc8068b50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdbdc150b90 0x7fdbdc15ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdbdc1503f0 0x7fdbdc0b2210 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 --2- 172.21.15.53:0/2415861408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbc40039b0 0x7fdbdc1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 >> 172.21.15.53:0/2415861408 conn(0x7fdbdc065c80 msgr2=0x7fdbdc0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 shutdown_connections 2024-09-13T18:25:38.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.713+0000 7fdbe30d5640 1 -- 172.21.15.53:0/2415861408 wait complete. 2024-09-13T18:25:38.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:38.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44e57e7640 1 Processor -- start 2024-09-13T18:25:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44e57e7640 1 -- start start 2024-09-13T18:25:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44e57e7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f44e015a6d0 0x7f44e0072d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44e57e7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e00713f0 con 0x7f44e00cd5a0 2024-09-13T18:25:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44e57e7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e015aab0 con 0x7f44e00cb670 2024-09-13T18:25:38.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44e57e7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e0071f90 con 0x7f44e015a6d0 2024-09-13T18:25:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44d67fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f44e00cd5a0 0x7f44e0071880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52866/0 (socket says 172.21.15.53:52866) 2024-09-13T18:25:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44d67fc640 1 -- 172.21.15.53:0/1299053814 learned_addr learned my addr 172.21.15.53:0/1299053814 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44deffd640 1 --2- 172.21.15.53:0/1299053814 >> v2:172.21.15.87:3300/0 conn(0x7f44e015a6d0 0x7f44e0072d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248968822 0 0) 0x7f44e00713f0 con 0x7f44e00cd5a0 2024-09-13T18:25:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44cc003530 con 0x7f44e00cd5a0 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 231790636 0 0) 0x7f44cc003530 con 0x7f44e00cd5a0 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 >> v2:172.21.15.87:3300/0 conn(0x7f44e015a6d0 msgr2=0x7f44e0072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 --2- 172.21.15.53:0/1299053814 >> v2:172.21.15.87:3300/0 conn(0x7f44e015a6d0 0x7f44e0072d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 >> v1:172.21.15.87:6789/0 conn(0x7f44e00cb670 legacy=0x7f44e006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0073310 con 0x7f44e00cd5a0 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f44c8001680 con 0x7f44e00cd5a0 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 >> v1:172.21.15.53:6789/0 conn(0x7f44e00cd5a0 legacy=0x7f44e0071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44cc003980 0x7f44cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44cc0047d0 0x7f44cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc005190 0x7f44cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0071f90 con 0x7f44cc003980 2024-09-13T18:25:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc00c030 con 0x7f44cc005190 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc00c1f0 con 0x7f44cc0047d0 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44deffd640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44cc003980 0x7f44cc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44df7fe640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc005190 0x7f44cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44d67fc640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44cc0047d0 0x7f44cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44deffd640 1 -- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44cc0047d0 msgr2=0x7f44cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44deffd640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44cc0047d0 0x7f44cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44deffd640 1 -- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc005190 msgr2=0x7f44cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44deffd640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc005190 0x7f44cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44df7fe640 1 -- 172.21.15.53:0/1299053814 reap_dead start 2024-09-13T18:25:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.861+0000 7f44deffd640 1 -- 172.21.15.53:0/1299053814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc003530 con 0x7f44cc003980 2024-09-13T18:25:38.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44deffd640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44cc003980 0x7f44cc003da0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009ae0 tx=0x7f44d001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4507e092fc3370e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d00a6420 con 0x7f44cc003980 2024-09-13T18:25:38.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d00a6580 con 0x7f44cc003980 2024-09-13T18:25:38.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44de7fc640 1 -- 172.21.15.53:0/1299053814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d00a6930 con 0x7f44cc003980 2024-09-13T18:25:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 -- 172.21.15.53:0/1299053814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44cc003980 msgr2=0x7f44cc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44cc003980 0x7f44cc003da0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009ae0 tx=0x7f44d001ca70 comp rx=0 tx=0).stop 2024-09-13T18:25:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 -- 172.21.15.53:0/1299053814 shutdown_connections 2024-09-13T18:25:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 --2- 172.21.15.53:0/1299053814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44cc003980 0x7f44cc003da0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 -- 172.21.15.53:0/1299053814 >> 172.21.15.53:0/1299053814 conn(0x7f44e00b0a30 msgr2=0x7f44e00b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 -- 172.21.15.53:0/1299053814 shutdown_connections 2024-09-13T18:25:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 -- 172.21.15.53:0/1299053814 wait complete. 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 Processor -- start 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.865+0000 7f44e57e7640 1 -- start start 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc003980 0x7f44e0158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44e00adf70 0x7f44e00ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44e00c9cb0 0x7f44e00ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00ae930 con 0x7f44e00adf70 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01f5110 con 0x7f44cc003980 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01f53f0 con 0x7f44e00c9cb0 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44e00adf70 0x7f44e00ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44e00adf70 0x7f44e00ae3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41502/0 (socket says 172.21.15.53:41502) 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 -- 172.21.15.53:0/257920402 learned_addr learned my addr 172.21.15.53:0/257920402 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44df7fe640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44e00c9cb0 0x7f44e00ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44deffd640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc003980 0x7f44e0158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 -- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44e00c9cb0 msgr2=0x7f44e00ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44e00c9cb0 0x7f44e00ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 -- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc003980 msgr2=0x7f44e0158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc003980 0x7f44e0158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 -- 172.21.15.53:0/257920402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e01f56d0 con 0x7f44e00adf70 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d67fc640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44e00adf70 0x7f44e00ae3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f44c8001210 tx=0x7f44c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d7fff640 1 -- 172.21.15.53:0/257920402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c800eed0 con 0x7f44e00adf70 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d7fff640 1 -- 172.21.15.53:0/257920402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c800c8a0 con 0x7f44e00adf70 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d7fff640 1 -- 172.21.15.53:0/257920402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c800cc30 con 0x7f44e00adf70 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e01f59b0 con 0x7f44e00adf70 2024-09-13T18:25:38.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e0158d90 con 0x7f44e00adf70 2024-09-13T18:25:38.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e01f5ed0 con 0x7f44e00adf70 2024-09-13T18:25:38.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d7fff640 1 -- 172.21.15.53:0/257920402 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44c801d460 con 0x7f44e00adf70 2024-09-13T18:25:38.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d7fff640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f44c00666c0 0x7f44c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:38.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44d7fff640 1 -- 172.21.15.53:0/257920402 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44c8084220 con 0x7f44e00adf70 2024-09-13T18:25:38.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.869+0000 7f44deffd640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f44c00666c0 0x7f44c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:38.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.873+0000 7f44deffd640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f44c00666c0 0x7f44c0068b80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f44d00ad000 tx=0x7f44d00b2040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:38.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:38.873+0000 7f44d7fff640 1 -- 172.21.15.53:0/257920402 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f44e01f5ed0 con 0x7f44e00adf70 2024-09-13T18:25:39.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.033+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44e01f5ed0 con 0x7f44e00adf70 2024-09-13T18:25:39.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.033+0000 7f44d7fff640 1 -- 172.21.15.53:0/257920402 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44e01f5ed0 con 0x7f44e00adf70 2024-09-13T18:25:39.037 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f44c00666c0 msgr2=0x7f44c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f44c00666c0 0x7f44c0068b80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f44d00ad000 tx=0x7f44d00b2040 comp rx=0 tx=0).stop 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44e00adf70 msgr2=0x7f44e00ae3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44e00adf70 0x7f44e00ae3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f44c8001210 tx=0x7f44c800ec80 comp rx=0 tx=0).stop 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 shutdown_connections 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f44c00666c0 0x7f44c0068b80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44e00c9cb0 0x7f44e00ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44e00adf70 0x7f44e00ae3f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 --2- 172.21.15.53:0/257920402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44cc003980 0x7f44e0158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 >> 172.21.15.53:0/257920402 conn(0x7f44e00b0a30 msgr2=0x7f44e00af820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:39.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 shutdown_connections 2024-09-13T18:25:39.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.037+0000 7f44e57e7640 1 -- 172.21.15.53:0/257920402 wait complete. 2024-09-13T18:25:39.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:39.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb6ef8640 1 Processor -- start 2024-09-13T18:25:39.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb6ef8640 1 -- start start 2024-09-13T18:25:39.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb6ef8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 0x7f5eb00d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb6ef8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5eb00d3390 0x7f5eb00cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb6ef8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb00b7db0 con 0x7f5eb00ccd10 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb6ef8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb00d0650 con 0x7f5eb00d3390 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb6ef8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00d0c10 con 0x7f5eb015c830 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5eb00ccd10 0x7f5eb00d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52880/0 (socket says 172.21.15.53:52880) 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 -- 172.21.15.53:0/2287567193 learned_addr learned my addr 172.21.15.53:0/2287567193 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb4c94640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 0x7f5eb00d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151451561 0 0) 0x7f5eb00b7db0 con 0x7f5eb00ccd10 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e98003530 con 0x7f5eb00ccd10 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb5495640 1 --2- 172.21.15.53:0/2287567193 >> v2:172.21.15.87:3300/0 conn(0x7f5eb00d3390 0x7f5eb00cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1126588187 0 0) 0x7f5e98003530 con 0x7f5eb00ccd10 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 msgr2=0x7f5eb00d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 0x7f5eb00d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 >> v2:172.21.15.87:3300/0 conn(0x7f5eb00d3390 msgr2=0x7f5eb00cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 --2- 172.21.15.53:0/2287567193 >> v2:172.21.15.87:3300/0 conn(0x7f5eb00d3390 0x7f5eb00cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00cd7d0 con 0x7f5eb00ccd10 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5ea4001680 con 0x7f5eb00ccd10 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb5495640 1 --2- 172.21.15.53:0/2287567193 >> v2:172.21.15.87:3300/0 conn(0x7f5eb00d3390 0x7f5eb00cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 >> v1:172.21.15.53:6789/0 conn(0x7f5eb00ccd10 legacy=0x7f5eb00d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e98003980 0x7f5e98003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e980047d0 0x7f5e98004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 0x7f5e98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00d0650 con 0x7f5e980047d0 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00d0c10 con 0x7f5e98003980 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9800b990 con 0x7f5eb015c830 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e980047d0 0x7f5e98004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb4c94640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e98003980 0x7f5e98003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb5495640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 0x7f5e98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 -- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 msgr2=0x7f5e98005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 0x7f5e98005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 -- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e98003980 msgr2=0x7f5e98003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e98003980 0x7f5e98003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eaffff640 1 -- 172.21.15.53:0/2287567193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98003530 con 0x7f5e980047d0 2024-09-13T18:25:39.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.185+0000 7f5eb5495640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb015c830 0x7f5e98005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:39.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eaffff640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e980047d0 0x7f5e98004c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00b43f0 tx=0x7f5ea401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bd66ae2c4d6b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40a8cb0 con 0x7f5e980047d0 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea40a8e10 con 0x7f5e980047d0 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eaf7fe640 1 -- 172.21.15.53:0/2287567193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4005b20 con 0x7f5e980047d0 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/2287567193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e980047d0 msgr2=0x7f5e98004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 --2- 172.21.15.53:0/2287567193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e980047d0 0x7f5e98004c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00b43f0 tx=0x7f5ea401f390 comp rx=0 tx=0).stop 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb5495640 1 -- 172.21.15.53:0/2287567193 reap_dead start 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/2287567193 shutdown_connections 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/2287567193 >> 172.21.15.53:0/2287567193 conn(0x7f5eb0070970 msgr2=0x7f5eb0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/2287567193 shutdown_connections 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/2287567193 wait complete. 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 Processor -- start 2024-09-13T18:25:39.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.189+0000 7f5eb6ef8640 1 -- start start 2024-09-13T18:25:39.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980047d0 0x7f5eb01f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb0155d80 0x7f5eb00ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb00b6c40 0x7f5eb00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0157f90 con 0x7f5eb00b6c40 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00cbde0 con 0x7f5e980047d0 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00b7600 con 0x7f5eb0155d80 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb00b6c40 0x7f5eb00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb00b6c40 0x7f5eb00b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41512/0 (socket says 172.21.15.53:41512) 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 -- 172.21.15.53:0/1283968054 learned_addr learned my addr 172.21.15.53:0/1283968054 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eaffff640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb0155d80 0x7f5eb00ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb4c94640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980047d0 0x7f5eb01f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 -- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb0155d80 msgr2=0x7f5eb00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb0155d80 0x7f5eb00ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 -- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980047d0 msgr2=0x7f5eb01f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980047d0 0x7f5eb01f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 -- 172.21.15.53:0/1283968054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00caed0 con 0x7f5eb00b6c40 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb5495640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb00b6c40 0x7f5eb00b70c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00d0240 tx=0x7f5ea80109f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5ead7fa640 1 -- 172.21.15.53:0/1283968054 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8004440 con 0x7f5eb00b6c40 2024-09-13T18:25:39.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5ead7fa640 1 -- 172.21.15.53:0/1283968054 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800c050 con 0x7f5eb00b6c40 2024-09-13T18:25:39.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb01f2d60 con 0x7f5eb00b6c40 2024-09-13T18:25:39.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5ead7fa640 1 -- 172.21.15.53:0/1283968054 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8003860 con 0x7f5eb00b6c40 2024-09-13T18:25:39.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb01f27a0 con 0x7f5eb00b6c40 2024-09-13T18:25:39.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb01580d0 con 0x7f5eb00b6c40 2024-09-13T18:25:39.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5ead7fa640 1 -- 172.21.15.53:0/1283968054 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ea80039c0 con 0x7f5eb00b6c40 2024-09-13T18:25:39.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5ead7fa640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e9c066690 0x7f5e9c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5ead7fa640 1 -- 172.21.15.53:0/1283968054 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5ea8084090 con 0x7f5eb00b6c40 2024-09-13T18:25:39.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.193+0000 7f5eb4c94640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e9c066690 0x7f5e9c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.197+0000 7f5eb4c94640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e9c066690 0x7f5e9c068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00133c0 tx=0x7f5ea000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.197+0000 7f5ead7fa640 1 -- 172.21.15.53:0/1283968054 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5eb01580d0 con 0x7f5eb00b6c40 2024-09-13T18:25:39.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.349+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5eb01580d0 con 0x7f5eb00b6c40 2024-09-13T18:25:39.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5ead7fa640 1 -- 172.21.15.53:0/1283968054 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5eb01580d0 con 0x7f5eb00b6c40 2024-09-13T18:25:39.355 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e9c066690 msgr2=0x7f5e9c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e9c066690 0x7f5e9c068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00133c0 tx=0x7f5ea000b040 comp rx=0 tx=0).stop 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb00b6c40 msgr2=0x7f5eb00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb00b6c40 0x7f5eb00b70c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00d0240 tx=0x7f5ea80109f0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 shutdown_connections 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e9c066690 0x7f5e9c068b50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5eb0155d80 0x7f5eb00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eb00b6c40 0x7f5eb00b70c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 --2- 172.21.15.53:0/1283968054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e980047d0 0x7f5eb01f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 >> 172.21.15.53:0/1283968054 conn(0x7f5eb0070970 msgr2=0x7f5eb00b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 shutdown_connections 2024-09-13T18:25:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.353+0000 7f5eb6ef8640 1 -- 172.21.15.53:0/1283968054 wait complete. 2024-09-13T18:25:39.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:39.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 Processor -- start 2024-09-13T18:25:39.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 -- start start 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2508143e80 0x7f250806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25080caee0 0x7f25080cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25080cd320 0x7f25080cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250806f7a0 con 0x7f25080cd320 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250806fd60 con 0x7f2508143e80 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250c9d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25080cb960 con 0x7f25080caee0 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25080cd320 0x7f25080cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25080cd320 0x7f25080cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41516/0 (socket says 172.21.15.53:41516) 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 -- 172.21.15.53:0/3642033000 learned_addr learned my addr 172.21.15.53:0/3642033000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f24fdd9b640 1 --2- 172.21.15.53:0/3642033000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25080caee0 0x7f25080cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250659c640 1 --2- 172.21.15.53:0/3642033000 >> v2:172.21.15.87:3300/0 conn(0x7f2508143e80 0x7f250806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 -- 172.21.15.53:0/3642033000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25080caee0 msgr2=0x7f25080cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 --2- 172.21.15.53:0/3642033000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25080caee0 0x7f25080cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 -- 172.21.15.53:0/3642033000 >> v2:172.21.15.87:3300/0 conn(0x7f2508143e80 msgr2=0x7f250806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 --2- 172.21.15.53:0/3642033000 >> v2:172.21.15.87:3300/0 conn(0x7f2508143e80 0x7f250806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f2506d9d640 1 -- 172.21.15.53:0/3642033000 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080cbc40 con 0x7f25080cd320 2024-09-13T18:25:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.497+0000 7f250659c640 1 --2- 172.21.15.53:0/3642033000 >> v2:172.21.15.87:3300/0 conn(0x7f2508143e80 0x7f250806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f2506d9d640 1 --2- 172.21.15.53:0/3642033000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080cd7b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f25080676d0 tx=0x7f250001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a3d14195716678 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f2505d9b640 1 -- 172.21.15.53:0/3642033000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000a57b0 con 0x7f25080cd320 2024-09-13T18:25:39.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f2505d9b640 1 -- 172.21.15.53:0/3642033000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25000a5910 con 0x7f25080cd320 2024-09-13T18:25:39.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f2505d9b640 1 -- 172.21.15.53:0/3642033000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000a5ca0 con 0x7f25080cd320 2024-09-13T18:25:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- 172.21.15.53:0/3642033000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 msgr2=0x7f25080cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 --2- 172.21.15.53:0/3642033000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080cd7b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f25080676d0 tx=0x7f250001c930 comp rx=0 tx=0).stop 2024-09-13T18:25:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- 172.21.15.53:0/3642033000 shutdown_connections 2024-09-13T18:25:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 --2- 172.21.15.53:0/3642033000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25080caee0 0x7f25080cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 --2- 172.21.15.53:0/3642033000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080cd7b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 --2- 172.21.15.53:0/3642033000 >> v2:172.21.15.87:3300/0 conn(0x7f2508143e80 0x7f250806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- 172.21.15.53:0/3642033000 >> 172.21.15.53:0/3642033000 conn(0x7f2508065c80 msgr2=0x7f2508066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:39.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- 172.21.15.53:0/3642033000 shutdown_connections 2024-09-13T18:25:39.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- 172.21.15.53:0/3642033000 wait complete. 2024-09-13T18:25:39.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 Processor -- start 2024-09-13T18:25:39.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- start start 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080caee0 0x7f2508159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2508143e80 0x7f25081409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2508158550 con 0x7f25080cd320 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080b2510 con 0x7f25080caee0 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f250c9d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25080b2ef0 con 0x7f2508143e80 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f24fdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f24fdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41518/0 (socket says 172.21.15.53:41518) 2024-09-13T18:25:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.501+0000 7f24fdd9b640 1 -- 172.21.15.53:0/2883382454 learned_addr learned my addr 172.21.15.53:0/2883382454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f250659c640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080caee0 0x7f2508159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f2506d9d640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2508143e80 0x7f25081409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24fdd9b640 1 -- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2508143e80 msgr2=0x7f25081409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24fdd9b640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2508143e80 0x7f25081409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24fdd9b640 1 -- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080caee0 msgr2=0x7f2508159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24fdd9b640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080caee0 0x7f2508159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24fdd9b640 1 -- 172.21.15.53:0/2883382454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500009b30 con 0x7f25080cd320 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24fdd9b640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080acb40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d800 tx=0x7f24f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24ff7fe640 1 -- 172.21.15.53:0/2883382454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00096a0 con 0x7f25080cd320 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24ff7fe640 1 -- 172.21.15.53:0/2883382454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f0009800 con 0x7f25080cd320 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25080b31d0 con 0x7f25080cd320 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24ff7fe640 1 -- 172.21.15.53:0/2883382454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0009990 con 0x7f25080cd320 2024-09-13T18:25:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2508164890 con 0x7f25080cd320 2024-09-13T18:25:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25080ce110 con 0x7f25080cd320 2024-09-13T18:25:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24ff7fe640 1 -- 172.21.15.53:0/2883382454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24f0009af0 con 0x7f25080cd320 2024-09-13T18:25:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24ff7fe640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f24e8066690 0x7f24e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f24ff7fe640 1 -- 172.21.15.53:0/2883382454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f24f0084630 con 0x7f25080cd320 2024-09-13T18:25:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.505+0000 7f250659c640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f24e8066690 0x7f24e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.509+0000 7f250659c640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f24e8066690 0x7f24e8068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24f800ba10 tx=0x7f24f8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.509+0000 7f24ff7fe640 1 -- 172.21.15.53:0/2883382454 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24f0051920 con 0x7f25080cd320 2024-09-13T18:25:39.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.669+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25080709e0 con 0x7f25080cd320 2024-09-13T18:25:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.669+0000 7f24ff7fe640 1 -- 172.21.15.53:0/2883382454 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24f0054f40 con 0x7f25080cd320 2024-09-13T18:25:39.674 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f24e8066690 msgr2=0x7f24e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f24e8066690 0x7f24e8068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24f800ba10 tx=0x7f24f8008040 comp rx=0 tx=0).stop 2024-09-13T18:25:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 msgr2=0x7f25080acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080acb40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24f000d800 tx=0x7f24f000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 shutdown_connections 2024-09-13T18:25:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f24e8066690 0x7f24e8068b50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2508143e80 0x7f25081409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25080cd320 0x7f25080acb40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 --2- 172.21.15.53:0/2883382454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080caee0 0x7f2508159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 >> 172.21.15.53:0/2883382454 conn(0x7f2508065c80 msgr2=0x7f25080b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 shutdown_connections 2024-09-13T18:25:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.673+0000 7f250c9d3640 1 -- 172.21.15.53:0/2883382454 wait complete. 2024-09-13T18:25:39.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:39.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.809+0000 7f91e26ef640 1 Processor -- start 2024-09-13T18:25:39.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.809+0000 7f91e26ef640 1 -- start start 2024-09-13T18:25:39.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e26ef640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91dc0cb980 0x7f91dc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e26ef640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 0x7f91dc0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e26ef640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc0b1ac0 con 0x7f91dc06b850 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e26ef640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc0b3010 con 0x7f91dc0cb980 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e26ef640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc159ac0 con 0x7f91dc0cbd60 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91d37fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f91dc06b850 0x7f91dc06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52884/0 (socket says 172.21.15.53:52884) 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91d37fe640 1 -- 172.21.15.53:0/2760312304 learned_addr learned my addr 172.21.15.53:0/2760312304 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 --2- 172.21.15.53:0/2760312304 >> v2:172.21.15.87:3300/0 conn(0x7f91dc0cb980 0x7f91dc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e0c8c640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 0x7f91dc0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925689815 0 0) 0x7f91dc0b1ac0 con 0x7f91dc06b850 2024-09-13T18:25:39.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c8003530 con 0x7f91dc06b850 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714136525 0 0) 0x7f91c8003530 con 0x7f91dc06b850 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 msgr2=0x7f91dc0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 0x7f91dc0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 >> v2:172.21.15.87:3300/0 conn(0x7f91dc0cb980 msgr2=0x7f91dc0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 --2- 172.21.15.53:0/2760312304 >> v2:172.21.15.87:3300/0 conn(0x7f91dc0cb980 0x7f91dc0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc159da0 con 0x7f91dc06b850 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f91c4001680 con 0x7f91dc06b850 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 >> v1:172.21.15.53:6789/0 conn(0x7f91dc06b850 legacy=0x7f91dc06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 0x7f91c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91c8004d10 0x7f91c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0b3010 con 0x7f91c8003980 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc159ac0 con 0x7f91c8004d10 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c800dbd0 con 0x7f91dc0cbd60 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91d37fe640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 0x7f91c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e0c8c640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91c8004d10 0x7f91c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 -- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 msgr2=0x7f91c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc0cbd60 0x7f91c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 -- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91c8004d10 msgr2=0x7f91c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91c8004d10 0x7f91c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 -- 172.21.15.53:0/2760312304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8003530 con 0x7f91c8003980 2024-09-13T18:25:39.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91e0c8c640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91c8004d10 0x7f91c8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:39.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91dbfff640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91c8003da0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009ae0 tx=0x7f91cc01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bde28573cdcce08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.813+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0a5650 con 0x7f91c8003980 2024-09-13T18:25:39.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc0a57b0 con 0x7f91c8003980 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91db7fe640 1 -- 172.21.15.53:0/2760312304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0a5b60 con 0x7f91c8003980 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- 172.21.15.53:0/2760312304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 msgr2=0x7f91c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 --2- 172.21.15.53:0/2760312304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91c8003da0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009ae0 tx=0x7f91cc01ca80 comp rx=0 tx=0).stop 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e0c8c640 1 -- 172.21.15.53:0/2760312304 reap_dead start 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- 172.21.15.53:0/2760312304 shutdown_connections 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- 172.21.15.53:0/2760312304 >> 172.21.15.53:0/2760312304 conn(0x7f91dc065c80 msgr2=0x7f91dc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- 172.21.15.53:0/2760312304 shutdown_connections 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- 172.21.15.53:0/2760312304 wait complete. 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 Processor -- start 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- start start 2024-09-13T18:25:39.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91dc15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc06cbc0 0x7f91dc14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91dc06d040 0x7f91dc14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc151c50 con 0x7f91c8003980 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc140f60 con 0x7f91dc06d040 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc15c860 con 0x7f91dc06cbc0 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91dc15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91dc15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41524/0 (socket says 172.21.15.53:41524) 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 -- 172.21.15.53:0/3245225667 learned_addr learned my addr 172.21.15.53:0/3245225667 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91d37fe640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc06cbc0 0x7f91dc14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e0c8c640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91dc06d040 0x7f91dc14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 -- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc06cbc0 msgr2=0x7f91dc14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc06cbc0 0x7f91dc14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 -- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91dc06d040 msgr2=0x7f91dc14dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91dc06d040 0x7f91dc14dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 -- 172.21.15.53:0/3245225667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc15c5c0 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e0c8c640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91dc06d040 0x7f91dc14dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91dbfff640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91dc15c080 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0b0040 tx=0x7f91c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91d97fa640 1 -- 172.21.15.53:0/3245225667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0a5650 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91d97fa640 1 -- 172.21.15.53:0/3245225667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc004020 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc151e40 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91d97fa640 1 -- 172.21.15.53:0/3245225667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0043d0 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.817+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc1526e0 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.821+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc067400 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.821+0000 7f91d97fa640 1 -- 172.21.15.53:0/3245225667 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91cc0b4040 con 0x7f91c8003980 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.821+0000 7f91d97fa640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91bc066690 0x7f91bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.821+0000 7f91d97fa640 1 -- 172.21.15.53:0/3245225667 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f91cc11e3a0 con 0x7f91c8003980 2024-09-13T18:25:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.821+0000 7f91d37fe640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91bc066690 0x7f91bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.821+0000 7f91d37fe640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91bc066690 0x7f91bc068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91dc14ea30 tx=0x7f91c4007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.825+0000 7f91d97fa640 1 -- 172.21.15.53:0/3245225667 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f91cc0eb7c0 con 0x7f91c8003980 2024-09-13T18:25:40.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.997+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f91dc152240 con 0x7f91c8003980 2024-09-13T18:25:40.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:39.997+0000 7f91d97fa640 1 -- 172.21.15.53:0/3245225667 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f91cc0eede0 con 0x7f91c8003980 2024-09-13T18:25:40.002 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:40.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91bc066690 msgr2=0x7f91bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91bc066690 0x7f91bc068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f91dc14ea30 tx=0x7f91c4007040 comp rx=0 tx=0).stop 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 msgr2=0x7f91dc15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91dc15c080 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0b0040 tx=0x7f91c8005800 comp rx=0 tx=0).stop 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 shutdown_connections 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91bc066690 0x7f91bc068b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91dc06cbc0 0x7f91dc14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91dc06d040 0x7f91dc14dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 --2- 172.21.15.53:0/3245225667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91c8003980 0x7f91dc15c080 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 >> 172.21.15.53:0/3245225667 conn(0x7f91dc065c80 msgr2=0x7f91dc14fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:40.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 shutdown_connections 2024-09-13T18:25:40.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.001+0000 7f91e26ef640 1 -- 172.21.15.53:0/3245225667 wait complete. 2024-09-13T18:25:40.020 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:25:40.020 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:40.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:40.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea43c9d640 1 Processor -- start 2024-09-13T18:25:40.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea43c9d640 1 -- start start 2024-09-13T18:25:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea43c9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fea3c0cb980 0x7fea3c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea43c9d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0b1ac0 con 0x7fea3c06b850 2024-09-13T18:25:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea43c9d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c159ac0 con 0x7fea3c0cbd60 2024-09-13T18:25:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea43c9d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3c159da0 con 0x7fea3c0cb980 2024-09-13T18:25:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea41238640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fea3c06b850 0x7fea3c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52894/0 (socket says 172.21.15.53:52894) 2024-09-13T18:25:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea41238640 1 -- 172.21.15.53:0/3764321251 learned_addr learned my addr 172.21.15.53:0/3764321251 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:40.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea41a39640 1 --2- 172.21.15.53:0/3764321251 >> v2:172.21.15.87:3300/0 conn(0x7fea3c0cb980 0x7fea3c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964479813 0 0) 0x7fea3c0b1ac0 con 0x7fea3c06b850 2024-09-13T18:25:40.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea28003530 con 0x7fea3c06b850 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883064805 0 0) 0x7fea28003530 con 0x7fea3c06b850 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 >> v2:172.21.15.87:3300/0 conn(0x7fea3c0cb980 msgr2=0x7fea3c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 --2- 172.21.15.53:0/3764321251 >> v2:172.21.15.87:3300/0 conn(0x7fea3c0cb980 0x7fea3c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 >> v1:172.21.15.87:6789/0 conn(0x7fea3c0cbd60 legacy=0x7fea3c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c15a080 con 0x7fea3c06b850 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fea2c001680 con 0x7fea3c06b850 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea41a39640 1 --2- 172.21.15.53:0/3764321251 >> v2:172.21.15.87:3300/0 conn(0x7fea3c0cb980 0x7fea3c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 >> v1:172.21.15.53:6789/0 conn(0x7fea3c06b850 legacy=0x7fea3c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea28003980 0x7fea28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea280047d0 0x7fea28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea28005190 0x7fea2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c159da0 con 0x7fea28005190 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2800c130 con 0x7fea28003980 2024-09-13T18:25:40.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2800c2f0 con 0x7fea280047d0 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea4223a640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea28005190 0x7fea2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea41a39640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea28003980 0x7fea28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea41238640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea280047d0 0x7fea28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea4223a640 1 -- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea280047d0 msgr2=0x7fea28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea4223a640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea280047d0 0x7fea28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea4223a640 1 -- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea28003980 msgr2=0x7fea28003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea4223a640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea28003980 0x7fea28003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea4223a640 1 -- 172.21.15.53:0/3764321251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28003530 con 0x7fea28005190 2024-09-13T18:25:40.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.185+0000 7fea41a39640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea28003980 0x7fea28003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:40.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea4223a640 1 -- 172.21.15.53:0/3764321251 reap_dead start 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea4223a640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea28005190 0x7fea2800b990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fea34001e40 tx=0x7fea3401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea47fe468ff15654 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34003b80 con 0x7fea28005190 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea34003ce0 con 0x7fea28005190 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea40a37640 1 -- 172.21.15.53:0/3764321251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340052f0 con 0x7fea28005190 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 -- 172.21.15.53:0/3764321251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea28005190 msgr2=0x7fea2800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea28005190 0x7fea2800b990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fea34001e40 tx=0x7fea3401c760 comp rx=0 tx=0).stop 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 -- 172.21.15.53:0/3764321251 shutdown_connections 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3764321251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea28005190 0x7fea2800b990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 -- 172.21.15.53:0/3764321251 >> 172.21.15.53:0/3764321251 conn(0x7fea3c065c80 msgr2=0x7fea3c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 -- 172.21.15.53:0/3764321251 shutdown_connections 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 -- 172.21.15.53:0/3764321251 wait complete. 2024-09-13T18:25:40.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 Processor -- start 2024-09-13T18:25:40.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.189+0000 7fea43c9d640 1 -- start start 2024-09-13T18:25:40.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea28005190 0x7fea3c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea3c148e40 0x7fea3c151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3c1f1330 0x7fea3c06bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c149370 con 0x7fea3c1f1330 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c1497f0 con 0x7fea3c148e40 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c149ad0 con 0x7fea28005190 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3c1f1330 0x7fea3c06bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3c1f1330 0x7fea3c06bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41534/0 (socket says 172.21.15.53:41534) 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 -- 172.21.15.53:0/3794069384 learned_addr learned my addr 172.21.15.53:0/3794069384 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea41a39640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea28005190 0x7fea3c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea41238640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea3c148e40 0x7fea3c151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 -- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea28005190 msgr2=0x7fea3c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea28005190 0x7fea3c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 -- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea3c148e40 msgr2=0x7fea3c151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea3c148e40 0x7fea3c151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 -- 172.21.15.53:0/3794069384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c149db0 con 0x7fea3c1f1330 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea4223a640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3c1f1330 0x7fea3c06bf00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fea3401d000 tx=0x7fea28005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea327fc640 1 -- 172.21.15.53:0/3794069384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340ae070 con 0x7fea3c1f1330 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea327fc640 1 -- 172.21.15.53:0/3794069384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea34001260 con 0x7fea3c1f1330 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c14a090 con 0x7fea3c1f1330 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea327fc640 1 -- 172.21.15.53:0/3794069384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34006b60 con 0x7fea3c1f1330 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c1f1790 con 0x7fea3c1f1330 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c067400 con 0x7fea3c1f1330 2024-09-13T18:25:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea327fc640 1 -- 172.21.15.53:0/3794069384 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea340a9450 con 0x7fea3c1f1330 2024-09-13T18:25:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea327fc640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fea200666c0 0x7fea20068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea327fc640 1 -- 172.21.15.53:0/3794069384 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fea3411d150 con 0x7fea3c1f1330 2024-09-13T18:25:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea41a39640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fea200666c0 0x7fea20068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.193+0000 7fea41a39640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fea200666c0 0x7fea20068b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea38009b40 tx=0x7fea38008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.197+0000 7fea327fc640 1 -- 172.21.15.53:0/3794069384 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea340ea440 con 0x7fea3c1f1330 2024-09-13T18:25:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.353+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea3c150a20 con 0x7fea3c1f1330 2024-09-13T18:25:40.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.353+0000 7fea327fc640 1 -- 172.21.15.53:0/3794069384 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16639 (secure 0 0 0) 0x7fea340eda60 con 0x7fea3c1f1330 2024-09-13T18:25:40.357 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:40.357 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:40.061767+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fea200666c0 msgr2=0x7fea20068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fea200666c0 0x7fea20068b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea38009b40 tx=0x7fea38008040 comp rx=0 tx=0).stop 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3c1f1330 msgr2=0x7fea3c06bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3c1f1330 0x7fea3c06bf00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fea3401d000 tx=0x7fea28005800 comp rx=0 tx=0).stop 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 shutdown_connections 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fea200666c0 0x7fea20068b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea3c1f1330 0x7fea3c06bf00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea3c148e40 0x7fea3c151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 --2- 172.21.15.53:0/3794069384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea28005190 0x7fea3c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 >> 172.21.15.53:0/3794069384 conn(0x7fea3c065c80 msgr2=0x7fea3c1583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 shutdown_connections 2024-09-13T18:25:40.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.357+0000 7fea43c9d640 1 -- 172.21.15.53:0/3794069384 wait complete. 2024-09-13T18:25:40.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:40.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f75f8640 1 Processor -- start 2024-09-13T18:25:40.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f75f8640 1 -- start start 2024-09-13T18:25:40.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f75f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe0f00ccf10 0x7fe0f00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f75f8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00b2bf0 0x7fe0f00cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f75f8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f00ccd60 con 0x7fe0f00ced50 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f75f8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f00cd830 con 0x7fe0f00ccf10 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f75f8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f00cc190 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f5394640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe0f00ccf10 0x7fe0f00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f5394640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe0f00ccf10 0x7fe0f00cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41550/0 (socket says 172.21.15.53:41550) 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f5394640 1 -- 172.21.15.53:0/458608736 learned_addr learned my addr 172.21.15.53:0/458608736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f4b93640 1 --2- 172.21.15.53:0/458608736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00b2bf0 0x7fe0f00cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f5394640 1 -- 172.21.15.53:0/458608736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00b2bf0 msgr2=0x7fe0f00cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f5394640 1 --2- 172.21.15.53:0/458608736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00b2bf0 0x7fe0f00cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f5394640 1 -- 172.21.15.53:0/458608736 >> v1:172.21.15.87:6789/0 conn(0x7fe0f00ced50 legacy=0x7fe0f00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:40.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.501+0000 7fe0f5394640 1 -- 172.21.15.53:0/458608736 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f00ce270 con 0x7fe0f00ccf10 2024-09-13T18:25:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f5394640 1 --2- 172.21.15.53:0/458608736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00ccf10 0x7fe0f00cbab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e50 tx=0x7fe0ec01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572083a252c39471 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0e7fff640 1 -- 172.21.15.53:0/458608736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0a57b0 con 0x7fe0f00ccf10 2024-09-13T18:25:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0e7fff640 1 -- 172.21.15.53:0/458608736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec0a5910 con 0x7fe0f00ccf10 2024-09-13T18:25:40.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0e7fff640 1 -- 172.21.15.53:0/458608736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0a5ca0 con 0x7fe0f00ccf10 2024-09-13T18:25:40.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- 172.21.15.53:0/458608736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00ccf10 msgr2=0x7fe0f00cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/458608736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00ccf10 0x7fe0f00cbab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e50 tx=0x7fe0ec01c930 comp rx=0 tx=0).stop 2024-09-13T18:25:40.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- 172.21.15.53:0/458608736 shutdown_connections 2024-09-13T18:25:40.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/458608736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00b2bf0 0x7fe0f00cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/458608736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00ccf10 0x7fe0f00cbab0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- 172.21.15.53:0/458608736 >> 172.21.15.53:0/458608736 conn(0x7fe0f00b20d0 msgr2=0x7fe0f00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- 172.21.15.53:0/458608736 shutdown_connections 2024-09-13T18:25:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- 172.21.15.53:0/458608736 wait complete. 2024-09-13T18:25:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 Processor -- start 2024-09-13T18:25:40.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- start start 2024-09-13T18:25:40.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00b2bf0 0x7fe0f00b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00ccf10 0x7fe0f00b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0f00ced50 0x7fe0f00c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f00ca570 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f0150ea0 con 0x7fe0f00ced50 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f75f8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f0151180 con 0x7fe0f00ccf10 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f5394640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00b2bf0 0x7fe0f00b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f5394640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00b2bf0 0x7fe0f00b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41562/0 (socket says 172.21.15.53:41562) 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.505+0000 7fe0f5394640 1 -- 172.21.15.53:0/2832758489 learned_addr learned my addr 172.21.15.53:0/2832758489 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f4b93640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00ccf10 0x7fe0f00b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f5b95640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0f00ced50 0x7fe0f00c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f5394640 1 -- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00ccf10 msgr2=0x7fe0f00b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f5394640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00ccf10 0x7fe0f00b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f5394640 1 -- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0f00ced50 msgr2=0x7fe0f00c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f5394640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0f00ced50 0x7fe0f00c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f5394640 1 -- 172.21.15.53:0/2832758489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec009b30 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f5394640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00b2bf0 0x7fe0f00b5470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec01afe0 tx=0x7fe0ec0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0e5ffb640 1 -- 172.21.15.53:0/2832758489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0b8670 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0e5ffb640 1 -- 172.21.15.53:0/2832758489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec0b87d0 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f0151460 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0e5ffb640 1 -- 172.21.15.53:0/2832758489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0b8b60 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f00c75d0 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f00cd2f0 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0e5ffb640 1 -- 172.21.15.53:0/2832758489 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0ec0b8cc0 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0e5ffb640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe0d4066690 0x7fe0d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0e5ffb640 1 -- 172.21.15.53:0/2832758489 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe0ec11f7d0 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f4b93640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe0d4066690 0x7fe0d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.509+0000 7fe0f4b93640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe0d4066690 0x7fe0d4068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0159e40 tx=0x7fe0e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.513+0000 7fe0e5ffb640 1 -- 172.21.15.53:0/2832758489 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0ec0ecc10 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.669+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0f0066a00 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.669+0000 7fe0e5ffb640 1 -- 172.21.15.53:0/2832758489 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0ec0bc020 con 0x7fe0f00b2bf0 2024-09-13T18:25:40.673 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe0d4066690 msgr2=0x7fe0d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe0d4066690 0x7fe0d4068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0159e40 tx=0x7fe0e0008040 comp rx=0 tx=0).stop 2024-09-13T18:25:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00b2bf0 msgr2=0x7fe0f00b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00b2bf0 0x7fe0f00b5470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec01afe0 tx=0x7fe0ec0196d0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 shutdown_connections 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe0d4066690 0x7fe0d4068b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0f00ccf10 0x7fe0f00b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0f00ced50 0x7fe0f00c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 --2- 172.21.15.53:0/2832758489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0f00b2bf0 0x7fe0f00b5470 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 >> 172.21.15.53:0/2832758489 conn(0x7fe0f00b20d0 msgr2=0x7fe0f01568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 shutdown_connections 2024-09-13T18:25:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.673+0000 7fe0f75f8640 1 -- 172.21.15.53:0/2832758489 wait complete. 2024-09-13T18:25:40.691 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.805+0000 7f6ecfd37640 1 Processor -- start 2024-09-13T18:25:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ecfd37640 1 -- start start 2024-09-13T18:25:40.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ecfd37640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ec80d3390 0x7f6ec80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ecfd37640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80b7db0 con 0x7f6ec815c830 2024-09-13T18:25:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ecfd37640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80d0650 con 0x7f6ec80ccd10 2024-09-13T18:25:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ecfd37640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80d0c10 con 0x7f6ec80d3390 2024-09-13T18:25:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ece2d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ec80d3390 0x7f6ec80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ecdad3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ec815c830 0x7f6ec80d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52900/0 (socket says 172.21.15.53:52900) 2024-09-13T18:25:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ece2d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ec80d3390 0x7f6ec80cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41570/0 (socket says 172.21.15.53:41570) 2024-09-13T18:25:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ecdad3640 1 -- 172.21.15.53:0/4062694861 learned_addr learned my addr 172.21.15.53:0/4062694861 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ece2d4640 1 -- 172.21.15.53:0/4062694861 >> v1:172.21.15.87:6789/0 conn(0x7f6ec80ccd10 legacy=0x7f6ec80d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ece2d4640 1 -- 172.21.15.53:0/4062694861 >> v1:172.21.15.53:6789/0 conn(0x7f6ec815c830 legacy=0x7f6ec80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ece2d4640 1 -- 172.21.15.53:0/4062694861 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80d17b0 con 0x7f6ec80d3390 2024-09-13T18:25:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6ece2d4640 1 --2- 172.21.15.53:0/4062694861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec80cd180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009d90 tx=0x7f6ec001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8cd64dfe62a917 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6eccad1640 1 -- 172.21.15.53:0/4062694861 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00a58e0 con 0x7f6ec80d3390 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6eccad1640 1 -- 172.21.15.53:0/4062694861 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec00a5a40 con 0x7f6ec80d3390 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.809+0000 7f6eccad1640 1 -- 172.21.15.53:0/4062694861 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00a5dd0 con 0x7f6ec80d3390 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- 172.21.15.53:0/4062694861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 msgr2=0x7f6ec80cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/4062694861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec80cd180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009d90 tx=0x7f6ec001c930 comp rx=0 tx=0).stop 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- 172.21.15.53:0/4062694861 shutdown_connections 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/4062694861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec80cd180 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- 172.21.15.53:0/4062694861 >> 172.21.15.53:0/4062694861 conn(0x7f6ec8070970 msgr2=0x7f6ec8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- 172.21.15.53:0/4062694861 shutdown_connections 2024-09-13T18:25:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- 172.21.15.53:0/4062694861 wait complete. 2024-09-13T18:25:40.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 Processor -- start 2024-09-13T18:25:40.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- start start 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ec80ccd10 0x7f6ec80cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec815c830 0x7f6ec8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81f6330 con 0x7f6ec80d3390 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80cbc10 con 0x7f6ec815c830 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81f5290 con 0x7f6ec80ccd10 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec814e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41586/0 (socket says 172.21.15.53:41586) 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 -- 172.21.15.53:0/818552391 learned_addr learned my addr 172.21.15.53:0/818552391 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:40.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ece2d4640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec815c830 0x7f6ec8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecdad3640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ec80ccd10 0x7f6ec80cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 -- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ec80ccd10 msgr2=0x7f6ec80cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ec80ccd10 0x7f6ec80cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 -- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec815c830 msgr2=0x7f6ec8151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec815c830 0x7f6ec8151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 -- 172.21.15.53:0/818552391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0009a70 con 0x7f6ec80d3390 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ece2d4640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec815c830 0x7f6ec8151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecd2d2640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec814e3e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c450 tx=0x7f6eb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ebe7fc640 1 -- 172.21.15.53:0/818552391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8012830 con 0x7f6ec80d3390 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ebe7fc640 1 -- 172.21.15.53:0/818552391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb80129b0 con 0x7f6ec80d3390 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec81f5570 con 0x7f6ec80d3390 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ebe7fc640 1 -- 172.21.15.53:0/818552391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8012d60 con 0x7f6ec80d3390 2024-09-13T18:25:40.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.813+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec81f5b30 con 0x7f6ec80d3390 2024-09-13T18:25:40.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.817+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec80cd180 con 0x7f6ec80d3390 2024-09-13T18:25:40.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.817+0000 7f6ebe7fc640 1 -- 172.21.15.53:0/818552391 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6eb801c460 con 0x7f6ec80d3390 2024-09-13T18:25:40.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.817+0000 7f6ebe7fc640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6eac066690 0x7f6eac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:40.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.817+0000 7f6ebe7fc640 1 -- 172.21.15.53:0/818552391 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6eb8084070 con 0x7f6ec80d3390 2024-09-13T18:25:40.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.817+0000 7f6ecdad3640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6eac066690 0x7f6eac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:40.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.817+0000 7f6ecdad3640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6eac066690 0x7f6eac068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4000f70 tx=0x7f6ec4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:40.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.821+0000 7f6ebe7fc640 1 -- 172.21.15.53:0/818552391 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6eb8051370 con 0x7f6ec80d3390 2024-09-13T18:25:40.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.973+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ec80cfcc0 con 0x7f6ec80d3390 2024-09-13T18:25:40.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.973+0000 7f6ebe7fc640 1 -- 172.21.15.53:0/818552391 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6eb8054990 con 0x7f6ec80d3390 2024-09-13T18:25:40.977 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6eac066690 msgr2=0x7f6eac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6eac066690 0x7f6eac068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4000f70 tx=0x7f6ec4009040 comp rx=0 tx=0).stop 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 msgr2=0x7f6ec814e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec814e3e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c450 tx=0x7f6eb800c910 comp rx=0 tx=0).stop 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 shutdown_connections 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6eac066690 0x7f6eac068b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec815c830 0x7f6ec8151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ec80d3390 0x7f6ec814e3e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 --2- 172.21.15.53:0/818552391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ec80ccd10 0x7f6ec80cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 >> 172.21.15.53:0/818552391 conn(0x7f6ec8070970 msgr2=0x7f6ec80b8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 shutdown_connections 2024-09-13T18:25:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:40.977+0000 7f6ecfd37640 1 -- 172.21.15.53:0/818552391 wait complete. 2024-09-13T18:25:40.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:41.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9c313640 1 Processor -- start 2024-09-13T18:25:41.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9c313640 1 -- start start 2024-09-13T18:25:41.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9c313640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94157020 0x7f8b9406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9c313640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b9406d270 0x7f8b9406f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9c313640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9406d6e0 con 0x7f8b94156c40 2024-09-13T18:25:41.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9c313640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b940715f0 con 0x7f8b9406d270 2024-09-13T18:25:41.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9c313640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940b15a0 con 0x7f8b94157020 2024-09-13T18:25:41.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8b94156c40 0x7f8b94070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52908/0 (socket says 172.21.15.53:52908) 2024-09-13T18:25:41.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 -- 172.21.15.53:0/3013811395 learned_addr learned my addr 172.21.15.53:0/3013811395 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:41.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269251544 0 0) 0x7f8b9406d6e0 con 0x7f8b94156c40 2024-09-13T18:25:41.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b80005740 con 0x7f8b94156c40 2024-09-13T18:25:41.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a8b0640 1 --2- 172.21.15.53:0/3013811395 >> v2:172.21.15.87:3300/0 conn(0x7f8b9406d270 0x7f8b9406f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b998ae640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94157020 0x7f8b9406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4133653836 0 0) 0x7f8b80005740 con 0x7f8b94156c40 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94157020 msgr2=0x7f8b9406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94157020 0x7f8b9406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 >> v2:172.21.15.87:3300/0 conn(0x7f8b9406d270 msgr2=0x7f8b9406f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 --2- 172.21.15.53:0/3013811395 >> v2:172.21.15.87:3300/0 conn(0x7f8b9406d270 0x7f8b9406f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940b1880 con 0x7f8b94156c40 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8b90001680 con 0x7f8b94156c40 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 >> v1:172.21.15.53:6789/0 conn(0x7f8b94156c40 legacy=0x7f8b94070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b80005b90 0x7f8b80005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b800069e0 0x7f8b80006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80007360 0x7f8b8000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940715f0 con 0x7f8b80005b90 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940b15a0 con 0x7f8b80007360 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8000e0e0 con 0x7f8b800069e0 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b80005b90 0x7f8b80005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b998ae640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b800069e0 0x7f8b80006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a8b0640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80007360 0x7f8b8000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 -- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b800069e0 msgr2=0x7f8b80006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b800069e0 0x7f8b80006e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 -- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80007360 msgr2=0x7f8b8000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80007360 0x7f8b8000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a0af640 1 -- 172.21.15.53:0/3013811395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80005740 con 0x7f8b80005b90 2024-09-13T18:25:41.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.109+0000 7f8b9a8b0640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80007360 0x7f8b8000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a0af640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b80005b90 0x7f8b80005fb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000c240 tx=0x7f8b9001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e06c221834c98d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900a5930 con 0x7f8b80005b90 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b900a5a90 con 0x7f8b80005b90 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b990ad640 1 -- 172.21.15.53:0/3013811395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900a5e60 con 0x7f8b80005b90 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- 172.21.15.53:0/3013811395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b80005b90 msgr2=0x7f8b80005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 --2- 172.21.15.53:0/3013811395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b80005b90 0x7f8b80005fb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000c240 tx=0x7f8b9001cc50 comp rx=0 tx=0).stop 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 -- 172.21.15.53:0/3013811395 reap_dead start 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- 172.21.15.53:0/3013811395 shutdown_connections 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- 172.21.15.53:0/3013811395 >> 172.21.15.53:0/3013811395 conn(0x7f8b94065c80 msgr2=0x7f8b94066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- 172.21.15.53:0/3013811395 shutdown_connections 2024-09-13T18:25:41.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- 172.21.15.53:0/3013811395 wait complete. 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 Processor -- start 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- start start 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80005b90 0x7f8b94148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94159820 0x7f8b94149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b94149e50 0x7f8b9415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9414a300 con 0x7f8b94149e50 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941494a0 con 0x7f8b80005b90 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9c313640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9415d0a0 con 0x7f8b94159820 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b94149e50 0x7f8b9415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b94149e50 0x7f8b9415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41600/0 (socket says 172.21.15.53:41600) 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 -- 172.21.15.53:0/1284161586 learned_addr learned my addr 172.21.15.53:0/1284161586 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 -- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94159820 msgr2=0x7f8b94149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94159820 0x7f8b94149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 -- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80005b90 msgr2=0x7f8b94148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80005b90 0x7f8b94148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.113+0000 7f8b9a8b0640 1 -- 172.21.15.53:0/1284161586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9415d380 con 0x7f8b94149e50 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b9a8b0640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b94149e50 0x7f8b9415f100 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8b94067360 tx=0x7f8b8c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b8affd640 1 -- 172.21.15.53:0/1284161586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c016620 con 0x7f8b94149e50 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b8affd640 1 -- 172.21.15.53:0/1284161586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c016780 con 0x7f8b94149e50 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9415d660 con 0x7f8b94149e50 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b8affd640 1 -- 172.21.15.53:0/1284161586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c016b10 con 0x7f8b94149e50 2024-09-13T18:25:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9415dc20 con 0x7f8b94149e50 2024-09-13T18:25:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b94158440 con 0x7f8b94149e50 2024-09-13T18:25:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b8affd640 1 -- 172.21.15.53:0/1284161586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b8c016c70 con 0x7f8b94149e50 2024-09-13T18:25:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b8affd640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8b780666c0 0x7f8b78068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b8affd640 1 -- 172.21.15.53:0/1284161586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8b8c084df0 con 0x7f8b94149e50 2024-09-13T18:25:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b9a0af640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8b780666c0 0x7f8b78068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.117+0000 7f8b9a0af640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8b780666c0 0x7f8b78068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b900aa000 tx=0x7f8b90001a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.121+0000 7f8b8affd640 1 -- 172.21.15.53:0/1284161586 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b94158440 con 0x7f8b94149e50 2024-09-13T18:25:41.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.273+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b94158440 con 0x7f8b94149e50 2024-09-13T18:25:41.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.273+0000 7f8b8affd640 1 -- 172.21.15.53:0/1284161586 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b94158440 con 0x7f8b94149e50 2024-09-13T18:25:41.278 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8b780666c0 msgr2=0x7f8b78068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8b780666c0 0x7f8b78068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b900aa000 tx=0x7f8b90001a10 comp rx=0 tx=0).stop 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b94149e50 msgr2=0x7f8b9415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b94149e50 0x7f8b9415f100 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8b94067360 tx=0x7f8b8c00f520 comp rx=0 tx=0).stop 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 shutdown_connections 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8b780666c0 0x7f8b78068b80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b94159820 0x7f8b94149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b94149e50 0x7f8b9415f100 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 --2- 172.21.15.53:0/1284161586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b80005b90 0x7f8b94148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 >> 172.21.15.53:0/1284161586 conn(0x7f8b94065c80 msgr2=0x7f8b940cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:41.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 shutdown_connections 2024-09-13T18:25:41.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.277+0000 7f8b9c313640 1 -- 172.21.15.53:0/1284161586 wait complete. 2024-09-13T18:25:41.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:41.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad7dd8c640 1 Processor -- start 2024-09-13T18:25:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad7dd8c640 1 -- start start 2024-09-13T18:25:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad7dd8c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad7815cdc0 0x7fad7815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad7dd8c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7806d980 con 0x7fad7815d760 2024-09-13T18:25:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad7dd8c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7806d650 con 0x7fad7815a3b0 2024-09-13T18:25:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad7dd8c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad780d1560 con 0x7fad7815cdc0 2024-09-13T18:25:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad76ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad7815cdc0 0x7fad7815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad77fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fad7815d760 0x7fad7806de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52920/0 (socket says 172.21.15.53:52920) 2024-09-13T18:25:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad77fff640 1 -- 172.21.15.53:0/1858769398 learned_addr learned my addr 172.21.15.53:0/1858769398 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad767fc640 1 -- 172.21.15.53:0/1858769398 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460433697 0 0) 0x7fad7806d980 con 0x7fad7815d760 2024-09-13T18:25:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad767fc640 1 -- 172.21.15.53:0/1858769398 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad64003530 con 0x7fad7815d760 2024-09-13T18:25:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad76ffd640 1 -- 172.21.15.53:0/1858769398 >> v1:172.21.15.87:6789/0 conn(0x7fad7815a3b0 legacy=0x7fad780b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad76ffd640 1 -- 172.21.15.53:0/1858769398 >> v1:172.21.15.53:6789/0 conn(0x7fad7815d760 legacy=0x7fad7806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.405+0000 7fad76ffd640 1 -- 172.21.15.53:0/1858769398 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780b53e0 con 0x7fad7815cdc0 2024-09-13T18:25:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad76ffd640 1 --2- 172.21.15.53:0/1858769398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815cdc0 0x7fad7815d220 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad68009d90 tx=0x7fad6801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76b1c2e34646837 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad767fc640 1 -- 172.21.15.53:0/1858769398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680a59e0 con 0x7fad7815cdc0 2024-09-13T18:25:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad767fc640 1 -- 172.21.15.53:0/1858769398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad680a5b40 con 0x7fad7815cdc0 2024-09-13T18:25:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad767fc640 1 -- 172.21.15.53:0/1858769398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680ad440 con 0x7fad7815cdc0 2024-09-13T18:25:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- 172.21.15.53:0/1858769398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815cdc0 msgr2=0x7fad7815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/1858769398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815cdc0 0x7fad7815d220 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad68009d90 tx=0x7fad6801c940 comp rx=0 tx=0).stop 2024-09-13T18:25:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- 172.21.15.53:0/1858769398 shutdown_connections 2024-09-13T18:25:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/1858769398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815cdc0 0x7fad7815d220 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- 172.21.15.53:0/1858769398 >> 172.21.15.53:0/1858769398 conn(0x7fad78071a50 msgr2=0x7fad78099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- 172.21.15.53:0/1858769398 shutdown_connections 2024-09-13T18:25:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- 172.21.15.53:0/1858769398 wait complete. 2024-09-13T18:25:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 Processor -- start 2024-09-13T18:25:41.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- start start 2024-09-13T18:25:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815a3b0 0x7fad781487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad7815cdc0 0x7fad781514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7815d760 0x7fad781519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad78148d20 con 0x7fad7815a3b0 2024-09-13T18:25:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad78152020 con 0x7fad7815d760 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad7dd8c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7814ff70 con 0x7fad7815cdc0 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815a3b0 0x7fad781487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815a3b0 0x7fad781487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41628/0 (socket says 172.21.15.53:41628) 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.409+0000 7fad777fe640 1 -- 172.21.15.53:0/2756474453 learned_addr learned my addr 172.21.15.53:0/2756474453 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad77fff640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7815d760 0x7fad781519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad76ffd640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad7815cdc0 0x7fad781514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad777fe640 1 -- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad7815cdc0 msgr2=0x7fad781514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad777fe640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad7815cdc0 0x7fad781514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad777fe640 1 -- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7815d760 msgr2=0x7fad781519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad777fe640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7815d760 0x7fad781519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad777fe640 1 -- 172.21.15.53:0/2756474453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68009a70 con 0x7fad7815a3b0 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad77fff640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7815d760 0x7fad781519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad777fe640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815a3b0 0x7fad781487e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c420 tx=0x7fad6000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad6ffff640 1 -- 172.21.15.53:0/2756474453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600052d0 con 0x7fad7815a3b0 2024-09-13T18:25:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad6ffff640 1 -- 172.21.15.53:0/2756474453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60005430 con 0x7fad7815a3b0 2024-09-13T18:25:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad78150250 con 0x7fad7815a3b0 2024-09-13T18:25:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad6ffff640 1 -- 172.21.15.53:0/2756474453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60007260 con 0x7fad7815a3b0 2024-09-13T18:25:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad78150810 con 0x7fad7815a3b0 2024-09-13T18:25:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7815d220 con 0x7fad7815a3b0 2024-09-13T18:25:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad6ffff640 1 -- 172.21.15.53:0/2756474453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad600073c0 con 0x7fad7815a3b0 2024-09-13T18:25:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad6ffff640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad58066690 0x7fad58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad6ffff640 1 -- 172.21.15.53:0/2756474453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fad60083680 con 0x7fad7815a3b0 2024-09-13T18:25:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad76ffd640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad58066690 0x7fad58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.413+0000 7fad76ffd640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad58066690 0x7fad58068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad680af000 tx=0x7fad680a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.417+0000 7fad6ffff640 1 -- 172.21.15.53:0/2756474453 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad600508d0 con 0x7fad7815a3b0 2024-09-13T18:25:41.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.589+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad7806fd90 con 0x7fad7815a3b0 2024-09-13T18:25:41.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.589+0000 7fad6ffff640 1 -- 172.21.15.53:0/2756474453 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fad60053ef0 con 0x7fad7815a3b0 2024-09-13T18:25:41.593 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:41.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad58066690 msgr2=0x7fad58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad58066690 0x7fad58068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad680af000 tx=0x7fad680a7070 comp rx=0 tx=0).stop 2024-09-13T18:25:41.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815a3b0 msgr2=0x7fad781487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815a3b0 0x7fad781487e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c420 tx=0x7fad6000c8e0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 shutdown_connections 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fad58066690 0x7fad58068b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad7815cdc0 0x7fad781514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad7815d760 0x7fad781519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 --2- 172.21.15.53:0/2756474453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad7815a3b0 0x7fad781487e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 >> 172.21.15.53:0/2756474453 conn(0x7fad78071a50 msgr2=0x7fad7815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 shutdown_connections 2024-09-13T18:25:41.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.593+0000 7fad7dd8c640 1 -- 172.21.15.53:0/2756474453 wait complete. 2024-09-13T18:25:41.612 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:25:41.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:41.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-13T18:25:41.624 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:41.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:25:41.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:41.625 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:25:41.674 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:25:41.674 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:41.681 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:25:41.681 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:41.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:41.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d2dd2a640 1 Processor -- start 2024-09-13T18:25:41.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d2dd2a640 1 -- start start 2024-09-13T18:25:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d2dd2a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 0x7f7d28165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d2dd2a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2806d480 con 0x7f7d2815b7c0 2024-09-13T18:25:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d2dd2a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2815ace0 con 0x7f7d281582a0 2024-09-13T18:25:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d2dd2a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2815aaf0 con 0x7f7d280713a0 2024-09-13T18:25:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d26ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7d2815b7c0 0x7f7d28070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52926/0 (socket says 172.21.15.53:52926) 2024-09-13T18:25:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.853+0000 7f7d26ffd640 1 -- 172.21.15.53:0/1196302404 learned_addr learned my addr 172.21.15.53:0/1196302404 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d27fff640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 0x7f7d28165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164019376 0 0) 0x7f7d2806d480 con 0x7f7d2815b7c0 2024-09-13T18:25:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d10003530 con 0x7f7d2815b7c0 2024-09-13T18:25:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866454840 0 0) 0x7f7d10003530 con 0x7f7d2815b7c0 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 msgr2=0x7f7d28165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 0x7f7d28165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 >> v1:172.21.15.87:6789/0 conn(0x7f7d281582a0 legacy=0x7f7d2806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2815afc0 con 0x7f7d2815b7c0 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7d1c001680 con 0x7f7d2815b7c0 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 >> v1:172.21.15.53:6789/0 conn(0x7f7d2815b7c0 legacy=0x7f7d28070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 0x7f7d100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d10003ef0 0x7f7d100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10004d10 0x7f7d10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1000ba40 con 0x7f7d10003ef0 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1000bb80 con 0x7f7d10004d10 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1000bd40 con 0x7f7d280713a0 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d10003ef0 0x7f7d100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d277fe640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 0x7f7d100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d27fff640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10004d10 0x7f7d10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d26ffd640 1 -- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 msgr2=0x7f7d100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d280713a0 0x7f7d100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d26ffd640 1 -- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10004d10 msgr2=0x7f7d10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10004d10 0x7f7d10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d26ffd640 1 -- 172.21.15.53:0/1196302404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10003530 con 0x7f7d10003ef0 2024-09-13T18:25:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d10003ef0 0x7f7d100047d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c190 tx=0x7f7d1c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45382894bf010606 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c005ae0 con 0x7f7d10003ef0 2024-09-13T18:25:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c005c40 con 0x7f7d10003ef0 2024-09-13T18:25:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.857+0000 7f7d267fc640 1 -- 172.21.15.53:0/1196302404 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0a5890 con 0x7f7d10003ef0 2024-09-13T18:25:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/1196302404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d10003ef0 msgr2=0x7f7d100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 --2- 172.21.15.53:0/1196302404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d10003ef0 0x7f7d100047d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c190 tx=0x7f7d1c01cc20 comp rx=0 tx=0).stop 2024-09-13T18:25:41.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d27fff640 1 -- 172.21.15.53:0/1196302404 reap_dead start 2024-09-13T18:25:41.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/1196302404 shutdown_connections 2024-09-13T18:25:41.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/1196302404 >> 172.21.15.53:0/1196302404 conn(0x7f7d28065c80 msgr2=0x7f7d28066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:41.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/1196302404 shutdown_connections 2024-09-13T18:25:41.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/1196302404 wait complete. 2024-09-13T18:25:41.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 Processor -- start 2024-09-13T18:25:41.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- start start 2024-09-13T18:25:41.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10003ef0 0x7f7d2814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d281ed220 0x7f7d281f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d281f14c0 0x7f7d281552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d281498c0 con 0x7f7d281ed220 2024-09-13T18:25:41.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2814b8d0 con 0x7f7d10003ef0 2024-09-13T18:25:41.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280ac250 con 0x7f7d281f14c0 2024-09-13T18:25:41.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d281ed220 0x7f7d281f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d281ed220 0x7f7d281f0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41646/0 (socket says 172.21.15.53:41646) 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 -- 172.21.15.53:0/2325795610 learned_addr learned my addr 172.21.15.53:0/2325795610 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d277fe640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10003ef0 0x7f7d2814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d27fff640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d281f14c0 0x7f7d281552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 -- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d281f14c0 msgr2=0x7f7d281552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d281f14c0 0x7f7d281552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 -- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10003ef0 msgr2=0x7f7d2814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10003ef0 0x7f7d2814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 -- 172.21.15.53:0/2325795610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28148cb0 con 0x7f7d281ed220 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d26ffd640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d281ed220 0x7f7d281f0f80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c01c690 tx=0x7f7d10005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d0ffff640 1 -- 172.21.15.53:0/2325795610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0b4070 con 0x7f7d281ed220 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d0ffff640 1 -- 172.21.15.53:0/2325795610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c0a5890 con 0x7f7d281ed220 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d0ffff640 1 -- 172.21.15.53:0/2325795610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0a5c40 con 0x7f7d281ed220 2024-09-13T18:25:41.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d28148f90 con 0x7f7d281ed220 2024-09-13T18:25:41.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.861+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d28149550 con 0x7f7d281ed220 2024-09-13T18:25:41.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.865+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d28067400 con 0x7f7d281ed220 2024-09-13T18:25:41.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.865+0000 7f7d0ffff640 1 -- 172.21.15.53:0/2325795610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d1c007070 con 0x7f7d281ed220 2024-09-13T18:25:41.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.865+0000 7f7d0ffff640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d14066690 0x7f7d14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:41.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.865+0000 7f7d0ffff640 1 -- 172.21.15.53:0/2325795610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7d1c11dcf0 con 0x7f7d281ed220 2024-09-13T18:25:41.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.865+0000 7f7d277fe640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d14066690 0x7f7d14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:41.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.865+0000 7f7d277fe640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d14066690 0x7f7d14068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7d18000c10 tx=0x7f7d180013f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:41.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:41.869+0000 7f7d0ffff640 1 -- 172.21.15.53:0/2325795610 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d1c0eb120 con 0x7f7d281ed220 2024-09-13T18:25:42.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.029+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d28149a70 con 0x7f7d281ed220 2024-09-13T18:25:42.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d0ffff640 1 -- 172.21.15.53:0/2325795610 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16639 (secure 0 0 0) 0x7f7d1c0be090 con 0x7f7d281ed220 2024-09-13T18:25:42.035 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:42.036 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:40.061767+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d14066690 msgr2=0x7f7d14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d14066690 0x7f7d14068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7d18000c10 tx=0x7f7d180013f0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d281ed220 msgr2=0x7f7d281f0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d281ed220 0x7f7d281f0f80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c01c690 tx=0x7f7d10005800 comp rx=0 tx=0).stop 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 shutdown_connections 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d14066690 0x7f7d14068b50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d281f14c0 0x7f7d281552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d281ed220 0x7f7d281f0f80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 --2- 172.21.15.53:0/2325795610 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d10003ef0 0x7f7d2814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 >> 172.21.15.53:0/2325795610 conn(0x7f7d28065c80 msgr2=0x7f7d280cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 shutdown_connections 2024-09-13T18:25:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.033+0000 7f7d2dd2a640 1 -- 172.21.15.53:0/2325795610 wait complete. 2024-09-13T18:25:42.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:42.055 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:42.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.181+0000 7fed3c418640 1 Processor -- start 2024-09-13T18:25:42.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.181+0000 7fed3c418640 1 -- start start 2024-09-13T18:25:42.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3c418640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed3406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3c418640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed340cda30 0x7fed340cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3c418640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3406f7a0 con 0x7fed340caee0 2024-09-13T18:25:42.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3c418640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3406fd60 con 0x7fed340cda30 2024-09-13T18:25:42.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3c418640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340cb960 con 0x7fed34143e80 2024-09-13T18:25:42.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a1b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed3406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a9b5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed340cda30 0x7fed340cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a9b5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed340cda30 0x7fed340cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:36452/0 (socket says 172.21.15.53:36452) 2024-09-13T18:25:42.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a9b5640 1 -- 172.21.15.53:0/1758080676 learned_addr learned my addr 172.21.15.53:0/1758080676 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:42.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a9b5640 1 -- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 msgr2=0x7fed3406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:42.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a9b5640 1 --2- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed3406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a9b5640 1 -- 172.21.15.53:0/1758080676 >> v1:172.21.15.87:6789/0 conn(0x7fed340caee0 legacy=0x7fed340cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a9b5640 1 -- 172.21.15.53:0/1758080676 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340cbc40 con 0x7fed340cda30 2024-09-13T18:25:42.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.185+0000 7fed3a1b4640 1 --2- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed3406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:42.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3a9b5640 1 --2- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340cda30 0x7fed340cb320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009e50 tx=0x7fed2c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87c6f5710f1e1c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed391b2640 1 -- 172.21.15.53:0/1758080676 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0a5810 con 0x7fed340cda30 2024-09-13T18:25:42.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed391b2640 1 -- 172.21.15.53:0/1758080676 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c0a5970 con 0x7fed340cda30 2024-09-13T18:25:42.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed391b2640 1 -- 172.21.15.53:0/1758080676 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0a5d00 con 0x7fed340cda30 2024-09-13T18:25:42.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340cda30 msgr2=0x7fed340cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 --2- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340cda30 0x7fed340cb320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009e50 tx=0x7fed2c01c970 comp rx=0 tx=0).stop 2024-09-13T18:25:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- 172.21.15.53:0/1758080676 shutdown_connections 2024-09-13T18:25:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 --2- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340cda30 0x7fed340cb320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 --2- 172.21.15.53:0/1758080676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed3406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- 172.21.15.53:0/1758080676 >> 172.21.15.53:0/1758080676 conn(0x7fed34065c80 msgr2=0x7fed34066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- 172.21.15.53:0/1758080676 shutdown_connections 2024-09-13T18:25:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- 172.21.15.53:0/1758080676 wait complete. 2024-09-13T18:25:42.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 Processor -- start 2024-09-13T18:25:42.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- start start 2024-09-13T18:25:42.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340caee0 0x7fed341406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed340cda30 0x7fed3413f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed34156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34140e60 con 0x7fed340cda30 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34140500 con 0x7fed340caee0 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.189+0000 7fed3c418640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3413f6c0 con 0x7fed34143e80 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed340cda30 0x7fed3413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed340cda30 0x7fed3413f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41656/0 (socket says 172.21.15.53:41656) 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 -- 172.21.15.53:0/643733970 learned_addr learned my addr 172.21.15.53:0/643733970 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed3a9b5640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed34156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed3a1b4640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340caee0 0x7fed341406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 -- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 msgr2=0x7fed34156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed34156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 -- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340caee0 msgr2=0x7fed341406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340caee0 0x7fed341406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 -- 172.21.15.53:0/643733970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30009420 con 0x7fed340cda30 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed3a1b4640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340caee0 0x7fed341406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed399b3640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed340cda30 0x7fed3413f180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c450 tx=0x7fed2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed2affd640 1 -- 172.21.15.53:0/643733970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240052d0 con 0x7fed340cda30 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed2affd640 1 -- 172.21.15.53:0/643733970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24005430 con 0x7fed340cda30 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed2affd640 1 -- 172.21.15.53:0/643733970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24007260 con 0x7fed340cda30 2024-09-13T18:25:42.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c009b30 con 0x7fed340cda30 2024-09-13T18:25:42.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3413fbd0 con 0x7fed340cda30 2024-09-13T18:25:42.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed340cb320 con 0x7fed340cda30 2024-09-13T18:25:42.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed2affd640 1 -- 172.21.15.53:0/643733970 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed240073c0 con 0x7fed340cda30 2024-09-13T18:25:42.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed2affd640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fed18066690 0x7fed18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed2affd640 1 -- 172.21.15.53:0/643733970 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fed24083a50 con 0x7fed340cda30 2024-09-13T18:25:42.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.193+0000 7fed3a1b4640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fed18066690 0x7fed18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.197+0000 7fed3a1b4640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fed18066690 0x7fed18068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed30009ca0 tx=0x7fed30008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.197+0000 7fed2affd640 1 -- 172.21.15.53:0/643733970 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed24050dd0 con 0x7fed340cda30 2024-09-13T18:25:42.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.357+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed340af8e0 con 0x7fed340cda30 2024-09-13T18:25:42.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.357+0000 7fed2affd640 1 -- 172.21.15.53:0/643733970 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed240543f0 con 0x7fed340cda30 2024-09-13T18:25:42.362 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fed18066690 msgr2=0x7fed18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fed18066690 0x7fed18068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed30009ca0 tx=0x7fed30008040 comp rx=0 tx=0).stop 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed340cda30 msgr2=0x7fed3413f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed340cda30 0x7fed3413f180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c450 tx=0x7fed2400c910 comp rx=0 tx=0).stop 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 shutdown_connections 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fed18066690 0x7fed18068b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed34143e80 0x7fed34156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed340cda30 0x7fed3413f180 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 --2- 172.21.15.53:0/643733970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed340caee0 0x7fed341406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 >> 172.21.15.53:0/643733970 conn(0x7fed34065c80 msgr2=0x7fed340a8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:42.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 shutdown_connections 2024-09-13T18:25:42.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.361+0000 7fed3c418640 1 -- 172.21.15.53:0/643733970 wait complete. 2024-09-13T18:25:42.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d853d6640 1 Processor -- start 2024-09-13T18:25:42.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d853d6640 1 -- start start 2024-09-13T18:25:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d853d6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 0x7f8d800cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d853d6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800b7db0 con 0x7f8d8015c830 2024-09-13T18:25:42.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d853d6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800d0650 con 0x7f8d800d2c80 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d853d6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800d0c10 con 0x7f8d800ccd10 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d8015c830 0x7f8d800d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52930/0 (socket says 172.21.15.53:52930) 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7effd640 1 -- 172.21.15.53:0/1060591637 learned_addr learned my addr 172.21.15.53:0/1060591637 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7e7fc640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 0x7f8d800cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537320534 0 0) 0x7f8d800b7db0 con 0x7f8d8015c830 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d68003530 con 0x7f8d8015c830 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466789887 0 0) 0x7f8d68003530 con 0x7f8d8015c830 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 msgr2=0x7f8d800cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 0x7f8d800cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 >> v1:172.21.15.87:6789/0 conn(0x7f8d800d2c80 legacy=0x7f8d800b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800d17b0 con 0x7f8d8015c830 2024-09-13T18:25:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8d70001680 con 0x7f8d8015c830 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 >> v1:172.21.15.53:6789/0 conn(0x7f8d8015c830 legacy=0x7f8d800d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 0x7f8d680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d68003f30 0x7f8d680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d68004d10 0x7f8d68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800d0c10 con 0x7f8d68004d10 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6800ba70 con 0x7f8d68003f30 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6800bc30 con 0x7f8d800ccd10 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7f7fe640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d68004d10 0x7f8d68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7effd640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 0x7f8d680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7e7fc640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d68003f30 0x7f8d680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7f7fe640 1 -- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 msgr2=0x7f8d680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7f7fe640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d800ccd10 0x7f8d680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7f7fe640 1 -- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d68003f30 msgr2=0x7f8d680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:42.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7f7fe640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d68003f30 0x7f8d680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.505+0000 7f8d7f7fe640 1 -- 172.21.15.53:0/1060591637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68003530 con 0x7f8d68004d10 2024-09-13T18:25:42.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d7f7fe640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d68004d10 0x7f8d68005190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001e70 tx=0x7f8d7801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727ed813813e2dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78003b80 con 0x7f8d68004d10 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78003ce0 con 0x7f8d68004d10 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d7dffb640 1 -- 172.21.15.53:0/1060591637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780052c0 con 0x7f8d68004d10 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 -- 172.21.15.53:0/1060591637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d68004d10 msgr2=0x7f8d68005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 --2- 172.21.15.53:0/1060591637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d68004d10 0x7f8d68005190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001e70 tx=0x7f8d7801c780 comp rx=0 tx=0).stop 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d7f7fe640 1 -- 172.21.15.53:0/1060591637 reap_dead start 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 -- 172.21.15.53:0/1060591637 shutdown_connections 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 -- 172.21.15.53:0/1060591637 >> 172.21.15.53:0/1060591637 conn(0x7f8d80070970 msgr2=0x7f8d80070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 -- 172.21.15.53:0/1060591637 shutdown_connections 2024-09-13T18:25:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 -- 172.21.15.53:0/1060591637 wait complete. 2024-09-13T18:25:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 Processor -- start 2024-09-13T18:25:42.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.509+0000 7f8d853d6640 1 -- start start 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d80155c80 0x7f8d800c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d801572a0 0x7f8d80157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800b6930 0x7f8d800b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80157c60 con 0x7f8d801572a0 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800b72f0 con 0x7f8d800b6930 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8015ef20 con 0x7f8d80155c80 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d801572a0 0x7f8d80157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d801572a0 0x7f8d80157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41682/0 (socket says 172.21.15.53:41682) 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 -- 172.21.15.53:0/126939462 learned_addr learned my addr 172.21.15.53:0/126939462 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7effd640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d80155c80 0x7f8d800c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7f7fe640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800b6930 0x7f8d800b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 -- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d80155c80 msgr2=0x7f8d800c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d80155c80 0x7f8d800c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 -- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800b6930 msgr2=0x7f8d800b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800b6930 0x7f8d800b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 -- 172.21.15.53:0/126939462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80159440 con 0x7f8d801572a0 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7e7fc640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d801572a0 0x7f8d80157720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d74011600 tx=0x7f8d74011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d677fe640 1 -- 172.21.15.53:0/126939462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74015870 con 0x7f8d801572a0 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d677fe640 1 -- 172.21.15.53:0/126939462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d740159d0 con 0x7f8d801572a0 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d80156060 con 0x7f8d801572a0 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d677fe640 1 -- 172.21.15.53:0/126939462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74015d80 con 0x7f8d801572a0 2024-09-13T18:25:42.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8015e5f0 con 0x7f8d801572a0 2024-09-13T18:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d800cd150 con 0x7f8d801572a0 2024-09-13T18:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d677fe640 1 -- 172.21.15.53:0/126939462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d7400f450 con 0x7f8d801572a0 2024-09-13T18:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d677fe640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d6c066690 0x7f8d6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d677fe640 1 -- 172.21.15.53:0/126939462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8d74084960 con 0x7f8d801572a0 2024-09-13T18:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7effd640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d6c066690 0x7f8d6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.513+0000 7f8d7effd640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d6c066690 0x7f8d6c068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d70004850 tx=0x7f8d70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.517+0000 7f8d677fe640 1 -- 172.21.15.53:0/126939462 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d74051c50 con 0x7f8d801572a0 2024-09-13T18:25:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.685+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d8015f060 con 0x7f8d801572a0 2024-09-13T18:25:42.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d677fe640 1 -- 172.21.15.53:0/126939462 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d74055270 con 0x7f8d801572a0 2024-09-13T18:25:42.693 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:42.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d6c066690 msgr2=0x7f8d6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d6c066690 0x7f8d6c068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d70004850 tx=0x7f8d70009040 comp rx=0 tx=0).stop 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d801572a0 msgr2=0x7f8d80157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d801572a0 0x7f8d80157720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d74011600 tx=0x7f8d74011ac0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 shutdown_connections 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d6c066690 0x7f8d6c068b50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d800b6930 0x7f8d800b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d801572a0 0x7f8d80157720 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 --2- 172.21.15.53:0/126939462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d80155c80 0x7f8d800c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 >> 172.21.15.53:0/126939462 conn(0x7f8d80070970 msgr2=0x7f8d80070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 shutdown_connections 2024-09-13T18:25:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.689+0000 7f8d853d6640 1 -- 172.21.15.53:0/126939462 wait complete. 2024-09-13T18:25:42.710 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0c841640 1 Processor -- start 2024-09-13T18:25:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0c841640 1 -- start start 2024-09-13T18:25:42.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0c841640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab08156c40 0x7fab08070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0c841640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0806d440 0x7fab0806f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0c841640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab080b15a0 con 0x7fab08157020 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0c841640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080b1880 con 0x7fab08156c40 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0c841640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080b1b60 con 0x7fab0806d440 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab08156c40 0x7fab08070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab08156c40 0x7fab08070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41692/0 (socket says 172.21.15.53:41692) 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0659c640 1 -- 172.21.15.53:0/753516285 learned_addr learned my addr 172.21.15.53:0/753516285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab06d9d640 1 --2- 172.21.15.53:0/753516285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0806d440 0x7fab0806f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0659c640 1 -- 172.21.15.53:0/753516285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0806d440 msgr2=0x7fab0806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0659c640 1 --2- 172.21.15.53:0/753516285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0806d440 0x7fab0806f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0659c640 1 -- 172.21.15.53:0/753516285 >> v1:172.21.15.87:6789/0 conn(0x7fab08157020 legacy=0x7fab0806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab0659c640 1 -- 172.21.15.53:0/753516285 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080b1e40 con 0x7fab08156c40 2024-09-13T18:25:42.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.837+0000 7fab06d9d640 1 --2- 172.21.15.53:0/753516285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0806d440 0x7fab0806f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:42.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0659c640 1 --2- 172.21.15.53:0/753516285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab08070ee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009870 tx=0x7faaf801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8fec15d36cf10a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0559a640 1 -- 172.21.15.53:0/753516285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf80aa430 con 0x7fab08156c40 2024-09-13T18:25:42.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0559a640 1 -- 172.21.15.53:0/753516285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf80aa590 con 0x7fab08156c40 2024-09-13T18:25:42.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0559a640 1 -- 172.21.15.53:0/753516285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf80aa920 con 0x7fab08156c40 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- 172.21.15.53:0/753516285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 msgr2=0x7fab08070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 --2- 172.21.15.53:0/753516285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab08070ee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009870 tx=0x7faaf801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- 172.21.15.53:0/753516285 shutdown_connections 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 --2- 172.21.15.53:0/753516285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0806d440 0x7fab0806f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 --2- 172.21.15.53:0/753516285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab08070ee0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- 172.21.15.53:0/753516285 >> 172.21.15.53:0/753516285 conn(0x7fab08065c80 msgr2=0x7fab08066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- 172.21.15.53:0/753516285 shutdown_connections 2024-09-13T18:25:42.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- 172.21.15.53:0/753516285 wait complete. 2024-09-13T18:25:42.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 Processor -- start 2024-09-13T18:25:42.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- start start 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab0806d440 0x7fab0814e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab0813be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0814a250 0x7fab0814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0814f590 con 0x7fab08156c40 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0814e980 con 0x7fab0806d440 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0c841640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0814ec60 con 0x7fab0814a250 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab0813be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab0813be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41696/0 (socket says 172.21.15.53:41696) 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 -- 172.21.15.53:0/3249190454 learned_addr learned my addr 172.21.15.53:0/3249190454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab0659c640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab0806d440 0x7fab0814e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab06d9d640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0814a250 0x7fab0814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 -- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0814a250 msgr2=0x7fab0814aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0814a250 0x7fab0814aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 -- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab0806d440 msgr2=0x7fab0814e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab0806d440 0x7fab0814e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 -- 172.21.15.53:0/3249190454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80094d0 con 0x7fab08156c40 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.841+0000 7fab05d9b640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab0813be60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faafc00b410 tx=0x7faafc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7faaf6ffd640 1 -- 172.21.15.53:0/3249190454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc004020 con 0x7fab08156c40 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7faaf6ffd640 1 -- 172.21.15.53:0/3249190454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc004180 con 0x7fab08156c40 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0814ef40 con 0x7fab08156c40 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7faaf6ffd640 1 -- 172.21.15.53:0/3249190454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc011630 con 0x7fab08156c40 2024-09-13T18:25:42.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0814e670 con 0x7fab08156c40 2024-09-13T18:25:42.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0806f330 con 0x7fab08156c40 2024-09-13T18:25:42.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7faaf6ffd640 1 -- 172.21.15.53:0/3249190454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faafc011790 con 0x7fab08156c40 2024-09-13T18:25:42.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7faaf6ffd640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faae8066690 0x7faae8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:42.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7faaf6ffd640 1 -- 172.21.15.53:0/3249190454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7faafc083fe0 con 0x7fab08156c40 2024-09-13T18:25:42.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7fab0659c640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faae8066690 0x7faae8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:42.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.845+0000 7fab0659c640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faae8066690 0x7faae8068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faaf80ae000 tx=0x7faaf80a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:42.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:42.849+0000 7faaf6ffd640 1 -- 172.21.15.53:0/3249190454 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faafc0512d0 con 0x7fab08156c40 2024-09-13T18:25:43.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.009+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab0814f6d0 con 0x7fab08156c40 2024-09-13T18:25:43.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.009+0000 7faaf6ffd640 1 -- 172.21.15.53:0/3249190454 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7faafc0548f0 con 0x7fab08156c40 2024-09-13T18:25:43.014 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:43.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faae8066690 msgr2=0x7faae8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faae8066690 0x7faae8068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faaf80ae000 tx=0x7faaf80a7000 comp rx=0 tx=0).stop 2024-09-13T18:25:43.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 msgr2=0x7fab0813be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab0813be60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faafc00b410 tx=0x7faafc00b8d0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 shutdown_connections 2024-09-13T18:25:43.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faae8066690 0x7faae8068b50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab0814a250 0x7fab0814aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab08156c40 0x7fab0813be60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 --2- 172.21.15.53:0/3249190454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab0806d440 0x7fab0814e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 >> 172.21.15.53:0/3249190454 conn(0x7fab08065c80 msgr2=0x7fab08155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:43.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 shutdown_connections 2024-09-13T18:25:43.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.013+0000 7fab0c841640 1 -- 172.21.15.53:0/3249190454 wait complete. 2024-09-13T18:25:43.033 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:43.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f7366212640 1 Processor -- start 2024-09-13T18:25:43.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f7366212640 1 -- start start 2024-09-13T18:25:43.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f7366212640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f73601582a0 0x7f736006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f7366212640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73600713a0 0x7f736006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f7366212640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736006d480 con 0x7f736015b7c0 2024-09-13T18:25:43.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f7366212640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736015aaf0 con 0x7f73601582a0 2024-09-13T18:25:43.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f7366212640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736006d760 con 0x7f73600713a0 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735ffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73600713a0 0x7f736006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f73601582a0 0x7f736006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735effd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f736015b7c0 0x7f7360070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:48610/0 (socket says 172.21.15.53:48610) 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f73601582a0 0x7f736006c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:36502/0 (socket says 172.21.15.53:36502) 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735effd640 1 -- 172.21.15.53:0/114040109 learned_addr learned my addr 172.21.15.53:0/114040109 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735f7fe640 1 -- 172.21.15.53:0/114040109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73600713a0 msgr2=0x7f736006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735f7fe640 1 --2- 172.21.15.53:0/114040109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73600713a0 0x7f736006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735f7fe640 1 -- 172.21.15.53:0/114040109 >> v1:172.21.15.87:6789/0 conn(0x7f736015b7c0 legacy=0x7f7360070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.157+0000 7f735f7fe640 1 -- 172.21.15.53:0/114040109 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736015ace0 con 0x7f73601582a0 2024-09-13T18:25:43.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f735f7fe640 1 --2- 172.21.15.53:0/114040109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 0x7f736006c900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f73500097c0 tx=0x7f735001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21a675766839fbec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f735e7fc640 1 -- 172.21.15.53:0/114040109 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500ab670 con 0x7f73601582a0 2024-09-13T18:25:43.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f735e7fc640 1 -- 172.21.15.53:0/114040109 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73500ab7d0 con 0x7f73601582a0 2024-09-13T18:25:43.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f735e7fc640 1 -- 172.21.15.53:0/114040109 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500abb60 con 0x7f73601582a0 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 -- 172.21.15.53:0/114040109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 msgr2=0x7f736006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 --2- 172.21.15.53:0/114040109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 0x7f736006c900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f73500097c0 tx=0x7f735001c470 comp rx=0 tx=0).stop 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 -- 172.21.15.53:0/114040109 shutdown_connections 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 --2- 172.21.15.53:0/114040109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f73600713a0 0x7f736006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 --2- 172.21.15.53:0/114040109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 0x7f736006c900 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 -- 172.21.15.53:0/114040109 >> 172.21.15.53:0/114040109 conn(0x7f7360065c80 msgr2=0x7f7360066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 -- 172.21.15.53:0/114040109 shutdown_connections 2024-09-13T18:25:43.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.161+0000 7f7366212640 1 -- 172.21.15.53:0/114040109 wait complete. 2024-09-13T18:25:43.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 Processor -- start 2024-09-13T18:25:43.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 -- start start 2024-09-13T18:25:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600713a0 0x7f7360159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 0x7f7360154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f736015b7c0 0x7f73601f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736015a090 con 0x7f73600713a0 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601590d0 con 0x7f73601582a0 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7360149440 con 0x7f736015b7c0 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600713a0 0x7f7360159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600713a0 0x7f7360159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41698/0 (socket says 172.21.15.53:41698) 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 -- 172.21.15.53:0/3325370683 learned_addr learned my addr 172.21.15.53:0/3325370683 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735ffff640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f736015b7c0 0x7f73601f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735effd640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 0x7f7360154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 -- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f736015b7c0 msgr2=0x7f73601f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f736015b7c0 0x7f73601f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 -- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 msgr2=0x7f7360154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 0x7f7360154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 -- 172.21.15.53:0/3325370683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350009420 con 0x7f73600713a0 2024-09-13T18:25:43.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f735f7fe640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600713a0 0x7f7360159b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f735001cd10 tx=0x7f735001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7347fff640 1 -- 172.21.15.53:0/3325370683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500bf610 con 0x7f73600713a0 2024-09-13T18:25:43.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7347fff640 1 -- 172.21.15.53:0/3325370683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73500bf770 con 0x7f73600713a0 2024-09-13T18:25:43.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7347fff640 1 -- 172.21.15.53:0/3325370683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500bfb00 con 0x7f73600713a0 2024-09-13T18:25:43.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7360150610 con 0x7f73600713a0 2024-09-13T18:25:43.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7360159630 con 0x7f73600713a0 2024-09-13T18:25:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7360067400 con 0x7f73600713a0 2024-09-13T18:25:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7347fff640 1 -- 172.21.15.53:0/3325370683 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f73500b5400 con 0x7f73600713a0 2024-09-13T18:25:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.165+0000 7f7347fff640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f734c066690 0x7f734c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.169+0000 7f7347fff640 1 -- 172.21.15.53:0/3325370683 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f735011eec0 con 0x7f73600713a0 2024-09-13T18:25:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.169+0000 7f735effd640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f734c066690 0x7f734c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.169+0000 7f735effd640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f734c066690 0x7f734c068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f736015aaa0 tx=0x7f7354009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.173+0000 7f7347fff640 1 -- 172.21.15.53:0/3325370683 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f73500ec360 con 0x7f73600713a0 2024-09-13T18:25:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.345+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7360150a10 con 0x7f73600713a0 2024-09-13T18:25:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.345+0000 7f7347fff640 1 -- 172.21.15.53:0/3325370683 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73500ef980 con 0x7f73600713a0 2024-09-13T18:25:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f734c066690 msgr2=0x7f734c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f734c066690 0x7f734c068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f736015aaa0 tx=0x7f7354009040 comp rx=0 tx=0).stop 2024-09-13T18:25:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600713a0 msgr2=0x7f7360159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600713a0 0x7f7360159b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f735001cd10 tx=0x7f735001acb0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 shutdown_connections 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f734c066690 0x7f734c068b50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f736015b7c0 0x7f73601f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f73601582a0 0x7f7360154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 --2- 172.21.15.53:0/3325370683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73600713a0 0x7f7360159b50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 >> 172.21.15.53:0/3325370683 conn(0x7f7360065c80 msgr2=0x7f7360149970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 shutdown_connections 2024-09-13T18:25:43.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.349+0000 7f7366212640 1 -- 172.21.15.53:0/3325370683 wait complete. 2024-09-13T18:25:43.368 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:25:43.369 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:25:43.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:43.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.489+0000 7f7fb1ab3640 1 Processor -- start 2024-09-13T18:25:43.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.489+0000 7f7fb1ab3640 1 -- start start 2024-09-13T18:25:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fb1ab3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7fac1582a0 0x7f7fac06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fb1ab3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac15b7c0 0x7f7fac06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fb1ab3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fac070c90 0x7f7fac071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fb1ab3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac15aaf0 con 0x7f7fac070c90 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fb1ab3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac06d760 con 0x7f7fac1582a0 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fb1ab3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac071650 con 0x7f7fac15b7c0 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fac070c90 0x7f7fac071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fac070c90 0x7f7fac071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41704/0 (socket says 172.21.15.53:41704) 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 -- 172.21.15.53:0/1155426821 learned_addr learned my addr 172.21.15.53:0/1155426821 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7faaffd640 1 --2- 172.21.15.53:0/1155426821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac15b7c0 0x7f7fac06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fab7fe640 1 --2- 172.21.15.53:0/1155426821 >> v2:172.21.15.87:3300/0 conn(0x7f7fac1582a0 0x7f7fac06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 -- 172.21.15.53:0/1155426821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac15b7c0 msgr2=0x7f7fac06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 --2- 172.21.15.53:0/1155426821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac15b7c0 0x7f7fac06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 -- 172.21.15.53:0/1155426821 >> v2:172.21.15.87:3300/0 conn(0x7f7fac1582a0 msgr2=0x7f7fac06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 --2- 172.21.15.53:0/1155426821 >> v2:172.21.15.87:3300/0 conn(0x7f7fac1582a0 0x7f7fac06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 -- 172.21.15.53:0/1155426821 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac06d480 con 0x7f7fac070c90 2024-09-13T18:25:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7fabfff640 1 --2- 172.21.15.53:0/1155426821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac070c90 0x7f7fac071110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7fac069f50 tx=0x7f7fa401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0af7ae6dec4e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7faa7fc640 1 -- 172.21.15.53:0/1155426821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a5840 con 0x7f7fac070c90 2024-09-13T18:25:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7faa7fc640 1 -- 172.21.15.53:0/1155426821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a59a0 con 0x7f7fac070c90 2024-09-13T18:25:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.493+0000 7f7faa7fc640 1 -- 172.21.15.53:0/1155426821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a5d30 con 0x7f7fac070c90 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/1155426821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac070c90 msgr2=0x7f7fac071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/1155426821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac070c90 0x7f7fac071110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7fac069f50 tx=0x7f7fa401c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/1155426821 shutdown_connections 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/1155426821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac15b7c0 0x7f7fac06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/1155426821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac070c90 0x7f7fac071110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/1155426821 >> v2:172.21.15.87:3300/0 conn(0x7f7fac1582a0 0x7f7fac06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/1155426821 >> 172.21.15.53:0/1155426821 conn(0x7f7fac065c80 msgr2=0x7f7fac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/1155426821 shutdown_connections 2024-09-13T18:25:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/1155426821 wait complete. 2024-09-13T18:25:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 Processor -- start 2024-09-13T18:25:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- start start 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac070c90 0x7f7fac14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fac1582a0 0x7f7fac148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac15b7c0 0x7f7fac1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1458f0 con 0x7f7fac15b7c0 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac145130 con 0x7f7fac1582a0 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fb1ab3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac144bf0 con 0x7f7fac070c90 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fab7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac070c90 0x7f7fac14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac15b7c0 0x7f7fac1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7faaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fac1582a0 0x7f7fac148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fab7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac070c90 0x7f7fac14fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:38578/0 (socket says 172.21.15.53:38578) 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac15b7c0 0x7f7fac1446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41716/0 (socket says 172.21.15.53:41716) 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fab7fe640 1 -- 172.21.15.53:0/140124882 learned_addr learned my addr 172.21.15.53:0/140124882 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fabfff640 1 -- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac070c90 msgr2=0x7f7fac14fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fabfff640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac070c90 0x7f7fac14fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fabfff640 1 -- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fac1582a0 msgr2=0x7f7fac148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fabfff640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fac1582a0 0x7f7fac148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.497+0000 7f7fabfff640 1 -- 172.21.15.53:0/140124882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009b30 con 0x7f7fac15b7c0 2024-09-13T18:25:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7fabfff640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac15b7c0 0x7f7fac1446b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0cc100 tx=0x7f7fa4019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7f93fff640 1 -- 172.21.15.53:0/140124882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40bd070 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7f93fff640 1 -- 172.21.15.53:0/140124882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40b8470 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac150260 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7f93fff640 1 -- 172.21.15.53:0/140124882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40b8860 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac150820 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac067400 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7f93fff640 1 -- 172.21.15.53:0/140124882 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fa40b89c0 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7f93fff640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f98066690 0x7f7f98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7f93fff640 1 -- 172.21.15.53:0/140124882 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7fa411efe0 con 0x7f7fac15b7c0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7fab7fe640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f98066690 0x7f7f98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.501+0000 7f7fab7fe640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f98066690 0x7f7f98068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00bb90 tx=0x7f7f9c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.505+0000 7f7f93fff640 1 -- 172.21.15.53:0/140124882 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fa40ec560 con 0x7f7fac15b7c0 2024-09-13T18:25:43.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.657+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fac145aa0 con 0x7f7fac15b7c0 2024-09-13T18:25:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.661+0000 7f7f93fff640 1 -- 172.21.15.53:0/140124882 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16639 (secure 0 0 0) 0x7f7fac145aa0 con 0x7f7fac15b7c0 2024-09-13T18:25:43.665 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:43.665 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:40.061767+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f98066690 msgr2=0x7f7f98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f98066690 0x7f7f98068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00bb90 tx=0x7f7f9c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac15b7c0 msgr2=0x7f7fac1446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac15b7c0 0x7f7fac1446b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0cc100 tx=0x7f7fa4019760 comp rx=0 tx=0).stop 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 shutdown_connections 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f98066690 0x7f7f98068b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac15b7c0 0x7f7fac1446b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fac1582a0 0x7f7fac148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 --2- 172.21.15.53:0/140124882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fac070c90 0x7f7fac14fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 >> 172.21.15.53:0/140124882 conn(0x7f7fac065c80 msgr2=0x7f7fac156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 shutdown_connections 2024-09-13T18:25:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.665+0000 7f7fb1ab3640 1 -- 172.21.15.53:0/140124882 wait complete. 2024-09-13T18:25:43.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:43.683 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:43.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a29ab6640 1 Processor -- start 2024-09-13T18:25:43.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a29ab6640 1 -- start start 2024-09-13T18:25:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a29ab6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a2415c830 0x7f5a240d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a29ab6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a240b7db0 con 0x7f5a240d3390 2024-09-13T18:25:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a29ab6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a240d0650 con 0x7f5a240ccd10 2024-09-13T18:25:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a29ab6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a240d0c10 con 0x7f5a2415c830 2024-09-13T18:25:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a23fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5a240d3390 0x7f5a240b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52942/0 (socket says 172.21.15.53:52942) 2024-09-13T18:25:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a23fff640 1 -- 172.21.15.53:0/362091644 learned_addr learned my addr 172.21.15.53:0/362091644 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a237fe640 1 --2- 172.21.15.53:0/362091644 >> v2:172.21.15.87:3300/0 conn(0x7f5a2415c830 0x7f5a240d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191970503 0 0) 0x7f5a240b7db0 con 0x7f5a240d3390 2024-09-13T18:25:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a10003530 con 0x7f5a240d3390 2024-09-13T18:25:43.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507267015 0 0) 0x7f5a10003530 con 0x7f5a240d3390 2024-09-13T18:25:43.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 >> v2:172.21.15.87:3300/0 conn(0x7f5a2415c830 msgr2=0x7f5a240d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:43.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 --2- 172.21.15.53:0/362091644 >> v2:172.21.15.87:3300/0 conn(0x7f5a2415c830 0x7f5a240d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 >> v1:172.21.15.87:6789/0 conn(0x7f5a240ccd10 legacy=0x7f5a240d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240cd7d0 con 0x7f5a240d3390 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5a1c001a00 con 0x7f5a240d3390 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 >> v1:172.21.15.53:6789/0 conn(0x7f5a240d3390 legacy=0x7f5a240b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a10003980 0x7f5a10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a100047d0 0x7f5a10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10005190 0x7f5a1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240d0c10 con 0x7f5a10003980 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1000c030 con 0x7f5a10005190 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1000c1f0 con 0x7f5a100047d0 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a237fe640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a10003980 0x7f5a10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a23fff640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10005190 0x7f5a1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a237fe640 1 -- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a100047d0 msgr2=0x7f5a10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a237fe640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a100047d0 0x7f5a10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a237fe640 1 -- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10005190 msgr2=0x7f5a1000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a237fe640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10005190 0x7f5a1000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a237fe640 1 -- 172.21.15.53:0/362091644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a10003530 con 0x7f5a10003980 2024-09-13T18:25:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a23fff640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10005190 0x7f5a1000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.809+0000 7f5a23fff640 1 -- 172.21.15.53:0/362091644 reap_dead start 2024-09-13T18:25:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a237fe640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a10003980 0x7f5a10003da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009ae0 tx=0x7f5a1401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec22c9970f3a4f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140a5530 con 0x7f5a10003980 2024-09-13T18:25:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a140a5690 con 0x7f5a10003980 2024-09-13T18:25:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a22ffd640 1 -- 172.21.15.53:0/362091644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140a5a40 con 0x7f5a10003980 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- 172.21.15.53:0/362091644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a10003980 msgr2=0x7f5a10003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a10003980 0x7f5a10003da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009ae0 tx=0x7f5a1401ca70 comp rx=0 tx=0).stop 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- 172.21.15.53:0/362091644 shutdown_connections 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/362091644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a10003980 0x7f5a10003da0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- 172.21.15.53:0/362091644 >> 172.21.15.53:0/362091644 conn(0x7f5a24070970 msgr2=0x7f5a24070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- 172.21.15.53:0/362091644 shutdown_connections 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- 172.21.15.53:0/362091644 wait complete. 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 Processor -- start 2024-09-13T18:25:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- start start 2024-09-13T18:25:43.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10003980 0x7f5a241560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a24154050 0x7f5a24151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2415ef10 0x7f5a2415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240c7d90 con 0x7f5a2415ef10 2024-09-13T18:25:43.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24152170 con 0x7f5a10003980 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a29ab6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2415f8c0 con 0x7f5a24154050 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a23fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2415ef10 0x7f5a2415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a23fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2415ef10 0x7f5a2415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41732/0 (socket says 172.21.15.53:41732) 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.813+0000 7f5a23fff640 1 -- 172.21.15.53:0/3758686425 learned_addr learned my addr 172.21.15.53:0/3758686425 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a1bfff640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a24154050 0x7f5a24151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a237fe640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10003980 0x7f5a241560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a23fff640 1 -- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a24154050 msgr2=0x7f5a24151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a23fff640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a24154050 0x7f5a24151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a23fff640 1 -- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10003980 msgr2=0x7f5a241560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a23fff640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10003980 0x7f5a241560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a23fff640 1 -- 172.21.15.53:0/3758686425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a241544e0 con 0x7f5a2415ef10 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a23fff640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2415ef10 0x7f5a2415f380 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5a2406bd40 tx=0x7f5a1c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a20ff9640 1 -- 172.21.15.53:0/3758686425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c004d70 con 0x7f5a2415ef10 2024-09-13T18:25:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a20ff9640 1 -- 172.21.15.53:0/3758686425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c00bb50 con 0x7f5a2415ef10 2024-09-13T18:25:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a241547c0 con 0x7f5a2415ef10 2024-09-13T18:25:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a20ff9640 1 -- 172.21.15.53:0/3758686425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c007070 con 0x7f5a2415ef10 2024-09-13T18:25:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a24156610 con 0x7f5a2415ef10 2024-09-13T18:25:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a240c7ed0 con 0x7f5a2415ef10 2024-09-13T18:25:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a20ff9640 1 -- 172.21.15.53:0/3758686425 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a1c0071d0 con 0x7f5a2415ef10 2024-09-13T18:25:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a20ff9640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a04066690 0x7f5a04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a20ff9640 1 -- 172.21.15.53:0/3758686425 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5a1c084540 con 0x7f5a2415ef10 2024-09-13T18:25:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a237fe640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a04066690 0x7f5a04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.817+0000 7f5a237fe640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a04066690 0x7f5a04068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a140af000 tx=0x7f5a14008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:43.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.821+0000 7f5a20ff9640 1 -- 172.21.15.53:0/3758686425 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5a240c7ed0 con 0x7f5a2415ef10 2024-09-13T18:25:43.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.981+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a240c7ed0 con 0x7f5a2415ef10 2024-09-13T18:25:43.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a20ff9640 1 -- 172.21.15.53:0/3758686425 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a240c7ed0 con 0x7f5a2415ef10 2024-09-13T18:25:43.987 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:43.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a04066690 msgr2=0x7f5a04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a04066690 0x7f5a04068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a140af000 tx=0x7f5a14008040 comp rx=0 tx=0).stop 2024-09-13T18:25:43.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2415ef10 msgr2=0x7f5a2415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:43.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2415ef10 0x7f5a2415f380 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5a2406bd40 tx=0x7f5a1c00b4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 shutdown_connections 2024-09-13T18:25:43.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a04066690 0x7f5a04068b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a24154050 0x7f5a24151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a2415ef10 0x7f5a2415f380 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 --2- 172.21.15.53:0/3758686425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a10003980 0x7f5a241560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 >> 172.21.15.53:0/3758686425 conn(0x7f5a24070970 msgr2=0x7f5a240b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 shutdown_connections 2024-09-13T18:25:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:43.985+0000 7f5a29ab6640 1 -- 172.21.15.53:0/3758686425 wait complete. 2024-09-13T18:25:44.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.133+0000 7f7cac393640 1 Processor -- start 2024-09-13T18:25:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.133+0000 7f7cac393640 1 -- start start 2024-09-13T18:25:44.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7cac393640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ca40ce570 0x7f7ca4070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7cac393640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca4070a40 0x7f7ca40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7cac393640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca40cb3c0 con 0x7f7ca415a3d0 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7cac393640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca406fd40 con 0x7f7ca40ce570 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7cac393640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40b3ca0 con 0x7f7ca4070a40 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ca40ce570 0x7f7ca4070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ca40ce570 0x7f7ca4070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41742/0 (socket says 172.21.15.53:41742) 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7caa12f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7ca415a3d0 0x7f7ca40b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52944/0 (socket says 172.21.15.53:52944) 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 -- 172.21.15.53:0/3595864639 learned_addr learned my addr 172.21.15.53:0/3595864639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7caa930640 1 --2- 172.21.15.53:0/3595864639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca4070a40 0x7f7ca40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 -- 172.21.15.53:0/3595864639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca4070a40 msgr2=0x7f7ca40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 --2- 172.21.15.53:0/3595864639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca4070a40 0x7f7ca40ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 -- 172.21.15.53:0/3595864639 >> v1:172.21.15.53:6789/0 conn(0x7f7ca415a3d0 legacy=0x7f7ca40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca912d640 1 -- 172.21.15.53:0/3595864639 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646790346 0 0) 0x7f7ca40cb3c0 con 0x7f7ca415a3d0 2024-09-13T18:25:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 -- 172.21.15.53:0/3595864639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40b3f80 con 0x7f7ca40ce570 2024-09-13T18:25:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca992e640 1 --2- 172.21.15.53:0/3595864639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca40ce570 0x7f7ca4070500 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009870 tx=0x7f7c9401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c866102e2a66d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca912d640 1 -- 172.21.15.53:0/3595864639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940ab640 con 0x7f7ca40ce570 2024-09-13T18:25:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca912d640 1 -- 172.21.15.53:0/3595864639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c940a7070 con 0x7f7ca40ce570 2024-09-13T18:25:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7ca912d640 1 -- 172.21.15.53:0/3595864639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940ab9c0 con 0x7f7ca40ce570 2024-09-13T18:25:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7cac393640 1 -- 172.21.15.53:0/3595864639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca40ce570 msgr2=0x7f7ca4070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.137+0000 7f7cac393640 1 --2- 172.21.15.53:0/3595864639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca40ce570 0x7f7ca4070500 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009870 tx=0x7f7c9401c530 comp rx=0 tx=0).stop 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- 172.21.15.53:0/3595864639 shutdown_connections 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 --2- 172.21.15.53:0/3595864639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca4070a40 0x7f7ca40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 --2- 172.21.15.53:0/3595864639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca40ce570 0x7f7ca4070500 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- 172.21.15.53:0/3595864639 >> 172.21.15.53:0/3595864639 conn(0x7f7ca4069f50 msgr2=0x7f7ca406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- 172.21.15.53:0/3595864639 shutdown_connections 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- 172.21.15.53:0/3595864639 wait complete. 2024-09-13T18:25:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 Processor -- start 2024-09-13T18:25:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- start start 2024-09-13T18:25:44.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ca40ce570 0x7f7ca4149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca415a3d0 0x7f7ca4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca4156560 0x7f7ca414d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca414a2a0 con 0x7f7ca4156560 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca414a420 con 0x7f7ca40ce570 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca415cf60 con 0x7f7ca415a3d0 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca4156560 0x7f7ca414d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca4156560 0x7f7ca414d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41750/0 (socket says 172.21.15.53:41750) 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 -- 172.21.15.53:0/1835037407 learned_addr learned my addr 172.21.15.53:0/1835037407 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa12f640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ca40ce570 0x7f7ca4149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7ca992e640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca415a3d0 0x7f7ca4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 -- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca415a3d0 msgr2=0x7f7ca4156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca415a3d0 0x7f7ca4156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 -- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ca40ce570 msgr2=0x7f7ca4149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ca40ce570 0x7f7ca4149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 -- 172.21.15.53:0/1835037407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940094d0 con 0x7f7ca4156560 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7caa930640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca4156560 0x7f7ca414d090 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007dc0 tx=0x7f7c9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7c9affd640 1 -- 172.21.15.53:0/1835037407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c014420 con 0x7f7ca4156560 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7c9affd640 1 -- 172.21.15.53:0/1835037407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c0145a0 con 0x7f7ca4156560 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca415d240 con 0x7f7ca4156560 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7c9affd640 1 -- 172.21.15.53:0/1835037407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c014950 con 0x7f7ca4156560 2024-09-13T18:25:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.141+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca415d800 con 0x7f7ca4156560 2024-09-13T18:25:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.145+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca414a5d0 con 0x7f7ca4156560 2024-09-13T18:25:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.145+0000 7f7c9affd640 1 -- 172.21.15.53:0/1835037407 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c9c014ab0 con 0x7f7ca4156560 2024-09-13T18:25:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.145+0000 7f7c9affd640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7c880666c0 0x7f7c88068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.145+0000 7f7c9affd640 1 -- 172.21.15.53:0/1835037407 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7c9c084b20 con 0x7f7ca4156560 2024-09-13T18:25:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.145+0000 7f7caa12f640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7c880666c0 0x7f7c88068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.145+0000 7f7caa12f640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7c880666c0 0x7f7c88068b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000f70 tx=0x7f7ca0007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.149+0000 7f7c9affd640 1 -- 172.21.15.53:0/1835037407 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ca414a5d0 con 0x7f7ca4156560 2024-09-13T18:25:44.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.309+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ca414a5d0 con 0x7f7ca4156560 2024-09-13T18:25:44.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.309+0000 7f7c9affd640 1 -- 172.21.15.53:0/1835037407 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ca414a5d0 con 0x7f7ca4156560 2024-09-13T18:25:44.314 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:44.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7c880666c0 msgr2=0x7f7c88068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7c880666c0 0x7f7c88068b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000f70 tx=0x7f7ca0007c10 comp rx=0 tx=0).stop 2024-09-13T18:25:44.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca4156560 msgr2=0x7f7ca414d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca4156560 0x7f7ca414d090 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007dc0 tx=0x7f7c9c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 shutdown_connections 2024-09-13T18:25:44.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7c880666c0 0x7f7c88068b80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ca415a3d0 0x7f7ca4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ca4156560 0x7f7ca414d090 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 --2- 172.21.15.53:0/1835037407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ca40ce570 0x7f7ca4149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 >> 172.21.15.53:0/1835037407 conn(0x7f7ca4069f50 msgr2=0x7f7ca406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:44.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 shutdown_connections 2024-09-13T18:25:44.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.313+0000 7f7cac393640 1 -- 172.21.15.53:0/1835037407 wait complete. 2024-09-13T18:25:44.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:44.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.461+0000 7f089eae2640 1 Processor -- start 2024-09-13T18:25:44.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.461+0000 7f089eae2640 1 -- start start 2024-09-13T18:25:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f089806d440 0x7f0898163e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08980715f0 con 0x7f0898157020 2024-09-13T18:25:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08980b15a0 con 0x7f0898156c40 2024-09-13T18:25:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0898070340 con 0x7f089806d440 2024-09-13T18:25:44.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f0897fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0898157020 0x7f089806cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52954/0 (socket says 172.21.15.53:52954) 2024-09-13T18:25:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f0897fff640 1 -- 172.21.15.53:0/1060375067 learned_addr learned my addr 172.21.15.53:0/1060375067 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089d07f640 1 --2- 172.21.15.53:0/1060375067 >> v2:172.21.15.53:3300/0 conn(0x7f089806d440 0x7f0898163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f08977fe640 1 -- 172.21.15.53:0/1060375067 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302616209 0 0) 0x7f08980715f0 con 0x7f0898157020 2024-09-13T18:25:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f08977fe640 1 -- 172.21.15.53:0/1060375067 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0888003530 con 0x7f0898157020 2024-09-13T18:25:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089d07f640 1 -- 172.21.15.53:0/1060375067 >> v1:172.21.15.87:6789/0 conn(0x7f0898156c40 legacy=0x7f0898070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089d07f640 1 -- 172.21.15.53:0/1060375067 >> v1:172.21.15.53:6789/0 conn(0x7f0898157020 legacy=0x7f089806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089d07f640 1 -- 172.21.15.53:0/1060375067 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08980b1880 con 0x7f089806d440 2024-09-13T18:25:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089d07f640 1 --2- 172.21.15.53:0/1060375067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898163e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0890009dc0 tx=0x7f089001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38357aa09d3650d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f08977fe640 1 -- 172.21.15.53:0/1060375067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900a58e0 con 0x7f089806d440 2024-09-13T18:25:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f08977fe640 1 -- 172.21.15.53:0/1060375067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08900a5a40 con 0x7f089806d440 2024-09-13T18:25:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f08977fe640 1 -- 172.21.15.53:0/1060375067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900a5dd0 con 0x7f089806d440 2024-09-13T18:25:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 -- 172.21.15.53:0/1060375067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 msgr2=0x7f0898163e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 --2- 172.21.15.53:0/1060375067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898163e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0890009dc0 tx=0x7f089001c920 comp rx=0 tx=0).stop 2024-09-13T18:25:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 -- 172.21.15.53:0/1060375067 shutdown_connections 2024-09-13T18:25:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 --2- 172.21.15.53:0/1060375067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898163e90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.465+0000 7f089eae2640 1 -- 172.21.15.53:0/1060375067 >> 172.21.15.53:0/1060375067 conn(0x7f0898065c80 msgr2=0x7f0898066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- 172.21.15.53:0/1060375067 shutdown_connections 2024-09-13T18:25:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- 172.21.15.53:0/1060375067 wait complete. 2024-09-13T18:25:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 Processor -- start 2024-09-13T18:25:44.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- start start 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0898156c40 0x7f0898155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08981561f0 0x7f089815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08981545e0 con 0x7f089806d440 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08981492f0 con 0x7f08981561f0 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08981486e0 con 0x7f0898156c40 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41768/0 (socket says 172.21.15.53:41768) 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 -- 172.21.15.53:0/3991909453 learned_addr learned my addr 172.21.15.53:0/3991909453 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:44.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f0897fff640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0898156c40 0x7f0898155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089d07f640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08981561f0 0x7f089815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 -- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0898156c40 msgr2=0x7f0898155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0898156c40 0x7f0898155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 -- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08981561f0 msgr2=0x7f089815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08981561f0 0x7f089815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 -- 172.21.15.53:0/3991909453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009a70 con 0x7f089806d440 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f0897fff640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0898156c40 0x7f0898155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089d07f640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08981561f0 0x7f089815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089c87e640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898147140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c500 tx=0x7f088c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f08957fa640 1 -- 172.21.15.53:0/3991909453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c005220 con 0x7f089806d440 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f08957fa640 1 -- 172.21.15.53:0/3991909453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c005380 con 0x7f089806d440 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f08957fa640 1 -- 172.21.15.53:0/3991909453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c007270 con 0x7f089806d440 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08981489c0 con 0x7f089806d440 2024-09-13T18:25:44.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0898148f80 con 0x7f089806d440 2024-09-13T18:25:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.469+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0898149110 con 0x7f089806d440 2024-09-13T18:25:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.473+0000 7f08957fa640 1 -- 172.21.15.53:0/3991909453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f088c0073d0 con 0x7f089806d440 2024-09-13T18:25:44.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.473+0000 7f08957fa640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f087c066690 0x7f087c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.473+0000 7f08957fa640 1 -- 172.21.15.53:0/3991909453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f088c083800 con 0x7f089806d440 2024-09-13T18:25:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.473+0000 7f0897fff640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f087c066690 0x7f087c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.473+0000 7f0897fff640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f087c066690 0x7f087c068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08980ccae0 tx=0x7f0884009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.477+0000 7f08957fa640 1 -- 172.21.15.53:0/3991909453 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f088c050b00 con 0x7f089806d440 2024-09-13T18:25:44.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08980b0800 con 0x7f089806d440 2024-09-13T18:25:44.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f08957fa640 1 -- 172.21.15.53:0/3991909453 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f088c054120 con 0x7f089806d440 2024-09-13T18:25:44.640 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f087c066690 msgr2=0x7f087c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f087c066690 0x7f087c068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08980ccae0 tx=0x7f0884009040 comp rx=0 tx=0).stop 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 msgr2=0x7f0898147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898147140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c500 tx=0x7f088c00c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 shutdown_connections 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f087c066690 0x7f087c068b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0898156c40 0x7f0898155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08981561f0 0x7f089815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 --2- 172.21.15.53:0/3991909453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089806d440 0x7f0898147140 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 >> 172.21.15.53:0/3991909453 conn(0x7f0898065c80 msgr2=0x7f0898159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 shutdown_connections 2024-09-13T18:25:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.637+0000 7f089eae2640 1 -- 172.21.15.53:0/3991909453 wait complete. 2024-09-13T18:25:44.659 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:25:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71edad640 1 Processor -- start 2024-09-13T18:25:44.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71edad640 1 -- start start 2024-09-13T18:25:44.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71edad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 0x7fc7180ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71edad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7180cd230 0x7fc7180b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71edad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180cf420 con 0x7fc71806d380 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71edad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71806c8a0 con 0x7fc7180cd230 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71edad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71806cb80 con 0x7fc71815a520 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc71806d380 0x7fc718065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52956/0 (socket says 172.21.15.53:52956) 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 -- 172.21.15.53:0/904144877 learned_addr learned my addr 172.21.15.53:0/904144877 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc717fff640 1 --2- 172.21.15.53:0/904144877 >> v2:172.21.15.87:3300/0 conn(0x7fc7180cd230 0x7fc7180b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71cb49640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 0x7fc7180ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743745494 0 0) 0x7fc7180cf420 con 0x7fc71806d380 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc700003530 con 0x7fc71806d380 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323276080 0 0) 0x7fc700003530 con 0x7fc71806d380 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 msgr2=0x7fc7180ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:44.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 0x7fc7180ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 >> v2:172.21.15.87:3300/0 conn(0x7fc7180cd230 msgr2=0x7fc7180b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 --2- 172.21.15.53:0/904144877 >> v2:172.21.15.87:3300/0 conn(0x7fc7180cd230 0x7fc7180b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71806ce60 con 0x7fc71806d380 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc710001a00 con 0x7fc71806d380 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 >> v1:172.21.15.53:6789/0 conn(0x7fc71806d380 legacy=0x7fc718065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 0x7fc700003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc700003f00 0x7fc7000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc700004d10 0x7fc700005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71806c8a0 con 0x7fc700004d10 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71806cb80 con 0x7fc700003f00 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70000b9e0 con 0x7fc71815a520 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc700004d10 0x7fc700005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71cb49640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 0x7fc700003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc717fff640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc700003f00 0x7fc7000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 -- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 msgr2=0x7fc700003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:44.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71815a520 0x7fc700003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 -- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc700003f00 msgr2=0x7fc7000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:44.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc700003f00 0x7fc7000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.777+0000 7fc71d34a640 1 -- 172.21.15.53:0/904144877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700003530 con 0x7fc700004d10 2024-09-13T18:25:44.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71d34a640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc700004d10 0x7fc700005190 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc71000a900 tx=0x7fc71001fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c0e4f8ccef56e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100aa6e0 con 0x7fc700004d10 2024-09-13T18:25:44.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7100aa840 con 0x7fc700004d10 2024-09-13T18:25:44.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc7177fe640 1 -- 172.21.15.53:0/904144877 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100aabf0 con 0x7fc700004d10 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 -- 172.21.15.53:0/904144877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc700004d10 msgr2=0x7fc700005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 --2- 172.21.15.53:0/904144877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc700004d10 0x7fc700005190 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc71000a900 tx=0x7fc71001fb40 comp rx=0 tx=0).stop 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71d34a640 1 -- 172.21.15.53:0/904144877 reap_dead start 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 -- 172.21.15.53:0/904144877 shutdown_connections 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 -- 172.21.15.53:0/904144877 >> 172.21.15.53:0/904144877 conn(0x7fc718069f50 msgr2=0x7fc71806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 -- 172.21.15.53:0/904144877 shutdown_connections 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 -- 172.21.15.53:0/904144877 wait complete. 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 Processor -- start 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.781+0000 7fc71edad640 1 -- start start 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71815c580 0x7fc718153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71815c960 0x7fc7181413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71813dc40 0x7fc71813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc718154ae0 con 0x7fc71815c580 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc718141900 con 0x7fc71815c960 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71813e600 con 0x7fc71813dc40 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71815c580 0x7fc718153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71815c580 0x7fc718153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41774/0 (socket says 172.21.15.53:41774) 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 -- 172.21.15.53:0/732223998 learned_addr learned my addr 172.21.15.53:0/732223998 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc717fff640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71815c960 0x7fc7181413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71d34a640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71813dc40 0x7fc71813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 -- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71813dc40 msgr2=0x7fc71813e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71813dc40 0x7fc71813e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 -- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71815c960 msgr2=0x7fc7181413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71815c960 0x7fc7181413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 -- 172.21.15.53:0/732223998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718153ed0 con 0x7fc71815c580 2024-09-13T18:25:44.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71d34a640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71813dc40 0x7fc71813e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71cb49640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71815c580 0x7fc718153860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc7080119d0 tx=0x7fc708011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc7157fa640 1 -- 172.21.15.53:0/732223998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70800fb50 con 0x7fc71815c580 2024-09-13T18:25:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc7157fa640 1 -- 172.21.15.53:0/732223998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70800fcb0 con 0x7fc71815c580 2024-09-13T18:25:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc7157fa640 1 -- 172.21.15.53:0/732223998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708014440 con 0x7fc71815c580 2024-09-13T18:25:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7181541b0 con 0x7fc71815c580 2024-09-13T18:25:44.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc718154770 con 0x7fc71815c580 2024-09-13T18:25:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc718154930 con 0x7fc71815c580 2024-09-13T18:25:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc7157fa640 1 -- 172.21.15.53:0/732223998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7080145a0 con 0x7fc71815c580 2024-09-13T18:25:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc7157fa640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7040666c0 0x7fc704068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc7157fa640 1 -- 172.21.15.53:0/732223998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc7080849f0 con 0x7fc71815c580 2024-09-13T18:25:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.785+0000 7fc717fff640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7040666c0 0x7fc704068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:44.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.789+0000 7fc717fff640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7040666c0 0x7fc704068b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc71815c0b0 tx=0x7fc70c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:44.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.789+0000 7fc7157fa640 1 -- 172.21.15.53:0/732223998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc708051e30 con 0x7fc71815c580 2024-09-13T18:25:44.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.961+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc7180b4bf0 con 0x7fc71815c580 2024-09-13T18:25:44.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.961+0000 7fc7157fa640 1 -- 172.21.15.53:0/732223998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc708022020 con 0x7fc71815c580 2024-09-13T18:25:44.965 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:25:44.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7040666c0 msgr2=0x7fc704068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7040666c0 0x7fc704068b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc71815c0b0 tx=0x7fc70c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:44.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71815c580 msgr2=0x7fc718153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:44.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71815c580 0x7fc718153860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc7080119d0 tx=0x7fc708011e90 comp rx=0 tx=0).stop 2024-09-13T18:25:44.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 shutdown_connections 2024-09-13T18:25:44.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7040666c0 0x7fc704068b80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71813dc40 0x7fc71813e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71815c960 0x7fc7181413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 --2- 172.21.15.53:0/732223998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71815c580 0x7fc718153860 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:44.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 >> 172.21.15.53:0/732223998 conn(0x7fc718069f50 msgr2=0x7fc718158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:44.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 shutdown_connections 2024-09-13T18:25:44.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:44.965+0000 7fc71edad640 1 -- 172.21.15.53:0/732223998 wait complete. 2024-09-13T18:25:44.985 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:25:44.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:44.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-13T18:25:45.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:45.000 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:25:45.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:25:45.000 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:25:45.054 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:25:45.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:45.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5e731640 1 Processor -- start 2024-09-13T18:25:45.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5e731640 1 -- start start 2024-09-13T18:25:45.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5e731640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f5815c980 0x7f2f5806cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5e731640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f5806a660 0x7f2f58070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5e731640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5815cd60 con 0x7f2f5806d550 2024-09-13T18:25:45.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5e731640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5806d1a0 con 0x7f2f5806a660 2024-09-13T18:25:45.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5e731640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f580cccd0 con 0x7f2f5815c980 2024-09-13T18:25:45.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f4ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2f5806d550 0x7f2f58069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52958/0 (socket says 172.21.15.53:52958) 2024-09-13T18:25:45.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f4ffff640 1 -- 172.21.15.53:0/1827287887 learned_addr learned my addr 172.21.15.53:0/1827287887 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:45.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5ccce640 1 --2- 172.21.15.53:0/1827287887 >> v2:172.21.15.53:3300/0 conn(0x7f2f5806a660 0x7f2f58070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f57fff640 1 --2- 172.21.15.53:0/1827287887 >> v2:172.21.15.87:3300/0 conn(0x7f2f5815c980 0x7f2f5806cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f577fe640 1 -- 172.21.15.53:0/1827287887 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323191538 0 0) 0x7f2f5815cd60 con 0x7f2f5806d550 2024-09-13T18:25:45.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f577fe640 1 -- 172.21.15.53:0/1827287887 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f44003530 con 0x7f2f5806d550 2024-09-13T18:25:45.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5ccce640 1 -- 172.21.15.53:0/1827287887 >> v2:172.21.15.87:3300/0 conn(0x7f2f5815c980 msgr2=0x7f2f5806cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5ccce640 1 --2- 172.21.15.53:0/1827287887 >> v2:172.21.15.87:3300/0 conn(0x7f2f5815c980 0x7f2f5806cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5ccce640 1 -- 172.21.15.53:0/1827287887 >> v1:172.21.15.53:6789/0 conn(0x7f2f5806d550 legacy=0x7f2f58069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.181+0000 7f2f5ccce640 1 -- 172.21.15.53:0/1827287887 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580ccfb0 con 0x7f2f5806a660 2024-09-13T18:25:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5ccce640 1 --2- 172.21.15.53:0/1827287887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806a660 0x7f2f58070310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f58072de0 tx=0x7f2f5001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdb859ee2d86ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f577fe640 1 -- 172.21.15.53:0/1827287887 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500a58f0 con 0x7f2f5806a660 2024-09-13T18:25:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f577fe640 1 -- 172.21.15.53:0/1827287887 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f500a5a50 con 0x7f2f5806a660 2024-09-13T18:25:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f577fe640 1 -- 172.21.15.53:0/1827287887 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500a5de0 con 0x7f2f5806a660 2024-09-13T18:25:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 -- 172.21.15.53:0/1827287887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806a660 msgr2=0x7f2f58070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 --2- 172.21.15.53:0/1827287887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806a660 0x7f2f58070310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2f58072de0 tx=0x7f2f5001c810 comp rx=0 tx=0).stop 2024-09-13T18:25:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 -- 172.21.15.53:0/1827287887 shutdown_connections 2024-09-13T18:25:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 --2- 172.21.15.53:0/1827287887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806a660 0x7f2f58070310 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 --2- 172.21.15.53:0/1827287887 >> v2:172.21.15.87:3300/0 conn(0x7f2f5815c980 0x7f2f5806cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 -- 172.21.15.53:0/1827287887 >> 172.21.15.53:0/1827287887 conn(0x7f2f580b0a30 msgr2=0x7f2f580b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 -- 172.21.15.53:0/1827287887 shutdown_connections 2024-09-13T18:25:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 -- 172.21.15.53:0/1827287887 wait complete. 2024-09-13T18:25:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 Processor -- start 2024-09-13T18:25:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 -- start start 2024-09-13T18:25:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f5806a660 0x7f2f58153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806d550 0x7f2f58151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.185+0000 7f2f5e731640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815c980 0x7f2f58141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f5e731640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5815b8d0 con 0x7f2f5806d550 2024-09-13T18:25:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f5e731640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5815bb20 con 0x7f2f5806a660 2024-09-13T18:25:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f5e731640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5815be00 con 0x7f2f5815c980 2024-09-13T18:25:45.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806d550 0x7f2f58151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806d550 0x7f2f58151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41792/0 (socket says 172.21.15.53:41792) 2024-09-13T18:25:45.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 -- 172.21.15.53:0/2766083333 learned_addr learned my addr 172.21.15.53:0/2766083333 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:45.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 -- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815c980 msgr2=0x7f2f58141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815c980 0x7f2f58141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 -- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f5806a660 msgr2=0x7f2f58153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f5806a660 0x7f2f58153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 -- 172.21.15.53:0/2766083333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f50009a70 con 0x7f2f5806d550 2024-09-13T18:25:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f4ffff640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806d550 0x7f2f58151020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001140 tx=0x7f2f4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f557fa640 1 -- 172.21.15.53:0/2766083333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40005cf0 con 0x7f2f5806d550 2024-09-13T18:25:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f557fa640 1 -- 172.21.15.53:0/2766083333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f40005e50 con 0x7f2f5806d550 2024-09-13T18:25:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5815c0e0 con 0x7f2f5806d550 2024-09-13T18:25:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f557fa640 1 -- 172.21.15.53:0/2766083333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400072f0 con 0x7f2f5806d550 2024-09-13T18:25:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f58154230 con 0x7f2f5806d550 2024-09-13T18:25:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58070310 con 0x7f2f5806d550 2024-09-13T18:25:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f557fa640 1 -- 172.21.15.53:0/2766083333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f40007450 con 0x7f2f5806d550 2024-09-13T18:25:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f557fa640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f380666c0 0x7f2f38068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f557fa640 1 -- 172.21.15.53:0/2766083333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2f400836e0 con 0x7f2f5806d550 2024-09-13T18:25:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f57fff640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f380666c0 0x7f2f38068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.189+0000 7f2f57fff640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f380666c0 0x7f2f38068b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2f48006aa0 tx=0x7f2f48006a30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.193+0000 7f2f557fa640 1 -- 172.21.15.53:0/2766083333 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f40050b20 con 0x7f2f5806d550 2024-09-13T18:25:45.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f580abf70 con 0x7f2f5806d550 2024-09-13T18:25:45.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f557fa640 1 -- 172.21.15.53:0/2766083333 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7f2f40054140 con 0x7f2f5806d550 2024-09-13T18:25:45.396 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:45.396 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:45.396 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:45.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f380666c0 msgr2=0x7f2f38068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f380666c0 0x7f2f38068b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2f48006aa0 tx=0x7f2f48006a30 comp rx=0 tx=0).stop 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806d550 msgr2=0x7f2f58151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806d550 0x7f2f58151020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001140 tx=0x7f2f4000c8e0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 shutdown_connections 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f380666c0 0x7f2f38068b80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815c980 0x7f2f58141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f5806d550 0x7f2f58151020 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 --2- 172.21.15.53:0/2766083333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f5806a660 0x7f2f58153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 >> 172.21.15.53:0/2766083333 conn(0x7f2f580b0a30 msgr2=0x7f2f580b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.393+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 shutdown_connections 2024-09-13T18:25:45.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.397+0000 7f2f5e731640 1 -- 172.21.15.53:0/2766083333 wait complete. 2024-09-13T18:25:45.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:45.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f4470640 1 Processor -- start 2024-09-13T18:25:45.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f4470640 1 -- start start 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f4470640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 0x7fc9ec070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f4470640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec06d480 con 0x7fc9ec1582a0 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f4470640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec15ace0 con 0x7fc9ec0711d0 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f4470640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec15aaf0 con 0x7fc9ec15b7c0 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f220c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc9ec1582a0 0x7fc9ec06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52964/0 (socket says 172.21.15.53:52964) 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f220c640 1 -- 172.21.15.53:0/1733327093 learned_addr learned my addr 172.21.15.53:0/1733327093 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653995158 0 0) 0x7fc9ec06d480 con 0x7fc9ec1582a0 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d8003530 con 0x7fc9ec1582a0 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f1a0b640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 0x7fc9ec070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1899069691 0 0) 0x7fc9d8003530 con 0x7fc9ec1582a0 2024-09-13T18:25:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 msgr2=0x7fc9ec070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 0x7fc9ec070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 >> v1:172.21.15.87:6789/0 conn(0x7fc9ec0711d0 legacy=0x7fc9ec1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec15afc0 con 0x7fc9ec1582a0 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc9e8001680 con 0x7fc9ec1582a0 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f1a0b640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 0x7fc9ec070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 >> v1:172.21.15.53:6789/0 conn(0x7fc9ec1582a0 legacy=0x7fc9ec06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80039b0 0x7fc9d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 0x7fc9d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d8004d10 0x7fc9d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d800baa0 con 0x7fc9d8004d10 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d800bc10 con 0x7fc9d80039b0 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d800bdd0 con 0x7fc9ec15b7c0 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f2a0d640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d8004d10 0x7fc9d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f220c640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80039b0 0x7fc9d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 msgr2=0x7fc9d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f2a0d640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec15b7c0 0x7fc9d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80039b0 msgr2=0x7fc9d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f2a0d640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80039b0 0x7fc9d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/1733327093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8003530 con 0x7fc9d8004d10 2024-09-13T18:25:45.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.541+0000 7fc9f220c640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9d80039b0 0x7fc9d8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:45.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f2a0d640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d8004d10 0x7fc9d8005190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4001e40 tx=0x7fc9e401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92880633f6bd8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4003b80 con 0x7fc9d8004d10 2024-09-13T18:25:45.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e4003ce0 con 0x7fc9d8004d10 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f120a640 1 -- 172.21.15.53:0/1733327093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e40052c0 con 0x7fc9d8004d10 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 -- 172.21.15.53:0/1733327093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d8004d10 msgr2=0x7fc9d8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 --2- 172.21.15.53:0/1733327093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d8004d10 0x7fc9d8005190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4001e40 tx=0x7fc9e401c760 comp rx=0 tx=0).stop 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/1733327093 reap_dead start 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 -- 172.21.15.53:0/1733327093 shutdown_connections 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 -- 172.21.15.53:0/1733327093 >> 172.21.15.53:0/1733327093 conn(0x7fc9ec065c80 msgr2=0x7fc9ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 -- 172.21.15.53:0/1733327093 shutdown_connections 2024-09-13T18:25:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 -- 172.21.15.53:0/1733327093 wait complete. 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 Processor -- start 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.545+0000 7fc9f4470640 1 -- start start 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec139fb0 0x7fc9ec150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9ec1535f0 0x7fc9ec06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ec150a60 0x7fc9ec070360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec13d850 con 0x7fc9ec150a60 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec153160 con 0x7fc9ec1535f0 2024-09-13T18:25:45.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec152550 con 0x7fc9ec139fb0 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ec150a60 0x7fc9ec070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ec150a60 0x7fc9ec070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41816/0 (socket says 172.21.15.53:41816) 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/138372420 learned_addr learned my addr 172.21.15.53:0/138372420 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f1a0b640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9ec1535f0 0x7fc9ec06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f220c640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec139fb0 0x7fc9ec150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec139fb0 msgr2=0x7fc9ec150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec139fb0 0x7fc9ec150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9ec1535f0 msgr2=0x7fc9ec06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9ec1535f0 0x7fc9ec06fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 -- 172.21.15.53:0/138372420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec152830 con 0x7fc9ec150a60 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f1a0b640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9ec1535f0 0x7fc9ec06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f220c640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec139fb0 0x7fc9ec150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f2a0d640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ec150a60 0x7fc9ec070360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc9e401cc40 tx=0x7fc9d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9e2ffd640 1 -- 172.21.15.53:0/138372420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4006d60 con 0x7fc9ec150a60 2024-09-13T18:25:45.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9e2ffd640 1 -- 172.21.15.53:0/138372420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e4007dc0 con 0x7fc9ec150a60 2024-09-13T18:25:45.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec152b10 con 0x7fc9ec150a60 2024-09-13T18:25:45.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9e2ffd640 1 -- 172.21.15.53:0/138372420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4007230 con 0x7fc9ec150a60 2024-09-13T18:25:45.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec152190 con 0x7fc9ec150a60 2024-09-13T18:25:45.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec067400 con 0x7fc9ec150a60 2024-09-13T18:25:45.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9e2ffd640 1 -- 172.21.15.53:0/138372420 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9e4007390 con 0x7fc9ec150a60 2024-09-13T18:25:45.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9e2ffd640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9d0066690 0x7fc9d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.549+0000 7fc9e2ffd640 1 -- 172.21.15.53:0/138372420 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc9e411d7e0 con 0x7fc9ec150a60 2024-09-13T18:25:45.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.553+0000 7fc9f220c640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9d0066690 0x7fc9d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.553+0000 7fc9f220c640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9d0066690 0x7fc9d0068b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8000f70 tx=0x7fc9e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.553+0000 7fc9e2ffd640 1 -- 172.21.15.53:0/138372420 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9e40eaad0 con 0x7fc9ec150a60 2024-09-13T18:25:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.713+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9ec13d850 con 0x7fc9ec150a60 2024-09-13T18:25:45.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.713+0000 7fc9e2ffd640 1 -- 172.21.15.53:0/138372420 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16639 (secure 0 0 0) 0x7fc9ec13d850 con 0x7fc9ec150a60 2024-09-13T18:25:45.718 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:45.719 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:40.061767+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:45.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9d0066690 msgr2=0x7fc9d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9d0066690 0x7fc9d0068b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8000f70 tx=0x7fc9e8009040 comp rx=0 tx=0).stop 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ec150a60 msgr2=0x7fc9ec070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ec150a60 0x7fc9ec070360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc9e401cc40 tx=0x7fc9d8005800 comp rx=0 tx=0).stop 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 shutdown_connections 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9d0066690 0x7fc9d0068b50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ec150a60 0x7fc9ec070360 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9ec1535f0 0x7fc9ec06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 --2- 172.21.15.53:0/138372420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9ec139fb0 0x7fc9ec150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 >> 172.21.15.53:0/138372420 conn(0x7fc9ec065c80 msgr2=0x7fc9ec14de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 shutdown_connections 2024-09-13T18:25:45.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.717+0000 7fc9f4470640 1 -- 172.21.15.53:0/138372420 wait complete. 2024-09-13T18:25:45.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:24:56.448268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:24:57.367221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:45.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:45.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.857+0000 7f84a5a76640 1 Processor -- start 2024-09-13T18:25:45.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.857+0000 7f84a5a76640 1 -- start start 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f84a5a76640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f84a015c860 0x7f84a00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f84a5a76640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 0x7f84a00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f84a5a76640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a00cdb50 con 0x7f84a00cd520 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f84a5a76640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a00b56d0 con 0x7f84a015c860 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f84a5a76640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00cd960 con 0x7f84a00cf7e0 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f84a00cd520 0x7f84a00cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52966/0 (socket says 172.21.15.53:52966) 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849effd640 1 -- 172.21.15.53:0/1575167875 learned_addr learned my addr 172.21.15.53:0/1575167875 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849f7fe640 1 --2- 172.21.15.53:0/1575167875 >> v2:172.21.15.87:3300/0 conn(0x7f84a015c860 0x7f84a00ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 0x7f84a00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545831690 0 0) 0x7f84a00cdb50 con 0x7f84a00cd520 2024-09-13T18:25:45.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8488003530 con 0x7f84a00cd520 2024-09-13T18:25:45.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937001521 0 0) 0x7f8488003530 con 0x7f84a00cd520 2024-09-13T18:25:45.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 msgr2=0x7f84a00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 0x7f84a00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 >> v2:172.21.15.87:3300/0 conn(0x7f84a015c860 msgr2=0x7f84a00ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 --2- 172.21.15.53:0/1575167875 >> v2:172.21.15.87:3300/0 conn(0x7f84a015c860 0x7f84a00ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a00d0350 con 0x7f84a00cd520 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8494001680 con 0x7f84a00cd520 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 >> v1:172.21.15.53:6789/0 conn(0x7f84a00cd520 legacy=0x7f84a00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 0x7f8488003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8488003f00 0x7f84880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8488004d10 0x7f8488005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00b56d0 con 0x7f8488004d10 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848800b990 con 0x7f8488003f00 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848800bb00 con 0x7f84a00cf7e0 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8488004d10 0x7f8488005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849f7fe640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 0x7f8488003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849effd640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8488003f00 0x7f84880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 -- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 msgr2=0x7f8488003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00cf7e0 0x7f8488003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 -- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8488003f00 msgr2=0x7f84880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:45.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8488003f00 0x7f84880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 -- 172.21.15.53:0/1575167875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488003530 con 0x7f8488004d10 2024-09-13T18:25:45.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.861+0000 7f849ffff640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8488004d10 0x7f8488005190 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8490009ae0 tx=0x7f849001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f204649634e4c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900a5660 con 0x7f8488004d10 2024-09-13T18:25:45.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84900a57c0 con 0x7f8488004d10 2024-09-13T18:25:45.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849e7fc640 1 -- 172.21.15.53:0/1575167875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900a5b70 con 0x7f8488004d10 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- 172.21.15.53:0/1575167875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8488004d10 msgr2=0x7f8488005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 --2- 172.21.15.53:0/1575167875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8488004d10 0x7f8488005190 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8490009ae0 tx=0x7f849001ca70 comp rx=0 tx=0).stop 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 -- 172.21.15.53:0/1575167875 reap_dead start 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- 172.21.15.53:0/1575167875 shutdown_connections 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- 172.21.15.53:0/1575167875 >> 172.21.15.53:0/1575167875 conn(0x7f84a0065c80 msgr2=0x7f84a0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- 172.21.15.53:0/1575167875 shutdown_connections 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- 172.21.15.53:0/1575167875 wait complete. 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 Processor -- start 2024-09-13T18:25:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- start start 2024-09-13T18:25:45.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01588b0 0x7f84a00b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00b3360 0x7f84a00c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a00c6fc0 0x7f84a015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00c74d0 con 0x7f84a00c6fc0 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a015dd20 con 0x7f84a01588b0 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a015e860 con 0x7f84a00b3360 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a00c6fc0 0x7f84a015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a00c6fc0 0x7f84a015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41830/0 (socket says 172.21.15.53:41830) 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 -- 172.21.15.53:0/310499524 learned_addr learned my addr 172.21.15.53:0/310499524 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849effd640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00b3360 0x7f84a00c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849f7fe640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01588b0 0x7f84a00b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 -- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00b3360 msgr2=0x7f84a00c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00b3360 0x7f84a00c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 -- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01588b0 msgr2=0x7f84a00b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01588b0 0x7f84a00b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 -- 172.21.15.53:0/310499524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a015df30 con 0x7f84a00c6fc0 2024-09-13T18:25:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f849ffff640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a00c6fc0 0x7f84a015ecf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84900b0040 tx=0x7f8488005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f8487fff640 1 -- 172.21.15.53:0/310499524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900bb070 con 0x7f84a00c6fc0 2024-09-13T18:25:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f8487fff640 1 -- 172.21.15.53:0/310499524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490004020 con 0x7f84a00c6fc0 2024-09-13T18:25:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a015e210 con 0x7f84a00c6fc0 2024-09-13T18:25:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.865+0000 7f8487fff640 1 -- 172.21.15.53:0/310499524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900a5660 con 0x7f84a00c6fc0 2024-09-13T18:25:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.869+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a01591f0 con 0x7f84a00c6fc0 2024-09-13T18:25:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.869+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a00cd960 con 0x7f84a00c6fc0 2024-09-13T18:25:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.869+0000 7f8487fff640 1 -- 172.21.15.53:0/310499524 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84900b4040 con 0x7f84a00c6fc0 2024-09-13T18:25:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.869+0000 7f8487fff640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f848c0666c0 0x7f848c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.869+0000 7f8487fff640 1 -- 172.21.15.53:0/310499524 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f849011dd10 con 0x7f84a00c6fc0 2024-09-13T18:25:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.869+0000 7f849f7fe640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f848c0666c0 0x7f848c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:45.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.869+0000 7f849f7fe640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f848c0666c0 0x7f848c068b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8498003c10 tx=0x7f849800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:45.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:45.873+0000 7f8487fff640 1 -- 172.21.15.53:0/310499524 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f84900eb020 con 0x7f84a00c6fc0 2024-09-13T18:25:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.033+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84a015e9a0 con 0x7f84a00c6fc0 2024-09-13T18:25:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f8487fff640 1 -- 172.21.15.53:0/310499524 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84900b2070 con 0x7f84a00c6fc0 2024-09-13T18:25:46.038 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f848c0666c0 msgr2=0x7f848c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f848c0666c0 0x7f848c068b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8498003c10 tx=0x7f849800b040 comp rx=0 tx=0).stop 2024-09-13T18:25:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a00c6fc0 msgr2=0x7f84a015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a00c6fc0 0x7f84a015ecf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84900b0040 tx=0x7f8488005800 comp rx=0 tx=0).stop 2024-09-13T18:25:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 shutdown_connections 2024-09-13T18:25:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f848c0666c0 0x7f848c068b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84a00b3360 0x7f84a00c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a00c6fc0 0x7f84a015ecf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 --2- 172.21.15.53:0/310499524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84a01588b0 0x7f84a00b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 >> 172.21.15.53:0/310499524 conn(0x7f84a0065c80 msgr2=0x7f84a00c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 shutdown_connections 2024-09-13T18:25:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.037+0000 7f84a5a76640 1 -- 172.21.15.53:0/310499524 wait complete. 2024-09-13T18:25:46.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:25:46.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ed00640 1 Processor -- start 2024-09-13T18:25:46.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ed00640 1 -- start start 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ed00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5908160300 0x7f59081606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ed00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f59080cf6a0 0x7f5908160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ed00640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5908161160 con 0x7f590815c9e0 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ed00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59080cfb10 con 0x7f5908160300 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ed00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59080aff30 con 0x7f59080cf6a0 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ca9c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5908160300 0x7f59081606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ca9c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5908160300 0x7f59081606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41842/0 (socket says 172.21.15.53:41842) 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ca9c640 1 -- 172.21.15.53:0/3900794771 learned_addr learned my addr 172.21.15.53:0/3900794771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590d29d640 1 --2- 172.21.15.53:0/3900794771 >> v2:172.21.15.87:3300/0 conn(0x7f59080cf6a0 0x7f5908160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ca9c640 1 -- 172.21.15.53:0/3900794771 >> v2:172.21.15.87:3300/0 conn(0x7f59080cf6a0 msgr2=0x7f5908160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ca9c640 1 --2- 172.21.15.53:0/3900794771 >> v2:172.21.15.87:3300/0 conn(0x7f59080cf6a0 0x7f5908160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ca9c640 1 -- 172.21.15.53:0/3900794771 >> v1:172.21.15.87:6789/0 conn(0x7f590815c9e0 legacy=0x7f59080b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.181+0000 7f590ca9c640 1 -- 172.21.15.53:0/3900794771 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590806ac90 con 0x7f5908160300 2024-09-13T18:25:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ca9c640 1 --2- 172.21.15.53:0/3900794771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5908160300 0x7f59081606e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f590806c110 tx=0x7f58f801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7cc10010d37e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f59077fe640 1 -- 172.21.15.53:0/3900794771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80aa650 con 0x7f5908160300 2024-09-13T18:25:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f59077fe640 1 -- 172.21.15.53:0/3900794771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f80aa7b0 con 0x7f5908160300 2024-09-13T18:25:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f59077fe640 1 -- 172.21.15.53:0/3900794771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80aab40 con 0x7f5908160300 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- 172.21.15.53:0/3900794771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5908160300 msgr2=0x7f59081606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 --2- 172.21.15.53:0/3900794771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5908160300 0x7f59081606e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f590806c110 tx=0x7f58f801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- 172.21.15.53:0/3900794771 shutdown_connections 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 --2- 172.21.15.53:0/3900794771 >> v2:172.21.15.87:3300/0 conn(0x7f59080cf6a0 0x7f5908160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 --2- 172.21.15.53:0/3900794771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5908160300 0x7f59081606e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- 172.21.15.53:0/3900794771 >> 172.21.15.53:0/3900794771 conn(0x7f59080b20d0 msgr2=0x7f59080b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- 172.21.15.53:0/3900794771 shutdown_connections 2024-09-13T18:25:46.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- 172.21.15.53:0/3900794771 wait complete. 2024-09-13T18:25:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 Processor -- start 2024-09-13T18:25:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- start start 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59080cf6a0 0x7f590815f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f590815c9e0 0x7f590814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908160300 0x7f59080b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b6260 con 0x7f590815c9e0 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b47a0 con 0x7f5908160300 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f590ed00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590814bab0 con 0x7f59080cf6a0 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f5907fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f590815c9e0 0x7f590814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.185+0000 7f5907fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f590815c9e0 0x7f590814bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41854/0 (socket says 172.21.15.53:41854) 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f5907fff640 1 -- 172.21.15.53:0/3426025341 learned_addr learned my addr 172.21.15.53:0/3426025341 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f590ca9c640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59080cf6a0 0x7f590815f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f590d29d640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908160300 0x7f59080b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f5907fff640 1 -- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59080cf6a0 msgr2=0x7f590815f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f5907fff640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59080cf6a0 0x7f590815f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f5907fff640 1 -- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908160300 msgr2=0x7f59080b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f5907fff640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908160300 0x7f59080b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f5907fff640 1 -- 172.21.15.53:0/3426025341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80094d0 con 0x7f590815c9e0 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f590d29d640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908160300 0x7f59080b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f5907fff640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f590815c9e0 0x7f590814bcb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c500 tx=0x7f58fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f59057fa640 1 -- 172.21.15.53:0/3426025341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc005220 con 0x7f590815c9e0 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f59057fa640 1 -- 172.21.15.53:0/3426025341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc005380 con 0x7f590815c9e0 2024-09-13T18:25:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f59057fa640 1 -- 172.21.15.53:0/3426025341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc007270 con 0x7f590815c9e0 2024-09-13T18:25:46.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080b41e0 con 0x7f590815c9e0 2024-09-13T18:25:46.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59080b5e80 con 0x7f590815c9e0 2024-09-13T18:25:46.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59080b63a0 con 0x7f590815c9e0 2024-09-13T18:25:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f59057fa640 1 -- 172.21.15.53:0/3426025341 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58fc0073d0 con 0x7f590815c9e0 2024-09-13T18:25:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f59057fa640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f58f4066690 0x7f58f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f59057fa640 1 -- 172.21.15.53:0/3426025341 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f58fc083b50 con 0x7f590815c9e0 2024-09-13T18:25:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.189+0000 7f590ca9c640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f58f4066690 0x7f58f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.193+0000 7f590ca9c640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f58f4066690 0x7f58f4068b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ae000 tx=0x7f58f80b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.193+0000 7f59057fa640 1 -- 172.21.15.53:0/3426025341 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59080b63a0 con 0x7f590815c9e0 2024-09-13T18:25:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.353+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59080b63a0 con 0x7f590815c9e0 2024-09-13T18:25:46.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f59057fa640 1 -- 172.21.15.53:0/3426025341 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59080b63a0 con 0x7f590815c9e0 2024-09-13T18:25:46.359 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:25:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f58f4066690 msgr2=0x7f58f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f58f4066690 0x7f58f4068b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58f80ae000 tx=0x7f58f80b5040 comp rx=0 tx=0).stop 2024-09-13T18:25:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f590815c9e0 msgr2=0x7f590814bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f590815c9e0 0x7f590814bcb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00c500 tx=0x7f58fc00c9c0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 shutdown_connections 2024-09-13T18:25:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f58f4066690 0x7f58f4068b50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5908160300 0x7f59080b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f590815c9e0 0x7f590814bcb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 --2- 172.21.15.53:0/3426025341 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59080cf6a0 0x7f590815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 >> 172.21.15.53:0/3426025341 conn(0x7f59080b20d0 msgr2=0x7f59080d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 shutdown_connections 2024-09-13T18:25:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.357+0000 7f590ed00640 1 -- 172.21.15.53:0/3426025341 wait complete. 2024-09-13T18:25:46.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:25:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556237e640 1 Processor -- start 2024-09-13T18:25:46.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556237e640 1 -- start start 2024-09-13T18:25:46.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556237e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f555c143e80 0x7f555c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556237e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c06f7a0 con 0x7f555c0cda30 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556237e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c06fd60 con 0x7f555c0caee0 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556237e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c0cb960 con 0x7f555c143e80 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556091b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f555c0cda30 0x7f555c0701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52970/0 (socket says 172.21.15.53:52970) 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556091b640 1 -- 172.21.15.53:0/4100423578 learned_addr learned my addr 172.21.15.53:0/4100423578 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555bfff640 1 --2- 172.21.15.53:0/4100423578 >> v2:172.21.15.87:3300/0 conn(0x7f555c143e80 0x7f555c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662037924 0 0) 0x7f555c06f7a0 con 0x7f555c0cda30 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5544003530 con 0x7f555c0cda30 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 48959920 0 0) 0x7f5544003530 con 0x7f555c0cda30 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 >> v2:172.21.15.87:3300/0 conn(0x7f555c143e80 msgr2=0x7f555c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 --2- 172.21.15.53:0/4100423578 >> v2:172.21.15.87:3300/0 conn(0x7f555c143e80 0x7f555c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 >> v1:172.21.15.87:6789/0 conn(0x7f555c0caee0 legacy=0x7f555c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0cbc40 con 0x7f555c0cda30 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5554001a00 con 0x7f555c0cda30 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 >> v1:172.21.15.53:6789/0 conn(0x7f555c0cda30 legacy=0x7f555c0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544003980 0x7f5544003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f5544004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440052b0 0x7f554400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0cb960 con 0x7f55440047d0 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554400c180 con 0x7f5544003980 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554400c340 con 0x7f55440052b0 2024-09-13T18:25:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555b7fe640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f5544004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556091b640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440052b0 0x7f554400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555bfff640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544003980 0x7f5544003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555b7fe640 1 -- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440052b0 msgr2=0x7f554400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555b7fe640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440052b0 0x7f554400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555b7fe640 1 -- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544003980 msgr2=0x7f5544003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555b7fe640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544003980 0x7f5544003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f555b7fe640 1 -- 172.21.15.53:0/4100423578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544003530 con 0x7f55440047d0 2024-09-13T18:25:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.497+0000 7f556091b640 1 -- 172.21.15.53:0/4100423578 reap_dead start 2024-09-13T18:25:46.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f555b7fe640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f5544004c50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5550001750 tx=0x7f555001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58915ad7fbac3a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55500052d0 con 0x7f55440047d0 2024-09-13T18:25:46.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55500a7050 con 0x7f55440047d0 2024-09-13T18:25:46.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f555affd640 1 -- 172.21.15.53:0/4100423578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550003600 con 0x7f55440047d0 2024-09-13T18:25:46.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 -- 172.21.15.53:0/4100423578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 msgr2=0x7f5544004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f5544004c50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5550001750 tx=0x7f555001c370 comp rx=0 tx=0).stop 2024-09-13T18:25:46.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 -- 172.21.15.53:0/4100423578 shutdown_connections 2024-09-13T18:25:46.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 --2- 172.21.15.53:0/4100423578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f5544004c50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 -- 172.21.15.53:0/4100423578 >> 172.21.15.53:0/4100423578 conn(0x7f555c065c80 msgr2=0x7f555c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 -- 172.21.15.53:0/4100423578 shutdown_connections 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 -- 172.21.15.53:0/4100423578 wait complete. 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 Processor -- start 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.501+0000 7f556237e640 1 -- start start 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f555c13a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f555c0c4390 0x7f555c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f555c0a9520 0x7f555c0a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0acfd0 con 0x7f55440047d0 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0c4d50 con 0x7f555c0a9520 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0aad40 con 0x7f555c0c4390 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f555c13a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f555c13a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41882/0 (socket says 172.21.15.53:41882) 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 -- 172.21.15.53:0/2747899282 learned_addr learned my addr 172.21.15.53:0/2747899282 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555b7fe640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f555c0c4390 0x7f555c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 -- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f555c0c4390 msgr2=0x7f555c0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f555c0c4390 0x7f555c0c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 -- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f555c0a9520 msgr2=0x7f555c0a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f555c0a9520 0x7f555c0a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 -- 172.21.15.53:0/2747899282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0a9ee0 con 0x7f55440047d0 2024-09-13T18:25:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555bfff640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f555c13a0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f554c011690 tx=0x7f554c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f5558ff9640 1 -- 172.21.15.53:0/2747899282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00f940 con 0x7f55440047d0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f5558ff9640 1 -- 172.21.15.53:0/2747899282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00faa0 con 0x7f55440047d0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c13a610 con 0x7f55440047d0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f5558ff9640 1 -- 172.21.15.53:0/2747899282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00fe10 con 0x7f55440047d0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c0aa410 con 0x7f55440047d0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c070560 con 0x7f55440047d0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f5558ff9640 1 -- 172.21.15.53:0/2747899282 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f554c015460 con 0x7f55440047d0 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f5558ff9640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5548066690 0x7f5548068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f5558ff9640 1 -- 172.21.15.53:0/2747899282 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f554c084690 con 0x7f55440047d0 2024-09-13T18:25:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.505+0000 7f555b7fe640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5548066690 0x7f5548068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.509+0000 7f555b7fe640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5548066690 0x7f5548068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f55440057b0 tx=0x7f55500011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.509+0000 7f5558ff9640 1 -- 172.21.15.53:0/2747899282 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f554c051980 con 0x7f55440047d0 2024-09-13T18:25:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f555c0adda0 con 0x7f55440047d0 2024-09-13T18:25:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f5558ff9640 1 -- 172.21.15.53:0/2747899282 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f554c054fa0 con 0x7f55440047d0 2024-09-13T18:25:46.668 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5548066690 msgr2=0x7f5548068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5548066690 0x7f5548068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f55440057b0 tx=0x7f55500011a0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 msgr2=0x7f555c13a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f555c13a0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f554c011690 tx=0x7f554c011b50 comp rx=0 tx=0).stop 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 shutdown_connections 2024-09-13T18:25:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5548066690 0x7f5548068b50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f555c0c4390 0x7f555c0c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f555c0a9520 0x7f555c0a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 --2- 172.21.15.53:0/2747899282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55440047d0 0x7f555c13a0d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 >> 172.21.15.53:0/2747899282 conn(0x7f555c065c80 msgr2=0x7f555c0b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 shutdown_connections 2024-09-13T18:25:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.664+0000 7f556237e640 1 -- 172.21.15.53:0/2747899282 wait complete. 2024-09-13T18:25:46.685 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:46.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.792+0000 7f3f28dd6640 1 Processor -- start 2024-09-13T18:25:46.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.792+0000 7f3f28dd6640 1 -- start start 2024-09-13T18:25:46.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f28dd6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3f240713a0 0x7f3f24165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f28dd6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2406d480 con 0x7f3f241582a0 2024-09-13T18:25:46.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f28dd6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2415ace0 con 0x7f3f2415b7c0 2024-09-13T18:25:46.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f28dd6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2415aaf0 con 0x7f3f240713a0 2024-09-13T18:25:46.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3f241582a0 0x7f3f2406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60296/0 (socket says 172.21.15.53:60296) 2024-09-13T18:25:46.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2259c640 1 -- 172.21.15.53:0/17208177 learned_addr learned my addr 172.21.15.53:0/17208177 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f22d9d640 1 --2- 172.21.15.53:0/17208177 >> v2:172.21.15.87:3300/0 conn(0x7f3f240713a0 0x7f3f24165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719779329 0 0) 0x7f3f2406d480 con 0x7f3f241582a0 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f0c003530 con 0x7f3f241582a0 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 598305467 0 0) 0x7f3f0c003530 con 0x7f3f241582a0 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 >> v2:172.21.15.87:3300/0 conn(0x7f3f240713a0 msgr2=0x7f3f24165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 --2- 172.21.15.53:0/17208177 >> v2:172.21.15.87:3300/0 conn(0x7f3f240713a0 0x7f3f24165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 >> v1:172.21.15.87:6789/0 conn(0x7f3f2415b7c0 legacy=0x7f3f24070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2415afc0 con 0x7f3f241582a0 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3f14001680 con 0x7f3f241582a0 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 >> v1:172.21.15.53:6789/0 conn(0x7f3f241582a0 legacy=0x7f3f2406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f0c003980 0x7f3f0c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f0c0047d0 0x7f3f0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c00c000 con 0x7f3f0c005190 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c00c170 con 0x7f3f0c003980 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c00c330 con 0x7f3f0c0047d0 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f22d9d640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f2259c640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f0c003980 0x7f3f0c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f21d9b640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f0c0047d0 0x7f3f0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f22d9d640 1 -- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f0c0047d0 msgr2=0x7f3f0c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:46.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f22d9d640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f0c0047d0 0x7f3f0c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f22d9d640 1 -- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f0c003980 msgr2=0x7f3f0c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:46.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f22d9d640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f0c003980 0x7f3f0c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f22d9d640 1 -- 172.21.15.53:0/17208177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c003530 con 0x7f3f0c005190 2024-09-13T18:25:46.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.796+0000 7f3f21d9b640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f0c0047d0 0x7f3f0c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:46.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f22d9d640 1 -- 172.21.15.53:0/17208177 reap_dead start 2024-09-13T18:25:46.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f22d9d640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f0c00b990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009f90 tx=0x7f3f1c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7b91716d28b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0a5c90 con 0x7f3f0c005190 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c00f040 con 0x7f3f0c005190 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2159a640 1 -- 172.21.15.53:0/17208177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0039a0 con 0x7f3f0c005190 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- 172.21.15.53:0/17208177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 msgr2=0x7f3f0c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f0c00b990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009f90 tx=0x7f3f1c01cc80 comp rx=0 tx=0).stop 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- 172.21.15.53:0/17208177 shutdown_connections 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/17208177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f0c00b990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- 172.21.15.53:0/17208177 >> 172.21.15.53:0/17208177 conn(0x7f3f24065c80 msgr2=0x7f3f24066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:46.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- 172.21.15.53:0/17208177 shutdown_connections 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- 172.21.15.53:0/17208177 wait complete. 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 Processor -- start 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- start start 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f24153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f241f08d0 0x7f3f240ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f240ab8c0 0x7f3f240abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24154510 con 0x7f3f0c005190 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24153f50 con 0x7f3f241f08d0 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24154230 con 0x7f3f240ab8c0 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f24153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f24153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54144/0 (socket says 172.21.15.53:54144) 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 -- 172.21.15.53:0/3468751994 learned_addr learned my addr 172.21.15.53:0/3468751994 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f22d9d640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f240ab8c0 0x7f3f240abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f21d9b640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f241f08d0 0x7f3f240ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 -- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f240ab8c0 msgr2=0x7f3f240abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f240ab8c0 0x7f3f240abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 -- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f241f08d0 msgr2=0x7f3f240ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f241f08d0 0x7f3f240ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 -- 172.21.15.53:0/3468751994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24155140 con 0x7f3f0c005190 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f21d9b640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f241f08d0 0x7f3f240ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f2259c640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f24153650 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400e780 tx=0x7f3f1400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f12ffd640 1 -- 172.21.15.53:0/3468751994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400ee90 con 0x7f3f0c005190 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f12ffd640 1 -- 172.21.15.53:0/3468751994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1400c8d0 con 0x7f3f0c005190 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f24155420 con 0x7f3f0c005190 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f12ffd640 1 -- 172.21.15.53:0/3468751994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400cc80 con 0x7f3f0c005190 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.800+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f240cd520 con 0x7f3f0c005190 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.804+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f24067400 con 0x7f3f0c005190 2024-09-13T18:25:46.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.804+0000 7f3f12ffd640 1 -- 172.21.15.53:0/3468751994 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f1401d460 con 0x7f3f0c005190 2024-09-13T18:25:46.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.804+0000 7f3f12ffd640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f040666c0 0x7f3f04068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:46.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.804+0000 7f3f12ffd640 1 -- 172.21.15.53:0/3468751994 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3f140840e0 con 0x7f3f0c005190 2024-09-13T18:25:46.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.804+0000 7f3f21d9b640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f040666c0 0x7f3f04068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:46.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.804+0000 7f3f21d9b640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f040666c0 0x7f3f04068b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f24155030 tx=0x7f3f18009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:46.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:46.808+0000 7f3f12ffd640 1 -- 172.21.15.53:0/3468751994 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f14051460 con 0x7f3f0c005190 2024-09-13T18:25:47.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.008+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f24155610 con 0x7f3f0c005190 2024-09-13T18:25:47.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.008+0000 7f3f12ffd640 1 -- 172.21.15.53:0/3468751994 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7f3f14054a80 con 0x7f3f0c005190 2024-09-13T18:25:47.014 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:47.014 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f040666c0 msgr2=0x7f3f04068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f040666c0 0x7f3f04068b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f24155030 tx=0x7f3f18009040 comp rx=0 tx=0).stop 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 msgr2=0x7f3f24153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f24153650 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400e780 tx=0x7f3f1400ec40 comp rx=0 tx=0).stop 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 shutdown_connections 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3f040666c0 0x7f3f04068b80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f240ab8c0 0x7f3f240abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f241f08d0 0x7f3f240ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 --2- 172.21.15.53:0/3468751994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f0c005190 0x7f3f24153650 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 >> 172.21.15.53:0/3468751994 conn(0x7f3f24065c80 msgr2=0x7f3f2406cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 shutdown_connections 2024-09-13T18:25:47.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.012+0000 7f3f28dd6640 1 -- 172.21.15.53:0/3468751994 wait complete. 2024-09-13T18:25:47.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c80023640 1 Processor -- start 2024-09-13T18:25:47.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c80023640 1 -- start start 2024-09-13T18:25:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c80023640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c780cc270 0x7f8c7815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c80023640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7806f550 con 0x7f8c7815a470 2024-09-13T18:25:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c80023640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7815dc40 con 0x7f8c780b1c10 2024-09-13T18:25:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c80023640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7806f880 con 0x7f8c780cc270 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8c7815a470 0x7f8c78071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60312/0 (socket says 172.21.15.53:60312) 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/3915932388 learned_addr learned my addr 172.21.15.53:0/3915932388 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953868490 0 0) 0x7f8c7806f550 con 0x7f8c7815a470 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c64003530 con 0x7f8c7815a470 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7d5be640 1 --2- 172.21.15.53:0/3915932388 >> v2:172.21.15.87:3300/0 conn(0x7f8c780cc270 0x7f8c7815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 717466485 0 0) 0x7f8c64003530 con 0x7f8c7815a470 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 >> v2:172.21.15.87:3300/0 conn(0x7f8c780cc270 msgr2=0x7f8c7815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 --2- 172.21.15.53:0/3915932388 >> v2:172.21.15.87:3300/0 conn(0x7f8c780cc270 0x7f8c7815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 >> v1:172.21.15.87:6789/0 conn(0x7f8c780b1c10 legacy=0x7f8c7806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780cc6d0 con 0x7f8c7815a470 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8c74001680 con 0x7f8c7815a470 2024-09-13T18:25:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 >> v1:172.21.15.53:6789/0 conn(0x7f8c7815a470 legacy=0x7f8c78071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c64003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c640047d0 0x7f8c64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c64005190 0x7f8c6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7806f880 con 0x7f8c64003980 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6400c0c0 con 0x7f8c640047d0 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6400c280 con 0x7f8c64005190 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c64003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7d5be640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c640047d0 0x7f8c64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c64005190 msgr2=0x7f8c6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7e5c0640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c64005190 0x7f8c6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c64005190 0x7f8c6400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c640047d0 msgr2=0x7f8c64004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c640047d0 0x7f8c64004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7e5c0640 1 -- 172.21.15.53:0/3915932388 reap_dead start 2024-09-13T18:25:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/3915932388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64003530 con 0x7f8c64003980 2024-09-13T18:25:47.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.140+0000 7f8c7d5be640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c640047d0 0x7f8c64004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c64003d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c190 tx=0x7f8c7401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd63f2922408cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740058e0 con 0x7f8c64003980 2024-09-13T18:25:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74005a60 con 0x7f8c64003980 2024-09-13T18:25:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7cdbd640 1 -- 172.21.15.53:0/3915932388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74005e10 con 0x7f8c64003980 2024-09-13T18:25:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- 172.21.15.53:0/3915932388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 msgr2=0x7f8c64003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c64003d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c190 tx=0x7f8c7401cbd0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- 172.21.15.53:0/3915932388 shutdown_connections 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 --2- 172.21.15.53:0/3915932388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c64003d80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- 172.21.15.53:0/3915932388 >> 172.21.15.53:0/3915932388 conn(0x7f8c78065c80 msgr2=0x7f8c78066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- 172.21.15.53:0/3915932388 shutdown_connections 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- 172.21.15.53:0/3915932388 wait complete. 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 Processor -- start 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- start start 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c781f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c781f27b0 0x7f8c781f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7815f2d0 0x7f8c7806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7815dc40 con 0x7f8c64003980 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781f91f0 con 0x7f8c7815f2d0 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c80023640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781f94d0 con 0x7f8c781f27b0 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c781f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c781f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54162/0 (socket says 172.21.15.53:54162) 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/4263744729 learned_addr learned my addr 172.21.15.53:0/4263744729 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7e5c0640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7815f2d0 0x7f8c7806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7d5be640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c781f27b0 0x7f8c781f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c781f27b0 msgr2=0x7f8c781f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c781f27b0 0x7f8c781f89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7815f2d0 msgr2=0x7f8c7806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7815f2d0 0x7f8c7806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 -- 172.21.15.53:0/4263744729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7815deb0 con 0x7f8c64003980 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7e5c0640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7815f2d0 0x7f8c7806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.144+0000 7f8c7ddbf640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c781f5f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401ca00 tx=0x7f8c64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/4263744729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74001640 con 0x7f8c64003980 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/4263744729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c740a58b0 con 0x7f8c64003980 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c781f8ee0 con 0x7f8c64003980 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/4263744729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740a5c40 con 0x7f8c64003980 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7815f750 con 0x7f8c64003980 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78067400 con 0x7f8c64003980 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/4263744729 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c740b4070 con 0x7f8c64003980 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c6a7fc640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8c5c066690 0x7f8c5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/4263744729 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8c7411df50 con 0x7f8c64003980 2024-09-13T18:25:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c7d5be640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8c5c066690 0x7f8c5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.148+0000 7f8c7d5be640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8c5c066690 0x7f8c5c068b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c78159590 tx=0x7f8c6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.152+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/4263744729 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c740eb2d0 con 0x7f8c64003980 2024-09-13T18:25:47.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.312+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c7815e040 con 0x7f8c64003980 2024-09-13T18:25:47.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.312+0000 7f8c6a7fc640 1 -- 172.21.15.53:0/4263744729 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16639 (secure 0 0 0) 0x7f8c740bc090 con 0x7f8c64003980 2024-09-13T18:25:47.318 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:47.319 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:40.061767+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8c5c066690 msgr2=0x7f8c5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8c5c066690 0x7f8c5c068b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c78159590 tx=0x7f8c6c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 msgr2=0x7f8c781f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c781f5f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401ca00 tx=0x7f8c64005800 comp rx=0 tx=0).stop 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 shutdown_connections 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8c5c066690 0x7f8c5c068b50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c781f27b0 0x7f8c781f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7815f2d0 0x7f8c7806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 --2- 172.21.15.53:0/4263744729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c64003980 0x7f8c781f5f30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 >> 172.21.15.53:0/4263744729 conn(0x7f8c78065c80 msgr2=0x7f8c7814fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 shutdown_connections 2024-09-13T18:25:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.316+0000 7f8c80023640 1 -- 172.21.15.53:0/4263744729 wait complete. 2024-09-13T18:25:47.338 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:25:47.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:47.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.452+0000 7f677f6ab640 1 Processor -- start 2024-09-13T18:25:47.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.452+0000 7f677f6ab640 1 -- start start 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f677806b850 0x7f67780b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67780cbd60 0x7f67780cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67780b1ac0 con 0x7f67780cb980 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67780b3010 con 0x7f67780cbd60 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6778159ac0 con 0x7f677806b850 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677d447640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f67780cb980 0x7f677806fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60322/0 (socket says 172.21.15.53:60322) 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677d447640 1 -- 172.21.15.53:0/1938239332 learned_addr learned my addr 172.21.15.53:0/1938239332 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677dc48640 1 --2- 172.21.15.53:0/1938239332 >> v2:172.21.15.53:3300/0 conn(0x7f67780cbd60 0x7f67780cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677cc46640 1 --2- 172.21.15.53:0/1938239332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f677806b850 0x7f67780b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f676ffff640 1 -- 172.21.15.53:0/1938239332 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402630636 0 0) 0x7f67780b1ac0 con 0x7f67780cb980 2024-09-13T18:25:47.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f676ffff640 1 -- 172.21.15.53:0/1938239332 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6764005740 con 0x7f67780cb980 2024-09-13T18:25:47.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677dc48640 1 -- 172.21.15.53:0/1938239332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f677806b850 msgr2=0x7f67780b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677dc48640 1 --2- 172.21.15.53:0/1938239332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f677806b850 0x7f67780b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677dc48640 1 -- 172.21.15.53:0/1938239332 >> v1:172.21.15.53:6789/0 conn(0x7f67780cb980 legacy=0x7f677806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677dc48640 1 -- 172.21.15.53:0/1938239332 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6778159da0 con 0x7f67780cbd60 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677dc48640 1 --2- 172.21.15.53:0/1938239332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cbd60 0x7f67780cdd40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6770009d90 tx=0x7f677001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6548fa659f62fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f676ffff640 1 -- 172.21.15.53:0/1938239332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700a5970 con 0x7f67780cbd60 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f676ffff640 1 -- 172.21.15.53:0/1938239332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700a5ad0 con 0x7f67780cbd60 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f676ffff640 1 -- 172.21.15.53:0/1938239332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700a5e60 con 0x7f67780cbd60 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- 172.21.15.53:0/1938239332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cbd60 msgr2=0x7f67780cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 --2- 172.21.15.53:0/1938239332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cbd60 0x7f67780cdd40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6770009d90 tx=0x7f677001c8b0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- 172.21.15.53:0/1938239332 shutdown_connections 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 --2- 172.21.15.53:0/1938239332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cbd60 0x7f67780cdd40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 --2- 172.21.15.53:0/1938239332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f677806b850 0x7f67780b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- 172.21.15.53:0/1938239332 >> 172.21.15.53:0/1938239332 conn(0x7f6778065c80 msgr2=0x7f6778066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- 172.21.15.53:0/1938239332 shutdown_connections 2024-09-13T18:25:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.456+0000 7f677f6ab640 1 -- 172.21.15.53:0/1938239332 wait complete. 2024-09-13T18:25:47.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 Processor -- start 2024-09-13T18:25:47.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 -- start start 2024-09-13T18:25:47.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677806b850 0x7f6778147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cb980 0x7f6778144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67780cbd60 0x7f677814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67781502b0 con 0x7f67780cb980 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677814f1c0 con 0x7f677806b850 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677814f4a0 con 0x7f67780cbd60 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cb980 0x7f6778144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cb980 0x7f6778144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54170/0 (socket says 172.21.15.53:54170) 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 -- 172.21.15.53:0/2924313783 learned_addr learned my addr 172.21.15.53:0/2924313783 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677d447640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677806b850 0x7f6778147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677dc48640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67780cbd60 0x7f677814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 -- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67780cbd60 msgr2=0x7f677814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67780cbd60 0x7f677814e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 -- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677806b850 msgr2=0x7f6778147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677806b850 0x7f6778147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 -- 172.21.15.53:0/2924313783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009a70 con 0x7f67780cb980 2024-09-13T18:25:47.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677dc48640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67780cbd60 0x7f677814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677d447640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677806b850 0x7f6778147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677cc46640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cb980 0x7f6778144e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f676800d7d0 tx=0x7f676800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f676dffb640 1 -- 172.21.15.53:0/2924313783 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800b6c0 con 0x7f67780cb980 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f676dffb640 1 -- 172.21.15.53:0/2924313783 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676800b820 con 0x7f67780cb980 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677814f780 con 0x7f67780cb980 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f676dffb640 1 -- 172.21.15.53:0/2924313783 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800bbb0 con 0x7f67780cb980 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.460+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6778145a80 con 0x7f67780cb980 2024-09-13T18:25:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.464+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6778067400 con 0x7f67780cb980 2024-09-13T18:25:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.464+0000 7f676dffb640 1 -- 172.21.15.53:0/2924313783 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f676800bd10 con 0x7f67780cb980 2024-09-13T18:25:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.464+0000 7f676dffb640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f675c066690 0x7f675c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.464+0000 7f676dffb640 1 -- 172.21.15.53:0/2924313783 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f67680846d0 con 0x7f67780cb980 2024-09-13T18:25:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.464+0000 7f677d447640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f675c066690 0x7f675c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.464+0000 7f677d447640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f675c066690 0x7f675c068b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67740011f0 tx=0x7f6774009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.468+0000 7f676dffb640 1 -- 172.21.15.53:0/2924313783 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6768051a50 con 0x7f67780cb980 2024-09-13T18:25:47.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.660+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67780b2c40 con 0x7f67780cb980 2024-09-13T18:25:47.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.660+0000 7f676dffb640 1 -- 172.21.15.53:0/2924313783 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7f6768055070 con 0x7f67780cb980 2024-09-13T18:25:47.666 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:47.666 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:47.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f675c066690 msgr2=0x7f675c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f675c066690 0x7f675c068b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67740011f0 tx=0x7f6774009040 comp rx=0 tx=0).stop 2024-09-13T18:25:47.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cb980 msgr2=0x7f6778144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cb980 0x7f6778144e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f676800d7d0 tx=0x7f676800dc90 comp rx=0 tx=0).stop 2024-09-13T18:25:47.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 shutdown_connections 2024-09-13T18:25:47.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f675c066690 0x7f675c068b50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67780cbd60 0x7f677814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67780cb980 0x7f6778144e40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 --2- 172.21.15.53:0/2924313783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677806b850 0x7f6778147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 >> 172.21.15.53:0/2924313783 conn(0x7f6778065c80 msgr2=0x7f677814be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 shutdown_connections 2024-09-13T18:25:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.664+0000 7f677f6ab640 1 -- 172.21.15.53:0/2924313783 wait complete. 2024-09-13T18:25:47.685 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:25:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.808+0000 7f90a4f8f640 1 Processor -- start 2024-09-13T18:25:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.808+0000 7f90a4f8f640 1 -- start start 2024-09-13T18:25:47.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f90a4f8f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90a00cb980 0x7f90a00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f90a4f8f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a00b1ac0 con 0x7f90a006b850 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f90a4f8f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a0159ac0 con 0x7f90a00cbd60 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f90a4f8f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a0159da0 con 0x7f90a00cb980 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f9097fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f90a006b850 0x7f90a006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60330/0 (socket says 172.21.15.53:60330) 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f9097fff640 1 -- 172.21.15.53:0/558949406 learned_addr learned my addr 172.21.15.53:0/558949406 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 --2- 172.21.15.53:0/558949406 >> v2:172.21.15.87:3300/0 conn(0x7f90a00cb980 0x7f90a00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850263128 0 0) 0x7f90a00b1ac0 con 0x7f90a006b850 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f908c003530 con 0x7f90a006b850 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679268646 0 0) 0x7f908c003530 con 0x7f90a006b850 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 >> v2:172.21.15.87:3300/0 conn(0x7f90a00cb980 msgr2=0x7f90a00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 --2- 172.21.15.53:0/558949406 >> v2:172.21.15.87:3300/0 conn(0x7f90a00cb980 0x7f90a00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 >> v1:172.21.15.87:6789/0 conn(0x7f90a00cbd60 legacy=0x7f90a00b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a015a080 con 0x7f90a006b850 2024-09-13T18:25:47.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9090001680 con 0x7f90a006b850 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 >> v1:172.21.15.53:6789/0 conn(0x7f90a006b850 legacy=0x7f90a006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f908c0039d0 0x7f908c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0047d0 0x7f908c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f908c0051e0 0x7f908c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0159da0 con 0x7f908c0039d0 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c00c130 con 0x7f908c0047d0 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c00c2f0 con 0x7f908c0051e0 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f908c0039d0 0x7f908c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f9097fff640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0047d0 0x7f908c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 -- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f908c0051e0 msgr2=0x7f908c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f908c0051e0 0x7f908c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 -- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0047d0 msgr2=0x7f908c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:47.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0047d0 0x7f908c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 -- 172.21.15.53:0/558949406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c003530 con 0x7f908c0039d0 2024-09-13T18:25:47.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f9097fff640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0047d0 0x7f908c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:47.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909ed9d640 1 -- 172.21.15.53:0/558949406 reap_dead start 2024-09-13T18:25:47.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909e59c640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f908c0039d0 0x7f908c003df0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9088009ab0 tx=0x7f908801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c985029e50ccfade server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.812+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90880a6510 con 0x7f908c0039d0 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90880a6670 con 0x7f908c0039d0 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f909dd9b640 1 -- 172.21.15.53:0/558949406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90880a6a20 con 0x7f908c0039d0 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- 172.21.15.53:0/558949406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f908c0039d0 msgr2=0x7f908c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f908c0039d0 0x7f908c003df0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9088009ab0 tx=0x7f908801ca20 comp rx=0 tx=0).stop 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- 172.21.15.53:0/558949406 shutdown_connections 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/558949406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f908c0039d0 0x7f908c003df0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- 172.21.15.53:0/558949406 >> 172.21.15.53:0/558949406 conn(0x7f90a0065c80 msgr2=0x7f90a0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- 172.21.15.53:0/558949406 shutdown_connections 2024-09-13T18:25:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- 172.21.15.53:0/558949406 wait complete. 2024-09-13T18:25:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 Processor -- start 2024-09-13T18:25:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- start start 2024-09-13T18:25:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0039d0 0x7f90a014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a014b2c0 0x7f90a0147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a01583f0 0x7f90a01588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0158de0 con 0x7f90a014b2c0 2024-09-13T18:25:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01486a0 con 0x7f908c0039d0 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a014dfe0 con 0x7f90a01583f0 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a014b2c0 0x7f90a0147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a014b2c0 0x7f90a0147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54198/0 (socket says 172.21.15.53:54198) 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 -- 172.21.15.53:0/1025896979 learned_addr learned my addr 172.21.15.53:0/1025896979 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f909e59c640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0039d0 0x7f90a014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f909ed9d640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a01583f0 0x7f90a01588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 -- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a01583f0 msgr2=0x7f90a01588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a01583f0 0x7f90a01588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 -- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0039d0 msgr2=0x7f90a014d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0039d0 0x7f90a014d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 -- 172.21.15.53:0/1025896979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a014e2c0 con 0x7f90a014b2c0 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9097fff640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a014b2c0 0x7f90a0147c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f909000d7e0 tx=0x7f909000dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9096ffd640 1 -- 172.21.15.53:0/1025896979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900074e0 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9096ffd640 1 -- 172.21.15.53:0/1025896979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090007640 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a014e5a0 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f9096ffd640 1 -- 172.21.15.53:0/1025896979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090004a10 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.816+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a0148190 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.820+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a0067400 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.820+0000 7f9096ffd640 1 -- 172.21.15.53:0/1025896979 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9090004b70 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.820+0000 7f9096ffd640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9080066690 0x7f9080068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.820+0000 7f9096ffd640 1 -- 172.21.15.53:0/1025896979 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9090083f60 con 0x7f90a014b2c0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.820+0000 7f909e59c640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9080066690 0x7f9080068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.820+0000 7f909e59c640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9080066690 0x7f9080068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f90880af000 tx=0x7f9088008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:47.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:47.824+0000 7f9096ffd640 1 -- 172.21.15.53:0/1025896979 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9090051250 con 0x7f90a014b2c0 2024-09-13T18:25:48.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.016+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90a015d4b0 con 0x7f90a014b2c0 2024-09-13T18:25:48.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f9096ffd640 1 -- 172.21.15.53:0/1025896979 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4722 (secure 0 0 0) 0x7f9090019090 con 0x7f90a014b2c0 2024-09-13T18:25:48.025 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:48.025 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/174910426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":174910426},{"type":"v1","addr":"172.21.15.87:6835","nonce":174910426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2698885908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2698885908},{"type":"v1","addr":"172.21.15.87:6837","nonce":2698885908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/480588185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":480588185},{"type":"v1","addr":"172.21.15.53:6834","nonce":480588185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:24:58.379517+0000","modified":"2024-09-13T18:25:01.385979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2656724921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656724921},{"type":"v1","addr":"172.21.15.53:6835","nonce":2656724921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9080066690 msgr2=0x7f9080068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9080066690 0x7f9080068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f90880af000 tx=0x7f9088008040 comp rx=0 tx=0).stop 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a014b2c0 msgr2=0x7f90a0147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a014b2c0 0x7f90a0147c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f909000d7e0 tx=0x7f909000dca0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 shutdown_connections 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9080066690 0x7f9080068b50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90a01583f0 0x7f90a01588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90a014b2c0 0x7f90a0147c50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 --2- 172.21.15.53:0/1025896979 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f908c0039d0 0x7f90a014d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 >> 172.21.15.53:0/1025896979 conn(0x7f90a0065c80 msgr2=0x7f90a00ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:48.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 shutdown_connections 2024-09-13T18:25:48.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.020+0000 7f90a4f8f640 1 -- 172.21.15.53:0/1025896979 wait complete. 2024-09-13T18:25:48.043 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:48.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77d254640 1 Processor -- start 2024-09-13T18:25:48.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77d254640 1 -- start start 2024-09-13T18:25:48.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77d254640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa77806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77d254640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa77815b7c0 0x7fa77806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77d254640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77806d480 con 0x7fa778070c90 2024-09-13T18:25:48.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77d254640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77815aaf0 con 0x7fa77815b7c0 2024-09-13T18:25:48.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77d254640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77806d760 con 0x7fa7781582a0 2024-09-13T18:25:48.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77759e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa778070c90 0x7fa77806f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60338/0 (socket says 172.21.15.53:60338) 2024-09-13T18:25:48.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77759e640 1 -- 172.21.15.53:0/4071441626 learned_addr learned my addr 172.21.15.53:0/4071441626 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa776d9d640 1 --2- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa77806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77659c640 1 --2- 172.21.15.53:0/4071441626 >> v2:172.21.15.87:3300/0 conn(0x7fa77815b7c0 0x7fa77806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa775d9b640 1 -- 172.21.15.53:0/4071441626 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187178401 0 0) 0x7fa77806d480 con 0x7fa778070c90 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa775d9b640 1 -- 172.21.15.53:0/4071441626 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa760003530 con 0x7fa778070c90 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa775d9b640 1 -- 172.21.15.53:0/4071441626 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3545751169 0 0) 0x7fa760003530 con 0x7fa778070c90 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77659c640 1 -- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 msgr2=0x7fa77806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77659c640 1 --2- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa77806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77659c640 1 -- 172.21.15.53:0/4071441626 >> v1:172.21.15.53:6789/0 conn(0x7fa778070c90 legacy=0x7fa77806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa77659c640 1 -- 172.21.15.53:0/4071441626 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77815ace0 con 0x7fa77815b7c0 2024-09-13T18:25:48.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.156+0000 7fa776d9d640 1 --2- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa77806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:25:48.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77659c640 1 --2- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 0x7fa77806ce40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097c0 tx=0x7fa76c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7820c56c7e815a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa775d9b640 1 -- 172.21.15.53:0/4071441626 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770001a00 con 0x7fa77815b7c0 2024-09-13T18:25:48.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa775d9b640 1 -- 172.21.15.53:0/4071441626 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c0a7050 con 0x7fa77815b7c0 2024-09-13T18:25:48.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa775d9b640 1 -- 172.21.15.53:0/4071441626 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0ab600 con 0x7fa77815b7c0 2024-09-13T18:25:48.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 -- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 msgr2=0x7fa77806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 --2- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 0x7fa77806ce40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097c0 tx=0x7fa76c01c390 comp rx=0 tx=0).stop 2024-09-13T18:25:48.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 -- 172.21.15.53:0/4071441626 shutdown_connections 2024-09-13T18:25:48.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 --2- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 0x7fa77806ce40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 --2- 172.21.15.53:0/4071441626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa77806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 -- 172.21.15.53:0/4071441626 >> 172.21.15.53:0/4071441626 conn(0x7fa778065c80 msgr2=0x7fa778066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:48.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 -- 172.21.15.53:0/4071441626 shutdown_connections 2024-09-13T18:25:48.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 -- 172.21.15.53:0/4071441626 wait complete. 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 Processor -- start 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.160+0000 7fa77d254640 1 -- start start 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa778070c90 0x7fa77814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa7780ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 0x7fa7780ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780afcb0 con 0x7fa778070c90 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778152390 con 0x7fa77815b7c0 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7781550b0 con 0x7fa7781582a0 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa778070c90 0x7fa77814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa778070c90 0x7fa77814e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54200/0 (socket says 172.21.15.53:54200) 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 -- 172.21.15.53:0/3365444883 learned_addr learned my addr 172.21.15.53:0/3365444883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:48.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77759e640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 0x7fa7780ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77659c640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa7780ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 -- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 msgr2=0x7fa7780ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa7780ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 -- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 msgr2=0x7fa7780ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 0x7fa7780ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 -- 172.21.15.53:0/3365444883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009420 con 0x7fa778070c90 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa776d9d640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa778070c90 0x7fa77814e780 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa76800ebe0 tx=0x7fa76800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa75f7fe640 1 -- 172.21.15.53:0/3365444883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800eee0 con 0x7fa778070c90 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa75f7fe640 1 -- 172.21.15.53:0/3365444883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76800cc30 con 0x7fa778070c90 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa75f7fe640 1 -- 172.21.15.53:0/3365444883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768013470 con 0x7fa778070c90 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c009420 con 0x7fa778070c90 2024-09-13T18:25:48.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778152630 con 0x7fa778070c90 2024-09-13T18:25:48.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa778067400 con 0x7fa778070c90 2024-09-13T18:25:48.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa75f7fe640 1 -- 172.21.15.53:0/3365444883 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7680135d0 con 0x7fa778070c90 2024-09-13T18:25:48.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa75f7fe640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa764066690 0x7fa764068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa75f7fe640 1 -- 172.21.15.53:0/3365444883 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa7680845b0 con 0x7fa778070c90 2024-09-13T18:25:48.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.164+0000 7fa77659c640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa764066690 0x7fa764068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.168+0000 7fa77659c640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa764066690 0x7fa764068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ad000 tx=0x7fa76c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.168+0000 7fa75f7fe640 1 -- 172.21.15.53:0/3365444883 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7680518b0 con 0x7fa778070c90 2024-09-13T18:25:48.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.328+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa77806f370 con 0x7fa778070c90 2024-09-13T18:25:48.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa75f7fe640 1 -- 172.21.15.53:0/3365444883 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16639 (secure 0 0 0) 0x7fa768054ed0 con 0x7fa778070c90 2024-09-13T18:25:48.335 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:48.335 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:40.061767+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:24:56.448268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:24:57.367221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:48.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa764066690 msgr2=0x7fa764068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa764066690 0x7fa764068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ad000 tx=0x7fa76c0a6000 comp rx=0 tx=0).stop 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa778070c90 msgr2=0x7fa77814e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa778070c90 0x7fa77814e780 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa76800ebe0 tx=0x7fa76800c520 comp rx=0 tx=0).stop 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 shutdown_connections 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa764066690 0x7fa764068b50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7781582a0 0x7fa7780ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa77815b7c0 0x7fa7780ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 --2- 172.21.15.53:0/3365444883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa778070c90 0x7fa77814e780 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 >> 172.21.15.53:0/3365444883 conn(0x7fa778065c80 msgr2=0x7fa778066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 shutdown_connections 2024-09-13T18:25:48.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.332+0000 7fa77d254640 1 -- 172.21.15.53:0/3365444883 wait complete. 2024-09-13T18:25:48.355 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:25:48.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f821e5640 1 Processor -- start 2024-09-13T18:25:48.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f821e5640 1 -- start start 2024-09-13T18:25:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f821e5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9f7c158d20 0x7f9f7c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f821e5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f7c071670 0x7f9f7c0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f821e5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7c159100 con 0x7f9f7c069f50 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f821e5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c071ef0 con 0x7f9f7c071670 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f821e5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c06c270 con 0x7f9f7c158d20 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f7c071670 0x7f9f7c0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f7c071670 0x7f9f7c0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54212/0 (socket says 172.21.15.53:54212) 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7affd640 1 -- 172.21.15.53:0/3736006720 learned_addr learned my addr 172.21.15.53:0/3736006720 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7b7fe640 1 --2- 172.21.15.53:0/3736006720 >> v2:172.21.15.87:3300/0 conn(0x7f9f7c158d20 0x7f9f7c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7affd640 1 -- 172.21.15.53:0/3736006720 >> v2:172.21.15.87:3300/0 conn(0x7f9f7c158d20 msgr2=0x7f9f7c15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7affd640 1 --2- 172.21.15.53:0/3736006720 >> v2:172.21.15.87:3300/0 conn(0x7f9f7c158d20 0x7f9f7c15d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7affd640 1 -- 172.21.15.53:0/3736006720 >> v1:172.21.15.87:6789/0 conn(0x7f9f7c069f50 legacy=0x7f9f7c06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7affd640 1 -- 172.21.15.53:0/3736006720 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c06c550 con 0x7f9f7c071670 2024-09-13T18:25:48.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.480+0000 7f9f7b7fe640 1 --2- 172.21.15.53:0/3736006720 >> v2:172.21.15.87:3300/0 conn(0x7f9f7c158d20 0x7f9f7c15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f7affd640 1 --2- 172.21.15.53:0/3736006720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c0ccba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c06b040 tx=0x7f9f7001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd74bff741fe97b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f7a7fc640 1 -- 172.21.15.53:0/3736006720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700ab660 con 0x7f9f7c071670 2024-09-13T18:25:48.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f7a7fc640 1 -- 172.21.15.53:0/3736006720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700ab7c0 con 0x7f9f7c071670 2024-09-13T18:25:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f7a7fc640 1 -- 172.21.15.53:0/3736006720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700abb50 con 0x7f9f7c071670 2024-09-13T18:25:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 -- 172.21.15.53:0/3736006720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 msgr2=0x7f9f7c0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 --2- 172.21.15.53:0/3736006720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c0ccba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c06b040 tx=0x7f9f7001c460 comp rx=0 tx=0).stop 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 -- 172.21.15.53:0/3736006720 shutdown_connections 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 --2- 172.21.15.53:0/3736006720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c0ccba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 --2- 172.21.15.53:0/3736006720 >> v2:172.21.15.87:3300/0 conn(0x7f9f7c158d20 0x7f9f7c15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 -- 172.21.15.53:0/3736006720 >> 172.21.15.53:0/3736006720 conn(0x7f9f7c0b0a30 msgr2=0x7f9f7c0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 -- 172.21.15.53:0/3736006720 shutdown_connections 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.484+0000 7f9f821e5640 1 -- 172.21.15.53:0/3736006720 wait complete. 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 Processor -- start 2024-09-13T18:25:48.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 -- start start 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f7c069f50 0x7f9f7c1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c14e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f7c158d20 0x7f9f7c154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0cb390 con 0x7f9f7c071670 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c156d50 con 0x7f9f7c069f50 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c157030 con 0x7f9f7c158d20 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c14e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c14e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54222/0 (socket says 172.21.15.53:54222) 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 -- 172.21.15.53:0/1944678992 learned_addr learned my addr 172.21.15.53:0/1944678992 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7b7fe640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f7c069f50 0x7f9f7c1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7bfff640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f7c158d20 0x7f9f7c154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 -- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f7c158d20 msgr2=0x7f9f7c154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f7c158d20 0x7f9f7c154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 -- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f7c069f50 msgr2=0x7f9f7c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f7c069f50 0x7f9f7c1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 -- 172.21.15.53:0/1944678992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009480 con 0x7f9f7c071670 2024-09-13T18:25:48.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f7affd640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c14e8a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9f70019070 tx=0x7f9f70019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f63fff640 1 -- 172.21.15.53:0/1944678992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700ab660 con 0x7f9f7c071670 2024-09-13T18:25:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f63fff640 1 -- 172.21.15.53:0/1944678992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700abd40 con 0x7f9f7c071670 2024-09-13T18:25:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c157310 con 0x7f9f7c071670 2024-09-13T18:25:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f63fff640 1 -- 172.21.15.53:0/1944678992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70005bc0 con 0x7f9f7c071670 2024-09-13T18:25:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c1578d0 con 0x7f9f7c071670 2024-09-13T18:25:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c0ccba0 con 0x7f9f7c071670 2024-09-13T18:25:48.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f63fff640 1 -- 172.21.15.53:0/1944678992 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f700a9070 con 0x7f9f7c071670 2024-09-13T18:25:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f63fff640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9f68066690 0x7f9f68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.488+0000 7f9f63fff640 1 -- 172.21.15.53:0/1944678992 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9f7011eb30 con 0x7f9f7c071670 2024-09-13T18:25:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.492+0000 7f9f7b7fe640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9f68066690 0x7f9f68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.492+0000 7f9f7b7fe640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9f68066690 0x7f9f68068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009a80 tx=0x7f9f74003cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.496+0000 7f9f63fff640 1 -- 172.21.15.53:0/1944678992 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f700ebda0 con 0x7f9f7c071670 2024-09-13T18:25:48.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.684+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9f7c157ac0 con 0x7f9f7c071670 2024-09-13T18:25:48.689 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:25:48.684+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:25:48.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f63fff640 1 -- 172.21.15.53:0/1944678992 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9f700c2090 con 0x7f9f7c071670 2024-09-13T18:25:48.700 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:25:48.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9f68066690 msgr2=0x7f9f68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9f68066690 0x7f9f68068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009a80 tx=0x7f9f74003cf0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 msgr2=0x7f9f7c14e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c14e8a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9f70019070 tx=0x7f9f70019200 comp rx=0 tx=0).stop 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 shutdown_connections 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9f68066690 0x7f9f68068b50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f7c158d20 0x7f9f7c154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f7c071670 0x7f9f7c14e8a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 --2- 172.21.15.53:0/1944678992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f7c069f50 0x7f9f7c1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 >> 172.21.15.53:0/1944678992 conn(0x7f9f7c0b0a30 msgr2=0x7f9f7c070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 shutdown_connections 2024-09-13T18:25:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.696+0000 7f9f821e5640 1 -- 172.21.15.53:0/1944678992 wait complete. 2024-09-13T18:25:48.708 INFO:tasks.ceph.mds.a.smithi053.stderr: -3040> 2024-09-13T18:25:01.958+0000 7fd75025a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:25:48.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:25:48.771 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:25:48.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.824+0000 7fe9ecb81640 1 Processor -- start 2024-09-13T18:25:48.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.824+0000 7fe9ecb81640 1 -- start start 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9ecb81640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe9e8158ba0 0x7fe9e80cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9ecb81640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e80b3830 con 0x7fe9e80b1dd0 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9ecb81640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e806bc20 con 0x7fe9e806ff40 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9ecb81640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e806c530 con 0x7fe9e8158ba0 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe9e80b1dd0 0x7fe9e80b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60346/0 (socket says 172.21.15.53:60346) 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e5d9b640 1 -- 172.21.15.53:0/417403741 learned_addr learned my addr 172.21.15.53:0/417403741 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e659c640 1 --2- 172.21.15.53:0/417403741 >> v2:172.21.15.87:3300/0 conn(0x7fe9e8158ba0 0x7fe9e80cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343797802 0 0) 0x7fe9dc001120 con 0x7fe9e80b1dd0 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d0003530 con 0x7fe9e80b1dd0 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005764951 0 0) 0x7fe9d0003530 con 0x7fe9e80b1dd0 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 >> v2:172.21.15.87:3300/0 conn(0x7fe9e8158ba0 msgr2=0x7fe9e80cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:48.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 --2- 172.21.15.53:0/417403741 >> v2:172.21.15.87:3300/0 conn(0x7fe9e8158ba0 0x7fe9e80cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 >> v1:172.21.15.87:6789/0 conn(0x7fe9e806ff40 legacy=0x7fe9e8070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8158f80 con 0x7fe9e80b1dd0 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe9dc001810 con 0x7fe9e80b1dd0 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 >> v1:172.21.15.53:6789/0 conn(0x7fe9e80b1dd0 legacy=0x7fe9e80b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9d0003980 0x7fe9d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9d00047d0 0x7fe9d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d00052b0 0x7fe9d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e806c530 con 0x7fe9d0003980 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d000c180 con 0x7fe9d00047d0 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d000c340 con 0x7fe9d00052b0 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e659c640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9d0003980 0x7fe9d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e5d9b640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9d00047d0 0x7fe9d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e6d9d640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d00052b0 0x7fe9d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e659c640 1 -- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d00052b0 msgr2=0x7fe9d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e659c640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d00052b0 0x7fe9d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e659c640 1 -- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9d00047d0 msgr2=0x7fe9d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e659c640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9d00047d0 0x7fe9d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e659c640 1 -- 172.21.15.53:0/417403741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0003530 con 0x7fe9d0003980 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e5d9b640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9d00047d0 0x7fe9d0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e6d9d640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d00052b0 0x7fe9d000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:48.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.828+0000 7fe9e6d9d640 1 -- 172.21.15.53:0/417403741 reap_dead start 2024-09-13T18:25:48.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e659c640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9d0003980 0x7fe9d0003da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009a90 tx=0x7fe9d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c957523b625596b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80a55b0 con 0x7fe9d0003980 2024-09-13T18:25:48.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d80a5710 con 0x7fe9d0003980 2024-09-13T18:25:48.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e559a640 1 -- 172.21.15.53:0/417403741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80a5aa0 con 0x7fe9d0003980 2024-09-13T18:25:48.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- 172.21.15.53:0/417403741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9d0003980 msgr2=0x7fe9d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9d0003980 0x7fe9d0003da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009a90 tx=0x7fe9d801c9e0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- 172.21.15.53:0/417403741 shutdown_connections 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/417403741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9d0003980 0x7fe9d0003da0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- 172.21.15.53:0/417403741 >> 172.21.15.53:0/417403741 conn(0x7fe9e8065c80 msgr2=0x7fe9e8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- 172.21.15.53:0/417403741 shutdown_connections 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- 172.21.15.53:0/417403741 wait complete. 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 Processor -- start 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- start start 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d0003980 0x7fe9e8155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e814dc80 0x7fe9e8149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e80a84d0 0x7fe9e814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e814a570 con 0x7fe9e80a84d0 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e814e1f0 con 0x7fe9e814dc80 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e814e4d0 con 0x7fe9d0003980 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e80a84d0 0x7fe9e814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e80a84d0 0x7fe9e814a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54260/0 (socket says 172.21.15.53:54260) 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 -- 172.21.15.53:0/1487146511 learned_addr learned my addr 172.21.15.53:0/1487146511 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e659c640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d0003980 0x7fe9e8155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e5d9b640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e814dc80 0x7fe9e8149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 -- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d0003980 msgr2=0x7fe9e8155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d0003980 0x7fe9e8155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 -- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e814dc80 msgr2=0x7fe9e8149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e814dc80 0x7fe9e8149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:48.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 -- 172.21.15.53:0/1487146511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e814e7b0 con 0x7fe9e80a84d0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9e6d9d640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e80a84d0 0x7fe9e814a030 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8071670 tx=0x7fe9e000d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9d6ffd640 1 -- 172.21.15.53:0/1487146511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0003d90 con 0x7fe9e80a84d0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9d6ffd640 1 -- 172.21.15.53:0/1487146511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e00050f0 con 0x7fe9e80a84d0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e814ea90 con 0x7fe9e80a84d0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9d6ffd640 1 -- 172.21.15.53:0/1487146511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00054a0 con 0x7fe9e80a84d0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.832+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e814f3e0 con 0x7fe9e80a84d0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.836+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e814ef40 con 0x7fe9e80a84d0 2024-09-13T18:25:48.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.836+0000 7fe9d6ffd640 1 -- 172.21.15.53:0/1487146511 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9e0005600 con 0x7fe9e80a84d0 2024-09-13T18:25:48.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.836+0000 7fe9d6ffd640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9c8066690 0x7fe9c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:48.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.836+0000 7fe9d6ffd640 1 -- 172.21.15.53:0/1487146511 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fe9e0083af0 con 0x7fe9e80a84d0 2024-09-13T18:25:48.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.836+0000 7fe9e659c640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9c8066690 0x7fe9c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:48.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.836+0000 7fe9e659c640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9c8066690 0x7fe9c8068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80af000 tx=0x7fe9d80046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:48.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:48.840+0000 7fe9d6ffd640 1 -- 172.21.15.53:0/1487146511 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9e0050e20 con 0x7fe9e80a84d0 2024-09-13T18:25:49.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.036+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9e80ade50 con 0x7fe9e80a84d0 2024-09-13T18:25:49.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.700+0000 7fe9d6ffd640 1 -- 172.21.15.53:0/1487146511 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe9e0018020 con 0x7fe9e80a84d0 2024-09-13T18:25:49.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9c8066690 msgr2=0x7fe9c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9c8066690 0x7fe9c8068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80af000 tx=0x7fe9d80046d0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e80a84d0 msgr2=0x7fe9e814a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e80a84d0 0x7fe9e814a030 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8071670 tx=0x7fe9e000d9f0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 shutdown_connections 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9c8066690 0x7fe9c8068b50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e80a84d0 0x7fe9e814a030 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e814dc80 0x7fe9e8149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 --2- 172.21.15.53:0/1487146511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9d0003980 0x7fe9e8155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 >> 172.21.15.53:0/1487146511 conn(0x7fe9e8065c80 msgr2=0x7fe9e8151b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 shutdown_connections 2024-09-13T18:25:49.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.704+0000 7fe9ecb81640 1 -- 172.21.15.53:0/1487146511 wait complete. 2024-09-13T18:25:49.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:25:49.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.856+0000 7fb3c7c65640 1 Processor -- start 2024-09-13T18:25:49.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.856+0000 7fb3c7c65640 1 -- start start 2024-09-13T18:25:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.856+0000 7fb3c7c65640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3c00b2d00 0x7fb3c006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.856+0000 7fb3c7c65640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00b1c60 con 0x7fb3c014f4f0 2024-09-13T18:25:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.856+0000 7fb3c7c65640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00b1f40 con 0x7fb3c015d150 2024-09-13T18:25:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.856+0000 7fb3c7c65640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00b3170 con 0x7fb3c00b2d00 2024-09-13T18:25:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c5a01640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb3c014f4f0 0x7fb3c014f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60352/0 (socket says 172.21.15.53:60352) 2024-09-13T18:25:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c5a01640 1 -- 172.21.15.53:0/1682036612 learned_addr learned my addr 172.21.15.53:0/1682036612 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 --2- 172.21.15.53:0/1682036612 >> v2:172.21.15.87:3300/0 conn(0x7fb3c00b2d00 0x7fb3c006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885531598 0 0) 0x7fb3c00b1c60 con 0x7fb3c014f4f0 2024-09-13T18:25:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3ac003530 con 0x7fb3c014f4f0 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181901226 0 0) 0x7fb3ac003530 con 0x7fb3c014f4f0 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 >> v2:172.21.15.87:3300/0 conn(0x7fb3c00b2d00 msgr2=0x7fb3c006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 --2- 172.21.15.53:0/1682036612 >> v2:172.21.15.87:3300/0 conn(0x7fb3c00b2d00 0x7fb3c006cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 >> v1:172.21.15.87:6789/0 conn(0x7fb3c015d150 legacy=0x7fb3c0071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00b2220 con 0x7fb3c014f4f0 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb3bc001a00 con 0x7fb3c014f4f0 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 >> v1:172.21.15.53:6789/0 conn(0x7fb3c014f4f0 legacy=0x7fb3c014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac003980 0x7fb3ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3ac0047d0 0x7fb3ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3ac005190 0x7fb3ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00b3170 con 0x7fb3ac005190 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac00c030 con 0x7fb3ac003980 2024-09-13T18:25:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac00c1f0 con 0x7fb3ac0047d0 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3ac005190 0x7fb3ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c5a01640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac003980 0x7fb3ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c5200640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3ac0047d0 0x7fb3ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 -- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3ac0047d0 msgr2=0x7fb3ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3ac0047d0 0x7fb3ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 -- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac003980 msgr2=0x7fb3ac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac003980 0x7fb3ac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 -- 172.21.15.53:0/1682036612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac003530 con 0x7fb3ac005190 2024-09-13T18:25:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 -- 172.21.15.53:0/1682036612 reap_dead start 2024-09-13T18:25:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c6202640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3ac005190 0x7fb3ac00b990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009ae0 tx=0x7fb3b801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68613b17ed5ce27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8004020 con 0x7fb3ac005190 2024-09-13T18:25:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b80041c0 con 0x7fb3ac005190 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.860+0000 7fb3c49ff640 1 -- 172.21.15.53:0/1682036612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80a56a0 con 0x7fb3ac005190 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- 172.21.15.53:0/1682036612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3ac005190 msgr2=0x7fb3ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3ac005190 0x7fb3ac00b990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009ae0 tx=0x7fb3b801cab0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- 172.21.15.53:0/1682036612 shutdown_connections 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/1682036612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3ac005190 0x7fb3ac00b990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- 172.21.15.53:0/1682036612 >> 172.21.15.53:0/1682036612 conn(0x7fb3c0073330 msgr2=0x7fb3c0065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- 172.21.15.53:0/1682036612 shutdown_connections 2024-09-13T18:25:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- 172.21.15.53:0/1682036612 wait complete. 2024-09-13T18:25:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 Processor -- start 2024-09-13T18:25:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- start start 2024-09-13T18:25:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac005190 0x7fb3c013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c0145ec0 0x7fb3c00b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c00ae100 0x7fb3c00ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cd3d0 con 0x7fb3c00ae100 2024-09-13T18:25:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cc610 con 0x7fb3ac005190 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cc8f0 con 0x7fb3c0145ec0 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c00ae100 0x7fb3c00ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c00ae100 0x7fb3c00ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54276/0 (socket says 172.21.15.53:54276) 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 -- 172.21.15.53:0/3956617394 learned_addr learned my addr 172.21.15.53:0/3956617394 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c5200640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c0145ec0 0x7fb3c00b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c5a01640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac005190 0x7fb3c013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 -- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c0145ec0 msgr2=0x7fb3c00b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c0145ec0 0x7fb3c00b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 -- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac005190 msgr2=0x7fb3c013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac005190 0x7fb3c013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 -- 172.21.15.53:0/3956617394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00ccbd0 con 0x7fb3c00ae100 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c5a01640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac005190 0x7fb3c013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c6202640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c00ae100 0x7fb3c00ae580 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3b801c8e0 tx=0x7fb3ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3b67fc640 1 -- 172.21.15.53:0/3956617394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8004330 con 0x7fb3c00ae100 2024-09-13T18:25:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3b67fc640 1 -- 172.21.15.53:0/3956617394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8004490 con 0x7fb3c00ae100 2024-09-13T18:25:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3b67fc640 1 -- 172.21.15.53:0/3956617394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8003860 con 0x7fb3c00ae100 2024-09-13T18:25:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c00cceb0 con 0x7fb3c00ae100 2024-09-13T18:25:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.864+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c00cc300 con 0x7fb3c00ae100 2024-09-13T18:25:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.868+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c00711f0 con 0x7fb3c00ae100 2024-09-13T18:25:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.868+0000 7fb3b67fc640 1 -- 172.21.15.53:0/3956617394 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb3b80039c0 con 0x7fb3c00ae100 2024-09-13T18:25:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.868+0000 7fb3b67fc640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a40666c0 0x7fb3a4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.868+0000 7fb3b67fc640 1 -- 172.21.15.53:0/3956617394 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fb3b811e450 con 0x7fb3c00ae100 2024-09-13T18:25:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.868+0000 7fb3c5a01640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a40666c0 0x7fb3a4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.868+0000 7fb3c5a01640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a40666c0 0x7fb3a4068b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc000f90 tx=0x7fb3bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:49.872+0000 7fb3b67fc640 1 -- 172.21.15.53:0/3956617394 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3b80eb660 con 0x7fb3c00ae100 2024-09-13T18:25:50.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.036+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3c00cd040 con 0x7fb3c00ae100 2024-09-13T18:25:50.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.712+0000 7fb3b67fc640 1 -- 172.21.15.53:0/3956617394 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb3b80b20d0 con 0x7fb3c00ae100 2024-09-13T18:25:50.718 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:25:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a40666c0 msgr2=0x7fb3a4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a40666c0 0x7fb3a4068b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc000f90 tx=0x7fb3bc009040 comp rx=0 tx=0).stop 2024-09-13T18:25:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c00ae100 msgr2=0x7fb3c00ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c00ae100 0x7fb3c00ae580 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3b801c8e0 tx=0x7fb3ac005800 comp rx=0 tx=0).stop 2024-09-13T18:25:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 shutdown_connections 2024-09-13T18:25:50.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a40666c0 0x7fb3a4068b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c0145ec0 0x7fb3c00b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c00ae100 0x7fb3c00ae580 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 --2- 172.21.15.53:0/3956617394 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3ac005190 0x7fb3c013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 >> 172.21.15.53:0/3956617394 conn(0x7fb3c0073330 msgr2=0x7fb3c0146d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:50.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 shutdown_connections 2024-09-13T18:25:50.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.716+0000 7fb3c7c65640 1 -- 172.21.15.53:0/3956617394 wait complete. 2024-09-13T18:25:50.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:25:50.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7d0db6640 1 Processor -- start 2024-09-13T18:25:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7d0db6640 1 -- start start 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7d0db6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0cf7f0 0x7fc7cc167400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7d0db6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc0d1d10 con 0x7fc7cc15c860 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7d0db6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc0d1ff0 con 0x7fc7cc0cdb70 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7d0db6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc0d1b20 con 0x7fc7cc0cf7f0 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc7cc15c860 0x7fc7cc0d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60354/0 (socket says 172.21.15.53:60354) 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 -- 172.21.15.53:0/1884191784 learned_addr learned my addr 172.21.15.53:0/1884191784 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7cad9d640 1 --2- 172.21.15.53:0/1884191784 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0cf7f0 0x7fc7cc167400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048943433 0 0) 0x7fc7cc0d1d10 con 0x7fc7cc15c860 2024-09-13T18:25:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003530 con 0x7fc7cc15c860 2024-09-13T18:25:50.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983381621 0 0) 0x7fc7b4003530 con 0x7fc7cc15c860 2024-09-13T18:25:50.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0cf7f0 msgr2=0x7fc7cc167400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:50.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 --2- 172.21.15.53:0/1884191784 >> v2:172.21.15.87:3300/0 conn(0x7fc7cc0cf7f0 0x7fc7cc167400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 >> v1:172.21.15.87:6789/0 conn(0x7fc7cc0cdb70 legacy=0x7fc7cc0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:50.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0d22d0 con 0x7fc7cc15c860 2024-09-13T18:25:50.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc7c0001680 con 0x7fc7cc15c860 2024-09-13T18:25:50.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 >> v1:172.21.15.53:6789/0 conn(0x7fc7cc15c860 legacy=0x7fc7cc0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:50.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b4003980 0x7fc7b4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b40047d0 0x7fc7b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7b4005190 0x7fc7b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400c010 con 0x7fc7b4003980 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400c180 con 0x7fc7b40047d0 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b400c340 con 0x7fc7b4005190 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b4003980 0x7fc7b4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 -- 172.21.15.53:0/1884191784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7b4005190 msgr2=0x7fc7b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7b4005190 0x7fc7b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 -- 172.21.15.53:0/1884191784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b40047d0 msgr2=0x7fc7b4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b40047d0 0x7fc7b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7ca59c640 1 -- 172.21.15.53:0/1884191784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4003530 con 0x7fc7b4003980 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.884+0000 7fc7cad9d640 1 -- 172.21.15.53:0/1884191784 reap_dead start 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b4003980 0x7fc7b4003da0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c1c0 tx=0x7fc7c001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5032b8cf2466ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0005ae0 con 0x7fc7b4003980 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c00ab070 con 0x7fc7b4003980 2024-09-13T18:25:50.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7c959a640 1 -- 172.21.15.53:0/1884191784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0007070 con 0x7fc7b4003980 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1884191784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b4003980 msgr2=0x7fc7b4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b4003980 0x7fc7b4003da0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c1c0 tx=0x7fc7c001f370 comp rx=0 tx=0).stop 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1884191784 shutdown_connections 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1884191784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7b4003980 0x7fc7b4003da0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1884191784 >> 172.21.15.53:0/1884191784 conn(0x7fc7cc065c80 msgr2=0x7fc7cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1884191784 shutdown_connections 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1884191784 wait complete. 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 Processor -- start 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- start start 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b4003980 0x7fc7cc1f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc1f19a0 0x7fc7cc0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0c8640 0x7fc7cc0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0c8ac0 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0c7120 con 0x7fc7b4003980 2024-09-13T18:25:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7d0db6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc1f3080 con 0x7fc7cc0c8640 2024-09-13T18:25:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7c9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc1f19a0 0x7fc7cc0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7c9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc1f19a0 0x7fc7cc0c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54286/0 (socket says 172.21.15.53:54286) 2024-09-13T18:25:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7c9d9b640 1 -- 172.21.15.53:0/1631525976 learned_addr learned my addr 172.21.15.53:0/1631525976 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.888+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b4003980 0x7fc7cc1f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7cad9d640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0c8640 0x7fc7cc0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7c9d9b640 1 -- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0c8640 msgr2=0x7fc7cc0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7c9d9b640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0c8640 0x7fc7cc0b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7c9d9b640 1 -- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b4003980 msgr2=0x7fc7cc1f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7c9d9b640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b4003980 0x7fc7cc1f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7c9d9b640 1 -- 172.21.15.53:0/1631525976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0c75b0 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b4003980 0x7fc7cc1f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7c9d9b640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc1f19a0 0x7fc7cc0c8100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00c400 tx=0x7fc7bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7baffd640 1 -- 172.21.15.53:0/1631525976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0052d0 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7baffd640 1 -- 172.21.15.53:0/1631525976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc005430 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0c6510 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7baffd640 1 -- 172.21.15.53:0/1631525976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc007260 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc0c6ad0 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc0c7290 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7baffd640 1 -- 172.21.15.53:0/1631525976 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7bc0073c0 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7baffd640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7ac066690 0x7fc7ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7baffd640 1 -- 172.21.15.53:0/1631525976 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fc7bc0833d0 con 0x7fc7cc1f19a0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7ac066690 0x7fc7ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.892+0000 7fc7ca59c640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7ac066690 0x7fc7ac068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00af000 tx=0x7fc7c00aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:50.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:50.896+0000 7fc7baffd640 1 -- 172.21.15.53:0/1631525976 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7bc0508b0 con 0x7fc7cc1f19a0 2024-09-13T18:25:51.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.060+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7cc0cf470 con 0x7fc7cc1f19a0 2024-09-13T18:25:51.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.720+0000 7fc7baffd640 1 -- 172.21.15.53:0/1631525976 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7bc053ed0 con 0x7fc7cc1f19a0 2024-09-13T18:25:51.725 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7ac066690 msgr2=0x7fc7ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7ac066690 0x7fc7ac068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00af000 tx=0x7fc7c00aa000 comp rx=0 tx=0).stop 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc1f19a0 msgr2=0x7fc7cc0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc1f19a0 0x7fc7cc0c8100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00c400 tx=0x7fc7bc00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 shutdown_connections 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc7ac066690 0x7fc7ac068b50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7cc0c8640 0x7fc7cc0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7cc1f19a0 0x7fc7cc0c8100 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 --2- 172.21.15.53:0/1631525976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7b4003980 0x7fc7cc1f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 >> 172.21.15.53:0/1631525976 conn(0x7fc7cc065c80 msgr2=0x7fc7cc0ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 shutdown_connections 2024-09-13T18:25:51.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.724+0000 7fc7d0db6640 1 -- 172.21.15.53:0/1631525976 wait complete. 2024-09-13T18:25:51.754 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:25:51.754 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:25:51.754 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:25:51.754 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:51.754 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:25:51.755 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:25:51.755 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:25:51.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:51.755 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:25:51.755 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:25:51.755 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:25:51.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:51.756 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:25:51.756 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:25:51.756 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:25:51.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:25:51.765 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:25:51.766 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:25:51.767 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:25:51.767 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:25:51.772 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:25:51.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:25:51.774 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:25:51.774 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:25:51.812 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:25:51.812 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:51.813 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:25:51.813 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:51.818 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:25:51.818 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:51.820 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:25:51.820 DEBUG:teuthology.parallel:result is None 2024-09-13T18:25:51.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:25:51.880 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:25:51.880 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:25:51.890 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:25:51.890 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.944+0000 7f9c561ca640 1 Processor -- start 2024-09-13T18:25:51.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.944+0000 7f9c561ca640 1 -- start start 2024-09-13T18:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c561ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c500d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c561ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c500cd6c0 0x7f9c500cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c561ca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9c500cdb00 0x7f9c500cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c561ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500d2400 con 0x7f9c500cd6c0 2024-09-13T18:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c561ca640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500d1530 con 0x7f9c500cdb00 2024-09-13T18:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c561ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500d0920 con 0x7f9c5015cab0 2024-09-13T18:25:51.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c500cd6c0 0x7f9c500cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c500cd6c0 0x7f9c500cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54312/0 (socket says 172.21.15.53:54312) 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 -- 172.21.15.53:0/2390913250 learned_addr learned my addr 172.21.15.53:0/2390913250 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4f7fe640 1 --2- 172.21.15.53:0/2390913250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c500d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 -- 172.21.15.53:0/2390913250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 msgr2=0x7f9c500d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4ffff640 1 --2- 172.21.15.53:0/2390913250 >> v2:172.21.15.87:3300/0 conn(0x7f9c500cdb00 0x7f9c500cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 --2- 172.21.15.53:0/2390913250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c500d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 -- 172.21.15.53:0/2390913250 >> v2:172.21.15.87:3300/0 conn(0x7f9c500cdb00 msgr2=0x7f9c500cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 --2- 172.21.15.53:0/2390913250 >> v2:172.21.15.87:3300/0 conn(0x7f9c500cdb00 0x7f9c500cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 -- 172.21.15.53:0/2390913250 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500d0c00 con 0x7f9c500cd6c0 2024-09-13T18:25:51.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4effd640 1 --2- 172.21.15.53:0/2390913250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cd6c0 0x7f9c500cf0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9c500b7fe0 tx=0x7f9c4401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152969afcf0df43c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:51.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4e7fc640 1 -- 172.21.15.53:0/2390913250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440aa610 con 0x7f9c500cd6c0 2024-09-13T18:25:51.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4e7fc640 1 -- 172.21.15.53:0/2390913250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c440a6040 con 0x7f9c500cd6c0 2024-09-13T18:25:51.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.948+0000 7f9c4e7fc640 1 -- 172.21.15.53:0/2390913250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440aa990 con 0x7f9c500cd6c0 2024-09-13T18:25:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- 172.21.15.53:0/2390913250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cd6c0 msgr2=0x7f9c500cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2390913250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cd6c0 0x7f9c500cf0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9c500b7fe0 tx=0x7f9c4401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- 172.21.15.53:0/2390913250 shutdown_connections 2024-09-13T18:25:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2390913250 >> v2:172.21.15.87:3300/0 conn(0x7f9c500cdb00 0x7f9c500cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2390913250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cd6c0 0x7f9c500cf0c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2390913250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c500d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- 172.21.15.53:0/2390913250 >> 172.21.15.53:0/2390913250 conn(0x7f9c50065c80 msgr2=0x7f9c50066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- 172.21.15.53:0/2390913250 shutdown_connections 2024-09-13T18:25:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- 172.21.15.53:0/2390913250 wait complete. 2024-09-13T18:25:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 Processor -- start 2024-09-13T18:25:51.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- start start 2024-09-13T18:25:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500cd6c0 0x7f9c501525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cdb00 0x7f9c5015e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c5015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50159350 con 0x7f9c500cdb00 2024-09-13T18:25:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b2870 con 0x7f9c500cd6c0 2024-09-13T18:25:51.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b2b50 con 0x7f9c5015cab0 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cdb00 0x7f9c5015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cdb00 0x7f9c5015e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54326/0 (socket says 172.21.15.53:54326) 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 -- 172.21.15.53:0/2352382328 learned_addr learned my addr 172.21.15.53:0/2352382328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4f7fe640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500cd6c0 0x7f9c501525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4ffff640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c5015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 -- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 msgr2=0x7f9c5015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c5015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 -- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500cd6c0 msgr2=0x7f9c501525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500cd6c0 0x7f9c501525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 -- 172.21.15.53:0/2352382328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c440094d0 con 0x7f9c500cdb00 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4ffff640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c5015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c4effd640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cdb00 0x7f9c5015e880 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9c4401aba0 tx=0x7f9c4401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:51.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c37fff640 1 -- 172.21.15.53:0/2352382328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440bd5f0 con 0x7f9c500cdb00 2024-09-13T18:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c37fff640 1 -- 172.21.15.53:0/2352382328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c440bd770 con 0x7f9c500cdb00 2024-09-13T18:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c500b2e30 con 0x7f9c500cdb00 2024-09-13T18:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c37fff640 1 -- 172.21.15.53:0/2352382328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440bdb20 con 0x7f9c500cdb00 2024-09-13T18:25:51.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.952+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c50158640 con 0x7f9c500cdb00 2024-09-13T18:25:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.956+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c500664c0 con 0x7f9c500cdb00 2024-09-13T18:25:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.956+0000 7f9c37fff640 1 -- 172.21.15.53:0/2352382328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c440b33f0 con 0x7f9c500cdb00 2024-09-13T18:25:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.956+0000 7f9c37fff640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9c3c0666c0 0x7f9c3c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.956+0000 7f9c37fff640 1 -- 172.21.15.53:0/2352382328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c4411eff0 con 0x7f9c500cdb00 2024-09-13T18:25:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.956+0000 7f9c4f7fe640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9c3c0666c0 0x7f9c3c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:51.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.956+0000 7f9c4f7fe640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9c3c0666c0 0x7f9c3c068b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c5015a470 tx=0x7f9c40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:51.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:51.960+0000 7f9c37fff640 1 -- 172.21.15.53:0/2352382328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c440ec670 con 0x7f9c500cdb00 2024-09-13T18:25:52.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.132+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9c50067910 con 0x7f9c500cdb00 2024-09-13T18:25:52.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c37fff640 1 -- 172.21.15.53:0/2352382328 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c50067910 con 0x7f9c500cdb00 2024-09-13T18:25:52.927 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9c3c0666c0 msgr2=0x7f9c3c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9c3c0666c0 0x7f9c3c068b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c5015a470 tx=0x7f9c40008040 comp rx=0 tx=0).stop 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cdb00 msgr2=0x7f9c5015e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cdb00 0x7f9c5015e880 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9c4401aba0 tx=0x7f9c4401ad30 comp rx=0 tx=0).stop 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 shutdown_connections 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9c3c0666c0 0x7f9c3c068b80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c5015cab0 0x7f9c5015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c500cdb00 0x7f9c5015e880 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 --2- 172.21.15.53:0/2352382328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c500cd6c0 0x7f9c501525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 >> 172.21.15.53:0/2352382328 conn(0x7f9c50065c80 msgr2=0x7f9c500b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:52.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 shutdown_connections 2024-09-13T18:25:52.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:52.924+0000 7f9c561ca640 1 -- 172.21.15.53:0/2352382328 wait complete. 2024-09-13T18:25:52.950 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:25:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.076+0000 7f5071e31640 1 Processor -- start 2024-09-13T18:25:53.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.076+0000 7f5071e31640 1 -- start start 2024-09-13T18:25:53.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5071e31640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f506c15cab0 0x7f506c0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5071e31640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f506c0cd6c0 0x7f506c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5071e31640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c0d2400 con 0x7f506c0cdb30 2024-09-13T18:25:53.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5071e31640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0d1530 con 0x7f506c0cd6c0 2024-09-13T18:25:53.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5071e31640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0d0920 con 0x7f506c15cab0 2024-09-13T18:25:53.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5063fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f506c0cd6c0 0x7f506c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f506bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f506c0cdb30 0x7f506c0b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60382/0 (socket says 172.21.15.53:60382) 2024-09-13T18:25:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f506bfff640 1 -- 172.21.15.53:0/162119667 learned_addr learned my addr 172.21.15.53:0/162119667 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5063fff640 1 -- 172.21.15.53:0/162119667 >> v2:172.21.15.87:3300/0 conn(0x7f506c15cab0 msgr2=0x7f506c0d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5063fff640 1 --2- 172.21.15.53:0/162119667 >> v2:172.21.15.87:3300/0 conn(0x7f506c15cab0 0x7f506c0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5063fff640 1 -- 172.21.15.53:0/162119667 >> v1:172.21.15.53:6789/0 conn(0x7f506c0cdb30 legacy=0x7f506c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5063fff640 1 -- 172.21.15.53:0/162119667 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c0d0c00 con 0x7f506c0cd6c0 2024-09-13T18:25:53.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f506affd640 1 -- 172.21.15.53:0/162119667 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681633681 0 0) 0x7f506c0d2400 con 0x7f506c0cdb30 2024-09-13T18:25:53.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5063fff640 1 --2- 172.21.15.53:0/162119667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cd6c0 0x7f506c0cf0c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f506c066930 tx=0x7f505401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0b047a887c678a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f506affd640 1 -- 172.21.15.53:0/162119667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50540ad660 con 0x7f506c0cd6c0 2024-09-13T18:25:53.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f506affd640 1 -- 172.21.15.53:0/162119667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540ad7c0 con 0x7f506c0cd6c0 2024-09-13T18:25:53.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f506affd640 1 -- 172.21.15.53:0/162119667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50540adb50 con 0x7f506c0cd6c0 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5071e31640 1 -- 172.21.15.53:0/162119667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cd6c0 msgr2=0x7f506c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.080+0000 7f5071e31640 1 --2- 172.21.15.53:0/162119667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cd6c0 0x7f506c0cf0c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f506c066930 tx=0x7f505401c450 comp rx=0 tx=0).stop 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- 172.21.15.53:0/162119667 shutdown_connections 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 --2- 172.21.15.53:0/162119667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cd6c0 0x7f506c0cf0c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 --2- 172.21.15.53:0/162119667 >> v2:172.21.15.87:3300/0 conn(0x7f506c15cab0 0x7f506c0d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- 172.21.15.53:0/162119667 >> 172.21.15.53:0/162119667 conn(0x7f506c065c80 msgr2=0x7f506c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- 172.21.15.53:0/162119667 shutdown_connections 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- 172.21.15.53:0/162119667 wait complete. 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 Processor -- start 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- start start 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd6c0 0x7f506c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cdb30 0x7f506c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15cab0 0x7f506c1603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c1594b0 con 0x7f506c0cdb30 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c159a30 con 0x7f506c0cd6c0 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c159750 con 0x7f506c15cab0 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cdb30 0x7f506c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cdb30 0x7f506c1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54346/0 (socket says 172.21.15.53:54346) 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 -- 172.21.15.53:0/3520180938 learned_addr learned my addr 172.21.15.53:0/3520180938 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f506b7fe640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd6c0 0x7f506c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f506bfff640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15cab0 0x7f506c1603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 -- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15cab0 msgr2=0x7f506c1603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15cab0 0x7f506c1603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 -- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd6c0 msgr2=0x7f506c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd6c0 0x7f506c157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 -- 172.21.15.53:0/3520180938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5054009420 con 0x7f506c0cdb30 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f506b7fe640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd6c0 0x7f506c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5063fff640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cdb30 0x7f506c1553d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5054019060 tx=0x7f505401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5068ff9640 1 -- 172.21.15.53:0/3520180938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50540b9650 con 0x7f506c0cdb30 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5068ff9640 1 -- 172.21.15.53:0/3520180938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50540b97d0 con 0x7f506c0cdb30 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5068ff9640 1 -- 172.21.15.53:0/3520180938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50540b9b80 con 0x7f506c0cdb30 2024-09-13T18:25:53.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c156e30 con 0x7f506c0cdb30 2024-09-13T18:25:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.084+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c1573f0 con 0x7f506c0cdb30 2024-09-13T18:25:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.088+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c1575e0 con 0x7f506c0cdb30 2024-09-13T18:25:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.088+0000 7f5068ff9640 1 -- 172.21.15.53:0/3520180938 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50540c4460 con 0x7f506c0cdb30 2024-09-13T18:25:53.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.088+0000 7f5068ff9640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f504c066690 0x7f504c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.088+0000 7f5068ff9640 1 -- 172.21.15.53:0/3520180938 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f505411f770 con 0x7f506c0cdb30 2024-09-13T18:25:53.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.088+0000 7f506b7fe640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f504c066690 0x7f504c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.088+0000 7f506b7fe640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f504c066690 0x7f504c068b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f506c159440 tx=0x7f505c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.092+0000 7f5068ff9640 1 -- 172.21.15.53:0/3520180938 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50540ed030 con 0x7f506c0cdb30 2024-09-13T18:25:53.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.304+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f506c0cf0c0 con 0x7f506c0cdb30 2024-09-13T18:25:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5068ff9640 1 -- 172.21.15.53:0/3520180938 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f50540f0650 con 0x7f506c0cdb30 2024-09-13T18:25:53.311 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:53.311 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:25:53.312 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:25:53.312 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.312 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:25:53.312 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:25:53.312 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.312 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.313 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:25:53.313 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:25:53.313 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.313 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.313 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.314 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:25:53.314 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:25:53.314 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.314 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.314 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:25:53.314 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:25:53.315 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.315 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.315 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.315 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:25:53.315 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:25:53.316 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.316 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.316 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:25:53.316 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:25:53.316 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.316 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.317 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.317 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.317 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:25:53.317 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:25:53.317 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.317 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.318 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:25:53.318 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:25:53.318 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.318 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.318 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.319 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:25:53.319 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:25:53.319 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.319 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.319 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.319 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.320 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.320 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.320 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:25:53.320 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:25:53.320 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:25:53.321 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:25:53.322 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.323 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.324 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.325 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.326 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.327 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.329 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:25:53.330 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:25:53.331 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.331 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.331 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:25:53.331 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:25:53.332 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.332 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:25:53.332 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:25:53.332 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.333 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:25:53.334 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:25:53.334 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:25:53.334 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.334 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.334 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.334 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.334 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-mds", 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBig+RmxHmeChAAb7mFW3a5zF1f1GYx/UioOw==", 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T18:25:53.335 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBig+Rmh5GeChAAL4yVtu2jz2FQWqUFHAprFQ==", 2024-09-13T18:25:53.336 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.336 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T18:25:53.336 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.336 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-osd", 2024-09-13T18:25:53.336 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBig+RmfKWeChAAXC+syiHOdZ0MzXlTcVRr+g==", 2024-09-13T18:25:53.337 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.337 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T18:25:53.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.337 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.337 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBig+Rm7rmeChAAVvzyqWPgUzN97Q7e6u/KDw==", 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBig+RmCs6eChAAwAdsXUY5rPhozGYYqfCbDQ==", 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T18:25:53.338 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.339 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.339 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T18:25:53.339 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBig+Rm+uKeChAArhjkgs2C71O+59NLcczsng==", 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:25:53.340 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:25:53.341 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:25:53.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f504c066690 msgr2=0x7f504c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f504c066690 0x7f504c068b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f506c159440 tx=0x7f505c008040 comp rx=0 tx=0).stop 2024-09-13T18:25:53.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cdb30 msgr2=0x7f506c1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cdb30 0x7f506c1553d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5054019060 tx=0x7f505401ac90 comp rx=0 tx=0).stop 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 shutdown_connections 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f504c066690 0x7f504c068b50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15cab0 0x7f506c1603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cdb30 0x7f506c1553d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 --2- 172.21.15.53:0/3520180938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd6c0 0x7f506c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 >> 172.21.15.53:0/3520180938 conn(0x7f506c065c80 msgr2=0x7f506c0b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 shutdown_connections 2024-09-13T18:25:53.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.308+0000 7f5071e31640 1 -- 172.21.15.53:0/3520180938 wait complete. 2024-09-13T18:25:53.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T18:25:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339f8eb640 1 Processor -- start 2024-09-13T18:25:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339f8eb640 1 -- start start 2024-09-13T18:25:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339f8eb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f33980cf7d0 0x7f33980b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339f8eb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980d2400 con 0x7f339815cab0 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339f8eb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980d1530 con 0x7f33980d19c0 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339f8eb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980cddd0 con 0x7f33980cf7d0 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339de88640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f33980cf7d0 0x7f33980b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339d687640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f339815cab0 0x7f33980cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60384/0 (socket says 172.21.15.53:60384) 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.468+0000 7f339d687640 1 -- 172.21.15.53:0/653226796 learned_addr learned my addr 172.21.15.53:0/653226796 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339de88640 1 -- 172.21.15.53:0/653226796 >> v1:172.21.15.87:6789/0 conn(0x7f33980d19c0 legacy=0x7f33980cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339de88640 1 -- 172.21.15.53:0/653226796 >> v1:172.21.15.53:6789/0 conn(0x7f339815cab0 legacy=0x7f33980cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339de88640 1 -- 172.21.15.53:0/653226796 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980d1e30 con 0x7f33980cf7d0 2024-09-13T18:25:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339de88640 1 --2- 172.21.15.53:0/653226796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33980cf7d0 0x7f33980b5870 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3390009d90 tx=0x7f339001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17416f4fb4e076a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f338ffff640 1 -- 172.21.15.53:0/653226796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900a5a00 con 0x7f33980cf7d0 2024-09-13T18:25:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f338ffff640 1 -- 172.21.15.53:0/653226796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900a5b60 con 0x7f33980cf7d0 2024-09-13T18:25:53.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f338ffff640 1 -- 172.21.15.53:0/653226796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900ad440 con 0x7f33980cf7d0 2024-09-13T18:25:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339f8eb640 1 -- 172.21.15.53:0/653226796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33980cf7d0 msgr2=0x7f33980b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339f8eb640 1 --2- 172.21.15.53:0/653226796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33980cf7d0 0x7f33980b5870 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3390009d90 tx=0x7f339001c940 comp rx=0 tx=0).stop 2024-09-13T18:25:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339f8eb640 1 -- 172.21.15.53:0/653226796 shutdown_connections 2024-09-13T18:25:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339f8eb640 1 --2- 172.21.15.53:0/653226796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33980cf7d0 0x7f33980b5870 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339f8eb640 1 -- 172.21.15.53:0/653226796 >> 172.21.15.53:0/653226796 conn(0x7f3398065c80 msgr2=0x7f3398066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339f8eb640 1 -- 172.21.15.53:0/653226796 shutdown_connections 2024-09-13T18:25:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.472+0000 7f339f8eb640 1 -- 172.21.15.53:0/653226796 wait complete. 2024-09-13T18:25:53.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 Processor -- start 2024-09-13T18:25:53.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 -- start start 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33980cf7d0 0x7f3398155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33980d19c0 0x7f33981505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f339815cab0 0x7f3398148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c9fd0 con 0x7f339815cab0 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398149180 con 0x7f33980d19c0 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33981565e0 con 0x7f33980cf7d0 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f339815cab0 0x7f3398148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f339815cab0 0x7f3398148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54352/0 (socket says 172.21.15.53:54352) 2024-09-13T18:25:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 -- 172.21.15.53:0/840081177 learned_addr learned my addr 172.21.15.53:0/840081177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339d687640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33980cf7d0 0x7f3398155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339ce86640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33980d19c0 0x7f33981505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 -- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33980cf7d0 msgr2=0x7f3398155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33980cf7d0 0x7f3398155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 -- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33980d19c0 msgr2=0x7f33981505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33980d19c0 0x7f33981505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 -- 172.21.15.53:0/840081177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009a70 con 0x7f339815cab0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339de88640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f339815cab0 0x7f3398148c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f339001a570 tx=0x7f33900196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f338dffb640 1 -- 172.21.15.53:0/840081177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900addc0 con 0x7f339815cab0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f338dffb640 1 -- 172.21.15.53:0/840081177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900b9450 con 0x7f339815cab0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33981568c0 con 0x7f339815cab0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f338dffb640 1 -- 172.21.15.53:0/840081177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900b97e0 con 0x7f339815cab0 2024-09-13T18:25:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.476+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398156e80 con 0x7f339815cab0 2024-09-13T18:25:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.480+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33980b5870 con 0x7f339815cab0 2024-09-13T18:25:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.480+0000 7f338dffb640 1 -- 172.21.15.53:0/840081177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33900b9940 con 0x7f339815cab0 2024-09-13T18:25:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.480+0000 7f338dffb640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f337c066690 0x7f337c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.480+0000 7f338dffb640 1 -- 172.21.15.53:0/840081177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33980b65c0 con 0x7f339815cab0 2024-09-13T18:25:53.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.480+0000 7f339d687640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f337c066690 0x7f337c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.480+0000 7f339d687640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f337c066690 0x7f337c068b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3394005890 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.484+0000 7f338dffb640 1 -- 172.21.15.53:0/840081177 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33900ecde0 con 0x7f339815cab0 2024-09-13T18:25:53.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.700+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f33980b2600 con 0x7f339815cab0 2024-09-13T18:25:53.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.704+0000 7f338dffb640 1 -- 172.21.15.53:0/840081177 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f33900f0400 con 0x7f339815cab0 2024-09-13T18:25:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f337c066690 msgr2=0x7f337c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f337c066690 0x7f337c068b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3394005890 tx=0x7f3394009040 comp rx=0 tx=0).stop 2024-09-13T18:25:53.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f339815cab0 msgr2=0x7f3398148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f339815cab0 0x7f3398148c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f339001a570 tx=0x7f33900196e0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 shutdown_connections 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f337c066690 0x7f337c068b50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f339815cab0 0x7f3398148c40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33980d19c0 0x7f33981505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 --2- 172.21.15.53:0/840081177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33980cf7d0 0x7f3398155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 >> 172.21.15.53:0/840081177 conn(0x7f3398065c80 msgr2=0x7f33980661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 shutdown_connections 2024-09-13T18:25:53.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.708+0000 7f339f8eb640 1 -- 172.21.15.53:0/840081177 wait complete. 2024-09-13T18:25:53.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T18:25:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f47033a4640 1 Processor -- start 2024-09-13T18:25:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f47033a4640 1 -- start start 2024-09-13T18:25:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f47033a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 0x7f46fc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f47033a4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f46fc0cbd60 0x7f46fc0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f47033a4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc0b1ac0 con 0x7f46fc0cb980 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f47033a4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc159ac0 con 0x7f46fc0cbd60 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f47033a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc159da0 con 0x7f46fc06b850 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f46fc0cb980 0x7f46fc06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60396/0 (socket says 172.21.15.53:60396) 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 -- 172.21.15.53:0/595696067 learned_addr learned my addr 172.21.15.53:0/595696067 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f470093f640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 0x7f46fc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701941640 1 --2- 172.21.15.53:0/595696067 >> v2:172.21.15.87:3300/0 conn(0x7f46fc0cbd60 0x7f46fc0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844892709 0 0) 0x7f46fc0b1ac0 con 0x7f46fc0cb980 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46e8003530 con 0x7f46fc0cb980 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4183350491 0 0) 0x7f46e8003530 con 0x7f46fc0cb980 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 msgr2=0x7f46fc0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 0x7f46fc0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 >> v2:172.21.15.87:3300/0 conn(0x7f46fc0cbd60 msgr2=0x7f46fc0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 --2- 172.21.15.53:0/595696067 >> v2:172.21.15.87:3300/0 conn(0x7f46fc0cbd60 0x7f46fc0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc15a080 con 0x7f46fc0cb980 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f46f8001680 con 0x7f46fc0cb980 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 >> v1:172.21.15.53:6789/0 conn(0x7f46fc0cb980 legacy=0x7f46fc06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46e8003980 0x7f46e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80047d0 0x7f46e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 0x7f46e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc159ac0 con 0x7f46e8003980 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc159da0 con 0x7f46e80047d0 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e800b990 con 0x7f46fc06b850 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46e8003980 0x7f46e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f470093f640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80047d0 0x7f46e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 -- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 msgr2=0x7f46e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701941640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 0x7f46e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06b850 0x7f46e8005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 -- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80047d0 msgr2=0x7f46e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80047d0 0x7f46e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f4701140640 1 -- 172.21.15.53:0/595696067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8003530 con 0x7f46e8003980 2024-09-13T18:25:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.848+0000 7f470093f640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46e80047d0 0x7f46e8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f4701140640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46e8003980 0x7f46e8003da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f46f800c240 tx=0x7f46f801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68885fad8063241f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80058e0 con 0x7f46e8003980 2024-09-13T18:25:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8005a40 con 0x7f46e8003980 2024-09-13T18:25:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f46f3fff640 1 -- 172.21.15.53:0/595696067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8005df0 con 0x7f46e8003980 2024-09-13T18:25:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 -- 172.21.15.53:0/595696067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46e8003980 msgr2=0x7f46e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 --2- 172.21.15.53:0/595696067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46e8003980 0x7f46e8003da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f46f800c240 tx=0x7f46f801cc10 comp rx=0 tx=0).stop 2024-09-13T18:25:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f4701941640 1 -- 172.21.15.53:0/595696067 reap_dead start 2024-09-13T18:25:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 -- 172.21.15.53:0/595696067 shutdown_connections 2024-09-13T18:25:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 -- 172.21.15.53:0/595696067 >> 172.21.15.53:0/595696067 conn(0x7f46fc065c80 msgr2=0x7f46fc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 -- 172.21.15.53:0/595696067 shutdown_connections 2024-09-13T18:25:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 -- 172.21.15.53:0/595696067 wait complete. 2024-09-13T18:25:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 Processor -- start 2024-09-13T18:25:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.852+0000 7f47033a4640 1 -- start start 2024-09-13T18:25:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06c2c0 0x7f46fc14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc06c6a0 0x7f46fc1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc14f220 0x7f46fc149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14fd40 con 0x7f46fc14f220 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14f780 con 0x7f46fc06c6a0 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14fa60 con 0x7f46fc06c2c0 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc14f220 0x7f46fc149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc14f220 0x7f46fc149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54376/0 (socket says 172.21.15.53:54376) 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 -- 172.21.15.53:0/1890309133 learned_addr learned my addr 172.21.15.53:0/1890309133 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701140640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06c2c0 0x7f46fc14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f470093f640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc06c6a0 0x7f46fc1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 -- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06c2c0 msgr2=0x7f46fc14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06c2c0 0x7f46fc14ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 -- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc06c6a0 msgr2=0x7f46fc1499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc06c6a0 0x7f46fc1499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 -- 172.21.15.53:0/1890309133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc1491d0 con 0x7f46fc14f220 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701941640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc14f220 0x7f46fc149f10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0cc140 tx=0x7f46f400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f46f1ffb640 1 -- 172.21.15.53:0/1890309133 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4016420 con 0x7f46fc14f220 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f46f1ffb640 1 -- 172.21.15.53:0/1890309133 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4016580 con 0x7f46fc14f220 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc1494b0 con 0x7f46fc14f220 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f46f1ffb640 1 -- 172.21.15.53:0/1890309133 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4016930 con 0x7f46fc14f220 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc1342d0 con 0x7f46fc14f220 2024-09-13T18:25:53.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc067400 con 0x7f46fc14f220 2024-09-13T18:25:53.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f46f1ffb640 1 -- 172.21.15.53:0/1890309133 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46f4016a90 con 0x7f46fc14f220 2024-09-13T18:25:53.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f46f1ffb640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46e00666c0 0x7f46e0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:53.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f46f1ffb640 1 -- 172.21.15.53:0/1890309133 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f46f4084b80 con 0x7f46fc14f220 2024-09-13T18:25:53.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.856+0000 7f4701140640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46e00666c0 0x7f46e0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:53.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.860+0000 7f4701140640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46e00666c0 0x7f46e0068b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f46f80aa000 tx=0x7f46f8000ff0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:53.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:53.860+0000 7f46f1ffb640 1 -- 172.21.15.53:0/1890309133 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f46f4052240 con 0x7f46fc14f220 2024-09-13T18:25:54.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.080+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f46fc1496a0 con 0x7f46fc14f220 2024-09-13T18:25:54.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f46f1ffb640 1 -- 172.21.15.53:0/1890309133 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f46f4055860 con 0x7f46fc14f220 2024-09-13T18:25:54.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46e00666c0 msgr2=0x7f46e0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46e00666c0 0x7f46e0068b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f46f80aa000 tx=0x7f46f8000ff0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc14f220 msgr2=0x7f46fc149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc14f220 0x7f46fc149f10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0cc140 tx=0x7f46f400f520 comp rx=0 tx=0).stop 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 shutdown_connections 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46e00666c0 0x7f46e0068b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc14f220 0x7f46fc149f10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc06c6a0 0x7f46fc1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 --2- 172.21.15.53:0/1890309133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc06c2c0 0x7f46fc14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 >> 172.21.15.53:0/1890309133 conn(0x7f46fc065c80 msgr2=0x7f46fc14a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 shutdown_connections 2024-09-13T18:25:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.088+0000 7f47033a4640 1 -- 172.21.15.53:0/1890309133 wait complete. 2024-09-13T18:25:54.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T18:25:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f65a0401640 1 Processor -- start 2024-09-13T18:25:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f65a0401640 1 -- start start 2024-09-13T18:25:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f65a0401640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6598146300 0x7f6598065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f65a0401640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980661c0 0x7f65980ad380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f65a0401640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65980ae100 con 0x7f65980ad8c0 2024-09-13T18:25:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f65a0401640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65980b3790 con 0x7f6598146300 2024-09-13T18:25:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f65a0401640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6598066630 con 0x7f65980661c0 2024-09-13T18:25:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659e19d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6598146300 0x7f6598065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659e19d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6598146300 0x7f6598065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54382/0 (socket says 172.21.15.53:54382) 2024-09-13T18:25:54.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659e19d640 1 -- 172.21.15.53:0/3717977592 learned_addr learned my addr 172.21.15.53:0/3717977592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:54.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659d99c640 1 --2- 172.21.15.53:0/3717977592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980661c0 0x7f65980ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659e19d640 1 -- 172.21.15.53:0/3717977592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980661c0 msgr2=0x7f65980ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:54.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659e19d640 1 --2- 172.21.15.53:0/3717977592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980661c0 0x7f65980ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659e19d640 1 -- 172.21.15.53:0/3717977592 >> v1:172.21.15.87:6789/0 conn(0x7f65980ad8c0 legacy=0x7f6598070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.236+0000 7f659e19d640 1 -- 172.21.15.53:0/3717977592 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65980ae3e0 con 0x7f6598146300 2024-09-13T18:25:54.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f659e19d640 1 --2- 172.21.15.53:0/3717977592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6598146300 0x7f6598065c80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f658c0098a0 tx=0x7f658c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72d73be55610bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:54.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f659d19b640 1 -- 172.21.15.53:0/3717977592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0a6040 con 0x7f6598146300 2024-09-13T18:25:54.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f659d19b640 1 -- 172.21.15.53:0/3717977592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0aa600 con 0x7f6598146300 2024-09-13T18:25:54.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f659d19b640 1 -- 172.21.15.53:0/3717977592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0aa990 con 0x7f6598146300 2024-09-13T18:25:54.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 -- 172.21.15.53:0/3717977592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6598146300 msgr2=0x7f6598065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 --2- 172.21.15.53:0/3717977592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6598146300 0x7f6598065c80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f658c0098a0 tx=0x7f658c01c480 comp rx=0 tx=0).stop 2024-09-13T18:25:54.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 -- 172.21.15.53:0/3717977592 shutdown_connections 2024-09-13T18:25:54.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 --2- 172.21.15.53:0/3717977592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980661c0 0x7f65980ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 --2- 172.21.15.53:0/3717977592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6598146300 0x7f6598065c80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 -- 172.21.15.53:0/3717977592 >> 172.21.15.53:0/3717977592 conn(0x7f6598069f50 msgr2=0x7f659806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:54.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 -- 172.21.15.53:0/3717977592 shutdown_connections 2024-09-13T18:25:54.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 -- 172.21.15.53:0/3717977592 wait complete. 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 Processor -- start 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.240+0000 7f65a0401640 1 -- start start 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65980661c0 0x7f659814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980ad8c0 0x7f6598143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6598146300 0x7f659813e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6598144580 con 0x7f65980661c0 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6598144860 con 0x7f65980ad8c0 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6598144b40 con 0x7f6598146300 2024-09-13T18:25:54.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65980661c0 0x7f659814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65980661c0 0x7f659814d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54394/0 (socket says 172.21.15.53:54394) 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 -- 172.21.15.53:0/2159112806 learned_addr learned my addr 172.21.15.53:0/2159112806 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e99e640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6598146300 0x7f659813e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659d99c640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980ad8c0 0x7f6598143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 -- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6598146300 msgr2=0x7f659813e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6598146300 0x7f659813e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 -- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980ad8c0 msgr2=0x7f6598143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980ad8c0 0x7f6598143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 -- 172.21.15.53:0/2159112806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0094d0 con 0x7f65980661c0 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659e19d640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65980661c0 0x7f659814d140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f658c01ab30 tx=0x7f658c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:54.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f658affd640 1 -- 172.21.15.53:0/2159112806 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b3800 con 0x7f65980661c0 2024-09-13T18:25:54.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f658affd640 1 -- 172.21.15.53:0/2159112806 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0b39a0 con 0x7f65980661c0 2024-09-13T18:25:54.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6598144e20 con 0x7f65980661c0 2024-09-13T18:25:54.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f658affd640 1 -- 172.21.15.53:0/2159112806 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b3d50 con 0x7f65980661c0 2024-09-13T18:25:54.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6598144320 con 0x7f65980661c0 2024-09-13T18:25:54.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65980ad380 con 0x7f65980661c0 2024-09-13T18:25:54.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f658affd640 1 -- 172.21.15.53:0/2159112806 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f658c0c6430 con 0x7f65980661c0 2024-09-13T18:25:54.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f658affd640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f657c066690 0x7f657c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f658affd640 1 -- 172.21.15.53:0/2159112806 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f658c11e930 con 0x7f65980661c0 2024-09-13T18:25:54.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.244+0000 7f659d99c640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f657c066690 0x7f657c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.248+0000 7f659d99c640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f657c066690 0x7f657c068b50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6598145720 tx=0x7f659400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:54.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.248+0000 7f658affd640 1 -- 172.21.15.53:0/2159112806 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f658c0ec080 con 0x7f65980661c0 2024-09-13T18:25:54.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:25:54.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:25:54.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.460+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f6598070b40 con 0x7f65980661c0 2024-09-13T18:25:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.468+0000 7f658affd640 1 -- 172.21.15.53:0/2159112806 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f658c0ef6a0 con 0x7f65980661c0 2024-09-13T18:25:54.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f657c066690 msgr2=0x7f657c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f657c066690 0x7f657c068b50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6598145720 tx=0x7f659400b040 comp rx=0 tx=0).stop 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65980661c0 msgr2=0x7f659814d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65980661c0 0x7f659814d140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f658c01ab30 tx=0x7f658c01acc0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 shutdown_connections 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f657c066690 0x7f657c068b50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6598146300 0x7f659813e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980ad8c0 0x7f6598143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 --2- 172.21.15.53:0/2159112806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65980661c0 0x7f659814d140 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 >> 172.21.15.53:0/2159112806 conn(0x7f6598069f50 msgr2=0x7f65980cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 shutdown_connections 2024-09-13T18:25:54.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.472+0000 7f65a0401640 1 -- 172.21.15.53:0/2159112806 wait complete. 2024-09-13T18:25:54.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T18:25:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f4a0143f640 1 Processor -- start 2024-09-13T18:25:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f4a0143f640 1 -- start start 2024-09-13T18:25:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f4a0143f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 0x7f49fc0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f4a0143f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc15bde0 con 0x7f49fc0b4710 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f4a0143f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc15c0c0 con 0x7f49fc0b3a40 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f4a0143f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc15bc60 con 0x7f49fc157fc0 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49fb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f49fc0b4710 0x7f49fc15d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60412/0 (socket says 172.21.15.53:60412) 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49fb7fe640 1 -- 172.21.15.53:0/4117332403 learned_addr learned my addr 172.21.15.53:0/4117332403 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49faffd640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 0x7f49fc0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850750438 0 0) 0x7f49fc15bde0 con 0x7f49fc0b4710 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e8003530 con 0x7f49fc0b4710 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870148178 0 0) 0x7f49e8003530 con 0x7f49fc0b4710 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 msgr2=0x7f49fc0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 0x7f49fc0b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 >> v1:172.21.15.87:6789/0 conn(0x7f49fc0b3a40 legacy=0x7f49fc0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc15c3a0 con 0x7f49fc0b4710 2024-09-13T18:25:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f49f4001a00 con 0x7f49fc0b4710 2024-09-13T18:25:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 >> v1:172.21.15.53:6789/0 conn(0x7f49fc0b4710 legacy=0x7f49fc15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49e8004360 0x7f49e8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 0x7f49e8005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc15bc60 con 0x7f49e80039b0 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e800fda0 con 0x7f49e8004360 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.612+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e800ff60 con 0x7f49fc157fc0 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49faffd640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49fb7fe640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 0x7f49e8005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49fa7fc640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49e8004360 0x7f49e8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49faffd640 1 -- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 msgr2=0x7f49e8005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49faffd640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc157fc0 0x7f49e8005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49faffd640 1 -- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49e8004360 msgr2=0x7f49e8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49faffd640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49e8004360 0x7f49e8004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49faffd640 1 -- 172.21.15.53:0/4117332403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8003530 con 0x7f49e80039b0 2024-09-13T18:25:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49faffd640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49e8003d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009ae0 tx=0x7f49ec01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a58ad5b1e585c0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0a5660 con 0x7f49e80039b0 2024-09-13T18:25:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec0a57c0 con 0x7f49e80039b0 2024-09-13T18:25:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49f9ffb640 1 -- 172.21.15.53:0/4117332403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0a5b70 con 0x7f49e80039b0 2024-09-13T18:25:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f4a0143f640 1 -- 172.21.15.53:0/4117332403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 msgr2=0x7f49e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f4a0143f640 1 --2- 172.21.15.53:0/4117332403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49e8003d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f49ec009ae0 tx=0x7f49ec01ca70 comp rx=0 tx=0).stop 2024-09-13T18:25:54.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f49fb7fe640 1 -- 172.21.15.53:0/4117332403 reap_dead start 2024-09-13T18:25:54.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f4a0143f640 1 -- 172.21.15.53:0/4117332403 shutdown_connections 2024-09-13T18:25:54.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f4a0143f640 1 -- 172.21.15.53:0/4117332403 >> 172.21.15.53:0/4117332403 conn(0x7f49fc071a50 msgr2=0x7f49fc099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:54.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f4a0143f640 1 -- 172.21.15.53:0/4117332403 shutdown_connections 2024-09-13T18:25:54.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.616+0000 7f4a0143f640 1 -- 172.21.15.53:0/4117332403 wait complete. 2024-09-13T18:25:54.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 Processor -- start 2024-09-13T18:25:54.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 -- start start 2024-09-13T18:25:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49fc1ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc1f1f10 0x7f49fc13d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49fc13df10 0x7f49fc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1ede70 con 0x7f49e80039b0 2024-09-13T18:25:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1f1500 con 0x7f49fc13df10 2024-09-13T18:25:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1f1a80 con 0x7f49fc1f1f10 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49fc1ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49fc1ed930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54414/0 (socket says 172.21.15.53:54414) 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 -- 172.21.15.53:0/1473279936 learned_addr learned my addr 172.21.15.53:0/1473279936 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49fa7fc640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc1f1f10 0x7f49fc13d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49fb7fe640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49fc13df10 0x7f49fc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 -- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc1f1f10 msgr2=0x7f49fc13d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc1f1f10 0x7f49fc13d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 -- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49fc13df10 msgr2=0x7f49fc06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49fc13df10 0x7f49fc06e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 -- 172.21.15.53:0/1473279936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc13e4b0 con 0x7f49e80039b0 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49faffd640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49fc1ed930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0b0040 tx=0x7f49e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49f37fe640 1 -- 172.21.15.53:0/1473279936 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0a5660 con 0x7f49e80039b0 2024-09-13T18:25:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49f37fe640 1 -- 172.21.15.53:0/1473279936 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec004260 con 0x7f49e80039b0 2024-09-13T18:25:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc13e790 con 0x7f49e80039b0 2024-09-13T18:25:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f49f37fe640 1 -- 172.21.15.53:0/1473279936 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0059a0 con 0x7f49e80039b0 2024-09-13T18:25:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc1f2390 con 0x7f49e80039b0 2024-09-13T18:25:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.620+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc13e970 con 0x7f49e80039b0 2024-09-13T18:25:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.624+0000 7f49f37fe640 1 -- 172.21.15.53:0/1473279936 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49ec0b4040 con 0x7f49e80039b0 2024-09-13T18:25:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.624+0000 7f49f37fe640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f49dc066690 0x7f49dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.624+0000 7f49f37fe640 1 -- 172.21.15.53:0/1473279936 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f49ec11d960 con 0x7f49e80039b0 2024-09-13T18:25:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.624+0000 7f49fa7fc640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f49dc066690 0x7f49dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.624+0000 7f49fa7fc640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f49dc066690 0x7f49dc068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0b5800 tx=0x7f49e400a9b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:54.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.628+0000 7f49f37fe640 1 -- 172.21.15.53:0/1473279936 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49ec0eaf80 con 0x7f49e80039b0 2024-09-13T18:25:54.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.844+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f49fc158860 con 0x7f49e80039b0 2024-09-13T18:25:54.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.848+0000 7f49f37fe640 1 -- 172.21.15.53:0/1473279936 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f49ec0b2020 con 0x7f49e80039b0 2024-09-13T18:25:54.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f49dc066690 msgr2=0x7f49dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f49dc066690 0x7f49dc068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0b5800 tx=0x7f49e400a9b0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 msgr2=0x7f49fc1ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49fc1ed930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f49ec0b0040 tx=0x7f49e8005800 comp rx=0 tx=0).stop 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 shutdown_connections 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f49dc066690 0x7f49dc068b50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49fc1f1f10 0x7f49fc13d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49fc13df10 0x7f49fc06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 --2- 172.21.15.53:0/1473279936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49e80039b0 0x7f49fc1ed930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 >> 172.21.15.53:0/1473279936 conn(0x7f49fc071a50 msgr2=0x7f49fc1533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 shutdown_connections 2024-09-13T18:25:54.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.852+0000 7f4a0143f640 1 -- 172.21.15.53:0/1473279936 wait complete. 2024-09-13T18:25:54.872 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T18:25:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbdad0ce640 1 Processor -- start 2024-09-13T18:25:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbdad0ce640 1 -- start start 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbdad0ce640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda80cb980 0x7fbda80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbdad0ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbda80cbd60 0x7fbda80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbdad0ce640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda80b1ac0 con 0x7fbda806b850 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbdad0ce640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda80b3010 con 0x7fbda80cbd60 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbdad0ce640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8159ac0 con 0x7fbda80cb980 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbda759e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbda80cbd60 0x7fbda80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbda759e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbda80cbd60 0x7fbda80cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54422/0 (socket says 172.21.15.53:54422) 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbda759e640 1 -- 172.21.15.53:0/2656273580 learned_addr learned my addr 172.21.15.53:0/2656273580 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.992+0000 7fbda6d9d640 1 --2- 172.21.15.53:0/2656273580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda80cb980 0x7fbda80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda759e640 1 -- 172.21.15.53:0/2656273580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda80cb980 msgr2=0x7fbda80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda759e640 1 --2- 172.21.15.53:0/2656273580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda80cb980 0x7fbda80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda759e640 1 -- 172.21.15.53:0/2656273580 >> v1:172.21.15.87:6789/0 conn(0x7fbda806b850 legacy=0x7fbda806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda759e640 1 -- 172.21.15.53:0/2656273580 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8159da0 con 0x7fbda80cbd60 2024-09-13T18:25:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda759e640 1 --2- 172.21.15.53:0/2656273580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80cdd40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009e80 tx=0x7fbda001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b0224452755856 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda659c640 1 -- 172.21.15.53:0/2656273580 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda00a5810 con 0x7fbda80cbd60 2024-09-13T18:25:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda659c640 1 -- 172.21.15.53:0/2656273580 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda00a5970 con 0x7fbda80cbd60 2024-09-13T18:25:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbda659c640 1 -- 172.21.15.53:0/2656273580 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda00a5d00 con 0x7fbda80cbd60 2024-09-13T18:25:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 -- 172.21.15.53:0/2656273580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 msgr2=0x7fbda80cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/2656273580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80cdd40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009e80 tx=0x7fbda001c950 comp rx=0 tx=0).stop 2024-09-13T18:25:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 -- 172.21.15.53:0/2656273580 shutdown_connections 2024-09-13T18:25:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/2656273580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80cdd40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/2656273580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda80cb980 0x7fbda80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 -- 172.21.15.53:0/2656273580 >> 172.21.15.53:0/2656273580 conn(0x7fbda8065c80 msgr2=0x7fbda8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 -- 172.21.15.53:0/2656273580 shutdown_connections 2024-09-13T18:25:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:54.996+0000 7fbdad0ce640 1 -- 172.21.15.53:0/2656273580 wait complete. 2024-09-13T18:25:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 Processor -- start 2024-09-13T18:25:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 -- start start 2024-09-13T18:25:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda806b850 0x7fbda8146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbda80cb980 0x7fbda80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda815c870 con 0x7fbda80cbd60 2024-09-13T18:25:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda814afd0 con 0x7fbda80cb980 2024-09-13T18:25:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8147280 con 0x7fbda806b850 2024-09-13T18:25:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54424/0 (socket says 172.21.15.53:54424) 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 -- 172.21.15.53:0/3694579057 learned_addr learned my addr 172.21.15.53:0/3694579057 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda6d9d640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda806b850 0x7fbda8146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbd9ffff640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbda80cb980 0x7fbda80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 -- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda806b850 msgr2=0x7fbda8146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda806b850 0x7fbda8146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 -- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbda80cb980 msgr2=0x7fbda80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbda80cb980 0x7fbda80ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 -- 172.21.15.53:0/3694579057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0009b30 con 0x7fbda80cbd60 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbd9ffff640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbda80cb980 0x7fbda80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbda759e640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80ace20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbda00af040 tx=0x7fbda00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbd9f7fe640 1 -- 172.21.15.53:0/3694579057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda00b8670 con 0x7fbda80cbd60 2024-09-13T18:25:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbd9f7fe640 1 -- 172.21.15.53:0/3694579057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda00b87d0 con 0x7fbda80cbd60 2024-09-13T18:25:55.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbd9f7fe640 1 -- 172.21.15.53:0/3694579057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda00b8b80 con 0x7fbda80cbd60 2024-09-13T18:25:55.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda815c2b0 con 0x7fbda80cbd60 2024-09-13T18:25:55.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda814ac60 con 0x7fbda80cbd60 2024-09-13T18:25:55.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda8067400 con 0x7fbda80cbd60 2024-09-13T18:25:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.000+0000 7fbd9f7fe640 1 -- 172.21.15.53:0/3694579057 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbda00b8ce0 con 0x7fbda80cbd60 2024-09-13T18:25:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.004+0000 7fbd9f7fe640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbd880666c0 0x7fbd88068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.004+0000 7fbd9f7fe640 1 -- 172.21.15.53:0/3694579057 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbda011f370 con 0x7fbda80cbd60 2024-09-13T18:25:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.004+0000 7fbda6d9d640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbd880666c0 0x7fbd88068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.004+0000 7fbda6d9d640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbd880666c0 0x7fbd88068b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800b9d0 tx=0x7fbd98008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.008+0000 7fbd9f7fe640 1 -- 172.21.15.53:0/3694579057 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbda00ecbe0 con 0x7fbda80cbd60 2024-09-13T18:25:55.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.224+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fbda814b140 con 0x7fbda80cbd60 2024-09-13T18:25:55.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.228+0000 7fbd9f7fe640 1 -- 172.21.15.53:0/3694579057 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbda00f0200 con 0x7fbda80cbd60 2024-09-13T18:25:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbd880666c0 msgr2=0x7fbd88068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbd880666c0 0x7fbd88068b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800b9d0 tx=0x7fbd98008040 comp rx=0 tx=0).stop 2024-09-13T18:25:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 msgr2=0x7fbda80ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80ace20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbda00af040 tx=0x7fbda00196f0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 shutdown_connections 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbd880666c0 0x7fbd88068b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbda80cbd60 0x7fbda80ace20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbda80cb980 0x7fbda80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 --2- 172.21.15.53:0/3694579057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbda806b850 0x7fbda8146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 >> 172.21.15.53:0/3694579057 conn(0x7fbda8065c80 msgr2=0x7fbda80aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 shutdown_connections 2024-09-13T18:25:55.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.232+0000 7fbdad0ce640 1 -- 172.21.15.53:0/3694579057 wait complete. 2024-09-13T18:25:55.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T18:25:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fece13ae640 1 Processor -- start 2024-09-13T18:25:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fece13ae640 1 -- start start 2024-09-13T18:25:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fece13ae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 0x7fecdc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fece13ae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0b1ac0 con 0x7fecdc0cbd60 2024-09-13T18:25:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fece13ae640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc159ac0 con 0x7fecdc0cb980 2024-09-13T18:25:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fece13ae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc159da0 con 0x7fecdc06b850 2024-09-13T18:25:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fecdb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fecdc0cbd60 0x7fecdc0b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60424/0 (socket says 172.21.15.53:60424) 2024-09-13T18:25:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fecdb7fe640 1 -- 172.21.15.53:0/94931230 learned_addr learned my addr 172.21.15.53:0/94931230 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fecda7fc640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 0x7fecdc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153237425 0 0) 0x7fecdc0b1ac0 con 0x7fecdc0cbd60 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.356+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc4003530 con 0x7fecdc0cbd60 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171387857 0 0) 0x7fecc4003530 con 0x7fecdc0cbd60 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 msgr2=0x7fecdc0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 0x7fecdc0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 >> v1:172.21.15.87:6789/0 conn(0x7fecdc0cb980 legacy=0x7fecdc06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc15a080 con 0x7fecdc0cbd60 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fecd4001a00 con 0x7fecdc0cbd60 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 >> v1:172.21.15.53:6789/0 conn(0x7fecdc0cbd60 legacy=0x7fecdc0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 0x7fecc40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecc4003f30 0x7fecc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecc4004d10 0x7fecc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc159da0 con 0x7fecc4004d10 2024-09-13T18:25:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc400bb20 con 0x7fecc4003f30 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc400bce0 con 0x7fecdc06b850 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecc4004d10 0x7fecc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecda7fc640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecc4003f30 0x7fecc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdaffd640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 0x7fecc40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 -- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 msgr2=0x7fecc40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 0x7fecc40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 -- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecc4003f30 msgr2=0x7fecc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecc4003f30 0x7fecc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 -- 172.21.15.53:0/94931230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4003530 con 0x7fecc4004d10 2024-09-13T18:25:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdaffd640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecdc06b850 0x7fecc40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecc4004d10 0x7fecc4005190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fecd400a830 tx=0x7fecd401fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38063de6e37bd68a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40aa6f0 con 0x7fecc4004d10 2024-09-13T18:25:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40aa850 con 0x7fecc4004d10 2024-09-13T18:25:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecd9ffb640 1 -- 172.21.15.53:0/94931230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40aac40 con 0x7fecc4004d10 2024-09-13T18:25:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fece13ae640 1 -- 172.21.15.53:0/94931230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecc4004d10 msgr2=0x7fecc4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fece13ae640 1 --2- 172.21.15.53:0/94931230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecc4004d10 0x7fecc4005190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fecd400a830 tx=0x7fecd401fac0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fecdb7fe640 1 -- 172.21.15.53:0/94931230 reap_dead start 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fece13ae640 1 -- 172.21.15.53:0/94931230 shutdown_connections 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fece13ae640 1 -- 172.21.15.53:0/94931230 >> 172.21.15.53:0/94931230 conn(0x7fecdc065c80 msgr2=0x7fecdc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fece13ae640 1 -- 172.21.15.53:0/94931230 shutdown_connections 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.360+0000 7fece13ae640 1 -- 172.21.15.53:0/94931230 wait complete. 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 Processor -- start 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 -- start start 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecc4004d10 0x7fecdc0c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecdc0c9cf0 0x7fecdc0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecdc0ac340 0x7fecdc148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0ca170 con 0x7fecdc0ac340 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1f2de0 con 0x7fecdc0c9cf0 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1f3050 con 0x7fecc4004d10 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecdc0ac340 0x7fecdc148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecdc0ac340 0x7fecdc148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54434/0 (socket says 172.21.15.53:54434) 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 -- 172.21.15.53:0/3930051647 learned_addr learned my addr 172.21.15.53:0/3930051647 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdaffd640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecc4004d10 0x7fecdc0c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecda7fc640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecdc0c9cf0 0x7fecdc0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 -- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecc4004d10 msgr2=0x7fecdc0c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecc4004d10 0x7fecdc0c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 -- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecdc0c9cf0 msgr2=0x7fecdc0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecdc0c9cf0 0x7fecdc0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 -- 172.21.15.53:0/3930051647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc1f3330 con 0x7fecdc0ac340 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecdb7fe640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecdc0ac340 0x7fecdc148410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007040 tx=0x7fecd401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecc37fe640 1 -- 172.21.15.53:0/3930051647 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40b9040 con 0x7fecdc0ac340 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecc37fe640 1 -- 172.21.15.53:0/3930051647 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4001800 con 0x7fecdc0ac340 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc1f3610 con 0x7fecdc0ac340 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecc37fe640 1 -- 172.21.15.53:0/3930051647 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40aa6f0 con 0x7fecdc0ac340 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0ac7c0 con 0x7fecdc0ac340 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc067400 con 0x7fecdc0ac340 2024-09-13T18:25:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecc37fe640 1 -- 172.21.15.53:0/3930051647 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fecd40aabc0 con 0x7fecdc0ac340 2024-09-13T18:25:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.364+0000 7fecc37fe640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc8066690 0x7fecc8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.368+0000 7fecc37fe640 1 -- 172.21.15.53:0/3930051647 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fecd4121590 con 0x7fecdc0ac340 2024-09-13T18:25:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.368+0000 7fecdaffd640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc8066690 0x7fecc8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.368+0000 7fecdaffd640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc8066690 0x7fecc8068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feccc000c10 tx=0x7feccc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.368+0000 7fecc37fe640 1 -- 172.21.15.53:0/3930051647 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fecd40eec50 con 0x7fecdc0ac340 2024-09-13T18:25:55.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.580+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fecdc1f3b30 con 0x7fecdc0ac340 2024-09-13T18:25:55.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fecc37fe640 1 -- 172.21.15.53:0/3930051647 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fecdc1f3b30 con 0x7fecdc0ac340 2024-09-13T18:25:55.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc8066690 msgr2=0x7fecc8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc8066690 0x7fecc8068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feccc000c10 tx=0x7feccc009040 comp rx=0 tx=0).stop 2024-09-13T18:25:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecdc0ac340 msgr2=0x7fecdc148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecdc0ac340 0x7fecdc148410 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007040 tx=0x7fecd401c860 comp rx=0 tx=0).stop 2024-09-13T18:25:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 shutdown_connections 2024-09-13T18:25:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecc8066690 0x7fecc8068b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecdc0ac340 0x7fecdc148410 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecdc0c9cf0 0x7fecdc0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 --2- 172.21.15.53:0/3930051647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecc4004d10 0x7fecdc0c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 >> 172.21.15.53:0/3930051647 conn(0x7fecdc065c80 msgr2=0x7fecdc0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:55.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 shutdown_connections 2024-09-13T18:25:55.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.588+0000 7fece13ae640 1 -- 172.21.15.53:0/3930051647 wait complete. 2024-09-13T18:25:55.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:55.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.712+0000 7fa4871e4640 1 Processor -- start 2024-09-13T18:25:55.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.712+0000 7fa4871e4640 1 -- start start 2024-09-13T18:25:55.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa4871e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800713a0 0x7fa480165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa4871e4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48006d480 con 0x7fa48015b7c0 2024-09-13T18:25:55.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa4871e4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48015ace0 con 0x7fa4801582a0 2024-09-13T18:25:55.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa4871e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48015aaf0 con 0x7fa4800713a0 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa48015b7c0 0x7fa480070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60434/0 (socket says 172.21.15.53:60434) 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47ffff640 1 -- 172.21.15.53:0/481963247 learned_addr learned my addr 172.21.15.53:0/481963247 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa485781640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800713a0 0x7fa480165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422281722 0 0) 0x7fa48006d480 con 0x7fa48015b7c0 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa468003530 con 0x7fa48015b7c0 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1282649616 0 0) 0x7fa468003530 con 0x7fa48015b7c0 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800713a0 msgr2=0x7fa480165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800713a0 0x7fa480165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 >> v1:172.21.15.87:6789/0 conn(0x7fa4801582a0 legacy=0x7fa48006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48015afc0 con 0x7fa48015b7c0 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa474001680 con 0x7fa48015b7c0 2024-09-13T18:25:55.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 >> v1:172.21.15.53:6789/0 conn(0x7fa48015b7c0 legacy=0x7fa480070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa468003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4680047d0 0x7fa468004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800713a0 0x7fa468005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800ba40 con 0x7fa4680039b0 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800bbb0 con 0x7fa4680047d0 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800bd70 con 0x7fa4800713a0 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa484f80640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa468003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa47ffff640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4680047d0 0x7fa468004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa484f80640 1 -- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800713a0 msgr2=0x7fa468005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa484f80640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800713a0 0x7fa468005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa484f80640 1 -- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4680047d0 msgr2=0x7fa468004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa484f80640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4680047d0 0x7fa468004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.716+0000 7fa484f80640 1 -- 172.21.15.53:0/481963247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468003530 con 0x7fa4680039b0 2024-09-13T18:25:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa468003dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa470001750 tx=0x7fa47001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcabb02c64f0337 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700052d0 con 0x7fa4680039b0 2024-09-13T18:25:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700a7050 con 0x7fa4680039b0 2024-09-13T18:25:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47f7fe640 1 -- 172.21.15.53:0/481963247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470003600 con 0x7fa4680039b0 2024-09-13T18:25:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- 172.21.15.53:0/481963247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 msgr2=0x7fa468003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 --2- 172.21.15.53:0/481963247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa468003dd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa470001750 tx=0x7fa47001c3c0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa485781640 1 -- 172.21.15.53:0/481963247 reap_dead start 2024-09-13T18:25:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- 172.21.15.53:0/481963247 shutdown_connections 2024-09-13T18:25:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- 172.21.15.53:0/481963247 >> 172.21.15.53:0/481963247 conn(0x7fa480065c80 msgr2=0x7fa480066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- 172.21.15.53:0/481963247 shutdown_connections 2024-09-13T18:25:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- 172.21.15.53:0/481963247 wait complete. 2024-09-13T18:25:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 Processor -- start 2024-09-13T18:25:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- start start 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa4801443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa480144910 0x7fa480147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4801483b0 0x7fa4801536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480155010 con 0x7fa4680039b0 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480146a70 con 0x7fa4801483b0 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa480154390 con 0x7fa480144910 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa4801443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa4801443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54450/0 (socket says 172.21.15.53:54450) 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 -- 172.21.15.53:0/2103559366 learned_addr learned my addr 172.21.15.53:0/2103559366 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa485781640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4801483b0 0x7fa4801536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47ffff640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa480144910 0x7fa480147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 -- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa480144910 msgr2=0x7fa480147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa480144910 0x7fa480147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 -- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4801483b0 msgr2=0x7fa4801536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4801483b0 0x7fa4801536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 -- 172.21.15.53:0/2103559366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480154670 con 0x7fa4680039b0 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47ffff640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa480144910 0x7fa480147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa484f80640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa4801443d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa470001750 tx=0x7fa468005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47d7fa640 1 -- 172.21.15.53:0/2103559366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470007040 con 0x7fa4680039b0 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47d7fa640 1 -- 172.21.15.53:0/2103559366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700071a0 con 0x7fa4680039b0 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa480154950 con 0x7fa4680039b0 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.720+0000 7fa47d7fa640 1 -- 172.21.15.53:0/2103559366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470007510 con 0x7fa4680039b0 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.724+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa480148860 con 0x7fa4680039b0 2024-09-13T18:25:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.724+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa480067400 con 0x7fa4680039b0 2024-09-13T18:25:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.724+0000 7fa47d7fa640 1 -- 172.21.15.53:0/2103559366 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4700067e0 con 0x7fa4680039b0 2024-09-13T18:25:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.724+0000 7fa47d7fa640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa46c0666c0 0x7fa46c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.724+0000 7fa47d7fa640 1 -- 172.21.15.53:0/2103559366 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa47011d5b0 con 0x7fa4680039b0 2024-09-13T18:25:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.724+0000 7fa47ffff640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa46c0666c0 0x7fa46c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.724+0000 7fa47ffff640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa46c0666c0 0x7fa46c068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa474001ec0 tx=0x7fa474009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:55.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.728+0000 7fa47d7fa640 1 -- 172.21.15.53:0/2103559366 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4700ee790 con 0x7fa4680039b0 2024-09-13T18:25:55.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.884+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa480074190 con 0x7fa4680039b0 2024-09-13T18:25:55.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.884+0000 7fa47d7fa640 1 -- 172.21.15.53:0/2103559366 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fa4700ee320 con 0x7fa4680039b0 2024-09-13T18:25:55.890 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:55.890 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":30,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:52.920129+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa46c0666c0 msgr2=0x7fa46c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa46c0666c0 0x7fa46c068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa474001ec0 tx=0x7fa474009040 comp rx=0 tx=0).stop 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 msgr2=0x7fa4801443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa4801443d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa470001750 tx=0x7fa468005800 comp rx=0 tx=0).stop 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 shutdown_connections 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa46c0666c0 0x7fa46c068b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa480144910 0x7fa480147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4801483b0 0x7fa4801536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 --2- 172.21.15.53:0/2103559366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4680039b0 0x7fa4801443d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 >> 172.21.15.53:0/2103559366 conn(0x7fa480065c80 msgr2=0x7fa480148e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 shutdown_connections 2024-09-13T18:25:55.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:55.888+0000 7fa4871e4640 1 -- 172.21.15.53:0/2103559366 wait complete. 2024-09-13T18:25:55.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:25:55.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:25:56.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.028+0000 7f0e8ba6e640 1 Processor -- start 2024-09-13T18:25:56.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.028+0000 7f0e8ba6e640 1 -- start start 2024-09-13T18:25:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8ba6e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0e840cf6b0 0x7f0e840cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8ba6e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e840d2150 0x7f0e840b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8ba6e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e840cdf20 con 0x7f0e8415c8e0 2024-09-13T18:25:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8ba6e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e840d10b0 con 0x7f0e840d2150 2024-09-13T18:25:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8ba6e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e840d1390 con 0x7f0e840cf6b0 2024-09-13T18:25:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8980a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0e8415c8e0 0x7f0e840cefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60438/0 (socket says 172.21.15.53:60438) 2024-09-13T18:25:56.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8980a640 1 -- 172.21.15.53:0/3184615040 learned_addr learned my addr 172.21.15.53:0/3184615040 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8a00b640 1 --2- 172.21.15.53:0/3184615040 >> v2:172.21.15.53:3300/0 conn(0x7f0e840d2150 0x7f0e840b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e89009640 1 --2- 172.21.15.53:0/3184615040 >> v2:172.21.15.87:3300/0 conn(0x7f0e840cf6b0 0x7f0e840cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e88808640 1 -- 172.21.15.53:0/3184615040 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677754083 0 0) 0x7f0e80001120 con 0x7f0e8415c8e0 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e88808640 1 -- 172.21.15.53:0/3184615040 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e70003530 con 0x7f0e8415c8e0 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8a00b640 1 -- 172.21.15.53:0/3184615040 >> v2:172.21.15.87:3300/0 conn(0x7f0e840cf6b0 msgr2=0x7f0e840cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8a00b640 1 --2- 172.21.15.53:0/3184615040 >> v2:172.21.15.87:3300/0 conn(0x7f0e840cf6b0 0x7f0e840cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8a00b640 1 -- 172.21.15.53:0/3184615040 >> v1:172.21.15.53:6789/0 conn(0x7f0e8415c8e0 legacy=0x7f0e840cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8a00b640 1 -- 172.21.15.53:0/3184615040 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e840d1670 con 0x7f0e840d2150 2024-09-13T18:25:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e8a00b640 1 --2- 172.21.15.53:0/3184615040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e840d2150 0x7f0e840b5980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0e840cccc0 tx=0x7f0e7c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c9cf28e5589960 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e88808640 1 -- 172.21.15.53:0/3184615040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0a57f0 con 0x7f0e840d2150 2024-09-13T18:25:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e88808640 1 -- 172.21.15.53:0/3184615040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c0a5950 con 0x7f0e840d2150 2024-09-13T18:25:56.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.032+0000 7f0e88808640 1 -- 172.21.15.53:0/3184615040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0a5ce0 con 0x7f0e840d2150 2024-09-13T18:25:56.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/3184615040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e840d2150 msgr2=0x7f0e840b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/3184615040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e840d2150 0x7f0e840b5980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0e840cccc0 tx=0x7f0e7c01c930 comp rx=0 tx=0).stop 2024-09-13T18:25:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/3184615040 shutdown_connections 2024-09-13T18:25:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/3184615040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e840d2150 0x7f0e840b5980 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/3184615040 >> v2:172.21.15.87:3300/0 conn(0x7f0e840cf6b0 0x7f0e840cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/3184615040 >> 172.21.15.53:0/3184615040 conn(0x7f0e84070570 msgr2=0x7f0e84070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/3184615040 shutdown_connections 2024-09-13T18:25:56.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/3184615040 wait complete. 2024-09-13T18:25:56.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 Processor -- start 2024-09-13T18:25:56.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- start start 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e840cf6b0 0x7f0e840b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e840d2150 0x7f0e8414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e8415c8e0 0x7f0e8414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b3da0 con 0x7f0e8415c8e0 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b3190 con 0x7f0e840cf6b0 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b3470 con 0x7f0e840d2150 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e8415c8e0 0x7f0e8414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e8415c8e0 0x7f0e8414f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54472/0 (socket says 172.21.15.53:54472) 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 -- 172.21.15.53:0/165595418 learned_addr learned my addr 172.21.15.53:0/165595418 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e89009640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e840d2150 0x7f0e8414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8980a640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e840cf6b0 0x7f0e840b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 -- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e840d2150 msgr2=0x7f0e8414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e840d2150 0x7f0e8414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 -- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e840cf6b0 msgr2=0x7f0e840b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e840cf6b0 0x7f0e840b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 -- 172.21.15.53:0/165595418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c009a70 con 0x7f0e8415c8e0 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8a00b640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e8415c8e0 0x7f0e8414f810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0b0040 tx=0x7f0e7c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e7a7fc640 1 -- 172.21.15.53:0/165595418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0b9650 con 0x7f0e8415c8e0 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e7a7fc640 1 -- 172.21.15.53:0/165595418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c0b97b0 con 0x7f0e8415c8e0 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e840b3750 con 0x7f0e8415c8e0 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e7a7fc640 1 -- 172.21.15.53:0/165595418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0b9b60 con 0x7f0e8415c8e0 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.036+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e840b2e20 con 0x7f0e8415c8e0 2024-09-13T18:25:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.040+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e84067400 con 0x7f0e8415c8e0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.040+0000 7f0e7a7fc640 1 -- 172.21.15.53:0/165595418 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e7c0b9cc0 con 0x7f0e8415c8e0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.040+0000 7f0e7a7fc640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0e68066690 0x7f0e68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.040+0000 7f0e7a7fc640 1 -- 172.21.15.53:0/165595418 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e7c11f0d0 con 0x7f0e8415c8e0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.040+0000 7f0e8980a640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0e68066690 0x7f0e68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.040+0000 7f0e8980a640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0e68066690 0x7f0e68068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001380 tx=0x7f0e80009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.044+0000 7f0e7a7fc640 1 -- 172.21.15.53:0/165595418 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e7c0ec790 con 0x7f0e8415c8e0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.204+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e840cd9e0 con 0x7f0e8415c8e0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.204+0000 7f0e7a7fc640 1 -- 172.21.15.53:0/165595418 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e7c0efdb0 con 0x7f0e8415c8e0 2024-09-13T18:25:56.399 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:25:56.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0e68066690 msgr2=0x7f0e68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0e68066690 0x7f0e68068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e80001380 tx=0x7f0e80009040 comp rx=0 tx=0).stop 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e8415c8e0 msgr2=0x7f0e8414f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e8415c8e0 0x7f0e8414f810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0b0040 tx=0x7f0e7c0196d0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 shutdown_connections 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0e68066690 0x7f0e68068b50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e840d2150 0x7f0e8414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e8415c8e0 0x7f0e8414f810 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 --2- 172.21.15.53:0/165595418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e840cf6b0 0x7f0e840b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 >> 172.21.15.53:0/165595418 conn(0x7f0e84070570 msgr2=0x7f0e84070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 shutdown_connections 2024-09-13T18:25:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.208+0000 7f0e8ba6e640 1 -- 172.21.15.53:0/165595418 wait complete. 2024-09-13T18:25:56.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:25:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.524+0000 7f71082ae640 1 Processor -- start 2024-09-13T18:25:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f71082ae640 1 -- start start 2024-09-13T18:25:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f71082ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71000713a0 0x7f7100165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f71082ae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710006d480 con 0x7f71001582a0 2024-09-13T18:25:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f71082ae640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710015ace0 con 0x7f710015b7c0 2024-09-13T18:25:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f71082ae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710015aaf0 con 0x7f71000713a0 2024-09-13T18:25:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f710684b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71000713a0 0x7f7100165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f710604a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f71001582a0 0x7f710006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60452/0 (socket says 172.21.15.53:60452) 2024-09-13T18:25:56.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f710604a640 1 -- 172.21.15.53:0/418376400 learned_addr learned my addr 172.21.15.53:0/418376400 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:25:56.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f710684b640 1 -- 172.21.15.53:0/418376400 >> v1:172.21.15.87:6789/0 conn(0x7f710015b7c0 legacy=0x7f7100070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f710684b640 1 -- 172.21.15.53:0/418376400 >> v1:172.21.15.53:6789/0 conn(0x7f71001582a0 legacy=0x7f710006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.528+0000 7f710684b640 1 -- 172.21.15.53:0/418376400 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710015afc0 con 0x7f71000713a0 2024-09-13T18:25:56.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 --2- 172.21.15.53:0/418376400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71000713a0 0x7f7100165100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009d90 tx=0x7f70f801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3899329dc1303907 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f7105048640 1 -- 172.21.15.53:0/418376400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80a5940 con 0x7f71000713a0 2024-09-13T18:25:56.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f7105048640 1 -- 172.21.15.53:0/418376400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f80a5aa0 con 0x7f71000713a0 2024-09-13T18:25:56.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f7105048640 1 -- 172.21.15.53:0/418376400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80a5e30 con 0x7f71000713a0 2024-09-13T18:25:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- 172.21.15.53:0/418376400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71000713a0 msgr2=0x7f7100165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 --2- 172.21.15.53:0/418376400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71000713a0 0x7f7100165100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009d90 tx=0x7f70f801c970 comp rx=0 tx=0).stop 2024-09-13T18:25:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- 172.21.15.53:0/418376400 shutdown_connections 2024-09-13T18:25:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 --2- 172.21.15.53:0/418376400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71000713a0 0x7f7100165100 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- 172.21.15.53:0/418376400 >> 172.21.15.53:0/418376400 conn(0x7f7100065c80 msgr2=0x7f7100066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- 172.21.15.53:0/418376400 shutdown_connections 2024-09-13T18:25:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- 172.21.15.53:0/418376400 wait complete. 2024-09-13T18:25:56.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 Processor -- start 2024-09-13T18:25:56.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- start start 2024-09-13T18:25:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71000713a0 0x7f7100140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71001582a0 0x7f710015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710015b7c0 0x7f7100155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001411b0 con 0x7f710015b7c0 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100159210 con 0x7f71000713a0 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f71082ae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71001594f0 con 0x7f71001582a0 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710015b7c0 0x7f7100155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710015b7c0 0x7f7100155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54488/0 (socket says 172.21.15.53:54488) 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 -- 172.21.15.53:0/2023624512 learned_addr learned my addr 172.21.15.53:0/2023624512 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f7105849640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71001582a0 0x7f710015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710604a640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71000713a0 0x7f7100140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 -- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71001582a0 msgr2=0x7f710015a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71001582a0 0x7f710015a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 -- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71000713a0 msgr2=0x7f7100140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71000713a0 0x7f7100140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f710684b640 1 -- 172.21.15.53:0/2023624512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8009a70 con 0x7f710015b7c0 2024-09-13T18:25:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.532+0000 7f7105849640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71001582a0 0x7f710015a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f710684b640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710015b7c0 0x7f7100155230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b0040 tx=0x7f70f8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f70f6ffd640 1 -- 172.21.15.53:0/2023624512 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80ade40 con 0x7f710015b7c0 2024-09-13T18:25:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f70f6ffd640 1 -- 172.21.15.53:0/2023624512 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8009450 con 0x7f710015b7c0 2024-09-13T18:25:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71001597d0 con 0x7f710015b7c0 2024-09-13T18:25:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f70f6ffd640 1 -- 172.21.15.53:0/2023624512 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80b9690 con 0x7f710015b7c0 2024-09-13T18:25:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100159d90 con 0x7f710015b7c0 2024-09-13T18:25:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100067400 con 0x7f710015b7c0 2024-09-13T18:25:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f70f6ffd640 1 -- 172.21.15.53:0/2023624512 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70f80b97f0 con 0x7f710015b7c0 2024-09-13T18:25:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f70f6ffd640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f70e4066690 0x7f70e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f70f6ffd640 1 -- 172.21.15.53:0/2023624512 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f70f811faf0 con 0x7f710015b7c0 2024-09-13T18:25:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f710604a640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f70e4066690 0x7f70e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.536+0000 7f710604a640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f70e4066690 0x7f70e4068b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f70fc005890 tx=0x7f70fc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.540+0000 7f70f6ffd640 1 -- 172.21.15.53:0/2023624512 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70f80ed220 con 0x7f710015b7c0 2024-09-13T18:25:56.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7100159f80 con 0x7f710015b7c0 2024-09-13T18:25:56.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f70f6ffd640 1 -- 172.21.15.53:0/2023624512 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f70f80f0840 con 0x7f710015b7c0 2024-09-13T18:25:56.700 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:56.700 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:25:56.701 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:25:56.701 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:25:56.701 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:25:56.701 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:25:56.701 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:25:56.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f70e4066690 msgr2=0x7f70e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f70e4066690 0x7f70e4068b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f70fc005890 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2024-09-13T18:25:56.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710015b7c0 msgr2=0x7f7100155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710015b7c0 0x7f7100155230 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b0040 tx=0x7f70f8019710 comp rx=0 tx=0).stop 2024-09-13T18:25:56.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 shutdown_connections 2024-09-13T18:25:56.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f70e4066690 0x7f70e4068b50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71001582a0 0x7f710015a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f710015b7c0 0x7f7100155230 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 --2- 172.21.15.53:0/2023624512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71000713a0 0x7f7100140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 >> 172.21.15.53:0/2023624512 conn(0x7f7100065c80 msgr2=0x7f71000af110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:56.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 shutdown_connections 2024-09-13T18:25:56.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.696+0000 7f71082ae640 1 -- 172.21.15.53:0/2023624512 wait complete. 2024-09-13T18:25:56.718 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:25:56.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:25:56.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f7dcd640 1 Processor -- start 2024-09-13T18:25:56.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f7dcd640 1 -- start start 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f7dcd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32f015c5e0 0x7f32f015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f7dcd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f32f006ccc0 0x7f32f006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f7dcd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f0070fb0 con 0x7f32f006f370 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f7dcd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f006d620 con 0x7f32f015c5e0 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f7dcd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f015dd30 con 0x7f32f006ccc0 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5b69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32f015c5e0 0x7f32f015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5b69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32f015c5e0 0x7f32f015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58584/0 (socket says 172.21.15.53:58584) 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5b69640 1 -- 172.21.15.53:0/2941551578 learned_addr learned my addr 172.21.15.53:0/2941551578 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5b69640 1 -- 172.21.15.53:0/2941551578 >> v2:172.21.15.87:3300/0 conn(0x7f32f006ccc0 msgr2=0x7f32f006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5368640 1 --2- 172.21.15.53:0/2941551578 >> v2:172.21.15.87:3300/0 conn(0x7f32f006ccc0 0x7f32f006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5b69640 1 --2- 172.21.15.53:0/2941551578 >> v2:172.21.15.87:3300/0 conn(0x7f32f006ccc0 0x7f32f006d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5b69640 1 -- 172.21.15.53:0/2941551578 >> v1:172.21.15.87:6789/0 conn(0x7f32f006f370 legacy=0x7f32f006f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:56.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.832+0000 7f32f5b69640 1 -- 172.21.15.53:0/2941551578 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f00cd810 con 0x7f32f015c5e0 2024-09-13T18:25:56.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f5b69640 1 --2- 172.21.15.53:0/2941551578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f015c5e0 0x7f32f015d7f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f32f00ce3b0 tx=0x7f32e001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60dd1c0d2577ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f4b67640 1 -- 172.21.15.53:0/2941551578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00a5840 con 0x7f32f015c5e0 2024-09-13T18:25:56.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f4b67640 1 -- 172.21.15.53:0/2941551578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e00a59a0 con 0x7f32f015c5e0 2024-09-13T18:25:56.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f4b67640 1 -- 172.21.15.53:0/2941551578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00a5d30 con 0x7f32f015c5e0 2024-09-13T18:25:56.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 -- 172.21.15.53:0/2941551578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f015c5e0 msgr2=0x7f32f015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/2941551578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f015c5e0 0x7f32f015d7f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f32f00ce3b0 tx=0x7f32e001c980 comp rx=0 tx=0).stop 2024-09-13T18:25:56.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 -- 172.21.15.53:0/2941551578 shutdown_connections 2024-09-13T18:25:56.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/2941551578 >> v2:172.21.15.87:3300/0 conn(0x7f32f006ccc0 0x7f32f006d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/2941551578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f015c5e0 0x7f32f015d7f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 -- 172.21.15.53:0/2941551578 >> 172.21.15.53:0/2941551578 conn(0x7f32f0073330 msgr2=0x7f32f0065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:56.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 -- 172.21.15.53:0/2941551578 shutdown_connections 2024-09-13T18:25:56.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 -- 172.21.15.53:0/2941551578 wait complete. 2024-09-13T18:25:56.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 Processor -- start 2024-09-13T18:25:56.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.836+0000 7f32f7dcd640 1 -- start start 2024-09-13T18:25:56.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f006ccc0 0x7f32f0152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32f006f370 0x7f32f015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32f015c5e0 0x7f32f0146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0147580 con 0x7f32f006ccc0 2024-09-13T18:25:56.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0147860 con 0x7f32f015c5e0 2024-09-13T18:25:56.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0147b40 con 0x7f32f006f370 2024-09-13T18:25:56.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f006ccc0 0x7f32f0152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f006ccc0 0x7f32f0152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58590/0 (socket says 172.21.15.53:58590) 2024-09-13T18:25:56.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 -- 172.21.15.53:0/1628465323 learned_addr learned my addr 172.21.15.53:0/1628465323 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:56.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5368640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32f006f370 0x7f32f015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 -- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32f006f370 msgr2=0x7f32f015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32f006f370 0x7f32f015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 -- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32f015c5e0 msgr2=0x7f32f0146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32f015c5e0 0x7f32f0146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 -- 172.21.15.53:0/1628465323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e0009b30 con 0x7f32f006ccc0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5b69640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f006ccc0 0x7f32f0152710 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f32e00af040 tx=0x7f32e0019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32ee7fc640 1 -- 172.21.15.53:0/1628465323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00b8880 con 0x7f32f006ccc0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32ee7fc640 1 -- 172.21.15.53:0/1628465323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e00b8a20 con 0x7f32f006ccc0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f0147e20 con 0x7f32f006ccc0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32ee7fc640 1 -- 172.21.15.53:0/1628465323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00b8dd0 con 0x7f32f006ccc0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f015b3a0 con 0x7f32f006ccc0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f00cc270 con 0x7f32f006ccc0 2024-09-13T18:25:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32ee7fc640 1 -- 172.21.15.53:0/1628465323 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32e00c3460 con 0x7f32f006ccc0 2024-09-13T18:25:56.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32ee7fc640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f32dc066690 0x7f32dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:56.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32ee7fc640 1 -- 172.21.15.53:0/1628465323 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32e011f5d0 con 0x7f32f006ccc0 2024-09-13T18:25:56.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.840+0000 7f32f5368640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f32dc066690 0x7f32dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:56.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.844+0000 7f32f5368640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f32dc066690 0x7f32dc068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32f014a430 tx=0x7f32e4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:56.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:56.844+0000 7f32ee7fc640 1 -- 172.21.15.53:0/1628465323 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32f00cc270 con 0x7f32f006ccc0 2024-09-13T18:25:57.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.008+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f32f00cc270 con 0x7f32f006ccc0 2024-09-13T18:25:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.944+0000 7f32ee7fc640 1 -- 172.21.15.53:0/1628465323 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f32f00cc270 con 0x7f32f006ccc0 2024-09-13T18:25:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:25:57.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f32dc066690 msgr2=0x7f32dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:57.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f32dc066690 0x7f32dc068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32f014a430 tx=0x7f32e4008040 comp rx=0 tx=0).stop 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f006ccc0 msgr2=0x7f32f0152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f006ccc0 0x7f32f0152710 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f32e00af040 tx=0x7f32e0019720 comp rx=0 tx=0).stop 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 shutdown_connections 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f32dc066690 0x7f32dc068b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32f006f370 0x7f32f015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32f015c5e0 0x7f32f0146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 --2- 172.21.15.53:0/1628465323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32f006ccc0 0x7f32f0152710 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 >> 172.21.15.53:0/1628465323 conn(0x7f32f0073330 msgr2=0x7f32f0158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:57.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 shutdown_connections 2024-09-13T18:25:57.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:57.948+0000 7f32f7dcd640 1 -- 172.21.15.53:0/1628465323 wait complete. 2024-09-13T18:25:57.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:25:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec2a9d8640 1 Processor -- start 2024-09-13T18:25:58.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec2a9d8640 1 -- start start 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec2a9d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec24071c40 0x7fec240cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec2a9d8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240cecf0 con 0x7fec240cde90 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec2a9d8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec24072020 con 0x7fec2415aa80 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec2a9d8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2415e2a0 con 0x7fec24071c40 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec23fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec24071c40 0x7fec240cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec23fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec24071c40 0x7fec240cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58598/0 (socket says 172.21.15.53:58598) 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec23fff640 1 -- 172.21.15.53:0/1583331286 learned_addr learned my addr 172.21.15.53:0/1583331286 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:58.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec237fe640 1 --1- 172.21.15.53:0/1583331286 >> v1:172.21.15.53:6789/0 conn(0x7fec240cde90 0x7fec2415e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60770/0 (socket says 172.21.15.53:60770) 2024-09-13T18:25:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec23fff640 1 -- 172.21.15.53:0/1583331286 >> v1:172.21.15.87:6789/0 conn(0x7fec2415aa80 legacy=0x7fec240b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec23fff640 1 -- 172.21.15.53:0/1583331286 >> v1:172.21.15.53:6789/0 conn(0x7fec240cde90 legacy=0x7fec2415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:58.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.112+0000 7fec23fff640 1 -- 172.21.15.53:0/1583331286 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240ce450 con 0x7fec24071c40 2024-09-13T18:25:58.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec23fff640 1 --2- 172.21.15.53:0/1583331286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec24071c40 0x7fec240cc320 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fec140098a0 tx=0x7fec1401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfe1573dc706426 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec22ffd640 1 -- 172.21.15.53:0/1583331286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ab600 con 0x7fec24071c40 2024-09-13T18:25:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec22ffd640 1 -- 172.21.15.53:0/1583331286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec140a7050 con 0x7fec24071c40 2024-09-13T18:25:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec22ffd640 1 -- 172.21.15.53:0/1583331286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ab980 con 0x7fec24071c40 2024-09-13T18:25:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec2a9d8640 1 -- 172.21.15.53:0/1583331286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec24071c40 msgr2=0x7fec240cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/1583331286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec24071c40 0x7fec240cc320 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fec140098a0 tx=0x7fec1401c3b0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec2a9d8640 1 -- 172.21.15.53:0/1583331286 shutdown_connections 2024-09-13T18:25:58.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/1583331286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec24071c40 0x7fec240cc320 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec2a9d8640 1 -- 172.21.15.53:0/1583331286 >> 172.21.15.53:0/1583331286 conn(0x7fec24069f50 msgr2=0x7fec2406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec2a9d8640 1 -- 172.21.15.53:0/1583331286 shutdown_connections 2024-09-13T18:25:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.116+0000 7fec2a9d8640 1 -- 172.21.15.53:0/1583331286 wait complete. 2024-09-13T18:25:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 Processor -- start 2024-09-13T18:25:58.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 -- start start 2024-09-13T18:25:58.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec24071c40 0x7fec241564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec240cde90 0x7fec24150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2415aa80 0x7fec240b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24150d70 con 0x7fec2415aa80 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24156050 con 0x7fec24071c40 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240b3be0 con 0x7fec240cde90 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2415aa80 0x7fec240b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2415aa80 0x7fec240b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58606/0 (socket says 172.21.15.53:58606) 2024-09-13T18:25:58.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 -- 172.21.15.53:0/3744998848 learned_addr learned my addr 172.21.15.53:0/3744998848 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec23fff640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec24071c40 0x7fec241564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec237fe640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec240cde90 0x7fec24150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 -- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec240cde90 msgr2=0x7fec24150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec240cde90 0x7fec24150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 -- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec24071c40 msgr2=0x7fec241564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec24071c40 0x7fec241564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 -- 172.21.15.53:0/3744998848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140094d0 con 0x7fec2415aa80 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec23fff640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec24071c40 0x7fec241564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec237fe640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec240cde90 0x7fec24150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec28f75640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2415aa80 0x7fec240b3120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00b970 tx=0x7fec1c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec20ff9640 1 -- 172.21.15.53:0/3744998848 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00cb40 con 0x7fec2415aa80 2024-09-13T18:25:58.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec20ff9640 1 -- 172.21.15.53:0/3744998848 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c00cca0 con 0x7fec2415aa80 2024-09-13T18:25:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec24155720 con 0x7fec2415aa80 2024-09-13T18:25:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec20ff9640 1 -- 172.21.15.53:0/3744998848 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c014680 con 0x7fec2415aa80 2024-09-13T18:25:58.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec24155ce0 con 0x7fec2415aa80 2024-09-13T18:25:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.120+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec24073540 con 0x7fec2415aa80 2024-09-13T18:25:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.124+0000 7fec20ff9640 1 -- 172.21.15.53:0/3744998848 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec1c003980 con 0x7fec2415aa80 2024-09-13T18:25:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.124+0000 7fec20ff9640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec10066690 0x7fec10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.124+0000 7fec20ff9640 1 -- 172.21.15.53:0/3744998848 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fec1c084190 con 0x7fec2415aa80 2024-09-13T18:25:58.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.124+0000 7fec23fff640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec10066690 0x7fec10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:58.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.124+0000 7fec23fff640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec10066690 0x7fec10068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec140ad000 tx=0x7fec140a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:58.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.128+0000 7fec20ff9640 1 -- 172.21.15.53:0/3744998848 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec1c0516c0 con 0x7fec2415aa80 2024-09-13T18:25:58.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.292+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fec241561c0 con 0x7fec2415aa80 2024-09-13T18:25:58.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.956+0000 7fec20ff9640 1 -- 172.21.15.53:0/3744998848 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fec1c0190d0 con 0x7fec2415aa80 2024-09-13T18:25:58.962 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:25:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec10066690 msgr2=0x7fec10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec10066690 0x7fec10068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec140ad000 tx=0x7fec140a6000 comp rx=0 tx=0).stop 2024-09-13T18:25:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2415aa80 msgr2=0x7fec240b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2415aa80 0x7fec240b3120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00b970 tx=0x7fec1c00be30 comp rx=0 tx=0).stop 2024-09-13T18:25:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 shutdown_connections 2024-09-13T18:25:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec10066690 0x7fec10068b50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec240cde90 0x7fec24150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2415aa80 0x7fec240b3120 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 --2- 172.21.15.53:0/3744998848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec24071c40 0x7fec241564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 >> 172.21.15.53:0/3744998848 conn(0x7fec24069f50 msgr2=0x7fec240b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 shutdown_connections 2024-09-13T18:25:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:58.964+0000 7fec2a9d8640 1 -- 172.21.15.53:0/3744998848 wait complete. 2024-09-13T18:25:59.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:25:59.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 Processor -- start 2024-09-13T18:25:59.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 -- start start 2024-09-13T18:25:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01d8070610 0x7f01d80b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80709f0 0x7f01d80b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f01d80b2cf0 0x7f01d806c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d80af260 con 0x7f01d8070610 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d80b4cb0 con 0x7f01d80b2cf0 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01e0420640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80b3470 con 0x7f01d80709f0 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01d8070610 0x7f01d80b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f01d8070610 0x7f01d80b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58608/0 (socket says 172.21.15.53:58608) 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 -- 172.21.15.53:0/1063991482 learned_addr learned my addr 172.21.15.53:0/1063991482 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01dd9bb640 1 --2- 172.21.15.53:0/1063991482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80709f0 0x7f01d80b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de9bd640 1 --2- 172.21.15.53:0/1063991482 >> v2:172.21.15.87:3300/0 conn(0x7f01d80b2cf0 0x7f01d806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 -- 172.21.15.53:0/1063991482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80709f0 msgr2=0x7f01d80b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 --2- 172.21.15.53:0/1063991482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80709f0 0x7f01d80b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 -- 172.21.15.53:0/1063991482 >> v2:172.21.15.87:3300/0 conn(0x7f01d80b2cf0 msgr2=0x7f01d806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 --2- 172.21.15.53:0/1063991482 >> v2:172.21.15.87:3300/0 conn(0x7f01d80b2cf0 0x7f01d806c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de1bc640 1 -- 172.21.15.53:0/1063991482 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80b3c90 con 0x7f01d8070610 2024-09-13T18:25:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.120+0000 7f01de9bd640 1 --2- 172.21.15.53:0/1063991482 >> v2:172.21.15.87:3300/0 conn(0x7f01d80b2cf0 0x7f01d806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01de1bc640 1 --2- 172.21.15.53:0/1063991482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d80b4770 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f01d815df00 tx=0x7f01d401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4ec73394b6433b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01dd1ba640 1 -- 172.21.15.53:0/1063991482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40ab670 con 0x7f01d8070610 2024-09-13T18:25:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01dd1ba640 1 -- 172.21.15.53:0/1063991482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d40ab7d0 con 0x7f01d8070610 2024-09-13T18:25:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01dd1ba640 1 -- 172.21.15.53:0/1063991482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40abb60 con 0x7f01d8070610 2024-09-13T18:25:59.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 -- 172.21.15.53:0/1063991482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 msgr2=0x7f01d80b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 --2- 172.21.15.53:0/1063991482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d80b4770 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f01d815df00 tx=0x7f01d401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 -- 172.21.15.53:0/1063991482 shutdown_connections 2024-09-13T18:25:59.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 --2- 172.21.15.53:0/1063991482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80709f0 0x7f01d80b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 --2- 172.21.15.53:0/1063991482 >> v2:172.21.15.87:3300/0 conn(0x7f01d80b2cf0 0x7f01d806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 --2- 172.21.15.53:0/1063991482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d80b4770 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 -- 172.21.15.53:0/1063991482 >> 172.21.15.53:0/1063991482 conn(0x7f01d8069f50 msgr2=0x7f01d806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:59.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 -- 172.21.15.53:0/1063991482 shutdown_connections 2024-09-13T18:25:59.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 -- 172.21.15.53:0/1063991482 wait complete. 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 Processor -- start 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.124+0000 7f01e0420640 1 -- start start 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d8141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01d80709f0 0x7f01d813e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80b2cf0 0x7f01d81627a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8141200 con 0x7f01d8070610 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8141b60 con 0x7f01d80709f0 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8140b70 con 0x7f01d80b2cf0 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d8141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d8141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58610/0 (socket says 172.21.15.53:58610) 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 -- 172.21.15.53:0/4275438917 learned_addr learned my addr 172.21.15.53:0/4275438917 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01dd9bb640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01d80709f0 0x7f01d813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de9bd640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80b2cf0 0x7f01d81627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 -- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80b2cf0 msgr2=0x7f01d81627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80b2cf0 0x7f01d81627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 -- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01d80709f0 msgr2=0x7f01d813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01d80709f0 0x7f01d813e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 -- 172.21.15.53:0/4275438917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d40094d0 con 0x7f01d8070610 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01dd9bb640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01d80709f0 0x7f01d813e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01de1bc640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d8141620 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f01d401cd90 tx=0x7f01d401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01ceffd640 1 -- 172.21.15.53:0/4275438917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40b4800 con 0x7f01d8070610 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01ceffd640 1 -- 172.21.15.53:0/4275438917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d40b4980 con 0x7f01d8070610 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d8163080 con 0x7f01d8070610 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01ceffd640 1 -- 172.21.15.53:0/4275438917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40b4d30 con 0x7f01d8070610 2024-09-13T18:25:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d8140e20 con 0x7f01d8070610 2024-09-13T18:25:59.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8141340 con 0x7f01d8070610 2024-09-13T18:25:59.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01ceffd640 1 -- 172.21.15.53:0/4275438917 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01d40c7440 con 0x7f01d8070610 2024-09-13T18:25:59.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01ceffd640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f01bc0666c0 0x7f01bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.128+0000 7f01ceffd640 1 -- 172.21.15.53:0/4275438917 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f01d411eeb0 con 0x7f01d8070610 2024-09-13T18:25:59.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.132+0000 7f01dd9bb640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f01bc0666c0 0x7f01bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.132+0000 7f01dd9bb640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f01bc0666c0 0x7f01bc068b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01c8004660 tx=0x7f01c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.132+0000 7f01ceffd640 1 -- 172.21.15.53:0/4275438917 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f01d40ec2f0 con 0x7f01d8070610 2024-09-13T18:25:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.328+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f01d8141340 con 0x7f01d8070610 2024-09-13T18:25:59.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.336+0000 7f01ceffd640 1 -- 172.21.15.53:0/4275438917 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f01d8141340 con 0x7f01d8070610 2024-09-13T18:25:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 4 and data pool 5 2024-09-13T18:25:59.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f01bc0666c0 msgr2=0x7f01bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f01bc0666c0 0x7f01bc068b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01c8004660 tx=0x7f01c8008040 comp rx=0 tx=0).stop 2024-09-13T18:25:59.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 msgr2=0x7f01d8141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d8141620 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f01d401cd90 tx=0x7f01d401ad30 comp rx=0 tx=0).stop 2024-09-13T18:25:59.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 shutdown_connections 2024-09-13T18:25:59.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f01bc0666c0 0x7f01bc068b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01d80b2cf0 0x7f01d81627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01d80709f0 0x7f01d813e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 --2- 172.21.15.53:0/4275438917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01d8070610 0x7f01d8141620 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 >> 172.21.15.53:0/4275438917 conn(0x7f01d8069f50 msgr2=0x7f01d815cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:59.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 shutdown_connections 2024-09-13T18:25:59.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.344+0000 7f01e0420640 1 -- 172.21.15.53:0/4275438917 wait complete. 2024-09-13T18:25:59.383 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:59.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.492+0000 7f8945a16640 1 Processor -- start 2024-09-13T18:25:59.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.492+0000 7f8945a16640 1 -- start start 2024-09-13T18:25:59.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f8945a16640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f894015a620 0x7f89400cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f8945a16640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8940066760 0x7f89400ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f8945a16640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89400b4bf0 0x7f89400b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f8945a16640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89400b5540 con 0x7f8940066760 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f8945a16640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89400cf270 con 0x7f894015a620 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f8945a16640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400cf550 con 0x7f89400b4bf0 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8940066760 0x7f89400ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8940066760 0x7f89400ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58622/0 (socket says 172.21.15.53:58622) 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 -- 172.21.15.53:0/364864855 learned_addr learned my addr 172.21.15.53:0/364864855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893f7fe640 1 --2- 172.21.15.53:0/364864855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89400b4bf0 0x7f89400b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893effd640 1 --2- 172.21.15.53:0/364864855 >> v2:172.21.15.87:3300/0 conn(0x7f894015a620 0x7f89400cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 -- 172.21.15.53:0/364864855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89400b4bf0 msgr2=0x7f89400b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 --2- 172.21.15.53:0/364864855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89400b4bf0 0x7f89400b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 -- 172.21.15.53:0/364864855 >> v2:172.21.15.87:3300/0 conn(0x7f894015a620 msgr2=0x7f89400cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 --2- 172.21.15.53:0/364864855 >> v2:172.21.15.87:3300/0 conn(0x7f894015a620 0x7f89400cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 -- 172.21.15.53:0/364864855 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940065c80 con 0x7f8940066760 2024-09-13T18:25:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893e7fc640 1 --2- 172.21.15.53:0/364864855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8940066760 0x7f89400ce940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8940070320 tx=0x7f892801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e613841cfe42c585 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893dffb640 1 -- 172.21.15.53:0/364864855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89280aa610 con 0x7f8940066760 2024-09-13T18:25:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893dffb640 1 -- 172.21.15.53:0/364864855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89280a6040 con 0x7f8940066760 2024-09-13T18:25:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.496+0000 7f893dffb640 1 -- 172.21.15.53:0/364864855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89280aa990 con 0x7f8940066760 2024-09-13T18:25:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- 172.21.15.53:0/364864855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8940066760 msgr2=0x7f89400ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 --2- 172.21.15.53:0/364864855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8940066760 0x7f89400ce940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8940070320 tx=0x7f892801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- 172.21.15.53:0/364864855 shutdown_connections 2024-09-13T18:25:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 --2- 172.21.15.53:0/364864855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89400b4bf0 0x7f89400b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 --2- 172.21.15.53:0/364864855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8940066760 0x7f89400ce940 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 --2- 172.21.15.53:0/364864855 >> v2:172.21.15.87:3300/0 conn(0x7f894015a620 0x7f89400cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- 172.21.15.53:0/364864855 >> 172.21.15.53:0/364864855 conn(0x7f8940069f50 msgr2=0x7f894006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- 172.21.15.53:0/364864855 shutdown_connections 2024-09-13T18:25:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- 172.21.15.53:0/364864855 wait complete. 2024-09-13T18:25:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 Processor -- start 2024-09-13T18:25:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- start start 2024-09-13T18:25:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8940066760 0x7f894013e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89400b4bf0 0x7f8940162670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894015a620 0x7f8940162bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400b2b60 con 0x7f89400b4bf0 2024-09-13T18:25:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8940164800 con 0x7f8940066760 2024-09-13T18:25:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8945a16640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8940164ae0 con 0x7f894015a620 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89400b4bf0 0x7f8940162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89400b4bf0 0x7f8940162670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58626/0 (socket says 172.21.15.53:58626) 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 -- 172.21.15.53:0/2165223024 learned_addr learned my addr 172.21.15.53:0/2165223024 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893effd640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8940066760 0x7f894013e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893f7fe640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894015a620 0x7f8940162bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 -- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894015a620 msgr2=0x7f8940162bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894015a620 0x7f8940162bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 -- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8940066760 msgr2=0x7f894013e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8940066760 0x7f894013e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 -- 172.21.15.53:0/2165223024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280094d0 con 0x7f89400b4bf0 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f893e7fc640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89400b4bf0 0x7f8940162670 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f892801aba0 tx=0x7f892801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8937fff640 1 -- 172.21.15.53:0/2165223024 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89280bd5f0 con 0x7f89400b4bf0 2024-09-13T18:25:59.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8937fff640 1 -- 172.21.15.53:0/2165223024 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89280bd750 con 0x7f89400b4bf0 2024-09-13T18:25:59.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.500+0000 7f8937fff640 1 -- 172.21.15.53:0/2165223024 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89280bdb00 con 0x7f89400b4bf0 2024-09-13T18:25:59.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8940164dc0 con 0x7f89400b4bf0 2024-09-13T18:25:59.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8940164380 con 0x7f89400b4bf0 2024-09-13T18:25:59.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8940164fe0 con 0x7f89400b4bf0 2024-09-13T18:25:59.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f8937fff640 1 -- 172.21.15.53:0/2165223024 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89280b33f0 con 0x7f89400b4bf0 2024-09-13T18:25:59.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f8937fff640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8920066690 0x7f8920068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f8937fff640 1 -- 172.21.15.53:0/2165223024 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f892811ed10 con 0x7f89400b4bf0 2024-09-13T18:25:59.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f893effd640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8920066690 0x7f8920068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.504+0000 7f893effd640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8920066690 0x7f8920068b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8930003fd0 tx=0x7f89300039a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.508+0000 7f8937fff640 1 -- 172.21.15.53:0/2165223024 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89280ec130 con 0x7f89400b4bf0 2024-09-13T18:25:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.664+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8940164570 con 0x7f89400b4bf0 2024-09-13T18:25:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8937fff640 1 -- 172.21.15.53:0/2165223024 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f89280c3090 con 0x7f89400b4bf0 2024-09-13T18:25:59.673 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:59.673 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":33,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:59.335927+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8920066690 msgr2=0x7f8920068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8920066690 0x7f8920068b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8930003fd0 tx=0x7f89300039a0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89400b4bf0 msgr2=0x7f8940162670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89400b4bf0 0x7f8940162670 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f892801aba0 tx=0x7f892801ad30 comp rx=0 tx=0).stop 2024-09-13T18:25:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 shutdown_connections 2024-09-13T18:25:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8920066690 0x7f8920068b50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894015a620 0x7f8940162bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89400b4bf0 0x7f8940162670 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 --2- 172.21.15.53:0/2165223024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8940066760 0x7f894013e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 >> 172.21.15.53:0/2165223024 conn(0x7f8940069f50 msgr2=0x7f894006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 shutdown_connections 2024-09-13T18:25:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.668+0000 7f8945a16640 1 -- 172.21.15.53:0/2165223024 wait complete. 2024-09-13T18:25:59.691 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:25:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.808+0000 7fa208d69640 1 Processor -- start 2024-09-13T18:25:59.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.808+0000 7fa208d69640 1 -- start start 2024-09-13T18:25:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa208d69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2041582a0 0x7fa20406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa208d69640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20406d480 con 0x7fa2040713a0 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa208d69640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20415ace0 con 0x7fa20415b7c0 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa208d69640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20415aaf0 con 0x7fa2041582a0 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2041582a0 0x7fa20406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2041582a0 0x7fa20406c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58634/0 (socket says 172.21.15.53:58634) 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20259c640 1 -- 172.21.15.53:0/1184603557 learned_addr learned my addr 172.21.15.53:0/1184603557 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20259c640 1 -- 172.21.15.53:0/1184603557 >> v1:172.21.15.87:6789/0 conn(0x7fa20415b7c0 legacy=0x7fa204070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20159a640 1 -- 172.21.15.53:0/1184603557 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996947190 0 0) 0x7fa20406d480 con 0x7fa2040713a0 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20259c640 1 -- 172.21.15.53:0/1184603557 >> v1:172.21.15.53:6789/0 conn(0x7fa2040713a0 legacy=0x7fa2041640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20259c640 1 -- 172.21.15.53:0/1184603557 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20415afc0 con 0x7fa2041582a0 2024-09-13T18:25:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20259c640 1 --2- 172.21.15.53:0/1184603557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2041582a0 0x7fa20406c900 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009870 tx=0x7fa1f401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919b7c7427a3b66e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20159a640 1 -- 172.21.15.53:0/1184603557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40ad660 con 0x7fa2041582a0 2024-09-13T18:25:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20159a640 1 -- 172.21.15.53:0/1184603557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f40ad7c0 con 0x7fa2041582a0 2024-09-13T18:25:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.812+0000 7fa20159a640 1 -- 172.21.15.53:0/1184603557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40adb50 con 0x7fa2041582a0 2024-09-13T18:25:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- 172.21.15.53:0/1184603557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2041582a0 msgr2=0x7fa20406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 --2- 172.21.15.53:0/1184603557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2041582a0 0x7fa20406c900 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009870 tx=0x7fa1f401c560 comp rx=0 tx=0).stop 2024-09-13T18:25:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- 172.21.15.53:0/1184603557 shutdown_connections 2024-09-13T18:25:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 --2- 172.21.15.53:0/1184603557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2041582a0 0x7fa20406c900 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- 172.21.15.53:0/1184603557 >> 172.21.15.53:0/1184603557 conn(0x7fa204065c80 msgr2=0x7fa204066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- 172.21.15.53:0/1184603557 shutdown_connections 2024-09-13T18:25:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- 172.21.15.53:0/1184603557 wait complete. 2024-09-13T18:25:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 Processor -- start 2024-09-13T18:25:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- start start 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2040713a0 0x7fa204146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2041582a0 0x7fa2041f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20415b7c0 0x7fa2040ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20414e400 con 0x7fa20415b7c0 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20414e660 con 0x7fa2040713a0 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2041f9ee0 con 0x7fa2041582a0 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20415b7c0 0x7fa2040ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20415b7c0 0x7fa2040ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58638/0 (socket says 172.21.15.53:58638) 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 -- 172.21.15.53:0/3301752297 learned_addr learned my addr 172.21.15.53:0/3301752297 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 -- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2041582a0 msgr2=0x7fa2041f9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa20259c640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2040713a0 0x7fa204146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa201d9b640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2041582a0 0x7fa2041f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2041582a0 0x7fa2041f9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 -- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2040713a0 msgr2=0x7fa204146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2040713a0 0x7fa204146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 -- 172.21.15.53:0/3301752297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40094d0 con 0x7fa20415b7c0 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa201d9b640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2041582a0 0x7fa2041f9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa20259c640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2040713a0 0x7fa204146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa202d9d640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20415b7c0 0x7fa2040ac8e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c750 tx=0x7fa1fc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa1f2ffd640 1 -- 172.21.15.53:0/3301752297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc003db0 con 0x7fa20415b7c0 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa1f2ffd640 1 -- 172.21.15.53:0/3301752297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00ce60 con 0x7fa20415b7c0 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2041fa1c0 con 0x7fa20415b7c0 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa1f2ffd640 1 -- 172.21.15.53:0/3301752297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0052b0 con 0x7fa20415b7c0 2024-09-13T18:25:59.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.816+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa204152690 con 0x7fa20415b7c0 2024-09-13T18:25:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.820+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa204067400 con 0x7fa20415b7c0 2024-09-13T18:25:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.820+0000 7fa1f2ffd640 1 -- 172.21.15.53:0/3301752297 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1fc005410 con 0x7fa20415b7c0 2024-09-13T18:25:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.820+0000 7fa1f2ffd640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1e40666c0 0x7fa1e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.820+0000 7fa1f2ffd640 1 -- 172.21.15.53:0/3301752297 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1fc0840a0 con 0x7fa20415b7c0 2024-09-13T18:25:59.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.820+0000 7fa20259c640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1e40666c0 0x7fa1e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.820+0000 7fa20259c640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1e40666c0 0x7fa1e4068b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40af000 tx=0x7fa1f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.824+0000 7fa1f2ffd640 1 -- 172.21.15.53:0/3301752297 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1fc051370 con 0x7fa20415b7c0 2024-09-13T18:25:59.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.983+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa20406c900 con 0x7fa20415b7c0 2024-09-13T18:25:59.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa1f2ffd640 1 -- 172.21.15.53:0/3301752297 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16522 (secure 0 0 0) 0x7fa1fc054990 con 0x7fa20415b7c0 2024-09-13T18:25:59.992 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:25:59.992 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":33,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:25:59.335927+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1e40666c0 msgr2=0x7fa1e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1e40666c0 0x7fa1e4068b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40af000 tx=0x7fa1f4008040 comp rx=0 tx=0).stop 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20415b7c0 msgr2=0x7fa2040ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20415b7c0 0x7fa2040ac8e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c750 tx=0x7fa1fc00cc10 comp rx=0 tx=0).stop 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 shutdown_connections 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1e40666c0 0x7fa1e4068b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2041582a0 0x7fa2041f9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20415b7c0 0x7fa2040ac8e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 --2- 172.21.15.53:0/3301752297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2040713a0 0x7fa204146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 >> 172.21.15.53:0/3301752297 conn(0x7fa204065c80 msgr2=0x7fa204153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:59.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 shutdown_connections 2024-09-13T18:25:59.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:25:59.987+0000 7fa208d69640 1 -- 172.21.15.53:0/3301752297 wait complete. 2024-09-13T18:26:00.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:26:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6592ba6640 1 Processor -- start 2024-09-13T18:26:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6592ba6640 1 -- start start 2024-09-13T18:26:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6592ba6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f658c15b470 0x7f658c0abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6592ba6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f658c0ac2e0 0x7f658c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6592ba6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c06c980 con 0x7f658c154a50 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6592ba6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0ac770 con 0x7f658c15b470 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6592ba6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c06bd70 con 0x7f658c0ac2e0 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f658bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f658c15b470 0x7f658c0abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6590942640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f658c154a50 0x7f658c06ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60782/0 (socket says 172.21.15.53:60782) 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6590942640 1 -- 172.21.15.53:0/373188587 learned_addr learned my addr 172.21.15.53:0/373188587 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f6591143640 1 --2- 172.21.15.53:0/373188587 >> v2:172.21.15.87:3300/0 conn(0x7f658c0ac2e0 0x7f658c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f658bfff640 1 -- 172.21.15.53:0/373188587 >> v2:172.21.15.87:3300/0 conn(0x7f658c0ac2e0 msgr2=0x7f658c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f658bfff640 1 --2- 172.21.15.53:0/373188587 >> v2:172.21.15.87:3300/0 conn(0x7f658c0ac2e0 0x7f658c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f658bfff640 1 -- 172.21.15.53:0/373188587 >> v1:172.21.15.53:6789/0 conn(0x7f658c154a50 legacy=0x7f658c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f658bfff640 1 -- 172.21.15.53:0/373188587 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c06c050 con 0x7f658c15b470 2024-09-13T18:26:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.119+0000 7f658b7fe640 1 -- 172.21.15.53:0/373188587 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014498311 0 0) 0x7f658c06c980 con 0x7f658c154a50 2024-09-13T18:26:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f658bfff640 1 --2- 172.21.15.53:0/373188587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c0abda0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f658c073080 tx=0x7f658001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb36425b81bdb15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f658b7fe640 1 -- 172.21.15.53:0/373188587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800a59c0 con 0x7f658c15b470 2024-09-13T18:26:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f658b7fe640 1 -- 172.21.15.53:0/373188587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800a5b20 con 0x7f658c15b470 2024-09-13T18:26:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f658b7fe640 1 -- 172.21.15.53:0/373188587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800ad440 con 0x7f658c15b470 2024-09-13T18:26:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 -- 172.21.15.53:0/373188587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 msgr2=0x7f658c0abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 --2- 172.21.15.53:0/373188587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c0abda0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f658c073080 tx=0x7f658001c900 comp rx=0 tx=0).stop 2024-09-13T18:26:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 -- 172.21.15.53:0/373188587 shutdown_connections 2024-09-13T18:26:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 --2- 172.21.15.53:0/373188587 >> v2:172.21.15.87:3300/0 conn(0x7f658c0ac2e0 0x7f658c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 --2- 172.21.15.53:0/373188587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c0abda0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 -- 172.21.15.53:0/373188587 >> 172.21.15.53:0/373188587 conn(0x7f658c069f50 msgr2=0x7f658c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:00.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 -- 172.21.15.53:0/373188587 shutdown_connections 2024-09-13T18:26:00.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 -- 172.21.15.53:0/373188587 wait complete. 2024-09-13T18:26:00.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.123+0000 7f6592ba6640 1 Processor -- start 2024-09-13T18:26:00.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 -- start start 2024-09-13T18:26:00.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f658c0ac2e0 0x7f658c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f658c154a50 0x7f658c0711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c070f70 con 0x7f658c15b470 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0709f0 con 0x7f658c0ac2e0 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0cb270 con 0x7f658c154a50 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58648/0 (socket says 172.21.15.53:58648) 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 -- 172.21.15.53:0/433939010 learned_addr learned my addr 172.21.15.53:0/433939010 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6590942640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f658c0ac2e0 0x7f658c150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f658bfff640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f658c154a50 0x7f658c0711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 -- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f658c154a50 msgr2=0x7f658c0711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f658c154a50 0x7f658c0711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 -- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f658c0ac2e0 msgr2=0x7f658c150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f658c0ac2e0 0x7f658c150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 -- 172.21.15.53:0/433939010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009a70 con 0x7f658c15b470 2024-09-13T18:26:00.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6591143640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c071720 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f658400d560 tx=0x7f658400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:00.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f65897fa640 1 -- 172.21.15.53:0/433939010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840125f0 con 0x7f658c15b470 2024-09-13T18:26:00.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f65897fa640 1 -- 172.21.15.53:0/433939010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584012770 con 0x7f658c15b470 2024-09-13T18:26:00.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c070c90 con 0x7f658c15b470 2024-09-13T18:26:00.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f65897fa640 1 -- 172.21.15.53:0/433939010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584012b20 con 0x7f658c15b470 2024-09-13T18:26:00.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c099ef0 con 0x7f658c15b470 2024-09-13T18:26:00.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c099a70 con 0x7f658c15b470 2024-09-13T18:26:00.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f65897fa640 1 -- 172.21.15.53:0/433939010 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6584012c80 con 0x7f658c15b470 2024-09-13T18:26:00.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f65897fa640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6578066690 0x7f6578068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f65897fa640 1 -- 172.21.15.53:0/433939010 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6584084f50 con 0x7f658c15b470 2024-09-13T18:26:00.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.127+0000 7f6590942640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6578066690 0x7f6578068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.131+0000 7f6590942640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6578066690 0x7f6578068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f657c000f70 tx=0x7f657c007b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:00.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.135+0000 7f65897fa640 1 -- 172.21.15.53:0/433939010 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65840523a0 con 0x7f658c15b470 2024-09-13T18:26:00.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.323+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f658c099a70 con 0x7f658c15b470 2024-09-13T18:26:00.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.335+0000 7f65897fa640 1 -- 172.21.15.53:0/433939010 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f658c099a70 con 0x7f658c15b470 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6578066690 msgr2=0x7f6578068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6578066690 0x7f6578068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f657c000f70 tx=0x7f657c007b60 comp rx=0 tx=0).stop 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 msgr2=0x7f658c071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c071720 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f658400d560 tx=0x7f658400da20 comp rx=0 tx=0).stop 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 shutdown_connections 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6578066690 0x7f6578068b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f658c154a50 0x7f658c0711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f658c15b470 0x7f658c071720 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 --2- 172.21.15.53:0/433939010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f658c0ac2e0 0x7f658c150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 >> 172.21.15.53:0/433939010 conn(0x7f658c069f50 msgr2=0x7f658c15c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 shutdown_connections 2024-09-13T18:26:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.339+0000 7f6592ba6640 1 -- 172.21.15.53:0/433939010 wait complete. 2024-09-13T18:26:00.367 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:26:00.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:26:00.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.479+0000 7f4eafec0640 1 Processor -- start 2024-09-13T18:26:00.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.479+0000 7f4eafec0640 1 -- start start 2024-09-13T18:26:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eafec0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea815c830 0x7f4ea80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eafec0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ea80ccd10 0x7f4ea80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eafec0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea80b7db0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eafec0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80d0650 con 0x7f4ea80ccd10 2024-09-13T18:26:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eafec0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80d0c10 con 0x7f4ea815c830 2024-09-13T18:26:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4ead45b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ea80ccd10 0x7f4ea80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eae45d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4ea80d2c80 0x7f4ea80b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60794/0 (socket says 172.21.15.53:60794) 2024-09-13T18:26:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eae45d640 1 -- 172.21.15.53:0/1776755820 learned_addr learned my addr 172.21.15.53:0/1776755820 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eadc5c640 1 --2- 172.21.15.53:0/1776755820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea815c830 0x7f4ea80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4ead45b640 1 -- 172.21.15.53:0/1776755820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea815c830 msgr2=0x7f4ea80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4ead45b640 1 --2- 172.21.15.53:0/1776755820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea815c830 0x7f4ea80d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4ead45b640 1 -- 172.21.15.53:0/1776755820 >> v1:172.21.15.53:6789/0 conn(0x7f4ea80d2c80 legacy=0x7f4ea80b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4ead45b640 1 -- 172.21.15.53:0/1776755820 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80cd7d0 con 0x7f4ea80ccd10 2024-09-13T18:26:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eacc5a640 1 -- 172.21.15.53:0/1776755820 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780661129 0 0) 0x7f4ea80b7db0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4ead45b640 1 --2- 172.21.15.53:0/1776755820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80ccd10 0x7f4ea80cd150 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40097c0 tx=0x7f4ea401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14969b950553f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:00.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eacc5a640 1 -- 172.21.15.53:0/1776755820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40ab600 con 0x7f4ea80ccd10 2024-09-13T18:26:00.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eacc5a640 1 -- 172.21.15.53:0/1776755820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea40a7050 con 0x7f4ea80ccd10 2024-09-13T18:26:00.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.483+0000 7f4eacc5a640 1 -- 172.21.15.53:0/1776755820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40ab980 con 0x7f4ea80ccd10 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- 172.21.15.53:0/1776755820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80ccd10 msgr2=0x7f4ea80cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 --2- 172.21.15.53:0/1776755820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80ccd10 0x7f4ea80cd150 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40097c0 tx=0x7f4ea401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- 172.21.15.53:0/1776755820 shutdown_connections 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 --2- 172.21.15.53:0/1776755820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80ccd10 0x7f4ea80cd150 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 --2- 172.21.15.53:0/1776755820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea815c830 0x7f4ea80d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- 172.21.15.53:0/1776755820 >> 172.21.15.53:0/1776755820 conn(0x7f4ea8070970 msgr2=0x7f4ea8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- 172.21.15.53:0/1776755820 shutdown_connections 2024-09-13T18:26:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- 172.21.15.53:0/1776755820 wait complete. 2024-09-13T18:26:00.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 Processor -- start 2024-09-13T18:26:00.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- start start 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea80ccd10 0x7f4ea81579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80d2c80 0x7f4ea814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea815c830 0x7f4ea815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8157560 con 0x7f4ea80d2c80 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8156c30 con 0x7f4ea815c830 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8156f10 con 0x7f4ea80ccd10 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4ead45b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80d2c80 0x7f4ea814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eadc5c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea80ccd10 0x7f4ea81579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eadc5c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea80ccd10 0x7f4ea81579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:60188/0 (socket says 172.21.15.53:60188) 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eadc5c640 1 -- 172.21.15.53:0/2790372678 learned_addr learned my addr 172.21.15.53:0/2790372678 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eae45d640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea815c830 0x7f4ea815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4ead45b640 1 -- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea80ccd10 msgr2=0x7f4ea81579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4ead45b640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea80ccd10 0x7f4ea81579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4ead45b640 1 -- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea815c830 msgr2=0x7f4ea815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4ead45b640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea815c830 0x7f4ea815b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4ead45b640 1 -- 172.21.15.53:0/2790372678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea4009420 con 0x7f4ea80d2c80 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4ead45b640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80d2c80 0x7f4ea814dd60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40ab000 tx=0x7f4ea401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4e9a7fc640 1 -- 172.21.15.53:0/2790372678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40b7650 con 0x7f4ea80d2c80 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4e9a7fc640 1 -- 172.21.15.53:0/2790372678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea40b77f0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea81571f0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4e9a7fc640 1 -- 172.21.15.53:0/2790372678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40b7ba0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.487+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea814e7b0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.491+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea80d1080 con 0x7f4ea80d2c80 2024-09-13T18:26:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.491+0000 7f4e9a7fc640 1 -- 172.21.15.53:0/2790372678 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ea40b7d00 con 0x7f4ea80d2c80 2024-09-13T18:26:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.491+0000 7f4e9a7fc640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4e8c066690 0x7f4e8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.491+0000 7f4e9a7fc640 1 -- 172.21.15.53:0/2790372678 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ea411e8a0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.491+0000 7f4eadc5c640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4e8c066690 0x7f4e8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:00.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.491+0000 7f4eadc5c640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4e8c066690 0x7f4e8c068b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80cd500 tx=0x7f4e9c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:00.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.495+0000 7f4e9a7fc640 1 -- 172.21.15.53:0/2790372678 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ea40ebcc0 con 0x7f4ea80d2c80 2024-09-13T18:26:00.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:00.679+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4ea80c9550 con 0x7f4ea80d2c80 2024-09-13T18:26:01.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.347+0000 7f4e9a7fc640 1 -- 172.21.15.53:0/2790372678 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4ea40ef2e0 con 0x7f4ea80d2c80 2024-09-13T18:26:01.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4e8c066690 msgr2=0x7f4e8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4e8c066690 0x7f4e8c068b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80cd500 tx=0x7f4e9c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80d2c80 msgr2=0x7f4ea814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80d2c80 0x7f4ea814dd60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40ab000 tx=0x7f4ea401ace0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 shutdown_connections 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4e8c066690 0x7f4e8c068b50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea815c830 0x7f4ea815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ea80d2c80 0x7f4ea814dd60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 --2- 172.21.15.53:0/2790372678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ea80ccd10 0x7f4ea81579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 >> 172.21.15.53:0/2790372678 conn(0x7f4ea8070970 msgr2=0x7f4ea814c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:01.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 shutdown_connections 2024-09-13T18:26:01.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.351+0000 7f4eafec0640 1 -- 172.21.15.53:0/2790372678 wait complete. 2024-09-13T18:26:01.381 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:26:01.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:01.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.507+0000 7f9585099640 1 Processor -- start 2024-09-13T18:26:01.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.507+0000 7f9585099640 1 -- start start 2024-09-13T18:26:01.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95801582a0 0x7f958006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f958015b7c0 0x7f958006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9580070c90 0x7f9580071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958015aaf0 con 0x7f95801582a0 2024-09-13T18:26:01.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958006d760 con 0x7f958015b7c0 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9580071650 con 0x7f9580070c90 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95801582a0 0x7f958006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95801582a0 0x7f958006c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58666/0 (socket says 172.21.15.53:58666) 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 -- 172.21.15.53:0/2602661548 learned_addr learned my addr 172.21.15.53:0/2602661548 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957f59e640 1 --2- 172.21.15.53:0/2602661548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9580070c90 0x7f9580071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957e59c640 1 --2- 172.21.15.53:0/2602661548 >> v2:172.21.15.87:3300/0 conn(0x7f958015b7c0 0x7f958006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 -- 172.21.15.53:0/2602661548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9580070c90 msgr2=0x7f9580071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 --2- 172.21.15.53:0/2602661548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9580070c90 0x7f9580071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 -- 172.21.15.53:0/2602661548 >> v2:172.21.15.87:3300/0 conn(0x7f958015b7c0 msgr2=0x7f958006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:01.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 --2- 172.21.15.53:0/2602661548 >> v2:172.21.15.87:3300/0 conn(0x7f958015b7c0 0x7f958006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 -- 172.21.15.53:0/2602661548 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958006d480 con 0x7f95801582a0 2024-09-13T18:26:01.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957e59c640 1 --2- 172.21.15.53:0/2602661548 >> v2:172.21.15.87:3300/0 conn(0x7f958015b7c0 0x7f958006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:01.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957ed9d640 1 --2- 172.21.15.53:0/2602661548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95801582a0 0x7f958006c900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f95800ce220 tx=0x7f956801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c91f7e7f428ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:01.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957dd9b640 1 -- 172.21.15.53:0/2602661548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680aa610 con 0x7f95801582a0 2024-09-13T18:26:01.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957dd9b640 1 -- 172.21.15.53:0/2602661548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95680a6040 con 0x7f95801582a0 2024-09-13T18:26:01.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f957dd9b640 1 -- 172.21.15.53:0/2602661548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680aa990 con 0x7f95801582a0 2024-09-13T18:26:01.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 -- 172.21.15.53:0/2602661548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95801582a0 msgr2=0x7f958006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 --2- 172.21.15.53:0/2602661548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95801582a0 0x7f958006c900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f95800ce220 tx=0x7f956801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 -- 172.21.15.53:0/2602661548 shutdown_connections 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 --2- 172.21.15.53:0/2602661548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9580070c90 0x7f9580071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 --2- 172.21.15.53:0/2602661548 >> v2:172.21.15.87:3300/0 conn(0x7f958015b7c0 0x7f958006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 --2- 172.21.15.53:0/2602661548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95801582a0 0x7f958006c900 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 -- 172.21.15.53:0/2602661548 >> 172.21.15.53:0/2602661548 conn(0x7f9580065c80 msgr2=0x7f9580066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.511+0000 7f9585099640 1 -- 172.21.15.53:0/2602661548 shutdown_connections 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 -- 172.21.15.53:0/2602661548 wait complete. 2024-09-13T18:26:01.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 Processor -- start 2024-09-13T18:26:01.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 -- start start 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9580070c90 0x7f958014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801582a0 0x7f95800ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f958015b7c0 0x7f95801416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958014e670 con 0x7f9580070c90 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95801503e0 con 0x7f95801582a0 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f9585099640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9580150680 con 0x7f958015b7c0 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9580070c90 0x7f958014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9580070c90 0x7f958014fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58672/0 (socket says 172.21.15.53:58672) 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 -- 172.21.15.53:0/2211807860 learned_addr learned my addr 172.21.15.53:0/2211807860 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957e59c640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801582a0 0x7f95800ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957f59e640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f958015b7c0 0x7f95801416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 -- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f958015b7c0 msgr2=0x7f95801416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f958015b7c0 0x7f95801416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 -- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801582a0 msgr2=0x7f95800ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801582a0 0x7f95800ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 -- 172.21.15.53:0/2211807860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094d0 con 0x7f9580070c90 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f957ed9d640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9580070c90 0x7f958014fea0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f95680ac040 tx=0x7f956801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f95777fe640 1 -- 172.21.15.53:0/2211807860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680bd5f0 con 0x7f9580070c90 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f95777fe640 1 -- 172.21.15.53:0/2211807860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95680bd770 con 0x7f9580070c90 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.515+0000 7f95777fe640 1 -- 172.21.15.53:0/2211807860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680bdb20 con 0x7f9580070c90 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9580150960 con 0x7f9580070c90 2024-09-13T18:26:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95800b2a70 con 0x7f9580070c90 2024-09-13T18:26:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9580067400 con 0x7f9580070c90 2024-09-13T18:26:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f95777fe640 1 -- 172.21.15.53:0/2211807860 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95680b33f0 con 0x7f9580070c90 2024-09-13T18:26:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f95777fe640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9560066690 0x7f9560068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f95777fe640 1 -- 172.21.15.53:0/2211807860 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f956811ee50 con 0x7f9580070c90 2024-09-13T18:26:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f957e59c640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9560066690 0x7f9560068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.519+0000 7f957e59c640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9560066690 0x7f9560068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9578007510 tx=0x7f95780074a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.523+0000 7f95777fe640 1 -- 172.21.15.53:0/2211807860 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95680ec300 con 0x7f9580070c90 2024-09-13T18:26:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.719+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95800700e0 con 0x7f9580070c90 2024-09-13T18:26:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.719+0000 7f95777fe640 1 -- 172.21.15.53:0/2211807860 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f95680c3090 con 0x7f9580070c90 2024-09-13T18:26:01.727 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:01.727 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3877303910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3877303910},{"type":"v1","addr":"172.21.15.87:6836","nonce":3877303910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1431925450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":1431925450},{"type":"v1","addr":"172.21.15.87:6837","nonce":1431925450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2751759497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2751759497},{"type":"v1","addr":"172.21.15.53:6834","nonce":2751759497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:25:59.336241+0000","modified":"2024-09-13T18:26:01.346568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5193":{"gid":5193,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2879083637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2879083637},{"type":"v1","addr":"172.21.15.53:6835","nonce":2879083637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:26:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9560066690 msgr2=0x7f9560068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9560066690 0x7f9560068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9578007510 tx=0x7f95780074a0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9580070c90 msgr2=0x7f958014fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9580070c90 0x7f958014fea0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f95680ac040 tx=0x7f956801ad30 comp rx=0 tx=0).stop 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 shutdown_connections 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9560066690 0x7f9560068b50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f958015b7c0 0x7f95801416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95801582a0 0x7f95800ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 --2- 172.21.15.53:0/2211807860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9580070c90 0x7f958014fea0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 >> 172.21.15.53:0/2211807860 conn(0x7f9580065c80 msgr2=0x7f9580157230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 shutdown_connections 2024-09-13T18:26:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.723+0000 7f9585099640 1 -- 172.21.15.53:0/2211807860 wait complete. 2024-09-13T18:26:01.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:01.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1e517d640 1 Processor -- start 2024-09-13T18:26:01.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1e517d640 1 -- start start 2024-09-13T18:26:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1e517d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 0x7fd1e0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1e517d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e006e370 con 0x7fd1e0157ef0 2024-09-13T18:26:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1e517d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e01582d0 con 0x7fd1e006df20 2024-09-13T18:26:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1e517d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00ae530 con 0x7fd1e006c340 2024-09-13T18:26:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ded9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd1e0157ef0 0x7fd1e006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60800/0 (socket says 172.21.15.53:60800) 2024-09-13T18:26:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ded9d640 1 -- 172.21.15.53:0/1492946673 learned_addr learned my addr 172.21.15.53:0/1492946673 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1de59c640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 0x7fd1e0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21785271 0 0) 0x7fd1e006e370 con 0x7fd1e0157ef0 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c8003530 con 0x7fd1e0157ef0 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3622523472 0 0) 0x7fd1c8003530 con 0x7fd1e0157ef0 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 msgr2=0x7fd1e0071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 0x7fd1e0071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 >> v1:172.21.15.87:6789/0 conn(0x7fd1e006df20 legacy=0x7fd1e00abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e006e5c0 con 0x7fd1e0157ef0 2024-09-13T18:26:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd1d0001680 con 0x7fd1e0157ef0 2024-09-13T18:26:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 >> v1:172.21.15.53:6789/0 conn(0x7fd1e0157ef0 legacy=0x7fd1e006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80039b0 0x7fd1c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 0x7fd1c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00ae530 con 0x7fd1c80047d0 2024-09-13T18:26:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800ba40 con 0x7fd1c80039b0 2024-09-13T18:26:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800bc00 con 0x7fd1e006c340 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1de59c640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1ded9d640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80039b0 0x7fd1c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1df59e640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 0x7fd1c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1de59c640 1 -- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 msgr2=0x7fd1c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1de59c640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 0x7fd1c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1de59c640 1 -- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80039b0 msgr2=0x7fd1c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1de59c640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1c80039b0 0x7fd1c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1de59c640 1 -- 172.21.15.53:0/1492946673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8003530 con 0x7fd1c80047d0 2024-09-13T18:26:01.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.863+0000 7fd1df59e640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e006c340 0x7fd1c8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1de59c640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1c8004c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009ab0 tx=0x7fd1d401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702a4c57114c5172 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40a5510 con 0x7fd1c80047d0 2024-09-13T18:26:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d40a5670 con 0x7fd1c80047d0 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1ddd9b640 1 -- 172.21.15.53:0/1492946673 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d40a5a20 con 0x7fd1c80047d0 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 -- 172.21.15.53:0/1492946673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 msgr2=0x7fd1c8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 --2- 172.21.15.53:0/1492946673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1c8004c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009ab0 tx=0x7fd1d401ca30 comp rx=0 tx=0).stop 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1df59e640 1 -- 172.21.15.53:0/1492946673 reap_dead start 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 -- 172.21.15.53:0/1492946673 shutdown_connections 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 -- 172.21.15.53:0/1492946673 >> 172.21.15.53:0/1492946673 conn(0x7fd1e00b0a50 msgr2=0x7fd1e00b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 -- 172.21.15.53:0/1492946673 shutdown_connections 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 -- 172.21.15.53:0/1492946673 wait complete. 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 Processor -- start 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.867+0000 7fd1e517d640 1 -- start start 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1e0157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e0153190 0x7fd1e0152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1e00ad390 0x7fd1e00ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00caa60 con 0x7fd1c80047d0 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00add50 con 0x7fd1e00ad390 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00c9e40 con 0x7fd1e0153190 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1e0157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1e0157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58702/0 (socket says 172.21.15.53:58702) 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 -- 172.21.15.53:0/775149836 learned_addr learned my addr 172.21.15.53:0/775149836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1df59e640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1e00ad390 0x7fd1e00ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1de59c640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e0153190 0x7fd1e0152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 -- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e0153190 msgr2=0x7fd1e0152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e0153190 0x7fd1e0152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 -- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1e00ad390 msgr2=0x7fd1e00ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1e00ad390 0x7fd1e00ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 -- 172.21.15.53:0/775149836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00ca0c0 con 0x7fd1c80047d0 2024-09-13T18:26:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1ded9d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1e0157380 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0011810 tx=0x7fd1d0011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1c77fe640 1 -- 172.21.15.53:0/775149836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000fb00 con 0x7fd1c80047d0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1c77fe640 1 -- 172.21.15.53:0/775149836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d000fc80 con 0x7fd1c80047d0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e00ca3a0 con 0x7fd1c80047d0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1c77fe640 1 -- 172.21.15.53:0/775149836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0015410 con 0x7fd1c80047d0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e01535d0 con 0x7fd1c80047d0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e00caba0 con 0x7fd1c80047d0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1c77fe640 1 -- 172.21.15.53:0/775149836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1d0015570 con 0x7fd1c80047d0 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1c77fe640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd1cc0666c0 0x7fd1cc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1c77fe640 1 -- 172.21.15.53:0/775149836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1d00873e0 con 0x7fd1c80047d0 2024-09-13T18:26:01.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1de59c640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd1cc0666c0 0x7fd1cc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:01.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.871+0000 7fd1de59c640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd1cc0666c0 0x7fd1cc068b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40af000 tx=0x7fd1d40046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:01.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:01.875+0000 7fd1c77fe640 1 -- 172.21.15.53:0/775149836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd1e00caba0 con 0x7fd1c80047d0 2024-09-13T18:26:02.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.031+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1e00caba0 con 0x7fd1c80047d0 2024-09-13T18:26:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.031+0000 7fd1c77fe640 1 -- 172.21.15.53:0/775149836 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16509 (secure 0 0 0) 0x7fd1e00caba0 con 0x7fd1c80047d0 2024-09-13T18:26:02.040 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:02.040 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:00.339515+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd1cc0666c0 msgr2=0x7fd1cc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd1cc0666c0 0x7fd1cc068b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40af000 tx=0x7fd1d40046d0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 msgr2=0x7fd1e0157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1e0157380 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0011810 tx=0x7fd1d0011cd0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 shutdown_connections 2024-09-13T18:26:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd1cc0666c0 0x7fd1cc068b80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1e0153190 0x7fd1e0152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1e00ad390 0x7fd1e00ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 --2- 172.21.15.53:0/775149836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1c80047d0 0x7fd1e0157380 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 >> 172.21.15.53:0/775149836 conn(0x7fd1e00b0a50 msgr2=0x7fd1e015e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 shutdown_connections 2024-09-13T18:26:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.035+0000 7fd1e517d640 1 -- 172.21.15.53:0/775149836 wait complete. 2024-09-13T18:26:02.057 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:26:02.057 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:26:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.159+0000 7fb7e6047640 1 Processor -- start 2024-09-13T18:26:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.159+0000 7fb7e6047640 1 -- start start 2024-09-13T18:26:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7e6047640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 0x7fb7e006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7e6047640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e006d480 con 0x7fb7e015b7c0 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7e6047640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e015ace0 con 0x7fb7e00713a0 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7e6047640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e015aaf0 con 0x7fb7e01582a0 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7deffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb7e015b7c0 0x7fb7e0070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60808/0 (socket says 172.21.15.53:60808) 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7deffd640 1 -- 172.21.15.53:0/3791700276 learned_addr learned my addr 172.21.15.53:0/3791700276 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7df7fe640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 0x7fb7e006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726634693 0 0) 0x7fb7e006d480 con 0x7fb7e015b7c0 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c8003530 con 0x7fb7e015b7c0 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3746803101 0 0) 0x7fb7c8003530 con 0x7fb7e015b7c0 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 msgr2=0x7fb7e006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 0x7fb7e006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 >> v1:172.21.15.87:6789/0 conn(0x7fb7e00713a0 legacy=0x7fb7e01640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e015afc0 con 0x7fb7e015b7c0 2024-09-13T18:26:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb7d4001680 con 0x7fb7e015b7c0 2024-09-13T18:26:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 >> v1:172.21.15.53:6789/0 conn(0x7fb7e015b7c0 legacy=0x7fb7e0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7c80039b0 0x7fb7c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 0x7fb7c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800ba40 con 0x7fb7c8004d10 2024-09-13T18:26:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800bb80 con 0x7fb7c80039b0 2024-09-13T18:26:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c800bd40 con 0x7fb7e01582a0 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7dffff640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7df7fe640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7c80039b0 0x7fb7c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7deffd640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 0x7fb7c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7dffff640 1 -- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 msgr2=0x7fb7c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7dffff640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7e01582a0 0x7fb7c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7dffff640 1 -- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7c80039b0 msgr2=0x7fb7c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7dffff640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7c80039b0 0x7fb7c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.163+0000 7fb7dffff640 1 -- 172.21.15.53:0/3791700276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8003530 con 0x7fb7c8004d10 2024-09-13T18:26:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7dffff640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8001e40 tx=0x7fb7d801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149c1ab956ccfcea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8003b80 con 0x7fb7c8004d10 2024-09-13T18:26:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8003ce0 con 0x7fb7c8004d10 2024-09-13T18:26:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7de7fc640 1 -- 172.21.15.53:0/3791700276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80052c0 con 0x7fb7c8004d10 2024-09-13T18:26:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- 172.21.15.53:0/3791700276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c8004d10 msgr2=0x7fb7c8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 --2- 172.21.15.53:0/3791700276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c8004d10 0x7fb7c8005190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8001e40 tx=0x7fb7d801c760 comp rx=0 tx=0).stop 2024-09-13T18:26:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7dffff640 1 -- 172.21.15.53:0/3791700276 reap_dead start 2024-09-13T18:26:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- 172.21.15.53:0/3791700276 shutdown_connections 2024-09-13T18:26:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- 172.21.15.53:0/3791700276 >> 172.21.15.53:0/3791700276 conn(0x7fb7e0065c80 msgr2=0x7fb7e0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- 172.21.15.53:0/3791700276 shutdown_connections 2024-09-13T18:26:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- 172.21.15.53:0/3791700276 wait complete. 2024-09-13T18:26:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 Processor -- start 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- start start 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7c8004d10 0x7fb7e00b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e0154860 0x7fb7e00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e0144a50 0x7fb7e0144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b2a80 con 0x7fb7e0154860 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0145410 con 0x7fb7e0144a50 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7e6047640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00b2ea0 con 0x7fb7c8004d10 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e0154860 0x7fb7e00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e0154860 0x7fb7e00acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58734/0 (socket says 172.21.15.53:58734) 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 -- 172.21.15.53:0/3632586975 learned_addr learned my addr 172.21.15.53:0/3632586975 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7dffff640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e0144a50 0x7fb7e0144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7df7fe640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7c8004d10 0x7fb7e00b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 -- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7c8004d10 msgr2=0x7fb7e00b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7c8004d10 0x7fb7e00b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 -- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e0144a50 msgr2=0x7fb7e0144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e0144a50 0x7fb7e0144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 -- 172.21.15.53:0/3632586975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00b1e00 con 0x7fb7e0154860 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.167+0000 7fb7deffd640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e0154860 0x7fb7e00acb40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400e820 tx=0x7fb7d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7c7fff640 1 -- 172.21.15.53:0/3632586975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400c8d0 con 0x7fb7e0154860 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7c7fff640 1 -- 172.21.15.53:0/3632586975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400ca30 con 0x7fb7e0154860 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7c7fff640 1 -- 172.21.15.53:0/3632586975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400cde0 con 0x7fb7e0154860 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00b20e0 con 0x7fb7e0154860 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e00b26a0 con 0x7fb7e0154860 2024-09-13T18:26:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e0067400 con 0x7fb7e0154860 2024-09-13T18:26:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7c7fff640 1 -- 172.21.15.53:0/3632586975 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7d401d460 con 0x7fb7e0154860 2024-09-13T18:26:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7c7fff640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7cc066690 0x7fb7cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7c7fff640 1 -- 172.21.15.53:0/3632586975 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d40840d0 con 0x7fb7e0154860 2024-09-13T18:26:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7df7fe640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7cc066690 0x7fb7cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.171+0000 7fb7df7fe640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7cc066690 0x7fb7cc068b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009a30 tx=0x7fb7d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.175+0000 7fb7c7fff640 1 -- 172.21.15.53:0/3632586975 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7d4051430 con 0x7fb7e0154860 2024-09-13T18:26:02.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.323+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7e00caaf0 con 0x7fb7cc066690 2024-09-13T18:26:02.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.347+0000 7fb7c7fff640 1 -- 172.21.15.53:0/3632586975 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288192 (secure 0 0 0) 0x7fb7e00caaf0 con 0x7fb7cc066690 2024-09-13T18:26:02.358 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.351+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7cc066690 msgr2=0x7fb7cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.351+0000 7fb7e6047640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7cc066690 0x7fb7cc068b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009a30 tx=0x7fb7d0008040 comp rx=0 tx=0).stop 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.351+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e0154860 msgr2=0x7fb7e00acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.351+0000 7fb7e6047640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e0154860 0x7fb7e00acb40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400e820 tx=0x7fb7d400ece0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 shutdown_connections 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb7cc066690 0x7fb7cc068b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7e0144a50 0x7fb7e0144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7e0154860 0x7fb7e00acb40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 --2- 172.21.15.53:0/3632586975 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7c8004d10 0x7fb7e00b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 >> 172.21.15.53:0/3632586975 conn(0x7fb7e0065c80 msgr2=0x7fb7e0158e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 shutdown_connections 2024-09-13T18:26:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.355+0000 7fb7e6047640 1 -- 172.21.15.53:0/3632586975 wait complete. 2024-09-13T18:26:02.377 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-13T18:26:00.922138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236700,"kb_used_data":4124,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738020,"statfs":{"total":773094113280,"available":772851732480,"internally_reserved":0,"allocated":4222976,"data_stored":2343381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001153"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.394386+0000","last_change":"2024-09-13T18:25:59.386968+0000","last_active":"2024-09-13T18:25:59.394386+0000","last_peered":"2024-09-13T18:25:59.394386+0000","last_clean":"2024-09-13T18:25:59.394386+0000","last_became_active":"2024-09-13T18:25:59.386242+0000","last_became_peered":"2024-09-13T18:25:59.386242+0000","last_unstale":"2024-09-13T18:25:59.394386+0000","last_undegraded":"2024-09-13T18:25:59.394386+0000","last_fullsized":"2024-09-13T18:25:59.394386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:06.985870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364061+0000","last_change":"2024-09-13T18:25:59.357737+0000","last_active":"2024-09-13T18:25:59.364061+0000","last_peered":"2024-09-13T18:25:59.364061+0000","last_clean":"2024-09-13T18:25:59.364061+0000","last_became_active":"2024-09-13T18:25:59.357446+0000","last_became_peered":"2024-09-13T18:25:59.357446+0000","last_unstale":"2024-09-13T18:25:59.364061+0000","last_undegraded":"2024-09-13T18:25:59.364061+0000","last_fullsized":"2024-09-13T18:25:59.364061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:16.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399991+0000","last_change":"2024-09-13T18:25:59.382645+0000","last_active":"2024-09-13T18:25:59.399991+0000","last_peered":"2024-09-13T18:25:59.399991+0000","last_clean":"2024-09-13T18:25:59.399991+0000","last_became_active":"2024-09-13T18:25:59.375127+0000","last_became_peered":"2024-09-13T18:25:59.375127+0000","last_unstale":"2024-09-13T18:25:59.399991+0000","last_undegraded":"2024-09-13T18:25:59.399991+0000","last_fullsized":"2024-09-13T18:25:59.399991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:48.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355764+0000","last_change":"2024-09-13T18:25:59.352528+0000","last_active":"2024-09-13T18:25:59.355764+0000","last_peered":"2024-09-13T18:25:59.355764+0000","last_clean":"2024-09-13T18:25:59.355764+0000","last_became_active":"2024-09-13T18:25:59.352249+0000","last_became_peered":"2024-09-13T18:25:59.352249+0000","last_unstale":"2024-09-13T18:25:59.355764+0000","last_undegraded":"2024-09-13T18:25:59.355764+0000","last_fullsized":"2024-09-13T18:25:59.355764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:01.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359890+0000","last_change":"2024-09-13T18:25:59.358782+0000","last_active":"2024-09-13T18:25:59.359890+0000","last_peered":"2024-09-13T18:25:59.359890+0000","last_clean":"2024-09-13T18:25:59.359890+0000","last_became_active":"2024-09-13T18:25:59.358526+0000","last_became_peered":"2024-09-13T18:25:59.358526+0000","last_unstale":"2024-09-13T18:25:59.359890+0000","last_undegraded":"2024-09-13T18:25:59.359890+0000","last_fullsized":"2024-09-13T18:25:59.359890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:46.354918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.380618+0000","last_change":"2024-09-13T18:25:59.379766+0000","last_active":"2024-09-13T18:25:59.380618+0000","last_peered":"2024-09-13T18:25:59.380618+0000","last_clean":"2024-09-13T18:25:59.380618+0000","last_became_active":"2024-09-13T18:25:59.379476+0000","last_became_peered":"2024-09-13T18:25:59.379476+0000","last_unstale":"2024-09-13T18:25:59.380618+0000","last_undegraded":"2024-09-13T18:25:59.380618+0000","last_fullsized":"2024-09-13T18:25:59.380618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:42.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399337+0000","last_change":"2024-09-13T18:25:59.393216+0000","last_active":"2024-09-13T18:25:59.399337+0000","last_peered":"2024-09-13T18:25:59.399337+0000","last_clean":"2024-09-13T18:25:59.399337+0000","last_became_active":"2024-09-13T18:25:59.392535+0000","last_became_peered":"2024-09-13T18:25:59.392535+0000","last_unstale":"2024-09-13T18:25:59.399337+0000","last_undegraded":"2024-09-13T18:25:59.399337+0000","last_fullsized":"2024-09-13T18:25:59.399337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:01.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400662+0000","last_change":"2024-09-13T18:25:59.396761+0000","last_active":"2024-09-13T18:25:59.400662+0000","last_peered":"2024-09-13T18:25:59.400662+0000","last_clean":"2024-09-13T18:25:59.400662+0000","last_became_active":"2024-09-13T18:25:59.395779+0000","last_became_peered":"2024-09-13T18:25:59.395779+0000","last_unstale":"2024-09-13T18:25:59.400662+0000","last_undegraded":"2024-09-13T18:25:59.400662+0000","last_fullsized":"2024-09-13T18:25:59.400662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:42.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379079+0000","last_change":"2024-09-13T18:25:59.361597+0000","last_active":"2024-09-13T18:25:59.379079+0000","last_peered":"2024-09-13T18:25:59.379079+0000","last_clean":"2024-09-13T18:25:59.379079+0000","last_became_active":"2024-09-13T18:25:59.360818+0000","last_became_peered":"2024-09-13T18:25:59.360818+0000","last_unstale":"2024-09-13T18:25:59.379079+0000","last_undegraded":"2024-09-13T18:25:59.379079+0000","last_fullsized":"2024-09-13T18:25:59.379079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:17.327540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.360476+0000","last_change":"2024-09-13T18:25:59.359948+0000","last_active":"2024-09-13T18:25:59.360476+0000","last_peered":"2024-09-13T18:25:59.360476+0000","last_clean":"2024-09-13T18:25:59.360476+0000","last_became_active":"2024-09-13T18:25:59.359718+0000","last_became_peered":"2024-09-13T18:25:59.359718+0000","last_unstale":"2024-09-13T18:25:59.360476+0000","last_undegraded":"2024-09-13T18:25:59.360476+0000","last_fullsized":"2024-09-13T18:25:59.360476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:20.965667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.396476+0000","last_change":"2024-09-13T18:25:59.387485+0000","last_active":"2024-09-13T18:25:59.396476+0000","last_peered":"2024-09-13T18:25:59.396476+0000","last_clean":"2024-09-13T18:25:59.396476+0000","last_became_active":"2024-09-13T18:25:59.386649+0000","last_became_peered":"2024-09-13T18:25:59.386649+0000","last_unstale":"2024-09-13T18:25:59.396476+0000","last_undegraded":"2024-09-13T18:25:59.396476+0000","last_fullsized":"2024-09-13T18:25:59.396476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:14.082902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.385029+0000","last_change":"2024-09-13T18:25:59.371557+0000","last_active":"2024-09-13T18:25:59.385029+0000","last_peered":"2024-09-13T18:25:59.385029+0000","last_clean":"2024-09-13T18:25:59.385029+0000","last_became_active":"2024-09-13T18:25:59.370706+0000","last_became_peered":"2024-09-13T18:25:59.370706+0000","last_unstale":"2024-09-13T18:25:59.385029+0000","last_undegraded":"2024-09-13T18:25:59.385029+0000","last_fullsized":"2024-09-13T18:25:59.385029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.202182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.357166+0000","last_change":"2024-09-13T18:25:59.355197+0000","last_active":"2024-09-13T18:25:59.357166+0000","last_peered":"2024-09-13T18:25:59.357166+0000","last_clean":"2024-09-13T18:25:59.357166+0000","last_became_active":"2024-09-13T18:25:59.354899+0000","last_became_peered":"2024-09-13T18:25:59.354899+0000","last_unstale":"2024-09-13T18:25:59.357166+0000","last_undegraded":"2024-09-13T18:25:59.357166+0000","last_fullsized":"2024-09-13T18:25:59.357166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.568288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364120+0000","last_change":"2024-09-13T18:25:59.357772+0000","last_active":"2024-09-13T18:25:59.364120+0000","last_peered":"2024-09-13T18:25:59.364120+0000","last_clean":"2024-09-13T18:25:59.364120+0000","last_became_active":"2024-09-13T18:25:59.357460+0000","last_became_peered":"2024-09-13T18:25:59.357460+0000","last_unstale":"2024-09-13T18:25:59.364120+0000","last_undegraded":"2024-09-13T18:25:59.364120+0000","last_fullsized":"2024-09-13T18:25:59.364120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:34.169942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401180+0000","last_change":"2024-09-13T18:25:59.395948+0000","last_active":"2024-09-13T18:25:59.401180+0000","last_peered":"2024-09-13T18:25:59.401180+0000","last_clean":"2024-09-13T18:25:59.401180+0000","last_became_active":"2024-09-13T18:25:59.395346+0000","last_became_peered":"2024-09-13T18:25:59.395346+0000","last_unstale":"2024-09-13T18:25:59.401180+0000","last_undegraded":"2024-09-13T18:25:59.401180+0000","last_fullsized":"2024-09-13T18:25:59.401180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.587580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401169+0000","last_change":"2024-09-13T18:25:59.399550+0000","last_active":"2024-09-13T18:25:59.401169+0000","last_peered":"2024-09-13T18:25:59.401169+0000","last_clean":"2024-09-13T18:25:59.401169+0000","last_became_active":"2024-09-13T18:25:59.398046+0000","last_became_peered":"2024-09-13T18:25:59.398046+0000","last_unstale":"2024-09-13T18:25:59.401169+0000","last_undegraded":"2024-09-13T18:25:59.401169+0000","last_fullsized":"2024-09-13T18:25:59.401169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.202182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399166+0000","last_change":"2024-09-13T18:25:59.392173+0000","last_active":"2024-09-13T18:25:59.399166+0000","last_peered":"2024-09-13T18:25:59.399166+0000","last_clean":"2024-09-13T18:25:59.399166+0000","last_became_active":"2024-09-13T18:25:59.391304+0000","last_became_peered":"2024-09-13T18:25:59.391304+0000","last_unstale":"2024-09-13T18:25:59.399166+0000","last_undegraded":"2024-09-13T18:25:59.399166+0000","last_fullsized":"2024-09-13T18:25:59.399166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364275+0000","last_change":"2024-09-13T18:25:59.361108+0000","last_active":"2024-09-13T18:25:59.364275+0000","last_peered":"2024-09-13T18:25:59.364275+0000","last_clean":"2024-09-13T18:25:59.364275+0000","last_became_active":"2024-09-13T18:25:59.359846+0000","last_became_peered":"2024-09-13T18:25:59.359846+0000","last_unstale":"2024-09-13T18:25:59.364275+0000","last_undegraded":"2024-09-13T18:25:59.364275+0000","last_fullsized":"2024-09-13T18:25:59.364275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.587580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364080+0000","last_change":"2024-09-13T18:25:59.357792+0000","last_active":"2024-09-13T18:25:59.364080+0000","last_peered":"2024-09-13T18:25:59.364080+0000","last_clean":"2024-09-13T18:25:59.364080+0000","last_became_active":"2024-09-13T18:25:59.356368+0000","last_became_peered":"2024-09-13T18:25:59.356368+0000","last_unstale":"2024-09-13T18:25:59.364080+0000","last_undegraded":"2024-09-13T18:25:59.364080+0000","last_fullsized":"2024-09-13T18:25:59.364080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.202182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.376070+0000","last_change":"2024-09-13T18:25:59.375482+0000","last_active":"2024-09-13T18:25:59.376070+0000","last_peered":"2024-09-13T18:25:59.376070+0000","last_clean":"2024-09-13T18:25:59.376070+0000","last_became_active":"2024-09-13T18:25:59.375271+0000","last_became_peered":"2024-09-13T18:25:59.375271+0000","last_unstale":"2024-09-13T18:25:59.376070+0000","last_undegraded":"2024-09-13T18:25:59.376070+0000","last_fullsized":"2024-09-13T18:25:59.376070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:31.714659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387857+0000","last_change":"2024-09-13T18:25:59.378570+0000","last_active":"2024-09-13T18:25:59.387857+0000","last_peered":"2024-09-13T18:25:59.387857+0000","last_clean":"2024-09-13T18:25:59.387857+0000","last_became_active":"2024-09-13T18:25:59.371071+0000","last_became_peered":"2024-09-13T18:25:59.371071+0000","last_unstale":"2024-09-13T18:25:59.387857+0000","last_undegraded":"2024-09-13T18:25:59.387857+0000","last_fullsized":"2024-09-13T18:25:59.387857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:05.407745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.385514+0000","last_change":"2024-09-13T18:25:59.369902+0000","last_active":"2024-09-13T18:25:59.385514+0000","last_peered":"2024-09-13T18:25:59.385514+0000","last_clean":"2024-09-13T18:25:59.385514+0000","last_became_active":"2024-09-13T18:25:59.368919+0000","last_became_peered":"2024-09-13T18:25:59.368919+0000","last_unstale":"2024-09-13T18:25:59.385514+0000","last_undegraded":"2024-09-13T18:25:59.385514+0000","last_fullsized":"2024-09-13T18:25:59.385514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:59.810213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.378995+0000","last_change":"2024-09-13T18:25:59.378287+0000","last_active":"2024-09-13T18:25:59.378995+0000","last_peered":"2024-09-13T18:25:59.378995+0000","last_clean":"2024-09-13T18:25:59.378995+0000","last_became_active":"2024-09-13T18:25:59.377973+0000","last_became_peered":"2024-09-13T18:25:59.377973+0000","last_unstale":"2024-09-13T18:25:59.378995+0000","last_undegraded":"2024-09-13T18:25:59.378995+0000","last_fullsized":"2024-09-13T18:25:59.378995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:26.745822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.385054+0000","last_change":"2024-09-13T18:25:59.377757+0000","last_active":"2024-09-13T18:25:59.385054+0000","last_peered":"2024-09-13T18:25:59.385054+0000","last_clean":"2024-09-13T18:25:59.385054+0000","last_became_active":"2024-09-13T18:25:59.376993+0000","last_became_peered":"2024-09-13T18:25:59.376993+0000","last_unstale":"2024-09-13T18:25:59.385054+0000","last_undegraded":"2024-09-13T18:25:59.385054+0000","last_fullsized":"2024-09-13T18:25:59.385054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:44.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.378299+0000","last_change":"2024-09-13T18:25:59.377564+0000","last_active":"2024-09-13T18:25:59.378299+0000","last_peered":"2024-09-13T18:25:59.378299+0000","last_clean":"2024-09-13T18:25:59.378299+0000","last_became_active":"2024-09-13T18:25:59.377327+0000","last_became_peered":"2024-09-13T18:25:59.377327+0000","last_unstale":"2024-09-13T18:25:59.378299+0000","last_undegraded":"2024-09-13T18:25:59.378299+0000","last_fullsized":"2024-09-13T18:25:59.378299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379194+0000","last_change":"2024-09-13T18:25:59.377448+0000","last_active":"2024-09-13T18:25:59.379194+0000","last_peered":"2024-09-13T18:25:59.379194+0000","last_clean":"2024-09-13T18:25:59.379194+0000","last_became_active":"2024-09-13T18:25:59.377161+0000","last_became_peered":"2024-09-13T18:25:59.377161+0000","last_unstale":"2024-09-13T18:25:59.379194+0000","last_undegraded":"2024-09-13T18:25:59.379194+0000","last_fullsized":"2024-09-13T18:25:59.379194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:48.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.381770+0000","last_change":"2024-09-13T18:25:59.381015+0000","last_active":"2024-09-13T18:25:59.381770+0000","last_peered":"2024-09-13T18:25:59.381770+0000","last_clean":"2024-09-13T18:25:59.381770+0000","last_became_active":"2024-09-13T18:25:59.380762+0000","last_became_peered":"2024-09-13T18:25:59.380762+0000","last_unstale":"2024-09-13T18:25:59.381770+0000","last_undegraded":"2024-09-13T18:25:59.381770+0000","last_fullsized":"2024-09-13T18:25:59.381770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:42.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.382004+0000","last_change":"2024-09-13T18:25:59.367967+0000","last_active":"2024-09-13T18:25:59.382004+0000","last_peered":"2024-09-13T18:25:59.382004+0000","last_clean":"2024-09-13T18:25:59.382004+0000","last_became_active":"2024-09-13T18:25:59.367230+0000","last_became_peered":"2024-09-13T18:25:59.367230+0000","last_unstale":"2024-09-13T18:25:59.382004+0000","last_undegraded":"2024-09-13T18:25:59.382004+0000","last_fullsized":"2024-09-13T18:25:59.382004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:34.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387726+0000","last_change":"2024-09-13T18:25:59.376482+0000","last_active":"2024-09-13T18:25:59.387726+0000","last_peered":"2024-09-13T18:25:59.387726+0000","last_clean":"2024-09-13T18:25:59.387726+0000","last_became_active":"2024-09-13T18:25:59.370533+0000","last_became_peered":"2024-09-13T18:25:59.370533+0000","last_unstale":"2024-09-13T18:25:59.387726+0000","last_undegraded":"2024-09-13T18:25:59.387726+0000","last_fullsized":"2024-09-13T18:25:59.387726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:20.965667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399039+0000","last_change":"2024-09-13T18:25:59.390686+0000","last_active":"2024-09-13T18:25:59.399039+0000","last_peered":"2024-09-13T18:25:59.399039+0000","last_clean":"2024-09-13T18:25:59.399039+0000","last_became_active":"2024-09-13T18:25:59.389749+0000","last_became_peered":"2024-09-13T18:25:59.389749+0000","last_unstale":"2024-09-13T18:25:59.399039+0000","last_undegraded":"2024-09-13T18:25:59.399039+0000","last_fullsized":"2024-09-13T18:25:59.399039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:59.810213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364509+0000","last_change":"2024-09-13T18:25:59.359203+0000","last_active":"2024-09-13T18:25:59.364509+0000","last_peered":"2024-09-13T18:25:59.364509+0000","last_clean":"2024-09-13T18:25:59.364509+0000","last_became_active":"2024-09-13T18:25:59.358480+0000","last_became_peered":"2024-09-13T18:25:59.358480+0000","last_unstale":"2024-09-13T18:25:59.364509+0000","last_undegraded":"2024-09-13T18:25:59.364509+0000","last_fullsized":"2024-09-13T18:25:59.364509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.568288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401135+0000","last_change":"2024-09-13T18:25:59.398959+0000","last_active":"2024-09-13T18:25:59.401135+0000","last_peered":"2024-09-13T18:25:59.401135+0000","last_clean":"2024-09-13T18:25:59.401135+0000","last_became_active":"2024-09-13T18:25:59.397534+0000","last_became_peered":"2024-09-13T18:25:59.397534+0000","last_unstale":"2024-09-13T18:25:59.401135+0000","last_undegraded":"2024-09-13T18:25:59.401135+0000","last_fullsized":"2024-09-13T18:25:59.401135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:34.169942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.377628+0000","last_change":"2024-09-13T18:25:59.376836+0000","last_active":"2024-09-13T18:25:59.377628+0000","last_peered":"2024-09-13T18:25:59.377628+0000","last_clean":"2024-09-13T18:25:59.377628+0000","last_became_active":"2024-09-13T18:25:59.376557+0000","last_became_peered":"2024-09-13T18:25:59.376557+0000","last_unstale":"2024-09-13T18:25:59.377628+0000","last_undegraded":"2024-09-13T18:25:59.377628+0000","last_fullsized":"2024-09-13T18:25:59.377628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:44.674956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400898+0000","last_change":"2024-09-13T18:25:58.993903+0000","last_active":"2024-09-13T18:25:59.400898+0000","last_peered":"2024-09-13T18:25:59.400898+0000","last_clean":"2024-09-13T18:25:59.400898+0000","last_became_active":"2024-09-13T18:25:58.993267+0000","last_became_peered":"2024-09-13T18:25:58.993267+0000","last_unstale":"2024-09-13T18:25:59.400898+0000","last_undegraded":"2024-09-13T18:25:59.400898+0000","last_fullsized":"2024-09-13T18:25:59.400898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:29.476297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.396962+0000","last_change":"2024-09-13T18:25:59.391863+0000","last_active":"2024-09-13T18:25:59.396962+0000","last_peered":"2024-09-13T18:25:59.396962+0000","last_clean":"2024-09-13T18:25:59.396962+0000","last_became_active":"2024-09-13T18:25:59.391288+0000","last_became_peered":"2024-09-13T18:25:59.391288+0000","last_unstale":"2024-09-13T18:25:59.396962+0000","last_undegraded":"2024-09-13T18:25:59.396962+0000","last_fullsized":"2024-09-13T18:25:59.396962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:21.794565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355263+0000","last_change":"2024-09-13T18:25:58.998653+0000","last_active":"2024-09-13T18:25:59.355263+0000","last_peered":"2024-09-13T18:25:59.355263+0000","last_clean":"2024-09-13T18:25:59.355263+0000","last_became_active":"2024-09-13T18:25:58.998169+0000","last_became_peered":"2024-09-13T18:25:58.998169+0000","last_unstale":"2024-09-13T18:25:59.355263+0000","last_undegraded":"2024-09-13T18:25:59.355263+0000","last_fullsized":"2024-09-13T18:25:59.355263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:37.559158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379191+0000","last_change":"2024-09-13T18:25:59.368316+0000","last_active":"2024-09-13T18:25:59.379191+0000","last_peered":"2024-09-13T18:25:59.379191+0000","last_clean":"2024-09-13T18:25:59.379191+0000","last_became_active":"2024-09-13T18:25:59.360969+0000","last_became_peered":"2024-09-13T18:25:59.360969+0000","last_unstale":"2024-09-13T18:25:59.379191+0000","last_undegraded":"2024-09-13T18:25:59.379191+0000","last_fullsized":"2024-09-13T18:25:59.379191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:54.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359523+0000","last_change":"2024-09-13T18:25:58.981877+0000","last_active":"2024-09-13T18:25:59.359523+0000","last_peered":"2024-09-13T18:25:59.359523+0000","last_clean":"2024-09-13T18:25:59.359523+0000","last_became_active":"2024-09-13T18:25:58.981617+0000","last_became_peered":"2024-09-13T18:25:58.981617+0000","last_unstale":"2024-09-13T18:25:59.359523+0000","last_undegraded":"2024-09-13T18:25:59.359523+0000","last_fullsized":"2024-09-13T18:25:59.359523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.381781+0000","last_change":"2024-09-13T18:25:59.381146+0000","last_active":"2024-09-13T18:25:59.381781+0000","last_peered":"2024-09-13T18:25:59.381781+0000","last_clean":"2024-09-13T18:25:59.381781+0000","last_became_active":"2024-09-13T18:25:59.380815+0000","last_became_peered":"2024-09-13T18:25:59.380815+0000","last_unstale":"2024-09-13T18:25:59.381781+0000","last_undegraded":"2024-09-13T18:25:59.381781+0000","last_fullsized":"2024-09-13T18:25:59.381781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:34.169942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.357008+0000","last_change":"2024-09-13T18:25:58.979590+0000","last_active":"2024-09-13T18:25:59.357008+0000","last_peered":"2024-09-13T18:25:59.357008+0000","last_clean":"2024-09-13T18:25:59.357008+0000","last_became_active":"2024-09-13T18:25:58.979060+0000","last_became_peered":"2024-09-13T18:25:58.979060+0000","last_unstale":"2024-09-13T18:25:59.357008+0000","last_undegraded":"2024-09-13T18:25:59.357008+0000","last_fullsized":"2024-09-13T18:25:59.357008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:06.570791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.398998+0000","last_change":"2024-09-13T18:25:59.390319+0000","last_active":"2024-09-13T18:25:59.398998+0000","last_peered":"2024-09-13T18:25:59.398998+0000","last_clean":"2024-09-13T18:25:59.398998+0000","last_became_active":"2024-09-13T18:25:59.389049+0000","last_became_peered":"2024-09-13T18:25:59.389049+0000","last_unstale":"2024-09-13T18:25:59.398998+0000","last_undegraded":"2024-09-13T18:25:59.398998+0000","last_fullsized":"2024-09-13T18:25:59.398998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:20.965667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387914+0000","last_change":"2024-09-13T18:25:58.983230+0000","last_active":"2024-09-13T18:25:59.387914+0000","last_peered":"2024-09-13T18:25:59.387914+0000","last_clean":"2024-09-13T18:25:59.387914+0000","last_became_active":"2024-09-13T18:25:58.981624+0000","last_became_peered":"2024-09-13T18:25:58.981624+0000","last_unstale":"2024-09-13T18:25:59.387914+0000","last_undegraded":"2024-09-13T18:25:59.387914+0000","last_fullsized":"2024-09-13T18:25:59.387914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:30.705530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.382493+0000","last_change":"2024-09-13T18:25:59.373749+0000","last_active":"2024-09-13T18:25:59.382493+0000","last_peered":"2024-09-13T18:25:59.382493+0000","last_clean":"2024-09-13T18:25:59.382493+0000","last_became_active":"2024-09-13T18:25:59.371093+0000","last_became_peered":"2024-09-13T18:25:59.371093+0000","last_unstale":"2024-09-13T18:25:59.382493+0000","last_undegraded":"2024-09-13T18:25:59.382493+0000","last_fullsized":"2024-09-13T18:25:59.382493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.382984+0000","last_change":"2024-09-13T18:25:58.982737+0000","last_active":"2024-09-13T18:25:59.382984+0000","last_peered":"2024-09-13T18:25:59.382984+0000","last_clean":"2024-09-13T18:25:59.382984+0000","last_became_active":"2024-09-13T18:25:58.982075+0000","last_became_peered":"2024-09-13T18:25:58.982075+0000","last_unstale":"2024-09-13T18:25:59.382984+0000","last_undegraded":"2024-09-13T18:25:59.382984+0000","last_fullsized":"2024-09-13T18:25:59.382984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:45.345789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388082+0000","last_change":"2024-09-13T18:25:59.378691+0000","last_active":"2024-09-13T18:25:59.388082+0000","last_peered":"2024-09-13T18:25:59.388082+0000","last_clean":"2024-09-13T18:25:59.388082+0000","last_became_active":"2024-09-13T18:25:59.377978+0000","last_became_peered":"2024-09-13T18:25:59.377978+0000","last_unstale":"2024-09-13T18:25:59.388082+0000","last_undegraded":"2024-09-13T18:25:59.388082+0000","last_fullsized":"2024-09-13T18:25:59.388082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:25.931862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.347940+0000","last_change":"2024-09-13T18:25:58.985700+0000","last_active":"2024-09-13T18:25:59.347940+0000","last_peered":"2024-09-13T18:25:59.347940+0000","last_clean":"2024-09-13T18:25:59.347940+0000","last_became_active":"2024-09-13T18:25:58.981921+0000","last_became_peered":"2024-09-13T18:25:58.981921+0000","last_unstale":"2024-09-13T18:25:59.347940+0000","last_undegraded":"2024-09-13T18:25:59.347940+0000","last_fullsized":"2024-09-13T18:25:59.347940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:37.559158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.381205+0000","last_change":"2024-09-13T18:25:59.379821+0000","last_active":"2024-09-13T18:25:59.381205+0000","last_peered":"2024-09-13T18:25:59.381205+0000","last_clean":"2024-09-13T18:25:59.381205+0000","last_became_active":"2024-09-13T18:25:59.379555+0000","last_became_peered":"2024-09-13T18:25:59.379555+0000","last_unstale":"2024-09-13T18:25:59.381205+0000","last_undegraded":"2024-09-13T18:25:59.381205+0000","last_fullsized":"2024-09-13T18:25:59.381205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:34.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.349837+0000","last_change":"2024-09-13T18:25:58.991850+0000","last_active":"2024-09-13T18:25:59.349837+0000","last_peered":"2024-09-13T18:25:59.349837+0000","last_clean":"2024-09-13T18:25:59.349837+0000","last_became_active":"2024-09-13T18:25:58.991025+0000","last_became_peered":"2024-09-13T18:25:58.991025+0000","last_unstale":"2024-09-13T18:25:59.349837+0000","last_undegraded":"2024-09-13T18:25:59.349837+0000","last_fullsized":"2024-09-13T18:25:59.349837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:23.910921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.383606+0000","last_change":"2024-09-13T18:25:59.370257+0000","last_active":"2024-09-13T18:25:59.383606+0000","last_peered":"2024-09-13T18:25:59.383606+0000","last_clean":"2024-09-13T18:25:59.383606+0000","last_became_active":"2024-09-13T18:25:59.369456+0000","last_became_peered":"2024-09-13T18:25:59.369456+0000","last_unstale":"2024-09-13T18:25:59.383606+0000","last_undegraded":"2024-09-13T18:25:59.383606+0000","last_fullsized":"2024-09-13T18:25:59.383606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:14.082902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.348633+0000","last_change":"2024-09-13T18:25:58.995278+0000","last_active":"2024-09-13T18:25:59.348633+0000","last_peered":"2024-09-13T18:25:59.348633+0000","last_clean":"2024-09-13T18:25:59.348633+0000","last_became_active":"2024-09-13T18:25:58.994880+0000","last_became_peered":"2024-09-13T18:25:58.994880+0000","last_unstale":"2024-09-13T18:25:59.348633+0000","last_undegraded":"2024-09-13T18:25:59.348633+0000","last_fullsized":"2024-09-13T18:25:59.348633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:00.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364003+0000","last_change":"2024-09-13T18:25:59.357445+0000","last_active":"2024-09-13T18:25:59.364003+0000","last_peered":"2024-09-13T18:25:59.364003+0000","last_clean":"2024-09-13T18:25:59.364003+0000","last_became_active":"2024-09-13T18:25:59.356511+0000","last_became_peered":"2024-09-13T18:25:59.356511+0000","last_unstale":"2024-09-13T18:25:59.364003+0000","last_undegraded":"2024-09-13T18:25:59.364003+0000","last_fullsized":"2024-09-13T18:25:59.364003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:14.082902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343480+0000","last_change":"2024-09-13T18:25:58.983154+0000","last_active":"2024-09-13T18:25:59.343480+0000","last_peered":"2024-09-13T18:25:59.343480+0000","last_clean":"2024-09-13T18:25:59.343480+0000","last_became_active":"2024-09-13T18:25:58.982763+0000","last_became_peered":"2024-09-13T18:25:58.982763+0000","last_unstale":"2024-09-13T18:25:59.343480+0000","last_undegraded":"2024-09-13T18:25:59.343480+0000","last_fullsized":"2024-09-13T18:25:59.343480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:47.216020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.396088+0000","last_change":"2024-09-13T18:25:59.395482+0000","last_active":"2024-09-13T18:25:59.396088+0000","last_peered":"2024-09-13T18:25:59.396088+0000","last_clean":"2024-09-13T18:25:59.396088+0000","last_became_active":"2024-09-13T18:25:59.395182+0000","last_became_peered":"2024-09-13T18:25:59.395182+0000","last_unstale":"2024-09-13T18:25:59.396088+0000","last_undegraded":"2024-09-13T18:25:59.396088+0000","last_fullsized":"2024-09-13T18:25:59.396088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:44.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388057+0000","last_change":"2024-09-13T18:25:58.998724+0000","last_active":"2024-09-13T18:25:59.388057+0000","last_peered":"2024-09-13T18:25:59.388057+0000","last_clean":"2024-09-13T18:25:59.388057+0000","last_became_active":"2024-09-13T18:25:58.998044+0000","last_became_peered":"2024-09-13T18:25:58.998044+0000","last_unstale":"2024-09-13T18:25:59.388057+0000","last_undegraded":"2024-09-13T18:25:59.388057+0000","last_fullsized":"2024-09-13T18:25:59.388057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:12.887138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399828+0000","last_change":"2024-09-13T18:25:59.379632+0000","last_active":"2024-09-13T18:25:59.399828+0000","last_peered":"2024-09-13T18:25:59.399828+0000","last_clean":"2024-09-13T18:25:59.399828+0000","last_became_active":"2024-09-13T18:25:59.375852+0000","last_became_peered":"2024-09-13T18:25:59.375852+0000","last_unstale":"2024-09-13T18:25:59.399828+0000","last_undegraded":"2024-09-13T18:25:59.399828+0000","last_fullsized":"2024-09-13T18:25:59.399828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:16.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.390047+0000","last_change":"2024-09-13T18:25:58.981667+0000","last_active":"2024-09-13T18:25:59.390047+0000","last_peered":"2024-09-13T18:25:59.390047+0000","last_clean":"2024-09-13T18:25:59.390047+0000","last_became_active":"2024-09-13T18:25:58.981337+0000","last_became_peered":"2024-09-13T18:25:58.981337+0000","last_unstale":"2024-09-13T18:25:59.390047+0000","last_undegraded":"2024-09-13T18:25:59.390047+0000","last_fullsized":"2024-09-13T18:25:59.390047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:05.976740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.371373+0000","last_change":"2024-09-13T18:25:59.370675+0000","last_active":"2024-09-13T18:25:59.371373+0000","last_peered":"2024-09-13T18:25:59.371373+0000","last_clean":"2024-09-13T18:25:59.371373+0000","last_became_active":"2024-09-13T18:25:59.370394+0000","last_became_peered":"2024-09-13T18:25:59.370394+0000","last_unstale":"2024-09-13T18:25:59.371373+0000","last_undegraded":"2024-09-13T18:25:59.371373+0000","last_fullsized":"2024-09-13T18:25:59.371373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:25.931862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.394929+0000","last_change":"2024-09-13T18:25:58.983235+0000","last_active":"2024-09-13T18:25:59.394929+0000","last_peered":"2024-09-13T18:25:59.394929+0000","last_clean":"2024-09-13T18:25:59.394929+0000","last_became_active":"2024-09-13T18:25:58.982532+0000","last_became_peered":"2024-09-13T18:25:58.982532+0000","last_unstale":"2024-09-13T18:25:59.394929+0000","last_undegraded":"2024-09-13T18:25:59.394929+0000","last_fullsized":"2024-09-13T18:25:59.394929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:37.559158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364335+0000","last_change":"2024-09-13T18:25:59.361294+0000","last_active":"2024-09-13T18:25:59.364335+0000","last_peered":"2024-09-13T18:25:59.364335+0000","last_clean":"2024-09-13T18:25:59.364335+0000","last_became_active":"2024-09-13T18:25:59.359875+0000","last_became_peered":"2024-09-13T18:25:59.359875+0000","last_unstale":"2024-09-13T18:25:59.364335+0000","last_undegraded":"2024-09-13T18:25:59.364335+0000","last_fullsized":"2024-09-13T18:25:59.364335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343852+0000","last_change":"2024-09-13T18:25:58.988971+0000","last_active":"2024-09-13T18:25:59.343852+0000","last_peered":"2024-09-13T18:25:59.343852+0000","last_clean":"2024-09-13T18:25:59.343852+0000","last_became_active":"2024-09-13T18:25:58.988717+0000","last_became_peered":"2024-09-13T18:25:58.988717+0000","last_unstale":"2024-09-13T18:25:59.343852+0000","last_undegraded":"2024-09-13T18:25:59.343852+0000","last_fullsized":"2024-09-13T18:25:59.343852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:05.976740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400698+0000","last_change":"2024-09-13T18:25:59.398132+0000","last_active":"2024-09-13T18:25:59.400698+0000","last_peered":"2024-09-13T18:25:59.400698+0000","last_clean":"2024-09-13T18:25:59.400698+0000","last_became_active":"2024-09-13T18:25:59.397338+0000","last_became_peered":"2024-09-13T18:25:59.397338+0000","last_unstale":"2024-09-13T18:25:59.400698+0000","last_undegraded":"2024-09-13T18:25:59.400698+0000","last_fullsized":"2024-09-13T18:25:59.400698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:34.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.348037+0000","last_change":"2024-09-13T18:25:58.998749+0000","last_active":"2024-09-13T18:25:59.348037+0000","last_peered":"2024-09-13T18:25:59.348037+0000","last_clean":"2024-09-13T18:25:59.348037+0000","last_became_active":"2024-09-13T18:25:58.998340+0000","last_became_peered":"2024-09-13T18:25:58.998340+0000","last_unstale":"2024-09-13T18:25:59.348037+0000","last_undegraded":"2024-09-13T18:25:59.348037+0000","last_fullsized":"2024-09-13T18:25:59.348037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:20.785436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.397638+0000","last_change":"2024-09-13T18:25:59.391968+0000","last_active":"2024-09-13T18:25:59.397638+0000","last_peered":"2024-09-13T18:25:59.397638+0000","last_clean":"2024-09-13T18:25:59.397638+0000","last_became_active":"2024-09-13T18:25:59.391410+0000","last_became_peered":"2024-09-13T18:25:59.391410+0000","last_unstale":"2024-09-13T18:25:59.397638+0000","last_undegraded":"2024-09-13T18:25:59.397638+0000","last_fullsized":"2024-09-13T18:25:59.397638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:57.794873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.363931+0000","last_change":"2024-09-13T18:25:58.981895+0000","last_active":"2024-09-13T18:25:59.363931+0000","last_peered":"2024-09-13T18:25:59.363931+0000","last_clean":"2024-09-13T18:25:59.363931+0000","last_became_active":"2024-09-13T18:25:58.981428+0000","last_became_peered":"2024-09-13T18:25:58.981428+0000","last_unstale":"2024-09-13T18:25:59.363931+0000","last_undegraded":"2024-09-13T18:25:59.363931+0000","last_fullsized":"2024-09-13T18:25:59.363931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:57.115503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388202+0000","last_change":"2024-09-13T18:25:59.383991+0000","last_active":"2024-09-13T18:25:59.388202+0000","last_peered":"2024-09-13T18:25:59.388202+0000","last_clean":"2024-09-13T18:25:59.388202+0000","last_became_active":"2024-09-13T18:25:59.383232+0000","last_became_peered":"2024-09-13T18:25:59.383232+0000","last_unstale":"2024-09-13T18:25:59.388202+0000","last_undegraded":"2024-09-13T18:25:59.388202+0000","last_fullsized":"2024-09-13T18:25:59.388202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.360410+0000","last_change":"2024-09-13T18:25:58.982424+0000","last_active":"2024-09-13T18:25:59.360410+0000","last_peered":"2024-09-13T18:25:59.360410+0000","last_clean":"2024-09-13T18:25:59.360410+0000","last_became_active":"2024-09-13T18:25:58.982059+0000","last_became_peered":"2024-09-13T18:25:58.982059+0000","last_unstale":"2024-09-13T18:25:59.360410+0000","last_undegraded":"2024-09-13T18:25:59.360410+0000","last_fullsized":"2024-09-13T18:25:59.360410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:00.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401291+0000","last_change":"2024-09-13T18:25:59.395552+0000","last_active":"2024-09-13T18:25:59.401291+0000","last_peered":"2024-09-13T18:25:59.401291+0000","last_clean":"2024-09-13T18:25:59.401291+0000","last_became_active":"2024-09-13T18:25:59.389168+0000","last_became_peered":"2024-09-13T18:25:59.389168+0000","last_unstale":"2024-09-13T18:25:59.401291+0000","last_undegraded":"2024-09-13T18:25:59.401291+0000","last_fullsized":"2024-09-13T18:25:59.401291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:36.898349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.392357+0000","last_change":"2024-09-13T18:25:58.989851+0000","last_active":"2024-09-13T18:25:59.392357+0000","last_peered":"2024-09-13T18:25:59.392357+0000","last_clean":"2024-09-13T18:25:59.392357+0000","last_became_active":"2024-09-13T18:25:58.984294+0000","last_became_peered":"2024-09-13T18:25:58.984294+0000","last_unstale":"2024-09-13T18:25:59.392357+0000","last_undegraded":"2024-09-13T18:25:59.392357+0000","last_fullsized":"2024-09-13T18:25:59.392357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:10.506725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.371685+0000","last_change":"2024-09-13T18:25:59.371151+0000","last_active":"2024-09-13T18:25:59.371685+0000","last_peered":"2024-09-13T18:25:59.371685+0000","last_clean":"2024-09-13T18:25:59.371685+0000","last_became_active":"2024-09-13T18:25:59.370723+0000","last_became_peered":"2024-09-13T18:25:59.370723+0000","last_unstale":"2024-09-13T18:25:59.371685+0000","last_undegraded":"2024-09-13T18:25:59.371685+0000","last_fullsized":"2024-09-13T18:25:59.371685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388878+0000","last_change":"2024-09-13T18:25:58.983503+0000","last_active":"2024-09-13T18:25:59.388878+0000","last_peered":"2024-09-13T18:25:59.388878+0000","last_clean":"2024-09-13T18:25:59.388878+0000","last_became_active":"2024-09-13T18:25:58.982850+0000","last_became_peered":"2024-09-13T18:25:58.982850+0000","last_unstale":"2024-09-13T18:25:59.388878+0000","last_undegraded":"2024-09-13T18:25:59.388878+0000","last_fullsized":"2024-09-13T18:25:59.388878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:29.476297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.380597+0000","last_change":"2024-09-13T18:25:59.379007+0000","last_active":"2024-09-13T18:25:59.380597+0000","last_peered":"2024-09-13T18:25:59.380597+0000","last_clean":"2024-09-13T18:25:59.380597+0000","last_became_active":"2024-09-13T18:25:59.378755+0000","last_became_peered":"2024-09-13T18:25:59.378755+0000","last_unstale":"2024-09-13T18:25:59.380597+0000","last_undegraded":"2024-09-13T18:25:59.380597+0000","last_fullsized":"2024-09-13T18:25:59.380597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:58.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.350922+0000","last_change":"2024-09-13T18:25:58.980225+0000","last_active":"2024-09-13T18:25:59.350922+0000","last_peered":"2024-09-13T18:25:59.350922+0000","last_clean":"2024-09-13T18:25:59.350922+0000","last_became_active":"2024-09-13T18:25:58.979433+0000","last_became_peered":"2024-09-13T18:25:58.979433+0000","last_unstale":"2024-09-13T18:25:59.350922+0000","last_undegraded":"2024-09-13T18:25:59.350922+0000","last_fullsized":"2024-09-13T18:25:59.350922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:59.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.378814+0000","last_change":"2024-09-13T18:25:59.378184+0000","last_active":"2024-09-13T18:25:59.378814+0000","last_peered":"2024-09-13T18:25:59.378814+0000","last_clean":"2024-09-13T18:25:59.378814+0000","last_became_active":"2024-09-13T18:25:59.377931+0000","last_became_peered":"2024-09-13T18:25:59.377931+0000","last_unstale":"2024-09-13T18:25:59.378814+0000","last_undegraded":"2024-09-13T18:25:59.378814+0000","last_fullsized":"2024-09-13T18:25:59.378814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355519+0000","last_change":"2024-09-13T18:25:58.973899+0000","last_active":"2024-09-13T18:25:59.355519+0000","last_peered":"2024-09-13T18:25:59.355519+0000","last_clean":"2024-09-13T18:25:59.355519+0000","last_became_active":"2024-09-13T18:25:58.973610+0000","last_became_peered":"2024-09-13T18:25:58.973610+0000","last_unstale":"2024-09-13T18:25:59.355519+0000","last_undegraded":"2024-09-13T18:25:59.355519+0000","last_fullsized":"2024-09-13T18:25:59.355519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.631692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359869+0000","last_change":"2024-09-13T18:25:59.356477+0000","last_active":"2024-09-13T18:25:59.359869+0000","last_peered":"2024-09-13T18:25:59.359869+0000","last_clean":"2024-09-13T18:25:59.359869+0000","last_became_active":"2024-09-13T18:25:59.356179+0000","last_became_peered":"2024-09-13T18:25:59.356179+0000","last_unstale":"2024-09-13T18:25:59.359869+0000","last_undegraded":"2024-09-13T18:25:59.359869+0000","last_fullsized":"2024-09-13T18:25:59.359869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:06.985870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355025+0000","last_change":"2024-09-13T18:25:58.990081+0000","last_active":"2024-09-13T18:25:59.355025+0000","last_peered":"2024-09-13T18:25:59.355025+0000","last_clean":"2024-09-13T18:25:59.355025+0000","last_became_active":"2024-09-13T18:25:58.989472+0000","last_became_peered":"2024-09-13T18:25:58.989472+0000","last_unstale":"2024-09-13T18:25:59.355025+0000","last_undegraded":"2024-09-13T18:25:59.355025+0000","last_fullsized":"2024-09-13T18:25:59.355025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:23.910921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.354603+0000","last_change":"2024-09-13T18:25:59.353033+0000","last_active":"2024-09-13T18:25:59.354603+0000","last_peered":"2024-09-13T18:25:59.354603+0000","last_clean":"2024-09-13T18:25:59.354603+0000","last_became_active":"2024-09-13T18:25:59.352026+0000","last_became_peered":"2024-09-13T18:25:59.352026+0000","last_unstale":"2024-09-13T18:25:59.354603+0000","last_undegraded":"2024-09-13T18:25:59.354603+0000","last_fullsized":"2024-09-13T18:25:59.354603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:57.794873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.349834+0000","last_change":"2024-09-13T18:25:58.989859+0000","last_active":"2024-09-13T18:25:59.349834+0000","last_peered":"2024-09-13T18:25:59.349834+0000","last_clean":"2024-09-13T18:25:59.349834+0000","last_became_active":"2024-09-13T18:25:58.984063+0000","last_became_peered":"2024-09-13T18:25:58.984063+0000","last_unstale":"2024-09-13T18:25:59.349834+0000","last_undegraded":"2024-09-13T18:25:59.349834+0000","last_fullsized":"2024-09-13T18:25:59.349834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:47.216020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.398936+0000","last_change":"2024-09-13T18:25:59.390419+0000","last_active":"2024-09-13T18:25:59.398936+0000","last_peered":"2024-09-13T18:25:59.398936+0000","last_clean":"2024-09-13T18:25:59.398936+0000","last_became_active":"2024-09-13T18:25:59.389711+0000","last_became_peered":"2024-09-13T18:25:59.389711+0000","last_unstale":"2024-09-13T18:25:59.398936+0000","last_undegraded":"2024-09-13T18:25:59.398936+0000","last_fullsized":"2024-09-13T18:25:59.398936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.361791+0000","last_change":"2024-09-13T18:25:58.998927+0000","last_active":"2024-09-13T18:25:59.361791+0000","last_peered":"2024-09-13T18:25:59.361791+0000","last_clean":"2024-09-13T18:25:59.361791+0000","last_became_active":"2024-09-13T18:25:58.998344+0000","last_became_peered":"2024-09-13T18:25:58.998344+0000","last_unstale":"2024-09-13T18:25:59.361791+0000","last_undegraded":"2024-09-13T18:25:59.361791+0000","last_fullsized":"2024-09-13T18:25:59.361791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:25.736693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.377515+0000","last_change":"2024-09-13T18:25:59.376779+0000","last_active":"2024-09-13T18:25:59.377515+0000","last_peered":"2024-09-13T18:25:59.377515+0000","last_clean":"2024-09-13T18:25:59.377515+0000","last_became_active":"2024-09-13T18:25:59.376542+0000","last_became_peered":"2024-09-13T18:25:59.376542+0000","last_unstale":"2024-09-13T18:25:59.377515+0000","last_undegraded":"2024-09-13T18:25:59.377515+0000","last_fullsized":"2024-09-13T18:25:59.377515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:01.852826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379675+0000","last_change":"2024-09-13T18:25:58.988365+0000","last_active":"2024-09-13T18:25:59.379675+0000","last_peered":"2024-09-13T18:25:59.379675+0000","last_clean":"2024-09-13T18:25:59.379675+0000","last_became_active":"2024-09-13T18:25:58.988043+0000","last_became_peered":"2024-09-13T18:25:58.988043+0000","last_unstale":"2024-09-13T18:25:59.379675+0000","last_undegraded":"2024-09-13T18:25:59.379675+0000","last_fullsized":"2024-09-13T18:25:59.379675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:20.785436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400274+0000","last_change":"2024-09-13T18:25:59.384337+0000","last_active":"2024-09-13T18:25:59.400274+0000","last_peered":"2024-09-13T18:25:59.400274+0000","last_clean":"2024-09-13T18:25:59.400274+0000","last_became_active":"2024-09-13T18:25:59.383370+0000","last_became_peered":"2024-09-13T18:25:59.383370+0000","last_unstale":"2024-09-13T18:25:59.400274+0000","last_undegraded":"2024-09-13T18:25:59.400274+0000","last_fullsized":"2024-09-13T18:25:59.400274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:16.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343615+0000","last_change":"2024-09-13T18:25:58.976230+0000","last_active":"2024-09-13T18:25:59.343615+0000","last_peered":"2024-09-13T18:25:59.343615+0000","last_clean":"2024-09-13T18:25:59.343615+0000","last_became_active":"2024-09-13T18:25:58.975897+0000","last_became_peered":"2024-09-13T18:25:58.975897+0000","last_unstale":"2024-09-13T18:25:59.343615+0000","last_undegraded":"2024-09-13T18:25:59.343615+0000","last_fullsized":"2024-09-13T18:25:59.343615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:30.705530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359325+0000","last_change":"2024-09-13T18:25:59.355724+0000","last_active":"2024-09-13T18:25:59.359325+0000","last_peered":"2024-09-13T18:25:59.359325+0000","last_clean":"2024-09-13T18:25:59.359325+0000","last_became_active":"2024-09-13T18:25:59.355425+0000","last_became_peered":"2024-09-13T18:25:59.355425+0000","last_unstale":"2024-09-13T18:25:59.359325+0000","last_undegraded":"2024-09-13T18:25:59.359325+0000","last_fullsized":"2024-09-13T18:25:59.359325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:01.852826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.344696+0000","last_change":"2024-09-13T18:25:58.981182+0000","last_active":"2024-09-13T18:25:59.344696+0000","last_peered":"2024-09-13T18:25:59.344696+0000","last_clean":"2024-09-13T18:25:59.344696+0000","last_became_active":"2024-09-13T18:25:58.980859+0000","last_became_peered":"2024-09-13T18:25:58.980859+0000","last_unstale":"2024-09-13T18:25:59.344696+0000","last_undegraded":"2024-09-13T18:25:59.344696+0000","last_fullsized":"2024-09-13T18:25:59.344696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:57.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387364+0000","last_change":"2024-09-13T18:25:59.373924+0000","last_active":"2024-09-13T18:25:59.387364+0000","last_peered":"2024-09-13T18:25:59.387364+0000","last_clean":"2024-09-13T18:25:59.387364+0000","last_became_active":"2024-09-13T18:25:59.364742+0000","last_became_peered":"2024-09-13T18:25:59.364742+0000","last_unstale":"2024-09-13T18:25:59.387364+0000","last_undegraded":"2024-09-13T18:25:59.387364+0000","last_fullsized":"2024-09-13T18:25:59.387364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.344451+0000","last_change":"2024-09-13T18:25:58.987347+0000","last_active":"2024-09-13T18:25:59.344451+0000","last_peered":"2024-09-13T18:25:59.344451+0000","last_clean":"2024-09-13T18:25:59.344451+0000","last_became_active":"2024-09-13T18:25:58.986494+0000","last_became_peered":"2024-09-13T18:25:58.986494+0000","last_unstale":"2024-09-13T18:25:59.344451+0000","last_undegraded":"2024-09-13T18:25:59.344451+0000","last_fullsized":"2024-09-13T18:25:59.344451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:59.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364310+0000","last_change":"2024-09-13T18:25:59.363659+0000","last_active":"2024-09-13T18:25:59.364310+0000","last_peered":"2024-09-13T18:25:59.364310+0000","last_clean":"2024-09-13T18:25:59.364310+0000","last_became_active":"2024-09-13T18:25:59.363312+0000","last_became_peered":"2024-09-13T18:25:59.363312+0000","last_unstale":"2024-09-13T18:25:59.364310+0000","last_undegraded":"2024-09-13T18:25:59.364310+0000","last_fullsized":"2024-09-13T18:25:59.364310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:58.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343954+0000","last_change":"2024-09-13T18:25:58.988534+0000","last_active":"2024-09-13T18:25:59.343954+0000","last_peered":"2024-09-13T18:25:59.343954+0000","last_clean":"2024-09-13T18:25:59.343954+0000","last_became_active":"2024-09-13T18:25:58.988154+0000","last_became_peered":"2024-09-13T18:25:58.988154+0000","last_unstale":"2024-09-13T18:25:59.343954+0000","last_undegraded":"2024-09-13T18:25:59.343954+0000","last_fullsized":"2024-09-13T18:25:59.343954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364452+0000","last_change":"2024-09-13T18:25:59.361808+0000","last_active":"2024-09-13T18:25:59.364452+0000","last_peered":"2024-09-13T18:25:59.364452+0000","last_clean":"2024-09-13T18:25:59.364452+0000","last_became_active":"2024-09-13T18:25:59.359687+0000","last_became_peered":"2024-09-13T18:25:59.359687+0000","last_unstale":"2024-09-13T18:25:59.364452+0000","last_undegraded":"2024-09-13T18:25:59.364452+0000","last_fullsized":"2024-09-13T18:25:59.364452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:54.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.349884+0000","last_change":"2024-09-13T18:25:58.990259+0000","last_active":"2024-09-13T18:25:59.349884+0000","last_peered":"2024-09-13T18:25:59.349884+0000","last_clean":"2024-09-13T18:25:59.349884+0000","last_became_active":"2024-09-13T18:25:58.984916+0000","last_became_peered":"2024-09-13T18:25:58.984916+0000","last_unstale":"2024-09-13T18:25:59.349884+0000","last_undegraded":"2024-09-13T18:25:59.349884+0000","last_fullsized":"2024-09-13T18:25:59.349884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.631692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379528+0000","last_change":"2024-09-13T18:25:59.368698+0000","last_active":"2024-09-13T18:25:59.379528+0000","last_peered":"2024-09-13T18:25:59.379528+0000","last_clean":"2024-09-13T18:25:59.379528+0000","last_became_active":"2024-09-13T18:25:59.361486+0000","last_became_peered":"2024-09-13T18:25:59.361486+0000","last_unstale":"2024-09-13T18:25:59.379528+0000","last_undegraded":"2024-09-13T18:25:59.379528+0000","last_fullsized":"2024-09-13T18:25:59.379528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.282644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.350215+0000","last_change":"2024-09-13T18:25:58.998970+0000","last_active":"2024-09-13T18:25:59.350215+0000","last_peered":"2024-09-13T18:25:59.350215+0000","last_clean":"2024-09-13T18:25:59.350215+0000","last_became_active":"2024-09-13T18:25:58.998631+0000","last_became_peered":"2024-09-13T18:25:58.998631+0000","last_unstale":"2024-09-13T18:25:59.350215+0000","last_undegraded":"2024-09-13T18:25:59.350215+0000","last_fullsized":"2024-09-13T18:25:59.350215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:43.665827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399507+0000","last_change":"2024-09-13T18:25:59.394030+0000","last_active":"2024-09-13T18:25:59.399507+0000","last_peered":"2024-09-13T18:25:59.399507+0000","last_clean":"2024-09-13T18:25:59.399507+0000","last_became_active":"2024-09-13T18:25:59.393416+0000","last_became_peered":"2024-09-13T18:25:59.393416+0000","last_unstale":"2024-09-13T18:25:59.399507+0000","last_undegraded":"2024-09-13T18:25:59.399507+0000","last_fullsized":"2024-09-13T18:25:59.399507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:05.407745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.352360+0000","last_change":"2024-09-13T18:25:58.997800+0000","last_active":"2024-09-13T18:25:59.352360+0000","last_peered":"2024-09-13T18:25:59.352360+0000","last_clean":"2024-09-13T18:25:59.352360+0000","last_became_active":"2024-09-13T18:25:58.997114+0000","last_became_peered":"2024-09-13T18:25:58.997114+0000","last_unstale":"2024-09-13T18:25:59.352360+0000","last_undegraded":"2024-09-13T18:25:59.352360+0000","last_fullsized":"2024-09-13T18:25:59.352360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:06.781985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T18:25:58.993623+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:25:58.993623+0000","last_peered":"2024-09-13T18:25:58.993623+0000","last_clean":"2024-09-13T18:25:58.993623+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:25:58.993623+0000","last_undegraded":"2024-09-13T18:25:58.993623+0000","last_fullsized":"2024-09-13T18:25:58.993623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":736045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.012},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.194},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.093},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.1140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.069},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.0960000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.872},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.97499999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.125},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.0409999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.008},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.0740000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.085},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.034}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.441},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.879}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3,"5min":3,"15min":3},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":376832,"data_stored":145657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.502}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.90000000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.755},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.871},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.377}]},{"osd":3,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.439},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.76000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.497}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.22},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.92700000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.2989999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:26:02.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:26:02.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.535+0000 7ff2308cd640 1 Processor -- start 2024-09-13T18:26:02.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.535+0000 7ff2308cd640 1 -- start start 2024-09-13T18:26:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff2308cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff22c0cb980 0x7ff22c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff2308cd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff22c0cbd60 0x7ff22c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff2308cd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c0b1ac0 con 0x7ff22c06b850 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff2308cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c0b3010 con 0x7ff22c0cb980 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff2308cd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c159ac0 con 0x7ff22c0cbd60 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff22c0cb980 0x7ff22c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff229d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff22c06b850 0x7ff22c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60812/0 (socket says 172.21.15.53:60812) 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff229d9b640 1 -- 172.21.15.53:0/3036088126 learned_addr learned my addr 172.21.15.53:0/3036088126 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22ad9d640 1 --2- 172.21.15.53:0/3036088126 >> v2:172.21.15.87:3300/0 conn(0x7ff22c0cbd60 0x7ff22c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22959a640 1 -- 172.21.15.53:0/3036088126 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520199482 0 0) 0x7ff22c0b1ac0 con 0x7ff22c06b850 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22959a640 1 -- 172.21.15.53:0/3036088126 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff214003530 con 0x7ff22c06b850 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22a59c640 1 -- 172.21.15.53:0/3036088126 >> v2:172.21.15.87:3300/0 conn(0x7ff22c0cbd60 msgr2=0x7ff22c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22a59c640 1 --2- 172.21.15.53:0/3036088126 >> v2:172.21.15.87:3300/0 conn(0x7ff22c0cbd60 0x7ff22c0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22a59c640 1 -- 172.21.15.53:0/3036088126 >> v1:172.21.15.53:6789/0 conn(0x7ff22c06b850 legacy=0x7ff22c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22a59c640 1 -- 172.21.15.53:0/3036088126 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c159da0 con 0x7ff22c0cb980 2024-09-13T18:26:02.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22a59c640 1 --2- 172.21.15.53:0/3036088126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c0b33b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0709a0 tx=0x7ff21c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44781b2f40a2356a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22959a640 1 -- 172.21.15.53:0/3036088126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0ac620 con 0x7ff22c0cb980 2024-09-13T18:26:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22959a640 1 -- 172.21.15.53:0/3036088126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c0ac780 con 0x7ff22c0cb980 2024-09-13T18:26:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.539+0000 7ff22959a640 1 -- 172.21.15.53:0/3036088126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0acb10 con 0x7ff22c0cb980 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- 172.21.15.53:0/3036088126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 msgr2=0x7ff22c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3036088126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c0b33b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0709a0 tx=0x7ff21c01c3c0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- 172.21.15.53:0/3036088126 shutdown_connections 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3036088126 >> v2:172.21.15.87:3300/0 conn(0x7ff22c0cbd60 0x7ff22c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3036088126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c0b33b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- 172.21.15.53:0/3036088126 >> 172.21.15.53:0/3036088126 conn(0x7ff22c065c80 msgr2=0x7ff22c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- 172.21.15.53:0/3036088126 shutdown_connections 2024-09-13T18:26:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- 172.21.15.53:0/3036088126 wait complete. 2024-09-13T18:26:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 Processor -- start 2024-09-13T18:26:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- start start 2024-09-13T18:26:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff22c06b850 0x7ff22c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff22c0cbd60 0x7ff22c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c0ae680 con 0x7ff22c0cb980 2024-09-13T18:26:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c0ae960 con 0x7ff22c06b850 2024-09-13T18:26:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c0aec40 con 0x7ff22c0cbd60 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c1522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58752/0 (socket says 172.21.15.53:58752) 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 -- 172.21.15.53:0/3369529583 learned_addr learned my addr 172.21.15.53:0/3369529583 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff22ad9d640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff22c0cbd60 0x7ff22c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff22a59c640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff22c06b850 0x7ff22c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 -- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff22c0cbd60 msgr2=0x7ff22c1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff22c0cbd60 0x7ff22c1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 -- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff22c06b850 msgr2=0x7ff22c15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff22c06b850 0x7ff22c15c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 -- 172.21.15.53:0/3369529583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c009420 con 0x7ff22c0cb980 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff229d9b640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c1522b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c420 tx=0x7ff22000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff21affd640 1 -- 172.21.15.53:0/3369529583 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220005cf0 con 0x7ff22c0cb980 2024-09-13T18:26:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff21affd640 1 -- 172.21.15.53:0/3369529583 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220005e50 con 0x7ff22c0cb980 2024-09-13T18:26:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c0aef20 con 0x7ff22c0cb980 2024-09-13T18:26:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.543+0000 7ff21affd640 1 -- 172.21.15.53:0/3369529583 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2200072d0 con 0x7ff22c0cb980 2024-09-13T18:26:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.547+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c1527f0 con 0x7ff22c0cb980 2024-09-13T18:26:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.547+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c067400 con 0x7ff22c0cb980 2024-09-13T18:26:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.547+0000 7ff21affd640 1 -- 172.21.15.53:0/3369529583 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff220007430 con 0x7ff22c0cb980 2024-09-13T18:26:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.547+0000 7ff21affd640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff20c0666c0 0x7ff20c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.547+0000 7ff21affd640 1 -- 172.21.15.53:0/3369529583 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff220083610 con 0x7ff22c0cb980 2024-09-13T18:26:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.547+0000 7ff22a59c640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff20c0666c0 0x7ff20c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.547+0000 7ff22a59c640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff20c0666c0 0x7ff20c068b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0ae000 tx=0x7ff21c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.551+0000 7ff21affd640 1 -- 172.21.15.53:0/3369529583 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff220050ac0 con 0x7ff22c0cb980 2024-09-13T18:26:02.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.707+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff22c0b2ba0 con 0x7ff20c0666c0 2024-09-13T18:26:02.736 INFO:tasks.ceph.mds.c.smithi053.stderr:2024-09-13T18:26:02.731+0000 7f723f8c2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:26:02.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.731+0000 7ff21affd640 1 -- 172.21.15.53:0/3369529583 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288192 (secure 0 0 0) 0x7ff22c0b2ba0 con 0x7ff20c0666c0 2024-09-13T18:26:02.739 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:02.741 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:26:02.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff20c0666c0 msgr2=0x7ff20c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff20c0666c0 0x7ff20c068b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0ae000 tx=0x7ff21c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:26:02.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 msgr2=0x7ff22c1522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c1522b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c420 tx=0x7ff22000c8e0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 shutdown_connections 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff20c0666c0 0x7ff20c068b80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff22c0cbd60 0x7ff22c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff22c0cb980 0x7ff22c1522b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 --2- 172.21.15.53:0/3369529583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff22c06b850 0x7ff22c15c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 >> 172.21.15.53:0/3369529583 conn(0x7ff22c065c80 msgr2=0x7ff22c14a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 shutdown_connections 2024-09-13T18:26:02.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.735+0000 7ff2308cd640 1 -- 172.21.15.53:0/3369529583 wait complete. 2024-09-13T18:26:02.759 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-13T18:26:00.922138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236700,"kb_used_data":4124,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738020,"statfs":{"total":773094113280,"available":772851732480,"internally_reserved":0,"allocated":4222976,"data_stored":2343381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001153"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.394386+0000","last_change":"2024-09-13T18:25:59.386968+0000","last_active":"2024-09-13T18:25:59.394386+0000","last_peered":"2024-09-13T18:25:59.394386+0000","last_clean":"2024-09-13T18:25:59.394386+0000","last_became_active":"2024-09-13T18:25:59.386242+0000","last_became_peered":"2024-09-13T18:25:59.386242+0000","last_unstale":"2024-09-13T18:25:59.394386+0000","last_undegraded":"2024-09-13T18:25:59.394386+0000","last_fullsized":"2024-09-13T18:25:59.394386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:06.985870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364061+0000","last_change":"2024-09-13T18:25:59.357737+0000","last_active":"2024-09-13T18:25:59.364061+0000","last_peered":"2024-09-13T18:25:59.364061+0000","last_clean":"2024-09-13T18:25:59.364061+0000","last_became_active":"2024-09-13T18:25:59.357446+0000","last_became_peered":"2024-09-13T18:25:59.357446+0000","last_unstale":"2024-09-13T18:25:59.364061+0000","last_undegraded":"2024-09-13T18:25:59.364061+0000","last_fullsized":"2024-09-13T18:25:59.364061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:16.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399991+0000","last_change":"2024-09-13T18:25:59.382645+0000","last_active":"2024-09-13T18:25:59.399991+0000","last_peered":"2024-09-13T18:25:59.399991+0000","last_clean":"2024-09-13T18:25:59.399991+0000","last_became_active":"2024-09-13T18:25:59.375127+0000","last_became_peered":"2024-09-13T18:25:59.375127+0000","last_unstale":"2024-09-13T18:25:59.399991+0000","last_undegraded":"2024-09-13T18:25:59.399991+0000","last_fullsized":"2024-09-13T18:25:59.399991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:48.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355764+0000","last_change":"2024-09-13T18:25:59.352528+0000","last_active":"2024-09-13T18:25:59.355764+0000","last_peered":"2024-09-13T18:25:59.355764+0000","last_clean":"2024-09-13T18:25:59.355764+0000","last_became_active":"2024-09-13T18:25:59.352249+0000","last_became_peered":"2024-09-13T18:25:59.352249+0000","last_unstale":"2024-09-13T18:25:59.355764+0000","last_undegraded":"2024-09-13T18:25:59.355764+0000","last_fullsized":"2024-09-13T18:25:59.355764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:01.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359890+0000","last_change":"2024-09-13T18:25:59.358782+0000","last_active":"2024-09-13T18:25:59.359890+0000","last_peered":"2024-09-13T18:25:59.359890+0000","last_clean":"2024-09-13T18:25:59.359890+0000","last_became_active":"2024-09-13T18:25:59.358526+0000","last_became_peered":"2024-09-13T18:25:59.358526+0000","last_unstale":"2024-09-13T18:25:59.359890+0000","last_undegraded":"2024-09-13T18:25:59.359890+0000","last_fullsized":"2024-09-13T18:25:59.359890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:46.354918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.380618+0000","last_change":"2024-09-13T18:25:59.379766+0000","last_active":"2024-09-13T18:25:59.380618+0000","last_peered":"2024-09-13T18:25:59.380618+0000","last_clean":"2024-09-13T18:25:59.380618+0000","last_became_active":"2024-09-13T18:25:59.379476+0000","last_became_peered":"2024-09-13T18:25:59.379476+0000","last_unstale":"2024-09-13T18:25:59.380618+0000","last_undegraded":"2024-09-13T18:25:59.380618+0000","last_fullsized":"2024-09-13T18:25:59.380618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:42.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399337+0000","last_change":"2024-09-13T18:25:59.393216+0000","last_active":"2024-09-13T18:25:59.399337+0000","last_peered":"2024-09-13T18:25:59.399337+0000","last_clean":"2024-09-13T18:25:59.399337+0000","last_became_active":"2024-09-13T18:25:59.392535+0000","last_became_peered":"2024-09-13T18:25:59.392535+0000","last_unstale":"2024-09-13T18:25:59.399337+0000","last_undegraded":"2024-09-13T18:25:59.399337+0000","last_fullsized":"2024-09-13T18:25:59.399337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:01.909953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400662+0000","last_change":"2024-09-13T18:25:59.396761+0000","last_active":"2024-09-13T18:25:59.400662+0000","last_peered":"2024-09-13T18:25:59.400662+0000","last_clean":"2024-09-13T18:25:59.400662+0000","last_became_active":"2024-09-13T18:25:59.395779+0000","last_became_peered":"2024-09-13T18:25:59.395779+0000","last_unstale":"2024-09-13T18:25:59.400662+0000","last_undegraded":"2024-09-13T18:25:59.400662+0000","last_fullsized":"2024-09-13T18:25:59.400662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:42.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379079+0000","last_change":"2024-09-13T18:25:59.361597+0000","last_active":"2024-09-13T18:25:59.379079+0000","last_peered":"2024-09-13T18:25:59.379079+0000","last_clean":"2024-09-13T18:25:59.379079+0000","last_became_active":"2024-09-13T18:25:59.360818+0000","last_became_peered":"2024-09-13T18:25:59.360818+0000","last_unstale":"2024-09-13T18:25:59.379079+0000","last_undegraded":"2024-09-13T18:25:59.379079+0000","last_fullsized":"2024-09-13T18:25:59.379079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:17.327540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.360476+0000","last_change":"2024-09-13T18:25:59.359948+0000","last_active":"2024-09-13T18:25:59.360476+0000","last_peered":"2024-09-13T18:25:59.360476+0000","last_clean":"2024-09-13T18:25:59.360476+0000","last_became_active":"2024-09-13T18:25:59.359718+0000","last_became_peered":"2024-09-13T18:25:59.359718+0000","last_unstale":"2024-09-13T18:25:59.360476+0000","last_undegraded":"2024-09-13T18:25:59.360476+0000","last_fullsized":"2024-09-13T18:25:59.360476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:20.965667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.396476+0000","last_change":"2024-09-13T18:25:59.387485+0000","last_active":"2024-09-13T18:25:59.396476+0000","last_peered":"2024-09-13T18:25:59.396476+0000","last_clean":"2024-09-13T18:25:59.396476+0000","last_became_active":"2024-09-13T18:25:59.386649+0000","last_became_peered":"2024-09-13T18:25:59.386649+0000","last_unstale":"2024-09-13T18:25:59.396476+0000","last_undegraded":"2024-09-13T18:25:59.396476+0000","last_fullsized":"2024-09-13T18:25:59.396476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:14.082902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.385029+0000","last_change":"2024-09-13T18:25:59.371557+0000","last_active":"2024-09-13T18:25:59.385029+0000","last_peered":"2024-09-13T18:25:59.385029+0000","last_clean":"2024-09-13T18:25:59.385029+0000","last_became_active":"2024-09-13T18:25:59.370706+0000","last_became_peered":"2024-09-13T18:25:59.370706+0000","last_unstale":"2024-09-13T18:25:59.385029+0000","last_undegraded":"2024-09-13T18:25:59.385029+0000","last_fullsized":"2024-09-13T18:25:59.385029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.202182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.357166+0000","last_change":"2024-09-13T18:25:59.355197+0000","last_active":"2024-09-13T18:25:59.357166+0000","last_peered":"2024-09-13T18:25:59.357166+0000","last_clean":"2024-09-13T18:25:59.357166+0000","last_became_active":"2024-09-13T18:25:59.354899+0000","last_became_peered":"2024-09-13T18:25:59.354899+0000","last_unstale":"2024-09-13T18:25:59.357166+0000","last_undegraded":"2024-09-13T18:25:59.357166+0000","last_fullsized":"2024-09-13T18:25:59.357166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.568288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364120+0000","last_change":"2024-09-13T18:25:59.357772+0000","last_active":"2024-09-13T18:25:59.364120+0000","last_peered":"2024-09-13T18:25:59.364120+0000","last_clean":"2024-09-13T18:25:59.364120+0000","last_became_active":"2024-09-13T18:25:59.357460+0000","last_became_peered":"2024-09-13T18:25:59.357460+0000","last_unstale":"2024-09-13T18:25:59.364120+0000","last_undegraded":"2024-09-13T18:25:59.364120+0000","last_fullsized":"2024-09-13T18:25:59.364120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:34.169942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401180+0000","last_change":"2024-09-13T18:25:59.395948+0000","last_active":"2024-09-13T18:25:59.401180+0000","last_peered":"2024-09-13T18:25:59.401180+0000","last_clean":"2024-09-13T18:25:59.401180+0000","last_became_active":"2024-09-13T18:25:59.395346+0000","last_became_peered":"2024-09-13T18:25:59.395346+0000","last_unstale":"2024-09-13T18:25:59.401180+0000","last_undegraded":"2024-09-13T18:25:59.401180+0000","last_fullsized":"2024-09-13T18:25:59.401180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.587580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401169+0000","last_change":"2024-09-13T18:25:59.399550+0000","last_active":"2024-09-13T18:25:59.401169+0000","last_peered":"2024-09-13T18:25:59.401169+0000","last_clean":"2024-09-13T18:25:59.401169+0000","last_became_active":"2024-09-13T18:25:59.398046+0000","last_became_peered":"2024-09-13T18:25:59.398046+0000","last_unstale":"2024-09-13T18:25:59.401169+0000","last_undegraded":"2024-09-13T18:25:59.401169+0000","last_fullsized":"2024-09-13T18:25:59.401169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.202182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399166+0000","last_change":"2024-09-13T18:25:59.392173+0000","last_active":"2024-09-13T18:25:59.399166+0000","last_peered":"2024-09-13T18:25:59.399166+0000","last_clean":"2024-09-13T18:25:59.399166+0000","last_became_active":"2024-09-13T18:25:59.391304+0000","last_became_peered":"2024-09-13T18:25:59.391304+0000","last_unstale":"2024-09-13T18:25:59.399166+0000","last_undegraded":"2024-09-13T18:25:59.399166+0000","last_fullsized":"2024-09-13T18:25:59.399166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364275+0000","last_change":"2024-09-13T18:25:59.361108+0000","last_active":"2024-09-13T18:25:59.364275+0000","last_peered":"2024-09-13T18:25:59.364275+0000","last_clean":"2024-09-13T18:25:59.364275+0000","last_became_active":"2024-09-13T18:25:59.359846+0000","last_became_peered":"2024-09-13T18:25:59.359846+0000","last_unstale":"2024-09-13T18:25:59.364275+0000","last_undegraded":"2024-09-13T18:25:59.364275+0000","last_fullsized":"2024-09-13T18:25:59.364275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.587580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364080+0000","last_change":"2024-09-13T18:25:59.357792+0000","last_active":"2024-09-13T18:25:59.364080+0000","last_peered":"2024-09-13T18:25:59.364080+0000","last_clean":"2024-09-13T18:25:59.364080+0000","last_became_active":"2024-09-13T18:25:59.356368+0000","last_became_peered":"2024-09-13T18:25:59.356368+0000","last_unstale":"2024-09-13T18:25:59.364080+0000","last_undegraded":"2024-09-13T18:25:59.364080+0000","last_fullsized":"2024-09-13T18:25:59.364080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:00.202182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.376070+0000","last_change":"2024-09-13T18:25:59.375482+0000","last_active":"2024-09-13T18:25:59.376070+0000","last_peered":"2024-09-13T18:25:59.376070+0000","last_clean":"2024-09-13T18:25:59.376070+0000","last_became_active":"2024-09-13T18:25:59.375271+0000","last_became_peered":"2024-09-13T18:25:59.375271+0000","last_unstale":"2024-09-13T18:25:59.376070+0000","last_undegraded":"2024-09-13T18:25:59.376070+0000","last_fullsized":"2024-09-13T18:25:59.376070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:31.714659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387857+0000","last_change":"2024-09-13T18:25:59.378570+0000","last_active":"2024-09-13T18:25:59.387857+0000","last_peered":"2024-09-13T18:25:59.387857+0000","last_clean":"2024-09-13T18:25:59.387857+0000","last_became_active":"2024-09-13T18:25:59.371071+0000","last_became_peered":"2024-09-13T18:25:59.371071+0000","last_unstale":"2024-09-13T18:25:59.387857+0000","last_undegraded":"2024-09-13T18:25:59.387857+0000","last_fullsized":"2024-09-13T18:25:59.387857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:05.407745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.385514+0000","last_change":"2024-09-13T18:25:59.369902+0000","last_active":"2024-09-13T18:25:59.385514+0000","last_peered":"2024-09-13T18:25:59.385514+0000","last_clean":"2024-09-13T18:25:59.385514+0000","last_became_active":"2024-09-13T18:25:59.368919+0000","last_became_peered":"2024-09-13T18:25:59.368919+0000","last_unstale":"2024-09-13T18:25:59.385514+0000","last_undegraded":"2024-09-13T18:25:59.385514+0000","last_fullsized":"2024-09-13T18:25:59.385514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:59.810213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.378995+0000","last_change":"2024-09-13T18:25:59.378287+0000","last_active":"2024-09-13T18:25:59.378995+0000","last_peered":"2024-09-13T18:25:59.378995+0000","last_clean":"2024-09-13T18:25:59.378995+0000","last_became_active":"2024-09-13T18:25:59.377973+0000","last_became_peered":"2024-09-13T18:25:59.377973+0000","last_unstale":"2024-09-13T18:25:59.378995+0000","last_undegraded":"2024-09-13T18:25:59.378995+0000","last_fullsized":"2024-09-13T18:25:59.378995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:26.745822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.385054+0000","last_change":"2024-09-13T18:25:59.377757+0000","last_active":"2024-09-13T18:25:59.385054+0000","last_peered":"2024-09-13T18:25:59.385054+0000","last_clean":"2024-09-13T18:25:59.385054+0000","last_became_active":"2024-09-13T18:25:59.376993+0000","last_became_peered":"2024-09-13T18:25:59.376993+0000","last_unstale":"2024-09-13T18:25:59.385054+0000","last_undegraded":"2024-09-13T18:25:59.385054+0000","last_fullsized":"2024-09-13T18:25:59.385054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:44.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.378299+0000","last_change":"2024-09-13T18:25:59.377564+0000","last_active":"2024-09-13T18:25:59.378299+0000","last_peered":"2024-09-13T18:25:59.378299+0000","last_clean":"2024-09-13T18:25:59.378299+0000","last_became_active":"2024-09-13T18:25:59.377327+0000","last_became_peered":"2024-09-13T18:25:59.377327+0000","last_unstale":"2024-09-13T18:25:59.378299+0000","last_undegraded":"2024-09-13T18:25:59.378299+0000","last_fullsized":"2024-09-13T18:25:59.378299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379194+0000","last_change":"2024-09-13T18:25:59.377448+0000","last_active":"2024-09-13T18:25:59.379194+0000","last_peered":"2024-09-13T18:25:59.379194+0000","last_clean":"2024-09-13T18:25:59.379194+0000","last_became_active":"2024-09-13T18:25:59.377161+0000","last_became_peered":"2024-09-13T18:25:59.377161+0000","last_unstale":"2024-09-13T18:25:59.379194+0000","last_undegraded":"2024-09-13T18:25:59.379194+0000","last_fullsized":"2024-09-13T18:25:59.379194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:48.770088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.381770+0000","last_change":"2024-09-13T18:25:59.381015+0000","last_active":"2024-09-13T18:25:59.381770+0000","last_peered":"2024-09-13T18:25:59.381770+0000","last_clean":"2024-09-13T18:25:59.381770+0000","last_became_active":"2024-09-13T18:25:59.380762+0000","last_became_peered":"2024-09-13T18:25:59.380762+0000","last_unstale":"2024-09-13T18:25:59.381770+0000","last_undegraded":"2024-09-13T18:25:59.381770+0000","last_fullsized":"2024-09-13T18:25:59.381770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:42.542130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.382004+0000","last_change":"2024-09-13T18:25:59.367967+0000","last_active":"2024-09-13T18:25:59.382004+0000","last_peered":"2024-09-13T18:25:59.382004+0000","last_clean":"2024-09-13T18:25:59.382004+0000","last_became_active":"2024-09-13T18:25:59.367230+0000","last_became_peered":"2024-09-13T18:25:59.367230+0000","last_unstale":"2024-09-13T18:25:59.382004+0000","last_undegraded":"2024-09-13T18:25:59.382004+0000","last_fullsized":"2024-09-13T18:25:59.382004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:34.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387726+0000","last_change":"2024-09-13T18:25:59.376482+0000","last_active":"2024-09-13T18:25:59.387726+0000","last_peered":"2024-09-13T18:25:59.387726+0000","last_clean":"2024-09-13T18:25:59.387726+0000","last_became_active":"2024-09-13T18:25:59.370533+0000","last_became_peered":"2024-09-13T18:25:59.370533+0000","last_unstale":"2024-09-13T18:25:59.387726+0000","last_undegraded":"2024-09-13T18:25:59.387726+0000","last_fullsized":"2024-09-13T18:25:59.387726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:20.965667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399039+0000","last_change":"2024-09-13T18:25:59.390686+0000","last_active":"2024-09-13T18:25:59.399039+0000","last_peered":"2024-09-13T18:25:59.399039+0000","last_clean":"2024-09-13T18:25:59.399039+0000","last_became_active":"2024-09-13T18:25:59.389749+0000","last_became_peered":"2024-09-13T18:25:59.389749+0000","last_unstale":"2024-09-13T18:25:59.399039+0000","last_undegraded":"2024-09-13T18:25:59.399039+0000","last_fullsized":"2024-09-13T18:25:59.399039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:59.810213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364509+0000","last_change":"2024-09-13T18:25:59.359203+0000","last_active":"2024-09-13T18:25:59.364509+0000","last_peered":"2024-09-13T18:25:59.364509+0000","last_clean":"2024-09-13T18:25:59.364509+0000","last_became_active":"2024-09-13T18:25:59.358480+0000","last_became_peered":"2024-09-13T18:25:59.358480+0000","last_unstale":"2024-09-13T18:25:59.364509+0000","last_undegraded":"2024-09-13T18:25:59.364509+0000","last_fullsized":"2024-09-13T18:25:59.364509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.568288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401135+0000","last_change":"2024-09-13T18:25:59.398959+0000","last_active":"2024-09-13T18:25:59.401135+0000","last_peered":"2024-09-13T18:25:59.401135+0000","last_clean":"2024-09-13T18:25:59.401135+0000","last_became_active":"2024-09-13T18:25:59.397534+0000","last_became_peered":"2024-09-13T18:25:59.397534+0000","last_unstale":"2024-09-13T18:25:59.401135+0000","last_undegraded":"2024-09-13T18:25:59.401135+0000","last_fullsized":"2024-09-13T18:25:59.401135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:34.169942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.377628+0000","last_change":"2024-09-13T18:25:59.376836+0000","last_active":"2024-09-13T18:25:59.377628+0000","last_peered":"2024-09-13T18:25:59.377628+0000","last_clean":"2024-09-13T18:25:59.377628+0000","last_became_active":"2024-09-13T18:25:59.376557+0000","last_became_peered":"2024-09-13T18:25:59.376557+0000","last_unstale":"2024-09-13T18:25:59.377628+0000","last_undegraded":"2024-09-13T18:25:59.377628+0000","last_fullsized":"2024-09-13T18:25:59.377628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:44.674956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400898+0000","last_change":"2024-09-13T18:25:58.993903+0000","last_active":"2024-09-13T18:25:59.400898+0000","last_peered":"2024-09-13T18:25:59.400898+0000","last_clean":"2024-09-13T18:25:59.400898+0000","last_became_active":"2024-09-13T18:25:58.993267+0000","last_became_peered":"2024-09-13T18:25:58.993267+0000","last_unstale":"2024-09-13T18:25:59.400898+0000","last_undegraded":"2024-09-13T18:25:59.400898+0000","last_fullsized":"2024-09-13T18:25:59.400898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:29.476297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.396962+0000","last_change":"2024-09-13T18:25:59.391863+0000","last_active":"2024-09-13T18:25:59.396962+0000","last_peered":"2024-09-13T18:25:59.396962+0000","last_clean":"2024-09-13T18:25:59.396962+0000","last_became_active":"2024-09-13T18:25:59.391288+0000","last_became_peered":"2024-09-13T18:25:59.391288+0000","last_unstale":"2024-09-13T18:25:59.396962+0000","last_undegraded":"2024-09-13T18:25:59.396962+0000","last_fullsized":"2024-09-13T18:25:59.396962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:21.794565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355263+0000","last_change":"2024-09-13T18:25:58.998653+0000","last_active":"2024-09-13T18:25:59.355263+0000","last_peered":"2024-09-13T18:25:59.355263+0000","last_clean":"2024-09-13T18:25:59.355263+0000","last_became_active":"2024-09-13T18:25:58.998169+0000","last_became_peered":"2024-09-13T18:25:58.998169+0000","last_unstale":"2024-09-13T18:25:59.355263+0000","last_undegraded":"2024-09-13T18:25:59.355263+0000","last_fullsized":"2024-09-13T18:25:59.355263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:37.559158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379191+0000","last_change":"2024-09-13T18:25:59.368316+0000","last_active":"2024-09-13T18:25:59.379191+0000","last_peered":"2024-09-13T18:25:59.379191+0000","last_clean":"2024-09-13T18:25:59.379191+0000","last_became_active":"2024-09-13T18:25:59.360969+0000","last_became_peered":"2024-09-13T18:25:59.360969+0000","last_unstale":"2024-09-13T18:25:59.379191+0000","last_undegraded":"2024-09-13T18:25:59.379191+0000","last_fullsized":"2024-09-13T18:25:59.379191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:54.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359523+0000","last_change":"2024-09-13T18:25:58.981877+0000","last_active":"2024-09-13T18:25:59.359523+0000","last_peered":"2024-09-13T18:25:59.359523+0000","last_clean":"2024-09-13T18:25:59.359523+0000","last_became_active":"2024-09-13T18:25:58.981617+0000","last_became_peered":"2024-09-13T18:25:58.981617+0000","last_unstale":"2024-09-13T18:25:59.359523+0000","last_undegraded":"2024-09-13T18:25:59.359523+0000","last_fullsized":"2024-09-13T18:25:59.359523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.381781+0000","last_change":"2024-09-13T18:25:59.381146+0000","last_active":"2024-09-13T18:25:59.381781+0000","last_peered":"2024-09-13T18:25:59.381781+0000","last_clean":"2024-09-13T18:25:59.381781+0000","last_became_active":"2024-09-13T18:25:59.380815+0000","last_became_peered":"2024-09-13T18:25:59.380815+0000","last_unstale":"2024-09-13T18:25:59.381781+0000","last_undegraded":"2024-09-13T18:25:59.381781+0000","last_fullsized":"2024-09-13T18:25:59.381781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:34.169942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.357008+0000","last_change":"2024-09-13T18:25:58.979590+0000","last_active":"2024-09-13T18:25:59.357008+0000","last_peered":"2024-09-13T18:25:59.357008+0000","last_clean":"2024-09-13T18:25:59.357008+0000","last_became_active":"2024-09-13T18:25:58.979060+0000","last_became_peered":"2024-09-13T18:25:58.979060+0000","last_unstale":"2024-09-13T18:25:59.357008+0000","last_undegraded":"2024-09-13T18:25:59.357008+0000","last_fullsized":"2024-09-13T18:25:59.357008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:06.570791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.398998+0000","last_change":"2024-09-13T18:25:59.390319+0000","last_active":"2024-09-13T18:25:59.398998+0000","last_peered":"2024-09-13T18:25:59.398998+0000","last_clean":"2024-09-13T18:25:59.398998+0000","last_became_active":"2024-09-13T18:25:59.389049+0000","last_became_peered":"2024-09-13T18:25:59.389049+0000","last_unstale":"2024-09-13T18:25:59.398998+0000","last_undegraded":"2024-09-13T18:25:59.398998+0000","last_fullsized":"2024-09-13T18:25:59.398998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:20.965667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387914+0000","last_change":"2024-09-13T18:25:58.983230+0000","last_active":"2024-09-13T18:25:59.387914+0000","last_peered":"2024-09-13T18:25:59.387914+0000","last_clean":"2024-09-13T18:25:59.387914+0000","last_became_active":"2024-09-13T18:25:58.981624+0000","last_became_peered":"2024-09-13T18:25:58.981624+0000","last_unstale":"2024-09-13T18:25:59.387914+0000","last_undegraded":"2024-09-13T18:25:59.387914+0000","last_fullsized":"2024-09-13T18:25:59.387914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:30.705530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.382493+0000","last_change":"2024-09-13T18:25:59.373749+0000","last_active":"2024-09-13T18:25:59.382493+0000","last_peered":"2024-09-13T18:25:59.382493+0000","last_clean":"2024-09-13T18:25:59.382493+0000","last_became_active":"2024-09-13T18:25:59.371093+0000","last_became_peered":"2024-09-13T18:25:59.371093+0000","last_unstale":"2024-09-13T18:25:59.382493+0000","last_undegraded":"2024-09-13T18:25:59.382493+0000","last_fullsized":"2024-09-13T18:25:59.382493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.382984+0000","last_change":"2024-09-13T18:25:58.982737+0000","last_active":"2024-09-13T18:25:59.382984+0000","last_peered":"2024-09-13T18:25:59.382984+0000","last_clean":"2024-09-13T18:25:59.382984+0000","last_became_active":"2024-09-13T18:25:58.982075+0000","last_became_peered":"2024-09-13T18:25:58.982075+0000","last_unstale":"2024-09-13T18:25:59.382984+0000","last_undegraded":"2024-09-13T18:25:59.382984+0000","last_fullsized":"2024-09-13T18:25:59.382984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:45.345789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388082+0000","last_change":"2024-09-13T18:25:59.378691+0000","last_active":"2024-09-13T18:25:59.388082+0000","last_peered":"2024-09-13T18:25:59.388082+0000","last_clean":"2024-09-13T18:25:59.388082+0000","last_became_active":"2024-09-13T18:25:59.377978+0000","last_became_peered":"2024-09-13T18:25:59.377978+0000","last_unstale":"2024-09-13T18:25:59.388082+0000","last_undegraded":"2024-09-13T18:25:59.388082+0000","last_fullsized":"2024-09-13T18:25:59.388082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:25.931862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.347940+0000","last_change":"2024-09-13T18:25:58.985700+0000","last_active":"2024-09-13T18:25:59.347940+0000","last_peered":"2024-09-13T18:25:59.347940+0000","last_clean":"2024-09-13T18:25:59.347940+0000","last_became_active":"2024-09-13T18:25:58.981921+0000","last_became_peered":"2024-09-13T18:25:58.981921+0000","last_unstale":"2024-09-13T18:25:59.347940+0000","last_undegraded":"2024-09-13T18:25:59.347940+0000","last_fullsized":"2024-09-13T18:25:59.347940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:37.559158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.381205+0000","last_change":"2024-09-13T18:25:59.379821+0000","last_active":"2024-09-13T18:25:59.381205+0000","last_peered":"2024-09-13T18:25:59.381205+0000","last_clean":"2024-09-13T18:25:59.381205+0000","last_became_active":"2024-09-13T18:25:59.379555+0000","last_became_peered":"2024-09-13T18:25:59.379555+0000","last_unstale":"2024-09-13T18:25:59.381205+0000","last_undegraded":"2024-09-13T18:25:59.381205+0000","last_fullsized":"2024-09-13T18:25:59.381205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:34.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.349837+0000","last_change":"2024-09-13T18:25:58.991850+0000","last_active":"2024-09-13T18:25:59.349837+0000","last_peered":"2024-09-13T18:25:59.349837+0000","last_clean":"2024-09-13T18:25:59.349837+0000","last_became_active":"2024-09-13T18:25:58.991025+0000","last_became_peered":"2024-09-13T18:25:58.991025+0000","last_unstale":"2024-09-13T18:25:59.349837+0000","last_undegraded":"2024-09-13T18:25:59.349837+0000","last_fullsized":"2024-09-13T18:25:59.349837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:23.910921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.383606+0000","last_change":"2024-09-13T18:25:59.370257+0000","last_active":"2024-09-13T18:25:59.383606+0000","last_peered":"2024-09-13T18:25:59.383606+0000","last_clean":"2024-09-13T18:25:59.383606+0000","last_became_active":"2024-09-13T18:25:59.369456+0000","last_became_peered":"2024-09-13T18:25:59.369456+0000","last_unstale":"2024-09-13T18:25:59.383606+0000","last_undegraded":"2024-09-13T18:25:59.383606+0000","last_fullsized":"2024-09-13T18:25:59.383606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:14.082902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.348633+0000","last_change":"2024-09-13T18:25:58.995278+0000","last_active":"2024-09-13T18:25:59.348633+0000","last_peered":"2024-09-13T18:25:59.348633+0000","last_clean":"2024-09-13T18:25:59.348633+0000","last_became_active":"2024-09-13T18:25:58.994880+0000","last_became_peered":"2024-09-13T18:25:58.994880+0000","last_unstale":"2024-09-13T18:25:59.348633+0000","last_undegraded":"2024-09-13T18:25:59.348633+0000","last_fullsized":"2024-09-13T18:25:59.348633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:00.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364003+0000","last_change":"2024-09-13T18:25:59.357445+0000","last_active":"2024-09-13T18:25:59.364003+0000","last_peered":"2024-09-13T18:25:59.364003+0000","last_clean":"2024-09-13T18:25:59.364003+0000","last_became_active":"2024-09-13T18:25:59.356511+0000","last_became_peered":"2024-09-13T18:25:59.356511+0000","last_unstale":"2024-09-13T18:25:59.364003+0000","last_undegraded":"2024-09-13T18:25:59.364003+0000","last_fullsized":"2024-09-13T18:25:59.364003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:14.082902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343480+0000","last_change":"2024-09-13T18:25:58.983154+0000","last_active":"2024-09-13T18:25:59.343480+0000","last_peered":"2024-09-13T18:25:59.343480+0000","last_clean":"2024-09-13T18:25:59.343480+0000","last_became_active":"2024-09-13T18:25:58.982763+0000","last_became_peered":"2024-09-13T18:25:58.982763+0000","last_unstale":"2024-09-13T18:25:59.343480+0000","last_undegraded":"2024-09-13T18:25:59.343480+0000","last_fullsized":"2024-09-13T18:25:59.343480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:47.216020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.396088+0000","last_change":"2024-09-13T18:25:59.395482+0000","last_active":"2024-09-13T18:25:59.396088+0000","last_peered":"2024-09-13T18:25:59.396088+0000","last_clean":"2024-09-13T18:25:59.396088+0000","last_became_active":"2024-09-13T18:25:59.395182+0000","last_became_peered":"2024-09-13T18:25:59.395182+0000","last_unstale":"2024-09-13T18:25:59.396088+0000","last_undegraded":"2024-09-13T18:25:59.396088+0000","last_fullsized":"2024-09-13T18:25:59.396088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:44.868094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388057+0000","last_change":"2024-09-13T18:25:58.998724+0000","last_active":"2024-09-13T18:25:59.388057+0000","last_peered":"2024-09-13T18:25:59.388057+0000","last_clean":"2024-09-13T18:25:59.388057+0000","last_became_active":"2024-09-13T18:25:58.998044+0000","last_became_peered":"2024-09-13T18:25:58.998044+0000","last_unstale":"2024-09-13T18:25:59.388057+0000","last_undegraded":"2024-09-13T18:25:59.388057+0000","last_fullsized":"2024-09-13T18:25:59.388057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:12.887138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399828+0000","last_change":"2024-09-13T18:25:59.379632+0000","last_active":"2024-09-13T18:25:59.399828+0000","last_peered":"2024-09-13T18:25:59.399828+0000","last_clean":"2024-09-13T18:25:59.399828+0000","last_became_active":"2024-09-13T18:25:59.375852+0000","last_became_peered":"2024-09-13T18:25:59.375852+0000","last_unstale":"2024-09-13T18:25:59.399828+0000","last_undegraded":"2024-09-13T18:25:59.399828+0000","last_fullsized":"2024-09-13T18:25:59.399828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:16.521961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.390047+0000","last_change":"2024-09-13T18:25:58.981667+0000","last_active":"2024-09-13T18:25:59.390047+0000","last_peered":"2024-09-13T18:25:59.390047+0000","last_clean":"2024-09-13T18:25:59.390047+0000","last_became_active":"2024-09-13T18:25:58.981337+0000","last_became_peered":"2024-09-13T18:25:58.981337+0000","last_unstale":"2024-09-13T18:25:59.390047+0000","last_undegraded":"2024-09-13T18:25:59.390047+0000","last_fullsized":"2024-09-13T18:25:59.390047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:05.976740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.371373+0000","last_change":"2024-09-13T18:25:59.370675+0000","last_active":"2024-09-13T18:25:59.371373+0000","last_peered":"2024-09-13T18:25:59.371373+0000","last_clean":"2024-09-13T18:25:59.371373+0000","last_became_active":"2024-09-13T18:25:59.370394+0000","last_became_peered":"2024-09-13T18:25:59.370394+0000","last_unstale":"2024-09-13T18:25:59.371373+0000","last_undegraded":"2024-09-13T18:25:59.371373+0000","last_fullsized":"2024-09-13T18:25:59.371373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:25.931862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.394929+0000","last_change":"2024-09-13T18:25:58.983235+0000","last_active":"2024-09-13T18:25:59.394929+0000","last_peered":"2024-09-13T18:25:59.394929+0000","last_clean":"2024-09-13T18:25:59.394929+0000","last_became_active":"2024-09-13T18:25:58.982532+0000","last_became_peered":"2024-09-13T18:25:58.982532+0000","last_unstale":"2024-09-13T18:25:59.394929+0000","last_undegraded":"2024-09-13T18:25:59.394929+0000","last_fullsized":"2024-09-13T18:25:59.394929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:37.559158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364335+0000","last_change":"2024-09-13T18:25:59.361294+0000","last_active":"2024-09-13T18:25:59.364335+0000","last_peered":"2024-09-13T18:25:59.364335+0000","last_clean":"2024-09-13T18:25:59.364335+0000","last_became_active":"2024-09-13T18:25:59.359875+0000","last_became_peered":"2024-09-13T18:25:59.359875+0000","last_unstale":"2024-09-13T18:25:59.364335+0000","last_undegraded":"2024-09-13T18:25:59.364335+0000","last_fullsized":"2024-09-13T18:25:59.364335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343852+0000","last_change":"2024-09-13T18:25:58.988971+0000","last_active":"2024-09-13T18:25:59.343852+0000","last_peered":"2024-09-13T18:25:59.343852+0000","last_clean":"2024-09-13T18:25:59.343852+0000","last_became_active":"2024-09-13T18:25:58.988717+0000","last_became_peered":"2024-09-13T18:25:58.988717+0000","last_unstale":"2024-09-13T18:25:59.343852+0000","last_undegraded":"2024-09-13T18:25:59.343852+0000","last_fullsized":"2024-09-13T18:25:59.343852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:05.976740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400698+0000","last_change":"2024-09-13T18:25:59.398132+0000","last_active":"2024-09-13T18:25:59.400698+0000","last_peered":"2024-09-13T18:25:59.400698+0000","last_clean":"2024-09-13T18:25:59.400698+0000","last_became_active":"2024-09-13T18:25:59.397338+0000","last_became_peered":"2024-09-13T18:25:59.397338+0000","last_unstale":"2024-09-13T18:25:59.400698+0000","last_undegraded":"2024-09-13T18:25:59.400698+0000","last_fullsized":"2024-09-13T18:25:59.400698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:34.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.348037+0000","last_change":"2024-09-13T18:25:58.998749+0000","last_active":"2024-09-13T18:25:59.348037+0000","last_peered":"2024-09-13T18:25:59.348037+0000","last_clean":"2024-09-13T18:25:59.348037+0000","last_became_active":"2024-09-13T18:25:58.998340+0000","last_became_peered":"2024-09-13T18:25:58.998340+0000","last_unstale":"2024-09-13T18:25:59.348037+0000","last_undegraded":"2024-09-13T18:25:59.348037+0000","last_fullsized":"2024-09-13T18:25:59.348037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:20.785436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.397638+0000","last_change":"2024-09-13T18:25:59.391968+0000","last_active":"2024-09-13T18:25:59.397638+0000","last_peered":"2024-09-13T18:25:59.397638+0000","last_clean":"2024-09-13T18:25:59.397638+0000","last_became_active":"2024-09-13T18:25:59.391410+0000","last_became_peered":"2024-09-13T18:25:59.391410+0000","last_unstale":"2024-09-13T18:25:59.397638+0000","last_undegraded":"2024-09-13T18:25:59.397638+0000","last_fullsized":"2024-09-13T18:25:59.397638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:57.794873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.363931+0000","last_change":"2024-09-13T18:25:58.981895+0000","last_active":"2024-09-13T18:25:59.363931+0000","last_peered":"2024-09-13T18:25:59.363931+0000","last_clean":"2024-09-13T18:25:59.363931+0000","last_became_active":"2024-09-13T18:25:58.981428+0000","last_became_peered":"2024-09-13T18:25:58.981428+0000","last_unstale":"2024-09-13T18:25:59.363931+0000","last_undegraded":"2024-09-13T18:25:59.363931+0000","last_fullsized":"2024-09-13T18:25:59.363931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:57.115503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388202+0000","last_change":"2024-09-13T18:25:59.383991+0000","last_active":"2024-09-13T18:25:59.388202+0000","last_peered":"2024-09-13T18:25:59.388202+0000","last_clean":"2024-09-13T18:25:59.388202+0000","last_became_active":"2024-09-13T18:25:59.383232+0000","last_became_peered":"2024-09-13T18:25:59.383232+0000","last_unstale":"2024-09-13T18:25:59.388202+0000","last_undegraded":"2024-09-13T18:25:59.388202+0000","last_fullsized":"2024-09-13T18:25:59.388202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.360410+0000","last_change":"2024-09-13T18:25:58.982424+0000","last_active":"2024-09-13T18:25:59.360410+0000","last_peered":"2024-09-13T18:25:59.360410+0000","last_clean":"2024-09-13T18:25:59.360410+0000","last_became_active":"2024-09-13T18:25:58.982059+0000","last_became_peered":"2024-09-13T18:25:58.982059+0000","last_unstale":"2024-09-13T18:25:59.360410+0000","last_undegraded":"2024-09-13T18:25:59.360410+0000","last_fullsized":"2024-09-13T18:25:59.360410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:00.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.401291+0000","last_change":"2024-09-13T18:25:59.395552+0000","last_active":"2024-09-13T18:25:59.401291+0000","last_peered":"2024-09-13T18:25:59.401291+0000","last_clean":"2024-09-13T18:25:59.401291+0000","last_became_active":"2024-09-13T18:25:59.389168+0000","last_became_peered":"2024-09-13T18:25:59.389168+0000","last_unstale":"2024-09-13T18:25:59.401291+0000","last_undegraded":"2024-09-13T18:25:59.401291+0000","last_fullsized":"2024-09-13T18:25:59.401291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:36.898349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.392357+0000","last_change":"2024-09-13T18:25:58.989851+0000","last_active":"2024-09-13T18:25:59.392357+0000","last_peered":"2024-09-13T18:25:59.392357+0000","last_clean":"2024-09-13T18:25:59.392357+0000","last_became_active":"2024-09-13T18:25:58.984294+0000","last_became_peered":"2024-09-13T18:25:58.984294+0000","last_unstale":"2024-09-13T18:25:59.392357+0000","last_undegraded":"2024-09-13T18:25:59.392357+0000","last_fullsized":"2024-09-13T18:25:59.392357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:10.506725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.371685+0000","last_change":"2024-09-13T18:25:59.371151+0000","last_active":"2024-09-13T18:25:59.371685+0000","last_peered":"2024-09-13T18:25:59.371685+0000","last_clean":"2024-09-13T18:25:59.371685+0000","last_became_active":"2024-09-13T18:25:59.370723+0000","last_became_peered":"2024-09-13T18:25:59.370723+0000","last_unstale":"2024-09-13T18:25:59.371685+0000","last_undegraded":"2024-09-13T18:25:59.371685+0000","last_fullsized":"2024-09-13T18:25:59.371685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.388878+0000","last_change":"2024-09-13T18:25:58.983503+0000","last_active":"2024-09-13T18:25:59.388878+0000","last_peered":"2024-09-13T18:25:59.388878+0000","last_clean":"2024-09-13T18:25:59.388878+0000","last_became_active":"2024-09-13T18:25:58.982850+0000","last_became_peered":"2024-09-13T18:25:58.982850+0000","last_unstale":"2024-09-13T18:25:59.388878+0000","last_undegraded":"2024-09-13T18:25:59.388878+0000","last_fullsized":"2024-09-13T18:25:59.388878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:29.476297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.380597+0000","last_change":"2024-09-13T18:25:59.379007+0000","last_active":"2024-09-13T18:25:59.380597+0000","last_peered":"2024-09-13T18:25:59.380597+0000","last_clean":"2024-09-13T18:25:59.380597+0000","last_became_active":"2024-09-13T18:25:59.378755+0000","last_became_peered":"2024-09-13T18:25:59.378755+0000","last_unstale":"2024-09-13T18:25:59.380597+0000","last_undegraded":"2024-09-13T18:25:59.380597+0000","last_fullsized":"2024-09-13T18:25:59.380597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:58.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.350922+0000","last_change":"2024-09-13T18:25:58.980225+0000","last_active":"2024-09-13T18:25:59.350922+0000","last_peered":"2024-09-13T18:25:59.350922+0000","last_clean":"2024-09-13T18:25:59.350922+0000","last_became_active":"2024-09-13T18:25:58.979433+0000","last_became_peered":"2024-09-13T18:25:58.979433+0000","last_unstale":"2024-09-13T18:25:59.350922+0000","last_undegraded":"2024-09-13T18:25:59.350922+0000","last_fullsized":"2024-09-13T18:25:59.350922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:59.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.378814+0000","last_change":"2024-09-13T18:25:59.378184+0000","last_active":"2024-09-13T18:25:59.378814+0000","last_peered":"2024-09-13T18:25:59.378814+0000","last_clean":"2024-09-13T18:25:59.378814+0000","last_became_active":"2024-09-13T18:25:59.377931+0000","last_became_peered":"2024-09-13T18:25:59.377931+0000","last_unstale":"2024-09-13T18:25:59.378814+0000","last_undegraded":"2024-09-13T18:25:59.378814+0000","last_fullsized":"2024-09-13T18:25:59.378814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355519+0000","last_change":"2024-09-13T18:25:58.973899+0000","last_active":"2024-09-13T18:25:59.355519+0000","last_peered":"2024-09-13T18:25:59.355519+0000","last_clean":"2024-09-13T18:25:59.355519+0000","last_became_active":"2024-09-13T18:25:58.973610+0000","last_became_peered":"2024-09-13T18:25:58.973610+0000","last_unstale":"2024-09-13T18:25:59.355519+0000","last_undegraded":"2024-09-13T18:25:59.355519+0000","last_fullsized":"2024-09-13T18:25:59.355519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.631692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359869+0000","last_change":"2024-09-13T18:25:59.356477+0000","last_active":"2024-09-13T18:25:59.359869+0000","last_peered":"2024-09-13T18:25:59.359869+0000","last_clean":"2024-09-13T18:25:59.359869+0000","last_became_active":"2024-09-13T18:25:59.356179+0000","last_became_peered":"2024-09-13T18:25:59.356179+0000","last_unstale":"2024-09-13T18:25:59.359869+0000","last_undegraded":"2024-09-13T18:25:59.359869+0000","last_fullsized":"2024-09-13T18:25:59.359869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:06.985870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.355025+0000","last_change":"2024-09-13T18:25:58.990081+0000","last_active":"2024-09-13T18:25:59.355025+0000","last_peered":"2024-09-13T18:25:59.355025+0000","last_clean":"2024-09-13T18:25:59.355025+0000","last_became_active":"2024-09-13T18:25:58.989472+0000","last_became_peered":"2024-09-13T18:25:58.989472+0000","last_unstale":"2024-09-13T18:25:59.355025+0000","last_undegraded":"2024-09-13T18:25:59.355025+0000","last_fullsized":"2024-09-13T18:25:59.355025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:23.910921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.354603+0000","last_change":"2024-09-13T18:25:59.353033+0000","last_active":"2024-09-13T18:25:59.354603+0000","last_peered":"2024-09-13T18:25:59.354603+0000","last_clean":"2024-09-13T18:25:59.354603+0000","last_became_active":"2024-09-13T18:25:59.352026+0000","last_became_peered":"2024-09-13T18:25:59.352026+0000","last_unstale":"2024-09-13T18:25:59.354603+0000","last_undegraded":"2024-09-13T18:25:59.354603+0000","last_fullsized":"2024-09-13T18:25:59.354603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:57.794873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.349834+0000","last_change":"2024-09-13T18:25:58.989859+0000","last_active":"2024-09-13T18:25:59.349834+0000","last_peered":"2024-09-13T18:25:59.349834+0000","last_clean":"2024-09-13T18:25:59.349834+0000","last_became_active":"2024-09-13T18:25:58.984063+0000","last_became_peered":"2024-09-13T18:25:58.984063+0000","last_unstale":"2024-09-13T18:25:59.349834+0000","last_undegraded":"2024-09-13T18:25:59.349834+0000","last_fullsized":"2024-09-13T18:25:59.349834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:47.216020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.398936+0000","last_change":"2024-09-13T18:25:59.390419+0000","last_active":"2024-09-13T18:25:59.398936+0000","last_peered":"2024-09-13T18:25:59.398936+0000","last_clean":"2024-09-13T18:25:59.398936+0000","last_became_active":"2024-09-13T18:25:59.389711+0000","last_became_peered":"2024-09-13T18:25:59.389711+0000","last_unstale":"2024-09-13T18:25:59.398936+0000","last_undegraded":"2024-09-13T18:25:59.398936+0000","last_fullsized":"2024-09-13T18:25:59.398936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:43.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.361791+0000","last_change":"2024-09-13T18:25:58.998927+0000","last_active":"2024-09-13T18:25:59.361791+0000","last_peered":"2024-09-13T18:25:59.361791+0000","last_clean":"2024-09-13T18:25:59.361791+0000","last_became_active":"2024-09-13T18:25:58.998344+0000","last_became_peered":"2024-09-13T18:25:58.998344+0000","last_unstale":"2024-09-13T18:25:59.361791+0000","last_undegraded":"2024-09-13T18:25:59.361791+0000","last_fullsized":"2024-09-13T18:25:59.361791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:25.736693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.377515+0000","last_change":"2024-09-13T18:25:59.376779+0000","last_active":"2024-09-13T18:25:59.377515+0000","last_peered":"2024-09-13T18:25:59.377515+0000","last_clean":"2024-09-13T18:25:59.377515+0000","last_became_active":"2024-09-13T18:25:59.376542+0000","last_became_peered":"2024-09-13T18:25:59.376542+0000","last_unstale":"2024-09-13T18:25:59.377515+0000","last_undegraded":"2024-09-13T18:25:59.377515+0000","last_fullsized":"2024-09-13T18:25:59.377515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:01.852826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379675+0000","last_change":"2024-09-13T18:25:58.988365+0000","last_active":"2024-09-13T18:25:59.379675+0000","last_peered":"2024-09-13T18:25:59.379675+0000","last_clean":"2024-09-13T18:25:59.379675+0000","last_became_active":"2024-09-13T18:25:58.988043+0000","last_became_peered":"2024-09-13T18:25:58.988043+0000","last_unstale":"2024-09-13T18:25:59.379675+0000","last_undegraded":"2024-09-13T18:25:59.379675+0000","last_fullsized":"2024-09-13T18:25:59.379675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:20.785436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.400274+0000","last_change":"2024-09-13T18:25:59.384337+0000","last_active":"2024-09-13T18:25:59.400274+0000","last_peered":"2024-09-13T18:25:59.400274+0000","last_clean":"2024-09-13T18:25:59.400274+0000","last_became_active":"2024-09-13T18:25:59.383370+0000","last_became_peered":"2024-09-13T18:25:59.383370+0000","last_unstale":"2024-09-13T18:25:59.400274+0000","last_undegraded":"2024-09-13T18:25:59.400274+0000","last_fullsized":"2024-09-13T18:25:59.400274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:16.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343615+0000","last_change":"2024-09-13T18:25:58.976230+0000","last_active":"2024-09-13T18:25:59.343615+0000","last_peered":"2024-09-13T18:25:59.343615+0000","last_clean":"2024-09-13T18:25:59.343615+0000","last_became_active":"2024-09-13T18:25:58.975897+0000","last_became_peered":"2024-09-13T18:25:58.975897+0000","last_unstale":"2024-09-13T18:25:59.343615+0000","last_undegraded":"2024-09-13T18:25:59.343615+0000","last_fullsized":"2024-09-13T18:25:59.343615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:30.705530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.359325+0000","last_change":"2024-09-13T18:25:59.355724+0000","last_active":"2024-09-13T18:25:59.359325+0000","last_peered":"2024-09-13T18:25:59.359325+0000","last_clean":"2024-09-13T18:25:59.359325+0000","last_became_active":"2024-09-13T18:25:59.355425+0000","last_became_peered":"2024-09-13T18:25:59.355425+0000","last_unstale":"2024-09-13T18:25:59.359325+0000","last_undegraded":"2024-09-13T18:25:59.359325+0000","last_fullsized":"2024-09-13T18:25:59.359325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:01.852826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.344696+0000","last_change":"2024-09-13T18:25:58.981182+0000","last_active":"2024-09-13T18:25:59.344696+0000","last_peered":"2024-09-13T18:25:59.344696+0000","last_clean":"2024-09-13T18:25:59.344696+0000","last_became_active":"2024-09-13T18:25:58.980859+0000","last_became_peered":"2024-09-13T18:25:58.980859+0000","last_unstale":"2024-09-13T18:25:59.344696+0000","last_undegraded":"2024-09-13T18:25:59.344696+0000","last_fullsized":"2024-09-13T18:25:59.344696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:57.836491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.387364+0000","last_change":"2024-09-13T18:25:59.373924+0000","last_active":"2024-09-13T18:25:59.387364+0000","last_peered":"2024-09-13T18:25:59.387364+0000","last_clean":"2024-09-13T18:25:59.387364+0000","last_became_active":"2024-09-13T18:25:59.364742+0000","last_became_peered":"2024-09-13T18:25:59.364742+0000","last_unstale":"2024-09-13T18:25:59.387364+0000","last_undegraded":"2024-09-13T18:25:59.387364+0000","last_fullsized":"2024-09-13T18:25:59.387364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:58.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.344451+0000","last_change":"2024-09-13T18:25:58.987347+0000","last_active":"2024-09-13T18:25:59.344451+0000","last_peered":"2024-09-13T18:25:59.344451+0000","last_clean":"2024-09-13T18:25:59.344451+0000","last_became_active":"2024-09-13T18:25:58.986494+0000","last_became_peered":"2024-09-13T18:25:58.986494+0000","last_unstale":"2024-09-13T18:25:59.344451+0000","last_undegraded":"2024-09-13T18:25:59.344451+0000","last_fullsized":"2024-09-13T18:25:59.344451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:59.852728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364310+0000","last_change":"2024-09-13T18:25:59.363659+0000","last_active":"2024-09-13T18:25:59.364310+0000","last_peered":"2024-09-13T18:25:59.364310+0000","last_clean":"2024-09-13T18:25:59.364310+0000","last_became_active":"2024-09-13T18:25:59.363312+0000","last_became_peered":"2024-09-13T18:25:59.363312+0000","last_unstale":"2024-09-13T18:25:59.364310+0000","last_undegraded":"2024-09-13T18:25:59.364310+0000","last_fullsized":"2024-09-13T18:25:59.364310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:58.124632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.343954+0000","last_change":"2024-09-13T18:25:58.988534+0000","last_active":"2024-09-13T18:25:59.343954+0000","last_peered":"2024-09-13T18:25:59.343954+0000","last_clean":"2024-09-13T18:25:59.343954+0000","last_became_active":"2024-09-13T18:25:58.988154+0000","last_became_peered":"2024-09-13T18:25:58.988154+0000","last_unstale":"2024-09-13T18:25:59.343954+0000","last_undegraded":"2024-09-13T18:25:59.343954+0000","last_fullsized":"2024-09-13T18:25:59.343954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.364452+0000","last_change":"2024-09-13T18:25:59.361808+0000","last_active":"2024-09-13T18:25:59.364452+0000","last_peered":"2024-09-13T18:25:59.364452+0000","last_clean":"2024-09-13T18:25:59.364452+0000","last_became_active":"2024-09-13T18:25:59.359687+0000","last_became_peered":"2024-09-13T18:25:59.359687+0000","last_unstale":"2024-09-13T18:25:59.364452+0000","last_undegraded":"2024-09-13T18:25:59.364452+0000","last_fullsized":"2024-09-13T18:25:59.364452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:54.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.349884+0000","last_change":"2024-09-13T18:25:58.990259+0000","last_active":"2024-09-13T18:25:59.349884+0000","last_peered":"2024-09-13T18:25:59.349884+0000","last_clean":"2024-09-13T18:25:59.349884+0000","last_became_active":"2024-09-13T18:25:58.984916+0000","last_became_peered":"2024-09-13T18:25:58.984916+0000","last_unstale":"2024-09-13T18:25:59.349884+0000","last_undegraded":"2024-09-13T18:25:59.349884+0000","last_fullsized":"2024-09-13T18:25:59.349884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.631692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.379528+0000","last_change":"2024-09-13T18:25:59.368698+0000","last_active":"2024-09-13T18:25:59.379528+0000","last_peered":"2024-09-13T18:25:59.379528+0000","last_clean":"2024-09-13T18:25:59.379528+0000","last_became_active":"2024-09-13T18:25:59.361486+0000","last_became_peered":"2024-09-13T18:25:59.361486+0000","last_unstale":"2024-09-13T18:25:59.379528+0000","last_undegraded":"2024-09-13T18:25:59.379528+0000","last_fullsized":"2024-09-13T18:25:59.379528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:58.282644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.350215+0000","last_change":"2024-09-13T18:25:58.998970+0000","last_active":"2024-09-13T18:25:59.350215+0000","last_peered":"2024-09-13T18:25:59.350215+0000","last_clean":"2024-09-13T18:25:59.350215+0000","last_became_active":"2024-09-13T18:25:58.998631+0000","last_became_peered":"2024-09-13T18:25:58.998631+0000","last_unstale":"2024-09-13T18:25:59.350215+0000","last_undegraded":"2024-09-13T18:25:59.350215+0000","last_fullsized":"2024-09-13T18:25:59.350215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:43.665827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.399507+0000","last_change":"2024-09-13T18:25:59.394030+0000","last_active":"2024-09-13T18:25:59.399507+0000","last_peered":"2024-09-13T18:25:59.399507+0000","last_clean":"2024-09-13T18:25:59.399507+0000","last_became_active":"2024-09-13T18:25:59.393416+0000","last_became_peered":"2024-09-13T18:25:59.393416+0000","last_unstale":"2024-09-13T18:25:59.399507+0000","last_undegraded":"2024-09-13T18:25:59.399507+0000","last_fullsized":"2024-09-13T18:25:59.399507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:58.944655+0000","last_clean_scrub_stamp":"2024-09-13T18:25:58.944655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:05.407745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:25:59.352360+0000","last_change":"2024-09-13T18:25:58.997800+0000","last_active":"2024-09-13T18:25:59.352360+0000","last_peered":"2024-09-13T18:25:59.352360+0000","last_clean":"2024-09-13T18:25:59.352360+0000","last_became_active":"2024-09-13T18:25:58.997114+0000","last_became_peered":"2024-09-13T18:25:58.997114+0000","last_unstale":"2024-09-13T18:25:59.352360+0000","last_undegraded":"2024-09-13T18:25:59.352360+0000","last_fullsized":"2024-09-13T18:25:59.352360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:57.935526+0000","last_clean_scrub_stamp":"2024-09-13T18:25:57.935526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:06.781985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T18:25:58.993623+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:25:58.993623+0000","last_peered":"2024-09-13T18:25:58.993623+0000","last_clean":"2024-09-13T18:25:58.993623+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:25:58.993623+0000","last_undegraded":"2024-09-13T18:25:58.993623+0000","last_fullsized":"2024-09-13T18:25:58.993623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":736045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.012},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.194},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.093},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.1140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.069},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.0960000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.872},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.97499999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.125},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.0409999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.008},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.0740000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.085},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.034}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.441},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.879}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3,"5min":3,"15min":3},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.69499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":376832,"data_stored":145657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.502}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.90000000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.755},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.871},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":389120,"data_stored":147173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.377}]},{"osd":3,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.439},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.76000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":954368,"data_stored":729180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.497}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.22},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.92700000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.2989999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:26:02.764 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:26:02.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:26:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.931+0000 7f3b17f44640 1 Processor -- start 2024-09-13T18:26:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.931+0000 7f3b17f44640 1 -- start start 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b10157020 0x7f3b1006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b1006d270 0x7f3b1006f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1006d6e0 con 0x7f3b10156c40 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b100715f0 con 0x7f3b1006d270 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b100b15a0 con 0x7f3b10157020 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b1006d270 0x7f3b1006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b1006d270 0x7f3b1006f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58760/0 (socket says 172.21.15.53:58760) 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 -- 172.21.15.53:0/3446860240 learned_addr learned my addr 172.21.15.53:0/3446860240 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b154df640 1 --2- 172.21.15.53:0/3446860240 >> v2:172.21.15.87:3300/0 conn(0x7f3b10157020 0x7f3b1006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 -- 172.21.15.53:0/3446860240 >> v2:172.21.15.87:3300/0 conn(0x7f3b10157020 msgr2=0x7f3b1006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 --2- 172.21.15.53:0/3446860240 >> v2:172.21.15.87:3300/0 conn(0x7f3b10157020 0x7f3b1006cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 -- 172.21.15.53:0/3446860240 >> v1:172.21.15.87:6789/0 conn(0x7f3b10156c40 legacy=0x7f3b10070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 -- 172.21.15.53:0/3446860240 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b100b1880 con 0x7f3b1006d270 2024-09-13T18:26:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b164e1640 1 --2- 172.21.15.53:0/3446860240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b1006f330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3b100cae90 tx=0x7f3b0801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6f95621bb6099a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b14cde640 1 -- 172.21.15.53:0/3446860240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080aa610 con 0x7f3b1006d270 2024-09-13T18:26:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b14cde640 1 -- 172.21.15.53:0/3446860240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b080a6040 con 0x7f3b1006d270 2024-09-13T18:26:02.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b14cde640 1 -- 172.21.15.53:0/3446860240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080aa990 con 0x7f3b1006d270 2024-09-13T18:26:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- 172.21.15.53:0/3446860240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 msgr2=0x7f3b1006f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3446860240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b1006f330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3b100cae90 tx=0x7f3b0801c4b0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- 172.21.15.53:0/3446860240 shutdown_connections 2024-09-13T18:26:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3446860240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b1006f330 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3446860240 >> v2:172.21.15.87:3300/0 conn(0x7f3b10157020 0x7f3b1006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- 172.21.15.53:0/3446860240 >> 172.21.15.53:0/3446860240 conn(0x7f3b10065c80 msgr2=0x7f3b10066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- 172.21.15.53:0/3446860240 shutdown_connections 2024-09-13T18:26:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.935+0000 7f3b17f44640 1 -- 172.21.15.53:0/3446860240 wait complete. 2024-09-13T18:26:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 Processor -- start 2024-09-13T18:26:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 -- start start 2024-09-13T18:26:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b10150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b10156c40 0x7f3b1015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b1015c700 0x7f3b100ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b10159250 con 0x7f3b1006d270 2024-09-13T18:26:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b101586d0 con 0x7f3b10156c40 2024-09-13T18:26:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b101589b0 con 0x7f3b1015c700 2024-09-13T18:26:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b10150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b10150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58774/0 (socket says 172.21.15.53:58774) 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 -- 172.21.15.53:0/3374203934 learned_addr learned my addr 172.21.15.53:0/3374203934 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b164e1640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b1015c700 0x7f3b100ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b154df640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b10156c40 0x7f3b1015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 -- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b1015c700 msgr2=0x7f3b100ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b1015c700 0x7f3b100ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 -- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b10156c40 msgr2=0x7f3b1015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b10156c40 0x7f3b1015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 -- 172.21.15.53:0/3374203934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080094d0 con 0x7f3b1006d270 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b154df640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b10156c40 0x7f3b1015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b15ce0640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b10150cc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c7c0 tx=0x7f3b0c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b067fc640 1 -- 172.21.15.53:0/3374203934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00aa50 con 0x7f3b1006d270 2024-09-13T18:26:02.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b067fc640 1 -- 172.21.15.53:0/3374203934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00abb0 con 0x7f3b1006d270 2024-09-13T18:26:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b067fc640 1 -- 172.21.15.53:0/3374203934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c012420 con 0x7f3b1006d270 2024-09-13T18:26:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b10158c90 con 0x7f3b1006d270 2024-09-13T18:26:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b10151200 con 0x7f3b1006d270 2024-09-13T18:26:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.939+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b10153190 con 0x7f3b1006d270 2024-09-13T18:26:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.943+0000 7f3b067fc640 1 -- 172.21.15.53:0/3374203934 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b0c012580 con 0x7f3b1006d270 2024-09-13T18:26:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.943+0000 7f3b067fc640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3af40666c0 0x7f3af4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.943+0000 7f3b067fc640 1 -- 172.21.15.53:0/3374203934 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b0c084400 con 0x7f3b1006d270 2024-09-13T18:26:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.943+0000 7f3b154df640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3af40666c0 0x7f3af4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:02.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.943+0000 7f3b154df640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3af40666c0 0x7f3af4068b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3b00006fd0 tx=0x7f3b00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:02.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:02.947+0000 7f3b067fc640 1 -- 172.21.15.53:0/3374203934 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b10153190 con 0x7f3b1006d270 2024-09-13T18:26:03.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.163+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3b10153190 con 0x7f3b1006d270 2024-09-13T18:26:03.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.171+0000 7f3b067fc640 1 -- 172.21.15.53:0/3374203934 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3b10153190 con 0x7f3b1006d270 2024-09-13T18:26:03.177 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:26:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3af40666c0 msgr2=0x7f3af4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3af40666c0 0x7f3af4068b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3b00006fd0 tx=0x7f3b00008040 comp rx=0 tx=0).stop 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 msgr2=0x7f3b10150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b10150cc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c7c0 tx=0x7f3b0c00cc80 comp rx=0 tx=0).stop 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 shutdown_connections 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3af40666c0 0x7f3af4068b80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b1015c700 0x7f3b100ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b10156c40 0x7f3b1015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 --2- 172.21.15.53:0/3374203934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1006d270 0x7f3b10150cc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 >> 172.21.15.53:0/3374203934 conn(0x7f3b10065c80 msgr2=0x7f3b1014b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 shutdown_connections 2024-09-13T18:26:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.175+0000 7f3b17f44640 1 -- 172.21.15.53:0/3374203934 wait complete. 2024-09-13T18:26:03.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.303+0000 7f917d597640 1 Processor -- start 2024-09-13T18:26:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.303+0000 7f917d597640 1 -- start start 2024-09-13T18:26:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91780cc270 0x7f917815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f91780b1c10 0x7f91780b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917806f550 con 0x7f917815a470 2024-09-13T18:26:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917806f880 con 0x7f91780b1c10 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917815d1a0 con 0x7f91780cc270 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f9176ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f917815a470 0x7f9178071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60826/0 (socket says 172.21.15.53:60826) 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f9176ffd640 1 -- 172.21.15.53:0/2856771598 learned_addr learned my addr 172.21.15.53:0/2856771598 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f91777fe640 1 --2- 172.21.15.53:0/2856771598 >> v2:172.21.15.53:3300/0 conn(0x7f91780b1c10 0x7f91780b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f9175ffb640 1 -- 172.21.15.53:0/2856771598 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937044635 0 0) 0x7f917806f550 con 0x7f917815a470 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f9175ffb640 1 -- 172.21.15.53:0/2856771598 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9160003530 con 0x7f917815a470 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f91767fc640 1 --2- 172.21.15.53:0/2856771598 >> v2:172.21.15.87:3300/0 conn(0x7f91780cc270 0x7f917815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f91777fe640 1 -- 172.21.15.53:0/2856771598 >> v2:172.21.15.87:3300/0 conn(0x7f91780cc270 msgr2=0x7f917815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f91777fe640 1 --2- 172.21.15.53:0/2856771598 >> v2:172.21.15.87:3300/0 conn(0x7f91780cc270 0x7f917815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f91777fe640 1 -- 172.21.15.53:0/2856771598 >> v1:172.21.15.53:6789/0 conn(0x7f917815a470 legacy=0x7f9178071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f91777fe640 1 -- 172.21.15.53:0/2856771598 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917815dc40 con 0x7f91780b1c10 2024-09-13T18:26:03.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f91777fe640 1 --2- 172.21.15.53:0/2856771598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f91780b2080 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f917806d800 tx=0x7f917001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246ce9fac3377a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:03.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f9175ffb640 1 -- 172.21.15.53:0/2856771598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700a58e0 con 0x7f91780b1c10 2024-09-13T18:26:03.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f9175ffb640 1 -- 172.21.15.53:0/2856771598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91700a5a40 con 0x7f91780b1c10 2024-09-13T18:26:03.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f9175ffb640 1 -- 172.21.15.53:0/2856771598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700a5dd0 con 0x7f91780b1c10 2024-09-13T18:26:03.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- 172.21.15.53:0/2856771598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 msgr2=0x7f91780b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 --2- 172.21.15.53:0/2856771598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f91780b2080 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f917806d800 tx=0x7f917001c930 comp rx=0 tx=0).stop 2024-09-13T18:26:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- 172.21.15.53:0/2856771598 shutdown_connections 2024-09-13T18:26:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 --2- 172.21.15.53:0/2856771598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f91780b2080 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 --2- 172.21.15.53:0/2856771598 >> v2:172.21.15.87:3300/0 conn(0x7f91780cc270 0x7f917815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- 172.21.15.53:0/2856771598 >> 172.21.15.53:0/2856771598 conn(0x7f9178065c80 msgr2=0x7f9178066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- 172.21.15.53:0/2856771598 shutdown_connections 2024-09-13T18:26:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.307+0000 7f917d597640 1 -- 172.21.15.53:0/2856771598 wait complete. 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 Processor -- start 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 -- start start 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f9178155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91780cc270 0x7f91781590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f917815a470 0x7f91780cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178158c90 con 0x7f91780b1c10 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178150910 con 0x7f91780cc270 2024-09-13T18:26:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91781562e0 con 0x7f917815a470 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f9178155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f9178155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58804/0 (socket says 172.21.15.53:58804) 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 -- 172.21.15.53:0/977475904 learned_addr learned my addr 172.21.15.53:0/977475904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f91777fe640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f917815a470 0x7f91780cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f91767fc640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91780cc270 0x7f91781590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 -- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f917815a470 msgr2=0x7f91780cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f917815a470 0x7f91780cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 -- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91780cc270 msgr2=0x7f91781590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91780cc270 0x7f91781590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 -- 172.21.15.53:0/977475904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009a70 con 0x7f91780b1c10 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f91767fc640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91780cc270 0x7f91781590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f9176ffd640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f9178155da0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f916800c420 tx=0x7f916800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f915f7fe640 1 -- 172.21.15.53:0/977475904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168005cf0 con 0x7f91780b1c10 2024-09-13T18:26:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f915f7fe640 1 -- 172.21.15.53:0/977475904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9168005e50 con 0x7f91780b1c10 2024-09-13T18:26:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9178158010 con 0x7f91780b1c10 2024-09-13T18:26:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f915f7fe640 1 -- 172.21.15.53:0/977475904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91680072f0 con 0x7f91780b1c10 2024-09-13T18:26:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91781585d0 con 0x7f91780b1c10 2024-09-13T18:26:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9178067400 con 0x7f91780b1c10 2024-09-13T18:26:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.311+0000 7f915f7fe640 1 -- 172.21.15.53:0/977475904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9168007450 con 0x7f91780b1c10 2024-09-13T18:26:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.315+0000 7f915f7fe640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9164066690 0x7f9164068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.315+0000 7f915f7fe640 1 -- 172.21.15.53:0/977475904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9168083730 con 0x7f91780b1c10 2024-09-13T18:26:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.315+0000 7f91767fc640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9164066690 0x7f9164068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.315+0000 7f91767fc640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9164066690 0x7f9164068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9178157520 tx=0x7f916c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.319+0000 7f915f7fe640 1 -- 172.21.15.53:0/977475904 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9168050aa0 con 0x7f91780b1c10 2024-09-13T18:26:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91780b2080 con 0x7f91780b1c10 2024-09-13T18:26:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f915f7fe640 1 -- 172.21.15.53:0/977475904 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f9168017020 con 0x7f91780b1c10 2024-09-13T18:26:03.513 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:03.513 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3877303910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3877303910},{"type":"v1","addr":"172.21.15.87:6836","nonce":3877303910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1431925450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":1431925450},{"type":"v1","addr":"172.21.15.87:6837","nonce":1431925450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2751759497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2751759497},{"type":"v1","addr":"172.21.15.53:6834","nonce":2751759497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:25:59.336241+0000","modified":"2024-09-13T18:26:01.346568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5193":{"gid":5193,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2879083637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2879083637},{"type":"v1","addr":"172.21.15.53:6835","nonce":2879083637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:26:03.513 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2024-09-13T18:26:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9164066690 msgr2=0x7f9164068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9164066690 0x7f9164068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9178157520 tx=0x7f916c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 msgr2=0x7f9178155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f9178155da0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f916800c420 tx=0x7f916800c8e0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 shutdown_connections 2024-09-13T18:26:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9164066690 0x7f9164068b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f917815a470 0x7f91780cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91780cc270 0x7f91781590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 --2- 172.21.15.53:0/977475904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91780b1c10 0x7f9178155da0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 >> 172.21.15.53:0/977475904 conn(0x7f9178065c80 msgr2=0x7f9178066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 shutdown_connections 2024-09-13T18:26:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:03.507+0000 7f917d597640 1 -- 172.21.15.53:0/977475904 wait complete. 2024-09-13T18:26:03.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:25:59.336241+0000', 'modified': '2024-09-13T18:26:01.346568+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5193': {'gid': 5193, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/2879083637', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6833', 'nonce': 2879083637}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 2879083637}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:26:03.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:26:03.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:26:04.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f32a6640 1 Processor -- start 2024-09-13T18:26:04.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f32a6640 1 -- start start 2024-09-13T18:26:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f32a6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f97ec1582a0 0x7f97ec06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f32a6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f97ec15b7c0 0x7f97ec06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f32a6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec06d480 con 0x7f97ec070c90 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f32a6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec15aaf0 con 0x7f97ec1582a0 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f32a6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec06d760 con 0x7f97ec15b7c0 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f1042640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f97ec1582a0 0x7f97ec06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f1042640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f97ec1582a0 0x7f97ec06c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58812/0 (socket says 172.21.15.53:58812) 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.063+0000 7f97f1042640 1 -- 172.21.15.53:0/3082398021 learned_addr learned my addr 172.21.15.53:0/3082398021 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f0841640 1 --2- 172.21.15.53:0/3082398021 >> v2:172.21.15.87:3300/0 conn(0x7f97ec15b7c0 0x7f97ec06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f1042640 1 -- 172.21.15.53:0/3082398021 >> v2:172.21.15.87:3300/0 conn(0x7f97ec15b7c0 msgr2=0x7f97ec06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f1042640 1 --2- 172.21.15.53:0/3082398021 >> v2:172.21.15.87:3300/0 conn(0x7f97ec15b7c0 0x7f97ec06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f1042640 1 -- 172.21.15.53:0/3082398021 >> v1:172.21.15.87:6789/0 conn(0x7f97ec070c90 legacy=0x7f97ec06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f1042640 1 -- 172.21.15.53:0/3082398021 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec15ace0 con 0x7f97ec1582a0 2024-09-13T18:26:04.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f1042640 1 --2- 172.21.15.53:0/3082398021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec06c900 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0ce220 tx=0x7f97e801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfb4dfaf98e681f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97e3fff640 1 -- 172.21.15.53:0/3082398021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e80ac410 con 0x7f97ec1582a0 2024-09-13T18:26:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97e3fff640 1 -- 172.21.15.53:0/3082398021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80ac570 con 0x7f97ec1582a0 2024-09-13T18:26:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97e3fff640 1 -- 172.21.15.53:0/3082398021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e80ac900 con 0x7f97ec1582a0 2024-09-13T18:26:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 -- 172.21.15.53:0/3082398021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 msgr2=0x7f97ec06c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 --2- 172.21.15.53:0/3082398021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec06c900 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0ce220 tx=0x7f97e801c4b0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 -- 172.21.15.53:0/3082398021 shutdown_connections 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 --2- 172.21.15.53:0/3082398021 >> v2:172.21.15.87:3300/0 conn(0x7f97ec15b7c0 0x7f97ec06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 --2- 172.21.15.53:0/3082398021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec06c900 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 -- 172.21.15.53:0/3082398021 >> 172.21.15.53:0/3082398021 conn(0x7f97ec065c80 msgr2=0x7f97ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 -- 172.21.15.53:0/3082398021 shutdown_connections 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.067+0000 7f97f32a6640 1 -- 172.21.15.53:0/3082398021 wait complete. 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 Processor -- start 2024-09-13T18:26:04.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 -- start start 2024-09-13T18:26:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec070c90 0x7f97ec0cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec0cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97ec15b7c0 0x7f97ec14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec14f440 con 0x7f97ec1582a0 2024-09-13T18:26:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec156a20 con 0x7f97ec070c90 2024-09-13T18:26:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec156d00 con 0x7f97ec15b7c0 2024-09-13T18:26:04.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec0cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec0cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58816/0 (socket says 172.21.15.53:58816) 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 -- 172.21.15.53:0/1029459108 learned_addr learned my addr 172.21.15.53:0/1029459108 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f1042640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec070c90 0x7f97ec0cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f1843640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97ec15b7c0 0x7f97ec14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 -- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97ec15b7c0 msgr2=0x7f97ec14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97ec15b7c0 0x7f97ec14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 -- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec070c90 msgr2=0x7f97ec0cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec070c90 0x7f97ec0cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 -- 172.21.15.53:0/1029459108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80094d0 con 0x7f97ec1582a0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f0841640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec0cc4d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00d5f0 tx=0x7f97dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97e1ffb640 1 -- 172.21.15.53:0/1029459108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0125f0 con 0x7f97ec1582a0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97e1ffb640 1 -- 172.21.15.53:0/1029459108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc012750 con 0x7f97ec1582a0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec14f0d0 con 0x7f97ec1582a0 2024-09-13T18:26:04.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97e1ffb640 1 -- 172.21.15.53:0/1029459108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc012ae0 con 0x7f97ec1582a0 2024-09-13T18:26:04.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec156fe0 con 0x7f97ec1582a0 2024-09-13T18:26:04.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.071+0000 7f97e1ffb640 1 -- 172.21.15.53:0/1029459108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97dc012c40 con 0x7f97ec1582a0 2024-09-13T18:26:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97e1ffb640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97d0066690 0x7f97d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97e1ffb640 1 -- 172.21.15.53:0/1029459108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97dc084680 con 0x7f97ec1582a0 2024-09-13T18:26:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f1042640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97d0066690 0x7f97d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 Processor -- start 2024-09-13T18:26:04.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- start start 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f1042640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97d0066690 0x7f97d0068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97e80ae000 tx=0x7f97e8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e880bb1f0 0x557e880bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e88071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e88071740 0x557e88071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e87f39e80 con 0x557e880bbb10 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e87ec7af0 con 0x557e880bb1f0 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e87ec50c0 con 0x557e88071740 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e88071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e88071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58820/0 (socket says 172.21.15.53:58820) 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 -- 172.21.15.53:0/266938151 learned_addr learned my addr 172.21.15.53:0/266938151 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f1843640 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e88071740 0x557e88071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 -- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e88071740 msgr2=0x557e88071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e88071740 0x557e88071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 -- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e880bb1f0 msgr2=0x557e880bb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f1042640 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e880bb1f0 0x557e880bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e880bb1f0 0x557e880bb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 -- 172.21.15.53:0/266938151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e87bbc890 con 0x557e880bbb10 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f0841640 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e88071200 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97dc051bb0 tx=0x7f97dc055db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2be524a6f5ac63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97d6ffd640 1 -- 172.21.15.53:0/266938151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0594e0 con 0x557e880bbb10 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97d6ffd640 1 -- 172.21.15.53:0/266938151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc05daa0 con 0x557e880bbb10 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97d6ffd640 1 -- 172.21.15.53:0/266938151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc059170 con 0x557e880bbb10 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- 172.21.15.53:0/266938151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 msgr2=0x557e88071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e88071200 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97dc051bb0 tx=0x7f97dc055db0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- 172.21.15.53:0/266938151 shutdown_connections 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e88071740 0x557e88071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e88071200 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 --2- 172.21.15.53:0/266938151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e880bb1f0 0x557e880bb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- 172.21.15.53:0/266938151 >> 172.21.15.53:0/266938151 conn(0x557e88077fb0 msgr2=0x557e88078390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- 172.21.15.53:0/266938151 shutdown_connections 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.075+0000 7f97f63ef000 1 -- 172.21.15.53:0/266938151 wait complete. 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- start start 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 Processor -- start 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8807cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bb1f0 0x557e8807d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bbb10 0x557e8807da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e87ec09b0 con 0x557e880bb1f0 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e87e5fc00 con 0x557e88071740 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e87e7e070 con 0x557e880bbb10 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 10 client.0 _ll_register_callbacks cb 0x557e8805dae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bb1f0 0x557e8807d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bb1f0 0x557e8807d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58824/0 (socket says 172.21.15.53:58824) 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 -- 172.21.15.53:0/2177606239 learned_addr learned my addr 172.21.15.53:0/2177606239 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f1042640 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8807cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f1843640 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bbb10 0x557e8807da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 -- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bbb10 msgr2=0x557e8807da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bbb10 0x557e8807da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 -- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 msgr2=0x557e8807cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8807cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 -- 172.21.15.53:0/2177606239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec156fe0 con 0x557e880bb1f0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f0841640 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bb1f0 0x557e8807d4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00d5c0 tx=0x7f97dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc265c6e4466b5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 1 -- 172.21.15.53:0/2177606239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc051dc0 con 0x557e880bb1f0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 1 -- 172.21.15.53:0/2177606239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97dc051f20 con 0x557e880bb1f0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e87e7d5f0 con 0x557e880bb1f0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 1 -- 172.21.15.53:0/2177606239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97dc054ba0 con 0x557e880bb1f0 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 10 client.5391 fetch_fsmap learned FSMap version 13 2024-09-13T18:26:04.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x557e87e85ab0 con 0x557e880bb1f0 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 1 -- 172.21.15.53:0/2177606239 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc077070 con 0x557e880bb1f0 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 1 -- 172.21.15.53:0/2177606239 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f97dc05d610 con 0x557e880bb1f0 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 10 client.5391 fetch_fsmap finished waiting for FSMap version 13 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 10 client.5391 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 20 client.5391 populate_metadata read hostname 'smithi053' 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8807e440 0x557e880cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 4 client.5391 mds_command: new command op to 5193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 --> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e87ebd790 con 0x557e8807e440 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f1042640 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8807e440 0x557e880cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f1042640 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8807e440 0x557e880cd2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0f75878f9c8e4d0 server_cookie=60c55372f2bf621a in_seq=0 out_seq=0 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 10 client.5391 ms_handle_connect on v2:172.21.15.53:6833/2879083637 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 1 -- 172.21.15.53:0/2177606239 <== mds.0 v2:172.21.15.53:6833/2879083637 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x557e87ebd790 con 0x557e8807e440 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 10 client.5391 handle_command_reply: tid=0 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 client.5391 shutdown 2024-09-13T18:26:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bb1f0 msgr2=0x557e8807d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bb1f0 0x557e8807d4f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00d5c0 tx=0x7f97dc000bd0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 shutdown_connections 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8807e440 0x557e880cd2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bbb10 0x557e8807da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bb1f0 0x557e8807d4f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97cbfff640 0 client.5391 ms_handle_reset on v2:172.21.15.53:6833/2879083637 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2177606239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8807cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 >> 172.21.15.53:0/2177606239 conn(0x557e88077fb0 msgr2=0x557e880701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 shutdown_connections 2024-09-13T18:26:04.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.079+0000 7f97f63ef000 1 -- 172.21.15.53:0/2177606239 wait complete. 2024-09-13T18:26:04.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.083+0000 7f97f63ef000 20 client.5391 trim_cache size 0 max 16384 2024-09-13T18:26:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.095+0000 7f97f63ef000 1 Processor -- start 2024-09-13T18:26:04.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.095+0000 7f97f63ef000 1 -- start start 2024-09-13T18:26:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e87b7d940 con 0x557e880bbb10 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88074590 con 0x557e88071740 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e87e87c60 con 0x557e880bb1f0 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58834/0 (socket says 172.21.15.53:58834) 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/2812300335 learned_addr learned my addr 172.21.15.53:0/2812300335 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f0841640 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1042640 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 msgr2=0x557e8811bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 msgr2=0x557e8811b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/2812300335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e87e6bc00 con 0x557e880bbb10 2024-09-13T18:26:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f0841640 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811c1c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f97e4005470 tx=0x7f97e4005930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461135270f2da0be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97d77fe640 1 -- 172.21.15.53:0/2812300335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011dc0 con 0x557e880bbb10 2024-09-13T18:26:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97d77fe640 1 -- 172.21.15.53:0/2812300335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e400d050 con 0x557e880bbb10 2024-09-13T18:26:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97d77fe640 1 -- 172.21.15.53:0/2812300335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40166b0 con 0x557e880bbb10 2024-09-13T18:26:04.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- 172.21.15.53:0/2812300335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 msgr2=0x557e8811c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811c1c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f97e4005470 tx=0x7f97e4005930 comp rx=0 tx=0).stop 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- 172.21.15.53:0/2812300335 shutdown_connections 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811c1c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- 172.21.15.53:0/2812300335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- 172.21.15.53:0/2812300335 >> 172.21.15.53:0/2812300335 conn(0x557e88077fb0 msgr2=0x557e8806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- 172.21.15.53:0/2812300335 shutdown_connections 2024-09-13T18:26:04.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- 172.21.15.53:0/2812300335 wait complete. 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- start start 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 Processor -- start 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e880696d0 con 0x557e880bbb10 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8807d1e0 con 0x557e88071740 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x557e87e5dc10 con 0x557e880bb1f0 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f63ef000 10 client.0 _ll_register_callbacks cb 0x7f97dc0519f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:26:04.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58842/0 (socket says 172.21.15.53:58842) 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/3012479426 learned_addr learned my addr 172.21.15.53:0/3012479426 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f0841640 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1042640 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 msgr2=0x557e8811db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 msgr2=0x557e8811d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.099+0000 7f97f1843640 1 -- 172.21.15.53:0/3012479426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e40050a0 con 0x557e880bbb10 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f1843640 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811e0b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x557e87f0bf10 tx=0x7f97e4003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f03f6371e250b04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 1 -- 172.21.15.53:0/3012479426 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4029680 con 0x557e880bbb10 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 1 -- 172.21.15.53:0/3012479426 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97e40297e0 con 0x557e880bbb10 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e87e90460 con 0x557e880bbb10 2024-09-13T18:26:04.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 1 -- 172.21.15.53:0/3012479426 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97e40299e0 con 0x557e880bbb10 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 10 client.5397 fetch_fsmap learned FSMap version 13 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x557e87bbccc0 con 0x557e880bbb10 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 1 -- 172.21.15.53:0/3012479426 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557e87e90460 con 0x557e880bbb10 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 1 -- 172.21.15.53:0/3012479426 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f97e4029b40 con 0x557e880bbb10 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 10 client.5397 fetch_fsmap finished waiting for FSMap version 13 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 10 client.5397 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 20 client.5397 populate_metadata read hostname 'smithi053' 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8811e5f0 0x557e8811e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 4 client.5397 mds_command: new command op to 5193 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 --> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557e87e899c0 con 0x557e8811e5f0 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f1042640 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8811e5f0 0x557e8811e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 10 client.5397 ms_handle_connect on v2:172.21.15.53:6833/2879083637 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f1042640 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8811e5f0 0x557e8811e9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=854f9341415d2813 server_cookie=ed1835886c68184b in_seq=0 out_seq=0 2024-09-13T18:26:04.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 1 -- 172.21.15.53:0/3012479426 <== mds.0 v2:172.21.15.53:6833/2879083637 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557e87e899c0 con 0x557e8811e5f0 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 10 client.5397 handle_command_reply: tid=0 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 client.5397 shutdown 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 msgr2=0x557e8811e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811e0b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x557e87f0bf10 tx=0x7f97e4003a80 comp rx=0 tx=0).stop 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 shutdown_connections 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:6833/2879083637,v1:172.21.15.53:6835/2879083637] conn(0x557e8811e5f0 0x557e8811e9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x557e880bb1f0 0x557e8811db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e880bbb10 0x557e8811e0b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97cbfff640 0 client.5397 ms_handle_reset on v2:172.21.15.53:6833/2879083637 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 --2- 172.21.15.53:0/3012479426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x557e88071740 0x557e8811d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 >> 172.21.15.53:0/3012479426 conn(0x557e88077fb0 msgr2=0x557e880701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 shutdown_connections 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 1 -- 172.21.15.53:0/3012479426 wait complete. 2024-09-13T18:26:04.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f63ef000 20 client.5397 trim_cache size 0 max 16384 2024-09-13T18:26:04.118 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:26:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:26:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:26:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5193, 2024-09-13T18:26:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:26:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:26:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:26:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 4.7694225929999998, 2024-09-13T18:26:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 13, 2024-09-13T18:26:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 34, 2024-09-13T18:26:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 34, 2024-09-13T18:26:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 12.227298311 2024-09-13T18:26:04.119 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97d0066690 msgr2=0x7f97d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97d0066690 0x7f97d0068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97e80ae000 tx=0x7f97e8008040 comp rx=0 tx=0).stop 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 msgr2=0x7f97ec0cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec0cc4d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00d5f0 tx=0x7f97dc00dab0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 shutdown_connections 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97d0066690 0x7f97d0068b50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97ec15b7c0 0x7f97ec14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97ec1582a0 0x7f97ec0cc4d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 --2- 172.21.15.53:0/1029459108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97ec070c90 0x7f97ec0cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 >> 172.21.15.53:0/1029459108 conn(0x7f97ec065c80 msgr2=0x7f97ec0cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 shutdown_connections 2024-09-13T18:26:04.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.103+0000 7f97f32a6640 1 -- 172.21.15.53:0/1029459108 wait complete. 2024-09-13T18:26:04.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:26:04.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.227+0000 7fca35554640 1 Processor -- start 2024-09-13T18:26:04.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.227+0000 7fca35554640 1 -- start start 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cb980 0x7fca300b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca3006b850 0x7fca300cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300b1ac0 con 0x7fca300cbd60 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca300b3010 con 0x7fca3006b850 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca30159ac0 con 0x7fca300cb980 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca3006b850 0x7fca300cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca3006b850 0x7fca300cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58858/0 (socket says 172.21.15.53:58858) 2024-09-13T18:26:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 -- 172.21.15.53:0/3665225711 learned_addr learned my addr 172.21.15.53:0/3665225711 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2effd640 1 --2- 172.21.15.53:0/3665225711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cb980 0x7fca300b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 -- 172.21.15.53:0/3665225711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cb980 msgr2=0x7fca300b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 --2- 172.21.15.53:0/3665225711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cb980 0x7fca300b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 -- 172.21.15.53:0/3665225711 >> v1:172.21.15.87:6789/0 conn(0x7fca300cbd60 legacy=0x7fca3006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 -- 172.21.15.53:0/3665225711 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30159da0 con 0x7fca3006b850 2024-09-13T18:26:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2e7fc640 1 --2- 172.21.15.53:0/3665225711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca300cdd40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fca180098a0 tx=0x7fca1801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395685cfd980736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2dffb640 1 -- 172.21.15.53:0/3665225711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180ab600 con 0x7fca3006b850 2024-09-13T18:26:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2dffb640 1 -- 172.21.15.53:0/3665225711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca180ab760 con 0x7fca3006b850 2024-09-13T18:26:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca2dffb640 1 -- 172.21.15.53:0/3665225711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180abaf0 con 0x7fca3006b850 2024-09-13T18:26:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- 172.21.15.53:0/3665225711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 msgr2=0x7fca300cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 --2- 172.21.15.53:0/3665225711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca300cdd40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fca180098a0 tx=0x7fca1801c440 comp rx=0 tx=0).stop 2024-09-13T18:26:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- 172.21.15.53:0/3665225711 shutdown_connections 2024-09-13T18:26:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 --2- 172.21.15.53:0/3665225711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca300cdd40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 --2- 172.21.15.53:0/3665225711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cb980 0x7fca300b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- 172.21.15.53:0/3665225711 >> 172.21.15.53:0/3665225711 conn(0x7fca30065c80 msgr2=0x7fca30066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- 172.21.15.53:0/3665225711 shutdown_connections 2024-09-13T18:26:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.231+0000 7fca35554640 1 -- 172.21.15.53:0/3665225711 wait complete. 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 Processor -- start 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 -- start start 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca301f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca300cb980 0x7fca30158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cbd60 0x7fca30148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3014b620 con 0x7fca3006b850 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca301f5c10 con 0x7fca300cb980 2024-09-13T18:26:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3014b850 con 0x7fca300cbd60 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca301f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca301f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58864/0 (socket says 172.21.15.53:58864) 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 -- 172.21.15.53:0/4221987648 learned_addr learned my addr 172.21.15.53:0/4221987648 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2f7fe640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cbd60 0x7fca30148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2e7fc640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca300cb980 0x7fca30158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 -- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cbd60 msgr2=0x7fca30148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cbd60 0x7fca30148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 -- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca300cb980 msgr2=0x7fca30158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca300cb980 0x7fca30158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 -- 172.21.15.53:0/4221987648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180094d0 con 0x7fca3006b850 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2e7fc640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca300cb980 0x7fca30158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca2effd640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca301f56d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca2000d800 tx=0x7fca2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca277fe640 1 -- 172.21.15.53:0/4221987648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000b6c0 con 0x7fca3006b850 2024-09-13T18:26:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca277fe640 1 -- 172.21.15.53:0/4221987648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2000b820 con 0x7fca3006b850 2024-09-13T18:26:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3014bb30 con 0x7fca3006b850 2024-09-13T18:26:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca277fe640 1 -- 172.21.15.53:0/4221987648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000bb90 con 0x7fca3006b850 2024-09-13T18:26:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3014c3d0 con 0x7fca3006b850 2024-09-13T18:26:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca30067400 con 0x7fca3006b850 2024-09-13T18:26:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.235+0000 7fca277fe640 1 -- 172.21.15.53:0/4221987648 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca2000bcf0 con 0x7fca3006b850 2024-09-13T18:26:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.239+0000 7fca277fe640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca10066690 0x7fca10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.239+0000 7fca277fe640 1 -- 172.21.15.53:0/4221987648 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca20084680 con 0x7fca3006b850 2024-09-13T18:26:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.239+0000 7fca2e7fc640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca10066690 0x7fca10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.239+0000 7fca2e7fc640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca10066690 0x7fca10068b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca180af000 tx=0x7fca18008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:04.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.243+0000 7fca277fe640 1 -- 172.21.15.53:0/4221987648 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca20051a80 con 0x7fca3006b850 2024-09-13T18:26:04.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.431+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca3014bd20 con 0x7fca3006b850 2024-09-13T18:26:04.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.431+0000 7fca277fe640 1 -- 172.21.15.53:0/4221987648 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca200550a0 con 0x7fca3006b850 2024-09-13T18:26:04.438 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:26:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca10066690 msgr2=0x7fca10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca10066690 0x7fca10068b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca180af000 tx=0x7fca18008040 comp rx=0 tx=0).stop 2024-09-13T18:26:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 msgr2=0x7fca301f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca301f56d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca2000d800 tx=0x7fca2000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 shutdown_connections 2024-09-13T18:26:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca10066690 0x7fca10068b50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca300cbd60 0x7fca30148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca300cb980 0x7fca30158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 --2- 172.21.15.53:0/4221987648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca3006b850 0x7fca301f56d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 >> 172.21.15.53:0/4221987648 conn(0x7fca30065c80 msgr2=0x7fca300ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 shutdown_connections 2024-09-13T18:26:04.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:04.435+0000 7fca35554640 1 -- 172.21.15.53:0/4221987648 wait complete. 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:26:04.456 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:26:04.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:04.457 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:26:04.462 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:26:04.462 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:26:04.462 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:26:04.462 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.462 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:26:04.462 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.462 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42432sec preferred_lft 42432sec 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:04.463 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:26:04.464 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:04.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:04.466 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:26:04.512 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:26:04.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:04.514 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:26:04.561 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:26:04.561 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:26:04.562 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:26:04.562 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:26:04.562 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:26:04.562 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:26:04.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:04.562 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:26:04.562 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:26:04.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:26:04.562 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:26:04.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:26:04.563 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:26:04.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:04.635 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:26:04.684 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:26:04.684 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:26:04.684 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:26:04.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:04.684 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:26:04.741 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:26:04.741 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:04.741 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:04.788 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:26:04.788 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:04.788 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:04.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:26:04.893 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:04.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:04.947 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:04.948 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:04.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:04.949 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:26:04.996 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:26:04.997 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:26:05.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:26:05.061 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:05.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:05.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:05.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:05.116 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:26:05.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:26:05.123+0000 7fcaefdf7580 -1 init, newargv = 0x5605d175b530 newargc=15 2024-09-13T18:26:05.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[38759]: starting ceph client 2024-09-13T18:26:05.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[38759]: starting fuse 2024-09-13T18:26:06.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:26:06.254 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:06.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:06.308 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:06.309 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:06.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:06.310 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:26:06.374 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:26:06.374 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:26:06.374 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:26:06.374 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:26:06.375 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:06.376 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:26:06.377 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:26:06.515 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.38759.asok 2024-09-13T18:26:06.697 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38759.asok 2024-09-13T18:26:06.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:06.697 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.38759.asok status 2024-09-13T18:26:06.866 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:26:06.866 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:26:06.866 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:26:06.866 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "38759", 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5412, 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:26:06.867 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 5412 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 5888568 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 5888568 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:06.868 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.5412 192.168.0.1:0/5888568", 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/5888568", 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 13, 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 34, 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:26:06.869 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:26:06.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:06.878 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:26:06.878 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:06.891 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:26:06.892 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:06.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:06.892 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:06.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:26:07.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.135+0000 7f5e92838640 1 Processor -- start 2024-09-13T18:26:07.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.135+0000 7f5e92838640 1 -- start start 2024-09-13T18:26:07.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.135+0000 7f5e92838640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c1582a0 0x7f5e8c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:07.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.135+0000 7f5e92838640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e8c0713a0 0x7f5e8c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:07.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.135+0000 7f5e92838640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c06d480 con 0x7f5e8c15b7c0 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.135+0000 7f5e92838640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c15aaf0 con 0x7f5e8c0713a0 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.135+0000 7f5e92838640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c06d760 con 0x7f5e8c1582a0 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c1582a0 0x7f5e8c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e90dd5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e8c0713a0 0x7f5e8c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c1582a0 0x7f5e8c06c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:39344/0 (socket says 172.21.15.53:39344) 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e90dd5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e8c0713a0 0x7f5e8c06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:39348/0 (socket says 172.21.15.53:39348) 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 -- 172.21.15.53:0/3486461331 learned_addr learned my addr 172.21.15.53:0/3486461331 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:07.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8b7fe640 1 --1- 172.21.15.53:0/3486461331 >> v1:172.21.15.87:6789/0 conn(0x7f5e8c15b7c0 0x7f5e8c070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:54290/0 (socket says 172.21.15.53:54290) 2024-09-13T18:26:07.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 -- 172.21.15.53:0/3486461331 >> v2:172.21.15.87:3300/0 conn(0x7f5e8c0713a0 msgr2=0x7f5e8c06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:07.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 --2- 172.21.15.53:0/3486461331 >> v2:172.21.15.87:3300/0 conn(0x7f5e8c0713a0 0x7f5e8c06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 -- 172.21.15.53:0/3486461331 >> v1:172.21.15.87:6789/0 conn(0x7f5e8c15b7c0 legacy=0x7f5e8c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:07.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 -- 172.21.15.53:0/3486461331 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c15ace0 con 0x7f5e8c1582a0 2024-09-13T18:26:07.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8bfff640 1 --2- 172.21.15.53:0/3486461331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c1582a0 0x7f5e8c06c900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009870 tx=0x7f5e8001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26364adcd439d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:07.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8affd640 1 -- 172.21.15.53:0/3486461331 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800a95f0 con 0x7f5e8c1582a0 2024-09-13T18:26:07.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8affd640 1 -- 172.21.15.53:0/3486461331 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e800a9750 con 0x7f5e8c1582a0 2024-09-13T18:26:07.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e8affd640 1 -- 172.21.15.53:0/3486461331 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800a9ae0 con 0x7f5e8c1582a0 2024-09-13T18:26:07.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e92838640 1 -- 172.21.15.53:0/3486461331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c1582a0 msgr2=0x7f5e8c06c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:07.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e92838640 1 --2- 172.21.15.53:0/3486461331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c1582a0 0x7f5e8c06c900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009870 tx=0x7f5e8001c530 comp rx=0 tx=0).stop 2024-09-13T18:26:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e92838640 1 -- 172.21.15.53:0/3486461331 shutdown_connections 2024-09-13T18:26:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e92838640 1 --2- 172.21.15.53:0/3486461331 >> v2:172.21.15.87:3300/0 conn(0x7f5e8c0713a0 0x7f5e8c06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e92838640 1 --2- 172.21.15.53:0/3486461331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c1582a0 0x7f5e8c06c900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.139+0000 7f5e92838640 1 -- 172.21.15.53:0/3486461331 >> 172.21.15.53:0/3486461331 conn(0x7f5e8c065c80 msgr2=0x7f5e8c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- 172.21.15.53:0/3486461331 shutdown_connections 2024-09-13T18:26:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- 172.21.15.53:0/3486461331 wait complete. 2024-09-13T18:26:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 Processor -- start 2024-09-13T18:26:07.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- start start 2024-09-13T18:26:07.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e8c0713a0 0x7f5e8c149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c15b7c0 0x7f5e8c159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e8c0aefa0 0x7f5e8c15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c14a350 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c1f9760 con 0x7f5e8c0713a0 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0adf00 con 0x7f5e8c15b7c0 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e8c0aefa0 0x7f5e8c15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e8c0aefa0 0x7f5e8c15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37932/0 (socket says 172.21.15.53:37932) 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 -- 172.21.15.53:0/2665229578 learned_addr learned my addr 172.21.15.53:0/2665229578 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e8b7fe640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c15b7c0 0x7f5e8c159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e8bfff640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e8c0713a0 0x7f5e8c149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 -- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c15b7c0 msgr2=0x7f5e8c159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c15b7c0 0x7f5e8c159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 -- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e8c0713a0 msgr2=0x7f5e8c149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e8c0713a0 0x7f5e8c149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 -- 172.21.15.53:0/2665229578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800094d0 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e90dd5640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e8c0aefa0 0x7f5e8c15a310 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400efc0 tx=0x7f5e8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e88ff9640 1 -- 172.21.15.53:0/2665229578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84014480 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e88ff9640 1 -- 172.21.15.53:0/2665229578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400f040 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c0ae1e0 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e88ff9640 1 -- 172.21.15.53:0/2665229578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84014820 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c0ae7a0 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.143+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c067400 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.147+0000 7f5e88ff9640 1 -- 172.21.15.53:0/2665229578 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e84014980 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.147+0000 7f5e88ff9640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e78066690 0x7f5e78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.147+0000 7f5e88ff9640 1 -- 172.21.15.53:0/2665229578 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e84084c40 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.147+0000 7f5e8bfff640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e78066690 0x7f5e78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.147+0000 7f5e8bfff640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e78066690 0x7f5e78068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e800ae000 tx=0x7f5e800b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.151+0000 7f5e88ff9640 1 -- 172.21.15.53:0/2665229578 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e84052060 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.347+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e8c153990 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e88ff9640 1 -- 172.21.15.53:0/2665229578 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5e84018070 con 0x7f5e8c0aefa0 2024-09-13T18:26:07.351 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e78066690 msgr2=0x7f5e78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e78066690 0x7f5e78068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e800ae000 tx=0x7f5e800b3040 comp rx=0 tx=0).stop 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e8c0aefa0 msgr2=0x7f5e8c15a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e8c0aefa0 0x7f5e8c15a310 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400efc0 tx=0x7f5e8400c490 comp rx=0 tx=0).stop 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 shutdown_connections 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e78066690 0x7f5e78068b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e8c15b7c0 0x7f5e8c159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e8c0aefa0 0x7f5e8c15a310 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 --2- 172.21.15.53:0/2665229578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e8c0713a0 0x7f5e8c149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 >> 172.21.15.53:0/2665229578 conn(0x7f5e8c065c80 msgr2=0x7f5e8c066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:07.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 shutdown_connections 2024-09-13T18:26:07.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:07.351+0000 7f5e92838640 1 -- 172.21.15.53:0/2665229578 wait complete. 2024-09-13T18:26:07.371 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:26:07.372 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:26:07.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:07.372 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:26:07.381 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:26:07.381 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:26:07.381 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:26:07.381 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.381 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-09-13T18:26:07.382 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:26:07.383 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:07.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:07.385 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:26:07.438 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:26:07.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:07.440 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:26:07.493 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:26:07.493 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:26:07.493 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:26:07.493 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:26:07.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:07.495 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:26:07.495 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:26:07.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:26:07.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:26:07.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:26:07.495 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:26:07.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:07.572 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:26:07.622 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:26:07.622 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:26:07.623 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:26:07.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:07.623 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:26:07.676 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:26:07.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:07.676 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:07.724 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:26:07.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:07.725 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:07.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:26:07.834 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:07.834 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:07.887 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:07.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:07.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:07.889 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:26:07.936 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:26:07.937 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:26:07.982 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:26:07.998 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:07.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:08.051 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:08.052 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:08.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:08.053 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:26:08.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:26:08.059+0000 7f543b390580 -1 init, newargv = 0x55a023b3f400 newargc=15 2024-09-13T18:26:08.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35165]: starting ceph client 2024-09-13T18:26:08.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35165]: starting fuse 2024-09-13T18:26:09.168 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:26:09.183 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:09.183 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:09.236 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:09.237 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:09.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:09.238 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:26:09.285 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:26:09.285 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:26:09.285 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:26:09.285 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:26:09.285 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:26:09.285 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:26:09.285 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:26:09.286 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:26:09.287 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:26:09.401 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.35165.asok 2024-09-13T18:26:09.584 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35165.asok 2024-09-13T18:26:09.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:09.584 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35165.asok status 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35165", 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:26:09.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5230, 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5230 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1788749955 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:26:09.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1788749955 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5230 192.168.0.1:0/1788749955", 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1788749955", 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 13, 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 34, 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:26:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:26:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:26:09.744 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:26:09.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:09.756 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:26:09.756 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:09.762 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:26:09.762 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:09.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:09.762 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:09.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:26:09.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a3a19640 1 Processor -- start 2024-09-13T18:26:09.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a3a19640 1 -- start start 2024-09-13T18:26:09.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a3a19640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f699c0cd380 0x7f699c0cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a3a19640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c06a660 0x7f699c0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a3a19640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c06b270 con 0x7f699c0cd760 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a3a19640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c0b1550 con 0x7f699c0cd380 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a3a19640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0cf7d0 con 0x7f699c06a660 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a17b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f699c0cd380 0x7f699c0cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a17b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f699c0cd380 0x7f699c0cfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37944/0 (socket says 172.21.15.53:37944) 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.951+0000 7f69a17b5640 1 -- 172.21.15.53:0/2721947514 learned_addr learned my addr 172.21.15.53:0/2721947514 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a1fb6640 1 --2- 172.21.15.53:0/2721947514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c06a660 0x7f699c0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a17b5640 1 -- 172.21.15.53:0/2721947514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c06a660 msgr2=0x7f699c0b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a17b5640 1 --2- 172.21.15.53:0/2721947514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c06a660 0x7f699c0b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a17b5640 1 -- 172.21.15.53:0/2721947514 >> v1:172.21.15.53:6789/0 conn(0x7f699c0cd760 legacy=0x7f699c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:09.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a17b5640 1 -- 172.21.15.53:0/2721947514 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c0cf5a0 con 0x7f699c0cd380 2024-09-13T18:26:09.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a1fb6640 1 --2- 172.21.15.53:0/2721947514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c06a660 0x7f699c0b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a17b5640 1 --2- 172.21.15.53:0/2721947514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c0cd380 0x7f699c0cfe90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6994009870 tx=0x7f699401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50bfe88f8ba7580 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f699bfff640 1 -- 172.21.15.53:0/2721947514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940ab640 con 0x7f699c0cd380 2024-09-13T18:26:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f699bfff640 1 -- 172.21.15.53:0/2721947514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940a7070 con 0x7f699c0cd380 2024-09-13T18:26:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f699bfff640 1 -- 172.21.15.53:0/2721947514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940ab9c0 con 0x7f699c0cd380 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 -- 172.21.15.53:0/2721947514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c0cd380 msgr2=0x7f699c0cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 --2- 172.21.15.53:0/2721947514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c0cd380 0x7f699c0cfe90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6994009870 tx=0x7f699401c440 comp rx=0 tx=0).stop 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 -- 172.21.15.53:0/2721947514 shutdown_connections 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 --2- 172.21.15.53:0/2721947514 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c06a660 0x7f699c0b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 --2- 172.21.15.53:0/2721947514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c0cd380 0x7f699c0cfe90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 -- 172.21.15.53:0/2721947514 >> 172.21.15.53:0/2721947514 conn(0x7f699c0b2060 msgr2=0x7f699c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 -- 172.21.15.53:0/2721947514 shutdown_connections 2024-09-13T18:26:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.955+0000 7f69a3a19640 1 -- 172.21.15.53:0/2721947514 wait complete. 2024-09-13T18:26:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 Processor -- start 2024-09-13T18:26:09.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 -- start start 2024-09-13T18:26:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c06a660 0x7f699c152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c0cd380 0x7f699c15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f699c0cd760 0x7f699c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c15e9b0 con 0x7f699c06a660 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c152080 con 0x7f699c0cd760 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c15ec00 con 0x7f699c0cd380 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c06a660 0x7f699c152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c06a660 0x7f699c152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37950/0 (socket says 172.21.15.53:37950) 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 -- 172.21.15.53:0/1190269000 learned_addr learned my addr 172.21.15.53:0/1190269000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a0fb4640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c0cd380 0x7f699c15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a1fb6640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f699c0cd760 0x7f699c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 -- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c0cd380 msgr2=0x7f699c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c0cd380 0x7f699c15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 -- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f699c0cd760 msgr2=0x7f699c0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f699c0cd760 0x7f699c0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 -- 172.21.15.53:0/1190269000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940094d0 con 0x7f699c06a660 2024-09-13T18:26:09.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a17b5640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c06a660 0x7f699c152ad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f699401aaf0 tx=0x7f699401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f6999ffb640 1 -- 172.21.15.53:0/1190269000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940be5f0 con 0x7f699c06a660 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f6999ffb640 1 -- 172.21.15.53:0/1190269000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940be770 con 0x7f699c06a660 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699c15eee0 con 0x7f699c06a660 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f6999ffb640 1 -- 172.21.15.53:0/1190269000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940beb20 con 0x7f699c06a660 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c1525b0 con 0x7f699c06a660 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.959+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c160090 con 0x7f699c06a660 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.963+0000 7f6999ffb640 1 -- 172.21.15.53:0/1190269000 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69940b43f0 con 0x7f699c06a660 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.963+0000 7f6999ffb640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69880666c0 0x7f6988068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.963+0000 7f6999ffb640 1 -- 172.21.15.53:0/1190269000 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f699411efe0 con 0x7f699c06a660 2024-09-13T18:26:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.963+0000 7f69a0fb4640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69880666c0 0x7f6988068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:09.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.963+0000 7f69a0fb4640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69880666c0 0x7f6988068b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ca540 tx=0x7f6990009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:09.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:09.967+0000 7f6999ffb640 1 -- 172.21.15.53:0/1190269000 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69940ec3c0 con 0x7f699c06a660 2024-09-13T18:26:10.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.163+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f699c0b2b80 con 0x7f699c06a660 2024-09-13T18:26:10.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.995+0000 7f6999ffb640 1 -- 172.21.15.53:0/1190269000 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 136+0+0 (secure 0 0 0) 0x7f69940ef9e0 con 0x7f699c06a660 2024-09-13T18:26:11.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69880666c0 msgr2=0x7f6988068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69880666c0 0x7f6988068b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ca540 tx=0x7f6990009040 comp rx=0 tx=0).stop 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c06a660 msgr2=0x7f699c152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c06a660 0x7f699c152ad0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f699401aaf0 tx=0x7f699401ac80 comp rx=0 tx=0).stop 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 shutdown_connections 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f69880666c0 0x7f6988068b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f699c0cd380 0x7f699c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f699c0cd760 0x7f699c0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 --2- 172.21.15.53:0/1190269000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f699c06a660 0x7f699c152ad0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 >> 172.21.15.53:0/1190269000 conn(0x7f699c0b2060 msgr2=0x7f699c156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 shutdown_connections 2024-09-13T18:26:11.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:10.999+0000 7f69a3a19640 1 -- 172.21.15.53:0/1190269000 wait complete. 2024-09-13T18:26:11.021 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:26:11.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f40455bc640 1 Processor -- start 2024-09-13T18:26:11.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f40455bc640 1 -- start start 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f40455bc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f404015b7c0 0x7f4040070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f40455bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40400711d0 0x7f40401640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f40455bc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404006d480 con 0x7f40401582a0 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f40455bc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4040071680 con 0x7f40400711d0 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f40455bc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404015aaf0 con 0x7f404015b7c0 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f40401582a0 0x7f404006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47628/0 (socket says 172.21.15.53:47628) 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403effd640 1 -- 172.21.15.53:0/3615087039 learned_addr learned my addr 172.21.15.53:0/3615087039 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403f7fe640 1 --2- 172.21.15.53:0/3615087039 >> v2:172.21.15.53:3300/0 conn(0x7f40400711d0 0x7f40401640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403e7fc640 1 --2- 172.21.15.53:0/3615087039 >> v2:172.21.15.87:3300/0 conn(0x7f404015b7c0 0x7f4040070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403f7fe640 1 -- 172.21.15.53:0/3615087039 >> v2:172.21.15.87:3300/0 conn(0x7f404015b7c0 msgr2=0x7f4040070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403f7fe640 1 --2- 172.21.15.53:0/3615087039 >> v2:172.21.15.87:3300/0 conn(0x7f404015b7c0 0x7f4040070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403f7fe640 1 -- 172.21.15.53:0/3615087039 >> v1:172.21.15.53:6789/0 conn(0x7f40401582a0 legacy=0x7f404006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403f7fe640 1 -- 172.21.15.53:0/3615087039 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404015ace0 con 0x7f40400711d0 2024-09-13T18:26:11.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.143+0000 7f403e7fc640 1 --2- 172.21.15.53:0/3615087039 >> v2:172.21.15.87:3300/0 conn(0x7f404015b7c0 0x7f4040070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f403f7fe640 1 --2- 172.21.15.53:0/3615087039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f40401640f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40400ce220 tx=0x7f403801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b2fcefb32e61dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f403dffb640 1 -- 172.21.15.53:0/3615087039 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40380ab600 con 0x7f40400711d0 2024-09-13T18:26:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f403dffb640 1 -- 172.21.15.53:0/3615087039 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40380a7050 con 0x7f40400711d0 2024-09-13T18:26:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f403dffb640 1 -- 172.21.15.53:0/3615087039 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40380ab980 con 0x7f40400711d0 2024-09-13T18:26:11.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 -- 172.21.15.53:0/3615087039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 msgr2=0x7f40401640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 --2- 172.21.15.53:0/3615087039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f40401640f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40400ce220 tx=0x7f403801c480 comp rx=0 tx=0).stop 2024-09-13T18:26:11.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 -- 172.21.15.53:0/3615087039 shutdown_connections 2024-09-13T18:26:11.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 --2- 172.21.15.53:0/3615087039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f40401640f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 --2- 172.21.15.53:0/3615087039 >> v2:172.21.15.87:3300/0 conn(0x7f404015b7c0 0x7f4040070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 -- 172.21.15.53:0/3615087039 >> 172.21.15.53:0/3615087039 conn(0x7f4040065c80 msgr2=0x7f4040066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:11.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 -- 172.21.15.53:0/3615087039 shutdown_connections 2024-09-13T18:26:11.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.147+0000 7f40455bc640 1 -- 172.21.15.53:0/3615087039 wait complete. 2024-09-13T18:26:11.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 Processor -- start 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 -- start start 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f404014d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40401582a0 0x7f40400a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404015b7c0 0x7f404014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40401505c0 con 0x7f40400711d0 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404014d620 con 0x7f40401582a0 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4040156fd0 con 0x7f404015b7c0 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f404014d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f404014d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37960/0 (socket says 172.21.15.53:37960) 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 -- 172.21.15.53:0/1240056698 learned_addr learned my addr 172.21.15.53:0/1240056698 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:11.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403e7fc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40401582a0 0x7f40400a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403f7fe640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404015b7c0 0x7f404014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 -- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404015b7c0 msgr2=0x7f404014d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404015b7c0 0x7f404014d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 -- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40401582a0 msgr2=0x7f40400a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40401582a0 0x7f40400a8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 -- 172.21.15.53:0/1240056698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4038009420 con 0x7f40400711d0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f403effd640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f404014d0e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f403000cbd0 tx=0x7f403000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40277fe640 1 -- 172.21.15.53:0/1240056698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403000ad40 con 0x7f40400711d0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40277fe640 1 -- 172.21.15.53:0/1240056698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030012400 con 0x7f40400711d0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40277fe640 1 -- 172.21.15.53:0/1240056698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403000aea0 con 0x7f40400711d0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40401572b0 con 0x7f40400711d0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4040150af0 con 0x7f40400711d0 2024-09-13T18:26:11.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4040067400 con 0x7f40400711d0 2024-09-13T18:26:11.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.151+0000 7f40277fe640 1 -- 172.21.15.53:0/1240056698 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4030007070 con 0x7f40400711d0 2024-09-13T18:26:11.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.155+0000 7f40277fe640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f402c066690 0x7f402c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.155+0000 7f40277fe640 1 -- 172.21.15.53:0/1240056698 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4030084200 con 0x7f40400711d0 2024-09-13T18:26:11.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.155+0000 7f403e7fc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f402c066690 0x7f402c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.155+0000 7f403e7fc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f402c066690 0x7f402c068b50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40401f64a0 tx=0x7f4034008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:11.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.159+0000 7f40277fe640 1 -- 172.21.15.53:0/1240056698 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40300516b0 con 0x7f40400711d0 2024-09-13T18:26:11.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.339+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f404006b270 con 0x7f402c066690 2024-09-13T18:26:11.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40277fe640 1 -- 172.21.15.53:0/1240056698 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f404006b270 con 0x7f402c066690 2024-09-13T18:26:11.345 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:26:11.345 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:11.345 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:26:11.345 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:11.346 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:26:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f402c066690 msgr2=0x7f402c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f402c066690 0x7f402c068b50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f40401f64a0 tx=0x7f4034008040 comp rx=0 tx=0).stop 2024-09-13T18:26:11.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 msgr2=0x7f404014d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f404014d0e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f403000cbd0 tx=0x7f403000a430 comp rx=0 tx=0).stop 2024-09-13T18:26:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 shutdown_connections 2024-09-13T18:26:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f402c066690 0x7f402c068b50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404015b7c0 0x7f404014d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40401582a0 0x7f40400a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 --2- 172.21.15.53:0/1240056698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40400711d0 0x7f404014d0e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 >> 172.21.15.53:0/1240056698 conn(0x7f4040065c80 msgr2=0x7f404006f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:11.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 shutdown_connections 2024-09-13T18:26:11.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.343+0000 7f40455bc640 1 -- 172.21.15.53:0/1240056698 wait complete. 2024-09-13T18:26:11.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:26:11.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.483+0000 7fc451d27640 1 Processor -- start 2024-09-13T18:26:11.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.483+0000 7fc451d27640 1 -- start start 2024-09-13T18:26:11.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc451d27640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc44c143e80 0x7fc44c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc451d27640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0caee0 0x7fc44c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc451d27640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c06f7a0 con 0x7fc44c0cd320 2024-09-13T18:26:11.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc451d27640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44c06fd60 con 0x7fc44c143e80 2024-09-13T18:26:11.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc451d27640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0cb960 con 0x7fc44c0caee0 2024-09-13T18:26:11.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc443fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0caee0 0x7fc44c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc44c143e80 0x7fc44c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc44c0cd320 0x7fc44c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:54302/0 (socket says 172.21.15.53:54302) 2024-09-13T18:26:11.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44bfff640 1 -- 172.21.15.53:0/277132183 learned_addr learned my addr 172.21.15.53:0/277132183 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:11.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc443fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0caee0 0x7fc44c0cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:39372/0 (socket says 172.21.15.53:39372) 2024-09-13T18:26:11.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44affd640 1 -- 172.21.15.53:0/277132183 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924673610 0 0) 0x7fc44c06f7a0 con 0x7fc44c0cd320 2024-09-13T18:26:11.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44affd640 1 -- 172.21.15.53:0/277132183 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc438003530 con 0x7fc44c0cd320 2024-09-13T18:26:11.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44b7fe640 1 -- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0caee0 msgr2=0x7fc44c0cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:11.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44b7fe640 1 --2- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0caee0 0x7fc44c0cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44b7fe640 1 -- 172.21.15.53:0/277132183 >> v1:172.21.15.87:6789/0 conn(0x7fc44c0cd320 legacy=0x7fc44c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44b7fe640 1 -- 172.21.15.53:0/277132183 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0cbc40 con 0x7fc44c143e80 2024-09-13T18:26:11.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc443fff640 1 --2- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0caee0 0x7fc44c0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:11.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.487+0000 7fc44b7fe640 1 --2- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c143e80 0x7fc44c06b390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0097c0 tx=0x7fc43c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce882f39638b7776 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:11.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc44affd640 1 -- 172.21.15.53:0/277132183 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0ac620 con 0x7fc44c143e80 2024-09-13T18:26:11.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc44affd640 1 -- 172.21.15.53:0/277132183 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c0ac780 con 0x7fc44c143e80 2024-09-13T18:26:11.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc44affd640 1 -- 172.21.15.53:0/277132183 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0acb10 con 0x7fc44c143e80 2024-09-13T18:26:11.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c143e80 msgr2=0x7fc44c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 --2- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c143e80 0x7fc44c06b390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0097c0 tx=0x7fc43c01c3e0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- 172.21.15.53:0/277132183 shutdown_connections 2024-09-13T18:26:11.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 --2- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0caee0 0x7fc44c0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 --2- 172.21.15.53:0/277132183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c143e80 0x7fc44c06b390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- 172.21.15.53:0/277132183 >> 172.21.15.53:0/277132183 conn(0x7fc44c065c80 msgr2=0x7fc44c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:11.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- 172.21.15.53:0/277132183 shutdown_connections 2024-09-13T18:26:11.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- 172.21.15.53:0/277132183 wait complete. 2024-09-13T18:26:11.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 Processor -- start 2024-09-13T18:26:11.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- start start 2024-09-13T18:26:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c0caee0 0x7fc44c13af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0cd320 0x7fc44c13f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc44c143e80 0x7fc44c13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c1399f0 con 0x7fc44c143e80 2024-09-13T18:26:11.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c140400 con 0x7fc44c0caee0 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc451d27640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0a84d0 con 0x7fc44c0cd320 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc44c143e80 0x7fc44c13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc44c143e80 0x7fc44c13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37972/0 (socket says 172.21.15.53:37972) 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.491+0000 7fc44bfff640 1 -- 172.21.15.53:0/3587849444 learned_addr learned my addr 172.21.15.53:0/3587849444 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44b7fe640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c0caee0 0x7fc44c13af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc443fff640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0cd320 0x7fc44c13f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44bfff640 1 -- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0cd320 msgr2=0x7fc44c13f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44bfff640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0cd320 0x7fc44c13f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44bfff640 1 -- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c0caee0 msgr2=0x7fc44c13af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44bfff640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c0caee0 0x7fc44c13af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44bfff640 1 -- 172.21.15.53:0/3587849444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434009420 con 0x7fc44c143e80 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc443fff640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0cd320 0x7fc44c13f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44b7fe640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c0caee0 0x7fc44c13af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44bfff640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc44c143e80 0x7fc44c13fec0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc44400caa0 tx=0x7fc44400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc448ff9640 1 -- 172.21.15.53:0/3587849444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400ac00 con 0x7fc44c143e80 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc448ff9640 1 -- 172.21.15.53:0/3587849444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400ad60 con 0x7fc44c143e80 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c009420 con 0x7fc44c143e80 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc448ff9640 1 -- 172.21.15.53:0/3587849444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444012620 con 0x7fc44c143e80 2024-09-13T18:26:11.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c0a8c00 con 0x7fc44c143e80 2024-09-13T18:26:11.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c0cb320 con 0x7fc44c143e80 2024-09-13T18:26:11.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc448ff9640 1 -- 172.21.15.53:0/3587849444 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc444007070 con 0x7fc44c143e80 2024-09-13T18:26:11.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc448ff9640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc42c066690 0x7fc42c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:11.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc448ff9640 1 -- 172.21.15.53:0/3587849444 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc444084180 con 0x7fc44c143e80 2024-09-13T18:26:11.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44b7fe640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc42c066690 0x7fc42c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:11.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.495+0000 7fc44b7fe640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc42c066690 0x7fc42c068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0ae000 tx=0x7fc43c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:11.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.499+0000 7fc448ff9640 1 -- 172.21.15.53:0/3587849444 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4440514e0 con 0x7fc44c143e80 2024-09-13T18:26:11.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.659+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc44c0cdf20 con 0x7fc44c143e80 2024-09-13T18:26:11.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.659+0000 7fc448ff9640 1 -- 172.21.15.53:0/3587849444 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc444054b00 con 0x7fc44c143e80 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc42c066690 msgr2=0x7fc42c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc42c066690 0x7fc42c068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0ae000 tx=0x7fc43c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc44c143e80 msgr2=0x7fc44c13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc44c143e80 0x7fc44c13fec0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc44400caa0 tx=0x7fc44400cf60 comp rx=0 tx=0).stop 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 shutdown_connections 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc42c066690 0x7fc42c068b50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc44c0cd320 0x7fc44c13f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc44c143e80 0x7fc44c13fec0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 --2- 172.21.15.53:0/3587849444 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc44c0caee0 0x7fc44c13af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 >> 172.21.15.53:0/3587849444 conn(0x7fc44c065c80 msgr2=0x7fc44c0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 shutdown_connections 2024-09-13T18:26:11.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:11.663+0000 7fc451d27640 1 -- 172.21.15.53:0/3587849444 wait complete. 2024-09-13T18:26:11.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:11.684 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp17790/subvol42040) 2024-09-13T18:26:11.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:11.707 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:26:11.775 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:26:11.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:11.776 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp17790/subvol42040) 2024-09-13T18:26:11.839 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:26:11.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp17790/subvol42040/.meta 2024-09-13T18:26:11.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol42040 subvol_grp17790 2024-09-13T18:26:12.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.075+0000 7fc71730f640 1 Processor -- start 2024-09-13T18:26:12.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.075+0000 7fc71730f640 1 -- start start 2024-09-13T18:26:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.075+0000 7fc71730f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc71006ccc0 0x7fc71006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.075+0000 7fc71730f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7100cc800 0x7fc7100ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.075+0000 7fc71730f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc710070fb0 con 0x7fc71015c5e0 2024-09-13T18:26:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.075+0000 7fc71730f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71006d620 con 0x7fc71006ccc0 2024-09-13T18:26:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.075+0000 7fc71730f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc710070a10 con 0x7fc7100cc800 2024-09-13T18:26:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7150ab640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc71015c5e0 0x7fc71015d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47642/0 (socket says 172.21.15.53:47642) 2024-09-13T18:26:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7148aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc71006ccc0 0x7fc71006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7150ab640 1 -- 172.21.15.53:0/526363280 learned_addr learned my addr 172.21.15.53:0/526363280 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7158ac640 1 --2- 172.21.15.53:0/526363280 >> v2:172.21.15.87:3300/0 conn(0x7fc7100cc800 0x7fc7100ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7148aa640 1 -- 172.21.15.53:0/526363280 >> v2:172.21.15.87:3300/0 conn(0x7fc7100cc800 msgr2=0x7fc7100ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7148aa640 1 --2- 172.21.15.53:0/526363280 >> v2:172.21.15.87:3300/0 conn(0x7fc7100cc800 0x7fc7100ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7148aa640 1 -- 172.21.15.53:0/526363280 >> v1:172.21.15.53:6789/0 conn(0x7fc71015c5e0 legacy=0x7fc71015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7148aa640 1 -- 172.21.15.53:0/526363280 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7100711e0 con 0x7fc71006ccc0 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc7148aa640 1 --2- 172.21.15.53:0/526363280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71006ccc0 0x7fc71006d0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc7100cdf40 tx=0x7fc70001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb47fb5f58744b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc707fff640 1 -- 172.21.15.53:0/526363280 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000ab5f0 con 0x7fc71006ccc0 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc707fff640 1 -- 172.21.15.53:0/526363280 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000ab750 con 0x7fc71006ccc0 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc707fff640 1 -- 172.21.15.53:0/526363280 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000abae0 con 0x7fc71006ccc0 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 -- 172.21.15.53:0/526363280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71006ccc0 msgr2=0x7fc71006d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 --2- 172.21.15.53:0/526363280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71006ccc0 0x7fc71006d0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc7100cdf40 tx=0x7fc70001c450 comp rx=0 tx=0).stop 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 -- 172.21.15.53:0/526363280 shutdown_connections 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 --2- 172.21.15.53:0/526363280 >> v2:172.21.15.87:3300/0 conn(0x7fc7100cc800 0x7fc7100ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 --2- 172.21.15.53:0/526363280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc71006ccc0 0x7fc71006d0e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 -- 172.21.15.53:0/526363280 >> 172.21.15.53:0/526363280 conn(0x7fc710073330 msgr2=0x7fc710065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 -- 172.21.15.53:0/526363280 shutdown_connections 2024-09-13T18:26:12.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.079+0000 7fc71730f640 1 -- 172.21.15.53:0/526363280 wait complete. 2024-09-13T18:26:12.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 Processor -- start 2024-09-13T18:26:12.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 -- start start 2024-09-13T18:26:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71006ccc0 0x7fc710153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7100cc800 0x7fc710150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71015c5e0 0x7fc7100ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc710156330 con 0x7fc7100cc800 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc710154640 con 0x7fc71006ccc0 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc710154920 con 0x7fc71015c5e0 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7100cc800 0x7fc710150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7100cc800 0x7fc710150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38002/0 (socket says 172.21.15.53:38002) 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 -- 172.21.15.53:0/472406176 learned_addr learned my addr 172.21.15.53:0/472406176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7150ab640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71006ccc0 0x7fc710153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7158ac640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71015c5e0 0x7fc7100ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 -- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71015c5e0 msgr2=0x7fc7100ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71015c5e0 0x7fc7100ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 -- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71006ccc0 msgr2=0x7fc710153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71006ccc0 0x7fc710153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 -- 172.21.15.53:0/472406176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700009420 con 0x7fc7100cc800 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc7148aa640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7100cc800 0x7fc710150200 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc700019060 tx=0x7fc70001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc705ffb640 1 -- 172.21.15.53:0/472406176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000bf610 con 0x7fc7100cc800 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc705ffb640 1 -- 172.21.15.53:0/472406176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000bf770 con 0x7fc7100cc800 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc710154c00 con 0x7fc7100cc800 2024-09-13T18:26:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc705ffb640 1 -- 172.21.15.53:0/472406176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000bfb20 con 0x7fc7100cc800 2024-09-13T18:26:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7100ab850 con 0x7fc7100cc800 2024-09-13T18:26:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.083+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71015c9c0 con 0x7fc7100cc800 2024-09-13T18:26:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.087+0000 7fc705ffb640 1 -- 172.21.15.53:0/472406176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7000bfc80 con 0x7fc7100cc800 2024-09-13T18:26:12.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.087+0000 7fc705ffb640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc6f4066690 0x7fc6f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.087+0000 7fc705ffb640 1 -- 172.21.15.53:0/472406176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7000a8050 con 0x7fc7100cc800 2024-09-13T18:26:12.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.087+0000 7fc7150ab640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc6f4066690 0x7fc6f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.087+0000 7fc7150ab640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc6f4066690 0x7fc6f4068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005c10 tx=0x7fc70c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:12.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.091+0000 7fc705ffb640 1 -- 172.21.15.53:0/472406176 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7000ebf90 con 0x7fc7100cc800 2024-09-13T18:26:12.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.271+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol42040", "group_name": "subvol_grp17790", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7100b1490 con 0x7fc6f4066690 2024-09-13T18:26:12.284 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:12.279+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:12.284 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:12.279+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:12.284 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:12.279+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:12.284 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:12.279+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:12.284 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:12.279+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:12.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.411+0000 7fc705ffb640 1 -- 172.21.15.53:0/472406176 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc70c00fe90 con 0x7fc6f4066690 2024-09-13T18:26:12.415 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp17790/subvol42040 2024-09-13T18:26:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc6f4066690 msgr2=0x7fc6f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc6f4066690 0x7fc6f4068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005c10 tx=0x7fc70c009040 comp rx=0 tx=0).stop 2024-09-13T18:26:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7100cc800 msgr2=0x7fc710150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7100cc800 0x7fc710150200 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc700019060 tx=0x7fc70001ac90 comp rx=0 tx=0).stop 2024-09-13T18:26:12.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 shutdown_connections 2024-09-13T18:26:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc6f4066690 0x7fc6f4068b50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc71015c5e0 0x7fc7100ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7100cc800 0x7fc710150200 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 --2- 172.21.15.53:0/472406176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71006ccc0 0x7fc710153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 >> 172.21.15.53:0/472406176 conn(0x7fc710073330 msgr2=0x7fc7100ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 shutdown_connections 2024-09-13T18:26:12.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.415+0000 7fc71730f640 1 -- 172.21.15.53:0/472406176 wait complete. 2024-09-13T18:26:12.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol42040 subvol_grp17790 2024-09-13T18:26:12.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff28596d640 1 Processor -- start 2024-09-13T18:26:12.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff28596d640 1 -- start start 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff28596d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2801548c0 0x7ff28015ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff28596d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff280154ca0 0x7ff2800cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff28596d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff280066610 con 0x7ff2800ce730 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff28596d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2800ccfa0 con 0x7ff280154ca0 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff28596d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28015b9a0 con 0x7ff2801548c0 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff2800ce730 0x7ff2800ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47658/0 (socket says 172.21.15.53:47658) 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27f7fe640 1 -- 172.21.15.53:0/551804346 learned_addr learned my addr 172.21.15.53:0/551804346 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27e7fc640 1 --2- 172.21.15.53:0/551804346 >> v2:172.21.15.53:3300/0 conn(0x7ff280154ca0 0x7ff2800cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27effd640 1 --2- 172.21.15.53:0/551804346 >> v2:172.21.15.87:3300/0 conn(0x7ff2801548c0 0x7ff28015ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27e7fc640 1 -- 172.21.15.53:0/551804346 >> v2:172.21.15.87:3300/0 conn(0x7ff2801548c0 msgr2=0x7ff28015ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27e7fc640 1 --2- 172.21.15.53:0/551804346 >> v2:172.21.15.87:3300/0 conn(0x7ff2801548c0 0x7ff28015ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27e7fc640 1 -- 172.21.15.53:0/551804346 >> v1:172.21.15.53:6789/0 conn(0x7ff2800ce730 legacy=0x7ff2800ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.555+0000 7ff27e7fc640 1 -- 172.21.15.53:0/551804346 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280065d20 con 0x7ff280154ca0 2024-09-13T18:26:12.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 --2- 172.21.15.53:0/551804346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff280154ca0 0x7ff2800cca60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff2800702b0 tx=0x7ff27401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eba4e2bf7dce6f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:12.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27dffb640 1 -- 172.21.15.53:0/551804346 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740ab650 con 0x7ff280154ca0 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27dffb640 1 -- 172.21.15.53:0/551804346 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2740ab7b0 con 0x7ff280154ca0 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27dffb640 1 -- 172.21.15.53:0/551804346 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740abb40 con 0x7ff280154ca0 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- 172.21.15.53:0/551804346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff280154ca0 msgr2=0x7ff2800cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 --2- 172.21.15.53:0/551804346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff280154ca0 0x7ff2800cca60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff2800702b0 tx=0x7ff27401c450 comp rx=0 tx=0).stop 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- 172.21.15.53:0/551804346 shutdown_connections 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 --2- 172.21.15.53:0/551804346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff280154ca0 0x7ff2800cca60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 --2- 172.21.15.53:0/551804346 >> v2:172.21.15.87:3300/0 conn(0x7ff2801548c0 0x7ff28015ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- 172.21.15.53:0/551804346 >> 172.21.15.53:0/551804346 conn(0x7ff280069f50 msgr2=0x7ff28006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- 172.21.15.53:0/551804346 shutdown_connections 2024-09-13T18:26:12.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- 172.21.15.53:0/551804346 wait complete. 2024-09-13T18:26:12.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 Processor -- start 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- start start 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800ce730 0x7ff280154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2801548c0 0x7ff28015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2801534e0 0x7ff28014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28014c4e0 con 0x7ff2801548c0 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280153970 con 0x7ff2800ce730 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff28596d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28014c780 con 0x7ff2801534e0 2024-09-13T18:26:12.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2801548c0 0x7ff28015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2801548c0 0x7ff28015d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38026/0 (socket says 172.21.15.53:38026) 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 -- 172.21.15.53:0/181408009 learned_addr learned my addr 172.21.15.53:0/181408009 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27f7fe640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2801534e0 0x7ff28014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27effd640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800ce730 0x7ff280154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 -- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2801534e0 msgr2=0x7ff28014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2801534e0 0x7ff28014ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 -- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800ce730 msgr2=0x7ff280154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.559+0000 7ff27e7fc640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800ce730 0x7ff280154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff27e7fc640 1 -- 172.21.15.53:0/181408009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009420 con 0x7ff2801548c0 2024-09-13T18:26:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff27e7fc640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2801548c0 0x7ff28015d120 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff2740ad040 tx=0x7ff27401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff267fff640 1 -- 172.21.15.53:0/181408009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740b5810 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff267fff640 1 -- 172.21.15.53:0/181408009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2740b5970 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff280153c50 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff267fff640 1 -- 172.21.15.53:0/181408009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740b5d20 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28015d660 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28015b590 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff267fff640 1 -- 172.21.15.53:0/181408009 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2740bf410 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff267fff640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff26c066690 0x7ff26c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff267fff640 1 -- 172.21.15.53:0/181408009 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff27411f0a0 con 0x7ff2801548c0 2024-09-13T18:26:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff27effd640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff26c066690 0x7ff26c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:12.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.563+0000 7ff27effd640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff26c066690 0x7ff26c068b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff28014eac0 tx=0x7ff270008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:12.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.567+0000 7ff267fff640 1 -- 172.21.15.53:0/181408009 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2740ec5c0 con 0x7ff2801548c0 2024-09-13T18:26:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.747+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol42040", "group_name": "subvol_grp17790", "target": ["mon-mgr", ""]}) v1 -- 0x7ff280152030 con 0x7ff26c066690 2024-09-13T18:26:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff267fff640 1 -- 172.21.15.53:0/181408009 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff280152030 con 0x7ff26c066690 2024-09-13T18:26:12.761 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp17790/subvol42040 2024-09-13T18:26:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff26c066690 msgr2=0x7ff26c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff26c066690 0x7ff26c068b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff28014eac0 tx=0x7ff270008040 comp rx=0 tx=0).stop 2024-09-13T18:26:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2801548c0 msgr2=0x7ff28015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2801548c0 0x7ff28015d120 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff2740ad040 tx=0x7ff27401ac90 comp rx=0 tx=0).stop 2024-09-13T18:26:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 shutdown_connections 2024-09-13T18:26:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff26c066690 0x7ff26c068b50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2801534e0 0x7ff28014ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2801548c0 0x7ff28015d120 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 --2- 172.21.15.53:0/181408009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2800ce730 0x7ff280154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 >> 172.21.15.53:0/181408009 conn(0x7ff280069f50 msgr2=0x7ff28015e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 shutdown_connections 2024-09-13T18:26:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:12.759+0000 7ff28596d640 1 -- 172.21.15.53:0/181408009 wait complete. 2024-09-13T18:26:12.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:12.779 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/9ffd7432dc09c0177e2b3c3f58ca1775.meta) 2024-09-13T18:26:16.897 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:26:16.897 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:26:16.897 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:26:16.898 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/subvol_grp17790/subvol42040 2024-09-13T18:26:16.898 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:26:16.898 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:16.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol42040 subvol_grp17790 2024-09-13T18:26:17.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.035+0000 7f43b666e640 1 Processor -- start 2024-09-13T18:26:17.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.035+0000 7f43b666e640 1 -- start start 2024-09-13T18:26:17.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.035+0000 7f43b666e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b015c860 0x7f43b00cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:17.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.035+0000 7f43b666e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b00d1d10 con 0x7f43b00cf7f0 2024-09-13T18:26:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.035+0000 7f43b666e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b00d1ff0 con 0x7f43b00d1410 2024-09-13T18:26:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.035+0000 7f43b666e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00d22d0 con 0x7f43b015c860 2024-09-13T18:26:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43b4c0b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f43b00cf7f0 0x7f43b00b6100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40700/0 (socket says 172.21.15.53:40700) 2024-09-13T18:26:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43b4c0b640 1 -- 172.21.15.53:0/2723839186 learned_addr learned my addr 172.21.15.53:0/2723839186 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43affff640 1 --2- 172.21.15.53:0/2723839186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b015c860 0x7f43b00cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43affff640 1 -- 172.21.15.53:0/2723839186 >> v1:172.21.15.87:6789/0 conn(0x7f43b00d1410 legacy=0x7f43b00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43affff640 1 -- 172.21.15.53:0/2723839186 >> v1:172.21.15.53:6789/0 conn(0x7f43b00cf7f0 legacy=0x7f43b00b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43affff640 1 -- 172.21.15.53:0/2723839186 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00b5be0 con 0x7f43b015c860 2024-09-13T18:26:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43affff640 1 --2- 172.21.15.53:0/2723839186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b015c860 0x7f43b00cdb70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009dc0 tx=0x7f43a801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838dc8d694c423fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:17.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43aeffd640 1 -- 172.21.15.53:0/2723839186 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80af600 con 0x7f43b015c860 2024-09-13T18:26:17.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43aeffd640 1 -- 172.21.15.53:0/2723839186 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a80ab050 con 0x7f43b015c860 2024-09-13T18:26:17.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.039+0000 7f43aeffd640 1 -- 172.21.15.53:0/2723839186 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80af980 con 0x7f43b015c860 2024-09-13T18:26:17.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- 172.21.15.53:0/2723839186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b015c860 msgr2=0x7f43b00cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:17.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 --2- 172.21.15.53:0/2723839186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b015c860 0x7f43b00cdb70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009dc0 tx=0x7f43a801f170 comp rx=0 tx=0).stop 2024-09-13T18:26:17.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- 172.21.15.53:0/2723839186 shutdown_connections 2024-09-13T18:26:17.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 --2- 172.21.15.53:0/2723839186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b015c860 0x7f43b00cdb70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- 172.21.15.53:0/2723839186 >> 172.21.15.53:0/2723839186 conn(0x7f43b0065c80 msgr2=0x7f43b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:17.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- 172.21.15.53:0/2723839186 shutdown_connections 2024-09-13T18:26:17.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- 172.21.15.53:0/2723839186 wait complete. 2024-09-13T18:26:17.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 Processor -- start 2024-09-13T18:26:17.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- start start 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b00cf7f0 0x7f43b01533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b00d1410 0x7f43b00b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b015c860 0x7f43b00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0153fc0 con 0x7f43b00d1410 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b015da80 con 0x7f43b015c860 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b666e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b015dd60 con 0x7f43b00cf7f0 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b00d1410 0x7f43b00b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b00d1410 0x7f43b00b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42472/0 (socket says 172.21.15.53:42472) 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 -- 172.21.15.53:0/2701493338 learned_addr learned my addr 172.21.15.53:0/2701493338 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43b4c0b640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b015c860 0x7f43b00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:17.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43affff640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b00cf7f0 0x7f43b01533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 -- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b00cf7f0 msgr2=0x7f43b01533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b00cf7f0 0x7f43b01533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 -- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b015c860 msgr2=0x7f43b00b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b015c860 0x7f43b00b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43af7fe640 1 -- 172.21.15.53:0/2701493338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8009a70 con 0x7f43b00d1410 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.043+0000 7f43affff640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b00cf7f0 0x7f43b01533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43af7fe640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b00d1410 0x7f43b00b3e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c500 tx=0x7f43a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43acff9640 1 -- 172.21.15.53:0/2701493338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4005220 con 0x7f43b00d1410 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43acff9640 1 -- 172.21.15.53:0/2701493338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4005380 con 0x7f43b00d1410 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b015e040 con 0x7f43b00d1410 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43acff9640 1 -- 172.21.15.53:0/2701493338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4007270 con 0x7f43b00d1410 2024-09-13T18:26:17.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b015e600 con 0x7f43b00d1410 2024-09-13T18:26:17.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b015e820 con 0x7f43b00d1410 2024-09-13T18:26:17.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43acff9640 1 -- 172.21.15.53:0/2701493338 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 6) v1 ==== 86143+0+0 (secure 0 0 0) 0x7f43a40073d0 con 0x7f43b00d1410 2024-09-13T18:26:17.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43acff9640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f439c066720 0x7f439c068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:17.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43acff9640 1 -- 172.21.15.53:0/2701493338 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43a40848b0 con 0x7f43b00d1410 2024-09-13T18:26:17.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43affff640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f439c066720 0x7f439c068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:17.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.047+0000 7f43affff640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f439c066720 0x7f439c068be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b1000 tx=0x7f43a80aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:17.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.055+0000 7f43acff9640 1 -- 172.21.15.53:0/2701493338 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43a4051cc0 con 0x7f43b00d1410 2024-09-13T18:26:17.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.239+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol42040", "group_name": "subvol_grp17790", "target": ["mon-mgr", ""]}) v1 -- 0x7f43b015fe80 con 0x7f439c066720 2024-09-13T18:26:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.267+0000 7f43acff9640 1 -- 172.21.15.53:0/2701493338 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f43b015fe80 con 0x7f439c066720 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f439c066720 msgr2=0x7f439c068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f439c066720 0x7f439c068be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b1000 tx=0x7f43a80aa000 comp rx=0 tx=0).stop 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b00d1410 msgr2=0x7f43b00b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b00d1410 0x7f43b00b3e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c500 tx=0x7f43a400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 shutdown_connections 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f439c066720 0x7f439c068be0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b015c860 0x7f43b00b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b00d1410 0x7f43b00b3e80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 --2- 172.21.15.53:0/2701493338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b00cf7f0 0x7f43b01533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 >> 172.21.15.53:0/2701493338 conn(0x7f43b0065c80 msgr2=0x7f43b00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 shutdown_connections 2024-09-13T18:26:17.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:17.271+0000 7f43b666e640 1 -- 172.21.15.53:0/2701493338 wait complete. 2024-09-13T18:26:17.277 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.275+0000 7f3e9e61a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.277 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.275+0000 7f3e9e61a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.278 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.275+0000 7f3e9e61a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.278 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.275+0000 7f3e9e61a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.278 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.275+0000 7f3e9e61a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:17.293 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:26:17.296 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.295+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.297 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.295+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.297 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.295+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.297 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.295+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.297 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:26:17.295+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:26:17.303 INFO:teuthology.orchestra.run.smithi053.stdout:3 2024-09-13T18:26:22.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:22.305 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:26:22.321 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-09-13T18:26:22.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp17790 2024-09-13T18:26:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f098d892640 1 Processor -- start 2024-09-13T18:26:22.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f098d892640 1 -- start start 2024-09-13T18:26:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f098d892640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f098815c830 0x7f09880d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f098d892640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09880ccd10 0x7f09880cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f098d892640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880b7db0 con 0x7f09880d2c80 2024-09-13T18:26:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f098d892640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880d0650 con 0x7f09880ccd10 2024-09-13T18:26:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f098d892640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880d0c10 con 0x7f098815c830 2024-09-13T18:26:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f09867fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09880ccd10 0x7f09880cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f09877fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f09880d2c80 0x7f09880b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40712/0 (socket says 172.21.15.53:40712) 2024-09-13T18:26:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f09877fe640 1 -- 172.21.15.53:0/3820911431 learned_addr learned my addr 172.21.15.53:0/3820911431 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f0986ffd640 1 --2- 172.21.15.53:0/3820911431 >> v2:172.21.15.87:3300/0 conn(0x7f098815c830 0x7f09880d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f09867fc640 1 -- 172.21.15.53:0/3820911431 >> v2:172.21.15.87:3300/0 conn(0x7f098815c830 msgr2=0x7f09880d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f09867fc640 1 --2- 172.21.15.53:0/3820911431 >> v2:172.21.15.87:3300/0 conn(0x7f098815c830 0x7f09880d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f09867fc640 1 -- 172.21.15.53:0/3820911431 >> v1:172.21.15.53:6789/0 conn(0x7f09880d2c80 legacy=0x7f09880b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.510+0000 7f09867fc640 1 -- 172.21.15.53:0/3820911431 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880cd7d0 con 0x7f09880ccd10 2024-09-13T18:26:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f09867fc640 1 --2- 172.21.15.53:0/3820911431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f09880cd180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f09880d0240 tx=0x7f097c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7d5481127a29de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0985ffb640 1 -- 172.21.15.53:0/3820911431 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0ab600 con 0x7f09880ccd10 2024-09-13T18:26:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0985ffb640 1 -- 172.21.15.53:0/3820911431 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c0a7050 con 0x7f09880ccd10 2024-09-13T18:26:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0985ffb640 1 -- 172.21.15.53:0/3820911431 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0ab980 con 0x7f09880ccd10 2024-09-13T18:26:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- 172.21.15.53:0/3820911431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 msgr2=0x7f09880cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 --2- 172.21.15.53:0/3820911431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f09880cd180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f09880d0240 tx=0x7f097c01c480 comp rx=0 tx=0).stop 2024-09-13T18:26:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- 172.21.15.53:0/3820911431 shutdown_connections 2024-09-13T18:26:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 --2- 172.21.15.53:0/3820911431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f09880cd180 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 --2- 172.21.15.53:0/3820911431 >> v2:172.21.15.87:3300/0 conn(0x7f098815c830 0x7f09880d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- 172.21.15.53:0/3820911431 >> 172.21.15.53:0/3820911431 conn(0x7f0988070970 msgr2=0x7f0988070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- 172.21.15.53:0/3820911431 shutdown_connections 2024-09-13T18:26:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- 172.21.15.53:0/3820911431 wait complete. 2024-09-13T18:26:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 Processor -- start 2024-09-13T18:26:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- start start 2024-09-13T18:26:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f098815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09880d2c80 0x7f0988158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f098815c830 0x7f0988156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988157eb0 con 0x7f09880ccd10 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09881578f0 con 0x7f09880d2c80 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f098d892640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0988157bd0 con 0x7f098815c830 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f098815d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f098815d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42490/0 (socket says 172.21.15.53:42490) 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 -- 172.21.15.53:0/1310401433 learned_addr learned my addr 172.21.15.53:0/1310401433 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f09877fe640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f098815c830 0x7f0988156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 -- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f098815c830 msgr2=0x7f0988156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f09867fc640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09880d2c80 0x7f0988158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:22.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f098815c830 0x7f0988156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 -- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09880d2c80 msgr2=0x7f0988158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09880d2c80 0x7f0988158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f0986ffd640 1 -- 172.21.15.53:0/1310401433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009420 con 0x7f09880ccd10 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f09867fc640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09880d2c80 0x7f0988158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.514+0000 7f09877fe640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f098815c830 0x7f0988156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f0986ffd640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f098815d9e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f097800d800 tx=0x7f097800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f096ffff640 1 -- 172.21.15.53:0/1310401433 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800b6c0 con 0x7f09880ccd10 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f096ffff640 1 -- 172.21.15.53:0/1310401433 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097800b820 con 0x7f09880ccd10 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880d3620 con 0x7f09880ccd10 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f096ffff640 1 -- 172.21.15.53:0/1310401433 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800bb90 con 0x7f09880ccd10 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880cae30 con 0x7f09880ccd10 2024-09-13T18:26:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880cd180 con 0x7f09880ccd10 2024-09-13T18:26:22.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f096ffff640 1 -- 172.21.15.53:0/1310401433 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f097800bcf0 con 0x7f09880ccd10 2024-09-13T18:26:22.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f096ffff640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0974066840 0x7f0974068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:22.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f096ffff640 1 -- 172.21.15.53:0/1310401433 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0978084ae0 con 0x7f09880ccd10 2024-09-13T18:26:22.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f09867fc640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0974066840 0x7f0974068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:22.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.518+0000 7f09867fc640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0974066840 0x7f0974068d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ad000 tx=0x7f097c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:22.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.522+0000 7f096ffff640 1 -- 172.21.15.53:0/1310401433 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0978051b30 con 0x7f09880ccd10 2024-09-13T18:26:22.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.706+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp17790", "target": ["mon-mgr", ""]}) v1 -- 0x7f09880d34a0 con 0x7f0974066840 2024-09-13T18:26:22.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.714+0000 7f096ffff640 1 -- 172.21.15.53:0/1310401433 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f097c0ab700 con 0x7f0974066840 2024-09-13T18:26:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0974066840 msgr2=0x7f0974068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0974066840 0x7f0974068d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ad000 tx=0x7f097c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 msgr2=0x7f098815d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f098815d9e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f097800d800 tx=0x7f097800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 shutdown_connections 2024-09-13T18:26:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0974066840 0x7f0974068d00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f098815c830 0x7f0988156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09880d2c80 0x7f0988158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 --2- 172.21.15.53:0/1310401433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09880ccd10 0x7f098815d9e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 >> 172.21.15.53:0/1310401433 conn(0x7f0988070970 msgr2=0x7f0988156490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 shutdown_connections 2024-09-13T18:26:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:22.718+0000 7f098d892640 1 -- 172.21.15.53:0/1310401433 wait complete. 2024-09-13T18:26:22.739 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:26:22.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:26:22.814 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:26:22.910 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:26:22.910 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:26:22.910 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:22.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.090+0000 7f861d935640 1 Processor -- start 2024-09-13T18:26:23.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.090+0000 7f861d935640 1 -- start start 2024-09-13T18:26:23.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f861d935640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 0x7f86180cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f861d935640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f86180cf600 0x7f86180b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f861d935640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86180d2400 con 0x7f861815cab0 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f861d935640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86180cfab0 con 0x7f86180cf600 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f861d935640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86180d1530 con 0x7f86180d19c0 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f8616ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f861815cab0 0x7f86180cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40728/0 (socket says 172.21.15.53:40728) 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f8616ffd640 1 -- 172.21.15.53:0/3515168599 learned_addr learned my addr 172.21.15.53:0/3515168599 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 0x7f86180cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86177fe640 1 --2- 172.21.15.53:0/3515168599 >> v2:172.21.15.87:3300/0 conn(0x7f86180cf600 0x7f86180b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941418850 0 0) 0x7f86180d2400 con 0x7f861815cab0 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8604003530 con 0x7f861815cab0 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2069225396 0 0) 0x7f8604003530 con 0x7f861815cab0 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 msgr2=0x7f86180cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 0x7f86180cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 >> v2:172.21.15.87:3300/0 conn(0x7f86180cf600 msgr2=0x7f86180b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 --2- 172.21.15.53:0/3515168599 >> v2:172.21.15.87:3300/0 conn(0x7f86180cf600 0x7f86180b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86180cddd0 con 0x7f861815cab0 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8608001680 con 0x7f861815cab0 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 >> v1:172.21.15.53:6789/0 conn(0x7f861815cab0 legacy=0x7f86180cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 0x7f8604003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8604003f00 0x7f86040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604004d10 0x7f8604005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180cfab0 con 0x7f8604003f00 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180d1530 con 0x7f8604004d10 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860400b990 con 0x7f86180d19c0 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8604003f00 0x7f86040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f8616ffd640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 0x7f8604003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86177fe640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604004d10 0x7f8604005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 -- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 msgr2=0x7f8604003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:23.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180d19c0 0x7f8604003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 -- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604004d10 msgr2=0x7f8604005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:23.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604004d10 0x7f8604005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 -- 172.21.15.53:0/3515168599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604003530 con 0x7f8604003f00 2024-09-13T18:26:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f860ffff640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8604003f00 0x7f86040047d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8600009ab0 tx=0x7f860001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3049aff1abb099 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000a5530 con 0x7f8604003f00 2024-09-13T18:26:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000a5690 con 0x7f8604003f00 2024-09-13T18:26:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.094+0000 7f86167fc640 1 -- 172.21.15.53:0/3515168599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000a5a40 con 0x7f8604003f00 2024-09-13T18:26:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- 172.21.15.53:0/3515168599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8604003f00 msgr2=0x7f86040047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 --2- 172.21.15.53:0/3515168599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8604003f00 0x7f86040047d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8600009ab0 tx=0x7f860001c9f0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 -- 172.21.15.53:0/3515168599 reap_dead start 2024-09-13T18:26:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- 172.21.15.53:0/3515168599 shutdown_connections 2024-09-13T18:26:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- 172.21.15.53:0/3515168599 >> 172.21.15.53:0/3515168599 conn(0x7f8618065c80 msgr2=0x7f8618066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- 172.21.15.53:0/3515168599 shutdown_connections 2024-09-13T18:26:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- 172.21.15.53:0/3515168599 wait complete. 2024-09-13T18:26:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 Processor -- start 2024-09-13T18:26:23.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- start start 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604003f00 0x7f86180ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180cc310 0x7f86180cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f861806f710 0x7f861806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86181f0ae0 con 0x7f861806f710 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86180ccdd0 con 0x7f8604003f00 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86180cd0b0 con 0x7f86180cc310 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f861806f710 0x7f861806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f861806f710 0x7f861806fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42514/0 (socket says 172.21.15.53:42514) 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 -- 172.21.15.53:0/2576041701 learned_addr learned my addr 172.21.15.53:0/2576041701 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f8616ffd640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604003f00 0x7f86180ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f860ffff640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180cc310 0x7f86180cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 -- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180cc310 msgr2=0x7f86180cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180cc310 0x7f86180cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 -- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604003f00 msgr2=0x7f86180ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604003f00 0x7f86180ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 -- 172.21.15.53:0/2576041701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86180cd390 con 0x7f861806f710 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f86177fe640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f861806f710 0x7f861806fba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f86180b5620 tx=0x7f861000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f8614ff9640 1 -- 172.21.15.53:0/2576041701 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610017400 con 0x7f861806f710 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f8614ff9640 1 -- 172.21.15.53:0/2576041701 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8610011040 con 0x7f861806f710 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86180cd670 con 0x7f861806f710 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f8614ff9640 1 -- 172.21.15.53:0/2576041701 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86100177c0 con 0x7f861806f710 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.098+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86180700e0 con 0x7f861806f710 2024-09-13T18:26:23.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.102+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86180d11c0 con 0x7f861806f710 2024-09-13T18:26:23.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.102+0000 7f8614ff9640 1 -- 172.21.15.53:0/2576041701 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f8610017920 con 0x7f861806f710 2024-09-13T18:26:23.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.102+0000 7f8614ff9640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85f8066840 0x7f85f8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.102+0000 7f8614ff9640 1 -- 172.21.15.53:0/2576041701 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8610084a80 con 0x7f861806f710 2024-09-13T18:26:23.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.102+0000 7f8616ffd640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85f8066840 0x7f85f8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.102+0000 7f8616ffd640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85f8066840 0x7f85f8068d00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8608001ec0 tx=0x7f8608009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.106+0000 7f8614ff9640 1 -- 172.21.15.53:0/2576041701 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8610051af0 con 0x7f861806f710 2024-09-13T18:26:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.266+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86180d21c0 con 0x7f861806f710 2024-09-13T18:26:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f8614ff9640 1 -- 172.21.15.53:0/2576041701 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f861001c090 con 0x7f861806f710 2024-09-13T18:26:23.273 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:23.273 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:00.339515+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85f8066840 msgr2=0x7f85f8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85f8066840 0x7f85f8068d00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8608001ec0 tx=0x7f8608009040 comp rx=0 tx=0).stop 2024-09-13T18:26:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f861806f710 msgr2=0x7f861806fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f861806f710 0x7f861806fba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f86180b5620 tx=0x7f861000f4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 shutdown_connections 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85f8066840 0x7f85f8068d00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86180cc310 0x7f86180cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f861806f710 0x7f861806fba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 --2- 172.21.15.53:0/2576041701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8604003f00 0x7f86180ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 >> 172.21.15.53:0/2576041701 conn(0x7f8618065c80 msgr2=0x7f86180b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 shutdown_connections 2024-09-13T18:26:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.270+0000 7f861d935640 1 -- 172.21.15.53:0/2576041701 wait complete. 2024-09-13T18:26:23.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:25:57.052393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:25:58.339187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:23.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:26:23.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20ad8a4640 1 Processor -- start 2024-09-13T18:26:23.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20ad8a4640 1 -- start start 2024-09-13T18:26:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20ad8a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80caee0 0x7f20a80cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20ad8a4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20a80cd320 0x7f20a80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20ad8a4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a806f7a0 con 0x7f20a8143e80 2024-09-13T18:26:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20ad8a4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a806baa0 con 0x7f20a80cd320 2024-09-13T18:26:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20ad8a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a806fd60 con 0x7f20a80caee0 2024-09-13T18:26:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20a77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20a80cd320 0x7f20a80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20a77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20a80cd320 0x7f20a80cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42530/0 (socket says 172.21.15.53:42530) 2024-09-13T18:26:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20a77fe640 1 -- 172.21.15.53:0/169573449 learned_addr learned my addr 172.21.15.53:0/169573449 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f209e7fc640 1 --2- 172.21.15.53:0/169573449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80caee0 0x7f20a80cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20a77fe640 1 -- 172.21.15.53:0/169573449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80caee0 msgr2=0x7f20a80cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20a77fe640 1 --2- 172.21.15.53:0/169573449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80caee0 0x7f20a80cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20a77fe640 1 -- 172.21.15.53:0/169573449 >> v1:172.21.15.87:6789/0 conn(0x7f20a8143e80 legacy=0x7f20a806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.422+0000 7f20a77fe640 1 -- 172.21.15.53:0/169573449 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a80cb960 con 0x7f20a80cd320 2024-09-13T18:26:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20a77fe640 1 --2- 172.21.15.53:0/169573449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80cd320 0x7f20a80cd7b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009e50 tx=0x7f20a001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8400cc4091a0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20a67fc640 1 -- 172.21.15.53:0/169573449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00a5830 con 0x7f20a80cd320 2024-09-13T18:26:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20a67fc640 1 -- 172.21.15.53:0/169573449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a00a5990 con 0x7f20a80cd320 2024-09-13T18:26:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20a67fc640 1 -- 172.21.15.53:0/169573449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00a5d20 con 0x7f20a80cd320 2024-09-13T18:26:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- 172.21.15.53:0/169573449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80cd320 msgr2=0x7f20a80cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/169573449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80cd320 0x7f20a80cd7b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009e50 tx=0x7f20a001c970 comp rx=0 tx=0).stop 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- 172.21.15.53:0/169573449 shutdown_connections 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/169573449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80cd320 0x7f20a80cd7b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/169573449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80caee0 0x7f20a80cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- 172.21.15.53:0/169573449 >> 172.21.15.53:0/169573449 conn(0x7f20a8065c80 msgr2=0x7f20a8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- 172.21.15.53:0/169573449 shutdown_connections 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- 172.21.15.53:0/169573449 wait complete. 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 Processor -- start 2024-09-13T18:26:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- start start 2024-09-13T18:26:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80caee0 0x7f20a80adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80cd320 0x7f20a80ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20a8143e80 0x7f20a815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81408a0 con 0x7f20a80caee0 2024-09-13T18:26:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8140000 con 0x7f20a8143e80 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20ad8a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81402e0 con 0x7f20a80cd320 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20a6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80caee0 0x7f20a80adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20a6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80caee0 0x7f20a80adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42540/0 (socket says 172.21.15.53:42540) 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.426+0000 7f20a6ffd640 1 -- 172.21.15.53:0/72447729 learned_addr learned my addr 172.21.15.53:0/72447729 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a77fe640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20a8143e80 0x7f20a815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f209e7fc640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80cd320 0x7f20a80ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a6ffd640 1 -- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80cd320 msgr2=0x7f20a80ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80cd320 0x7f20a80ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a6ffd640 1 -- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20a8143e80 msgr2=0x7f20a815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20a8143e80 0x7f20a815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a6ffd640 1 -- 172.21.15.53:0/72447729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009b30 con 0x7f20a80caee0 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80caee0 0x7f20a80adc00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f209800c3c0 tx=0x7f209800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a4ff9640 1 -- 172.21.15.53:0/72447729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980052d0 con 0x7f20a80caee0 2024-09-13T18:26:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a4ff9640 1 -- 172.21.15.53:0/72447729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098005430 con 0x7f20a80caee0 2024-09-13T18:26:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a81405c0 con 0x7f20a80caee0 2024-09-13T18:26:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a4ff9640 1 -- 172.21.15.53:0/72447729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098003840 con 0x7f20a80caee0 2024-09-13T18:26:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a8140bb0 con 0x7f20a80caee0 2024-09-13T18:26:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a80aa2f0 con 0x7f20a80caee0 2024-09-13T18:26:23.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a4ff9640 1 -- 172.21.15.53:0/72447729 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f20980039a0 con 0x7f20a80caee0 2024-09-13T18:26:23.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a4ff9640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2088066840 0x7f2088068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f20a4ff9640 1 -- 172.21.15.53:0/72447729 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2098083930 con 0x7f20a80caee0 2024-09-13T18:26:23.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f209e7fc640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2088066840 0x7f2088068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.430+0000 7f209e7fc640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2088066840 0x7f2088068d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f209000b9d0 tx=0x7f2090008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.434+0000 7f20a4ff9640 1 -- 172.21.15.53:0/72447729 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f20a80aa2f0 con 0x7f20a80caee0 2024-09-13T18:26:23.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20a80aa2f0 con 0x7f20a80caee0 2024-09-13T18:26:23.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20a4ff9640 1 -- 172.21.15.53:0/72447729 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20a80aa2f0 con 0x7f20a80caee0 2024-09-13T18:26:23.601 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2088066840 msgr2=0x7f2088068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2088066840 0x7f2088068d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f209000b9d0 tx=0x7f2090008040 comp rx=0 tx=0).stop 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80caee0 msgr2=0x7f20a80adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80caee0 0x7f20a80adc00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f209800c3c0 tx=0x7f209800c880 comp rx=0 tx=0).stop 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 shutdown_connections 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2088066840 0x7f2088068d00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20a80cd320 0x7f20a80ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20a8143e80 0x7f20a815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 --2- 172.21.15.53:0/72447729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20a80caee0 0x7f20a80adc00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.598+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 >> 172.21.15.53:0/72447729 conn(0x7f20a8065c80 msgr2=0x7f20a80afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.602+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 shutdown_connections 2024-09-13T18:26:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.602+0000 7f20ad8a4640 1 -- 172.21.15.53:0/72447729 wait complete. 2024-09-13T18:26:23.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:26:23.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6cddc640 1 Processor -- start 2024-09-13T18:26:23.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6cddc640 1 -- start start 2024-09-13T18:26:23.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6cddc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a680b2bf0 0x7f2a680cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6cddc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ced50 0x7f2a680b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6cddc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680ccd60 con 0x7f2a680ccf10 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6cddc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680cc190 con 0x7f2a680b2bf0 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6cddc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680ce270 con 0x7f2a680ced50 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a65d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a680b2bf0 0x7f2a680cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2a680ccf10 0x7f2a680cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40740/0 (socket says 172.21.15.53:40740) 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a6659c640 1 -- 172.21.15.53:0/1008316122 learned_addr learned my addr 172.21.15.53:0/1008316122 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a66d9d640 1 --2- 172.21.15.53:0/1008316122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ced50 0x7f2a680b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a65d9b640 1 -- 172.21.15.53:0/1008316122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ced50 msgr2=0x7f2a680b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.746+0000 7f2a65d9b640 1 --2- 172.21.15.53:0/1008316122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ced50 0x7f2a680b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a65d9b640 1 -- 172.21.15.53:0/1008316122 >> v1:172.21.15.53:6789/0 conn(0x7f2a680ccf10 legacy=0x7f2a680cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6559a640 1 -- 172.21.15.53:0/1008316122 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316067187 0 0) 0x7f2a680ccd60 con 0x7f2a680ccf10 2024-09-13T18:26:23.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a65d9b640 1 -- 172.21.15.53:0/1008316122 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680ce550 con 0x7f2a680b2bf0 2024-09-13T18:26:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a65d9b640 1 --2- 172.21.15.53:0/1008316122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680b2bf0 0x7f2a680cbab0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0097c0 tx=0x7f2a5c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327eace26b169811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6559a640 1 -- 172.21.15.53:0/1008316122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0ab600 con 0x7f2a680b2bf0 2024-09-13T18:26:23.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6559a640 1 -- 172.21.15.53:0/1008316122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0a7050 con 0x7f2a680b2bf0 2024-09-13T18:26:23.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6559a640 1 -- 172.21.15.53:0/1008316122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0ab980 con 0x7f2a680b2bf0 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 -- 172.21.15.53:0/1008316122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680b2bf0 msgr2=0x7f2a680cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/1008316122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680b2bf0 0x7f2a680cbab0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0097c0 tx=0x7f2a5c01c3e0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 -- 172.21.15.53:0/1008316122 shutdown_connections 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/1008316122 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ced50 0x7f2a680b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/1008316122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680b2bf0 0x7f2a680cbab0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 -- 172.21.15.53:0/1008316122 >> 172.21.15.53:0/1008316122 conn(0x7f2a680b20d0 msgr2=0x7f2a680b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 -- 172.21.15.53:0/1008316122 shutdown_connections 2024-09-13T18:26:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.750+0000 7f2a6cddc640 1 -- 172.21.15.53:0/1008316122 wait complete. 2024-09-13T18:26:23.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 Processor -- start 2024-09-13T18:26:23.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 -- start start 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a680b2bf0 0x7f2a68150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ccf10 0x7f2a68157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680ced50 0x7f2a68157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680ca090 con 0x7f2a680ced50 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680c9760 con 0x7f2a680b2bf0 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680c9a40 con 0x7f2a680ccf10 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680ced50 0x7f2a68157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680ced50 0x7f2a68157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42562/0 (socket says 172.21.15.53:42562) 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 -- 172.21.15.53:0/3135819674 learned_addr learned my addr 172.21.15.53:0/3135819674 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6659c640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a680b2bf0 0x7f2a68150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a65d9b640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ccf10 0x7f2a68157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 -- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ccf10 msgr2=0x7f2a68157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ccf10 0x7f2a68157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 -- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a680b2bf0 msgr2=0x7f2a68150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a680b2bf0 0x7f2a68150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 -- 172.21.15.53:0/3135819674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c009420 con 0x7f2a680ced50 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6659c640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a680b2bf0 0x7f2a68150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a66d9d640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680ced50 0x7f2a68157f90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2a60007e40 tx=0x7f2a6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a56ffd640 1 -- 172.21.15.53:0/3135819674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60014620 con 0x7f2a680ced50 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a56ffd640 1 -- 172.21.15.53:0/3135819674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000ee90 con 0x7f2a680ced50 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a680c9d20 con 0x7f2a680ced50 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a56ffd640 1 -- 172.21.15.53:0/3135819674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a600149e0 con 0x7f2a680ced50 2024-09-13T18:26:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6815abd0 con 0x7f2a680ced50 2024-09-13T18:26:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.754+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a680ca200 con 0x7f2a680ced50 2024-09-13T18:26:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.758+0000 7f2a56ffd640 1 -- 172.21.15.53:0/3135819674 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f2a60014b40 con 0x7f2a680ced50 2024-09-13T18:26:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.758+0000 7f2a56ffd640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2a48066840 0x7f2a48068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.758+0000 7f2a56ffd640 1 -- 172.21.15.53:0/3135819674 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a60084f00 con 0x7f2a680ced50 2024-09-13T18:26:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.758+0000 7f2a6659c640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2a48066840 0x7f2a48068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.758+0000 7f2a6659c640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2a48066840 0x7f2a48068d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000f70 tx=0x7f2a58009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.762+0000 7f2a56ffd640 1 -- 172.21.15.53:0/3135819674 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a60051f50 con 0x7f2a680ced50 2024-09-13T18:26:23.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.922+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a680b33d0 con 0x7f2a680ced50 2024-09-13T18:26:23.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.922+0000 7f2a56ffd640 1 -- 172.21.15.53:0/3135819674 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a60055570 con 0x7f2a680ced50 2024-09-13T18:26:23.927 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:26:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2a48066840 msgr2=0x7f2a48068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2a48066840 0x7f2a48068d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a58000f70 tx=0x7f2a58009040 comp rx=0 tx=0).stop 2024-09-13T18:26:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680ced50 msgr2=0x7f2a68157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680ced50 0x7f2a68157f90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2a60007e40 tx=0x7f2a6000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 shutdown_connections 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2a48066840 0x7f2a48068d00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a680ccf10 0x7f2a68157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a680ced50 0x7f2a68157f90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 --2- 172.21.15.53:0/3135819674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a680b2bf0 0x7f2a68150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 >> 172.21.15.53:0/3135819674 conn(0x7f2a680b20d0 msgr2=0x7f2a680cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 shutdown_connections 2024-09-13T18:26:23.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:23.926+0000 7f2a6cddc640 1 -- 172.21.15.53:0/3135819674 wait complete. 2024-09-13T18:26:23.946 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:26:24.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23de1c6640 1 Processor -- start 2024-09-13T18:26:24.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23de1c6640 1 -- start start 2024-09-13T18:26:24.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23de1c6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23d8158ba0 0x7f23d80cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23de1c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23d80b1dd0 0x7f23d80b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23de1c6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d806bc20 con 0x7f23d806ff40 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23de1c6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d806c530 con 0x7f23d80b1dd0 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23de1c6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d8158f80 con 0x7f23d8158ba0 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23ceffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23d80b1dd0 0x7f23d80b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23d7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f23d806ff40 0x7f23d8070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40744/0 (socket says 172.21.15.53:40744) 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23d7fff640 1 -- 172.21.15.53:0/3645892478 learned_addr learned my addr 172.21.15.53:0/3645892478 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23d77fe640 1 --2- 172.21.15.53:0/3645892478 >> v2:172.21.15.87:3300/0 conn(0x7f23d8158ba0 0x7f23d80cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23ceffd640 1 -- 172.21.15.53:0/3645892478 >> v2:172.21.15.87:3300/0 conn(0x7f23d8158ba0 msgr2=0x7f23d80cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23ceffd640 1 --2- 172.21.15.53:0/3645892478 >> v2:172.21.15.87:3300/0 conn(0x7f23d8158ba0 0x7f23d80cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23ceffd640 1 -- 172.21.15.53:0/3645892478 >> v1:172.21.15.53:6789/0 conn(0x7f23d806ff40 legacy=0x7f23d8070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23ceffd640 1 -- 172.21.15.53:0/3645892478 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80b2340 con 0x7f23d80b1dd0 2024-09-13T18:26:24.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.070+0000 7f23d77fe640 1 --2- 172.21.15.53:0/3645892478 >> v2:172.21.15.87:3300/0 conn(0x7f23d8158ba0 0x7f23d80cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:24.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23ceffd640 1 --2- 172.21.15.53:0/3645892478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d80b1dd0 0x7f23d80b3120 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f23d806d7c0 tx=0x7f23c001e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81e28bf07943dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23d6ffd640 1 -- 172.21.15.53:0/3645892478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00a7830 con 0x7f23d80b1dd0 2024-09-13T18:26:24.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23d6ffd640 1 -- 172.21.15.53:0/3645892478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c00ab070 con 0x7f23d80b1dd0 2024-09-13T18:26:24.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23d6ffd640 1 -- 172.21.15.53:0/3645892478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00a7bb0 con 0x7f23d80b1dd0 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- 172.21.15.53:0/3645892478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d80b1dd0 msgr2=0x7f23d80b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3645892478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d80b1dd0 0x7f23d80b3120 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f23d806d7c0 tx=0x7f23c001e7c0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- 172.21.15.53:0/3645892478 shutdown_connections 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3645892478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d80b1dd0 0x7f23d80b3120 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3645892478 >> v2:172.21.15.87:3300/0 conn(0x7f23d8158ba0 0x7f23d80cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- 172.21.15.53:0/3645892478 >> 172.21.15.53:0/3645892478 conn(0x7f23d8065c80 msgr2=0x7f23d8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- 172.21.15.53:0/3645892478 shutdown_connections 2024-09-13T18:26:24.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- 172.21.15.53:0/3645892478 wait complete. 2024-09-13T18:26:24.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 Processor -- start 2024-09-13T18:26:24.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- start start 2024-09-13T18:26:24.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23d806ff40 0x7f23d81f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23d80b1dd0 0x7f23d815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d8158ba0 0x7f23d80ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81f6120 con 0x7f23d8158ba0 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80acdf0 con 0x7f23d806ff40 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.074+0000 7f23de1c6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815ef60 con 0x7f23d80b1dd0 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d8158ba0 0x7f23d80ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d8158ba0 0x7f23d80ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42570/0 (socket says 172.21.15.53:42570) 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 -- 172.21.15.53:0/3136129775 learned_addr learned my addr 172.21.15.53:0/3136129775 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23ceffd640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23d80b1dd0 0x7f23d815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d77fe640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23d806ff40 0x7f23d81f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 -- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23d80b1dd0 msgr2=0x7f23d815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23d80b1dd0 0x7f23d815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 -- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23d806ff40 msgr2=0x7f23d81f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23d806ff40 0x7f23d81f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 -- 172.21.15.53:0/3136129775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c000b6b0 con 0x7f23d8158ba0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d7fff640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d8158ba0 0x7f23d80ad280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f23d000cbf0 tx=0x7f23d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d4ff9640 1 -- 172.21.15.53:0/3136129775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d000ad40 con 0x7f23d8158ba0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d4ff9640 1 -- 172.21.15.53:0/3136129775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0012400 con 0x7f23d8158ba0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d8154c00 con 0x7f23d8158ba0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d4ff9640 1 -- 172.21.15.53:0/3136129775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d000aea0 con 0x7f23d8158ba0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d81606c0 con 0x7f23d8158ba0 2024-09-13T18:26:24.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d80b3120 con 0x7f23d8158ba0 2024-09-13T18:26:24.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d4ff9640 1 -- 172.21.15.53:0/3136129775 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f23d0007070 con 0x7f23d8158ba0 2024-09-13T18:26:24.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d4ff9640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f23b8066870 0x7f23b8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d4ff9640 1 -- 172.21.15.53:0/3136129775 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23d00841b0 con 0x7f23d8158ba0 2024-09-13T18:26:24.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d77fe640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f23b8066870 0x7f23b8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.078+0000 7f23d77fe640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f23b8066870 0x7f23b8068d30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f23c80045f0 tx=0x7f23c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.082+0000 7f23d4ff9640 1 -- 172.21.15.53:0/3136129775 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f23d0051490 con 0x7f23d8158ba0 2024-09-13T18:26:24.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.246+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23d80acf30 con 0x7f23d8158ba0 2024-09-13T18:26:24.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.246+0000 7f23d4ff9640 1 -- 172.21.15.53:0/3136129775 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23d0054ab0 con 0x7f23d8158ba0 2024-09-13T18:26:24.250 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:26:24.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f23b8066870 msgr2=0x7f23b8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f23b8066870 0x7f23b8068d30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f23c80045f0 tx=0x7f23c8008040 comp rx=0 tx=0).stop 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d8158ba0 msgr2=0x7f23d80ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d8158ba0 0x7f23d80ad280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f23d000cbf0 tx=0x7f23d000a430 comp rx=0 tx=0).stop 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 shutdown_connections 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f23b8066870 0x7f23b8068d30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f23d80b1dd0 0x7f23d815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23d8158ba0 0x7f23d80ad280 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 --2- 172.21.15.53:0/3136129775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23d806ff40 0x7f23d81f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 >> 172.21.15.53:0/3136129775 conn(0x7f23d8065c80 msgr2=0x7f23d815afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 shutdown_connections 2024-09-13T18:26:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.250+0000 7f23de1c6640 1 -- 172.21.15.53:0/3136129775 wait complete. 2024-09-13T18:26:24.270 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:26:24.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:24.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:24.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6f492640 1 Processor -- start 2024-09-13T18:26:24.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6f492640 1 -- start start 2024-09-13T18:26:24.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6f492640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 0x7f2c68065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6f492640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c680661c0 0x7f2c6806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6f492640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c680ad000 con 0x7f2c6815c750 2024-09-13T18:26:24.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6f492640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c68066650 con 0x7f2c680661c0 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6f492640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680ad230 con 0x7f2c680acbc0 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6d22e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2c6815c750 0x7f2c680ae980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40750/0 (socket says 172.21.15.53:40750) 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6d22e640 1 -- 172.21.15.53:0/1676386421 learned_addr learned my addr 172.21.15.53:0/1676386421 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6da2f640 1 --2- 172.21.15.53:0/1676386421 >> v2:172.21.15.87:3300/0 conn(0x7f2c680661c0 0x7f2c6806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c6ca2d640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 0x7f2c68065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340301203 0 0) 0x7f2c680ad000 con 0x7f2c6815c750 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c54003530 con 0x7f2c6815c750 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795952373 0 0) 0x7f2c54003530 con 0x7f2c6815c750 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 msgr2=0x7f2c68065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 0x7f2c68065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 >> v2:172.21.15.87:3300/0 conn(0x7f2c680661c0 msgr2=0x7f2c6806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 --2- 172.21.15.53:0/1676386421 >> v2:172.21.15.87:3300/0 conn(0x7f2c680661c0 0x7f2c6806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680ad510 con 0x7f2c6815c750 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f2c64001680 con 0x7f2c6815c750 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 >> v1:172.21.15.53:6789/0 conn(0x7f2c6815c750 legacy=0x7f2c680ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c54003980 0x7f2c54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 0x7f2c540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004d10 0x7f2c54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68066650 con 0x7f2c54004d10 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680ad230 con 0x7f2c54003980 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.394+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5400b990 con 0x7f2c680acbc0 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004d10 0x7f2c54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6d22e640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c54003980 0x7f2c54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6ca2d640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 0x7f2c540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 -- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 msgr2=0x7f2c540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c680acbc0 0x7f2c540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 -- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c54003980 msgr2=0x7f2c54003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c54003980 0x7f2c54003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 -- 172.21.15.53:0/1676386421 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54003530 con 0x7f2c54004d10 2024-09-13T18:26:24.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004d10 0x7f2c54005190 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009fc0 tx=0x7f2c6001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15394da07575819 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600a5cd0 con 0x7f2c54004d10 2024-09-13T18:26:24.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000f040 con 0x7f2c54004d10 2024-09-13T18:26:24.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c5ffff640 1 -- 172.21.15.53:0/1676386421 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600ad680 con 0x7f2c54004d10 2024-09-13T18:26:24.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6f492640 1 -- 172.21.15.53:0/1676386421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004d10 msgr2=0x7f2c54005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6f492640 1 --2- 172.21.15.53:0/1676386421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c54004d10 0x7f2c54005190 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009fc0 tx=0x7f2c6001ccc0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6da2f640 1 -- 172.21.15.53:0/1676386421 reap_dead start 2024-09-13T18:26:24.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6f492640 1 -- 172.21.15.53:0/1676386421 shutdown_connections 2024-09-13T18:26:24.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6f492640 1 -- 172.21.15.53:0/1676386421 >> 172.21.15.53:0/1676386421 conn(0x7f2c680b1310 msgr2=0x7f2c680b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:24.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6f492640 1 -- 172.21.15.53:0/1676386421 shutdown_connections 2024-09-13T18:26:24.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.398+0000 7f2c6f492640 1 -- 172.21.15.53:0/1676386421 wait complete. 2024-09-13T18:26:24.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 Processor -- start 2024-09-13T18:26:24.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 -- start start 2024-09-13T18:26:24.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c68140a00 0x7f2c680afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c680b00c0 0x7f2c68153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c681542a0 0x7f2c6815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680b0540 con 0x7f2c68140a00 2024-09-13T18:26:24.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68155c50 con 0x7f2c680b00c0 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68155ed0 con 0x7f2c681542a0 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c68140a00 0x7f2c680afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c68140a00 0x7f2c680afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42580/0 (socket says 172.21.15.53:42580) 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 -- 172.21.15.53:0/2543928688 learned_addr learned my addr 172.21.15.53:0/2543928688 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6da2f640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c681542a0 0x7f2c6815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6ca2d640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c680b00c0 0x7f2c68153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 -- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c681542a0 msgr2=0x7f2c6815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c681542a0 0x7f2c6815ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 -- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c680b00c0 msgr2=0x7f2c68153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c680b00c0 0x7f2c68153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 -- 172.21.15.53:0/2543928688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c681561b0 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6ca2d640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c680b00c0 0x7f2c68153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6d22e640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c68140a00 0x7f2c680afb80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400eaf0 tx=0x7f2c640016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c5dffb640 1 -- 172.21.15.53:0/2543928688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400c850 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c5dffb640 1 -- 172.21.15.53:0/2543928688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400c9b0 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c5dffb640 1 -- 172.21.15.53:0/2543928688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400cd60 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c68156490 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c68156a50 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c680ae980 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.402+0000 7f2c5dffb640 1 -- 172.21.15.53:0/2543928688 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f2c6401d460 con 0x7f2c68140a00 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.406+0000 7f2c5dffb640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c4c066840 0x7f2c4c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.406+0000 7f2c5dffb640 1 -- 172.21.15.53:0/2543928688 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c640844e0 con 0x7f2c68140a00 2024-09-13T18:26:24.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.406+0000 7f2c6ca2d640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c4c066840 0x7f2c4c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.406+0000 7f2c6ca2d640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c4c066840 0x7f2c4c068d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2c680b0750 tx=0x7f2c58008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.410+0000 7f2c5dffb640 1 -- 172.21.15.53:0/2543928688 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c64051660 con 0x7f2c68140a00 2024-09-13T18:26:24.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.578+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2c6806d9f0 con 0x7f2c68140a00 2024-09-13T18:26:24.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.578+0000 7f2c5dffb640 1 -- 172.21.15.53:0/2543928688 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2c64054c80 con 0x7f2c68140a00 2024-09-13T18:26:24.583 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:26:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c4c066840 msgr2=0x7f2c4c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c4c066840 0x7f2c4c068d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2c680b0750 tx=0x7f2c58008040 comp rx=0 tx=0).stop 2024-09-13T18:26:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c68140a00 msgr2=0x7f2c680afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c68140a00 0x7f2c680afb80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400eaf0 tx=0x7f2c640016f0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 shutdown_connections 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c4c066840 0x7f2c4c068d00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c681542a0 0x7f2c6815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c680b00c0 0x7f2c68153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 --2- 172.21.15.53:0/2543928688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c68140a00 0x7f2c680afb80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 >> 172.21.15.53:0/2543928688 conn(0x7f2c680b1310 msgr2=0x7f2c6815b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 shutdown_connections 2024-09-13T18:26:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.582+0000 7f2c6f492640 1 -- 172.21.15.53:0/2543928688 wait complete. 2024-09-13T18:26:24.601 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:26:24.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:24.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:24.612 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[38759]: fuse finished with error 0 and tester_r 0 2024-09-13T18:26:24.613 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:26:24.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:24.613 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:26:24.749 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:26:24.749 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:24.756 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:24.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.862+0000 7f66c75b0640 1 Processor -- start 2024-09-13T18:26:24.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.862+0000 7f66c75b0640 1 -- start start 2024-09-13T18:26:24.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c75b0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 0x7f66c0070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c75b0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66c00711d0 0x7f66c01640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c75b0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c006d480 con 0x7f66c01582a0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c75b0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c015aaf0 con 0x7f66c00711d0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c75b0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c006d760 con 0x7f66c015b7c0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c534c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66c01582a0 0x7f66c006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40760/0 (socket says 172.21.15.53:40760) 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c534c640 1 -- 172.21.15.53:0/214299770 learned_addr learned my addr 172.21.15.53:0/214299770 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176005612 0 0) 0x7f66c006d480 con 0x7f66c01582a0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66ac003530 con 0x7f66c01582a0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c4b4b640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 0x7f66c0070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 --2- 172.21.15.53:0/214299770 >> v2:172.21.15.87:3300/0 conn(0x7f66c00711d0 0x7f66c01640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249030893 0 0) 0x7f66ac003530 con 0x7f66c01582a0 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 msgr2=0x7f66c0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 0x7f66c0070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 >> v2:172.21.15.87:3300/0 conn(0x7f66c00711d0 msgr2=0x7f66c01640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 --2- 172.21.15.53:0/214299770 >> v2:172.21.15.87:3300/0 conn(0x7f66c00711d0 0x7f66c01640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c015ace0 con 0x7f66c01582a0 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f66bc001680 con 0x7f66c01582a0 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 >> v1:172.21.15.53:6789/0 conn(0x7f66c01582a0 legacy=0x7f66c006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 0x7f66ac003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac004000 0x7f66ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac004d10 0x7f66ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac00ba40 con 0x7f66ac004d10 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac00bbb0 con 0x7f66ac004000 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac00bd70 con 0x7f66c015b7c0 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac004d10 0x7f66ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c534c640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 0x7f66ac003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c4b4b640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac004000 0x7f66ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 -- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 msgr2=0x7f66ac003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 0x7f66ac003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 -- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac004000 msgr2=0x7f66ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66ac004000 0x7f66ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 -- 172.21.15.53:0/214299770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac003530 con 0x7f66ac004d10 2024-09-13T18:26:24.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c534c640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c015b7c0 0x7f66ac003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:24.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.866+0000 7f66c5b4d640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac004d10 0x7f66ac005190 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f66b8007360 tx=0x7f66b801ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692333ff67ca7a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80a5d80 con 0x7f66ac004d10 2024-09-13T18:26:24.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b80ad440 con 0x7f66ac004d10 2024-09-13T18:26:24.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66b7fff640 1 -- 172.21.15.53:0/214299770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80ad7d0 con 0x7f66ac004d10 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- 172.21.15.53:0/214299770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac004d10 msgr2=0x7f66ac005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 --2- 172.21.15.53:0/214299770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66ac004d10 0x7f66ac005190 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f66b8007360 tx=0x7f66b801ce80 comp rx=0 tx=0).stop 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c5b4d640 1 -- 172.21.15.53:0/214299770 reap_dead start 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- 172.21.15.53:0/214299770 shutdown_connections 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- 172.21.15.53:0/214299770 >> 172.21.15.53:0/214299770 conn(0x7f66c0065c80 msgr2=0x7f66c0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- 172.21.15.53:0/214299770 shutdown_connections 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- 172.21.15.53:0/214299770 wait complete. 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 Processor -- start 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- start start 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66ac004d10 0x7f66c01f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c014dc10 0x7f66c00c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c014e090 0x7f66c00c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c00c3e10 con 0x7f66c014dc10 2024-09-13T18:26:24.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c00c40f0 con 0x7f66c014e090 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c00b16a0 con 0x7f66ac004d10 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c014dc10 0x7f66c00c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c014dc10 0x7f66c00c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42594/0 (socket says 172.21.15.53:42594) 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 -- 172.21.15.53:0/3816351342 learned_addr learned my addr 172.21.15.53:0/3816351342 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c5b4d640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c014e090 0x7f66c00c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c534c640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66ac004d10 0x7f66c01f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 -- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66ac004d10 msgr2=0x7f66c01f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66ac004d10 0x7f66c01f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 -- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c014e090 msgr2=0x7f66c00c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c014e090 0x7f66c00c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 -- 172.21.15.53:0/3816351342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c00b1980 con 0x7f66c014dc10 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c4b4b640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c014dc10 0x7f66c00c3390 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f66b000f580 tx=0x7f66b000fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66b5ffb640 1 -- 172.21.15.53:0/3816351342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0013810 con 0x7f66c014dc10 2024-09-13T18:26:24.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66b5ffb640 1 -- 172.21.15.53:0/3816351342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b0013970 con 0x7f66c014dc10 2024-09-13T18:26:24.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c00ccbb0 con 0x7f66c014dc10 2024-09-13T18:26:24.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66b5ffb640 1 -- 172.21.15.53:0/3816351342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0013d20 con 0x7f66c014dc10 2024-09-13T18:26:24.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.870+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c00c3aa0 con 0x7f66c014dc10 2024-09-13T18:26:24.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.874+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c0067400 con 0x7f66c014dc10 2024-09-13T18:26:24.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.874+0000 7f66b5ffb640 1 -- 172.21.15.53:0/3816351342 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f66b001f460 con 0x7f66c014dc10 2024-09-13T18:26:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.874+0000 7f66b5ffb640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66a4066840 0x7f66a4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.874+0000 7f66b5ffb640 1 -- 172.21.15.53:0/3816351342 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66b0084890 con 0x7f66c014dc10 2024-09-13T18:26:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.874+0000 7f66c534c640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66a4066840 0x7f66a4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:24.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.874+0000 7f66c534c640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66a4066840 0x7f66a4068d00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66bc000c10 tx=0x7f66bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:24.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:24.878+0000 7f66b5ffb640 1 -- 172.21.15.53:0/3816351342 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66b0051990 con 0x7f66c014dc10 2024-09-13T18:26:25.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.038+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c006d3a0 con 0x7f66c014dc10 2024-09-13T18:26:25.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66b5ffb640 1 -- 172.21.15.53:0/3816351342 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f66b0054fb0 con 0x7f66c014dc10 2024-09-13T18:26:25.045 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:25.045 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:00.339515+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66a4066840 msgr2=0x7f66a4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66a4066840 0x7f66a4068d00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f66bc000c10 tx=0x7f66bc009040 comp rx=0 tx=0).stop 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c014dc10 msgr2=0x7f66c00c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c014dc10 0x7f66c00c3390 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f66b000f580 tx=0x7f66b000fa40 comp rx=0 tx=0).stop 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 shutdown_connections 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66a4066840 0x7f66a4068d00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c014e090 0x7f66c00c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c014dc10 0x7f66c00c3390 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 --2- 172.21.15.53:0/3816351342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66ac004d10 0x7f66c01f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 >> 172.21.15.53:0/3816351342 conn(0x7f66c0065c80 msgr2=0x7f66c015a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:25.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 shutdown_connections 2024-09-13T18:26:25.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.042+0000 7f66c75b0640 1 -- 172.21.15.53:0/3816351342 wait complete. 2024-09-13T18:26:25.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:25:57.052393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:25:58.339187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:25.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:26:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb699049640 1 Processor -- start 2024-09-13T18:26:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb699049640 1 -- start start 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb699049640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb69406a4f0 0x7fb69415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb699049640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940d0320 con 0x7fb69406aa60 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb699049640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940d0600 con 0x7fb69415dbe0 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb699049640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69406b830 con 0x7fb69406a4f0 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb692d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb69406aa60 0x7fb69406ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40776/0 (socket says 172.21.15.53:40776) 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb692d9d640 1 -- 172.21.15.53:0/1874914665 learned_addr learned my addr 172.21.15.53:0/1874914665 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb69259c640 1 --2- 172.21.15.53:0/1874914665 >> v2:172.21.15.53:3300/0 conn(0x7fb69406a4f0 0x7fb69415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb691d9b640 1 -- 172.21.15.53:0/1874914665 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932923870 0 0) 0x7fb6940d0320 con 0x7fb69406aa60 2024-09-13T18:26:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb691d9b640 1 -- 172.21.15.53:0/1874914665 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb67c003530 con 0x7fb69406aa60 2024-09-13T18:26:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb69259c640 1 -- 172.21.15.53:0/1874914665 >> v1:172.21.15.87:6789/0 conn(0x7fb69415dbe0 legacy=0x7fb694166520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb69259c640 1 -- 172.21.15.53:0/1874914665 >> v1:172.21.15.53:6789/0 conn(0x7fb69406aa60 legacy=0x7fb69406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.186+0000 7fb69259c640 1 -- 172.21.15.53:0/1874914665 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6940d08e0 con 0x7fb69406a4f0 2024-09-13T18:26:25.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb69259c640 1 --2- 172.21.15.53:0/1874914665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb69415d6a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb6880097c0 tx=0x7fb68801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e309292750db33e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb691d9b640 1 -- 172.21.15.53:0/1874914665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6880ab600 con 0x7fb69406a4f0 2024-09-13T18:26:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb691d9b640 1 -- 172.21.15.53:0/1874914665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6880a7050 con 0x7fb69406a4f0 2024-09-13T18:26:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb691d9b640 1 -- 172.21.15.53:0/1874914665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6880ab980 con 0x7fb69406a4f0 2024-09-13T18:26:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- 172.21.15.53:0/1874914665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 msgr2=0x7fb69415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 --2- 172.21.15.53:0/1874914665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb69415d6a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb6880097c0 tx=0x7fb68801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- 172.21.15.53:0/1874914665 shutdown_connections 2024-09-13T18:26:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 --2- 172.21.15.53:0/1874914665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb69415d6a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- 172.21.15.53:0/1874914665 >> 172.21.15.53:0/1874914665 conn(0x7fb694071a70 msgr2=0x7fb694099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- 172.21.15.53:0/1874914665 shutdown_connections 2024-09-13T18:26:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- 172.21.15.53:0/1874914665 wait complete. 2024-09-13T18:26:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 Processor -- start 2024-09-13T18:26:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- start start 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb694157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69406aa60 0x7fb694149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69415dbe0 0x7fb694159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940b2750 con 0x7fb69406a4f0 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940b2d10 con 0x7fb69415dbe0 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb699049640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940b1730 con 0x7fb69406aa60 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb692d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb694157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb692d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb694157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42610/0 (socket says 172.21.15.53:42610) 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.190+0000 7fb692d9d640 1 -- 172.21.15.53:0/2151533504 learned_addr learned my addr 172.21.15.53:0/2151533504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb69359e640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69415dbe0 0x7fb694159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb69259c640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69406aa60 0x7fb694149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb692d9d640 1 -- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69406aa60 msgr2=0x7fb694149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb692d9d640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69406aa60 0x7fb694149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb692d9d640 1 -- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69415dbe0 msgr2=0x7fb694159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb692d9d640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69415dbe0 0x7fb694159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb692d9d640 1 -- 172.21.15.53:0/2151533504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb688009420 con 0x7fb69406a4f0 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb69359e640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69415dbe0 0x7fb694159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb692d9d640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb694157720 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c500 tx=0x7fb68400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb67b7fe640 1 -- 172.21.15.53:0/2151533504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684005cf0 con 0x7fb69406a4f0 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb67b7fe640 1 -- 172.21.15.53:0/2151533504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb684005e50 con 0x7fb69406a4f0 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6940b1a10 con 0x7fb69406a4f0 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb67b7fe640 1 -- 172.21.15.53:0/2151533504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840072f0 con 0x7fb69406a4f0 2024-09-13T18:26:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69414d050 con 0x7fb69406a4f0 2024-09-13T18:26:25.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6940d1540 con 0x7fb69406a4f0 2024-09-13T18:26:25.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb67b7fe640 1 -- 172.21.15.53:0/2151533504 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fb684007450 con 0x7fb69406a4f0 2024-09-13T18:26:25.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb67b7fe640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb680066840 0x7fb680068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb67b7fe640 1 -- 172.21.15.53:0/2151533504 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6840839c0 con 0x7fb69406a4f0 2024-09-13T18:26:25.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb69259c640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb680066840 0x7fb680068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.194+0000 7fb69259c640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb680066840 0x7fb680068d00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6880ad000 tx=0x7fb688008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.198+0000 7fb67b7fe640 1 -- 172.21.15.53:0/2151533504 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb684050bf0 con 0x7fb69406a4f0 2024-09-13T18:26:25.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.358+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb69409a180 con 0x7fb69406a4f0 2024-09-13T18:26:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.358+0000 7fb67b7fe640 1 -- 172.21.15.53:0/2151533504 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb684017020 con 0x7fb69406a4f0 2024-09-13T18:26:25.364 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:26:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb680066840 msgr2=0x7fb680068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb680066840 0x7fb680068d00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6880ad000 tx=0x7fb688008040 comp rx=0 tx=0).stop 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 msgr2=0x7fb694157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb694157720 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c500 tx=0x7fb68400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 shutdown_connections 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb680066840 0x7fb680068d00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69406aa60 0x7fb694149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69415dbe0 0x7fb694159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 --2- 172.21.15.53:0/2151533504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69406a4f0 0x7fb694157720 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 >> 172.21.15.53:0/2151533504 conn(0x7fb694071a70 msgr2=0x7fb69414ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 shutdown_connections 2024-09-13T18:26:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.362+0000 7fb699049640 1 -- 172.21.15.53:0/2151533504 wait complete. 2024-09-13T18:26:25.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:26:25.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97e63f640 1 Processor -- start 2024-09-13T18:26:25.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97e63f640 1 -- start start 2024-09-13T18:26:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97e63f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 0x7fc97806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97e63f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97806f7a0 con 0x7fc9780cda30 2024-09-13T18:26:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97e63f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97806fd60 con 0x7fc9780caee0 2024-09-13T18:26:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97e63f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780cb960 con 0x7fc978143e80 2024-09-13T18:26:25.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97cbdc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc9780cda30 0x7fc9780701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40788/0 (socket says 172.21.15.53:40788) 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97cbdc640 1 -- 172.21.15.53:0/2148177114 learned_addr learned my addr 172.21.15.53:0/2148177114 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc977fff640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 0x7fc97806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245737135 0 0) 0x7fc97806f7a0 con 0x7fc9780cda30 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc964003530 con 0x7fc9780cda30 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4188308879 0 0) 0x7fc964003530 con 0x7fc9780cda30 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 msgr2=0x7fc97806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 0x7fc97806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 >> v1:172.21.15.87:6789/0 conn(0x7fc9780caee0 legacy=0x7fc9780cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780cbc40 con 0x7fc9780cda30 2024-09-13T18:26:25.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc970001680 con 0x7fc9780cda30 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 >> v1:172.21.15.53:6789/0 conn(0x7fc9780cda30 legacy=0x7fc9780701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9640039b0 0x7fc964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9640047d0 0x7fc964004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 0x7fc9640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780cb960 con 0x7fc9640039b0 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96400bac0 con 0x7fc9640047d0 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96400bc80 con 0x7fc978143e80 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc977fff640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9640039b0 0x7fc964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc9777fe640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9640047d0 0x7fc964004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc97cbdc640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 0x7fc9640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc977fff640 1 -- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 msgr2=0x7fc9640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc977fff640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc978143e80 0x7fc9640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc977fff640 1 -- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9640047d0 msgr2=0x7fc964004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc977fff640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9640047d0 0x7fc964004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.502+0000 7fc977fff640 1 -- 172.21.15.53:0/2148177114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964003530 con 0x7fc9640039b0 2024-09-13T18:26:25.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc977fff640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9640039b0 0x7fc964003dd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc960009fc0 tx=0x7fc96001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01c2f40b4565b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600a5c60 con 0x7fc9640039b0 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96000f040 con 0x7fc9640039b0 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc976ffd640 1 -- 172.21.15.53:0/2148177114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600ad440 con 0x7fc9640039b0 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 -- 172.21.15.53:0/2148177114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9640039b0 msgr2=0x7fc964003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 --2- 172.21.15.53:0/2148177114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9640039b0 0x7fc964003dd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc960009fc0 tx=0x7fc96001cc50 comp rx=0 tx=0).stop 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97cbdc640 1 -- 172.21.15.53:0/2148177114 reap_dead start 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 -- 172.21.15.53:0/2148177114 shutdown_connections 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 -- 172.21.15.53:0/2148177114 >> 172.21.15.53:0/2148177114 conn(0x7fc978065c80 msgr2=0x7fc978066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 -- 172.21.15.53:0/2148177114 shutdown_connections 2024-09-13T18:26:25.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 -- 172.21.15.53:0/2148177114 wait complete. 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 Processor -- start 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.506+0000 7fc97e63f640 1 -- start start 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9640039b0 0x7fc9781f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97815a660 0x7fc97815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9780ade30 0x7fc9780ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781f4ce0 con 0x7fc9780ade30 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b0f30 con 0x7fc97815a660 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc978154700 con 0x7fc9640039b0 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9780ade30 0x7fc9780ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9780ade30 0x7fc9780ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42622/0 (socket says 172.21.15.53:42622) 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 -- 172.21.15.53:0/1669651599 learned_addr learned my addr 172.21.15.53:0/1669651599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:25.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc977fff640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9640039b0 0x7fc9781f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc9777fe640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97815a660 0x7fc97815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 -- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9640039b0 msgr2=0x7fc9781f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9640039b0 0x7fc9781f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 -- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97815a660 msgr2=0x7fc97815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97815a660 0x7fc97815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 -- 172.21.15.53:0/1669651599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780ae7d0 con 0x7fc9780ade30 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97cbdc640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9780ade30 0x7fc9780ae290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc97806d370 tx=0x7fc97000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc974ff9640 1 -- 172.21.15.53:0/1669651599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000eed0 con 0x7fc9780ade30 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc974ff9640 1 -- 172.21.15.53:0/1669651599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000c690 con 0x7fc9780ade30 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9780aea40 con 0x7fc9780ade30 2024-09-13T18:26:25.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc974ff9640 1 -- 172.21.15.53:0/1669651599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000ca20 con 0x7fc9780ade30 2024-09-13T18:26:25.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780af000 con 0x7fc9780ade30 2024-09-13T18:26:25.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9780cd320 con 0x7fc9780ade30 2024-09-13T18:26:25.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc974ff9640 1 -- 172.21.15.53:0/1669651599 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc97000cb80 con 0x7fc9780ade30 2024-09-13T18:26:25.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc974ff9640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc958066870 0x7fc958068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc974ff9640 1 -- 172.21.15.53:0/1669651599 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9700839a0 con 0x7fc9780ade30 2024-09-13T18:26:25.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.510+0000 7fc977fff640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc958066870 0x7fc958068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.514+0000 7fc977fff640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc958066870 0x7fc958068d30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc9600af000 tx=0x7fc960004ac0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.514+0000 7fc974ff9640 1 -- 172.21.15.53:0/1669651599 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc970050a90 con 0x7fc9780ade30 2024-09-13T18:26:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.670+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9780b32b0 con 0x7fc9780ade30 2024-09-13T18:26:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.670+0000 7fc974ff9640 1 -- 172.21.15.53:0/1669651599 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc970019020 con 0x7fc9780ade30 2024-09-13T18:26:25.675 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:26:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc958066870 msgr2=0x7fc958068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc958066870 0x7fc958068d30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc9600af000 tx=0x7fc960004ac0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9780ade30 msgr2=0x7fc9780ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9780ade30 0x7fc9780ae290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc97806d370 tx=0x7fc97000eb90 comp rx=0 tx=0).stop 2024-09-13T18:26:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 shutdown_connections 2024-09-13T18:26:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc958066870 0x7fc958068d30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9780ade30 0x7fc9780ae290 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc97815a660 0x7fc97815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 --2- 172.21.15.53:0/1669651599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9640039b0 0x7fc9781f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 >> 172.21.15.53:0/1669651599 conn(0x7fc978065c80 msgr2=0x7fc97815c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 shutdown_connections 2024-09-13T18:26:25.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.674+0000 7fc97e63f640 1 -- 172.21.15.53:0/1669651599 wait complete. 2024-09-13T18:26:25.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:26:25.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e71312640 1 Processor -- start 2024-09-13T18:26:25.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e71312640 1 -- start start 2024-09-13T18:26:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e71312640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0ccd10 0x7f9e6c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e71312640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9e6c0d2c80 0x7f9e6c0d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e71312640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c0b7db0 con 0x7f9e6c15c830 2024-09-13T18:26:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e71312640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c0d3670 con 0x7f9e6c0d2c80 2024-09-13T18:26:25.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e71312640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0d0650 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9e6c0d2c80 0x7f9e6c0d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6a7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0ccd10 0x7f9e6c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9e6c0d2c80 0x7f9e6c0d3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:38518/0 (socket says 172.21.15.53:38518) 2024-09-13T18:26:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6affd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9e6c15c830 0x7f9e6c0d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:32996/0 (socket says 172.21.15.53:32996) 2024-09-13T18:26:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6b7fe640 1 -- 172.21.15.53:0/2961406431 learned_addr learned my addr 172.21.15.53:0/2961406431 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:25.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6a7fc640 1 -- 172.21.15.53:0/2961406431 >> v2:172.21.15.87:3300/0 conn(0x7f9e6c0d2c80 msgr2=0x7f9e6c0d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:25.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6a7fc640 1 --2- 172.21.15.53:0/2961406431 >> v2:172.21.15.87:3300/0 conn(0x7f9e6c0d2c80 0x7f9e6c0d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6a7fc640 1 -- 172.21.15.53:0/2961406431 >> v1:172.21.15.87:6789/0 conn(0x7f9e6c15c830 legacy=0x7f9e6c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e6a7fc640 1 -- 172.21.15.53:0/2961406431 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0d0c10 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.806+0000 7f9e69ffb640 1 -- 172.21.15.53:0/2961406431 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817650086 0 0) 0x7f9e6c0b7db0 con 0x7f9e6c15c830 2024-09-13T18:26:25.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e6a7fc640 1 --2- 172.21.15.53:0/2961406431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0ccd10 0x7f9e6c0cd150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e600097c0 tx=0x7f9e6001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462035ef40ea329d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e69ffb640 1 -- 172.21.15.53:0/2961406431 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600ab600 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e69ffb640 1 -- 172.21.15.53:0/2961406431 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e600a7050 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e69ffb640 1 -- 172.21.15.53:0/2961406431 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600ab980 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 -- 172.21.15.53:0/2961406431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0ccd10 msgr2=0x7f9e6c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 --2- 172.21.15.53:0/2961406431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0ccd10 0x7f9e6c0cd150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e600097c0 tx=0x7f9e6001c4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 -- 172.21.15.53:0/2961406431 shutdown_connections 2024-09-13T18:26:25.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 --2- 172.21.15.53:0/2961406431 >> v2:172.21.15.87:3300/0 conn(0x7f9e6c0d2c80 0x7f9e6c0d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 --2- 172.21.15.53:0/2961406431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0ccd10 0x7f9e6c0cd150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 -- 172.21.15.53:0/2961406431 >> 172.21.15.53:0/2961406431 conn(0x7f9e6c070970 msgr2=0x7f9e6c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:25.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 -- 172.21.15.53:0/2961406431 shutdown_connections 2024-09-13T18:26:25.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.810+0000 7f9e71312640 1 -- 172.21.15.53:0/2961406431 wait complete. 2024-09-13T18:26:25.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 Processor -- start 2024-09-13T18:26:25.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 -- start start 2024-09-13T18:26:25.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e6c0ccd10 0x7f9e6c152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0d2c80 0x7f9e6c0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e6c15c830 0x7f9e6c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15e750 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15ea20 con 0x7f9e6c15c830 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15ed00 con 0x7f9e6c0d2c80 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e6c0ccd10 0x7f9e6c152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e6c0ccd10 0x7f9e6c152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42624/0 (socket says 172.21.15.53:42624) 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 -- 172.21.15.53:0/2436405878 learned_addr learned my addr 172.21.15.53:0/2436405878 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6b7fe640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e6c15c830 0x7f9e6c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6a7fc640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0d2c80 0x7f9e6c0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 -- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0d2c80 msgr2=0x7f9e6c0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0d2c80 0x7f9e6c0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 -- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e6c15c830 msgr2=0x7f9e6c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e6c15c830 0x7f9e6c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 -- 172.21.15.53:0/2436405878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e60009420 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e6affd640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e6c0ccd10 0x7f9e6c152b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00c480 tx=0x7f9e5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e537fe640 1 -- 172.21.15.53:0/2436405878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0074e0 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e537fe640 1 -- 172.21.15.53:0/2436405878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c007660 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e537fe640 1 -- 172.21.15.53:0/2436405878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c004a30 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c15efe0 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c15f5a0 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c15f790 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e537fe640 1 -- 172.21.15.53:0/2436405878 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f9e5c004b90 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e537fe640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9e58066870 0x7f9e58068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:25.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.814+0000 7f9e537fe640 1 -- 172.21.15.53:0/2436405878 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e5c0835a0 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.818+0000 7f9e6a7fc640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9e58066870 0x7f9e58068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:25.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.818+0000 7f9e6a7fc640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9e58066870 0x7f9e58068d30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9e600ad000 tx=0x7f9e600a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.818+0000 7f9e537fe640 1 -- 172.21.15.53:0/2436405878 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e5c050720 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.978+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e6c0d3110 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.978+0000 7f9e537fe640 1 -- 172.21.15.53:0/2436405878 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e5c053d40 con 0x7f9e6c0ccd10 2024-09-13T18:26:25.982 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:26:25.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9e58066870 msgr2=0x7f9e58068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9e58066870 0x7f9e58068d30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9e600ad000 tx=0x7f9e600a6000 comp rx=0 tx=0).stop 2024-09-13T18:26:25.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e6c0ccd10 msgr2=0x7f9e6c152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:25.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e6c0ccd10 0x7f9e6c152b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00c480 tx=0x7f9e5c00c940 comp rx=0 tx=0).stop 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 shutdown_connections 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9e58066870 0x7f9e58068d30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e6c0d2c80 0x7f9e6c0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e6c15c830 0x7f9e6c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 --2- 172.21.15.53:0/2436405878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e6c0ccd10 0x7f9e6c152b50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 >> 172.21.15.53:0/2436405878 conn(0x7f9e6c070970 msgr2=0x7f9e6c0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 shutdown_connections 2024-09-13T18:26:25.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:25.982+0000 7f9e71312640 1 -- 172.21.15.53:0/2436405878 wait complete. 2024-09-13T18:26:26.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:26:26.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144e680640 1 Processor -- start 2024-09-13T18:26:26.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144e680640 1 -- start start 2024-09-13T18:26:26.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144e680640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14481582a0 0x7f144806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144e680640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14480713a0 0x7f144806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144e680640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144806d480 con 0x7f144815b7c0 2024-09-13T18:26:26.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144e680640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144815aaf0 con 0x7f14481582a0 2024-09-13T18:26:26.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144e680640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144806d760 con 0x7f14480713a0 2024-09-13T18:26:26.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144cc1d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14480713a0 0x7f144806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f1447fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14481582a0 0x7f144806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f14477fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f144815b7c0 0x7f1448070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:33012/0 (socket says 172.21.15.53:33012) 2024-09-13T18:26:26.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f14477fe640 1 -- 172.21.15.53:0/2034175103 learned_addr learned my addr 172.21.15.53:0/2034175103 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:26.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144cc1d640 1 -- 172.21.15.53:0/2034175103 >> v2:172.21.15.87:3300/0 conn(0x7f14481582a0 msgr2=0x7f144806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:26.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144cc1d640 1 --2- 172.21.15.53:0/2034175103 >> v2:172.21.15.87:3300/0 conn(0x7f14481582a0 0x7f144806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144cc1d640 1 -- 172.21.15.53:0/2034175103 >> v1:172.21.15.87:6789/0 conn(0x7f144815b7c0 legacy=0x7f1448070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.114+0000 7f144cc1d640 1 -- 172.21.15.53:0/2034175103 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144815ace0 con 0x7f14480713a0 2024-09-13T18:26:26.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144cc1d640 1 --2- 172.21.15.53:0/2034175103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14480713a0 0x7f144806ce40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14400097c0 tx=0x7f144001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=968c8e7f718ed553 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f1446ffd640 1 -- 172.21.15.53:0/2034175103 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400ab670 con 0x7f14480713a0 2024-09-13T18:26:26.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f1446ffd640 1 -- 172.21.15.53:0/2034175103 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14400ab7d0 con 0x7f14480713a0 2024-09-13T18:26:26.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f1446ffd640 1 -- 172.21.15.53:0/2034175103 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400abb60 con 0x7f14480713a0 2024-09-13T18:26:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 -- 172.21.15.53:0/2034175103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14480713a0 msgr2=0x7f144806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 --2- 172.21.15.53:0/2034175103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14480713a0 0x7f144806ce40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14400097c0 tx=0x7f144001c470 comp rx=0 tx=0).stop 2024-09-13T18:26:26.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 -- 172.21.15.53:0/2034175103 shutdown_connections 2024-09-13T18:26:26.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 --2- 172.21.15.53:0/2034175103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14480713a0 0x7f144806ce40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 --2- 172.21.15.53:0/2034175103 >> v2:172.21.15.87:3300/0 conn(0x7f14481582a0 0x7f144806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 -- 172.21.15.53:0/2034175103 >> 172.21.15.53:0/2034175103 conn(0x7f1448065c80 msgr2=0x7f1448066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:26.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 -- 172.21.15.53:0/2034175103 shutdown_connections 2024-09-13T18:26:26.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.118+0000 7f144e680640 1 -- 172.21.15.53:0/2034175103 wait complete. 2024-09-13T18:26:26.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 Processor -- start 2024-09-13T18:26:26.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 -- start start 2024-09-13T18:26:26.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14480713a0 0x7f144814a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14481582a0 0x7f144814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f144815b7c0 0x7f144814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448147160 con 0x7f14480713a0 2024-09-13T18:26:26.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448147440 con 0x7f14481582a0 2024-09-13T18:26:26.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1448147720 con 0x7f144815b7c0 2024-09-13T18:26:26.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14480713a0 0x7f144814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14480713a0 0x7f144814a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42632/0 (socket says 172.21.15.53:42632) 2024-09-13T18:26:26.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 -- 172.21.15.53:0/650648895 learned_addr learned my addr 172.21.15.53:0/650648895 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:26.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144cc1d640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f144815b7c0 0x7f144814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f14477fe640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14481582a0 0x7f144814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 -- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f144815b7c0 msgr2=0x7f144814b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f144815b7c0 0x7f144814b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 -- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14481582a0 msgr2=0x7f144814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14481582a0 0x7f144814afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 -- 172.21.15.53:0/650648895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440009420 con 0x7f14480713a0 2024-09-13T18:26:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1447fff640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14480713a0 0x7f144814a640 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f143800efc0 tx=0x7f143800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1444ff9640 1 -- 172.21.15.53:0/650648895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438014480 con 0x7f14480713a0 2024-09-13T18:26:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1444ff9640 1 -- 172.21.15.53:0/650648895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800f040 con 0x7f14480713a0 2024-09-13T18:26:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1448147a00 con 0x7f14480713a0 2024-09-13T18:26:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1444ff9640 1 -- 172.21.15.53:0/650648895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438014800 con 0x7f14480713a0 2024-09-13T18:26:26.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1448146c60 con 0x7f14480713a0 2024-09-13T18:26:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1448067400 con 0x7f14480713a0 2024-09-13T18:26:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.122+0000 7f1444ff9640 1 -- 172.21.15.53:0/650648895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1438014960 con 0x7f14480713a0 2024-09-13T18:26:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.126+0000 7f1444ff9640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1428066840 0x7f1428068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.126+0000 7f1444ff9640 1 -- 172.21.15.53:0/650648895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1438085400 con 0x7f14480713a0 2024-09-13T18:26:26.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.126+0000 7f14477fe640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1428066840 0x7f1428068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.126+0000 7f14477fe640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1428066840 0x7f1428068d00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1448139260 tx=0x7f1430009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.130+0000 7f1444ff9640 1 -- 172.21.15.53:0/650648895 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1438052450 con 0x7f14480713a0 2024-09-13T18:26:26.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1448146ee0 con 0x7f14480713a0 2024-09-13T18:26:26.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f1444ff9640 1 -- 172.21.15.53:0/650648895 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f143805ae60 con 0x7f14480713a0 2024-09-13T18:26:26.305 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:26:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1428066840 msgr2=0x7f1428068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1428066840 0x7f1428068d00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1448139260 tx=0x7f1430009040 comp rx=0 tx=0).stop 2024-09-13T18:26:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14480713a0 msgr2=0x7f144814a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14480713a0 0x7f144814a640 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f143800efc0 tx=0x7f143800c490 comp rx=0 tx=0).stop 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 shutdown_connections 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1428066840 0x7f1428068d00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f144815b7c0 0x7f144814b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14481582a0 0x7f144814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 --2- 172.21.15.53:0/650648895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14480713a0 0x7f144814a640 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 >> 172.21.15.53:0/650648895 conn(0x7f1448065c80 msgr2=0x7f14480ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 shutdown_connections 2024-09-13T18:26:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.302+0000 7f144e680640 1 -- 172.21.15.53:0/650648895 wait complete. 2024-09-13T18:26:26.324 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:26:26.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:26.324 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:26.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35165]: fuse finished with error 0 and tester_r 0 2024-09-13T18:26:26.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:26:26.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:26.342 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:26:26.483 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:26:26.484 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:26.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:26:26.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:26:26.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:26.490 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:26:26.536 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:26:26.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:26.537 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:26:26.537 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:26.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:26:26.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:26:26.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:26.544 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:26:26.592 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:26:26.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:26:26.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:26.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.722+0000 7f02d8481640 1 Processor -- start 2024-09-13T18:26:26.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.722+0000 7f02d8481640 1 -- start start 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d8481640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d015a470 0x7f02d00cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d8481640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02d015cc60 0x7f02d0071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d8481640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d006f550 con 0x7f02d00b1c10 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d8481640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d006f880 con 0x7f02d015cc60 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d8481640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d015dc40 con 0x7f02d015a470 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02d015cc60 0x7f02d0071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02d015cc60 0x7f02d0071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53718/0 (socket says 172.21.15.53:53718) 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 -- 172.21.15.53:0/1896081411 learned_addr learned my addr 172.21.15.53:0/1896081411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 -- 172.21.15.53:0/1896081411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d015a470 msgr2=0x7f02d00cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 --2- 172.21.15.53:0/1896081411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d015a470 0x7f02d00cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 -- 172.21.15.53:0/1896081411 >> v1:172.21.15.87:6789/0 conn(0x7f02d00b1c10 legacy=0x7f02d006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:26.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 -- 172.21.15.53:0/1896081411 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00715a0 con 0x7f02d015cc60 2024-09-13T18:26:26.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d5a1c640 1 --2- 172.21.15.53:0/1896081411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d0071060 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009870 tx=0x7f02c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d8d1e6ee193e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d521b640 1 -- 172.21.15.53:0/1896081411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c00aa640 con 0x7f02d015cc60 2024-09-13T18:26:26.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d521b640 1 -- 172.21.15.53:0/1896081411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c00aa7a0 con 0x7f02d015cc60 2024-09-13T18:26:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.726+0000 7f02d521b640 1 -- 172.21.15.53:0/1896081411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c00aab30 con 0x7f02d015cc60 2024-09-13T18:26:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- 172.21.15.53:0/1896081411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 msgr2=0x7f02d0071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 --2- 172.21.15.53:0/1896081411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d0071060 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009870 tx=0x7f02c001c520 comp rx=0 tx=0).stop 2024-09-13T18:26:26.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- 172.21.15.53:0/1896081411 shutdown_connections 2024-09-13T18:26:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 --2- 172.21.15.53:0/1896081411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d0071060 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 --2- 172.21.15.53:0/1896081411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d015a470 0x7f02d00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- 172.21.15.53:0/1896081411 >> 172.21.15.53:0/1896081411 conn(0x7f02d0065c80 msgr2=0x7f02d0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- 172.21.15.53:0/1896081411 shutdown_connections 2024-09-13T18:26:26.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- 172.21.15.53:0/1896081411 wait complete. 2024-09-13T18:26:26.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 Processor -- start 2024-09-13T18:26:26.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- start start 2024-09-13T18:26:26.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d00b1c10 0x7f02d01f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d015a470 0x7f02d0156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d014d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d015b7b0 con 0x7f02d015cc60 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d01f6290 con 0x7f02d015a470 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d015ac30 con 0x7f02d00b1c10 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d014d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d014d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53732/0 (socket says 172.21.15.53:53732) 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 -- 172.21.15.53:0/4054865118 learned_addr learned my addr 172.21.15.53:0/4054865118 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d5a1c640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d015a470 0x7f02d0156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d621d640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d00b1c10 0x7f02d01f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 -- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d00b1c10 msgr2=0x7f02d01f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d00b1c10 0x7f02d01f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 -- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d015a470 msgr2=0x7f02d0156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d015a470 0x7f02d0156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 -- 172.21.15.53:0/4054865118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00094d0 con 0x7f02d015cc60 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d6a1e640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d014d3d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c780 tx=0x7f02c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02c6ffd640 1 -- 172.21.15.53:0/4054865118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8003d90 con 0x7f02d015cc60 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02c6ffd640 1 -- 172.21.15.53:0/4054865118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c800ce90 con 0x7f02d015cc60 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d015af10 con 0x7f02d015cc60 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02c6ffd640 1 -- 172.21.15.53:0/4054865118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80052b0 con 0x7f02d015cc60 2024-09-13T18:26:26.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.730+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d015b4d0 con 0x7f02d015cc60 2024-09-13T18:26:26.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.734+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d0067400 con 0x7f02d015cc60 2024-09-13T18:26:26.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.734+0000 7f02c6ffd640 1 -- 172.21.15.53:0/4054865118 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f02c8005410 con 0x7f02d015cc60 2024-09-13T18:26:26.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.734+0000 7f02c6ffd640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f02b4066840 0x7f02b4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.734+0000 7f02c6ffd640 1 -- 172.21.15.53:0/4054865118 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02c8083a20 con 0x7f02d015cc60 2024-09-13T18:26:26.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.734+0000 7f02d621d640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f02b4066840 0x7f02b4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.734+0000 7f02d621d640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f02b4066840 0x7f02b4068d00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f02cc006fd0 tx=0x7f02cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.738+0000 7f02c6ffd640 1 -- 172.21.15.53:0/4054865118 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02c8050a80 con 0x7f02d015cc60 2024-09-13T18:26:26.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02d00cc270 con 0x7f02d015cc60 2024-09-13T18:26:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02c6ffd640 1 -- 172.21.15.53:0/4054865118 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f02c8017070 con 0x7f02d015cc60 2024-09-13T18:26:26.941 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:26.941 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3877303910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3877303910},{"type":"v1","addr":"172.21.15.87:6836","nonce":3877303910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1431925450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":1431925450},{"type":"v1","addr":"172.21.15.87:6837","nonce":1431925450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2751759497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2751759497},{"type":"v1","addr":"172.21.15.53:6834","nonce":2751759497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:25:59.336241+0000","modified":"2024-09-13T18:26:01.346568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5193":{"gid":5193,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2879083637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2879083637},{"type":"v1","addr":"172.21.15.53:6835","nonce":2879083637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:26:26.941 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 14 2024-09-13T18:26:26.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f02b4066840 msgr2=0x7f02b4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f02b4066840 0x7f02b4068d00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f02cc006fd0 tx=0x7f02cc008040 comp rx=0 tx=0).stop 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 msgr2=0x7f02d014d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d014d3d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c780 tx=0x7f02c800cc40 comp rx=0 tx=0).stop 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 shutdown_connections 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f02b4066840 0x7f02b4068d00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d015cc60 0x7f02d014d3d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02d015a470 0x7f02d0156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 --2- 172.21.15.53:0/4054865118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f02d00b1c10 0x7f02d01f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 >> 172.21.15.53:0/4054865118 conn(0x7f02d0065c80 msgr2=0x7f02d0066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 shutdown_connections 2024-09-13T18:26:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:26.938+0000 7f02d8481640 1 -- 172.21.15.53:0/4054865118 wait complete. 2024-09-13T18:26:26.960 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.070+0000 7f6523694640 1 Processor -- start 2024-09-13T18:26:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6523694640 1 -- start start 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6523694640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f651c0d19c0 0x7f651c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6523694640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 0x7f651c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6523694640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651c0d2400 con 0x7f651c15cab0 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6523694640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651c0cfa90 con 0x7f651c0d19c0 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6523694640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0d1530 con 0x7f651c0cf600 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f651c15cab0 0x7f651c0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50306/0 (socket says 172.21.15.53:50306) 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 -- 172.21.15.53:0/67804322 learned_addr learned my addr 172.21.15.53:0/67804322 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521c31640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 0x7f651c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6520c2f640 1 --2- 172.21.15.53:0/67804322 >> v2:172.21.15.87:3300/0 conn(0x7f651c0d19c0 0x7f651c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019989824 0 0) 0x7f651c0d2400 con 0x7f651c15cab0 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6508003530 con 0x7f651c15cab0 2024-09-13T18:26:27.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3827389491 0 0) 0x7f6508003530 con 0x7f651c15cab0 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 msgr2=0x7f651c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 0x7f651c0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 >> v2:172.21.15.87:3300/0 conn(0x7f651c0d19c0 msgr2=0x7f651c0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 --2- 172.21.15.53:0/67804322 >> v2:172.21.15.87:3300/0 conn(0x7f651c0d19c0 0x7f651c0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c0cddd0 con 0x7f651c15cab0 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6518001a00 con 0x7f651c15cab0 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 >> v1:172.21.15.53:6789/0 conn(0x7f651c15cab0 legacy=0x7f651c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f6508003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 0x7f65080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6508004d10 0x7f6508005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0cfa90 con 0x7f6508003980 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0d1530 con 0x7f6508004d10 2024-09-13T18:26:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650800b990 con 0x7f651c0cf600 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f6508003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6520c2f640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 0x7f65080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521c31640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6508004d10 0x7f6508005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 -- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 msgr2=0x7f65080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0cf600 0x7f65080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 -- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6508004d10 msgr2=0x7f6508005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6508004d10 0x7f6508005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.074+0000 7f6521430640 1 -- 172.21.15.53:0/67804322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6508003530 con 0x7f6508003980 2024-09-13T18:26:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6521430640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f6508003da0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f651800a890 tx=0x7f651801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb6ed7a726924b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180ad630 con 0x7f6508003980 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65180a8070 con 0x7f6508003980 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6513fff640 1 -- 172.21.15.53:0/67804322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180ad9f0 con 0x7f6508003980 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- 172.21.15.53:0/67804322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 msgr2=0x7f6508003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 --2- 172.21.15.53:0/67804322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f6508003da0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f651800a890 tx=0x7f651801d380 comp rx=0 tx=0).stop 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6521c31640 1 -- 172.21.15.53:0/67804322 reap_dead start 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- 172.21.15.53:0/67804322 shutdown_connections 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- 172.21.15.53:0/67804322 >> 172.21.15.53:0/67804322 conn(0x7f651c065c80 msgr2=0x7f651c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- 172.21.15.53:0/67804322 shutdown_connections 2024-09-13T18:26:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- 172.21.15.53:0/67804322 wait complete. 2024-09-13T18:26:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 Processor -- start 2024-09-13T18:26:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- start start 2024-09-13T18:26:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f651c14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f651c14db40 0x7f651c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0b4030 0x7f651c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c14fad0 con 0x7f6508003980 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c0b49f0 con 0x7f651c14db40 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6523694640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651c14ee50 con 0x7f651c0b4030 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6521430640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f651c14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6521430640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f651c14e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53748/0 (socket says 172.21.15.53:53748) 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.078+0000 7f6521430640 1 -- 172.21.15.53:0/3830633944 learned_addr learned my addr 172.21.15.53:0/3830633944 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6521c31640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0b4030 0x7f651c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6520c2f640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f651c14db40 0x7f651c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6521430640 1 -- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0b4030 msgr2=0x7f651c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6521430640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0b4030 0x7f651c0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6521430640 1 -- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f651c14db40 msgr2=0x7f651c14d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6521430640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f651c14db40 0x7f651c14d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6521430640 1 -- 172.21.15.53:0/3830633944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c14f130 con 0x7f6508003980 2024-09-13T18:26:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6521430640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f651c14e870 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f651801cdf0 tx=0x7f6508005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6511ffb640 1 -- 172.21.15.53:0/3830633944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518001900 con 0x7f6508003980 2024-09-13T18:26:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6511ffb640 1 -- 172.21.15.53:0/3830633944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6518004b70 con 0x7f6508003980 2024-09-13T18:26:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651c14f410 con 0x7f6508003980 2024-09-13T18:26:27.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6511ffb640 1 -- 172.21.15.53:0/3830633944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518001a60 con 0x7f6508003980 2024-09-13T18:26:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651c14e2c0 con 0x7f6508003980 2024-09-13T18:26:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651c0b6bb0 con 0x7f6508003980 2024-09-13T18:26:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6511ffb640 1 -- 172.21.15.53:0/3830633944 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f65180aa030 con 0x7f6508003980 2024-09-13T18:26:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6511ffb640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6500066870 0x7f6500068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6511ffb640 1 -- 172.21.15.53:0/3830633944 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f651811e430 con 0x7f6508003980 2024-09-13T18:26:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6520c2f640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6500066870 0x7f6500068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.082+0000 7f6520c2f640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6500066870 0x7f6500068d30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f651c14e7b0 tx=0x7f650c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.086+0000 7f6511ffb640 1 -- 172.21.15.53:0/3830633944 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65180eb550 con 0x7f6508003980 2024-09-13T18:26:27.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.242+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f651c0b26f0 con 0x7f6508003980 2024-09-13T18:26:27.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.242+0000 7f6511ffb640 1 -- 172.21.15.53:0/3830633944 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f65180eeb70 con 0x7f6508003980 2024-09-13T18:26:27.248 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:27.248 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:00.339515+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:27.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6500066870 msgr2=0x7f6500068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6500066870 0x7f6500068d30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f651c14e7b0 tx=0x7f650c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:27.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 msgr2=0x7f651c14e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f651c14e870 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f651801cdf0 tx=0x7f6508005800 comp rx=0 tx=0).stop 2024-09-13T18:26:27.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 shutdown_connections 2024-09-13T18:26:27.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6500066870 0x7f6500068d30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f651c0b4030 0x7f651c0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f651c14db40 0x7f651c14d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 --2- 172.21.15.53:0/3830633944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6508003980 0x7f651c14e870 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 >> 172.21.15.53:0/3830633944 conn(0x7f651c065c80 msgr2=0x7f651c0b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:27.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 shutdown_connections 2024-09-13T18:26:27.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.246+0000 7f6523694640 1 -- 172.21.15.53:0/3830633944 wait complete. 2024-09-13T18:26:27.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:25:57.052393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:25:58.339187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:27.343 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:26:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a318f640 1 Processor -- start 2024-09-13T18:26:27.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a318f640 1 -- start start 2024-09-13T18:26:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a318f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f169c070ce0 0x7f169c071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a318f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f169c06b390 0x7f169c06b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a318f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c146180 con 0x7f169c1457c0 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a318f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c06bd00 con 0x7f169c070ce0 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a318f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0702d0 con 0x7f169c06b390 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f169bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f169c070ce0 0x7f169c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f169bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f169c070ce0 0x7f169c071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53752/0 (socket says 172.21.15.53:53752) 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f169bfff640 1 -- 172.21.15.53:0/1687929097 learned_addr learned my addr 172.21.15.53:0/1687929097 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a172c640 1 --2- 172.21.15.53:0/1687929097 >> v2:172.21.15.87:3300/0 conn(0x7f169c06b390 0x7f169c06b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f169bfff640 1 -- 172.21.15.53:0/1687929097 >> v2:172.21.15.87:3300/0 conn(0x7f169c06b390 msgr2=0x7f169c06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f169bfff640 1 --2- 172.21.15.53:0/1687929097 >> v2:172.21.15.87:3300/0 conn(0x7f169c06b390 0x7f169c06b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f169bfff640 1 -- 172.21.15.53:0/1687929097 >> v1:172.21.15.87:6789/0 conn(0x7f169c1457c0 legacy=0x7f169c0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f169bfff640 1 -- 172.21.15.53:0/1687929097 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c06c4c0 con 0x7f169c070ce0 2024-09-13T18:26:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.474+0000 7f16a172c640 1 --2- 172.21.15.53:0/1687929097 >> v2:172.21.15.87:3300/0 conn(0x7f169c06b390 0x7f169c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f169bfff640 1 --2- 172.21.15.53:0/1687929097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c070ce0 0x7f169c071150 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f169c0b33d0 tx=0x7f169001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eff083e56f1b532 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f169b7fe640 1 -- 172.21.15.53:0/1687929097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16900aa610 con 0x7f169c070ce0 2024-09-13T18:26:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f169b7fe640 1 -- 172.21.15.53:0/1687929097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16900a6040 con 0x7f169c070ce0 2024-09-13T18:26:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f169b7fe640 1 -- 172.21.15.53:0/1687929097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16900aa990 con 0x7f169c070ce0 2024-09-13T18:26:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- 172.21.15.53:0/1687929097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c070ce0 msgr2=0x7f169c071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 --2- 172.21.15.53:0/1687929097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c070ce0 0x7f169c071150 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f169c0b33d0 tx=0x7f169001c4b0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- 172.21.15.53:0/1687929097 shutdown_connections 2024-09-13T18:26:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 --2- 172.21.15.53:0/1687929097 >> v2:172.21.15.87:3300/0 conn(0x7f169c06b390 0x7f169c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 --2- 172.21.15.53:0/1687929097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c070ce0 0x7f169c071150 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- 172.21.15.53:0/1687929097 >> 172.21.15.53:0/1687929097 conn(0x7f169c065c80 msgr2=0x7f169c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- 172.21.15.53:0/1687929097 shutdown_connections 2024-09-13T18:26:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- 172.21.15.53:0/1687929097 wait complete. 2024-09-13T18:26:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 Processor -- start 2024-09-13T18:26:27.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- start start 2024-09-13T18:26:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c06b390 0x7f169c13b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c070ce0 0x7f169c142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c1457c0 0x7f169c13b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c158880 con 0x7f169c1457c0 2024-09-13T18:26:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c13b710 con 0x7f169c070ce0 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a318f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15e5a0 con 0x7f169c06b390 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c1457c0 0x7f169c13b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c1457c0 0x7f169c13b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53766/0 (socket says 172.21.15.53:53766) 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 -- 172.21.15.53:0/1342184310 learned_addr learned my addr 172.21.15.53:0/1342184310 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a0f2b640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c06b390 0x7f169c13b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f169bfff640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c070ce0 0x7f169c142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 -- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c06b390 msgr2=0x7f169c13b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c06b390 0x7f169c13b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 -- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c070ce0 msgr2=0x7f169c142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c070ce0 0x7f169c142240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a172c640 1 -- 172.21.15.53:0/1342184310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16900094d0 con 0x7f169c1457c0 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.478+0000 7f16a0f2b640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c06b390 0x7f169c13b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16a172c640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c1457c0 0x7f169c13b930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f169400c7f0 tx=0x7f169400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16997fa640 1 -- 172.21.15.53:0/1342184310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694007820 con 0x7f169c1457c0 2024-09-13T18:26:27.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16997fa640 1 -- 172.21.15.53:0/1342184310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940079c0 con 0x7f169c1457c0 2024-09-13T18:26:27.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c15e880 con 0x7f169c1457c0 2024-09-13T18:26:27.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16997fa640 1 -- 172.21.15.53:0/1342184310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694007d70 con 0x7f169c1457c0 2024-09-13T18:26:27.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c142780 con 0x7f169c1457c0 2024-09-13T18:26:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c06b7c0 con 0x7f169c1457c0 2024-09-13T18:26:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16997fa640 1 -- 172.21.15.53:0/1342184310 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f16940113f0 con 0x7f169c1457c0 2024-09-13T18:26:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16997fa640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1688066870 0x7f1688068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16997fa640 1 -- 172.21.15.53:0/1342184310 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16940847a0 con 0x7f169c1457c0 2024-09-13T18:26:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16a0f2b640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1688066870 0x7f1688068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.482+0000 7f16a0f2b640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1688066870 0x7f1688068d30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f169c1421e0 tx=0x7f168c0073e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.486+0000 7f16997fa640 1 -- 172.21.15.53:0/1342184310 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1694051780 con 0x7f169c1457c0 2024-09-13T18:26:27.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.646+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f169c0b1be0 con 0x7f169c1457c0 2024-09-13T18:26:27.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.646+0000 7f16997fa640 1 -- 172.21.15.53:0/1342184310 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f169401f0a0 con 0x7f169c1457c0 2024-09-13T18:26:27.650 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:26:27.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1688066870 msgr2=0x7f1688068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1688066870 0x7f1688068d30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f169c1421e0 tx=0x7f168c0073e0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c1457c0 msgr2=0x7f169c13b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c1457c0 0x7f169c13b930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f169400c7f0 tx=0x7f169400ccb0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 shutdown_connections 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1688066870 0x7f1688068d30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f169c1457c0 0x7f169c13b930 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f169c070ce0 0x7f169c142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 --2- 172.21.15.53:0/1342184310 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f169c06b390 0x7f169c13b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 >> 172.21.15.53:0/1342184310 conn(0x7f169c065c80 msgr2=0x7f169c15b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 shutdown_connections 2024-09-13T18:26:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.650+0000 7f16a318f640 1 -- 172.21.15.53:0/1342184310 wait complete. 2024-09-13T18:26:27.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:26:27.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca12308640 1 Processor -- start 2024-09-13T18:26:27.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca12308640 1 -- start start 2024-09-13T18:26:27.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca12308640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fca0c0b21f0 0x7fca0c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca12308640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c06c600 con 0x7fca0c15e0c0 2024-09-13T18:26:27.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca12308640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c0b2b10 con 0x7fca0c06bad0 2024-09-13T18:26:27.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca12308640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c06c840 con 0x7fca0c0b21f0 2024-09-13T18:26:27.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca108a5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fca0c15e0c0 0x7fca0c15e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50314/0 (socket says 172.21.15.53:50314) 2024-09-13T18:26:27.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca108a5640 1 -- 172.21.15.53:0/1111771178 learned_addr learned my addr 172.21.15.53:0/1111771178 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0bfff640 1 --2- 172.21.15.53:0/1111771178 >> v2:172.21.15.87:3300/0 conn(0x7fca0c0b21f0 0x7fca0c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026832735 0 0) 0x7fca040014a0 con 0x7fca0c15e0c0 2024-09-13T18:26:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f8003530 con 0x7fca0c15e0c0 2024-09-13T18:26:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3612373638 0 0) 0x7fc9f8003530 con 0x7fca0c15e0c0 2024-09-13T18:26:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 >> v2:172.21.15.87:3300/0 conn(0x7fca0c0b21f0 msgr2=0x7fca0c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 --2- 172.21.15.53:0/1111771178 >> v2:172.21.15.87:3300/0 conn(0x7fca0c0b21f0 0x7fca0c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 >> v1:172.21.15.87:6789/0 conn(0x7fca0c06bad0 legacy=0x7fca0c06bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c06cb20 con 0x7fca0c15e0c0 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fca04001b90 con 0x7fca0c15e0c0 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 >> v1:172.21.15.53:6789/0 conn(0x7fca0c15e0c0 legacy=0x7fca0c15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9f8003980 0x7fc9f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f80047d0 0x7fc9f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f8005190 0x7fc9f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c06c840 con 0x7fc9f8003980 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f800c030 con 0x7fc9f80047d0 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f800c1f0 con 0x7fc9f8005190 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0bfff640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9f8003980 0x7fc9f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0b7fe640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f80047d0 0x7fc9f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca108a5640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f8005190 0x7fc9f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0bfff640 1 -- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f8005190 msgr2=0x7fc9f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0bfff640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9f8005190 0x7fc9f800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0bfff640 1 -- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f80047d0 msgr2=0x7fc9f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0bfff640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f80047d0 0x7fc9f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0bfff640 1 -- 172.21.15.53:0/1111771178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8003530 con 0x7fc9f8003980 2024-09-13T18:26:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca0b7fe640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f80047d0 0x7fc9f8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.798+0000 7fca108a5640 1 -- 172.21.15.53:0/1111771178 reap_dead start 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca0bfff640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9f8003980 0x7fc9f8003da0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009ae0 tx=0x7fc9fc01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4323de16c304bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0a5520 con 0x7fc9f8003980 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc0a5680 con 0x7fc9f8003980 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca0affd640 1 -- 172.21.15.53:0/1111771178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0a5a30 con 0x7fc9f8003980 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 -- 172.21.15.53:0/1111771178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9f8003980 msgr2=0x7fc9f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9f8003980 0x7fc9f8003da0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009ae0 tx=0x7fc9fc01ca40 comp rx=0 tx=0).stop 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 -- 172.21.15.53:0/1111771178 shutdown_connections 2024-09-13T18:26:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 --2- 172.21.15.53:0/1111771178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9f8003980 0x7fc9f8003da0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 -- 172.21.15.53:0/1111771178 >> 172.21.15.53:0/1111771178 conn(0x7fca0c069f50 msgr2=0x7fca0c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 -- 172.21.15.53:0/1111771178 shutdown_connections 2024-09-13T18:26:27.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 -- 172.21.15.53:0/1111771178 wait complete. 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 Processor -- start 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.802+0000 7fca12308640 1 -- start start 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f8003980 0x7fca0c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0c158300 0x7fca0c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca0c1570c0 0x7fca0c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c155300 con 0x7fca0c158300 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1546f0 con 0x7fc9f8003980 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c1549d0 con 0x7fca0c1570c0 2024-09-13T18:26:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0c158300 0x7fca0c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0c158300 0x7fca0c1593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53792/0 (socket says 172.21.15.53:53792) 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 -- 172.21.15.53:0/3540408112 learned_addr learned my addr 172.21.15.53:0/3540408112 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca108a5640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca0c1570c0 0x7fca0c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0bfff640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f8003980 0x7fca0c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 -- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca0c1570c0 msgr2=0x7fca0c157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca0c1570c0 0x7fca0c157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 -- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f8003980 msgr2=0x7fca0c1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f8003980 0x7fca0c1564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 -- 172.21.15.53:0/3540408112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c154cb0 con 0x7fca0c158300 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0bfff640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f8003980 0x7fca0c1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0b7fe640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0c158300 0x7fca0c1593f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400d4a0 tx=0x7fc9f400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca08ff9640 1 -- 172.21.15.53:0/3540408112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4005480 con 0x7fca0c158300 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca08ff9640 1 -- 172.21.15.53:0/3540408112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4007030 con 0x7fca0c158300 2024-09-13T18:26:27.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca08ff9640 1 -- 172.21.15.53:0/3540408112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40073e0 con 0x7fca0c158300 2024-09-13T18:26:27.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c154f90 con 0x7fca0c158300 2024-09-13T18:26:27.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c1569e0 con 0x7fca0c158300 2024-09-13T18:26:27.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c155470 con 0x7fca0c158300 2024-09-13T18:26:27.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca08ff9640 1 -- 172.21.15.53:0/3540408112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc9f4007540 con 0x7fca0c158300 2024-09-13T18:26:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca08ff9640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9ec066840 0x7fc9ec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca08ff9640 1 -- 172.21.15.53:0/3540408112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9f4083b00 con 0x7fca0c158300 2024-09-13T18:26:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.806+0000 7fca0bfff640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9ec066840 0x7fc9ec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.810+0000 7fca0bfff640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9ec066840 0x7fc9ec068d00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0af000 tx=0x7fc9fc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:27.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.810+0000 7fca08ff9640 1 -- 172.21.15.53:0/3540408112 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9f4050ba0 con 0x7fca0c158300 2024-09-13T18:26:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.970+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca0c160990 con 0x7fca0c158300 2024-09-13T18:26:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.970+0000 7fca08ff9640 1 -- 172.21.15.53:0/3540408112 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9f40190a0 con 0x7fca0c158300 2024-09-13T18:26:27.974 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.970+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9ec066840 msgr2=0x7fc9ec068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.970+0000 7fca12308640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9ec066840 0x7fc9ec068d00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0af000 tx=0x7fc9fc008040 comp rx=0 tx=0).stop 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.970+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0c158300 msgr2=0x7fca0c1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.970+0000 7fca12308640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0c158300 0x7fca0c1593f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400d4a0 tx=0x7fc9f400d960 comp rx=0 tx=0).stop 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 shutdown_connections 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc9ec066840 0x7fc9ec068d00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca0c1570c0 0x7fca0c157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0c158300 0x7fca0c1593f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 --2- 172.21.15.53:0/3540408112 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9f8003980 0x7fca0c1564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 >> 172.21.15.53:0/3540408112 conn(0x7fca0c069f50 msgr2=0x7fca0c070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 shutdown_connections 2024-09-13T18:26:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:27.974+0000 7fca12308640 1 -- 172.21.15.53:0/3540408112 wait complete. 2024-09-13T18:26:27.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:26:28.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.110+0000 7ff000942640 1 Processor -- start 2024-09-13T18:26:28.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.110+0000 7ff000942640 1 -- start start 2024-09-13T18:26:28.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7ff000942640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feffc15c830 0x7feffc0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7ff000942640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feffc0ccd10 0x7feffc0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7ff000942640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc0b7db0 con 0x7feffc0d2c80 2024-09-13T18:26:28.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7ff000942640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc0d0650 con 0x7feffc0ccd10 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7ff000942640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc0d0c10 con 0x7feffc15c830 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feffc0ccd10 0x7feffc0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feffad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7feffc0d2c80 0x7feffc0b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50322/0 (socket says 172.21.15.53:50322) 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feffc0ccd10 0x7feffc0cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53798/0 (socket says 172.21.15.53:53798) 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feffad9d640 1 -- 172.21.15.53:0/3500431062 learned_addr learned my addr 172.21.15.53:0/3500431062 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feffa59c640 1 --2- 172.21.15.53:0/3500431062 >> v2:172.21.15.87:3300/0 conn(0x7feffc15c830 0x7feffc0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff9d9b640 1 -- 172.21.15.53:0/3500431062 >> v2:172.21.15.87:3300/0 conn(0x7feffc15c830 msgr2=0x7feffc0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff9d9b640 1 --2- 172.21.15.53:0/3500431062 >> v2:172.21.15.87:3300/0 conn(0x7feffc15c830 0x7feffc0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff9d9b640 1 -- 172.21.15.53:0/3500431062 >> v1:172.21.15.53:6789/0 conn(0x7feffc0d2c80 legacy=0x7feffc0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff9d9b640 1 -- 172.21.15.53:0/3500431062 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0cd7d0 con 0x7feffc0ccd10 2024-09-13T18:26:28.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff959a640 1 -- 172.21.15.53:0/3500431062 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466842077 0 0) 0x7feffc0b7db0 con 0x7feffc0d2c80 2024-09-13T18:26:28.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff9d9b640 1 --2- 172.21.15.53:0/3500431062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc0cd180 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feffc0d0240 tx=0x7feff001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f924d72fdec79592 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff959a640 1 -- 172.21.15.53:0/3500431062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00ab600 con 0x7feffc0ccd10 2024-09-13T18:26:28.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff959a640 1 -- 172.21.15.53:0/3500431062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff00a7050 con 0x7feffc0ccd10 2024-09-13T18:26:28.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.114+0000 7feff959a640 1 -- 172.21.15.53:0/3500431062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00ab980 con 0x7feffc0ccd10 2024-09-13T18:26:28.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- 172.21.15.53:0/3500431062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 msgr2=0x7feffc0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 --2- 172.21.15.53:0/3500431062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc0cd180 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feffc0d0240 tx=0x7feff001c480 comp rx=0 tx=0).stop 2024-09-13T18:26:28.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- 172.21.15.53:0/3500431062 shutdown_connections 2024-09-13T18:26:28.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 --2- 172.21.15.53:0/3500431062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc0cd180 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 --2- 172.21.15.53:0/3500431062 >> v2:172.21.15.87:3300/0 conn(0x7feffc15c830 0x7feffc0d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- 172.21.15.53:0/3500431062 >> 172.21.15.53:0/3500431062 conn(0x7feffc070970 msgr2=0x7feffc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:28.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- 172.21.15.53:0/3500431062 shutdown_connections 2024-09-13T18:26:28.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- 172.21.15.53:0/3500431062 wait complete. 2024-09-13T18:26:28.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 Processor -- start 2024-09-13T18:26:28.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- start start 2024-09-13T18:26:28.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feffc0d2c80 0x7feffc0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feffc15c830 0x7feffc0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc15e0c0 con 0x7feffc0ccd10 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc15e3a0 con 0x7feffc0d2c80 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc15e680 con 0x7feffc15c830 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc1575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53800/0 (socket says 172.21.15.53:53800) 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 -- 172.21.15.53:0/2340612230 learned_addr learned my addr 172.21.15.53:0/2340612230 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feff9d9b640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feffc0d2c80 0x7feffc0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffad9d640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feffc15c830 0x7feffc0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 -- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feffc15c830 msgr2=0x7feffc0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feffc15c830 0x7feffc0b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 -- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feffc0d2c80 msgr2=0x7feffc0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feffc0d2c80 0x7feffc0b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 -- 172.21.15.53:0/2340612230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0009420 con 0x7feffc0ccd10 2024-09-13T18:26:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffad9d640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feffc15c830 0x7feffc0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feff9d9b640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feffc0d2c80 0x7feffc0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7feffa59c640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc1575d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fefec00d800 tx=0x7fefec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7fefeaffd640 1 -- 172.21.15.53:0/2340612230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00b6c0 con 0x7feffc0ccd10 2024-09-13T18:26:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7fefeaffd640 1 -- 172.21.15.53:0/2340612230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec00b820 con 0x7feffc0ccd10 2024-09-13T18:26:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc15e960 con 0x7feffc0ccd10 2024-09-13T18:26:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7fefeaffd640 1 -- 172.21.15.53:0/2340612230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec00bb90 con 0x7feffc0ccd10 2024-09-13T18:26:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.118+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc0c9e90 con 0x7feffc0ccd10 2024-09-13T18:26:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.122+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc0ca110 con 0x7feffc0ccd10 2024-09-13T18:26:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.122+0000 7fefeaffd640 1 -- 172.21.15.53:0/2340612230 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fefec00bcf0 con 0x7feffc0ccd10 2024-09-13T18:26:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.122+0000 7fefeaffd640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fefdc066840 0x7fefdc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.122+0000 7fefeaffd640 1 -- 172.21.15.53:0/2340612230 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefec084a20 con 0x7feffc0ccd10 2024-09-13T18:26:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.122+0000 7feff9d9b640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fefdc066840 0x7fefdc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.122+0000 7feff9d9b640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fefdc066840 0x7fefdc068d00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feff00ad000 tx=0x7feff0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.126+0000 7fefeaffd640 1 -- 172.21.15.53:0/2340612230 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fefec051b10 con 0x7feffc0ccd10 2024-09-13T18:26:28.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.282+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feffc0d1560 con 0x7feffc0ccd10 2024-09-13T18:26:28.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7fefeaffd640 1 -- 172.21.15.53:0/2340612230 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefec055130 con 0x7feffc0ccd10 2024-09-13T18:26:28.288 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:26:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fefdc066840 msgr2=0x7fefdc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fefdc066840 0x7fefdc068d00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feff00ad000 tx=0x7feff0008040 comp rx=0 tx=0).stop 2024-09-13T18:26:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 msgr2=0x7feffc1575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc1575d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fefec00d800 tx=0x7fefec00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 shutdown_connections 2024-09-13T18:26:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fefdc066840 0x7fefdc068d00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feffc15c830 0x7feffc0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feffc0d2c80 0x7feffc0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 --2- 172.21.15.53:0/2340612230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feffc0ccd10 0x7feffc1575d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 >> 172.21.15.53:0/2340612230 conn(0x7feffc070970 msgr2=0x7feffc14c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:28.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 shutdown_connections 2024-09-13T18:26:28.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.286+0000 7ff000942640 1 -- 172.21.15.53:0/2340612230 wait complete. 2024-09-13T18:26:28.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:28.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5b9de640 1 Processor -- start 2024-09-13T18:26:28.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5b9de640 1 -- start start 2024-09-13T18:26:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5b9de640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c5415cab0 0x7f6c540d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5b9de640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5b9de640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540d2400 con 0x7f6c540cdb00 2024-09-13T18:26:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5b9de640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540d1530 con 0x7f6c5415cab0 2024-09-13T18:26:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5b9de640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540d0920 con 0x7f6c540cd6c0 2024-09-13T18:26:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5977a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c5415cab0 0x7f6c540d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c59f7b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6c540cdb00 0x7f6c540b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50338/0 (socket says 172.21.15.53:50338) 2024-09-13T18:26:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c59f7b640 1 -- 172.21.15.53:0/673999681 learned_addr learned my addr 172.21.15.53:0/673999681 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c58f79640 1 --2- 172.21.15.53:0/673999681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5977a640 1 -- 172.21.15.53:0/673999681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 msgr2=0x7f6c540cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:28.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5977a640 1 --2- 172.21.15.53:0/673999681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5977a640 1 -- 172.21.15.53:0/673999681 >> v1:172.21.15.53:6789/0 conn(0x7f6c540cdb00 legacy=0x7f6c540b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c5977a640 1 -- 172.21.15.53:0/673999681 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540d0c00 con 0x7f6c5415cab0 2024-09-13T18:26:28.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.426+0000 7f6c4bfff640 1 -- 172.21.15.53:0/673999681 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048866441 0 0) 0x7f6c540d2400 con 0x7f6c540cdb00 2024-09-13T18:26:28.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5977a640 1 --2- 172.21.15.53:0/673999681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c5415cab0 0x7f6c540d19c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6c500097c0 tx=0x7f6c5001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c6a838cb853325 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c4bfff640 1 -- 172.21.15.53:0/673999681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500ad680 con 0x7f6c5415cab0 2024-09-13T18:26:28.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c4bfff640 1 -- 172.21.15.53:0/673999681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c500ad7e0 con 0x7f6c5415cab0 2024-09-13T18:26:28.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c4bfff640 1 -- 172.21.15.53:0/673999681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500adb70 con 0x7f6c5415cab0 2024-09-13T18:26:28.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 -- 172.21.15.53:0/673999681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c5415cab0 msgr2=0x7f6c540d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/673999681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c5415cab0 0x7f6c540d19c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6c500097c0 tx=0x7f6c5001c470 comp rx=0 tx=0).stop 2024-09-13T18:26:28.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 -- 172.21.15.53:0/673999681 shutdown_connections 2024-09-13T18:26:28.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/673999681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/673999681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c5415cab0 0x7f6c540d19c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 -- 172.21.15.53:0/673999681 >> 172.21.15.53:0/673999681 conn(0x7f6c54065c80 msgr2=0x7f6c54066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 -- 172.21.15.53:0/673999681 shutdown_connections 2024-09-13T18:26:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 -- 172.21.15.53:0/673999681 wait complete. 2024-09-13T18:26:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 Processor -- start 2024-09-13T18:26:28.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.430+0000 7f6c5b9de640 1 -- start start 2024-09-13T18:26:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c540cdb00 0x7f6c54153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c5415cab0 0x7f6c540b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540ca190 con 0x7f6c540cdb00 2024-09-13T18:26:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540ca470 con 0x7f6c5415cab0 2024-09-13T18:26:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540ca750 con 0x7f6c540cd6c0 2024-09-13T18:26:28.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c540cdb00 0x7f6c54153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c540cdb00 0x7f6c54153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53820/0 (socket says 172.21.15.53:53820) 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 -- 172.21.15.53:0/3313309797 learned_addr learned my addr 172.21.15.53:0/3313309797 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5977a640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c59f7b640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c5415cab0 0x7f6c540b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 -- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 msgr2=0x7f6c540cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 -- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c5415cab0 msgr2=0x7f6c540b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c5415cab0 0x7f6c540b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 -- 172.21.15.53:0/3313309797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50009420 con 0x7f6c540cdb00 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c59f7b640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c5415cab0 0x7f6c540b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c58f79640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c540cdb00 0x7f6c54153870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400d5d0 tx=0x7f6c4400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c49ffb640 1 -- 172.21.15.53:0/3313309797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44004240 con 0x7f6c540cdb00 2024-09-13T18:26:28.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c49ffb640 1 -- 172.21.15.53:0/3313309797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440043a0 con 0x7f6c540cdb00 2024-09-13T18:26:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540caa30 con 0x7f6c540cdb00 2024-09-13T18:26:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c49ffb640 1 -- 172.21.15.53:0/3313309797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44003840 con 0x7f6c540cdb00 2024-09-13T18:26:28.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54156400 con 0x7f6c540cdb00 2024-09-13T18:26:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540b1c50 con 0x7f6c540cdb00 2024-09-13T18:26:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c49ffb640 1 -- 172.21.15.53:0/3313309797 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f6c440039a0 con 0x7f6c540cdb00 2024-09-13T18:26:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c49ffb640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c38066840 0x7f6c38068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c49ffb640 1 -- 172.21.15.53:0/3313309797 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c44084650 con 0x7f6c540cdb00 2024-09-13T18:26:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5977a640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c38066840 0x7f6c38068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.434+0000 7f6c5977a640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c38066840 0x7f6c38068d00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c500af000 tx=0x7f6c500a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.438+0000 7f6c49ffb640 1 -- 172.21.15.53:0/3313309797 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6c44051730 con 0x7f6c540cdb00 2024-09-13T18:26:28.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.634+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c540d1af0 con 0x7f6c540cdb00 2024-09-13T18:26:28.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c49ffb640 1 -- 172.21.15.53:0/3313309797 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f6c44054d50 con 0x7f6c540cdb00 2024-09-13T18:26:28.640 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:28.641 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3877303910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3877303910},{"type":"v1","addr":"172.21.15.87:6836","nonce":3877303910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1431925450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":1431925450},{"type":"v1","addr":"172.21.15.87:6837","nonce":1431925450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2751759497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2751759497},{"type":"v1","addr":"172.21.15.53:6834","nonce":2751759497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:25:59.336241+0000","modified":"2024-09-13T18:26:01.346568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5193":{"gid":5193,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2879083637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2879083637},{"type":"v1","addr":"172.21.15.53:6835","nonce":2879083637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:26:28.641 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 14 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c38066840 msgr2=0x7f6c38068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c38066840 0x7f6c38068d00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c500af000 tx=0x7f6c500a7000 comp rx=0 tx=0).stop 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c540cdb00 msgr2=0x7f6c54153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c540cdb00 0x7f6c54153870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400d5d0 tx=0x7f6c4400da90 comp rx=0 tx=0).stop 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 shutdown_connections 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c38066840 0x7f6c38068d00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c5415cab0 0x7f6c540b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c540cdb00 0x7f6c54153870 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 --2- 172.21.15.53:0/3313309797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c540cd6c0 0x7f6c540cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 >> 172.21.15.53:0/3313309797 conn(0x7f6c54065c80 msgr2=0x7f6c540b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:28.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 shutdown_connections 2024-09-13T18:26:28.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.638+0000 7f6c5b9de640 1 -- 172.21.15.53:0/3313309797 wait complete. 2024-09-13T18:26:28.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:28.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda4d759640 1 Processor -- start 2024-09-13T18:26:28.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda4d759640 1 -- start start 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda4d759640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda480b1af0 0x7fda480cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda4d759640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480cfe80 con 0x7fda48069f50 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda4d759640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4806ac20 con 0x7fda480cd630 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda4d759640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480d0120 con 0x7fda480b1af0 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda477fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fda48069f50 0x7fda4806a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50344/0 (socket says 172.21.15.53:50344) 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda477fe640 1 -- 172.21.15.53:0/979598615 learned_addr learned my addr 172.21.15.53:0/979598615 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda467fc640 1 --2- 172.21.15.53:0/979598615 >> v2:172.21.15.87:3300/0 conn(0x7fda480b1af0 0x7fda480cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031254512 0 0) 0x7fda480cfe80 con 0x7fda48069f50 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda30003530 con 0x7fda48069f50 2024-09-13T18:26:28.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434747745 0 0) 0x7fda30003530 con 0x7fda48069f50 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 >> v2:172.21.15.87:3300/0 conn(0x7fda480b1af0 msgr2=0x7fda480cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 --2- 172.21.15.53:0/979598615 >> v2:172.21.15.87:3300/0 conn(0x7fda480b1af0 0x7fda480cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 >> v1:172.21.15.87:6789/0 conn(0x7fda480cd630 legacy=0x7fda480b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4806af00 con 0x7fda48069f50 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fda40001680 con 0x7fda48069f50 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 >> v1:172.21.15.53:6789/0 conn(0x7fda48069f50 legacy=0x7fda4806a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda30003980 0x7fda30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda300052b0 0x7fda3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480d0120 con 0x7fda300047d0 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3000c180 con 0x7fda30003980 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3000c340 con 0x7fda300052b0 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda467fc640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda46ffd640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda30003980 0x7fda30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda477fe640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda300052b0 0x7fda3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda467fc640 1 -- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda300052b0 msgr2=0x7fda3000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda467fc640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda300052b0 0x7fda3000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda467fc640 1 -- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda30003980 msgr2=0x7fda30003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda467fc640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda30003980 0x7fda30003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda467fc640 1 -- 172.21.15.53:0/979598615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30003530 con 0x7fda300047d0 2024-09-13T18:26:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.782+0000 7fda477fe640 1 -- 172.21.15.53:0/979598615 reap_dead start 2024-09-13T18:26:28.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda467fc640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda30004c50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009ab0 tx=0x7fda3c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315f1cf9f15594c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0a55a0 con 0x7fda300047d0 2024-09-13T18:26:28.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c0a5700 con 0x7fda300047d0 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda45ffb640 1 -- 172.21.15.53:0/979598615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0a5ab0 con 0x7fda300047d0 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- 172.21.15.53:0/979598615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 msgr2=0x7fda30004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda30004c50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009ab0 tx=0x7fda3c01c9f0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- 172.21.15.53:0/979598615 shutdown_connections 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 --2- 172.21.15.53:0/979598615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda30004c50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- 172.21.15.53:0/979598615 >> 172.21.15.53:0/979598615 conn(0x7fda480b20d0 msgr2=0x7fda480b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- 172.21.15.53:0/979598615 shutdown_connections 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- 172.21.15.53:0/979598615 wait complete. 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 Processor -- start 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- start start 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda480b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda481539c0 0x7fda480c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48153190 0x7fda4815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48154ad0 con 0x7fda300047d0 2024-09-13T18:26:28.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48153ec0 con 0x7fda48153190 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.786+0000 7fda4d759640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda481541a0 con 0x7fda481539c0 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda480b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda480b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53826/0 (socket says 172.21.15.53:53826) 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 -- 172.21.15.53:0/3811361445 learned_addr learned my addr 172.21.15.53:0/3811361445 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda467fc640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda481539c0 0x7fda480c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda477fe640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48153190 0x7fda4815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 -- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda481539c0 msgr2=0x7fda480c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda481539c0 0x7fda480c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 -- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48153190 msgr2=0x7fda4815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48153190 0x7fda4815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 -- 172.21.15.53:0/3811361445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48154480 con 0x7fda300047d0 2024-09-13T18:26:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda46ffd640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda480b33d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fda38000f90 tx=0x7fda3800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda2f7fe640 1 -- 172.21.15.53:0/3811361445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38003b90 con 0x7fda300047d0 2024-09-13T18:26:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda2f7fe640 1 -- 172.21.15.53:0/3811361445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda38003cf0 con 0x7fda300047d0 2024-09-13T18:26:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda48154760 con 0x7fda300047d0 2024-09-13T18:26:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda2f7fe640 1 -- 172.21.15.53:0/3811361445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38005310 con 0x7fda300047d0 2024-09-13T18:26:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda481537f0 con 0x7fda300047d0 2024-09-13T18:26:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda480b0cf0 con 0x7fda300047d0 2024-09-13T18:26:28.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda2f7fe640 1 -- 172.21.15.53:0/3811361445 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fda38005470 con 0x7fda300047d0 2024-09-13T18:26:28.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda2f7fe640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fda34066870 0x7fda34068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:28.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda2f7fe640 1 -- 172.21.15.53:0/3811361445 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda38084520 con 0x7fda300047d0 2024-09-13T18:26:28.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.790+0000 7fda467fc640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fda34066870 0x7fda34068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:28.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.794+0000 7fda467fc640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fda34066870 0x7fda34068d30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0af000 tx=0x7fda3c0046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:28.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.794+0000 7fda2f7fe640 1 -- 172.21.15.53:0/3811361445 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda38051610 con 0x7fda300047d0 2024-09-13T18:26:28.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.954+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda480afcc0 con 0x7fda300047d0 2024-09-13T18:26:28.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.958+0000 7fda2f7fe640 1 -- 172.21.15.53:0/3811361445 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16509 (secure 0 0 0) 0x7fda38003e60 con 0x7fda300047d0 2024-09-13T18:26:28.962 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:28.962 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:00.339515+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fda34066870 msgr2=0x7fda34068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fda34066870 0x7fda34068d30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0af000 tx=0x7fda3c0046d0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 msgr2=0x7fda480b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda480b33d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fda38000f90 tx=0x7fda3800ec80 comp rx=0 tx=0).stop 2024-09-13T18:26:28.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 shutdown_connections 2024-09-13T18:26:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fda34066870 0x7fda34068d30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda481539c0 0x7fda480c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48153190 0x7fda4815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 --2- 172.21.15.53:0/3811361445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda300047d0 0x7fda480b33d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 >> 172.21.15.53:0/3811361445 conn(0x7fda480b20d0 msgr2=0x7fda480aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 shutdown_connections 2024-09-13T18:26:28.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:28.962+0000 7fda4d759640 1 -- 172.21.15.53:0/3811361445 wait complete. 2024-09-13T18:26:28.982 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:26:28.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:29.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4033804640 1 Processor -- start 2024-09-13T18:26:29.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4033804640 1 -- start start 2024-09-13T18:26:29.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4033804640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f402c15ca90 0x7f402c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4033804640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c06d010 0x7f402c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4033804640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402c0b4210 con 0x7f402c15c6b0 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4033804640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402c0cb640 con 0x7f402c15ca90 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4033804640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0cb920 con 0x7f402c06d010 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4031da1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c06d010 0x7f402c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4031da1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c06d010 0x7f402c0cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:45736/0 (socket says 172.21.15.53:45736) 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4030d9f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f402c15ca90 0x7f402c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4031da1640 1 -- 172.21.15.53:0/1118295163 learned_addr learned my addr 172.21.15.53:0/1118295163 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:29.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4031da1640 1 -- 172.21.15.53:0/1118295163 >> v2:172.21.15.87:3300/0 conn(0x7f402c15ca90 msgr2=0x7f402c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:29.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4031da1640 1 --2- 172.21.15.53:0/1118295163 >> v2:172.21.15.87:3300/0 conn(0x7f402c15ca90 0x7f402c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4031da1640 1 -- 172.21.15.53:0/1118295163 >> v1:172.21.15.87:6789/0 conn(0x7f402c15c6b0 legacy=0x7f402c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4031da1640 1 -- 172.21.15.53:0/1118295163 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c0cbc00 con 0x7f402c06d010 2024-09-13T18:26:29.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.110+0000 7f4030d9f640 1 --2- 172.21.15.53:0/1118295163 >> v2:172.21.15.87:3300/0 conn(0x7f402c15ca90 0x7f402c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:29.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4031da1640 1 --2- 172.21.15.53:0/1118295163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c06d010 0x7f402c0cd270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4024009e50 tx=0x7f402401ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7dc955c26349e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4023fff640 1 -- 172.21.15.53:0/1118295163 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240a56d0 con 0x7f402c06d010 2024-09-13T18:26:29.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4023fff640 1 -- 172.21.15.53:0/1118295163 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40240a5830 con 0x7f402c06d010 2024-09-13T18:26:29.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4023fff640 1 -- 172.21.15.53:0/1118295163 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240a5bc0 con 0x7f402c06d010 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 -- 172.21.15.53:0/1118295163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c06d010 msgr2=0x7f402c0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 --2- 172.21.15.53:0/1118295163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c06d010 0x7f402c0cd270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4024009e50 tx=0x7f402401ca00 comp rx=0 tx=0).stop 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 -- 172.21.15.53:0/1118295163 shutdown_connections 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 --2- 172.21.15.53:0/1118295163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c06d010 0x7f402c0cd270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 --2- 172.21.15.53:0/1118295163 >> v2:172.21.15.87:3300/0 conn(0x7f402c15ca90 0x7f402c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 -- 172.21.15.53:0/1118295163 >> 172.21.15.53:0/1118295163 conn(0x7f402c0664a0 msgr2=0x7f402c0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 -- 172.21.15.53:0/1118295163 shutdown_connections 2024-09-13T18:26:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 -- 172.21.15.53:0/1118295163 wait complete. 2024-09-13T18:26:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 Processor -- start 2024-09-13T18:26:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.114+0000 7f4033804640 1 -- start start 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f402c15c6b0 0x7f402c14f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c15ca90 0x7f402c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f402c0ae3c0 0x7f402c0ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c15f3e0 con 0x7f402c15c6b0 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0ac110 con 0x7f402c0ae3c0 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c14fc00 con 0x7f402c15ca90 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f402c15c6b0 0x7f402c14f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f402c15c6b0 0x7f402c14f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53834/0 (socket says 172.21.15.53:53834) 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 -- 172.21.15.53:0/2940522938 learned_addr learned my addr 172.21.15.53:0/2940522938 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4031da1640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f402c0ae3c0 0x7f402c0ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4030d9f640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c15ca90 0x7f402c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 -- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c15ca90 msgr2=0x7f402c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c15ca90 0x7f402c15ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 -- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f402c0ae3c0 msgr2=0x7f402c0ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f402c0ae3c0 0x7f402c0ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 -- 172.21.15.53:0/2940522938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c009420 con 0x7f402c15c6b0 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f40315a0640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f402c15c6b0 0x7f402c14f6c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f402800c500 tx=0x7f402800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4021ffb640 1 -- 172.21.15.53:0/2940522938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028005220 con 0x7f402c15c6b0 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4021ffb640 1 -- 172.21.15.53:0/2940522938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4028005380 con 0x7f402c15c6b0 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4024009b30 con 0x7f402c15c6b0 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4021ffb640 1 -- 172.21.15.53:0/2940522938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028007270 con 0x7f402c15c6b0 2024-09-13T18:26:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c15f8d0 con 0x7f402c15c6b0 2024-09-13T18:26:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c0713d0 con 0x7f402c15c6b0 2024-09-13T18:26:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4021ffb640 1 -- 172.21.15.53:0/2940522938 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f40280073d0 con 0x7f402c15c6b0 2024-09-13T18:26:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4021ffb640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4010066840 0x7f4010068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4021ffb640 1 -- 172.21.15.53:0/2940522938 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4028083ec0 con 0x7f402c15c6b0 2024-09-13T18:26:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.118+0000 7f4030d9f640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4010066840 0x7f4010068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.122+0000 7f4030d9f640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4010066840 0x7f4010068d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f402c15fe90 tx=0x7f401c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.126+0000 7f4021ffb640 1 -- 172.21.15.53:0/2940522938 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4028050fa0 con 0x7f402c15c6b0 2024-09-13T18:26:29.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.318+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f402c06bec0 con 0x7f402c15c6b0 2024-09-13T18:26:29.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.318+0000 7f4021ffb640 1 -- 172.21.15.53:0/2940522938 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f40280545c0 con 0x7f402c15c6b0 2024-09-13T18:26:29.323 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:29.323 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3877303910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3877303910},{"type":"v1","addr":"172.21.15.87:6836","nonce":3877303910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1431925450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":1431925450},{"type":"v1","addr":"172.21.15.87:6837","nonce":1431925450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2751759497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2751759497},{"type":"v1","addr":"172.21.15.53:6834","nonce":2751759497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:25:59.336241+0000","modified":"2024-09-13T18:26:01.346568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5193":{"gid":5193,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2879083637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2879083637},{"type":"v1","addr":"172.21.15.53:6835","nonce":2879083637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:26:29.324 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 14 2024-09-13T18:26:29.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4010066840 msgr2=0x7f4010068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4010066840 0x7f4010068d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f402c15fe90 tx=0x7f401c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f402c15c6b0 msgr2=0x7f402c14f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f402c15c6b0 0x7f402c14f6c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f402800c500 tx=0x7f402800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 shutdown_connections 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4010066840 0x7f4010068d00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f402c15ca90 0x7f402c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f402c0ae3c0 0x7f402c0ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 --2- 172.21.15.53:0/2940522938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f402c15c6b0 0x7f402c14f6c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 >> 172.21.15.53:0/2940522938 conn(0x7f402c06d010 msgr2=0x7f402c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 shutdown_connections 2024-09-13T18:26:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.322+0000 7f4033804640 1 -- 172.21.15.53:0/2940522938 wait complete. 2024-09-13T18:26:29.343 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:29.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a82d4640 1 Processor -- start 2024-09-13T18:26:29.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a82d4640 1 -- start start 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a82d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 0x7f80a00b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a82d4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00d2400 con 0x7f80a015cab0 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a82d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00d1530 con 0x7f80a00d19c0 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a82d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00cddd0 con 0x7f80a00cf7d0 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a6070640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f80a015cab0 0x7f80a00cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50346/0 (socket says 172.21.15.53:50346) 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a6070640 1 -- 172.21.15.53:0/299360737 learned_addr learned my addr 172.21.15.53:0/299360737 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a6871640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 0x7f80a00b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914054115 0 0) 0x7f80a00d2400 con 0x7f80a015cab0 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f808c003530 con 0x7f80a015cab0 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 742562676 0 0) 0x7f808c003530 con 0x7f80a015cab0 2024-09-13T18:26:29.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 msgr2=0x7f80a00b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 0x7f80a00b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 >> v1:172.21.15.87:6789/0 conn(0x7f80a00d19c0 legacy=0x7f80a00cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00d1e30 con 0x7f80a015cab0 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f809c001680 con 0x7f80a015cab0 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 >> v1:172.21.15.53:6789/0 conn(0x7f80a015cab0 legacy=0x7f80a00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f808c0039b0 0x7f808c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f808c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 0x7f808c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00cddd0 con 0x7f808c0047d0 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c00ba70 con 0x7f808c0039b0 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c00bc30 con 0x7f80a00cf7d0 2024-09-13T18:26:29.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a586f640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f808c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a6070640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f808c0039b0 0x7f808c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a6871640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 0x7f808c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a586f640 1 -- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 msgr2=0x7f808c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a586f640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a00cf7d0 0x7f808c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a586f640 1 -- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f808c0039b0 msgr2=0x7f808c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a586f640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f808c0039b0 0x7f808c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.466+0000 7f80a586f640 1 -- 172.21.15.53:0/299360737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c003530 con 0x7f808c0047d0 2024-09-13T18:26:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a586f640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f808c004c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8090001750 tx=0x7f809001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48250de5d0d3c570 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900052d0 con 0x7f808c0047d0 2024-09-13T18:26:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80900a7050 con 0x7f808c0047d0 2024-09-13T18:26:29.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a506e640 1 -- 172.21.15.53:0/299360737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090003600 con 0x7f808c0047d0 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 -- 172.21.15.53:0/299360737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 msgr2=0x7f808c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 --2- 172.21.15.53:0/299360737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f808c004c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8090001750 tx=0x7f809001c3c0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a6871640 1 -- 172.21.15.53:0/299360737 reap_dead start 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 -- 172.21.15.53:0/299360737 shutdown_connections 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 -- 172.21.15.53:0/299360737 >> 172.21.15.53:0/299360737 conn(0x7f80a0065c80 msgr2=0x7f80a0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 -- 172.21.15.53:0/299360737 shutdown_connections 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 -- 172.21.15.53:0/299360737 wait complete. 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 Processor -- start 2024-09-13T18:26:29.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.470+0000 7f80a82d4640 1 -- start start 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f80a014cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00cbab0 0x7f80a00cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a0157920 0x7f80a0157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0158310 con 0x7f808c0047d0 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00ca190 con 0x7f80a00cbab0 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00cc470 con 0x7f80a0157920 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f80a014cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f80a014cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53862/0 (socket says 172.21.15.53:53862) 2024-09-13T18:26:29.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 -- 172.21.15.53:0/1288051399 learned_addr learned my addr 172.21.15.53:0/1288051399 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6871640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a0157920 0x7f80a0157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a586f640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00cbab0 0x7f80a00cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 -- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a0157920 msgr2=0x7f80a0157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a0157920 0x7f80a0157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 -- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00cbab0 msgr2=0x7f80a00cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00cbab0 0x7f80a00cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 -- 172.21.15.53:0/1288051399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00cafb0 con 0x7f808c0047d0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a6070640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f80a014cae0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f809c0117c0 tx=0x7f809c011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f8096ffd640 1 -- 172.21.15.53:0/1288051399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00fb00 con 0x7f808c0047d0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f8096ffd640 1 -- 172.21.15.53:0/1288051399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00fca0 con 0x7f808c0047d0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a014d020 con 0x7f808c0047d0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f8096ffd640 1 -- 172.21.15.53:0/1288051399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c015650 con 0x7f808c0047d0 2024-09-13T18:26:29.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a00ca680 con 0x7f808c0047d0 2024-09-13T18:26:29.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a00d05b0 con 0x7f808c0047d0 2024-09-13T18:26:29.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f8096ffd640 1 -- 172.21.15.53:0/1288051399 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f809c0157b0 con 0x7f808c0047d0 2024-09-13T18:26:29.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f8096ffd640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8084066840 0x7f8084068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f8096ffd640 1 -- 172.21.15.53:0/1288051399 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f809c0876e0 con 0x7f808c0047d0 2024-09-13T18:26:29.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.474+0000 7f80a586f640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8084066840 0x7f8084068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.478+0000 7f80a586f640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8084066840 0x7f8084068d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f808c0057b0 tx=0x7f80900011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.478+0000 7f8096ffd640 1 -- 172.21.15.53:0/1288051399 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f809c0547c0 con 0x7f808c0047d0 2024-09-13T18:26:29.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.670+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80a015b870 con 0x7f808c0047d0 2024-09-13T18:26:29.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f8096ffd640 1 -- 172.21.15.53:0/1288051399 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f809c0014e0 con 0x7f808c0047d0 2024-09-13T18:26:29.676 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:29.676 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3877303910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3877303910},{"type":"v1","addr":"172.21.15.87:6836","nonce":3877303910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1431925450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":1431925450},{"type":"v1","addr":"172.21.15.87:6837","nonce":1431925450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2751759497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2751759497},{"type":"v1","addr":"172.21.15.53:6834","nonce":2751759497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:25:59.336241+0000","modified":"2024-09-13T18:26:01.346568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5193":{"gid":5193,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2879083637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2879083637},{"type":"v1","addr":"172.21.15.53:6835","nonce":2879083637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:26:29.676 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 14 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8084066840 msgr2=0x7f8084068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8084066840 0x7f8084068d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f808c0057b0 tx=0x7f80900011a0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 msgr2=0x7f80a014cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f80a014cae0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f809c0117c0 tx=0x7f809c011c80 comp rx=0 tx=0).stop 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 shutdown_connections 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8084066840 0x7f8084068d00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80a0157920 0x7f80a0157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80a00cbab0 0x7f80a00cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 --2- 172.21.15.53:0/1288051399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f808c0047d0 0x7f80a014cae0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 >> 172.21.15.53:0/1288051399 conn(0x7f80a0065c80 msgr2=0x7f80a015ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:29.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 shutdown_connections 2024-09-13T18:26:29.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.674+0000 7f80a82d4640 1 -- 172.21.15.53:0/1288051399 wait complete. 2024-09-13T18:26:29.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:29.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d8696640 1 Processor -- start 2024-09-13T18:26:29.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d8696640 1 -- start start 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d8696640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d01582a0 0x7fe2d006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d8696640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe2d00713a0 0x7fe2d006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d8696640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d006d480 con 0x7fe2d015b7c0 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d8696640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d015aaf0 con 0x7fe2d00713a0 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d8696640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d006d760 con 0x7fe2d01582a0 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d5c31640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe2d015b7c0 0x7fe2d0070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50362/0 (socket says 172.21.15.53:50362) 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d6c33640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe2d00713a0 0x7fe2d006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d5c31640 1 -- 172.21.15.53:0/2722926225 learned_addr learned my addr 172.21.15.53:0/2722926225 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d6432640 1 --2- 172.21.15.53:0/2722926225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d01582a0 0x7fe2d006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d5430640 1 -- 172.21.15.53:0/2722926225 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965675723 0 0) 0x7fe2d006d480 con 0x7fe2d015b7c0 2024-09-13T18:26:29.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d5430640 1 -- 172.21.15.53:0/2722926225 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2bc003530 con 0x7fe2d015b7c0 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d6c33640 1 -- 172.21.15.53:0/2722926225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d01582a0 msgr2=0x7fe2d006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d6c33640 1 --2- 172.21.15.53:0/2722926225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d01582a0 0x7fe2d006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d6c33640 1 -- 172.21.15.53:0/2722926225 >> v1:172.21.15.53:6789/0 conn(0x7fe2d015b7c0 legacy=0x7fe2d0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.814+0000 7fe2d6c33640 1 -- 172.21.15.53:0/2722926225 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d015ace0 con 0x7fe2d00713a0 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d6c33640 1 --2- 172.21.15.53:0/2722926225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d00713a0 0x7fe2d006ce40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009d90 tx=0x7fe2c801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444f5bd55aefd73c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d5430640 1 -- 172.21.15.53:0/2722926225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0001680 con 0x7fe2d00713a0 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d5430640 1 -- 172.21.15.53:0/2722926225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c80a55c0 con 0x7fe2d00713a0 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d5430640 1 -- 172.21.15.53:0/2722926225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80a5950 con 0x7fe2d00713a0 2024-09-13T18:26:29.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- 172.21.15.53:0/2722926225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d00713a0 msgr2=0x7fe2d006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2722926225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d00713a0 0x7fe2d006ce40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009d90 tx=0x7fe2c801c780 comp rx=0 tx=0).stop 2024-09-13T18:26:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- 172.21.15.53:0/2722926225 shutdown_connections 2024-09-13T18:26:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2722926225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d00713a0 0x7fe2d006ce40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2722926225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d01582a0 0x7fe2d006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- 172.21.15.53:0/2722926225 >> 172.21.15.53:0/2722926225 conn(0x7fe2d0065c80 msgr2=0x7fe2d0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- 172.21.15.53:0/2722926225 shutdown_connections 2024-09-13T18:26:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- 172.21.15.53:0/2722926225 wait complete. 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 Processor -- start 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- start start 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2d00713a0 0x7fe2d014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d01582a0 0x7fe2d0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d015b7c0 0x7fe2d014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0152400 con 0x7fe2d01582a0 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d014ff90 con 0x7fe2d00713a0 2024-09-13T18:26:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d8696640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0151080 con 0x7fe2d015b7c0 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.818+0000 7fe2d5c31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d01582a0 0x7fe2d0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d01582a0 0x7fe2d0150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53880/0 (socket says 172.21.15.53:53880) 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 -- 172.21.15.53:0/2716981889 learned_addr learned my addr 172.21.15.53:0/2716981889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 -- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d015b7c0 msgr2=0x7fe2d014a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d6c33640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d015b7c0 0x7fe2d014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d6432640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2d00713a0 0x7fe2d014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d015b7c0 0x7fe2d014a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 -- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2d00713a0 msgr2=0x7fe2d014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2d00713a0 0x7fe2d014fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 -- 172.21.15.53:0/2716981889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009a70 con 0x7fe2d01582a0 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d5c31640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d01582a0 0x7fe2d0150b40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c770 tx=0x7fe2c000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2c6ffd640 1 -- 172.21.15.53:0/2716981889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00074e0 con 0x7fe2d01582a0 2024-09-13T18:26:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2c6ffd640 1 -- 172.21.15.53:0/2716981889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0007640 con 0x7fe2d01582a0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d014efb0 con 0x7fe2d01582a0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2c6ffd640 1 -- 172.21.15.53:0/2716981889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0004a10 con 0x7fe2d01582a0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d014f250 con 0x7fe2d01582a0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d0067400 con 0x7fe2d01582a0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2c6ffd640 1 -- 172.21.15.53:0/2716981889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe2c0004b70 con 0x7fe2d01582a0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2c6ffd640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe2b4066840 0x7fe2b4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2c6ffd640 1 -- 172.21.15.53:0/2716981889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2c00838c0 con 0x7fe2d01582a0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d6432640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe2b4066840 0x7fe2b4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.822+0000 7fe2d6432640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe2b4066840 0x7fe2b4068d00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009a30 tx=0x7fe2cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.826+0000 7fe2c6ffd640 1 -- 172.21.15.53:0/2716981889 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2c0050a40 con 0x7fe2d01582a0 2024-09-13T18:26:29.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.990+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2d0151ff0 con 0x7fe2d01582a0 2024-09-13T18:26:29.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2c6ffd640 1 -- 172.21.15.53:0/2716981889 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16509 (secure 0 0 0) 0x7fe2c0018020 con 0x7fe2d01582a0 2024-09-13T18:26:29.997 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:29.997 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:00.339515+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:25:57.052393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:25:58.339187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:29.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe2b4066840 msgr2=0x7fe2b4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe2b4066840 0x7fe2b4068d00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009a30 tx=0x7fe2cc008040 comp rx=0 tx=0).stop 2024-09-13T18:26:29.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d01582a0 msgr2=0x7fe2d0150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d01582a0 0x7fe2d0150b40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c770 tx=0x7fe2c000cc30 comp rx=0 tx=0).stop 2024-09-13T18:26:29.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 shutdown_connections 2024-09-13T18:26:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe2b4066840 0x7fe2b4068d00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2d015b7c0 0x7fe2d014a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2d01582a0 0x7fe2d0150b40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 --2- 172.21.15.53:0/2716981889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe2d00713a0 0x7fe2d014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 >> 172.21.15.53:0/2716981889 conn(0x7fe2d0065c80 msgr2=0x7fe2d0066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 shutdown_connections 2024-09-13T18:26:30.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:29.994+0000 7fe2d8696640 1 -- 172.21.15.53:0/2716981889 wait complete. 2024-09-13T18:26:30.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:26:30.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e41c69640 1 Processor -- start 2024-09-13T18:26:30.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e41c69640 1 -- start start 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e41c69640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c159180 0x7f1e3c0703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e41c69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e3c159560 0x7f1e3c070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e41c69640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c15cf90 con 0x7f1e3c0b24a0 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e41c69640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c15d830 con 0x7f1e3c159560 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e41c69640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0cc160 con 0x7f1e3c159180 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e3c0b24a0 0x7f1e3c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50372/0 (socket says 172.21.15.53:50372) 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3affd640 1 -- 172.21.15.53:0/2619567303 learned_addr learned my addr 172.21.15.53:0/2619567303 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3bfff640 1 --2- 172.21.15.53:0/2619567303 >> v2:172.21.15.53:3300/0 conn(0x7f1e3c159560 0x7f1e3c070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3a7fc640 1 -- 172.21.15.53:0/2619567303 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430287513 0 0) 0x7f1e3c15cf90 con 0x7f1e3c0b24a0 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3a7fc640 1 -- 172.21.15.53:0/2619567303 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e28003530 con 0x7f1e3c0b24a0 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3b7fe640 1 --2- 172.21.15.53:0/2619567303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c159180 0x7f1e3c0703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3bfff640 1 -- 172.21.15.53:0/2619567303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c159180 msgr2=0x7f1e3c0703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3bfff640 1 --2- 172.21.15.53:0/2619567303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c159180 0x7f1e3c0703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3bfff640 1 -- 172.21.15.53:0/2619567303 >> v1:172.21.15.53:6789/0 conn(0x7f1e3c0b24a0 legacy=0x7f1e3c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3bfff640 1 -- 172.21.15.53:0/2619567303 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c06e140 con 0x7f1e3c159560 2024-09-13T18:26:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.134+0000 7f1e3b7fe640 1 --2- 172.21.15.53:0/2619567303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c159180 0x7f1e3c0703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e3bfff640 1 --2- 172.21.15.53:0/2619567303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c070910 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097f0 tx=0x7f1e3401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf771ce4ac6b03a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e3a7fc640 1 -- 172.21.15.53:0/2619567303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340ab600 con 0x7f1e3c159560 2024-09-13T18:26:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e3a7fc640 1 -- 172.21.15.53:0/2619567303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e340a7050 con 0x7f1e3c159560 2024-09-13T18:26:30.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e3a7fc640 1 -- 172.21.15.53:0/2619567303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340ab980 con 0x7f1e3c159560 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- 172.21.15.53:0/2619567303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 msgr2=0x7f1e3c070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 --2- 172.21.15.53:0/2619567303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c070910 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1e340097f0 tx=0x7f1e3401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- 172.21.15.53:0/2619567303 shutdown_connections 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 --2- 172.21.15.53:0/2619567303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c070910 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 --2- 172.21.15.53:0/2619567303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c159180 0x7f1e3c0703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- 172.21.15.53:0/2619567303 >> 172.21.15.53:0/2619567303 conn(0x7f1e3c069f50 msgr2=0x7f1e3c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- 172.21.15.53:0/2619567303 shutdown_connections 2024-09-13T18:26:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- 172.21.15.53:0/2619567303 wait complete. 2024-09-13T18:26:30.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 Processor -- start 2024-09-13T18:26:30.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- start start 2024-09-13T18:26:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c0b24a0 0x7f1e3c148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c159180 0x7f1e3c14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c1547c0 con 0x7f1e3c159560 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c149190 con 0x7f1e3c159180 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e41c69640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c153bb0 con 0x7f1e3c0b24a0 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e3bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e3bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53886/0 (socket says 172.21.15.53:53886) 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.138+0000 7f1e3bfff640 1 -- 172.21.15.53:0/3711009080 learned_addr learned my addr 172.21.15.53:0/3711009080 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3bfff640 1 -- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c0b24a0 msgr2=0x7f1e3c148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3affd640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c159180 0x7f1e3c14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3b7fe640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c0b24a0 0x7f1e3c148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3bfff640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c0b24a0 0x7f1e3c148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3bfff640 1 -- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c159180 msgr2=0x7f1e3c14fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3bfff640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c159180 0x7f1e3c14fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3bfff640 1 -- 172.21.15.53:0/3711009080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009420 con 0x7f1e3c159560 2024-09-13T18:26:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3bfff640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c150320 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1e3401a0d0 tx=0x7f1e34019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e33fff640 1 -- 172.21.15.53:0/3711009080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340b5470 con 0x7f1e3c159560 2024-09-13T18:26:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e33fff640 1 -- 172.21.15.53:0/3711009080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e340b55f0 con 0x7f1e3c159560 2024-09-13T18:26:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c153e90 con 0x7f1e3c159560 2024-09-13T18:26:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e33fff640 1 -- 172.21.15.53:0/3711009080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340b59a0 con 0x7f1e3c159560 2024-09-13T18:26:30.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c154450 con 0x7f1e3c159560 2024-09-13T18:26:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c06a330 con 0x7f1e3c159560 2024-09-13T18:26:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e33fff640 1 -- 172.21.15.53:0/3711009080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1e340b2040 con 0x7f1e3c159560 2024-09-13T18:26:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e33fff640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e1c066840 0x7f1e1c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e33fff640 1 -- 172.21.15.53:0/3711009080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e3411e970 con 0x7f1e3c159560 2024-09-13T18:26:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3b7fe640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e1c066840 0x7f1e1c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.142+0000 7f1e3b7fe640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e1c066840 0x7f1e1c068d00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0ae850 tx=0x7f1e2c0084f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:30.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.146+0000 7f1e33fff640 1 -- 172.21.15.53:0/3711009080 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e340eb950 con 0x7f1e3c159560 2024-09-13T18:26:30.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.338+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1e3c151c00 con 0x7f1e3c159560 2024-09-13T18:26:30.343 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:26:30.338+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:26:30.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.350+0000 7f1e33fff640 1 -- 172.21.15.53:0/3711009080 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1e340b0020 con 0x7f1e3c159560 2024-09-13T18:26:30.355 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:26:30.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e1c066840 msgr2=0x7f1e1c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e1c066840 0x7f1e1c068d00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0ae850 tx=0x7f1e2c0084f0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 msgr2=0x7f1e3c150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c150320 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1e3401a0d0 tx=0x7f1e34019240 comp rx=0 tx=0).stop 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 shutdown_connections 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1e1c066840 0x7f1e1c068d00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e3c159560 0x7f1e3c150320 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e3c159180 0x7f1e3c14fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 --2- 172.21.15.53:0/3711009080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e3c0b24a0 0x7f1e3c148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 >> 172.21.15.53:0/3711009080 conn(0x7f1e3c069f50 msgr2=0x7f1e3c159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 shutdown_connections 2024-09-13T18:26:30.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.354+0000 7f1e41c69640 1 -- 172.21.15.53:0/3711009080 wait complete. 2024-09-13T18:26:30.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:26:30.433 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:26:30.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d818cc640 1 Processor -- start 2024-09-13T18:26:30.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d818cc640 1 -- start start 2024-09-13T18:26:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d818cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d7c0cf1f0 0x7f7d7c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d818cc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c06d080 con 0x7f7d7c15a4a0 2024-09-13T18:26:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d818cc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c06d2b0 con 0x7f7d7c066390 2024-09-13T18:26:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d818cc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c0ccd20 con 0x7f7d7c0cf1f0 2024-09-13T18:26:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7d7c15a4a0 0x7f7d7c065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50388/0 (socket says 172.21.15.53:50388) 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 -- 172.21.15.53:0/1362036707 learned_addr learned my addr 172.21.15.53:0/1362036707 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7b7fe640 1 --2- 172.21.15.53:0/1362036707 >> v2:172.21.15.87:3300/0 conn(0x7f7d7c0cf1f0 0x7f7d7c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415826328 0 0) 0x7f7d7c06d080 con 0x7f7d7c15a4a0 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d64003530 con 0x7f7d7c15a4a0 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2806029848 0 0) 0x7f7d64003530 con 0x7f7d7c15a4a0 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 >> v2:172.21.15.87:3300/0 conn(0x7f7d7c0cf1f0 msgr2=0x7f7d7c06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 --2- 172.21.15.53:0/1362036707 >> v2:172.21.15.87:3300/0 conn(0x7f7d7c0cf1f0 0x7f7d7c06cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 >> v1:172.21.15.87:6789/0 conn(0x7f7d7c066390 legacy=0x7f7d7c15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c06d590 con 0x7f7d7c15a4a0 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7d6c001680 con 0x7f7d7c15a4a0 2024-09-13T18:26:30.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 >> v1:172.21.15.53:6789/0 conn(0x7f7d7c15a4a0 legacy=0x7f7d7c065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64005190 0x7f7d6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c0ccd20 con 0x7f7d64003980 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6400c130 con 0x7f7d640047d0 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6400c2f0 con 0x7f7d64005190 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 -- 172.21.15.53:0/1362036707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64005190 msgr2=0x7f7d6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7a7fc640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64005190 0x7f7d6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 -- 172.21.15.53:0/1362036707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d640047d0 msgr2=0x7f7d64004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d640047d0 0x7f7d64004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7b7fe640 1 -- 172.21.15.53:0/1362036707 reap_dead start 2024-09-13T18:26:30.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.486+0000 7f7d7affd640 1 -- 172.21.15.53:0/1362036707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64003530 con 0x7f7d64003980 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d7affd640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c240 tx=0x7f7d6c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120c25f56eefeda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c005ae0 con 0x7f7d64003980 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c005c60 con 0x7f7d64003980 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d79ffb640 1 -- 172.21.15.53:0/1362036707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0a57e0 con 0x7f7d64003980 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- 172.21.15.53:0/1362036707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 msgr2=0x7f7d64003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00c240 tx=0x7f7d6c01cbf0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- 172.21.15.53:0/1362036707 shutdown_connections 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 --2- 172.21.15.53:0/1362036707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- 172.21.15.53:0/1362036707 >> 172.21.15.53:0/1362036707 conn(0x7f7d7c069f50 msgr2=0x7f7d7c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- 172.21.15.53:0/1362036707 shutdown_connections 2024-09-13T18:26:30.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- 172.21.15.53:0/1362036707 wait complete. 2024-09-13T18:26:30.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 Processor -- start 2024-09-13T18:26:30.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- start start 2024-09-13T18:26:30.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64003980 0x7f7d7c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d7c15c210 0x7f7d7c1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7c1452c0 0x7f7d7c150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c15c710 con 0x7f7d7c15c210 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c15c9f0 con 0x7f7d7c1452c0 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.490+0000 7f7d818cc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c15ccd0 con 0x7f7d64003980 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d7c15c210 0x7f7d7c1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d7c15c210 0x7f7d7c1506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53924/0 (socket says 172.21.15.53:53924) 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 -- 172.21.15.53:0/168774500 learned_addr learned my addr 172.21.15.53:0/168774500 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7affd640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64003980 0x7f7d7c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7b7fe640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7c1452c0 0x7f7d7c150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 -- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64003980 msgr2=0x7f7d7c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64003980 0x7f7d7c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 -- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7c1452c0 msgr2=0x7f7d7c150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:30.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7c1452c0 0x7f7d7c150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 -- 172.21.15.53:0/168774500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c15cfb0 con 0x7f7d7c15c210 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7b7fe640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7c1452c0 0x7f7d7c150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7a7fc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d7c15c210 0x7f7d7c1506e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000d4a0 tx=0x7f7d7000d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d63fff640 1 -- 172.21.15.53:0/168774500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70005480 con 0x7f7d7c15c210 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d63fff640 1 -- 172.21.15.53:0/168774500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70003620 con 0x7f7d7c15c210 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d63fff640 1 -- 172.21.15.53:0/168774500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70003990 con 0x7f7d7c15c210 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7c15d290 con 0x7f7d7c15c210 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c151c40 con 0x7f7d7c15c210 2024-09-13T18:26:30.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7c070e20 con 0x7f7d7c15c210 2024-09-13T18:26:30.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d63fff640 1 -- 172.21.15.53:0/168774500 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f7d70003af0 con 0x7f7d7c15c210 2024-09-13T18:26:30.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d63fff640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d68066870 0x7f7d68068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:30.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d63fff640 1 -- 172.21.15.53:0/168774500 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7d700843f0 con 0x7f7d7c15c210 2024-09-13T18:26:30.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7affd640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d68066870 0x7f7d68068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:30.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.494+0000 7f7d7affd640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d68066870 0x7f7d68068d30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0ab000 tx=0x7f7d6c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:30.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.498+0000 7f7d63fff640 1 -- 172.21.15.53:0/168774500 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d70051370 con 0x7f7d7c15c210 2024-09-13T18:26:30.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:30.686+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7d7c157ce0 con 0x7f7d7c15c210 2024-09-13T18:26:31.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.358+0000 7f7d63fff640 1 -- 172.21.15.53:0/168774500 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7d70054990 con 0x7f7d7c15c210 2024-09-13T18:26:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d68066870 msgr2=0x7f7d68068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d68066870 0x7f7d68068d30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0ab000 tx=0x7f7d6c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:26:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d7c15c210 msgr2=0x7f7d7c1506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:31.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d7c15c210 0x7f7d7c1506e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000d4a0 tx=0x7f7d7000d960 comp rx=0 tx=0).stop 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 shutdown_connections 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7d68066870 0x7f7d68068d30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7c1452c0 0x7f7d7c150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d7c15c210 0x7f7d7c1506e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 --2- 172.21.15.53:0/168774500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d64003980 0x7f7d7c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 >> 172.21.15.53:0/168774500 conn(0x7f7d7c069f50 msgr2=0x7f7d7c0b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 shutdown_connections 2024-09-13T18:26:31.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.362+0000 7f7d818cc640 1 -- 172.21.15.53:0/168774500 wait complete. 2024-09-13T18:26:31.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:26:31.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877cc19640 1 Processor -- start 2024-09-13T18:26:31.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877cc19640 1 -- start start 2024-09-13T18:26:31.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877cc19640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 0x7f877815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877cc19640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87780cc800 0x7f87780cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877cc19640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8778070fb0 con 0x7f877806ccc0 2024-09-13T18:26:31.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877cc19640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877815dd30 con 0x7f87780cc800 2024-09-13T18:26:31.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877cc19640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8778070a10 con 0x7f877815c5e0 2024-09-13T18:26:31.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f8775d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f877806ccc0 0x7f877806d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50394/0 (socket says 172.21.15.53:50394) 2024-09-13T18:26:31.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f8775d9b640 1 -- 172.21.15.53:0/3298683412 learned_addr learned my addr 172.21.15.53:0/3298683412 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:31.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f8776d9d640 1 --2- 172.21.15.53:0/3298683412 >> v2:172.21.15.87:3300/0 conn(0x7f87780cc800 0x7f87780cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877659c640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 0x7f877815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704083239 0 0) 0x7f8778070fb0 con 0x7f877806ccc0 2024-09-13T18:26:31.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8760003530 con 0x7f877806ccc0 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3083916704 0 0) 0x7f8760003530 con 0x7f877806ccc0 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 msgr2=0x7f877815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 0x7f877815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 >> v2:172.21.15.87:3300/0 conn(0x7f87780cc800 msgr2=0x7f87780cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 --2- 172.21.15.53:0/3298683412 >> v2:172.21.15.87:3300/0 conn(0x7f87780cc800 0x7f87780cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780711e0 con 0x7f877806ccc0 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f876c001680 con 0x7f877806ccc0 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.514+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 >> v1:172.21.15.53:6789/0 conn(0x7f877806ccc0 legacy=0x7f877806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8760003980 0x7f8760003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8760004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 0x7f8760005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877815dd30 con 0x7f87600047d0 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778070a10 con 0x7f8760003980 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876000b990 con 0x7f877815c5e0 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8775d9b640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8760004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877659c640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8760003980 0x7f8760003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8776d9d640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 0x7f8760005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8775d9b640 1 -- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 msgr2=0x7f8760005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8775d9b640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f877815c5e0 0x7f8760005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8775d9b640 1 -- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8760003980 msgr2=0x7f8760003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8775d9b640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8760003980 0x7f8760003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8775d9b640 1 -- 172.21.15.53:0/3298683412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760003530 con 0x7f87600047d0 2024-09-13T18:26:31.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8775d9b640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8760004c50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f87780ce3b0 tx=0x7f876c01f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bffb61f721d21fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:31.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c0a8cd0 con 0x7f87600047d0 2024-09-13T18:26:31.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c0a8e30 con 0x7f87600047d0 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877559a640 1 -- 172.21.15.53:0/3298683412 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c005b20 con 0x7f87600047d0 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877cc19640 1 -- 172.21.15.53:0/3298683412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 msgr2=0x7f8760004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877cc19640 1 --2- 172.21.15.53:0/3298683412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8760004c50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f87780ce3b0 tx=0x7f876c01f430 comp rx=0 tx=0).stop 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f8776d9d640 1 -- 172.21.15.53:0/3298683412 reap_dead start 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877cc19640 1 -- 172.21.15.53:0/3298683412 shutdown_connections 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877cc19640 1 -- 172.21.15.53:0/3298683412 >> 172.21.15.53:0/3298683412 conn(0x7f8778073330 msgr2=0x7f8778065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877cc19640 1 -- 172.21.15.53:0/3298683412 shutdown_connections 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.518+0000 7f877cc19640 1 -- 172.21.15.53:0/3298683412 wait complete. 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 Processor -- start 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 -- start start 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8778142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8778142b90 0x7f87781508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8778150e20 0x7f877815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781512d0 con 0x7f87600047d0 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877815bdc0 con 0x7f8778142b90 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8778144750 con 0x7f8778150e20 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8778142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8778142650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53946/0 (socket says 172.21.15.53:53946) 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 -- 172.21.15.53:0/2216231032 learned_addr learned my addr 172.21.15.53:0/2216231032 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f8775d9b640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8778142b90 0x7f87781508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f8776d9d640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8778150e20 0x7f877815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 -- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8778150e20 msgr2=0x7f877815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8778150e20 0x7f877815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 -- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8778142b90 msgr2=0x7f87781508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:31.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8778142b90 0x7f87781508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 -- 172.21.15.53:0/2216231032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877815b240 con 0x7f87600047d0 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f8776d9d640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8778150e20 0x7f877815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877659c640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8778142650 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8768011590 tx=0x7f8768011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f8766ffd640 1 -- 172.21.15.53:0/2216231032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768015930 con 0x7f87600047d0 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f8766ffd640 1 -- 172.21.15.53:0/2216231032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768015a90 con 0x7f87600047d0 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877815b520 con 0x7f87600047d0 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f8766ffd640 1 -- 172.21.15.53:0/2216231032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768015e20 con 0x7f87600047d0 2024-09-13T18:26:31.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877815bae0 con 0x7f87600047d0 2024-09-13T18:26:31.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.522+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87780b1490 con 0x7f87600047d0 2024-09-13T18:26:31.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.526+0000 7f8766ffd640 1 -- 172.21.15.53:0/2216231032 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f876801d400 con 0x7f87600047d0 2024-09-13T18:26:31.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.526+0000 7f8766ffd640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8758066840 0x7f8758068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:31.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.526+0000 7f8766ffd640 1 -- 172.21.15.53:0/2216231032 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8768084e60 con 0x7f87600047d0 2024-09-13T18:26:31.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.526+0000 7f8775d9b640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8758066840 0x7f8758068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:31.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.526+0000 7f8775d9b640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8758066840 0x7f8758068d00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f876c0ad000 tx=0x7f876c001a10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:31.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.530+0000 7f8766ffd640 1 -- 172.21.15.53:0/2216231032 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87680b0db0 con 0x7f87600047d0 2024-09-13T18:26:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:31.690+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8778143100 con 0x7f87600047d0 2024-09-13T18:26:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.370+0000 7f8766ffd640 1 -- 172.21.15.53:0/2216231032 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8768055af0 con 0x7f87600047d0 2024-09-13T18:26:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:26:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8758066840 msgr2=0x7f8758068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8758066840 0x7f8758068d00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f876c0ad000 tx=0x7f876c001a10 comp rx=0 tx=0).stop 2024-09-13T18:26:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 msgr2=0x7f8778142650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8778142650 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8768011590 tx=0x7f8768011a50 comp rx=0 tx=0).stop 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 shutdown_connections 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8758066840 0x7f8758068d00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8778150e20 0x7f877815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8778142b90 0x7f87781508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 --2- 172.21.15.53:0/2216231032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87600047d0 0x7f8778142650 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 >> 172.21.15.53:0/2216231032 conn(0x7f8778073330 msgr2=0x7f877806f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 shutdown_connections 2024-09-13T18:26:32.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.374+0000 7f877cc19640 1 -- 172.21.15.53:0/2216231032 wait complete. 2024-09-13T18:26:32.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:26:32.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6db5e59640 1 Processor -- start 2024-09-13T18:26:32.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6db5e59640 1 -- start start 2024-09-13T18:26:32.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6db5e59640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6db00cdad0 0x7f6db0143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6db5e59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6db5e59640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00b1ba0 con 0x7f6db00cd6f0 2024-09-13T18:26:32.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6db5e59640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00b3020 con 0x7f6db00cdad0 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6db5e59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b1f80 con 0x7f6db0143d50 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6daeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6db00cdad0 0x7f6db0143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6daf7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6db00cd6f0 0x7f6db00b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50404/0 (socket says 172.21.15.53:50404) 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6daf7fe640 1 -- 172.21.15.53:0/1365834983 learned_addr learned my addr 172.21.15.53:0/1365834983 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.530+0000 7f6dae7fc640 1 -- 172.21.15.53:0/1365834983 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282275177 0 0) 0x7f6db00b1ba0 con 0x7f6db00cd6f0 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6dae7fc640 1 -- 172.21.15.53:0/1365834983 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d9c003530 con 0x7f6db00cd6f0 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6daffff640 1 --2- 172.21.15.53:0/1365834983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6daeffd640 1 -- 172.21.15.53:0/1365834983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 msgr2=0x7f6db006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6daeffd640 1 --2- 172.21.15.53:0/1365834983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db006b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6daeffd640 1 -- 172.21.15.53:0/1365834983 >> v1:172.21.15.53:6789/0 conn(0x7f6db00cd6f0 legacy=0x7f6db00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6daeffd640 1 -- 172.21.15.53:0/1365834983 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00b2260 con 0x7f6db00cdad0 2024-09-13T18:26:32.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6daffff640 1 --2- 172.21.15.53:0/1365834983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db006b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:32.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6daeffd640 1 --2- 172.21.15.53:0/1365834983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cdad0 0x7f6db0143810 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097c0 tx=0x7f6d9801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1767ba32d8444567 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:32.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6dae7fc640 1 -- 172.21.15.53:0/1365834983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d980ab670 con 0x7f6db00cdad0 2024-09-13T18:26:32.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6dae7fc640 1 -- 172.21.15.53:0/1365834983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d980ab7d0 con 0x7f6db00cdad0 2024-09-13T18:26:32.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6dae7fc640 1 -- 172.21.15.53:0/1365834983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d980abb60 con 0x7f6db00cdad0 2024-09-13T18:26:32.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 -- 172.21.15.53:0/1365834983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cdad0 msgr2=0x7f6db0143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1365834983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cdad0 0x7f6db0143810 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097c0 tx=0x7f6d9801c470 comp rx=0 tx=0).stop 2024-09-13T18:26:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 -- 172.21.15.53:0/1365834983 shutdown_connections 2024-09-13T18:26:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1365834983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db006b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1365834983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cdad0 0x7f6db0143810 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 -- 172.21.15.53:0/1365834983 >> 172.21.15.53:0/1365834983 conn(0x7f6db0073330 msgr2=0x7f6db0065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 -- 172.21.15.53:0/1365834983 shutdown_connections 2024-09-13T18:26:32.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.534+0000 7f6db5e59640 1 -- 172.21.15.53:0/1365834983 wait complete. 2024-09-13T18:26:32.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 Processor -- start 2024-09-13T18:26:32.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 -- start start 2024-09-13T18:26:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cd6f0 0x7f6db015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6db00cdad0 0x7f6db0162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db0162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db013e040 con 0x7f6db00cd6f0 2024-09-13T18:26:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db0071300 con 0x7f6db00cdad0 2024-09-13T18:26:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db015d6a0 con 0x7f6db0143d50 2024-09-13T18:26:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cd6f0 0x7f6db015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cd6f0 0x7f6db015d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53968/0 (socket says 172.21.15.53:53968) 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 -- 172.21.15.53:0/1849693813 learned_addr learned my addr 172.21.15.53:0/1849693813 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daffff640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db0162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 -- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 msgr2=0x7f6db0162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db0162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 -- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6db00cdad0 msgr2=0x7f6db0162240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daeffd640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6db00cdad0 0x7f6db0162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6db00cdad0 0x7f6db0162240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 -- 172.21.15.53:0/1849693813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d98009420 con 0x7f6db00cd6f0 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6daf7fe640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cd6f0 0x7f6db015d160 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6da000cbe0 tx=0x7f6da000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6da7fff640 1 -- 172.21.15.53:0/1849693813 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000ad40 con 0x7f6db00cd6f0 2024-09-13T18:26:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6da7fff640 1 -- 172.21.15.53:0/1849693813 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0012400 con 0x7f6db00cd6f0 2024-09-13T18:26:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db0162de0 con 0x7f6db00cd6f0 2024-09-13T18:26:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6da7fff640 1 -- 172.21.15.53:0/1849693813 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000aea0 con 0x7f6db00cd6f0 2024-09-13T18:26:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db01633a0 con 0x7f6db00cd6f0 2024-09-13T18:26:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.538+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0143810 con 0x7f6db00cd6f0 2024-09-13T18:26:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.542+0000 7f6da7fff640 1 -- 172.21.15.53:0/1849693813 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f6da0012770 con 0x7f6db00cd6f0 2024-09-13T18:26:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.542+0000 7f6da7fff640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d90066840 0x7f6d90068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.542+0000 7f6da7fff640 1 -- 172.21.15.53:0/1849693813 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f6da0084210 con 0x7f6db00cd6f0 2024-09-13T18:26:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.542+0000 7f6daeffd640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d90066840 0x7f6d90068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.542+0000 7f6daeffd640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d90066840 0x7f6d90068d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d980af000 tx=0x7f6d98008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.546+0000 7f6da7fff640 1 -- 172.21.15.53:0/1849693813 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6da0051510 con 0x7f6db00cd6f0 2024-09-13T18:26:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:32.710+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6db00ad8f0 con 0x7f6db00cd6f0 2024-09-13T18:26:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.374+0000 7f6da7fff640 1 -- 172.21.15.53:0/1849693813 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6da0054b30 con 0x7f6db00cd6f0 2024-09-13T18:26:33.377 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d90066840 msgr2=0x7f6d90068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d90066840 0x7f6d90068d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d980af000 tx=0x7f6d98008040 comp rx=0 tx=0).stop 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cd6f0 msgr2=0x7f6db015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cd6f0 0x7f6db015d160 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6da000cbe0 tx=0x7f6da000a430 comp rx=0 tx=0).stop 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 shutdown_connections 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6d90066840 0x7f6d90068d00 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d980af000 tx=0x7f6d98008040 comp rx=0 tx=0).stop 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6db0143d50 0x7f6db0162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6db00cdad0 0x7f6db0162240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 --2- 172.21.15.53:0/1849693813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6db00cd6f0 0x7f6db015d160 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 >> 172.21.15.53:0/1849693813 conn(0x7f6db0073330 msgr2=0x7f6db00b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:33.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 shutdown_connections 2024-09-13T18:26:33.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.378+0000 7f6db5e59640 1 -- 172.21.15.53:0/1849693813 wait complete. 2024-09-13T18:26:33.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:26:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e7a70640 1 Processor -- start 2024-09-13T18:26:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e7a70640 1 -- start start 2024-09-13T18:26:33.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e7a70640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 0x7f50e00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e7a70640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50e00ada60 0x7f50e00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e7a70640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e00b3c80 con 0x7f50e006e440 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e7a70640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e00ac690 con 0x7f50e00ada60 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e7a70640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0154ff0 con 0x7f50e0072de0 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e580c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f50e006e440 0x7f50e015b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50416/0 (socket says 172.21.15.53:50416) 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e580c640 1 -- 172.21.15.53:0/1415428256 learned_addr learned my addr 172.21.15.53:0/1415428256 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e600d640 1 --2- 172.21.15.53:0/1415428256 >> v2:172.21.15.87:3300/0 conn(0x7f50e00ada60 0x7f50e00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e500b640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 0x7f50e00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836414654 0 0) 0x7f50dc001120 con 0x7f50e006e440 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc003530 con 0x7f50e006e440 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900290441 0 0) 0x7f50cc003530 con 0x7f50e006e440 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 msgr2=0x7f50e00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 0x7f50e00ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 >> v2:172.21.15.87:3300/0 conn(0x7f50e00ada60 msgr2=0x7f50e00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 --2- 172.21.15.53:0/1415428256 >> v2:172.21.15.87:3300/0 conn(0x7f50e00ada60 0x7f50e00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e00abda0 con 0x7f50e006e440 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f50dc001810 con 0x7f50e006e440 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 >> v1:172.21.15.53:6789/0 conn(0x7f50e006e440 legacy=0x7f50e015b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 0x7f50cc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50cc003f00 0x7f50cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc004d10 0x7f50cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0154ff0 con 0x7f50cc003f00 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00b990 con 0x7f50cc004d10 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00bad0 con 0x7f50e0072de0 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e500b640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50cc003f00 0x7f50cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e580c640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 0x7f50cc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e600d640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc004d10 0x7f50cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e500b640 1 -- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 msgr2=0x7f50cc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e500b640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e0072de0 0x7f50cc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e500b640 1 -- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc004d10 msgr2=0x7f50cc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e500b640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc004d10 0x7f50cc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e500b640 1 -- 172.21.15.53:0/1415428256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc003530 con 0x7f50cc003f00 2024-09-13T18:26:33.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.526+0000 7f50e600d640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc004d10 0x7f50cc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e500b640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50cc003f00 0x7f50cc0047d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009ab0 tx=0x7f50d001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8402ef4e29506980 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00a5640 con 0x7f50cc003f00 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d00a57a0 con 0x7f50cc003f00 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e480a640 1 -- 172.21.15.53:0/1415428256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00a5b50 con 0x7f50cc003f00 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 -- 172.21.15.53:0/1415428256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50cc003f00 msgr2=0x7f50cc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 --2- 172.21.15.53:0/1415428256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50cc003f00 0x7f50cc0047d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009ab0 tx=0x7f50d001c9f0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e600d640 1 -- 172.21.15.53:0/1415428256 reap_dead start 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 -- 172.21.15.53:0/1415428256 shutdown_connections 2024-09-13T18:26:33.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 -- 172.21.15.53:0/1415428256 >> 172.21.15.53:0/1415428256 conn(0x7f50e00b0ac0 msgr2=0x7f50e00b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 -- 172.21.15.53:0/1415428256 shutdown_connections 2024-09-13T18:26:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 -- 172.21.15.53:0/1415428256 wait complete. 2024-09-13T18:26:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 Processor -- start 2024-09-13T18:26:33.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.530+0000 7f50e7a70640 1 -- start start 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc003f00 0x7f50e0099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e009b0f0 0x7f50e009c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50e0147760 0x7f50e01520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e009cba0 con 0x7f50e0147760 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e009a050 con 0x7f50cc003f00 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e009a330 con 0x7f50e009b0f0 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50e0147760 0x7f50e01520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50e0147760 0x7f50e01520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53982/0 (socket says 172.21.15.53:53982) 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 -- 172.21.15.53:0/3952141864 learned_addr learned my addr 172.21.15.53:0/3952141864 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e500b640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e009b0f0 0x7f50e009c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e580c640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc003f00 0x7f50e0099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 -- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e009b0f0 msgr2=0x7f50e009c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e009b0f0 0x7f50e009c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 -- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc003f00 msgr2=0x7f50e0099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc003f00 0x7f50e0099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 -- 172.21.15.53:0/3952141864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e009a610 con 0x7f50e0147760 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e600d640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50e0147760 0x7f50e01520f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f50e00cecc0 tx=0x7f50d800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50d67fc640 1 -- 172.21.15.53:0/3952141864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8016620 con 0x7f50e0147760 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50d67fc640 1 -- 172.21.15.53:0/3952141864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8016780 con 0x7f50e0147760 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e009a8f0 con 0x7f50e0147760 2024-09-13T18:26:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50d67fc640 1 -- 172.21.15.53:0/3952141864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8016b10 con 0x7f50e0147760 2024-09-13T18:26:33.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e0147be0 con 0x7f50e0147760 2024-09-13T18:26:33.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e00adf10 con 0x7f50e0147760 2024-09-13T18:26:33.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50d67fc640 1 -- 172.21.15.53:0/3952141864 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f50d8016c70 con 0x7f50e0147760 2024-09-13T18:26:33.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.534+0000 7f50d67fc640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50c4066870 0x7f50c4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.538+0000 7f50d67fc640 1 -- 172.21.15.53:0/3952141864 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50d8084fd0 con 0x7f50e0147760 2024-09-13T18:26:33.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.538+0000 7f50e580c640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50c4066870 0x7f50c4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.538+0000 7f50e580c640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50c4066870 0x7f50c4068d30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0013a0 tx=0x7f50dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:33.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.542+0000 7f50d67fc640 1 -- 172.21.15.53:0/3952141864 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50d8052340 con 0x7f50e0147760 2024-09-13T18:26:33.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.718+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f50e01540a0 con 0x7f50e0147760 2024-09-13T18:26:33.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50d67fc640 1 -- 172.21.15.53:0/3952141864 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f50d8055960 con 0x7f50e0147760 2024-09-13T18:26:33.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50c4066870 msgr2=0x7f50c4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50c4066870 0x7f50c4068d30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0013a0 tx=0x7f50dc009040 comp rx=0 tx=0).stop 2024-09-13T18:26:33.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50e0147760 msgr2=0x7f50e01520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50e0147760 0x7f50e01520f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f50e00cecc0 tx=0x7f50d800f520 comp rx=0 tx=0).stop 2024-09-13T18:26:33.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 shutdown_connections 2024-09-13T18:26:33.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50c4066870 0x7f50c4068d30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50e009b0f0 0x7f50e009c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50e0147760 0x7f50e01520f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 --2- 172.21.15.53:0/3952141864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50cc003f00 0x7f50e0099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 >> 172.21.15.53:0/3952141864 conn(0x7f50e00b0ac0 msgr2=0x7f50e006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:33.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 shutdown_connections 2024-09-13T18:26:33.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.726+0000 7f50e7a70640 1 -- 172.21.15.53:0/3952141864 wait complete. 2024-09-13T18:26:33.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-13T18:26:33.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 Processor -- start 2024-09-13T18:26:33.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 -- start start 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8f4158d20 0x7fd8f415d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 0x7fd8f40ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8f4069f50 0x7fd8f406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f406a920 con 0x7fd8f4158d20 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f4159100 con 0x7fd8f4069f50 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fbe5c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4071ef0 con 0x7fd8f4071670 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8f4158d20 0x7fd8f415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8f4158d20 0x7fd8f415d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53984/0 (socket says 172.21.15.53:53984) 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/4081753536 learned_addr learned my addr 172.21.15.53:0/4081753536 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/4081753536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 msgr2=0x7fd8f40ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f93f7640 1 --2- 172.21.15.53:0/4081753536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 0x7fd8f40ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8fa3f9640 1 --2- 172.21.15.53:0/4081753536 >> v2:172.21.15.87:3300/0 conn(0x7fd8f4069f50 0x7fd8f406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 --2- 172.21.15.53:0/4081753536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 0x7fd8f40ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/4081753536 >> v2:172.21.15.87:3300/0 conn(0x7fd8f4069f50 msgr2=0x7fd8f406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 --2- 172.21.15.53:0/4081753536 >> v2:172.21.15.87:3300/0 conn(0x7fd8f4069f50 0x7fd8f406a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.858+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/4081753536 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f406c270 con 0x7fd8f4158d20 2024-09-13T18:26:33.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 --2- 172.21.15.53:0/4081753536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4158d20 0x7fd8f415d320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40ae8d0 tx=0x7fd8f001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d44a850780e6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:33.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f8bf6640 1 -- 172.21.15.53:0/4081753536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00ac600 con 0x7fd8f4158d20 2024-09-13T18:26:33.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f8bf6640 1 -- 172.21.15.53:0/4081753536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f00a8050 con 0x7fd8f4158d20 2024-09-13T18:26:33.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f8bf6640 1 -- 172.21.15.53:0/4081753536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00ac980 con 0x7fd8f4158d20 2024-09-13T18:26:33.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/4081753536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4158d20 msgr2=0x7fd8f415d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/4081753536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4158d20 0x7fd8f415d320 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40ae8d0 tx=0x7fd8f001c460 comp rx=0 tx=0).stop 2024-09-13T18:26:33.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/4081753536 shutdown_connections 2024-09-13T18:26:33.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/4081753536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 0x7fd8f40ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/4081753536 >> v2:172.21.15.87:3300/0 conn(0x7fd8f4069f50 0x7fd8f406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/4081753536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4158d20 0x7fd8f415d320 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/4081753536 >> 172.21.15.53:0/4081753536 conn(0x7fd8f40b0a30 msgr2=0x7fd8f40b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/4081753536 shutdown_connections 2024-09-13T18:26:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/4081753536 wait complete. 2024-09-13T18:26:33.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 Processor -- start 2024-09-13T18:26:33.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- start start 2024-09-13T18:26:33.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4069f50 0x7fd8f41437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 0x7fd8f41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f4158d20 0x7fd8f4157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4156710 con 0x7fd8f4069f50 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f409b190 con 0x7fd8f4158d20 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f409b470 con 0x7fd8f4071670 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4069f50 0x7fd8f41437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4069f50 0x7fd8f41437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53998/0 (socket says 172.21.15.53:53998) 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/1289158062 learned_addr learned my addr 172.21.15.53:0/1289158062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fa3f9640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f4158d20 0x7fd8f4157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 msgr2=0x7fd8f41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 0x7fd8f41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f4158d20 msgr2=0x7fd8f4157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:33.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f4158d20 0x7fd8f4157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 -- 172.21.15.53:0/1289158062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00094d0 con 0x7fd8f4069f50 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8f9bf8640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4069f50 0x7fd8f41437f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0000c10 tx=0x7fd8f0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8ea7fc640 1 -- 172.21.15.53:0/1289158062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00b5610 con 0x7fd8f4069f50 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8ea7fc640 1 -- 172.21.15.53:0/1289158062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f00b5770 con 0x7fd8f4069f50 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f4156a50 con 0x7fd8f4069f50 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8ea7fc640 1 -- 172.21.15.53:0/1289158062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00b5b20 con 0x7fd8f4069f50 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.862+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f4157010 con 0x7fd8f4069f50 2024-09-13T18:26:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.866+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f409b640 con 0x7fd8f4069f50 2024-09-13T18:26:33.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.866+0000 7fd8ea7fc640 1 -- 172.21.15.53:0/1289158062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd8f00b3040 con 0x7fd8f4069f50 2024-09-13T18:26:33.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.866+0000 7fd8ea7fc640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd8d8066840 0x7fd8d8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:33.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.866+0000 7fd8ea7fc640 1 -- 172.21.15.53:0/1289158062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8f011e6f0 con 0x7fd8f4069f50 2024-09-13T18:26:33.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.866+0000 7fd8f93f7640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd8d8066840 0x7fd8d8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:33.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.866+0000 7fd8f93f7640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd8d8066840 0x7fd8d8068d00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4006ac0 tx=0x7fd8e4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:33.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:33.870+0000 7fd8ea7fc640 1 -- 172.21.15.53:0/1289158062 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8f00eb9d0 con 0x7fd8f4069f50 2024-09-13T18:26:34.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.086+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fd8f4150dc0 con 0x7fd8f4069f50 2024-09-13T18:26:34.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.386+0000 7fd8ea7fc640 1 -- 172.21.15.53:0/1289158062 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v109) v1 ==== 158+0+0 (secure 0 0 0) 0x7fd8f00eeff0 con 0x7fd8f4069f50 2024-09-13T18:26:34.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd8d8066840 msgr2=0x7fd8d8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd8d8066840 0x7fd8d8068d00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4006ac0 tx=0x7fd8e4008040 comp rx=0 tx=0).stop 2024-09-13T18:26:34.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4069f50 msgr2=0x7fd8f41437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4069f50 0x7fd8f41437f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0000c10 tx=0x7fd8f0019200 comp rx=0 tx=0).stop 2024-09-13T18:26:34.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 shutdown_connections 2024-09-13T18:26:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd8d8066840 0x7fd8d8068d00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f4071670 0x7fd8f41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8f4158d20 0x7fd8f4157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 --2- 172.21.15.53:0/1289158062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f4069f50 0x7fd8f41437f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 >> 172.21.15.53:0/1289158062 conn(0x7fd8f40b0a30 msgr2=0x7fd8f40b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 shutdown_connections 2024-09-13T18:26:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.390+0000 7fd8fbe5c640 1 -- 172.21.15.53:0/1289158062 wait complete. 2024-09-13T18:26:34.418 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2024-09-13T18:26:34.419 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:26:34.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:34.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.546+0000 7f8f6f904640 1 Processor -- start 2024-09-13T18:26:34.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.546+0000 7f8f6f904640 1 -- start start 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6f904640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f6815a470 0x7f8f680cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6f904640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f6815cc60 0x7f8f68071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6f904640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6806f550 con 0x7f8f680b1c10 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6f904640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6806f880 con 0x7f8f6815a470 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6f904640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6815dc40 con 0x7f8f6815cc60 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6dea1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8f680b1c10 0x7f8f6806fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50420/0 (socket says 172.21.15.53:50420) 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6d6a0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f6815a470 0x7f8f680cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6dea1640 1 -- 172.21.15.53:0/2971211131 learned_addr learned my addr 172.21.15.53:0/2971211131 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6ce9f640 1 --2- 172.21.15.53:0/2971211131 >> v2:172.21.15.87:3300/0 conn(0x7f8f6815cc60 0x7f8f68071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f5ffff640 1 -- 172.21.15.53:0/2971211131 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581200855 0 0) 0x7f8f6806f550 con 0x7f8f680b1c10 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f5ffff640 1 -- 172.21.15.53:0/2971211131 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f54003530 con 0x7f8f680b1c10 2024-09-13T18:26:34.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6d6a0640 1 -- 172.21.15.53:0/2971211131 >> v2:172.21.15.87:3300/0 conn(0x7f8f6815cc60 msgr2=0x7f8f68071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6d6a0640 1 --2- 172.21.15.53:0/2971211131 >> v2:172.21.15.87:3300/0 conn(0x7f8f6815cc60 0x7f8f68071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6d6a0640 1 -- 172.21.15.53:0/2971211131 >> v1:172.21.15.53:6789/0 conn(0x7f8f680b1c10 legacy=0x7f8f6806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.550+0000 7f8f6d6a0640 1 -- 172.21.15.53:0/2971211131 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f680715a0 con 0x7f8f6815a470 2024-09-13T18:26:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 --2- 172.21.15.53:0/2971211131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6815a470 0x7f8f680cc270 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8f6806d800 tx=0x7f8f5801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c107bccec51066 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f5ffff640 1 -- 172.21.15.53:0/2971211131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580ab680 con 0x7f8f6815a470 2024-09-13T18:26:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f5ffff640 1 -- 172.21.15.53:0/2971211131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f580ab7e0 con 0x7f8f6815a470 2024-09-13T18:26:34.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f5ffff640 1 -- 172.21.15.53:0/2971211131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580abb70 con 0x7f8f6815a470 2024-09-13T18:26:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- 172.21.15.53:0/2971211131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6815a470 msgr2=0x7f8f680cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 --2- 172.21.15.53:0/2971211131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6815a470 0x7f8f680cc270 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8f6806d800 tx=0x7f8f5801c480 comp rx=0 tx=0).stop 2024-09-13T18:26:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- 172.21.15.53:0/2971211131 shutdown_connections 2024-09-13T18:26:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 --2- 172.21.15.53:0/2971211131 >> v2:172.21.15.87:3300/0 conn(0x7f8f6815cc60 0x7f8f68071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 --2- 172.21.15.53:0/2971211131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f6815a470 0x7f8f680cc270 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- 172.21.15.53:0/2971211131 >> 172.21.15.53:0/2971211131 conn(0x7f8f68065c80 msgr2=0x7f8f68066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:34.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- 172.21.15.53:0/2971211131 shutdown_connections 2024-09-13T18:26:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- 172.21.15.53:0/2971211131 wait complete. 2024-09-13T18:26:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 Processor -- start 2024-09-13T18:26:34.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- start start 2024-09-13T18:26:34.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f680b1c10 0x7f8f6813f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f6815a470 0x7f8f6813c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f6815cc60 0x7f8f680b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68140100 con 0x7f8f680b1c10 2024-09-13T18:26:34.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6813fb40 con 0x7f8f6815a470 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6813fe20 con 0x7f8f6815cc60 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f680b1c10 0x7f8f6813f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f680b1c10 0x7f8f6813f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54016/0 (socket says 172.21.15.53:54016) 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 -- 172.21.15.53:0/1416237173 learned_addr learned my addr 172.21.15.53:0/1416237173 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6ce9f640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f6815a470 0x7f8f6813c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 -- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f6815cc60 msgr2=0x7f8f680b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f6815cc60 0x7f8f680b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 -- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f6815a470 msgr2=0x7f8f6813c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f6815a470 0x7f8f6813c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 -- 172.21.15.53:0/1416237173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58009420 con 0x7f8f680b1c10 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6d6a0640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f680b1c10 0x7f8f6813f160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8f580ad040 tx=0x7f8f5801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f5dffb640 1 -- 172.21.15.53:0/1416237173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580bf610 con 0x7f8f680b1c10 2024-09-13T18:26:34.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f5dffb640 1 -- 172.21.15.53:0/1416237173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f580bf790 con 0x7f8f680b1c10 2024-09-13T18:26:34.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f680b25b0 con 0x7f8f680b1c10 2024-09-13T18:26:34.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.554+0000 7f8f5dffb640 1 -- 172.21.15.53:0/1416237173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580bfb40 con 0x7f8f680b1c10 2024-09-13T18:26:34.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.558+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6813d550 con 0x7f8f680b1c10 2024-09-13T18:26:34.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.558+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f68067400 con 0x7f8f680b1c10 2024-09-13T18:26:34.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.558+0000 7f8f5dffb640 1 -- 172.21.15.53:0/1416237173 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f8f580b5400 con 0x7f8f680b1c10 2024-09-13T18:26:34.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.558+0000 7f8f5dffb640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f4c066840 0x7f8f4c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.558+0000 7f8f5dffb640 1 -- 172.21.15.53:0/1416237173 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8f5811eeb0 con 0x7f8f680b1c10 2024-09-13T18:26:34.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.558+0000 7f8f6ce9f640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f4c066840 0x7f8f4c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.558+0000 7f8f6ce9f640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f4c066840 0x7f8f4c068d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f68152c40 tx=0x7f8f64008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:34.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.562+0000 7f8f5dffb640 1 -- 172.21.15.53:0/1416237173 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f580ec220 con 0x7f8f680b1c10 2024-09-13T18:26:34.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.722+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f6813d0d0 con 0x7f8f680b1c10 2024-09-13T18:26:34.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f5dffb640 1 -- 172.21.15.53:0/1416237173 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12926 (secure 0 0 0) 0x7f8f6813d0d0 con 0x7f8f680b1c10 2024-09-13T18:26:34.729 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:34.729 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:33.367554+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/2879083637":"2024-09-14T18:26:30.342511+0000","172.21.15.53:6833/2879083637":"2024-09-14T18:26:30.342511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f4c066840 msgr2=0x7f8f4c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f4c066840 0x7f8f4c068d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f68152c40 tx=0x7f8f64008040 comp rx=0 tx=0).stop 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f680b1c10 msgr2=0x7f8f6813f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f680b1c10 0x7f8f6813f160 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8f580ad040 tx=0x7f8f5801acc0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 shutdown_connections 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f4c066840 0x7f8f4c068d00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f6815cc60 0x7f8f680b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f6815a470 0x7f8f6813c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 --2- 172.21.15.53:0/1416237173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f680b1c10 0x7f8f6813f160 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 >> 172.21.15.53:0/1416237173 conn(0x7f8f68065c80 msgr2=0x7f8f68066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:34.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.726+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 shutdown_connections 2024-09-13T18:26:34.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.730+0000 7f8f6f904640 1 -- 172.21.15.53:0/1416237173 wait complete. 2024-09-13T18:26:34.750 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:34.750 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:26:34.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4d5de3640 1 Processor -- start 2024-09-13T18:26:34.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4d5de3640 1 -- start start 2024-09-13T18:26:34.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4d5de3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d0143e80 0x7fc4d006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4d5de3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4d00cda30 0x7fc4d00cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4d5de3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d006f7a0 con 0x7fc4d00caee0 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4d5de3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d006fd60 con 0x7fc4d00cda30 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4d5de3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00cb960 con 0x7fc4d0143e80 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4ceffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc4d00caee0 0x7fc4d00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50422/0 (socket says 172.21.15.53:50422) 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4ceffd640 1 -- 172.21.15.53:0/1916965751 learned_addr learned my addr 172.21.15.53:0/1916965751 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4cf7fe640 1 --2- 172.21.15.53:0/1916965751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d0143e80 0x7fc4d006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4cffff640 1 --2- 172.21.15.53:0/1916965751 >> v2:172.21.15.87:3300/0 conn(0x7fc4d00cda30 0x7fc4d00cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4ce7fc640 1 -- 172.21.15.53:0/1916965751 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542519510 0 0) 0x7fc4d006f7a0 con 0x7fc4d00caee0 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4ce7fc640 1 -- 172.21.15.53:0/1916965751 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b8003530 con 0x7fc4d00caee0 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4cf7fe640 1 -- 172.21.15.53:0/1916965751 >> v2:172.21.15.87:3300/0 conn(0x7fc4d00cda30 msgr2=0x7fc4d00cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:34.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4cf7fe640 1 --2- 172.21.15.53:0/1916965751 >> v2:172.21.15.87:3300/0 conn(0x7fc4d00cda30 0x7fc4d00cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4cf7fe640 1 -- 172.21.15.53:0/1916965751 >> v1:172.21.15.53:6789/0 conn(0x7fc4d00caee0 legacy=0x7fc4d00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.878+0000 7fc4cf7fe640 1 -- 172.21.15.53:0/1916965751 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00cbc40 con 0x7fc4d0143e80 2024-09-13T18:26:34.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4cf7fe640 1 --2- 172.21.15.53:0/1916965751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d0143e80 0x7fc4d006b390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00097c0 tx=0x7fc4c001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2ce1f5fc9a8140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:34.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4ce7fc640 1 -- 172.21.15.53:0/1916965751 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00ac620 con 0x7fc4d0143e80 2024-09-13T18:26:34.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4ce7fc640 1 -- 172.21.15.53:0/1916965751 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c00ac780 con 0x7fc4d0143e80 2024-09-13T18:26:34.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4ce7fc640 1 -- 172.21.15.53:0/1916965751 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00acaf0 con 0x7fc4d0143e80 2024-09-13T18:26:34.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1916965751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d0143e80 msgr2=0x7fc4d006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1916965751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d0143e80 0x7fc4d006b390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00097c0 tx=0x7fc4c001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1916965751 shutdown_connections 2024-09-13T18:26:34.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1916965751 >> v2:172.21.15.87:3300/0 conn(0x7fc4d00cda30 0x7fc4d00cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1916965751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d0143e80 0x7fc4d006b390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1916965751 >> 172.21.15.53:0/1916965751 conn(0x7fc4d0065c80 msgr2=0x7fc4d0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:34.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1916965751 shutdown_connections 2024-09-13T18:26:34.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1916965751 wait complete. 2024-09-13T18:26:34.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.882+0000 7fc4d5de3640 1 Processor -- start 2024-09-13T18:26:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 -- start start 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d00caee0 0x7fc4d01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4d00cda30 0x7fc4d0138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d0143e80 0x7fc4d0138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f3ba0 con 0x7fc4d0143e80 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f2f40 con 0x7fc4d00cda30 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d01f3200 con 0x7fc4d00caee0 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d0143e80 0x7fc4d0138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d0143e80 0x7fc4d0138fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54026/0 (socket says 172.21.15.53:54026) 2024-09-13T18:26:34.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 -- 172.21.15.53:0/1665830035 learned_addr learned my addr 172.21.15.53:0/1665830035 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cf7fe640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d00caee0 0x7fc4d01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4ceffd640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4d00cda30 0x7fc4d0138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 -- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d00caee0 msgr2=0x7fc4d01f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d00caee0 0x7fc4d01f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 -- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4d00cda30 msgr2=0x7fc4d0138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4d00cda30 0x7fc4d0138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 -- 172.21.15.53:0/1665830035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c0009420 con 0x7fc4d0143e80 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4cffff640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d0143e80 0x7fc4d0138fe0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800e7f0 tx=0x7fc4c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4b7fff640 1 -- 172.21.15.53:0/1665830035 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8009530 con 0x7fc4d0143e80 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4b7fff640 1 -- 172.21.15.53:0/1665830035 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800eea0 con 0x7fc4d0143e80 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4b7fff640 1 -- 172.21.15.53:0/1665830035 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800cb60 con 0x7fc4d0143e80 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d01f34e0 con 0x7fc4d0143e80 2024-09-13T18:26:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d01f60e0 con 0x7fc4d0143e80 2024-09-13T18:26:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d00cb320 con 0x7fc4d0143e80 2024-09-13T18:26:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.886+0000 7fc4b7fff640 1 -- 172.21.15.53:0/1665830035 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc4c800ccc0 con 0x7fc4d0143e80 2024-09-13T18:26:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.890+0000 7fc4b7fff640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4bc066840 0x7fc4bc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.890+0000 7fc4b7fff640 1 -- 172.21.15.53:0/1665830035 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc4c80841c0 con 0x7fc4d0143e80 2024-09-13T18:26:34.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.890+0000 7fc4cf7fe640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4bc066840 0x7fc4bc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:34.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.890+0000 7fc4cf7fe640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4bc066840 0x7fc4bc068d00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00ae000 tx=0x7fc4c00a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:34.894+0000 7fc4b7fff640 1 -- 172.21.15.53:0/1665830035 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4c8051640 con 0x7fc4d0143e80 2024-09-13T18:26:35.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.050+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4d015da20 con 0x7fc4d0143e80 2024-09-13T18:26:35.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4b7fff640 1 -- 172.21.15.53:0/1665830035 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4c8054c60 con 0x7fc4d0143e80 2024-09-13T18:26:35.056 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:26:35.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4bc066840 msgr2=0x7fc4bc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4bc066840 0x7fc4bc068d00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00ae000 tx=0x7fc4c00a7000 comp rx=0 tx=0).stop 2024-09-13T18:26:35.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d0143e80 msgr2=0x7fc4d0138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d0143e80 0x7fc4d0138fe0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800e7f0 tx=0x7fc4c800ecb0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 shutdown_connections 2024-09-13T18:26:35.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4bc066840 0x7fc4bc068d00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4d0143e80 0x7fc4d0138fe0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4d00cda30 0x7fc4d0138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 --2- 172.21.15.53:0/1665830035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4d00caee0 0x7fc4d01f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 >> 172.21.15.53:0/1665830035 conn(0x7fc4d0065c80 msgr2=0x7fc4d00af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:35.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 shutdown_connections 2024-09-13T18:26:35.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.054+0000 7fc4d5de3640 1 -- 172.21.15.53:0/1665830035 wait complete. 2024-09-13T18:26:35.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-13T18:26:35.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.186+0000 7fbf06a38640 1 Processor -- start 2024-09-13T18:26:35.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.186+0000 7fbf06a38640 1 -- start start 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf000cb980 0x7fbf000b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbf0006b850 0x7fbf000cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf000b1ac0 con 0x7fbf000cbd60 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf000b3010 con 0x7fbf0006b850 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf00159ac0 con 0x7fbf000cb980 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbf0006b850 0x7fbf000cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbf0006b850 0x7fbf000cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54032/0 (socket says 172.21.15.53:54032) 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 -- 172.21.15.53:0/473163933 learned_addr learned my addr 172.21.15.53:0/473163933 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbefffff640 1 --2- 172.21.15.53:0/473163933 >> v2:172.21.15.87:3300/0 conn(0x7fbf000cb980 0x7fbf000b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 -- 172.21.15.53:0/473163933 >> v2:172.21.15.87:3300/0 conn(0x7fbf000cb980 msgr2=0x7fbf000b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:35.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 --2- 172.21.15.53:0/473163933 >> v2:172.21.15.87:3300/0 conn(0x7fbf000cb980 0x7fbf000b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 -- 172.21.15.53:0/473163933 >> v1:172.21.15.87:6789/0 conn(0x7fbf000cbd60 legacy=0x7fbf0006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 -- 172.21.15.53:0/473163933 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf00159da0 con 0x7fbf0006b850 2024-09-13T18:26:35.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbeff7fe640 1 --2- 172.21.15.53:0/473163933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf0006b850 0x7fbf000cdd40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbf00071820 tx=0x7fbef401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba70c49d994bf97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbefeffd640 1 -- 172.21.15.53:0/473163933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40ab620 con 0x7fbf0006b850 2024-09-13T18:26:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbefeffd640 1 -- 172.21.15.53:0/473163933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef40ab780 con 0x7fbf0006b850 2024-09-13T18:26:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbefeffd640 1 -- 172.21.15.53:0/473163933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40abb10 con 0x7fbf0006b850 2024-09-13T18:26:35.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- 172.21.15.53:0/473163933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf0006b850 msgr2=0x7fbf000cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 --2- 172.21.15.53:0/473163933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf0006b850 0x7fbf000cdd40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbf00071820 tx=0x7fbef401c420 comp rx=0 tx=0).stop 2024-09-13T18:26:35.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- 172.21.15.53:0/473163933 shutdown_connections 2024-09-13T18:26:35.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 --2- 172.21.15.53:0/473163933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf0006b850 0x7fbf000cdd40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 --2- 172.21.15.53:0/473163933 >> v2:172.21.15.87:3300/0 conn(0x7fbf000cb980 0x7fbf000b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- 172.21.15.53:0/473163933 >> 172.21.15.53:0/473163933 conn(0x7fbf00065c80 msgr2=0x7fbf00066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:35.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- 172.21.15.53:0/473163933 shutdown_connections 2024-09-13T18:26:35.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.190+0000 7fbf06a38640 1 -- 172.21.15.53:0/473163933 wait complete. 2024-09-13T18:26:35.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 Processor -- start 2024-09-13T18:26:35.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 -- start start 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf0006b850 0x7fbf00149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf000cb980 0x7fbf0014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf000cbd60 0x7fbf001f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00150fc0 con 0x7fbf000cb980 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00151860 con 0x7fbf000cbd60 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0014de10 con 0x7fbf0006b850 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf000cb980 0x7fbf0014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf000cb980 0x7fbf0014c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54034/0 (socket says 172.21.15.53:54034) 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 -- 172.21.15.53:0/622617342 learned_addr learned my addr 172.21.15.53:0/622617342 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbefffff640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf0006b850 0x7fbf00149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf04fd5640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf000cbd60 0x7fbf001f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 -- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf0006b850 msgr2=0x7fbf00149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf0006b850 0x7fbf00149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 -- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf000cbd60 msgr2=0x7fbf001f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf000cbd60 0x7fbf001f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 -- 172.21.15.53:0/622617342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40094d0 con 0x7fbf000cb980 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbefffff640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf0006b850 0x7fbf00149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbeff7fe640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf000cb980 0x7fbf0014c200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbef401a050 tx=0x7fbef401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbefcff9640 1 -- 172.21.15.53:0/622617342 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40be3f0 con 0x7fbf000cb980 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbefcff9640 1 -- 172.21.15.53:0/622617342 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef40be570 con 0x7fbf000cb980 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbefcff9640 1 -- 172.21.15.53:0/622617342 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40be920 con 0x7fbf000cb980 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf00151210 con 0x7fbf000cb980 2024-09-13T18:26:35.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0014dac0 con 0x7fbf000cb980 2024-09-13T18:26:35.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf00067400 con 0x7fbf000cb980 2024-09-13T18:26:35.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.194+0000 7fbefcff9640 1 -- 172.21.15.53:0/622617342 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fbef40b43f0 con 0x7fbf000cb980 2024-09-13T18:26:35.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.198+0000 7fbefcff9640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbeec066840 0x7fbeec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.198+0000 7fbefcff9640 1 -- 172.21.15.53:0/622617342 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbef411e9b0 con 0x7fbf000cb980 2024-09-13T18:26:35.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.198+0000 7fbefffff640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbeec066840 0x7fbeec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.198+0000 7fbefffff640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbeec066840 0x7fbeec068d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbf0006d570 tx=0x7fbef0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:35.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.202+0000 7fbefcff9640 1 -- 172.21.15.53:0/622617342 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbef40ebd40 con 0x7fbf000cb980 2024-09-13T18:26:35.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:35.422+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7fbf000b2be0 con 0x7fbf000cb980 2024-09-13T18:26:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.394+0000 7fbefcff9640 1 -- 172.21.15.53:0/622617342 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v111) v1 ==== 143+0+0 (secure 0 0 0) 0x7fbef40ef360 con 0x7fbf000cb980 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbeec066840 msgr2=0x7fbeec068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbeec066840 0x7fbeec068d00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbf0006d570 tx=0x7fbef0008040 comp rx=0 tx=0).stop 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf000cb980 msgr2=0x7fbf0014c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf000cb980 0x7fbf0014c200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbef401a050 tx=0x7fbef401ac60 comp rx=0 tx=0).stop 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 shutdown_connections 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbeec066840 0x7fbeec068d00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf000cbd60 0x7fbf001f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf000cb980 0x7fbf0014c200 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 --2- 172.21.15.53:0/622617342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf0006b850 0x7fbf00149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 >> 172.21.15.53:0/622617342 conn(0x7fbf00065c80 msgr2=0x7fbf0014a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 shutdown_connections 2024-09-13T18:26:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.398+0000 7fbf06a38640 1 -- 172.21.15.53:0/622617342 wait complete. 2024-09-13T18:26:36.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:26:36.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd115cd0640 1 Processor -- start 2024-09-13T18:26:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd115cd0640 1 -- start start 2024-09-13T18:26:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd115cd0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd110143e80 0x7fd11006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd115cd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1100cda30 0x7fd1100cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd115cd0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11006f7a0 con 0x7fd1100caee0 2024-09-13T18:26:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd115cd0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11006fd60 con 0x7fd110143e80 2024-09-13T18:26:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd115cd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100cb960 con 0x7fd1100cda30 2024-09-13T18:26:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd110143e80 0x7fd11006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10ffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1100cda30 0x7fd1100cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10ffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1100cda30 0x7fd1100cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:51542/0 (socket says 172.21.15.53:51542) 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd110143e80 0x7fd11006b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:57380/0 (socket says 172.21.15.53:57380) 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10ffff640 1 -- 172.21.15.53:0/626840359 learned_addr learned my addr 172.21.15.53:0/626840359 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10f7fe640 1 -- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1100cda30 msgr2=0x7fd1100cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10f7fe640 1 --2- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1100cda30 0x7fd1100cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10f7fe640 1 -- 172.21.15.53:0/626840359 >> v1:172.21.15.87:6789/0 conn(0x7fd1100caee0 legacy=0x7fd1100cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10f7fe640 1 -- 172.21.15.53:0/626840359 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100cbc40 con 0x7fd110143e80 2024-09-13T18:26:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.562+0000 7fd10ffff640 1 --2- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1100cda30 0x7fd1100cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd10f7fe640 1 --2- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd110143e80 0x7fd11006b390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd1000097c0 tx=0x7fd10001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43087b4cb7c53e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd10e7fc640 1 -- 172.21.15.53:0/626840359 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000ab600 con 0x7fd110143e80 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd10e7fc640 1 -- 172.21.15.53:0/626840359 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1000a7050 con 0x7fd110143e80 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd10e7fc640 1 -- 172.21.15.53:0/626840359 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000ab980 con 0x7fd110143e80 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 -- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd110143e80 msgr2=0x7fd11006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 --2- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd110143e80 0x7fd11006b390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd1000097c0 tx=0x7fd10001c350 comp rx=0 tx=0).stop 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 -- 172.21.15.53:0/626840359 shutdown_connections 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 --2- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1100cda30 0x7fd1100cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 --2- 172.21.15.53:0/626840359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd110143e80 0x7fd11006b390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 -- 172.21.15.53:0/626840359 >> 172.21.15.53:0/626840359 conn(0x7fd110065c80 msgr2=0x7fd110066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:36.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 -- 172.21.15.53:0/626840359 shutdown_connections 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 -- 172.21.15.53:0/626840359 wait complete. 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 Processor -- start 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.566+0000 7fd115cd0640 1 -- start start 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1100caee0 0x7fd110157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1100cda30 0x7fd110155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd110143e80 0x7fd110140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11013f910 con 0x7fd1100cda30 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11013fbf0 con 0x7fd1100caee0 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11013fed0 con 0x7fd110143e80 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1100cda30 0x7fd110155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1100cda30 0x7fd110155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58578/0 (socket says 172.21.15.53:58578) 2024-09-13T18:26:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 -- 172.21.15.53:0/3969775548 learned_addr learned my addr 172.21.15.53:0/3969775548 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10f7fe640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1100caee0 0x7fd110157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10ffff640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd110143e80 0x7fd110140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 -- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd110143e80 msgr2=0x7fd110140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd110143e80 0x7fd110140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 -- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1100caee0 msgr2=0x7fd110157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1100caee0 0x7fd110157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 -- 172.21.15.53:0/3969775548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108009b30 con 0x7fd1100cda30 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10f7fe640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1100caee0 0x7fd110157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10effd640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1100cda30 0x7fd110155fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c420 tx=0x7fd10400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd0f7fff640 1 -- 172.21.15.53:0/3969775548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040052d0 con 0x7fd1100cda30 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd0f7fff640 1 -- 172.21.15.53:0/3969775548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104005430 con 0x7fd1100cda30 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd100009420 con 0x7fd1100cda30 2024-09-13T18:26:36.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd0f7fff640 1 -- 172.21.15.53:0/3969775548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104007260 con 0x7fd1100cda30 2024-09-13T18:26:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd110140490 con 0x7fd1100cda30 2024-09-13T18:26:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1100cb350 con 0x7fd1100cda30 2024-09-13T18:26:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd0f7fff640 1 -- 172.21.15.53:0/3969775548 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd1040073c0 con 0x7fd1100cda30 2024-09-13T18:26:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd0f7fff640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0fc066840 0x7fd0fc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd0f7fff640 1 -- 172.21.15.53:0/3969775548 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd104083580 con 0x7fd1100cda30 2024-09-13T18:26:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.570+0000 7fd10f7fe640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0fc066840 0x7fd0fc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:36.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.574+0000 7fd10f7fe640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0fc066840 0x7fd0fc068d00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd1000ad000 tx=0x7fd100008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:36.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.574+0000 7fd0f7fff640 1 -- 172.21.15.53:0/3969775548 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd104050970 con 0x7fd1100cda30 2024-09-13T18:26:36.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.734+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd11015ce70 con 0x7fd1100cda30 2024-09-13T18:26:36.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.738+0000 7fd0f7fff640 1 -- 172.21.15.53:0/3969775548 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd104053f90 con 0x7fd1100cda30 2024-09-13T18:26:36.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0fc066840 msgr2=0x7fd0fc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0fc066840 0x7fd0fc068d00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd1000ad000 tx=0x7fd100008040 comp rx=0 tx=0).stop 2024-09-13T18:26:36.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1100cda30 msgr2=0x7fd110155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1100cda30 0x7fd110155fa0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c420 tx=0x7fd10400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 shutdown_connections 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0fc066840 0x7fd0fc068d00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd110143e80 0x7fd110140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1100cda30 0x7fd110155fa0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 --2- 172.21.15.53:0/3969775548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1100caee0 0x7fd110157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 >> 172.21.15.53:0/3969775548 conn(0x7fd110065c80 msgr2=0x7fd1100af480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 shutdown_connections 2024-09-13T18:26:36.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:36.742+0000 7fd115cd0640 1 -- 172.21.15.53:0/3969775548 wait complete. 2024-09-13T18:26:36.763 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:26:36.764 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:26:36.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:26:36.914 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:26:36.914 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:26:36.914 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:36.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:26:36.921 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:26:36.921 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:36.926 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:26:36.926 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:26:36.926 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:36.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:26:36.969 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:26:36.969 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:36.975 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:26:36.975 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:26:36.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:37.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.142+0000 7f152dbf7640 1 Processor -- start 2024-09-13T18:26:37.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.142+0000 7f152dbf7640 1 -- start start 2024-09-13T18:26:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.142+0000 7f152dbf7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15281582a0 0x7f152806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.142+0000 7f152dbf7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f152815b7c0 0x7f152806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.142+0000 7f152dbf7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152806d480 con 0x7f1528070c90 2024-09-13T18:26:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.142+0000 7f152dbf7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152815aaf0 con 0x7f15281582a0 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.142+0000 7f152dbf7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152806d760 con 0x7f152815b7c0 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15281582a0 0x7f152806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15281582a0 0x7f152806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58580/0 (socket says 172.21.15.53:58580) 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 -- 172.21.15.53:0/2688619185 learned_addr learned my addr 172.21.15.53:0/2688619185 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 -- 172.21.15.53:0/2688619185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f152815b7c0 msgr2=0x7f152806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 --2- 172.21.15.53:0/2688619185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f152815b7c0 0x7f152806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 -- 172.21.15.53:0/2688619185 >> v1:172.21.15.87:6789/0 conn(0x7f1528070c90 legacy=0x7f152806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 -- 172.21.15.53:0/2688619185 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152815ace0 con 0x7f15281582a0 2024-09-13T18:26:37.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15277fe640 1 --2- 172.21.15.53:0/2688619185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15281582a0 0x7f152806c900 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1518009870 tx=0x7f151801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76ece9399bfea12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15267fc640 1 -- 172.21.15.53:0/2688619185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180ac410 con 0x7f15281582a0 2024-09-13T18:26:37.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15267fc640 1 -- 172.21.15.53:0/2688619185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15180ac570 con 0x7f15281582a0 2024-09-13T18:26:37.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f15267fc640 1 -- 172.21.15.53:0/2688619185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180ac900 con 0x7f15281582a0 2024-09-13T18:26:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 -- 172.21.15.53:0/2688619185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15281582a0 msgr2=0x7f152806c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 --2- 172.21.15.53:0/2688619185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15281582a0 0x7f152806c900 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1518009870 tx=0x7f151801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 -- 172.21.15.53:0/2688619185 shutdown_connections 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 --2- 172.21.15.53:0/2688619185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f152815b7c0 0x7f152806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 --2- 172.21.15.53:0/2688619185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15281582a0 0x7f152806c900 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 -- 172.21.15.53:0/2688619185 >> 172.21.15.53:0/2688619185 conn(0x7f1528065c80 msgr2=0x7f1528066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 -- 172.21.15.53:0/2688619185 shutdown_connections 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.146+0000 7f152dbf7640 1 -- 172.21.15.53:0/2688619185 wait complete. 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 Processor -- start 2024-09-13T18:26:37.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 -- start start 2024-09-13T18:26:37.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1528070c90 0x7f15280cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15281582a0 0x7f152814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152815b7c0 0x7f152814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152814c870 con 0x7f152815b7c0 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152814efa0 con 0x7f15281582a0 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152814ebe0 con 0x7f1528070c90 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152815b7c0 0x7f152814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152815b7c0 0x7f152814bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58596/0 (socket says 172.21.15.53:58596) 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 -- 172.21.15.53:0/590250227 learned_addr learned my addr 172.21.15.53:0/590250227 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1526ffd640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15281582a0 0x7f152814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f15277fe640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1528070c90 0x7f15280cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 -- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1528070c90 msgr2=0x7f15280cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1528070c90 0x7f15280cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 -- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15281582a0 msgr2=0x7f152814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15281582a0 0x7f152814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 -- 172.21.15.53:0/590250227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180094d0 con 0x7f152815b7c0 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f1527fff640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152815b7c0 0x7f152814bf60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f152000c780 tx=0x7f152000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f150ffff640 1 -- 172.21.15.53:0/590250227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520003d90 con 0x7f152815b7c0 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f150ffff640 1 -- 172.21.15.53:0/590250227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152000ce90 con 0x7f152815b7c0 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152814c590 con 0x7f152815b7c0 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f150ffff640 1 -- 172.21.15.53:0/590250227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200052b0 con 0x7f152815b7c0 2024-09-13T18:26:37.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152814f770 con 0x7f152815b7c0 2024-09-13T18:26:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528067400 con 0x7f152815b7c0 2024-09-13T18:26:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.150+0000 7f150ffff640 1 -- 172.21.15.53:0/590250227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1520005410 con 0x7f152815b7c0 2024-09-13T18:26:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.154+0000 7f150ffff640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1514066840 0x7f1514068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.154+0000 7f150ffff640 1 -- 172.21.15.53:0/590250227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1520083a50 con 0x7f152815b7c0 2024-09-13T18:26:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.154+0000 7f15277fe640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1514066840 0x7f1514068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.154+0000 7f15277fe640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1514066840 0x7f1514068d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f15180ae000 tx=0x7f1518008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.158+0000 7f150ffff640 1 -- 172.21.15.53:0/590250227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1520050e40 con 0x7f152815b7c0 2024-09-13T18:26:37.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.354+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f152814f2d0 con 0x7f152815b7c0 2024-09-13T18:26:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.354+0000 7f150ffff640 1 -- 172.21.15.53:0/590250227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f1520017070 con 0x7f152815b7c0 2024-09-13T18:26:37.358 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:37.358 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3877303910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3877303910},{"type":"v1","addr":"172.21.15.87:6836","nonce":3877303910}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5095,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1431925450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":1431925450},{"type":"v1","addr":"172.21.15.87:6837","nonce":1431925450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2751759497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2751759497},{"type":"v1","addr":"172.21.15.53:6834","nonce":2751759497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2798875427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":2798875427},{"type":"v1","addr":"172.21.15.53:6835","nonce":2798875427}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2024-09-13T18:26:37.358 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 16 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1514066840 msgr2=0x7f1514068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1514066840 0x7f1514068d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f15180ae000 tx=0x7f1518008040 comp rx=0 tx=0).stop 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152815b7c0 msgr2=0x7f152814bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152815b7c0 0x7f152814bf60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f152000c780 tx=0x7f152000cc40 comp rx=0 tx=0).stop 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 shutdown_connections 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1514066840 0x7f1514068d00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152815b7c0 0x7f152814bf60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15281582a0 0x7f152814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 --2- 172.21.15.53:0/590250227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1528070c90 0x7f15280cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 >> 172.21.15.53:0/590250227 conn(0x7f1528065c80 msgr2=0x7f15280af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 shutdown_connections 2024-09-13T18:26:37.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.358+0000 7f152dbf7640 1 -- 172.21.15.53:0/590250227 wait complete. 2024-09-13T18:26:37.378 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:26:37.378 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:26:37.378 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:26:37.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:26:37.379 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:26:37.379 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:26:37.379 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:26:37.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:26:37.379 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:26:37.379 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:26:37.380 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:26:37.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:26:37.380 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:26:37.380 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:26:37.380 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:26:37.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:26:37.393 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:26:37.394 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:26:37.395 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:26:37.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:26:37.396 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:26:37.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:26:37.400 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:26:37.401 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:26:37.437 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:26:37.437 DEBUG:teuthology.parallel:result is None 2024-09-13T18:26:37.438 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:26:37.438 DEBUG:teuthology.parallel:result is None 2024-09-13T18:26:37.445 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:26:37.445 DEBUG:teuthology.parallel:result is None 2024-09-13T18:26:37.446 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:26:37.447 DEBUG:teuthology.parallel:result is None 2024-09-13T18:26:37.447 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:26:37.509 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:26:37.509 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:26:37.516 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:26:37.519 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:26:37.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1263d4d640 1 Processor -- start 2024-09-13T18:26:37.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1263d4d640 1 -- start start 2024-09-13T18:26:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1263d4d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f125c0b1af0 0x7f125c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1263d4d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f125c069f50 0x7f125c06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1263d4d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c0cfe80 con 0x7f125c0cd630 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1263d4d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c0d0120 con 0x7f125c0b1af0 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1263d4d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c0b1400 con 0x7f125c069f50 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f12612e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f125c0b1af0 0x7f125c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1261ae9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f125c0cd630 0x7f125c0b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47780/0 (socket says 172.21.15.53:47780) 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1261ae9640 1 -- 172.21.15.53:0/1651537614 learned_addr learned my addr 172.21.15.53:0/1651537614 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f12622ea640 1 --2- 172.21.15.53:0/1651537614 >> v2:172.21.15.87:3300/0 conn(0x7f125c069f50 0x7f125c06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f12612e8640 1 -- 172.21.15.53:0/1651537614 >> v2:172.21.15.87:3300/0 conn(0x7f125c069f50 msgr2=0x7f125c06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f12612e8640 1 --2- 172.21.15.53:0/1651537614 >> v2:172.21.15.87:3300/0 conn(0x7f125c069f50 0x7f125c06a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f12612e8640 1 -- 172.21.15.53:0/1651537614 >> v1:172.21.15.53:6789/0 conn(0x7f125c0cd630 legacy=0x7f125c0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1260ae7640 1 -- 172.21.15.53:0/1651537614 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588165292 0 0) 0x7f125c0cfe80 con 0x7f125c0cd630 2024-09-13T18:26:37.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f12612e8640 1 -- 172.21.15.53:0/1651537614 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c06ac20 con 0x7f125c0b1af0 2024-09-13T18:26:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f12612e8640 1 --2- 172.21.15.53:0/1651537614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c0b1af0 0x7f125c0cf580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f125c0c7540 tx=0x7f124c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ffedc800aac626 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1260ae7640 1 -- 172.21.15.53:0/1651537614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c0ab600 con 0x7f125c0b1af0 2024-09-13T18:26:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.566+0000 7f1260ae7640 1 -- 172.21.15.53:0/1651537614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c0a7050 con 0x7f125c0b1af0 2024-09-13T18:26:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1260ae7640 1 -- 172.21.15.53:0/1651537614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c0ab980 con 0x7f125c0b1af0 2024-09-13T18:26:37.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- 172.21.15.53:0/1651537614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c0b1af0 msgr2=0x7f125c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 --2- 172.21.15.53:0/1651537614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c0b1af0 0x7f125c0cf580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f125c0c7540 tx=0x7f124c01c360 comp rx=0 tx=0).stop 2024-09-13T18:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- 172.21.15.53:0/1651537614 shutdown_connections 2024-09-13T18:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 --2- 172.21.15.53:0/1651537614 >> v2:172.21.15.87:3300/0 conn(0x7f125c069f50 0x7f125c06a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 --2- 172.21.15.53:0/1651537614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c0b1af0 0x7f125c0cf580 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- 172.21.15.53:0/1651537614 >> 172.21.15.53:0/1651537614 conn(0x7f125c0b20d0 msgr2=0x7f125c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- 172.21.15.53:0/1651537614 shutdown_connections 2024-09-13T18:26:37.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- 172.21.15.53:0/1651537614 wait complete. 2024-09-13T18:26:37.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 Processor -- start 2024-09-13T18:26:37.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- start start 2024-09-13T18:26:37.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c069f50 0x7f125c15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c0b1af0 0x7f125c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0cd630 0x7f125c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c15ed10 con 0x7f125c069f50 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c15eff0 con 0x7f125c0b1af0 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c15f2d0 con 0x7f125c0cd630 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c069f50 0x7f125c15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c069f50 0x7f125c15e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58640/0 (socket says 172.21.15.53:58640) 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 -- 172.21.15.53:0/2931770254 learned_addr learned my addr 172.21.15.53:0/2931770254 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 -- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0cd630 msgr2=0x7f125c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0cd630 0x7f125c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f12612e8640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c0b1af0 0x7f125c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 -- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c0b1af0 msgr2=0x7f125c153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c0b1af0 0x7f125c153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 -- 172.21.15.53:0/2931770254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c009420 con 0x7f125c069f50 2024-09-13T18:26:37.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1261ae9640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c069f50 0x7f125c15e2e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f125800c400 tx=0x7f125800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f12527fc640 1 -- 172.21.15.53:0/2931770254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12580074e0 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f12527fc640 1 -- 172.21.15.53:0/2931770254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1258007660 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c15f5b0 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f12527fc640 1 -- 172.21.15.53:0/2931770254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258004a30 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.570+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c0cc730 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.574+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c06a6d0 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.574+0000 7f12527fc640 1 -- 172.21.15.53:0/2931770254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1258004b90 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.574+0000 7f12527fc640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066840 0x7f1240068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.574+0000 7f12527fc640 1 -- 172.21.15.53:0/2931770254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1258083ff0 con 0x7f125c069f50 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.574+0000 7f12612e8640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066840 0x7f1240068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:37.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.574+0000 7f12612e8640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066840 0x7f1240068d00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f124c0ad000 tx=0x7f124c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:37.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.578+0000 7f12527fc640 1 -- 172.21.15.53:0/2931770254 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1258051350 con 0x7f125c069f50 2024-09-13T18:26:37.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:37.746+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f125c0742f0 con 0x7f125c069f50 2024-09-13T18:26:38.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.746+0000 7f12527fc640 1 -- 172.21.15.53:0/2931770254 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1258054970 con 0x7f125c069f50 2024-09-13T18:26:38.751 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:26:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066840 msgr2=0x7f1240068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066840 0x7f1240068d00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f124c0ad000 tx=0x7f124c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c069f50 msgr2=0x7f125c15e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c069f50 0x7f125c15e2e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f125800c400 tx=0x7f125800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 shutdown_connections 2024-09-13T18:26:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1240066840 0x7f1240068d00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f125c0cd630 0x7f125c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f125c0b1af0 0x7f125c153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 --2- 172.21.15.53:0/2931770254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f125c069f50 0x7f125c15e2e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 >> 172.21.15.53:0/2931770254 conn(0x7f125c0b20d0 msgr2=0x7f125c0cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 shutdown_connections 2024-09-13T18:26:38.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.750+0000 7f1263d4d640 1 -- 172.21.15.53:0/2931770254 wait complete. 2024-09-13T18:26:38.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:26:38.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.894+0000 7f36702a5640 1 Processor -- start 2024-09-13T18:26:38.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.894+0000 7f36702a5640 1 -- start start 2024-09-13T18:26:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f36702a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f366806b850 0x7f36680b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f36702a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36680b1ac0 con 0x7f36680cb980 2024-09-13T18:26:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f36702a5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3668159ac0 con 0x7f36680cbd60 2024-09-13T18:26:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f36702a5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3668159da0 con 0x7f366806b850 2024-09-13T18:26:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d840640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f366806b850 0x7f36680b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d840640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f366806b850 0x7f36680b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58650/0 (socket says 172.21.15.53:58650) 2024-09-13T18:26:38.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d840640 1 -- 172.21.15.53:0/559820727 learned_addr learned my addr 172.21.15.53:0/559820727 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366e041640 1 --1- 172.21.15.53:0/559820727 >> v1:172.21.15.53:6789/0 conn(0x7f36680cb980 0x7f366806fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47788/0 (socket says 172.21.15.53:47788) 2024-09-13T18:26:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d840640 1 -- 172.21.15.53:0/559820727 >> v1:172.21.15.87:6789/0 conn(0x7f36680cbd60 legacy=0x7f36680b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d840640 1 -- 172.21.15.53:0/559820727 >> v1:172.21.15.53:6789/0 conn(0x7f36680cb980 legacy=0x7f366806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d840640 1 -- 172.21.15.53:0/559820727 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366815a080 con 0x7f366806b850 2024-09-13T18:26:38.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d840640 1 --2- 172.21.15.53:0/559820727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366806b850 0x7f36680b33b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f365800bb10 tx=0x7f365801eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddcb5d312da371c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d03f640 1 -- 172.21.15.53:0/559820727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580a7bb0 con 0x7f366806b850 2024-09-13T18:26:38.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d03f640 1 -- 172.21.15.53:0/559820727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580a7d10 con 0x7f366806b850 2024-09-13T18:26:38.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.898+0000 7f366d03f640 1 -- 172.21.15.53:0/559820727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580af660 con 0x7f366806b850 2024-09-13T18:26:38.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- 172.21.15.53:0/559820727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366806b850 msgr2=0x7f36680b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 --2- 172.21.15.53:0/559820727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366806b850 0x7f36680b33b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f365800bb10 tx=0x7f365801eae0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- 172.21.15.53:0/559820727 shutdown_connections 2024-09-13T18:26:38.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 --2- 172.21.15.53:0/559820727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366806b850 0x7f36680b33b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- 172.21.15.53:0/559820727 >> 172.21.15.53:0/559820727 conn(0x7f3668065c80 msgr2=0x7f3668066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- 172.21.15.53:0/559820727 shutdown_connections 2024-09-13T18:26:38.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- 172.21.15.53:0/559820727 wait complete. 2024-09-13T18:26:38.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 Processor -- start 2024-09-13T18:26:38.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- start start 2024-09-13T18:26:38.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366806b850 0x7f366814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36680cb980 0x7f366806f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36680cbd60 0x7f366806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366814ec20 con 0x7f36680cbd60 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3668131800 con 0x7f366806b850 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f36702a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3668131ae0 con 0x7f36680cb980 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36680cbd60 0x7f366806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36680cbd60 0x7f366806fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58652/0 (socket says 172.21.15.53:58652) 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 -- 172.21.15.53:0/1137042719 learned_addr learned my addr 172.21.15.53:0/1137042719 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e041640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366806b850 0x7f366814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366d840640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36680cb980 0x7f366806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 -- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36680cb980 msgr2=0x7f366806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36680cb980 0x7f366806f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 -- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366806b850 msgr2=0x7f366814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366806b850 0x7f366814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e842640 1 -- 172.21.15.53:0/1137042719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365800b770 con 0x7f36680cbd60 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.902+0000 7f366e041640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366806b850 0x7f366814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f366e842640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36680cbd60 0x7f366806fb40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f366000c770 tx=0x7f366000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f365effd640 1 -- 172.21.15.53:0/1137042719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660003b80 con 0x7f36680cbd60 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f365effd640 1 -- 172.21.15.53:0/1137042719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660003ce0 con 0x7f36680cbd60 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3668131dc0 con 0x7f36680cbd60 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f365effd640 1 -- 172.21.15.53:0/1137042719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366000aa90 con 0x7f36680cbd60 2024-09-13T18:26:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3668132380 con 0x7f36680cbd60 2024-09-13T18:26:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3668067400 con 0x7f36680cbd60 2024-09-13T18:26:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f365effd640 1 -- 172.21.15.53:0/1137042719 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f366000abf0 con 0x7f36680cbd60 2024-09-13T18:26:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f365effd640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f364c066840 0x7f364c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f365effd640 1 -- 172.21.15.53:0/1137042719 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3660083fd0 con 0x7f36680cbd60 2024-09-13T18:26:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f366e041640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f364c066840 0x7f364c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.906+0000 7f366e041640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f364c066840 0x7f364c068d00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3664000f70 tx=0x7f3664007cd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:38.910+0000 7f365effd640 1 -- 172.21.15.53:0/1137042719 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3660051410 con 0x7f36680cbd60 2024-09-13T18:26:39.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.126+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f36680ce0d0 con 0x7f36680cbd60 2024-09-13T18:26:39.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.126+0000 7f365effd640 1 -- 172.21.15.53:0/1137042719 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3660054a30 con 0x7f36680cbd60 2024-09-13T18:26:39.130 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:39.130 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:26:39.130 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:26:39.130 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:26:39.131 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:26:39.132 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.133 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.134 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.135 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.136 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.137 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:26:39.139 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:26:39.140 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:26:39.142 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:39.144 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:26:39.144 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f364c066840 msgr2=0x7f364c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f364c066840 0x7f364c068d00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3664000f70 tx=0x7f3664007cd0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36680cbd60 msgr2=0x7f366806fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36680cbd60 0x7f366806fb40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f366000c770 tx=0x7f366000cc30 comp rx=0 tx=0).stop 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 shutdown_connections 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f364c066840 0x7f364c068d00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36680cb980 0x7f366806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36680cbd60 0x7f366806fb40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 --2- 172.21.15.53:0/1137042719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366806b850 0x7f366814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 >> 172.21.15.53:0/1137042719 conn(0x7f3668065c80 msgr2=0x7f36680ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 shutdown_connections 2024-09-13T18:26:39.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.130+0000 7f36702a5640 1 -- 172.21.15.53:0/1137042719 wait complete. 2024-09-13T18:26:39.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:39.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.270+0000 7f4a7facd640 1 Processor -- start 2024-09-13T18:26:39.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.270+0000 7f4a7facd640 1 -- start start 2024-09-13T18:26:39.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7facd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a7815b7c0 0x7f4a78070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7facd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a780711d0 0x7f4a781640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7facd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7806d480 con 0x7f4a781582a0 2024-09-13T18:26:39.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7facd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7815aaf0 con 0x7f4a7815b7c0 2024-09-13T18:26:39.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7facd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7806d760 con 0x7f4a780711d0 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7e06a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a780711d0 0x7f4a781640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7d068640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a7815b7c0 0x7f4a78070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7d869640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4a781582a0 0x7f4a7806c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:38214/0 (socket says 172.21.15.53:38214) 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7e06a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a780711d0 0x7f4a781640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:51630/0 (socket says 172.21.15.53:51630) 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7d869640 1 -- 172.21.15.53:0/2105210894 learned_addr learned my addr 172.21.15.53:0/2105210894 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7d068640 1 -- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a780711d0 msgr2=0x7f4a781640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7d068640 1 --2- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a780711d0 0x7f4a781640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7d068640 1 -- 172.21.15.53:0/2105210894 >> v1:172.21.15.87:6789/0 conn(0x7f4a781582a0 legacy=0x7f4a7806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7d068640 1 -- 172.21.15.53:0/2105210894 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7815ace0 con 0x7f4a7815b7c0 2024-09-13T18:26:39.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.274+0000 7f4a7e06a640 1 --2- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a780711d0 0x7f4a781640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7d068640 1 --2- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a7815b7c0 0x7f4a78070c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097c0 tx=0x7f4a6c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5968c59a75689078 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7c867640 1 -- 172.21.15.53:0/2105210894 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0ad640 con 0x7f4a7815b7c0 2024-09-13T18:26:39.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7c867640 1 -- 172.21.15.53:0/2105210894 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0ad7a0 con 0x7f4a7815b7c0 2024-09-13T18:26:39.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7c867640 1 -- 172.21.15.53:0/2105210894 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0adb30 con 0x7f4a7815b7c0 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 -- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a7815b7c0 msgr2=0x7f4a78070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 --2- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a7815b7c0 0x7f4a78070c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097c0 tx=0x7f4a6c01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 -- 172.21.15.53:0/2105210894 shutdown_connections 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 --2- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a780711d0 0x7f4a781640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 --2- 172.21.15.53:0/2105210894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a7815b7c0 0x7f4a78070c90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 -- 172.21.15.53:0/2105210894 >> 172.21.15.53:0/2105210894 conn(0x7f4a78065c80 msgr2=0x7f4a78066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 -- 172.21.15.53:0/2105210894 shutdown_connections 2024-09-13T18:26:39.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 -- 172.21.15.53:0/2105210894 wait complete. 2024-09-13T18:26:39.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 Processor -- start 2024-09-13T18:26:39.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.278+0000 7f4a7facd640 1 -- start start 2024-09-13T18:26:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a780711d0 0x7f4a7814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a781582a0 0x7f4a78150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7815b7c0 0x7f4a781f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78156270 con 0x7f4a7815b7c0 2024-09-13T18:26:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78153fc0 con 0x7f4a780711d0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781542a0 con 0x7f4a781582a0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7815b7c0 0x7f4a781f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7815b7c0 0x7f4a781f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58654/0 (socket says 172.21.15.53:58654) 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 -- 172.21.15.53:0/3398495902 learned_addr learned my addr 172.21.15.53:0/3398495902 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7d068640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a781582a0 0x7f4a78150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7d869640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a780711d0 0x7f4a7814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 -- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a781582a0 msgr2=0x7f4a78150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a781582a0 0x7f4a78150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 -- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a780711d0 msgr2=0x7f4a7814f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a780711d0 0x7f4a7814f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 -- 172.21.15.53:0/3398495902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68009a70 con 0x7f4a7815b7c0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7e06a640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7815b7c0 0x7f4a781f5180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800efc0 tx=0x7f4a68009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a767fc640 1 -- 172.21.15.53:0/3398495902 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68009d70 con 0x7f4a7815b7c0 2024-09-13T18:26:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a767fc640 1 -- 172.21.15.53:0/3398495902 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6800f040 con 0x7f4a7815b7c0 2024-09-13T18:26:39.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c009420 con 0x7f4a7815b7c0 2024-09-13T18:26:39.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a767fc640 1 -- 172.21.15.53:0/3398495902 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680039a0 con 0x7f4a7815b7c0 2024-09-13T18:26:39.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a78154860 con 0x7f4a7815b7c0 2024-09-13T18:26:39.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a78067400 con 0x7f4a7815b7c0 2024-09-13T18:26:39.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a767fc640 1 -- 172.21.15.53:0/3398495902 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f4a680144a0 con 0x7f4a7815b7c0 2024-09-13T18:26:39.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a767fc640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4a64066840 0x7f4a64068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a767fc640 1 -- 172.21.15.53:0/3398495902 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a68084e90 con 0x7f4a7815b7c0 2024-09-13T18:26:39.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.282+0000 7f4a7d869640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4a64066840 0x7f4a64068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.286+0000 7f4a7d869640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4a64066840 0x7f4a64068d00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4a70005890 tx=0x7f4a70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.286+0000 7f4a767fc640 1 -- 172.21.15.53:0/3398495902 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a68052250 con 0x7f4a7815b7c0 2024-09-13T18:26:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.450+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a780ad6b0 con 0x7f4a7815b7c0 2024-09-13T18:26:39.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.450+0000 7f4a767fc640 1 -- 172.21.15.53:0/3398495902 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f4a68055870 con 0x7f4a7815b7c0 2024-09-13T18:26:39.456 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:39.456 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":42,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:38.743150+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:39.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4a64066840 msgr2=0x7f4a64068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4a64066840 0x7f4a64068d00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4a70005890 tx=0x7f4a70009040 comp rx=0 tx=0).stop 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7815b7c0 msgr2=0x7f4a781f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7815b7c0 0x7f4a781f5180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800efc0 tx=0x7f4a68009f90 comp rx=0 tx=0).stop 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 shutdown_connections 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4a64066840 0x7f4a64068d00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a781582a0 0x7f4a78150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7815b7c0 0x7f4a781f5180 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 --2- 172.21.15.53:0/3398495902 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a780711d0 0x7f4a7814f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 >> 172.21.15.53:0/3398495902 conn(0x7f4a78065c80 msgr2=0x7f4a780cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 shutdown_connections 2024-09-13T18:26:39.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.454+0000 7f4a7facd640 1 -- 172.21.15.53:0/3398495902 wait complete. 2024-09-13T18:26:39.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:39.476 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:26:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.594+0000 7fb84ee20640 1 Processor -- start 2024-09-13T18:26:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb84ee20640 1 -- start start 2024-09-13T18:26:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb84ee20640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8480caee0 0x7fb8480cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb84ee20640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84806f7a0 con 0x7fb848143e80 2024-09-13T18:26:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb84ee20640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84806fd60 con 0x7fb8480cd320 2024-09-13T18:26:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb84ee20640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84806baa0 con 0x7fb8480caee0 2024-09-13T18:26:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb847fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8480caee0 0x7fb8480cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb84cbbc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb848143e80 0x7fb84806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47798/0 (socket says 172.21.15.53:47798) 2024-09-13T18:26:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb84cbbc640 1 -- 172.21.15.53:0/991070944 learned_addr learned my addr 172.21.15.53:0/991070944 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:39.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb847fff640 1 -- 172.21.15.53:0/991070944 >> v1:172.21.15.87:6789/0 conn(0x7fb8480cd320 legacy=0x7fb8480cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb847fff640 1 -- 172.21.15.53:0/991070944 >> v1:172.21.15.53:6789/0 conn(0x7fb848143e80 legacy=0x7fb84806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb847fff640 1 -- 172.21.15.53:0/991070944 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480cb960 con 0x7fb8480caee0 2024-09-13T18:26:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb847fff640 1 --2- 172.21.15.53:0/991070944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480caee0 0x7fb8480cb350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb8380097f0 tx=0x7fb83801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37826c974945a688 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.598+0000 7fb8477fe640 1 -- 172.21.15.53:0/991070944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380ac600 con 0x7fb8480caee0 2024-09-13T18:26:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb8477fe640 1 -- 172.21.15.53:0/991070944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380a8050 con 0x7fb8480caee0 2024-09-13T18:26:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb8477fe640 1 -- 172.21.15.53:0/991070944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380ac980 con 0x7fb8480caee0 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- 172.21.15.53:0/991070944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480caee0 msgr2=0x7fb8480cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 --2- 172.21.15.53:0/991070944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480caee0 0x7fb8480cb350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb8380097f0 tx=0x7fb83801c3a0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- 172.21.15.53:0/991070944 shutdown_connections 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 --2- 172.21.15.53:0/991070944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480caee0 0x7fb8480cb350 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- 172.21.15.53:0/991070944 >> 172.21.15.53:0/991070944 conn(0x7fb848065c80 msgr2=0x7fb848066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- 172.21.15.53:0/991070944 shutdown_connections 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- 172.21.15.53:0/991070944 wait complete. 2024-09-13T18:26:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 Processor -- start 2024-09-13T18:26:39.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- start start 2024-09-13T18:26:39.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8480caee0 0x7fb8480a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480cd320 0x7fb848159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb848143e80 0x7fb84813f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84815b080 con 0x7fb8480cd320 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84813fca0 con 0x7fb8480caee0 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84815a470 con 0x7fb848143e80 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480cd320 0x7fb848159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480cd320 0x7fb848159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58668/0 (socket says 172.21.15.53:58668) 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 -- 172.21.15.53:0/3061503803 learned_addr learned my addr 172.21.15.53:0/3061503803 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84cbbc640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8480caee0 0x7fb8480a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84d3bd640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb848143e80 0x7fb84813f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 -- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb848143e80 msgr2=0x7fb84813f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb848143e80 0x7fb84813f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 -- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8480caee0 msgr2=0x7fb8480a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8480caee0 0x7fb8480a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 -- 172.21.15.53:0/3061503803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009420 con 0x7fb8480cd320 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84cbbc640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8480caee0 0x7fb8480a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84d3bd640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb848143e80 0x7fb84813f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb847fff640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480cd320 0x7fb848159d90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb838009740 tx=0x7fb83801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb8457fa640 1 -- 172.21.15.53:0/3061503803 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b7650 con 0x7fb8480cd320 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb8457fa640 1 -- 172.21.15.53:0/3061503803 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380ace90 con 0x7fb8480cd320 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84815a750 con 0x7fb8480cd320 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84815ad10 con 0x7fb8480cd320 2024-09-13T18:26:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.602+0000 7fb8457fa640 1 -- 172.21.15.53:0/3061503803 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380b7a10 con 0x7fb8480cd320 2024-09-13T18:26:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.606+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb828005260 con 0x7fb8480cd320 2024-09-13T18:26:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.606+0000 7fb8457fa640 1 -- 172.21.15.53:0/3061503803 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fb8380b3070 con 0x7fb8480cd320 2024-09-13T18:26:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.606+0000 7fb8457fa640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb834066840 0x7fb834068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.606+0000 7fb8457fa640 1 -- 172.21.15.53:0/3061503803 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb83811e620 con 0x7fb8480cd320 2024-09-13T18:26:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.606+0000 7fb84cbbc640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb834066840 0x7fb834068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.606+0000 7fb84cbbc640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb834066840 0x7fb834068d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005890 tx=0x7fb83c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.610+0000 7fb8457fa640 1 -- 172.21.15.53:0/3061503803 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8380eb8b0 con 0x7fb8480cd320 2024-09-13T18:26:39.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.770+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb828005a90 con 0x7fb8480cd320 2024-09-13T18:26:39.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.770+0000 7fb8457fa640 1 -- 172.21.15.53:0/3061503803 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8380bb0a0 con 0x7fb8480cd320 2024-09-13T18:26:39.776 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:26:39.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb834066840 msgr2=0x7fb834068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb834066840 0x7fb834068d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005890 tx=0x7fb83c009040 comp rx=0 tx=0).stop 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480cd320 msgr2=0x7fb848159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480cd320 0x7fb848159d90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb838009740 tx=0x7fb83801abe0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 shutdown_connections 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb834066840 0x7fb834068d00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb848143e80 0x7fb84813f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8480cd320 0x7fb848159d90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 --2- 172.21.15.53:0/3061503803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8480caee0 0x7fb8480a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 >> 172.21.15.53:0/3061503803 conn(0x7fb848065c80 msgr2=0x7fb84815bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 shutdown_connections 2024-09-13T18:26:39.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.774+0000 7fb84ee20640 1 -- 172.21.15.53:0/3061503803 wait complete. 2024-09-13T18:26:39.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.902+0000 7fe516975640 1 Processor -- start 2024-09-13T18:26:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.902+0000 7fe516975640 1 -- start start 2024-09-13T18:26:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe516975640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe5101582a0 0x7fe51006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe516975640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51006d480 con 0x7fe51015b7c0 2024-09-13T18:26:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe516975640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51015ace0 con 0x7fe5100713a0 2024-09-13T18:26:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe516975640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51015aaf0 con 0x7fe5101582a0 2024-09-13T18:26:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe51015b7c0 0x7fe510070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47810/0 (socket says 172.21.15.53:47810) 2024-09-13T18:26:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50f7fe640 1 -- 172.21.15.53:0/1492074292 learned_addr learned my addr 172.21.15.53:0/1492074292 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50ffff640 1 --2- 172.21.15.53:0/1492074292 >> v2:172.21.15.87:3300/0 conn(0x7fe5101582a0 0x7fe51006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639614713 0 0) 0x7fe51006d480 con 0x7fe51015b7c0 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4fc003530 con 0x7fe51015b7c0 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571773225 0 0) 0x7fe4fc003530 con 0x7fe51015b7c0 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 >> v2:172.21.15.87:3300/0 conn(0x7fe5101582a0 msgr2=0x7fe51006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 --2- 172.21.15.53:0/1492074292 >> v2:172.21.15.87:3300/0 conn(0x7fe5101582a0 0x7fe51006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 >> v1:172.21.15.87:6789/0 conn(0x7fe5100713a0 legacy=0x7fe5101640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51015afc0 con 0x7fe51015b7c0 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe4f8001680 con 0x7fe51015b7c0 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 >> v1:172.21.15.53:6789/0 conn(0x7fe51015b7c0 legacy=0x7fe510070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4fc003980 0x7fe4fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc0047d0 0x7fe4fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4fc005190 0x7fe4fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc00c000 con 0x7fe4fc005190 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc00c170 con 0x7fe4fc0047d0 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc00c330 con 0x7fe4fc003980 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4fc005190 0x7fe4fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50f7fe640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc0047d0 0x7fe4fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 -- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4fc003980 msgr2=0x7fe4fc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50ffff640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4fc003980 0x7fe4fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4fc003980 0x7fe4fc003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 -- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc0047d0 msgr2=0x7fe4fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc0047d0 0x7fe4fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 -- 172.21.15.53:0/1492074292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc003530 con 0x7fe4fc005190 2024-09-13T18:26:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50f7fe640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc0047d0 0x7fe4fc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 -- 172.21.15.53:0/1492074292 reap_dead start 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe514f12640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4fc005190 0x7fe4fc00b990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe508001e40 tx=0x7fe50801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b8489a226d23e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508003b80 con 0x7fe4fc005190 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe508003ce0 con 0x7fe4fc005190 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.906+0000 7fe50effd640 1 -- 172.21.15.53:0/1492074292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508005260 con 0x7fe4fc005190 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- 172.21.15.53:0/1492074292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4fc005190 msgr2=0x7fe4fc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4fc005190 0x7fe4fc00b990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe508001e40 tx=0x7fe50801c760 comp rx=0 tx=0).stop 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- 172.21.15.53:0/1492074292 shutdown_connections 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 --2- 172.21.15.53:0/1492074292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4fc005190 0x7fe4fc00b990 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- 172.21.15.53:0/1492074292 >> 172.21.15.53:0/1492074292 conn(0x7fe510065c80 msgr2=0x7fe510066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- 172.21.15.53:0/1492074292 shutdown_connections 2024-09-13T18:26:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- 172.21.15.53:0/1492074292 wait complete. 2024-09-13T18:26:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 Processor -- start 2024-09-13T18:26:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- start start 2024-09-13T18:26:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc005190 0x7fe510155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5100a84d0 0x7fe5100ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe51014ff30 0x7fe5100ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100ab9a0 con 0x7fe5100a84d0 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101559b0 con 0x7fe4fc005190 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100abbd0 con 0x7fe51014ff30 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5100a84d0 0x7fe5100ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5100a84d0 0x7fe5100ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58696/0 (socket says 172.21.15.53:58696) 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 -- 172.21.15.53:0/722739661 learned_addr learned my addr 172.21.15.53:0/722739661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe514f12640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe51014ff30 0x7fe5100ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50ffff640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc005190 0x7fe510155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 -- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe51014ff30 msgr2=0x7fe5100ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe51014ff30 0x7fe5100ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 -- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc005190 msgr2=0x7fe510155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc005190 0x7fe510155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 -- 172.21.15.53:0/722739661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100abeb0 con 0x7fe5100a84d0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50f7fe640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5100a84d0 0x7fe5100ae1a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8007fd0 tx=0x7fe4f800dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50cff9640 1 -- 172.21.15.53:0/722739661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80074e0 con 0x7fe5100a84d0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50cff9640 1 -- 172.21.15.53:0/722739661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8007640 con 0x7fe5100a84d0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5100ac190 con 0x7fe5100a84d0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe50cff9640 1 -- 172.21.15.53:0/722739661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8004a10 con 0x7fe5100a84d0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.910+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe510155580 con 0x7fe5100a84d0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.914+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe510067400 con 0x7fe5100a84d0 2024-09-13T18:26:39.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.914+0000 7fe50cff9640 1 -- 172.21.15.53:0/722739661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe4f8004b70 con 0x7fe5100a84d0 2024-09-13T18:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.914+0000 7fe50cff9640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4f0066840 0x7fe4f0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.914+0000 7fe50cff9640 1 -- 172.21.15.53:0/722739661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe4f8083ff0 con 0x7fe5100a84d0 2024-09-13T18:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.914+0000 7fe50ffff640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4f0066840 0x7fe4f0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:39.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.914+0000 7fe50ffff640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4f0066840 0x7fe4f0068d00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe500009a30 tx=0x7fe500008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:39.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:39.918+0000 7fe50cff9640 1 -- 172.21.15.53:0/722739661 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4f8051280 con 0x7fe5100a84d0 2024-09-13T18:26:40.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5100cde10 con 0x7fe5100a84d0 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe50cff9640 1 -- 172.21.15.53:0/722739661 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe4f8019090 con 0x7fe5100a84d0 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:40.081 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:26:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4f0066840 msgr2=0x7fe4f0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4f0066840 0x7fe4f0068d00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe500009a30 tx=0x7fe500008040 comp rx=0 tx=0).stop 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5100a84d0 msgr2=0x7fe5100ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5100a84d0 0x7fe5100ae1a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8007fd0 tx=0x7fe4f800dc70 comp rx=0 tx=0).stop 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 shutdown_connections 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe4f0066840 0x7fe4f0068d00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe51014ff30 0x7fe5100ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5100a84d0 0x7fe5100ae1a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 --2- 172.21.15.53:0/722739661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4fc005190 0x7fe510155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 >> 172.21.15.53:0/722739661 conn(0x7fe510065c80 msgr2=0x7fe5100cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 shutdown_connections 2024-09-13T18:26:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.078+0000 7fe516975640 1 -- 172.21.15.53:0/722739661 wait complete. 2024-09-13T18:26:40.099 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:26:40.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:26:40.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241aed2640 1 Processor -- start 2024-09-13T18:26:40.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241aed2640 1 -- start start 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241aed2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f24140d1c20 0x7f24140d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241aed2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24140d2590 con 0x7f241415c850 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241aed2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24140cd6e0 con 0x7f24140b1dc0 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241aed2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24140d0340 con 0x7f24140d1c20 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f2418c6e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f241415c850 0x7f24140ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47816/0 (socket says 172.21.15.53:47816) 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f2418c6e640 1 -- 172.21.15.53:0/1623340667 learned_addr learned my addr 172.21.15.53:0/1623340667 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241946f640 1 --2- 172.21.15.53:0/1623340667 >> v2:172.21.15.53:3300/0 conn(0x7f24140d1c20 0x7f24140d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f24137fe640 1 -- 172.21.15.53:0/1623340667 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184582671 0 0) 0x7f24140d2590 con 0x7f241415c850 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f24137fe640 1 -- 172.21.15.53:0/1623340667 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23fc003530 con 0x7f241415c850 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241946f640 1 -- 172.21.15.53:0/1623340667 >> v1:172.21.15.87:6789/0 conn(0x7f24140b1dc0 legacy=0x7f24140b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f24137fe640 1 -- 172.21.15.53:0/1623340667 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888591864 0 0) 0x7f24140cd6e0 con 0x7f24140b1dc0 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241946f640 1 -- 172.21.15.53:0/1623340667 >> v1:172.21.15.53:6789/0 conn(0x7f241415c850 legacy=0x7f24140ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.222+0000 7f241946f640 1 -- 172.21.15.53:0/1623340667 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140cd970 con 0x7f24140d1c20 2024-09-13T18:26:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241946f640 1 --2- 172.21.15.53:0/1623340667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24140d1c20 0x7f24140d2050 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f240c009d90 tx=0x7f240c01efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5a599af9f9ed24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f24137fe640 1 -- 172.21.15.53:0/1623340667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24040016a0 con 0x7f24140d1c20 2024-09-13T18:26:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f24137fe640 1 -- 172.21.15.53:0/1623340667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c0a8b70 con 0x7f24140d1c20 2024-09-13T18:26:40.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f24137fe640 1 -- 172.21.15.53:0/1623340667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c0b0440 con 0x7f24140d1c20 2024-09-13T18:26:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241aed2640 1 -- 172.21.15.53:0/1623340667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24140d1c20 msgr2=0x7f24140d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241aed2640 1 --2- 172.21.15.53:0/1623340667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24140d1c20 0x7f24140d2050 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f240c009d90 tx=0x7f240c01efa0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241aed2640 1 -- 172.21.15.53:0/1623340667 shutdown_connections 2024-09-13T18:26:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241aed2640 1 --2- 172.21.15.53:0/1623340667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24140d1c20 0x7f24140d2050 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241aed2640 1 -- 172.21.15.53:0/1623340667 >> 172.21.15.53:0/1623340667 conn(0x7f2414065c80 msgr2=0x7f2414066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241aed2640 1 -- 172.21.15.53:0/1623340667 shutdown_connections 2024-09-13T18:26:40.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.226+0000 7f241aed2640 1 -- 172.21.15.53:0/1623340667 wait complete. 2024-09-13T18:26:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 Processor -- start 2024-09-13T18:26:40.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 -- start start 2024-09-13T18:26:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24140b1dc0 0x7f2414157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24140d1c20 0x7f241415e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f241415c850 0x7f241415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24140b3aa0 con 0x7f241415c850 2024-09-13T18:26:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24140b2e90 con 0x7f24140b1dc0 2024-09-13T18:26:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24140b3170 con 0x7f24140d1c20 2024-09-13T18:26:40.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f241415c850 0x7f241415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f241415c850 0x7f241415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58716/0 (socket says 172.21.15.53:58716) 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 -- 172.21.15.53:0/2314293347 learned_addr learned my addr 172.21.15.53:0/2314293347 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f2418c6e640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24140b1dc0 0x7f2414157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f2413fff640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24140d1c20 0x7f241415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 -- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24140d1c20 msgr2=0x7f241415e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24140d1c20 0x7f241415e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 -- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24140b1dc0 msgr2=0x7f2414157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24140b1dc0 0x7f2414157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 -- 172.21.15.53:0/2314293347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c009a70 con 0x7f241415c850 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241946f640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f241415c850 0x7f241415e9b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f240c0b3040 tx=0x7f240c01bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f24117fa640 1 -- 172.21.15.53:0/2314293347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c009450 con 0x7f241415c850 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f24117fa640 1 -- 172.21.15.53:0/2314293347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c0039a0 con 0x7f241415c850 2024-09-13T18:26:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24140b3450 con 0x7f241415c850 2024-09-13T18:26:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f24117fa640 1 -- 172.21.15.53:0/2314293347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c003d70 con 0x7f241415c850 2024-09-13T18:26:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24140b21d0 con 0x7f241415c850 2024-09-13T18:26:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24140d2050 con 0x7f241415c850 2024-09-13T18:26:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f24117fa640 1 -- 172.21.15.53:0/2314293347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f240c0b7050 con 0x7f241415c850 2024-09-13T18:26:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f24117fa640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2400066840 0x7f2400068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.230+0000 7f24117fa640 1 -- 172.21.15.53:0/2314293347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f240c121990 con 0x7f241415c850 2024-09-13T18:26:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.234+0000 7f2418c6e640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2400066840 0x7f2400068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.234+0000 7f2418c6e640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2400066840 0x7f2400068d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2404000f70 tx=0x7f24040018c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.238+0000 7f24117fa640 1 -- 172.21.15.53:0/2314293347 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f240c0eeee0 con 0x7f241415c850 2024-09-13T18:26:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.390+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f24140b3be0 con 0x7f241415c850 2024-09-13T18:26:40.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.750+0000 7f24117fa640 1 -- 172.21.15.53:0/2314293347 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7f24140b3be0 con 0x7f241415c850 2024-09-13T18:26:40.756 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:26:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2400066840 msgr2=0x7f2400068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2400066840 0x7f2400068d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2404000f70 tx=0x7f24040018c0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f241415c850 msgr2=0x7f241415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f241415c850 0x7f241415e9b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f240c0b3040 tx=0x7f240c01bd40 comp rx=0 tx=0).stop 2024-09-13T18:26:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 shutdown_connections 2024-09-13T18:26:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2400066840 0x7f2400068d00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24140d1c20 0x7f241415e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f241415c850 0x7f241415e9b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 --2- 172.21.15.53:0/2314293347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24140b1dc0 0x7f2414157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 >> 172.21.15.53:0/2314293347 conn(0x7f2414065c80 msgr2=0x7f2414066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 shutdown_connections 2024-09-13T18:26:40.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.758+0000 7f241aed2640 1 -- 172.21.15.53:0/2314293347 wait complete. 2024-09-13T18:26:40.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:26:40.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa240dfc640 1 Processor -- start 2024-09-13T18:26:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa240dfc640 1 -- start start 2024-09-13T18:26:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa240dfc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c154a40 0x7fa23c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa240dfc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa23c06cf00 0x7fa23c0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa240dfc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c06b330 con 0x7fa23c0cac00 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa240dfc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c154e20 con 0x7fa23c06cf00 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa240dfc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c06b610 con 0x7fa23c154a40 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa23c06cf00 0x7fa23c0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa23c06cf00 0x7fa23c0cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58722/0 (socket says 172.21.15.53:58722) 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23ad9d640 1 -- 172.21.15.53:0/1894421992 learned_addr learned my addr 172.21.15.53:0/1894421992 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23a59c640 1 --2- 172.21.15.53:0/1894421992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c154a40 0x7fa23c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23ad9d640 1 -- 172.21.15.53:0/1894421992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c154a40 msgr2=0x7fa23c06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23ad9d640 1 --2- 172.21.15.53:0/1894421992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c154a40 0x7fa23c06c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23ad9d640 1 -- 172.21.15.53:0/1894421992 >> v1:172.21.15.87:6789/0 conn(0x7fa23c0cac00 legacy=0x7fa23c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23ad9d640 1 -- 172.21.15.53:0/1894421992 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c06b8f0 con 0x7fa23c06cf00 2024-09-13T18:26:40.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.902+0000 7fa23a59c640 1 --2- 172.21.15.53:0/1894421992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c154a40 0x7fa23c06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa23ad9d640 1 --2- 172.21.15.53:0/1894421992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0cc440 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009870 tx=0x7fa22c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fb890969d5cd58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa23959a640 1 -- 172.21.15.53:0/1894421992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0aa610 con 0x7fa23c06cf00 2024-09-13T18:26:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa23959a640 1 -- 172.21.15.53:0/1894421992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c0a6040 con 0x7fa23c06cf00 2024-09-13T18:26:40.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa23959a640 1 -- 172.21.15.53:0/1894421992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0aa990 con 0x7fa23c06cf00 2024-09-13T18:26:40.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 -- 172.21.15.53:0/1894421992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 msgr2=0x7fa23c0cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 --2- 172.21.15.53:0/1894421992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0cc440 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009870 tx=0x7fa22c01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 -- 172.21.15.53:0/1894421992 shutdown_connections 2024-09-13T18:26:40.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 --2- 172.21.15.53:0/1894421992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0cc440 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 --2- 172.21.15.53:0/1894421992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c154a40 0x7fa23c06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 -- 172.21.15.53:0/1894421992 >> 172.21.15.53:0/1894421992 conn(0x7fa23c065e50 msgr2=0x7fa23c066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:40.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 -- 172.21.15.53:0/1894421992 shutdown_connections 2024-09-13T18:26:40.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.906+0000 7fa240dfc640 1 -- 172.21.15.53:0/1894421992 wait complete. 2024-09-13T18:26:40.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 Processor -- start 2024-09-13T18:26:40.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 -- start start 2024-09-13T18:26:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c0cac00 0x7fa23c141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa23c154a40 0x7fa23c06f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c070960 con 0x7fa23c06cf00 2024-09-13T18:26:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c097ee0 con 0x7fa23c154a40 2024-09-13T18:26:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c070b50 con 0x7fa23c0cac00 2024-09-13T18:26:40.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58738/0 (socket says 172.21.15.53:58738) 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 -- 172.21.15.53:0/3986273101 learned_addr learned my addr 172.21.15.53:0/3986273101 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23ad9d640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa23c154a40 0x7fa23c06f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa239d9b640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c0cac00 0x7fa23c141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 -- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c0cac00 msgr2=0x7fa23c141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c0cac00 0x7fa23c141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 -- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa23c154a40 msgr2=0x7fa23c06f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa23c154a40 0x7fa23c06f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 -- 172.21.15.53:0/3986273101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0094d0 con 0x7fa23c06cf00 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa23a59c640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0979a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa23400ce00 tx=0x7fa23400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa232ffd640 1 -- 172.21.15.53:0/3986273101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23400f890 con 0x7fa23c06cf00 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa232ffd640 1 -- 172.21.15.53:0/3986273101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23400f9f0 con 0x7fa23c06cf00 2024-09-13T18:26:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa232ffd640 1 -- 172.21.15.53:0/3986273101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23400fdc0 con 0x7fa23c06cf00 2024-09-13T18:26:40.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c153c60 con 0x7fa23c06cf00 2024-09-13T18:26:40.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c1412f0 con 0x7fa23c06cf00 2024-09-13T18:26:40.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0cd190 con 0x7fa23c06cf00 2024-09-13T18:26:40.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa232ffd640 1 -- 172.21.15.53:0/3986273101 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa23400b040 con 0x7fa23c06cf00 2024-09-13T18:26:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.910+0000 7fa232ffd640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa21c066840 0x7fa21c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.914+0000 7fa232ffd640 1 -- 172.21.15.53:0/3986273101 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa234084e60 con 0x7fa23c06cf00 2024-09-13T18:26:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.914+0000 7fa239d9b640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa21c066840 0x7fa21c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.914+0000 7fa239d9b640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa21c066840 0x7fa21c068d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0b2c60 tx=0x7fa224009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:40.918+0000 7fa232ffd640 1 -- 172.21.15.53:0/3986273101 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa234052020 con 0x7fa23c06cf00 2024-09-13T18:26:41.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.074+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa23c152220 con 0x7fa23c06cf00 2024-09-13T18:26:41.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.762+0000 7fa232ffd640 1 -- 172.21.15.53:0/3986273101 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa23401d070 con 0x7fa23c06cf00 2024-09-13T18:26:41.767 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:26:41.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.770+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa21c066840 msgr2=0x7fa21c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.770+0000 7fa240dfc640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa21c066840 0x7fa21c068d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0b2c60 tx=0x7fa224009040 comp rx=0 tx=0).stop 2024-09-13T18:26:41.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.770+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 msgr2=0x7fa23c0979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.770+0000 7fa240dfc640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0979a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa23400ce00 tx=0x7fa23400a650 comp rx=0 tx=0).stop 2024-09-13T18:26:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 shutdown_connections 2024-09-13T18:26:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa21c066840 0x7fa21c068d00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa23c0cac00 0x7fa23c141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa23c154a40 0x7fa23c06f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 --2- 172.21.15.53:0/3986273101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa23c06cf00 0x7fa23c0979a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 >> 172.21.15.53:0/3986273101 conn(0x7fa23c065e50 msgr2=0x7fa23c152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:41.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 shutdown_connections 2024-09-13T18:26:41.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.782+0000 7fa240dfc640 1 -- 172.21.15.53:0/3986273101 wait complete. 2024-09-13T18:26:41.816 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:26:41.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.938+0000 7f470d937640 1 Processor -- start 2024-09-13T18:26:41.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.938+0000 7f470d937640 1 -- start start 2024-09-13T18:26:41.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f470d937640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4708143e80 0x7f470806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:41.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f470d937640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f47080cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:41.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f470d937640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470806f7a0 con 0x7f47080caee0 2024-09-13T18:26:41.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f470d937640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470806fd60 con 0x7f4708143e80 2024-09-13T18:26:41.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f470d937640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080cb960 con 0x7f47080cda30 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f4706ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4708143e80 0x7f470806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f47077fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f47080cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f47067fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f47080caee0 0x7f47080cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:38260/0 (socket says 172.21.15.53:38260) 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f47067fc640 1 -- 172.21.15.53:0/606213192 learned_addr learned my addr 172.21.15.53:0/606213192 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f4706ffd640 1 -- 172.21.15.53:0/606213192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 msgr2=0x7f47080cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f4706ffd640 1 --2- 172.21.15.53:0/606213192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f47080cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f4706ffd640 1 -- 172.21.15.53:0/606213192 >> v1:172.21.15.87:6789/0 conn(0x7f47080caee0 legacy=0x7f47080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.942+0000 7f4706ffd640 1 -- 172.21.15.53:0/606213192 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080cbc40 con 0x7f4708143e80 2024-09-13T18:26:41.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f4706ffd640 1 --2- 172.21.15.53:0/606213192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4708143e80 0x7f470806b390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009d90 tx=0x7f46f801c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9a419cf22a77018 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:41.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f4705ffb640 1 -- 172.21.15.53:0/606213192 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80a58c0 con 0x7f4708143e80 2024-09-13T18:26:41.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f4705ffb640 1 -- 172.21.15.53:0/606213192 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f80a5a20 con 0x7f4708143e80 2024-09-13T18:26:41.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f4705ffb640 1 -- 172.21.15.53:0/606213192 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f80a5db0 con 0x7f4708143e80 2024-09-13T18:26:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 -- 172.21.15.53:0/606213192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4708143e80 msgr2=0x7f470806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 --2- 172.21.15.53:0/606213192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4708143e80 0x7f470806b390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009d90 tx=0x7f46f801c820 comp rx=0 tx=0).stop 2024-09-13T18:26:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 -- 172.21.15.53:0/606213192 shutdown_connections 2024-09-13T18:26:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 --2- 172.21.15.53:0/606213192 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f47080cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 --2- 172.21.15.53:0/606213192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4708143e80 0x7f470806b390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 -- 172.21.15.53:0/606213192 >> 172.21.15.53:0/606213192 conn(0x7f4708065c80 msgr2=0x7f4708066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 -- 172.21.15.53:0/606213192 shutdown_connections 2024-09-13T18:26:41.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 -- 172.21.15.53:0/606213192 wait complete. 2024-09-13T18:26:41.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 Processor -- start 2024-09-13T18:26:41.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.946+0000 7f470d937640 1 -- start start 2024-09-13T18:26:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47080caee0 0x7f4708157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f4708139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4708143e80 0x7f4708139c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b0ab0 con 0x7f4708143e80 2024-09-13T18:26:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080afea0 con 0x7f47080caee0 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b0180 con 0x7f47080cda30 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4708143e80 0x7f4708139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4708143e80 0x7f4708139c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58754/0 (socket says 172.21.15.53:58754) 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 -- 172.21.15.53:0/986965532 learned_addr learned my addr 172.21.15.53:0/986965532 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47067fc640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f4708139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f4706ffd640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47080caee0 0x7f4708157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 -- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 msgr2=0x7f4708139700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f4708139700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 -- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47080caee0 msgr2=0x7f4708157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47080caee0 0x7f4708157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 -- 172.21.15.53:0/986965532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009a70 con 0x7f4708143e80 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f47077fe640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4708143e80 0x7f4708139c40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f470000e7f0 tx=0x7f470000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f46effff640 1 -- 172.21.15.53:0/986965532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47000094d0 con 0x7f4708143e80 2024-09-13T18:26:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f46effff640 1 -- 172.21.15.53:0/986965532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470000eea0 con 0x7f4708143e80 2024-09-13T18:26:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f46effff640 1 -- 172.21.15.53:0/986965532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000cb60 con 0x7f4708143e80 2024-09-13T18:26:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47080b0460 con 0x7f4708143e80 2024-09-13T18:26:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708157c60 con 0x7f4708143e80 2024-09-13T18:26:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47080b0c20 con 0x7f4708143e80 2024-09-13T18:26:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f46effff640 1 -- 172.21.15.53:0/986965532 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f470000ccc0 con 0x7f4708143e80 2024-09-13T18:26:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f46effff640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46f4066840 0x7f46f4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.950+0000 7f46effff640 1 -- 172.21.15.53:0/986965532 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4700084c50 con 0x7f4708143e80 2024-09-13T18:26:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.954+0000 7f4706ffd640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46f4066840 0x7f46f4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.954+0000 7f4706ffd640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46f4066840 0x7f46f4068d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f46f80af000 tx=0x7f46f80a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:41.958+0000 7f46effff640 1 -- 172.21.15.53:0/986965532 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4700051e80 con 0x7f4708143e80 2024-09-13T18:26:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.150+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f47080cb350 con 0x7f4708143e80 2024-09-13T18:26:42.166 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 6 and data pool 7 2024-09-13T18:26:42.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.162+0000 7f46effff640 1 -- 172.21.15.53:0/986965532 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 172+0+0 (secure 0 0 0) 0x7f47000170c0 con 0x7f4708143e80 2024-09-13T18:26:42.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.166+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46f4066840 msgr2=0x7f46f4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.166+0000 7f470d937640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46f4066840 0x7f46f4068d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f46f80af000 tx=0x7f46f80a7070 comp rx=0 tx=0).stop 2024-09-13T18:26:42.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.166+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4708143e80 msgr2=0x7f4708139c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.166+0000 7f470d937640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4708143e80 0x7f4708139c40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f470000e7f0 tx=0x7f470000ecb0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 shutdown_connections 2024-09-13T18:26:42.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f46f4066840 0x7f46f4068d00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47080cda30 0x7f4708139700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4708143e80 0x7f4708139c40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 --2- 172.21.15.53:0/986965532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47080caee0 0x7f4708157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 >> 172.21.15.53:0/986965532 conn(0x7f4708065c80 msgr2=0x7f4708143070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:42.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 shutdown_connections 2024-09-13T18:26:42.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.170+0000 7f470d937640 1 -- 172.21.15.53:0/986965532 wait complete. 2024-09-13T18:26:42.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:42.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb357d60640 1 Processor -- start 2024-09-13T18:26:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb357d60640 1 -- start start 2024-09-13T18:26:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb357d60640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 0x7fb3500d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb357d60640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3500cf7d0 0x7fb3500b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb357d60640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3500d2400 con 0x7fb3500cd6c0 2024-09-13T18:26:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb357d60640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3500d1530 con 0x7fb3500cf7d0 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb357d60640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500d0920 con 0x7fb35015cab0 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3552fb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb3500cd6c0 0x7fb3500cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47826/0 (socket says 172.21.15.53:47826) 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3552fb640 1 -- 172.21.15.53:0/3130010480 learned_addr learned my addr 172.21.15.53:0/3130010480 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3562fd640 1 --2- 172.21.15.53:0/3130010480 >> v2:172.21.15.87:3300/0 conn(0x7fb3500cf7d0 0x7fb3500b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb355afc640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 0x7fb3500d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675403020 0 0) 0x7fb3500d2400 con 0x7fb3500cd6c0 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c003530 con 0x7fb3500cd6c0 2024-09-13T18:26:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568619915 0 0) 0x7fb33c003530 con 0x7fb3500cd6c0 2024-09-13T18:26:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 msgr2=0x7fb3500d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 0x7fb3500d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 >> v2:172.21.15.87:3300/0 conn(0x7fb3500cf7d0 msgr2=0x7fb3500b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 --2- 172.21.15.53:0/3130010480 >> v2:172.21.15.87:3300/0 conn(0x7fb3500cf7d0 0x7fb3500b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500d0c00 con 0x7fb3500cd6c0 2024-09-13T18:26:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb340001680 con 0x7fb3500cd6c0 2024-09-13T18:26:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 >> v1:172.21.15.53:6789/0 conn(0x7fb3500cd6c0 legacy=0x7fb3500cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 0x7fb33c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb33c003f00 0x7fb33c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb33c004d10 0x7fb33c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500d1530 con 0x7fb33c004d10 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500d0920 con 0x7fb33c003f00 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c00b990 con 0x7fb35015cab0 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3562fd640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb33c004d10 0x7fb33c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3552fb640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb33c003f00 0x7fb33c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb355afc640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 0x7fb33c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3562fd640 1 -- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 msgr2=0x7fb33c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3562fd640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb35015cab0 0x7fb33c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3562fd640 1 -- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb33c003f00 msgr2=0x7fb33c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3562fd640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb33c003f00 0x7fb33c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3562fd640 1 -- 172.21.15.53:0/3130010480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c003530 con 0x7fb33c004d10 2024-09-13T18:26:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.326+0000 7fb3552fb640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb33c003f00 0x7fb33c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:42.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb3562fd640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb33c004d10 0x7fb33c005190 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb348009f90 tx=0x7fb34801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da6b4dc20bddfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480a5c90 con 0x7fb33c004d10 2024-09-13T18:26:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800f040 con 0x7fb33c004d10 2024-09-13T18:26:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb354afa640 1 -- 172.21.15.53:0/3130010480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480ad640 con 0x7fb33c004d10 2024-09-13T18:26:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb357d60640 1 -- 172.21.15.53:0/3130010480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb33c004d10 msgr2=0x7fb33c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb357d60640 1 --2- 172.21.15.53:0/3130010480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb33c004d10 0x7fb33c005190 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb348009f90 tx=0x7fb34801cc20 comp rx=0 tx=0).stop 2024-09-13T18:26:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb3562fd640 1 -- 172.21.15.53:0/3130010480 reap_dead start 2024-09-13T18:26:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb357d60640 1 -- 172.21.15.53:0/3130010480 shutdown_connections 2024-09-13T18:26:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb357d60640 1 -- 172.21.15.53:0/3130010480 >> 172.21.15.53:0/3130010480 conn(0x7fb350065c80 msgr2=0x7fb350066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb357d60640 1 -- 172.21.15.53:0/3130010480 shutdown_connections 2024-09-13T18:26:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.330+0000 7fb357d60640 1 -- 172.21.15.53:0/3130010480 wait complete. 2024-09-13T18:26:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 Processor -- start 2024-09-13T18:26:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 -- start start 2024-09-13T18:26:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350155ae0 0x7fb3501f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3501f2810 0x7fb3500b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500b6e00 0x7fb350158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500b7280 con 0x7fb3500b6e00 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb350157c80 con 0x7fb3501f2810 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb350157f60 con 0x7fb350155ae0 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500b6e00 0x7fb350158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500b6e00 0x7fb350158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58770/0 (socket says 172.21.15.53:58770) 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 -- 172.21.15.53:0/4182041101 learned_addr learned my addr 172.21.15.53:0/4182041101 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3552fb640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3501f2810 0x7fb3500b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb355afc640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350155ae0 0x7fb3501f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 -- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350155ae0 msgr2=0x7fb3501f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350155ae0 0x7fb3501f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 -- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3501f2810 msgr2=0x7fb3500b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3501f2810 0x7fb3500b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 -- 172.21.15.53:0/4182041101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350158240 con 0x7fb3500b6e00 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3552fb640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3501f2810 0x7fb3500b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3562fd640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500b6e00 0x7fb350158d20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb348002240 tx=0x7fb348009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3467fc640 1 -- 172.21.15.53:0/4182041101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480ae890 con 0x7fb3500b6e00 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3467fc640 1 -- 172.21.15.53:0/4182041101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3480ae9f0 con 0x7fb3500b6e00 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb350158520 con 0x7fb3500b6e00 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3467fc640 1 -- 172.21.15.53:0/4182041101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480aeda0 con 0x7fb3500b6e00 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb350155ec0 con 0x7fb3500b6e00 2024-09-13T18:26:42.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3500d19c0 con 0x7fb3500b6e00 2024-09-13T18:26:42.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.334+0000 7fb3467fc640 1 -- 172.21.15.53:0/4182041101 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fb3480b4040 con 0x7fb3500b6e00 2024-09-13T18:26:42.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.338+0000 7fb3467fc640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb334066870 0x7fb334068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.338+0000 7fb3467fc640 1 -- 172.21.15.53:0/4182041101 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb34811ec50 con 0x7fb3500b6e00 2024-09-13T18:26:42.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.338+0000 7fb355afc640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb334066870 0x7fb334068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.338+0000 7fb355afc640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb334066870 0x7fb334068d30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009a30 tx=0x7fb34c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.342+0000 7fb3467fc640 1 -- 172.21.15.53:0/4182041101 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3480ebdf0 con 0x7fb3500b6e00 2024-09-13T18:26:42.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.506+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb35015afb0 con 0x7fb3500b6e00 2024-09-13T18:26:42.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.506+0000 7fb3467fc640 1 -- 172.21.15.53:0/4182041101 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16466 (secure 0 0 0) 0x7fb3480b2020 con 0x7fb3500b6e00 2024-09-13T18:26:42.511 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:42.511 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":45,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:42.155152+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb334066870 msgr2=0x7fb334068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb334066870 0x7fb334068d30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009a30 tx=0x7fb34c008040 comp rx=0 tx=0).stop 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500b6e00 msgr2=0x7fb350158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500b6e00 0x7fb350158d20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb348002240 tx=0x7fb348009750 comp rx=0 tx=0).stop 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 shutdown_connections 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb334066870 0x7fb334068d30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3500b6e00 0x7fb350158d20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3501f2810 0x7fb3500b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 --2- 172.21.15.53:0/4182041101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb350155ae0 0x7fb3501f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 >> 172.21.15.53:0/4182041101 conn(0x7fb350065c80 msgr2=0x7fb35015b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 shutdown_connections 2024-09-13T18:26:42.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.510+0000 7fb357d60640 1 -- 172.21.15.53:0/4182041101 wait complete. 2024-09-13T18:26:42.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeef24640 1 Processor -- start 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeef24640 1 -- start start 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeef24640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcee81580e0 0x7fcee815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeef24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcee8158800 0x7fcee8158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeef24640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee815c760 con 0x7fcee815c2a0 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeef24640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee8159190 con 0x7fcee8158800 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeef24640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee815ca40 con 0x7fcee81580e0 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceed4c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcee8158800 0x7fcee8158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceed4c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcee8158800 0x7fcee8158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58786/0 (socket says 172.21.15.53:58786) 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceed4c1640 1 -- 172.21.15.53:0/2628368563 learned_addr learned my addr 172.21.15.53:0/2628368563 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceeccc0640 1 --2- 172.21.15.53:0/2628368563 >> v2:172.21.15.87:3300/0 conn(0x7fcee81580e0 0x7fcee815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceed4c1640 1 -- 172.21.15.53:0/2628368563 >> v2:172.21.15.87:3300/0 conn(0x7fcee81580e0 msgr2=0x7fcee815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceed4c1640 1 --2- 172.21.15.53:0/2628368563 >> v2:172.21.15.87:3300/0 conn(0x7fcee81580e0 0x7fcee815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceed4c1640 1 -- 172.21.15.53:0/2628368563 >> v1:172.21.15.87:6789/0 conn(0x7fcee815c2a0 legacy=0x7fcee815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.654+0000 7fceed4c1640 1 -- 172.21.15.53:0/2628368563 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee815cd20 con 0x7fcee8158800 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceed4c1640 1 --2- 172.21.15.53:0/2628368563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee8158c50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcee8067b60 tx=0x7fcee001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe55c7e9ea1c5ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fcee77fe640 1 -- 172.21.15.53:0/2628368563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee00aa610 con 0x7fcee8158800 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fcee77fe640 1 -- 172.21.15.53:0/2628368563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee00a6040 con 0x7fcee8158800 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fcee77fe640 1 -- 172.21.15.53:0/2628368563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee00aa990 con 0x7fcee8158800 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 -- 172.21.15.53:0/2628368563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 msgr2=0x7fcee8158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 --2- 172.21.15.53:0/2628368563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee8158c50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcee8067b60 tx=0x7fcee001c4b0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 -- 172.21.15.53:0/2628368563 shutdown_connections 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 --2- 172.21.15.53:0/2628368563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee8158c50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 --2- 172.21.15.53:0/2628368563 >> v2:172.21.15.87:3300/0 conn(0x7fcee81580e0 0x7fcee815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 -- 172.21.15.53:0/2628368563 >> 172.21.15.53:0/2628368563 conn(0x7fcee8071ac0 msgr2=0x7fcee8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 -- 172.21.15.53:0/2628368563 shutdown_connections 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 -- 172.21.15.53:0/2628368563 wait complete. 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 Processor -- start 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.658+0000 7fceeef24640 1 -- start start 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcee81580e0 0x7fcee81f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee815c2a0 0x7fcee81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee814c900 con 0x7fcee8158800 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee814e0a0 con 0x7fcee815c2a0 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80b2f90 con 0x7fcee81580e0 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee814db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58794/0 (socket says 172.21.15.53:58794) 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 -- 172.21.15.53:0/2036598674 learned_addr learned my addr 172.21.15.53:0/2036598674 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceed4c1640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee815c2a0 0x7fcee81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeccc0640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcee81580e0 0x7fcee81f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 -- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcee81580e0 msgr2=0x7fcee81f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcee81580e0 0x7fcee81f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 -- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee815c2a0 msgr2=0x7fcee81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee815c2a0 0x7fcee81519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 -- 172.21.15.53:0/2036598674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00094d0 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee7fff640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee814db60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fced000c450 tx=0x7fced000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee57fa640 1 -- 172.21.15.53:0/2036598674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0012830 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee57fa640 1 -- 172.21.15.53:0/2036598674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced00129b0 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee814e2b0 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee57fa640 1 -- 172.21.15.53:0/2036598674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0012d60 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee814e870 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee80b31b0 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee57fa640 1 -- 172.21.15.53:0/2036598674 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fced001c460 con 0x7fcee8158800 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee57fa640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcec8066840 0x7fcec8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fcee57fa640 1 -- 172.21.15.53:0/2036598674 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fced00843e0 con 0x7fcee8158800 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.662+0000 7fceeccc0640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcec8066840 0x7fcec8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.666+0000 7fceeccc0640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcec8066840 0x7fcec8068d00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fced8003fd0 tx=0x7fced80039c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.666+0000 7fcee57fa640 1 -- 172.21.15.53:0/2036598674 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fced0051430 con 0x7fcee8158800 2024-09-13T18:26:42.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.826+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcee809a180 con 0x7fcee8158800 2024-09-13T18:26:42.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.830+0000 7fcee57fa640 1 -- 172.21.15.53:0/2036598674 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16466 (secure 0 0 0) 0x7fced0054a50 con 0x7fcee8158800 2024-09-13T18:26:42.835 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:42.835 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":45,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:42.155152+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:42.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcec8066840 msgr2=0x7fcec8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcec8066840 0x7fcec8068d00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fced8003fd0 tx=0x7fced80039c0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 msgr2=0x7fcee814db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee814db60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fced000c450 tx=0x7fced000c910 comp rx=0 tx=0).stop 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 shutdown_connections 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcec8066840 0x7fcec8068d00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcee815c2a0 0x7fcee81519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcee8158800 0x7fcee814db60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 --2- 172.21.15.53:0/2036598674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcee81580e0 0x7fcee81f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 >> 172.21.15.53:0/2036598674 conn(0x7fcee8071ac0 msgr2=0x7fcee806d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 shutdown_connections 2024-09-13T18:26:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.834+0000 7fceeef24640 1 -- 172.21.15.53:0/2036598674 wait complete. 2024-09-13T18:26:42.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:26:42.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0089b07640 1 Processor -- start 2024-09-13T18:26:42.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0089b07640 1 -- start start 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0089b07640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0084143e80 0x7f008406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0089b07640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00840caee0 0x7f00840cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0089b07640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008406f7a0 con 0x7f00840cd320 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0089b07640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008406fd60 con 0x7f00840caee0 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0089b07640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840cb960 con 0x7f0084143e80 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0082ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00840caee0 0x7f00840cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f00837fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0084143e80 0x7f008406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0082ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00840caee0 0x7f00840cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:57596/0 (socket says 172.21.15.53:57596) 2024-09-13T18:26:42.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0082ffd640 1 -- 172.21.15.53:0/3228585016 learned_addr learned my addr 172.21.15.53:0/3228585016 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:42.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f0083fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f00840cd320 0x7f00840cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:38286/0 (socket says 172.21.15.53:38286) 2024-09-13T18:26:42.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f00837fe640 1 -- 172.21.15.53:0/3228585016 >> v2:172.21.15.87:3300/0 conn(0x7f00840caee0 msgr2=0x7f00840cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:42.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f00837fe640 1 --2- 172.21.15.53:0/3228585016 >> v2:172.21.15.87:3300/0 conn(0x7f00840caee0 0x7f00840cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f00837fe640 1 -- 172.21.15.53:0/3228585016 >> v1:172.21.15.87:6789/0 conn(0x7f00840cd320 legacy=0x7f00840cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.986+0000 7f00837fe640 1 -- 172.21.15.53:0/3228585016 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840cbc40 con 0x7f0084143e80 2024-09-13T18:26:42.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f00837fe640 1 --2- 172.21.15.53:0/3228585016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0084143e80 0x7f008406b390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00740097c0 tx=0x7f007401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f921447b89accfe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f00827fc640 1 -- 172.21.15.53:0/3228585016 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00740ac620 con 0x7f0084143e80 2024-09-13T18:26:42.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f00827fc640 1 -- 172.21.15.53:0/3228585016 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00740ac780 con 0x7f0084143e80 2024-09-13T18:26:42.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f00827fc640 1 -- 172.21.15.53:0/3228585016 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00740acb10 con 0x7f0084143e80 2024-09-13T18:26:42.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 -- 172.21.15.53:0/3228585016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0084143e80 msgr2=0x7f008406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 --2- 172.21.15.53:0/3228585016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0084143e80 0x7f008406b390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00740097c0 tx=0x7f007401c3e0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 -- 172.21.15.53:0/3228585016 shutdown_connections 2024-09-13T18:26:42.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 --2- 172.21.15.53:0/3228585016 >> v2:172.21.15.87:3300/0 conn(0x7f00840caee0 0x7f00840cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 --2- 172.21.15.53:0/3228585016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0084143e80 0x7f008406b390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 -- 172.21.15.53:0/3228585016 >> 172.21.15.53:0/3228585016 conn(0x7f0084065c80 msgr2=0x7f0084066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:42.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 -- 172.21.15.53:0/3228585016 shutdown_connections 2024-09-13T18:26:42.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 -- 172.21.15.53:0/3228585016 wait complete. 2024-09-13T18:26:42.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 Processor -- start 2024-09-13T18:26:42.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 -- start start 2024-09-13T18:26:42.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00840caee0 0x7f00841364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00840cd320 0x7f0084155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084143e80 0x7f0084137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:42.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.990+0000 7f0089b07640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00841369e0 con 0x7f00840cd320 2024-09-13T18:26:42.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0089b07640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084151a50 con 0x7f0084143e80 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0089b07640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0084151cf0 con 0x7f00840caee0 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00840cd320 0x7f0084155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00840cd320 0x7f0084155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58800/0 (socket says 172.21.15.53:58800) 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 -- 172.21.15.53:0/2108658318 learned_addr learned my addr 172.21.15.53:0/2108658318 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0083fff640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084143e80 0x7f0084137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f00837fe640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00840caee0 0x7f00841364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 -- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00840caee0 msgr2=0x7f00841364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00840caee0 0x7f00841364a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 -- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084143e80 msgr2=0x7f0084137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084143e80 0x7f0084137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 -- 172.21.15.53:0/2108658318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074009420 con 0x7f00840cd320 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0082ffd640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00840cd320 0x7f0084155720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f007800e7f0 tx=0x7f007800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f006bfff640 1 -- 172.21.15.53:0/2108658318 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078009580 con 0x7f00840cd320 2024-09-13T18:26:42.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f006bfff640 1 -- 172.21.15.53:0/2108658318 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007800c940 con 0x7f00840cd320 2024-09-13T18:26:42.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0084151fd0 con 0x7f00840cd320 2024-09-13T18:26:42.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f006bfff640 1 -- 172.21.15.53:0/2108658318 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007800ccf0 con 0x7f00840cd320 2024-09-13T18:26:42.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0084152590 con 0x7f00840cd320 2024-09-13T18:26:42.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00840cb320 con 0x7f00840cd320 2024-09-13T18:26:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f006bfff640 1 -- 172.21.15.53:0/2108658318 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f0078013470 con 0x7f00840cd320 2024-09-13T18:26:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f006bfff640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0070066840 0x7f0070068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f006bfff640 1 -- 172.21.15.53:0/2108658318 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0078084440 con 0x7f00840cd320 2024-09-13T18:26:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.994+0000 7f00837fe640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0070066840 0x7f0070068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:43.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.998+0000 7f00837fe640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0070066840 0x7f0070068d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f00740ae000 tx=0x7f00740a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:43.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:42.998+0000 7f006bfff640 1 -- 172.21.15.53:0/2108658318 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0078051670 con 0x7f00840cd320 2024-09-13T18:26:43.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:43.198+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0084141790 con 0x7f00840cd320 2024-09-13T18:26:43.416 INFO:tasks.ceph.mds.a.smithi053.stderr:2024-09-13T18:26:43.414+0000 7fb935bb0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:26:44.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.170+0000 7f006bfff640 1 -- 172.21.15.53:0/2108658318 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0078054c90 con 0x7f00840cd320 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0070066840 msgr2=0x7f0070068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0070066840 0x7f0070068d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f00740ae000 tx=0x7f00740a7000 comp rx=0 tx=0).stop 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00840cd320 msgr2=0x7f0084155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00840cd320 0x7f0084155720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f007800e7f0 tx=0x7f007800ecb0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 shutdown_connections 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0070066840 0x7f0070068d00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084143e80 0x7f0084137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00840cd320 0x7f0084155720 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 --2- 172.21.15.53:0/2108658318 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00840caee0 0x7f00841364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 >> 172.21.15.53:0/2108658318 conn(0x7f0084065c80 msgr2=0x7f0084154720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:44.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 shutdown_connections 2024-09-13T18:26:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.174+0000 7f0089b07640 1 -- 172.21.15.53:0/2108658318 wait complete. 2024-09-13T18:26:44.202 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:26:44.202 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:26:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fd0480640 1 Processor -- start 2024-09-13T18:26:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fd0480640 1 -- start start 2024-09-13T18:26:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fd0480640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc815b180 0x7f7fc8164f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fd0480640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fc80cfae0 0x7f7fc80d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fd0480640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc8164540 con 0x7f7fc80b4ab0 2024-09-13T18:26:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fd0480640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80cd0e0 con 0x7f7fc80cfae0 2024-09-13T18:26:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fd0480640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80cd3c0 con 0x7f7fc815b180 2024-09-13T18:26:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fcea1d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fc80cfae0 0x7f7fc80d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fcea1d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fc80cfae0 0x7f7fc80d1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58806/0 (socket says 172.21.15.53:58806) 2024-09-13T18:26:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fcea1d640 1 -- 172.21.15.53:0/2672808139 learned_addr learned my addr 172.21.15.53:0/2672808139 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fce21c640 1 --2- 172.21.15.53:0/2672808139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc815b180 0x7f7fc8164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fcea1d640 1 -- 172.21.15.53:0/2672808139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc815b180 msgr2=0x7f7fc8164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fcea1d640 1 --2- 172.21.15.53:0/2672808139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc815b180 0x7f7fc8164f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fcea1d640 1 -- 172.21.15.53:0/2672808139 >> v1:172.21.15.87:6789/0 conn(0x7f7fc80b4ab0 legacy=0x7f7fc80cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:44.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.330+0000 7f7fcea1d640 1 -- 172.21.15.53:0/2672808139 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8164790 con 0x7f7fc80cfae0 2024-09-13T18:26:44.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fcea1d640 1 --2- 172.21.15.53:0/2672808139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc80cfae0 0x7f7fc80d1a60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009870 tx=0x7f7fb801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b205dedd76c08853 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:44.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fcd21a640 1 -- 172.21.15.53:0/2672808139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80d27b0 con 0x7f7fc80cfae0 2024-09-13T18:26:44.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fcd21a640 1 -- 172.21.15.53:0/2672808139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb80ac410 con 0x7f7fc80cfae0 2024-09-13T18:26:44.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fcd21a640 1 -- 172.21.15.53:0/2672808139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80ac7a0 con 0x7f7fc80cfae0 2024-09-13T18:26:44.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 -- 172.21.15.53:0/2672808139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc80cfae0 msgr2=0x7f7fc80d1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 --2- 172.21.15.53:0/2672808139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc80cfae0 0x7f7fc80d1a60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009870 tx=0x7f7fb801c560 comp rx=0 tx=0).stop 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 -- 172.21.15.53:0/2672808139 shutdown_connections 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 --2- 172.21.15.53:0/2672808139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc80cfae0 0x7f7fc80d1a60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 --2- 172.21.15.53:0/2672808139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc815b180 0x7f7fc8164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 -- 172.21.15.53:0/2672808139 >> 172.21.15.53:0/2672808139 conn(0x7f7fc8070740 msgr2=0x7f7fc8070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 -- 172.21.15.53:0/2672808139 shutdown_connections 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 -- 172.21.15.53:0/2672808139 wait complete. 2024-09-13T18:26:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 Processor -- start 2024-09-13T18:26:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.334+0000 7f7fd0480640 1 -- start start 2024-09-13T18:26:44.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc80b4ab0 0x7f7fc81580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:44.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80cfae0 0x7f7fc80b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc815b180 0x7f7fc80b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8158620 con 0x7f7fc815b180 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8161350 con 0x7f7fc80cfae0 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8161630 con 0x7f7fc80b4ab0 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc815b180 0x7f7fc80b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc815b180 0x7f7fc80b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58818/0 (socket says 172.21.15.53:58818) 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcda1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80cfae0 0x7f7fc80b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 -- 172.21.15.53:0/3475531627 learned_addr learned my addr 172.21.15.53:0/3475531627 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fce21c640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc80b4ab0 0x7f7fc81580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 -- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc80b4ab0 msgr2=0x7f7fc81580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc80b4ab0 0x7f7fc81580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 -- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80cfae0 msgr2=0x7f7fc80b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80cfae0 0x7f7fc80b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 -- 172.21.15.53:0/3475531627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb80094d0 con 0x7f7fc815b180 2024-09-13T18:26:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fcea1d640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc815b180 0x7f7fc80b7270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8019170 tx=0x7f7fb8019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fc6ffd640 1 -- 172.21.15.53:0/3475531627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80ace20 con 0x7f7fc815b180 2024-09-13T18:26:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fc6ffd640 1 -- 172.21.15.53:0/3475531627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb80b5460 con 0x7f7fc815b180 2024-09-13T18:26:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fc6ffd640 1 -- 172.21.15.53:0/3475531627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80b57f0 con 0x7f7fc815b180 2024-09-13T18:26:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc8161910 con 0x7f7fc815b180 2024-09-13T18:26:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc8161ed0 con 0x7f7fc815b180 2024-09-13T18:26:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc80d1a60 con 0x7f7fc815b180 2024-09-13T18:26:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fc6ffd640 1 -- 172.21.15.53:0/3475531627 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f7fb80b3070 con 0x7f7fc815b180 2024-09-13T18:26:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fc6ffd640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7fb4066840 0x7f7fb4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.338+0000 7f7fc6ffd640 1 -- 172.21.15.53:0/3475531627 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fb811e160 con 0x7f7fc815b180 2024-09-13T18:26:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.342+0000 7f7fce21c640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7fb4066840 0x7f7fb4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:44.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.342+0000 7f7fce21c640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7fb4066840 0x7f7fb4068d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0011340 tx=0x7f7fc000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.346+0000 7f7fc6ffd640 1 -- 172.21.15.53:0/3475531627 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fb80eb150 con 0x7f7fc815b180 2024-09-13T18:26:44.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:44.542+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7fc8070f30 con 0x7f7fc815b180 2024-09-13T18:26:45.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.466+0000 7f7fc6ffd640 1 -- 172.21.15.53:0/3475531627 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7fb80ee770 con 0x7f7fc815b180 2024-09-13T18:26:45.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7fb4066840 msgr2=0x7f7fb4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7fb4066840 0x7f7fb4068d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0011340 tx=0x7f7fc000b040 comp rx=0 tx=0).stop 2024-09-13T18:26:45.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc815b180 msgr2=0x7f7fc80b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc815b180 0x7f7fc80b7270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8019170 tx=0x7f7fb8019300 comp rx=0 tx=0).stop 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 shutdown_connections 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7fb4066840 0x7f7fb4068d00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc815b180 0x7f7fc80b7270 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80cfae0 0x7f7fc80b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 --2- 172.21.15.53:0/3475531627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc80b4ab0 0x7f7fc81580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 >> 172.21.15.53:0/3475531627 conn(0x7f7fc8070740 msgr2=0x7f7fc8159b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 shutdown_connections 2024-09-13T18:26:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.470+0000 7f7fd0480640 1 -- 172.21.15.53:0/3475531627 wait complete. 2024-09-13T18:26:45.496 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:26:45.496 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:45.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 Processor -- start 2024-09-13T18:26:45.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 -- start start 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a600b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a6006b850 0x7f8a600cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a600cbd60 0x7f8a6006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600b1ac0 con 0x7f8a6006b850 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a60159ac0 con 0x7f8a600cbd60 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.614+0000 7f8a6849e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60159da0 con 0x7f8a600cb980 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a6006b850 0x7f8a600cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a6006b850 0x7f8a600cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58832/0 (socket says 172.21.15.53:58832) 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 -- 172.21.15.53:0/1811607497 learned_addr learned my addr 172.21.15.53:0/1811607497 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a66a3b640 1 --2- 172.21.15.53:0/1811607497 >> v2:172.21.15.87:3300/0 conn(0x7f8a600cbd60 0x7f8a6006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6623a640 1 --2- 172.21.15.53:0/1811607497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a600b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 -- 172.21.15.53:0/1811607497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 msgr2=0x7f8a600b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 --2- 172.21.15.53:0/1811607497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a600b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 -- 172.21.15.53:0/1811607497 >> v2:172.21.15.87:3300/0 conn(0x7f8a600cbd60 msgr2=0x7f8a6006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 --2- 172.21.15.53:0/1811607497 >> v2:172.21.15.87:3300/0 conn(0x7f8a600cbd60 0x7f8a6006fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 -- 172.21.15.53:0/1811607497 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6015a080 con 0x7f8a6006b850 2024-09-13T18:26:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a66a3b640 1 --2- 172.21.15.53:0/1811607497 >> v2:172.21.15.87:3300/0 conn(0x7f8a600cbd60 0x7f8a6006fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65a39640 1 --2- 172.21.15.53:0/1811607497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a6006b850 0x7f8a600cdd40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009e50 tx=0x7f8a5c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0037835a786e1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65238640 1 -- 172.21.15.53:0/1811607497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0a56c0 con 0x7f8a6006b850 2024-09-13T18:26:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65238640 1 -- 172.21.15.53:0/1811607497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0a5820 con 0x7f8a6006b850 2024-09-13T18:26:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a65238640 1 -- 172.21.15.53:0/1811607497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0a5bb0 con 0x7f8a6006b850 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 -- 172.21.15.53:0/1811607497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a6006b850 msgr2=0x7f8a600cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 --2- 172.21.15.53:0/1811607497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a6006b850 0x7f8a600cdd40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009e50 tx=0x7f8a5c01c930 comp rx=0 tx=0).stop 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 -- 172.21.15.53:0/1811607497 shutdown_connections 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 --2- 172.21.15.53:0/1811607497 >> v2:172.21.15.87:3300/0 conn(0x7f8a600cbd60 0x7f8a6006fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 --2- 172.21.15.53:0/1811607497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a6006b850 0x7f8a600cdd40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 --2- 172.21.15.53:0/1811607497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a600b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 -- 172.21.15.53:0/1811607497 >> 172.21.15.53:0/1811607497 conn(0x7f8a60065c80 msgr2=0x7f8a60066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 -- 172.21.15.53:0/1811607497 shutdown_connections 2024-09-13T18:26:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.618+0000 7f8a6849e640 1 -- 172.21.15.53:0/1811607497 wait complete. 2024-09-13T18:26:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 Processor -- start 2024-09-13T18:26:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 -- start start 2024-09-13T18:26:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a6006b850 0x7f8a601479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a6014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600cbd60 0x7f8a6014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60148260 con 0x7f8a600cbd60 2024-09-13T18:26:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014c1b0 con 0x7f8a6006b850 2024-09-13T18:26:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014c490 con 0x7f8a600cb980 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600cbd60 0x7f8a6014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6623a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a6006b850 0x7f8a601479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600cbd60 0x7f8a6014bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58836/0 (socket says 172.21.15.53:58836) 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 -- 172.21.15.53:0/4140328639 learned_addr learned my addr 172.21.15.53:0/4140328639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a65a39640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a6014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 -- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 msgr2=0x7f8a6014d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a6014d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 -- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a6006b850 msgr2=0x7f8a601479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a6006b850 0x7f8a601479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 -- 172.21.15.53:0/4140328639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c009b30 con 0x7f8a600cbd60 2024-09-13T18:26:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a66a3b640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600cbd60 0x7f8a6014bab0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e810 tx=0x7f8a5800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a52ffd640 1 -- 172.21.15.53:0/4140328639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800c8d0 con 0x7f8a600cbd60 2024-09-13T18:26:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a52ffd640 1 -- 172.21.15.53:0/4140328639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5800ca30 con 0x7f8a600cbd60 2024-09-13T18:26:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a52ffd640 1 -- 172.21.15.53:0/4140328639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800cde0 con 0x7f8a600cbd60 2024-09-13T18:26:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6014c770 con 0x7f8a600cbd60 2024-09-13T18:26:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6014cd30 con 0x7f8a600cbd60 2024-09-13T18:26:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.622+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a60067400 con 0x7f8a600cbd60 2024-09-13T18:26:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.626+0000 7f8a52ffd640 1 -- 172.21.15.53:0/4140328639 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f8a58026430 con 0x7f8a600cbd60 2024-09-13T18:26:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.626+0000 7f8a52ffd640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8a44066870 0x7f8a44068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.626+0000 7f8a52ffd640 1 -- 172.21.15.53:0/4140328639 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a58084700 con 0x7f8a600cbd60 2024-09-13T18:26:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.626+0000 7f8a6623a640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8a44066870 0x7f8a44068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.626+0000 7f8a6623a640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8a44066870 0x7f8a44068d30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a6014de60 tx=0x7f8a54008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:45.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.630+0000 7f8a52ffd640 1 -- 172.21.15.53:0/4140328639 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a58051820 con 0x7f8a600cbd60 2024-09-13T18:26:45.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.822+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a600b33b0 con 0x7f8a600cbd60 2024-09-13T18:26:45.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.822+0000 7f8a52ffd640 1 -- 172.21.15.53:0/4140328639 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f8a58054e40 con 0x7f8a600cbd60 2024-09-13T18:26:45.827 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:45.827 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:26:45.827 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 22 2024-09-13T18:26:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8a44066870 msgr2=0x7f8a44068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8a44066870 0x7f8a44068d30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a6014de60 tx=0x7f8a54008040 comp rx=0 tx=0).stop 2024-09-13T18:26:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600cbd60 msgr2=0x7f8a6014bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600cbd60 0x7f8a6014bab0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e810 tx=0x7f8a5800ecd0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 shutdown_connections 2024-09-13T18:26:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8a44066870 0x7f8a44068d30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600cb980 0x7f8a6014d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600cbd60 0x7f8a6014bab0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 --2- 172.21.15.53:0/4140328639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a6006b850 0x7f8a601479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 >> 172.21.15.53:0/4140328639 conn(0x7f8a60065c80 msgr2=0x7f8a600ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:45.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 shutdown_connections 2024-09-13T18:26:45.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.826+0000 7f8a6849e640 1 -- 172.21.15.53:0/4140328639 wait complete. 2024-09-13T18:26:45.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:45.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.950+0000 7f31a3add640 1 Processor -- start 2024-09-13T18:26:45.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.950+0000 7f31a3add640 1 -- start start 2024-09-13T18:26:45.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a3add640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a3add640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f319c0b1e00 0x7f319c06f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a3add640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0b2860 con 0x7f319c06b390 2024-09-13T18:26:45.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a3add640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c06b7d0 con 0x7f319c0b1e00 2024-09-13T18:26:45.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a3add640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0cb540 con 0x7f319c0cbb60 2024-09-13T18:26:45.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a207a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f319c0b1e00 0x7f319c06f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1879640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1078640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f319c06b390 0x7f319c0cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:38312/0 (socket says 172.21.15.53:38312) 2024-09-13T18:26:45.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1879640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:51770/0 (socket says 172.21.15.53:51770) 2024-09-13T18:26:45.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1078640 1 -- 172.21.15.53:0/1138502915 learned_addr learned my addr 172.21.15.53:0/1138502915 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:45.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a207a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f319c0b1e00 0x7f319c06f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:57638/0 (socket says 172.21.15.53:57638) 2024-09-13T18:26:45.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1879640 1 -- 172.21.15.53:0/1138502915 >> v2:172.21.15.87:3300/0 conn(0x7f319c0b1e00 msgr2=0x7f319c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:45.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1879640 1 --2- 172.21.15.53:0/1138502915 >> v2:172.21.15.87:3300/0 conn(0x7f319c0b1e00 0x7f319c06f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1879640 1 -- 172.21.15.53:0/1138502915 >> v1:172.21.15.87:6789/0 conn(0x7f319c06b390 legacy=0x7f319c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a1879640 1 -- 172.21.15.53:0/1138502915 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0b2580 con 0x7f319c0cbb60 2024-09-13T18:26:45.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.954+0000 7f31a207a640 1 --2- 172.21.15.53:0/1138502915 >> v2:172.21.15.87:3300/0 conn(0x7f319c0b1e00 0x7f319c06f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:45.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 --2- 172.21.15.53:0/1138502915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158ba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31980097c0 tx=0x7f319801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6de15c6e9572fc65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:45.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a0877640 1 -- 172.21.15.53:0/1138502915 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980ab600 con 0x7f319c0cbb60 2024-09-13T18:26:45.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a0877640 1 -- 172.21.15.53:0/1138502915 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31980a7050 con 0x7f319c0cbb60 2024-09-13T18:26:45.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a0877640 1 -- 172.21.15.53:0/1138502915 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980ab980 con 0x7f319c0cbb60 2024-09-13T18:26:45.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- 172.21.15.53:0/1138502915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 msgr2=0x7f319c158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 --2- 172.21.15.53:0/1138502915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158ba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31980097c0 tx=0x7f319801c410 comp rx=0 tx=0).stop 2024-09-13T18:26:45.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- 172.21.15.53:0/1138502915 shutdown_connections 2024-09-13T18:26:45.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 --2- 172.21.15.53:0/1138502915 >> v2:172.21.15.87:3300/0 conn(0x7f319c0b1e00 0x7f319c06f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 --2- 172.21.15.53:0/1138502915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158ba0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- 172.21.15.53:0/1138502915 >> 172.21.15.53:0/1138502915 conn(0x7f319c065c80 msgr2=0x7f319c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:45.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- 172.21.15.53:0/1138502915 shutdown_connections 2024-09-13T18:26:45.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- 172.21.15.53:0/1138502915 wait complete. 2024-09-13T18:26:45.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 Processor -- start 2024-09-13T18:26:45.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- start start 2024-09-13T18:26:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f319c06b390 0x7f319c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f319c0b1e00 0x7f319c14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c14e8a0 con 0x7f319c06b390 2024-09-13T18:26:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c14eb80 con 0x7f319c0b1e00 2024-09-13T18:26:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a3add640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c14ee60 con 0x7f319c0cbb60 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f319c06b390 0x7f319c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f319c06b390 0x7f319c0c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58838/0 (socket says 172.21.15.53:58838) 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 -- 172.21.15.53:0/2904485181 learned_addr learned my addr 172.21.15.53:0/2904485181 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1078640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f319c0b1e00 0x7f319c14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a207a640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 -- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 msgr2=0x7f319c158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 -- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f319c0b1e00 msgr2=0x7f319c14f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f319c0b1e00 0x7f319c14f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1879640 1 -- 172.21.15.53:0/2904485181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194009a70 con 0x7f319c06b390 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.958+0000 7f31a1078640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f319c0b1e00 0x7f319c14f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31a1879640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f319c06b390 0x7f319c0c4770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f319801aac0 tx=0x7f31980191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:45.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31927fc640 1 -- 172.21.15.53:0/2904485181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198006e20 con 0x7f319c06b390 2024-09-13T18:26:45.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31927fc640 1 -- 172.21.15.53:0/2904485181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31980b6480 con 0x7f319c06b390 2024-09-13T18:26:45.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3198009420 con 0x7f319c06b390 2024-09-13T18:26:45.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31927fc640 1 -- 172.21.15.53:0/2904485181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980b6850 con 0x7f319c06b390 2024-09-13T18:26:45.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c14f420 con 0x7f319c06b390 2024-09-13T18:26:45.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c067400 con 0x7f319c06b390 2024-09-13T18:26:45.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31927fc640 1 -- 172.21.15.53:0/2904485181 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f31980b2040 con 0x7f319c06b390 2024-09-13T18:26:45.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31927fc640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3180066840 0x7f3180068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:45.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31927fc640 1 -- 172.21.15.53:0/2904485181 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f319811ecc0 con 0x7f319c06b390 2024-09-13T18:26:45.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31a1078640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3180066840 0x7f3180068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:45.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.962+0000 7f31a1078640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3180066840 0x7f3180068d00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f319c0b0080 tx=0x7f318c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:45.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:45.966+0000 7f31927fc640 1 -- 172.21.15.53:0/2904485181 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3198125080 con 0x7f319c06b390 2024-09-13T18:26:46.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.118+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f319c14f610 con 0x7f319c06b390 2024-09-13T18:26:46.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31927fc640 1 -- 172.21.15.53:0/2904485181 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16453 (secure 0 0 0) 0x7f31980c6020 con 0x7f319c06b390 2024-09-13T18:26:46.126 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:46.126 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":46,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:43.159322+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3180066840 msgr2=0x7f3180068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3180066840 0x7f3180068d00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f319c0b0080 tx=0x7f318c009040 comp rx=0 tx=0).stop 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f319c06b390 msgr2=0x7f319c0c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f319c06b390 0x7f319c0c4770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f319801aac0 tx=0x7f31980191b0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 shutdown_connections 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3180066840 0x7f3180068d00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f319c0cbb60 0x7f319c158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f319c0b1e00 0x7f319c14f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 --2- 172.21.15.53:0/2904485181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f319c06b390 0x7f319c0c4770 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 >> 172.21.15.53:0/2904485181 conn(0x7f319c065c80 msgr2=0x7f319c159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 shutdown_connections 2024-09-13T18:26:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.122+0000 7f31a3add640 1 -- 172.21.15.53:0/2904485181 wait complete. 2024-09-13T18:26:46.144 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:26:46.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:26:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.250+0000 7f2869ce4640 1 Processor -- start 2024-09-13T18:26:46.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.250+0000 7f2869ce4640 1 -- start start 2024-09-13T18:26:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2869ce4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f286406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2869ce4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286415cd60 con 0x7f286406d550 2024-09-13T18:26:46.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2869ce4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28640cccd0 con 0x7f286406a660 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2869ce4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286406d1a0 con 0x7f286415c980 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2862ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f286406d550 0x7f2864069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47828/0 (socket says 172.21.15.53:47828) 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2862ffd640 1 -- 172.21.15.53:0/1856915960 learned_addr learned my addr 172.21.15.53:0/1856915960 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f286406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441845875 0 0) 0x7f286415cd60 con 0x7f286406d550 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c003530 con 0x7f286406d550 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 41748332 0 0) 0x7f284c003530 con 0x7f286406d550 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 msgr2=0x7f286406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f286406cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 >> v1:172.21.15.87:6789/0 conn(0x7f286406a660 legacy=0x7f2864070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640ccfb0 con 0x7f286406d550 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f2858001800 con 0x7f286406d550 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f286406cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:46.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 >> v1:172.21.15.53:6789/0 conn(0x7f286406d550 legacy=0x7f2864069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f284c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f284c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f284c004d10 0x7f284c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286406d1a0 con 0x7f284c0039b0 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c00bbc0 con 0x7f284c004d10 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c00bd80 con 0x7f286415c980 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f284c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2863fff640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f284c004d10 0x7f284c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2862ffd640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f284c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 -- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 msgr2=0x7f284c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f284c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 -- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f284c004d10 msgr2=0x7f284c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:46.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f284c004d10 0x7f284c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 -- 172.21.15.53:0/1856915960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c003530 con 0x7f284c0039b0 2024-09-13T18:26:46.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f2862ffd640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f286415c980 0x7f284c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28637fe640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f284c003dd0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f28540098d0 tx=0x7f285401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fb4a3e2fa48e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a8640 con 0x7f284c0039b0 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28540a87a0 con 0x7f284c0039b0 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.254+0000 7f28627fc640 1 -- 172.21.15.53:0/1856915960 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a8b10 con 0x7f284c0039b0 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- 172.21.15.53:0/1856915960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 msgr2=0x7f284c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 --2- 172.21.15.53:0/1856915960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f284c003dd0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f28540098d0 tx=0x7f285401c5d0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2863fff640 1 -- 172.21.15.53:0/1856915960 reap_dead start 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- 172.21.15.53:0/1856915960 shutdown_connections 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- 172.21.15.53:0/1856915960 >> 172.21.15.53:0/1856915960 conn(0x7f28640b0a30 msgr2=0x7f28640b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- 172.21.15.53:0/1856915960 shutdown_connections 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- 172.21.15.53:0/1856915960 wait complete. 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 Processor -- start 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- start start 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f286409c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28640c80b0 0x7f28640c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28640ac8d0 0x7f28640acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28640c8a70 con 0x7f284c0039b0 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286415cd60 con 0x7f28640ac8d0 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28641518c0 con 0x7f28640c80b0 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f286409c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f286409c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58860/0 (socket says 172.21.15.53:58860) 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 -- 172.21.15.53:0/1431136636 learned_addr learned my addr 172.21.15.53:0/1431136636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2862ffd640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28640c80b0 0x7f28640c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2863fff640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28640ac8d0 0x7f28640acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 -- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28640c80b0 msgr2=0x7f28640c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28640c80b0 0x7f28640c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 -- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28640ac8d0 msgr2=0x7f28640acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28640ac8d0 0x7f28640acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 -- 172.21.15.53:0/1431136636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640ad2a0 con 0x7f284c0039b0 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f28637fe640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f286409c2e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f28540098d0 tx=0x7f284c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f284bfff640 1 -- 172.21.15.53:0/1431136636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a8640 con 0x7f284c0039b0 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f284bfff640 1 -- 172.21.15.53:0/1431136636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28540b9470 con 0x7f284c0039b0 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640ad560 con 0x7f284c0039b0 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f284bfff640 1 -- 172.21.15.53:0/1431136636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540b9820 con 0x7f284c0039b0 2024-09-13T18:26:46.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.258+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286415cfb0 con 0x7f284c0039b0 2024-09-13T18:26:46.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.262+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2864070310 con 0x7f284c0039b0 2024-09-13T18:26:46.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.262+0000 7f284bfff640 1 -- 172.21.15.53:0/1431136636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f28540b0400 con 0x7f284c0039b0 2024-09-13T18:26:46.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.262+0000 7f284bfff640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2850066840 0x7f2850068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.262+0000 7f284bfff640 1 -- 172.21.15.53:0/1431136636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f285411e390 con 0x7f284c0039b0 2024-09-13T18:26:46.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.262+0000 7f2862ffd640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2850066840 0x7f2850068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.262+0000 7f2862ffd640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2850066840 0x7f2850068d00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2858001930 tx=0x7f2858009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.266+0000 7f284bfff640 1 -- 172.21.15.53:0/1431136636 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28540eb520 con 0x7f284c0039b0 2024-09-13T18:26:46.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.414+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28640c8a70 con 0x7f2850066840 2024-09-13T18:26:46.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.438+0000 7f284bfff640 1 -- 172.21.15.53:0/1431136636 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273468 (secure 0 0 0) 0x7f28640c8a70 con 0x7f2850066840 2024-09-13T18:26:46.442 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:46.446 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:26:46.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2850066840 msgr2=0x7f2850068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2850066840 0x7f2850068d00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2858001930 tx=0x7f2858009040 comp rx=0 tx=0).stop 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 msgr2=0x7f286409c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f286409c2e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f28540098d0 tx=0x7f284c005800 comp rx=0 tx=0).stop 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 shutdown_connections 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2850066840 0x7f2850068d00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28640c80b0 0x7f28640c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28640ac8d0 0x7f28640acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 --2- 172.21.15.53:0/1431136636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f284c0039b0 0x7f286409c2e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 >> 172.21.15.53:0/1431136636 conn(0x7f28640b0a30 msgr2=0x7f28640b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 shutdown_connections 2024-09-13T18:26:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.442+0000 7f2869ce4640 1 -- 172.21.15.53:0/1431136636 wait complete. 2024-09-13T18:26:46.460 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-13T18:26:44.936226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237536,"kb_used_data":4940,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737184,"statfs":{"total":773094113280,"available":772850876416,"internally_reserved":0,"allocated":5058560,"data_stored":2716981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.183041"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:26:37.555849+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:26:37.555849+0000","last_peered":"2024-09-13T18:26:37.555849+0000","last_clean":"2024-09-13T18:26:37.555849+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:26:37.555849+0000","last_undegraded":"2024-09-13T18:26:37.555849+0000","last_fullsized":"2024-09-13T18:26:37.555849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.21}]},{"osd":5,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.88800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":190108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.2390000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.4830000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.3280000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.752},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.4159999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.5029999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.5449999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.282}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":190108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.747},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.05},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.97399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.087},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.151}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":491520,"data_stored":195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.077},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.107}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31592,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":479232,"data_stored":190108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.626},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.95299999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.117},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.0609999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3,"5min":3,"15min":3},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.628}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.90300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.1859999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.135}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.056},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.22}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.1579999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1073152,"data_stored":780476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.497}]},{"osd":3,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:26:46.465 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:26:46.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.622+0000 7fbb2bf86640 1 Processor -- start 2024-09-13T18:26:46.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.622+0000 7fbb2bf86640 1 -- start start 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb2bf86640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb241582a0 0x7fbb2406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb2bf86640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2406d480 con 0x7fbb2415b7c0 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb2bf86640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2415ace0 con 0x7fbb240713a0 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb2bf86640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2415aaf0 con 0x7fbb241582a0 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb29d22640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb241582a0 0x7fbb2406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb29521640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbb2415b7c0 0x7fbb24070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57938/0 (socket says 172.21.15.53:57938) 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb29521640 1 -- 172.21.15.53:0/1489043489 learned_addr learned my addr 172.21.15.53:0/1489043489 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:46.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb29d22640 1 -- 172.21.15.53:0/1489043489 >> v1:172.21.15.87:6789/0 conn(0x7fbb240713a0 legacy=0x7fbb241640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:46.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb29d22640 1 -- 172.21.15.53:0/1489043489 >> v1:172.21.15.53:6789/0 conn(0x7fbb2415b7c0 legacy=0x7fbb24070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb29d22640 1 -- 172.21.15.53:0/1489043489 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2415afc0 con 0x7fbb241582a0 2024-09-13T18:26:46.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb29d22640 1 --2- 172.21.15.53:0/1489043489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb241582a0 0x7fbb2406c900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009d90 tx=0x7fbb1c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2cf0930219251f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb28d20640 1 -- 172.21.15.53:0/1489043489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0a57f0 con 0x7fbb241582a0 2024-09-13T18:26:46.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb28d20640 1 -- 172.21.15.53:0/1489043489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0a5950 con 0x7fbb241582a0 2024-09-13T18:26:46.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb28d20640 1 -- 172.21.15.53:0/1489043489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0a5ce0 con 0x7fbb241582a0 2024-09-13T18:26:46.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb2bf86640 1 -- 172.21.15.53:0/1489043489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb241582a0 msgr2=0x7fbb2406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.626+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/1489043489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb241582a0 0x7fbb2406c900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009d90 tx=0x7fbb1c01c930 comp rx=0 tx=0).stop 2024-09-13T18:26:46.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- 172.21.15.53:0/1489043489 shutdown_connections 2024-09-13T18:26:46.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/1489043489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb241582a0 0x7fbb2406c900 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- 172.21.15.53:0/1489043489 >> 172.21.15.53:0/1489043489 conn(0x7fbb24065c80 msgr2=0x7fbb24066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:46.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- 172.21.15.53:0/1489043489 shutdown_connections 2024-09-13T18:26:46.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- 172.21.15.53:0/1489043489 wait complete. 2024-09-13T18:26:46.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 Processor -- start 2024-09-13T18:26:46.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- start start 2024-09-13T18:26:46.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb240713a0 0x7fbb24149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb241582a0 0x7fbb2414bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb2415b7c0 0x7fbb24153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2414d0f0 con 0x7fbb240713a0 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2414c4e0 con 0x7fbb241582a0 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2414c7c0 con 0x7fbb2415b7c0 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb240713a0 0x7fbb24149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb240713a0 0x7fbb24149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59232/0 (socket says 172.21.15.53:59232) 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 -- 172.21.15.53:0/2054289032 learned_addr learned my addr 172.21.15.53:0/2054289032 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29521640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb241582a0 0x7fbb2414bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2a523640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb2415b7c0 0x7fbb24153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 -- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb2415b7c0 msgr2=0x7fbb24153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb2415b7c0 0x7fbb24153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 -- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb241582a0 msgr2=0x7fbb2414bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb241582a0 0x7fbb2414bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 -- 172.21.15.53:0/2054289032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c009a70 con 0x7fbb240713a0 2024-09-13T18:26:46.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2a523640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb2415b7c0 0x7fbb24153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29521640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb241582a0 0x7fbb2414bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb29d22640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb240713a0 0x7fbb24149f20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b0040 tx=0x7fbb1c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb1a7fc640 1 -- 172.21.15.53:0/2054289032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0ad850 con 0x7fbb240713a0 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb1a7fc640 1 -- 172.21.15.53:0/2054289032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0ad9b0 con 0x7fbb240713a0 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2414caa0 con 0x7fbb240713a0 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb1a7fc640 1 -- 172.21.15.53:0/2054289032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0add60 con 0x7fbb240713a0 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2414a460 con 0x7fbb240713a0 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.630+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24067400 con 0x7fbb240713a0 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.634+0000 7fbb1a7fc640 1 -- 172.21.15.53:0/2054289032 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fbb1c0b4050 con 0x7fbb240713a0 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.634+0000 7fbb1a7fc640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbb08066840 0x7fbb08068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.634+0000 7fbb1a7fc640 1 -- 172.21.15.53:0/2054289032 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb1c11f490 con 0x7fbb240713a0 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.634+0000 7fbb29521640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbb08066840 0x7fbb08068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.634+0000 7fbb29521640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbb08066840 0x7fbb08068d00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb2414dee0 tx=0x7fbb14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.638+0000 7fbb1a7fc640 1 -- 172.21.15.53:0/2054289032 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb1c0ec6a0 con 0x7fbb240713a0 2024-09-13T18:26:46.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.790+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb24067400 con 0x7fbb08066840 2024-09-13T18:26:46.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.810+0000 7fbb1a7fc640 1 -- 172.21.15.53:0/2054289032 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273468 (secure 0 0 0) 0x7fbb24067400 con 0x7fbb08066840 2024-09-13T18:26:46.816 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:46.819 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:26:46.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbb08066840 msgr2=0x7fbb08068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbb08066840 0x7fbb08068d00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb2414dee0 tx=0x7fbb14009040 comp rx=0 tx=0).stop 2024-09-13T18:26:46.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb240713a0 msgr2=0x7fbb24149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb240713a0 0x7fbb24149f20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b0040 tx=0x7fbb1c0196d0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 shutdown_connections 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbb08066840 0x7fbb08068d00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb2415b7c0 0x7fbb24153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb241582a0 0x7fbb2414bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 --2- 172.21.15.53:0/2054289032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb240713a0 0x7fbb24149f20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.814+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 >> 172.21.15.53:0/2054289032 conn(0x7fbb24065c80 msgr2=0x7fbb24156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.818+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 shutdown_connections 2024-09-13T18:26:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.818+0000 7fbb2bf86640 1 -- 172.21.15.53:0/2054289032 wait complete. 2024-09-13T18:26:46.836 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-13T18:26:44.936226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237536,"kb_used_data":4940,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737184,"statfs":{"total":773094113280,"available":772850876416,"internally_reserved":0,"allocated":5058560,"data_stored":2716981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.183041"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:41.751430+0000","last_change":"2024-09-13T18:26:41.751430+0000","last_active":"2024-09-13T18:26:41.751430+0000","last_peered":"2024-09-13T18:26:41.751430+0000","last_clean":"2024-09-13T18:26:41.751430+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:41.751430+0000","last_undegraded":"2024-09-13T18:26:41.751430+0000","last_fullsized":"2024-09-13T18:26:41.751430+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:26:40.747805+0000","last_change":"2024-09-13T18:26:40.747805+0000","last_active":"2024-09-13T18:26:40.747805+0000","last_peered":"2024-09-13T18:26:40.747805+0000","last_clean":"2024-09-13T18:26:40.747805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:26:40.747805+0000","last_undegraded":"2024-09-13T18:26:40.747805+0000","last_fullsized":"2024-09-13T18:26:40.747805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-13T18:26:37.555849+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:26:37.555849+0000","last_peered":"2024-09-13T18:26:37.555849+0000","last_clean":"2024-09-13T18:26:37.555849+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:26:37.555849+0000","last_undegraded":"2024-09-13T18:26:37.555849+0000","last_fullsized":"2024-09-13T18:26:37.555849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.21}]},{"osd":5,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.88800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":190108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.2390000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.4830000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.3280000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.752},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.4159999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.5029999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.5449999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.282}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":190108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.747},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.89000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.05},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.97399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.087},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.83799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.151}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":491520,"data_stored":195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.077},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.107}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31592,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":479232,"data_stored":190108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.626},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.95299999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.2629999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.117},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.0609999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3,"5min":3,"15min":3},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.628}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.90300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.1859999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.135}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.056},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.22}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.1579999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1073152,"data_stored":780476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.497}]},{"osd":3,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:26:46.840 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:26:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.998+0000 7f983a85d640 1 Processor -- start 2024-09-13T18:26:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:46.998+0000 7f983a85d640 1 -- start start 2024-09-13T18:26:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f983a85d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f983415b7c0 0x7f9834070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f983a85d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983406d480 con 0x7f98340711d0 2024-09-13T18:26:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f983a85d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983415ace0 con 0x7f98341582a0 2024-09-13T18:26:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f983a85d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9834071680 con 0x7f983415b7c0 2024-09-13T18:26:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f9838dfa640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98340711d0 0x7f98341640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57942/0 (socket says 172.21.15.53:57942) 2024-09-13T18:26:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f9838dfa640 1 -- 172.21.15.53:0/4256214214 learned_addr learned my addr 172.21.15.53:0/4256214214 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f98337fe640 1 --2- 172.21.15.53:0/4256214214 >> v2:172.21.15.53:3300/0 conn(0x7f983415b7c0 0x7f9834070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f98337fe640 1 -- 172.21.15.53:0/4256214214 >> v1:172.21.15.87:6789/0 conn(0x7f98341582a0 legacy=0x7f983406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f98337fe640 1 -- 172.21.15.53:0/4256214214 >> v1:172.21.15.53:6789/0 conn(0x7f98340711d0 legacy=0x7f98341640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f98337fe640 1 -- 172.21.15.53:0/4256214214 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983415afc0 con 0x7f983415b7c0 2024-09-13T18:26:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.002+0000 7f9832ffd640 1 -- 172.21.15.53:0/4256214214 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606843508 0 0) 0x7f983406d480 con 0x7f98340711d0 2024-09-13T18:26:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f98337fe640 1 --2- 172.21.15.53:0/4256214214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f983415b7c0 0x7f9834070c90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f98280097c0 tx=0x7f982801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a37389b35f776f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f9832ffd640 1 -- 172.21.15.53:0/4256214214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280ab600 con 0x7f983415b7c0 2024-09-13T18:26:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f9832ffd640 1 -- 172.21.15.53:0/4256214214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98280a7050 con 0x7f983415b7c0 2024-09-13T18:26:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f9832ffd640 1 -- 172.21.15.53:0/4256214214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280ab980 con 0x7f983415b7c0 2024-09-13T18:26:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 -- 172.21.15.53:0/4256214214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f983415b7c0 msgr2=0x7f9834070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 --2- 172.21.15.53:0/4256214214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f983415b7c0 0x7f9834070c90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f98280097c0 tx=0x7f982801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 -- 172.21.15.53:0/4256214214 shutdown_connections 2024-09-13T18:26:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 --2- 172.21.15.53:0/4256214214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f983415b7c0 0x7f9834070c90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 -- 172.21.15.53:0/4256214214 >> 172.21.15.53:0/4256214214 conn(0x7f9834065c80 msgr2=0x7f9834066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 -- 172.21.15.53:0/4256214214 shutdown_connections 2024-09-13T18:26:47.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 -- 172.21.15.53:0/4256214214 wait complete. 2024-09-13T18:26:47.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 Processor -- start 2024-09-13T18:26:47.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.006+0000 7f983a85d640 1 -- start start 2024-09-13T18:26:47.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98340711d0 0x7f983414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98341582a0 0x7f98340aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983415b7c0 0x7f983414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983414b450 con 0x7f98340711d0 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834156dc0 con 0x7f983415b7c0 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98341570a0 con 0x7f98341582a0 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98340711d0 0x7f983414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98340711d0 0x7f983414af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59238/0 (socket says 172.21.15.53:59238) 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 -- 172.21.15.53:0/783937446 learned_addr learned my addr 172.21.15.53:0/783937446 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f98337fe640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98341582a0 0x7f98340aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9838dfa640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983415b7c0 0x7f983414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 -- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98341582a0 msgr2=0x7f98340aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98341582a0 0x7f98340aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 -- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983415b7c0 msgr2=0x7f983414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983415b7c0 0x7f983414eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 -- 172.21.15.53:0/783937446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828009420 con 0x7f98340711d0 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f98337fe640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98341582a0 0x7f98340aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9838dfa640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983415b7c0 0x7f983414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9833fff640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98340711d0 0x7f983414af10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f982400c500 tx=0x7f982400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9830ff9640 1 -- 172.21.15.53:0/783937446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824005220 con 0x7f98340711d0 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9830ff9640 1 -- 172.21.15.53:0/783937446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824005380 con 0x7f98340711d0 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9830ff9640 1 -- 172.21.15.53:0/783937446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824007270 con 0x7f98340711d0 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9834157380 con 0x7f98340711d0 2024-09-13T18:26:47.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983414ead0 con 0x7f98340711d0 2024-09-13T18:26:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9834067400 con 0x7f98340711d0 2024-09-13T18:26:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9830ff9640 1 -- 172.21.15.53:0/783937446 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f98240073d0 con 0x7f98340711d0 2024-09-13T18:26:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9830ff9640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9820066840 0x7f9820068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f9830ff9640 1 -- 172.21.15.53:0/783937446 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9824083da0 con 0x7f98340711d0 2024-09-13T18:26:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.010+0000 7f98337fe640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9820066840 0x7f9820068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.014+0000 7f98337fe640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9820066840 0x7f9820068d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f98280ad000 tx=0x7f9828008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.014+0000 7f9830ff9640 1 -- 172.21.15.53:0/783937446 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9824050ea0 con 0x7f98340711d0 2024-09-13T18:26:47.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.170+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f983406d220 con 0x7f9820066840 2024-09-13T18:26:47.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.194+0000 7f9830ff9640 1 -- 172.21.15.53:0/783937446 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288050 (secure 0 0 0) 0x7f98280ab740 con 0x7f9820066840 2024-09-13T18:26:47.198 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9820066840 msgr2=0x7f9820068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9820066840 0x7f9820068d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f98280ad000 tx=0x7f9828008040 comp rx=0 tx=0).stop 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98340711d0 msgr2=0x7f983414af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98340711d0 0x7f983414af10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f982400c500 tx=0x7f982400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 shutdown_connections 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9820066840 0x7f9820068d00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98341582a0 0x7f98340aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f983415b7c0 0x7f983414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 --2- 172.21.15.53:0/783937446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98340711d0 0x7f983414af10 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 >> 172.21.15.53:0/783937446 conn(0x7f9834065c80 msgr2=0x7f9834153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 shutdown_connections 2024-09-13T18:26:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.198+0000 7f983a85d640 1 -- 172.21.15.53:0/783937446 wait complete. 2024-09-13T18:26:47.219 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-13T18:26:46.936736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246180,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754728540,"statfs":{"total":773094113280,"available":772842024960,"internally_reserved":0,"allocated":5529600,"data_stored":2923412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":246402616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001691"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.214332+0000","last_change":"2024-09-13T18:26:42.200662+0000","last_active":"2024-09-13T18:26:42.214332+0000","last_peered":"2024-09-13T18:26:42.214332+0000","last_clean":"2024-09-13T18:26:42.214332+0000","last_became_active":"2024-09-13T18:26:42.200015+0000","last_became_peered":"2024-09-13T18:26:42.200015+0000","last_unstale":"2024-09-13T18:26:42.214332+0000","last_undegraded":"2024-09-13T18:26:42.214332+0000","last_fullsized":"2024-09-13T18:26:42.214332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178104+0000","last_change":"2024-09-13T18:26:42.187659+0000","last_active":"2024-09-13T18:26:43.178104+0000","last_peered":"2024-09-13T18:26:43.178104+0000","last_clean":"2024-09-13T18:26:43.178104+0000","last_became_active":"2024-09-13T18:26:42.185980+0000","last_became_peered":"2024-09-13T18:26:42.185980+0000","last_unstale":"2024-09-13T18:26:43.178104+0000","last_undegraded":"2024-09-13T18:26:43.178104+0000","last_fullsized":"2024-09-13T18:26:43.178104+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.179222+0000","last_change":"2024-09-13T18:26:42.172685+0000","last_active":"2024-09-13T18:26:42.179222+0000","last_peered":"2024-09-13T18:26:42.179222+0000","last_clean":"2024-09-13T18:26:42.179222+0000","last_became_active":"2024-09-13T18:26:42.171857+0000","last_became_peered":"2024-09-13T18:26:42.171857+0000","last_unstale":"2024-09-13T18:26:42.179222+0000","last_undegraded":"2024-09-13T18:26:42.179222+0000","last_fullsized":"2024-09-13T18:26:42.179222+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.380421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382058+0000","last_change":"2024-09-13T18:26:42.212976+0000","last_active":"2024-09-13T18:26:44.382058+0000","last_peered":"2024-09-13T18:26:44.382058+0000","last_clean":"2024-09-13T18:26:44.382058+0000","last_became_active":"2024-09-13T18:26:42.212748+0000","last_became_peered":"2024-09-13T18:26:42.212748+0000","last_unstale":"2024-09-13T18:26:44.382058+0000","last_undegraded":"2024-09-13T18:26:44.382058+0000","last_fullsized":"2024-09-13T18:26:44.382058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:42.682099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177842+0000","last_change":"2024-09-13T18:26:42.189143+0000","last_active":"2024-09-13T18:26:43.177842+0000","last_peered":"2024-09-13T18:26:43.177842+0000","last_clean":"2024-09-13T18:26:43.177842+0000","last_became_active":"2024-09-13T18:26:42.188457+0000","last_became_peered":"2024-09-13T18:26:42.188457+0000","last_unstale":"2024-09-13T18:26:43.177842+0000","last_undegraded":"2024-09-13T18:26:43.177842+0000","last_fullsized":"2024-09-13T18:26:43.177842+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:42.682099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.202698+0000","last_change":"2024-09-13T18:26:42.197953+0000","last_active":"2024-09-13T18:26:42.202698+0000","last_peered":"2024-09-13T18:26:42.202698+0000","last_clean":"2024-09-13T18:26:42.202698+0000","last_became_active":"2024-09-13T18:26:42.197326+0000","last_became_peered":"2024-09-13T18:26:42.197326+0000","last_unstale":"2024-09-13T18:26:42.202698+0000","last_undegraded":"2024-09-13T18:26:42.202698+0000","last_fullsized":"2024-09-13T18:26:42.202698+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:13.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.211592+0000","last_change":"2024-09-13T18:26:42.196638+0000","last_active":"2024-09-13T18:26:42.211592+0000","last_peered":"2024-09-13T18:26:42.211592+0000","last_clean":"2024-09-13T18:26:42.211592+0000","last_became_active":"2024-09-13T18:26:42.195610+0000","last_became_peered":"2024-09-13T18:26:42.195610+0000","last_unstale":"2024-09-13T18:26:42.211592+0000","last_undegraded":"2024-09-13T18:26:42.211592+0000","last_fullsized":"2024-09-13T18:26:42.211592+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381490+0000","last_change":"2024-09-13T18:26:42.196478+0000","last_active":"2024-09-13T18:26:44.381490+0000","last_peered":"2024-09-13T18:26:44.381490+0000","last_clean":"2024-09-13T18:26:44.381490+0000","last_became_active":"2024-09-13T18:26:42.195254+0000","last_became_peered":"2024-09-13T18:26:42.195254+0000","last_unstale":"2024-09-13T18:26:44.381490+0000","last_undegraded":"2024-09-13T18:26:44.381490+0000","last_fullsized":"2024-09-13T18:26:44.381490+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:08.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382316+0000","last_change":"2024-09-13T18:26:42.184646+0000","last_active":"2024-09-13T18:26:44.382316+0000","last_peered":"2024-09-13T18:26:44.382316+0000","last_clean":"2024-09-13T18:26:44.382316+0000","last_became_active":"2024-09-13T18:26:42.184380+0000","last_became_peered":"2024-09-13T18:26:42.184380+0000","last_unstale":"2024-09-13T18:26:44.382316+0000","last_undegraded":"2024-09-13T18:26:44.382316+0000","last_fullsized":"2024-09-13T18:26:44.382316+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:03.518337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382406+0000","last_change":"2024-09-13T18:26:42.211909+0000","last_active":"2024-09-13T18:26:44.382406+0000","last_peered":"2024-09-13T18:26:44.382406+0000","last_clean":"2024-09-13T18:26:44.382406+0000","last_became_active":"2024-09-13T18:26:42.211601+0000","last_became_peered":"2024-09-13T18:26:42.211601+0000","last_unstale":"2024-09-13T18:26:44.382406+0000","last_undegraded":"2024-09-13T18:26:44.382406+0000","last_fullsized":"2024-09-13T18:26:44.382406+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:11.397925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382230+0000","last_change":"2024-09-13T18:26:42.186875+0000","last_active":"2024-09-13T18:26:44.382230+0000","last_peered":"2024-09-13T18:26:44.382230+0000","last_clean":"2024-09-13T18:26:44.382230+0000","last_became_active":"2024-09-13T18:26:42.186612+0000","last_became_peered":"2024-09-13T18:26:42.186612+0000","last_unstale":"2024-09-13T18:26:44.382230+0000","last_undegraded":"2024-09-13T18:26:44.382230+0000","last_fullsized":"2024-09-13T18:26:44.382230+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.288195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177708+0000","last_change":"2024-09-13T18:26:42.193062+0000","last_active":"2024-09-13T18:26:43.177708+0000","last_peered":"2024-09-13T18:26:43.177708+0000","last_clean":"2024-09-13T18:26:43.177708+0000","last_became_active":"2024-09-13T18:26:42.192371+0000","last_became_peered":"2024-09-13T18:26:42.192371+0000","last_unstale":"2024-09-13T18:26:43.177708+0000","last_undegraded":"2024-09-13T18:26:43.177708+0000","last_fullsized":"2024-09-13T18:26:43.177708+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:14.728821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872036+0000","last_change":"2024-09-13T18:26:42.179904+0000","last_active":"2024-09-13T18:26:43.872036+0000","last_peered":"2024-09-13T18:26:43.872036+0000","last_clean":"2024-09-13T18:26:43.872036+0000","last_became_active":"2024-09-13T18:26:42.178013+0000","last_became_peered":"2024-09-13T18:26:42.178013+0000","last_unstale":"2024-09-13T18:26:43.872036+0000","last_undegraded":"2024-09-13T18:26:43.872036+0000","last_fullsized":"2024-09-13T18:26:43.872036+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:05.950445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381747+0000","last_change":"2024-09-13T18:26:42.185257+0000","last_active":"2024-09-13T18:26:44.381747+0000","last_peered":"2024-09-13T18:26:44.381747+0000","last_clean":"2024-09-13T18:26:44.381747+0000","last_became_active":"2024-09-13T18:26:42.184976+0000","last_became_peered":"2024-09-13T18:26:42.184976+0000","last_unstale":"2024-09-13T18:26:44.381747+0000","last_undegraded":"2024-09-13T18:26:44.381747+0000","last_fullsized":"2024-09-13T18:26:44.381747+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:49.638441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182717+0000","last_change":"2024-09-13T18:26:42.181552+0000","last_active":"2024-09-13T18:26:42.182717+0000","last_peered":"2024-09-13T18:26:42.182717+0000","last_clean":"2024-09-13T18:26:42.182717+0000","last_became_active":"2024-09-13T18:26:42.180992+0000","last_became_peered":"2024-09-13T18:26:42.180992+0000","last_unstale":"2024-09-13T18:26:42.182717+0000","last_undegraded":"2024-09-13T18:26:42.182717+0000","last_fullsized":"2024-09-13T18:26:42.182717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:54.959235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083466+0000","last_change":"2024-09-13T18:26:42.186980+0000","last_active":"2024-09-13T18:26:45.083466+0000","last_peered":"2024-09-13T18:26:45.083466+0000","last_clean":"2024-09-13T18:26:45.083466+0000","last_became_active":"2024-09-13T18:26:42.185980+0000","last_became_peered":"2024-09-13T18:26:42.185980+0000","last_unstale":"2024-09-13T18:26:45.083466+0000","last_undegraded":"2024-09-13T18:26:45.083466+0000","last_fullsized":"2024-09-13T18:26:45.083466+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:45.826157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.195682+0000","last_change":"2024-09-13T18:26:42.188559+0000","last_active":"2024-09-13T18:26:42.195682+0000","last_peered":"2024-09-13T18:26:42.195682+0000","last_clean":"2024-09-13T18:26:42.195682+0000","last_became_active":"2024-09-13T18:26:42.187794+0000","last_became_peered":"2024-09-13T18:26:42.187794+0000","last_unstale":"2024-09-13T18:26:42.195682+0000","last_undegraded":"2024-09-13T18:26:42.195682+0000","last_fullsized":"2024-09-13T18:26:42.195682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:03.518337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.183203+0000","last_change":"2024-09-13T18:26:42.178481+0000","last_active":"2024-09-13T18:26:42.183203+0000","last_peered":"2024-09-13T18:26:42.183203+0000","last_clean":"2024-09-13T18:26:42.183203+0000","last_became_active":"2024-09-13T18:26:42.177786+0000","last_became_peered":"2024-09-13T18:26:42.177786+0000","last_unstale":"2024-09-13T18:26:42.183203+0000","last_undegraded":"2024-09-13T18:26:42.183203+0000","last_fullsized":"2024-09-13T18:26:42.183203+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.288195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083669+0000","last_change":"2024-09-13T18:26:42.212807+0000","last_active":"2024-09-13T18:26:45.083669+0000","last_peered":"2024-09-13T18:26:45.083669+0000","last_clean":"2024-09-13T18:26:45.083669+0000","last_became_active":"2024-09-13T18:26:42.212186+0000","last_became_peered":"2024-09-13T18:26:42.212186+0000","last_unstale":"2024-09-13T18:26:45.083669+0000","last_undegraded":"2024-09-13T18:26:45.083669+0000","last_fullsized":"2024-09-13T18:26:45.083669+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:55.423521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872073+0000","last_change":"2024-09-13T18:26:42.179546+0000","last_active":"2024-09-13T18:26:43.872073+0000","last_peered":"2024-09-13T18:26:43.872073+0000","last_clean":"2024-09-13T18:26:43.872073+0000","last_became_active":"2024-09-13T18:26:42.179265+0000","last_became_peered":"2024-09-13T18:26:42.179265+0000","last_unstale":"2024-09-13T18:26:43.872073+0000","last_undegraded":"2024-09-13T18:26:43.872073+0000","last_fullsized":"2024-09-13T18:26:43.872073+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:36.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.214232+0000","last_change":"2024-09-13T18:26:42.213648+0000","last_active":"2024-09-13T18:26:42.214232+0000","last_peered":"2024-09-13T18:26:42.214232+0000","last_clean":"2024-09-13T18:26:42.214232+0000","last_became_active":"2024-09-13T18:26:42.213415+0000","last_became_peered":"2024-09-13T18:26:42.213415+0000","last_unstale":"2024-09-13T18:26:42.214232+0000","last_undegraded":"2024-09-13T18:26:42.214232+0000","last_fullsized":"2024-09-13T18:26:42.214232+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:28.295627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381725+0000","last_change":"2024-09-13T18:26:42.214989+0000","last_active":"2024-09-13T18:26:44.381725+0000","last_peered":"2024-09-13T18:26:44.381725+0000","last_clean":"2024-09-13T18:26:44.381725+0000","last_became_active":"2024-09-13T18:26:42.214712+0000","last_became_peered":"2024-09-13T18:26:42.214712+0000","last_unstale":"2024-09-13T18:26:44.381725+0000","last_undegraded":"2024-09-13T18:26:44.381725+0000","last_fullsized":"2024-09-13T18:26:44.381725+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:33.671323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083176+0000","last_change":"2024-09-13T18:26:42.206421+0000","last_active":"2024-09-13T18:26:45.083176+0000","last_peered":"2024-09-13T18:26:45.083176+0000","last_clean":"2024-09-13T18:26:45.083176+0000","last_became_active":"2024-09-13T18:26:42.205617+0000","last_became_peered":"2024-09-13T18:26:42.205617+0000","last_unstale":"2024-09-13T18:26:45.083176+0000","last_undegraded":"2024-09-13T18:26:45.083176+0000","last_fullsized":"2024-09-13T18:26:45.083176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:34.533154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083110+0000","last_change":"2024-09-13T18:26:42.206165+0000","last_active":"2024-09-13T18:26:45.083110+0000","last_peered":"2024-09-13T18:26:45.083110+0000","last_clean":"2024-09-13T18:26:45.083110+0000","last_became_active":"2024-09-13T18:26:42.205424+0000","last_became_peered":"2024-09-13T18:26:42.205424+0000","last_unstale":"2024-09-13T18:26:45.083110+0000","last_undegraded":"2024-09-13T18:26:45.083110+0000","last_fullsized":"2024-09-13T18:26:45.083110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:46.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083918+0000","last_change":"2024-09-13T18:26:42.216221+0000","last_active":"2024-09-13T18:26:45.083918+0000","last_peered":"2024-09-13T18:26:45.083918+0000","last_clean":"2024-09-13T18:26:45.083918+0000","last_became_active":"2024-09-13T18:26:42.214495+0000","last_became_peered":"2024-09-13T18:26:42.214495+0000","last_unstale":"2024-09-13T18:26:45.083918+0000","last_undegraded":"2024-09-13T18:26:45.083918+0000","last_fullsized":"2024-09-13T18:26:45.083918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:36.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872153+0000","last_change":"2024-09-13T18:26:42.175912+0000","last_active":"2024-09-13T18:26:43.872153+0000","last_peered":"2024-09-13T18:26:43.872153+0000","last_clean":"2024-09-13T18:26:43.872153+0000","last_became_active":"2024-09-13T18:26:42.174011+0000","last_became_peered":"2024-09-13T18:26:42.174011+0000","last_unstale":"2024-09-13T18:26:43.872153+0000","last_undegraded":"2024-09-13T18:26:43.872153+0000","last_fullsized":"2024-09-13T18:26:43.872153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:46.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.203107+0000","last_change":"2024-09-13T18:26:42.189508+0000","last_active":"2024-09-13T18:26:42.203107+0000","last_peered":"2024-09-13T18:26:42.203107+0000","last_clean":"2024-09-13T18:26:42.203107+0000","last_became_active":"2024-09-13T18:26:42.188654+0000","last_became_peered":"2024-09-13T18:26:42.188654+0000","last_unstale":"2024-09-13T18:26:42.203107+0000","last_undegraded":"2024-09-13T18:26:42.203107+0000","last_fullsized":"2024-09-13T18:26:42.203107+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:33.671323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178118+0000","last_change":"2024-09-13T18:26:42.193002+0000","last_active":"2024-09-13T18:26:43.178118+0000","last_peered":"2024-09-13T18:26:43.178118+0000","last_clean":"2024-09-13T18:26:43.178118+0000","last_became_active":"2024-09-13T18:26:42.191614+0000","last_became_peered":"2024-09-13T18:26:42.191614+0000","last_unstale":"2024-09-13T18:26:43.178118+0000","last_undegraded":"2024-09-13T18:26:43.178118+0000","last_fullsized":"2024-09-13T18:26:43.178118+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083375+0000","last_change":"2024-09-13T18:26:42.213714+0000","last_active":"2024-09-13T18:26:45.083375+0000","last_peered":"2024-09-13T18:26:45.083375+0000","last_clean":"2024-09-13T18:26:45.083375+0000","last_became_active":"2024-09-13T18:26:42.213065+0000","last_became_peered":"2024-09-13T18:26:42.213065+0000","last_unstale":"2024-09-13T18:26:45.083375+0000","last_undegraded":"2024-09-13T18:26:45.083375+0000","last_fullsized":"2024-09-13T18:26:45.083375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:38.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.202582+0000","last_change":"2024-09-13T18:26:42.198684+0000","last_active":"2024-09-13T18:26:42.202582+0000","last_peered":"2024-09-13T18:26:42.202582+0000","last_clean":"2024-09-13T18:26:42.202582+0000","last_became_active":"2024-09-13T18:26:42.197996+0000","last_became_peered":"2024-09-13T18:26:42.197996+0000","last_unstale":"2024-09-13T18:26:42.202582+0000","last_undegraded":"2024-09-13T18:26:42.202582+0000","last_fullsized":"2024-09-13T18:26:42.202582+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:49.638441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.191442+0000","last_change":"2024-09-13T18:26:42.190799+0000","last_active":"2024-09-13T18:26:42.191442+0000","last_peered":"2024-09-13T18:26:42.191442+0000","last_clean":"2024-09-13T18:26:42.191442+0000","last_became_active":"2024-09-13T18:26:42.190559+0000","last_became_peered":"2024-09-13T18:26:42.190559+0000","last_unstale":"2024-09-13T18:26:42.191442+0000","last_undegraded":"2024-09-13T18:26:42.191442+0000","last_fullsized":"2024-09-13T18:26:42.191442+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:32.668533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.871706+0000","last_change":"2024-09-13T18:26:42.185094+0000","last_active":"2024-09-13T18:26:43.871706+0000","last_peered":"2024-09-13T18:26:43.871706+0000","last_clean":"2024-09-13T18:26:43.871706+0000","last_became_active":"2024-09-13T18:26:42.184831+0000","last_became_peered":"2024-09-13T18:26:42.184831+0000","last_unstale":"2024-09-13T18:26:43.871706+0000","last_undegraded":"2024-09-13T18:26:43.871706+0000","last_fullsized":"2024-09-13T18:26:43.871706+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:38.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172805+0000","last_change":"2024-09-13T18:26:42.183841+0000","last_active":"2024-09-13T18:26:43.172805+0000","last_peered":"2024-09-13T18:26:43.172805+0000","last_clean":"2024-09-13T18:26:43.172805+0000","last_became_active":"2024-09-13T18:26:42.183506+0000","last_became_peered":"2024-09-13T18:26:42.183506+0000","last_unstale":"2024-09-13T18:26:43.172805+0000","last_undegraded":"2024-09-13T18:26:43.172805+0000","last_fullsized":"2024-09-13T18:26:43.172805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:15.825996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.213764+0000","last_change":"2024-09-13T18:26:41.780313+0000","last_active":"2024-09-13T18:26:42.213764+0000","last_peered":"2024-09-13T18:26:42.213764+0000","last_clean":"2024-09-13T18:26:42.213764+0000","last_became_active":"2024-09-13T18:26:41.779907+0000","last_became_peered":"2024-09-13T18:26:41.779907+0000","last_unstale":"2024-09-13T18:26:42.213764+0000","last_undegraded":"2024-09-13T18:26:42.213764+0000","last_fullsized":"2024-09-13T18:26:42.213764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:48.634817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.084065+0000","last_change":"2024-09-13T18:26:42.216626+0000","last_active":"2024-09-13T18:26:45.084065+0000","last_peered":"2024-09-13T18:26:45.084065+0000","last_clean":"2024-09-13T18:26:45.084065+0000","last_became_active":"2024-09-13T18:26:42.215190+0000","last_became_peered":"2024-09-13T18:26:42.215190+0000","last_unstale":"2024-09-13T18:26:45.084065+0000","last_undegraded":"2024-09-13T18:26:45.084065+0000","last_fullsized":"2024-09-13T18:26:45.084065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:27.097044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.220602+0000","last_change":"2024-09-13T18:26:41.798871+0000","last_active":"2024-09-13T18:26:42.220602+0000","last_peered":"2024-09-13T18:26:42.220602+0000","last_clean":"2024-09-13T18:26:42.220602+0000","last_became_active":"2024-09-13T18:26:41.794811+0000","last_became_peered":"2024-09-13T18:26:41.794811+0000","last_unstale":"2024-09-13T18:26:42.220602+0000","last_undegraded":"2024-09-13T18:26:42.220602+0000","last_fullsized":"2024-09-13T18:26:42.220602+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:35.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177988+0000","last_change":"2024-09-13T18:26:42.192464+0000","last_active":"2024-09-13T18:26:43.177988+0000","last_peered":"2024-09-13T18:26:43.177988+0000","last_clean":"2024-09-13T18:26:43.177988+0000","last_became_active":"2024-09-13T18:26:42.191543+0000","last_became_peered":"2024-09-13T18:26:42.191543+0000","last_unstale":"2024-09-13T18:26:43.177988+0000","last_undegraded":"2024-09-13T18:26:43.177988+0000","last_fullsized":"2024-09-13T18:26:43.177988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172822+0000","last_change":"2024-09-13T18:26:41.804324+0000","last_active":"2024-09-13T18:26:43.172822+0000","last_peered":"2024-09-13T18:26:43.172822+0000","last_clean":"2024-09-13T18:26:43.172822+0000","last_became_active":"2024-09-13T18:26:41.803835+0000","last_became_peered":"2024-09-13T18:26:41.803835+0000","last_unstale":"2024-09-13T18:26:43.172822+0000","last_undegraded":"2024-09-13T18:26:43.172822+0000","last_fullsized":"2024-09-13T18:26:43.172822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:53.883190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172892+0000","last_change":"2024-09-13T18:26:42.214914+0000","last_active":"2024-09-13T18:26:43.172892+0000","last_peered":"2024-09-13T18:26:43.172892+0000","last_clean":"2024-09-13T18:26:43.172892+0000","last_became_active":"2024-09-13T18:26:42.214639+0000","last_became_peered":"2024-09-13T18:26:42.214639+0000","last_unstale":"2024-09-13T18:26:43.172892+0000","last_undegraded":"2024-09-13T18:26:43.172892+0000","last_fullsized":"2024-09-13T18:26:43.172892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:01.193783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.220186+0000","last_change":"2024-09-13T18:26:41.812573+0000","last_active":"2024-09-13T18:26:42.220186+0000","last_peered":"2024-09-13T18:26:42.220186+0000","last_clean":"2024-09-13T18:26:42.220186+0000","last_became_active":"2024-09-13T18:26:41.811864+0000","last_became_peered":"2024-09-13T18:26:41.811864+0000","last_unstale":"2024-09-13T18:26:42.220186+0000","last_undegraded":"2024-09-13T18:26:42.220186+0000","last_fullsized":"2024-09-13T18:26:42.220186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:00.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.218331+0000","last_change":"2024-09-13T18:26:42.216352+0000","last_active":"2024-09-13T18:26:42.218331+0000","last_peered":"2024-09-13T18:26:42.218331+0000","last_clean":"2024-09-13T18:26:42.218331+0000","last_became_active":"2024-09-13T18:26:42.215741+0000","last_became_peered":"2024-09-13T18:26:42.215741+0000","last_unstale":"2024-09-13T18:26:42.218331+0000","last_undegraded":"2024-09-13T18:26:42.218331+0000","last_fullsized":"2024-09-13T18:26:42.218331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:59.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.211537+0000","last_change":"2024-09-13T18:26:41.796032+0000","last_active":"2024-09-13T18:26:42.211537+0000","last_peered":"2024-09-13T18:26:42.211537+0000","last_clean":"2024-09-13T18:26:42.211537+0000","last_became_active":"2024-09-13T18:26:41.795232+0000","last_became_peered":"2024-09-13T18:26:41.795232+0000","last_unstale":"2024-09-13T18:26:42.211537+0000","last_undegraded":"2024-09-13T18:26:42.211537+0000","last_fullsized":"2024-09-13T18:26:42.211537+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:41.678475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381800+0000","last_change":"2024-09-13T18:26:42.180214+0000","last_active":"2024-09-13T18:26:44.381800+0000","last_peered":"2024-09-13T18:26:44.381800+0000","last_clean":"2024-09-13T18:26:44.381800+0000","last_became_active":"2024-09-13T18:26:42.179478+0000","last_became_peered":"2024-09-13T18:26:42.179478+0000","last_unstale":"2024-09-13T18:26:44.381800+0000","last_undegraded":"2024-09-13T18:26:44.381800+0000","last_fullsized":"2024-09-13T18:26:44.381800+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:34.533154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.210289+0000","last_change":"2024-09-13T18:26:41.804378+0000","last_active":"2024-09-13T18:26:42.210289+0000","last_peered":"2024-09-13T18:26:42.210289+0000","last_clean":"2024-09-13T18:26:42.210289+0000","last_became_active":"2024-09-13T18:26:41.803629+0000","last_became_peered":"2024-09-13T18:26:41.803629+0000","last_unstale":"2024-09-13T18:26:42.210289+0000","last_undegraded":"2024-09-13T18:26:42.210289+0000","last_fullsized":"2024-09-13T18:26:42.210289+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:57.373104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381499+0000","last_change":"2024-09-13T18:26:42.206083+0000","last_active":"2024-09-13T18:26:44.381499+0000","last_peered":"2024-09-13T18:26:44.381499+0000","last_clean":"2024-09-13T18:26:44.381499+0000","last_became_active":"2024-09-13T18:26:42.205808+0000","last_became_peered":"2024-09-13T18:26:42.205808+0000","last_unstale":"2024-09-13T18:26:44.381499+0000","last_undegraded":"2024-09-13T18:26:44.381499+0000","last_fullsized":"2024-09-13T18:26:44.381499+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:59.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177385+0000","last_change":"2024-09-13T18:26:41.791880+0000","last_active":"2024-09-13T18:26:43.177385+0000","last_peered":"2024-09-13T18:26:43.177385+0000","last_clean":"2024-09-13T18:26:43.177385+0000","last_became_active":"2024-09-13T18:26:41.791182+0000","last_became_peered":"2024-09-13T18:26:41.791182+0000","last_unstale":"2024-09-13T18:26:43.177385+0000","last_undegraded":"2024-09-13T18:26:43.177385+0000","last_fullsized":"2024-09-13T18:26:43.177385+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:58.239230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.082894+0000","last_change":"2024-09-13T18:26:42.206038+0000","last_active":"2024-09-13T18:26:45.082894+0000","last_peered":"2024-09-13T18:26:45.082894+0000","last_clean":"2024-09-13T18:26:45.082894+0000","last_became_active":"2024-09-13T18:26:42.205461+0000","last_became_peered":"2024-09-13T18:26:42.205461+0000","last_unstale":"2024-09-13T18:26:45.082894+0000","last_undegraded":"2024-09-13T18:26:45.082894+0000","last_fullsized":"2024-09-13T18:26:45.082894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:56.153102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381623+0000","last_change":"2024-09-13T18:26:41.788633+0000","last_active":"2024-09-13T18:26:44.381623+0000","last_peered":"2024-09-13T18:26:44.381623+0000","last_clean":"2024-09-13T18:26:44.381623+0000","last_became_active":"2024-09-13T18:26:41.787982+0000","last_became_peered":"2024-09-13T18:26:41.787982+0000","last_unstale":"2024-09-13T18:26:44.381623+0000","last_undegraded":"2024-09-13T18:26:44.381623+0000","last_fullsized":"2024-09-13T18:26:44.381623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:36.601061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.183103+0000","last_change":"2024-09-13T18:26:42.178417+0000","last_active":"2024-09-13T18:26:42.183103+0000","last_peered":"2024-09-13T18:26:42.183103+0000","last_clean":"2024-09-13T18:26:42.183103+0000","last_became_active":"2024-09-13T18:26:42.177724+0000","last_became_peered":"2024-09-13T18:26:42.177724+0000","last_unstale":"2024-09-13T18:26:42.183103+0000","last_undegraded":"2024-09-13T18:26:42.183103+0000","last_fullsized":"2024-09-13T18:26:42.183103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:22.661205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.167963+0000","last_change":"2024-09-13T18:26:41.793817+0000","last_active":"2024-09-13T18:26:42.167963+0000","last_peered":"2024-09-13T18:26:42.167963+0000","last_clean":"2024-09-13T18:26:42.167963+0000","last_became_active":"2024-09-13T18:26:41.793113+0000","last_became_peered":"2024-09-13T18:26:41.793113+0000","last_unstale":"2024-09-13T18:26:42.167963+0000","last_undegraded":"2024-09-13T18:26:42.167963+0000","last_fullsized":"2024-09-13T18:26:42.167963+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:04.946821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.217257+0000","last_change":"2024-09-13T18:26:42.209275+0000","last_active":"2024-09-13T18:26:42.217257+0000","last_peered":"2024-09-13T18:26:42.217257+0000","last_clean":"2024-09-13T18:26:42.217257+0000","last_became_active":"2024-09-13T18:26:42.207633+0000","last_became_peered":"2024-09-13T18:26:42.207633+0000","last_unstale":"2024-09-13T18:26:42.217257+0000","last_undegraded":"2024-09-13T18:26:42.217257+0000","last_fullsized":"2024-09-13T18:26:42.217257+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:58.804712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382562+0000","last_change":"2024-09-13T18:26:41.801027+0000","last_active":"2024-09-13T18:26:44.382562+0000","last_peered":"2024-09-13T18:26:44.382562+0000","last_clean":"2024-09-13T18:26:44.382562+0000","last_became_active":"2024-09-13T18:26:41.800553+0000","last_became_peered":"2024-09-13T18:26:41.800553+0000","last_unstale":"2024-09-13T18:26:44.382562+0000","last_undegraded":"2024-09-13T18:26:44.382562+0000","last_fullsized":"2024-09-13T18:26:44.382562+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:36.003767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182568+0000","last_change":"2024-09-13T18:26:42.179684+0000","last_active":"2024-09-13T18:26:42.182568+0000","last_peered":"2024-09-13T18:26:42.182568+0000","last_clean":"2024-09-13T18:26:42.182568+0000","last_became_active":"2024-09-13T18:26:42.179432+0000","last_became_peered":"2024-09-13T18:26:42.179432+0000","last_unstale":"2024-09-13T18:26:42.182568+0000","last_undegraded":"2024-09-13T18:26:42.182568+0000","last_fullsized":"2024-09-13T18:26:42.182568+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:52.110887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.222737+0000","last_change":"2024-09-13T18:26:41.805854+0000","last_active":"2024-09-13T18:26:42.222737+0000","last_peered":"2024-09-13T18:26:42.222737+0000","last_clean":"2024-09-13T18:26:42.222737+0000","last_became_active":"2024-09-13T18:26:41.805050+0000","last_became_peered":"2024-09-13T18:26:41.805050+0000","last_unstale":"2024-09-13T18:26:42.222737+0000","last_undegraded":"2024-09-13T18:26:42.222737+0000","last_fullsized":"2024-09-13T18:26:42.222737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:21.657580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.217877+0000","last_change":"2024-09-13T18:26:42.197702+0000","last_active":"2024-09-13T18:26:42.217877+0000","last_peered":"2024-09-13T18:26:42.217877+0000","last_clean":"2024-09-13T18:26:42.217877+0000","last_became_active":"2024-09-13T18:26:42.195067+0000","last_became_peered":"2024-09-13T18:26:42.195067+0000","last_unstale":"2024-09-13T18:26:42.217877+0000","last_undegraded":"2024-09-13T18:26:42.217877+0000","last_fullsized":"2024-09-13T18:26:42.217877+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872242+0000","last_change":"2024-09-13T18:26:41.790941+0000","last_active":"2024-09-13T18:26:43.872242+0000","last_peered":"2024-09-13T18:26:43.872242+0000","last_clean":"2024-09-13T18:26:43.872242+0000","last_became_active":"2024-09-13T18:26:41.790423+0000","last_became_peered":"2024-09-13T18:26:41.790423+0000","last_unstale":"2024-09-13T18:26:43.872242+0000","last_undegraded":"2024-09-13T18:26:43.872242+0000","last_fullsized":"2024-09-13T18:26:43.872242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:21.604937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083196+0000","last_change":"2024-09-13T18:26:42.212409+0000","last_active":"2024-09-13T18:26:45.083196+0000","last_peered":"2024-09-13T18:26:45.083196+0000","last_clean":"2024-09-13T18:26:45.083196+0000","last_became_active":"2024-09-13T18:26:42.211922+0000","last_became_peered":"2024-09-13T18:26:42.211922+0000","last_unstale":"2024-09-13T18:26:45.083196+0000","last_undegraded":"2024-09-13T18:26:45.083196+0000","last_fullsized":"2024-09-13T18:26:45.083196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:54.886814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.202530+0000","last_change":"2024-09-13T18:26:41.788809+0000","last_active":"2024-09-13T18:26:42.202530+0000","last_peered":"2024-09-13T18:26:42.202530+0000","last_clean":"2024-09-13T18:26:42.202530+0000","last_became_active":"2024-09-13T18:26:41.788218+0000","last_became_peered":"2024-09-13T18:26:41.788218+0000","last_unstale":"2024-09-13T18:26:42.202530+0000","last_undegraded":"2024-09-13T18:26:42.202530+0000","last_fullsized":"2024-09-13T18:26:42.202530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:02.514713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381946+0000","last_change":"2024-09-13T18:26:42.204586+0000","last_active":"2024-09-13T18:26:44.381946+0000","last_peered":"2024-09-13T18:26:44.381946+0000","last_clean":"2024-09-13T18:26:44.381946+0000","last_became_active":"2024-09-13T18:26:42.204328+0000","last_became_peered":"2024-09-13T18:26:42.204328+0000","last_unstale":"2024-09-13T18:26:44.381946+0000","last_undegraded":"2024-09-13T18:26:44.381946+0000","last_fullsized":"2024-09-13T18:26:44.381946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:15.825996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.184021+0000","last_change":"2024-09-13T18:26:41.800395+0000","last_active":"2024-09-13T18:26:42.184021+0000","last_peered":"2024-09-13T18:26:42.184021+0000","last_clean":"2024-09-13T18:26:42.184021+0000","last_became_active":"2024-09-13T18:26:41.799657+0000","last_became_peered":"2024-09-13T18:26:41.799657+0000","last_unstale":"2024-09-13T18:26:42.184021+0000","last_undegraded":"2024-09-13T18:26:42.184021+0000","last_fullsized":"2024-09-13T18:26:42.184021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.376797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.185664+0000","last_change":"2024-09-13T18:26:42.183461+0000","last_active":"2024-09-13T18:26:42.185664+0000","last_peered":"2024-09-13T18:26:42.185664+0000","last_clean":"2024-09-13T18:26:42.185664+0000","last_became_active":"2024-09-13T18:26:42.183194+0000","last_became_peered":"2024-09-13T18:26:42.183194+0000","last_unstale":"2024-09-13T18:26:42.185664+0000","last_undegraded":"2024-09-13T18:26:42.185664+0000","last_fullsized":"2024-09-13T18:26:42.185664+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.174816+0000","last_change":"2024-09-13T18:26:41.788164+0000","last_active":"2024-09-13T18:26:42.174816+0000","last_peered":"2024-09-13T18:26:42.174816+0000","last_clean":"2024-09-13T18:26:42.174816+0000","last_became_active":"2024-09-13T18:26:41.787721+0000","last_became_peered":"2024-09-13T18:26:41.787721+0000","last_unstale":"2024-09-13T18:26:42.174816+0000","last_undegraded":"2024-09-13T18:26:42.174816+0000","last_fullsized":"2024-09-13T18:26:42.174816+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:32.667699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.222170+0000","last_change":"2024-09-13T18:26:42.219209+0000","last_active":"2024-09-13T18:26:42.222170+0000","last_peered":"2024-09-13T18:26:42.222170+0000","last_clean":"2024-09-13T18:26:42.222170+0000","last_became_active":"2024-09-13T18:26:42.218595+0000","last_became_peered":"2024-09-13T18:26:42.218595+0000","last_unstale":"2024-09-13T18:26:42.222170+0000","last_undegraded":"2024-09-13T18:26:42.222170+0000","last_fullsized":"2024-09-13T18:26:42.222170+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:14.728821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381799+0000","last_change":"2024-09-13T18:26:41.802488+0000","last_active":"2024-09-13T18:26:44.381799+0000","last_peered":"2024-09-13T18:26:44.381799+0000","last_clean":"2024-09-13T18:26:44.381799+0000","last_became_active":"2024-09-13T18:26:41.802040+0000","last_became_peered":"2024-09-13T18:26:41.802040+0000","last_unstale":"2024-09-13T18:26:44.381799+0000","last_undegraded":"2024-09-13T18:26:44.381799+0000","last_fullsized":"2024-09-13T18:26:44.381799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:06.971251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872242+0000","last_change":"2024-09-13T18:26:42.191381+0000","last_active":"2024-09-13T18:26:43.872242+0000","last_peered":"2024-09-13T18:26:43.872242+0000","last_clean":"2024-09-13T18:26:43.872242+0000","last_became_active":"2024-09-13T18:26:42.190896+0000","last_became_peered":"2024-09-13T18:26:42.190896+0000","last_unstale":"2024-09-13T18:26:43.872242+0000","last_undegraded":"2024-09-13T18:26:43.872242+0000","last_fullsized":"2024-09-13T18:26:43.872242+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:58.376728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872329+0000","last_change":"2024-09-13T18:26:41.775866+0000","last_active":"2024-09-13T18:26:43.872329+0000","last_peered":"2024-09-13T18:26:43.872329+0000","last_clean":"2024-09-13T18:26:43.872329+0000","last_became_active":"2024-09-13T18:26:41.775245+0000","last_became_peered":"2024-09-13T18:26:41.775245+0000","last_unstale":"2024-09-13T18:26:43.872329+0000","last_undegraded":"2024-09-13T18:26:43.872329+0000","last_fullsized":"2024-09-13T18:26:43.872329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:19.130933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382332+0000","last_change":"2024-09-13T18:26:42.178230+0000","last_active":"2024-09-13T18:26:44.382332+0000","last_peered":"2024-09-13T18:26:44.382332+0000","last_clean":"2024-09-13T18:26:44.382332+0000","last_became_active":"2024-09-13T18:26:42.177966+0000","last_became_peered":"2024-09-13T18:26:42.177966+0000","last_unstale":"2024-09-13T18:26:44.382332+0000","last_undegraded":"2024-09-13T18:26:44.382332+0000","last_fullsized":"2024-09-13T18:26:44.382332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:19.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.208941+0000","last_change":"2024-09-13T18:26:41.792328+0000","last_active":"2024-09-13T18:26:42.208941+0000","last_peered":"2024-09-13T18:26:42.208941+0000","last_clean":"2024-09-13T18:26:42.208941+0000","last_became_active":"2024-09-13T18:26:41.791128+0000","last_became_peered":"2024-09-13T18:26:41.791128+0000","last_unstale":"2024-09-13T18:26:42.208941+0000","last_undegraded":"2024-09-13T18:26:42.208941+0000","last_fullsized":"2024-09-13T18:26:42.208941+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:37.884621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083497+0000","last_change":"2024-09-13T18:26:42.213492+0000","last_active":"2024-09-13T18:26:45.083497+0000","last_peered":"2024-09-13T18:26:45.083497+0000","last_clean":"2024-09-13T18:26:45.083497+0000","last_became_active":"2024-09-13T18:26:42.212751+0000","last_became_peered":"2024-09-13T18:26:42.212751+0000","last_unstale":"2024-09-13T18:26:45.083497+0000","last_undegraded":"2024-09-13T18:26:45.083497+0000","last_fullsized":"2024-09-13T18:26:45.083497+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:05.950445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178263+0000","last_change":"2024-09-13T18:26:41.803308+0000","last_active":"2024-09-13T18:26:43.178263+0000","last_peered":"2024-09-13T18:26:43.178263+0000","last_clean":"2024-09-13T18:26:43.178263+0000","last_became_active":"2024-09-13T18:26:41.801125+0000","last_became_peered":"2024-09-13T18:26:41.801125+0000","last_unstale":"2024-09-13T18:26:43.178263+0000","last_undegraded":"2024-09-13T18:26:43.178263+0000","last_fullsized":"2024-09-13T18:26:43.178263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.376797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083485+0000","last_change":"2024-09-13T18:26:42.214316+0000","last_active":"2024-09-13T18:26:45.083485+0000","last_peered":"2024-09-13T18:26:45.083485+0000","last_clean":"2024-09-13T18:26:45.083485+0000","last_became_active":"2024-09-13T18:26:42.213198+0000","last_became_peered":"2024-09-13T18:26:42.213198+0000","last_unstale":"2024-09-13T18:26:45.083485+0000","last_undegraded":"2024-09-13T18:26:45.083485+0000","last_fullsized":"2024-09-13T18:26:45.083485+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:58.376728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.175197+0000","last_change":"2024-09-13T18:26:41.780266+0000","last_active":"2024-09-13T18:26:42.175197+0000","last_peered":"2024-09-13T18:26:42.175197+0000","last_clean":"2024-09-13T18:26:42.175197+0000","last_became_active":"2024-09-13T18:26:41.779600+0000","last_became_peered":"2024-09-13T18:26:41.779600+0000","last_unstale":"2024-09-13T18:26:42.175197+0000","last_undegraded":"2024-09-13T18:26:42.175197+0000","last_fullsized":"2024-09-13T18:26:42.175197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:54.284571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182539+0000","last_change":"2024-09-13T18:26:42.179172+0000","last_active":"2024-09-13T18:26:42.182539+0000","last_peered":"2024-09-13T18:26:42.182539+0000","last_clean":"2024-09-13T18:26:42.182539+0000","last_became_active":"2024-09-13T18:26:42.178940+0000","last_became_peered":"2024-09-13T18:26:42.178940+0000","last_unstale":"2024-09-13T18:26:42.182539+0000","last_undegraded":"2024-09-13T18:26:42.182539+0000","last_fullsized":"2024-09-13T18:26:42.182539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:29.033821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.211760+0000","last_change":"2024-09-13T18:26:41.795613+0000","last_active":"2024-09-13T18:26:42.211760+0000","last_peered":"2024-09-13T18:26:42.211760+0000","last_clean":"2024-09-13T18:26:42.211760+0000","last_became_active":"2024-09-13T18:26:41.795081+0000","last_became_peered":"2024-09-13T18:26:41.795081+0000","last_unstale":"2024-09-13T18:26:42.211760+0000","last_undegraded":"2024-09-13T18:26:42.211760+0000","last_fullsized":"2024-09-13T18:26:42.211760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:10.394301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172490+0000","last_change":"2024-09-13T18:26:42.191181+0000","last_active":"2024-09-13T18:26:43.172490+0000","last_peered":"2024-09-13T18:26:43.172490+0000","last_clean":"2024-09-13T18:26:43.172490+0000","last_became_active":"2024-09-13T18:26:42.190553+0000","last_became_peered":"2024-09-13T18:26:42.190553+0000","last_unstale":"2024-09-13T18:26:43.172490+0000","last_undegraded":"2024-09-13T18:26:43.172490+0000","last_fullsized":"2024-09-13T18:26:43.172490+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:41.031148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177607+0000","last_change":"2024-09-13T18:26:41.796332+0000","last_active":"2024-09-13T18:26:43.177607+0000","last_peered":"2024-09-13T18:26:43.177607+0000","last_clean":"2024-09-13T18:26:43.177607+0000","last_became_active":"2024-09-13T18:26:41.795600+0000","last_became_peered":"2024-09-13T18:26:41.795600+0000","last_unstale":"2024-09-13T18:26:43.177607+0000","last_undegraded":"2024-09-13T18:26:43.177607+0000","last_fullsized":"2024-09-13T18:26:43.177607+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:44.428115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.871864+0000","last_change":"2024-09-13T18:26:42.204425+0000","last_active":"2024-09-13T18:26:43.871864+0000","last_peered":"2024-09-13T18:26:43.871864+0000","last_clean":"2024-09-13T18:26:43.871864+0000","last_became_active":"2024-09-13T18:26:42.204128+0000","last_became_peered":"2024-09-13T18:26:42.204128+0000","last_unstale":"2024-09-13T18:26:43.871864+0000","last_undegraded":"2024-09-13T18:26:43.871864+0000","last_fullsized":"2024-09-13T18:26:43.871864+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:53.632168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381599+0000","last_change":"2024-09-13T18:26:41.795784+0000","last_active":"2024-09-13T18:26:44.381599+0000","last_peered":"2024-09-13T18:26:44.381599+0000","last_clean":"2024-09-13T18:26:44.381599+0000","last_became_active":"2024-09-13T18:26:41.795354+0000","last_became_peered":"2024-09-13T18:26:41.795354+0000","last_unstale":"2024-09-13T18:26:44.381599+0000","last_undegraded":"2024-09-13T18:26:44.381599+0000","last_fullsized":"2024-09-13T18:26:44.381599+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:15.458772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381615+0000","last_change":"2024-09-13T18:26:42.184691+0000","last_active":"2024-09-13T18:26:44.381615+0000","last_peered":"2024-09-13T18:26:44.381615+0000","last_clean":"2024-09-13T18:26:44.381615+0000","last_became_active":"2024-09-13T18:26:42.184421+0000","last_became_peered":"2024-09-13T18:26:42.184421+0000","last_unstale":"2024-09-13T18:26:44.381615+0000","last_undegraded":"2024-09-13T18:26:44.381615+0000","last_fullsized":"2024-09-13T18:26:44.381615+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:22.661205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.181587+0000","last_change":"2024-09-13T18:26:41.799287+0000","last_active":"2024-09-13T18:26:42.181587+0000","last_peered":"2024-09-13T18:26:42.181587+0000","last_clean":"2024-09-13T18:26:42.181587+0000","last_became_active":"2024-09-13T18:26:41.798623+0000","last_became_peered":"2024-09-13T18:26:41.798623+0000","last_unstale":"2024-09-13T18:26:42.181587+0000","last_undegraded":"2024-09-13T18:26:42.181587+0000","last_fullsized":"2024-09-13T18:26:42.181587+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:40.027523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.084153+0000","last_change":"2024-09-13T18:26:42.215803+0000","last_active":"2024-09-13T18:26:45.084153+0000","last_peered":"2024-09-13T18:26:45.084153+0000","last_clean":"2024-09-13T18:26:45.084153+0000","last_became_active":"2024-09-13T18:26:42.213804+0000","last_became_peered":"2024-09-13T18:26:42.213804+0000","last_unstale":"2024-09-13T18:26:45.084153+0000","last_undegraded":"2024-09-13T18:26:45.084153+0000","last_fullsized":"2024-09-13T18:26:45.084153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:57.198496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.175530+0000","last_change":"2024-09-13T18:26:41.792988+0000","last_active":"2024-09-13T18:26:42.175530+0000","last_peered":"2024-09-13T18:26:42.175530+0000","last_clean":"2024-09-13T18:26:42.175530+0000","last_became_active":"2024-09-13T18:26:41.792675+0000","last_became_peered":"2024-09-13T18:26:41.792675+0000","last_unstale":"2024-09-13T18:26:42.175530+0000","last_undegraded":"2024-09-13T18:26:42.175530+0000","last_fullsized":"2024-09-13T18:26:42.175530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:21.657580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382077+0000","last_change":"2024-09-13T18:26:42.177507+0000","last_active":"2024-09-13T18:26:44.382077+0000","last_peered":"2024-09-13T18:26:44.382077+0000","last_clean":"2024-09-13T18:26:44.382077+0000","last_became_active":"2024-09-13T18:26:42.177223+0000","last_became_peered":"2024-09-13T18:26:42.177223+0000","last_unstale":"2024-09-13T18:26:44.382077+0000","last_undegraded":"2024-09-13T18:26:44.382077+0000","last_fullsized":"2024-09-13T18:26:44.382077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.181867+0000","last_change":"2024-09-13T18:26:41.804413+0000","last_active":"2024-09-13T18:26:42.181867+0000","last_peered":"2024-09-13T18:26:42.181867+0000","last_clean":"2024-09-13T18:26:42.181867+0000","last_became_active":"2024-09-13T18:26:41.803710+0000","last_became_peered":"2024-09-13T18:26:41.803710+0000","last_unstale":"2024-09-13T18:26:42.181867+0000","last_undegraded":"2024-09-13T18:26:42.181867+0000","last_fullsized":"2024-09-13T18:26:42.181867+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:58.239230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.217924+0000","last_change":"2024-09-13T18:26:42.199256+0000","last_active":"2024-09-13T18:26:42.217924+0000","last_peered":"2024-09-13T18:26:42.217924+0000","last_clean":"2024-09-13T18:26:42.217924+0000","last_became_active":"2024-09-13T18:26:42.198547+0000","last_became_peered":"2024-09-13T18:26:42.198547+0000","last_unstale":"2024-09-13T18:26:42.217924+0000","last_undegraded":"2024-09-13T18:26:42.217924+0000","last_fullsized":"2024-09-13T18:26:42.217924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:19.186782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172420+0000","last_change":"2024-09-13T18:26:41.805356+0000","last_active":"2024-09-13T18:26:43.172420+0000","last_peered":"2024-09-13T18:26:43.172420+0000","last_clean":"2024-09-13T18:26:43.172420+0000","last_became_active":"2024-09-13T18:26:41.804795+0000","last_became_peered":"2024-09-13T18:26:41.804795+0000","last_unstale":"2024-09-13T18:26:43.172420+0000","last_undegraded":"2024-09-13T18:26:43.172420+0000","last_fullsized":"2024-09-13T18:26:43.172420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:54.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.187065+0000","last_change":"2024-09-13T18:26:42.184747+0000","last_active":"2024-09-13T18:26:42.187065+0000","last_peered":"2024-09-13T18:26:42.187065+0000","last_clean":"2024-09-13T18:26:42.187065+0000","last_became_active":"2024-09-13T18:26:42.184439+0000","last_became_peered":"2024-09-13T18:26:42.184439+0000","last_unstale":"2024-09-13T18:26:42.187065+0000","last_undegraded":"2024-09-13T18:26:42.187065+0000","last_fullsized":"2024-09-13T18:26:42.187065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:39.886829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.187027+0000","last_change":"2024-09-13T18:26:41.804092+0000","last_active":"2024-09-13T18:26:42.187027+0000","last_peered":"2024-09-13T18:26:42.187027+0000","last_clean":"2024-09-13T18:26:42.187027+0000","last_became_active":"2024-09-13T18:26:41.803422+0000","last_became_peered":"2024-09-13T18:26:41.803422+0000","last_unstale":"2024-09-13T18:26:42.187027+0000","last_undegraded":"2024-09-13T18:26:42.187027+0000","last_fullsized":"2024-09-13T18:26:42.187027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:44.428115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182686+0000","last_change":"2024-09-13T18:26:42.180274+0000","last_active":"2024-09-13T18:26:42.182686+0000","last_peered":"2024-09-13T18:26:42.182686+0000","last_clean":"2024-09-13T18:26:42.182686+0000","last_became_active":"2024-09-13T18:26:42.179991+0000","last_became_peered":"2024-09-13T18:26:42.179991+0000","last_unstale":"2024-09-13T18:26:42.182686+0000","last_undegraded":"2024-09-13T18:26:42.182686+0000","last_fullsized":"2024-09-13T18:26:42.182686+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:19.186782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.167817+0000","last_change":"2024-09-13T18:26:41.791722+0000","last_active":"2024-09-13T18:26:42.167817+0000","last_peered":"2024-09-13T18:26:42.167817+0000","last_clean":"2024-09-13T18:26:42.167817+0000","last_became_active":"2024-09-13T18:26:41.790212+0000","last_became_peered":"2024-09-13T18:26:41.790212+0000","last_unstale":"2024-09-13T18:26:42.167817+0000","last_undegraded":"2024-09-13T18:26:42.167817+0000","last_fullsized":"2024-09-13T18:26:42.167817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:45.205786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177622+0000","last_change":"2024-09-13T18:26:42.187618+0000","last_active":"2024-09-13T18:26:43.177622+0000","last_peered":"2024-09-13T18:26:43.177622+0000","last_clean":"2024-09-13T18:26:43.177622+0000","last_became_active":"2024-09-13T18:26:42.186226+0000","last_became_peered":"2024-09-13T18:26:42.186226+0000","last_unstale":"2024-09-13T18:26:43.177622+0000","last_undegraded":"2024-09-13T18:26:43.177622+0000","last_fullsized":"2024-09-13T18:26:43.177622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:08.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172424+0000","last_change":"2024-09-13T18:26:41.786760+0000","last_active":"2024-09-13T18:26:43.172424+0000","last_peered":"2024-09-13T18:26:43.172424+0000","last_clean":"2024-09-13T18:26:43.172424+0000","last_became_active":"2024-09-13T18:26:41.786467+0000","last_became_peered":"2024-09-13T18:26:41.786467+0000","last_unstale":"2024-09-13T18:26:43.172424+0000","last_undegraded":"2024-09-13T18:26:43.172424+0000","last_fullsized":"2024-09-13T18:26:43.172424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:57.373104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.179720+0000","last_change":"2024-09-13T18:26:42.176373+0000","last_active":"2024-09-13T18:26:42.179720+0000","last_peered":"2024-09-13T18:26:42.179720+0000","last_clean":"2024-09-13T18:26:42.179720+0000","last_became_active":"2024-09-13T18:26:42.175579+0000","last_became_peered":"2024-09-13T18:26:42.175579+0000","last_unstale":"2024-09-13T18:26:42.179720+0000","last_undegraded":"2024-09-13T18:26:42.179720+0000","last_fullsized":"2024-09-13T18:26:42.179720+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:45.431739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381828+0000","last_change":"2024-09-13T18:26:41.781621+0000","last_active":"2024-09-13T18:26:44.381828+0000","last_peered":"2024-09-13T18:26:44.381828+0000","last_clean":"2024-09-13T18:26:44.381828+0000","last_became_active":"2024-09-13T18:26:41.780750+0000","last_became_peered":"2024-09-13T18:26:41.780750+0000","last_unstale":"2024-09-13T18:26:44.381828+0000","last_undegraded":"2024-09-13T18:26:44.381828+0000","last_fullsized":"2024-09-13T18:26:44.381828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:48.822739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382504+0000","last_change":"2024-09-13T18:26:42.204630+0000","last_active":"2024-09-13T18:26:44.382504+0000","last_peered":"2024-09-13T18:26:44.382504+0000","last_clean":"2024-09-13T18:26:44.382504+0000","last_became_active":"2024-09-13T18:26:42.204346+0000","last_became_peered":"2024-09-13T18:26:42.204346+0000","last_unstale":"2024-09-13T18:26:44.382504+0000","last_undegraded":"2024-09-13T18:26:44.382504+0000","last_fullsized":"2024-09-13T18:26:44.382504+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178427+0000","last_change":"2024-09-13T18:26:41.803018+0000","last_active":"2024-09-13T18:26:43.178427+0000","last_peered":"2024-09-13T18:26:43.178427+0000","last_clean":"2024-09-13T18:26:43.178427+0000","last_became_active":"2024-09-13T18:26:41.802300+0000","last_became_peered":"2024-09-13T18:26:41.802300+0000","last_unstale":"2024-09-13T18:26:43.178427+0000","last_undegraded":"2024-09-13T18:26:43.178427+0000","last_fullsized":"2024-09-13T18:26:43.178427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:40.027523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:26:41.783199+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:26:41.783199+0000","last_peered":"2024-09-13T18:26:41.783199+0000","last_clean":"2024-09-13T18:26:41.783199+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:26:41.783199+0000","last_undegraded":"2024-09-13T18:26:41.783199+0000","last_fullsized":"2024-09-13T18:26:41.783199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":804552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.298},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.169}]},{"osd":1,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.258},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.202}]},{"osd":3,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.88},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.337}]},{"osd":4,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.034}]},{"osd":6,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.1220000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":214766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.252}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.506},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.0529999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.587}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.141},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.88200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.181},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.6559999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.095}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":544768,"data_stored":220464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.876}]},{"osd":2,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.95399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.0449999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.081}]},{"osd":6,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.1259999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.497}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.97199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.621},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.03},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.069}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.141},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1060000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":540672,"data_stored":214732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.099}]},{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.91300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.002}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.3100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3,"5min":3,"15min":3},"last":1.143},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.173}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":557056,"data_stored":221980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.625},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.288}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.0649999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.115}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.087},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.167}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.145},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3320000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35744,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":544768,"data_stored":220464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.876},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.99299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":810796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38}]},{"osd":3,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:26:47.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:26:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.374+0000 7f6804a49640 1 Processor -- start 2024-09-13T18:26:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.374+0000 7f6804a49640 1 -- start start 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f68000cb980 0x7f68000b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68000cbd60 0x7f68000cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000b1ac0 con 0x7f680006b850 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68000b3010 con 0x7f68000cbd60 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6800159ac0 con 0x7f68000cb980 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67f7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f680006b850 0x7f680006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57952/0 (socket says 172.21.15.53:57952) 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67f7fff640 1 -- 172.21.15.53:0/1456264045 learned_addr learned my addr 172.21.15.53:0/1456264045 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fed9d640 1 --2- 172.21.15.53:0/1456264045 >> v2:172.21.15.53:3300/0 conn(0x7f68000cbd60 0x7f68000cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fe59c640 1 --2- 172.21.15.53:0/1456264045 >> v2:172.21.15.87:3300/0 conn(0x7f68000cb980 0x7f68000b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fdd9b640 1 -- 172.21.15.53:0/1456264045 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935300859 0 0) 0x7f68000b1ac0 con 0x7f680006b850 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fdd9b640 1 -- 172.21.15.53:0/1456264045 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e0003530 con 0x7f680006b850 2024-09-13T18:26:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fed9d640 1 -- 172.21.15.53:0/1456264045 >> v2:172.21.15.87:3300/0 conn(0x7f68000cb980 msgr2=0x7f68000b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fed9d640 1 --2- 172.21.15.53:0/1456264045 >> v2:172.21.15.87:3300/0 conn(0x7f68000cb980 0x7f68000b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fed9d640 1 -- 172.21.15.53:0/1456264045 >> v1:172.21.15.53:6789/0 conn(0x7f680006b850 legacy=0x7f680006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fed9d640 1 -- 172.21.15.53:0/1456264045 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800159da0 con 0x7f68000cbd60 2024-09-13T18:26:47.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fed9d640 1 --2- 172.21.15.53:0/1456264045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68000cbd60 0x7f68000cdd40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6800071820 tx=0x7f67f801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdfbc224bf3d0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fdd9b640 1 -- 172.21.15.53:0/1456264045 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f80a5930 con 0x7f68000cbd60 2024-09-13T18:26:47.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fdd9b640 1 -- 172.21.15.53:0/1456264045 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f80a5a90 con 0x7f68000cbd60 2024-09-13T18:26:47.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f67fdd9b640 1 -- 172.21.15.53:0/1456264045 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f80a5e20 con 0x7f68000cbd60 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- 172.21.15.53:0/1456264045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68000cbd60 msgr2=0x7f68000cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 --2- 172.21.15.53:0/1456264045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68000cbd60 0x7f68000cdd40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6800071820 tx=0x7f67f801c870 comp rx=0 tx=0).stop 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- 172.21.15.53:0/1456264045 shutdown_connections 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 --2- 172.21.15.53:0/1456264045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68000cbd60 0x7f68000cdd40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 --2- 172.21.15.53:0/1456264045 >> v2:172.21.15.87:3300/0 conn(0x7f68000cb980 0x7f68000b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- 172.21.15.53:0/1456264045 >> 172.21.15.53:0/1456264045 conn(0x7f6800065c80 msgr2=0x7f6800066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- 172.21.15.53:0/1456264045 shutdown_connections 2024-09-13T18:26:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.378+0000 7f6804a49640 1 -- 172.21.15.53:0/1456264045 wait complete. 2024-09-13T18:26:47.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 Processor -- start 2024-09-13T18:26:47.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 -- start start 2024-09-13T18:26:47.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f680006b850 0x7f6800145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68000cb980 0x7f6800151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68000cbd60 0x7f680014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6800152640 con 0x7f680006b850 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6800151a30 con 0x7f68000cbd60 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6800151d10 con 0x7f68000cb980 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f680006b850 0x7f6800145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f680006b850 0x7f6800145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59252/0 (socket says 172.21.15.53:59252) 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 -- 172.21.15.53:0/836735724 learned_addr learned my addr 172.21.15.53:0/836735724 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fed9d640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68000cbd60 0x7f680014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67f7fff640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68000cb980 0x7f6800151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 -- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68000cb980 msgr2=0x7f6800151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68000cb980 0x7f6800151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 -- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68000cbd60 msgr2=0x7f680014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68000cbd60 0x7f680014a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 -- 172.21.15.53:0/836735724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8009a70 con 0x7f680006b850 2024-09-13T18:26:47.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67fe59c640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f680006b850 0x7f6800145200 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f67f000e930 tx=0x7f67f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67f6ffd640 1 -- 172.21.15.53:0/836735724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0009690 con 0x7f680006b850 2024-09-13T18:26:47.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67f6ffd640 1 -- 172.21.15.53:0/836735724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f000ca00 con 0x7f680006b850 2024-09-13T18:26:47.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6800151ff0 con 0x7f680006b850 2024-09-13T18:26:47.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f67f6ffd640 1 -- 172.21.15.53:0/836735724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f000cd70 con 0x7f680006b850 2024-09-13T18:26:47.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680014ae90 con 0x7f680006b850 2024-09-13T18:26:47.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.382+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6800067400 con 0x7f680006b850 2024-09-13T18:26:47.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.386+0000 7f67f6ffd640 1 -- 172.21.15.53:0/836735724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f67f0013470 con 0x7f680006b850 2024-09-13T18:26:47.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.386+0000 7f67f6ffd640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066870 0x7f67e4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.386+0000 7f67f6ffd640 1 -- 172.21.15.53:0/836735724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67f0084640 con 0x7f680006b850 2024-09-13T18:26:47.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.386+0000 7f67f7fff640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066870 0x7f67e4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.386+0000 7f67f7fff640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066870 0x7f67e4068d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f68001f65d0 tx=0x7f67e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.390+0000 7f67f6ffd640 1 -- 172.21.15.53:0/836735724 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f67f0051880 con 0x7f680006b850 2024-09-13T18:26:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.598+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f68000b2ba0 con 0x7f680006b850 2024-09-13T18:26:47.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.598+0000 7f67f6ffd640 1 -- 172.21.15.53:0/836735724 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7f67f0054ea0 con 0x7f680006b850 2024-09-13T18:26:47.603 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:47.603 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":133,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1726251884,"num_in_osds":8,"osd_in_since":1726251876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":252088320,"bytes_avail":772842024960,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":22,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5700}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-13T18:26:30.932368+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:26:47.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066870 msgr2=0x7f67e4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066870 0x7f67e4068d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f68001f65d0 tx=0x7f67e8009040 comp rx=0 tx=0).stop 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f680006b850 msgr2=0x7f6800145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f680006b850 0x7f6800145200 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f67f000e930 tx=0x7f67f000edf0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 shutdown_connections 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066870 0x7f67e4068d30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68000cb980 0x7f6800151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68000cbd60 0x7f680014a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 --2- 172.21.15.53:0/836735724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f680006b850 0x7f6800145200 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 >> 172.21.15.53:0/836735724 conn(0x7f6800065c80 msgr2=0x7f680015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 shutdown_connections 2024-09-13T18:26:47.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.602+0000 7f6804a49640 1 -- 172.21.15.53:0/836735724 wait complete. 2024-09-13T18:26:47.621 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:26:47.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:26:47.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.742+0000 7fa827a83640 1 Processor -- start 2024-09-13T18:26:47.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.742+0000 7fa827a83640 1 -- start start 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8200d19c0 0x7fa8200cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8200cf600 0x7fa8200b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8200d2400 con 0x7fa82015cab0 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200cfa90 con 0x7fa8200d19c0 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200d1530 con 0x7fa8200cf600 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8200d19c0 0x7fa8200cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8200d19c0 0x7fa8200cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59256/0 (socket says 172.21.15.53:59256) 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 -- 172.21.15.53:0/4028509488 learned_addr learned my addr 172.21.15.53:0/4028509488 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa826020640 1 --2- 172.21.15.53:0/4028509488 >> v2:172.21.15.87:3300/0 conn(0x7fa8200cf600 0x7fa8200b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 -- 172.21.15.53:0/4028509488 >> v2:172.21.15.87:3300/0 conn(0x7fa8200cf600 msgr2=0x7fa8200b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 --2- 172.21.15.53:0/4028509488 >> v2:172.21.15.87:3300/0 conn(0x7fa8200cf600 0x7fa8200b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 -- 172.21.15.53:0/4028509488 >> v1:172.21.15.53:6789/0 conn(0x7fa82015cab0 legacy=0x7fa8200cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 -- 172.21.15.53:0/4028509488 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200cddd0 con 0x7fa8200d19c0 2024-09-13T18:26:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82501e640 1 --2- 172.21.15.53:0/4028509488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200d19c0 0x7fa8200cf0c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa8200b7fe0 tx=0x7fa81001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b20d2a243806cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82481d640 1 -- 172.21.15.53:0/4028509488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ab610 con 0x7fa8200d19c0 2024-09-13T18:26:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82481d640 1 -- 172.21.15.53:0/4028509488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100ab770 con 0x7fa8200d19c0 2024-09-13T18:26:47.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa82481d640 1 -- 172.21.15.53:0/4028509488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100abb00 con 0x7fa8200d19c0 2024-09-13T18:26:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 -- 172.21.15.53:0/4028509488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200d19c0 msgr2=0x7fa8200cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 --2- 172.21.15.53:0/4028509488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200d19c0 0x7fa8200cf0c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa8200b7fe0 tx=0x7fa81001c520 comp rx=0 tx=0).stop 2024-09-13T18:26:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 -- 172.21.15.53:0/4028509488 shutdown_connections 2024-09-13T18:26:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 --2- 172.21.15.53:0/4028509488 >> v2:172.21.15.87:3300/0 conn(0x7fa8200cf600 0x7fa8200b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.746+0000 7fa827a83640 1 --2- 172.21.15.53:0/4028509488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200d19c0 0x7fa8200cf0c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- 172.21.15.53:0/4028509488 >> 172.21.15.53:0/4028509488 conn(0x7fa820065c80 msgr2=0x7fa820066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- 172.21.15.53:0/4028509488 shutdown_connections 2024-09-13T18:26:47.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- 172.21.15.53:0/4028509488 wait complete. 2024-09-13T18:26:47.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 Processor -- start 2024-09-13T18:26:47.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- start start 2024-09-13T18:26:47.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200cf600 0x7fa8201505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8200d19c0 0x7fa82015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa82015cab0 0x7fa82014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820150190 con 0x7fa8200cf600 2024-09-13T18:26:47.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82014f290 con 0x7fa8200d19c0 2024-09-13T18:26:47.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82014f570 con 0x7fa82015cab0 2024-09-13T18:26:47.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200cf600 0x7fa8201505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200cf600 0x7fa8201505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59260/0 (socket says 172.21.15.53:59260) 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 -- 172.21.15.53:0/2762085904 learned_addr learned my addr 172.21.15.53:0/2762085904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82501e640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8200d19c0 0x7fa82015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa826020640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa82015cab0 0x7fa82014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 -- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa82015cab0 msgr2=0x7fa82014dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa82015cab0 0x7fa82014dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 -- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8200d19c0 msgr2=0x7fa82015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8200d19c0 0x7fa82015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 -- 172.21.15.53:0/2762085904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100094d0 con 0x7fa8200cf600 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa826020640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa82015cab0 0x7fa82014dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa82581f640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200cf600 0x7fa8201505a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c3c0 tx=0x7fa81c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa8167fc640 1 -- 172.21.15.53:0/2762085904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0052d0 con 0x7fa8200cf600 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa8167fc640 1 -- 172.21.15.53:0/2762085904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c005430 con 0x7fa8200cf600 2024-09-13T18:26:47.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82014f850 con 0x7fa8200cf600 2024-09-13T18:26:47.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa8167fc640 1 -- 172.21.15.53:0/2762085904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c003840 con 0x7fa8200cf600 2024-09-13T18:26:47.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa820153960 con 0x7fa8200cf600 2024-09-13T18:26:47.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.750+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8200b5870 con 0x7fa8200cf600 2024-09-13T18:26:47.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.754+0000 7fa8167fc640 1 -- 172.21.15.53:0/2762085904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa81c0039a0 con 0x7fa8200cf600 2024-09-13T18:26:47.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.754+0000 7fa8167fc640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa804066840 0x7fa804068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:47.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.754+0000 7fa8167fc640 1 -- 172.21.15.53:0/2762085904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa81c083a60 con 0x7fa8200cf600 2024-09-13T18:26:47.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.754+0000 7fa82501e640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa804066840 0x7fa804068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:47.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.754+0000 7fa82501e640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa804066840 0x7fa804068d00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8100af000 tx=0x7fa8100a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:47.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.758+0000 7fa8167fc640 1 -- 172.21.15.53:0/2762085904 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa81c050ab0 con 0x7fa8200cf600 2024-09-13T18:26:47.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.914+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8200d05b0 con 0x7fa804066840 2024-09-13T18:26:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.934+0000 7fa8167fc640 1 -- 172.21.15.53:0/2762085904 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288050 (secure 0 0 0) 0x7fa8100ab8e0 con 0x7fa804066840 2024-09-13T18:26:47.943 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:47.944 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:26:47.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa804066840 msgr2=0x7fa804068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa804066840 0x7fa804068d00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8100af000 tx=0x7fa8100a7000 comp rx=0 tx=0).stop 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200cf600 msgr2=0x7fa8201505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200cf600 0x7fa8201505a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c3c0 tx=0x7fa81c00c880 comp rx=0 tx=0).stop 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 shutdown_connections 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa804066840 0x7fa804068d00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa82015cab0 0x7fa82014dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8200d19c0 0x7fa82015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 --2- 172.21.15.53:0/2762085904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8200cf600 0x7fa8201505a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 >> 172.21.15.53:0/2762085904 conn(0x7fa820065c80 msgr2=0x7fa8200b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 shutdown_connections 2024-09-13T18:26:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:47.942+0000 7fa827a83640 1 -- 172.21.15.53:0/2762085904 wait complete. 2024-09-13T18:26:47.962 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-13T18:26:46.936736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246180,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754728540,"statfs":{"total":773094113280,"available":772842024960,"internally_reserved":0,"allocated":5529600,"data_stored":2923412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":246402616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001691"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.214332+0000","last_change":"2024-09-13T18:26:42.200662+0000","last_active":"2024-09-13T18:26:42.214332+0000","last_peered":"2024-09-13T18:26:42.214332+0000","last_clean":"2024-09-13T18:26:42.214332+0000","last_became_active":"2024-09-13T18:26:42.200015+0000","last_became_peered":"2024-09-13T18:26:42.200015+0000","last_unstale":"2024-09-13T18:26:42.214332+0000","last_undegraded":"2024-09-13T18:26:42.214332+0000","last_fullsized":"2024-09-13T18:26:42.214332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178104+0000","last_change":"2024-09-13T18:26:42.187659+0000","last_active":"2024-09-13T18:26:43.178104+0000","last_peered":"2024-09-13T18:26:43.178104+0000","last_clean":"2024-09-13T18:26:43.178104+0000","last_became_active":"2024-09-13T18:26:42.185980+0000","last_became_peered":"2024-09-13T18:26:42.185980+0000","last_unstale":"2024-09-13T18:26:43.178104+0000","last_undegraded":"2024-09-13T18:26:43.178104+0000","last_fullsized":"2024-09-13T18:26:43.178104+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.179222+0000","last_change":"2024-09-13T18:26:42.172685+0000","last_active":"2024-09-13T18:26:42.179222+0000","last_peered":"2024-09-13T18:26:42.179222+0000","last_clean":"2024-09-13T18:26:42.179222+0000","last_became_active":"2024-09-13T18:26:42.171857+0000","last_became_peered":"2024-09-13T18:26:42.171857+0000","last_unstale":"2024-09-13T18:26:42.179222+0000","last_undegraded":"2024-09-13T18:26:42.179222+0000","last_fullsized":"2024-09-13T18:26:42.179222+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.380421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382058+0000","last_change":"2024-09-13T18:26:42.212976+0000","last_active":"2024-09-13T18:26:44.382058+0000","last_peered":"2024-09-13T18:26:44.382058+0000","last_clean":"2024-09-13T18:26:44.382058+0000","last_became_active":"2024-09-13T18:26:42.212748+0000","last_became_peered":"2024-09-13T18:26:42.212748+0000","last_unstale":"2024-09-13T18:26:44.382058+0000","last_undegraded":"2024-09-13T18:26:44.382058+0000","last_fullsized":"2024-09-13T18:26:44.382058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:42.682099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177842+0000","last_change":"2024-09-13T18:26:42.189143+0000","last_active":"2024-09-13T18:26:43.177842+0000","last_peered":"2024-09-13T18:26:43.177842+0000","last_clean":"2024-09-13T18:26:43.177842+0000","last_became_active":"2024-09-13T18:26:42.188457+0000","last_became_peered":"2024-09-13T18:26:42.188457+0000","last_unstale":"2024-09-13T18:26:43.177842+0000","last_undegraded":"2024-09-13T18:26:43.177842+0000","last_fullsized":"2024-09-13T18:26:43.177842+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:42.682099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.202698+0000","last_change":"2024-09-13T18:26:42.197953+0000","last_active":"2024-09-13T18:26:42.202698+0000","last_peered":"2024-09-13T18:26:42.202698+0000","last_clean":"2024-09-13T18:26:42.202698+0000","last_became_active":"2024-09-13T18:26:42.197326+0000","last_became_peered":"2024-09-13T18:26:42.197326+0000","last_unstale":"2024-09-13T18:26:42.202698+0000","last_undegraded":"2024-09-13T18:26:42.202698+0000","last_fullsized":"2024-09-13T18:26:42.202698+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:13.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.211592+0000","last_change":"2024-09-13T18:26:42.196638+0000","last_active":"2024-09-13T18:26:42.211592+0000","last_peered":"2024-09-13T18:26:42.211592+0000","last_clean":"2024-09-13T18:26:42.211592+0000","last_became_active":"2024-09-13T18:26:42.195610+0000","last_became_peered":"2024-09-13T18:26:42.195610+0000","last_unstale":"2024-09-13T18:26:42.211592+0000","last_undegraded":"2024-09-13T18:26:42.211592+0000","last_fullsized":"2024-09-13T18:26:42.211592+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381490+0000","last_change":"2024-09-13T18:26:42.196478+0000","last_active":"2024-09-13T18:26:44.381490+0000","last_peered":"2024-09-13T18:26:44.381490+0000","last_clean":"2024-09-13T18:26:44.381490+0000","last_became_active":"2024-09-13T18:26:42.195254+0000","last_became_peered":"2024-09-13T18:26:42.195254+0000","last_unstale":"2024-09-13T18:26:44.381490+0000","last_undegraded":"2024-09-13T18:26:44.381490+0000","last_fullsized":"2024-09-13T18:26:44.381490+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:08.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382316+0000","last_change":"2024-09-13T18:26:42.184646+0000","last_active":"2024-09-13T18:26:44.382316+0000","last_peered":"2024-09-13T18:26:44.382316+0000","last_clean":"2024-09-13T18:26:44.382316+0000","last_became_active":"2024-09-13T18:26:42.184380+0000","last_became_peered":"2024-09-13T18:26:42.184380+0000","last_unstale":"2024-09-13T18:26:44.382316+0000","last_undegraded":"2024-09-13T18:26:44.382316+0000","last_fullsized":"2024-09-13T18:26:44.382316+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:03.518337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382406+0000","last_change":"2024-09-13T18:26:42.211909+0000","last_active":"2024-09-13T18:26:44.382406+0000","last_peered":"2024-09-13T18:26:44.382406+0000","last_clean":"2024-09-13T18:26:44.382406+0000","last_became_active":"2024-09-13T18:26:42.211601+0000","last_became_peered":"2024-09-13T18:26:42.211601+0000","last_unstale":"2024-09-13T18:26:44.382406+0000","last_undegraded":"2024-09-13T18:26:44.382406+0000","last_fullsized":"2024-09-13T18:26:44.382406+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:11.397925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382230+0000","last_change":"2024-09-13T18:26:42.186875+0000","last_active":"2024-09-13T18:26:44.382230+0000","last_peered":"2024-09-13T18:26:44.382230+0000","last_clean":"2024-09-13T18:26:44.382230+0000","last_became_active":"2024-09-13T18:26:42.186612+0000","last_became_peered":"2024-09-13T18:26:42.186612+0000","last_unstale":"2024-09-13T18:26:44.382230+0000","last_undegraded":"2024-09-13T18:26:44.382230+0000","last_fullsized":"2024-09-13T18:26:44.382230+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.288195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177708+0000","last_change":"2024-09-13T18:26:42.193062+0000","last_active":"2024-09-13T18:26:43.177708+0000","last_peered":"2024-09-13T18:26:43.177708+0000","last_clean":"2024-09-13T18:26:43.177708+0000","last_became_active":"2024-09-13T18:26:42.192371+0000","last_became_peered":"2024-09-13T18:26:42.192371+0000","last_unstale":"2024-09-13T18:26:43.177708+0000","last_undegraded":"2024-09-13T18:26:43.177708+0000","last_fullsized":"2024-09-13T18:26:43.177708+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:14.728821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872036+0000","last_change":"2024-09-13T18:26:42.179904+0000","last_active":"2024-09-13T18:26:43.872036+0000","last_peered":"2024-09-13T18:26:43.872036+0000","last_clean":"2024-09-13T18:26:43.872036+0000","last_became_active":"2024-09-13T18:26:42.178013+0000","last_became_peered":"2024-09-13T18:26:42.178013+0000","last_unstale":"2024-09-13T18:26:43.872036+0000","last_undegraded":"2024-09-13T18:26:43.872036+0000","last_fullsized":"2024-09-13T18:26:43.872036+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:05.950445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381747+0000","last_change":"2024-09-13T18:26:42.185257+0000","last_active":"2024-09-13T18:26:44.381747+0000","last_peered":"2024-09-13T18:26:44.381747+0000","last_clean":"2024-09-13T18:26:44.381747+0000","last_became_active":"2024-09-13T18:26:42.184976+0000","last_became_peered":"2024-09-13T18:26:42.184976+0000","last_unstale":"2024-09-13T18:26:44.381747+0000","last_undegraded":"2024-09-13T18:26:44.381747+0000","last_fullsized":"2024-09-13T18:26:44.381747+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:49.638441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182717+0000","last_change":"2024-09-13T18:26:42.181552+0000","last_active":"2024-09-13T18:26:42.182717+0000","last_peered":"2024-09-13T18:26:42.182717+0000","last_clean":"2024-09-13T18:26:42.182717+0000","last_became_active":"2024-09-13T18:26:42.180992+0000","last_became_peered":"2024-09-13T18:26:42.180992+0000","last_unstale":"2024-09-13T18:26:42.182717+0000","last_undegraded":"2024-09-13T18:26:42.182717+0000","last_fullsized":"2024-09-13T18:26:42.182717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:54.959235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083466+0000","last_change":"2024-09-13T18:26:42.186980+0000","last_active":"2024-09-13T18:26:45.083466+0000","last_peered":"2024-09-13T18:26:45.083466+0000","last_clean":"2024-09-13T18:26:45.083466+0000","last_became_active":"2024-09-13T18:26:42.185980+0000","last_became_peered":"2024-09-13T18:26:42.185980+0000","last_unstale":"2024-09-13T18:26:45.083466+0000","last_undegraded":"2024-09-13T18:26:45.083466+0000","last_fullsized":"2024-09-13T18:26:45.083466+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:45.826157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.195682+0000","last_change":"2024-09-13T18:26:42.188559+0000","last_active":"2024-09-13T18:26:42.195682+0000","last_peered":"2024-09-13T18:26:42.195682+0000","last_clean":"2024-09-13T18:26:42.195682+0000","last_became_active":"2024-09-13T18:26:42.187794+0000","last_became_peered":"2024-09-13T18:26:42.187794+0000","last_unstale":"2024-09-13T18:26:42.195682+0000","last_undegraded":"2024-09-13T18:26:42.195682+0000","last_fullsized":"2024-09-13T18:26:42.195682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:03.518337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.183203+0000","last_change":"2024-09-13T18:26:42.178481+0000","last_active":"2024-09-13T18:26:42.183203+0000","last_peered":"2024-09-13T18:26:42.183203+0000","last_clean":"2024-09-13T18:26:42.183203+0000","last_became_active":"2024-09-13T18:26:42.177786+0000","last_became_peered":"2024-09-13T18:26:42.177786+0000","last_unstale":"2024-09-13T18:26:42.183203+0000","last_undegraded":"2024-09-13T18:26:42.183203+0000","last_fullsized":"2024-09-13T18:26:42.183203+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.288195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083669+0000","last_change":"2024-09-13T18:26:42.212807+0000","last_active":"2024-09-13T18:26:45.083669+0000","last_peered":"2024-09-13T18:26:45.083669+0000","last_clean":"2024-09-13T18:26:45.083669+0000","last_became_active":"2024-09-13T18:26:42.212186+0000","last_became_peered":"2024-09-13T18:26:42.212186+0000","last_unstale":"2024-09-13T18:26:45.083669+0000","last_undegraded":"2024-09-13T18:26:45.083669+0000","last_fullsized":"2024-09-13T18:26:45.083669+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:55.423521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872073+0000","last_change":"2024-09-13T18:26:42.179546+0000","last_active":"2024-09-13T18:26:43.872073+0000","last_peered":"2024-09-13T18:26:43.872073+0000","last_clean":"2024-09-13T18:26:43.872073+0000","last_became_active":"2024-09-13T18:26:42.179265+0000","last_became_peered":"2024-09-13T18:26:42.179265+0000","last_unstale":"2024-09-13T18:26:43.872073+0000","last_undegraded":"2024-09-13T18:26:43.872073+0000","last_fullsized":"2024-09-13T18:26:43.872073+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:36.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.214232+0000","last_change":"2024-09-13T18:26:42.213648+0000","last_active":"2024-09-13T18:26:42.214232+0000","last_peered":"2024-09-13T18:26:42.214232+0000","last_clean":"2024-09-13T18:26:42.214232+0000","last_became_active":"2024-09-13T18:26:42.213415+0000","last_became_peered":"2024-09-13T18:26:42.213415+0000","last_unstale":"2024-09-13T18:26:42.214232+0000","last_undegraded":"2024-09-13T18:26:42.214232+0000","last_fullsized":"2024-09-13T18:26:42.214232+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:28.295627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381725+0000","last_change":"2024-09-13T18:26:42.214989+0000","last_active":"2024-09-13T18:26:44.381725+0000","last_peered":"2024-09-13T18:26:44.381725+0000","last_clean":"2024-09-13T18:26:44.381725+0000","last_became_active":"2024-09-13T18:26:42.214712+0000","last_became_peered":"2024-09-13T18:26:42.214712+0000","last_unstale":"2024-09-13T18:26:44.381725+0000","last_undegraded":"2024-09-13T18:26:44.381725+0000","last_fullsized":"2024-09-13T18:26:44.381725+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:33.671323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083176+0000","last_change":"2024-09-13T18:26:42.206421+0000","last_active":"2024-09-13T18:26:45.083176+0000","last_peered":"2024-09-13T18:26:45.083176+0000","last_clean":"2024-09-13T18:26:45.083176+0000","last_became_active":"2024-09-13T18:26:42.205617+0000","last_became_peered":"2024-09-13T18:26:42.205617+0000","last_unstale":"2024-09-13T18:26:45.083176+0000","last_undegraded":"2024-09-13T18:26:45.083176+0000","last_fullsized":"2024-09-13T18:26:45.083176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:34.533154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083110+0000","last_change":"2024-09-13T18:26:42.206165+0000","last_active":"2024-09-13T18:26:45.083110+0000","last_peered":"2024-09-13T18:26:45.083110+0000","last_clean":"2024-09-13T18:26:45.083110+0000","last_became_active":"2024-09-13T18:26:42.205424+0000","last_became_peered":"2024-09-13T18:26:42.205424+0000","last_unstale":"2024-09-13T18:26:45.083110+0000","last_undegraded":"2024-09-13T18:26:45.083110+0000","last_fullsized":"2024-09-13T18:26:45.083110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:46.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083918+0000","last_change":"2024-09-13T18:26:42.216221+0000","last_active":"2024-09-13T18:26:45.083918+0000","last_peered":"2024-09-13T18:26:45.083918+0000","last_clean":"2024-09-13T18:26:45.083918+0000","last_became_active":"2024-09-13T18:26:42.214495+0000","last_became_peered":"2024-09-13T18:26:42.214495+0000","last_unstale":"2024-09-13T18:26:45.083918+0000","last_undegraded":"2024-09-13T18:26:45.083918+0000","last_fullsized":"2024-09-13T18:26:45.083918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:36.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872153+0000","last_change":"2024-09-13T18:26:42.175912+0000","last_active":"2024-09-13T18:26:43.872153+0000","last_peered":"2024-09-13T18:26:43.872153+0000","last_clean":"2024-09-13T18:26:43.872153+0000","last_became_active":"2024-09-13T18:26:42.174011+0000","last_became_peered":"2024-09-13T18:26:42.174011+0000","last_unstale":"2024-09-13T18:26:43.872153+0000","last_undegraded":"2024-09-13T18:26:43.872153+0000","last_fullsized":"2024-09-13T18:26:43.872153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:46.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.203107+0000","last_change":"2024-09-13T18:26:42.189508+0000","last_active":"2024-09-13T18:26:42.203107+0000","last_peered":"2024-09-13T18:26:42.203107+0000","last_clean":"2024-09-13T18:26:42.203107+0000","last_became_active":"2024-09-13T18:26:42.188654+0000","last_became_peered":"2024-09-13T18:26:42.188654+0000","last_unstale":"2024-09-13T18:26:42.203107+0000","last_undegraded":"2024-09-13T18:26:42.203107+0000","last_fullsized":"2024-09-13T18:26:42.203107+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:33.671323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178118+0000","last_change":"2024-09-13T18:26:42.193002+0000","last_active":"2024-09-13T18:26:43.178118+0000","last_peered":"2024-09-13T18:26:43.178118+0000","last_clean":"2024-09-13T18:26:43.178118+0000","last_became_active":"2024-09-13T18:26:42.191614+0000","last_became_peered":"2024-09-13T18:26:42.191614+0000","last_unstale":"2024-09-13T18:26:43.178118+0000","last_undegraded":"2024-09-13T18:26:43.178118+0000","last_fullsized":"2024-09-13T18:26:43.178118+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083375+0000","last_change":"2024-09-13T18:26:42.213714+0000","last_active":"2024-09-13T18:26:45.083375+0000","last_peered":"2024-09-13T18:26:45.083375+0000","last_clean":"2024-09-13T18:26:45.083375+0000","last_became_active":"2024-09-13T18:26:42.213065+0000","last_became_peered":"2024-09-13T18:26:42.213065+0000","last_unstale":"2024-09-13T18:26:45.083375+0000","last_undegraded":"2024-09-13T18:26:45.083375+0000","last_fullsized":"2024-09-13T18:26:45.083375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:38.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.202582+0000","last_change":"2024-09-13T18:26:42.198684+0000","last_active":"2024-09-13T18:26:42.202582+0000","last_peered":"2024-09-13T18:26:42.202582+0000","last_clean":"2024-09-13T18:26:42.202582+0000","last_became_active":"2024-09-13T18:26:42.197996+0000","last_became_peered":"2024-09-13T18:26:42.197996+0000","last_unstale":"2024-09-13T18:26:42.202582+0000","last_undegraded":"2024-09-13T18:26:42.202582+0000","last_fullsized":"2024-09-13T18:26:42.202582+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:49.638441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.191442+0000","last_change":"2024-09-13T18:26:42.190799+0000","last_active":"2024-09-13T18:26:42.191442+0000","last_peered":"2024-09-13T18:26:42.191442+0000","last_clean":"2024-09-13T18:26:42.191442+0000","last_became_active":"2024-09-13T18:26:42.190559+0000","last_became_peered":"2024-09-13T18:26:42.190559+0000","last_unstale":"2024-09-13T18:26:42.191442+0000","last_undegraded":"2024-09-13T18:26:42.191442+0000","last_fullsized":"2024-09-13T18:26:42.191442+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:32.668533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.871706+0000","last_change":"2024-09-13T18:26:42.185094+0000","last_active":"2024-09-13T18:26:43.871706+0000","last_peered":"2024-09-13T18:26:43.871706+0000","last_clean":"2024-09-13T18:26:43.871706+0000","last_became_active":"2024-09-13T18:26:42.184831+0000","last_became_peered":"2024-09-13T18:26:42.184831+0000","last_unstale":"2024-09-13T18:26:43.871706+0000","last_undegraded":"2024-09-13T18:26:43.871706+0000","last_fullsized":"2024-09-13T18:26:43.871706+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:38.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172805+0000","last_change":"2024-09-13T18:26:42.183841+0000","last_active":"2024-09-13T18:26:43.172805+0000","last_peered":"2024-09-13T18:26:43.172805+0000","last_clean":"2024-09-13T18:26:43.172805+0000","last_became_active":"2024-09-13T18:26:42.183506+0000","last_became_peered":"2024-09-13T18:26:42.183506+0000","last_unstale":"2024-09-13T18:26:43.172805+0000","last_undegraded":"2024-09-13T18:26:43.172805+0000","last_fullsized":"2024-09-13T18:26:43.172805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:15.825996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.213764+0000","last_change":"2024-09-13T18:26:41.780313+0000","last_active":"2024-09-13T18:26:42.213764+0000","last_peered":"2024-09-13T18:26:42.213764+0000","last_clean":"2024-09-13T18:26:42.213764+0000","last_became_active":"2024-09-13T18:26:41.779907+0000","last_became_peered":"2024-09-13T18:26:41.779907+0000","last_unstale":"2024-09-13T18:26:42.213764+0000","last_undegraded":"2024-09-13T18:26:42.213764+0000","last_fullsized":"2024-09-13T18:26:42.213764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:48.634817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.084065+0000","last_change":"2024-09-13T18:26:42.216626+0000","last_active":"2024-09-13T18:26:45.084065+0000","last_peered":"2024-09-13T18:26:45.084065+0000","last_clean":"2024-09-13T18:26:45.084065+0000","last_became_active":"2024-09-13T18:26:42.215190+0000","last_became_peered":"2024-09-13T18:26:42.215190+0000","last_unstale":"2024-09-13T18:26:45.084065+0000","last_undegraded":"2024-09-13T18:26:45.084065+0000","last_fullsized":"2024-09-13T18:26:45.084065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:27.097044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.220602+0000","last_change":"2024-09-13T18:26:41.798871+0000","last_active":"2024-09-13T18:26:42.220602+0000","last_peered":"2024-09-13T18:26:42.220602+0000","last_clean":"2024-09-13T18:26:42.220602+0000","last_became_active":"2024-09-13T18:26:41.794811+0000","last_became_peered":"2024-09-13T18:26:41.794811+0000","last_unstale":"2024-09-13T18:26:42.220602+0000","last_undegraded":"2024-09-13T18:26:42.220602+0000","last_fullsized":"2024-09-13T18:26:42.220602+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:35.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177988+0000","last_change":"2024-09-13T18:26:42.192464+0000","last_active":"2024-09-13T18:26:43.177988+0000","last_peered":"2024-09-13T18:26:43.177988+0000","last_clean":"2024-09-13T18:26:43.177988+0000","last_became_active":"2024-09-13T18:26:42.191543+0000","last_became_peered":"2024-09-13T18:26:42.191543+0000","last_unstale":"2024-09-13T18:26:43.177988+0000","last_undegraded":"2024-09-13T18:26:43.177988+0000","last_fullsized":"2024-09-13T18:26:43.177988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172822+0000","last_change":"2024-09-13T18:26:41.804324+0000","last_active":"2024-09-13T18:26:43.172822+0000","last_peered":"2024-09-13T18:26:43.172822+0000","last_clean":"2024-09-13T18:26:43.172822+0000","last_became_active":"2024-09-13T18:26:41.803835+0000","last_became_peered":"2024-09-13T18:26:41.803835+0000","last_unstale":"2024-09-13T18:26:43.172822+0000","last_undegraded":"2024-09-13T18:26:43.172822+0000","last_fullsized":"2024-09-13T18:26:43.172822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:53.883190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172892+0000","last_change":"2024-09-13T18:26:42.214914+0000","last_active":"2024-09-13T18:26:43.172892+0000","last_peered":"2024-09-13T18:26:43.172892+0000","last_clean":"2024-09-13T18:26:43.172892+0000","last_became_active":"2024-09-13T18:26:42.214639+0000","last_became_peered":"2024-09-13T18:26:42.214639+0000","last_unstale":"2024-09-13T18:26:43.172892+0000","last_undegraded":"2024-09-13T18:26:43.172892+0000","last_fullsized":"2024-09-13T18:26:43.172892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:01.193783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.220186+0000","last_change":"2024-09-13T18:26:41.812573+0000","last_active":"2024-09-13T18:26:42.220186+0000","last_peered":"2024-09-13T18:26:42.220186+0000","last_clean":"2024-09-13T18:26:42.220186+0000","last_became_active":"2024-09-13T18:26:41.811864+0000","last_became_peered":"2024-09-13T18:26:41.811864+0000","last_unstale":"2024-09-13T18:26:42.220186+0000","last_undegraded":"2024-09-13T18:26:42.220186+0000","last_fullsized":"2024-09-13T18:26:42.220186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:00.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.218331+0000","last_change":"2024-09-13T18:26:42.216352+0000","last_active":"2024-09-13T18:26:42.218331+0000","last_peered":"2024-09-13T18:26:42.218331+0000","last_clean":"2024-09-13T18:26:42.218331+0000","last_became_active":"2024-09-13T18:26:42.215741+0000","last_became_peered":"2024-09-13T18:26:42.215741+0000","last_unstale":"2024-09-13T18:26:42.218331+0000","last_undegraded":"2024-09-13T18:26:42.218331+0000","last_fullsized":"2024-09-13T18:26:42.218331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:59.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.211537+0000","last_change":"2024-09-13T18:26:41.796032+0000","last_active":"2024-09-13T18:26:42.211537+0000","last_peered":"2024-09-13T18:26:42.211537+0000","last_clean":"2024-09-13T18:26:42.211537+0000","last_became_active":"2024-09-13T18:26:41.795232+0000","last_became_peered":"2024-09-13T18:26:41.795232+0000","last_unstale":"2024-09-13T18:26:42.211537+0000","last_undegraded":"2024-09-13T18:26:42.211537+0000","last_fullsized":"2024-09-13T18:26:42.211537+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:41.678475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381800+0000","last_change":"2024-09-13T18:26:42.180214+0000","last_active":"2024-09-13T18:26:44.381800+0000","last_peered":"2024-09-13T18:26:44.381800+0000","last_clean":"2024-09-13T18:26:44.381800+0000","last_became_active":"2024-09-13T18:26:42.179478+0000","last_became_peered":"2024-09-13T18:26:42.179478+0000","last_unstale":"2024-09-13T18:26:44.381800+0000","last_undegraded":"2024-09-13T18:26:44.381800+0000","last_fullsized":"2024-09-13T18:26:44.381800+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:34.533154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.210289+0000","last_change":"2024-09-13T18:26:41.804378+0000","last_active":"2024-09-13T18:26:42.210289+0000","last_peered":"2024-09-13T18:26:42.210289+0000","last_clean":"2024-09-13T18:26:42.210289+0000","last_became_active":"2024-09-13T18:26:41.803629+0000","last_became_peered":"2024-09-13T18:26:41.803629+0000","last_unstale":"2024-09-13T18:26:42.210289+0000","last_undegraded":"2024-09-13T18:26:42.210289+0000","last_fullsized":"2024-09-13T18:26:42.210289+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:57.373104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381499+0000","last_change":"2024-09-13T18:26:42.206083+0000","last_active":"2024-09-13T18:26:44.381499+0000","last_peered":"2024-09-13T18:26:44.381499+0000","last_clean":"2024-09-13T18:26:44.381499+0000","last_became_active":"2024-09-13T18:26:42.205808+0000","last_became_peered":"2024-09-13T18:26:42.205808+0000","last_unstale":"2024-09-13T18:26:44.381499+0000","last_undegraded":"2024-09-13T18:26:44.381499+0000","last_fullsized":"2024-09-13T18:26:44.381499+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:59.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177385+0000","last_change":"2024-09-13T18:26:41.791880+0000","last_active":"2024-09-13T18:26:43.177385+0000","last_peered":"2024-09-13T18:26:43.177385+0000","last_clean":"2024-09-13T18:26:43.177385+0000","last_became_active":"2024-09-13T18:26:41.791182+0000","last_became_peered":"2024-09-13T18:26:41.791182+0000","last_unstale":"2024-09-13T18:26:43.177385+0000","last_undegraded":"2024-09-13T18:26:43.177385+0000","last_fullsized":"2024-09-13T18:26:43.177385+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:58.239230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.082894+0000","last_change":"2024-09-13T18:26:42.206038+0000","last_active":"2024-09-13T18:26:45.082894+0000","last_peered":"2024-09-13T18:26:45.082894+0000","last_clean":"2024-09-13T18:26:45.082894+0000","last_became_active":"2024-09-13T18:26:42.205461+0000","last_became_peered":"2024-09-13T18:26:42.205461+0000","last_unstale":"2024-09-13T18:26:45.082894+0000","last_undegraded":"2024-09-13T18:26:45.082894+0000","last_fullsized":"2024-09-13T18:26:45.082894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:56.153102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381623+0000","last_change":"2024-09-13T18:26:41.788633+0000","last_active":"2024-09-13T18:26:44.381623+0000","last_peered":"2024-09-13T18:26:44.381623+0000","last_clean":"2024-09-13T18:26:44.381623+0000","last_became_active":"2024-09-13T18:26:41.787982+0000","last_became_peered":"2024-09-13T18:26:41.787982+0000","last_unstale":"2024-09-13T18:26:44.381623+0000","last_undegraded":"2024-09-13T18:26:44.381623+0000","last_fullsized":"2024-09-13T18:26:44.381623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:36.601061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.183103+0000","last_change":"2024-09-13T18:26:42.178417+0000","last_active":"2024-09-13T18:26:42.183103+0000","last_peered":"2024-09-13T18:26:42.183103+0000","last_clean":"2024-09-13T18:26:42.183103+0000","last_became_active":"2024-09-13T18:26:42.177724+0000","last_became_peered":"2024-09-13T18:26:42.177724+0000","last_unstale":"2024-09-13T18:26:42.183103+0000","last_undegraded":"2024-09-13T18:26:42.183103+0000","last_fullsized":"2024-09-13T18:26:42.183103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:22.661205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.167963+0000","last_change":"2024-09-13T18:26:41.793817+0000","last_active":"2024-09-13T18:26:42.167963+0000","last_peered":"2024-09-13T18:26:42.167963+0000","last_clean":"2024-09-13T18:26:42.167963+0000","last_became_active":"2024-09-13T18:26:41.793113+0000","last_became_peered":"2024-09-13T18:26:41.793113+0000","last_unstale":"2024-09-13T18:26:42.167963+0000","last_undegraded":"2024-09-13T18:26:42.167963+0000","last_fullsized":"2024-09-13T18:26:42.167963+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:04.946821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.217257+0000","last_change":"2024-09-13T18:26:42.209275+0000","last_active":"2024-09-13T18:26:42.217257+0000","last_peered":"2024-09-13T18:26:42.217257+0000","last_clean":"2024-09-13T18:26:42.217257+0000","last_became_active":"2024-09-13T18:26:42.207633+0000","last_became_peered":"2024-09-13T18:26:42.207633+0000","last_unstale":"2024-09-13T18:26:42.217257+0000","last_undegraded":"2024-09-13T18:26:42.217257+0000","last_fullsized":"2024-09-13T18:26:42.217257+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:58.804712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382562+0000","last_change":"2024-09-13T18:26:41.801027+0000","last_active":"2024-09-13T18:26:44.382562+0000","last_peered":"2024-09-13T18:26:44.382562+0000","last_clean":"2024-09-13T18:26:44.382562+0000","last_became_active":"2024-09-13T18:26:41.800553+0000","last_became_peered":"2024-09-13T18:26:41.800553+0000","last_unstale":"2024-09-13T18:26:44.382562+0000","last_undegraded":"2024-09-13T18:26:44.382562+0000","last_fullsized":"2024-09-13T18:26:44.382562+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:36.003767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182568+0000","last_change":"2024-09-13T18:26:42.179684+0000","last_active":"2024-09-13T18:26:42.182568+0000","last_peered":"2024-09-13T18:26:42.182568+0000","last_clean":"2024-09-13T18:26:42.182568+0000","last_became_active":"2024-09-13T18:26:42.179432+0000","last_became_peered":"2024-09-13T18:26:42.179432+0000","last_unstale":"2024-09-13T18:26:42.182568+0000","last_undegraded":"2024-09-13T18:26:42.182568+0000","last_fullsized":"2024-09-13T18:26:42.182568+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:52.110887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.222737+0000","last_change":"2024-09-13T18:26:41.805854+0000","last_active":"2024-09-13T18:26:42.222737+0000","last_peered":"2024-09-13T18:26:42.222737+0000","last_clean":"2024-09-13T18:26:42.222737+0000","last_became_active":"2024-09-13T18:26:41.805050+0000","last_became_peered":"2024-09-13T18:26:41.805050+0000","last_unstale":"2024-09-13T18:26:42.222737+0000","last_undegraded":"2024-09-13T18:26:42.222737+0000","last_fullsized":"2024-09-13T18:26:42.222737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:21.657580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.217877+0000","last_change":"2024-09-13T18:26:42.197702+0000","last_active":"2024-09-13T18:26:42.217877+0000","last_peered":"2024-09-13T18:26:42.217877+0000","last_clean":"2024-09-13T18:26:42.217877+0000","last_became_active":"2024-09-13T18:26:42.195067+0000","last_became_peered":"2024-09-13T18:26:42.195067+0000","last_unstale":"2024-09-13T18:26:42.217877+0000","last_undegraded":"2024-09-13T18:26:42.217877+0000","last_fullsized":"2024-09-13T18:26:42.217877+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872242+0000","last_change":"2024-09-13T18:26:41.790941+0000","last_active":"2024-09-13T18:26:43.872242+0000","last_peered":"2024-09-13T18:26:43.872242+0000","last_clean":"2024-09-13T18:26:43.872242+0000","last_became_active":"2024-09-13T18:26:41.790423+0000","last_became_peered":"2024-09-13T18:26:41.790423+0000","last_unstale":"2024-09-13T18:26:43.872242+0000","last_undegraded":"2024-09-13T18:26:43.872242+0000","last_fullsized":"2024-09-13T18:26:43.872242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:21.604937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083196+0000","last_change":"2024-09-13T18:26:42.212409+0000","last_active":"2024-09-13T18:26:45.083196+0000","last_peered":"2024-09-13T18:26:45.083196+0000","last_clean":"2024-09-13T18:26:45.083196+0000","last_became_active":"2024-09-13T18:26:42.211922+0000","last_became_peered":"2024-09-13T18:26:42.211922+0000","last_unstale":"2024-09-13T18:26:45.083196+0000","last_undegraded":"2024-09-13T18:26:45.083196+0000","last_fullsized":"2024-09-13T18:26:45.083196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:54.886814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.202530+0000","last_change":"2024-09-13T18:26:41.788809+0000","last_active":"2024-09-13T18:26:42.202530+0000","last_peered":"2024-09-13T18:26:42.202530+0000","last_clean":"2024-09-13T18:26:42.202530+0000","last_became_active":"2024-09-13T18:26:41.788218+0000","last_became_peered":"2024-09-13T18:26:41.788218+0000","last_unstale":"2024-09-13T18:26:42.202530+0000","last_undegraded":"2024-09-13T18:26:42.202530+0000","last_fullsized":"2024-09-13T18:26:42.202530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:02.514713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381946+0000","last_change":"2024-09-13T18:26:42.204586+0000","last_active":"2024-09-13T18:26:44.381946+0000","last_peered":"2024-09-13T18:26:44.381946+0000","last_clean":"2024-09-13T18:26:44.381946+0000","last_became_active":"2024-09-13T18:26:42.204328+0000","last_became_peered":"2024-09-13T18:26:42.204328+0000","last_unstale":"2024-09-13T18:26:44.381946+0000","last_undegraded":"2024-09-13T18:26:44.381946+0000","last_fullsized":"2024-09-13T18:26:44.381946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:15.825996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.184021+0000","last_change":"2024-09-13T18:26:41.800395+0000","last_active":"2024-09-13T18:26:42.184021+0000","last_peered":"2024-09-13T18:26:42.184021+0000","last_clean":"2024-09-13T18:26:42.184021+0000","last_became_active":"2024-09-13T18:26:41.799657+0000","last_became_peered":"2024-09-13T18:26:41.799657+0000","last_unstale":"2024-09-13T18:26:42.184021+0000","last_undegraded":"2024-09-13T18:26:42.184021+0000","last_fullsized":"2024-09-13T18:26:42.184021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.376797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.185664+0000","last_change":"2024-09-13T18:26:42.183461+0000","last_active":"2024-09-13T18:26:42.185664+0000","last_peered":"2024-09-13T18:26:42.185664+0000","last_clean":"2024-09-13T18:26:42.185664+0000","last_became_active":"2024-09-13T18:26:42.183194+0000","last_became_peered":"2024-09-13T18:26:42.183194+0000","last_unstale":"2024-09-13T18:26:42.185664+0000","last_undegraded":"2024-09-13T18:26:42.185664+0000","last_fullsized":"2024-09-13T18:26:42.185664+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.174816+0000","last_change":"2024-09-13T18:26:41.788164+0000","last_active":"2024-09-13T18:26:42.174816+0000","last_peered":"2024-09-13T18:26:42.174816+0000","last_clean":"2024-09-13T18:26:42.174816+0000","last_became_active":"2024-09-13T18:26:41.787721+0000","last_became_peered":"2024-09-13T18:26:41.787721+0000","last_unstale":"2024-09-13T18:26:42.174816+0000","last_undegraded":"2024-09-13T18:26:42.174816+0000","last_fullsized":"2024-09-13T18:26:42.174816+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:32.667699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.222170+0000","last_change":"2024-09-13T18:26:42.219209+0000","last_active":"2024-09-13T18:26:42.222170+0000","last_peered":"2024-09-13T18:26:42.222170+0000","last_clean":"2024-09-13T18:26:42.222170+0000","last_became_active":"2024-09-13T18:26:42.218595+0000","last_became_peered":"2024-09-13T18:26:42.218595+0000","last_unstale":"2024-09-13T18:26:42.222170+0000","last_undegraded":"2024-09-13T18:26:42.222170+0000","last_fullsized":"2024-09-13T18:26:42.222170+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:14.728821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381799+0000","last_change":"2024-09-13T18:26:41.802488+0000","last_active":"2024-09-13T18:26:44.381799+0000","last_peered":"2024-09-13T18:26:44.381799+0000","last_clean":"2024-09-13T18:26:44.381799+0000","last_became_active":"2024-09-13T18:26:41.802040+0000","last_became_peered":"2024-09-13T18:26:41.802040+0000","last_unstale":"2024-09-13T18:26:44.381799+0000","last_undegraded":"2024-09-13T18:26:44.381799+0000","last_fullsized":"2024-09-13T18:26:44.381799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:06.971251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872242+0000","last_change":"2024-09-13T18:26:42.191381+0000","last_active":"2024-09-13T18:26:43.872242+0000","last_peered":"2024-09-13T18:26:43.872242+0000","last_clean":"2024-09-13T18:26:43.872242+0000","last_became_active":"2024-09-13T18:26:42.190896+0000","last_became_peered":"2024-09-13T18:26:42.190896+0000","last_unstale":"2024-09-13T18:26:43.872242+0000","last_undegraded":"2024-09-13T18:26:43.872242+0000","last_fullsized":"2024-09-13T18:26:43.872242+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:58.376728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872329+0000","last_change":"2024-09-13T18:26:41.775866+0000","last_active":"2024-09-13T18:26:43.872329+0000","last_peered":"2024-09-13T18:26:43.872329+0000","last_clean":"2024-09-13T18:26:43.872329+0000","last_became_active":"2024-09-13T18:26:41.775245+0000","last_became_peered":"2024-09-13T18:26:41.775245+0000","last_unstale":"2024-09-13T18:26:43.872329+0000","last_undegraded":"2024-09-13T18:26:43.872329+0000","last_fullsized":"2024-09-13T18:26:43.872329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:19.130933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382332+0000","last_change":"2024-09-13T18:26:42.178230+0000","last_active":"2024-09-13T18:26:44.382332+0000","last_peered":"2024-09-13T18:26:44.382332+0000","last_clean":"2024-09-13T18:26:44.382332+0000","last_became_active":"2024-09-13T18:26:42.177966+0000","last_became_peered":"2024-09-13T18:26:42.177966+0000","last_unstale":"2024-09-13T18:26:44.382332+0000","last_undegraded":"2024-09-13T18:26:44.382332+0000","last_fullsized":"2024-09-13T18:26:44.382332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:19.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.208941+0000","last_change":"2024-09-13T18:26:41.792328+0000","last_active":"2024-09-13T18:26:42.208941+0000","last_peered":"2024-09-13T18:26:42.208941+0000","last_clean":"2024-09-13T18:26:42.208941+0000","last_became_active":"2024-09-13T18:26:41.791128+0000","last_became_peered":"2024-09-13T18:26:41.791128+0000","last_unstale":"2024-09-13T18:26:42.208941+0000","last_undegraded":"2024-09-13T18:26:42.208941+0000","last_fullsized":"2024-09-13T18:26:42.208941+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:37.884621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083497+0000","last_change":"2024-09-13T18:26:42.213492+0000","last_active":"2024-09-13T18:26:45.083497+0000","last_peered":"2024-09-13T18:26:45.083497+0000","last_clean":"2024-09-13T18:26:45.083497+0000","last_became_active":"2024-09-13T18:26:42.212751+0000","last_became_peered":"2024-09-13T18:26:42.212751+0000","last_unstale":"2024-09-13T18:26:45.083497+0000","last_undegraded":"2024-09-13T18:26:45.083497+0000","last_fullsized":"2024-09-13T18:26:45.083497+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:05.950445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178263+0000","last_change":"2024-09-13T18:26:41.803308+0000","last_active":"2024-09-13T18:26:43.178263+0000","last_peered":"2024-09-13T18:26:43.178263+0000","last_clean":"2024-09-13T18:26:43.178263+0000","last_became_active":"2024-09-13T18:26:41.801125+0000","last_became_peered":"2024-09-13T18:26:41.801125+0000","last_unstale":"2024-09-13T18:26:43.178263+0000","last_undegraded":"2024-09-13T18:26:43.178263+0000","last_fullsized":"2024-09-13T18:26:43.178263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.376797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083485+0000","last_change":"2024-09-13T18:26:42.214316+0000","last_active":"2024-09-13T18:26:45.083485+0000","last_peered":"2024-09-13T18:26:45.083485+0000","last_clean":"2024-09-13T18:26:45.083485+0000","last_became_active":"2024-09-13T18:26:42.213198+0000","last_became_peered":"2024-09-13T18:26:42.213198+0000","last_unstale":"2024-09-13T18:26:45.083485+0000","last_undegraded":"2024-09-13T18:26:45.083485+0000","last_fullsized":"2024-09-13T18:26:45.083485+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:58.376728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.175197+0000","last_change":"2024-09-13T18:26:41.780266+0000","last_active":"2024-09-13T18:26:42.175197+0000","last_peered":"2024-09-13T18:26:42.175197+0000","last_clean":"2024-09-13T18:26:42.175197+0000","last_became_active":"2024-09-13T18:26:41.779600+0000","last_became_peered":"2024-09-13T18:26:41.779600+0000","last_unstale":"2024-09-13T18:26:42.175197+0000","last_undegraded":"2024-09-13T18:26:42.175197+0000","last_fullsized":"2024-09-13T18:26:42.175197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:54.284571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182539+0000","last_change":"2024-09-13T18:26:42.179172+0000","last_active":"2024-09-13T18:26:42.182539+0000","last_peered":"2024-09-13T18:26:42.182539+0000","last_clean":"2024-09-13T18:26:42.182539+0000","last_became_active":"2024-09-13T18:26:42.178940+0000","last_became_peered":"2024-09-13T18:26:42.178940+0000","last_unstale":"2024-09-13T18:26:42.182539+0000","last_undegraded":"2024-09-13T18:26:42.182539+0000","last_fullsized":"2024-09-13T18:26:42.182539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:29.033821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.211760+0000","last_change":"2024-09-13T18:26:41.795613+0000","last_active":"2024-09-13T18:26:42.211760+0000","last_peered":"2024-09-13T18:26:42.211760+0000","last_clean":"2024-09-13T18:26:42.211760+0000","last_became_active":"2024-09-13T18:26:41.795081+0000","last_became_peered":"2024-09-13T18:26:41.795081+0000","last_unstale":"2024-09-13T18:26:42.211760+0000","last_undegraded":"2024-09-13T18:26:42.211760+0000","last_fullsized":"2024-09-13T18:26:42.211760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:10.394301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172490+0000","last_change":"2024-09-13T18:26:42.191181+0000","last_active":"2024-09-13T18:26:43.172490+0000","last_peered":"2024-09-13T18:26:43.172490+0000","last_clean":"2024-09-13T18:26:43.172490+0000","last_became_active":"2024-09-13T18:26:42.190553+0000","last_became_peered":"2024-09-13T18:26:42.190553+0000","last_unstale":"2024-09-13T18:26:43.172490+0000","last_undegraded":"2024-09-13T18:26:43.172490+0000","last_fullsized":"2024-09-13T18:26:43.172490+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:41.031148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177607+0000","last_change":"2024-09-13T18:26:41.796332+0000","last_active":"2024-09-13T18:26:43.177607+0000","last_peered":"2024-09-13T18:26:43.177607+0000","last_clean":"2024-09-13T18:26:43.177607+0000","last_became_active":"2024-09-13T18:26:41.795600+0000","last_became_peered":"2024-09-13T18:26:41.795600+0000","last_unstale":"2024-09-13T18:26:43.177607+0000","last_undegraded":"2024-09-13T18:26:43.177607+0000","last_fullsized":"2024-09-13T18:26:43.177607+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:44.428115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.871864+0000","last_change":"2024-09-13T18:26:42.204425+0000","last_active":"2024-09-13T18:26:43.871864+0000","last_peered":"2024-09-13T18:26:43.871864+0000","last_clean":"2024-09-13T18:26:43.871864+0000","last_became_active":"2024-09-13T18:26:42.204128+0000","last_became_peered":"2024-09-13T18:26:42.204128+0000","last_unstale":"2024-09-13T18:26:43.871864+0000","last_undegraded":"2024-09-13T18:26:43.871864+0000","last_fullsized":"2024-09-13T18:26:43.871864+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:53.632168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381599+0000","last_change":"2024-09-13T18:26:41.795784+0000","last_active":"2024-09-13T18:26:44.381599+0000","last_peered":"2024-09-13T18:26:44.381599+0000","last_clean":"2024-09-13T18:26:44.381599+0000","last_became_active":"2024-09-13T18:26:41.795354+0000","last_became_peered":"2024-09-13T18:26:41.795354+0000","last_unstale":"2024-09-13T18:26:44.381599+0000","last_undegraded":"2024-09-13T18:26:44.381599+0000","last_fullsized":"2024-09-13T18:26:44.381599+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:15.458772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381615+0000","last_change":"2024-09-13T18:26:42.184691+0000","last_active":"2024-09-13T18:26:44.381615+0000","last_peered":"2024-09-13T18:26:44.381615+0000","last_clean":"2024-09-13T18:26:44.381615+0000","last_became_active":"2024-09-13T18:26:42.184421+0000","last_became_peered":"2024-09-13T18:26:42.184421+0000","last_unstale":"2024-09-13T18:26:44.381615+0000","last_undegraded":"2024-09-13T18:26:44.381615+0000","last_fullsized":"2024-09-13T18:26:44.381615+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:22.661205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.181587+0000","last_change":"2024-09-13T18:26:41.799287+0000","last_active":"2024-09-13T18:26:42.181587+0000","last_peered":"2024-09-13T18:26:42.181587+0000","last_clean":"2024-09-13T18:26:42.181587+0000","last_became_active":"2024-09-13T18:26:41.798623+0000","last_became_peered":"2024-09-13T18:26:41.798623+0000","last_unstale":"2024-09-13T18:26:42.181587+0000","last_undegraded":"2024-09-13T18:26:42.181587+0000","last_fullsized":"2024-09-13T18:26:42.181587+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:40.027523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.084153+0000","last_change":"2024-09-13T18:26:42.215803+0000","last_active":"2024-09-13T18:26:45.084153+0000","last_peered":"2024-09-13T18:26:45.084153+0000","last_clean":"2024-09-13T18:26:45.084153+0000","last_became_active":"2024-09-13T18:26:42.213804+0000","last_became_peered":"2024-09-13T18:26:42.213804+0000","last_unstale":"2024-09-13T18:26:45.084153+0000","last_undegraded":"2024-09-13T18:26:45.084153+0000","last_fullsized":"2024-09-13T18:26:45.084153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:57.198496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.175530+0000","last_change":"2024-09-13T18:26:41.792988+0000","last_active":"2024-09-13T18:26:42.175530+0000","last_peered":"2024-09-13T18:26:42.175530+0000","last_clean":"2024-09-13T18:26:42.175530+0000","last_became_active":"2024-09-13T18:26:41.792675+0000","last_became_peered":"2024-09-13T18:26:41.792675+0000","last_unstale":"2024-09-13T18:26:42.175530+0000","last_undegraded":"2024-09-13T18:26:42.175530+0000","last_fullsized":"2024-09-13T18:26:42.175530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:21.657580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382077+0000","last_change":"2024-09-13T18:26:42.177507+0000","last_active":"2024-09-13T18:26:44.382077+0000","last_peered":"2024-09-13T18:26:44.382077+0000","last_clean":"2024-09-13T18:26:44.382077+0000","last_became_active":"2024-09-13T18:26:42.177223+0000","last_became_peered":"2024-09-13T18:26:42.177223+0000","last_unstale":"2024-09-13T18:26:44.382077+0000","last_undegraded":"2024-09-13T18:26:44.382077+0000","last_fullsized":"2024-09-13T18:26:44.382077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.181867+0000","last_change":"2024-09-13T18:26:41.804413+0000","last_active":"2024-09-13T18:26:42.181867+0000","last_peered":"2024-09-13T18:26:42.181867+0000","last_clean":"2024-09-13T18:26:42.181867+0000","last_became_active":"2024-09-13T18:26:41.803710+0000","last_became_peered":"2024-09-13T18:26:41.803710+0000","last_unstale":"2024-09-13T18:26:42.181867+0000","last_undegraded":"2024-09-13T18:26:42.181867+0000","last_fullsized":"2024-09-13T18:26:42.181867+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:58.239230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.217924+0000","last_change":"2024-09-13T18:26:42.199256+0000","last_active":"2024-09-13T18:26:42.217924+0000","last_peered":"2024-09-13T18:26:42.217924+0000","last_clean":"2024-09-13T18:26:42.217924+0000","last_became_active":"2024-09-13T18:26:42.198547+0000","last_became_peered":"2024-09-13T18:26:42.198547+0000","last_unstale":"2024-09-13T18:26:42.217924+0000","last_undegraded":"2024-09-13T18:26:42.217924+0000","last_fullsized":"2024-09-13T18:26:42.217924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:19.186782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172420+0000","last_change":"2024-09-13T18:26:41.805356+0000","last_active":"2024-09-13T18:26:43.172420+0000","last_peered":"2024-09-13T18:26:43.172420+0000","last_clean":"2024-09-13T18:26:43.172420+0000","last_became_active":"2024-09-13T18:26:41.804795+0000","last_became_peered":"2024-09-13T18:26:41.804795+0000","last_unstale":"2024-09-13T18:26:43.172420+0000","last_undegraded":"2024-09-13T18:26:43.172420+0000","last_fullsized":"2024-09-13T18:26:43.172420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:54.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.187065+0000","last_change":"2024-09-13T18:26:42.184747+0000","last_active":"2024-09-13T18:26:42.187065+0000","last_peered":"2024-09-13T18:26:42.187065+0000","last_clean":"2024-09-13T18:26:42.187065+0000","last_became_active":"2024-09-13T18:26:42.184439+0000","last_became_peered":"2024-09-13T18:26:42.184439+0000","last_unstale":"2024-09-13T18:26:42.187065+0000","last_undegraded":"2024-09-13T18:26:42.187065+0000","last_fullsized":"2024-09-13T18:26:42.187065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:39.886829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.187027+0000","last_change":"2024-09-13T18:26:41.804092+0000","last_active":"2024-09-13T18:26:42.187027+0000","last_peered":"2024-09-13T18:26:42.187027+0000","last_clean":"2024-09-13T18:26:42.187027+0000","last_became_active":"2024-09-13T18:26:41.803422+0000","last_became_peered":"2024-09-13T18:26:41.803422+0000","last_unstale":"2024-09-13T18:26:42.187027+0000","last_undegraded":"2024-09-13T18:26:42.187027+0000","last_fullsized":"2024-09-13T18:26:42.187027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:44.428115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.182686+0000","last_change":"2024-09-13T18:26:42.180274+0000","last_active":"2024-09-13T18:26:42.182686+0000","last_peered":"2024-09-13T18:26:42.182686+0000","last_clean":"2024-09-13T18:26:42.182686+0000","last_became_active":"2024-09-13T18:26:42.179991+0000","last_became_peered":"2024-09-13T18:26:42.179991+0000","last_unstale":"2024-09-13T18:26:42.182686+0000","last_undegraded":"2024-09-13T18:26:42.182686+0000","last_fullsized":"2024-09-13T18:26:42.182686+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:19.186782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.167817+0000","last_change":"2024-09-13T18:26:41.791722+0000","last_active":"2024-09-13T18:26:42.167817+0000","last_peered":"2024-09-13T18:26:42.167817+0000","last_clean":"2024-09-13T18:26:42.167817+0000","last_became_active":"2024-09-13T18:26:41.790212+0000","last_became_peered":"2024-09-13T18:26:41.790212+0000","last_unstale":"2024-09-13T18:26:42.167817+0000","last_undegraded":"2024-09-13T18:26:42.167817+0000","last_fullsized":"2024-09-13T18:26:42.167817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:45.205786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177622+0000","last_change":"2024-09-13T18:26:42.187618+0000","last_active":"2024-09-13T18:26:43.177622+0000","last_peered":"2024-09-13T18:26:43.177622+0000","last_clean":"2024-09-13T18:26:43.177622+0000","last_became_active":"2024-09-13T18:26:42.186226+0000","last_became_peered":"2024-09-13T18:26:42.186226+0000","last_unstale":"2024-09-13T18:26:43.177622+0000","last_undegraded":"2024-09-13T18:26:43.177622+0000","last_fullsized":"2024-09-13T18:26:43.177622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:08.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172424+0000","last_change":"2024-09-13T18:26:41.786760+0000","last_active":"2024-09-13T18:26:43.172424+0000","last_peered":"2024-09-13T18:26:43.172424+0000","last_clean":"2024-09-13T18:26:43.172424+0000","last_became_active":"2024-09-13T18:26:41.786467+0000","last_became_peered":"2024-09-13T18:26:41.786467+0000","last_unstale":"2024-09-13T18:26:43.172424+0000","last_undegraded":"2024-09-13T18:26:43.172424+0000","last_fullsized":"2024-09-13T18:26:43.172424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:57.373104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:42.179720+0000","last_change":"2024-09-13T18:26:42.176373+0000","last_active":"2024-09-13T18:26:42.179720+0000","last_peered":"2024-09-13T18:26:42.179720+0000","last_clean":"2024-09-13T18:26:42.179720+0000","last_became_active":"2024-09-13T18:26:42.175579+0000","last_became_peered":"2024-09-13T18:26:42.175579+0000","last_unstale":"2024-09-13T18:26:42.179720+0000","last_undegraded":"2024-09-13T18:26:42.179720+0000","last_fullsized":"2024-09-13T18:26:42.179720+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:45.431739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381828+0000","last_change":"2024-09-13T18:26:41.781621+0000","last_active":"2024-09-13T18:26:44.381828+0000","last_peered":"2024-09-13T18:26:44.381828+0000","last_clean":"2024-09-13T18:26:44.381828+0000","last_became_active":"2024-09-13T18:26:41.780750+0000","last_became_peered":"2024-09-13T18:26:41.780750+0000","last_unstale":"2024-09-13T18:26:44.381828+0000","last_undegraded":"2024-09-13T18:26:44.381828+0000","last_fullsized":"2024-09-13T18:26:44.381828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:48.822739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382504+0000","last_change":"2024-09-13T18:26:42.204630+0000","last_active":"2024-09-13T18:26:44.382504+0000","last_peered":"2024-09-13T18:26:44.382504+0000","last_clean":"2024-09-13T18:26:44.382504+0000","last_became_active":"2024-09-13T18:26:42.204346+0000","last_became_peered":"2024-09-13T18:26:42.204346+0000","last_unstale":"2024-09-13T18:26:44.382504+0000","last_undegraded":"2024-09-13T18:26:44.382504+0000","last_fullsized":"2024-09-13T18:26:44.382504+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178427+0000","last_change":"2024-09-13T18:26:41.803018+0000","last_active":"2024-09-13T18:26:43.178427+0000","last_peered":"2024-09-13T18:26:43.178427+0000","last_clean":"2024-09-13T18:26:43.178427+0000","last_became_active":"2024-09-13T18:26:41.802300+0000","last_became_peered":"2024-09-13T18:26:41.802300+0000","last_unstale":"2024-09-13T18:26:43.178427+0000","last_undegraded":"2024-09-13T18:26:43.178427+0000","last_fullsized":"2024-09-13T18:26:43.178427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:40.027523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-13T18:26:41.783199+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:26:41.783199+0000","last_peered":"2024-09-13T18:26:41.783199+0000","last_clean":"2024-09-13T18:26:41.783199+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:26:41.783199+0000","last_undegraded":"2024-09-13T18:26:41.783199+0000","last_fullsized":"2024-09-13T18:26:41.783199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":804552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.298},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":1.169}]},{"osd":1,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.258},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.93300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.202}]},{"osd":3,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.88},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.337}]},{"osd":4,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.034}]},{"osd":6,"last update":"Fri Sep 13 18:25:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.1220000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":214766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.252}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.506},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":1.0529999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.587}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.141},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.88200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.181},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":1.6559999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.095}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":544768,"data_stored":220464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.876}]},{"osd":2,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.95399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.0449999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.081}]},{"osd":6,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.1259999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.497}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.97199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.621},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.03},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.069}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.141},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1060000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":540672,"data_stored":214732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.099}]},{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.91300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.002}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.3100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3,"5min":3,"15min":3},"last":1.143},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.173}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":557056,"data_stored":221980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.625},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.032}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.288}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.0649999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.115}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.087},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.167}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.145},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.3320000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35744,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":544768,"data_stored":220464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.876},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.83899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:25:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.99299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":810796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38}]},{"osd":3,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:25:46 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:26:50.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:26:51.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.098+0000 7fc1a2ab2640 1 Processor -- start 2024-09-13T18:26:51.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc1a2ab2640 1 -- start start 2024-09-13T18:26:51.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc1a2ab2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc19c06ae50 0x7fc19c15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc1a2ab2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc19c15cbf0 0x7fc19c15d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc1a2ab2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19c15dd40 con 0x7fc19c15c810 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc1a2ab2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19c15dff0 con 0x7fc19c06ae50 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc1a2ab2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19c15e2d0 con 0x7fc19c15cbf0 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc19c06ae50 0x7fc19c15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc19c06ae50 0x7fc19c15d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59274/0 (socket says 172.21.15.53:59274) 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 -- 172.21.15.53:0/2637443559 learned_addr learned my addr 172.21.15.53:0/2637443559 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc1a104f640 1 --2- 172.21.15.53:0/2637443559 >> v2:172.21.15.87:3300/0 conn(0x7fc19c15cbf0 0x7fc19c15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 -- 172.21.15.53:0/2637443559 >> v2:172.21.15.87:3300/0 conn(0x7fc19c15cbf0 msgr2=0x7fc19c15d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 --2- 172.21.15.53:0/2637443559 >> v2:172.21.15.87:3300/0 conn(0x7fc19c15cbf0 0x7fc19c15d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 -- 172.21.15.53:0/2637443559 >> v1:172.21.15.87:6789/0 conn(0x7fc19c15c810 legacy=0x7fc19c06a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 -- 172.21.15.53:0/2637443559 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c15e5b0 con 0x7fc19c06ae50 2024-09-13T18:26:51.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.102+0000 7fc193fff640 1 --2- 172.21.15.53:0/2637443559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c06ae50 0x7fc19c15d2c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0cccf0 tx=0x7fc18c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b01ce457b13f06a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1937fe640 1 -- 172.21.15.53:0/2637443559 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0ab660 con 0x7fc19c06ae50 2024-09-13T18:26:51.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1937fe640 1 -- 172.21.15.53:0/2637443559 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c0ab7c0 con 0x7fc19c06ae50 2024-09-13T18:26:51.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1937fe640 1 -- 172.21.15.53:0/2637443559 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0abb50 con 0x7fc19c06ae50 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/2637443559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c06ae50 msgr2=0x7fc19c15d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/2637443559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c06ae50 0x7fc19c15d2c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0cccf0 tx=0x7fc18c01c460 comp rx=0 tx=0).stop 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/2637443559 shutdown_connections 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/2637443559 >> v2:172.21.15.87:3300/0 conn(0x7fc19c15cbf0 0x7fc19c15d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/2637443559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c06ae50 0x7fc19c15d2c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/2637443559 >> 172.21.15.53:0/2637443559 conn(0x7fc19c071a50 msgr2=0x7fc19c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/2637443559 shutdown_connections 2024-09-13T18:26:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/2637443559 wait complete. 2024-09-13T18:26:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 Processor -- start 2024-09-13T18:26:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- start start 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc19c06ae50 0x7fc19c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c15c810 0x7fc19c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc19c15cbf0 0x7fc19c09d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0cc310 con 0x7fc19c15c810 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c154ec0 con 0x7fc19c06ae50 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0cdd70 con 0x7fc19c15cbf0 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c15c810 0x7fc19c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c15c810 0x7fc19c0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59284/0 (socket says 172.21.15.53:59284) 2024-09-13T18:26:51.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 -- 172.21.15.53:0/3512806932 learned_addr learned my addr 172.21.15.53:0/3512806932 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a084e640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc19c06ae50 0x7fc19c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a104f640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc19c15cbf0 0x7fc19c09d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 -- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc19c15cbf0 msgr2=0x7fc19c09d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc19c15cbf0 0x7fc19c09d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 -- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc19c06ae50 msgr2=0x7fc19c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc19c06ae50 0x7fc19c155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 -- 172.21.15.53:0/3512806932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0094d0 con 0x7fc19c15c810 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc193fff640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c15c810 0x7fc19c0cb370 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc18c019070 tx=0x7fc18c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1917fa640 1 -- 172.21.15.53:0/3512806932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0b4800 con 0x7fc19c15c810 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1917fa640 1 -- 172.21.15.53:0/3512806932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c0b4960 con 0x7fc19c15c810 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c0cba70 con 0x7fc19c15c810 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1917fa640 1 -- 172.21.15.53:0/3512806932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0b4d10 con 0x7fc19c15c810 2024-09-13T18:26:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.106+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c0cc030 con 0x7fc19c15c810 2024-09-13T18:26:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.110+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19c06a740 con 0x7fc19c15c810 2024-09-13T18:26:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.110+0000 7fc1917fa640 1 -- 172.21.15.53:0/3512806932 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc18c0a9070 con 0x7fc19c15c810 2024-09-13T18:26:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.110+0000 7fc1917fa640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc188066840 0x7fc188068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.110+0000 7fc1917fa640 1 -- 172.21.15.53:0/3512806932 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc18c11e410 con 0x7fc19c15c810 2024-09-13T18:26:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.110+0000 7fc1a084e640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc188066840 0x7fc188068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.110+0000 7fc1a084e640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc188066840 0x7fc188068d00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc19c157520 tx=0x7fc198009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.114+0000 7fc1917fa640 1 -- 172.21.15.53:0/3512806932 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc18c0eb510 con 0x7fc19c15c810 2024-09-13T18:26:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.270+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc19c15d840 con 0x7fc188066840 2024-09-13T18:26:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.290+0000 7fc1917fa640 1 -- 172.21.15.53:0/3512806932 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287698 (secure 0 0 0) 0x7fc19c15d840 con 0x7fc188066840 2024-09-13T18:26:51.297 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc188066840 msgr2=0x7fc188068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc188066840 0x7fc188068d00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc19c157520 tx=0x7fc198009040 comp rx=0 tx=0).stop 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c15c810 msgr2=0x7fc19c0cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c15c810 0x7fc19c0cb370 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc18c019070 tx=0x7fc18c01aca0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 shutdown_connections 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc188066840 0x7fc188068d00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc19c15cbf0 0x7fc19c09d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc19c15c810 0x7fc19c0cb370 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 --2- 172.21.15.53:0/3512806932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc19c06ae50 0x7fc19c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 >> 172.21.15.53:0/3512806932 conn(0x7fc19c071a50 msgr2=0x7fc19c1598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 shutdown_connections 2024-09-13T18:26:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.294+0000 7fc1a2ab2640 1 -- 172.21.15.53:0/3512806932 wait complete. 2024-09-13T18:26:51.314 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-13T18:26:50.938042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246196,"kb_used_data":5448,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754728524,"statfs":{"total":773094113280,"available":772842008576,"internally_reserved":0,"allocated":5578752,"data_stored":2948612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":246402616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.773636"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261542+0000","last_change":"2024-09-13T18:26:42.200662+0000","last_active":"2024-09-13T18:26:45.261542+0000","last_peered":"2024-09-13T18:26:45.261542+0000","last_clean":"2024-09-13T18:26:45.261542+0000","last_became_active":"2024-09-13T18:26:42.200015+0000","last_became_peered":"2024-09-13T18:26:42.200015+0000","last_unstale":"2024-09-13T18:26:45.261542+0000","last_undegraded":"2024-09-13T18:26:45.261542+0000","last_fullsized":"2024-09-13T18:26:45.261542+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178104+0000","last_change":"2024-09-13T18:26:42.187659+0000","last_active":"2024-09-13T18:26:43.178104+0000","last_peered":"2024-09-13T18:26:43.178104+0000","last_clean":"2024-09-13T18:26:43.178104+0000","last_became_active":"2024-09-13T18:26:42.185980+0000","last_became_peered":"2024-09-13T18:26:42.185980+0000","last_unstale":"2024-09-13T18:26:43.178104+0000","last_undegraded":"2024-09-13T18:26:43.178104+0000","last_fullsized":"2024-09-13T18:26:43.178104+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255025+0000","last_change":"2024-09-13T18:26:42.172685+0000","last_active":"2024-09-13T18:26:45.255025+0000","last_peered":"2024-09-13T18:26:45.255025+0000","last_clean":"2024-09-13T18:26:45.255025+0000","last_became_active":"2024-09-13T18:26:42.171857+0000","last_became_peered":"2024-09-13T18:26:42.171857+0000","last_unstale":"2024-09-13T18:26:45.255025+0000","last_undegraded":"2024-09-13T18:26:45.255025+0000","last_fullsized":"2024-09-13T18:26:45.255025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.380421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382058+0000","last_change":"2024-09-13T18:26:42.212976+0000","last_active":"2024-09-13T18:26:44.382058+0000","last_peered":"2024-09-13T18:26:44.382058+0000","last_clean":"2024-09-13T18:26:44.382058+0000","last_became_active":"2024-09-13T18:26:42.212748+0000","last_became_peered":"2024-09-13T18:26:42.212748+0000","last_unstale":"2024-09-13T18:26:44.382058+0000","last_undegraded":"2024-09-13T18:26:44.382058+0000","last_fullsized":"2024-09-13T18:26:44.382058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:42.682099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177842+0000","last_change":"2024-09-13T18:26:42.189143+0000","last_active":"2024-09-13T18:26:43.177842+0000","last_peered":"2024-09-13T18:26:43.177842+0000","last_clean":"2024-09-13T18:26:43.177842+0000","last_became_active":"2024-09-13T18:26:42.188457+0000","last_became_peered":"2024-09-13T18:26:42.188457+0000","last_unstale":"2024-09-13T18:26:43.177842+0000","last_undegraded":"2024-09-13T18:26:43.177842+0000","last_fullsized":"2024-09-13T18:26:43.177842+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:42.682099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263487+0000","last_change":"2024-09-13T18:26:42.197953+0000","last_active":"2024-09-13T18:26:45.263487+0000","last_peered":"2024-09-13T18:26:45.263487+0000","last_clean":"2024-09-13T18:26:45.263487+0000","last_became_active":"2024-09-13T18:26:42.197326+0000","last_became_peered":"2024-09-13T18:26:42.197326+0000","last_unstale":"2024-09-13T18:26:45.263487+0000","last_undegraded":"2024-09-13T18:26:45.263487+0000","last_fullsized":"2024-09-13T18:26:45.263487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:13.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261321+0000","last_change":"2024-09-13T18:26:42.196638+0000","last_active":"2024-09-13T18:26:45.261321+0000","last_peered":"2024-09-13T18:26:45.261321+0000","last_clean":"2024-09-13T18:26:45.261321+0000","last_became_active":"2024-09-13T18:26:42.195610+0000","last_became_peered":"2024-09-13T18:26:42.195610+0000","last_unstale":"2024-09-13T18:26:45.261321+0000","last_undegraded":"2024-09-13T18:26:45.261321+0000","last_fullsized":"2024-09-13T18:26:45.261321+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381490+0000","last_change":"2024-09-13T18:26:42.196478+0000","last_active":"2024-09-13T18:26:44.381490+0000","last_peered":"2024-09-13T18:26:44.381490+0000","last_clean":"2024-09-13T18:26:44.381490+0000","last_became_active":"2024-09-13T18:26:42.195254+0000","last_became_peered":"2024-09-13T18:26:42.195254+0000","last_unstale":"2024-09-13T18:26:44.381490+0000","last_undegraded":"2024-09-13T18:26:44.381490+0000","last_fullsized":"2024-09-13T18:26:44.381490+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:08.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382316+0000","last_change":"2024-09-13T18:26:42.184646+0000","last_active":"2024-09-13T18:26:44.382316+0000","last_peered":"2024-09-13T18:26:44.382316+0000","last_clean":"2024-09-13T18:26:44.382316+0000","last_became_active":"2024-09-13T18:26:42.184380+0000","last_became_peered":"2024-09-13T18:26:42.184380+0000","last_unstale":"2024-09-13T18:26:44.382316+0000","last_undegraded":"2024-09-13T18:26:44.382316+0000","last_fullsized":"2024-09-13T18:26:44.382316+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:03.518337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382406+0000","last_change":"2024-09-13T18:26:42.211909+0000","last_active":"2024-09-13T18:26:44.382406+0000","last_peered":"2024-09-13T18:26:44.382406+0000","last_clean":"2024-09-13T18:26:44.382406+0000","last_became_active":"2024-09-13T18:26:42.211601+0000","last_became_peered":"2024-09-13T18:26:42.211601+0000","last_unstale":"2024-09-13T18:26:44.382406+0000","last_undegraded":"2024-09-13T18:26:44.382406+0000","last_fullsized":"2024-09-13T18:26:44.382406+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:11.397925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382230+0000","last_change":"2024-09-13T18:26:42.186875+0000","last_active":"2024-09-13T18:26:44.382230+0000","last_peered":"2024-09-13T18:26:44.382230+0000","last_clean":"2024-09-13T18:26:44.382230+0000","last_became_active":"2024-09-13T18:26:42.186612+0000","last_became_peered":"2024-09-13T18:26:42.186612+0000","last_unstale":"2024-09-13T18:26:44.382230+0000","last_undegraded":"2024-09-13T18:26:44.382230+0000","last_fullsized":"2024-09-13T18:26:44.382230+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.288195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177708+0000","last_change":"2024-09-13T18:26:42.193062+0000","last_active":"2024-09-13T18:26:43.177708+0000","last_peered":"2024-09-13T18:26:43.177708+0000","last_clean":"2024-09-13T18:26:43.177708+0000","last_became_active":"2024-09-13T18:26:42.192371+0000","last_became_peered":"2024-09-13T18:26:42.192371+0000","last_unstale":"2024-09-13T18:26:43.177708+0000","last_undegraded":"2024-09-13T18:26:43.177708+0000","last_fullsized":"2024-09-13T18:26:43.177708+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:14.728821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872036+0000","last_change":"2024-09-13T18:26:42.179904+0000","last_active":"2024-09-13T18:26:43.872036+0000","last_peered":"2024-09-13T18:26:43.872036+0000","last_clean":"2024-09-13T18:26:43.872036+0000","last_became_active":"2024-09-13T18:26:42.178013+0000","last_became_peered":"2024-09-13T18:26:42.178013+0000","last_unstale":"2024-09-13T18:26:43.872036+0000","last_undegraded":"2024-09-13T18:26:43.872036+0000","last_fullsized":"2024-09-13T18:26:43.872036+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:05.950445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381747+0000","last_change":"2024-09-13T18:26:42.185257+0000","last_active":"2024-09-13T18:26:44.381747+0000","last_peered":"2024-09-13T18:26:44.381747+0000","last_clean":"2024-09-13T18:26:44.381747+0000","last_became_active":"2024-09-13T18:26:42.184976+0000","last_became_peered":"2024-09-13T18:26:42.184976+0000","last_unstale":"2024-09-13T18:26:44.381747+0000","last_undegraded":"2024-09-13T18:26:44.381747+0000","last_fullsized":"2024-09-13T18:26:44.381747+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:49.638441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263344+0000","last_change":"2024-09-13T18:26:42.181552+0000","last_active":"2024-09-13T18:26:45.263344+0000","last_peered":"2024-09-13T18:26:45.263344+0000","last_clean":"2024-09-13T18:26:45.263344+0000","last_became_active":"2024-09-13T18:26:42.180992+0000","last_became_peered":"2024-09-13T18:26:42.180992+0000","last_unstale":"2024-09-13T18:26:45.263344+0000","last_undegraded":"2024-09-13T18:26:45.263344+0000","last_fullsized":"2024-09-13T18:26:45.263344+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:54.959235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083466+0000","last_change":"2024-09-13T18:26:42.186980+0000","last_active":"2024-09-13T18:26:45.083466+0000","last_peered":"2024-09-13T18:26:45.083466+0000","last_clean":"2024-09-13T18:26:45.083466+0000","last_became_active":"2024-09-13T18:26:42.185980+0000","last_became_peered":"2024-09-13T18:26:42.185980+0000","last_unstale":"2024-09-13T18:26:45.083466+0000","last_undegraded":"2024-09-13T18:26:45.083466+0000","last_fullsized":"2024-09-13T18:26:45.083466+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:45.826157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255164+0000","last_change":"2024-09-13T18:26:42.188559+0000","last_active":"2024-09-13T18:26:45.255164+0000","last_peered":"2024-09-13T18:26:45.255164+0000","last_clean":"2024-09-13T18:26:45.255164+0000","last_became_active":"2024-09-13T18:26:42.187794+0000","last_became_peered":"2024-09-13T18:26:42.187794+0000","last_unstale":"2024-09-13T18:26:45.255164+0000","last_undegraded":"2024-09-13T18:26:45.255164+0000","last_fullsized":"2024-09-13T18:26:45.255164+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:03.518337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255067+0000","last_change":"2024-09-13T18:26:42.178481+0000","last_active":"2024-09-13T18:26:45.255067+0000","last_peered":"2024-09-13T18:26:45.255067+0000","last_clean":"2024-09-13T18:26:45.255067+0000","last_became_active":"2024-09-13T18:26:42.177786+0000","last_became_peered":"2024-09-13T18:26:42.177786+0000","last_unstale":"2024-09-13T18:26:45.255067+0000","last_undegraded":"2024-09-13T18:26:45.255067+0000","last_fullsized":"2024-09-13T18:26:45.255067+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:55.288195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083669+0000","last_change":"2024-09-13T18:26:42.212807+0000","last_active":"2024-09-13T18:26:45.083669+0000","last_peered":"2024-09-13T18:26:45.083669+0000","last_clean":"2024-09-13T18:26:45.083669+0000","last_became_active":"2024-09-13T18:26:42.212186+0000","last_became_peered":"2024-09-13T18:26:42.212186+0000","last_unstale":"2024-09-13T18:26:45.083669+0000","last_undegraded":"2024-09-13T18:26:45.083669+0000","last_fullsized":"2024-09-13T18:26:45.083669+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:55.423521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872073+0000","last_change":"2024-09-13T18:26:42.179546+0000","last_active":"2024-09-13T18:26:43.872073+0000","last_peered":"2024-09-13T18:26:43.872073+0000","last_clean":"2024-09-13T18:26:43.872073+0000","last_became_active":"2024-09-13T18:26:42.179265+0000","last_became_peered":"2024-09-13T18:26:42.179265+0000","last_unstale":"2024-09-13T18:26:43.872073+0000","last_undegraded":"2024-09-13T18:26:43.872073+0000","last_fullsized":"2024-09-13T18:26:43.872073+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:36.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263650+0000","last_change":"2024-09-13T18:26:42.213648+0000","last_active":"2024-09-13T18:26:45.263650+0000","last_peered":"2024-09-13T18:26:45.263650+0000","last_clean":"2024-09-13T18:26:45.263650+0000","last_became_active":"2024-09-13T18:26:42.213415+0000","last_became_peered":"2024-09-13T18:26:42.213415+0000","last_unstale":"2024-09-13T18:26:45.263650+0000","last_undegraded":"2024-09-13T18:26:45.263650+0000","last_fullsized":"2024-09-13T18:26:45.263650+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:28.295627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381725+0000","last_change":"2024-09-13T18:26:42.214989+0000","last_active":"2024-09-13T18:26:44.381725+0000","last_peered":"2024-09-13T18:26:44.381725+0000","last_clean":"2024-09-13T18:26:44.381725+0000","last_became_active":"2024-09-13T18:26:42.214712+0000","last_became_peered":"2024-09-13T18:26:42.214712+0000","last_unstale":"2024-09-13T18:26:44.381725+0000","last_undegraded":"2024-09-13T18:26:44.381725+0000","last_fullsized":"2024-09-13T18:26:44.381725+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:33.671323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083176+0000","last_change":"2024-09-13T18:26:42.206421+0000","last_active":"2024-09-13T18:26:45.083176+0000","last_peered":"2024-09-13T18:26:45.083176+0000","last_clean":"2024-09-13T18:26:45.083176+0000","last_became_active":"2024-09-13T18:26:42.205617+0000","last_became_peered":"2024-09-13T18:26:42.205617+0000","last_unstale":"2024-09-13T18:26:45.083176+0000","last_undegraded":"2024-09-13T18:26:45.083176+0000","last_fullsized":"2024-09-13T18:26:45.083176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:34.533154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083110+0000","last_change":"2024-09-13T18:26:42.206165+0000","last_active":"2024-09-13T18:26:45.083110+0000","last_peered":"2024-09-13T18:26:45.083110+0000","last_clean":"2024-09-13T18:26:45.083110+0000","last_became_active":"2024-09-13T18:26:42.205424+0000","last_became_peered":"2024-09-13T18:26:42.205424+0000","last_unstale":"2024-09-13T18:26:45.083110+0000","last_undegraded":"2024-09-13T18:26:45.083110+0000","last_fullsized":"2024-09-13T18:26:45.083110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:46.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083918+0000","last_change":"2024-09-13T18:26:42.216221+0000","last_active":"2024-09-13T18:26:45.083918+0000","last_peered":"2024-09-13T18:26:45.083918+0000","last_clean":"2024-09-13T18:26:45.083918+0000","last_became_active":"2024-09-13T18:26:42.214495+0000","last_became_peered":"2024-09-13T18:26:42.214495+0000","last_unstale":"2024-09-13T18:26:45.083918+0000","last_undegraded":"2024-09-13T18:26:45.083918+0000","last_fullsized":"2024-09-13T18:26:45.083918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:36.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872153+0000","last_change":"2024-09-13T18:26:42.175912+0000","last_active":"2024-09-13T18:26:43.872153+0000","last_peered":"2024-09-13T18:26:43.872153+0000","last_clean":"2024-09-13T18:26:43.872153+0000","last_became_active":"2024-09-13T18:26:42.174011+0000","last_became_peered":"2024-09-13T18:26:42.174011+0000","last_unstale":"2024-09-13T18:26:43.872153+0000","last_undegraded":"2024-09-13T18:26:43.872153+0000","last_fullsized":"2024-09-13T18:26:43.872153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:46.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255046+0000","last_change":"2024-09-13T18:26:42.189508+0000","last_active":"2024-09-13T18:26:45.255046+0000","last_peered":"2024-09-13T18:26:45.255046+0000","last_clean":"2024-09-13T18:26:45.255046+0000","last_became_active":"2024-09-13T18:26:42.188654+0000","last_became_peered":"2024-09-13T18:26:42.188654+0000","last_unstale":"2024-09-13T18:26:45.255046+0000","last_undegraded":"2024-09-13T18:26:45.255046+0000","last_fullsized":"2024-09-13T18:26:45.255046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:33.671323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178118+0000","last_change":"2024-09-13T18:26:42.193002+0000","last_active":"2024-09-13T18:26:43.178118+0000","last_peered":"2024-09-13T18:26:43.178118+0000","last_clean":"2024-09-13T18:26:43.178118+0000","last_became_active":"2024-09-13T18:26:42.191614+0000","last_became_peered":"2024-09-13T18:26:42.191614+0000","last_unstale":"2024-09-13T18:26:43.178118+0000","last_undegraded":"2024-09-13T18:26:43.178118+0000","last_fullsized":"2024-09-13T18:26:43.178118+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083375+0000","last_change":"2024-09-13T18:26:42.213714+0000","last_active":"2024-09-13T18:26:45.083375+0000","last_peered":"2024-09-13T18:26:45.083375+0000","last_clean":"2024-09-13T18:26:45.083375+0000","last_became_active":"2024-09-13T18:26:42.213065+0000","last_became_peered":"2024-09-13T18:26:42.213065+0000","last_unstale":"2024-09-13T18:26:45.083375+0000","last_undegraded":"2024-09-13T18:26:45.083375+0000","last_fullsized":"2024-09-13T18:26:45.083375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:38.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.254922+0000","last_change":"2024-09-13T18:26:42.198684+0000","last_active":"2024-09-13T18:26:45.254922+0000","last_peered":"2024-09-13T18:26:45.254922+0000","last_clean":"2024-09-13T18:26:45.254922+0000","last_became_active":"2024-09-13T18:26:42.197996+0000","last_became_peered":"2024-09-13T18:26:42.197996+0000","last_unstale":"2024-09-13T18:26:45.254922+0000","last_undegraded":"2024-09-13T18:26:45.254922+0000","last_fullsized":"2024-09-13T18:26:45.254922+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:49.638441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263401+0000","last_change":"2024-09-13T18:26:42.190799+0000","last_active":"2024-09-13T18:26:45.263401+0000","last_peered":"2024-09-13T18:26:45.263401+0000","last_clean":"2024-09-13T18:26:45.263401+0000","last_became_active":"2024-09-13T18:26:42.190559+0000","last_became_peered":"2024-09-13T18:26:42.190559+0000","last_unstale":"2024-09-13T18:26:45.263401+0000","last_undegraded":"2024-09-13T18:26:45.263401+0000","last_fullsized":"2024-09-13T18:26:45.263401+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:32.668533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.871706+0000","last_change":"2024-09-13T18:26:42.185094+0000","last_active":"2024-09-13T18:26:43.871706+0000","last_peered":"2024-09-13T18:26:43.871706+0000","last_clean":"2024-09-13T18:26:43.871706+0000","last_became_active":"2024-09-13T18:26:42.184831+0000","last_became_peered":"2024-09-13T18:26:42.184831+0000","last_unstale":"2024-09-13T18:26:43.871706+0000","last_undegraded":"2024-09-13T18:26:43.871706+0000","last_fullsized":"2024-09-13T18:26:43.871706+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:38.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172805+0000","last_change":"2024-09-13T18:26:42.183841+0000","last_active":"2024-09-13T18:26:43.172805+0000","last_peered":"2024-09-13T18:26:43.172805+0000","last_clean":"2024-09-13T18:26:43.172805+0000","last_became_active":"2024-09-13T18:26:42.183506+0000","last_became_peered":"2024-09-13T18:26:42.183506+0000","last_unstale":"2024-09-13T18:26:43.172805+0000","last_undegraded":"2024-09-13T18:26:43.172805+0000","last_fullsized":"2024-09-13T18:26:43.172805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:15.825996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.264060+0000","last_change":"2024-09-13T18:26:41.780313+0000","last_active":"2024-09-13T18:26:45.264060+0000","last_peered":"2024-09-13T18:26:45.264060+0000","last_clean":"2024-09-13T18:26:45.264060+0000","last_became_active":"2024-09-13T18:26:41.779907+0000","last_became_peered":"2024-09-13T18:26:41.779907+0000","last_unstale":"2024-09-13T18:26:45.264060+0000","last_undegraded":"2024-09-13T18:26:45.264060+0000","last_fullsized":"2024-09-13T18:26:45.264060+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:48.634817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.084065+0000","last_change":"2024-09-13T18:26:42.216626+0000","last_active":"2024-09-13T18:26:45.084065+0000","last_peered":"2024-09-13T18:26:45.084065+0000","last_clean":"2024-09-13T18:26:45.084065+0000","last_became_active":"2024-09-13T18:26:42.215190+0000","last_became_peered":"2024-09-13T18:26:42.215190+0000","last_unstale":"2024-09-13T18:26:45.084065+0000","last_undegraded":"2024-09-13T18:26:45.084065+0000","last_fullsized":"2024-09-13T18:26:45.084065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:27.097044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255141+0000","last_change":"2024-09-13T18:26:41.798871+0000","last_active":"2024-09-13T18:26:45.255141+0000","last_peered":"2024-09-13T18:26:45.255141+0000","last_clean":"2024-09-13T18:26:45.255141+0000","last_became_active":"2024-09-13T18:26:41.794811+0000","last_became_peered":"2024-09-13T18:26:41.794811+0000","last_unstale":"2024-09-13T18:26:45.255141+0000","last_undegraded":"2024-09-13T18:26:45.255141+0000","last_fullsized":"2024-09-13T18:26:45.255141+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:35.643213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177988+0000","last_change":"2024-09-13T18:26:42.192464+0000","last_active":"2024-09-13T18:26:43.177988+0000","last_peered":"2024-09-13T18:26:43.177988+0000","last_clean":"2024-09-13T18:26:43.177988+0000","last_became_active":"2024-09-13T18:26:42.191543+0000","last_became_peered":"2024-09-13T18:26:42.191543+0000","last_unstale":"2024-09-13T18:26:43.177988+0000","last_undegraded":"2024-09-13T18:26:43.177988+0000","last_fullsized":"2024-09-13T18:26:43.177988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172822+0000","last_change":"2024-09-13T18:26:41.804324+0000","last_active":"2024-09-13T18:26:43.172822+0000","last_peered":"2024-09-13T18:26:43.172822+0000","last_clean":"2024-09-13T18:26:43.172822+0000","last_became_active":"2024-09-13T18:26:41.803835+0000","last_became_peered":"2024-09-13T18:26:41.803835+0000","last_unstale":"2024-09-13T18:26:43.172822+0000","last_undegraded":"2024-09-13T18:26:43.172822+0000","last_fullsized":"2024-09-13T18:26:43.172822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:53.883190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172892+0000","last_change":"2024-09-13T18:26:42.214914+0000","last_active":"2024-09-13T18:26:43.172892+0000","last_peered":"2024-09-13T18:26:43.172892+0000","last_clean":"2024-09-13T18:26:43.172892+0000","last_became_active":"2024-09-13T18:26:42.214639+0000","last_became_peered":"2024-09-13T18:26:42.214639+0000","last_unstale":"2024-09-13T18:26:43.172892+0000","last_undegraded":"2024-09-13T18:26:43.172892+0000","last_fullsized":"2024-09-13T18:26:43.172892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:01.193783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261417+0000","last_change":"2024-09-13T18:26:41.812573+0000","last_active":"2024-09-13T18:26:45.261417+0000","last_peered":"2024-09-13T18:26:45.261417+0000","last_clean":"2024-09-13T18:26:45.261417+0000","last_became_active":"2024-09-13T18:26:41.811864+0000","last_became_peered":"2024-09-13T18:26:41.811864+0000","last_unstale":"2024-09-13T18:26:45.261417+0000","last_undegraded":"2024-09-13T18:26:45.261417+0000","last_fullsized":"2024-09-13T18:26:45.261417+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:03:00.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.254944+0000","last_change":"2024-09-13T18:26:42.216352+0000","last_active":"2024-09-13T18:26:45.254944+0000","last_peered":"2024-09-13T18:26:45.254944+0000","last_clean":"2024-09-13T18:26:45.254944+0000","last_became_active":"2024-09-13T18:26:42.215741+0000","last_became_peered":"2024-09-13T18:26:42.215741+0000","last_unstale":"2024-09-13T18:26:45.254944+0000","last_undegraded":"2024-09-13T18:26:45.254944+0000","last_fullsized":"2024-09-13T18:26:45.254944+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:59.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263748+0000","last_change":"2024-09-13T18:26:41.796032+0000","last_active":"2024-09-13T18:26:45.263748+0000","last_peered":"2024-09-13T18:26:45.263748+0000","last_clean":"2024-09-13T18:26:45.263748+0000","last_became_active":"2024-09-13T18:26:41.795232+0000","last_became_peered":"2024-09-13T18:26:41.795232+0000","last_unstale":"2024-09-13T18:26:45.263748+0000","last_undegraded":"2024-09-13T18:26:45.263748+0000","last_fullsized":"2024-09-13T18:26:45.263748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:41.678475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381800+0000","last_change":"2024-09-13T18:26:42.180214+0000","last_active":"2024-09-13T18:26:44.381800+0000","last_peered":"2024-09-13T18:26:44.381800+0000","last_clean":"2024-09-13T18:26:44.381800+0000","last_became_active":"2024-09-13T18:26:42.179478+0000","last_became_peered":"2024-09-13T18:26:42.179478+0000","last_unstale":"2024-09-13T18:26:44.381800+0000","last_undegraded":"2024-09-13T18:26:44.381800+0000","last_fullsized":"2024-09-13T18:26:44.381800+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:34.533154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.254976+0000","last_change":"2024-09-13T18:26:41.804378+0000","last_active":"2024-09-13T18:26:45.254976+0000","last_peered":"2024-09-13T18:26:45.254976+0000","last_clean":"2024-09-13T18:26:45.254976+0000","last_became_active":"2024-09-13T18:26:41.803629+0000","last_became_peered":"2024-09-13T18:26:41.803629+0000","last_unstale":"2024-09-13T18:26:45.254976+0000","last_undegraded":"2024-09-13T18:26:45.254976+0000","last_fullsized":"2024-09-13T18:26:45.254976+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:57.373104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381499+0000","last_change":"2024-09-13T18:26:42.206083+0000","last_active":"2024-09-13T18:26:44.381499+0000","last_peered":"2024-09-13T18:26:44.381499+0000","last_clean":"2024-09-13T18:26:44.381499+0000","last_became_active":"2024-09-13T18:26:42.205808+0000","last_became_peered":"2024-09-13T18:26:42.205808+0000","last_unstale":"2024-09-13T18:26:44.381499+0000","last_undegraded":"2024-09-13T18:26:44.381499+0000","last_fullsized":"2024-09-13T18:26:44.381499+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:59.242854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177385+0000","last_change":"2024-09-13T18:26:41.791880+0000","last_active":"2024-09-13T18:26:43.177385+0000","last_peered":"2024-09-13T18:26:43.177385+0000","last_clean":"2024-09-13T18:26:43.177385+0000","last_became_active":"2024-09-13T18:26:41.791182+0000","last_became_peered":"2024-09-13T18:26:41.791182+0000","last_unstale":"2024-09-13T18:26:43.177385+0000","last_undegraded":"2024-09-13T18:26:43.177385+0000","last_fullsized":"2024-09-13T18:26:43.177385+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:58.239230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.082894+0000","last_change":"2024-09-13T18:26:42.206038+0000","last_active":"2024-09-13T18:26:45.082894+0000","last_peered":"2024-09-13T18:26:45.082894+0000","last_clean":"2024-09-13T18:26:45.082894+0000","last_became_active":"2024-09-13T18:26:42.205461+0000","last_became_peered":"2024-09-13T18:26:42.205461+0000","last_unstale":"2024-09-13T18:26:45.082894+0000","last_undegraded":"2024-09-13T18:26:45.082894+0000","last_fullsized":"2024-09-13T18:26:45.082894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:56.153102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381623+0000","last_change":"2024-09-13T18:26:41.788633+0000","last_active":"2024-09-13T18:26:44.381623+0000","last_peered":"2024-09-13T18:26:44.381623+0000","last_clean":"2024-09-13T18:26:44.381623+0000","last_became_active":"2024-09-13T18:26:41.787982+0000","last_became_peered":"2024-09-13T18:26:41.787982+0000","last_unstale":"2024-09-13T18:26:44.381623+0000","last_undegraded":"2024-09-13T18:26:44.381623+0000","last_fullsized":"2024-09-13T18:26:44.381623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:36.601061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255089+0000","last_change":"2024-09-13T18:26:42.178417+0000","last_active":"2024-09-13T18:26:45.255089+0000","last_peered":"2024-09-13T18:26:45.255089+0000","last_clean":"2024-09-13T18:26:45.255089+0000","last_became_active":"2024-09-13T18:26:42.177724+0000","last_became_peered":"2024-09-13T18:26:42.177724+0000","last_unstale":"2024-09-13T18:26:45.255089+0000","last_undegraded":"2024-09-13T18:26:45.255089+0000","last_fullsized":"2024-09-13T18:26:45.255089+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:22.661205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255185+0000","last_change":"2024-09-13T18:26:41.793817+0000","last_active":"2024-09-13T18:26:45.255185+0000","last_peered":"2024-09-13T18:26:45.255185+0000","last_clean":"2024-09-13T18:26:45.255185+0000","last_became_active":"2024-09-13T18:26:41.793113+0000","last_became_peered":"2024-09-13T18:26:41.793113+0000","last_unstale":"2024-09-13T18:26:45.255185+0000","last_undegraded":"2024-09-13T18:26:45.255185+0000","last_fullsized":"2024-09-13T18:26:45.255185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:04.946821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261565+0000","last_change":"2024-09-13T18:26:42.209275+0000","last_active":"2024-09-13T18:26:45.261565+0000","last_peered":"2024-09-13T18:26:45.261565+0000","last_clean":"2024-09-13T18:26:45.261565+0000","last_became_active":"2024-09-13T18:26:42.207633+0000","last_became_peered":"2024-09-13T18:26:42.207633+0000","last_unstale":"2024-09-13T18:26:45.261565+0000","last_undegraded":"2024-09-13T18:26:45.261565+0000","last_fullsized":"2024-09-13T18:26:45.261565+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:58.804712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382562+0000","last_change":"2024-09-13T18:26:41.801027+0000","last_active":"2024-09-13T18:26:44.382562+0000","last_peered":"2024-09-13T18:26:44.382562+0000","last_clean":"2024-09-13T18:26:44.382562+0000","last_became_active":"2024-09-13T18:26:41.800553+0000","last_became_peered":"2024-09-13T18:26:41.800553+0000","last_unstale":"2024-09-13T18:26:44.382562+0000","last_undegraded":"2024-09-13T18:26:44.382562+0000","last_fullsized":"2024-09-13T18:26:44.382562+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:36.003767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263917+0000","last_change":"2024-09-13T18:26:42.179684+0000","last_active":"2024-09-13T18:26:45.263917+0000","last_peered":"2024-09-13T18:26:45.263917+0000","last_clean":"2024-09-13T18:26:45.263917+0000","last_became_active":"2024-09-13T18:26:42.179432+0000","last_became_peered":"2024-09-13T18:26:42.179432+0000","last_unstale":"2024-09-13T18:26:45.263917+0000","last_undegraded":"2024-09-13T18:26:45.263917+0000","last_fullsized":"2024-09-13T18:26:45.263917+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:52.110887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261494+0000","last_change":"2024-09-13T18:26:41.805854+0000","last_active":"2024-09-13T18:26:45.261494+0000","last_peered":"2024-09-13T18:26:45.261494+0000","last_clean":"2024-09-13T18:26:45.261494+0000","last_became_active":"2024-09-13T18:26:41.805050+0000","last_became_peered":"2024-09-13T18:26:41.805050+0000","last_unstale":"2024-09-13T18:26:45.261494+0000","last_undegraded":"2024-09-13T18:26:45.261494+0000","last_fullsized":"2024-09-13T18:26:45.261494+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:21.657580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261442+0000","last_change":"2024-09-13T18:26:42.197702+0000","last_active":"2024-09-13T18:26:45.261442+0000","last_peered":"2024-09-13T18:26:45.261442+0000","last_clean":"2024-09-13T18:26:45.261442+0000","last_became_active":"2024-09-13T18:26:42.195067+0000","last_became_peered":"2024-09-13T18:26:42.195067+0000","last_unstale":"2024-09-13T18:26:45.261442+0000","last_undegraded":"2024-09-13T18:26:45.261442+0000","last_fullsized":"2024-09-13T18:26:45.261442+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872242+0000","last_change":"2024-09-13T18:26:41.790941+0000","last_active":"2024-09-13T18:26:43.872242+0000","last_peered":"2024-09-13T18:26:43.872242+0000","last_clean":"2024-09-13T18:26:43.872242+0000","last_became_active":"2024-09-13T18:26:41.790423+0000","last_became_peered":"2024-09-13T18:26:41.790423+0000","last_unstale":"2024-09-13T18:26:43.872242+0000","last_undegraded":"2024-09-13T18:26:43.872242+0000","last_fullsized":"2024-09-13T18:26:43.872242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:21.604937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083196+0000","last_change":"2024-09-13T18:26:42.212409+0000","last_active":"2024-09-13T18:26:45.083196+0000","last_peered":"2024-09-13T18:26:45.083196+0000","last_clean":"2024-09-13T18:26:45.083196+0000","last_became_active":"2024-09-13T18:26:42.211922+0000","last_became_peered":"2024-09-13T18:26:42.211922+0000","last_unstale":"2024-09-13T18:26:45.083196+0000","last_undegraded":"2024-09-13T18:26:45.083196+0000","last_fullsized":"2024-09-13T18:26:45.083196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:54.886814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263804+0000","last_change":"2024-09-13T18:26:41.788809+0000","last_active":"2024-09-13T18:26:45.263804+0000","last_peered":"2024-09-13T18:26:45.263804+0000","last_clean":"2024-09-13T18:26:45.263804+0000","last_became_active":"2024-09-13T18:26:41.788218+0000","last_became_peered":"2024-09-13T18:26:41.788218+0000","last_unstale":"2024-09-13T18:26:45.263804+0000","last_undegraded":"2024-09-13T18:26:45.263804+0000","last_fullsized":"2024-09-13T18:26:45.263804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:02.514713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381946+0000","last_change":"2024-09-13T18:26:42.204586+0000","last_active":"2024-09-13T18:26:44.381946+0000","last_peered":"2024-09-13T18:26:44.381946+0000","last_clean":"2024-09-13T18:26:44.381946+0000","last_became_active":"2024-09-13T18:26:42.204328+0000","last_became_peered":"2024-09-13T18:26:42.204328+0000","last_unstale":"2024-09-13T18:26:44.381946+0000","last_undegraded":"2024-09-13T18:26:44.381946+0000","last_fullsized":"2024-09-13T18:26:44.381946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:15.825996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261373+0000","last_change":"2024-09-13T18:26:41.800395+0000","last_active":"2024-09-13T18:26:45.261373+0000","last_peered":"2024-09-13T18:26:45.261373+0000","last_clean":"2024-09-13T18:26:45.261373+0000","last_became_active":"2024-09-13T18:26:41.799657+0000","last_became_peered":"2024-09-13T18:26:41.799657+0000","last_unstale":"2024-09-13T18:26:45.261373+0000","last_undegraded":"2024-09-13T18:26:45.261373+0000","last_fullsized":"2024-09-13T18:26:45.261373+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.376797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263280+0000","last_change":"2024-09-13T18:26:42.183461+0000","last_active":"2024-09-13T18:26:45.263280+0000","last_peered":"2024-09-13T18:26:45.263280+0000","last_clean":"2024-09-13T18:26:45.263280+0000","last_became_active":"2024-09-13T18:26:42.183194+0000","last_became_peered":"2024-09-13T18:26:42.183194+0000","last_unstale":"2024-09-13T18:26:45.263280+0000","last_undegraded":"2024-09-13T18:26:45.263280+0000","last_fullsized":"2024-09-13T18:26:45.263280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:50.416094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263444+0000","last_change":"2024-09-13T18:26:41.788164+0000","last_active":"2024-09-13T18:26:45.263444+0000","last_peered":"2024-09-13T18:26:45.263444+0000","last_clean":"2024-09-13T18:26:45.263444+0000","last_became_active":"2024-09-13T18:26:41.787721+0000","last_became_peered":"2024-09-13T18:26:41.787721+0000","last_unstale":"2024-09-13T18:26:45.263444+0000","last_undegraded":"2024-09-13T18:26:45.263444+0000","last_fullsized":"2024-09-13T18:26:45.263444+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:32.667699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261343+0000","last_change":"2024-09-13T18:26:42.219209+0000","last_active":"2024-09-13T18:26:45.261343+0000","last_peered":"2024-09-13T18:26:45.261343+0000","last_clean":"2024-09-13T18:26:45.261343+0000","last_became_active":"2024-09-13T18:26:42.218595+0000","last_became_peered":"2024-09-13T18:26:42.218595+0000","last_unstale":"2024-09-13T18:26:45.261343+0000","last_undegraded":"2024-09-13T18:26:45.261343+0000","last_fullsized":"2024-09-13T18:26:45.261343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:14.728821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381799+0000","last_change":"2024-09-13T18:26:41.802488+0000","last_active":"2024-09-13T18:26:44.381799+0000","last_peered":"2024-09-13T18:26:44.381799+0000","last_clean":"2024-09-13T18:26:44.381799+0000","last_became_active":"2024-09-13T18:26:41.802040+0000","last_became_peered":"2024-09-13T18:26:41.802040+0000","last_unstale":"2024-09-13T18:26:44.381799+0000","last_undegraded":"2024-09-13T18:26:44.381799+0000","last_fullsized":"2024-09-13T18:26:44.381799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:06.971251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872242+0000","last_change":"2024-09-13T18:26:42.191381+0000","last_active":"2024-09-13T18:26:43.872242+0000","last_peered":"2024-09-13T18:26:43.872242+0000","last_clean":"2024-09-13T18:26:43.872242+0000","last_became_active":"2024-09-13T18:26:42.190896+0000","last_became_peered":"2024-09-13T18:26:42.190896+0000","last_unstale":"2024-09-13T18:26:43.872242+0000","last_undegraded":"2024-09-13T18:26:43.872242+0000","last_fullsized":"2024-09-13T18:26:43.872242+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:58.376728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.872329+0000","last_change":"2024-09-13T18:26:41.775866+0000","last_active":"2024-09-13T18:26:43.872329+0000","last_peered":"2024-09-13T18:26:43.872329+0000","last_clean":"2024-09-13T18:26:43.872329+0000","last_became_active":"2024-09-13T18:26:41.775245+0000","last_became_peered":"2024-09-13T18:26:41.775245+0000","last_unstale":"2024-09-13T18:26:43.872329+0000","last_undegraded":"2024-09-13T18:26:43.872329+0000","last_fullsized":"2024-09-13T18:26:43.872329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:19.130933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382332+0000","last_change":"2024-09-13T18:26:42.178230+0000","last_active":"2024-09-13T18:26:44.382332+0000","last_peered":"2024-09-13T18:26:44.382332+0000","last_clean":"2024-09-13T18:26:44.382332+0000","last_became_active":"2024-09-13T18:26:42.177966+0000","last_became_peered":"2024-09-13T18:26:42.177966+0000","last_unstale":"2024-09-13T18:26:44.382332+0000","last_undegraded":"2024-09-13T18:26:44.382332+0000","last_fullsized":"2024-09-13T18:26:44.382332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:19.472859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255116+0000","last_change":"2024-09-13T18:26:41.792328+0000","last_active":"2024-09-13T18:26:45.255116+0000","last_peered":"2024-09-13T18:26:45.255116+0000","last_clean":"2024-09-13T18:26:45.255116+0000","last_became_active":"2024-09-13T18:26:41.791128+0000","last_became_peered":"2024-09-13T18:26:41.791128+0000","last_unstale":"2024-09-13T18:26:45.255116+0000","last_undegraded":"2024-09-13T18:26:45.255116+0000","last_fullsized":"2024-09-13T18:26:45.255116+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:37.884621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083497+0000","last_change":"2024-09-13T18:26:42.213492+0000","last_active":"2024-09-13T18:26:45.083497+0000","last_peered":"2024-09-13T18:26:45.083497+0000","last_clean":"2024-09-13T18:26:45.083497+0000","last_became_active":"2024-09-13T18:26:42.212751+0000","last_became_peered":"2024-09-13T18:26:42.212751+0000","last_unstale":"2024-09-13T18:26:45.083497+0000","last_undegraded":"2024-09-13T18:26:45.083497+0000","last_fullsized":"2024-09-13T18:26:45.083497+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:05.950445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178263+0000","last_change":"2024-09-13T18:26:41.803308+0000","last_active":"2024-09-13T18:26:43.178263+0000","last_peered":"2024-09-13T18:26:43.178263+0000","last_clean":"2024-09-13T18:26:43.178263+0000","last_became_active":"2024-09-13T18:26:41.801125+0000","last_became_peered":"2024-09-13T18:26:41.801125+0000","last_unstale":"2024-09-13T18:26:43.178263+0000","last_undegraded":"2024-09-13T18:26:43.178263+0000","last_fullsized":"2024-09-13T18:26:43.178263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.376797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.083485+0000","last_change":"2024-09-13T18:26:42.214316+0000","last_active":"2024-09-13T18:26:45.083485+0000","last_peered":"2024-09-13T18:26:45.083485+0000","last_clean":"2024-09-13T18:26:45.083485+0000","last_became_active":"2024-09-13T18:26:42.213198+0000","last_became_peered":"2024-09-13T18:26:42.213198+0000","last_unstale":"2024-09-13T18:26:45.083485+0000","last_undegraded":"2024-09-13T18:26:45.083485+0000","last_fullsized":"2024-09-13T18:26:45.083485+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:58.376728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263966+0000","last_change":"2024-09-13T18:26:41.780266+0000","last_active":"2024-09-13T18:26:45.263966+0000","last_peered":"2024-09-13T18:26:45.263966+0000","last_clean":"2024-09-13T18:26:45.263966+0000","last_became_active":"2024-09-13T18:26:41.779600+0000","last_became_peered":"2024-09-13T18:26:41.779600+0000","last_unstale":"2024-09-13T18:26:45.263966+0000","last_undegraded":"2024-09-13T18:26:45.263966+0000","last_fullsized":"2024-09-13T18:26:45.263966+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:54.284571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263538+0000","last_change":"2024-09-13T18:26:42.179172+0000","last_active":"2024-09-13T18:26:45.263538+0000","last_peered":"2024-09-13T18:26:45.263538+0000","last_clean":"2024-09-13T18:26:45.263538+0000","last_became_active":"2024-09-13T18:26:42.178940+0000","last_became_peered":"2024-09-13T18:26:42.178940+0000","last_unstale":"2024-09-13T18:26:45.263538+0000","last_undegraded":"2024-09-13T18:26:45.263538+0000","last_fullsized":"2024-09-13T18:26:45.263538+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:29.033821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263865+0000","last_change":"2024-09-13T18:26:41.795613+0000","last_active":"2024-09-13T18:26:45.263865+0000","last_peered":"2024-09-13T18:26:45.263865+0000","last_clean":"2024-09-13T18:26:45.263865+0000","last_became_active":"2024-09-13T18:26:41.795081+0000","last_became_peered":"2024-09-13T18:26:41.795081+0000","last_unstale":"2024-09-13T18:26:45.263865+0000","last_undegraded":"2024-09-13T18:26:45.263865+0000","last_fullsized":"2024-09-13T18:26:45.263865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:10.394301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172490+0000","last_change":"2024-09-13T18:26:42.191181+0000","last_active":"2024-09-13T18:26:43.172490+0000","last_peered":"2024-09-13T18:26:43.172490+0000","last_clean":"2024-09-13T18:26:43.172490+0000","last_became_active":"2024-09-13T18:26:42.190553+0000","last_became_peered":"2024-09-13T18:26:42.190553+0000","last_unstale":"2024-09-13T18:26:43.172490+0000","last_undegraded":"2024-09-13T18:26:43.172490+0000","last_fullsized":"2024-09-13T18:26:43.172490+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:41.031148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177607+0000","last_change":"2024-09-13T18:26:41.796332+0000","last_active":"2024-09-13T18:26:43.177607+0000","last_peered":"2024-09-13T18:26:43.177607+0000","last_clean":"2024-09-13T18:26:43.177607+0000","last_became_active":"2024-09-13T18:26:41.795600+0000","last_became_peered":"2024-09-13T18:26:41.795600+0000","last_unstale":"2024-09-13T18:26:43.177607+0000","last_undegraded":"2024-09-13T18:26:43.177607+0000","last_fullsized":"2024-09-13T18:26:43.177607+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:44.428115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.871864+0000","last_change":"2024-09-13T18:26:42.204425+0000","last_active":"2024-09-13T18:26:43.871864+0000","last_peered":"2024-09-13T18:26:43.871864+0000","last_clean":"2024-09-13T18:26:43.871864+0000","last_became_active":"2024-09-13T18:26:42.204128+0000","last_became_peered":"2024-09-13T18:26:42.204128+0000","last_unstale":"2024-09-13T18:26:43.871864+0000","last_undegraded":"2024-09-13T18:26:43.871864+0000","last_fullsized":"2024-09-13T18:26:43.871864+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:53.632168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381599+0000","last_change":"2024-09-13T18:26:41.795784+0000","last_active":"2024-09-13T18:26:44.381599+0000","last_peered":"2024-09-13T18:26:44.381599+0000","last_clean":"2024-09-13T18:26:44.381599+0000","last_became_active":"2024-09-13T18:26:41.795354+0000","last_became_peered":"2024-09-13T18:26:41.795354+0000","last_unstale":"2024-09-13T18:26:44.381599+0000","last_undegraded":"2024-09-13T18:26:44.381599+0000","last_fullsized":"2024-09-13T18:26:44.381599+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:15.458772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381615+0000","last_change":"2024-09-13T18:26:42.184691+0000","last_active":"2024-09-13T18:26:44.381615+0000","last_peered":"2024-09-13T18:26:44.381615+0000","last_clean":"2024-09-13T18:26:44.381615+0000","last_became_active":"2024-09-13T18:26:42.184421+0000","last_became_peered":"2024-09-13T18:26:42.184421+0000","last_unstale":"2024-09-13T18:26:44.381615+0000","last_undegraded":"2024-09-13T18:26:44.381615+0000","last_fullsized":"2024-09-13T18:26:44.381615+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:22.661205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261271+0000","last_change":"2024-09-13T18:26:41.799287+0000","last_active":"2024-09-13T18:26:45.261271+0000","last_peered":"2024-09-13T18:26:45.261271+0000","last_clean":"2024-09-13T18:26:45.261271+0000","last_became_active":"2024-09-13T18:26:41.798623+0000","last_became_peered":"2024-09-13T18:26:41.798623+0000","last_unstale":"2024-09-13T18:26:45.261271+0000","last_undegraded":"2024-09-13T18:26:45.261271+0000","last_fullsized":"2024-09-13T18:26:45.261271+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:40.027523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.084153+0000","last_change":"2024-09-13T18:26:42.215803+0000","last_active":"2024-09-13T18:26:45.084153+0000","last_peered":"2024-09-13T18:26:45.084153+0000","last_clean":"2024-09-13T18:26:45.084153+0000","last_became_active":"2024-09-13T18:26:42.213804+0000","last_became_peered":"2024-09-13T18:26:42.213804+0000","last_unstale":"2024-09-13T18:26:45.084153+0000","last_undegraded":"2024-09-13T18:26:45.084153+0000","last_fullsized":"2024-09-13T18:26:45.084153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:57.198496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.461505+0000","last_change":"2024-09-13T18:26:41.792988+0000","last_active":"2024-09-13T18:26:45.461505+0000","last_peered":"2024-09-13T18:26:45.461505+0000","last_clean":"2024-09-13T18:26:45.461505+0000","last_became_active":"2024-09-13T18:26:41.792675+0000","last_became_peered":"2024-09-13T18:26:41.792675+0000","last_unstale":"2024-09-13T18:26:45.461505+0000","last_undegraded":"2024-09-13T18:26:45.461505+0000","last_fullsized":"2024-09-13T18:26:45.461505+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:21.657580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382077+0000","last_change":"2024-09-13T18:26:42.177507+0000","last_active":"2024-09-13T18:26:44.382077+0000","last_peered":"2024-09-13T18:26:44.382077+0000","last_clean":"2024-09-13T18:26:44.382077+0000","last_became_active":"2024-09-13T18:26:42.177223+0000","last_became_peered":"2024-09-13T18:26:42.177223+0000","last_unstale":"2024-09-13T18:26:44.382077+0000","last_undegraded":"2024-09-13T18:26:44.382077+0000","last_fullsized":"2024-09-13T18:26:44.382077+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:38.535356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261520+0000","last_change":"2024-09-13T18:26:41.804413+0000","last_active":"2024-09-13T18:26:45.261520+0000","last_peered":"2024-09-13T18:26:45.261520+0000","last_clean":"2024-09-13T18:26:45.261520+0000","last_became_active":"2024-09-13T18:26:41.803710+0000","last_became_peered":"2024-09-13T18:26:41.803710+0000","last_unstale":"2024-09-13T18:26:45.261520+0000","last_undegraded":"2024-09-13T18:26:45.261520+0000","last_fullsized":"2024-09-13T18:26:45.261520+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:58.239230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261465+0000","last_change":"2024-09-13T18:26:42.199256+0000","last_active":"2024-09-13T18:26:45.261465+0000","last_peered":"2024-09-13T18:26:45.261465+0000","last_clean":"2024-09-13T18:26:45.261465+0000","last_became_active":"2024-09-13T18:26:42.198547+0000","last_became_peered":"2024-09-13T18:26:42.198547+0000","last_unstale":"2024-09-13T18:26:45.261465+0000","last_undegraded":"2024-09-13T18:26:45.261465+0000","last_fullsized":"2024-09-13T18:26:45.261465+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:19.186782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172420+0000","last_change":"2024-09-13T18:26:41.805356+0000","last_active":"2024-09-13T18:26:43.172420+0000","last_peered":"2024-09-13T18:26:43.172420+0000","last_clean":"2024-09-13T18:26:43.172420+0000","last_became_active":"2024-09-13T18:26:41.804795+0000","last_became_peered":"2024-09-13T18:26:41.804795+0000","last_unstale":"2024-09-13T18:26:43.172420+0000","last_undegraded":"2024-09-13T18:26:43.172420+0000","last_fullsized":"2024-09-13T18:26:43.172420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:54.419897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263586+0000","last_change":"2024-09-13T18:26:42.184747+0000","last_active":"2024-09-13T18:26:45.263586+0000","last_peered":"2024-09-13T18:26:45.263586+0000","last_clean":"2024-09-13T18:26:45.263586+0000","last_became_active":"2024-09-13T18:26:42.184439+0000","last_became_peered":"2024-09-13T18:26:42.184439+0000","last_unstale":"2024-09-13T18:26:45.263586+0000","last_undegraded":"2024-09-13T18:26:45.263586+0000","last_fullsized":"2024-09-13T18:26:45.263586+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:39.886829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.261395+0000","last_change":"2024-09-13T18:26:41.804092+0000","last_active":"2024-09-13T18:26:45.261395+0000","last_peered":"2024-09-13T18:26:45.261395+0000","last_clean":"2024-09-13T18:26:45.261395+0000","last_became_active":"2024-09-13T18:26:41.803422+0000","last_became_peered":"2024-09-13T18:26:41.803422+0000","last_unstale":"2024-09-13T18:26:45.261395+0000","last_undegraded":"2024-09-13T18:26:45.261395+0000","last_fullsized":"2024-09-13T18:26:45.261395+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:44.428115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.263702+0000","last_change":"2024-09-13T18:26:42.180274+0000","last_active":"2024-09-13T18:26:45.263702+0000","last_peered":"2024-09-13T18:26:45.263702+0000","last_clean":"2024-09-13T18:26:45.263702+0000","last_became_active":"2024-09-13T18:26:42.179991+0000","last_became_peered":"2024-09-13T18:26:42.179991+0000","last_unstale":"2024-09-13T18:26:45.263702+0000","last_undegraded":"2024-09-13T18:26:45.263702+0000","last_fullsized":"2024-09-13T18:26:45.263702+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:19.186782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.255000+0000","last_change":"2024-09-13T18:26:41.791722+0000","last_active":"2024-09-13T18:26:45.255000+0000","last_peered":"2024-09-13T18:26:45.255000+0000","last_clean":"2024-09-13T18:26:45.255000+0000","last_became_active":"2024-09-13T18:26:41.790212+0000","last_became_peered":"2024-09-13T18:26:41.790212+0000","last_unstale":"2024-09-13T18:26:45.255000+0000","last_undegraded":"2024-09-13T18:26:45.255000+0000","last_fullsized":"2024-09-13T18:26:45.255000+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:45.205786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.177622+0000","last_change":"2024-09-13T18:26:42.187618+0000","last_active":"2024-09-13T18:26:43.177622+0000","last_peered":"2024-09-13T18:26:43.177622+0000","last_clean":"2024-09-13T18:26:43.177622+0000","last_became_active":"2024-09-13T18:26:42.186226+0000","last_became_peered":"2024-09-13T18:26:42.186226+0000","last_unstale":"2024-09-13T18:26:43.177622+0000","last_undegraded":"2024-09-13T18:26:43.177622+0000","last_fullsized":"2024-09-13T18:26:43.177622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:08.382270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.172424+0000","last_change":"2024-09-13T18:26:41.786760+0000","last_active":"2024-09-13T18:26:43.172424+0000","last_peered":"2024-09-13T18:26:43.172424+0000","last_clean":"2024-09-13T18:26:43.172424+0000","last_became_active":"2024-09-13T18:26:41.786467+0000","last_became_peered":"2024-09-13T18:26:41.786467+0000","last_unstale":"2024-09-13T18:26:43.172424+0000","last_undegraded":"2024-09-13T18:26:43.172424+0000","last_fullsized":"2024-09-13T18:26:43.172424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:57.373104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.254884+0000","last_change":"2024-09-13T18:26:42.176373+0000","last_active":"2024-09-13T18:26:45.254884+0000","last_peered":"2024-09-13T18:26:45.254884+0000","last_clean":"2024-09-13T18:26:45.254884+0000","last_became_active":"2024-09-13T18:26:42.175579+0000","last_became_peered":"2024-09-13T18:26:42.175579+0000","last_unstale":"2024-09-13T18:26:45.254884+0000","last_undegraded":"2024-09-13T18:26:45.254884+0000","last_fullsized":"2024-09-13T18:26:45.254884+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:45.431739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.381828+0000","last_change":"2024-09-13T18:26:41.781621+0000","last_active":"2024-09-13T18:26:44.381828+0000","last_peered":"2024-09-13T18:26:44.381828+0000","last_clean":"2024-09-13T18:26:44.381828+0000","last_became_active":"2024-09-13T18:26:41.780750+0000","last_became_peered":"2024-09-13T18:26:41.780750+0000","last_unstale":"2024-09-13T18:26:44.381828+0000","last_undegraded":"2024-09-13T18:26:44.381828+0000","last_fullsized":"2024-09-13T18:26:44.381828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:48.822739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:44.382504+0000","last_change":"2024-09-13T18:26:42.204630+0000","last_active":"2024-09-13T18:26:44.382504+0000","last_peered":"2024-09-13T18:26:44.382504+0000","last_clean":"2024-09-13T18:26:44.382504+0000","last_became_active":"2024-09-13T18:26:42.204346+0000","last_became_peered":"2024-09-13T18:26:42.204346+0000","last_unstale":"2024-09-13T18:26:44.382504+0000","last_undegraded":"2024-09-13T18:26:44.382504+0000","last_fullsized":"2024-09-13T18:26:44.382504+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:41.751430+0000","last_clean_scrub_stamp":"2024-09-13T18:26:41.751430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:34.605696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:43.178427+0000","last_change":"2024-09-13T18:26:41.803018+0000","last_active":"2024-09-13T18:26:43.178427+0000","last_peered":"2024-09-13T18:26:43.178427+0000","last_clean":"2024-09-13T18:26:43.178427+0000","last_became_active":"2024-09-13T18:26:41.802300+0000","last_became_peered":"2024-09-13T18:26:41.802300+0000","last_unstale":"2024-09-13T18:26:43.178427+0000","last_undegraded":"2024-09-13T18:26:43.178427+0000","last_fullsized":"2024-09-13T18:26:43.178427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:26:40.747805+0000","last_clean_scrub_stamp":"2024-09-13T18:26:40.747805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:40.027523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T18:26:45.461893+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:26:45.461893+0000","last_peered":"2024-09-13T18:26:45.461893+0000","last_clean":"2024-09-13T18:26:45.461893+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:26:45.461893+0000","last_undegraded":"2024-09-13T18:26:45.461893+0000","last_fullsized":"2024-09-13T18:26:45.461893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1138688,"data_stored":810852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.877,"15min":0.87},"min":{"1min":0.57899999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.876,"15min":0.86599999999999999},"min":{"1min":0.64500000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.012}]},{"osd":1,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.258,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.64800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79000000000000004,"15min":0.78600000000000003},"min":{"1min":0.55300000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.88,"15min":0.875},"min":{"1min":0.63800000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.202,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.054}]},{"osd":3,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.874,"15min":0.878},"min":{"1min":0.56100000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.109,"5min":1.448,"15min":1.448},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.91200000000000003,"15min":0.89800000000000002},"min":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.85599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.2370000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.94899999999999995,"15min":0.94299999999999995},"min":{"1min":0.63800000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.103}]},{"osd":5,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3180000000000001,"5min":1.877,"15min":1.877},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.72699999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2789999999999999,"5min":1.319,"15min":1.319},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.0680000000000001,"15min":1.0620000000000001},"min":{"1min":0.84899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2769999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.081,"5min":0.998,"15min":0.98399999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.2110000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":221066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.94599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.4220000000000002,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.73899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.121}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":0.97499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.0209999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":544768,"data_stored":220464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85899999999999999,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5469999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.45300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.194,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.0960000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82799999999999996,"15min":0.81699999999999995},"min":{"1min":0.497,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.131,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.54900000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1180000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.878,"15min":0.874},"min":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.98299999999999998,"15min":0.98699999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4730000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.96899999999999997},"min":{"1min":0.63500000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.3740000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.874},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.64900000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.242,"5min":1.871,"15min":1.871},"last":1.0680000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.93799999999999994,"15min":0.94799999999999995},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0449999999999999,"15min":1.0680000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2110000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.03,"15min":1.0449999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3420000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2170000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.125,"15min":1.145},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.248,"5min":2.246,"15min":2.246},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.147,"15min":1.163},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.2470000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.94199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":221958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.127},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":1.056}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.095}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.24},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.1639999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":1.3420000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.218},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.28}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":552960,"data_stored":221032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.879,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.70999999999999996,"15min":0.69199999999999995},"min":{"1min":0.42099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1679999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1339999999999999,"5min":1.704,"15min":1.704},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.496}]},{"osd":2,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.39700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89300000000000002,"5min":1.647,"15min":1.647},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.73999999999999999,"15min":0.72299999999999998},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.0840000000000001,"5min":1.399,"15min":1.399},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.94699999999999995,"15min":0.95499999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.123,"15min":1.139},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.429,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0389999999999999,"15min":1.028},"min":{"1min":0.72299999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.54,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.145},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.202,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.0920000000000001,"15min":1.0860000000000001},"min":{"1min":0.68899999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.6190000000000002,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.0600000000000001,"15min":1.0529999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.593,"5min":1.96,"15min":1.96},"last":1.0920000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:26:46 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1100000000000001,"15min":1.1140000000000001},"min":{"1min":0.72399999999999998,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3540000000000001,"5min":3,"15min":3},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.04,"5min":0.998,"15min":0.99099999999999999},"min":{"1min":0.69499999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":557056,"data_stored":221980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.86199999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.92200000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.087},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.117}]},{"osd":7,"last update":"Fri Sep 13 18:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.2030000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35744,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":544768,"data_stored":220464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.41699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69099999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:26:45 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.69999999999999996,"15min":0.68700000000000006},"min":{"1min":0.377,"5min":0.311,"15min":0.311},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":1.101}]},{"osd":3,"last update":"Fri Sep 13 18:26:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0920000000000001,"5min":1.117,"15min":1.117},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.40500000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1499999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.1499999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:26:45 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.90100000000000002,"15min":0.89800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4359999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":0.92300000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.3420000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:26:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.61199999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2709999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.05},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.026,"15min":1.032},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.4930000000000001,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.4930000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:26:45 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.71599999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.272,"5min":1.653,"15min":1.653},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.98799999999999999,"15min":0.98599999999999999},"min":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2350000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1990000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:26:45 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.03,"15min":1.036},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2889999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.272},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.018,"15min":1.004},"min":{"1min":0.64300000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.546,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.546}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":810796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66400000000000003,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.371,"15min":0.371},"max":{"1min":1.0740000000000001,"5min":1.147,"15min":1.147},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.202,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0329999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.52700000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.099,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3169999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.046}]},{"osd":4,"last update":"Fri Sep 13 18:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.153,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.998,"15min":0.998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3029999999999999,"5min":1.986,"15min":1.986},"last":1.014}]},{"osd":5,"last update":"Fri Sep 13 18:26:47 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.69099999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4239999999999999,"5min":2.641,"15min":2.641},"last":1.091},{"interface":"front","average":{"1min":1.073,"5min":1.0489999999999999,"15min":1.0449999999999999},"min":{"1min":0.78800000000000003,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4259999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:26:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.083,"15min":1.079},"min":{"1min":0.67800000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.373,"5min":1.891,"15min":1.891},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.034,"15min":1.038},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.345,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:26:47 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.034,"15min":1.0349999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.361,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.113,"15min":1.105},"min":{"1min":0.90500000000000003,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5009999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.177}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:26:51.371 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:26:51.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:26:51.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa2a5aee640 1 Processor -- start 2024-09-13T18:26:51.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa2a5aee640 1 -- start start 2024-09-13T18:26:51.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa2a5aee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2a0156c40 0x7fa2a0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa2a5aee640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2a006d440 0x7fa2a006f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa2a5aee640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a00b15a0 con 0x7fa2a0157020 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa2a5aee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a00b1880 con 0x7fa2a0156c40 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa2a5aee640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a00b1b60 con 0x7fa2a006d440 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2a0156c40 0x7fa2a0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa2a0157020 0x7fa2a006cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57978/0 (socket says 172.21.15.53:57978) 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2a0156c40 0x7fa2a0070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59296/0 (socket says 172.21.15.53:59296) 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29effd640 1 -- 172.21.15.53:0/3519353811 learned_addr learned my addr 172.21.15.53:0/3519353811 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29ffff640 1 --2- 172.21.15.53:0/3519353811 >> v2:172.21.15.87:3300/0 conn(0x7fa2a006d440 0x7fa2a006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29f7fe640 1 -- 172.21.15.53:0/3519353811 >> v2:172.21.15.87:3300/0 conn(0x7fa2a006d440 msgr2=0x7fa2a006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29f7fe640 1 --2- 172.21.15.53:0/3519353811 >> v2:172.21.15.87:3300/0 conn(0x7fa2a006d440 0x7fa2a006f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29f7fe640 1 -- 172.21.15.53:0/3519353811 >> v1:172.21.15.53:6789/0 conn(0x7fa2a0157020 legacy=0x7fa2a006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29f7fe640 1 -- 172.21.15.53:0/3519353811 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a00b1e40 con 0x7fa2a0156c40 2024-09-13T18:26:51.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.490+0000 7fa29e7fc640 1 -- 172.21.15.53:0/3519353811 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576404734 0 0) 0x7fa2a00b15a0 con 0x7fa2a0157020 2024-09-13T18:26:51.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa29f7fe640 1 --2- 172.21.15.53:0/3519353811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a0070ee0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097c0 tx=0x7fa29001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608c075a903f1af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa29e7fc640 1 -- 172.21.15.53:0/3519353811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900ab650 con 0x7fa2a0156c40 2024-09-13T18:26:51.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa29e7fc640 1 -- 172.21.15.53:0/3519353811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900ab7b0 con 0x7fa2a0156c40 2024-09-13T18:26:51.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa29e7fc640 1 -- 172.21.15.53:0/3519353811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900abb40 con 0x7fa2a0156c40 2024-09-13T18:26:51.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 -- 172.21.15.53:0/3519353811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 msgr2=0x7fa2a0070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/3519353811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a0070ee0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097c0 tx=0x7fa29001c430 comp rx=0 tx=0).stop 2024-09-13T18:26:51.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 -- 172.21.15.53:0/3519353811 shutdown_connections 2024-09-13T18:26:51.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/3519353811 >> v2:172.21.15.87:3300/0 conn(0x7fa2a006d440 0x7fa2a006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/3519353811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a0070ee0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 -- 172.21.15.53:0/3519353811 >> 172.21.15.53:0/3519353811 conn(0x7fa2a0065c80 msgr2=0x7fa2a0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:51.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 -- 172.21.15.53:0/3519353811 shutdown_connections 2024-09-13T18:26:51.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 -- 172.21.15.53:0/3519353811 wait complete. 2024-09-13T18:26:51.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 Processor -- start 2024-09-13T18:26:51.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.494+0000 7fa2a5aee640 1 -- start start 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2a006d440 0x7fa2a013e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2a013e770 0x7fa2a0158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0159a20 con 0x7fa2a0156c40 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a015c5b0 con 0x7fa2a006d440 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a015b2c0 con 0x7fa2a013e770 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a015b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59312/0 (socket says 172.21.15.53:59312) 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 -- 172.21.15.53:0/26107198 learned_addr learned my addr 172.21.15.53:0/26107198 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29f7fe640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2a006d440 0x7fa2a013e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29ffff640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2a013e770 0x7fa2a0158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 -- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2a013e770 msgr2=0x7fa2a0158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2a013e770 0x7fa2a0158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 -- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2a006d440 msgr2=0x7fa2a013e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2a006d440 0x7fa2a013e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 -- 172.21.15.53:0/26107198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290009420 con 0x7fa2a0156c40 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29effd640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a015b750 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c520 tx=0x7fa29400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa287fff640 1 -- 172.21.15.53:0/26107198 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940074e0 con 0x7fa2a0156c40 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa287fff640 1 -- 172.21.15.53:0/26107198 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294007640 con 0x7fa2a0156c40 2024-09-13T18:26:51.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa287fff640 1 -- 172.21.15.53:0/26107198 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940049f0 con 0x7fa2a0156c40 2024-09-13T18:26:51.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a013e580 con 0x7fa2a0156c40 2024-09-13T18:26:51.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a015a990 con 0x7fa2a0156c40 2024-09-13T18:26:51.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a0152f10 con 0x7fa2a0156c40 2024-09-13T18:26:51.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa287fff640 1 -- 172.21.15.53:0/26107198 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa294004b50 con 0x7fa2a0156c40 2024-09-13T18:26:51.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa287fff640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa28c066870 0x7fa28c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa287fff640 1 -- 172.21.15.53:0/26107198 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa294083760 con 0x7fa2a0156c40 2024-09-13T18:26:51.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.498+0000 7fa29f7fe640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa28c066870 0x7fa28c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.502+0000 7fa29f7fe640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa28c066870 0x7fa28c068d30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa2900af000 tx=0x7fa2900a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.506+0000 7fa287fff640 1 -- 172.21.15.53:0/26107198 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa294050830 con 0x7fa2a0156c40 2024-09-13T18:26:51.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.710+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa2a015b430 con 0x7fa2a0156c40 2024-09-13T18:26:51.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa287fff640 1 -- 172.21.15.53:0/26107198 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa294018020 con 0x7fa2a0156c40 2024-09-13T18:26:51.720 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:26:51.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa28c066870 msgr2=0x7fa28c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa28c066870 0x7fa28c068d30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa2900af000 tx=0x7fa2900a7000 comp rx=0 tx=0).stop 2024-09-13T18:26:51.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 msgr2=0x7fa2a015b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a015b750 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c520 tx=0x7fa29400c9e0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 shutdown_connections 2024-09-13T18:26:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa28c066870 0x7fa28c068d30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2a013e770 0x7fa2a0158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a0156c40 0x7fa2a015b750 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 --2- 172.21.15.53:0/26107198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2a006d440 0x7fa2a013e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 >> 172.21.15.53:0/26107198 conn(0x7fa2a0065c80 msgr2=0x7fa2a0148b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 shutdown_connections 2024-09-13T18:26:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.718+0000 7fa2a5aee640 1 -- 172.21.15.53:0/26107198 wait complete. 2024-09-13T18:26:51.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:26:51.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0742162640 1 Processor -- start 2024-09-13T18:26:51.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0742162640 1 -- start start 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0742162640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0742162640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f073c0cf600 0x7f073c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0742162640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0d2400 con 0x7f073c15cab0 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0742162640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0cfab0 con 0x7f073c0cf600 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0742162640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0d1530 con 0x7f073c0d19c0 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f073bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f073c0cf600 0x7f073c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0732ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f073b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f073c15cab0 0x7f073c0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:46246/0 (socket says 172.21.15.53:46246) 2024-09-13T18:26:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f073b7fe640 1 -- 172.21.15.53:0/3920287815 learned_addr learned my addr 172.21.15.53:0/3920287815 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0732ffd640 1 -- 172.21.15.53:0/3920287815 >> v2:172.21.15.87:3300/0 conn(0x7f073c0cf600 msgr2=0x7f073c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0732ffd640 1 --2- 172.21.15.53:0/3920287815 >> v2:172.21.15.87:3300/0 conn(0x7f073c0cf600 0x7f073c0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0732ffd640 1 -- 172.21.15.53:0/3920287815 >> v1:172.21.15.87:6789/0 conn(0x7f073c15cab0 legacy=0x7f073c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f0732ffd640 1 -- 172.21.15.53:0/3920287815 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0cddd0 con 0x7f073c0d19c0 2024-09-13T18:26:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.846+0000 7f073bfff640 1 --2- 172.21.15.53:0/3920287815 >> v2:172.21.15.87:3300/0 conn(0x7f073c0cf600 0x7f073c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0732ffd640 1 --2- 172.21.15.53:0/3920287815 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c0cf0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07240097c0 tx=0x7f072401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4349f2044cf4de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f073affd640 1 -- 172.21.15.53:0/3920287815 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240ad640 con 0x7f073c0d19c0 2024-09-13T18:26:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f073affd640 1 -- 172.21.15.53:0/3920287815 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07240ad7a0 con 0x7f073c0d19c0 2024-09-13T18:26:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f073affd640 1 -- 172.21.15.53:0/3920287815 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240adb30 con 0x7f073c0d19c0 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- 172.21.15.53:0/3920287815 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 msgr2=0x7f073c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 --2- 172.21.15.53:0/3920287815 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c0cf0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07240097c0 tx=0x7f072401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- 172.21.15.53:0/3920287815 shutdown_connections 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 --2- 172.21.15.53:0/3920287815 >> v2:172.21.15.87:3300/0 conn(0x7f073c0cf600 0x7f073c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 --2- 172.21.15.53:0/3920287815 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c0cf0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- 172.21.15.53:0/3920287815 >> 172.21.15.53:0/3920287815 conn(0x7f073c065c80 msgr2=0x7f073c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- 172.21.15.53:0/3920287815 shutdown_connections 2024-09-13T18:26:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- 172.21.15.53:0/3920287815 wait complete. 2024-09-13T18:26:51.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 Processor -- start 2024-09-13T18:26:51.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- start start 2024-09-13T18:26:51.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0cf600 0x7f073c14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f073c15cab0 0x7f073c166740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1662b0 con 0x7f073c0cf600 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1656a0 con 0x7f073c15cab0 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f0742162640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c165980 con 0x7f073c0d19c0 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f073b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0cf600 0x7f073c14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f073b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0cf600 0x7f073c14f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59326/0 (socket says 172.21.15.53:59326) 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f073b7fe640 1 -- 172.21.15.53:0/2708192834 learned_addr learned my addr 172.21.15.53:0/2708192834 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.850+0000 7f073bfff640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f073c15cab0 0x7f073c166740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0732ffd640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f073b7fe640 1 -- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 msgr2=0x7f073c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f073b7fe640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f073b7fe640 1 -- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f073c15cab0 msgr2=0x7f073c166740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f073b7fe640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f073c15cab0 0x7f073c166740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f073b7fe640 1 -- 172.21.15.53:0/2708192834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0734009a70 con 0x7f073c0cf600 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0732ffd640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f073b7fe640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0cf600 0x7f073c14f9e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c420 tx=0x7f072c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0738ff9640 1 -- 172.21.15.53:0/2708192834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c005cf0 con 0x7f073c0cf600 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0724009420 con 0x7f073c0cf600 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0738ff9640 1 -- 172.21.15.53:0/2708192834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c005e50 con 0x7f073c0cf600 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0738ff9640 1 -- 172.21.15.53:0/2708192834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c0072f0 con 0x7f073c0cf600 2024-09-13T18:26:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c165f40 con 0x7f073c0cf600 2024-09-13T18:26:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c0b5870 con 0x7f073c0cf600 2024-09-13T18:26:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0738ff9640 1 -- 172.21.15.53:0/2708192834 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f072c007450 con 0x7f073c0cf600 2024-09-13T18:26:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0738ff9640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f071c066840 0x7f071c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0738ff9640 1 -- 172.21.15.53:0/2708192834 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f072c083af0 con 0x7f073c0cf600 2024-09-13T18:26:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0732ffd640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f071c066840 0x7f071c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.854+0000 7f0732ffd640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f071c066840 0x7f071c068d00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f07240af000 tx=0x7f07240a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:51.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:51.858+0000 7f0738ff9640 1 -- 172.21.15.53:0/2708192834 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f072c050b60 con 0x7f073c0cf600 2024-09-13T18:26:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f073c0b42e0 con 0x7f073c0cf600 2024-09-13T18:26:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0738ff9640 1 -- 172.21.15.53:0/2708192834 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f072c017020 con 0x7f073c0cf600 2024-09-13T18:26:52.054 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:26:52.054 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:26:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 22 2024-09-13T18:26:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f071c066840 msgr2=0x7f071c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f071c066840 0x7f071c068d00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f07240af000 tx=0x7f07240a7070 comp rx=0 tx=0).stop 2024-09-13T18:26:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0cf600 msgr2=0x7f073c14f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0cf600 0x7f073c14f9e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c420 tx=0x7f072c00c8e0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 shutdown_connections 2024-09-13T18:26:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f071c066840 0x7f071c068d00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f073c0d19c0 0x7f073c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f073c15cab0 0x7f073c166740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.050+0000 7f0742162640 1 --2- 172.21.15.53:0/2708192834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0cf600 0x7f073c14f9e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.054+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 >> 172.21.15.53:0/2708192834 conn(0x7f073c065c80 msgr2=0x7f073c0b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.054+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 shutdown_connections 2024-09-13T18:26:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.054+0000 7f0742162640 1 -- 172.21.15.53:0/2708192834 wait complete. 2024-09-13T18:26:52.474 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:26:42.155898+0000', 'modified': '2024-09-13T18:26:45.456189+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5700}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5700': {'gid': 5700, 'name': 'a', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/1420693601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6833', 'nonce': 1420693601}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 1420693601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:26:52.474 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:26:52.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:26:52.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.606+0000 7f1222eed640 1 Processor -- start 2024-09-13T18:26:52.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.606+0000 7f1222eed640 1 -- start start 2024-09-13T18:26:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.606+0000 7f1222eed640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f121c1582a0 0x7f121c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1222eed640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 0x7f121c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1222eed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c06d480 con 0x7f121c070c90 2024-09-13T18:26:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1222eed640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c15aaf0 con 0x7f121c1582a0 2024-09-13T18:26:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1222eed640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c06d760 con 0x7f121c15b7c0 2024-09-13T18:26:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f121c070c90 0x7f121c06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57990/0 (socket says 172.21.15.53:57990) 2024-09-13T18:26:52.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 -- 172.21.15.53:0/4254386137 learned_addr learned my addr 172.21.15.53:0/4254386137 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1213fff640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 0x7f121c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1220c89640 1 --2- 172.21.15.53:0/4254386137 >> v2:172.21.15.87:3300/0 conn(0x7f121c1582a0 0x7f121c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060410970 0 0) 0x7f121c06d480 con 0x7f121c070c90 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1204003530 con 0x7f121c070c90 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1566807641 0 0) 0x7f1204003530 con 0x7f121c070c90 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 msgr2=0x7f121c06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 0x7f121c06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 >> v2:172.21.15.87:3300/0 conn(0x7f121c1582a0 msgr2=0x7f121c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 --2- 172.21.15.53:0/4254386137 >> v2:172.21.15.87:3300/0 conn(0x7f121c1582a0 0x7f121c06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c15ace0 con 0x7f121c070c90 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f1214001a00 con 0x7f121c070c90 2024-09-13T18:26:52.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 >> v1:172.21.15.53:6789/0 conn(0x7f121c070c90 legacy=0x7f121c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 0x7f1204003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1204003f00 0x7f12040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1204004d10 0x7f1204005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120400b990 con 0x7f1204004d10 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120400bad0 con 0x7f1204003f00 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120400bc10 con 0x7f121c15b7c0 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1204004d10 0x7f1204005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1220c89640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 0x7f1204003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 -- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 msgr2=0x7f1204003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 0x7f1204003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 -- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1204003f00 msgr2=0x7f12040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1213fff640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1204003f00 0x7f12040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1204003f00 0x7f12040047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 -- 172.21.15.53:0/4254386137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1204003530 con 0x7f1204004d10 2024-09-13T18:26:52.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f1220c89640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c15b7c0 0x7f1204003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f122148a640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1204004d10 0x7f1204005190 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f121400a830 tx=0x7f121401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eee035bdc97f52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140ad630 con 0x7f1204004d10 2024-09-13T18:26:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12140a8070 con 0x7f1204004d10 2024-09-13T18:26:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.610+0000 7f12137fe640 1 -- 172.21.15.53:0/4254386137 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140ad9d0 con 0x7f1204004d10 2024-09-13T18:26:52.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- 172.21.15.53:0/4254386137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1204004d10 msgr2=0x7f1204005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 --2- 172.21.15.53:0/4254386137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1204004d10 0x7f1204005190 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f121400a830 tx=0x7f121401d300 comp rx=0 tx=0).stop 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 -- 172.21.15.53:0/4254386137 reap_dead start 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- 172.21.15.53:0/4254386137 shutdown_connections 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- 172.21.15.53:0/4254386137 >> 172.21.15.53:0/4254386137 conn(0x7f121c065c80 msgr2=0x7f121c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- 172.21.15.53:0/4254386137 shutdown_connections 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- 172.21.15.53:0/4254386137 wait complete. 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 Processor -- start 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- start start 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c0b1d20 0x7f121c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f121c0cd230 0x7f121c149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f121c149fd0 0x7f121c148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0c87e0 con 0x7f121c149fd0 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0c8ac0 con 0x7f121c0cd230 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0c8da0 con 0x7f121c0b1d20 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f121c149fd0 0x7f121c148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f121c149fd0 0x7f121c148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59348/0 (socket says 172.21.15.53:59348) 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 -- 172.21.15.53:0/3126495549 learned_addr learned my addr 172.21.15.53:0/3126495549 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1213fff640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f121c0cd230 0x7f121c149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1220c89640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c0b1d20 0x7f121c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 -- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c0b1d20 msgr2=0x7f121c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c0b1d20 0x7f121c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 -- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f121c0cd230 msgr2=0x7f121c149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f121c0cd230 0x7f121c149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 -- 172.21.15.53:0/3126495549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0c9080 con 0x7f121c149fd0 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f122148a640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f121c149fd0 0x7f121c148e40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f121401cd70 tx=0x7f1204005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f12117fa640 1 -- 172.21.15.53:0/3126495549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214002000 con 0x7f121c149fd0 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f12117fa640 1 -- 172.21.15.53:0/3126495549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1214001950 con 0x7f121c149fd0 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c0c9360 con 0x7f121c149fd0 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f12117fa640 1 -- 172.21.15.53:0/3126495549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140b6650 con 0x7f121c149fd0 2024-09-13T18:26:52.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.614+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c0c84f0 con 0x7f121c149fd0 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f12117fa640 1 -- 172.21.15.53:0/3126495549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f12140aa030 con 0x7f121c149fd0 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f12117fa640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1208066840 0x7f1208068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f12117fa640 1 -- 172.21.15.53:0/3126495549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f121411e410 con 0x7f121c149fd0 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1208066840 0x7f1208068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 Processor -- start 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 -- start start 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1208066840 0x7f1208068d00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1218009b40 tx=0x7f1218008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d2b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d26b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d26bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d133e80 con 0x56163d2b51f0 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d0c1af0 con 0x56163d2b5b10 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x56163d0bf0c0 con 0x56163d26b740 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d2b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d2b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59356/0 (socket says 172.21.15.53:59356) 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 -- 172.21.15.53:0/2862784947 learned_addr learned my addr 172.21.15.53:0/2862784947 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1213fff640 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d26b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f122148a640 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d26bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 -- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 msgr2=0x56163d26bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d26bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 -- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 msgr2=0x56163d26b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d26b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 -- 172.21.15.53:0/2862784947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56163cdb6890 con 0x56163d2b51f0 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1213fff640 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d26b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:52.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.618+0000 7f1220c89640 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d2b55d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1218012db0 tx=0x7f1218015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810818ddf112d86c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f12027fc640 1 -- 172.21.15.53:0/2862784947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218009890 con 0x56163d2b51f0 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f12027fc640 1 -- 172.21.15.53:0/2862784947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218003ba0 con 0x56163d2b51f0 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f12027fc640 1 -- 172.21.15.53:0/2862784947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218023410 con 0x56163d2b51f0 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/2862784947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 msgr2=0x56163d2b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d2b55d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1218012db0 tx=0x7f1218015000 comp rx=0 tx=0).stop 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/2862784947 shutdown_connections 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d26bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d26b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- 172.21.15.53:0/2862784947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d2b55d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/2862784947 >> 172.21.15.53:0/2862784947 conn(0x56163d271fb0 msgr2=0x56163d272390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/2862784947 shutdown_connections 2024-09-13T18:26:52.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/2862784947 wait complete. 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- start start 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 Processor -- start 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d276fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b51f0 0x56163d2774f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b5b10 0x56163d277a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d0ba9b0 con 0x56163d2b5b10 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d059c00 con 0x56163d2b51f0 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x56163d078070 con 0x56163d26b740 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 10 client.0 _ll_register_callbacks cb 0x56163d257ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b5b10 0x56163d277a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b5b10 0x56163d277a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59372/0 (socket says 172.21.15.53:59372) 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 -- 172.21.15.53:0/398921411 learned_addr learned my addr 172.21.15.53:0/398921411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1213fff640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b51f0 0x56163d2774f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1220c89640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d276fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 -- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 msgr2=0x56163d276fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d276fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 -- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b51f0 msgr2=0x56163d2774f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b51f0 0x56163d2774f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 -- 172.21.15.53:0/398921411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1218012a90 con 0x56163d2b5b10 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1220c89640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d276fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1213fff640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b51f0 0x56163d2774f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f122148a640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b5b10 0x56163d277a30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f121401d7e0 tx=0x7f12140eec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58ca153b13809d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f11fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f11fb7fe640 1 -- 172.21.15.53:0/398921411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140f2e50 con 0x56163d2b5b10 2024-09-13T18:26:52.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f11fb7fe640 1 -- 172.21.15.53:0/398921411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12140f74a0 con 0x56163d2b5b10 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56163d0775f0 con 0x56163d2b5b10 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f11fb7fe640 1 -- 172.21.15.53:0/398921411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f121411e0b0 con 0x56163d2b5b10 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 10 client.5865 fetch_fsmap learned FSMap version 22 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56163d07fab0 con 0x56163d2b5b10 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f11fb7fe640 1 -- 172.21.15.53:0/398921411 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121410a020 con 0x56163d2b5b10 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f11fb7fe640 1 -- 172.21.15.53:0/398921411 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f12140b4070 con 0x56163d2b5b10 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 10 client.5865 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 10 client.5865 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 20 client.5865 populate_metadata read hostname 'smithi053' 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d278440 0x56163d2c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 4 client.5865 mds_command: new command op to 5700 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 --> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56163d0b7790 con 0x56163d278440 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.622+0000 7f1220c89640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d278440 0x56163d2c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f11fb7fe640 10 client.5865 ms_handle_connect on v2:172.21.15.53:6833/1420693601 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1220c89640 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d278440 0x56163d2c72a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb4e48d133fde12 server_cookie=786d03df187fff3b in_seq=0 out_seq=0 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f11fb7fe640 1 -- 172.21.15.53:0/398921411 <== mds.0 v2:172.21.15.53:6833/1420693601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56163d0b7790 con 0x56163d278440 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f11fb7fe640 10 client.5865 handle_command_reply: tid=0 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 client.5865 shutdown 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b5b10 msgr2=0x56163d277a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b5b10 0x56163d277a30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f121401d7e0 tx=0x7f12140eec70 comp rx=0 tx=0).stop 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 shutdown_connections 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d278440 0x56163d2c72a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b5b10 0x56163d277a30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b51f0 0x56163d2774f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f11fb7fe640 0 client.5865 ms_handle_reset on v2:172.21.15.53:6833/1420693601 2024-09-13T18:26:52.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 --2- 172.21.15.53:0/398921411 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d26b740 0x56163d276fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 >> 172.21.15.53:0/398921411 conn(0x56163d271fb0 msgr2=0x56163d26a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 shutdown_connections 2024-09-13T18:26:52.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 1 -- 172.21.15.53:0/398921411 wait complete. 2024-09-13T18:26:52.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.626+0000 7f1226036000 20 client.5865 trim_cache size 0 max 16384 2024-09-13T18:26:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 Processor -- start 2024-09-13T18:26:52.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- start start 2024-09-13T18:26:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d26b740 0x56163d2713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b51f0 0x56163d270260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d2707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163cd77940 con 0x56163d26b740 2024-09-13T18:26:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d081c60 con 0x56163d2b5b10 2024-09-13T18:26:52.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x56163d073f80 con 0x56163d2b51f0 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d26b740 0x56163d2713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d26b740 0x56163d2713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59386/0 (socket says 172.21.15.53:59386) 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 -- 172.21.15.53:0/2147301157 learned_addr learned my addr 172.21.15.53:0/2147301157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 -- 172.21.15.53:0/2147301157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b51f0 msgr2=0x56163d270260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b51f0 0x56163d270260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 -- 172.21.15.53:0/2147301157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 msgr2=0x56163d2707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f122148a640 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d2707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d2707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 -- 172.21.15.53:0/2147301157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56163d065c00 con 0x56163d26b740 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1220c89640 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d26b740 0x56163d2713c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1218026040 tx=0x7f1218017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1663e4ed973d71e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1202ffd640 1 -- 172.21.15.53:0/2147301157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218033070 con 0x56163d26b740 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1202ffd640 1 -- 172.21.15.53:0/2147301157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218003b20 con 0x56163d26b740 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1202ffd640 1 -- 172.21.15.53:0/2147301157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218034b00 con 0x56163d26b740 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- 172.21.15.53:0/2147301157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d26b740 msgr2=0x56163d2713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d26b740 0x56163d2713c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1218026040 tx=0x7f1218017000 comp rx=0 tx=0).stop 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- 172.21.15.53:0/2147301157 shutdown_connections 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b51f0 0x56163d270260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d2b5b10 0x56163d2707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 --2- 172.21.15.53:0/2147301157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d26b740 0x56163d2713c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- 172.21.15.53:0/2147301157 >> 172.21.15.53:0/2147301157 conn(0x56163d271fb0 msgr2=0x56163d2699d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- 172.21.15.53:0/2147301157 shutdown_connections 2024-09-13T18:26:52.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- 172.21.15.53:0/2147301157 wait complete. 2024-09-13T18:26:52.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 -- start start 2024-09-13T18:26:52.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.642+0000 7f1226036000 1 Processor -- start 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d26b740 0x56163d316d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d317260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b5b10 0x56163d2facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d0b9840 con 0x56163d2b51f0 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d0bcfa0 con 0x56163d26b740 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x56163d2cbf90 con 0x56163d2b5b10 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 10 client.0 _ll_register_callbacks cb 0x7f121801a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d317260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d317260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59396/0 (socket says 172.21.15.53:59396) 2024-09-13T18:26:52.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 -- 172.21.15.53:0/4250240108 learned_addr learned my addr 172.21.15.53:0/4250240108 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1220c89640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d26b740 0x56163d316d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 -- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b5b10 msgr2=0x56163d2facf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f122148a640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b5b10 0x56163d2facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b5b10 0x56163d2facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 -- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d26b740 msgr2=0x56163d316d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d26b740 0x56163d316d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 -- 172.21.15.53:0/4250240108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56163cdb6890 con 0x56163d2b51f0 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1220c89640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d26b740 0x56163d316d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1213fff640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d317260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f120c006e90 tx=0x7f120c0146c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ae85cba8eca65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 1 -- 172.21.15.53:0/4250240108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c017680 con 0x56163d2b51f0 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 1 -- 172.21.15.53:0/4250240108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f120c0177e0 con 0x56163d2b51f0 2024-09-13T18:26:52.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56163d08a460 con 0x56163d2b51f0 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 1 -- 172.21.15.53:0/4250240108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f120c0179a0 con 0x56163d2b51f0 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 10 client.5871 fetch_fsmap learned FSMap version 22 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56163cdb6cc0 con 0x56163d2b51f0 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 1 -- 172.21.15.53:0/4250240108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56163d08a460 con 0x56163d2b51f0 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 1 -- 172.21.15.53:0/4250240108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f120c012070 con 0x56163d2b51f0 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 10 client.5871 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 10 client.5871 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 20 client.5871 populate_metadata read hostname 'smithi053' 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d2fb230 0x56163d2fb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 4 client.5871 mds_command: new command op to 5700 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 --> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56163d0839c0 con 0x56163d2fb230 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1220c89640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d2fb230 0x56163d2fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1220c89640 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d2fb230 0x56163d2fb610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd06ee4c6ff9d6e server_cookie=f9745b6d266f482b in_seq=0 out_seq=0 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 10 client.5871 ms_handle_connect on v2:172.21.15.53:6833/1420693601 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 1 -- 172.21.15.53:0/4250240108 <== mds.0 v2:172.21.15.53:6833/1420693601 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x56163d0839c0 con 0x56163d2fb230 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 10 client.5871 handle_command_reply: tid=0 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 client.5871 shutdown 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 msgr2=0x56163d317260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d317260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f120c006e90 tx=0x7f120c0146c0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 shutdown_connections 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:6833/1420693601,v1:172.21.15.53:6835/1420693601] conn(0x56163d2fb230 0x56163d2fb610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x56163d2b5b10 0x56163d2facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56163d2b51f0 0x56163d317260 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 --2- 172.21.15.53:0/4250240108 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x56163d26b740 0x56163d316d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f11fb7fe640 0 client.5871 ms_handle_reset on v2:172.21.15.53:6833/1420693601 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 >> 172.21.15.53:0/4250240108 conn(0x56163d271fb0 msgr2=0x56163d26a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 shutdown_connections 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 1 -- 172.21.15.53:0/4250240108 wait complete. 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1226036000 20 client.5871 trim_cache size 0 max 16384 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5700, 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:26:52.658 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:26:52.659 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.49021447, 2024-09-13T18:26:52.659 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 22, 2024-09-13T18:26:52.659 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 46, 2024-09-13T18:26:52.659 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 46, 2024-09-13T18:26:52.659 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.140006222 2024-09-13T18:26:52.659 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:26:52.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1208066840 msgr2=0x7f1208068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1208066840 0x7f1208068d00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1218009b40 tx=0x7f1218008040 comp rx=0 tx=0).stop 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f121c149fd0 msgr2=0x7f121c148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f121c149fd0 0x7f121c148e40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f121401cd70 tx=0x7f1204005800 comp rx=0 tx=0).stop 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 shutdown_connections 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1208066840 0x7f1208068d00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f121c149fd0 0x7f121c148e40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f121c0cd230 0x7f121c149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 --2- 172.21.15.53:0/3126495549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f121c0b1d20 0x7f121c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 >> 172.21.15.53:0/3126495549 conn(0x7f121c065c80 msgr2=0x7f121c1586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 shutdown_connections 2024-09-13T18:26:52.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.646+0000 7f1222eed640 1 -- 172.21.15.53:0/3126495549 wait complete. 2024-09-13T18:26:52.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:26:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e6aad640 1 Processor -- start 2024-09-13T18:26:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e6aad640 1 -- start start 2024-09-13T18:26:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e6aad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e6aad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1e0069f50 0x7fc1e006a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e6aad640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e00cfe80 con 0x7fc1e00cd630 2024-09-13T18:26:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e6aad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00d0120 con 0x7fc1e0069f50 2024-09-13T18:26:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e6aad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00b1400 con 0x7fc1e00b1af0 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1dffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e504a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1e0069f50 0x7fc1e006a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1dffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e00cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:43232/0 (socket says 172.21.15.53:43232) 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e504a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1e0069f50 0x7fc1e006a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:38292/0 (socket says 172.21.15.53:38292) 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1dffff640 1 -- 172.21.15.53:0/2005800066 learned_addr learned my addr 172.21.15.53:0/2005800066 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e4849640 1 --1- 172.21.15.53:0/2005800066 >> v1:172.21.15.87:6789/0 conn(0x7fc1e00cd630 0x7fc1e00b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:46260/0 (socket says 172.21.15.53:46260) 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1dffff640 1 -- 172.21.15.53:0/2005800066 >> v2:172.21.15.87:3300/0 conn(0x7fc1e0069f50 msgr2=0x7fc1e006a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1dffff640 1 --2- 172.21.15.53:0/2005800066 >> v2:172.21.15.87:3300/0 conn(0x7fc1e0069f50 0x7fc1e006a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1dffff640 1 -- 172.21.15.53:0/2005800066 >> v1:172.21.15.87:6789/0 conn(0x7fc1e00cd630 legacy=0x7fc1e00b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1dffff640 1 -- 172.21.15.53:0/2005800066 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e006ac20 con 0x7fc1e00b1af0 2024-09-13T18:26:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.778+0000 7fc1e504a640 1 --2- 172.21.15.53:0/2005800066 >> v2:172.21.15.87:3300/0 conn(0x7fc1e0069f50 0x7fc1e006a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:26:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1dffff640 1 --2- 172.21.15.53:0/2005800066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e00cf580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009870 tx=0x7fc1d401cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e208c6c7d4454628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1df7fe640 1 -- 172.21.15.53:0/2005800066 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4004230 con 0x7fc1e00b1af0 2024-09-13T18:26:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1df7fe640 1 -- 172.21.15.53:0/2005800066 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d40a7050 con 0x7fc1e00b1af0 2024-09-13T18:26:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1df7fe640 1 -- 172.21.15.53:0/2005800066 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4003620 con 0x7fc1e00b1af0 2024-09-13T18:26:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2005800066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 msgr2=0x7fc1e00cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2005800066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e00cf580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009870 tx=0x7fc1d401cea0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2005800066 shutdown_connections 2024-09-13T18:26:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2005800066 >> v2:172.21.15.87:3300/0 conn(0x7fc1e0069f50 0x7fc1e006a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2005800066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e00cf580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2005800066 >> 172.21.15.53:0/2005800066 conn(0x7fc1e00b20d0 msgr2=0x7fc1e00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2005800066 shutdown_connections 2024-09-13T18:26:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2005800066 wait complete. 2024-09-13T18:26:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 Processor -- start 2024-09-13T18:26:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.782+0000 7fc1e6aad640 1 -- start start 2024-09-13T18:26:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1e0069f50 0x7fc1e00b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e0153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1e00cd630 0x7fc1e00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0153a70 con 0x7fc1e00cd630 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00cb4b0 con 0x7fc1e0069f50 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00cb790 con 0x7fc1e00b1af0 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1e00cd630 0x7fc1e00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1e00cd630 0x7fc1e00cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59412/0 (socket says 172.21.15.53:59412) 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 -- 172.21.15.53:0/2202659476 learned_addr learned my addr 172.21.15.53:0/2202659476 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e4849640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1e0069f50 0x7fc1e00b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1dffff640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e0153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 -- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 msgr2=0x7fc1e0153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e0153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 -- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1e0069f50 msgr2=0x7fc1e00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1e0069f50 0x7fc1e00b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 -- 172.21.15.53:0/2202659476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8009420 con 0x7fc1e00cd630 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e4849640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1e0069f50 0x7fc1e00b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e504a640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1e00cd630 0x7fc1e00cc550 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800e930 tx=0x7fc1d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1dd7fa640 1 -- 172.21.15.53:0/2202659476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8009680 con 0x7fc1e00cd630 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1dd7fa640 1 -- 172.21.15.53:0/2202659476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d8004020 con 0x7fc1e00cd630 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d40094d0 con 0x7fc1e00cd630 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1dd7fa640 1 -- 172.21.15.53:0/2202659476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80043f0 con 0x7fc1e00cd630 2024-09-13T18:26:52.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e00cbd50 con 0x7fc1e00cd630 2024-09-13T18:26:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e006a3c0 con 0x7fc1e00cd630 2024-09-13T18:26:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1dd7fa640 1 -- 172.21.15.53:0/2202659476 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc1d800c940 con 0x7fc1e00cd630 2024-09-13T18:26:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1dd7fa640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1cc066840 0x7fc1cc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1dd7fa640 1 -- 172.21.15.53:0/2202659476 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d8084320 con 0x7fc1e00cd630 2024-09-13T18:26:52.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.786+0000 7fc1e4849640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1cc066840 0x7fc1cc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:52.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.790+0000 7fc1e4849640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1cc066840 0x7fc1cc068d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00012f0 tx=0x7fc1d0005be0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:52.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.790+0000 7fc1dd7fa640 1 -- 172.21.15.53:0/2202659476 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1d80514a0 con 0x7fc1e00cd630 2024-09-13T18:26:52.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.986+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1e00ce660 con 0x7fc1e00cd630 2024-09-13T18:26:52.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.986+0000 7fc1dd7fa640 1 -- 172.21.15.53:0/2202659476 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc1d8054ac0 con 0x7fc1e00cd630 2024-09-13T18:26:52.990 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:26:52.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1cc066840 msgr2=0x7fc1cc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1cc066840 0x7fc1cc068d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00012f0 tx=0x7fc1d0005be0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1e00cd630 msgr2=0x7fc1e00cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:52.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1e00cd630 0x7fc1e00cc550 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800e930 tx=0x7fc1d800edf0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 shutdown_connections 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc1cc066840 0x7fc1cc068d00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1e00b1af0 0x7fc1e0153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1e00cd630 0x7fc1e00cc550 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 --2- 172.21.15.53:0/2202659476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1e0069f50 0x7fc1e00b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 >> 172.21.15.53:0/2202659476 conn(0x7fc1e00b20d0 msgr2=0x7fc1e006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 shutdown_connections 2024-09-13T18:26:52.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:52.990+0000 7fc1e6aad640 1 -- 172.21.15.53:0/2202659476 wait complete. 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:26:53.010 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:26:53.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.011 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:53.017 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42384sec preferred_lft 42384sec 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:26:53.018 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:53.019 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:26:53.020 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:26:53.020 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:53.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.020 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:26:53.071 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:26:53.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.072 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:26:53.122 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:26:53.122 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:26:53.122 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:26:53.122 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:26:53.122 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:26:53.123 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:26:53.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.123 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:26:53.123 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:26:53.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:26:53.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:26:53.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:26:53.123 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:26:53.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.195 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:26:53.241 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:26:53.241 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:26:53.241 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:26:53.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:26:53.297 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:26:53.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:53.297 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:53.345 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:26:53.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:53.345 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:53.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:26:53.451 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:53.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:53.505 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:53.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.505 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:26:53.553 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:26:53.553 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:26:53.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:26:53.613 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:53.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:53.666 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:53.667 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:53.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:53.668 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:26:53.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:26:53.678+0000 7faab070b580 -1 init, newargv = 0x5593e317a4d0 newargc=15 2024-09-13T18:26:53.683 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[40623]: starting ceph client 2024-09-13T18:26:53.688 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[40623]: starting fuse 2024-09-13T18:26:54.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:54.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:26:54.788 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:26:54.803 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:54.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:54.865 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:54.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:54.866 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:26:54.917 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:26:54.917 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:54.918 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:26:54.919 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:26:54.920 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:26:55.047 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.40623.asok 2024-09-13T18:26:55.229 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40623.asok 2024-09-13T18:26:55.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:55.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40623.asok status 2024-09-13T18:26:55.390 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "40623", 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5880, 2024-09-13T18:26:55.391 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 5880 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1835828948 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:26:55.392 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1835828948 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.5880 192.168.0.1:0/1835828948", 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1835828948", 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 22, 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 46, 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:26:55.393 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:26:55.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:55.404 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:26:55.404 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:55.410 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:26:55.410 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:55.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:55.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:26:55.464 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:26:55.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.629+0000 7fac19c80640 1 Processor -- start 2024-09-13T18:26:55.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac19c80640 1 -- start start 2024-09-13T18:26:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac19c80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 0x7fac140ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac19c80640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1415dd20 con 0x7fac1415d570 2024-09-13T18:26:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac19c80640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1415e000 con 0x7fac140ac8b0 2024-09-13T18:26:55.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac19c80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1415cf80 con 0x7fac140713c0 2024-09-13T18:26:55.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fac1415d570 0x7fac14070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58004/0 (socket says 172.21.15.53:58004) 2024-09-13T18:26:55.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 -- 172.21.15.53:0/2855126335 learned_addr learned my addr 172.21.15.53:0/2855126335 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac12ffd640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 0x7fac140ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589986269 0 0) 0x7fac1415dd20 con 0x7fac1415d570 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabfc003530 con 0x7fac1415d570 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882067841 0 0) 0x7fac1415e000 con 0x7fac140ac8b0 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac1415dd20 con 0x7fac140ac8b0 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697700548 0 0) 0x7fabfc003530 con 0x7fac1415d570 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 msgr2=0x7fac140ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 0x7fac140ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 >> v1:172.21.15.87:6789/0 conn(0x7fac140ac8b0 legacy=0x7fac14152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140acf80 con 0x7fac1415d570 2024-09-13T18:26:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fac04001a00 con 0x7fac1415d570 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 >> v1:172.21.15.53:6789/0 conn(0x7fac1415d570 legacy=0x7fac14070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fabfc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 0x7fabfc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabfc004d10 0x7fabfc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1415cf80 con 0x7fabfc003b40 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc00ba70 con 0x7fabfc004d10 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc00bc30 con 0x7fac140713c0 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fabfc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac13fff640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabfc004d10 0x7fabfc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac12ffd640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 0x7fabfc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 -- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 msgr2=0x7fabfc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac140713c0 0x7fabfc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 -- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabfc004d10 msgr2=0x7fabfc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabfc004d10 0x7fabfc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.633+0000 7fac137fe640 1 -- 172.21.15.53:0/2855126335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc003530 con 0x7fabfc003b40 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac137fe640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fabfc003f40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fac0400a710 tx=0x7fac0401d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471c5d1811da945 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040ae470 con 0x7fabfc003b40 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040ae5f0 con 0x7fabfc003b40 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac127fc640 1 -- 172.21.15.53:0/2855126335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040ae9a0 con 0x7fabfc003b40 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 -- 172.21.15.53:0/2855126335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 msgr2=0x7fabfc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 --2- 172.21.15.53:0/2855126335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fabfc003f40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fac0400a710 tx=0x7fac0401d220 comp rx=0 tx=0).stop 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac13fff640 1 -- 172.21.15.53:0/2855126335 reap_dead start 2024-09-13T18:26:55.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 -- 172.21.15.53:0/2855126335 shutdown_connections 2024-09-13T18:26:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 -- 172.21.15.53:0/2855126335 >> 172.21.15.53:0/2855126335 conn(0x7fac140b0a50 msgr2=0x7fac140b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 -- 172.21.15.53:0/2855126335 shutdown_connections 2024-09-13T18:26:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 -- 172.21.15.53:0/2855126335 wait complete. 2024-09-13T18:26:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 Processor -- start 2024-09-13T18:26:55.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 -- start start 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fac141600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac141526a0 0x7fac14154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.637+0000 7fac19c80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac14154990 0x7fac14161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac19c80640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409c240 con 0x7fabfc003b40 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac19c80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac141551d0 con 0x7fac14154990 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac19c80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac141554b0 con 0x7fac141526a0 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fac141600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fac141600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59436/0 (socket says 172.21.15.53:59436) 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 -- 172.21.15.53:0/2047713344 learned_addr learned my addr 172.21.15.53:0/2047713344 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac12ffd640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac141526a0 0x7fac14154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac13fff640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac14154990 0x7fac14161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 -- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac141526a0 msgr2=0x7fac14154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac141526a0 0x7fac14154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 -- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac14154990 msgr2=0x7fac14161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac14154990 0x7fac14161c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 -- 172.21.15.53:0/2047713344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14155790 con 0x7fabfc003b40 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac12ffd640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac141526a0 0x7fac14154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac137fe640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fac141600e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fac0401d050 tx=0x7fabfc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fabfbfff640 1 -- 172.21.15.53:0/2047713344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04004d70 con 0x7fabfc003b40 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fabfbfff640 1 -- 172.21.15.53:0/2047713344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040ae760 con 0x7fabfc003b40 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac14152b20 con 0x7fabfc003b40 2024-09-13T18:26:55.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fabfbfff640 1 -- 172.21.15.53:0/2047713344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040aead0 con 0x7fabfc003b40 2024-09-13T18:26:55.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac141621c0 con 0x7fabfc003b40 2024-09-13T18:26:55.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14155010 con 0x7fabfc003b40 2024-09-13T18:26:55.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fabfbfff640 1 -- 172.21.15.53:0/2047713344 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fac040b7030 con 0x7fabfc003b40 2024-09-13T18:26:55.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fabfbfff640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fac00066840 0x7fac00068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fabfbfff640 1 -- 172.21.15.53:0/2047713344 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac040b5070 con 0x7fabfc003b40 2024-09-13T18:26:55.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.641+0000 7fac12ffd640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fac00066840 0x7fac00068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.645+0000 7fac12ffd640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fac00066840 0x7fac00068d00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac1409ca70 tx=0x7fac08008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.645+0000 7fabfbfff640 1 -- 172.21.15.53:0/2047713344 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac040ec040 con 0x7fabfc003b40 2024-09-13T18:26:55.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac14155920 con 0x7fabfc003b40 2024-09-13T18:26:55.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fabfbfff640 1 -- 172.21.15.53:0/2047713344 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7fac040ef660 con 0x7fabfc003b40 2024-09-13T18:26:55.846 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:26:55.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fac00066840 msgr2=0x7fac00068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fac00066840 0x7fac00068d00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac1409ca70 tx=0x7fac08008040 comp rx=0 tx=0).stop 2024-09-13T18:26:55.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 msgr2=0x7fac141600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fac141600e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fac0401d050 tx=0x7fabfc005800 comp rx=0 tx=0).stop 2024-09-13T18:26:55.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 shutdown_connections 2024-09-13T18:26:55.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fac00066840 0x7fac00068d00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac141526a0 0x7fac14154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac14154990 0x7fac14161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.841+0000 7fac19c80640 1 --2- 172.21.15.53:0/2047713344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabfc003b40 0x7fac141600e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.845+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 >> 172.21.15.53:0/2047713344 conn(0x7fac140b0a50 msgr2=0x7fac140af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.845+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 shutdown_connections 2024-09-13T18:26:55.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:55.845+0000 7fac19c80640 1 -- 172.21.15.53:0/2047713344 wait complete. 2024-09-13T18:26:55.865 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:26:55.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:26:55.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:26:55.865 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:26:55.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:55.866 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:26:55.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:26:55.866 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:26:55.866 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:26:55.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:55.866 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:55.873 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42387sec preferred_lft 42387sec 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:26:55.874 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.875 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:26:55.876 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:26:55.876 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:26:55.876 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:26:55.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:55.876 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:26:55.927 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:26:55.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:55.929 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:26:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:26:55.982 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:26:55.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:55.984 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:26:55.984 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:26:55.984 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:26:55.984 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:26:55.984 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:26:55.984 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:26:56.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:56.057 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:26:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:26:56.105 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:26:56.105 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:26:56.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:56.105 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:26:56.159 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:26:56.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:56.160 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:56.208 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:26:56.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:26:56.208 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:56.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:26:56.314 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:56.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:56.368 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:56.368 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:56.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:56.369 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:26:56.417 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:26:56.417 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:26:56.465 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:26:56.481 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:56.482 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:56.536 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:56.537 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:56.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:56.537 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:26:56.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:26:56.542+0000 7f3564f65580 -1 init, newargv = 0x5567e5a92620 newargc=15 2024-09-13T18:26:56.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35358]: starting ceph client 2024-09-13T18:26:56.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35358]: starting fuse 2024-09-13T18:26:57.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:26:57.669 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:26:57.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:26:57.723 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:26:57.724 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:26:57.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:57.724 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:26:57.772 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:26:57.773 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:26:57.773 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:26:57.774 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:26:57.775 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:26:57.775 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:26:57.775 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:26:57.775 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:26:57.891 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.35358.asok 2024-09-13T18:26:58.074 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35358.asok 2024-09-13T18:26:58.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:58.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35358.asok status 2024-09-13T18:26:58.235 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:26:58.235 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:26:58.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:26:58.235 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:26:58.235 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35358", 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5599, 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5599 2024-09-13T18:26:58.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 186925191 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 186925191 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5599 192.168.0.1:0/186925191", 2024-09-13T18:26:58.237 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/186925191", 2024-09-13T18:26:58.238 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:26:58.238 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 22, 2024-09-13T18:26:58.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 46, 2024-09-13T18:26:58.238 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:26:58.238 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:26:58.238 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:26:58.238 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:26:58.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:58.249 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:26:58.249 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:58.255 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:26:58.255 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:58.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:26:58.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:26:58.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:26:58.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.449+0000 7f831bd52640 1 Processor -- start 2024-09-13T18:26:58.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.449+0000 7f831bd52640 1 -- start start 2024-09-13T18:26:58.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f831bd52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8314160780 0x7f8314164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f831bd52640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f831406cad0 0x7f83140b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f831bd52640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f83140b24e0 0x7f831406f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f831bd52640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140b2990 con 0x7f8314160780 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f831bd52640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8314165420 con 0x7f83140b24e0 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f831bd52640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831406c640 con 0x7f831406cad0 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8314160780 0x7f8314164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8314160780 0x7f8314164ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59592/0 (socket says 172.21.15.53:59592) 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 -- 172.21.15.53:0/2848842929 learned_addr learned my addr 172.21.15.53:0/2848842929 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f83192ed640 1 --2- 172.21.15.53:0/2848842929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f831406cad0 0x7f83140b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f831a2ef640 1 --2- 172.21.15.53:0/2848842929 >> v2:172.21.15.87:3300/0 conn(0x7f83140b24e0 0x7f831406f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 -- 172.21.15.53:0/2848842929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f831406cad0 msgr2=0x7f83140b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:58.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 --2- 172.21.15.53:0/2848842929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f831406cad0 0x7f83140b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 -- 172.21.15.53:0/2848842929 >> v2:172.21.15.87:3300/0 conn(0x7f83140b24e0 msgr2=0x7f831406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:58.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 --2- 172.21.15.53:0/2848842929 >> v2:172.21.15.87:3300/0 conn(0x7f83140b24e0 0x7f831406f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f8319aee640 1 -- 172.21.15.53:0/2848842929 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831406ba30 con 0x7f8314160780 2024-09-13T18:26:58.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.453+0000 7f83192ed640 1 --2- 172.21.15.53:0/2848842929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f831406cad0 0x7f83140b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f8319aee640 1 --2- 172.21.15.53:0/2848842929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8314160780 0x7f8314164ee0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f831406c5b0 tx=0x7f831001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd4a01b6d67ce7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f8318aec640 1 -- 172.21.15.53:0/2848842929 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100aa610 con 0x7f8314160780 2024-09-13T18:26:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f8318aec640 1 -- 172.21.15.53:0/2848842929 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100a6040 con 0x7f8314160780 2024-09-13T18:26:58.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f8318aec640 1 -- 172.21.15.53:0/2848842929 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100aa990 con 0x7f8314160780 2024-09-13T18:26:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 -- 172.21.15.53:0/2848842929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8314160780 msgr2=0x7f8314164ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 --2- 172.21.15.53:0/2848842929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8314160780 0x7f8314164ee0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f831406c5b0 tx=0x7f831001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 -- 172.21.15.53:0/2848842929 shutdown_connections 2024-09-13T18:26:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 --2- 172.21.15.53:0/2848842929 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f831406cad0 0x7f83140b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 --2- 172.21.15.53:0/2848842929 >> v2:172.21.15.87:3300/0 conn(0x7f83140b24e0 0x7f831406f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 --2- 172.21.15.53:0/2848842929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8314160780 0x7f8314164ee0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 -- 172.21.15.53:0/2848842929 >> 172.21.15.53:0/2848842929 conn(0x7f8314073330 msgr2=0x7f8314065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 -- 172.21.15.53:0/2848842929 shutdown_connections 2024-09-13T18:26:58.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 -- 172.21.15.53:0/2848842929 wait complete. 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 Processor -- start 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.457+0000 7f831bd52640 1 -- start start 2024-09-13T18:26:58.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831406cad0 0x7f83141587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83140b24e0 0x7f83140cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8314160780 0x7f83140cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140ce160 con 0x7f831406cad0 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140cdea0 con 0x7f8314160780 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83140cbdc0 con 0x7f83140b24e0 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831406cad0 0x7f83141587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831406cad0 0x7f83141587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59594/0 (socket says 172.21.15.53:59594) 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 -- 172.21.15.53:0/1538575904 learned_addr learned my addr 172.21.15.53:0/1538575904 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83192ed640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83140b24e0 0x7f83140cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831a2ef640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8314160780 0x7f83140cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 -- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83140b24e0 msgr2=0x7f83140cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83140b24e0 0x7f83140cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 -- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8314160780 msgr2=0x7f83140cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:58.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8314160780 0x7f83140cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 -- 172.21.15.53:0/1538575904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094d0 con 0x7f831406cad0 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831a2ef640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8314160780 0x7f83140cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83192ed640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83140b24e0 0x7f83140cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f8319aee640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831406cad0 0x7f83141587f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f83100ac040 tx=0x7f831001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83067fc640 1 -- 172.21.15.53:0/1538575904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100bd5f0 con 0x7f831406cad0 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83067fc640 1 -- 172.21.15.53:0/1538575904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100bd770 con 0x7f831406cad0 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83067fc640 1 -- 172.21.15.53:0/1538575904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100bdb20 con 0x7f831406cad0 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83140cc0a0 con 0x7f831406cad0 2024-09-13T18:26:58.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83141582d0 con 0x7f831406cad0 2024-09-13T18:26:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83141584c0 con 0x7f831406cad0 2024-09-13T18:26:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83067fc640 1 -- 172.21.15.53:0/1538575904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f83140700c0 con 0x7f831406cad0 2024-09-13T18:26:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83067fc640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82f8066840 0x7f82f8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83067fc640 1 -- 172.21.15.53:0/1538575904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f831011ee80 con 0x7f831406cad0 2024-09-13T18:26:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.461+0000 7f83192ed640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82f8066840 0x7f82f8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:58.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.465+0000 7f83192ed640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82f8066840 0x7f82f8068d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f83080094c0 tx=0x7f830800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:58.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.465+0000 7f83067fc640 1 -- 172.21.15.53:0/1538575904 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83100ebf10 con 0x7f831406cad0 2024-09-13T18:26:58.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:58.665+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f83140cabf0 con 0x7f831406cad0 2024-09-13T18:26:59.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.021+0000 7f83067fc640 1 -- 172.21.15.53:0/1538575904 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 136+0+0 (secure 0 0 0) 0x7f83100ef530 con 0x7f831406cad0 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82f8066840 msgr2=0x7f82f8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82f8066840 0x7f82f8068d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f83080094c0 tx=0x7f830800b040 comp rx=0 tx=0).stop 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831406cad0 msgr2=0x7f83141587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831406cad0 0x7f83141587f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f83100ac040 tx=0x7f831001ad30 comp rx=0 tx=0).stop 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 shutdown_connections 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82f8066840 0x7f82f8068d00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83140b24e0 0x7f83140cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8314160780 0x7f83140cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 --2- 172.21.15.53:0/1538575904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831406cad0 0x7f83141587f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 >> 172.21.15.53:0/1538575904 conn(0x7f8314073330 msgr2=0x7f83140ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 shutdown_connections 2024-09-13T18:26:59.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.025+0000 7f831bd52640 1 -- 172.21.15.53:0/1538575904 wait complete. 2024-09-13T18:26:59.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:26:59.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f33c8640 1 Processor -- start 2024-09-13T18:26:59.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f33c8640 1 -- start start 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f33c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec06c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f33c8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9ec06ddc0 0x7fe9ec0cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f33c8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec0cfc50 con 0x7fe9ec0cf820 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f33c8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec06e200 con 0x7fe9ec06ddc0 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f33c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec15d1a0 con 0x7fe9ec1591c0 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f0963640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9ec06ddc0 0x7fe9ec0cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f0963640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9ec06ddc0 0x7fe9ec0cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59602/0 (socket says 172.21.15.53:59602) 2024-09-13T18:26:59.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f0963640 1 -- 172.21.15.53:0/3740693218 learned_addr learned my addr 172.21.15.53:0/3740693218 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f1965640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe9ec0cf820 0x7fe9ec159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38308/0 (socket says 172.21.15.53:38308) 2024-09-13T18:26:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f1164640 1 --2- 172.21.15.53:0/3740693218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f0963640 1 -- 172.21.15.53:0/3740693218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 msgr2=0x7fe9ec06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f0963640 1 --2- 172.21.15.53:0/3740693218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec06c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f0963640 1 -- 172.21.15.53:0/3740693218 >> v1:172.21.15.53:6789/0 conn(0x7fe9ec0cf820 legacy=0x7fe9ec159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.181+0000 7fe9f0963640 1 -- 172.21.15.53:0/3740693218 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec15d480 con 0x7fe9ec06ddc0 2024-09-13T18:26:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f0963640 1 --2- 172.21.15.53:0/3740693218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0cf2e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0cfde0 tx=0x7fe9dc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf988ca2f212e1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9e3fff640 1 -- 172.21.15.53:0/3740693218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0ab600 con 0x7fe9ec06ddc0 2024-09-13T18:26:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9e3fff640 1 -- 172.21.15.53:0/3740693218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0a7050 con 0x7fe9ec06ddc0 2024-09-13T18:26:59.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9e3fff640 1 -- 172.21.15.53:0/3740693218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0ab980 con 0x7fe9ec06ddc0 2024-09-13T18:26:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3740693218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec06ddc0 msgr2=0x7fe9ec0cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3740693218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0cf2e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0cfde0 tx=0x7fe9dc01c3d0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3740693218 shutdown_connections 2024-09-13T18:26:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3740693218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0cf2e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3740693218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec06c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3740693218 >> 172.21.15.53:0/3740693218 conn(0x7fe9ec073130 msgr2=0x7fe9ec069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3740693218 shutdown_connections 2024-09-13T18:26:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3740693218 wait complete. 2024-09-13T18:26:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 Processor -- start 2024-09-13T18:26:59.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.185+0000 7fe9f33c8640 1 -- start start 2024-09-13T18:26:59.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec0cf820 0x7fe9ec0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0b1cf0 con 0x7fe9ec0cf820 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0b0710 con 0x7fe9ec06ddc0 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0b09f0 con 0x7fe9ec1591c0 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec0cf820 0x7fe9ec0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec0cf820 0x7fe9ec0b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59608/0 (socket says 172.21.15.53:59608) 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 -- 172.21.15.53:0/3524431183 learned_addr learned my addr 172.21.15.53:0/3524431183 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f1164640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f1965640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 -- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 msgr2=0x7fe9ec0afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec0afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 -- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9ec06ddc0 msgr2=0x7fe9ec0a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 -- 172.21.15.53:0/3524431183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0094d0 con 0x7fe9ec0cf820 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f1164640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f0963640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec0cf820 0x7fe9ec0b17b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc01aa80 tx=0x7fe9dc019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9e1ffb640 1 -- 172.21.15.53:0/3524431183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0b4850 con 0x7fe9ec0cf820 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9e1ffb640 1 -- 172.21.15.53:0/3524431183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0b49b0 con 0x7fe9ec0cf820 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec0b0cd0 con 0x7fe9ec0cf820 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9e1ffb640 1 -- 172.21.15.53:0/3524431183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0b4d40 con 0x7fe9ec0cf820 2024-09-13T18:26:59.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec0b1290 con 0x7fe9ec0cf820 2024-09-13T18:26:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec15ce30 con 0x7fe9ec0cf820 2024-09-13T18:26:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9e1ffb640 1 -- 172.21.15.53:0/3524431183 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe9dc0b2070 con 0x7fe9ec0cf820 2024-09-13T18:26:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9e1ffb640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9d0066840 0x7fe9d0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9e1ffb640 1 -- 172.21.15.53:0/3524431183 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9dc11e8b0 con 0x7fe9ec0cf820 2024-09-13T18:26:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f1164640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9d0066840 0x7fe9d0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.189+0000 7fe9f1164640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9d0066840 0x7fe9d0068d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4007330 tx=0x7fe9e400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.193+0000 7fe9e1ffb640 1 -- 172.21.15.53:0/3524431183 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9dc0eb890 con 0x7fe9ec0cf820 2024-09-13T18:26:59.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.377+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9ec15dd20 con 0x7fe9d0066840 2024-09-13T18:26:59.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9e1ffb640 1 -- 172.21.15.53:0/3524431183 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe9e4009c00 con 0x7fe9d0066840 2024-09-13T18:26:59.384 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:26:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:26:59.384 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:26:59.385 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:26:59.385 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9d0066840 msgr2=0x7fe9d0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9d0066840 0x7fe9d0068d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4007330 tx=0x7fe9e400b040 comp rx=0 tx=0).stop 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec0cf820 msgr2=0x7fe9ec0b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec0cf820 0x7fe9ec0b17b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc01aa80 tx=0x7fe9dc019170 comp rx=0 tx=0).stop 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 shutdown_connections 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe9d0066840 0x7fe9d0068d00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9ec1591c0 0x7fe9ec0afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9ec0cf820 0x7fe9ec0b17b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 --2- 172.21.15.53:0/3524431183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9ec06ddc0 0x7fe9ec0a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 >> 172.21.15.53:0/3524431183 conn(0x7fe9ec073130 msgr2=0x7fe9ec0cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 shutdown_connections 2024-09-13T18:26:59.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.381+0000 7fe9f33c8640 1 -- 172.21.15.53:0/3524431183 wait complete. 2024-09-13T18:26:59.404 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:26:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa048ec2640 1 Processor -- start 2024-09-13T18:26:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa048ec2640 1 -- start start 2024-09-13T18:26:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa048ec2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa0440b2f00 0x7fa04416b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa048ec2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa044160ed0 con 0x7fa04406bdd0 2024-09-13T18:26:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa048ec2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0440b1500 con 0x7fa04406d1c0 2024-09-13T18:26:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa048ec2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0440b23d0 con 0x7fa0440b2f00 2024-09-13T18:26:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa04406bdd0 0x7fa0440cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38324/0 (socket says 172.21.15.53:38324) 2024-09-13T18:26:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04259c640 1 -- 172.21.15.53:0/1186740317 learned_addr learned my addr 172.21.15.53:0/1186740317 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa042d9d640 1 --2- 172.21.15.53:0/1186740317 >> v2:172.21.15.87:3300/0 conn(0x7fa0440b2f00 0x7fa04416b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124314842 0 0) 0x7fa044160ed0 con 0x7fa04406bdd0 2024-09-13T18:26:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa02c003530 con 0x7fa04406bdd0 2024-09-13T18:26:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1295464348 0 0) 0x7fa02c003530 con 0x7fa04406bdd0 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 >> v2:172.21.15.87:3300/0 conn(0x7fa0440b2f00 msgr2=0x7fa04416b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 --2- 172.21.15.53:0/1186740317 >> v2:172.21.15.87:3300/0 conn(0x7fa0440b2f00 0x7fa04416b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 >> v1:172.21.15.87:6789/0 conn(0x7fa04406d1c0 legacy=0x7fa0440b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0440b1750 con 0x7fa04406bdd0 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa034001a00 con 0x7fa04406bdd0 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 >> v1:172.21.15.53:6789/0 conn(0x7fa04406bdd0 legacy=0x7fa0440cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02c003980 0x7fa02c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa02c0047d0 0x7fa02c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c005190 0x7fa02c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440b23d0 con 0x7fa02c0047d0 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c00c030 con 0x7fa02c003980 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c00c1f0 con 0x7fa02c005190 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa041d9b640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa02c0047d0 0x7fa02c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04259c640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02c003980 0x7fa02c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa042d9d640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c005190 0x7fa02c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa041d9b640 1 -- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c005190 msgr2=0x7fa02c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa041d9b640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c005190 0x7fa02c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa041d9b640 1 -- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02c003980 msgr2=0x7fa02c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa041d9b640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02c003980 0x7fa02c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa041d9b640 1 -- 172.21.15.53:0/1186740317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c003530 con 0x7fa02c0047d0 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa042d9d640 1 -- 172.21.15.53:0/1186740317 reap_dead start 2024-09-13T18:26:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.521+0000 7fa04259c640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa02c003980 0x7fa02c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:59.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa041d9b640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa02c0047d0 0x7fa02c004c50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa038001780 tx=0x7fa03801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5adf83eca556ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380052d0 con 0x7fa02c0047d0 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0380a7050 con 0x7fa02c0047d0 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa04159a640 1 -- 172.21.15.53:0/1186740317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038003600 con 0x7fa02c0047d0 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- 172.21.15.53:0/1186740317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa02c0047d0 msgr2=0x7fa02c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa02c0047d0 0x7fa02c004c50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa038001780 tx=0x7fa03801c400 comp rx=0 tx=0).stop 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- 172.21.15.53:0/1186740317 shutdown_connections 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1186740317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa02c0047d0 0x7fa02c004c50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- 172.21.15.53:0/1186740317 >> 172.21.15.53:0/1186740317 conn(0x7fa044065c80 msgr2=0x7fa044066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- 172.21.15.53:0/1186740317 shutdown_connections 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- 172.21.15.53:0/1186740317 wait complete. 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 Processor -- start 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- start start 2024-09-13T18:26:59.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c0047d0 0x7fa0440ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa044161f20 0x7fa0440ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa04415b520 0x7fa04415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04415bec0 con 0x7fa04415b520 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa044162e00 con 0x7fa044161f20 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa048ec2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440ca090 con 0x7fa02c0047d0 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa042d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa04415b520 0x7fa04415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa042d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa04415b520 0x7fa04415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59624/0 (socket says 172.21.15.53:59624) 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.525+0000 7fa042d9d640 1 -- 172.21.15.53:0/1462360622 learned_addr learned my addr 172.21.15.53:0/1462360622 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa041d9b640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa044161f20 0x7fa0440ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa04259c640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c0047d0 0x7fa0440ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa042d9d640 1 -- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c0047d0 msgr2=0x7fa0440ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa042d9d640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c0047d0 0x7fa0440ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa042d9d640 1 -- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa044161f20 msgr2=0x7fa0440ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa042d9d640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa044161f20 0x7fa0440ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa042d9d640 1 -- 172.21.15.53:0/1462360622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044163090 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa04259c640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c0047d0 0x7fa0440ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa042d9d640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa04415b520 0x7fa04415b980 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa044071240 tx=0x7fa03c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa032ffd640 1 -- 172.21.15.53:0/1462360622 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c004500 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa032ffd640 1 -- 172.21.15.53:0/1462360622 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c003620 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa044163370 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa032ffd640 1 -- 172.21.15.53:0/1462360622 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0039d0 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0440a8a70 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa044163890 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa032ffd640 1 -- 172.21.15.53:0/1462360622 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa03c003b30 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa032ffd640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa024066840 0x7fa024068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa032ffd640 1 -- 172.21.15.53:0/1462360622 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa03c084c50 con 0x7fa04415b520 2024-09-13T18:26:59.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa04259c640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa024066840 0x7fa024068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.529+0000 7fa04259c640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa024066840 0x7fa024068d00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa034004c00 tx=0x7fa034004b90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.533+0000 7fa032ffd640 1 -- 172.21.15.53:0/1462360622 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa03c051d20 con 0x7fa04415b520 2024-09-13T18:26:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.693+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa044163890 con 0x7fa04415b520 2024-09-13T18:26:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.693+0000 7fa032ffd640 1 -- 172.21.15.53:0/1462360622 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa044163890 con 0x7fa04415b520 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa024066840 msgr2=0x7fa024068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa024066840 0x7fa024068d00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa034004c00 tx=0x7fa034004b90 comp rx=0 tx=0).stop 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa04415b520 msgr2=0x7fa04415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa04415b520 0x7fa04415b980 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa044071240 tx=0x7fa03c011920 comp rx=0 tx=0).stop 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 shutdown_connections 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa024066840 0x7fa024068d00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa04415b520 0x7fa04415b980 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa044161f20 0x7fa0440ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 --2- 172.21.15.53:0/1462360622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa02c0047d0 0x7fa0440ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 >> 172.21.15.53:0/1462360622 conn(0x7fa044065c80 msgr2=0x7fa0440af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 shutdown_connections 2024-09-13T18:26:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.697+0000 7fa048ec2640 1 -- 172.21.15.53:0/1462360622 wait complete. 2024-09-13T18:26:59.718 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:26:59.718 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:26:59.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:26:59.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf1732d640 1 Processor -- start 2024-09-13T18:26:59.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf1732d640 1 -- start start 2024-09-13T18:26:59.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf1732d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf101582a0 0x7fcf1006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf1732d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf1015b7c0 0x7fcf1006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf1732d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1006d480 con 0x7fcf10070c90 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf1732d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1015aaf0 con 0x7fcf1015b7c0 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf1732d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1006d760 con 0x7fcf101582a0 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf148c8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf1015b7c0 0x7fcf1006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf158ca640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcf10070c90 0x7fcf1006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38330/0 (socket says 172.21.15.53:38330) 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf158ca640 1 -- 172.21.15.53:0/2523441826 learned_addr learned my addr 172.21.15.53:0/2523441826 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf150c9640 1 --2- 172.21.15.53:0/2523441826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf101582a0 0x7fcf1006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf07fff640 1 -- 172.21.15.53:0/2523441826 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899888921 0 0) 0x7fcf1006d480 con 0x7fcf10070c90 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf07fff640 1 -- 172.21.15.53:0/2523441826 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcefc003530 con 0x7fcf10070c90 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf148c8640 1 -- 172.21.15.53:0/2523441826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf101582a0 msgr2=0x7fcf1006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf148c8640 1 --2- 172.21.15.53:0/2523441826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf101582a0 0x7fcf1006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf148c8640 1 -- 172.21.15.53:0/2523441826 >> v1:172.21.15.53:6789/0 conn(0x7fcf10070c90 legacy=0x7fcf1006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf148c8640 1 -- 172.21.15.53:0/2523441826 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1015ace0 con 0x7fcf1015b7c0 2024-09-13T18:26:59.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.897+0000 7fcf150c9640 1 --2- 172.21.15.53:0/2523441826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf101582a0 0x7fcf1006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:26:59.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf148c8640 1 --2- 172.21.15.53:0/2523441826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf1006ce40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0097c0 tx=0x7fcf0c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b18cc6e45c969f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf07fff640 1 -- 172.21.15.53:0/2523441826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0ab600 con 0x7fcf1015b7c0 2024-09-13T18:26:59.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf07fff640 1 -- 172.21.15.53:0/2523441826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c0a7050 con 0x7fcf1015b7c0 2024-09-13T18:26:59.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf07fff640 1 -- 172.21.15.53:0/2523441826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0ab960 con 0x7fcf1015b7c0 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- 172.21.15.53:0/2523441826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 msgr2=0x7fcf1006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 --2- 172.21.15.53:0/2523441826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf1006ce40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0097c0 tx=0x7fcf0c01c470 comp rx=0 tx=0).stop 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- 172.21.15.53:0/2523441826 shutdown_connections 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 --2- 172.21.15.53:0/2523441826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf1006ce40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 --2- 172.21.15.53:0/2523441826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf101582a0 0x7fcf1006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- 172.21.15.53:0/2523441826 >> 172.21.15.53:0/2523441826 conn(0x7fcf10065c80 msgr2=0x7fcf10066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- 172.21.15.53:0/2523441826 shutdown_connections 2024-09-13T18:26:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- 172.21.15.53:0/2523441826 wait complete. 2024-09-13T18:26:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 Processor -- start 2024-09-13T18:26:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- start start 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf10070c90 0x7fcf101496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf101582a0 0x7fcf1013bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf100b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1013c1b0 con 0x7fcf1015b7c0 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100b3550 con 0x7fcf101582a0 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf1732d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10150320 con 0x7fcf10070c90 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf100b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf100b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59650/0 (socket says 172.21.15.53:59650) 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 -- 172.21.15.53:0/3887027224 learned_addr learned my addr 172.21.15.53:0/3887027224 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf148c8640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf101582a0 0x7fcf1013bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 -- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf10070c90 msgr2=0x7fcf101496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf150c9640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf10070c90 0x7fcf101496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf10070c90 0x7fcf101496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 -- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf101582a0 msgr2=0x7fcf1013bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf101582a0 0x7fcf1013bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf158ca640 1 -- 172.21.15.53:0/3887027224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c009420 con 0x7fcf1015b7c0 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.901+0000 7fcf148c8640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf101582a0 0x7fcf1013bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf158ca640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf100b2d00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800cb40 tx=0x7fcf0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf05ffb640 1 -- 172.21.15.53:0/3887027224 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800aca0 con 0x7fcf1015b7c0 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf05ffb640 1 -- 172.21.15.53:0/3887027224 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0800ae00 con 0x7fcf1015b7c0 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10071630 con 0x7fcf1015b7c0 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf05ffb640 1 -- 172.21.15.53:0/3887027224 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08012620 con 0x7fcf1015b7c0 2024-09-13T18:26:59.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf101508e0 con 0x7fcf1015b7c0 2024-09-13T18:26:59.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10067400 con 0x7fcf1015b7c0 2024-09-13T18:26:59.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf05ffb640 1 -- 172.21.15.53:0/3887027224 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fcf08007070 con 0x7fcf1015b7c0 2024-09-13T18:26:59.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf05ffb640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcef4066870 0x7fcef4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf05ffb640 1 -- 172.21.15.53:0/3887027224 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf08084410 con 0x7fcf1015b7c0 2024-09-13T18:26:59.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf150c9640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcef4066870 0x7fcef4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.905+0000 7fcf150c9640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcef4066870 0x7fcef4068d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000d8b0 tx=0x7fcf00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:26:59.909+0000 7fcf05ffb640 1 -- 172.21.15.53:0/3887027224 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf08051590 con 0x7fcf1015b7c0 2024-09-13T18:27:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.069+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf10150e00 con 0x7fcf1015b7c0 2024-09-13T18:27:00.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf05ffb640 1 -- 172.21.15.53:0/3887027224 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16453 (secure 0 0 0) 0x7fcf10150e00 con 0x7fcf1015b7c0 2024-09-13T18:27:00.077 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:00.078 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":46,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:43.159322+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcef4066870 msgr2=0x7fcef4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcef4066870 0x7fcef4068d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000d8b0 tx=0x7fcf00008040 comp rx=0 tx=0).stop 2024-09-13T18:27:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 msgr2=0x7fcf100b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf100b2d00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800cb40 tx=0x7fcf0800a060 comp rx=0 tx=0).stop 2024-09-13T18:27:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 shutdown_connections 2024-09-13T18:27:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcef4066870 0x7fcef4068d30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf1015b7c0 0x7fcf100b2d00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf101582a0 0x7fcf1013bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 --2- 172.21.15.53:0/3887027224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf10070c90 0x7fcf101496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 >> 172.21.15.53:0/3887027224 conn(0x7fcf10065c80 msgr2=0x7fcf10066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 shutdown_connections 2024-09-13T18:27:00.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.073+0000 7fcf1732d640 1 -- 172.21.15.53:0/3887027224 wait complete. 2024-09-13T18:27:00.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:40.433725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:26:41.119531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:00.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:00.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31b0a64640 1 Processor -- start 2024-09-13T18:27:00.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31b0a64640 1 -- start start 2024-09-13T18:27:00.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31b0a64640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31ac15fc00 0x7f31ac0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31b0a64640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac160370 0x7f31ac160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31b0a64640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac0cd4f0 con 0x7f31ac0b2d20 2024-09-13T18:27:00.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31b0a64640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac160d40 con 0x7f31ac15fc00 2024-09-13T18:27:00.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31b0a64640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0cd750 con 0x7f31ac160370 2024-09-13T18:27:00.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aa59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31ac15fc00 0x7f31ac0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aa59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31ac15fc00 0x7f31ac0cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59662/0 (socket says 172.21.15.53:59662) 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aa59c640 1 -- 172.21.15.53:0/726483666 learned_addr learned my addr 172.21.15.53:0/726483666 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aad9d640 1 --2- 172.21.15.53:0/726483666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac160370 0x7f31ac160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aa59c640 1 -- 172.21.15.53:0/726483666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac160370 msgr2=0x7f31ac160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aa59c640 1 --2- 172.21.15.53:0/726483666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac160370 0x7f31ac160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aa59c640 1 -- 172.21.15.53:0/726483666 >> v1:172.21.15.87:6789/0 conn(0x7f31ac0b2d20 legacy=0x7f31ac0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.217+0000 7f31aa59c640 1 -- 172.21.15.53:0/726483666 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0cda30 con 0x7f31ac15fc00 2024-09-13T18:27:00.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31aa59c640 1 --2- 172.21.15.53:0/726483666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac15fc00 0x7f31ac0cabb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f319c009870 tx=0x7f319c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96ea65cd920cb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a959a640 1 -- 172.21.15.53:0/726483666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c0a95f0 con 0x7f31ac15fc00 2024-09-13T18:27:00.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a959a640 1 -- 172.21.15.53:0/726483666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c0a9750 con 0x7f31ac15fc00 2024-09-13T18:27:00.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a959a640 1 -- 172.21.15.53:0/726483666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c0a9ae0 con 0x7f31ac15fc00 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- 172.21.15.53:0/726483666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac15fc00 msgr2=0x7f31ac0cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 --2- 172.21.15.53:0/726483666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac15fc00 0x7f31ac0cabb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f319c009870 tx=0x7f319c01c530 comp rx=0 tx=0).stop 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- 172.21.15.53:0/726483666 shutdown_connections 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 --2- 172.21.15.53:0/726483666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac160370 0x7f31ac160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 --2- 172.21.15.53:0/726483666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac15fc00 0x7f31ac0cabb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- 172.21.15.53:0/726483666 >> 172.21.15.53:0/726483666 conn(0x7f31ac0b2170 msgr2=0x7f31ac0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- 172.21.15.53:0/726483666 shutdown_connections 2024-09-13T18:27:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- 172.21.15.53:0/726483666 wait complete. 2024-09-13T18:27:00.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 Processor -- start 2024-09-13T18:27:00.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- start start 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac0b2d20 0x7f31ac159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac160370 0x7f31ac06da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ac1566e0 0x7f31ac156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac159620 con 0x7f31ac160370 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac159900 con 0x7f31ac1566e0 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31b0a64640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac14fc80 con 0x7f31ac0b2d20 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac160370 0x7f31ac06da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac160370 0x7f31ac06da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59666/0 (socket says 172.21.15.53:59666) 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 -- 172.21.15.53:0/4163722539 learned_addr learned my addr 172.21.15.53:0/4163722539 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31aa59c640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac0b2d20 0x7f31ac159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31aad9d640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ac1566e0 0x7f31ac156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 -- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac0b2d20 msgr2=0x7f31ac159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac0b2d20 0x7f31ac159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 -- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ac1566e0 msgr2=0x7f31ac156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ac1566e0 0x7f31ac156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31a9d9b640 1 -- 172.21.15.53:0/4163722539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0094d0 con 0x7f31ac160370 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.221+0000 7f31aad9d640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ac1566e0 0x7f31ac156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f31a9d9b640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac160370 0x7f31ac06da80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c4d0 tx=0x7f31a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f319affd640 1 -- 172.21.15.53:0/4163722539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00052d0 con 0x7f31ac160370 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f319affd640 1 -- 172.21.15.53:0/4163722539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a0005430 con 0x7f31ac160370 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac14ff60 con 0x7f31ac160370 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f319affd640 1 -- 172.21.15.53:0/4163722539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0012830 con 0x7f31ac160370 2024-09-13T18:27:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac14f490 con 0x7f31ac160370 2024-09-13T18:27:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac0cfb50 con 0x7f31ac160370 2024-09-13T18:27:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f319affd640 1 -- 172.21.15.53:0/4163722539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f31a0012990 con 0x7f31ac160370 2024-09-13T18:27:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f319affd640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f318c066870 0x7f318c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f319affd640 1 -- 172.21.15.53:0/4163722539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31a0083ee0 con 0x7f31ac160370 2024-09-13T18:27:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f31aa59c640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f318c066870 0x7f318c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.225+0000 7f31aa59c640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f318c066870 0x7f318c068d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f319c0ae000 tx=0x7f319c0b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.229+0000 7f319affd640 1 -- 172.21.15.53:0/4163722539 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f31a0051060 con 0x7f31ac160370 2024-09-13T18:27:00.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.389+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31ac150410 con 0x7f31ac160370 2024-09-13T18:27:00.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f319affd640 1 -- 172.21.15.53:0/4163722539 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31a0054680 con 0x7f31ac160370 2024-09-13T18:27:00.396 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f318c066870 msgr2=0x7f318c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f318c066870 0x7f318c068d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f319c0ae000 tx=0x7f319c0b3040 comp rx=0 tx=0).stop 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac160370 msgr2=0x7f31ac06da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac160370 0x7f31ac06da80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c4d0 tx=0x7f31a000c990 comp rx=0 tx=0).stop 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 shutdown_connections 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f318c066870 0x7f318c068d30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ac1566e0 0x7f31ac156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ac160370 0x7f31ac06da80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 --2- 172.21.15.53:0/4163722539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ac0b2d20 0x7f31ac159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 >> 172.21.15.53:0/4163722539 conn(0x7f31ac0b2170 msgr2=0x7f31ac0c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 shutdown_connections 2024-09-13T18:27:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.393+0000 7f31b0a64640 1 -- 172.21.15.53:0/4163722539 wait complete. 2024-09-13T18:27:00.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:00.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa708910640 1 Processor -- start 2024-09-13T18:27:00.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa708910640 1 -- start start 2024-09-13T18:27:00.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa708910640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7040adcd0 0x7fa70406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa708910640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70406ca80 con 0x7fa7041424a0 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa708910640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7040716f0 con 0x7fa70406da30 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa708910640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70406ccf0 con 0x7fa7040adcd0 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa70259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7040adcd0 0x7fa70406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa70259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7040adcd0 0x7fa70406d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59680/0 (socket says 172.21.15.53:59680) 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa70259c640 1 -- 172.21.15.53:0/3712004713 learned_addr learned my addr 172.21.15.53:0/3712004713 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa70259c640 1 -- 172.21.15.53:0/3712004713 >> v1:172.21.15.87:6789/0 conn(0x7fa70406da30 legacy=0x7fa704141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa70259c640 1 -- 172.21.15.53:0/3712004713 >> v1:172.21.15.53:6789/0 conn(0x7fa7041424a0 legacy=0x7fa7040ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.533+0000 7fa70259c640 1 -- 172.21.15.53:0/3712004713 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70406cfd0 con 0x7fa7040adcd0 2024-09-13T18:27:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa70259c640 1 --2- 172.21.15.53:0/3712004713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70406d4f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009870 tx=0x7fa6f401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523b0aa0fb82d07c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa70159a640 1 -- 172.21.15.53:0/3712004713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7040ae2c0 con 0x7fa7040adcd0 2024-09-13T18:27:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa70159a640 1 -- 172.21.15.53:0/3712004713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f40a9400 con 0x7fa7040adcd0 2024-09-13T18:27:00.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa70159a640 1 -- 172.21.15.53:0/3712004713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40a9790 con 0x7fa7040adcd0 2024-09-13T18:27:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- 172.21.15.53:0/3712004713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 msgr2=0x7fa70406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 --2- 172.21.15.53:0/3712004713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70406d4f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009870 tx=0x7fa6f401c520 comp rx=0 tx=0).stop 2024-09-13T18:27:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- 172.21.15.53:0/3712004713 shutdown_connections 2024-09-13T18:27:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 --2- 172.21.15.53:0/3712004713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70406d4f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- 172.21.15.53:0/3712004713 >> 172.21.15.53:0/3712004713 conn(0x7fa704066080 msgr2=0x7fa704066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- 172.21.15.53:0/3712004713 shutdown_connections 2024-09-13T18:27:00.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- 172.21.15.53:0/3712004713 wait complete. 2024-09-13T18:27:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 Processor -- start 2024-09-13T18:27:00.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- start start 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70413a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7041424a0 0x7fa704144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa704145360 0x7fa70413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041457f0 con 0x7fa7040adcd0 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704142e80 con 0x7fa7041424a0 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa708910640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041430d0 con 0x7fa704145360 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa70259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70413a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa70259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70413a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59690/0 (socket says 172.21.15.53:59690) 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.537+0000 7fa70259c640 1 -- 172.21.15.53:0/3170955918 learned_addr learned my addr 172.21.15.53:0/3170955918 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa701d9b640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7041424a0 0x7fa704144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa702d9d640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa704145360 0x7fa70413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa70259c640 1 -- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa704145360 msgr2=0x7fa70413eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa70259c640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa704145360 0x7fa70413eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa70259c640 1 -- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7041424a0 msgr2=0x7fa704144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa70259c640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7041424a0 0x7fa704144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa70259c640 1 -- 172.21.15.53:0/3170955918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40094d0 con 0x7fa7040adcd0 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa701d9b640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7041424a0 0x7fa704144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa70259c640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70413a690 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa6f401a150 tx=0x7fa6f401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa6f2ffd640 1 -- 172.21.15.53:0/3170955918 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40b1800 con 0x7fa7040adcd0 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa6f2ffd640 1 -- 172.21.15.53:0/3170955918 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f40b1980 con 0x7fa7040adcd0 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7041433b0 con 0x7fa7040adcd0 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa6f2ffd640 1 -- 172.21.15.53:0/3170955918 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40b1d30 con 0x7fa7040adcd0 2024-09-13T18:27:00.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa704143970 con 0x7fa7040adcd0 2024-09-13T18:27:00.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70406d4f0 con 0x7fa7040adcd0 2024-09-13T18:27:00.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa6f2ffd640 1 -- 172.21.15.53:0/3170955918 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa6f40bc450 con 0x7fa7040adcd0 2024-09-13T18:27:00.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa6f2ffd640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6e4066840 0x7fa6e4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa6f2ffd640 1 -- 172.21.15.53:0/3170955918 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6f411ef10 con 0x7fa7040adcd0 2024-09-13T18:27:00.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa701d9b640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6e4066840 0x7fa6e4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.541+0000 7fa701d9b640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6e4066840 0x7fa6e4068d00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7040affd0 tx=0x7fa6f8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.545+0000 7fa6f2ffd640 1 -- 172.21.15.53:0/3170955918 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa6f40ebe60 con 0x7fa7040adcd0 2024-09-13T18:27:00.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.701+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa704142ad0 con 0x7fa7040adcd0 2024-09-13T18:27:00.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.701+0000 7fa6f2ffd640 1 -- 172.21.15.53:0/3170955918 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6f40a6030 con 0x7fa7040adcd0 2024-09-13T18:27:00.708 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6e4066840 msgr2=0x7fa6e4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6e4066840 0x7fa6e4068d00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7040affd0 tx=0x7fa6f8009040 comp rx=0 tx=0).stop 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 msgr2=0x7fa70413a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70413a690 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa6f401a150 tx=0x7fa6f401ad60 comp rx=0 tx=0).stop 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 shutdown_connections 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6e4066840 0x7fa6e4068d00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa704145360 0x7fa70413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7041424a0 0x7fa704144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 --2- 172.21.15.53:0/3170955918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040adcd0 0x7fa70413a690 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 >> 172.21.15.53:0/3170955918 conn(0x7fa704066080 msgr2=0x7fa704066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 shutdown_connections 2024-09-13T18:27:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.705+0000 7fa708910640 1 -- 172.21.15.53:0/3170955918 wait complete. 2024-09-13T18:27:00.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:00.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff44da2d640 1 Processor -- start 2024-09-13T18:27:00.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff44da2d640 1 -- start start 2024-09-13T18:27:00.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff44da2d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff4480caee0 0x7ff4480cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff44da2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4480cd320 0x7ff4480cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff44da2d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44806f7a0 con 0x7ff448143e80 2024-09-13T18:27:00.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff44da2d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44806baa0 con 0x7ff4480cd320 2024-09-13T18:27:00.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff44da2d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44806fd60 con 0x7ff4480caee0 2024-09-13T18:27:00.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4480cd320 0x7ff4480cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4480cd320 0x7ff4480cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59696/0 (socket says 172.21.15.53:59696) 2024-09-13T18:27:00.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 -- 172.21.15.53:0/1493900146 learned_addr learned my addr 172.21.15.53:0/1493900146 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:00.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff43e7fc640 1 --2- 172.21.15.53:0/1493900146 >> v2:172.21.15.87:3300/0 conn(0x7ff4480caee0 0x7ff4480cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 -- 172.21.15.53:0/1493900146 >> v2:172.21.15.87:3300/0 conn(0x7ff4480caee0 msgr2=0x7ff4480cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:00.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 --2- 172.21.15.53:0/1493900146 >> v2:172.21.15.87:3300/0 conn(0x7ff4480caee0 0x7ff4480cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 -- 172.21.15.53:0/1493900146 >> v1:172.21.15.87:6789/0 conn(0x7ff448143e80 legacy=0x7ff44806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 -- 172.21.15.53:0/1493900146 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480cb960 con 0x7ff4480cd320 2024-09-13T18:27:00.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.837+0000 7ff4477fe640 1 --2- 172.21.15.53:0/1493900146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480cd320 0x7ff4480cd780 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff440009e50 tx=0x7ff44001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c358b984de97c6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff4467fc640 1 -- 172.21.15.53:0/1493900146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400a57f0 con 0x7ff4480cd320 2024-09-13T18:27:00.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff4467fc640 1 -- 172.21.15.53:0/1493900146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4400a5950 con 0x7ff4480cd320 2024-09-13T18:27:00.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff4467fc640 1 -- 172.21.15.53:0/1493900146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400a5ce0 con 0x7ff4480cd320 2024-09-13T18:27:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- 172.21.15.53:0/1493900146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480cd320 msgr2=0x7ff4480cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1493900146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480cd320 0x7ff4480cd780 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff440009e50 tx=0x7ff44001c930 comp rx=0 tx=0).stop 2024-09-13T18:27:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- 172.21.15.53:0/1493900146 shutdown_connections 2024-09-13T18:27:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1493900146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480cd320 0x7ff4480cd780 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1493900146 >> v2:172.21.15.87:3300/0 conn(0x7ff4480caee0 0x7ff4480cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- 172.21.15.53:0/1493900146 >> 172.21.15.53:0/1493900146 conn(0x7ff448065c80 msgr2=0x7ff448066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:00.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- 172.21.15.53:0/1493900146 shutdown_connections 2024-09-13T18:27:00.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- 172.21.15.53:0/1493900146 wait complete. 2024-09-13T18:27:00.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 Processor -- start 2024-09-13T18:27:00.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- start start 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480caee0 0x7ff44815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4480cd320 0x7ff448140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff448143e80 0x7ff4481572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480ac390 con 0x7ff4480caee0 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44815b9a0 con 0x7ff448143e80 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44815ad80 con 0x7ff4480cd320 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480caee0 0x7ff44815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480caee0 0x7ff44815b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59702/0 (socket says 172.21.15.53:59702) 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 -- 172.21.15.53:0/1838890089 learned_addr learned my addr 172.21.15.53:0/1838890089 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff43e7fc640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4480cd320 0x7ff448140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff4477fe640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff448143e80 0x7ff4481572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 -- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4480cd320 msgr2=0x7ff448140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4480cd320 0x7ff448140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 -- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff448143e80 msgr2=0x7ff4481572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff448143e80 0x7ff4481572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 -- 172.21.15.53:0/1838890089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009b30 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff446ffd640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480caee0 0x7ff44815b460 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c3f0 tx=0x7ff43800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff444ff9640 1 -- 172.21.15.53:0/1838890089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380052d0 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff444ff9640 1 -- 172.21.15.53:0/1838890089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438005430 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4480acb80 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff444ff9640 1 -- 172.21.15.53:0/1838890089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438003840 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.841+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff448140d80 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.845+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff448140840 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.845+0000 7ff444ff9640 1 -- 172.21.15.53:0/1838890089 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7ff4380039a0 con 0x7ff4480caee0 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.845+0000 7ff444ff9640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff428066840 0x7ff428068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:00.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.845+0000 7ff444ff9640 1 -- 172.21.15.53:0/1838890089 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff438083820 con 0x7ff4480caee0 2024-09-13T18:27:00.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.845+0000 7ff43e7fc640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff428066840 0x7ff428068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:00.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.845+0000 7ff43e7fc640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff428066840 0x7ff428068d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff4480ca6e0 tx=0x7ff430008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:00.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:00.849+0000 7ff444ff9640 1 -- 172.21.15.53:0/1838890089 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff438050b00 con 0x7ff4480caee0 2024-09-13T18:27:01.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4480cb350 con 0x7ff4480caee0 2024-09-13T18:27:01.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff444ff9640 1 -- 172.21.15.53:0/1838890089 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4380170a0 con 0x7ff4480caee0 2024-09-13T18:27:01.010 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:27:01.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff428066840 msgr2=0x7ff428068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff428066840 0x7ff428068d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff4480ca6e0 tx=0x7ff430008040 comp rx=0 tx=0).stop 2024-09-13T18:27:01.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480caee0 msgr2=0x7ff44815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480caee0 0x7ff44815b460 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c3f0 tx=0x7ff43800c8b0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 shutdown_connections 2024-09-13T18:27:01.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff428066840 0x7ff428068d00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff4480cd320 0x7ff448140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff448143e80 0x7ff4481572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 --2- 172.21.15.53:0/1838890089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4480caee0 0x7ff44815b460 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 >> 172.21.15.53:0/1838890089 conn(0x7ff448065c80 msgr2=0x7ff448155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 shutdown_connections 2024-09-13T18:27:01.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.005+0000 7ff44da2d640 1 -- 172.21.15.53:0/1838890089 wait complete. 2024-09-13T18:27:01.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:01.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 Processor -- start 2024-09-13T18:27:01.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 -- start start 2024-09-13T18:27:01.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe33415dc20 0x7fe3340cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe334069f50 0x7fe33406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3340cb710 0x7fe3340cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33406a8d0 con 0x7fe33415dc20 2024-09-13T18:27:01.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3340ae7b0 con 0x7fe334069f50 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe33b25c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33415e000 con 0x7fe3340cb710 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe33415dc20 0x7fe3340cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe33415dc20 0x7fe3340cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59710/0 (socket says 172.21.15.53:59710) 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 -- 172.21.15.53:0/369123246 learned_addr learned my addr 172.21.15.53:0/369123246 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe3397f9640 1 --2- 172.21.15.53:0/369123246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3340cb710 0x7fe3340cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe333fff640 1 --2- 172.21.15.53:0/369123246 >> v2:172.21.15.87:3300/0 conn(0x7fe334069f50 0x7fe33406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 -- 172.21.15.53:0/369123246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3340cb710 msgr2=0x7fe3340cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 --2- 172.21.15.53:0/369123246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3340cb710 0x7fe3340cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 -- 172.21.15.53:0/369123246 >> v2:172.21.15.87:3300/0 conn(0x7fe334069f50 msgr2=0x7fe33406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 --2- 172.21.15.53:0/369123246 >> v2:172.21.15.87:3300/0 conn(0x7fe334069f50 0x7fe33406a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe338ff8640 1 -- 172.21.15.53:0/369123246 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340b3140 con 0x7fe33415dc20 2024-09-13T18:27:01.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.149+0000 7fe333fff640 1 --2- 172.21.15.53:0/369123246 >> v2:172.21.15.87:3300/0 conn(0x7fe334069f50 0x7fe33406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:01.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe338ff8640 1 --2- 172.21.15.53:0/369123246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe33415dc20 0x7fe3340cd590 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe3340b1a20 tx=0x7fe32c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5600691f1277aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe3337fe640 1 -- 172.21.15.53:0/369123246 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0a5840 con 0x7fe33415dc20 2024-09-13T18:27:01.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe3337fe640 1 -- 172.21.15.53:0/369123246 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c0a59a0 con 0x7fe33415dc20 2024-09-13T18:27:01.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe3337fe640 1 -- 172.21.15.53:0/369123246 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0a5d30 con 0x7fe33415dc20 2024-09-13T18:27:01.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 -- 172.21.15.53:0/369123246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe33415dc20 msgr2=0x7fe3340cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 --2- 172.21.15.53:0/369123246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe33415dc20 0x7fe3340cd590 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe3340b1a20 tx=0x7fe32c01c9c0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 -- 172.21.15.53:0/369123246 shutdown_connections 2024-09-13T18:27:01.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 --2- 172.21.15.53:0/369123246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3340cb710 0x7fe3340cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 --2- 172.21.15.53:0/369123246 >> v2:172.21.15.87:3300/0 conn(0x7fe334069f50 0x7fe33406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 --2- 172.21.15.53:0/369123246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe33415dc20 0x7fe3340cd590 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 -- 172.21.15.53:0/369123246 >> 172.21.15.53:0/369123246 conn(0x7fe3340b0a30 msgr2=0x7fe3340b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 -- 172.21.15.53:0/369123246 shutdown_connections 2024-09-13T18:27:01.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 -- 172.21.15.53:0/369123246 wait complete. 2024-09-13T18:27:01.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 Processor -- start 2024-09-13T18:27:01.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.153+0000 7fe33b25c640 1 -- start start 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe334069f50 0x7fe33414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3340cb710 0x7fe3340acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe33415dc20 0x7fe334153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33414d1c0 con 0x7fe3340cb710 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33414d460 con 0x7fe334069f50 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33414d740 con 0x7fe33415dc20 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3340cb710 0x7fe3340acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3340cb710 0x7fe3340acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59722/0 (socket says 172.21.15.53:59722) 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 -- 172.21.15.53:0/1958178596 learned_addr learned my addr 172.21.15.53:0/1958178596 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe3397f9640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe33415dc20 0x7fe334153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe338ff8640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe334069f50 0x7fe33414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 -- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe33415dc20 msgr2=0x7fe334153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe33415dc20 0x7fe334153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 -- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe334069f50 msgr2=0x7fe33414c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe334069f50 0x7fe33414c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 -- 172.21.15.53:0/1958178596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c009b30 con 0x7fe3340cb710 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe333fff640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3340cb710 0x7fe3340acf10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c7c0 tx=0x7fe32800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe3317fa640 1 -- 172.21.15.53:0/1958178596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328005ba0 con 0x7fe3340cb710 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe3317fa640 1 -- 172.21.15.53:0/1958178596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe328005d00 con 0x7fe3340cb710 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33414da20 con 0x7fe3340cb710 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe3317fa640 1 -- 172.21.15.53:0/1958178596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328006250 con 0x7fe3340cb710 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33414e220 con 0x7fe3340cb710 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33406a390 con 0x7fe3340cb710 2024-09-13T18:27:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe3317fa640 1 -- 172.21.15.53:0/1958178596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe3280063b0 con 0x7fe3340cb710 2024-09-13T18:27:01.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe3317fa640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe320066840 0x7fe320068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.157+0000 7fe3317fa640 1 -- 172.21.15.53:0/1958178596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe328084430 con 0x7fe3340cb710 2024-09-13T18:27:01.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.161+0000 7fe338ff8640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe320066840 0x7fe320068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.161+0000 7fe338ff8640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe320066840 0x7fe320068d00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0ae000 tx=0x7fe32c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.165+0000 7fe3317fa640 1 -- 172.21.15.53:0/1958178596 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe328051420 con 0x7fe3340cb710 2024-09-13T18:27:01.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.329+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe33414ded0 con 0x7fe3340cb710 2024-09-13T18:27:01.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.329+0000 7fe3317fa640 1 -- 172.21.15.53:0/1958178596 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe328054a40 con 0x7fe3340cb710 2024-09-13T18:27:01.335 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe320066840 msgr2=0x7fe320068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe320066840 0x7fe320068d00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0ae000 tx=0x7fe32c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3340cb710 msgr2=0x7fe3340acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3340cb710 0x7fe3340acf10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c7c0 tx=0x7fe32800cc80 comp rx=0 tx=0).stop 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 shutdown_connections 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe320066840 0x7fe320068d00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe33415dc20 0x7fe334153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3340cb710 0x7fe3340acf10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 --2- 172.21.15.53:0/1958178596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe334069f50 0x7fe33414c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 >> 172.21.15.53:0/1958178596 conn(0x7fe3340b0a30 msgr2=0x7fe3340caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 shutdown_connections 2024-09-13T18:27:01.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.333+0000 7fe33b25c640 1 -- 172.21.15.53:0/1958178596 wait complete. 2024-09-13T18:27:01.353 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:27:01.353 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:01.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.521+0000 7f92d7160640 1 Processor -- start 2024-09-13T18:27:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.521+0000 7f92d7160640 1 -- start start 2024-09-13T18:27:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d7160640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d01582a0 0x7f92d006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d7160640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92d015b7c0 0x7f92d006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d7160640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f92d0070c90 0x7f92d0071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d7160640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d015aaf0 con 0x7f92d015b7c0 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d7160640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d006d760 con 0x7f92d0070c90 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d7160640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0071640 con 0x7f92d01582a0 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92d015b7c0 0x7f92d006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92d015b7c0 0x7f92d006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59738/0 (socket says 172.21.15.53:59738) 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 -- 172.21.15.53:0/3208036211 learned_addr learned my addr 172.21.15.53:0/3208036211 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d4efc640 1 --2- 172.21.15.53:0/3208036211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d01582a0 0x7f92d006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 -- 172.21.15.53:0/3208036211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d01582a0 msgr2=0x7f92d006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92d56fd640 1 --2- 172.21.15.53:0/3208036211 >> v2:172.21.15.87:3300/0 conn(0x7f92d0070c90 0x7f92d0071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 --2- 172.21.15.53:0/3208036211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d01582a0 0x7f92d006c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 -- 172.21.15.53:0/3208036211 >> v2:172.21.15.87:3300/0 conn(0x7f92d0070c90 msgr2=0x7f92d0071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 --2- 172.21.15.53:0/3208036211 >> v2:172.21.15.87:3300/0 conn(0x7f92d0070c90 0x7f92d0071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 -- 172.21.15.53:0/3208036211 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d006d480 con 0x7f92d015b7c0 2024-09-13T18:27:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cffff640 1 --2- 172.21.15.53:0/3208036211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d015b7c0 0x7f92d006ce40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f92d0066c30 tx=0x7f92c401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f02d7bcab60d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cf7fe640 1 -- 172.21.15.53:0/3208036211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40aa610 con 0x7f92d015b7c0 2024-09-13T18:27:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cf7fe640 1 -- 172.21.15.53:0/3208036211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c40a6040 con 0x7f92d015b7c0 2024-09-13T18:27:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.525+0000 7f92cf7fe640 1 -- 172.21.15.53:0/3208036211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40aa990 con 0x7f92d015b7c0 2024-09-13T18:27:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- 172.21.15.53:0/3208036211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d015b7c0 msgr2=0x7f92d006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 --2- 172.21.15.53:0/3208036211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d015b7c0 0x7f92d006ce40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f92d0066c30 tx=0x7f92c401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- 172.21.15.53:0/3208036211 shutdown_connections 2024-09-13T18:27:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 --2- 172.21.15.53:0/3208036211 >> v2:172.21.15.87:3300/0 conn(0x7f92d0070c90 0x7f92d0071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 --2- 172.21.15.53:0/3208036211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d015b7c0 0x7f92d006ce40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 --2- 172.21.15.53:0/3208036211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d01582a0 0x7f92d006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- 172.21.15.53:0/3208036211 >> 172.21.15.53:0/3208036211 conn(0x7f92d0065c80 msgr2=0x7f92d0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- 172.21.15.53:0/3208036211 shutdown_connections 2024-09-13T18:27:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- 172.21.15.53:0/3208036211 wait complete. 2024-09-13T18:27:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 Processor -- start 2024-09-13T18:27:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- start start 2024-09-13T18:27:01.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0070c90 0x7f92d014e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d01582a0 0x7f92d013f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d015b7c0 0x7f92d013fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d014c570 con 0x7f92d01582a0 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d014d580 con 0x7f92d0070c90 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d7160640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d014c7c0 con 0x7f92d015b7c0 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d01582a0 0x7f92d013f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d01582a0 0x7f92d013f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59746/0 (socket says 172.21.15.53:59746) 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 -- 172.21.15.53:0/3300148387 learned_addr learned my addr 172.21.15.53:0/3300148387 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d56fd640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d015b7c0 0x7f92d013fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d4efc640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0070c90 0x7f92d014e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 -- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d015b7c0 msgr2=0x7f92d013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d015b7c0 0x7f92d013fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 -- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0070c90 msgr2=0x7f92d014e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0070c90 0x7f92d014e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 -- 172.21.15.53:0/3300148387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40094d0 con 0x7f92d01582a0 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92d4efc640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0070c90 0x7f92d014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.529+0000 7f92cffff640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d01582a0 0x7f92d013f740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f92c40ac040 tx=0x7f92c401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92cd7fa640 1 -- 172.21.15.53:0/3300148387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40b3800 con 0x7f92d01582a0 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92cd7fa640 1 -- 172.21.15.53:0/3300148387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c40b3980 con 0x7f92d01582a0 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d014caa0 con 0x7f92d01582a0 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92cd7fa640 1 -- 172.21.15.53:0/3300148387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40b3d30 con 0x7f92d01582a0 2024-09-13T18:27:01.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d014d060 con 0x7f92d01582a0 2024-09-13T18:27:01.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d0067400 con 0x7f92d01582a0 2024-09-13T18:27:01.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92cd7fa640 1 -- 172.21.15.53:0/3300148387 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f92c40bd3f0 con 0x7f92d01582a0 2024-09-13T18:27:01.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92cd7fa640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f92bc066840 0x7f92bc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92cd7fa640 1 -- 172.21.15.53:0/3300148387 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92c411eed0 con 0x7f92d01582a0 2024-09-13T18:27:01.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92d4efc640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f92bc066840 0x7f92bc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.533+0000 7f92d4efc640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f92bc066840 0x7f92bc068d00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f92c0006fd0 tx=0x7f92c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.537+0000 7f92cd7fa640 1 -- 172.21.15.53:0/3300148387 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92c40ebeb0 con 0x7f92d01582a0 2024-09-13T18:27:01.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.693+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92d00700e0 con 0x7f92d01582a0 2024-09-13T18:27:01.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.693+0000 7f92cd7fa640 1 -- 172.21.15.53:0/3300148387 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16453 (secure 0 0 0) 0x7f92c40ef4d0 con 0x7f92d01582a0 2024-09-13T18:27:01.699 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:01.700 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":46,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:43.159322+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:01.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f92bc066840 msgr2=0x7f92bc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f92bc066840 0x7f92bc068d00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f92c0006fd0 tx=0x7f92c0008040 comp rx=0 tx=0).stop 2024-09-13T18:27:01.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d01582a0 msgr2=0x7f92d013f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d01582a0 0x7f92d013f740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f92c40ac040 tx=0x7f92c401ad30 comp rx=0 tx=0).stop 2024-09-13T18:27:01.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 shutdown_connections 2024-09-13T18:27:01.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f92bc066840 0x7f92bc068d00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92d015b7c0 0x7f92d013fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d01582a0 0x7f92d013f740 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 --2- 172.21.15.53:0/3300148387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92d0070c90 0x7f92d014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 >> 172.21.15.53:0/3300148387 conn(0x7f92d0065c80 msgr2=0x7f92d00ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 shutdown_connections 2024-09-13T18:27:01.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.697+0000 7f92d7160640 1 -- 172.21.15.53:0/3300148387 wait complete. 2024-09-13T18:27:01.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:40.433725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:26:41.119531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:01.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:01.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 Processor -- start 2024-09-13T18:27:01.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 -- start start 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd72c15c830 0x7fd72c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd72c0ccd10 0x7fd72c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0d2c80 0x7fd72c0d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c0d3650 con 0x7fd72c15c830 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c0b7db0 con 0x7fd72c0ccd10 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd730c57640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0d0650 con 0x7fd72c0d2c80 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd72c15c830 0x7fd72c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd72c15c830 0x7fd72c0d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59750/0 (socket says 172.21.15.53:59750) 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 -- 172.21.15.53:0/2692595566 learned_addr learned my addr 172.21.15.53:0/2692595566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd729d9b640 1 --2- 172.21.15.53:0/2692595566 >> v2:172.21.15.87:3300/0 conn(0x7fd72c0ccd10 0x7fd72c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72ad9d640 1 --2- 172.21.15.53:0/2692595566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0d2c80 0x7fd72c0d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 -- 172.21.15.53:0/2692595566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0d2c80 msgr2=0x7fd72c0d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 --2- 172.21.15.53:0/2692595566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0d2c80 0x7fd72c0d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 -- 172.21.15.53:0/2692595566 >> v2:172.21.15.87:3300/0 conn(0x7fd72c0ccd10 msgr2=0x7fd72c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 --2- 172.21.15.53:0/2692595566 >> v2:172.21.15.87:3300/0 conn(0x7fd72c0ccd10 0x7fd72c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd72a59c640 1 -- 172.21.15.53:0/2692595566 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0d0c10 con 0x7fd72c15c830 2024-09-13T18:27:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.845+0000 7fd729d9b640 1 --2- 172.21.15.53:0/2692595566 >> v2:172.21.15.87:3300/0 conn(0x7fd72c0ccd10 0x7fd72c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:01.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd72a59c640 1 --2- 172.21.15.53:0/2692595566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c15c830 0x7fd72c0d10a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0b43f0 tx=0x7fd71c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d867d04dae6e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd72959a640 1 -- 172.21.15.53:0/2692595566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0a89d0 con 0x7fd72c15c830 2024-09-13T18:27:01.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd72959a640 1 -- 172.21.15.53:0/2692595566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0a8b30 con 0x7fd72c15c830 2024-09-13T18:27:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd72959a640 1 -- 172.21.15.53:0/2692595566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0b0440 con 0x7fd72c15c830 2024-09-13T18:27:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- 172.21.15.53:0/2692595566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c15c830 msgr2=0x7fd72c0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 --2- 172.21.15.53:0/2692595566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c15c830 0x7fd72c0d10a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0b43f0 tx=0x7fd71c01ed10 comp rx=0 tx=0).stop 2024-09-13T18:27:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- 172.21.15.53:0/2692595566 shutdown_connections 2024-09-13T18:27:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 --2- 172.21.15.53:0/2692595566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0d2c80 0x7fd72c0d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 --2- 172.21.15.53:0/2692595566 >> v2:172.21.15.87:3300/0 conn(0x7fd72c0ccd10 0x7fd72c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 --2- 172.21.15.53:0/2692595566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c15c830 0x7fd72c0d10a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- 172.21.15.53:0/2692595566 >> 172.21.15.53:0/2692595566 conn(0x7fd72c070970 msgr2=0x7fd72c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- 172.21.15.53:0/2692595566 shutdown_connections 2024-09-13T18:27:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- 172.21.15.53:0/2692595566 wait complete. 2024-09-13T18:27:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 Processor -- start 2024-09-13T18:27:01.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- start start 2024-09-13T18:27:01.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0ccd10 0x7fd72c1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c0d2c80 0x7fd72c158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72c15c830 0x7fd72c15ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c1f2ce0 con 0x7fd72c0d2c80 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0ca110 con 0x7fd72c15c830 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd730c57640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0ca3b0 con 0x7fd72c0ccd10 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c0d2c80 0x7fd72c158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c0d2c80 0x7fd72c158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59766/0 (socket says 172.21.15.53:59766) 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 -- 172.21.15.53:0/1518990003 learned_addr learned my addr 172.21.15.53:0/1518990003 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd72ad9d640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72c15c830 0x7fd72c15ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd72a59c640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0ccd10 0x7fd72c1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 -- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0ccd10 msgr2=0x7fd72c1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0ccd10 0x7fd72c1f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 -- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72c15c830 msgr2=0x7fd72c15ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72c15c830 0x7fd72c15ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 -- 172.21.15.53:0/1518990003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0094d0 con 0x7fd72c0d2c80 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd729d9b640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c0d2c80 0x7fd72c158cb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c7c0 tx=0x7fd72000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.849+0000 7fd71affd640 1 -- 172.21.15.53:0/1518990003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720007a30 con 0x7fd72c0d2c80 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd71affd640 1 -- 172.21.15.53:0/1518990003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720007b90 con 0x7fd72c0d2c80 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c0c98c0 con 0x7fd72c0d2c80 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd71affd640 1 -- 172.21.15.53:0/1518990003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000ce70 con 0x7fd72c0d2c80 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c0ca690 con 0x7fd72c0d2c80 2024-09-13T18:27:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c0cd180 con 0x7fd72c0d2c80 2024-09-13T18:27:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd71affd640 1 -- 172.21.15.53:0/1518990003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd7200113f0 con 0x7fd72c0d2c80 2024-09-13T18:27:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd71affd640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd70c066840 0x7fd70c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd71affd640 1 -- 172.21.15.53:0/1518990003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd720084b10 con 0x7fd72c0d2c80 2024-09-13T18:27:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.853+0000 7fd72a59c640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd70c066840 0x7fd70c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.857+0000 7fd72a59c640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd70c066840 0x7fd70c068d00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0b2000 tx=0x7fd71c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:01.857+0000 7fd71affd640 1 -- 172.21.15.53:0/1518990003 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd720051c60 con 0x7fd72c0d2c80 2024-09-13T18:27:02.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.017+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd72c0b2d60 con 0x7fd72c0d2c80 2024-09-13T18:27:02.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.017+0000 7fd71affd640 1 -- 172.21.15.53:0/1518990003 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd720055280 con 0x7fd72c0d2c80 2024-09-13T18:27:02.024 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:27:02.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd70c066840 msgr2=0x7fd70c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd70c066840 0x7fd70c068d00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0b2000 tx=0x7fd71c008040 comp rx=0 tx=0).stop 2024-09-13T18:27:02.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c0d2c80 msgr2=0x7fd72c158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c0d2c80 0x7fd72c158cb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c7c0 tx=0x7fd72000cc80 comp rx=0 tx=0).stop 2024-09-13T18:27:02.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 shutdown_connections 2024-09-13T18:27:02.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd70c066840 0x7fd70c068d00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72c15c830 0x7fd72c15ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72c0d2c80 0x7fd72c158cb0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 --2- 172.21.15.53:0/1518990003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd72c0ccd10 0x7fd72c1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 >> 172.21.15.53:0/1518990003 conn(0x7fd72c070970 msgr2=0x7fd72c0b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 shutdown_connections 2024-09-13T18:27:02.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.021+0000 7fd730c57640 1 -- 172.21.15.53:0/1518990003 wait complete. 2024-09-13T18:27:02.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659ef08640 1 Processor -- start 2024-09-13T18:27:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659ef08640 1 -- start start 2024-09-13T18:27:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659ef08640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f659815c890 0x7f659815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659ef08640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980b4160 0x7f65980b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659ef08640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65980b45a0 con 0x7f659806aa90 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659ef08640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65980cd960 con 0x7f659815c890 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659ef08640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65980b59d0 con 0x7f65980b4160 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659cca4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f659815c890 0x7f659815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659cca4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f659815c890 0x7f659815cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59780/0 (socket says 172.21.15.53:59780) 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659cca4640 1 -- 172.21.15.53:0/2216360886 learned_addr learned my addr 172.21.15.53:0/2216360886 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f6597fff640 1 --2- 172.21.15.53:0/2216360886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980b4160 0x7f65980b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659cca4640 1 -- 172.21.15.53:0/2216360886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980b4160 msgr2=0x7f65980b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659cca4640 1 --2- 172.21.15.53:0/2216360886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980b4160 0x7f65980b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659cca4640 1 -- 172.21.15.53:0/2216360886 >> v1:172.21.15.87:6789/0 conn(0x7f659806aa90 legacy=0x7f65980d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.161+0000 7f659cca4640 1 -- 172.21.15.53:0/2216360886 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65980cd030 con 0x7f659815c890 2024-09-13T18:27:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659cca4640 1 --2- 172.21.15.53:0/2216360886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659815c890 0x7f659815cc70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f658c0098a0 tx=0x7f658c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6635a1fafd673cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f65977fe640 1 -- 172.21.15.53:0/2216360886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0aa670 con 0x7f659815c890 2024-09-13T18:27:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f65977fe640 1 -- 172.21.15.53:0/2216360886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0aa7d0 con 0x7f659815c890 2024-09-13T18:27:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f65977fe640 1 -- 172.21.15.53:0/2216360886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0aab60 con 0x7f659815c890 2024-09-13T18:27:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 -- 172.21.15.53:0/2216360886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659815c890 msgr2=0x7f659815cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 --2- 172.21.15.53:0/2216360886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659815c890 0x7f659815cc70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f658c0098a0 tx=0x7f658c01c510 comp rx=0 tx=0).stop 2024-09-13T18:27:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 -- 172.21.15.53:0/2216360886 shutdown_connections 2024-09-13T18:27:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 --2- 172.21.15.53:0/2216360886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65980b4160 0x7f65980b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 --2- 172.21.15.53:0/2216360886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659815c890 0x7f659815cc70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 -- 172.21.15.53:0/2216360886 >> 172.21.15.53:0/2216360886 conn(0x7f6598071a70 msgr2=0x7f6598099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 -- 172.21.15.53:0/2216360886 shutdown_connections 2024-09-13T18:27:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 -- 172.21.15.53:0/2216360886 wait complete. 2024-09-13T18:27:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 Processor -- start 2024-09-13T18:27:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.165+0000 7f659ef08640 1 -- start start 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659806aa90 0x7f6598153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980b4160 0x7f659815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f659815c890 0x7f659815f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659815fc60 con 0x7f659806aa90 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659815dbf0 con 0x7f65980b4160 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6598154c70 con 0x7f659815c890 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659806aa90 0x7f6598153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659806aa90 0x7f6598153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59788/0 (socket says 172.21.15.53:59788) 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 -- 172.21.15.53:0/1788569074 learned_addr learned my addr 172.21.15.53:0/1788569074 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659d4a5640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f659815c890 0x7f659815f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f6597fff640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980b4160 0x7f659815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 -- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f659815c890 msgr2=0x7f659815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f659815c890 0x7f659815f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 -- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980b4160 msgr2=0x7f659815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980b4160 0x7f659815f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 -- 172.21.15.53:0/1788569074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0094d0 con 0x7f659806aa90 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659cca4640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659806aa90 0x7f6598153ac0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f658c01cdb0 tx=0x7f658c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f65957fa640 1 -- 172.21.15.53:0/1788569074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b3800 con 0x7f659806aa90 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f65957fa640 1 -- 172.21.15.53:0/1788569074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0b3960 con 0x7f659806aa90 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6598154f50 con 0x7f659806aa90 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f65957fa640 1 -- 172.21.15.53:0/1788569074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b3d10 con 0x7f659806aa90 2024-09-13T18:27:02.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6598155510 con 0x7f659806aa90 2024-09-13T18:27:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6598067400 con 0x7f659806aa90 2024-09-13T18:27:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f65957fa640 1 -- 172.21.15.53:0/1788569074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f658c0bc3e0 con 0x7f659806aa90 2024-09-13T18:27:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f65957fa640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6584066840 0x7f6584068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f65957fa640 1 -- 172.21.15.53:0/1788569074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f658c11eaa0 con 0x7f659806aa90 2024-09-13T18:27:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.169+0000 7f6597fff640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6584066840 0x7f6584068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.173+0000 7f6597fff640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6584066840 0x7f6584068d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f65980c99a0 tx=0x7f6588008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.173+0000 7f65957fa640 1 -- 172.21.15.53:0/1788569074 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f658c0ebbe0 con 0x7f659806aa90 2024-09-13T18:27:02.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.333+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6598154db0 con 0x7f659806aa90 2024-09-13T18:27:02.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f65957fa640 1 -- 172.21.15.53:0/1788569074 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6598154db0 con 0x7f659806aa90 2024-09-13T18:27:02.340 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:27:02.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6584066840 msgr2=0x7f6584068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6584066840 0x7f6584068d00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f65980c99a0 tx=0x7f6588008040 comp rx=0 tx=0).stop 2024-09-13T18:27:02.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659806aa90 msgr2=0x7f6598153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659806aa90 0x7f6598153ac0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f658c01cdb0 tx=0x7f658c01ad50 comp rx=0 tx=0).stop 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 shutdown_connections 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6584066840 0x7f6584068d00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f659815c890 0x7f659815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65980b4160 0x7f659815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 --2- 172.21.15.53:0/1788569074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f659806aa90 0x7f6598153ac0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 >> 172.21.15.53:0/1788569074 conn(0x7f6598071a70 msgr2=0x7f6598099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 shutdown_connections 2024-09-13T18:27:02.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.337+0000 7f659ef08640 1 -- 172.21.15.53:0/1788569074 wait complete. 2024-09-13T18:27:02.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:02.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975ee50640 1 Processor -- start 2024-09-13T18:27:02.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975ee50640 1 -- start start 2024-09-13T18:27:02.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975ee50640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9758143e80 0x7f975806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975ee50640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580cda30 0x7f97580cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975ee50640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975806f7a0 con 0x7f97580caee0 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975ee50640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975806fd60 con 0x7f9758143e80 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975ee50640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97580cb960 con 0x7f97580cda30 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975cbec640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9758143e80 0x7f975806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f9757fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f97580caee0 0x7f97580cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38360/0 (socket says 172.21.15.53:38360) 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f9757fff640 1 -- 172.21.15.53:0/2412152963 learned_addr learned my addr 172.21.15.53:0/2412152963 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975d3ed640 1 --2- 172.21.15.53:0/2412152963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580cda30 0x7f97580cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975cbec640 1 -- 172.21.15.53:0/2412152963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580cda30 msgr2=0x7f97580cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975cbec640 1 --2- 172.21.15.53:0/2412152963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580cda30 0x7f97580cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975cbec640 1 -- 172.21.15.53:0/2412152963 >> v1:172.21.15.53:6789/0 conn(0x7f97580caee0 legacy=0x7f97580cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f975cbec640 1 -- 172.21.15.53:0/2412152963 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97580cbc40 con 0x7f9758143e80 2024-09-13T18:27:02.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.477+0000 7f97577fe640 1 -- 172.21.15.53:0/2412152963 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213154053 0 0) 0x7f975806f7a0 con 0x7f97580caee0 2024-09-13T18:27:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975cbec640 1 --2- 172.21.15.53:0/2412152963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9758143e80 0x7f975806b390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f97480097c0 tx=0x7f974801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde5026d14738c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f97577fe640 1 -- 172.21.15.53:0/2412152963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480ab600 con 0x7f9758143e80 2024-09-13T18:27:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f97577fe640 1 -- 172.21.15.53:0/2412152963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97480a7050 con 0x7f9758143e80 2024-09-13T18:27:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f97577fe640 1 -- 172.21.15.53:0/2412152963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480ab980 con 0x7f9758143e80 2024-09-13T18:27:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 -- 172.21.15.53:0/2412152963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9758143e80 msgr2=0x7f975806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 --2- 172.21.15.53:0/2412152963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9758143e80 0x7f975806b390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f97480097c0 tx=0x7f974801c350 comp rx=0 tx=0).stop 2024-09-13T18:27:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 -- 172.21.15.53:0/2412152963 shutdown_connections 2024-09-13T18:27:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 --2- 172.21.15.53:0/2412152963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580cda30 0x7f97580cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 --2- 172.21.15.53:0/2412152963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9758143e80 0x7f975806b390 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 -- 172.21.15.53:0/2412152963 >> 172.21.15.53:0/2412152963 conn(0x7f9758065c80 msgr2=0x7f9758066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 -- 172.21.15.53:0/2412152963 shutdown_connections 2024-09-13T18:27:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.481+0000 7f975ee50640 1 -- 172.21.15.53:0/2412152963 wait complete. 2024-09-13T18:27:02.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 Processor -- start 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 -- start start 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580caee0 0x7f97580a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97580cda30 0x7f9758140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9758143e80 0x7f97580a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97580a9dc0 con 0x7f97580cda30 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97580ad380 con 0x7f9758143e80 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97580aad40 con 0x7f97580caee0 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97580cda30 0x7f9758140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97580cda30 0x7f9758140b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59810/0 (socket says 172.21.15.53:59810) 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 -- 172.21.15.53:0/457080210 learned_addr learned my addr 172.21.15.53:0/457080210 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975d3ed640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9758143e80 0x7f97580a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975cbec640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580caee0 0x7f97580a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 -- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580caee0 msgr2=0x7f97580a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580caee0 0x7f97580a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 -- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9758143e80 msgr2=0x7f97580a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9758143e80 0x7f97580a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 -- 172.21.15.53:0/457080210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748009420 con 0x7f97580cda30 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975d3ed640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9758143e80 0x7f97580a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f9757fff640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97580cda30 0x7f9758140b20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f974c00c480 tx=0x7f974c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f97557fa640 1 -- 172.21.15.53:0/457080210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0074e0 con 0x7f97580cda30 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f97557fa640 1 -- 172.21.15.53:0/457080210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c007660 con 0x7f97580cda30 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97580acdc0 con 0x7f97580cda30 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f97557fa640 1 -- 172.21.15.53:0/457080210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c004a30 con 0x7f97580cda30 2024-09-13T18:27:02.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9758159730 con 0x7f97580cda30 2024-09-13T18:27:02.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97580cb350 con 0x7f97580cda30 2024-09-13T18:27:02.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.485+0000 7f97557fa640 1 -- 172.21.15.53:0/457080210 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f974c004b90 con 0x7f97580cda30 2024-09-13T18:27:02.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.489+0000 7f97557fa640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9744066840 0x7f9744068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.489+0000 7f97557fa640 1 -- 172.21.15.53:0/457080210 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f974c083560 con 0x7f97580cda30 2024-09-13T18:27:02.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.489+0000 7f975cbec640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9744066840 0x7f9744068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.489+0000 7f975cbec640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9744066840 0x7f9744068d00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f97480ad000 tx=0x7f97480a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.493+0000 7f97557fa640 1 -- 172.21.15.53:0/457080210 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f974c0506e0 con 0x7f97580cda30 2024-09-13T18:27:02.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.649+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9758157ac0 con 0x7f97580cda30 2024-09-13T18:27:02.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f97557fa640 1 -- 172.21.15.53:0/457080210 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f974c018020 con 0x7f97580cda30 2024-09-13T18:27:02.656 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9744066840 msgr2=0x7f9744068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9744066840 0x7f9744068d00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f97480ad000 tx=0x7f97480a6000 comp rx=0 tx=0).stop 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97580cda30 msgr2=0x7f9758140b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97580cda30 0x7f9758140b20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f974c00c480 tx=0x7f974c00c940 comp rx=0 tx=0).stop 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 shutdown_connections 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9744066840 0x7f9744068d00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9758143e80 0x7f97580a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97580cda30 0x7f9758140b20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 --2- 172.21.15.53:0/457080210 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97580caee0 0x7f97580a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 >> 172.21.15.53:0/457080210 conn(0x7f9758065c80 msgr2=0x7f9758155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 shutdown_connections 2024-09-13T18:27:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.653+0000 7f975ee50640 1 -- 172.21.15.53:0/457080210 wait complete. 2024-09-13T18:27:02.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:02.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5fdd94640 1 Processor -- start 2024-09-13T18:27:02.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5fdd94640 1 -- start start 2024-09-13T18:27:02.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5fdd94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 0x7fb5f80ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5fdd94640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80cd590 con 0x7fb5f8159260 2024-09-13T18:27:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5fdd94640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f806c4a0 con 0x7fb5f8070440 2024-09-13T18:27:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5fdd94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8070d40 con 0x7fb5f8070890 2024-09-13T18:27:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb5f8159260 0x7fb5f80b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38372/0 (socket says 172.21.15.53:38372) 2024-09-13T18:27:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f77fe640 1 -- 172.21.15.53:0/614503521 learned_addr learned my addr 172.21.15.53:0/614503521 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072665630 0 0) 0x7fb5f80cd590 con 0x7fb5f8159260 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e0003530 con 0x7fb5f8159260 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f7fff640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 0x7fb5f80ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3200813961 0 0) 0x7fb5e0003530 con 0x7fb5f8159260 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 msgr2=0x7fb5f80ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 0x7fb5f80ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 >> v1:172.21.15.87:6789/0 conn(0x7fb5f8070440 legacy=0x7fb5f80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80b44f0 con 0x7fb5f8159260 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb5f0001a00 con 0x7fb5f8159260 2024-09-13T18:27:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 >> v1:172.21.15.53:6789/0 conn(0x7fb5f8159260 legacy=0x7fb5f80b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 0x7fb5e00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e0003f30 0x7fb5e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8070d40 con 0x7fb5e0004d10 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e000dc80 con 0x7fb5e0003f30 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e000de40 con 0x7fb5f8070890 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f7fff640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f77fe640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 0x7fb5e00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f7fff640 1 -- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 msgr2=0x7fb5e00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f7fff640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f8070890 0x7fb5e00039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f6ffd640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e0003f30 0x7fb5e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f7fff640 1 -- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e0003f30 msgr2=0x7fb5e00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f7fff640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e0003f30 0x7fb5e00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f7fff640 1 -- 172.21.15.53:0/614503521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0003530 con 0x7fb5e0004d10 2024-09-13T18:27:02.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.785+0000 7fb5f6ffd640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5e0003f30 0x7fb5e00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5f7fff640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5e0005190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009ae0 tx=0x7fb5e801cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f0c739bb8eb565 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80a5700 con 0x7fb5e0004d10 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e80a5860 con 0x7fb5e0004d10 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5f67fc640 1 -- 172.21.15.53:0/614503521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80a5c10 con 0x7fb5e0004d10 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 -- 172.21.15.53:0/614503521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 msgr2=0x7fb5e0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 --2- 172.21.15.53:0/614503521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5e0005190 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009ae0 tx=0x7fb5e801cb00 comp rx=0 tx=0).stop 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5f7fff640 1 -- 172.21.15.53:0/614503521 reap_dead start 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 -- 172.21.15.53:0/614503521 shutdown_connections 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 -- 172.21.15.53:0/614503521 >> 172.21.15.53:0/614503521 conn(0x7fb5f80b1310 msgr2=0x7fb5f80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 -- 172.21.15.53:0/614503521 shutdown_connections 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 -- 172.21.15.53:0/614503521 wait complete. 2024-09-13T18:27:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 Processor -- start 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.789+0000 7fb5fdd94640 1 -- start start 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5f8158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f80b05c0 0x7fb5f815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f815a870 0x7fb5f8148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f815ad20 con 0x7fb5e0004d10 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8159cf0 con 0x7fb5f80b05c0 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8158000 con 0x7fb5f815a870 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5f8158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5f8158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59828/0 (socket says 172.21.15.53:59828) 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 -- 172.21.15.53:0/2999418021 learned_addr learned my addr 172.21.15.53:0/2999418021 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f7fff640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f815a870 0x7fb5f8148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f6ffd640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f80b05c0 0x7fb5f815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 -- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f815a870 msgr2=0x7fb5f8148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f815a870 0x7fb5f8148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 -- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f80b05c0 msgr2=0x7fb5f815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f80b05c0 0x7fb5f815a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 -- 172.21.15.53:0/2999418021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f8159a50 con 0x7fb5e0004d10 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f7fff640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f815a870 0x7fb5f8148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f77fe640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5f8158710 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0001590 tx=0x7fb5f000c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5dffff640 1 -- 172.21.15.53:0/2999418021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00070d0 con 0x7fb5e0004d10 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5dffff640 1 -- 172.21.15.53:0/2999418021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0007230 con 0x7fb5e0004d10 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f80afae0 con 0x7fb5e0004d10 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5dffff640 1 -- 172.21.15.53:0/2999418021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000cd80 con 0x7fb5e0004d10 2024-09-13T18:27:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80b00a0 con 0x7fb5e0004d10 2024-09-13T18:27:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f80af940 con 0x7fb5e0004d10 2024-09-13T18:27:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5dffff640 1 -- 172.21.15.53:0/2999418021 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fb5f0005440 con 0x7fb5e0004d10 2024-09-13T18:27:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5dffff640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb5e4066840 0x7fb5e4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5dffff640 1 -- 172.21.15.53:0/2999418021 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5f0085150 con 0x7fb5e0004d10 2024-09-13T18:27:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.793+0000 7fb5f6ffd640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb5e4066840 0x7fb5e4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:02.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.797+0000 7fb5f6ffd640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb5e4066840 0x7fb5e4068d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb5f81563f0 tx=0x7fb5ec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.797+0000 7fb5dffff640 1 -- 172.21.15.53:0/2999418021 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5f80af940 con 0x7fb5e0004d10 2024-09-13T18:27:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.969+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb5f80af940 con 0x7fb5e0004d10 2024-09-13T18:27:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.969+0000 7fb5dffff640 1 -- 172.21.15.53:0/2999418021 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb5f80af940 con 0x7fb5e0004d10 2024-09-13T18:27:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb5e4066840 msgr2=0x7fb5e4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb5e4066840 0x7fb5e4068d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb5f81563f0 tx=0x7fb5ec009040 comp rx=0 tx=0).stop 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 msgr2=0x7fb5f8158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5f8158710 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0001590 tx=0x7fb5f000c4b0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 shutdown_connections 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb5e4066840 0x7fb5e4068d00 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb5f81563f0 tx=0x7fb5ec009040 comp rx=0 tx=0).stop 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f815a870 0x7fb5f8148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f80b05c0 0x7fb5f815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 --2- 172.21.15.53:0/2999418021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5e0004d10 0x7fb5f8158710 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 >> 172.21.15.53:0/2999418021 conn(0x7fb5f80b1310 msgr2=0x7fb5f815ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:02.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 shutdown_connections 2024-09-13T18:27:02.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:02.973+0000 7fb5fdd94640 1 -- 172.21.15.53:0/2999418021 wait complete. 2024-09-13T18:27:02.993 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:27:02.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:02.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:27:03.005 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[40623]: fuse finished with error 0 and tester_r 0 2024-09-13T18:27:03.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:03.081 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:27:03.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:03.081 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:27:03.087 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:27:03.087 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:03.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:03.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd9362e1640 1 Processor -- start 2024-09-13T18:27:03.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd9362e1640 1 -- start start 2024-09-13T18:27:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd9362e1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9300cd630 0x7fd9300b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd9362e1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd93006a660 0x7fd9300cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd9362e1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9300cfe80 con 0x7fd9300b1af0 2024-09-13T18:27:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd9362e1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9300d0120 con 0x7fd93006a660 2024-09-13T18:27:03.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd9362e1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93006ac20 con 0x7fd9300cd630 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd93006a660 0x7fd9300cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd93006a660 0x7fd9300cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59842/0 (socket says 172.21.15.53:59842) 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 -- 172.21.15.53:0/2730003499 learned_addr learned my addr 172.21.15.53:0/2730003499 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd92ffff640 1 --2- 172.21.15.53:0/2730003499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9300cd630 0x7fd9300b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 -- 172.21.15.53:0/2730003499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9300cd630 msgr2=0x7fd9300b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 --2- 172.21.15.53:0/2730003499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9300cd630 0x7fd9300b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 -- 172.21.15.53:0/2730003499 >> v1:172.21.15.87:6789/0 conn(0x7fd9300b1af0 legacy=0x7fd930069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:03.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 -- 172.21.15.53:0/2730003499 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93006af00 con 0x7fd93006a660 2024-09-13T18:27:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.241+0000 7fd93487e640 1 --2- 172.21.15.53:0/2730003499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93006a660 0x7fd9300cf580 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd928009e50 tx=0x7fd92801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25dc4e54adfc31d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92effd640 1 -- 172.21.15.53:0/2730003499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280a5550 con 0x7fd93006a660 2024-09-13T18:27:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92effd640 1 -- 172.21.15.53:0/2730003499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9280a56b0 con 0x7fd93006a660 2024-09-13T18:27:03.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92effd640 1 -- 172.21.15.53:0/2730003499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280a5a40 con 0x7fd93006a660 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- 172.21.15.53:0/2730003499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93006a660 msgr2=0x7fd9300cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 --2- 172.21.15.53:0/2730003499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93006a660 0x7fd9300cf580 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd928009e50 tx=0x7fd92801c8d0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- 172.21.15.53:0/2730003499 shutdown_connections 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 --2- 172.21.15.53:0/2730003499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93006a660 0x7fd9300cf580 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 --2- 172.21.15.53:0/2730003499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9300cd630 0x7fd9300b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- 172.21.15.53:0/2730003499 >> 172.21.15.53:0/2730003499 conn(0x7fd9300b20d0 msgr2=0x7fd9300b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- 172.21.15.53:0/2730003499 shutdown_connections 2024-09-13T18:27:03.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- 172.21.15.53:0/2730003499 wait complete. 2024-09-13T18:27:03.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 Processor -- start 2024-09-13T18:27:03.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- start start 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd93006a660 0x7fd9300cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9300b1af0 0x7fd930153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9300cd630 0x7fd93015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300cf0b0 con 0x7fd9300b1af0 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300b4f60 con 0x7fd9300cd630 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300b5240 con 0x7fd93006a660 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9300b1af0 0x7fd930153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9300b1af0 0x7fd930153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59850/0 (socket says 172.21.15.53:59850) 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 -- 172.21.15.53:0/308817871 learned_addr learned my addr 172.21.15.53:0/308817871 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92ffff640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd93006a660 0x7fd9300cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd93487e640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9300cd630 0x7fd93015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 -- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd93006a660 msgr2=0x7fd9300cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd93006a660 0x7fd9300cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 -- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9300cd630 msgr2=0x7fd93015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9300cd630 0x7fd93015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 -- 172.21.15.53:0/308817871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928009b30 con 0x7fd9300b1af0 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92ffff640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd93006a660 0x7fd9300cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92f7fe640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9300b1af0 0x7fd930153910 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b410 tx=0x7fd92000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92cff9640 1 -- 172.21.15.53:0/308817871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920004020 con 0x7fd9300b1af0 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92cff9640 1 -- 172.21.15.53:0/308817871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920004180 con 0x7fd9300b1af0 2024-09-13T18:27:03.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9300b5520 con 0x7fd9300b1af0 2024-09-13T18:27:03.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd92cff9640 1 -- 172.21.15.53:0/308817871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920011630 con 0x7fd9300b1af0 2024-09-13T18:27:03.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.245+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9300b5d20 con 0x7fd9300b1af0 2024-09-13T18:27:03.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.249+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9300c3f00 con 0x7fd9300b1af0 2024-09-13T18:27:03.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.249+0000 7fd92cff9640 1 -- 172.21.15.53:0/308817871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd920011790 con 0x7fd9300b1af0 2024-09-13T18:27:03.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.249+0000 7fd92cff9640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd910066840 0x7fd910068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.249+0000 7fd92cff9640 1 -- 172.21.15.53:0/308817871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd920084320 con 0x7fd9300b1af0 2024-09-13T18:27:03.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.249+0000 7fd92ffff640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd910066840 0x7fd910068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.249+0000 7fd92ffff640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd910066840 0x7fd910068d00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd918007a70 tx=0x7fd918008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.253+0000 7fd92cff9640 1 -- 172.21.15.53:0/308817871 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd920051370 con 0x7fd9300b1af0 2024-09-13T18:27:03.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.413+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9300b5a40 con 0x7fd9300b1af0 2024-09-13T18:27:03.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.413+0000 7fd92cff9640 1 -- 172.21.15.53:0/308817871 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16453 (secure 0 0 0) 0x7fd920054990 con 0x7fd9300b1af0 2024-09-13T18:27:03.420 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:03.420 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":46,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:43.159322+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:03.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd910066840 msgr2=0x7fd910068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd910066840 0x7fd910068d00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd918007a70 tx=0x7fd918008040 comp rx=0 tx=0).stop 2024-09-13T18:27:03.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9300b1af0 msgr2=0x7fd930153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9300b1af0 0x7fd930153910 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b410 tx=0x7fd92000b8d0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 shutdown_connections 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd910066840 0x7fd910068d00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9300cd630 0x7fd93015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9300b1af0 0x7fd930153910 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 --2- 172.21.15.53:0/308817871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd93006a660 0x7fd9300cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 >> 172.21.15.53:0/308817871 conn(0x7fd9300b20d0 msgr2=0x7fd930069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 shutdown_connections 2024-09-13T18:27:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.417+0000 7fd9362e1640 1 -- 172.21.15.53:0/308817871 wait complete. 2024-09-13T18:27:03.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:40.433725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:26:41.119531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:03.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:03.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d9230d640 1 Processor -- start 2024-09-13T18:27:03.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d9230d640 1 -- start start 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d9230d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c15c860 0x7f3d8c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d9230d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3d8c0cf7e0 0x7f3d8c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d9230d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0cdb50 con 0x7f3d8c0cd520 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d9230d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b56d0 con 0x7f3d8c0cf7e0 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d9230d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cd960 con 0x7f3d8c15c860 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8bfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c15c860 0x7f3d8c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3d8c0cd520 0x7f3d8c0cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:47308/0 (socket says 172.21.15.53:47308) 2024-09-13T18:27:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8b7fe640 1 -- 172.21.15.53:0/1788082722 learned_addr learned my addr 172.21.15.53:0/1788082722 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d908aa640 1 --2- 172.21.15.53:0/1788082722 >> v2:172.21.15.87:3300/0 conn(0x7f3d8c0cf7e0 0x7f3d8c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8affd640 1 -- 172.21.15.53:0/1788082722 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7659037 0 0) 0x7f3d8c0cdb50 con 0x7f3d8c0cd520 2024-09-13T18:27:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8bfff640 1 -- 172.21.15.53:0/1788082722 >> v2:172.21.15.87:3300/0 conn(0x7f3d8c0cf7e0 msgr2=0x7f3d8c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8bfff640 1 --2- 172.21.15.53:0/1788082722 >> v2:172.21.15.87:3300/0 conn(0x7f3d8c0cf7e0 0x7f3d8c0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8bfff640 1 -- 172.21.15.53:0/1788082722 >> v1:172.21.15.87:6789/0 conn(0x7f3d8c0cd520 legacy=0x7f3d8c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.565+0000 7f3d8bfff640 1 -- 172.21.15.53:0/1788082722 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0d0350 con 0x7f3d8c15c860 2024-09-13T18:27:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d8bfff640 1 --2- 172.21.15.53:0/1788082722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c15c860 0x7f3d8c0ccfe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0097c0 tx=0x7f3d7c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56808d98c99f988e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d8affd640 1 -- 172.21.15.53:0/1788082722 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0a8990 con 0x7f3d8c15c860 2024-09-13T18:27:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d8affd640 1 -- 172.21.15.53:0/1788082722 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0a8af0 con 0x7f3d8c15c860 2024-09-13T18:27:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d8affd640 1 -- 172.21.15.53:0/1788082722 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0a8e80 con 0x7f3d8c15c860 2024-09-13T18:27:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 -- 172.21.15.53:0/1788082722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c15c860 msgr2=0x7f3d8c0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1788082722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c15c860 0x7f3d8c0ccfe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0097c0 tx=0x7f3d7c01ec90 comp rx=0 tx=0).stop 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 -- 172.21.15.53:0/1788082722 shutdown_connections 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1788082722 >> v2:172.21.15.87:3300/0 conn(0x7f3d8c0cf7e0 0x7f3d8c0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1788082722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c15c860 0x7f3d8c0ccfe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 -- 172.21.15.53:0/1788082722 >> 172.21.15.53:0/1788082722 conn(0x7f3d8c065c80 msgr2=0x7f3d8c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 -- 172.21.15.53:0/1788082722 shutdown_connections 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 -- 172.21.15.53:0/1788082722 wait complete. 2024-09-13T18:27:03.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 Processor -- start 2024-09-13T18:27:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.569+0000 7f3d9230d640 1 -- start start 2024-09-13T18:27:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d8c0cd520 0x7f3d8c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c0cf7e0 0x7f3d8c15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d8c15c860 0x7f3d8c1f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cabb0 con 0x7f3d8c15c860 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b5040 con 0x7f3d8c0cd520 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b4d60 con 0x7f3d8c0cf7e0 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d8c15c860 0x7f3d8c1f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d8c15c860 0x7f3d8c1f25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59860/0 (socket says 172.21.15.53:59860) 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 -- 172.21.15.53:0/1577434319 learned_addr learned my addr 172.21.15.53:0/1577434319 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d8bfff640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d8c0cd520 0x7f3d8c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d8b7fe640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c0cf7e0 0x7f3d8c15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 -- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c0cf7e0 msgr2=0x7f3d8c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c0cf7e0 0x7f3d8c15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 -- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d8c0cd520 msgr2=0x7f3d8c15ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d8c0cd520 0x7f3d8c15ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 -- 172.21.15.53:0/1577434319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c009420 con 0x7f3d8c15c860 2024-09-13T18:27:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d908aa640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d8c15c860 0x7f3d8c1f25d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400efc0 tx=0x7f3d8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d88ff9640 1 -- 172.21.15.53:0/1577434319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84014480 con 0x7f3d8c15c860 2024-09-13T18:27:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d88ff9640 1 -- 172.21.15.53:0/1577434319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400f040 con 0x7f3d8c15c860 2024-09-13T18:27:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0b2c20 con 0x7f3d8c15c860 2024-09-13T18:27:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d88ff9640 1 -- 172.21.15.53:0/1577434319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84014820 con 0x7f3d8c15c860 2024-09-13T18:27:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c0b31e0 con 0x7f3d8c15c860 2024-09-13T18:27:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c0b3400 con 0x7f3d8c15c860 2024-09-13T18:27:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d88ff9640 1 -- 172.21.15.53:0/1577434319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f3d84014980 con 0x7f3d8c15c860 2024-09-13T18:27:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d88ff9640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3d78066840 0x7f3d78068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d88ff9640 1 -- 172.21.15.53:0/1577434319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d840854d0 con 0x7f3d8c15c860 2024-09-13T18:27:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.573+0000 7f3d8bfff640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3d78066840 0x7f3d78068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.577+0000 7f3d8bfff640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3d78066840 0x7f3d78068d00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b2000 tx=0x7f3d7c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.577+0000 7f3d88ff9640 1 -- 172.21.15.53:0/1577434319 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d84052420 con 0x7f3d8c15c860 2024-09-13T18:27:03.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.729+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d8c161060 con 0x7f3d8c15c860 2024-09-13T18:27:03.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d88ff9640 1 -- 172.21.15.53:0/1577434319 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d8c161060 con 0x7f3d8c15c860 2024-09-13T18:27:03.736 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:27:03.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3d78066840 msgr2=0x7f3d78068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3d78066840 0x7f3d78068d00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b2000 tx=0x7f3d7c008040 comp rx=0 tx=0).stop 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d8c15c860 msgr2=0x7f3d8c1f25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d8c15c860 0x7f3d8c1f25d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400efc0 tx=0x7f3d8400c490 comp rx=0 tx=0).stop 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 shutdown_connections 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3d78066840 0x7f3d78068d00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d8c0cf7e0 0x7f3d8c15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d8c15c860 0x7f3d8c1f25d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 --2- 172.21.15.53:0/1577434319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d8c0cd520 0x7f3d8c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 >> 172.21.15.53:0/1577434319 conn(0x7f3d8c065c80 msgr2=0x7f3d8c0d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 shutdown_connections 2024-09-13T18:27:03.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.733+0000 7f3d9230d640 1 -- 172.21.15.53:0/1577434319 wait complete. 2024-09-13T18:27:03.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:03.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 Processor -- start 2024-09-13T18:27:03.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 -- start start 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc474143e80 0x7fc47406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4740caee0 0x7fc4740cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4740cd320 0x7fc4740cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47406f7a0 con 0x7fc474143e80 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47406fd60 con 0x7fc4740caee0 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47c70b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740cdd10 con 0x7fc4740cd320 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc474143e80 0x7fc47406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc474143e80 0x7fc47406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59872/0 (socket says 172.21.15.53:59872) 2024-09-13T18:27:03.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 -- 172.21.15.53:0/2422993455 learned_addr learned my addr 172.21.15.53:0/2422993455 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47aca8640 1 --2- 172.21.15.53:0/2422993455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4740cd320 0x7fc4740cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc479ca6640 1 --2- 172.21.15.53:0/2422993455 >> v2:172.21.15.87:3300/0 conn(0x7fc4740caee0 0x7fc4740cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 -- 172.21.15.53:0/2422993455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4740cd320 msgr2=0x7fc4740cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 --2- 172.21.15.53:0/2422993455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4740cd320 0x7fc4740cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 -- 172.21.15.53:0/2422993455 >> v2:172.21.15.87:3300/0 conn(0x7fc4740caee0 msgr2=0x7fc4740cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 --2- 172.21.15.53:0/2422993455 >> v2:172.21.15.87:3300/0 conn(0x7fc4740caee0 0x7fc4740cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.869+0000 7fc47a4a7640 1 -- 172.21.15.53:0/2422993455 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4740cb960 con 0x7fc474143e80 2024-09-13T18:27:03.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47a4a7640 1 --2- 172.21.15.53:0/2422993455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc474143e80 0x7fc47406b390 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc470009870 tx=0x7fc47001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafd3161bd788b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc4794a5640 1 -- 172.21.15.53:0/2422993455 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700ab620 con 0x7fc474143e80 2024-09-13T18:27:03.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc4794a5640 1 -- 172.21.15.53:0/2422993455 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4700ab780 con 0x7fc474143e80 2024-09-13T18:27:03.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc4794a5640 1 -- 172.21.15.53:0/2422993455 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700abb10 con 0x7fc474143e80 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 -- 172.21.15.53:0/2422993455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc474143e80 msgr2=0x7fc47406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 --2- 172.21.15.53:0/2422993455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc474143e80 0x7fc47406b390 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc470009870 tx=0x7fc47001c460 comp rx=0 tx=0).stop 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 -- 172.21.15.53:0/2422993455 shutdown_connections 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 --2- 172.21.15.53:0/2422993455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4740cd320 0x7fc4740cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 --2- 172.21.15.53:0/2422993455 >> v2:172.21.15.87:3300/0 conn(0x7fc4740caee0 0x7fc4740cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 --2- 172.21.15.53:0/2422993455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc474143e80 0x7fc47406b390 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 -- 172.21.15.53:0/2422993455 >> 172.21.15.53:0/2422993455 conn(0x7fc474065c80 msgr2=0x7fc474066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 -- 172.21.15.53:0/2422993455 shutdown_connections 2024-09-13T18:27:03.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 -- 172.21.15.53:0/2422993455 wait complete. 2024-09-13T18:27:03.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 Processor -- start 2024-09-13T18:27:03.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.873+0000 7fc47c70b640 1 -- start start 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4740caee0 0x7fc47413e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4740cd320 0x7fc474143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc474143e80 0x7fc474156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740ad750 con 0x7fc4740cd320 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741562a0 con 0x7fc4740caee0 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47413e640 con 0x7fc474143e80 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4740cd320 0x7fc474143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4740cd320 0x7fc474143000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59886/0 (socket says 172.21.15.53:59886) 2024-09-13T18:27:03.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 -- 172.21.15.53:0/4192949990 learned_addr learned my addr 172.21.15.53:0/4192949990 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47aca8640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc474143e80 0x7fc474156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47a4a7640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4740caee0 0x7fc47413e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 -- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc474143e80 msgr2=0x7fc474156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc474143e80 0x7fc474156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 -- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4740caee0 msgr2=0x7fc47413e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4740caee0 0x7fc47413e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 -- 172.21.15.53:0/4192949990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700094d0 con 0x7fc4740cd320 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc479ca6640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4740cd320 0x7fc474143000 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d5f0 tx=0x7fc46400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc46affd640 1 -- 172.21.15.53:0/4192949990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464018070 con 0x7fc4740cd320 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc46affd640 1 -- 172.21.15.53:0/4192949990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464004240 con 0x7fc4740cd320 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4740aceb0 con 0x7fc4740cd320 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc46affd640 1 -- 172.21.15.53:0/4192949990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640043f0 con 0x7fc4740cd320 2024-09-13T18:27:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4740ad470 con 0x7fc4740cd320 2024-09-13T18:27:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc474070a00 con 0x7fc4740cd320 2024-09-13T18:27:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc46affd640 1 -- 172.21.15.53:0/4192949990 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc464003620 con 0x7fc4740cd320 2024-09-13T18:27:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc46affd640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc458066870 0x7fc458068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc46affd640 1 -- 172.21.15.53:0/4192949990 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc464084170 con 0x7fc4740cd320 2024-09-13T18:27:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.877+0000 7fc47a4a7640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc458066870 0x7fc458068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.881+0000 7fc47a4a7640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc458066870 0x7fc458068d30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc4700af000 tx=0x7fc4700a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:03.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:03.881+0000 7fc46affd640 1 -- 172.21.15.53:0/4192949990 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc464051260 con 0x7fc4740cd320 2024-09-13T18:27:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.037+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4740b0ee0 con 0x7fc4740cd320 2024-09-13T18:27:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.037+0000 7fc46affd640 1 -- 172.21.15.53:0/4192949990 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc464054880 con 0x7fc4740cd320 2024-09-13T18:27:04.044 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:27:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc458066870 msgr2=0x7fc458068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc458066870 0x7fc458068d30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc4700af000 tx=0x7fc4700a7000 comp rx=0 tx=0).stop 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4740cd320 msgr2=0x7fc474143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4740cd320 0x7fc474143000 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d5f0 tx=0x7fc46400dab0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 shutdown_connections 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc458066870 0x7fc458068d30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc474143e80 0x7fc474156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4740cd320 0x7fc474143000 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 --2- 172.21.15.53:0/4192949990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4740caee0 0x7fc47413e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 >> 172.21.15.53:0/4192949990 conn(0x7fc474065c80 msgr2=0x7fc4740ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 shutdown_connections 2024-09-13T18:27:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.041+0000 7fc47c70b640 1 -- 172.21.15.53:0/4192949990 wait complete. 2024-09-13T18:27:04.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.221+0000 7f885b327640 1 Processor -- start 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.221+0000 7f885b327640 1 -- start start 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f885b327640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88540ccd10 0x7f88540cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f885b327640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f88540d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f885b327640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88540b7db0 con 0x7f885415c830 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f885b327640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540d3650 con 0x7f88540ccd10 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f885b327640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88540d0650 con 0x7f88540d2c80 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88588c2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88540ccd10 0x7f88540cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88590c3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f885415c830 0x7f88540d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38374/0 (socket says 172.21.15.53:38374) 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88588c2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88540ccd10 0x7f88540cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59894/0 (socket says 172.21.15.53:59894) 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88590c3640 1 -- 172.21.15.53:0/3221630086 learned_addr learned my addr 172.21.15.53:0/3221630086 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88598c4640 1 --2- 172.21.15.53:0/3221630086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f88540d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88588c2640 1 -- 172.21.15.53:0/3221630086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 msgr2=0x7f88540d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88588c2640 1 --2- 172.21.15.53:0/3221630086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f88540d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88588c2640 1 -- 172.21.15.53:0/3221630086 >> v1:172.21.15.53:6789/0 conn(0x7f885415c830 legacy=0x7f88540d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f884bfff640 1 -- 172.21.15.53:0/3221630086 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15368592 0 0) 0x7f88540b7db0 con 0x7f885415c830 2024-09-13T18:27:04.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88588c2640 1 -- 172.21.15.53:0/3221630086 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540d0c10 con 0x7f88540ccd10 2024-09-13T18:27:04.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f88588c2640 1 --2- 172.21.15.53:0/3221630086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f88540cd180 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f88440097c0 tx=0x7f884401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b8550be4d01f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f884bfff640 1 -- 172.21.15.53:0/3221630086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440ab600 con 0x7f88540ccd10 2024-09-13T18:27:04.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f884bfff640 1 -- 172.21.15.53:0/3221630086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88440a7050 con 0x7f88540ccd10 2024-09-13T18:27:04.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.225+0000 7f884bfff640 1 -- 172.21.15.53:0/3221630086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440ab980 con 0x7f88540ccd10 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- 172.21.15.53:0/3221630086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 msgr2=0x7f88540cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 --2- 172.21.15.53:0/3221630086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f88540cd180 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f88440097c0 tx=0x7f884401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- 172.21.15.53:0/3221630086 shutdown_connections 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 --2- 172.21.15.53:0/3221630086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f88540d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 --2- 172.21.15.53:0/3221630086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f88540cd180 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- 172.21.15.53:0/3221630086 >> 172.21.15.53:0/3221630086 conn(0x7f8854070970 msgr2=0x7f8854070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- 172.21.15.53:0/3221630086 shutdown_connections 2024-09-13T18:27:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- 172.21.15.53:0/3221630086 wait complete. 2024-09-13T18:27:04.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 Processor -- start 2024-09-13T18:27:04.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- start start 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f8854065ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f8854151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f885415c830 0x7f8854152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8854158f50 con 0x7f88540ccd10 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8854158020 con 0x7f885415c830 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8854158300 con 0x7f88540d2c80 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f8854065ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f8854065ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59900/0 (socket says 172.21.15.53:59900) 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 -- 172.21.15.53:0/1222324893 learned_addr learned my addr 172.21.15.53:0/1222324893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88598c4640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f885415c830 0x7f8854152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88588c2640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f8854151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 -- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 msgr2=0x7f8854151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f8854151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 -- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f885415c830 msgr2=0x7f8854152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f885415c830 0x7f8854152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 -- 172.21.15.53:0/1222324893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009420 con 0x7f88540ccd10 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88588c2640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f8854151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88598c4640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f885415c830 0x7f8854152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f88590c3640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f8854065ee0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f885000c480 tx=0x7f885000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f8849ffb640 1 -- 172.21.15.53:0/1222324893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500074e0 con 0x7f88540ccd10 2024-09-13T18:27:04.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f8849ffb640 1 -- 172.21.15.53:0/1222324893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8850007660 con 0x7f88540ccd10 2024-09-13T18:27:04.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88541585e0 con 0x7f88540ccd10 2024-09-13T18:27:04.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f8849ffb640 1 -- 172.21.15.53:0/1222324893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850004a30 con 0x7f88540ccd10 2024-09-13T18:27:04.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.229+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8854066420 con 0x7f88540ccd10 2024-09-13T18:27:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.233+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8854158820 con 0x7f88540ccd10 2024-09-13T18:27:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.233+0000 7f8849ffb640 1 -- 172.21.15.53:0/1222324893 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f8850004b90 con 0x7f88540ccd10 2024-09-13T18:27:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.233+0000 7f8849ffb640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8838066840 0x7f8838068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.233+0000 7f8849ffb640 1 -- 172.21.15.53:0/1222324893 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88500839e0 con 0x7f88540ccd10 2024-09-13T18:27:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.233+0000 7f88588c2640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8838066840 0x7f8838068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.233+0000 7f88588c2640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8838066840 0x7f8838068d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88440ad000 tx=0x7f8844008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.237+0000 7f8849ffb640 1 -- 172.21.15.53:0/1222324893 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8854158820 con 0x7f88540ccd10 2024-09-13T18:27:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.393+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88541587d0 con 0x7f88540ccd10 2024-09-13T18:27:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.393+0000 7f8849ffb640 1 -- 172.21.15.53:0/1222324893 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8850018020 con 0x7f88540ccd10 2024-09-13T18:27:04.400 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8838066840 msgr2=0x7f8838068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8838066840 0x7f8838068d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f88440ad000 tx=0x7f8844008040 comp rx=0 tx=0).stop 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 msgr2=0x7f8854065ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f8854065ee0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f885000c480 tx=0x7f885000c940 comp rx=0 tx=0).stop 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 shutdown_connections 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8838066840 0x7f8838068d00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88540d2c80 0x7f8854151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f885415c830 0x7f8854152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 --2- 172.21.15.53:0/1222324893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88540ccd10 0x7f8854065ee0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 >> 172.21.15.53:0/1222324893 conn(0x7f8854070970 msgr2=0x7f8854070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 shutdown_connections 2024-09-13T18:27:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.397+0000 7f885b327640 1 -- 172.21.15.53:0/1222324893 wait complete. 2024-09-13T18:27:04.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:04.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 Processor -- start 2024-09-13T18:27:04.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 -- start start 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7900cb980 0x7fd7900b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd79006b850 0x7fd7900cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7900cbd60 0x7fd79006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900b1ac0 con 0x7fd7900cb980 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd790159ac0 con 0x7fd79006b850 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd796cff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd790159da0 con 0x7fd7900cbd60 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd794a9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7900cb980 0x7fd7900b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd794a9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7900cb980 0x7fd7900b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59902/0 (socket says 172.21.15.53:59902) 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.537+0000 7fd794a9b640 1 -- 172.21.15.53:0/4027298251 learned_addr learned my addr 172.21.15.53:0/4027298251 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd787fff640 1 --2- 172.21.15.53:0/4027298251 >> v2:172.21.15.87:3300/0 conn(0x7fd79006b850 0x7fd7900cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd79529c640 1 --2- 172.21.15.53:0/4027298251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7900cbd60 0x7fd79006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd794a9b640 1 -- 172.21.15.53:0/4027298251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7900cbd60 msgr2=0x7fd79006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd794a9b640 1 --2- 172.21.15.53:0/4027298251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7900cbd60 0x7fd79006fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd794a9b640 1 -- 172.21.15.53:0/4027298251 >> v2:172.21.15.87:3300/0 conn(0x7fd79006b850 msgr2=0x7fd7900cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd794a9b640 1 --2- 172.21.15.53:0/4027298251 >> v2:172.21.15.87:3300/0 conn(0x7fd79006b850 0x7fd7900cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd794a9b640 1 -- 172.21.15.53:0/4027298251 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79015a080 con 0x7fd7900cb980 2024-09-13T18:27:04.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd794a9b640 1 --2- 172.21.15.53:0/4027298251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd7900b33b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd7900b38f0 tx=0x7fd78c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8929612dd3f138 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd7877fe640 1 -- 172.21.15.53:0/4027298251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0ab600 con 0x7fd7900cb980 2024-09-13T18:27:04.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd7877fe640 1 -- 172.21.15.53:0/4027298251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c0a7050 con 0x7fd7900cb980 2024-09-13T18:27:04.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd7877fe640 1 -- 172.21.15.53:0/4027298251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0ab980 con 0x7fd7900cb980 2024-09-13T18:27:04.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 -- 172.21.15.53:0/4027298251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 msgr2=0x7fd7900b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 --2- 172.21.15.53:0/4027298251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd7900b33b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd7900b38f0 tx=0x7fd78c01c460 comp rx=0 tx=0).stop 2024-09-13T18:27:04.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 -- 172.21.15.53:0/4027298251 shutdown_connections 2024-09-13T18:27:04.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 --2- 172.21.15.53:0/4027298251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7900cbd60 0x7fd79006fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 --2- 172.21.15.53:0/4027298251 >> v2:172.21.15.87:3300/0 conn(0x7fd79006b850 0x7fd7900cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 --2- 172.21.15.53:0/4027298251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd7900b33b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 -- 172.21.15.53:0/4027298251 >> 172.21.15.53:0/4027298251 conn(0x7fd790065c80 msgr2=0x7fd790066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 -- 172.21.15.53:0/4027298251 shutdown_connections 2024-09-13T18:27:04.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.541+0000 7fd796cff640 1 -- 172.21.15.53:0/4027298251 wait complete. 2024-09-13T18:27:04.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 Processor -- start 2024-09-13T18:27:04.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 -- start start 2024-09-13T18:27:04.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd79006b850 0x7fd790148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd79014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7900cbd60 0x7fd79014b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79014c790 con 0x7fd7900cb980 2024-09-13T18:27:04.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790151f00 con 0x7fd7900cbd60 2024-09-13T18:27:04.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79014bb10 con 0x7fd79006b850 2024-09-13T18:27:04.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd79014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd79014af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59904/0 (socket says 172.21.15.53:59904) 2024-09-13T18:27:04.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 -- 172.21.15.53:0/452453877 learned_addr learned my addr 172.21.15.53:0/452453877 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd794a9b640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd79006b850 0x7fd790148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd79529c640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7900cbd60 0x7fd79014b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 -- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd79006b850 msgr2=0x7fd790148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd79006b850 0x7fd790148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 -- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7900cbd60 msgr2=0x7fd79014b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7900cbd60 0x7fd79014b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 -- 172.21.15.53:0/452453877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0094d0 con 0x7fd7900cb980 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd787fff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd79014af80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd78000d5f0 tx=0x7fd78000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd7857fa640 1 -- 172.21.15.53:0/452453877 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800125f0 con 0x7fd7900cb980 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd7857fa640 1 -- 172.21.15.53:0/452453877 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780012750 con 0x7fd7900cb980 2024-09-13T18:27:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79014bdf0 con 0x7fd7900cb980 2024-09-13T18:27:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd7857fa640 1 -- 172.21.15.53:0/452453877 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780012ae0 con 0x7fd7900cb980 2024-09-13T18:27:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79014c3b0 con 0x7fd7900cb980 2024-09-13T18:27:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.545+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd790067400 con 0x7fd7900cb980 2024-09-13T18:27:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.549+0000 7fd7857fa640 1 -- 172.21.15.53:0/452453877 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd780012c40 con 0x7fd7900cb980 2024-09-13T18:27:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.549+0000 7fd7857fa640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd77c066840 0x7fd77c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.549+0000 7fd7857fa640 1 -- 172.21.15.53:0/452453877 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7800849e0 con 0x7fd7900cb980 2024-09-13T18:27:04.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.549+0000 7fd794a9b640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd77c066840 0x7fd77c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.549+0000 7fd794a9b640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd77c066840 0x7fd77c068d00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0ad000 tx=0x7fd78c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.553+0000 7fd7857fa640 1 -- 172.21.15.53:0/452453877 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd780051ad0 con 0x7fd7900cb980 2024-09-13T18:27:04.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd79014c8d0 con 0x7fd7900cb980 2024-09-13T18:27:04.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd7857fa640 1 -- 172.21.15.53:0/452453877 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd79014c8d0 con 0x7fd7900cb980 2024-09-13T18:27:04.721 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd77c066840 msgr2=0x7fd77c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd77c066840 0x7fd77c068d00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0ad000 tx=0x7fd78c0a6000 comp rx=0 tx=0).stop 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 msgr2=0x7fd79014af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd79014af80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd78000d5f0 tx=0x7fd78000dab0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 shutdown_connections 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd77c066840 0x7fd77c068d00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7900cbd60 0x7fd79014b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7900cb980 0x7fd79014af80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 --2- 172.21.15.53:0/452453877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd79006b850 0x7fd790148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 >> 172.21.15.53:0/452453877 conn(0x7fd790065c80 msgr2=0x7fd79006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 shutdown_connections 2024-09-13T18:27:04.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.717+0000 7fd796cff640 1 -- 172.21.15.53:0/452453877 wait complete. 2024-09-13T18:27:04.739 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:27:04.739 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:27:04.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:27:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2beec9640 1 Processor -- start 2024-09-13T18:27:04.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2beec9640 1 -- start start 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2beec9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b806c340 0x7fb2b8071b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2beec9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2b806df20 0x7fb2b815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2beec9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b806e370 con 0x7fb2b8157ef0 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2beec9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b80ae530 con 0x7fb2b806df20 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2beec9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81582d0 con 0x7fb2b806c340 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2b7fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b806c340 0x7fb2b8071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2bd466640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2b806df20 0x7fb2b815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2b7fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b806c340 0x7fb2b8071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:57764/0 (socket says 172.21.15.53:57764) 2024-09-13T18:27:04.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2b7fff640 1 -- 172.21.15.53:0/564138694 learned_addr learned my addr 172.21.15.53:0/564138694 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:04.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2b7fff640 1 -- 172.21.15.53:0/564138694 >> v2:172.21.15.87:3300/0 conn(0x7fb2b806df20 msgr2=0x7fb2b815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:04.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2b7fff640 1 --2- 172.21.15.53:0/564138694 >> v2:172.21.15.87:3300/0 conn(0x7fb2b806df20 0x7fb2b815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2b7fff640 1 -- 172.21.15.53:0/564138694 >> v1:172.21.15.87:6789/0 conn(0x7fb2b8157ef0 legacy=0x7fb2b806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.853+0000 7fb2b7fff640 1 -- 172.21.15.53:0/564138694 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b806e5c0 con 0x7fb2b806c340 2024-09-13T18:27:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2b7fff640 1 --2- 172.21.15.53:0/564138694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b806c340 0x7fb2b8071b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009870 tx=0x7fb2ac01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31fcacaabf662101 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2b77fe640 1 -- 172.21.15.53:0/564138694 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0a95f0 con 0x7fb2b806c340 2024-09-13T18:27:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2b77fe640 1 -- 172.21.15.53:0/564138694 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0a9750 con 0x7fb2b806c340 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2b77fe640 1 -- 172.21.15.53:0/564138694 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0a9ae0 con 0x7fb2b806c340 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 -- 172.21.15.53:0/564138694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b806c340 msgr2=0x7fb2b8071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 --2- 172.21.15.53:0/564138694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b806c340 0x7fb2b8071b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009870 tx=0x7fb2ac01c530 comp rx=0 tx=0).stop 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 -- 172.21.15.53:0/564138694 shutdown_connections 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 --2- 172.21.15.53:0/564138694 >> v2:172.21.15.87:3300/0 conn(0x7fb2b806df20 0x7fb2b815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 --2- 172.21.15.53:0/564138694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b806c340 0x7fb2b8071b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 -- 172.21.15.53:0/564138694 >> 172.21.15.53:0/564138694 conn(0x7fb2b80b0a50 msgr2=0x7fb2b80b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 -- 172.21.15.53:0/564138694 shutdown_connections 2024-09-13T18:27:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 -- 172.21.15.53:0/564138694 wait complete. 2024-09-13T18:27:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 Processor -- start 2024-09-13T18:27:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.857+0000 7fb2beec9640 1 -- start start 2024-09-13T18:27:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2b806c340 0x7fb2b81647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2b806df20 0x7fb2b80cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b8157ef0 0x7fb2b80cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80cb7b0 con 0x7fb2b806df20 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8151c70 con 0x7fb2b806c340 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80cba50 con 0x7fb2b8157ef0 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2b806df20 0x7fb2b80cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2b806df20 0x7fb2b80cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59914/0 (socket says 172.21.15.53:59914) 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 -- 172.21.15.53:0/806893999 learned_addr learned my addr 172.21.15.53:0/806893999 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2bd466640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b8157ef0 0x7fb2b80cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2bcc65640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2b806c340 0x7fb2b81647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 -- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b8157ef0 msgr2=0x7fb2b80cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b8157ef0 0x7fb2b80cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 -- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2b806c340 msgr2=0x7fb2b81647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2b806c340 0x7fb2b81647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 -- 172.21.15.53:0/806893999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac0094d0 con 0x7fb2b806df20 2024-09-13T18:27:04.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b7fff640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2b806df20 0x7fb2b80cd2d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac01cdd0 tx=0x7fb2ac01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b57fa640 1 -- 172.21.15.53:0/806893999 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0b1800 con 0x7fb2b806df20 2024-09-13T18:27:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b57fa640 1 -- 172.21.15.53:0/806893999 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0b1960 con 0x7fb2b806df20 2024-09-13T18:27:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b57fa640 1 -- 172.21.15.53:0/806893999 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0b1d10 con 0x7fb2b806df20 2024-09-13T18:27:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b80cbd30 con 0x7fb2b806df20 2024-09-13T18:27:04.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b80cde40 con 0x7fb2b806df20 2024-09-13T18:27:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8071b10 con 0x7fb2b806df20 2024-09-13T18:27:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.861+0000 7fb2b57fa640 1 -- 172.21.15.53:0/806893999 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fb2ac0ba3a0 con 0x7fb2b806df20 2024-09-13T18:27:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.865+0000 7fb2b57fa640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2a4066840 0x7fb2a4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:04.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.865+0000 7fb2b57fa640 1 -- 172.21.15.53:0/806893999 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2ac11e8d0 con 0x7fb2b806df20 2024-09-13T18:27:04.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.865+0000 7fb2bcc65640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2a4066840 0x7fb2a4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:04.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.865+0000 7fb2bcc65640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2a4066840 0x7fb2a4068d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80012f0 tx=0x7fb2a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:04.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:04.869+0000 7fb2b57fa640 1 -- 172.21.15.53:0/806893999 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb2ac0eb980 con 0x7fb2b806df20 2024-09-13T18:27:05.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.021+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2b809d110 con 0x7fb2b806df20 2024-09-13T18:27:05.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2b57fa640 1 -- 172.21.15.53:0/806893999 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16453 (secure 0 0 0) 0x7fb2ac0c0030 con 0x7fb2b806df20 2024-09-13T18:27:05.030 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:05.030 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":46,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:26:43.159322+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2a4066840 msgr2=0x7fb2a4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2a4066840 0x7fb2a4068d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80012f0 tx=0x7fb2a8009040 comp rx=0 tx=0).stop 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2b806df20 msgr2=0x7fb2b80cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2b806df20 0x7fb2b80cd2d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac01cdd0 tx=0x7fb2ac01ad70 comp rx=0 tx=0).stop 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 shutdown_connections 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb2a4066840 0x7fb2a4068d00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2b8157ef0 0x7fb2b80cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2b806df20 0x7fb2b80cd2d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 --2- 172.21.15.53:0/806893999 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2b806c340 0x7fb2b81647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 >> 172.21.15.53:0/806893999 conn(0x7fb2b80b0a50 msgr2=0x7fb2b815b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 shutdown_connections 2024-09-13T18:27:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.025+0000 7fb2beec9640 1 -- 172.21.15.53:0/806893999 wait complete. 2024-09-13T18:27:05.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:40.433725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:26:41.119531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:27:05.048 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:27:05.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc9259d0640 1 Processor -- start 2024-09-13T18:27:05.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc9259d0640 1 -- start start 2024-09-13T18:27:05.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc9259d0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc920156c40 0x7fc920070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc9259d0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200b15a0 con 0x7fc92006d440 2024-09-13T18:27:05.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc9259d0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9200b1880 con 0x7fc920157020 2024-09-13T18:27:05.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc9259d0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200b1b60 con 0x7fc920156c40 2024-09-13T18:27:05.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc91f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc92006d440 0x7fc92006f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38380/0 (socket says 172.21.15.53:38380) 2024-09-13T18:27:05.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc91f7fe640 1 -- 172.21.15.53:0/678463961 learned_addr learned my addr 172.21.15.53:0/678463961 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:05.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc91effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc920156c40 0x7fc920070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc91effd640 1 -- 172.21.15.53:0/678463961 >> v1:172.21.15.87:6789/0 conn(0x7fc920157020 legacy=0x7fc92006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc91effd640 1 -- 172.21.15.53:0/678463961 >> v1:172.21.15.53:6789/0 conn(0x7fc92006d440 legacy=0x7fc92006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.169+0000 7fc91effd640 1 -- 172.21.15.53:0/678463961 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200b1e40 con 0x7fc920156c40 2024-09-13T18:27:05.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91effd640 1 --2- 172.21.15.53:0/678463961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc920070ee0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc9100097f0 tx=0x7fc91001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbffd536c23640b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91dffb640 1 -- 172.21.15.53:0/678463961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9100aa5f0 con 0x7fc920156c40 2024-09-13T18:27:05.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91dffb640 1 -- 172.21.15.53:0/678463961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9100aa750 con 0x7fc920156c40 2024-09-13T18:27:05.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91dffb640 1 -- 172.21.15.53:0/678463961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9100aaae0 con 0x7fc920156c40 2024-09-13T18:27:05.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- 172.21.15.53:0/678463961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 msgr2=0x7fc920070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 --2- 172.21.15.53:0/678463961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc920070ee0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc9100097f0 tx=0x7fc91001c470 comp rx=0 tx=0).stop 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- 172.21.15.53:0/678463961 shutdown_connections 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 --2- 172.21.15.53:0/678463961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc920070ee0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- 172.21.15.53:0/678463961 >> 172.21.15.53:0/678463961 conn(0x7fc920065c80 msgr2=0x7fc920066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- 172.21.15.53:0/678463961 shutdown_connections 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- 172.21.15.53:0/678463961 wait complete. 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 Processor -- start 2024-09-13T18:27:05.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- start start 2024-09-13T18:27:05.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc92006d440 0x7fc9201584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc9201537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc920144920 0x7fc9200b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920155070 con 0x7fc920156c40 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920155eb0 con 0x7fc92006d440 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc9259d0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc920145130 con 0x7fc920144920 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc9201537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc9201537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59940/0 (socket says 172.21.15.53:59940) 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 -- 172.21.15.53:0/581214197 learned_addr learned my addr 172.21.15.53:0/581214197 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91effd640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc92006d440 0x7fc9201584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91f7fe640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc920144920 0x7fc9200b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 -- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc920144920 msgr2=0x7fc9200b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc920144920 0x7fc9200b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 -- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc92006d440 msgr2=0x7fc9201584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc92006d440 0x7fc9201584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 -- 172.21.15.53:0/581214197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910009420 con 0x7fc920156c40 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91f7fe640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc920144920 0x7fc9200b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.173+0000 7fc91e7fc640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc9201537f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc91400c530 tx=0x7fc91400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc907fff640 1 -- 172.21.15.53:0/581214197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914005220 con 0x7fc920156c40 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc907fff640 1 -- 172.21.15.53:0/581214197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914005380 con 0x7fc920156c40 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc907fff640 1 -- 172.21.15.53:0/581214197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914007270 con 0x7fc920156c40 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9201552a0 con 0x7fc920156c40 2024-09-13T18:27:05.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc920155860 con 0x7fc920156c40 2024-09-13T18:27:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920156060 con 0x7fc920156c40 2024-09-13T18:27:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc907fff640 1 -- 172.21.15.53:0/581214197 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc9140073d0 con 0x7fc920156c40 2024-09-13T18:27:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc907fff640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc90c066840 0x7fc90c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc907fff640 1 -- 172.21.15.53:0/581214197 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc914083de0 con 0x7fc920156c40 2024-09-13T18:27:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc91effd640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc90c066840 0x7fc90c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.177+0000 7fc91effd640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc90c066840 0x7fc90c068d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc9100ae000 tx=0x7fc9100a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.181+0000 7fc907fff640 1 -- 172.21.15.53:0/581214197 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc920156060 con 0x7fc920156c40 2024-09-13T18:27:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc920156060 con 0x7fc920156c40 2024-09-13T18:27:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc907fff640 1 -- 172.21.15.53:0/581214197 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc920156060 con 0x7fc920156c40 2024-09-13T18:27:05.341 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:27:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc90c066840 msgr2=0x7fc90c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc90c066840 0x7fc90c068d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc9100ae000 tx=0x7fc9100a7000 comp rx=0 tx=0).stop 2024-09-13T18:27:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 msgr2=0x7fc9201537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc9201537f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc91400c530 tx=0x7fc91400c9f0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 shutdown_connections 2024-09-13T18:27:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc90c066840 0x7fc90c068d00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc920144920 0x7fc9200b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc920156c40 0x7fc9201537f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 --2- 172.21.15.53:0/581214197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc92006d440 0x7fc9201584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 >> 172.21.15.53:0/581214197 conn(0x7fc920065c80 msgr2=0x7fc92015a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 shutdown_connections 2024-09-13T18:27:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.337+0000 7fc9259d0640 1 -- 172.21.15.53:0/581214197 wait complete. 2024-09-13T18:27:05.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:27:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8faa8a3640 1 Processor -- start 2024-09-13T18:27:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8faa8a3640 1 -- start start 2024-09-13T18:27:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8faa8a3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 0x7f8fa4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8faa8a3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8fa4157020 0x7f8fa406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8faa8a3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa406d6e0 con 0x7f8fa406d270 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8faa8a3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa4070340 con 0x7f8fa4157020 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8faa8a3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40b15a0 con 0x7f8fa4156c40 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8fa8e40640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8fa406d270 0x7f8fa415cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38390/0 (socket says 172.21.15.53:38390) 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8fa8e40640 1 -- 172.21.15.53:0/2586465952 learned_addr learned my addr 172.21.15.53:0/2586465952 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8fa3fff640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 0x7f8fa4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.469+0000 7f8fa37fe640 1 --2- 172.21.15.53:0/2586465952 >> v2:172.21.15.87:3300/0 conn(0x7f8fa4157020 0x7f8fa406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425103758 0 0) 0x7f8fa406d6e0 con 0x7f8fa406d270 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f8c003530 con 0x7f8fa406d270 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3330087739 0 0) 0x7f8f8c003530 con 0x7f8fa406d270 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 msgr2=0x7f8fa4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 0x7f8fa4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 >> v2:172.21.15.87:3300/0 conn(0x7f8fa4157020 msgr2=0x7f8fa406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 --2- 172.21.15.53:0/2586465952 >> v2:172.21.15.87:3300/0 conn(0x7f8fa4157020 0x7f8fa406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40b1880 con 0x7f8fa406d270 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8f9c001a00 con 0x7f8fa406d270 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 >> v1:172.21.15.53:6789/0 conn(0x7f8fa406d270 legacy=0x7f8fa415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f8c003980 0x7f8f8c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f8c0047d0 0x7f8f8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 0x7f8f8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40b15a0 con 0x7f8f8c0047d0 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c00b990 con 0x7f8f8c003980 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c00bad0 con 0x7f8fa4156c40 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa37fe640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f8c0047d0 0x7f8f8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa3fff640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f8c003980 0x7f8f8c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa37fe640 1 -- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 msgr2=0x7f8f8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa8e40640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 0x7f8f8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa37fe640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4156c40 0x7f8f8c005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa37fe640 1 -- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f8c003980 msgr2=0x7f8f8c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa37fe640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f8c003980 0x7f8f8c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa37fe640 1 -- 172.21.15.53:0/2586465952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c003530 con 0x7f8f8c0047d0 2024-09-13T18:27:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa37fe640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f8c0047d0 0x7f8f8c004c50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009ae0 tx=0x7f8f9801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3047e04ebcc75cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980a55c0 con 0x7f8f8c0047d0 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f980a5720 con 0x7f8f8c0047d0 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa2ffd640 1 -- 172.21.15.53:0/2586465952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980a58d0 con 0x7f8f8c0047d0 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8faa8a3640 1 -- 172.21.15.53:0/2586465952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f8c0047d0 msgr2=0x7f8f8c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8faa8a3640 1 --2- 172.21.15.53:0/2586465952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f8c0047d0 0x7f8f8c004c50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009ae0 tx=0x7f8f9801cab0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8fa8e40640 1 -- 172.21.15.53:0/2586465952 reap_dead start 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8faa8a3640 1 -- 172.21.15.53:0/2586465952 shutdown_connections 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8faa8a3640 1 -- 172.21.15.53:0/2586465952 >> 172.21.15.53:0/2586465952 conn(0x7f8fa4065c80 msgr2=0x7f8fa4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8faa8a3640 1 -- 172.21.15.53:0/2586465952 shutdown_connections 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.473+0000 7f8faa8a3640 1 -- 172.21.15.53:0/2586465952 wait complete. 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 Processor -- start 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 -- start start 2024-09-13T18:27:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4155da0 0x7f8fa415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4156180 0x7f8fa415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa41532d0 0x7f8fa4153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa415c4a0 con 0x7f8fa41532d0 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa4153ca0 con 0x7f8fa4156180 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa415b820 con 0x7f8fa4155da0 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa41532d0 0x7f8fa4153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa41532d0 0x7f8fa4153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59958/0 (socket says 172.21.15.53:59958) 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 -- 172.21.15.53:0/1065651620 learned_addr learned my addr 172.21.15.53:0/1065651620 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa37fe640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4156180 0x7f8fa415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa3fff640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4155da0 0x7f8fa415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 -- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4155da0 msgr2=0x7f8fa415acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4155da0 0x7f8fa415acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 -- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4156180 msgr2=0x7f8fa415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4156180 0x7f8fa415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 -- 172.21.15.53:0/1065651620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa415bb00 con 0x7f8fa41532d0 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa8e40640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa41532d0 0x7f8fa4153760 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0012f0 tx=0x7f8f9c010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa0ff9640 1 -- 172.21.15.53:0/1065651620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00e8b0 con 0x7f8fa41532d0 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa0ff9640 1 -- 172.21.15.53:0/1065651620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00ea10 con 0x7f8fa41532d0 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa415bde0 con 0x7f8fa41532d0 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa0ff9640 1 -- 172.21.15.53:0/1065651620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00ed80 con 0x7f8fa41532d0 2024-09-13T18:27:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa41556b0 con 0x7f8fa41532d0 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa415c7a0 con 0x7f8fa41532d0 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa0ff9640 1 -- 172.21.15.53:0/1065651620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f8f9c01e3b0 con 0x7f8fa41532d0 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.477+0000 7f8fa0ff9640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f90066840 0x7f8f90068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.481+0000 7f8fa0ff9640 1 -- 172.21.15.53:0/1065651620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f9c086d90 con 0x7f8fa41532d0 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.481+0000 7f8fa3fff640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f90066840 0x7f8f90068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.481+0000 7f8fa3fff640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f90066840 0x7f8f90068d00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009950 tx=0x7f8f94008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.485+0000 7f8fa0ff9640 1 -- 172.21.15.53:0/1065651620 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f9c053fc0 con 0x7f8fa41532d0 2024-09-13T18:27:05.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.641+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fa415c5e0 con 0x7f8fa41532d0 2024-09-13T18:27:05.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.641+0000 7f8fa0ff9640 1 -- 172.21.15.53:0/1065651620 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fa415c5e0 con 0x7f8fa41532d0 2024-09-13T18:27:05.647 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:27:05.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f90066840 msgr2=0x7f8f90068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f90066840 0x7f8f90068d00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009950 tx=0x7f8f94008040 comp rx=0 tx=0).stop 2024-09-13T18:27:05.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa41532d0 msgr2=0x7f8fa4153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa41532d0 0x7f8fa4153760 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0012f0 tx=0x7f8f9c010be0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 shutdown_connections 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8f90066840 0x7f8f90068d00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa41532d0 0x7f8fa4153760 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fa4156180 0x7f8fa415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 --2- 172.21.15.53:0/1065651620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fa4155da0 0x7f8fa415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 >> 172.21.15.53:0/1065651620 conn(0x7f8fa4065c80 msgr2=0x7f8fa40cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 shutdown_connections 2024-09-13T18:27:05.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.645+0000 7f8faa8a3640 1 -- 172.21.15.53:0/1065651620 wait complete. 2024-09-13T18:27:05.665 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:27:05.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf9fcf640 1 Processor -- start 2024-09-13T18:27:05.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf9fcf640 1 -- start start 2024-09-13T18:27:05.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf9fcf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3cf4070ce0 0x7f3cf4071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf9fcf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3cf406b390 0x7f3cf406b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf9fcf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf4146180 con 0x7f3cf41457c0 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf9fcf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf406bd00 con 0x7f3cf406b390 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf9fcf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf40702d0 con 0x7f3cf4070ce0 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3cf406b390 0x7f3cf406b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3cf406b390 0x7f3cf406b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59972/0 (socket says 172.21.15.53:59972) 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf3fff640 1 -- 172.21.15.53:0/104076636 learned_addr learned my addr 172.21.15.53:0/104076636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf2ffd640 1 --2- 172.21.15.53:0/104076636 >> v2:172.21.15.87:3300/0 conn(0x7f3cf4070ce0 0x7f3cf4071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf3fff640 1 -- 172.21.15.53:0/104076636 >> v2:172.21.15.87:3300/0 conn(0x7f3cf4070ce0 msgr2=0x7f3cf4071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/104076636 >> v2:172.21.15.87:3300/0 conn(0x7f3cf4070ce0 0x7f3cf4071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf3fff640 1 -- 172.21.15.53:0/104076636 >> v1:172.21.15.87:6789/0 conn(0x7f3cf41457c0 legacy=0x7f3cf40b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf3fff640 1 -- 172.21.15.53:0/104076636 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf406c4c0 con 0x7f3cf406b390 2024-09-13T18:27:05.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.793+0000 7f3cf2ffd640 1 --2- 172.21.15.53:0/104076636 >> v2:172.21.15.87:3300/0 conn(0x7f3cf4070ce0 0x7f3cf4071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:05.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/104076636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf406b390 0x7f3cf406b7c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40b31a0 tx=0x7f3cec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacc6162f4ed9299 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf27fc640 1 -- 172.21.15.53:0/104076636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0a5880 con 0x7f3cf406b390 2024-09-13T18:27:05.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf27fc640 1 -- 172.21.15.53:0/104076636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec0a59e0 con 0x7f3cf406b390 2024-09-13T18:27:05.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf27fc640 1 -- 172.21.15.53:0/104076636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0a5d70 con 0x7f3cf406b390 2024-09-13T18:27:05.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/104076636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf406b390 msgr2=0x7f3cf406b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/104076636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf406b390 0x7f3cf406b7c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40b31a0 tx=0x7f3cec01c9c0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/104076636 shutdown_connections 2024-09-13T18:27:05.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/104076636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf406b390 0x7f3cf406b7c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/104076636 >> v2:172.21.15.87:3300/0 conn(0x7f3cf4070ce0 0x7f3cf4071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/104076636 >> 172.21.15.53:0/104076636 conn(0x7f3cf4065c80 msgr2=0x7f3cf4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/104076636 shutdown_connections 2024-09-13T18:27:05.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/104076636 wait complete. 2024-09-13T18:27:05.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 Processor -- start 2024-09-13T18:27:05.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- start start 2024-09-13T18:27:05.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3cf406b390 0x7f3cf415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf4070ce0 0x7f3cf413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cf41457c0 0x7f3cf4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf415df40 con 0x7f3cf4070ce0 2024-09-13T18:27:05.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf415c660 con 0x7f3cf41457c0 2024-09-13T18:27:05.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf9fcf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf415d980 con 0x7f3cf406b390 2024-09-13T18:27:05.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf4070ce0 0x7f3cf413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf4070ce0 0x7f3cf413e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59980/0 (socket says 172.21.15.53:59980) 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 -- 172.21.15.53:0/1693329390 learned_addr learned my addr 172.21.15.53:0/1693329390 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf37fe640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3cf406b390 0x7f3cf415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf3fff640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cf41457c0 0x7f3cf4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 -- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3cf406b390 msgr2=0x7f3cf415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3cf406b390 0x7f3cf415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 -- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cf41457c0 msgr2=0x7f3cf4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cf41457c0 0x7f3cf4157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 -- 172.21.15.53:0/1693329390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec009b30 con 0x7f3cf4070ce0 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.797+0000 7f3cf2ffd640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf4070ce0 0x7f3cf413e9a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400e840 tx=0x7f3ce400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cdbfff640 1 -- 172.21.15.53:0/1693329390 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400c8d0 con 0x7f3cf4070ce0 2024-09-13T18:27:05.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cdbfff640 1 -- 172.21.15.53:0/1693329390 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400ca30 con 0x7f3cf4070ce0 2024-09-13T18:27:05.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf415dc60 con 0x7f3cf4070ce0 2024-09-13T18:27:05.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cdbfff640 1 -- 172.21.15.53:0/1693329390 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400cde0 con 0x7f3cf4070ce0 2024-09-13T18:27:05.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf413b7a0 con 0x7f3cf4070ce0 2024-09-13T18:27:05.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf406b7c0 con 0x7f3cf4070ce0 2024-09-13T18:27:05.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cdbfff640 1 -- 172.21.15.53:0/1693329390 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f3ce4013410 con 0x7f3cf4070ce0 2024-09-13T18:27:05.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cdbfff640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ce0066840 0x7f3ce0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:05.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cdbfff640 1 -- 172.21.15.53:0/1693329390 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ce4084320 con 0x7f3cf4070ce0 2024-09-13T18:27:05.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cf37fe640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ce0066840 0x7f3ce0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:05.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.801+0000 7f3cf37fe640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ce0066840 0x7f3ce0068d00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8000f70 tx=0x7f3ce8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:05.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.805+0000 7f3cdbfff640 1 -- 172.21.15.53:0/1693329390 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ce4051390 con 0x7f3cf4070ce0 2024-09-13T18:27:05.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.965+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3cf40aecb0 con 0x7f3cf4070ce0 2024-09-13T18:27:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.965+0000 7f3cdbfff640 1 -- 172.21.15.53:0/1693329390 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ce40549b0 con 0x7f3cf4070ce0 2024-09-13T18:27:05.970 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:27:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.965+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ce0066840 msgr2=0x7f3ce0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.965+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ce0066840 0x7f3ce0068d00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8000f70 tx=0x7f3ce8009040 comp rx=0 tx=0).stop 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.965+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf4070ce0 msgr2=0x7f3cf413e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.965+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf4070ce0 0x7f3cf413e9a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400e840 tx=0x7f3ce400ed00 comp rx=0 tx=0).stop 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 shutdown_connections 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3ce0066840 0x7f3ce0068d00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3cf41457c0 0x7f3cf4157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3cf4070ce0 0x7f3cf413e9a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 --2- 172.21.15.53:0/1693329390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3cf406b390 0x7f3cf415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 >> 172.21.15.53:0/1693329390 conn(0x7f3cf4065c80 msgr2=0x7f3cf40b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 shutdown_connections 2024-09-13T18:27:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:05.969+0000 7f3cf9fcf640 1 -- 172.21.15.53:0/1693329390 wait complete. 2024-09-13T18:27:05.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:27:06.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f93591640 1 Processor -- start 2024-09-13T18:27:06.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f93591640 1 -- start start 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f93591640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c15a4a0 0x7f2f8c0b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f93591640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f8c0b3ce0 0x7f2f8c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f93591640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c0b2790 con 0x7f2f8c06a490 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f93591640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c06a940 con 0x7f2f8c0b3ce0 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f93591640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b29e0 con 0x7f2f8c15a4a0 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f90b2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f8c0b3ce0 0x7f2f8c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f90b2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f8c0b3ce0 0x7f2f8c069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59994/0 (socket says 172.21.15.53:59994) 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f90b2c640 1 -- 172.21.15.53:0/582936642 learned_addr learned my addr 172.21.15.53:0/582936642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f9132d640 1 --2- 172.21.15.53:0/582936642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c15a4a0 0x7f2f8c0b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f90b2c640 1 -- 172.21.15.53:0/582936642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c15a4a0 msgr2=0x7f2f8c0b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:06.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f90b2c640 1 --2- 172.21.15.53:0/582936642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c15a4a0 0x7f2f8c0b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f90b2c640 1 -- 172.21.15.53:0/582936642 >> v1:172.21.15.87:6789/0 conn(0x7f2f8c06a490 legacy=0x7f2f8c15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:06.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.101+0000 7f2f90b2c640 1 -- 172.21.15.53:0/582936642 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0b2cc0 con 0x7f2f8c0b3ce0 2024-09-13T18:27:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f90b2c640 1 --2- 172.21.15.53:0/582936642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c0b3ce0 0x7f2f8c069f50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c006fd0 tx=0x7f2f7c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e17efd012b8bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f83fff640 1 -- 172.21.15.53:0/582936642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0aa670 con 0x7f2f8c0b3ce0 2024-09-13T18:27:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f83fff640 1 -- 172.21.15.53:0/582936642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c0aa7d0 con 0x7f2f8c0b3ce0 2024-09-13T18:27:06.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f83fff640 1 -- 172.21.15.53:0/582936642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0aab60 con 0x7f2f8c0b3ce0 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- 172.21.15.53:0/582936642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c0b3ce0 msgr2=0x7f2f8c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 --2- 172.21.15.53:0/582936642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c0b3ce0 0x7f2f8c069f50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c006fd0 tx=0x7f2f7c01c510 comp rx=0 tx=0).stop 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- 172.21.15.53:0/582936642 shutdown_connections 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 --2- 172.21.15.53:0/582936642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c0b3ce0 0x7f2f8c069f50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 --2- 172.21.15.53:0/582936642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c15a4a0 0x7f2f8c0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- 172.21.15.53:0/582936642 >> 172.21.15.53:0/582936642 conn(0x7f2f8c0b0a30 msgr2=0x7f2f8c0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- 172.21.15.53:0/582936642 shutdown_connections 2024-09-13T18:27:06.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- 172.21.15.53:0/582936642 wait complete. 2024-09-13T18:27:06.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 Processor -- start 2024-09-13T18:27:06.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- start start 2024-09-13T18:27:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c06a490 0x7f2f8c14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c0b3ce0 0x7f2f8c152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f8c15a4a0 0x7f2f8c15c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c15b170 con 0x7f2f8c06a490 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c15b3c0 con 0x7f2f8c15a4a0 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f93591640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c15b6a0 con 0x7f2f8c0b3ce0 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f9132d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c06a490 0x7f2f8c14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f9132d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c06a490 0x7f2f8c14d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60008/0 (socket says 172.21.15.53:60008) 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f9132d640 1 -- 172.21.15.53:0/3621709906 learned_addr learned my addr 172.21.15.53:0/3621709906 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f90b2c640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c0b3ce0 0x7f2f8c152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.105+0000 7f2f91b2e640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f8c15a4a0 0x7f2f8c15c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f9132d640 1 -- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c0b3ce0 msgr2=0x7f2f8c152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f9132d640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c0b3ce0 0x7f2f8c152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f9132d640 1 -- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f8c15a4a0 msgr2=0x7f2f8c15c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f9132d640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f8c15a4a0 0x7f2f8c15c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f9132d640 1 -- 172.21.15.53:0/3621709906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c009480 con 0x7f2f8c06a490 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f9132d640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c06a490 0x7f2f8c14d770 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800d5f0 tx=0x7f2f8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f81ffb640 1 -- 172.21.15.53:0/3621709906 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880125f0 con 0x7f2f8c06a490 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f81ffb640 1 -- 172.21.15.53:0/3621709906 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88012750 con 0x7f2f8c06a490 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c15b980 con 0x7f2f8c06a490 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f81ffb640 1 -- 172.21.15.53:0/3621709906 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88012ae0 con 0x7f2f8c06a490 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c15bf40 con 0x7f2f8c06a490 2024-09-13T18:27:06.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c069f50 con 0x7f2f8c06a490 2024-09-13T18:27:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f81ffb640 1 -- 172.21.15.53:0/3621709906 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f2f88012c40 con 0x7f2f8c06a490 2024-09-13T18:27:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f81ffb640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f70066840 0x7f2f70068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f81ffb640 1 -- 172.21.15.53:0/3621709906 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f880849c0 con 0x7f2f8c06a490 2024-09-13T18:27:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f90b2c640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f70066840 0x7f2f70068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.109+0000 7f2f90b2c640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f70066840 0x7f2f70068d00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0ae000 tx=0x7f2f7c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.113+0000 7f2f81ffb640 1 -- 172.21.15.53:0/3621709906 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f88051b40 con 0x7f2f8c06a490 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f8c06ae40 con 0x7f2f8c06a490 2024-09-13T18:27:06.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f81ffb640 1 -- 172.21.15.53:0/3621709906 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2f88007380 con 0x7f2f8c06a490 2024-09-13T18:27:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:27:06.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f70066840 msgr2=0x7f2f70068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f70066840 0x7f2f70068d00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0ae000 tx=0x7f2f7c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c06a490 msgr2=0x7f2f8c14d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c06a490 0x7f2f8c14d770 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800d5f0 tx=0x7f2f8800dab0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 shutdown_connections 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f70066840 0x7f2f70068d00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f8c0b3ce0 0x7f2f8c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f8c15a4a0 0x7f2f8c15c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 --2- 172.21.15.53:0/3621709906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8c06a490 0x7f2f8c14d770 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 >> 172.21.15.53:0/3621709906 conn(0x7f2f8c0b0a30 msgr2=0x7f2f8c153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 shutdown_connections 2024-09-13T18:27:06.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.285+0000 7f2f93591640 1 -- 172.21.15.53:0/3621709906 wait complete. 2024-09-13T18:27:06.307 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:27:06.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:06.307 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:27:06.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35358]: fuse finished with error 0 and tester_r 0 2024-09-13T18:27:06.322 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:27:06.352 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:27:06.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:27:06.353 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:27:06.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3edba7640 1 Processor -- start 2024-09-13T18:27:06.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3edba7640 1 -- start start 2024-09-13T18:27:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3edba7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3e81582a0 0x7fe3e806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3edba7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3e80713a0 0x7fe3e806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3edba7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e806d480 con 0x7fe3e815b7c0 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3edba7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e815aaf0 con 0x7fe3e80713a0 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3edba7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e806d760 con 0x7fe3e81582a0 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3e80713a0 0x7fe3e806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe3e815b7c0 0x7fe3e8070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38404/0 (socket says 172.21.15.53:38404) 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e6ffd640 1 -- 172.21.15.53:0/447216735 learned_addr learned my addr 172.21.15.53:0/447216735 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3e80713a0 0x7fe3e806ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60016/0 (socket says 172.21.15.53:60016) 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e77fe640 1 --2- 172.21.15.53:0/447216735 >> v2:172.21.15.87:3300/0 conn(0x7fe3e81582a0 0x7fe3e806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e7fff640 1 -- 172.21.15.53:0/447216735 >> v2:172.21.15.87:3300/0 conn(0x7fe3e81582a0 msgr2=0x7fe3e806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e7fff640 1 --2- 172.21.15.53:0/447216735 >> v2:172.21.15.87:3300/0 conn(0x7fe3e81582a0 0x7fe3e806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e7fff640 1 -- 172.21.15.53:0/447216735 >> v1:172.21.15.53:6789/0 conn(0x7fe3e815b7c0 legacy=0x7fe3e8070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e7fff640 1 -- 172.21.15.53:0/447216735 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e815ace0 con 0x7fe3e80713a0 2024-09-13T18:27:06.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.529+0000 7fe3e67fc640 1 -- 172.21.15.53:0/447216735 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201954707 0 0) 0x7fe3e806d480 con 0x7fe3e815b7c0 2024-09-13T18:27:06.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 --2- 172.21.15.53:0/447216735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e80713a0 0x7fe3e806ce40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8069f50 tx=0x7fe3e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d362c5e225d342a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e67fc640 1 -- 172.21.15.53:0/447216735 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00a7070 con 0x7fe3e80713a0 2024-09-13T18:27:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e67fc640 1 -- 172.21.15.53:0/447216735 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e00ab430 con 0x7fe3e80713a0 2024-09-13T18:27:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e67fc640 1 -- 172.21.15.53:0/447216735 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00ab7c0 con 0x7fe3e80713a0 2024-09-13T18:27:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- 172.21.15.53:0/447216735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e80713a0 msgr2=0x7fe3e806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 --2- 172.21.15.53:0/447216735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e80713a0 0x7fe3e806ce40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8069f50 tx=0x7fe3e001c430 comp rx=0 tx=0).stop 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- 172.21.15.53:0/447216735 shutdown_connections 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 --2- 172.21.15.53:0/447216735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e80713a0 0x7fe3e806ce40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 --2- 172.21.15.53:0/447216735 >> v2:172.21.15.87:3300/0 conn(0x7fe3e81582a0 0x7fe3e806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- 172.21.15.53:0/447216735 >> 172.21.15.53:0/447216735 conn(0x7fe3e8065c80 msgr2=0x7fe3e8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- 172.21.15.53:0/447216735 shutdown_connections 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- 172.21.15.53:0/447216735 wait complete. 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 Processor -- start 2024-09-13T18:27:06.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- start start 2024-09-13T18:27:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3e80713a0 0x7fe3e814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e81582a0 0x7fe3e8152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e815b7c0 0x7fe3e806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e81528b0 con 0x7fe3e815b7c0 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8152ac0 con 0x7fe3e81582a0 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3edba7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8152da0 con 0x7fe3e80713a0 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e815b7c0 0x7fe3e806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e815b7c0 0x7fe3e806fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60022/0 (socket says 172.21.15.53:60022) 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 -- 172.21.15.53:0/2926288316 learned_addr learned my addr 172.21.15.53:0/2926288316 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e6ffd640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e81582a0 0x7fe3e8152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 -- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3e80713a0 msgr2=0x7fe3e814a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3e80713a0 0x7fe3e814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 -- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e81582a0 msgr2=0x7fe3e8152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e81582a0 0x7fe3e8152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 -- 172.21.15.53:0/2926288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0009420 con 0x7fe3e815b7c0 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.533+0000 7fe3e7fff640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e815b7c0 0x7fe3e806fe80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00ad040 tx=0x7fe3e001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3cffff640 1 -- 172.21.15.53:0/2926288316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00b5810 con 0x7fe3e815b7c0 2024-09-13T18:27:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3cffff640 1 -- 172.21.15.53:0/2926288316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e00b5970 con 0x7fe3e815b7c0 2024-09-13T18:27:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e8153080 con 0x7fe3e815b7c0 2024-09-13T18:27:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3cffff640 1 -- 172.21.15.53:0/2926288316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00b5d20 con 0x7fe3e815b7c0 2024-09-13T18:27:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e8153640 con 0x7fe3e815b7c0 2024-09-13T18:27:06.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e8067400 con 0x7fe3e815b7c0 2024-09-13T18:27:06.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3cffff640 1 -- 172.21.15.53:0/2926288316 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe3e00bf410 con 0x7fe3e815b7c0 2024-09-13T18:27:06.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3cffff640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe3d4066840 0x7fe3d4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3cffff640 1 -- 172.21.15.53:0/2926288316 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3e011ecf0 con 0x7fe3e815b7c0 2024-09-13T18:27:06.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3e77fe640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe3d4066840 0x7fe3d4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.537+0000 7fe3e77fe640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe3d4066840 0x7fe3d4068d00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80070b0 tx=0x7fe3d8007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.541+0000 7fe3cffff640 1 -- 172.21.15.53:0/2926288316 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3e0123070 con 0x7fe3e815b7c0 2024-09-13T18:27:06.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3e8152ee0 con 0x7fe3e815b7c0 2024-09-13T18:27:06.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3cffff640 1 -- 172.21.15.53:0/2926288316 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fe3e8152ee0 con 0x7fe3e815b7c0 2024-09-13T18:27:06.742 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:06.742 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:06.742 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe3d4066840 msgr2=0x7fe3d4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe3d4066840 0x7fe3d4068d00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80070b0 tx=0x7fe3d8007040 comp rx=0 tx=0).stop 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e815b7c0 msgr2=0x7fe3e806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e815b7c0 0x7fe3e806fe80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00ad040 tx=0x7fe3e001ac70 comp rx=0 tx=0).stop 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 shutdown_connections 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe3d4066840 0x7fe3d4068d00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3e815b7c0 0x7fe3e806fe80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3e81582a0 0x7fe3e8152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 --2- 172.21.15.53:0/2926288316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3e80713a0 0x7fe3e814a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 >> 172.21.15.53:0/2926288316 conn(0x7fe3e8065c80 msgr2=0x7fe3e80ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 shutdown_connections 2024-09-13T18:27:06.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:06.737+0000 7fe3edba7640 1 -- 172.21.15.53:0/2926288316 wait complete. 2024-09-13T18:27:06.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:06.896 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-09-13T18:27:06.896 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-13T18:27:06.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol56700 2024-09-13T18:27:07.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f495291e640 1 Processor -- start 2024-09-13T18:27:07.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f495291e640 1 -- start start 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f495291e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c165400 0x7f494c1677f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f495291e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c160ca0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f495291e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c161130 con 0x7f494c15fd60 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f495291e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c160370 con 0x7f494c165400 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f494b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f494c0cf0a0 0x7f494c0cf4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42036/0 (socket says 172.21.15.53:42036) 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f494b7fe640 1 -- 172.21.15.53:0/3248652971 learned_addr learned my addr 172.21.15.53:0/3248652971 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f4950ebb640 1 --2- 172.21.15.53:0/3248652971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c165400 0x7f494c1677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051295927 0 0) 0x7f494c160ca0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4934003530 con 0x7f494c0cf0a0 2024-09-13T18:27:07.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136533793 0 0) 0x7f494c161130 con 0x7f494c15fd60 2024-09-13T18:27:07.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f494c160ca0 con 0x7f494c15fd60 2024-09-13T18:27:07.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f4950ebb640 1 -- 172.21.15.53:0/3248652971 >> v1:172.21.15.87:6789/0 conn(0x7f494c15fd60 legacy=0x7f494c0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f4950ebb640 1 -- 172.21.15.53:0/3248652971 >> v1:172.21.15.53:6789/0 conn(0x7f494c0cf0a0 legacy=0x7f494c0cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1616380823 0 0) 0x7f4934003530 con 0x7f494c0cf0a0 2024-09-13T18:27:07.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.017+0000 7f4950ebb640 1 -- 172.21.15.53:0/3248652971 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c160650 con 0x7f494c165400 2024-09-13T18:27:07.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f4950ebb640 1 --2- 172.21.15.53:0/3248652971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c165400 0x7f494c1677f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49440097f0 tx=0x7f494401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c808d3ca575e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940001a00 con 0x7f494c165400 2024-09-13T18:27:07.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49440a7050 con 0x7f494c165400 2024-09-13T18:27:07.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f494affd640 1 -- 172.21.15.53:0/3248652971 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49440ab600 con 0x7f494c165400 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 -- 172.21.15.53:0/3248652971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c165400 msgr2=0x7f494c1677f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 --2- 172.21.15.53:0/3248652971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c165400 0x7f494c1677f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49440097f0 tx=0x7f494401c400 comp rx=0 tx=0).stop 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 -- 172.21.15.53:0/3248652971 shutdown_connections 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 --2- 172.21.15.53:0/3248652971 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c165400 0x7f494c1677f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 -- 172.21.15.53:0/3248652971 >> 172.21.15.53:0/3248652971 conn(0x7f494c070970 msgr2=0x7f494c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 -- 172.21.15.53:0/3248652971 shutdown_connections 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 -- 172.21.15.53:0/3248652971 wait complete. 2024-09-13T18:27:07.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 Processor -- start 2024-09-13T18:27:07.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.021+0000 7f495291e640 1 -- start start 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f494c0cf0a0 0x7f494c0b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c15fd60 0x7f494c15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f494c165400 0x7f494c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c15aac0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0b8520 con 0x7f494c165400 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c15ad40 con 0x7f494c15fd60 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f494c0cf0a0 0x7f494c0b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f494c0cf0a0 0x7f494c0b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37990/0 (socket says 172.21.15.53:37990) 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 -- 172.21.15.53:0/1944402165 learned_addr learned my addr 172.21.15.53:0/1944402165 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4950ebb640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f494c165400 0x7f494c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 -- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c15fd60 msgr2=0x7f494c15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494b7fe640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c15fd60 0x7f494c15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c15fd60 0x7f494c15b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 -- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f494c165400 msgr2=0x7f494c153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f494c165400 0x7f494c153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 -- 172.21.15.53:0/1944402165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009420 con 0x7f494c0cf0a0 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4950ebb640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f494c165400 0x7f494c153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494bfff640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f494c0cf0a0 0x7f494c0b7f40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c490 tx=0x7f493c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4948ff9640 1 -- 172.21.15.53:0/1944402165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0052d0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4948ff9640 1 -- 172.21.15.53:0/1944402165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c005430 con 0x7f494c0cf0a0 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c15b020 con 0x7f494c0cf0a0 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4948ff9640 1 -- 172.21.15.53:0/1944402165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c012870 con 0x7f494c0cf0a0 2024-09-13T18:27:07.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c154e10 con 0x7f494c0cf0a0 2024-09-13T18:27:07.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c15b4d0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4948ff9640 1 -- 172.21.15.53:0/1944402165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f493c0129d0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4948ff9640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4938066840 0x7f4938068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f4948ff9640 1 -- 172.21.15.53:0/1944402165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f493c084af0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.025+0000 7f494b7fe640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4938066840 0x7f4938068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.029+0000 7f494b7fe640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4938066840 0x7f4938068d00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f494c0b4840 tx=0x7f4940009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.029+0000 7f4948ff9640 1 -- 172.21.15.53:0/1944402165 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f493c051cc0 con 0x7f494c0cf0a0 2024-09-13T18:27:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.217+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol56700", "target": ["mon-mgr", ""]}) v1 -- 0x7f494c0cd750 con 0x7f4938066840 2024-09-13T18:27:07.233 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:27:07.230+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:27:07.233 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:27:07.230+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:27:07.233 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:27:07.230+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:27:07.233 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:27:07.230+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:27:07.233 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:27:07.230+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:27:07.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f4948ff9640 1 -- 172.21.15.53:0/1944402165 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4940001eb0 con 0x7f4938066840 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4938066840 msgr2=0x7f4938068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4938066840 0x7f4938068d00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f494c0b4840 tx=0x7f4940009040 comp rx=0 tx=0).stop 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f494c0cf0a0 msgr2=0x7f494c0b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f494c0cf0a0 0x7f494c0b7f40 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c490 tx=0x7f493c00c950 comp rx=0 tx=0).stop 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 shutdown_connections 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4938066840 0x7f4938068d00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f494c15fd60 0x7f494c15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f494c165400 0x7f494c153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 --2- 172.21.15.53:0/1944402165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f494c0cf0a0 0x7f494c0b7f40 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 >> 172.21.15.53:0/1944402165 conn(0x7f494c070970 msgr2=0x7f494c0c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:07.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 shutdown_connections 2024-09-13T18:27:07.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.273+0000 7f495291e640 1 -- 172.21.15.53:0/1944402165 wait complete. 2024-09-13T18:27:07.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.413+0000 7f3ff44c2640 1 Processor -- start 2024-09-13T18:27:07.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.413+0000 7f3ff44c2640 1 -- start start 2024-09-13T18:27:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff44c2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fec15b7c0 0x7f3fec070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff44c2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff44c2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec06d480 con 0x7f3fec1582a0 2024-09-13T18:27:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff44c2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec15aaf0 con 0x7f3fec15b7c0 2024-09-13T18:27:07.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff44c2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec06d760 con 0x7f3fec0711d0 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff1a5d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fec15b7c0 0x7f3fec070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff2a5f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff225e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3fec1582a0 0x7f3fec06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:53912/0 (socket says 172.21.15.53:53912) 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff225e640 1 -- 172.21.15.53:0/4111553544 learned_addr learned my addr 172.21.15.53:0/4111553544 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff1a5d640 1 -- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 msgr2=0x7f3fec1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff1a5d640 1 --2- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff1a5d640 1 -- 172.21.15.53:0/4111553544 >> v1:172.21.15.87:6789/0 conn(0x7f3fec1582a0 legacy=0x7f3fec06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff1a5d640 1 -- 172.21.15.53:0/4111553544 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec15ace0 con 0x7f3fec15b7c0 2024-09-13T18:27:07.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff2a5f640 1 --2- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:27:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.417+0000 7f3ff1a5d640 1 --2- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec15b7c0 0x7f3fec070c90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0097c0 tx=0x7f3fdc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315f79b720e289d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff125c640 1 -- 172.21.15.53:0/4111553544 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0ad640 con 0x7f3fec15b7c0 2024-09-13T18:27:07.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff125c640 1 -- 172.21.15.53:0/4111553544 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0ad7a0 con 0x7f3fec15b7c0 2024-09-13T18:27:07.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff125c640 1 -- 172.21.15.53:0/4111553544 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0adb30 con 0x7f3fec15b7c0 2024-09-13T18:27:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec15b7c0 msgr2=0x7f3fec070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec15b7c0 0x7f3fec070c90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0097c0 tx=0x7f3fdc01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- 172.21.15.53:0/4111553544 shutdown_connections 2024-09-13T18:27:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/4111553544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec15b7c0 0x7f3fec070c90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- 172.21.15.53:0/4111553544 >> 172.21.15.53:0/4111553544 conn(0x7f3fec065c80 msgr2=0x7f3fec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- 172.21.15.53:0/4111553544 shutdown_connections 2024-09-13T18:27:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- 172.21.15.53:0/4111553544 wait complete. 2024-09-13T18:27:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 Processor -- start 2024-09-13T18:27:07.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- start start 2024-09-13T18:27:07.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec1582a0 0x7f3fec1f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fec15b7c0 0x7f3fec138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec1f36c0 con 0x7f3fec15b7c0 2024-09-13T18:27:07.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec1586f0 con 0x7f3fec1582a0 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff44c2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec158f90 con 0x7f3fec0711d0 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff2a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fec15b7c0 0x7f3fec138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff2a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fec15b7c0 0x7f3fec138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38000/0 (socket says 172.21.15.53:38000) 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff2a5f640 1 -- 172.21.15.53:0/1818823847 learned_addr learned my addr 172.21.15.53:0/1818823847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.421+0000 7f3ff225e640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff1a5d640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec1582a0 0x7f3fec1f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff2a5f640 1 -- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 msgr2=0x7f3fec14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff2a5f640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff2a5f640 1 -- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec1582a0 msgr2=0x7f3fec1f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff2a5f640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec1582a0 0x7f3fec1f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff2a5f640 1 -- 172.21.15.53:0/1818823847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009a70 con 0x7f3fec15b7c0 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff1a5d640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec1582a0 0x7f3fec1f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff2a5f640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fec15b7c0 0x7f3fec138ac0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400efc0 tx=0x7f3fe4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3fe2ffd640 1 -- 172.21.15.53:0/1818823847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4009d70 con 0x7f3fec15b7c0 2024-09-13T18:27:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3fe2ffd640 1 -- 172.21.15.53:0/1818823847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400f040 con 0x7f3fec15b7c0 2024-09-13T18:27:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3fe2ffd640 1 -- 172.21.15.53:0/1818823847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40039a0 con 0x7f3fec15b7c0 2024-09-13T18:27:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc009420 con 0x7f3fec15b7c0 2024-09-13T18:27:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec150610 con 0x7f3fec15b7c0 2024-09-13T18:27:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec067400 con 0x7f3fec15b7c0 2024-09-13T18:27:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3fe2ffd640 1 -- 172.21.15.53:0/1818823847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f3fe40144a0 con 0x7f3fec15b7c0 2024-09-13T18:27:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3fe2ffd640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3fd0066870 0x7f3fd0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3fe2ffd640 1 -- 172.21.15.53:0/1818823847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fe4085160 con 0x7f3fec15b7c0 2024-09-13T18:27:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff225e640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3fd0066870 0x7f3fd0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.425+0000 7f3ff225e640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3fd0066870 0x7f3fd0068d30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8005890 tx=0x7f3fe8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.429+0000 7f3fe2ffd640 1 -- 172.21.15.53:0/1818823847 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3fe4052130 con 0x7f3fec15b7c0 2024-09-13T18:27:07.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.625+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fec0ae9b0 con 0x7f3fec15b7c0 2024-09-13T18:27:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.625+0000 7f3fe2ffd640 1 -- 172.21.15.53:0/1818823847 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f3fe4055750 con 0x7f3fec15b7c0 2024-09-13T18:27:07.631 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:07.631 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:07.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3fd0066870 msgr2=0x7f3fd0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3fd0066870 0x7f3fd0068d30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8005890 tx=0x7f3fe8009040 comp rx=0 tx=0).stop 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fec15b7c0 msgr2=0x7f3fec138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fec15b7c0 0x7f3fec138ac0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400efc0 tx=0x7f3fe4009f90 comp rx=0 tx=0).stop 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 shutdown_connections 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3fd0066870 0x7f3fd0068d30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fec15b7c0 0x7f3fec138ac0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fec1582a0 0x7f3fec1f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 --2- 172.21.15.53:0/1818823847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fec0711d0 0x7f3fec14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 >> 172.21.15.53:0/1818823847 conn(0x7f3fec065c80 msgr2=0x7f3fec151480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 shutdown_connections 2024-09-13T18:27:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.629+0000 7f3ff44c2640 1 -- 172.21.15.53:0/1818823847 wait complete. 2024-09-13T18:27:07.651 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:07.793 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.54398208599999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.973270898227778,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:07.794 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.973270898227778 }, "state": "open", "uptime": 0.543982086 } ] 2024-09-13T18:27:07.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:07.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b3344640 1 Processor -- start 2024-09-13T18:27:07.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b3344640 1 -- start start 2024-09-13T18:27:07.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b3344640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f93ac0cb980 0x7f93ac0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b3344640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b3344640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0b1ac0 con 0x7f93ac06b850 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b3344640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0b3010 con 0x7f93ac0cb980 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b3344640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac159ac0 con 0x7f93ac0cbd60 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b08df640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f93ac06b850 0x7f93ac06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42046/0 (socket says 172.21.15.53:42046) 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b08df640 1 -- 172.21.15.53:0/935551503 learned_addr learned my addr 172.21.15.53:0/935551503 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b10e0640 1 --2- 172.21.15.53:0/935551503 >> v2:172.21.15.53:3300/0 conn(0x7f93ac0cb980 0x7f93ac0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b18e1640 1 --2- 172.21.15.53:0/935551503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93a3fff640 1 -- 172.21.15.53:0/935551503 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297852401 0 0) 0x7f93ac0b1ac0 con 0x7f93ac06b850 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93a3fff640 1 -- 172.21.15.53:0/935551503 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9398003530 con 0x7f93ac06b850 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b10e0640 1 -- 172.21.15.53:0/935551503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 msgr2=0x7f93ac0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b10e0640 1 --2- 172.21.15.53:0/935551503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b10e0640 1 -- 172.21.15.53:0/935551503 >> v1:172.21.15.53:6789/0 conn(0x7f93ac06b850 legacy=0x7f93ac06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93a3fff640 1 -- 172.21.15.53:0/935551503 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217405453 0 0) 0x7f9398003530 con 0x7f93ac06b850 2024-09-13T18:27:07.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.913+0000 7f93b10e0640 1 -- 172.21.15.53:0/935551503 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac159da0 con 0x7f93ac0cb980 2024-09-13T18:27:07.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b10e0640 1 --2- 172.21.15.53:0/935551503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac0b33b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a801c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7700725620a4d12b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93a3fff640 1 -- 172.21.15.53:0/935551503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c001680 con 0x7f93ac0cb980 2024-09-13T18:27:07.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93a3fff640 1 -- 172.21.15.53:0/935551503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a80a55d0 con 0x7f93ac0cb980 2024-09-13T18:27:07.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93a3fff640 1 -- 172.21.15.53:0/935551503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a5940 con 0x7f93ac0cb980 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- 172.21.15.53:0/935551503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 msgr2=0x7f93ac0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 --2- 172.21.15.53:0/935551503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac0b33b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a801c7d0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- 172.21.15.53:0/935551503 shutdown_connections 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 --2- 172.21.15.53:0/935551503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 --2- 172.21.15.53:0/935551503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac0b33b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- 172.21.15.53:0/935551503 >> 172.21.15.53:0/935551503 conn(0x7f93ac065c80 msgr2=0x7f93ac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- 172.21.15.53:0/935551503 shutdown_connections 2024-09-13T18:27:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- 172.21.15.53:0/935551503 wait complete. 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 Processor -- start 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- start start 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac06b850 0x7f93ac1f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1f6c60 con 0x7f93ac0cb980 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1f66a0 con 0x7f93ac06b850 2024-09-13T18:27:07.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b3344640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1f6980 con 0x7f93ac0cbd60 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38010/0 (socket says 172.21.15.53:38010) 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 -- 172.21.15.53:0/3264782373 learned_addr learned my addr 172.21.15.53:0/3264782373 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b18e1640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b10e0640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac06b850 0x7f93ac1f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 -- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 msgr2=0x7f93ac14fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac14fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 -- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac06b850 msgr2=0x7f93ac1f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac06b850 0x7f93ac1f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 -- 172.21.15.53:0/3264782373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a8009a70 con 0x7f93ac0cb980 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93b08df640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac149820 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c750 tx=0x7f939c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.917+0000 7f93a1ffb640 1 -- 172.21.15.53:0/3264782373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c005ae0 con 0x7f93ac0cb980 2024-09-13T18:27:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93a1ffb640 1 -- 172.21.15.53:0/3264782373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c005c40 con 0x7f93ac0cb980 2024-09-13T18:27:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac14f370 con 0x7f93ac0cb980 2024-09-13T18:27:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93a1ffb640 1 -- 172.21.15.53:0/3264782373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c007070 con 0x7f93ac0cb980 2024-09-13T18:27:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac1f62e0 con 0x7f93ac0cb980 2024-09-13T18:27:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac067400 con 0x7f93ac0cb980 2024-09-13T18:27:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93a1ffb640 1 -- 172.21.15.53:0/3264782373 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 7) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f939c0071d0 con 0x7f93ac0cb980 2024-09-13T18:27:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93a1ffb640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066840 0x7f9390068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93a1ffb640 1 -- 172.21.15.53:0/3264782373 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f939c084140 con 0x7f93ac0cb980 2024-09-13T18:27:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93b10e0640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066840 0x7f9390068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.921+0000 7f93b10e0640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066840 0x7f9390068d00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93a80af000 tx=0x7f93a80a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:07.925+0000 7f93a1ffb640 1 -- 172.21.15.53:0/3264782373 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f939c0512c0 con 0x7f93ac0cb980 2024-09-13T18:27:08.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.125+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93ac0b2be0 con 0x7f93ac0cb980 2024-09-13T18:27:08.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.125+0000 7f93a1ffb640 1 -- 172.21.15.53:0/3264782373 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f939c0548e0 con 0x7f93ac0cb980 2024-09-13T18:27:08.132 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:08.132 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:08.132 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066840 msgr2=0x7f9390068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066840 0x7f9390068d00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93a80af000 tx=0x7f93a80a7070 comp rx=0 tx=0).stop 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 msgr2=0x7f93ac149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac149820 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c750 tx=0x7f939c00cc10 comp rx=0 tx=0).stop 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 shutdown_connections 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9390066840 0x7f9390068d00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ac0cbd60 0x7f93ac14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:08.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ac0cb980 0x7f93ac149820 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:08.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 --2- 172.21.15.53:0/3264782373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ac06b850 0x7f93ac1f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:08.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 >> 172.21.15.53:0/3264782373 conn(0x7f93ac065c80 msgr2=0x7f93ac0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:08.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 shutdown_connections 2024-09-13T18:27:08.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:08.129+0000 7f93b3344640 1 -- 172.21.15.53:0/3264782373 wait complete. 2024-09-13T18:27:08.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:08.275 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":1.0279661449999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.948713227411663,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:08.275 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.948713227411663 }, "state": "open", "uptime": 1.027966145 } ] 2024-09-13T18:27:08.275 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:13.276 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 Processor -- start 2024-09-13T18:27:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 -- start start 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdef015a470 0x7fdef00cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef0071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdef00b1c10 0x7fdef00b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef006f880 con 0x7fdef00b1c10 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef00b2600 con 0x7fdef015a470 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdef5d94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef006f550 con 0x7fdef015cc60 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdef00b1c10 0x7fdef00b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdef00b1c10 0x7fdef00b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38018/0 (socket says 172.21.15.53:38018) 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 -- 172.21.15.53:0/2941597314 learned_addr learned my addr 172.21.15.53:0/2941597314 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeeffd640 1 --2- 172.21.15.53:0/2941597314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef0071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeef7fe640 1 --2- 172.21.15.53:0/2941597314 >> v2:172.21.15.87:3300/0 conn(0x7fdef015a470 0x7fdef00cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 -- 172.21.15.53:0/2941597314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 msgr2=0x7fdef0071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 --2- 172.21.15.53:0/2941597314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef0071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 -- 172.21.15.53:0/2941597314 >> v2:172.21.15.87:3300/0 conn(0x7fdef015a470 msgr2=0x7fdef00cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 --2- 172.21.15.53:0/2941597314 >> v2:172.21.15.87:3300/0 conn(0x7fdef015a470 0x7fdef00cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeffff640 1 -- 172.21.15.53:0/2941597314 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef015dc40 con 0x7fdef00b1c10 2024-09-13T18:27:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.405+0000 7fdeeeffd640 1 --2- 172.21.15.53:0/2941597314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef0071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:13.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdeeffff640 1 --2- 172.21.15.53:0/2941597314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef00b1c10 0x7fdef00b20c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdef0069f50 tx=0x7fdee001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e6f50c4e299ada server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdeee7fc640 1 -- 172.21.15.53:0/2941597314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a5870 con 0x7fdef00b1c10 2024-09-13T18:27:13.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdeee7fc640 1 -- 172.21.15.53:0/2941597314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00a59d0 con 0x7fdef00b1c10 2024-09-13T18:27:13.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdeee7fc640 1 -- 172.21.15.53:0/2941597314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a5d60 con 0x7fdef00b1c10 2024-09-13T18:27:13.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 -- 172.21.15.53:0/2941597314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef00b1c10 msgr2=0x7fdef00b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2941597314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef00b1c10 0x7fdef00b20c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdef0069f50 tx=0x7fdee001c9f0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 -- 172.21.15.53:0/2941597314 shutdown_connections 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2941597314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef0071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2941597314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef00b1c10 0x7fdef00b20c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2941597314 >> v2:172.21.15.87:3300/0 conn(0x7fdef015a470 0x7fdef00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 -- 172.21.15.53:0/2941597314 >> 172.21.15.53:0/2941597314 conn(0x7fdef0065c80 msgr2=0x7fdef0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 -- 172.21.15.53:0/2941597314 shutdown_connections 2024-09-13T18:27:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 -- 172.21.15.53:0/2941597314 wait complete. 2024-09-13T18:27:13.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 Processor -- start 2024-09-13T18:27:13.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.409+0000 7fdef5d94640 1 -- start start 2024-09-13T18:27:13.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b1c10 0x7fdef0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef015a470 0x7fdef00c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef00c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef013f530 con 0x7fdef015a470 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0158b60 con 0x7fdef00b1c10 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0159530 con 0x7fdef015cc60 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef015a470 0x7fdef00c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef015a470 0x7fdef00c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38032/0 (socket says 172.21.15.53:38032) 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 -- 172.21.15.53:0/2362438104 learned_addr learned my addr 172.21.15.53:0/2362438104 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeffff640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef00c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeef7fe640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b1c10 0x7fdef0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 -- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 msgr2=0x7fdef00c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef00c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 -- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b1c10 msgr2=0x7fdef0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b1c10 0x7fdef0158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 -- 172.21.15.53:0/2362438104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0009b30 con 0x7fdef015a470 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeeeffd640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef015a470 0x7fdef00c5f60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fded800d7d0 tx=0x7fded800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdee7fff640 1 -- 172.21.15.53:0/2362438104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80096a0 con 0x7fdef015a470 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdee7fff640 1 -- 172.21.15.53:0/2362438104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8009800 con 0x7fdef015a470 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef0157f50 con 0x7fdef015a470 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdee7fff640 1 -- 172.21.15.53:0/2362438104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8009bb0 con 0x7fdef015a470 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef0158510 con 0x7fdef015a470 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef0067400 con 0x7fdef015a470 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdee7fff640 1 -- 172.21.15.53:0/2362438104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7fded8009d10 con 0x7fdef015a470 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdee7fff640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fded00668d0 0x7fded0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdee7fff640 1 -- 172.21.15.53:0/2362438104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fded8084d20 con 0x7fdef015a470 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.413+0000 7fdeef7fe640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fded00668d0 0x7fded0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.417+0000 7fdeef7fe640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fded00668d0 0x7fded0068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdee800ba30 tx=0x7fdee8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.417+0000 7fdee7fff640 1 -- 172.21.15.53:0/2362438104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fded8051d30 con 0x7fdef015a470 2024-09-13T18:27:13.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.609+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdef0070870 con 0x7fdef015a470 2024-09-13T18:27:13.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.609+0000 7fdee7fff640 1 -- 172.21.15.53:0/2362438104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fded800b440 con 0x7fdef015a470 2024-09-13T18:27:13.616 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:13.616 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:13.616 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fded00668d0 msgr2=0x7fded0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fded00668d0 0x7fded0068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdee800ba30 tx=0x7fdee8008040 comp rx=0 tx=0).stop 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef015a470 msgr2=0x7fdef00c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef015a470 0x7fdef00c5f60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fded800d7d0 tx=0x7fded800dc90 comp rx=0 tx=0).stop 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 shutdown_connections 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fded00668d0 0x7fded0068d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdef015cc60 0x7fdef00c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdef015a470 0x7fdef00c5f60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 --2- 172.21.15.53:0/2362438104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b1c10 0x7fdef0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 >> 172.21.15.53:0/2362438104 conn(0x7fdef0065c80 msgr2=0x7fdef00aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 shutdown_connections 2024-09-13T18:27:13.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:13.613+0000 7fdef5d94640 1 -- 172.21.15.53:0/2362438104 wait complete. 2024-09-13T18:27:13.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:13.774 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":6.5237943979999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.671769207323859,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:13.774 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.67176920732386 }, "state": "open", "uptime": 6.523794398 } ] 2024-09-13T18:27:13.774 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:18.776 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:18.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9dad157640 1 Processor -- start 2024-09-13T18:27:18.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9dad157640 1 -- start start 2024-09-13T18:27:18.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9dad157640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9da8159f10 0x7f9da815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9dad157640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 0x7f9da80c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9dad157640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da806fd50 con 0x7f9da815a830 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9dad157640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da8070b90 con 0x7f9da8159f10 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9dad157640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8071020 con 0x7f9da80719f0 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da759e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9da815a830 0x7f9da815d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55444/0 (socket says 172.21.15.53:55444) 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da759e640 1 -- 172.21.15.53:0/520092446 learned_addr learned my addr 172.21.15.53:0/520092446 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 0x7f9da80c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/520092446 >> v2:172.21.15.87:3300/0 conn(0x7f9da8159f10 0x7f9da815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116103140 0 0) 0x7f9da806fd50 con 0x7f9da815a830 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d94003530 con 0x7f9da815a830 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2824084868 0 0) 0x7f9d94003530 con 0x7f9da815a830 2024-09-13T18:27:18.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 msgr2=0x7f9da80c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 0x7f9da80c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 >> v2:172.21.15.87:3300/0 conn(0x7f9da8159f10 msgr2=0x7f9da815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 --2- 172.21.15.53:0/520092446 >> v2:172.21.15.87:3300/0 conn(0x7f9da8159f10 0x7f9da815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da806ff80 con 0x7f9da815a830 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9da0001a00 con 0x7f9da815a830 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 >> v1:172.21.15.53:6789/0 conn(0x7f9da815a830 legacy=0x7f9da815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9d94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 0x7f9d940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d94004d10 0x7f9d94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8070b90 con 0x7f9d94003980 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8071020 con 0x7f9d94004d10 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9400dba0 con 0x7f9da80719f0 2024-09-13T18:27:18.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9d94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 0x7f9d940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da759e640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d94004d10 0x7f9d94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da6d9d640 1 -- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 msgr2=0x7f9d940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da80719f0 0x7f9d940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da6d9d640 1 -- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d94004d10 msgr2=0x7f9d94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:18.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d94004d10 0x7f9d94005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.909+0000 7f9da6d9d640 1 -- 172.21.15.53:0/520092446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94003530 con 0x7f9d94003980 2024-09-13T18:27:18.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9d94003da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009b10 tx=0x7f9d9801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7bedcbc68396d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980a55a0 con 0x7f9d94003980 2024-09-13T18:27:18.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980a5700 con 0x7f9d94003980 2024-09-13T18:27:18.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9da659c640 1 -- 172.21.15.53:0/520092446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980a5ab0 con 0x7f9d94003980 2024-09-13T18:27:18.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 -- 172.21.15.53:0/520092446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 msgr2=0x7f9d94003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 --2- 172.21.15.53:0/520092446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9d94003da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009b10 tx=0x7f9d9801cab0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9da759e640 1 -- 172.21.15.53:0/520092446 reap_dead start 2024-09-13T18:27:18.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 -- 172.21.15.53:0/520092446 shutdown_connections 2024-09-13T18:27:18.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 -- 172.21.15.53:0/520092446 >> 172.21.15.53:0/520092446 conn(0x7f9da80b0840 msgr2=0x7f9da80b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:18.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 -- 172.21.15.53:0/520092446 shutdown_connections 2024-09-13T18:27:18.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 -- 172.21.15.53:0/520092446 wait complete. 2024-09-13T18:27:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 Processor -- start 2024-09-13T18:27:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.913+0000 7f9dad157640 1 -- start start 2024-09-13T18:27:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9da81f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da8158ff0 0x7f9da80afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9da80cb580 0x7f9da80cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80cbf40 con 0x7f9d94003980 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da815e3a0 con 0x7f9da80cb580 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da815e660 con 0x7f9da8158ff0 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9da81f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9da81f6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54574/0 (socket says 172.21.15.53:54574) 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 -- 172.21.15.53:0/3072157952 learned_addr learned my addr 172.21.15.53:0/3072157952 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da759e640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9da80cb580 0x7f9da80cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da8158ff0 0x7f9da80afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 -- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da8158ff0 msgr2=0x7f9da80afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da8158ff0 0x7f9da80afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 -- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9da80cb580 msgr2=0x7f9da80cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9da80cb580 0x7f9da80cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 -- 172.21.15.53:0/3072157952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da815e940 con 0x7f9d94003980 2024-09-13T18:27:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9da6d9d640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9da81f6240 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9d9801c8e0 tx=0x7f9d94005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9d9ffff640 1 -- 172.21.15.53:0/3072157952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980be070 con 0x7f9d94003980 2024-09-13T18:27:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9d9ffff640 1 -- 172.21.15.53:0/3072157952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980a5e90 con 0x7f9d94003980 2024-09-13T18:27:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da815ec20 con 0x7f9d94003980 2024-09-13T18:27:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9d9ffff640 1 -- 172.21.15.53:0/3072157952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98004020 con 0x7f9d94003980 2024-09-13T18:27:18.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da80aff60 con 0x7f9d94003980 2024-09-13T18:27:18.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da815a2f0 con 0x7f9d94003980 2024-09-13T18:27:18.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9d9ffff640 1 -- 172.21.15.53:0/3072157952 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f9d980b4040 con 0x7f9d94003980 2024-09-13T18:27:18.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9d9ffff640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d880668d0 0x7f9d88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:18.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.917+0000 7f9d9ffff640 1 -- 172.21.15.53:0/3072157952 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d9811dce0 con 0x7f9d94003980 2024-09-13T18:27:18.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.921+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d880668d0 0x7f9d88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:18.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.921+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d880668d0 0x7f9d88068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9da8153c50 tx=0x7f9d90008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:18.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:18.925+0000 7f9d9ffff640 1 -- 172.21.15.53:0/3072157952 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d980ead80 con 0x7f9d94003980 2024-09-13T18:27:19.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.117+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9da815a2f0 con 0x7f9d94003980 2024-09-13T18:27:19.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9d9ffff640 1 -- 172.21.15.53:0/3072157952 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f9d980ee3a0 con 0x7f9d94003980 2024-09-13T18:27:19.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:19.125 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:19.125 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d880668d0 msgr2=0x7f9d88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d880668d0 0x7f9d88068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9da8153c50 tx=0x7f9d90008040 comp rx=0 tx=0).stop 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 msgr2=0x7f9da81f6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9da81f6240 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9d9801c8e0 tx=0x7f9d94005800 comp rx=0 tx=0).stop 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 shutdown_connections 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d880668d0 0x7f9d88068d90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9da8158ff0 0x7f9da80afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9da80cb580 0x7f9da80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 --2- 172.21.15.53:0/3072157952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d94003980 0x7f9da81f6240 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:19.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 >> 172.21.15.53:0/3072157952 conn(0x7f9da80b0840 msgr2=0x7f9da806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:19.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 shutdown_connections 2024-09-13T18:27:19.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:19.121+0000 7f9dad157640 1 -- 172.21.15.53:0/3072157952 wait complete. 2024-09-13T18:27:19.142 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:19.280 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":12.027642670000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.397923094759637,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:19.280 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.397923094759637 }, "state": "open", "uptime": 12.02764267 } ] 2024-09-13T18:27:19.281 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:24.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:24.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb01b217640 1 Processor -- start 2024-09-13T18:27:24.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb01b217640 1 -- start start 2024-09-13T18:27:24.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb01b217640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 0x7fb0140b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb01b217640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0140b1ac0 con 0x7fb0140cb980 2024-09-13T18:27:24.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb01b217640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb014159ac0 con 0x7fb01406b850 2024-09-13T18:27:24.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb01b217640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb014159da0 con 0x7fb0140cbd60 2024-09-13T18:27:24.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb018fb3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0140cb980 0x7fb01406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55446/0 (socket says 172.21.15.53:55446) 2024-09-13T18:27:24.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb018fb3640 1 -- 172.21.15.53:0/802931198 learned_addr learned my addr 172.21.15.53:0/802931198 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0197b4640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 0x7fb0140b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085760140 0 0) 0x7fb0140b1ac0 con 0x7fb0140cb980 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb004003530 con 0x7fb0140cb980 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423536744 0 0) 0x7fb004003530 con 0x7fb0140cb980 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 msgr2=0x7fb0140b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 0x7fb0140b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 >> v1:172.21.15.87:6789/0 conn(0x7fb01406b850 legacy=0x7fb0140b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01415a080 con 0x7fb0140cb980 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb008001680 con 0x7fb0140cb980 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 >> v1:172.21.15.53:6789/0 conn(0x7fb0140cb980 legacy=0x7fb01406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040039b0 0x7fb004003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0040047d0 0x7fb004004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 0x7fb0040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014159da0 con 0x7fb0040047d0 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00400bac0 con 0x7fb0040039b0 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00400de90 con 0x7fb0140cbd60 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb013fff640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0040047d0 0x7fb004004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb018fb3640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040039b0 0x7fb004003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb0197b4640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 0x7fb0040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb013fff640 1 -- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 msgr2=0x7fb0040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb013fff640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb0140cbd60 0x7fb0040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb013fff640 1 -- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040039b0 msgr2=0x7fb004003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb013fff640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040039b0 0x7fb004003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb013fff640 1 -- 172.21.15.53:0/802931198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb004003530 con 0x7fb0040047d0 2024-09-13T18:27:24.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.413+0000 7fb018fb3640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040039b0 0x7fb004003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb013fff640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0040047d0 0x7fb004004c50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb000001750 tx=0x7fb00001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1686a99f6bb9ff5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000052d0 con 0x7fb0040047d0 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0000a7050 con 0x7fb0040047d0 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb0137fe640 1 -- 172.21.15.53:0/802931198 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000003600 con 0x7fb0040047d0 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 -- 172.21.15.53:0/802931198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0040047d0 msgr2=0x7fb004004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 --2- 172.21.15.53:0/802931198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0040047d0 0x7fb004004c50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb000001750 tx=0x7fb00001c3b0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb0197b4640 1 -- 172.21.15.53:0/802931198 reap_dead start 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 -- 172.21.15.53:0/802931198 shutdown_connections 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 -- 172.21.15.53:0/802931198 >> 172.21.15.53:0/802931198 conn(0x7fb014065c80 msgr2=0x7fb014066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:24.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 -- 172.21.15.53:0/802931198 shutdown_connections 2024-09-13T18:27:24.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 -- 172.21.15.53:0/802931198 wait complete. 2024-09-13T18:27:24.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 Processor -- start 2024-09-13T18:27:24.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.417+0000 7fb01b217640 1 -- start start 2024-09-13T18:27:24.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040047d0 0x7fb01414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0141474d0 0x7fb0141468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb014147a00 0x7fb014146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014147350 con 0x7fb0141474d0 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0140a8680 con 0x7fb0040047d0 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb014149ac0 con 0x7fb014147a00 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0141474d0 0x7fb0141468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0141474d0 0x7fb0141468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54598/0 (socket says 172.21.15.53:54598) 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 -- 172.21.15.53:0/640847896 learned_addr learned my addr 172.21.15.53:0/640847896 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0197b4640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb014147a00 0x7fb014146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb018fb3640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040047d0 0x7fb01414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 -- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb014147a00 msgr2=0x7fb014146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb014147a00 0x7fb014146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 -- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040047d0 msgr2=0x7fb01414f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040047d0 0x7fb01414f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 -- 172.21.15.53:0/640847896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014148eb0 con 0x7fb0141474d0 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0197b4640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb014147a00 0x7fb014146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb013fff640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0141474d0 0x7fb0141468d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb000001750 tx=0x7fb004005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0117fa640 1 -- 172.21.15.53:0/640847896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000007180 con 0x7fb0141474d0 2024-09-13T18:27:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0117fa640 1 -- 172.21.15.53:0/640847896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0000072e0 con 0x7fb0141474d0 2024-09-13T18:27:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb014149190 con 0x7fb0141474d0 2024-09-13T18:27:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0117fa640 1 -- 172.21.15.53:0/640847896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000007690 con 0x7fb0141474d0 2024-09-13T18:27:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01414a060 con 0x7fb0141474d0 2024-09-13T18:27:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb014067400 con 0x7fb0141474d0 2024-09-13T18:27:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0117fa640 1 -- 172.21.15.53:0/640847896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7fb0000067e0 con 0x7fb0141474d0 2024-09-13T18:27:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0117fa640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faff80668d0 0x7faff8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb0117fa640 1 -- 172.21.15.53:0/640847896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb00011e8e0 con 0x7fb0141474d0 2024-09-13T18:27:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.421+0000 7fb018fb3640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faff80668d0 0x7faff8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.425+0000 7fb018fb3640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faff80668d0 0x7faff8068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb0080017b0 tx=0x7fb008009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.425+0000 7fb0117fa640 1 -- 172.21.15.53:0/640847896 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0000eb9d0 con 0x7fb0141474d0 2024-09-13T18:27:24.548 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:24.552 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:24.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.621+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0140cdd40 con 0x7fb0141474d0 2024-09-13T18:27:24.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.621+0000 7fb0117fa640 1 -- 172.21.15.53:0/640847896 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fb0000eeff0 con 0x7fb0141474d0 2024-09-13T18:27:24.627 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:24.627 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:24.627 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:24.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faff80668d0 msgr2=0x7faff8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faff80668d0 0x7faff8068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb0080017b0 tx=0x7fb008009040 comp rx=0 tx=0).stop 2024-09-13T18:27:24.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0141474d0 msgr2=0x7fb0141468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:24.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0141474d0 0x7fb0141468d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb000001750 tx=0x7fb004005800 comp rx=0 tx=0).stop 2024-09-13T18:27:24.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 shutdown_connections 2024-09-13T18:27:24.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faff80668d0 0x7faff8068d90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb014147a00 0x7fb014146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0141474d0 0x7fb0141468d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 --2- 172.21.15.53:0/640847896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0040047d0 0x7fb01414f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 >> 172.21.15.53:0/640847896 conn(0x7fb014065c80 msgr2=0x7fb0141624c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 shutdown_connections 2024-09-13T18:27:24.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:24.625+0000 7fb01b217640 1 -- 172.21.15.53:0/640847896 wait complete. 2024-09-13T18:27:24.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:24.832 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":17.583507007000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.124998311946168,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:24.833 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.124998311946168 }, "state": "open", "uptime": 17.583507007 } ] 2024-09-13T18:27:24.833 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:29.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:29.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9186865640 1 Processor -- start 2024-09-13T18:27:29.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9186865640 1 -- start start 2024-09-13T18:27:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9186865640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 0x7f9180167210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9186865640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91800ad000 con 0x7f91800acbc0 2024-09-13T18:27:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9186865640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91800ad230 con 0x7f918015c750 2024-09-13T18:27:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9186865640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91800ad510 con 0x7f9180066390 2024-09-13T18:27:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9177fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f91800acbc0 0x7f9180065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46964/0 (socket says 172.21.15.53:46964) 2024-09-13T18:27:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9177fff640 1 -- 172.21.15.53:0/1820792504 learned_addr learned my addr 172.21.15.53:0/1820792504 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:29.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9184e02640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 0x7f9180167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076560463 0 0) 0x7f91800ad000 con 0x7f91800acbc0 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c003530 con 0x7f91800acbc0 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2328771385 0 0) 0x7f916c003530 con 0x7f91800acbc0 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 msgr2=0x7f9180167210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 0x7f9180167210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 >> v1:172.21.15.87:6789/0 conn(0x7f918015c750 legacy=0x7f91800ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800ad7f0 con 0x7f91800acbc0 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9168001680 con 0x7f91800acbc0 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 >> v1:172.21.15.53:6789/0 conn(0x7f91800acbc0 legacy=0x7f9180065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 0x7f916c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916c003f30 0x7f916c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c004d10 0x7f916c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91800ad510 con 0x7f916c004d10 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c00ba70 con 0x7f916c003f30 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c00bc30 con 0x7f9180066390 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9184e02640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c004d10 0x7f916c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9177fff640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916c003f30 0x7f916c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917ffff640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 0x7f916c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9184e02640 1 -- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 msgr2=0x7f916c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9184e02640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 0x7f916c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9184e02640 1 -- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916c003f30 msgr2=0x7f916c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9184e02640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f916c003f30 0x7f916c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f9184e02640 1 -- 172.21.15.53:0/1820792504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c003530 con 0x7f916c004d10 2024-09-13T18:27:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.964+0000 7f917ffff640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9180066390 0x7f916c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9184e02640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c004d10 0x7f916c005190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f91800af0d0 tx=0x7f917801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42ea3dc5357a731 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780a5c30 con 0x7f916c004d10 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917800f040 con 0x7f916c004d10 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f917f7fe640 1 -- 172.21.15.53:0/1820792504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780ad440 con 0x7f916c004d10 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- 172.21.15.53:0/1820792504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c004d10 msgr2=0x7f916c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 --2- 172.21.15.53:0/1820792504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c004d10 0x7f916c005190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f91800af0d0 tx=0x7f917801cc20 comp rx=0 tx=0).stop 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9184e02640 1 -- 172.21.15.53:0/1820792504 reap_dead start 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- 172.21.15.53:0/1820792504 shutdown_connections 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- 172.21.15.53:0/1820792504 >> 172.21.15.53:0/1820792504 conn(0x7f91800b1310 msgr2=0x7f91800b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- 172.21.15.53:0/1820792504 shutdown_connections 2024-09-13T18:27:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- 172.21.15.53:0/1820792504 wait complete. 2024-09-13T18:27:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 Processor -- start 2024-09-13T18:27:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- start start 2024-09-13T18:27:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916c004d10 0x7f918014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f918015e560 0x7f9180141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9180153e80 0x7f9180154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180154870 con 0x7f9180153e80 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918015ea20 con 0x7f918015e560 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9186865640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918015ed00 con 0x7f916c004d10 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.968+0000 7f9184e02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9180153e80 0x7f9180154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9180153e80 0x7f9180154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41468/0 (socket says 172.21.15.53:41468) 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 -- 172.21.15.53:0/646696442 learned_addr learned my addr 172.21.15.53:0/646696442 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9177fff640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f918015e560 0x7f9180141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917ffff640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916c004d10 0x7f918014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 -- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916c004d10 msgr2=0x7f918014fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916c004d10 0x7f918014fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 -- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f918015e560 msgr2=0x7f9180141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f918015e560 0x7f9180141df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 -- 172.21.15.53:0/646696442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918015efe0 con 0x7f9180153e80 2024-09-13T18:27:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9184e02640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9180153e80 0x7f9180154330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9178002240 tx=0x7f9178009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917d7fa640 1 -- 172.21.15.53:0/646696442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780ae890 con 0x7f9180153e80 2024-09-13T18:27:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917d7fa640 1 -- 172.21.15.53:0/646696442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91780aea10 con 0x7f9180153e80 2024-09-13T18:27:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918015f2c0 con 0x7f9180153e80 2024-09-13T18:27:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917d7fa640 1 -- 172.21.15.53:0/646696442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780aedc0 con 0x7f9180153e80 2024-09-13T18:27:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9180151ad0 con 0x7f9180153e80 2024-09-13T18:27:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91800ad000 con 0x7f9180153e80 2024-09-13T18:27:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917d7fa640 1 -- 172.21.15.53:0/646696442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f91780b4040 con 0x7f9180153e80 2024-09-13T18:27:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917d7fa640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91600668d0 0x7f9160068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917d7fa640 1 -- 172.21.15.53:0/646696442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f917811ee30 con 0x7f9180153e80 2024-09-13T18:27:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917ffff640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91600668d0 0x7f9160068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:29.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.972+0000 7f917ffff640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91600668d0 0x7f9160068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c10 tx=0x7f9170009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:29.976+0000 7f917d7fa640 1 -- 172.21.15.53:0/646696442 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f91780ebf10 con 0x7f9180153e80 2024-09-13T18:27:30.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.168+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91800ae380 con 0x7f9180153e80 2024-09-13T18:27:30.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f917d7fa640 1 -- 172.21.15.53:0/646696442 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f91780b2070 con 0x7f9180153e80 2024-09-13T18:27:30.177 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:30.177 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:30.177 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:30.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91600668d0 msgr2=0x7f9160068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91600668d0 0x7f9160068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c10 tx=0x7f9170009040 comp rx=0 tx=0).stop 2024-09-13T18:27:30.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9180153e80 msgr2=0x7f9180154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9180153e80 0x7f9180154330 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9178002240 tx=0x7f9178009750 comp rx=0 tx=0).stop 2024-09-13T18:27:30.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 shutdown_connections 2024-09-13T18:27:30.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f91600668d0 0x7f9160068d90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9180153e80 0x7f9180154330 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f918015e560 0x7f9180141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 --2- 172.21.15.53:0/646696442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f916c004d10 0x7f918014fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 >> 172.21.15.53:0/646696442 conn(0x7f91800b1310 msgr2=0x7f918006db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 shutdown_connections 2024-09-13T18:27:30.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:30.172+0000 7f9186865640 1 -- 172.21.15.53:0/646696442 wait complete. 2024-09-13T18:27:30.196 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:30.333 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":23.083385483000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.8582525524067,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:30.333 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.8582525524067 }, "state": "open", "uptime": 23.083385483 } ] 2024-09-13T18:27:30.334 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:35.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:35.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a47af640 1 Processor -- start 2024-09-13T18:27:35.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a47af640 1 -- start start 2024-09-13T18:27:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a47af640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f989c0cbb60 0x7f989c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a47af640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c0b2860 con 0x7f989c158ba0 2024-09-13T18:27:35.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a47af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c158f80 con 0x7f989c06fa80 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a47af640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0b2580 con 0x7f989c0cbb60 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a254b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f989c158ba0 0x7f989c06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46974/0 (socket says 172.21.15.53:46974) 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a254b640 1 -- 172.21.15.53:0/973014988 learned_addr learned my addr 172.21.15.53:0/973014988 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a2d4c640 1 --2- 172.21.15.53:0/973014988 >> v2:172.21.15.87:3300/0 conn(0x7f989c0cbb60 0x7f989c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941348851 0 0) 0x7f989c0b2860 con 0x7f989c158ba0 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9888003530 con 0x7f989c158ba0 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2672904578 0 0) 0x7f9888003530 con 0x7f989c158ba0 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 >> v2:172.21.15.87:3300/0 conn(0x7f989c0cbb60 msgr2=0x7f989c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 --2- 172.21.15.53:0/973014988 >> v2:172.21.15.87:3300/0 conn(0x7f989c0cbb60 0x7f989c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 >> v1:172.21.15.87:6789/0 conn(0x7f989c06fa80 legacy=0x7f989c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0cc3a0 con 0x7f989c158ba0 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f988c001680 con 0x7f989c158ba0 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 >> v1:172.21.15.53:6789/0 conn(0x7f989c158ba0 legacy=0x7f989c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9888003980 0x7f9888003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98880047d0 0x7f9888004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9888005190 0x7f988800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0b2580 con 0x7f98880047d0 2024-09-13T18:27:35.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988800c130 con 0x7f9888005190 2024-09-13T18:27:35.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988800c2f0 con 0x7f9888003980 2024-09-13T18:27:35.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1d4a640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98880047d0 0x7f9888004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a2d4c640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9888005190 0x7f988800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a254b640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9888003980 0x7f9888003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1d4a640 1 -- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9888003980 msgr2=0x7f9888003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:35.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1d4a640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9888003980 0x7f9888003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1d4a640 1 -- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9888005190 msgr2=0x7f988800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:35.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1d4a640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9888005190 0x7f988800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a1d4a640 1 -- 172.21.15.53:0/973014988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9888003530 con 0x7f98880047d0 2024-09-13T18:27:35.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.464+0000 7f98a2d4c640 1 -- 172.21.15.53:0/973014988 reap_dead start 2024-09-13T18:27:35.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98880047d0 0x7f9888004c50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9898001780 tx=0x7f989801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd73ccf0055adce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980052d0 con 0x7f98880047d0 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98980a7050 con 0x7f98880047d0 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1549640 1 -- 172.21.15.53:0/973014988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898003600 con 0x7f98880047d0 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- 172.21.15.53:0/973014988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98880047d0 msgr2=0x7f9888004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98880047d0 0x7f9888004c50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9898001780 tx=0x7f989801c400 comp rx=0 tx=0).stop 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- 172.21.15.53:0/973014988 shutdown_connections 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 --2- 172.21.15.53:0/973014988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98880047d0 0x7f9888004c50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- 172.21.15.53:0/973014988 >> 172.21.15.53:0/973014988 conn(0x7f989c065c80 msgr2=0x7f989c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- 172.21.15.53:0/973014988 shutdown_connections 2024-09-13T18:27:35.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- 172.21.15.53:0/973014988 wait complete. 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 Processor -- start 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- start start 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98880047d0 0x7f989c0c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989c0a9550 0x7f989c0a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f989c14c930 0x7f989c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c14d2f0 con 0x7f989c0a9550 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0ab7a0 con 0x7f98880047d0 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a47af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0aba80 con 0x7f989c14c930 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989c0a9550 0x7f989c0a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989c0a9550 0x7f989c0a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41482/0 (socket says 172.21.15.53:41482) 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 -- 172.21.15.53:0/1414447982 learned_addr learned my addr 172.21.15.53:0/1414447982 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a254b640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98880047d0 0x7f989c0c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a2d4c640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f989c14c930 0x7f989c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 -- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f989c14c930 msgr2=0x7f989c14cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f989c14c930 0x7f989c14cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 -- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98880047d0 msgr2=0x7f989c0c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98880047d0 0x7f989c0c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a1d4a640 1 -- 172.21.15.53:0/1414447982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0abd60 con 0x7f989c0a9550 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.468+0000 7f98a2d4c640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f989c14c930 0x7f989c14cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f98a1d4a640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989c0a9550 0x7f989c0a99b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f989801c230 tx=0x7f9888005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f9892ffd640 1 -- 172.21.15.53:0/1414447982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980072f0 con 0x7f989c0a9550 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f9892ffd640 1 -- 172.21.15.53:0/1414447982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9898007450 con 0x7f989c0a9550 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c0ac040 con 0x7f989c0a9550 2024-09-13T18:27:35.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f9892ffd640 1 -- 172.21.15.53:0/1414447982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980067e0 con 0x7f989c0a9550 2024-09-13T18:27:35.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c0ac600 con 0x7f989c0a9550 2024-09-13T18:27:35.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c067400 con 0x7f989c0a9550 2024-09-13T18:27:35.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f9892ffd640 1 -- 172.21.15.53:0/1414447982 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f9898006940 con 0x7f989c0a9550 2024-09-13T18:27:35.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f9892ffd640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9880066900 0x7f9880068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:35.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f9892ffd640 1 -- 172.21.15.53:0/1414447982 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f989811e5d0 con 0x7f989c0a9550 2024-09-13T18:27:35.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f98a254b640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9880066900 0x7f9880068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:35.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.472+0000 7f98a254b640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9880066900 0x7f9880068dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f988c000c10 tx=0x7f988c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:35.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.476+0000 7f9892ffd640 1 -- 172.21.15.53:0/1414447982 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98980eb590 con 0x7f989c0a9550 2024-09-13T18:27:35.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.668+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f989c0cce80 con 0x7f989c0a9550 2024-09-13T18:27:35.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.668+0000 7f9892ffd640 1 -- 172.21.15.53:0/1414447982 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f98980aae80 con 0x7f989c0a9550 2024-09-13T18:27:35.676 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:35.676 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:35.676 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:35.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9880066900 msgr2=0x7f9880068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9880066900 0x7f9880068dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f988c000c10 tx=0x7f988c009040 comp rx=0 tx=0).stop 2024-09-13T18:27:35.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989c0a9550 msgr2=0x7f989c0a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:35.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989c0a9550 0x7f989c0a99b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f989801c230 tx=0x7f9888005800 comp rx=0 tx=0).stop 2024-09-13T18:27:35.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 shutdown_connections 2024-09-13T18:27:35.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9880066900 0x7f9880068dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f989c14c930 0x7f989c14cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f989c0a9550 0x7f989c0a99b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 --2- 172.21.15.53:0/1414447982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98880047d0 0x7f989c0c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 >> 172.21.15.53:0/1414447982 conn(0x7f989c065c80 msgr2=0x7f989c0aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 shutdown_connections 2024-09-13T18:27:35.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:35.672+0000 7f98a47af640 1 -- 172.21.15.53:0/1414447982 wait complete. 2024-09-13T18:27:35.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:35.828 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":28.57927604,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.59506475976691,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:35.829 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.59506475976691 }, "state": "open", "uptime": 28.57927604 } ] 2024-09-13T18:27:35.829 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:40.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.960+0000 7f65bc3c3640 1 Processor -- start 2024-09-13T18:27:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.960+0000 7f65bc3c3640 1 -- start start 2024-09-13T18:27:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65bc3c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65b41582a0 0x7f65b406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65bc3c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65bc3c3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f65b4070c90 0x7f65b4071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65bc3c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b415aaf0 con 0x7f65b41582a0 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65bc3c3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b406d760 con 0x7f65b4070c90 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65bc3c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4071650 con 0x7f65b415b7c0 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65b41582a0 0x7f65b406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65b41582a0 0x7f65b406c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44078/0 (socket says 172.21.15.53:44078) 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 -- 172.21.15.53:0/2918505624 learned_addr learned my addr 172.21.15.53:0/2918505624 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65b995e640 1 --2- 172.21.15.53:0/2918505624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 -- 172.21.15.53:0/2918505624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 msgr2=0x7f65b406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 --2- 172.21.15.53:0/2918505624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 -- 172.21.15.53:0/2918505624 >> v2:172.21.15.87:3300/0 conn(0x7f65b4070c90 msgr2=0x7f65b4071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba960640 1 --2- 172.21.15.53:0/2918505624 >> v2:172.21.15.87:3300/0 conn(0x7f65b4070c90 0x7f65b4071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 --2- 172.21.15.53:0/2918505624 >> v2:172.21.15.87:3300/0 conn(0x7f65b4070c90 0x7f65b4071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 -- 172.21.15.53:0/2918505624 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b406d480 con 0x7f65b41582a0 2024-09-13T18:27:40.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65ba15f640 1 --2- 172.21.15.53:0/2918505624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b41582a0 0x7f65b406c900 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f65b4066c00 tx=0x7f65b001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1ecde7f848b164 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65b915d640 1 -- 172.21.15.53:0/2918505624 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00aa610 con 0x7f65b41582a0 2024-09-13T18:27:40.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65b915d640 1 -- 172.21.15.53:0/2918505624 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00a6040 con 0x7f65b41582a0 2024-09-13T18:27:40.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.964+0000 7f65b915d640 1 -- 172.21.15.53:0/2918505624 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00aa990 con 0x7f65b41582a0 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- 172.21.15.53:0/2918505624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b41582a0 msgr2=0x7f65b406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/2918505624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b41582a0 0x7f65b406c900 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f65b4066c00 tx=0x7f65b001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- 172.21.15.53:0/2918505624 shutdown_connections 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/2918505624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/2918505624 >> v2:172.21.15.87:3300/0 conn(0x7f65b4070c90 0x7f65b4071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/2918505624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b41582a0 0x7f65b406c900 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- 172.21.15.53:0/2918505624 >> 172.21.15.53:0/2918505624 conn(0x7f65b4065c80 msgr2=0x7f65b4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- 172.21.15.53:0/2918505624 shutdown_connections 2024-09-13T18:27:40.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- 172.21.15.53:0/2918505624 wait complete. 2024-09-13T18:27:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 Processor -- start 2024-09-13T18:27:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- start start 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b4070c90 0x7f65b41f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65b41582a0 0x7f65b4141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b414f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4159530 con 0x7f65b4070c90 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b41f5890 con 0x7f65b41582a0 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65bc3c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b414e500 con 0x7f65b415b7c0 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b4070c90 0x7f65b41f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b4070c90 0x7f65b41f5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44086/0 (socket says 172.21.15.53:44086) 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 -- 172.21.15.53:0/656472710 learned_addr learned my addr 172.21.15.53:0/656472710 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:40.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba960640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b414f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65b995e640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65b41582a0 0x7f65b4141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 -- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 msgr2=0x7f65b414f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b414f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 -- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65b41582a0 msgr2=0x7f65b4141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65b41582a0 0x7f65b4141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 -- 172.21.15.53:0/656472710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00094d0 con 0x7f65b4070c90 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65b995e640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65b41582a0 0x7f65b4141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.968+0000 7f65ba15f640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b4070c90 0x7f65b41f5350 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f65b00ac040 tx=0x7f65b001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65aaffd640 1 -- 172.21.15.53:0/656472710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00b3600 con 0x7f65b4070c90 2024-09-13T18:27:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65aaffd640 1 -- 172.21.15.53:0/656472710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00b3780 con 0x7f65b4070c90 2024-09-13T18:27:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4158920 con 0x7f65b4070c90 2024-09-13T18:27:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65aaffd640 1 -- 172.21.15.53:0/656472710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00b3b30 con 0x7f65b4070c90 2024-09-13T18:27:40.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b4158ee0 con 0x7f65b4070c90 2024-09-13T18:27:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b4067400 con 0x7f65b4070c90 2024-09-13T18:27:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65aaffd640 1 -- 172.21.15.53:0/656472710 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f65b00b3c90 con 0x7f65b4070c90 2024-09-13T18:27:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65aaffd640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f65980668d0 0x7f6598068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65aaffd640 1 -- 172.21.15.53:0/656472710 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f65b011f1d0 con 0x7f65b4070c90 2024-09-13T18:27:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65b995e640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f65980668d0 0x7f6598068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:40.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.972+0000 7f65b995e640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f65980668d0 0x7f6598068d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f65a4006fd0 tx=0x7f65a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:40.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:40.980+0000 7f65aaffd640 1 -- 172.21.15.53:0/656472710 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65b00ec120 con 0x7f65b4070c90 2024-09-13T18:27:41.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.176+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b40700e0 con 0x7f65b4070c90 2024-09-13T18:27:41.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.176+0000 7f65aaffd640 1 -- 172.21.15.53:0/656472710 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f65b00ef740 con 0x7f65b4070c90 2024-09-13T18:27:41.184 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:41.184 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:41.184 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f65980668d0 msgr2=0x7f6598068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f65980668d0 0x7f6598068d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f65a4006fd0 tx=0x7f65a4008040 comp rx=0 tx=0).stop 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b4070c90 msgr2=0x7f65b41f5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b4070c90 0x7f65b41f5350 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f65b00ac040 tx=0x7f65b001ad30 comp rx=0 tx=0).stop 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 shutdown_connections 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f65980668d0 0x7f6598068d90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65b415b7c0 0x7f65b414f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65b41582a0 0x7f65b4141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 --2- 172.21.15.53:0/656472710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65b4070c90 0x7f65b41f5350 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 >> 172.21.15.53:0/656472710 conn(0x7f65b4065c80 msgr2=0x7f65b4066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 shutdown_connections 2024-09-13T18:27:41.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:41.180+0000 7f65bc3c3640 1 -- 172.21.15.53:0/656472710 wait complete. 2024-09-13T18:27:41.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:41.349 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":34.099175189999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.334069854771396,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:41.350 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.334069854771396 }, "state": "open", "uptime": 34.09917519 } ] 2024-09-13T18:27:41.350 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:46.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c740c3640 1 Processor -- start 2024-09-13T18:27:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c740c3640 1 -- start start 2024-09-13T18:27:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c740c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c6c15cab0 0x7f0c6c0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c740c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c740c3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c0d2400 con 0x7f0c6c0cdb00 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c740c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6c0d1530 con 0x7f0c6c15cab0 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c740c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0d0920 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c71e5f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c6c15cab0 0x7f0c6c0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c72660640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0c6c0cdb00 0x7f0c6c0b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51980/0 (socket says 172.21.15.53:51980) 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.480+0000 7f0c72660640 1 -- 172.21.15.53:0/739552076 learned_addr learned my addr 172.21.15.53:0/739552076 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c7165e640 1 --2- 172.21.15.53:0/739552076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c71e5f640 1 -- 172.21.15.53:0/739552076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c0cd6c0 msgr2=0x7f0c6c0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c71e5f640 1 --2- 172.21.15.53:0/739552076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c71e5f640 1 -- 172.21.15.53:0/739552076 >> v1:172.21.15.53:6789/0 conn(0x7f0c6c0cdb00 legacy=0x7f0c6c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c71e5f640 1 -- 172.21.15.53:0/739552076 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0d0c00 con 0x7f0c6c15cab0 2024-09-13T18:27:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c7165e640 1 --2- 172.21.15.53:0/739552076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c71e5f640 1 --2- 172.21.15.53:0/739552076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c15cab0 0x7f0c6c0d19c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009d90 tx=0x7f0c6401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f066b35c0defbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c70e5d640 1 -- 172.21.15.53:0/739552076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640a5910 con 0x7f0c6c15cab0 2024-09-13T18:27:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c70e5d640 1 -- 172.21.15.53:0/739552076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c640a5a70 con 0x7f0c6c15cab0 2024-09-13T18:27:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c70e5d640 1 -- 172.21.15.53:0/739552076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640a5e00 con 0x7f0c6c15cab0 2024-09-13T18:27:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 -- 172.21.15.53:0/739552076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c15cab0 msgr2=0x7f0c6c0d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 --2- 172.21.15.53:0/739552076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c15cab0 0x7f0c6c0d19c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009d90 tx=0x7f0c6401c940 comp rx=0 tx=0).stop 2024-09-13T18:27:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 -- 172.21.15.53:0/739552076 shutdown_connections 2024-09-13T18:27:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 --2- 172.21.15.53:0/739552076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 --2- 172.21.15.53:0/739552076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c15cab0 0x7f0c6c0d19c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 -- 172.21.15.53:0/739552076 >> 172.21.15.53:0/739552076 conn(0x7f0c6c065c80 msgr2=0x7f0c6c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 -- 172.21.15.53:0/739552076 shutdown_connections 2024-09-13T18:27:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.484+0000 7f0c740c3640 1 -- 172.21.15.53:0/739552076 wait complete. 2024-09-13T18:27:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 Processor -- start 2024-09-13T18:27:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 -- start start 2024-09-13T18:27:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c6c0cdb00 0x7f0c6c155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c15cab0 0x7f0c6c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0cb5c0 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c14d380 con 0x7f0c6c0cdb00 2024-09-13T18:27:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0cb7f0 con 0x7f0c6c15cab0 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44114/0 (socket says 172.21.15.53:44114) 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 -- 172.21.15.53:0/2956544782 learned_addr learned my addr 172.21.15.53:0/2956544782 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c7165e640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c6c0cdb00 0x7f0c6c155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c72660640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c15cab0 0x7f0c6c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 -- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c15cab0 msgr2=0x7f0c6c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c15cab0 0x7f0c6c15def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 -- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c6c0cdb00 msgr2=0x7f0c6c155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c6c0cdb00 0x7f0c6c155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 -- 172.21.15.53:0/2956544782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64009a70 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c7165e640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c6c0cdb00 0x7f0c6c155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c71e5f640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cb080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0c6401a570 tx=0x7f0c640196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c6a7fc640 1 -- 172.21.15.53:0/2956544782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640ad750 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c6a7fc640 1 -- 172.21.15.53:0/2956544782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c640ad8b0 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c0cbad0 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c6a7fc640 1 -- 172.21.15.53:0/2956544782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640adc60 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c15d6f0 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.488+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c0cb930 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.492+0000 7f0c6a7fc640 1 -- 172.21.15.53:0/2956544782 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f0c640b8420 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.492+0000 7f0c6a7fc640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c580668d0 0x7f0c58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.492+0000 7f0c6a7fc640 1 -- 172.21.15.53:0/2956544782 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0c6411f960 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.492+0000 7f0c7165e640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c580668d0 0x7f0c58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.492+0000 7f0c7165e640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c580668d0 0x7f0c58068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c14d0a0 tx=0x7f0c60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:46.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.496+0000 7f0c6a7fc640 1 -- 172.21.15.53:0/2956544782 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c6c0cb930 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c6c0cb930 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c6a7fc640 1 -- 172.21.15.53:0/2956544782 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f0c6c0cb930 con 0x7f0c6c0cd6c0 2024-09-13T18:27:46.698 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:46.698 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:46.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c580668d0 msgr2=0x7f0c58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c580668d0 0x7f0c58068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c14d0a0 tx=0x7f0c60008040 comp rx=0 tx=0).stop 2024-09-13T18:27:46.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c0cd6c0 msgr2=0x7f0c6c0cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cb080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0c6401a570 tx=0x7f0c640196e0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 shutdown_connections 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c580668d0 0x7f0c58068d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c6c15cab0 0x7f0c6c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c6c0cdb00 0x7f0c6c155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 --2- 172.21.15.53:0/2956544782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c6c0cd6c0 0x7f0c6c0cb080 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 >> 172.21.15.53:0/2956544782 conn(0x7f0c6c065c80 msgr2=0x7f0c6c0b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.692+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 shutdown_connections 2024-09-13T18:27:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:46.696+0000 7f0c740c3640 1 -- 172.21.15.53:0/2956544782 wait complete. 2024-09-13T18:27:46.720 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:46.854 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":39.603083822000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.077124212281664,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:46.854 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.077124212281664 }, "state": "open", "uptime": 39.603083822 } ] 2024-09-13T18:27:46.855 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:51.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.984+0000 7fd0d6ec3640 1 Processor -- start 2024-09-13T18:27:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.984+0000 7fd0d6ec3640 1 -- start start 2024-09-13T18:27:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0d00d19c0 0x7fd0d00cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d00d2400 con 0x7fd0d00cf600 2024-09-13T18:27:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d00d1530 con 0x7fd0d015cab0 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d00cfa90 con 0x7fd0d00d19c0 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0d00d19c0 0x7fd0d00cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d5460640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd0d00cf600 0x7fd0d00b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53304/0 (socket says 172.21.15.53:53304) 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0d00d19c0 0x7fd0d00cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41424/0 (socket says 172.21.15.53:41424) 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c7fff640 1 -- 172.21.15.53:0/3768196532 learned_addr learned my addr 172.21.15.53:0/3768196532 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c7fff640 1 -- 172.21.15.53:0/3768196532 >> v1:172.21.15.87:6789/0 conn(0x7fd0d015cab0 legacy=0x7fd0d00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c7fff640 1 -- 172.21.15.53:0/3768196532 >> v1:172.21.15.53:6789/0 conn(0x7fd0d00cf600 legacy=0x7fd0d00b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c7fff640 1 -- 172.21.15.53:0/3768196532 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00cddd0 con 0x7fd0d00d19c0 2024-09-13T18:27:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c77fe640 1 -- 172.21.15.53:0/3768196532 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004763646 0 0) 0x7fd0d00d2400 con 0x7fd0d00cf600 2024-09-13T18:27:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c7fff640 1 --2- 172.21.15.53:0/3768196532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00cf0c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009870 tx=0x7fd0c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbc35fb3e08c355 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c77fe640 1 -- 172.21.15.53:0/3768196532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ab610 con 0x7fd0d00d19c0 2024-09-13T18:27:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c77fe640 1 -- 172.21.15.53:0/3768196532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00ab770 con 0x7fd0d00d19c0 2024-09-13T18:27:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0c77fe640 1 -- 172.21.15.53:0/3768196532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00abb00 con 0x7fd0d00d19c0 2024-09-13T18:27:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/3768196532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 msgr2=0x7fd0d00cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/3768196532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00cf0c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009870 tx=0x7fd0c001c520 comp rx=0 tx=0).stop 2024-09-13T18:27:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/3768196532 shutdown_connections 2024-09-13T18:27:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/3768196532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00cf0c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/3768196532 >> 172.21.15.53:0/3768196532 conn(0x7fd0d0065c80 msgr2=0x7fd0d0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/3768196532 shutdown_connections 2024-09-13T18:27:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.988+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/3768196532 wait complete. 2024-09-13T18:27:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 Processor -- start 2024-09-13T18:27:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 -- start start 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d00cf600 0x7fd0d01532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0d015cab0 0x7fd0d00b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00cd4f0 con 0x7fd0d00d19c0 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d01537f0 con 0x7fd0d00cf600 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00cc8e0 con 0x7fd0d015cab0 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41440/0 (socket says 172.21.15.53:41440) 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 -- 172.21.15.53:0/835909886 learned_addr learned my addr 172.21.15.53:0/835909886 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d4c5f640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d00cf600 0x7fd0d01532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d5460640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0d015cab0 0x7fd0d00b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 -- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0d015cab0 msgr2=0x7fd0d00b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0d015cab0 0x7fd0d00b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 -- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d00cf600 msgr2=0x7fd0d01532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d00cf600 0x7fd0d01532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 -- 172.21.15.53:0/835909886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00094d0 con 0x7fd0d00d19c0 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d4c5f640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d00cf600 0x7fd0d01532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c7fff640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00caa10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00ad040 tx=0x7fd0c001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c57fa640 1 -- 172.21.15.53:0/835909886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00b4800 con 0x7fd0d00d19c0 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c57fa640 1 -- 172.21.15.53:0/835909886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00b4960 con 0x7fd0d00d19c0 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d00ccbc0 con 0x7fd0d00d19c0 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0c57fa640 1 -- 172.21.15.53:0/835909886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00b4d10 con 0x7fd0d00d19c0 2024-09-13T18:27:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d00cd180 con 0x7fd0d00d19c0 2024-09-13T18:27:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.992+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d00cd660 con 0x7fd0d00d19c0 2024-09-13T18:27:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.996+0000 7fd0c57fa640 1 -- 172.21.15.53:0/835909886 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7fd0c00c83a0 con 0x7fd0d00d19c0 2024-09-13T18:27:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.996+0000 7fd0c57fa640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0bc0668d0 0x7fd0bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.996+0000 7fd0c57fa640 1 -- 172.21.15.53:0/835909886 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd0c011f050 con 0x7fd0d00d19c0 2024-09-13T18:27:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.996+0000 7fd0d4c5f640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0bc0668d0 0x7fd0bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:51.996+0000 7fd0d4c5f640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0bc0668d0 0x7fd0bc068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00b5180 tx=0x7fd0cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:52.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.000+0000 7fd0c57fa640 1 -- 172.21.15.53:0/835909886 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd0c00ec090 con 0x7fd0d00d19c0 2024-09-13T18:27:52.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.192+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0d0067910 con 0x7fd0d00d19c0 2024-09-13T18:27:52.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.192+0000 7fd0c57fa640 1 -- 172.21.15.53:0/835909886 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fd0d0067910 con 0x7fd0d00d19c0 2024-09-13T18:27:52.199 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:52.200 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:52.200 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0bc0668d0 msgr2=0x7fd0bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0bc0668d0 0x7fd0bc068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00b5180 tx=0x7fd0cc008040 comp rx=0 tx=0).stop 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 msgr2=0x7fd0d00caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00caa10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00ad040 tx=0x7fd0c001ad60 comp rx=0 tx=0).stop 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 shutdown_connections 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd0bc0668d0 0x7fd0bc068d90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0d015cab0 0x7fd0d00b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0d00d19c0 0x7fd0d00caa10 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 --2- 172.21.15.53:0/835909886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0d00cf600 0x7fd0d01532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 >> 172.21.15.53:0/835909886 conn(0x7fd0d0065c80 msgr2=0x7fd0d00b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 shutdown_connections 2024-09-13T18:27:52.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:52.196+0000 7fd0d6ec3640 1 -- 172.21.15.53:0/835909886 wait complete. 2024-09-13T18:27:52.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:52.350 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":45.102998521000004,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.82360832003511,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:52.351 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.82360832003511 }, "state": "open", "uptime": 45.102998521 } ] 2024-09-13T18:27:52.351 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:27:54.671 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:54.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:27:57.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:27:57.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.480+0000 7f8583ebf640 1 Processor -- start 2024-09-13T18:27:57.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.480+0000 7f8583ebf640 1 -- start start 2024-09-13T18:27:57.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8583ebf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 0x7f857c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8583ebf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f857c0711d0 0x7f857c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8583ebf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c06d480 con 0x7f857c1582a0 2024-09-13T18:27:57.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8583ebf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c15aaf0 con 0x7f857c0711d0 2024-09-13T18:27:57.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8583ebf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c06d760 con 0x7f857c15b7c0 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8581c5b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f857c1582a0 0x7f857c06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45972/0 (socket says 172.21.15.53:45972) 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8581c5b640 1 -- 172.21.15.53:0/120239118 learned_addr learned my addr 172.21.15.53:0/120239118 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858145a640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 0x7f857c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858245c640 1 --2- 172.21.15.53:0/120239118 >> v2:172.21.15.87:3300/0 conn(0x7f857c0711d0 0x7f857c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138540226 0 0) 0x7f857c06d480 con 0x7f857c1582a0 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8568003530 con 0x7f857c1582a0 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2291265243 0 0) 0x7f8568003530 con 0x7f857c1582a0 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 msgr2=0x7f857c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 0x7f857c070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 >> v2:172.21.15.87:3300/0 conn(0x7f857c0711d0 msgr2=0x7f857c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 --2- 172.21.15.53:0/120239118 >> v2:172.21.15.87:3300/0 conn(0x7f857c0711d0 0x7f857c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c15ace0 con 0x7f857c1582a0 2024-09-13T18:27:57.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8574001a00 con 0x7f857c1582a0 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 >> v1:172.21.15.53:6789/0 conn(0x7f857c1582a0 legacy=0x7f857c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8568003980 0x7f8568003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85680047d0 0x7f8568004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 0x7f8568005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856800b990 con 0x7f85680047d0 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856800bad0 con 0x7f8568003980 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856800bc10 con 0x7f857c15b7c0 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858145a640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85680047d0 0x7f8568004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858245c640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 0x7f8568005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8581c5b640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8568003980 0x7f8568003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858145a640 1 -- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 msgr2=0x7f8568005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858145a640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c15b7c0 0x7f8568005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858145a640 1 -- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8568003980 msgr2=0x7f8568003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:27:57.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858145a640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8568003980 0x7f8568003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f858145a640 1 -- 172.21.15.53:0/120239118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568003530 con 0x7f85680047d0 2024-09-13T18:27:57.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.484+0000 7f8581c5b640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8568003980 0x7f8568003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:57.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f858145a640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85680047d0 0x7f8568004c50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f856c009ae0 tx=0x7f856c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78625f23235dfa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:57.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0a5580 con 0x7f85680047d0 2024-09-13T18:27:57.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c0a56e0 con 0x7f85680047d0 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8580c59640 1 -- 172.21.15.53:0/120239118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0a5a90 con 0x7f85680047d0 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- 172.21.15.53:0/120239118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85680047d0 msgr2=0x7f8568004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 --2- 172.21.15.53:0/120239118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85680047d0 0x7f8568004c50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f856c009ae0 tx=0x7f856c01ca70 comp rx=0 tx=0).stop 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f858245c640 1 -- 172.21.15.53:0/120239118 reap_dead start 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- 172.21.15.53:0/120239118 shutdown_connections 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- 172.21.15.53:0/120239118 >> 172.21.15.53:0/120239118 conn(0x7f857c065c80 msgr2=0x7f857c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- 172.21.15.53:0/120239118 shutdown_connections 2024-09-13T18:27:57.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- 172.21.15.53:0/120239118 wait complete. 2024-09-13T18:27:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 Processor -- start 2024-09-13T18:27:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- start start 2024-09-13T18:27:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85680047d0 0x7f857c1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f857c0b2b50 0x7f857c0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c144ce0 0x7f857c145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c153d20 con 0x7f857c0b2b50 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c155040 con 0x7f85680047d0 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8583ebf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c153fa0 con 0x7f857c144ce0 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f858145a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f857c0b2b50 0x7f857c0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f858145a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f857c0b2b50 0x7f857c0acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52254/0 (socket says 172.21.15.53:52254) 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f858145a640 1 -- 172.21.15.53:0/3642967050 learned_addr learned my addr 172.21.15.53:0/3642967050 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f858245c640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c144ce0 0x7f857c145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.488+0000 7f8581c5b640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85680047d0 0x7f857c1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f858145a640 1 -- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c144ce0 msgr2=0x7f857c145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f858145a640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c144ce0 0x7f857c145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f858145a640 1 -- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85680047d0 msgr2=0x7f857c1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f858145a640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85680047d0 0x7f857c1537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f858145a640 1 -- 172.21.15.53:0/3642967050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c154280 con 0x7f857c0b2b50 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f858145a640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f857c0b2b50 0x7f857c0acb40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f856c009ae0 tx=0x7f8568005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f85727fc640 1 -- 172.21.15.53:0/3642967050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0be070 con 0x7f857c0b2b50 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f85727fc640 1 -- 172.21.15.53:0/3642967050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c004020 con 0x7f857c0b2b50 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c154560 con 0x7f857c0b2b50 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f85727fc640 1 -- 172.21.15.53:0/3642967050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0a5580 con 0x7f857c0b2b50 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c154b20 con 0x7f857c0b2b50 2024-09-13T18:27:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c067400 con 0x7f857c0b2b50 2024-09-13T18:27:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f85727fc640 1 -- 172.21.15.53:0/3642967050 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f856c0b4040 con 0x7f857c0b2b50 2024-09-13T18:27:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f85727fc640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85600668d0 0x7f8560068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f85727fc640 1 -- 172.21.15.53:0/3642967050 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f856c11e010 con 0x7f857c0b2b50 2024-09-13T18:27:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f8581c5b640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85600668d0 0x7f8560068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.492+0000 7f8581c5b640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85600668d0 0x7f8560068d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85740013e0 tx=0x7f85740018c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:57.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.496+0000 7f85727fc640 1 -- 172.21.15.53:0/3642967050 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f856c0eb070 con 0x7f857c0b2b50 2024-09-13T18:27:57.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.692+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f857c0cb8d0 con 0x7f857c0b2b50 2024-09-13T18:27:57.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.692+0000 7f85727fc640 1 -- 172.21.15.53:0/3642967050 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f856c0ee690 con 0x7f857c0b2b50 2024-09-13T18:27:57.699 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:27:57.699 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:27:57.699 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:27:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85600668d0 msgr2=0x7f8560068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85600668d0 0x7f8560068d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85740013e0 tx=0x7f85740018c0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f857c0b2b50 msgr2=0x7f857c0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f857c0b2b50 0x7f857c0acb40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f856c009ae0 tx=0x7f8568005800 comp rx=0 tx=0).stop 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 shutdown_connections 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f85600668d0 0x7f8560068d90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f857c144ce0 0x7f857c145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f857c0b2b50 0x7f857c0acb40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 --2- 172.21.15.53:0/3642967050 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85680047d0 0x7f857c1537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 >> 172.21.15.53:0/3642967050 conn(0x7f857c065c80 msgr2=0x7f857c0cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 shutdown_connections 2024-09-13T18:27:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:27:57.696+0000 7f8583ebf640 1 -- 172.21.15.53:0/3642967050 wait complete. 2024-09-13T18:27:57.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:27:57.862 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":50.610932302000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.572930947889763,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:27:57.862 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.572930947889763 }, "state": "open", "uptime": 50.610932302 } ] 2024-09-13T18:27:57.863 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:28:02.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:03.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.992+0000 7f4db0383640 1 Processor -- start 2024-09-13T18:28:03.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.992+0000 7f4db0383640 1 -- start start 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4db0383640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4da80cb980 0x7f4da80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4db0383640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4da806b850 0x7f4da80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4db0383640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da80cbd60 0x7f4da806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4db0383640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80b1ac0 con 0x7f4da80cb980 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4db0383640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da8159ac0 con 0x7f4da806b850 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4db0383640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8159da0 con 0x7f4da80cbd60 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4da80cb980 0x7f4da80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4da80cb980 0x7f4da80b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52262/0 (socket says 172.21.15.53:52262) 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 -- 172.21.15.53:0/2596748773 learned_addr learned my addr 172.21.15.53:0/2596748773 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dad91e640 1 --2- 172.21.15.53:0/2596748773 >> v2:172.21.15.87:3300/0 conn(0x7f4da806b850 0x7f4da80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae920640 1 --2- 172.21.15.53:0/2596748773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da80cbd60 0x7f4da806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 -- 172.21.15.53:0/2596748773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da80cbd60 msgr2=0x7f4da806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 --2- 172.21.15.53:0/2596748773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da80cbd60 0x7f4da806fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 -- 172.21.15.53:0/2596748773 >> v2:172.21.15.87:3300/0 conn(0x7f4da806b850 msgr2=0x7f4da80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 --2- 172.21.15.53:0/2596748773 >> v2:172.21.15.87:3300/0 conn(0x7f4da806b850 0x7f4da80cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae11f640 1 -- 172.21.15.53:0/2596748773 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da815a080 con 0x7f4da80cb980 2024-09-13T18:28:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dad91e640 1 --2- 172.21.15.53:0/2596748773 >> v2:172.21.15.87:3300/0 conn(0x7f4da806b850 0x7f4da80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:03.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:02.996+0000 7f4dae920640 1 --2- 172.21.15.53:0/2596748773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da80cbd60 0x7f4da806fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:03.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae11f640 1 --2- 172.21.15.53:0/2596748773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cb980 0x7f4da80b33b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4da80b38f0 tx=0x7f4da401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8181e51067c5b702 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:03.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dad11d640 1 -- 172.21.15.53:0/2596748773 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40ab600 con 0x7f4da80cb980 2024-09-13T18:28:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dad11d640 1 -- 172.21.15.53:0/2596748773 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40a7050 con 0x7f4da80cb980 2024-09-13T18:28:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dad11d640 1 -- 172.21.15.53:0/2596748773 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40ab980 con 0x7f4da80cb980 2024-09-13T18:28:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- 172.21.15.53:0/2596748773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cb980 msgr2=0x7f4da80b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 --2- 172.21.15.53:0/2596748773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cb980 0x7f4da80b33b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4da80b38f0 tx=0x7f4da401c460 comp rx=0 tx=0).stop 2024-09-13T18:28:03.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- 172.21.15.53:0/2596748773 shutdown_connections 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 --2- 172.21.15.53:0/2596748773 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da80cbd60 0x7f4da806fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 --2- 172.21.15.53:0/2596748773 >> v2:172.21.15.87:3300/0 conn(0x7f4da806b850 0x7f4da80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 --2- 172.21.15.53:0/2596748773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cb980 0x7f4da80b33b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- 172.21.15.53:0/2596748773 >> 172.21.15.53:0/2596748773 conn(0x7f4da8065c80 msgr2=0x7f4da8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- 172.21.15.53:0/2596748773 shutdown_connections 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- 172.21.15.53:0/2596748773 wait complete. 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 Processor -- start 2024-09-13T18:28:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- start start 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da806b850 0x7f4da814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4da80cb980 0x7f4da8140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cbd60 0x7f4da8160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8160650 con 0x7f4da80cbd60 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81608a0 con 0x7f4da80cb980 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4db0383640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8160b80 con 0x7f4da806b850 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cbd60 0x7f4da8160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cbd60 0x7f4da8160110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52278/0 (socket says 172.21.15.53:52278) 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 -- 172.21.15.53:0/2132418936 learned_addr learned my addr 172.21.15.53:0/2132418936 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:03.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dad91e640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4da80cb980 0x7f4da8140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae11f640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da806b850 0x7f4da814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 -- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da806b850 msgr2=0x7f4da814cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da806b850 0x7f4da814cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 -- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4da80cb980 msgr2=0x7f4da8140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4da80cb980 0x7f4da8140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae920640 1 -- 172.21.15.53:0/2132418936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da40094d0 con 0x7f4da80cbd60 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.000+0000 7f4dae11f640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da806b850 0x7f4da814cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4dae920640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cbd60 0x7f4da8160110 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4da000cef0 tx=0x7f4da000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4d9effd640 1 -- 172.21.15.53:0/2132418936 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000d840 con 0x7f4da80cbd60 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4d9effd640 1 -- 172.21.15.53:0/2132418936 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da000d9c0 con 0x7f4da80cbd60 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da8160e60 con 0x7f4da80cbd60 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4d9effd640 1 -- 172.21.15.53:0/2132418936 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000dd70 con 0x7f4da80cbd60 2024-09-13T18:28:03.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8161420 con 0x7f4da80cbd60 2024-09-13T18:28:03.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8067400 con 0x7f4da80cbd60 2024-09-13T18:28:03.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4d9effd640 1 -- 172.21.15.53:0/2132418936 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f4da001e3b0 con 0x7f4da80cbd60 2024-09-13T18:28:03.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4d9effd640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d8c066900 0x7f4d8c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4d9effd640 1 -- 172.21.15.53:0/2132418936 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4da0084f60 con 0x7f4da80cbd60 2024-09-13T18:28:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4dae11f640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d8c066900 0x7f4d8c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.004+0000 7f4dae11f640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d8c066900 0x7f4d8c068dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4da40ad000 tx=0x7f4da40a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:03.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.008+0000 7f4d9effd640 1 -- 172.21.15.53:0/2132418936 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4da00520a0 con 0x7f4da80cbd60 2024-09-13T18:28:03.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.204+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da8161640 con 0x7f4da80cbd60 2024-09-13T18:28:03.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.204+0000 7f4d9effd640 1 -- 172.21.15.53:0/2132418936 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f4da001a020 con 0x7f4da80cbd60 2024-09-13T18:28:03.212 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:03.212 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:28:03.213 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d8c066900 msgr2=0x7f4d8c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d8c066900 0x7f4d8c068dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4da40ad000 tx=0x7f4da40a6000 comp rx=0 tx=0).stop 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cbd60 msgr2=0x7f4da8160110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cbd60 0x7f4da8160110 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4da000cef0 tx=0x7f4da000a710 comp rx=0 tx=0).stop 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 shutdown_connections 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4d8c066900 0x7f4d8c068dc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4da80cbd60 0x7f4da8160110 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4da80cb980 0x7f4da8140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 --2- 172.21.15.53:0/2132418936 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4da806b850 0x7f4da814cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:03.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 >> 172.21.15.53:0/2132418936 conn(0x7f4da8065c80 msgr2=0x7f4da806fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:03.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 shutdown_connections 2024-09-13T18:28:03.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:03.208+0000 7f4db0383640 1 -- 172.21.15.53:0/2132418936 wait complete. 2024-09-13T18:28:03.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:28:03.374 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":56.122875329000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.325244473464203,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:28:03.374 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.325244473464203 }, "state": "open", "uptime": 56.122875329 } ] 2024-09-13T18:28:03.375 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:28:08.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:08.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feba49e2640 1 Processor -- start 2024-09-13T18:28:08.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feba49e2640 1 -- start start 2024-09-13T18:28:08.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feba49e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feba00713a0 0x7feba0165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feba49e2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba006d480 con 0x7feba015b7c0 2024-09-13T18:28:08.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feba49e2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba015ace0 con 0x7feba01582a0 2024-09-13T18:28:08.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feba49e2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba015aaf0 con 0x7feba00713a0 2024-09-13T18:28:08.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feb9dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7feba015b7c0 0x7feba0070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60628/0 (socket says 172.21.15.53:60628) 2024-09-13T18:28:08.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feb9ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feba00713a0 0x7feba0165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feb9dd9b640 1 -- 172.21.15.53:0/469893013 learned_addr learned my addr 172.21.15.53:0/469893013 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:08.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feb9ed9d640 1 -- 172.21.15.53:0/469893013 >> v1:172.21.15.87:6789/0 conn(0x7feba01582a0 legacy=0x7feba006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feb9ed9d640 1 -- 172.21.15.53:0/469893013 >> v1:172.21.15.53:6789/0 conn(0x7feba015b7c0 legacy=0x7feba0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.508+0000 7feb9ed9d640 1 -- 172.21.15.53:0/469893013 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba015afc0 con 0x7feba00713a0 2024-09-13T18:28:08.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feb9ed9d640 1 --2- 172.21.15.53:0/469893013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba00713a0 0x7feba0165100 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb98009d90 tx=0x7feb9801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37ced04cf68548 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feb9d59a640 1 -- 172.21.15.53:0/469893013 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980a5860 con 0x7feba00713a0 2024-09-13T18:28:08.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feb9d59a640 1 -- 172.21.15.53:0/469893013 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb980a59c0 con 0x7feba00713a0 2024-09-13T18:28:08.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feb9d59a640 1 -- 172.21.15.53:0/469893013 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980a5d50 con 0x7feba00713a0 2024-09-13T18:28:08.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 -- 172.21.15.53:0/469893013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba00713a0 msgr2=0x7feba0165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 --2- 172.21.15.53:0/469893013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba00713a0 0x7feba0165100 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7feb98009d90 tx=0x7feb9801c800 comp rx=0 tx=0).stop 2024-09-13T18:28:08.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 -- 172.21.15.53:0/469893013 shutdown_connections 2024-09-13T18:28:08.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 --2- 172.21.15.53:0/469893013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba00713a0 0x7feba0165100 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 -- 172.21.15.53:0/469893013 >> 172.21.15.53:0/469893013 conn(0x7feba0065c80 msgr2=0x7feba0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 -- 172.21.15.53:0/469893013 shutdown_connections 2024-09-13T18:28:08.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 -- 172.21.15.53:0/469893013 wait complete. 2024-09-13T18:28:08.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 Processor -- start 2024-09-13T18:28:08.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.512+0000 7feba49e2640 1 -- start start 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feba00713a0 0x7feba013d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba01582a0 0x7feba01e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015b7c0 0x7feba013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01e4db0 con 0x7feba01582a0 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0154600 con 0x7feba015b7c0 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba01e47c0 con 0x7feba00713a0 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba01582a0 0x7feba01e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba01582a0 0x7feba01e51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58832/0 (socket says 172.21.15.53:58832) 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 -- 172.21.15.53:0/2898579033 learned_addr learned my addr 172.21.15.53:0/2898579033 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:08.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9ed9d640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015b7c0 0x7feba013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9e59c640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feba00713a0 0x7feba013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 -- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feba00713a0 msgr2=0x7feba013d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feba00713a0 0x7feba013d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 -- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015b7c0 msgr2=0x7feba013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015b7c0 0x7feba013fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 -- 172.21.15.53:0/2898579033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009a70 con 0x7feba01582a0 2024-09-13T18:28:08.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9dd9b640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba01582a0 0x7feba01e51d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feb94009e80 tx=0x7feb9400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb8effd640 1 -- 172.21.15.53:0/2898579033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb940078f0 con 0x7feba01582a0 2024-09-13T18:28:08.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb8effd640 1 -- 172.21.15.53:0/2898579033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94007a50 con 0x7feba01582a0 2024-09-13T18:28:08.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba0153df0 con 0x7feba01582a0 2024-09-13T18:28:08.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb8effd640 1 -- 172.21.15.53:0/2898579033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94007e00 con 0x7feba01582a0 2024-09-13T18:28:08.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba0154320 con 0x7feba01582a0 2024-09-13T18:28:08.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba0067400 con 0x7feba01582a0 2024-09-13T18:28:08.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb8effd640 1 -- 172.21.15.53:0/2898579033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 8) v1 ==== 86296+0+0 (secure 0 0 0) 0x7feb94009070 con 0x7feba01582a0 2024-09-13T18:28:08.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb8effd640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb800668d0 0x7feb80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:08.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb8effd640 1 -- 172.21.15.53:0/2898579033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feb940864c0 con 0x7feba01582a0 2024-09-13T18:28:08.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.516+0000 7feb9e59c640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb800668d0 0x7feb80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:08.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.520+0000 7feb9e59c640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb800668d0 0x7feb80068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feba01e2750 tx=0x7feb90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:08.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.524+0000 7feb8effd640 1 -- 172.21.15.53:0/2898579033 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb94053520 con 0x7feba01582a0 2024-09-13T18:28:08.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feba01e4ef0 con 0x7feba01582a0 2024-09-13T18:28:08.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feb8effd640 1 -- 172.21.15.53:0/2898579033 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7feba01e4ef0 con 0x7feba01582a0 2024-09-13T18:28:08.722 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:08.722 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:28:08.722 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:28:08.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb800668d0 msgr2=0x7feb80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb800668d0 0x7feb80068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feba01e2750 tx=0x7feb90009040 comp rx=0 tx=0).stop 2024-09-13T18:28:08.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba01582a0 msgr2=0x7feba01e51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba01582a0 0x7feba01e51d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7feb94009e80 tx=0x7feb9400c430 comp rx=0 tx=0).stop 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 shutdown_connections 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feb800668d0 0x7feb80068d90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba015b7c0 0x7feba013fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feba01582a0 0x7feba01e51d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 --2- 172.21.15.53:0/2898579033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feba00713a0 0x7feba013d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 >> 172.21.15.53:0/2898579033 conn(0x7feba0065c80 msgr2=0x7feba0066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.716+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 shutdown_connections 2024-09-13T18:28:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:08.720+0000 7feba49e2640 1 -- 172.21.15.53:0/2898579033 wait complete. 2024-09-13T18:28:08.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:28:08.882 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5701,"entity":{"name":{"type":"client","num":5701},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":378640944}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":61.630818542,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.080868693559101,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5701 172.21.15.87:0/378640944","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:28:08.883 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 378640944, "type": "any" }, "name": { "num": 5701, "type": "client" } }, "id": 5701, "inst": "client.5701 172.21.15.87:0/378640944", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.0808686935591 }, "state": "open", "uptime": 61.630818542 } ] 2024-09-13T18:28:08.883 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-13T18:28:13.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:14.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.012+0000 7f373958b640 1 Processor -- start 2024-09-13T18:28:14.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.012+0000 7f373958b640 1 -- start start 2024-09-13T18:28:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f373958b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f37340b2320 0x7f373415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f373958b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373406f550 con 0x7f37340cc270 2024-09-13T18:28:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f373958b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373415dc40 con 0x7f373415a470 2024-09-13T18:28:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f373958b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373406f880 con 0x7f37340b2320 2024-09-13T18:28:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f37340cc270 0x7f37340b1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60638/0 (socket says 172.21.15.53:60638) 2024-09-13T18:28:14.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 -- 172.21.15.53:0/2152692356 learned_addr learned my addr 172.21.15.53:0/2152692356 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37337fe640 1 --2- 172.21.15.53:0/2152692356 >> v2:172.21.15.87:3300/0 conn(0x7f37340b2320 0x7f373415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984342541 0 0) 0x7f373406f550 con 0x7f37340cc270 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f371c003530 con 0x7f37340cc270 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71666791 0 0) 0x7f371c003530 con 0x7f37340cc270 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 >> v2:172.21.15.87:3300/0 conn(0x7f37340b2320 msgr2=0x7f373415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 --2- 172.21.15.53:0/2152692356 >> v2:172.21.15.87:3300/0 conn(0x7f37340b2320 0x7f373415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 >> v1:172.21.15.87:6789/0 conn(0x7f373415a470 legacy=0x7f3734071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340cc6d0 con 0x7f37340cc270 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3728001680 con 0x7f37340cc270 2024-09-13T18:28:14.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 >> v1:172.21.15.53:6789/0 conn(0x7f37340cc270 legacy=0x7f37340b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f371c003980 0x7f371c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f371c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f371c005190 0x7f371c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373406f880 con 0x7f371c0047d0 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c00c030 con 0x7f371c003980 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c00c1f0 con 0x7f371c005190 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f371c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f3732ffd640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f371c003980 0x7f371c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37337fe640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f371c005190 0x7f371c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 -- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f371c005190 msgr2=0x7f371c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f371c005190 0x7f371c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 -- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f371c003980 msgr2=0x7f371c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f371c003980 0x7f371c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37327fc640 1 -- 172.21.15.53:0/2152692356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c003530 con 0x7f371c0047d0 2024-09-13T18:28:14.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.016+0000 7f37337fe640 1 -- 172.21.15.53:0/2152692356 reap_dead start 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f37327fc640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f371c004c50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f372800c210 tx=0x7f372801f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c275140c1f42b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728005ae0 con 0x7f371c0047d0 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37280ab070 con 0x7f371c0047d0 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3731ffb640 1 -- 172.21.15.53:0/2152692356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728007070 con 0x7f371c0047d0 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- 172.21.15.53:0/2152692356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 msgr2=0x7f371c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f371c004c50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f372800c210 tx=0x7f372801f310 comp rx=0 tx=0).stop 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- 172.21.15.53:0/2152692356 shutdown_connections 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 --2- 172.21.15.53:0/2152692356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f371c004c50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- 172.21.15.53:0/2152692356 >> 172.21.15.53:0/2152692356 conn(0x7f3734065c80 msgr2=0x7f3734066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- 172.21.15.53:0/2152692356 shutdown_connections 2024-09-13T18:28:14.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- 172.21.15.53:0/2152692356 wait complete. 2024-09-13T18:28:14.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 Processor -- start 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- start start 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f3734146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3734155ff0 0x7f3734156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f373406b5a0 0x7f373406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734152450 con 0x7f371c0047d0 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734151b80 con 0x7f3734155ff0 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f373958b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373406bf60 con 0x7f373406b5a0 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f3734146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f3734146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58856/0 (socket says 172.21.15.53:58856) 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 -- 172.21.15.53:0/1950098412 learned_addr learned my addr 172.21.15.53:0/1950098412 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f37327fc640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3734155ff0 0x7f3734156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f37337fe640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f373406b5a0 0x7f373406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 -- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f373406b5a0 msgr2=0x7f373406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f373406b5a0 0x7f373406ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 -- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3734155ff0 msgr2=0x7f3734156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3734155ff0 0x7f3734156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f3732ffd640 1 -- 172.21.15.53:0/1950098412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734156a70 con 0x7f371c0047d0 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.020+0000 7f37337fe640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f373406b5a0 0x7f373406ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f3732ffd640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f3734146f80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3724001ec0 tx=0x7f372400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f371b7fe640 1 -- 172.21.15.53:0/1950098412 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240052e0 con 0x7f371c0047d0 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f371b7fe640 1 -- 172.21.15.53:0/1950098412 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724005440 con 0x7f371c0047d0 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3734151d90 con 0x7f371c0047d0 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f371b7fe640 1 -- 172.21.15.53:0/1950098412 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724003820 con 0x7f371c0047d0 2024-09-13T18:28:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37341552c0 con 0x7f371c0047d0 2024-09-13T18:28:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37341526c0 con 0x7f371c0047d0 2024-09-13T18:28:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f371b7fe640 1 -- 172.21.15.53:0/1950098412 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f3724003980 con 0x7f371c0047d0 2024-09-13T18:28:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f371b7fe640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3720066840 0x7f3720068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f371b7fe640 1 -- 172.21.15.53:0/1950098412 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3724083b00 con 0x7f371c0047d0 2024-09-13T18:28:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f37327fc640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3720066840 0x7f3720068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.024+0000 7f37327fc640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3720066840 0x7f3720068d00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f37280ae000 tx=0x7f3728007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.028+0000 7f371b7fe640 1 -- 172.21.15.53:0/1950098412 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3724050d10 con 0x7f371c0047d0 2024-09-13T18:28:14.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.224+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3734067400 con 0x7f371c0047d0 2024-09-13T18:28:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f371b7fe640 1 -- 172.21.15.53:0/1950098412 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f3724019020 con 0x7f371c0047d0 2024-09-13T18:28:14.233 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:14.233 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:28:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3720066840 msgr2=0x7f3720068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3720066840 0x7f3720068d00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f37280ae000 tx=0x7f3728007040 comp rx=0 tx=0).stop 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 msgr2=0x7f3734146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f3734146f80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3724001ec0 tx=0x7f372400e8a0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 shutdown_connections 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3720066840 0x7f3720068d00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f373406b5a0 0x7f373406ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3734155ff0 0x7f3734156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 --2- 172.21.15.53:0/1950098412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371c0047d0 0x7f3734146f80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 >> 172.21.15.53:0/1950098412 conn(0x7f3734065c80 msgr2=0x7f373406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 shutdown_connections 2024-09-13T18:28:14.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.228+0000 7f373958b640 1 -- 172.21.15.53:0/1950098412 wait complete. 2024-09-13T18:28:14.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:28:14.394 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-09-13T18:28:14.394 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-13T18:28:14.394 DEBUG:tasks.ceph_test_case:wait_until_true: success in 60s and 0 retries 2024-09-13T18:28:14.395 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:28:14.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:28:14.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:28:14.534 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:28:14.534 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:28:14.534 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:14.540 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:28:14.540 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:28:14.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:14.541 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:28:14.589 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T18:28:14.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:14.590 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:28:14.590 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:14.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:28:14.596 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:28:14.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:14.597 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:28:14.645 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:28:14.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:14.646 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:28:14.646 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:14.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:28:14.652 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:28:14.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:14.653 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:28:14.701 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:28:14.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:14.702 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:28:14.702 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:14.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:28:14.707 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:28:14.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:14.708 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:28:14.753 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:28:14.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:14.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:14.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.880+0000 7f2808ab6640 1 Processor -- start 2024-09-13T18:28:14.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.880+0000 7f2808ab6640 1 -- start start 2024-09-13T18:28:14.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2808ab6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28041582a0 0x7f280406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2808ab6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28040713a0 0x7f280406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2808ab6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280406d480 con 0x7f280415b7c0 2024-09-13T18:28:14.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2808ab6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280415aaf0 con 0x7f28041582a0 2024-09-13T18:28:14.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2808ab6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280406d760 con 0x7f28040713a0 2024-09-13T18:28:14.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28041582a0 0x7f280406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2801d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f280415b7c0 0x7f2804070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60648/0 (socket says 172.21.15.53:60648) 2024-09-13T18:28:14.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2801d9b640 1 -- 172.21.15.53:0/2245762997 learned_addr learned my addr 172.21.15.53:0/2245762997 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:14.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2802d9d640 1 --2- 172.21.15.53:0/2245762997 >> v2:172.21.15.87:3300/0 conn(0x7f28040713a0 0x7f280406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280259c640 1 -- 172.21.15.53:0/2245762997 >> v2:172.21.15.87:3300/0 conn(0x7f28040713a0 msgr2=0x7f280406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:14.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280259c640 1 --2- 172.21.15.53:0/2245762997 >> v2:172.21.15.87:3300/0 conn(0x7f28040713a0 0x7f280406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280259c640 1 -- 172.21.15.53:0/2245762997 >> v1:172.21.15.53:6789/0 conn(0x7f280415b7c0 legacy=0x7f2804070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280159a640 1 -- 172.21.15.53:0/2245762997 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864573753 0 0) 0x7f280406d480 con 0x7f280415b7c0 2024-09-13T18:28:14.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280259c640 1 -- 172.21.15.53:0/2245762997 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280415ace0 con 0x7f28041582a0 2024-09-13T18:28:14.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f2802d9d640 1 --2- 172.21.15.53:0/2245762997 >> v2:172.21.15.87:3300/0 conn(0x7f28040713a0 0x7f280406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280259c640 1 --2- 172.21.15.53:0/2245762997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28041582a0 0x7f280406c900 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2804158680 tx=0x7f27ec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91fa761f5d0f788 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280159a640 1 -- 172.21.15.53:0/2245762997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0a7070 con 0x7f28041582a0 2024-09-13T18:28:14.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280159a640 1 -- 172.21.15.53:0/2245762997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec0ab430 con 0x7f28041582a0 2024-09-13T18:28:14.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.884+0000 7f280159a640 1 -- 172.21.15.53:0/2245762997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0ab7c0 con 0x7f28041582a0 2024-09-13T18:28:14.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- 172.21.15.53:0/2245762997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28041582a0 msgr2=0x7f280406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 --2- 172.21.15.53:0/2245762997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28041582a0 0x7f280406c900 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2804158680 tx=0x7f27ec01c430 comp rx=0 tx=0).stop 2024-09-13T18:28:14.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- 172.21.15.53:0/2245762997 shutdown_connections 2024-09-13T18:28:14.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 --2- 172.21.15.53:0/2245762997 >> v2:172.21.15.87:3300/0 conn(0x7f28040713a0 0x7f280406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 --2- 172.21.15.53:0/2245762997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28041582a0 0x7f280406c900 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- 172.21.15.53:0/2245762997 >> 172.21.15.53:0/2245762997 conn(0x7f2804065c80 msgr2=0x7f2804066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- 172.21.15.53:0/2245762997 shutdown_connections 2024-09-13T18:28:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- 172.21.15.53:0/2245762997 wait complete. 2024-09-13T18:28:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 Processor -- start 2024-09-13T18:28:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- start start 2024-09-13T18:28:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28040713a0 0x7f2804139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28041582a0 0x7f280414da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f280415b7c0 0x7f2804147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280414d1d0 con 0x7f280415b7c0 2024-09-13T18:28:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2804149800 con 0x7f28041582a0 2024-09-13T18:28:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280413a2d0 con 0x7f28040713a0 2024-09-13T18:28:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f280415b7c0 0x7f2804147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f280415b7c0 0x7f2804147e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58868/0 (socket says 172.21.15.53:58868) 2024-09-13T18:28:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 -- 172.21.15.53:0/3554198126 learned_addr learned my addr 172.21.15.53:0/3554198126 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2801d9b640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28041582a0 0x7f280414da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f280259c640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28040713a0 0x7f2804139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 -- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28040713a0 msgr2=0x7f2804139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28040713a0 0x7f2804139d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 -- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28041582a0 msgr2=0x7f280414da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28041582a0 0x7f280414da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 -- 172.21.15.53:0/3554198126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec009420 con 0x7f280415b7c0 2024-09-13T18:28:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f280259c640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28040713a0 0x7f2804139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2802d9d640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f280415b7c0 0x7f2804147e90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e600 tx=0x7f27fc00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f27faffd640 1 -- 172.21.15.53:0/3554198126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00c620 con 0x7f280415b7c0 2024-09-13T18:28:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f27faffd640 1 -- 172.21.15.53:0/3554198126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00c780 con 0x7f280415b7c0 2024-09-13T18:28:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2804156d00 con 0x7f280415b7c0 2024-09-13T18:28:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f27faffd640 1 -- 172.21.15.53:0/3554198126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00cb30 con 0x7f280415b7c0 2024-09-13T18:28:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.888+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28041572c0 con 0x7f280415b7c0 2024-09-13T18:28:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.892+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2804067400 con 0x7f280415b7c0 2024-09-13T18:28:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.892+0000 7f27faffd640 1 -- 172.21.15.53:0/3554198126 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f27fc00cc90 con 0x7f280415b7c0 2024-09-13T18:28:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.892+0000 7f27faffd640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f27e4066870 0x7f27e4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.892+0000 7f27faffd640 1 -- 172.21.15.53:0/3554198126 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f27fc0842b0 con 0x7f280415b7c0 2024-09-13T18:28:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.892+0000 7f280259c640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f27e4066870 0x7f27e4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.892+0000 7f280259c640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f27e4066870 0x7f27e4068d30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0af000 tx=0x7f27ec0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:14.896+0000 7f27faffd640 1 -- 172.21.15.53:0/3554198126 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27fc0512e0 con 0x7f280415b7c0 2024-09-13T18:28:15.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.088+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28041574e0 con 0x7f280415b7c0 2024-09-13T18:28:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.088+0000 7f27faffd640 1 -- 172.21.15.53:0/3554198126 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f27fc054900 con 0x7f280415b7c0 2024-09-13T18:28:15.096 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:15.096 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:28:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:28:15.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f27e4066870 msgr2=0x7f27e4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f27e4066870 0x7f27e4068d30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0af000 tx=0x7f27ec0a7000 comp rx=0 tx=0).stop 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f280415b7c0 msgr2=0x7f2804147e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f280415b7c0 0x7f2804147e90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e600 tx=0x7f27fc00eac0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 shutdown_connections 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f27e4066870 0x7f27e4068d30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f280415b7c0 0x7f2804147e90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28041582a0 0x7f280414da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 --2- 172.21.15.53:0/3554198126 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28040713a0 0x7f2804139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 >> 172.21.15.53:0/3554198126 conn(0x7f2804065c80 msgr2=0x7f2804150300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 shutdown_connections 2024-09-13T18:28:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.092+0000 7f2808ab6640 1 -- 172.21.15.53:0/3554198126 wait complete. 2024-09-13T18:28:15.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0e5a00640 1 Processor -- start 2024-09-13T18:28:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0e5a00640 1 -- start start 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0e5a00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc0e015cab0 0x7fc0e00d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0e5a00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0e00cf7d0 0x7fc0e00b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0e5a00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e00d2400 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0e5a00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e00d1530 con 0x7fc0e00cf7d0 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0e5a00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e00d0920 con 0x7fc0e015cab0 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0df7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0e00cf7d0 0x7fc0e00b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0de7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0e00cd6c0 0x7fc0e00cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60658/0 (socket says 172.21.15.53:60658) 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0de7fc640 1 -- 172.21.15.53:0/4243641821 learned_addr learned my addr 172.21.15.53:0/4243641821 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0deffd640 1 --2- 172.21.15.53:0/4243641821 >> v2:172.21.15.87:3300/0 conn(0x7fc0e015cab0 0x7fc0e00d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0df7fe640 1 -- 172.21.15.53:0/4243641821 >> v2:172.21.15.87:3300/0 conn(0x7fc0e015cab0 msgr2=0x7fc0e00d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0df7fe640 1 --2- 172.21.15.53:0/4243641821 >> v2:172.21.15.87:3300/0 conn(0x7fc0e015cab0 0x7fc0e00d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0df7fe640 1 -- 172.21.15.53:0/4243641821 >> v1:172.21.15.53:6789/0 conn(0x7fc0e00cd6c0 legacy=0x7fc0e00cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.232+0000 7fc0df7fe640 1 -- 172.21.15.53:0/4243641821 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00d0c00 con 0x7fc0e00cf7d0 2024-09-13T18:28:15.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0df7fe640 1 --2- 172.21.15.53:0/4243641821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cf7d0 0x7fc0e00b5870 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0066930 tx=0x7fc0d801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31b523520f996d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0ddffb640 1 -- 172.21.15.53:0/4243641821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80ab650 con 0x7fc0e00cf7d0 2024-09-13T18:28:15.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0ddffb640 1 -- 172.21.15.53:0/4243641821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d80ab7b0 con 0x7fc0e00cf7d0 2024-09-13T18:28:15.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0ddffb640 1 -- 172.21.15.53:0/4243641821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80abb40 con 0x7fc0e00cf7d0 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- 172.21.15.53:0/4243641821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cf7d0 msgr2=0x7fc0e00b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/4243641821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cf7d0 0x7fc0e00b5870 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0066930 tx=0x7fc0d801c450 comp rx=0 tx=0).stop 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- 172.21.15.53:0/4243641821 shutdown_connections 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/4243641821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cf7d0 0x7fc0e00b5870 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/4243641821 >> v2:172.21.15.87:3300/0 conn(0x7fc0e015cab0 0x7fc0e00d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- 172.21.15.53:0/4243641821 >> 172.21.15.53:0/4243641821 conn(0x7fc0e0065c80 msgr2=0x7fc0e0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- 172.21.15.53:0/4243641821 shutdown_connections 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- 172.21.15.53:0/4243641821 wait complete. 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 Processor -- start 2024-09-13T18:28:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- start start 2024-09-13T18:28:15.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cd6c0 0x7fc0e01501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e00cf7d0 0x7fc0e015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e015cab0 0x7fc0e0152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e0151e80 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e01520d0 con 0x7fc0e015cab0 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0e5a00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e01523b0 con 0x7fc0e00cf7d0 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cd6c0 0x7fc0e01501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cd6c0 0x7fc0e01501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58900/0 (socket says 172.21.15.53:58900) 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.236+0000 7fc0deffd640 1 -- 172.21.15.53:0/2464850095 learned_addr learned my addr 172.21.15.53:0/2464850095 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0de7fc640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e00cf7d0 0x7fc0e015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0df7fe640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e015cab0 0x7fc0e0152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0deffd640 1 -- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e00cf7d0 msgr2=0x7fc0e015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0deffd640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e00cf7d0 0x7fc0e015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0deffd640 1 -- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e015cab0 msgr2=0x7fc0e0152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0deffd640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e015cab0 0x7fc0e0152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0deffd640 1 -- 172.21.15.53:0/2464850095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8009420 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0df7fe640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e015cab0 0x7fc0e0152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0deffd640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cd6c0 0x7fc0e01501d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000d800 tx=0x7fc0d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0d7fff640 1 -- 172.21.15.53:0/2464850095 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d000b6c0 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0d7fff640 1 -- 172.21.15.53:0/2464850095 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d000b820 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e0152690 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0d7fff640 1 -- 172.21.15.53:0/2464850095 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d000bb90 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e0150710 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e00b5870 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0d7fff640 1 -- 172.21.15.53:0/2464850095 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc0d000bcf0 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0d7fff640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c0066870 0x7fc0c0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0d7fff640 1 -- 172.21.15.53:0/2464850095 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc0d00854c0 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.240+0000 7fc0de7fc640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c0066870 0x7fc0c0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.244+0000 7fc0de7fc640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c0066870 0x7fc0c0068d30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00b51d0 tx=0x7fc0c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.244+0000 7fc0d7fff640 1 -- 172.21.15.53:0/2464850095 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc0d00525c0 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.408+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0e006a270 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0d7fff640 1 -- 172.21.15.53:0/2464850095 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fc0d0055be0 con 0x7fc0e00cd6c0 2024-09-13T18:28:15.417 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:15.417 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:27:40.159907+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:15.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c0066870 msgr2=0x7fc0c0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c0066870 0x7fc0c0068d30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00b51d0 tx=0x7fc0c8009040 comp rx=0 tx=0).stop 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cd6c0 msgr2=0x7fc0e01501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cd6c0 0x7fc0e01501d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000d800 tx=0x7fc0d000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 shutdown_connections 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc0c0066870 0x7fc0c0068d30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0e00cf7d0 0x7fc0e015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0e015cab0 0x7fc0e0152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 --2- 172.21.15.53:0/2464850095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0e00cd6c0 0x7fc0e01501d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 >> 172.21.15.53:0/2464850095 conn(0x7fc0e0065c80 msgr2=0x7fc0e0159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 shutdown_connections 2024-09-13T18:28:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.412+0000 7fc0e5a00640 1 -- 172.21.15.53:0/2464850095 wait complete. 2024-09-13T18:28:15.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:26:40.433725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:26:41.119531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:15.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.552+0000 7fdd7fc1e640 1 Processor -- start 2024-09-13T18:28:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7fc1e640 1 -- start start 2024-09-13T18:28:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7fc1e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd78158ba0 0x7fdd780cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7fc1e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd780b3830 con 0x7fdd780b1dd0 2024-09-13T18:28:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7fc1e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7806bc20 con 0x7fdd7806ff40 2024-09-13T18:28:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7fc1e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7806c530 con 0x7fdd78158ba0 2024-09-13T18:28:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7d1b9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdd780b1dd0 0x7fdd780b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60662/0 (socket says 172.21.15.53:60662) 2024-09-13T18:28:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7d1b9640 1 -- 172.21.15.53:0/815381666 learned_addr learned my addr 172.21.15.53:0/815381666 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7d9ba640 1 --2- 172.21.15.53:0/815381666 >> v2:172.21.15.53:3300/0 conn(0x7fdd78158ba0 0x7fdd780cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7c9b8640 1 -- 172.21.15.53:0/815381666 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216060347 0 0) 0x7fdd68001120 con 0x7fdd780b1dd0 2024-09-13T18:28:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7c9b8640 1 -- 172.21.15.53:0/815381666 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd64003530 con 0x7fdd780b1dd0 2024-09-13T18:28:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7d9ba640 1 -- 172.21.15.53:0/815381666 >> v1:172.21.15.87:6789/0 conn(0x7fdd7806ff40 legacy=0x7fdd78070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7d9ba640 1 -- 172.21.15.53:0/815381666 >> v1:172.21.15.53:6789/0 conn(0x7fdd780b1dd0 legacy=0x7fdd780b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.556+0000 7fdd7d9ba640 1 -- 172.21.15.53:0/815381666 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78158f80 con 0x7fdd78158ba0 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7d9ba640 1 --2- 172.21.15.53:0/815381666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd78158ba0 0x7fdd780cb9d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdd740097c0 tx=0x7fdd7401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459565de10515a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7c9b8640 1 -- 172.21.15.53:0/815381666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd740ab600 con 0x7fdd78158ba0 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7c9b8640 1 -- 172.21.15.53:0/815381666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd740a7050 con 0x7fdd78158ba0 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7c9b8640 1 -- 172.21.15.53:0/815381666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd740ab960 con 0x7fdd78158ba0 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/815381666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd78158ba0 msgr2=0x7fdd780cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/815381666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd78158ba0 0x7fdd780cb9d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdd740097c0 tx=0x7fdd7401c350 comp rx=0 tx=0).stop 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/815381666 shutdown_connections 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/815381666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd78158ba0 0x7fdd780cb9d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/815381666 >> 172.21.15.53:0/815381666 conn(0x7fdd78065c80 msgr2=0x7fdd78066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/815381666 shutdown_connections 2024-09-13T18:28:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.560+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/815381666 wait complete. 2024-09-13T18:28:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 Processor -- start 2024-09-13T18:28:15.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 -- start start 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7806ff40 0x7fdd78151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd780b1dd0 0x7fdd780ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd78158ba0 0x7fdd780a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780abf70 con 0x7fdd7806ff40 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780ac250 con 0x7fdd78158ba0 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780ac530 con 0x7fdd780b1dd0 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7806ff40 0x7fdd78151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7806ff40 0x7fdd78151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58922/0 (socket says 172.21.15.53:58922) 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 -- 172.21.15.53:0/1442736133 learned_addr learned my addr 172.21.15.53:0/1442736133 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d1b9640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd780b1dd0 0x7fdd780ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 -- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd780b1dd0 msgr2=0x7fdd780ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7e1bb640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd78158ba0 0x7fdd780a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd780b1dd0 0x7fdd780ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 -- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd78158ba0 msgr2=0x7fdd780a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd78158ba0 0x7fdd780a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 -- 172.21.15.53:0/1442736133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74009420 con 0x7fdd7806ff40 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7e1bb640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd78158ba0 0x7fdd780a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7d9ba640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7806ff40 0x7fdd78151980 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdd74018f60 tx=0x7fdd740190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd6e7fc640 1 -- 172.21.15.53:0/1442736133 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74006e20 con 0x7fdd7806ff40 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd6e7fc640 1 -- 172.21.15.53:0/1442736133 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd74004020 con 0x7fdd7806ff40 2024-09-13T18:28:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd6e7fc640 1 -- 172.21.15.53:0/1442736133 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74004390 con 0x7fdd7806ff40 2024-09-13T18:28:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd780ac810 con 0x7fdd7806ff40 2024-09-13T18:28:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd78151ec0 con 0x7fdd7806ff40 2024-09-13T18:28:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd780cb9d0 con 0x7fdd7806ff40 2024-09-13T18:28:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd6e7fc640 1 -- 172.21.15.53:0/1442736133 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fdd740b2040 con 0x7fdd7806ff40 2024-09-13T18:28:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd6e7fc640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd5c066840 0x7fdd5c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.564+0000 7fdd6e7fc640 1 -- 172.21.15.53:0/1442736133 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdd7411e480 con 0x7fdd7806ff40 2024-09-13T18:28:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.568+0000 7fdd7d1b9640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd5c066840 0x7fdd5c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.568+0000 7fdd7d1b9640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd5c066840 0x7fdd5c068d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd781f6300 tx=0x7fdd68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.572+0000 7fdd6e7fc640 1 -- 172.21.15.53:0/1442736133 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdd740eb420 con 0x7fdd7806ff40 2024-09-13T18:28:15.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.728+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd780cbee0 con 0x7fdd7806ff40 2024-09-13T18:28:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.728+0000 7fdd6e7fc640 1 -- 172.21.15.53:0/1442736133 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd740044f0 con 0x7fdd7806ff40 2024-09-13T18:28:15.734 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:28:15.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd5c066840 msgr2=0x7fdd5c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd5c066840 0x7fdd5c068d00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd781f6300 tx=0x7fdd68009040 comp rx=0 tx=0).stop 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7806ff40 msgr2=0x7fdd78151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7806ff40 0x7fdd78151980 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fdd74018f60 tx=0x7fdd740190f0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 shutdown_connections 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd5c066840 0x7fdd5c068d00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd780b1dd0 0x7fdd780ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd78158ba0 0x7fdd780a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 --2- 172.21.15.53:0/1442736133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7806ff40 0x7fdd78151980 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 >> 172.21.15.53:0/1442736133 conn(0x7fdd78065c80 msgr2=0x7fdd78166aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 shutdown_connections 2024-09-13T18:28:15.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.732+0000 7fdd7fc1e640 1 -- 172.21.15.53:0/1442736133 wait complete. 2024-09-13T18:28:15.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:28:15.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe64858b640 1 Processor -- start 2024-09-13T18:28:15.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe64858b640 1 -- start start 2024-09-13T18:28:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe64858b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe640143e80 0x7fe64006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe64858b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6400cda30 0x7fe6400cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe64858b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64006f7a0 con 0x7fe6400caee0 2024-09-13T18:28:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe64858b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64006fd60 con 0x7fe6400cda30 2024-09-13T18:28:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe64858b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400cb960 con 0x7fe640143e80 2024-09-13T18:28:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646b28640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6400cda30 0x7fe6400cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646b28640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6400cda30 0x7fe6400cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58926/0 (socket says 172.21.15.53:58926) 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646b28640 1 -- 172.21.15.53:0/3716690454 learned_addr learned my addr 172.21.15.53:0/3716690454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646327640 1 --2- 172.21.15.53:0/3716690454 >> v2:172.21.15.87:3300/0 conn(0x7fe640143e80 0x7fe64006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646b28640 1 -- 172.21.15.53:0/3716690454 >> v2:172.21.15.87:3300/0 conn(0x7fe640143e80 msgr2=0x7fe64006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646b28640 1 --2- 172.21.15.53:0/3716690454 >> v2:172.21.15.87:3300/0 conn(0x7fe640143e80 0x7fe64006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646b28640 1 -- 172.21.15.53:0/3716690454 >> v1:172.21.15.87:6789/0 conn(0x7fe6400caee0 legacy=0x7fe6400cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646b28640 1 -- 172.21.15.53:0/3716690454 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400cbc40 con 0x7fe6400cda30 2024-09-13T18:28:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.872+0000 7fe646327640 1 --2- 172.21.15.53:0/3716690454 >> v2:172.21.15.87:3300/0 conn(0x7fe640143e80 0x7fe64006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe646b28640 1 --2- 172.21.15.53:0/3716690454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400cb350 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe6400676d0 tx=0x7fe63801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc30d556036636f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe645325640 1 -- 172.21.15.53:0/3716690454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380a5700 con 0x7fe6400cda30 2024-09-13T18:28:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe645325640 1 -- 172.21.15.53:0/3716690454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6380a5860 con 0x7fe6400cda30 2024-09-13T18:28:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe645325640 1 -- 172.21.15.53:0/3716690454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380a5bf0 con 0x7fe6400cda30 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- 172.21.15.53:0/3716690454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 msgr2=0x7fe6400cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 --2- 172.21.15.53:0/3716690454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400cb350 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe6400676d0 tx=0x7fe63801c860 comp rx=0 tx=0).stop 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- 172.21.15.53:0/3716690454 shutdown_connections 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 --2- 172.21.15.53:0/3716690454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400cb350 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 --2- 172.21.15.53:0/3716690454 >> v2:172.21.15.87:3300/0 conn(0x7fe640143e80 0x7fe64006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- 172.21.15.53:0/3716690454 >> 172.21.15.53:0/3716690454 conn(0x7fe640065c80 msgr2=0x7fe640066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- 172.21.15.53:0/3716690454 shutdown_connections 2024-09-13T18:28:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- 172.21.15.53:0/3716690454 wait complete. 2024-09-13T18:28:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 Processor -- start 2024-09-13T18:28:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- start start 2024-09-13T18:28:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6400caee0 0x7fe6400abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe640143e80 0x7fe6400a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64015b160 con 0x7fe6400cda30 2024-09-13T18:28:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64015a4e0 con 0x7fe6400caee0 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe64858b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64015a7c0 con 0x7fe640143e80 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe645b26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe645b26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400ac010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58940/0 (socket says 172.21.15.53:58940) 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe645b26640 1 -- 172.21.15.53:0/4185513805 learned_addr learned my addr 172.21.15.53:0/4185513805 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe646327640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6400caee0 0x7fe6400abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.876+0000 7fe646b28640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe640143e80 0x7fe6400a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe645b26640 1 -- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe640143e80 msgr2=0x7fe6400a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe645b26640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe640143e80 0x7fe6400a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe645b26640 1 -- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6400caee0 msgr2=0x7fe6400abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe645b26640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6400caee0 0x7fe6400abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe645b26640 1 -- 172.21.15.53:0/4185513805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638009b30 con 0x7fe6400cda30 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe646327640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6400caee0 0x7fe6400abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe645b26640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400ac010 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c450 tx=0x7fe63000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe636ffd640 1 -- 172.21.15.53:0/4185513805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630012830 con 0x7fe6400cda30 2024-09-13T18:28:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe636ffd640 1 -- 172.21.15.53:0/4185513805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6300129b0 con 0x7fe6400cda30 2024-09-13T18:28:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64015aaa0 con 0x7fe6400cda30 2024-09-13T18:28:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe636ffd640 1 -- 172.21.15.53:0/4185513805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630012d60 con 0x7fe6400cda30 2024-09-13T18:28:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe640142940 con 0x7fe6400cda30 2024-09-13T18:28:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64015b2a0 con 0x7fe6400cda30 2024-09-13T18:28:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe636ffd640 1 -- 172.21.15.53:0/4185513805 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe63001c460 con 0x7fe6400cda30 2024-09-13T18:28:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe636ffd640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe624066840 0x7fe624068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe636ffd640 1 -- 172.21.15.53:0/4185513805 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe630084340 con 0x7fe6400cda30 2024-09-13T18:28:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe646327640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe624066840 0x7fe624068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.880+0000 7fe646327640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe624066840 0x7fe624068d00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00b990 tx=0x7fe63c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:15.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:15.884+0000 7fe636ffd640 1 -- 172.21.15.53:0/4185513805 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe64015b2a0 con 0x7fe6400cda30 2024-09-13T18:28:16.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.044+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe64015b2a0 con 0x7fe6400cda30 2024-09-13T18:28:16.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.044+0000 7fe636ffd640 1 -- 172.21.15.53:0/4185513805 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe64015b2a0 con 0x7fe6400cda30 2024-09-13T18:28:16.051 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe624066840 msgr2=0x7fe624068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe624066840 0x7fe624068d00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00b990 tx=0x7fe63c008040 comp rx=0 tx=0).stop 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 msgr2=0x7fe6400ac010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400ac010 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c450 tx=0x7fe63000c910 comp rx=0 tx=0).stop 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 shutdown_connections 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe624066840 0x7fe624068d00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe640143e80 0x7fe6400a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6400cda30 0x7fe6400ac010 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 --2- 172.21.15.53:0/4185513805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6400caee0 0x7fe6400abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 >> 172.21.15.53:0/4185513805 conn(0x7fe640065c80 msgr2=0x7fe640155890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:16.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 shutdown_connections 2024-09-13T18:28:16.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.048+0000 7fe64858b640 1 -- 172.21.15.53:0/4185513805 wait complete. 2024-09-13T18:28:16.071 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:28:16.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7ad20a640 1 Processor -- start 2024-09-13T18:28:16.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7ad20a640 1 -- start start 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7ad20a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7a80b2bf0 0x7fd7a80cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7ad20a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd7a80ced50 0x7fd7a80b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7ad20a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80ccd60 con 0x7fd7a80ccf10 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7ad20a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80cc190 con 0x7fd7a80b2bf0 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7ad20a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80ce270 con 0x7fd7a80ced50 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7a80b2bf0 0x7fd7a80cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a6d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd7a80ccf10 0x7fd7a80cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60672/0 (socket says 172.21.15.53:60672) 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a6d9d640 1 -- 172.21.15.53:0/2408001412 learned_addr learned my addr 172.21.15.53:0/2408001412 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a759e640 1 --2- 172.21.15.53:0/2408001412 >> v2:172.21.15.87:3300/0 conn(0x7fd7a80ced50 0x7fd7a80b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a659c640 1 -- 172.21.15.53:0/2408001412 >> v2:172.21.15.87:3300/0 conn(0x7fd7a80ced50 msgr2=0x7fd7a80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:16.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a659c640 1 --2- 172.21.15.53:0/2408001412 >> v2:172.21.15.87:3300/0 conn(0x7fd7a80ced50 0x7fd7a80b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a659c640 1 -- 172.21.15.53:0/2408001412 >> v1:172.21.15.53:6789/0 conn(0x7fd7a80ccf10 legacy=0x7fd7a80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a659c640 1 -- 172.21.15.53:0/2408001412 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a80ce550 con 0x7fd7a80b2bf0 2024-09-13T18:28:16.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.188+0000 7fd7a5d9b640 1 -- 172.21.15.53:0/2408001412 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30619968 0 0) 0x7fd7a80ccd60 con 0x7fd7a80ccf10 2024-09-13T18:28:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7a659c640 1 --2- 172.21.15.53:0/2408001412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80b2bf0 0x7fd7a80cbab0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8070db0 tx=0x7fd79c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4178a561abfb23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7a5d9b640 1 -- 172.21.15.53:0/2408001412 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0ab600 con 0x7fd7a80b2bf0 2024-09-13T18:28:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7a5d9b640 1 -- 172.21.15.53:0/2408001412 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c0a7050 con 0x7fd7a80b2bf0 2024-09-13T18:28:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7a5d9b640 1 -- 172.21.15.53:0/2408001412 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0ab980 con 0x7fd7a80b2bf0 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 -- 172.21.15.53:0/2408001412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80b2bf0 msgr2=0x7fd7a80cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/2408001412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80b2bf0 0x7fd7a80cbab0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8070db0 tx=0x7fd79c01c3c0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 -- 172.21.15.53:0/2408001412 shutdown_connections 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/2408001412 >> v2:172.21.15.87:3300/0 conn(0x7fd7a80ced50 0x7fd7a80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/2408001412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80b2bf0 0x7fd7a80cbab0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 -- 172.21.15.53:0/2408001412 >> 172.21.15.53:0/2408001412 conn(0x7fd7a80b20d0 msgr2=0x7fd7a80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 -- 172.21.15.53:0/2408001412 shutdown_connections 2024-09-13T18:28:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 -- 172.21.15.53:0/2408001412 wait complete. 2024-09-13T18:28:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 Processor -- start 2024-09-13T18:28:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 -- start start 2024-09-13T18:28:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7a80b2bf0 0x7fd7a81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.192+0000 7fd7ad20a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80ccf10 0x7fd7a813f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7ad20a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7a80ced50 0x7fd7a80c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7ad20a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8151830 con 0x7fd7a80ccf10 2024-09-13T18:28:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7ad20a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a813dc00 con 0x7fd7a80b2bf0 2024-09-13T18:28:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7ad20a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a813d8d0 con 0x7fd7a80ced50 2024-09-13T18:28:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80ccf10 0x7fd7a813f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80ccf10 0x7fd7a813f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58952/0 (socket says 172.21.15.53:58952) 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 -- 172.21.15.53:0/1059866903 learned_addr learned my addr 172.21.15.53:0/1059866903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a759e640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7a80ced50 0x7fd7a80c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a6d9d640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7a80b2bf0 0x7fd7a81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 -- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7a80ced50 msgr2=0x7fd7a80c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7a80ced50 0x7fd7a80c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 -- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7a80b2bf0 msgr2=0x7fd7a81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7a80b2bf0 0x7fd7a81512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 -- 172.21.15.53:0/1059866903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c009420 con 0x7fd7a80ccf10 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a659c640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80ccf10 0x7fd7a813f920 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000c10 tx=0x7fd79c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd78f7fe640 1 -- 172.21.15.53:0/1059866903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c004230 con 0x7fd7a80ccf10 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd78f7fe640 1 -- 172.21.15.53:0/1059866903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c004390 con 0x7fd7a80ccf10 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd78f7fe640 1 -- 172.21.15.53:0/1059866903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c003860 con 0x7fd7a80ccf10 2024-09-13T18:28:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a813f340 con 0x7fd7a80ccf10 2024-09-13T18:28:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8140490 con 0x7fd7a80ccf10 2024-09-13T18:28:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a813dd70 con 0x7fd7a80ccf10 2024-09-13T18:28:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd78f7fe640 1 -- 172.21.15.53:0/1059866903 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd79c0b2040 con 0x7fd7a80ccf10 2024-09-13T18:28:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd78f7fe640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd794066840 0x7fd794068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd78f7fe640 1 -- 172.21.15.53:0/1059866903 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd79c11e4a0 con 0x7fd7a80ccf10 2024-09-13T18:28:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.196+0000 7fd7a6d9d640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd794066840 0x7fd794068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.200+0000 7fd7a6d9d640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd794066840 0x7fd794068d00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd798000f70 tx=0x7fd798007b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.200+0000 7fd78f7fe640 1 -- 172.21.15.53:0/1059866903 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd79c0eb420 con 0x7fd7a80ccf10 2024-09-13T18:28:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.364+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7a8066a00 con 0x7fd7a80ccf10 2024-09-13T18:28:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.364+0000 7fd78f7fe640 1 -- 172.21.15.53:0/1059866903 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd79c006e20 con 0x7fd7a80ccf10 2024-09-13T18:28:16.371 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:28:16.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd794066840 msgr2=0x7fd794068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd794066840 0x7fd794068d00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd798000f70 tx=0x7fd798007b60 comp rx=0 tx=0).stop 2024-09-13T18:28:16.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80ccf10 msgr2=0x7fd7a813f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80ccf10 0x7fd7a813f920 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000c10 tx=0x7fd79c019160 comp rx=0 tx=0).stop 2024-09-13T18:28:16.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 shutdown_connections 2024-09-13T18:28:16.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd794066840 0x7fd794068d00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7a80ced50 0x7fd7a80c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a80ccf10 0x7fd7a813f920 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 --2- 172.21.15.53:0/1059866903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7a80b2bf0 0x7fd7a81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 >> 172.21.15.53:0/1059866903 conn(0x7fd7a80b20d0 msgr2=0x7fd7a80b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:16.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 shutdown_connections 2024-09-13T18:28:16.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.368+0000 7fd7ad20a640 1 -- 172.21.15.53:0/1059866903 wait complete. 2024-09-13T18:28:16.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:16.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a865f6640 1 Processor -- start 2024-09-13T18:28:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a865f6640 1 -- start start 2024-09-13T18:28:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a865f6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 0x7f1a801675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a865f6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a80160a70 con 0x7f1a8015c840 2024-09-13T18:28:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a865f6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a80160d50 con 0x7f1a800b1650 2024-09-13T18:28:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a865f6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800cdd80 con 0x7f1a800b4e50 2024-09-13T18:28:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1a8015c840 0x7f1a80160220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60686/0 (socket says 172.21.15.53:60686) 2024-09-13T18:28:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7ffff640 1 -- 172.21.15.53:0/2989934615 learned_addr learned my addr 172.21.15.53:0/2989934615 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a84b93640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 0x7f1a801675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832502943 0 0) 0x7f1a80160a70 con 0x7f1a8015c840 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a6c003530 con 0x7f1a8015c840 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775718938 0 0) 0x7f1a80160d50 con 0x7f1a800b1650 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a80160a70 con 0x7f1a800b1650 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727753875 0 0) 0x7f1a6c003530 con 0x7f1a8015c840 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 msgr2=0x7f1a801675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 0x7f1a801675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 >> v1:172.21.15.87:6789/0 conn(0x7f1a800b1650 legacy=0x7f1a800b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80161030 con 0x7f1a8015c840 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f1a70001680 con 0x7f1a8015c840 2024-09-13T18:28:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 >> v1:172.21.15.53:6789/0 conn(0x7f1a8015c840 legacy=0x7f1a80160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 0x7f1a6c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0040a0 0x7f1a6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c004d10 0x7f1a6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800cdd80 con 0x7f1a6c0040a0 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c00ba70 con 0x7f1a6c004d10 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c00bc30 con 0x7f1a800b4e50 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a77fff640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0040a0 0x7f1a6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a84b93640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c004d10 0x7f1a6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a7ffff640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 0x7f1a6c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a77fff640 1 -- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 msgr2=0x7f1a6c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a77fff640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a800b4e50 0x7f1a6c003b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a77fff640 1 -- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c004d10 msgr2=0x7f1a6c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a77fff640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c004d10 0x7f1a6c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.504+0000 7f1a77fff640 1 -- 172.21.15.53:0/2989934615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c003530 con 0x7f1a6c0040a0 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a77fff640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0040a0 0x7f1a6c0047d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1a680018d0 tx=0x7f1a6801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4120b979125fd161 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a680052d0 con 0x7f1a6c0040a0 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68005450 con 0x7f1a6c0040a0 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a7f7fe640 1 -- 172.21.15.53:0/2989934615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a680a8950 con 0x7f1a6c0040a0 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- 172.21.15.53:0/2989934615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0040a0 msgr2=0x7f1a6c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 --2- 172.21.15.53:0/2989934615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0040a0 0x7f1a6c0047d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1a680018d0 tx=0x7f1a6801ecf0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a84b93640 1 -- 172.21.15.53:0/2989934615 reap_dead start 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- 172.21.15.53:0/2989934615 shutdown_connections 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- 172.21.15.53:0/2989934615 >> 172.21.15.53:0/2989934615 conn(0x7f1a80066080 msgr2=0x7f1a80066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- 172.21.15.53:0/2989934615 shutdown_connections 2024-09-13T18:28:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- 172.21.15.53:0/2989934615 wait complete. 2024-09-13T18:28:16.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 Processor -- start 2024-09-13T18:28:16.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- start start 2024-09-13T18:28:16.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a801f1c10 0x7f1a8015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a800cb840 0x7f1a800cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a8015e7d0 0x7f1a8015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800cc200 con 0x7f1a801f1c10 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800c8b80 con 0x7f1a800cb840 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a865f6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8015d5f0 con 0x7f1a8015e7d0 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a7ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a801f1c10 0x7f1a8015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a7ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a801f1c10 0x7f1a8015da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58974/0 (socket says 172.21.15.53:58974) 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.508+0000 7f1a7ffff640 1 -- 172.21.15.53:0/3811950550 learned_addr learned my addr 172.21.15.53:0/3811950550 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a77fff640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a800cb840 0x7f1a800cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a84b93640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a8015e7d0 0x7f1a8015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7ffff640 1 -- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a8015e7d0 msgr2=0x7f1a8015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7ffff640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a8015e7d0 0x7f1a8015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7ffff640 1 -- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a800cb840 msgr2=0x7f1a800cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7ffff640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a800cb840 0x7f1a800cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7ffff640 1 -- 172.21.15.53:0/3811950550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8015f190 con 0x7f1a801f1c10 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a77fff640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a800cb840 0x7f1a800cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7ffff640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a801f1c10 0x7f1a8015da80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000db40 tx=0x7f1a70007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7d7fa640 1 -- 172.21.15.53:0/3811950550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70004cc0 con 0x7f1a801f1c10 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7d7fa640 1 -- 172.21.15.53:0/3811950550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70004e20 con 0x7f1a801f1c10 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8015f400 con 0x7f1a801f1c10 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7d7fa640 1 -- 172.21.15.53:0/3811950550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700072f0 con 0x7f1a801f1c10 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8015cfa0 con 0x7f1a801f1c10 2024-09-13T18:28:16.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a80160d50 con 0x7f1a801f1c10 2024-09-13T18:28:16.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7d7fa640 1 -- 172.21.15.53:0/3811950550 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1a70007450 con 0x7f1a801f1c10 2024-09-13T18:28:16.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7d7fa640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a60066870 0x7f1a60068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a7d7fa640 1 -- 172.21.15.53:0/3811950550 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1a70083f10 con 0x7f1a801f1c10 2024-09-13T18:28:16.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a77fff640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a60066870 0x7f1a60068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.512+0000 7f1a77fff640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a60066870 0x7f1a60068d30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a680b0000 tx=0x7f1a680aa070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.516+0000 7f1a7d7fa640 1 -- 172.21.15.53:0/3811950550 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1a70050e90 con 0x7f1a801f1c10 2024-09-13T18:28:16.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a800c8fc0 con 0x7f1a801f1c10 2024-09-13T18:28:16.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a7d7fa640 1 -- 172.21.15.53:0/3811950550 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f1a70019020 con 0x7f1a801f1c10 2024-09-13T18:28:16.717 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:16.718 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:28:16.718 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:28:16.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a60066870 msgr2=0x7f1a60068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a60066870 0x7f1a60068d30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a680b0000 tx=0x7f1a680aa070 comp rx=0 tx=0).stop 2024-09-13T18:28:16.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a801f1c10 msgr2=0x7f1a8015da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a801f1c10 0x7f1a8015da80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000db40 tx=0x7f1a70007e60 comp rx=0 tx=0).stop 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 shutdown_connections 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a60066870 0x7f1a60068d30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a8015e7d0 0x7f1a8015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a800cb840 0x7f1a800cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 --2- 172.21.15.53:0/3811950550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a801f1c10 0x7f1a8015da80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 >> 172.21.15.53:0/3811950550 conn(0x7f1a80066080 msgr2=0x7f1a800cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 shutdown_connections 2024-09-13T18:28:16.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.712+0000 7f1a865f6640 1 -- 172.21.15.53:0/3811950550 wait complete. 2024-09-13T18:28:16.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:16.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071bfa1640 1 Processor -- start 2024-09-13T18:28:16.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071bfa1640 1 -- start start 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071bfa1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 0x7f07140d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071bfa1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07140cd6c0 0x7f07140cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071bfa1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07140d2400 con 0x7f07140cdb00 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071bfa1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140d1530 con 0x7f07140cd6c0 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071bfa1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140d0920 con 0x7f071415cab0 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071953c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07140cd6c0 0x7f07140cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071953c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07140cd6c0 0x7f07140cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45140/0 (socket says 172.21.15.53:45140) 2024-09-13T18:28:16.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071953c640 1 -- 172.21.15.53:0/2260893018 learned_addr learned my addr 172.21.15.53:0/2260893018 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:16.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071953c640 1 -- 172.21.15.53:0/2260893018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 msgr2=0x7f07140d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:16.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071953c640 1 --2- 172.21.15.53:0/2260893018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 0x7f07140d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071953c640 1 -- 172.21.15.53:0/2260893018 >> v1:172.21.15.87:6789/0 conn(0x7f07140cdb00 legacy=0x7f07140b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:16.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.844+0000 7f071953c640 1 -- 172.21.15.53:0/2260893018 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07140d0c00 con 0x7f07140cd6c0 2024-09-13T18:28:16.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071953c640 1 --2- 172.21.15.53:0/2260893018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f07140cf0c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0704009870 tx=0x7f070401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35168a32613c83da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0718d3b640 1 -- 172.21.15.53:0/2260893018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07040ac620 con 0x7f07140cd6c0 2024-09-13T18:28:16.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0718d3b640 1 -- 172.21.15.53:0/2260893018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07040ac780 con 0x7f07140cd6c0 2024-09-13T18:28:16.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0718d3b640 1 -- 172.21.15.53:0/2260893018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07040acb10 con 0x7f07140cd6c0 2024-09-13T18:28:16.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- 172.21.15.53:0/2260893018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 msgr2=0x7f07140cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 --2- 172.21.15.53:0/2260893018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f07140cf0c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0704009870 tx=0x7f070401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- 172.21.15.53:0/2260893018 shutdown_connections 2024-09-13T18:28:16.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 --2- 172.21.15.53:0/2260893018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f07140cf0c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 --2- 172.21.15.53:0/2260893018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 0x7f07140d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- 172.21.15.53:0/2260893018 >> 172.21.15.53:0/2260893018 conn(0x7f0714065c80 msgr2=0x7f0714066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:16.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- 172.21.15.53:0/2260893018 shutdown_connections 2024-09-13T18:28:16.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- 172.21.15.53:0/2260893018 wait complete. 2024-09-13T18:28:16.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 Processor -- start 2024-09-13T18:28:16.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- start start 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f0714166750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07140cdb00 0x7f0714159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 0x7f0714154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0714157260 con 0x7f07140cd6c0 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0714166c90 con 0x7f07140cdb00 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140cb980 con 0x7f071415cab0 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f0714166750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f0714166750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45142/0 (socket says 172.21.15.53:45142) 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 -- 172.21.15.53:0/3727852404 learned_addr learned my addr 172.21.15.53:0/3727852404 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:16.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071953c640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07140cdb00 0x7f0714159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 -- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 msgr2=0x7f0714154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 0x7f0714154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 -- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07140cdb00 msgr2=0x7f0714159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07140cdb00 0x7f0714159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 -- 172.21.15.53:0/3727852404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040094d0 con 0x7f07140cd6c0 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f0719d3d640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f0714166750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f071000ba50 tx=0x7f071000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f070a7fc640 1 -- 172.21.15.53:0/3727852404 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000cbe0 con 0x7f07140cd6c0 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f070a7fc640 1 -- 172.21.15.53:0/3727852404 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071000cd60 con 0x7f07140cd6c0 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f070a7fc640 1 -- 172.21.15.53:0/3727852404 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710014680 con 0x7f07140cd6c0 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07140cb3c0 con 0x7f07140cd6c0 2024-09-13T18:28:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.848+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0714156ef0 con 0x7f07140cd6c0 2024-09-13T18:28:16.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.852+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07140cf0c0 con 0x7f07140cd6c0 2024-09-13T18:28:16.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.852+0000 7f070a7fc640 1 -- 172.21.15.53:0/3727852404 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f071001d3b0 con 0x7f07140cd6c0 2024-09-13T18:28:16.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.852+0000 7f070a7fc640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06f8066840 0x7f06f8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:16.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.852+0000 7f070a7fc640 1 -- 172.21.15.53:0/3727852404 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0710084400 con 0x7f07140cd6c0 2024-09-13T18:28:16.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.852+0000 7f071953c640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06f8066840 0x7f06f8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:16.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.852+0000 7f071953c640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06f8066840 0x7f06f8068d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07040ae000 tx=0x7f0704008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:16.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:16.856+0000 7f070a7fc640 1 -- 172.21.15.53:0/3727852404 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0710051540 con 0x7f07140cd6c0 2024-09-13T18:28:17.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.012+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07140c8d90 con 0x7f07140cd6c0 2024-09-13T18:28:17.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f070a7fc640 1 -- 172.21.15.53:0/3727852404 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f0710054b60 con 0x7f07140cd6c0 2024-09-13T18:28:17.021 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:17.021 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:27:40.159907+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06f8066840 msgr2=0x7f06f8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06f8066840 0x7f06f8068d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07040ae000 tx=0x7f0704008040 comp rx=0 tx=0).stop 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 msgr2=0x7f0714166750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f0714166750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f071000ba50 tx=0x7f071000bf10 comp rx=0 tx=0).stop 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 shutdown_connections 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f06f8066840 0x7f06f8068d00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f071415cab0 0x7f0714154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07140cdb00 0x7f0714159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 --2- 172.21.15.53:0/3727852404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07140cd6c0 0x7f0714166750 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 >> 172.21.15.53:0/3727852404 conn(0x7f0714065c80 msgr2=0x7f07140b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 shutdown_connections 2024-09-13T18:28:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.016+0000 7f071bfa1640 1 -- 172.21.15.53:0/3727852404 wait complete. 2024-09-13T18:28:17.039 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:28:17.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa288a59640 1 Processor -- start 2024-09-13T18:28:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa288a59640 1 -- start start 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa288a59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 0x7fa28415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa288a59640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28415dff0 con 0x7fa28415c810 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa288a59640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28415e2d0 con 0x7fa28406ae50 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa288a59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28415e5b0 con 0x7fa2841600a0 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa28415c810 0x7fa28406a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55448/0 (socket says 172.21.15.53:55448) 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 -- 172.21.15.53:0/2942679690 learned_addr learned my addr 172.21.15.53:0/2942679690 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa282d9d640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 0x7fa28415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219536850 0 0) 0x7fa28415dff0 con 0x7fa28415c810 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa270003530 con 0x7fa28415c810 2024-09-13T18:28:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1337028647 0 0) 0x7fa270003530 con 0x7fa28415c810 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 msgr2=0x7fa28415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 0x7fa28415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 >> v1:172.21.15.87:6789/0 conn(0x7fa28406ae50 legacy=0x7fa28415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28415e890 con 0x7fa28415c810 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa274001680 con 0x7fa28415c810 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 >> v1:172.21.15.53:6789/0 conn(0x7fa28415c810 legacy=0x7fa28406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa270003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 0x7fa2700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa270004d10 0x7fa270005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28415e5b0 con 0x7fa2700039b0 2024-09-13T18:28:17.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27000ba40 con 0x7fa270004d10 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27000bc00 con 0x7fa2841600a0 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa270003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa281d9b640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 0x7fa2700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa282d9d640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa270004d10 0x7fa270005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 -- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 msgr2=0x7fa2700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 0x7fa2700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 -- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa270004d10 msgr2=0x7fa270005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa270004d10 0x7fa270005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa28259c640 1 -- 172.21.15.53:0/2942679690 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa270003530 con 0x7fa2700039b0 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa282d9d640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa270004d10 0x7fa270005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.148+0000 7fa281d9b640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2841600a0 0x7fa2700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:17.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa28259c640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa270003d90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa27400c210 tx=0x7fa27401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b16a465aacdcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740a5b50 con 0x7fa2700039b0 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2740a5cd0 con 0x7fa2700039b0 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa28159a640 1 -- 172.21.15.53:0/2942679690 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274005b20 con 0x7fa2700039b0 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- 172.21.15.53:0/2942679690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 msgr2=0x7fa270003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 --2- 172.21.15.53:0/2942679690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa270003d90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa27400c210 tx=0x7fa27401cc50 comp rx=0 tx=0).stop 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa282d9d640 1 -- 172.21.15.53:0/2942679690 reap_dead start 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- 172.21.15.53:0/2942679690 shutdown_connections 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- 172.21.15.53:0/2942679690 >> 172.21.15.53:0/2942679690 conn(0x7fa284071a50 msgr2=0x7fa284099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- 172.21.15.53:0/2942679690 shutdown_connections 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- 172.21.15.53:0/2942679690 wait complete. 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 Processor -- start 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- start start 2024-09-13T18:28:17.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa2841560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28409b700 0x7fa28409bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa28406d5b0 0x7fa28406da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28406df70 con 0x7fa2700039b0 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2841f5510 con 0x7fa28409b700 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.152+0000 7fa288a59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28409c1c0 con 0x7fa28406d5b0 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa2841560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa2841560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45160/0 (socket says 172.21.15.53:45160) 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 -- 172.21.15.53:0/4177179245 learned_addr learned my addr 172.21.15.53:0/4177179245 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa281d9b640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28409b700 0x7fa28409bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa282d9d640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa28406d5b0 0x7fa28406da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 -- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa28406d5b0 msgr2=0x7fa28406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa28406d5b0 0x7fa28406da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 -- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28409b700 msgr2=0x7fa28409bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28409b700 0x7fa28409bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 -- 172.21.15.53:0/4177179245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28409c4a0 con 0x7fa2700039b0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa28259c640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa2841560d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa27401ca80 tx=0x7fa270005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa27affd640 1 -- 172.21.15.53:0/4177179245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740b4070 con 0x7fa2700039b0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa27affd640 1 -- 172.21.15.53:0/4177179245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2740a5950 con 0x7fa2700039b0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28409c780 con 0x7fa2700039b0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa27affd640 1 -- 172.21.15.53:0/4177179245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274005b00 con 0x7fa2700039b0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa284156610 con 0x7fa2700039b0 2024-09-13T18:28:17.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2841f5650 con 0x7fa2700039b0 2024-09-13T18:28:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa27affd640 1 -- 172.21.15.53:0/4177179245 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa274005c80 con 0x7fa2700039b0 2024-09-13T18:28:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa27affd640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa264066840 0x7fa264068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa27affd640 1 -- 172.21.15.53:0/4177179245 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa27411dfd0 con 0x7fa2700039b0 2024-09-13T18:28:17.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa281d9b640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa264066840 0x7fa264068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.156+0000 7fa281d9b640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa264066840 0x7fa264068d00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa2840d15d0 tx=0x7fa27c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.160+0000 7fa27affd640 1 -- 172.21.15.53:0/4177179245 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2740eb110 con 0x7fa2700039b0 2024-09-13T18:28:17.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.348+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa28415d2c0 con 0x7fa2700039b0 2024-09-13T18:28:17.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa27affd640 1 -- 172.21.15.53:0/4177179245 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7fa2740ee730 con 0x7fa2700039b0 2024-09-13T18:28:17.356 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:17.356 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:28:17.357 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:28:17.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa264066840 msgr2=0x7fa264068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa264066840 0x7fa264068d00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa2840d15d0 tx=0x7fa27c009040 comp rx=0 tx=0).stop 2024-09-13T18:28:17.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 msgr2=0x7fa2841560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa2841560d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa27401ca80 tx=0x7fa270005800 comp rx=0 tx=0).stop 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 shutdown_connections 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa264066840 0x7fa264068d00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa28406d5b0 0x7fa28406da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa28409b700 0x7fa28409bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 --2- 172.21.15.53:0/4177179245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2700039b0 0x7fa2841560d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 >> 172.21.15.53:0/4177179245 conn(0x7fa284071a50 msgr2=0x7fa2841599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 shutdown_connections 2024-09-13T18:28:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.352+0000 7fa288a59640 1 -- 172.21.15.53:0/4177179245 wait complete. 2024-09-13T18:28:17.374 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:17.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5930b84640 1 Processor -- start 2024-09-13T18:28:17.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5930b84640 1 -- start start 2024-09-13T18:28:17.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5930b84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f592c15c750 0x7f592c0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5930b84640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f592c066390 0x7f592c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5930b84640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0ad230 con 0x7f592c0ae980 2024-09-13T18:28:17.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5930b84640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0ad510 con 0x7f592c15c750 2024-09-13T18:28:17.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5930b84640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0ad7f0 con 0x7f592c066390 2024-09-13T18:28:17.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f592c15c750 0x7f592c0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5929d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f592c0ae980 0x7f592c065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55460/0 (socket says 172.21.15.53:55460) 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f5929d9b640 1 -- 172.21.15.53:0/2070920035 learned_addr learned my addr 172.21.15.53:0/2070920035 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f592c15c750 0x7f592c0acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45170/0 (socket says 172.21.15.53:45170) 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592ad9d640 1 --2- 172.21.15.53:0/2070920035 >> v2:172.21.15.87:3300/0 conn(0x7f592c066390 0x7f592c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592a59c640 1 -- 172.21.15.53:0/2070920035 >> v2:172.21.15.87:3300/0 conn(0x7f592c066390 msgr2=0x7f592c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592a59c640 1 --2- 172.21.15.53:0/2070920035 >> v2:172.21.15.87:3300/0 conn(0x7f592c066390 0x7f592c06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592a59c640 1 -- 172.21.15.53:0/2070920035 >> v1:172.21.15.53:6789/0 conn(0x7f592c0ae980 legacy=0x7f592c065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592959a640 1 -- 172.21.15.53:0/2070920035 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633204363 0 0) 0x7f592c0ad230 con 0x7f592c0ae980 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592a59c640 1 -- 172.21.15.53:0/2070920035 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0adad0 con 0x7f592c15c750 2024-09-13T18:28:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.488+0000 7f592ad9d640 1 --2- 172.21.15.53:0/2070920035 >> v2:172.21.15.87:3300/0 conn(0x7f592c066390 0x7f592c06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:17.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f592a59c640 1 --2- 172.21.15.53:0/2070920035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c15c750 0x7f592c0acbc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f592c0b4850 tx=0x7f591c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd41fe1b7a1e55c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f592959a640 1 -- 172.21.15.53:0/2070920035 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c0a5980 con 0x7f592c15c750 2024-09-13T18:28:17.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f592959a640 1 -- 172.21.15.53:0/2070920035 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0aef90 con 0x7f592c15c750 2024-09-13T18:28:17.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f592959a640 1 -- 172.21.15.53:0/2070920035 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c0a5d00 con 0x7f592c15c750 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 -- 172.21.15.53:0/2070920035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c15c750 msgr2=0x7f592c0acbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 --2- 172.21.15.53:0/2070920035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c15c750 0x7f592c0acbc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f592c0b4850 tx=0x7f591c01c8a0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 -- 172.21.15.53:0/2070920035 shutdown_connections 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 --2- 172.21.15.53:0/2070920035 >> v2:172.21.15.87:3300/0 conn(0x7f592c066390 0x7f592c06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 --2- 172.21.15.53:0/2070920035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c15c750 0x7f592c0acbc0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 -- 172.21.15.53:0/2070920035 >> 172.21.15.53:0/2070920035 conn(0x7f592c0b1310 msgr2=0x7f592c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 -- 172.21.15.53:0/2070920035 shutdown_connections 2024-09-13T18:28:17.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 -- 172.21.15.53:0/2070920035 wait complete. 2024-09-13T18:28:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 Processor -- start 2024-09-13T18:28:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 -- start start 2024-09-13T18:28:17.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c066390 0x7f592c155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.492+0000 7f5930b84640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f592c0ae980 0x7f592c14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5930b84640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592c15c750 0x7f592c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5930b84640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c158720 con 0x7f592c066390 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5930b84640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c156060 con 0x7f592c0ae980 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5930b84640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c154db0 con 0x7f592c15c750 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c066390 0x7f592c155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c066390 0x7f592c155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45178/0 (socket says 172.21.15.53:45178) 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 -- 172.21.15.53:0/3715729259 learned_addr learned my addr 172.21.15.53:0/3715729259 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5929d9b640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f592c0ae980 0x7f592c14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 -- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592c15c750 msgr2=0x7f592c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592c15c750 0x7f592c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 -- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f592c0ae980 msgr2=0x7f592c14d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f592c0ae980 0x7f592c14d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 -- 172.21.15.53:0/3715729259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c009a70 con 0x7f592c066390 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5929d9b640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f592c0ae980 0x7f592c14d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f592a59c640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c066390 0x7f592c155b20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f591c000f90 tx=0x7f591c019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5922ffd640 1 -- 172.21.15.53:0/3715729259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c009450 con 0x7f592c066390 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5922ffd640 1 -- 172.21.15.53:0/3715729259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c0ad650 con 0x7f592c066390 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c155090 con 0x7f592c066390 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5922ffd640 1 -- 172.21.15.53:0/3715729259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c0ad9c0 con 0x7f592c066390 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c1583b0 con 0x7f592c066390 2024-09-13T18:28:17.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c06c650 con 0x7f592c066390 2024-09-13T18:28:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5922ffd640 1 -- 172.21.15.53:0/3715729259 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f591c0adb20 con 0x7f592c066390 2024-09-13T18:28:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5922ffd640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f590c066840 0x7f590c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5922ffd640 1 -- 172.21.15.53:0/3715729259 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f591c11f500 con 0x7f592c066390 2024-09-13T18:28:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5929d9b640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f590c066840 0x7f590c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.496+0000 7f5929d9b640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f590c066840 0x7f590c068d00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f592c0ce900 tx=0x7f5914009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.500+0000 7f5922ffd640 1 -- 172.21.15.53:0/3715729259 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f591c0ec640 con 0x7f592c066390 2024-09-13T18:28:17.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.692+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f592c1566c0 con 0x7f592c066390 2024-09-13T18:28:17.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.692+0000 7f5922ffd640 1 -- 172.21.15.53:0/3715729259 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f591c0efc60 con 0x7f592c066390 2024-09-13T18:28:17.700 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:17.700 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:26:42.155898+0000","modified":"2024-09-13T18:26:45.456189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5700":{"gid":5700,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1420693601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1420693601},{"type":"v1","addr":"172.21.15.53:6835","nonce":1420693601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:28:17.700 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 23 2024-09-13T18:28:17.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f590c066840 msgr2=0x7f590c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f590c066840 0x7f590c068d00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f592c0ce900 tx=0x7f5914009040 comp rx=0 tx=0).stop 2024-09-13T18:28:17.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c066390 msgr2=0x7f592c155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c066390 0x7f592c155b20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f591c000f90 tx=0x7f591c019640 comp rx=0 tx=0).stop 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 shutdown_connections 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f590c066840 0x7f590c068d00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592c15c750 0x7f592c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f592c0ae980 0x7f592c14d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 --2- 172.21.15.53:0/3715729259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f592c066390 0x7f592c155b20 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 >> 172.21.15.53:0/3715729259 conn(0x7f592c0b1310 msgr2=0x7f592c156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 shutdown_connections 2024-09-13T18:28:17.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.696+0000 7f5930b84640 1 -- 172.21.15.53:0/3715729259 wait complete. 2024-09-13T18:28:17.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:17.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef9b488640 1 Processor -- start 2024-09-13T18:28:17.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef9b488640 1 -- start start 2024-09-13T18:28:17.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef9b488640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef940713a0 0x7fef94165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef9b488640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9406d480 con 0x7fef941582a0 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef9b488640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9415ace0 con 0x7fef9415b7c0 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef9b488640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9415aaf0 con 0x7fef940713a0 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef99224640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fef941582a0 0x7fef9406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55472/0 (socket says 172.21.15.53:55472) 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef99224640 1 -- 172.21.15.53:0/1016619985 learned_addr learned my addr 172.21.15.53:0/1016619985 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef99a25640 1 --2- 172.21.15.53:0/1016619985 >> v2:172.21.15.53:3300/0 conn(0x7fef940713a0 0x7fef94165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef8bfff640 1 -- 172.21.15.53:0/1016619985 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910699259 0 0) 0x7fef9406d480 con 0x7fef941582a0 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef8bfff640 1 -- 172.21.15.53:0/1016619985 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef80003530 con 0x7fef941582a0 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef99a25640 1 -- 172.21.15.53:0/1016619985 >> v1:172.21.15.87:6789/0 conn(0x7fef9415b7c0 legacy=0x7fef94070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef99a25640 1 -- 172.21.15.53:0/1016619985 >> v1:172.21.15.53:6789/0 conn(0x7fef941582a0 legacy=0x7fef9406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.824+0000 7fef99a25640 1 -- 172.21.15.53:0/1016619985 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9415afc0 con 0x7fef940713a0 2024-09-13T18:28:17.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef99a25640 1 --2- 172.21.15.53:0/1016619985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef940713a0 0x7fef94165100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009d90 tx=0x7fef8c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea207da64de16b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef8bfff640 1 -- 172.21.15.53:0/1016619985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c0a5940 con 0x7fef940713a0 2024-09-13T18:28:17.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef8bfff640 1 -- 172.21.15.53:0/1016619985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c0a5aa0 con 0x7fef940713a0 2024-09-13T18:28:17.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef8bfff640 1 -- 172.21.15.53:0/1016619985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c0a5e10 con 0x7fef940713a0 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 -- 172.21.15.53:0/1016619985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef940713a0 msgr2=0x7fef94165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 --2- 172.21.15.53:0/1016619985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef940713a0 0x7fef94165100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009d90 tx=0x7fef8c01c970 comp rx=0 tx=0).stop 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 -- 172.21.15.53:0/1016619985 shutdown_connections 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 --2- 172.21.15.53:0/1016619985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef940713a0 0x7fef94165100 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 -- 172.21.15.53:0/1016619985 >> 172.21.15.53:0/1016619985 conn(0x7fef94065c80 msgr2=0x7fef94066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 -- 172.21.15.53:0/1016619985 shutdown_connections 2024-09-13T18:28:17.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 -- 172.21.15.53:0/1016619985 wait complete. 2024-09-13T18:28:17.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 Processor -- start 2024-09-13T18:28:17.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.828+0000 7fef9b488640 1 -- start start 2024-09-13T18:28:17.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef940713a0 0x7fef94149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef941582a0 0x7fef941470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef9415b7c0 0x7fef94159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94147630 con 0x7fef941582a0 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94158c80 con 0x7fef940713a0 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef94158f60 con 0x7fef9415b7c0 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef941582a0 0x7fef941470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef941582a0 0x7fef941470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45208/0 (socket says 172.21.15.53:45208) 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 -- 172.21.15.53:0/1106785051 learned_addr learned my addr 172.21.15.53:0/1106785051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef99224640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef940713a0 0x7fef94149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 -- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef9415b7c0 msgr2=0x7fef94159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef99a25640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef9415b7c0 0x7fef94159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef9415b7c0 0x7fef94159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 -- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef940713a0 msgr2=0x7fef94149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef940713a0 0x7fef94149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 -- 172.21.15.53:0/1106785051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c009a70 con 0x7fef941582a0 2024-09-13T18:28:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef98a23640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef941582a0 0x7fef941470f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c370 tx=0x7fef8400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef89ffb640 1 -- 172.21.15.53:0/1106785051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef840052d0 con 0x7fef941582a0 2024-09-13T18:28:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef89ffb640 1 -- 172.21.15.53:0/1106785051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef84005430 con 0x7fef941582a0 2024-09-13T18:28:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef94159240 con 0x7fef941582a0 2024-09-13T18:28:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef89ffb640 1 -- 172.21.15.53:0/1106785051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84007260 con 0x7fef941582a0 2024-09-13T18:28:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef94159800 con 0x7fef941582a0 2024-09-13T18:28:17.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef94067400 con 0x7fef941582a0 2024-09-13T18:28:17.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef89ffb640 1 -- 172.21.15.53:0/1106785051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fef840073c0 con 0x7fef941582a0 2024-09-13T18:28:17.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef89ffb640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef78066870 0x7fef78068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef89ffb640 1 -- 172.21.15.53:0/1106785051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fef84083780 con 0x7fef941582a0 2024-09-13T18:28:17.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.832+0000 7fef99224640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef78066870 0x7fef78068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.836+0000 7fef99224640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef78066870 0x7fef78068d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fef900011f0 tx=0x7fef90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:17.836+0000 7fef89ffb640 1 -- 172.21.15.53:0/1106785051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef840508c0 con 0x7fef941582a0 2024-09-13T18:28:18.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.000+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef9406c900 con 0x7fef941582a0 2024-09-13T18:28:18.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.000+0000 7fef89ffb640 1 -- 172.21.15.53:0/1106785051 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fef84053ee0 con 0x7fef941582a0 2024-09-13T18:28:18.008 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:18.008 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:27:40.159907+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:26:40.433725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:26:41.119531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef78066870 msgr2=0x7fef78068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef78066870 0x7fef78068d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fef900011f0 tx=0x7fef90009040 comp rx=0 tx=0).stop 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef941582a0 msgr2=0x7fef941470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef941582a0 0x7fef941470f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c370 tx=0x7fef8400c830 comp rx=0 tx=0).stop 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 shutdown_connections 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fef78066870 0x7fef78068d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef9415b7c0 0x7fef94159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef941582a0 0x7fef941470f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 --2- 172.21.15.53:0/1106785051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef940713a0 0x7fef94149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 >> 172.21.15.53:0/1106785051 conn(0x7fef94065c80 msgr2=0x7fef94066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:18.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 shutdown_connections 2024-09-13T18:28:18.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.004+0000 7fef9b488640 1 -- 172.21.15.53:0/1106785051 wait complete. 2024-09-13T18:28:18.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:28:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83e1bd1640 1 Processor -- start 2024-09-13T18:28:18.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83e1bd1640 1 -- start start 2024-09-13T18:28:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83e1bd1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83dc0b1af0 0x7f83dc0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83e1bd1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc0cfe80 con 0x7f83dc0cd630 2024-09-13T18:28:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83e1bd1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc06ac20 con 0x7f83dc069f50 2024-09-13T18:28:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83e1bd1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0d0120 con 0x7f83dc0b1af0 2024-09-13T18:28:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83db7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f83dc0cd630 0x7f83dc0b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55484/0 (socket says 172.21.15.53:55484) 2024-09-13T18:28:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83daffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83dc0b1af0 0x7f83dc0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83db7fe640 1 -- 172.21.15.53:0/1130753227 learned_addr learned my addr 172.21.15.53:0/1130753227 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83daffd640 1 -- 172.21.15.53:0/1130753227 >> v1:172.21.15.87:6789/0 conn(0x7f83dc069f50 legacy=0x7f83dc06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83daffd640 1 -- 172.21.15.53:0/1130753227 >> v1:172.21.15.53:6789/0 conn(0x7f83dc0cd630 legacy=0x7f83dc0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83da7fc640 1 -- 172.21.15.53:0/1130753227 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547678576 0 0) 0x7f83dc0cfe80 con 0x7f83dc0cd630 2024-09-13T18:28:18.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.148+0000 7f83daffd640 1 -- 172.21.15.53:0/1130753227 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc06af00 con 0x7f83dc0b1af0 2024-09-13T18:28:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83daffd640 1 --2- 172.21.15.53:0/1130753227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0cf580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0097c0 tx=0x7f83cc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc977e1a095596bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83da7fc640 1 -- 172.21.15.53:0/1130753227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0ab600 con 0x7f83dc0b1af0 2024-09-13T18:28:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83da7fc640 1 -- 172.21.15.53:0/1130753227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc0a7050 con 0x7f83dc0b1af0 2024-09-13T18:28:18.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83da7fc640 1 -- 172.21.15.53:0/1130753227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0ab980 con 0x7f83dc0b1af0 2024-09-13T18:28:18.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 -- 172.21.15.53:0/1130753227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc0b1af0 msgr2=0x7f83dc0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/1130753227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0cf580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0097c0 tx=0x7f83cc01c380 comp rx=0 tx=0).stop 2024-09-13T18:28:18.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 -- 172.21.15.53:0/1130753227 shutdown_connections 2024-09-13T18:28:18.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/1130753227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0cf580 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 -- 172.21.15.53:0/1130753227 >> 172.21.15.53:0/1130753227 conn(0x7f83dc0b20d0 msgr2=0x7f83dc0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:18.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 -- 172.21.15.53:0/1130753227 shutdown_connections 2024-09-13T18:28:18.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 -- 172.21.15.53:0/1130753227 wait complete. 2024-09-13T18:28:18.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 Processor -- start 2024-09-13T18:28:18.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.152+0000 7f83e1bd1640 1 -- start start 2024-09-13T18:28:18.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc069f50 0x7f83dc0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83dc0cd630 0x7f83dc0b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0b38d0 con 0x7f83dc069f50 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0b3bb0 con 0x7f83dc0b1af0 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0b3e90 con 0x7f83dc0cd630 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc069f50 0x7f83dc0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc069f50 0x7f83dc0b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45216/0 (socket says 172.21.15.53:45216) 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 -- 172.21.15.53:0/3751830146 learned_addr learned my addr 172.21.15.53:0/3751830146 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83daffd640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83dbfff640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83dc0cd630 0x7f83dc0b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 -- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83dc0cd630 msgr2=0x7f83dc0b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83dc0cd630 0x7f83dc0b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 -- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc0b1af0 msgr2=0x7f83dc0b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 -- 172.21.15.53:0/3751830146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc009420 con 0x7f83dc069f50 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83daffd640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83db7fe640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc069f50 0x7f83dc0b4970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f83d00011f0 tx=0x7f83d000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83c3fff640 1 -- 172.21.15.53:0/3751830146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00074e0 con 0x7f83dc069f50 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83c3fff640 1 -- 172.21.15.53:0/3751830146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d0007640 con 0x7f83dc069f50 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc0b4170 con 0x7f83dc069f50 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83c3fff640 1 -- 172.21.15.53:0/3751830146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0004a10 con 0x7f83dc069f50 2024-09-13T18:28:18.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc155150 con 0x7f83dc069f50 2024-09-13T18:28:18.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc06a360 con 0x7f83dc069f50 2024-09-13T18:28:18.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83c3fff640 1 -- 172.21.15.53:0/3751830146 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f83d0004b70 con 0x7f83dc069f50 2024-09-13T18:28:18.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83c3fff640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f83c8066870 0x7f83c8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83c3fff640 1 -- 172.21.15.53:0/3751830146 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f83d0083d00 con 0x7f83dc069f50 2024-09-13T18:28:18.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.156+0000 7f83daffd640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f83c8066870 0x7f83c8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.160+0000 7f83daffd640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f83c8066870 0x7f83c8068d30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0ad000 tx=0x7f83cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:18.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.160+0000 7f83c3fff640 1 -- 172.21.15.53:0/3751830146 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83d0050e90 con 0x7f83dc069f50 2024-09-13T18:28:18.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.352+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f83dc0b4620 con 0x7f83dc069f50 2024-09-13T18:28:18.359 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:28:18.352+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:28:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.364+0000 7f83c3fff640 1 -- 172.21.15.53:0/3751830146 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f83d0018020 con 0x7f83dc069f50 2024-09-13T18:28:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:28:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f83c8066870 msgr2=0x7f83c8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f83c8066870 0x7f83c8068d30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0ad000 tx=0x7f83cc008040 comp rx=0 tx=0).stop 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc069f50 msgr2=0x7f83dc0b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc069f50 0x7f83dc0b4970 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f83d00011f0 tx=0x7f83d000c9b0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 shutdown_connections 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f83c8066870 0x7f83c8068d30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83dc0cd630 0x7f83dc0b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83dc0b1af0 0x7f83dc0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 --2- 172.21.15.53:0/3751830146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83dc069f50 0x7f83dc0b4970 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 >> 172.21.15.53:0/3751830146 conn(0x7f83dc0b20d0 msgr2=0x7f83dc06e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 shutdown_connections 2024-09-13T18:28:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.368+0000 7f83e1bd1640 1 -- 172.21.15.53:0/3751830146 wait complete. 2024-09-13T18:28:18.379 INFO:tasks.ceph.mds.a.smithi053.stderr: -8854> 2024-09-13T18:26:43.414+0000 7fb935bb0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:28:18.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:28:18.424 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:28:18.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f8470640 1 Processor -- start 2024-09-13T18:28:18.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f8470640 1 -- start start 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f8470640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82f0154a50 0x7f82f006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f8470640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82f015b470 0x7f82f00abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f8470640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f006c980 con 0x7f82f00ac2e0 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f8470640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00ac770 con 0x7f82f0154a50 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f8470640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f006d350 con 0x7f82f015b470 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f620c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82f0154a50 0x7f82f006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f620c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82f0154a50 0x7f82f006ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45244/0 (socket says 172.21.15.53:45244) 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.500+0000 7f82f620c640 1 -- 172.21.15.53:0/832993367 learned_addr learned my addr 172.21.15.53:0/832993367 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:18.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f620c640 1 -- 172.21.15.53:0/832993367 >> v2:172.21.15.87:3300/0 conn(0x7f82f015b470 msgr2=0x7f82f00abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:18.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f620c640 1 --2- 172.21.15.53:0/832993367 >> v2:172.21.15.87:3300/0 conn(0x7f82f015b470 0x7f82f00abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f620c640 1 -- 172.21.15.53:0/832993367 >> v1:172.21.15.87:6789/0 conn(0x7f82f00ac2e0 legacy=0x7f82f00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:18.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f620c640 1 -- 172.21.15.53:0/832993367 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f006bd70 con 0x7f82f0154a50 2024-09-13T18:28:18.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f620c640 1 --2- 172.21.15.53:0/832993367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f006ce10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f82f00b4470 tx=0x7f82ec01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08e48d8d86adc05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:18.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f520a640 1 -- 172.21.15.53:0/832993367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0aa610 con 0x7f82f0154a50 2024-09-13T18:28:18.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f520a640 1 -- 172.21.15.53:0/832993367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec0a6040 con 0x7f82f0154a50 2024-09-13T18:28:18.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f520a640 1 -- 172.21.15.53:0/832993367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0aa990 con 0x7f82f0154a50 2024-09-13T18:28:18.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 -- 172.21.15.53:0/832993367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 msgr2=0x7f82f006ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 --2- 172.21.15.53:0/832993367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f006ce10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f82f00b4470 tx=0x7f82ec01c4b0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 -- 172.21.15.53:0/832993367 shutdown_connections 2024-09-13T18:28:18.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 --2- 172.21.15.53:0/832993367 >> v2:172.21.15.87:3300/0 conn(0x7f82f015b470 0x7f82f00abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 --2- 172.21.15.53:0/832993367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f006ce10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 -- 172.21.15.53:0/832993367 >> 172.21.15.53:0/832993367 conn(0x7f82f0069f50 msgr2=0x7f82f006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 -- 172.21.15.53:0/832993367 shutdown_connections 2024-09-13T18:28:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.504+0000 7f82f8470640 1 -- 172.21.15.53:0/832993367 wait complete. 2024-09-13T18:28:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 Processor -- start 2024-09-13T18:28:18.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 -- start start 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f00ac2e0 0x7f82f013afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f0070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82f015b470 0x7f82f015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0159560 con 0x7f82f0154a50 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0159840 con 0x7f82f00ac2e0 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0159b20 con 0x7f82f015b470 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f0070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f0070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45246/0 (socket says 172.21.15.53:45246) 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 -- 172.21.15.53:0/4085173900 learned_addr learned my addr 172.21.15.53:0/4085173900 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f620c640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f00ac2e0 0x7f82f013afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f6a0d640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82f015b470 0x7f82f015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 -- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82f015b470 msgr2=0x7f82f015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82f015b470 0x7f82f015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 -- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f00ac2e0 msgr2=0x7f82f013afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f00ac2e0 0x7f82f013afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 -- 172.21.15.53:0/4085173900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0094d0 con 0x7f82f0154a50 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f5a0b640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f0070bc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b550 tx=0x7f82e000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82e6ffd640 1 -- 172.21.15.53:0/4085173900 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0010870 con 0x7f82f0154a50 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82e6ffd640 1 -- 172.21.15.53:0/4085173900 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e00109f0 con 0x7f82f0154a50 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f0159e00 con 0x7f82f0154a50 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82e6ffd640 1 -- 172.21.15.53:0/4085173900 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0010da0 con 0x7f82f0154a50 2024-09-13T18:28:18.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f015ab20 con 0x7f82f0154a50 2024-09-13T18:28:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f00b2620 con 0x7f82f0154a50 2024-09-13T18:28:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.508+0000 7f82e6ffd640 1 -- 172.21.15.53:0/4085173900 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f82e000f3c0 con 0x7f82f0154a50 2024-09-13T18:28:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.512+0000 7f82e6ffd640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82d4066840 0x7f82d4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.512+0000 7f82e6ffd640 1 -- 172.21.15.53:0/4085173900 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f82e00844f0 con 0x7f82f0154a50 2024-09-13T18:28:18.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.512+0000 7f82f620c640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82d4066840 0x7f82d4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:18.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.512+0000 7f82f620c640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82d4066840 0x7f82d4068d00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0ae000 tx=0x7f82ec0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:18.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.516+0000 7f82e6ffd640 1 -- 172.21.15.53:0/4085173900 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82e0051550 con 0x7f82f0154a50 2024-09-13T18:28:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:18.700+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82f015b8e0 con 0x7f82f0154a50 2024-09-13T18:28:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.368+0000 7f82e6ffd640 1 -- 172.21.15.53:0/4085173900 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f82e0054b70 con 0x7f82f0154a50 2024-09-13T18:28:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82d4066840 msgr2=0x7f82d4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82d4066840 0x7f82d4068d00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0ae000 tx=0x7f82ec0a7000 comp rx=0 tx=0).stop 2024-09-13T18:28:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 msgr2=0x7f82f0070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f0070bc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b550 tx=0x7f82e000ba10 comp rx=0 tx=0).stop 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 shutdown_connections 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f82d4066840 0x7f82d4068d00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82f015b470 0x7f82f015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82f0154a50 0x7f82f0070bc0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 --2- 172.21.15.53:0/4085173900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f00ac2e0 0x7f82f013afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 >> 172.21.15.53:0/4085173900 conn(0x7f82f0069f50 msgr2=0x7f82f015c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 shutdown_connections 2024-09-13T18:28:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.372+0000 7f82f8470640 1 -- 172.21.15.53:0/4085173900 wait complete. 2024-09-13T18:28:19.398 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:28:19.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a89dc4640 1 Processor -- start 2024-09-13T18:28:19.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a89dc4640 1 -- start start 2024-09-13T18:28:19.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a89dc4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a8415c5e0 0x7f1a8415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a89dc4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a84070fb0 con 0x7f1a840cc800 2024-09-13T18:28:19.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a89dc4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8415dd30 con 0x7f1a8406ccc0 2024-09-13T18:28:19.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a89dc4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a84070a10 con 0x7f1a8415c5e0 2024-09-13T18:28:19.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a837fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a8415c5e0 0x7f1a8415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a83fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1a840cc800 0x7f1a840ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55494/0 (socket says 172.21.15.53:55494) 2024-09-13T18:28:19.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a83fff640 1 -- 172.21.15.53:0/1685582115 learned_addr learned my addr 172.21.15.53:0/1685582115 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:19.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a837fe640 1 -- 172.21.15.53:0/1685582115 >> v1:172.21.15.87:6789/0 conn(0x7f1a8406ccc0 legacy=0x7f1a8406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:19.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a837fe640 1 -- 172.21.15.53:0/1685582115 >> v1:172.21.15.53:6789/0 conn(0x7f1a840cc800 legacy=0x7f1a840ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.568+0000 7f1a827fc640 1 -- 172.21.15.53:0/1685582115 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414595526 0 0) 0x7f1a84070fb0 con 0x7f1a840cc800 2024-09-13T18:28:19.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a837fe640 1 -- 172.21.15.53:0/1685582115 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840711e0 con 0x7f1a8415c5e0 2024-09-13T18:28:19.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1685582115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a8415d7f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0097c0 tx=0x7f1a7c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2df22054316b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:19.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a827fc640 1 -- 172.21.15.53:0/1685582115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0ad680 con 0x7f1a8415c5e0 2024-09-13T18:28:19.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a827fc640 1 -- 172.21.15.53:0/1685582115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0ad7e0 con 0x7f1a8415c5e0 2024-09-13T18:28:19.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a827fc640 1 -- 172.21.15.53:0/1685582115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0adb70 con 0x7f1a8415c5e0 2024-09-13T18:28:19.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1685582115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 msgr2=0x7f1a8415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1685582115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a8415d7f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0097c0 tx=0x7f1a7c01c470 comp rx=0 tx=0).stop 2024-09-13T18:28:19.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1685582115 shutdown_connections 2024-09-13T18:28:19.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1685582115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a8415d7f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1685582115 >> 172.21.15.53:0/1685582115 conn(0x7f1a84073330 msgr2=0x7f1a84065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:19.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1685582115 shutdown_connections 2024-09-13T18:28:19.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.572+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1685582115 wait complete. 2024-09-13T18:28:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 Processor -- start 2024-09-13T18:28:19.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 -- start start 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8406ccc0 0x7f1a8414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a840cc800 0x7f1a84159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a840ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84159fa0 con 0x7f1a8415c5e0 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8414e2f0 con 0x7f1a8406ccc0 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a841599e0 con 0x7f1a840cc800 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a840ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a840ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45264/0 (socket says 172.21.15.53:45264) 2024-09-13T18:28:19.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 -- 172.21.15.53:0/1244573950 learned_addr learned my addr 172.21.15.53:0/1244573950 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8406ccc0 0x7f1a8414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a82ffd640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a840cc800 0x7f1a84159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 -- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a840cc800 msgr2=0x7f1a84159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a840cc800 0x7f1a84159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 -- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8406ccc0 msgr2=0x7f1a8414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8406ccc0 0x7f1a8414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 -- 172.21.15.53:0/1244573950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c009420 con 0x7f1a8415c5e0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a83fff640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a840ade60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c480 tx=0x7f1a7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a6bfff640 1 -- 172.21.15.53:0/1244573950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740074e0 con 0x7f1a8415c5e0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a6bfff640 1 -- 172.21.15.53:0/1244573950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74007640 con 0x7f1a8415c5e0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a84159cc0 con 0x7f1a8415c5e0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a6bfff640 1 -- 172.21.15.53:0/1244573950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74004a10 con 0x7f1a8415c5e0 2024-09-13T18:28:19.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8414eaf0 con 0x7f1a8415c5e0 2024-09-13T18:28:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8414e670 con 0x7f1a8415c5e0 2024-09-13T18:28:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a6bfff640 1 -- 172.21.15.53:0/1244573950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1a74004b70 con 0x7f1a8415c5e0 2024-09-13T18:28:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a6bfff640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a70066840 0x7f1a70068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a6bfff640 1 -- 172.21.15.53:0/1244573950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1a74083980 con 0x7f1a8415c5e0 2024-09-13T18:28:19.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.576+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a70066840 0x7f1a70068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:19.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.580+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a70066840 0x7f1a70068d00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0af000 tx=0x7f1a7c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:19.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.584+0000 7f1a6bfff640 1 -- 172.21.15.53:0/1244573950 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1a8414e670 con 0x7f1a8415c5e0 2024-09-13T18:28:19.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:19.740+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a8414e670 con 0x7f1a8415c5e0 2024-09-13T18:28:20.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.380+0000 7f1a6bfff640 1 -- 172.21.15.53:0/1244573950 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1a8414e670 con 0x7f1a8415c5e0 2024-09-13T18:28:20.386 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:28:20.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a70066840 msgr2=0x7f1a70068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a70066840 0x7f1a70068d00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0af000 tx=0x7f1a7c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 msgr2=0x7f1a840ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a840ade60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c480 tx=0x7f1a7400c940 comp rx=0 tx=0).stop 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 shutdown_connections 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1a70066840 0x7f1a70068d00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a840cc800 0x7f1a84159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a8415c5e0 0x7f1a840ade60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 --2- 172.21.15.53:0/1244573950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a8406ccc0 0x7f1a8414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 >> 172.21.15.53:0/1244573950 conn(0x7f1a84073330 msgr2=0x7f1a840b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 shutdown_connections 2024-09-13T18:28:20.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.384+0000 7f1a89dc4640 1 -- 172.21.15.53:0/1244573950 wait complete. 2024-09-13T18:28:20.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:28:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 Processor -- start 2024-09-13T18:28:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 -- start start 2024-09-13T18:28:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cd6f0 0x7f15480b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f15480cdad0 0x7f1548143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1548143d50 0x7f154815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480b3020 con 0x7f1548143d50 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480b1f80 con 0x7f15480cdad0 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154e5eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480b2260 con 0x7f15480cd6f0 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154cb88640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1548143d50 0x7f154815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154cb88640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1548143d50 0x7f154815dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45280/0 (socket says 172.21.15.53:45280) 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.532+0000 7f154cb88640 1 -- 172.21.15.53:0/1043868501 learned_addr learned my addr 172.21.15.53:0/1043868501 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f15477fe640 1 --2- 172.21.15.53:0/1043868501 >> v2:172.21.15.87:3300/0 conn(0x7f15480cdad0 0x7f1548143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f1547fff640 1 --2- 172.21.15.53:0/1043868501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cd6f0 0x7f15480b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154cb88640 1 -- 172.21.15.53:0/1043868501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cd6f0 msgr2=0x7f15480b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154cb88640 1 --2- 172.21.15.53:0/1043868501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cd6f0 0x7f15480b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154cb88640 1 -- 172.21.15.53:0/1043868501 >> v2:172.21.15.87:3300/0 conn(0x7f15480cdad0 msgr2=0x7f1548143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:20.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154cb88640 1 --2- 172.21.15.53:0/1043868501 >> v2:172.21.15.87:3300/0 conn(0x7f15480cdad0 0x7f1548143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154cb88640 1 -- 172.21.15.53:0/1043868501 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480b2540 con 0x7f1548143d50 2024-09-13T18:28:20.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154cb88640 1 --2- 172.21.15.53:0/1043868501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1548143d50 0x7f154815dee0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1548066880 tx=0x7f154001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1051a4237e97ef27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f1546ffd640 1 -- 172.21.15.53:0/1043868501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15400a64a0 con 0x7f1548143d50 2024-09-13T18:28:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f1546ffd640 1 -- 172.21.15.53:0/1043868501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15400a6600 con 0x7f1548143d50 2024-09-13T18:28:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f1546ffd640 1 -- 172.21.15.53:0/1043868501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15400a6990 con 0x7f1548143d50 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 -- 172.21.15.53:0/1043868501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1548143d50 msgr2=0x7f154815dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 --2- 172.21.15.53:0/1043868501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1548143d50 0x7f154815dee0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1548066880 tx=0x7f154001c700 comp rx=0 tx=0).stop 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 -- 172.21.15.53:0/1043868501 shutdown_connections 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 --2- 172.21.15.53:0/1043868501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1548143d50 0x7f154815dee0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 --2- 172.21.15.53:0/1043868501 >> v2:172.21.15.87:3300/0 conn(0x7f15480cdad0 0x7f1548143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 --2- 172.21.15.53:0/1043868501 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cd6f0 0x7f15480b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 -- 172.21.15.53:0/1043868501 >> 172.21.15.53:0/1043868501 conn(0x7f1548073330 msgr2=0x7f1548065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 -- 172.21.15.53:0/1043868501 shutdown_connections 2024-09-13T18:28:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.536+0000 7f154e5eb640 1 -- 172.21.15.53:0/1043868501 wait complete. 2024-09-13T18:28:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 Processor -- start 2024-09-13T18:28:20.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 -- start start 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15480cd6f0 0x7f1548140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cdad0 0x7f15480a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1548143d50 0x7f1548159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480a9ee0 con 0x7f15480cd6f0 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154815b430 con 0x7f1548143d50 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154813b870 con 0x7f15480cdad0 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15480cd6f0 0x7f1548140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15480cd6f0 0x7f1548140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45290/0 (socket says 172.21.15.53:45290) 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 -- 172.21.15.53:0/963955714 learned_addr learned my addr 172.21.15.53:0/963955714 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:20.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154cb88640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1548143d50 0x7f1548159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f15477fe640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cdad0 0x7f15480a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 -- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cdad0 msgr2=0x7f15480a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cdad0 0x7f15480a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 -- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1548143d50 msgr2=0x7f1548159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1548143d50 0x7f1548159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 -- 172.21.15.53:0/963955714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1540009b30 con 0x7f15480cd6f0 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1547fff640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15480cd6f0 0x7f1548140a80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f153800d5f0 tx=0x7f153800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1544ff9640 1 -- 172.21.15.53:0/963955714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380125f0 con 0x7f15480cd6f0 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1544ff9640 1 -- 172.21.15.53:0/963955714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538012750 con 0x7f15480cd6f0 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f1544ff9640 1 -- 172.21.15.53:0/963955714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538012ae0 con 0x7f15480cd6f0 2024-09-13T18:28:20.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154813bb50 con 0x7f15480cd6f0 2024-09-13T18:28:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15480ab2d0 con 0x7f15480cd6f0 2024-09-13T18:28:20.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.540+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1548143810 con 0x7f15480cd6f0 2024-09-13T18:28:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.544+0000 7f1544ff9640 1 -- 172.21.15.53:0/963955714 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1538012c40 con 0x7f15480cd6f0 2024-09-13T18:28:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.544+0000 7f1544ff9640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1530066840 0x7f1530068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.544+0000 7f1544ff9640 1 -- 172.21.15.53:0/963955714 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f15380847e0 con 0x7f15480cd6f0 2024-09-13T18:28:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.544+0000 7f15477fe640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1530066840 0x7f1530068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:20.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.544+0000 7f15477fe640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1530066840 0x7f1530068d00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f154813c8d0 tx=0x7f1534008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:20.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.548+0000 7f1544ff9640 1 -- 172.21.15.53:0/963955714 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1538051a80 con 0x7f15480cd6f0 2024-09-13T18:28:20.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:20.708+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f154813d5e0 con 0x7f15480cd6f0 2024-09-13T18:28:21.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.384+0000 7f1544ff9640 1 -- 172.21.15.53:0/963955714 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) v1 ==== 169+0+0 (secure 0 0 0) 0x7f15380550a0 con 0x7f15480cd6f0 2024-09-13T18:28:21.392 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1530066840 msgr2=0x7f1530068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1530066840 0x7f1530068d00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f154813c8d0 tx=0x7f1534008040 comp rx=0 tx=0).stop 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15480cd6f0 msgr2=0x7f1548140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15480cd6f0 0x7f1548140a80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f153800d5f0 tx=0x7f153800dab0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 shutdown_connections 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1530066840 0x7f1530068d00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15480cdad0 0x7f15480a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1548143d50 0x7f1548159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 --2- 172.21.15.53:0/963955714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15480cd6f0 0x7f1548140a80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 >> 172.21.15.53:0/963955714 conn(0x7f1548073330 msgr2=0x7f15480a8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 shutdown_connections 2024-09-13T18:28:21.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.392+0000 7f154e5eb640 1 -- 172.21.15.53:0/963955714 wait complete. 2024-09-13T18:28:21.426 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:28:21.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3f9d1640 1 Processor -- start 2024-09-13T18:28:21.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3f9d1640 1 -- start start 2024-09-13T18:28:21.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3f9d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd38157020 0x7fdd3806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3f9d1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3806d6e0 con 0x7fdd38156c40 2024-09-13T18:28:21.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3f9d1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd380715f0 con 0x7fdd3806d270 2024-09-13T18:28:21.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3f9d1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd380b15a0 con 0x7fdd38157020 2024-09-13T18:28:21.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3cf6c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd38157020 0x7fdd3806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3d76d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdd38156c40 0x7fdd38070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55510/0 (socket says 172.21.15.53:55510) 2024-09-13T18:28:21.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3cf6c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd38157020 0x7fdd3806cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45294/0 (socket says 172.21.15.53:45294) 2024-09-13T18:28:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3d76d640 1 -- 172.21.15.53:0/105564183 learned_addr learned my addr 172.21.15.53:0/105564183 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3cf6c640 1 -- 172.21.15.53:0/105564183 >> v1:172.21.15.87:6789/0 conn(0x7fdd3806d270 legacy=0x7fdd3806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3cf6c640 1 -- 172.21.15.53:0/105564183 >> v1:172.21.15.53:6789/0 conn(0x7fdd38156c40 legacy=0x7fdd38070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd2bfff640 1 -- 172.21.15.53:0/105564183 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55667369 0 0) 0x7fdd3806d6e0 con 0x7fdd38156c40 2024-09-13T18:28:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.548+0000 7fdd3cf6c640 1 -- 172.21.15.53:0/105564183 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380b1880 con 0x7fdd38157020 2024-09-13T18:28:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 --2- 172.21.15.53:0/105564183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38157020 0x7fdd3806cd30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0097c0 tx=0x7fdd2c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a411f8c4a3453 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd2bfff640 1 -- 172.21.15.53:0/105564183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0ab670 con 0x7fdd38157020 2024-09-13T18:28:21.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd2bfff640 1 -- 172.21.15.53:0/105564183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c0ab7d0 con 0x7fdd38157020 2024-09-13T18:28:21.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd2bfff640 1 -- 172.21.15.53:0/105564183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0abb60 con 0x7fdd38157020 2024-09-13T18:28:21.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/105564183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38157020 msgr2=0x7fdd3806cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/105564183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38157020 0x7fdd3806cd30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0097c0 tx=0x7fdd2c01c470 comp rx=0 tx=0).stop 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/105564183 shutdown_connections 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/105564183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38157020 0x7fdd3806cd30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/105564183 >> 172.21.15.53:0/105564183 conn(0x7fdd38065c80 msgr2=0x7fdd38066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/105564183 shutdown_connections 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/105564183 wait complete. 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 Processor -- start 2024-09-13T18:28:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- start start 2024-09-13T18:28:21.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd3806d270 0x7fdd381f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38156c40 0x7fdd3814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd380ae5c0 0x7fdd3815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3806bf70 con 0x7fdd38156c40 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38155290 con 0x7fdd380ae5c0 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3f9d1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380aeb80 con 0x7fdd3806d270 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38156c40 0x7fdd3814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38156c40 0x7fdd3814b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45310/0 (socket says 172.21.15.53:45310) 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 -- 172.21.15.53:0/2044226693 learned_addr learned my addr 172.21.15.53:0/2044226693 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3df6e640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd380ae5c0 0x7fdd3815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3d76d640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd3806d270 0x7fdd381f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 -- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd3806d270 msgr2=0x7fdd381f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd3806d270 0x7fdd381f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 -- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd380ae5c0 msgr2=0x7fdd3815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd380ae5c0 0x7fdd3815c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.552+0000 7fdd3cf6c640 1 -- 172.21.15.53:0/2044226693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c009420 con 0x7fdd38156c40 2024-09-13T18:28:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd3cf6c640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38156c40 0x7fdd3814b010 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0ad040 tx=0x7fdd2c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd29ffb640 1 -- 172.21.15.53:0/2044226693 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0b5810 con 0x7fdd38156c40 2024-09-13T18:28:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd29ffb640 1 -- 172.21.15.53:0/2044226693 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c0b5990 con 0x7fdd38156c40 2024-09-13T18:28:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd380aee60 con 0x7fdd38156c40 2024-09-13T18:28:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd29ffb640 1 -- 172.21.15.53:0/2044226693 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0b5d40 con 0x7fdd38156c40 2024-09-13T18:28:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd380af420 con 0x7fdd38156c40 2024-09-13T18:28:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd38155400 con 0x7fdd38156c40 2024-09-13T18:28:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd29ffb640 1 -- 172.21.15.53:0/2044226693 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fdd2c0b4390 con 0x7fdd38156c40 2024-09-13T18:28:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd29ffb640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd1c066870 0x7fdd1c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd29ffb640 1 -- 172.21.15.53:0/2044226693 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdd2c11eb40 con 0x7fdd38156c40 2024-09-13T18:28:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd3d76d640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd1c066870 0x7fdd1c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.556+0000 7fdd3d76d640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd1c066870 0x7fdd1c068d30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdd34007fd0 tx=0x7fdd34007ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.560+0000 7fdd29ffb640 1 -- 172.21.15.53:0/2044226693 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdd2c0ebf60 con 0x7fdd38156c40 2024-09-13T18:28:21.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.720+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdd3806cd30 con 0x7fdd38156c40 2024-09-13T18:28:21.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd29ffb640 1 -- 172.21.15.53:0/2044226693 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdd2c0ef580 con 0x7fdd38156c40 2024-09-13T18:28:21.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd1c066870 msgr2=0x7fdd1c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd1c066870 0x7fdd1c068d30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdd34007fd0 tx=0x7fdd34007ba0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38156c40 msgr2=0x7fdd3814b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38156c40 0x7fdd3814b010 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0ad040 tx=0x7fdd2c01acb0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 shutdown_connections 2024-09-13T18:28:21.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fdd1c066870 0x7fdd1c068d30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd380ae5c0 0x7fdd3815c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd38156c40 0x7fdd3814b010 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 --2- 172.21.15.53:0/2044226693 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd3806d270 0x7fdd381f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 >> 172.21.15.53:0/2044226693 conn(0x7fdd38065c80 msgr2=0x7fdd380cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 shutdown_connections 2024-09-13T18:28:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.728+0000 7fdd3f9d1640 1 -- 172.21.15.53:0/2044226693 wait complete. 2024-09-13T18:28:21.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-13T18:28:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2968f83640 1 Processor -- start 2024-09-13T18:28:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2968f83640 1 -- start start 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2968f83640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f2964160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2968f83640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2964160d70 0x7f29640d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2968f83640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29641603a0 con 0x7f29640cd720 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2968f83640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296415db20 con 0x7f2964160d70 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2968f83640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296415d280 con 0x7f296415cb80 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2962d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2964160d70 0x7f29640d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2962d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2964160d70 0x7f29640d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45326/0 (socket says 172.21.15.53:45326) 2024-09-13T18:28:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2962d9d640 1 -- 172.21.15.53:0/3334491563 learned_addr learned my addr 172.21.15.53:0/3334491563 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2961d9b640 1 --2- 172.21.15.53:0/3334491563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f2964160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2962d9d640 1 -- 172.21.15.53:0/3334491563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 msgr2=0x7f2964160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2962d9d640 1 --2- 172.21.15.53:0/3334491563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f2964160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2962d9d640 1 -- 172.21.15.53:0/3334491563 >> v1:172.21.15.87:6789/0 conn(0x7f29640cd720 legacy=0x7f29640b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.868+0000 7f2962d9d640 1 -- 172.21.15.53:0/3334491563 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296415d560 con 0x7f2964160d70 2024-09-13T18:28:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2962d9d640 1 --2- 172.21.15.53:0/3334491563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640d02c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f295c009e50 tx=0x7f295c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435a9092d02a0d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f296159a640 1 -- 172.21.15.53:0/3334491563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0af400 con 0x7f2964160d70 2024-09-13T18:28:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f296159a640 1 -- 172.21.15.53:0/3334491563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c0ab050 con 0x7f2964160d70 2024-09-13T18:28:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f296159a640 1 -- 172.21.15.53:0/3334491563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0af780 con 0x7f2964160d70 2024-09-13T18:28:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 -- 172.21.15.53:0/3334491563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 msgr2=0x7f29640d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 --2- 172.21.15.53:0/3334491563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640d02c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f295c009e50 tx=0x7f295c01f210 comp rx=0 tx=0).stop 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 -- 172.21.15.53:0/3334491563 shutdown_connections 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 --2- 172.21.15.53:0/3334491563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640d02c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 --2- 172.21.15.53:0/3334491563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f2964160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 -- 172.21.15.53:0/3334491563 >> 172.21.15.53:0/3334491563 conn(0x7f2964070970 msgr2=0x7f2964070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 -- 172.21.15.53:0/3334491563 shutdown_connections 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 -- 172.21.15.53:0/3334491563 wait complete. 2024-09-13T18:28:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 Processor -- start 2024-09-13T18:28:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.872+0000 7f2968f83640 1 -- start start 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29640cd720 0x7f29640ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f29640a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29640a9bf0 con 0x7f2964160d70 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29640a9ed0 con 0x7f29640cd720 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29640aa1b0 con 0x7f296415cb80 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45332/0 (socket says 172.21.15.53:45332) 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 -- 172.21.15.53:0/2804665816 learned_addr learned my addr 172.21.15.53:0/2804665816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2961d9b640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f29640a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f296259c640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29640cd720 0x7f29640ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 -- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 msgr2=0x7f29640a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f29640a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 -- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29640cd720 msgr2=0x7f29640ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29640cd720 0x7f29640ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 -- 172.21.15.53:0/2804665816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c009b30 con 0x7f2964160d70 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f296259c640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29640cd720 0x7f29640ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2961d9b640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f29640a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2962d9d640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640b2280 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f295c01ce40 tx=0x7f295c01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2952ffd640 1 -- 172.21.15.53:0/2804665816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0c0070 con 0x7f2964160d70 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2952ffd640 1 -- 172.21.15.53:0/2804665816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c009510 con 0x7f2964160d70 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29640aa490 con 0x7f2964160d70 2024-09-13T18:28:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2952ffd640 1 -- 172.21.15.53:0/2804665816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0afd70 con 0x7f2964160d70 2024-09-13T18:28:21.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29640abe90 con 0x7f2964160d70 2024-09-13T18:28:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29641f3450 con 0x7f2964160d70 2024-09-13T18:28:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2952ffd640 1 -- 172.21.15.53:0/2804665816 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f295c0b6040 con 0x7f2964160d70 2024-09-13T18:28:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2952ffd640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2944066870 0x7f2944068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f2952ffd640 1 -- 172.21.15.53:0/2804665816 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f295c121a80 con 0x7f2964160d70 2024-09-13T18:28:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.876+0000 7f296259c640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2944066870 0x7f2944068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.880+0000 7f296259c640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2944066870 0x7f2944068d30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2954000f70 tx=0x7f2954009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:21.880+0000 7f2952ffd640 1 -- 172.21.15.53:0/2804665816 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29641f3450 con 0x7f2964160d70 2024-09-13T18:28:22.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.116+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f29641f3450 con 0x7f2964160d70 2024-09-13T18:28:22.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.388+0000 7f2952ffd640 1 -- 172.21.15.53:0/2804665816 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v189) v1 ==== 140+0+0 (secure 0 0 0) 0x7f29641f3450 con 0x7f2964160d70 2024-09-13T18:28:22.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2944066870 msgr2=0x7f2944068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2944066870 0x7f2944068d30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2954000f70 tx=0x7f2954009040 comp rx=0 tx=0).stop 2024-09-13T18:28:22.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 msgr2=0x7f29640b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640b2280 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f295c01ce40 tx=0x7f295c01bfb0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 shutdown_connections 2024-09-13T18:28:22.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2944066870 0x7f2944068d30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f296415cb80 0x7f29640a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2964160d70 0x7f29640b2280 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 --2- 172.21.15.53:0/2804665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29640cd720 0x7f29640ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 >> 172.21.15.53:0/2804665816 conn(0x7f2964070970 msgr2=0x7f29640b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 shutdown_connections 2024-09-13T18:28:22.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.392+0000 7f2968f83640 1 -- 172.21.15.53:0/2804665816 wait complete. 2024-09-13T18:28:22.419 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-13T18:28:22.419 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2024-09-13T18:28:22.419 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:28:22.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:22.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3769408640 1 Processor -- start 2024-09-13T18:28:22.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3769408640 1 -- start start 2024-09-13T18:28:22.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3769408640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 0x7f37640b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3769408640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f376406a660 0x7f37640cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3769408640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640cfe80 con 0x7f37640b1af0 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3769408640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37640d0120 con 0x7f376406a660 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3769408640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376406ac20 con 0x7f37640cd630 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f37627fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f37640b1af0 0x7f3764069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55522/0 (socket says 172.21.15.53:55522) 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f37627fc640 1 -- 172.21.15.53:0/882293319 learned_addr learned my addr 172.21.15.53:0/882293319 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f37637fe640 1 --2- 172.21.15.53:0/882293319 >> v2:172.21.15.87:3300/0 conn(0x7f376406a660 0x7f37640cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3762ffd640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 0x7f37640b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177777305 0 0) 0x7f37640cfe80 con 0x7f37640b1af0 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f374c003530 con 0x7f37640b1af0 2024-09-13T18:28:22.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2320091998 0 0) 0x7f374c003530 con 0x7f37640b1af0 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 msgr2=0x7f37640b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 0x7f37640b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 >> v2:172.21.15.87:3300/0 conn(0x7f376406a660 msgr2=0x7f37640cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 --2- 172.21.15.53:0/882293319 >> v2:172.21.15.87:3300/0 conn(0x7f376406a660 0x7f37640cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376406af00 con 0x7f37640b1af0 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3758001680 con 0x7f37640b1af0 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 >> v1:172.21.15.53:6789/0 conn(0x7f37640b1af0 legacy=0x7f3764069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f374c003980 0x7f374c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 0x7f374c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f374c004d10 0x7f374c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640d0120 con 0x7f374c003980 2024-09-13T18:28:22.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376406ac20 con 0x7f374c004d10 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c00ba10 con 0x7f37640cd630 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3762ffd640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f374c003980 0x7f374c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f37627fc640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 0x7f374c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f37637fe640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f374c004d10 0x7f374c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3762ffd640 1 -- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 msgr2=0x7f374c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3762ffd640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37640cd630 0x7f374c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3762ffd640 1 -- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f374c004d10 msgr2=0x7f374c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3762ffd640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f374c004d10 0x7f374c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f3762ffd640 1 -- 172.21.15.53:0/882293319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c003530 con 0x7f374c003980 2024-09-13T18:28:22.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.548+0000 7f37637fe640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f374c004d10 0x7f374c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:22.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3762ffd640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f374c003980 0x7f374c003da0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3754009ae0 tx=0x7f375401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d0dc50c51e2df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540aa460 con 0x7f374c003980 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37540aa5c0 con 0x7f374c003980 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3761ffb640 1 -- 172.21.15.53:0/882293319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540aa970 con 0x7f374c003980 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 -- 172.21.15.53:0/882293319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f374c003980 msgr2=0x7f374c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 --2- 172.21.15.53:0/882293319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f374c003980 0x7f374c003da0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3754009ae0 tx=0x7f375401ca70 comp rx=0 tx=0).stop 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f37637fe640 1 -- 172.21.15.53:0/882293319 reap_dead start 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 -- 172.21.15.53:0/882293319 shutdown_connections 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 -- 172.21.15.53:0/882293319 >> 172.21.15.53:0/882293319 conn(0x7f37640b20d0 msgr2=0x7f37640b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 -- 172.21.15.53:0/882293319 shutdown_connections 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 -- 172.21.15.53:0/882293319 wait complete. 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 Processor -- start 2024-09-13T18:28:22.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.552+0000 7f3769408640 1 -- start start 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f374c003980 0x7f37641f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f376415e9f0 0x7f37641f9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37640b5b60 0x7f376414e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376415e5d0 con 0x7f37640b5b60 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376415dd00 con 0x7f376415e9f0 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640ca440 con 0x7f374c003980 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37640b5b60 0x7f376414e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37640b5b60 0x7f376414e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45354/0 (socket says 172.21.15.53:45354) 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 -- 172.21.15.53:0/3915230732 learned_addr learned my addr 172.21.15.53:0/3915230732 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3762ffd640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f374c003980 0x7f37641f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37627fc640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f376415e9f0 0x7f37641f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 -- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f374c003980 msgr2=0x7f37641f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f374c003980 0x7f37641f8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 -- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f376415e9f0 msgr2=0x7f37641f9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f376415e9f0 0x7f37641f9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 -- 172.21.15.53:0/3915230732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376415df10 con 0x7f37640b5b60 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37627fc640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f376415e9f0 0x7f37641f9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f37637fe640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37640b5b60 0x7f376414e070 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3764070a70 tx=0x7f375c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f374b7fe640 1 -- 172.21.15.53:0/3915230732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c017400 con 0x7f37640b5b60 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f374b7fe640 1 -- 172.21.15.53:0/3915230732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c011040 con 0x7f37640b5b60 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376415e1f0 con 0x7f37640b5b60 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f374b7fe640 1 -- 172.21.15.53:0/3915230732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c017780 con 0x7f37640b5b60 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640b4dd0 con 0x7f37640b5b60 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376415e710 con 0x7f37640b5b60 2024-09-13T18:28:22.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f374b7fe640 1 -- 172.21.15.53:0/3915230732 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f375c0203b0 con 0x7f37640b5b60 2024-09-13T18:28:22.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f374b7fe640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3750066840 0x7f3750068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f374b7fe640 1 -- 172.21.15.53:0/3915230732 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f375c084430 con 0x7f37640b5b60 2024-09-13T18:28:22.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.556+0000 7f3762ffd640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3750066840 0x7f3750068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.560+0000 7f3762ffd640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3750066840 0x7f3750068d00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f37540ae000 tx=0x7f37540046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.560+0000 7f374b7fe640 1 -- 172.21.15.53:0/3915230732 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f376415e710 con 0x7f37640b5b60 2024-09-13T18:28:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.724+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f376415e710 con 0x7f37640b5b60 2024-09-13T18:28:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.724+0000 7f374b7fe640 1 -- 172.21.15.53:0/3915230732 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+12926 (secure 0 0 0) 0x7f375c051710 con 0x7f37640b5b60 2024-09-13T18:28:22.730 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:22.730 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":51,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:21.379449+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1420693601":"2024-09-14T18:28:18.358539+0000","172.21.15.53:6833/1420693601":"2024-09-14T18:28:18.358539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3750066840 msgr2=0x7f3750068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3750066840 0x7f3750068d00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f37540ae000 tx=0x7f37540046d0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37640b5b60 msgr2=0x7f376414e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37640b5b60 0x7f376414e070 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3764070a70 tx=0x7f375c00f4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 shutdown_connections 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3750066840 0x7f3750068d00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37640b5b60 0x7f376414e070 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f376415e9f0 0x7f37641f9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 --2- 172.21.15.53:0/3915230732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f374c003980 0x7f37641f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 >> 172.21.15.53:0/3915230732 conn(0x7f37640b20d0 msgr2=0x7f376415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 shutdown_connections 2024-09-13T18:28:22.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.728+0000 7f3769408640 1 -- 172.21.15.53:0/3915230732 wait complete. 2024-09-13T18:28:22.751 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:22.751 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 Processor -- start 2024-09-13T18:28:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 -- start start 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd1815c830 0x7efd180d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd180ccd10 0x7efd180cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd180d2c80 0x7efd180d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd180d3670 con 0x7efd180d2c80 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd180b7db0 con 0x7efd180ccd10 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1f18c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd180d0650 con 0x7efd1815c830 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd180d2c80 0x7efd180d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd180d2c80 0x7efd180d3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45366/0 (socket says 172.21.15.53:45366) 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 -- 172.21.15.53:0/1971950752 learned_addr learned my addr 172.21.15.53:0/1971950752 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd17fff640 1 --2- 172.21.15.53:0/1971950752 >> v2:172.21.15.87:3300/0 conn(0x7efd180ccd10 0x7efd180cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1cf28640 1 --2- 172.21.15.53:0/1971950752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd1815c830 0x7efd180d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 -- 172.21.15.53:0/1971950752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd1815c830 msgr2=0x7efd180d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 --2- 172.21.15.53:0/1971950752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd1815c830 0x7efd180d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 -- 172.21.15.53:0/1971950752 >> v2:172.21.15.87:3300/0 conn(0x7efd180ccd10 msgr2=0x7efd180cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 --2- 172.21.15.53:0/1971950752 >> v2:172.21.15.87:3300/0 conn(0x7efd180ccd10 0x7efd180cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.860+0000 7efd1d729640 1 -- 172.21.15.53:0/1971950752 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd180d0c10 con 0x7efd180d2c80 2024-09-13T18:28:22.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1d729640 1 --2- 172.21.15.53:0/1971950752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180d3130 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efd180b4fa0 tx=0x7efd0801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6702e15ec02a32b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd177fe640 1 -- 172.21.15.53:0/1971950752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080a89d0 con 0x7efd180d2c80 2024-09-13T18:28:22.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd177fe640 1 -- 172.21.15.53:0/1971950752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd080a8b30 con 0x7efd180d2c80 2024-09-13T18:28:22.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd177fe640 1 -- 172.21.15.53:0/1971950752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080b0440 con 0x7efd180d2c80 2024-09-13T18:28:22.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 -- 172.21.15.53:0/1971950752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 msgr2=0x7efd180d3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 --2- 172.21.15.53:0/1971950752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180d3130 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efd180b4fa0 tx=0x7efd0801ed10 comp rx=0 tx=0).stop 2024-09-13T18:28:22.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 -- 172.21.15.53:0/1971950752 shutdown_connections 2024-09-13T18:28:22.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 --2- 172.21.15.53:0/1971950752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180d3130 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 --2- 172.21.15.53:0/1971950752 >> v2:172.21.15.87:3300/0 conn(0x7efd180ccd10 0x7efd180cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 --2- 172.21.15.53:0/1971950752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd1815c830 0x7efd180d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 -- 172.21.15.53:0/1971950752 >> 172.21.15.53:0/1971950752 conn(0x7efd18070970 msgr2=0x7efd18070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:22.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 -- 172.21.15.53:0/1971950752 shutdown_connections 2024-09-13T18:28:22.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.864+0000 7efd1f18c640 1 -- 172.21.15.53:0/1971950752 wait complete. 2024-09-13T18:28:22.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 Processor -- start 2024-09-13T18:28:22.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 -- start start 2024-09-13T18:28:22.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd180ccd10 0x7efd180ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd1815c830 0x7efd180cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1814c4d0 con 0x7efd180d2c80 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd180aee10 con 0x7efd1815c830 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1814c770 con 0x7efd180ccd10 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45378/0 (socket says 172.21.15.53:45378) 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 -- 172.21.15.53:0/3879402205 learned_addr learned my addr 172.21.15.53:0/3879402205 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1d729640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd1815c830 0x7efd180cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 -- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd180ccd10 msgr2=0x7efd180ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd180ccd10 0x7efd180ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 -- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd1815c830 msgr2=0x7efd180cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd1815c830 0x7efd180cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 -- 172.21.15.53:0/3879402205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd080094d0 con 0x7efd180d2c80 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd17fff640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180cb960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e840 tx=0x7efd0000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd157fa640 1 -- 172.21.15.53:0/3879402205 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00009510 con 0x7efd180d2c80 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd157fa640 1 -- 172.21.15.53:0/3879402205 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000ee90 con 0x7efd180d2c80 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1814ca50 con 0x7efd180d2c80 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd157fa640 1 -- 172.21.15.53:0/3879402205 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000cb60 con 0x7efd180d2c80 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1814d010 con 0x7efd180d2c80 2024-09-13T18:28:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd180cd150 con 0x7efd180d2c80 2024-09-13T18:28:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.868+0000 7efd157fa640 1 -- 172.21.15.53:0/3879402205 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7efd0000ccc0 con 0x7efd180d2c80 2024-09-13T18:28:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.872+0000 7efd157fa640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efcf8066840 0x7efcf8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.872+0000 7efd157fa640 1 -- 172.21.15.53:0/3879402205 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd00084960 con 0x7efd180d2c80 2024-09-13T18:28:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.872+0000 7efd1cf28640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efcf8066840 0x7efcf8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.872+0000 7efd1cf28640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efcf8066840 0x7efcf8068d00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd1000e110 tx=0x7efd1000d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:22.872+0000 7efd157fa640 1 -- 172.21.15.53:0/3879402205 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efd00051ec0 con 0x7efd180d2c80 2024-09-13T18:28:23.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.032+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd180b83e0 con 0x7efd180d2c80 2024-09-13T18:28:23.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.032+0000 7efd157fa640 1 -- 172.21.15.53:0/3879402205 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd000170a0 con 0x7efd180d2c80 2024-09-13T18:28:23.039 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:28:23.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efcf8066840 msgr2=0x7efcf8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:23.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efcf8066840 0x7efcf8068d00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd1000e110 tx=0x7efd1000d040 comp rx=0 tx=0).stop 2024-09-13T18:28:23.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 msgr2=0x7efd180cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:23.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180cb960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e840 tx=0x7efd0000ec40 comp rx=0 tx=0).stop 2024-09-13T18:28:23.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 shutdown_connections 2024-09-13T18:28:23.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7efcf8066840 0x7efcf8068d00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd1815c830 0x7efd180cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd180d2c80 0x7efd180cb960 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 --2- 172.21.15.53:0/3879402205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efd180ccd10 0x7efd180ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 >> 172.21.15.53:0/3879402205 conn(0x7efd18070970 msgr2=0x7efd180663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:23.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 shutdown_connections 2024-09-13T18:28:23.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.036+0000 7efd1f18c640 1 -- 172.21.15.53:0/3879402205 wait complete. 2024-09-13T18:28:23.057 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-13T18:28:23.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.172+0000 7f455bf16640 1 Processor -- start 2024-09-13T18:28:23.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.172+0000 7f455bf16640 1 -- start start 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455bf16640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f45541582a0 0x7f455406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455bf16640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f455415b7c0 0x7f455406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455bf16640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4554070c90 0x7f4554071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455bf16640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455415aaf0 con 0x7f455415b7c0 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455bf16640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455406d760 con 0x7f45541582a0 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455bf16640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4554071650 con 0x7f4554070c90 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f455415b7c0 0x7f455406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f455415b7c0 0x7f455406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45384/0 (socket says 172.21.15.53:45384) 2024-09-13T18:28:23.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 -- 172.21.15.53:0/3719327204 learned_addr learned my addr 172.21.15.53:0/3719327204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f4559cb2640 1 --2- 172.21.15.53:0/3719327204 >> v2:172.21.15.87:3300/0 conn(0x7f45541582a0 0x7f455406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455a4b3640 1 --2- 172.21.15.53:0/3719327204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4554070c90 0x7f4554071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 -- 172.21.15.53:0/3719327204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4554070c90 msgr2=0x7f4554071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 --2- 172.21.15.53:0/3719327204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4554070c90 0x7f4554071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 -- 172.21.15.53:0/3719327204 >> v2:172.21.15.87:3300/0 conn(0x7f45541582a0 msgr2=0x7f455406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 --2- 172.21.15.53:0/3719327204 >> v2:172.21.15.87:3300/0 conn(0x7f45541582a0 0x7f455406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 -- 172.21.15.53:0/3719327204 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455406d480 con 0x7f455415b7c0 2024-09-13T18:28:23.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f455a4b3640 1 --2- 172.21.15.53:0/3719327204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4554070c90 0x7f4554071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f45594b1640 1 --2- 172.21.15.53:0/3719327204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455415b7c0 0x7f455406ce40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4554069f50 tx=0x7f454801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e8f8722a7b2646 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f4558cb0640 1 -- 172.21.15.53:0/3719327204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480aa610 con 0x7f455415b7c0 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f4558cb0640 1 -- 172.21.15.53:0/3719327204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45480a6040 con 0x7f455415b7c0 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.176+0000 7f4558cb0640 1 -- 172.21.15.53:0/3719327204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480aa990 con 0x7f455415b7c0 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- 172.21.15.53:0/3719327204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455415b7c0 msgr2=0x7f455406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 --2- 172.21.15.53:0/3719327204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455415b7c0 0x7f455406ce40 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4554069f50 tx=0x7f454801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- 172.21.15.53:0/3719327204 shutdown_connections 2024-09-13T18:28:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 --2- 172.21.15.53:0/3719327204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4554070c90 0x7f4554071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 --2- 172.21.15.53:0/3719327204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f455415b7c0 0x7f455406ce40 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 --2- 172.21.15.53:0/3719327204 >> v2:172.21.15.87:3300/0 conn(0x7f45541582a0 0x7f455406c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- 172.21.15.53:0/3719327204 >> 172.21.15.53:0/3719327204 conn(0x7f4554065c80 msgr2=0x7f4554066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:23.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- 172.21.15.53:0/3719327204 shutdown_connections 2024-09-13T18:28:23.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- 172.21.15.53:0/3719327204 wait complete. 2024-09-13T18:28:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 Processor -- start 2024-09-13T18:28:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- start start 2024-09-13T18:28:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4554070c90 0x7f4554152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45541582a0 0x7f45541f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455415b7c0 0x7f455414b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455414c150 con 0x7f45541582a0 2024-09-13T18:28:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541546f0 con 0x7f4554070c90 2024-09-13T18:28:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455414fc00 con 0x7f455415b7c0 2024-09-13T18:28:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45541582a0 0x7f45541f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45541582a0 0x7f45541f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45394/0 (socket says 172.21.15.53:45394) 2024-09-13T18:28:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 -- 172.21.15.53:0/1752263843 learned_addr learned my addr 172.21.15.53:0/1752263843 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f4559cb2640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4554070c90 0x7f4554152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455a4b3640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455415b7c0 0x7f455414b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 -- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455415b7c0 msgr2=0x7f455414b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455415b7c0 0x7f455414b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 -- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4554070c90 msgr2=0x7f4554152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4554070c90 0x7f4554152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 -- 172.21.15.53:0/1752263843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480094d0 con 0x7f45541582a0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45594b1640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45541582a0 0x7f45541f30c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f45480ac040 tx=0x7f454801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45527fc640 1 -- 172.21.15.53:0/1752263843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480bd5f0 con 0x7f45541582a0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45527fc640 1 -- 172.21.15.53:0/1752263843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45480bd750 con 0x7f45541582a0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455414fea0 con 0x7f45541582a0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f45527fc640 1 -- 172.21.15.53:0/1752263843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480bdae0 con 0x7f45541582a0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.180+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4554150460 con 0x7f45541582a0 2024-09-13T18:28:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.184+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4554067400 con 0x7f45541582a0 2024-09-13T18:28:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.184+0000 7f45527fc640 1 -- 172.21.15.53:0/1752263843 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f45480b33f0 con 0x7f45541582a0 2024-09-13T18:28:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.184+0000 7f45527fc640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4540066840 0x7f4540068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:23.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.184+0000 7f45527fc640 1 -- 172.21.15.53:0/1752263843 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f454811ef00 con 0x7f45541582a0 2024-09-13T18:28:23.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.184+0000 7f4559cb2640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4540066840 0x7f4540068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:23.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.184+0000 7f4559cb2640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4540066840 0x7f4540068d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f454c007a60 tx=0x7f454c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.188+0000 7f45527fc640 1 -- 172.21.15.53:0/1752263843 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45480ec3d0 con 0x7f45541582a0 2024-09-13T18:28:23.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:23.396+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f4554150650 con 0x7f45541582a0 2024-09-13T18:28:24.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.396+0000 7f45527fc640 1 -- 172.21.15.53:0/1752263843 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v191) v1 ==== 164+0+0 (secure 0 0 0) 0x7f45480ef9f0 con 0x7f45541582a0 2024-09-13T18:28:24.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4540066840 msgr2=0x7f4540068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4540066840 0x7f4540068d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f454c007a60 tx=0x7f454c008040 comp rx=0 tx=0).stop 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45541582a0 msgr2=0x7f45541f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45541582a0 0x7f45541f30c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f45480ac040 tx=0x7f454801ad30 comp rx=0 tx=0).stop 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 shutdown_connections 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4540066840 0x7f4540068d00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455415b7c0 0x7f455414b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45541582a0 0x7f45541f30c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 --2- 172.21.15.53:0/1752263843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4554070c90 0x7f4554152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 >> 172.21.15.53:0/1752263843 conn(0x7f4554065c80 msgr2=0x7f45540af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 shutdown_connections 2024-09-13T18:28:24.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.400+0000 7f455bf16640 1 -- 172.21.15.53:0/1752263843 wait complete. 2024-09-13T18:28:24.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:28:24.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f39a4c640 1 Processor -- start 2024-09-13T18:28:24.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f39a4c640 1 -- start start 2024-09-13T18:28:24.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f39a4c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f3415a5a0 0x7f2f34065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:24.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f39a4c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f340ced30 0x7f2f3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:24.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f39a4c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340cf300 con 0x7f2f340661c0 2024-09-13T18:28:24.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f39a4c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f34066630 con 0x7f2f3415a5a0 2024-09-13T18:28:24.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f39a4c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3415a980 con 0x7f2f340ced30 2024-09-13T18:28:24.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f32ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f3415a5a0 0x7f2f34065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:24.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f327fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2f340661c0 0x7f2f340ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55534/0 (socket says 172.21.15.53:55534) 2024-09-13T18:28:24.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f327fc640 1 -- 172.21.15.53:0/2502889570 learned_addr learned my addr 172.21.15.53:0/2502889570 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:24.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f337fe640 1 --2- 172.21.15.53:0/2502889570 >> v2:172.21.15.87:3300/0 conn(0x7f2f340ced30 0x7f2f3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:24.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f32ffd640 1 -- 172.21.15.53:0/2502889570 >> v2:172.21.15.87:3300/0 conn(0x7f2f340ced30 msgr2=0x7f2f3406c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:24.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f32ffd640 1 --2- 172.21.15.53:0/2502889570 >> v2:172.21.15.87:3300/0 conn(0x7f2f340ced30 0x7f2f3406c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f32ffd640 1 -- 172.21.15.53:0/2502889570 >> v1:172.21.15.53:6789/0 conn(0x7f2f340661c0 legacy=0x7f2f340ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f31ffb640 1 -- 172.21.15.53:0/2502889570 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507165531 0 0) 0x7f2f340cf300 con 0x7f2f340661c0 2024-09-13T18:28:24.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.556+0000 7f2f32ffd640 1 -- 172.21.15.53:0/2502889570 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340ccd80 con 0x7f2f3415a5a0 2024-09-13T18:28:24.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f32ffd640 1 --2- 172.21.15.53:0/2502889570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f3415a5a0 0x7f2f34065c80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2f34066cd0 tx=0x7f2f2401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4474f46022dd1091 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:24.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f31ffb640 1 -- 172.21.15.53:0/2502889570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240a5960 con 0x7f2f3415a5a0 2024-09-13T18:28:24.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f31ffb640 1 -- 172.21.15.53:0/2502889570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f240a5ac0 con 0x7f2f3415a5a0 2024-09-13T18:28:24.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f31ffb640 1 -- 172.21.15.53:0/2502889570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240a5e50 con 0x7f2f3415a5a0 2024-09-13T18:28:24.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 -- 172.21.15.53:0/2502889570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f3415a5a0 msgr2=0x7f2f34065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/2502889570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f3415a5a0 0x7f2f34065c80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2f34066cd0 tx=0x7f2f2401c8a0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 -- 172.21.15.53:0/2502889570 shutdown_connections 2024-09-13T18:28:24.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/2502889570 >> v2:172.21.15.87:3300/0 conn(0x7f2f340ced30 0x7f2f3406c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/2502889570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f3415a5a0 0x7f2f34065c80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 -- 172.21.15.53:0/2502889570 >> 172.21.15.53:0/2502889570 conn(0x7f2f340b1380 msgr2=0x7f2f340b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:24.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 -- 172.21.15.53:0/2502889570 shutdown_connections 2024-09-13T18:28:24.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.560+0000 7f2f39a4c640 1 -- 172.21.15.53:0/2502889570 wait complete. 2024-09-13T18:28:24.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 Processor -- start 2024-09-13T18:28:24.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 -- start start 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f340661c0 0x7f2f34161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f340ced30 0x7f2f340b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f3415a5a0 0x7f2f34143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34164130 con 0x7f2f340ced30 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340b0f10 con 0x7f2f3415a5a0 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34163520 con 0x7f2f340661c0 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f340ced30 0x7f2f340b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:24.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f340ced30 0x7f2f340b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45400/0 (socket says 172.21.15.53:45400) 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 -- 172.21.15.53:0/3059748104 learned_addr learned my addr 172.21.15.53:0/3059748104 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f337fe640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f3415a5a0 0x7f2f34143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f32ffd640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f340661c0 0x7f2f34161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 -- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f340661c0 msgr2=0x7f2f34161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f340661c0 0x7f2f34161b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 -- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f3415a5a0 msgr2=0x7f2f34143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f3415a5a0 0x7f2f34143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 -- 172.21.15.53:0/3059748104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24009a70 con 0x7f2f340ced30 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f327fc640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f340ced30 0x7f2f340b09d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2f280011f0 tx=0x7f2f2800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f1bfff640 1 -- 172.21.15.53:0/3059748104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280074e0 con 0x7f2f340ced30 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f1bfff640 1 -- 172.21.15.53:0/3059748104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28007640 con 0x7f2f340ced30 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f34163800 con 0x7f2f340ced30 2024-09-13T18:28:24.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f1bfff640 1 -- 172.21.15.53:0/3059748104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28004a10 con 0x7f2f340ced30 2024-09-13T18:28:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f34163dc0 con 0x7f2f340ced30 2024-09-13T18:28:24.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f341642e0 con 0x7f2f340ced30 2024-09-13T18:28:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f1bfff640 1 -- 172.21.15.53:0/3059748104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f2f28004b70 con 0x7f2f340ced30 2024-09-13T18:28:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f1bfff640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f20066840 0x7f2f20068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.564+0000 7f2f1bfff640 1 -- 172.21.15.53:0/3059748104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2f280834e0 con 0x7f2f340ced30 2024-09-13T18:28:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.568+0000 7f2f32ffd640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f20066840 0x7f2f20068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:24.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.568+0000 7f2f32ffd640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f20066840 0x7f2f20068d00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2f240af000 tx=0x7f2f240a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:24.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.568+0000 7f2f1bfff640 1 -- 172.21.15.53:0/3059748104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f28050850 con 0x7f2f340ced30 2024-09-13T18:28:24.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.732+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2f3406c8f0 con 0x7f2f340ced30 2024-09-13T18:28:24.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f1bfff640 1 -- 172.21.15.53:0/3059748104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f280180c0 con 0x7f2f340ced30 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f20066840 msgr2=0x7f2f20068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f20066840 0x7f2f20068d00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2f240af000 tx=0x7f2f240a7070 comp rx=0 tx=0).stop 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f340ced30 msgr2=0x7f2f340b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f340ced30 0x7f2f340b09d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2f280011f0 tx=0x7f2f2800c9b0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 shutdown_connections 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2f20066840 0x7f2f20068d00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f3415a5a0 0x7f2f34143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f340ced30 0x7f2f340b09d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 --2- 172.21.15.53:0/3059748104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f340661c0 0x7f2f34161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 >> 172.21.15.53:0/3059748104 conn(0x7f2f340b1380 msgr2=0x7f2f3415abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:24.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 shutdown_connections 2024-09-13T18:28:24.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:24.740+0000 7f2f39a4c640 1 -- 172.21.15.53:0/3059748104 wait complete. 2024-09-13T18:28:24.764 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:28:24.764 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:28:24.802 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:24.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:24.845 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:28:24.925 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:28:24.926 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:28:24.926 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:24.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:28:24.932 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:28:24.932 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:24.973 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:28:24.973 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:28:24.974 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:24.981 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:28:24.981 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:28:24.981 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:25.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:28:25.024 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:28:25.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:25.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83b183e640 1 Processor -- start 2024-09-13T18:28:25.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83b183e640 1 -- start start 2024-09-13T18:28:25.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83b183e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f83ac15cab0 0x7f83ac0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83b183e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 0x7f83ac0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83b183e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ac0d2400 con 0x7f83ac0cd6c0 2024-09-13T18:28:25.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83b183e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac0d1530 con 0x7f83ac15cab0 2024-09-13T18:28:25.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83b183e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0d0920 con 0x7f83ac0cf7d0 2024-09-13T18:28:25.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83aa7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f83ac0cd6c0 0x7f83ac0cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55540/0 (socket says 172.21.15.53:55540) 2024-09-13T18:28:25.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83aa7fc640 1 -- 172.21.15.53:0/1838564522 learned_addr learned my addr 172.21.15.53:0/1838564522 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83aaffd640 1 --2- 172.21.15.53:0/1838564522 >> v2:172.21.15.87:3300/0 conn(0x7f83ac15cab0 0x7f83ac0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83ab7fe640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 0x7f83ac0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145450179 0 0) 0x7f83ac0d2400 con 0x7f83ac0cd6c0 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8394003530 con 0x7f83ac0cd6c0 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839217377 0 0) 0x7f8394003530 con 0x7f83ac0cd6c0 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 msgr2=0x7f83ac0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 0x7f83ac0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 >> v2:172.21.15.87:3300/0 conn(0x7f83ac15cab0 msgr2=0x7f83ac0d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:25.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 --2- 172.21.15.53:0/1838564522 >> v2:172.21.15.87:3300/0 conn(0x7f83ac15cab0 0x7f83ac0d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0d0c00 con 0x7f83ac0cd6c0 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f83a0001680 con 0x7f83ac0cd6c0 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 >> v1:172.21.15.53:6789/0 conn(0x7f83ac0cd6c0 legacy=0x7f83ac0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 0x7f8394003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8394003f00 0x7f83940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8394004d10 0x7f8394005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0d1530 con 0x7f8394004d10 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0d0920 con 0x7f8394003f00 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839400b990 con 0x7f83ac0cf7d0 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83ab7fe640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8394004d10 0x7f8394005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83aa7fc640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8394003f00 0x7f83940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83aaffd640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 0x7f8394003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83ab7fe640 1 -- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 msgr2=0x7f8394003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:25.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83ab7fe640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac0cf7d0 0x7f8394003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83ab7fe640 1 -- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8394003f00 msgr2=0x7f83940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:25.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83ab7fe640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8394003f00 0x7f83940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83ab7fe640 1 -- 172.21.15.53:0/1838564522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394003530 con 0x7f8394004d10 2024-09-13T18:28:25.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.148+0000 7f83aa7fc640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8394003f00 0x7f83940047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83ab7fe640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8394004d10 0x7f8394005190 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009fc0 tx=0x7f83a401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc5e4f92b64032 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40a5c90 con 0x7f8394004d10 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a400f040 con 0x7f8394004d10 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83a9ffb640 1 -- 172.21.15.53:0/1838564522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40ad440 con 0x7f8394004d10 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83b183e640 1 -- 172.21.15.53:0/1838564522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8394004d10 msgr2=0x7f8394005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83b183e640 1 --2- 172.21.15.53:0/1838564522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8394004d10 0x7f8394005190 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009fc0 tx=0x7f83a401cc20 comp rx=0 tx=0).stop 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83ab7fe640 1 -- 172.21.15.53:0/1838564522 reap_dead start 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83b183e640 1 -- 172.21.15.53:0/1838564522 shutdown_connections 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83b183e640 1 -- 172.21.15.53:0/1838564522 >> 172.21.15.53:0/1838564522 conn(0x7f83ac065c80 msgr2=0x7f83ac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:25.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83b183e640 1 -- 172.21.15.53:0/1838564522 shutdown_connections 2024-09-13T18:28:25.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.152+0000 7f83b183e640 1 -- 172.21.15.53:0/1838564522 wait complete. 2024-09-13T18:28:25.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 Processor -- start 2024-09-13T18:28:25.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 -- start start 2024-09-13T18:28:25.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac1529a0 0x7f83ac0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac157f60 0x7f83ac0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83ac1587a0 0x7f83ac158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac159190 con 0x7f83ac157f60 2024-09-13T18:28:25.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0b3a70 con 0x7f83ac1587a0 2024-09-13T18:28:25.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0b4dc0 con 0x7f83ac1529a0 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac157f60 0x7f83ac0b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac157f60 0x7f83ac0b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45422/0 (socket says 172.21.15.53:45422) 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 -- 172.21.15.53:0/3625140152 learned_addr learned my addr 172.21.15.53:0/3625140152 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83ab7fe640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83ac1587a0 0x7f83ac158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aaffd640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac1529a0 0x7f83ac0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 -- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac1529a0 msgr2=0x7f83ac0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac1529a0 0x7f83ac0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 -- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83ac1587a0 msgr2=0x7f83ac158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83ac1587a0 0x7f83ac158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 -- 172.21.15.53:0/3625140152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0b2a50 con 0x7f83ac157f60 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aaffd640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac1529a0 0x7f83ac0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83aa7fc640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac157f60 0x7f83ac0b3530 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f83a000eaf0 tx=0x7f83a0001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f8393fff640 1 -- 172.21.15.53:0/3625140152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a000c8a0 con 0x7f83ac157f60 2024-09-13T18:28:25.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f8393fff640 1 -- 172.21.15.53:0/3625140152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a000ca00 con 0x7f83ac157f60 2024-09-13T18:28:25.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac0b2d30 con 0x7f83ac157f60 2024-09-13T18:28:25.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f8393fff640 1 -- 172.21.15.53:0/3625140152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a000cd90 con 0x7f83ac157f60 2024-09-13T18:28:25.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ac153310 con 0x7f83ac157f60 2024-09-13T18:28:25.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ac0b28b0 con 0x7f83ac157f60 2024-09-13T18:28:25.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f8393fff640 1 -- 172.21.15.53:0/3625140152 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f83a001d460 con 0x7f83ac157f60 2024-09-13T18:28:25.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.156+0000 7f8393fff640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8398066840 0x7f8398068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.160+0000 7f8393fff640 1 -- 172.21.15.53:0/3625140152 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f83a0084250 con 0x7f83ac157f60 2024-09-13T18:28:25.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.160+0000 7f83aaffd640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8398066840 0x7f8398068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.160+0000 7f83aaffd640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8398066840 0x7f8398068d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f839c009aa0 tx=0x7f839c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.164+0000 7f8393fff640 1 -- 172.21.15.53:0/3625140152 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83ac0b28b0 con 0x7f83ac157f60 2024-09-13T18:28:25.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.356+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83ac0b28b0 con 0x7f83ac157f60 2024-09-13T18:28:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.356+0000 7f8393fff640 1 -- 172.21.15.53:0/3625140152 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f83ac0b28b0 con 0x7f83ac157f60 2024-09-13T18:28:25.364 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:25.364 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/3089614309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3089614309},{"type":"v1","addr":"172.21.15.53:6834","nonce":3089614309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3086557022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3086557022},{"type":"v1","addr":"172.21.15.87:6835","nonce":3086557022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/2763160956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":2763160956},{"type":"v1","addr":"172.21.15.87:6837","nonce":2763160956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":6246,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3779642141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3779642141},{"type":"v1","addr":"172.21.15.53:6835","nonce":3779642141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2024-09-13T18:28:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 25 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8398066840 msgr2=0x7f8398068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8398066840 0x7f8398068d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f839c009aa0 tx=0x7f839c008040 comp rx=0 tx=0).stop 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac157f60 msgr2=0x7f83ac0b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac157f60 0x7f83ac0b3530 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f83a000eaf0 tx=0x7f83a0001740 comp rx=0 tx=0).stop 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 shutdown_connections 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8398066840 0x7f8398068d00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83ac1587a0 0x7f83ac158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83ac157f60 0x7f83ac0b3530 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 --2- 172.21.15.53:0/3625140152 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83ac1529a0 0x7f83ac0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 >> 172.21.15.53:0/3625140152 conn(0x7f83ac065c80 msgr2=0x7f83ac15ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 shutdown_connections 2024-09-13T18:28:25.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.360+0000 7f83b183e640 1 -- 172.21.15.53:0/3625140152 wait complete. 2024-09-13T18:28:25.382 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:28:25.382 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:28:25.383 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:28:25.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:28:25.383 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:28:25.383 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:28:25.383 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:28:25.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:28:25.383 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:28:25.384 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:28:25.384 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:28:25.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:28:25.384 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:28:25.384 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:28:25.384 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:28:25.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:28:25.392 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:28:25.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:28:25.394 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:28:25.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:28:25.400 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:28:25.400 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:28:25.405 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:28:25.405 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:28:25.441 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:28:25.441 DEBUG:teuthology.parallel:result is None 2024-09-13T18:28:25.442 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:28:25.442 DEBUG:teuthology.parallel:result is None 2024-09-13T18:28:25.453 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:28:25.453 DEBUG:teuthology.parallel:result is None 2024-09-13T18:28:25.455 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:28:25.455 DEBUG:teuthology.parallel:result is None 2024-09-13T18:28:25.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:28:25.507 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:28:25.510 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:28:25.522 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:28:25.533 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:28:25.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c78cf640 1 Processor -- start 2024-09-13T18:28:25.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c78cf640 1 -- start start 2024-09-13T18:28:25.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c78cf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8c00cf7d0 0x7fb8c00b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c78cf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00d2400 con 0x7fb8c00d19c0 2024-09-13T18:28:25.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c78cf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c00d1530 con 0x7fb8c015cab0 2024-09-13T18:28:25.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c78cf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00cddd0 con 0x7fb8c00cf7d0 2024-09-13T18:28:25.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c5e6c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8c00cf7d0 0x7fb8c00b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c4e6a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb8c00d19c0 0x7fb8c00cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55546/0 (socket says 172.21.15.53:55546) 2024-09-13T18:28:25.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c4e6a640 1 -- 172.21.15.53:0/3460812323 learned_addr learned my addr 172.21.15.53:0/3460812323 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:25.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c5e6c640 1 -- 172.21.15.53:0/3460812323 >> v1:172.21.15.87:6789/0 conn(0x7fb8c015cab0 legacy=0x7fb8c00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c5e6c640 1 -- 172.21.15.53:0/3460812323 >> v1:172.21.15.53:6789/0 conn(0x7fb8c00d19c0 legacy=0x7fb8c00cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c5e6c640 1 -- 172.21.15.53:0/3460812323 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00d1e30 con 0x7fb8c00cf7d0 2024-09-13T18:28:25.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8c5e6c640 1 --2- 172.21.15.53:0/3460812323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00cf7d0 0x7fb8c00b5870 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80097c0 tx=0x7fb8b801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ef22ccc9f15da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8b7fff640 1 -- 172.21.15.53:0/3460812323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80ab670 con 0x7fb8c00cf7d0 2024-09-13T18:28:25.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8b7fff640 1 -- 172.21.15.53:0/3460812323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b80ab7d0 con 0x7fb8c00cf7d0 2024-09-13T18:28:25.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.564+0000 7fb8b7fff640 1 -- 172.21.15.53:0/3460812323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80abb60 con 0x7fb8c00cf7d0 2024-09-13T18:28:25.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/3460812323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00cf7d0 msgr2=0x7fb8c00b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/3460812323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00cf7d0 0x7fb8c00b5870 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80097c0 tx=0x7fb8b801c470 comp rx=0 tx=0).stop 2024-09-13T18:28:25.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/3460812323 shutdown_connections 2024-09-13T18:28:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/3460812323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00cf7d0 0x7fb8c00b5870 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/3460812323 >> 172.21.15.53:0/3460812323 conn(0x7fb8c0065c80 msgr2=0x7fb8c0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/3460812323 shutdown_connections 2024-09-13T18:28:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/3460812323 wait complete. 2024-09-13T18:28:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 Processor -- start 2024-09-13T18:28:25.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- start start 2024-09-13T18:28:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00cf7d0 0x7fb8c0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c00d19c0 0x7fb8c0156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c015cab0 0x7fb8c014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0158120 con 0x7fb8c015cab0 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0157c90 con 0x7fb8c00d19c0 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c01573f0 con 0x7fb8c00cf7d0 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c015cab0 0x7fb8c014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c015cab0 0x7fb8c014e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45460/0 (socket says 172.21.15.53:45460) 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 -- 172.21.15.53:0/92076740 learned_addr learned my addr 172.21.15.53:0/92076740 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c4e6a640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c00d19c0 0x7fb8c0156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 -- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00cf7d0 msgr2=0x7fb8c0156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c566b640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00cf7d0 0x7fb8c0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00cf7d0 0x7fb8c0156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 -- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c00d19c0 msgr2=0x7fb8c0156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c00d19c0 0x7fb8c0156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 -- 172.21.15.53:0/92076740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009420 con 0x7fb8c015cab0 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c4e6a640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c00d19c0 0x7fb8c0156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:25.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c566b640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00cf7d0 0x7fb8c0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c5e6c640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c015cab0 0x7fb8c014e220 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8019080 tx=0x7fb8b801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/92076740 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80b5810 con 0x7fb8c015cab0 2024-09-13T18:28:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/92076740 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b80b5970 con 0x7fb8c015cab0 2024-09-13T18:28:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c00b3800 con 0x7fb8c015cab0 2024-09-13T18:28:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/92076740 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80b5d00 con 0x7fb8c015cab0 2024-09-13T18:28:25.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c0157920 con 0x7fb8c015cab0 2024-09-13T18:28:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.568+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c0157e20 con 0x7fb8c015cab0 2024-09-13T18:28:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.572+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/92076740 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fb8b80c83f0 con 0x7fb8c015cab0 2024-09-13T18:28:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.572+0000 7fb8b5ffb640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb8a4066870 0x7fb8a4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.572+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/92076740 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8c00b65c0 con 0x7fb8c015cab0 2024-09-13T18:28:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.572+0000 7fb8c566b640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb8a4066870 0x7fb8a4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.572+0000 7fb8c566b640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb8a4066870 0x7fb8a4068d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc007fd0 tx=0x7fb8bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.576+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/92076740 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8b80ec510 con 0x7fb8c015cab0 2024-09-13T18:28:25.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-13T18:28:25.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-13T18:28:25.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-13T18:28:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:25.744+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb8c00b5870 con 0x7fb8c015cab0 2024-09-13T18:28:26.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.744+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/92076740 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb8b80b5e60 con 0x7fb8c015cab0 2024-09-13T18:28:26.750 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:28:26.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb8a4066870 msgr2=0x7fb8a4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:26.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb8a4066870 0x7fb8a4068d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc007fd0 tx=0x7fb8bc009040 comp rx=0 tx=0).stop 2024-09-13T18:28:26.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c015cab0 msgr2=0x7fb8c014e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:26.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c015cab0 0x7fb8c014e220 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8019080 tx=0x7fb8b801acb0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 shutdown_connections 2024-09-13T18:28:26.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb8a4066870 0x7fb8a4068d30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c015cab0 0x7fb8c014e220 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c00d19c0 0x7fb8c0156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 --2- 172.21.15.53:0/92076740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00cf7d0 0x7fb8c0156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 >> 172.21.15.53:0/92076740 conn(0x7fb8c0065c80 msgr2=0x7fb8c015cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:26.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 shutdown_connections 2024-09-13T18:28:26.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.748+0000 7fb8c78cf640 1 -- 172.21.15.53:0/92076740 wait complete. 2024-09-13T18:28:26.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:28:26.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.896+0000 7f7ee7793640 1 Processor -- start 2024-09-13T18:28:26.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.896+0000 7f7ee7793640 1 -- start start 2024-09-13T18:28:26.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee7793640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7ee00cb980 0x7f7ee00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:26.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee7793640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ee006b850 0x7f7ee00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee7793640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee00cbd60 0x7f7ee006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee7793640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee00b1ac0 con 0x7f7ee006b850 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee7793640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee0159ac0 con 0x7f7ee00cb980 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee7793640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0159da0 con 0x7f7ee00cbd60 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ee006b850 0x7f7ee00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ee006b850 0x7f7ee00cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58152/0 (socket says 172.21.15.53:58152) 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/3529386274 learned_addr learned my addr 172.21.15.53:0/3529386274 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee552f640 1 --2- 172.21.15.53:0/3529386274 >> v2:172.21.15.87:3300/0 conn(0x7f7ee00cb980 0x7f7ee00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee5d30640 1 --2- 172.21.15.53:0/3529386274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee00cbd60 0x7f7ee006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/3529386274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee00cbd60 msgr2=0x7f7ee006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 --2- 172.21.15.53:0/3529386274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee00cbd60 0x7f7ee006fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/3529386274 >> v2:172.21.15.87:3300/0 conn(0x7f7ee00cb980 msgr2=0x7f7ee00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 --2- 172.21.15.53:0/3529386274 >> v2:172.21.15.87:3300/0 conn(0x7f7ee00cb980 0x7f7ee00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/3529386274 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee015a080 con 0x7f7ee006b850 2024-09-13T18:28:26.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.900+0000 7f7ee4d2e640 1 --2- 172.21.15.53:0/3529386274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee006b850 0x7f7ee00cdd40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0071820 tx=0x7f7ed001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a981c6b6e835d0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:26.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ed7fff640 1 -- 172.21.15.53:0/3529386274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00ab600 con 0x7f7ee006b850 2024-09-13T18:28:26.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ed7fff640 1 -- 172.21.15.53:0/3529386274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed00a7050 con 0x7f7ee006b850 2024-09-13T18:28:26.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ed7fff640 1 -- 172.21.15.53:0/3529386274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00ab980 con 0x7f7ee006b850 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- 172.21.15.53:0/3529386274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee006b850 msgr2=0x7f7ee00cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 --2- 172.21.15.53:0/3529386274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee006b850 0x7f7ee00cdd40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0071820 tx=0x7f7ed001c460 comp rx=0 tx=0).stop 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- 172.21.15.53:0/3529386274 shutdown_connections 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 --2- 172.21.15.53:0/3529386274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee00cbd60 0x7f7ee006fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 --2- 172.21.15.53:0/3529386274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee006b850 0x7f7ee00cdd40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 --2- 172.21.15.53:0/3529386274 >> v2:172.21.15.87:3300/0 conn(0x7f7ee00cb980 0x7f7ee00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- 172.21.15.53:0/3529386274 >> 172.21.15.53:0/3529386274 conn(0x7f7ee0065c80 msgr2=0x7f7ee0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:26.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- 172.21.15.53:0/3529386274 shutdown_connections 2024-09-13T18:28:26.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- 172.21.15.53:0/3529386274 wait complete. 2024-09-13T18:28:26.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 Processor -- start 2024-09-13T18:28:26.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- start start 2024-09-13T18:28:26.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee006b850 0x7f7ee0147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:26.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee00cb980 0x7f7ee0151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:26.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ee00cbd60 0x7f7ee0152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0152940 con 0x7f7ee00cb980 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0148310 con 0x7f7ee00cbd60 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee7793640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee015b880 con 0x7f7ee006b850 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee4d2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee00cb980 0x7f7ee0151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee4d2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee00cb980 0x7f7ee0151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58162/0 (socket says 172.21.15.53:58162) 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/2968720034 learned_addr learned my addr 172.21.15.53:0/2968720034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.904+0000 7f7ee5d30640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ee00cbd60 0x7f7ee0152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee552f640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee006b850 0x7f7ee0147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee006b850 msgr2=0x7f7ee0147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee4d2e640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee006b850 0x7f7ee0147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ee00cbd60 msgr2=0x7f7ee0152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee4d2e640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ee00cbd60 0x7f7ee0152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee4d2e640 1 -- 172.21.15.53:0/2968720034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed00094d0 con 0x7f7ee00cb980 2024-09-13T18:28:26.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee4d2e640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee00cb980 0x7f7ee0151dd0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00ae040 tx=0x7f7ed0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:26.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ed5ffb640 1 -- 172.21.15.53:0/2968720034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00b6470 con 0x7f7ee00cb980 2024-09-13T18:28:26.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ed5ffb640 1 -- 172.21.15.53:0/2968720034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed00b65d0 con 0x7f7ee00cb980 2024-09-13T18:28:26.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ed5ffb640 1 -- 172.21.15.53:0/2968720034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00b6980 con 0x7f7ee00cb980 2024-09-13T18:28:26.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee015bb60 con 0x7f7ee00cb980 2024-09-13T18:28:26.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee015c120 con 0x7f7ee00cb980 2024-09-13T18:28:26.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee0067400 con 0x7f7ee00cb980 2024-09-13T18:28:26.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ed5ffb640 1 -- 172.21.15.53:0/2968720034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f7ed00b2070 con 0x7f7ee00cb980 2024-09-13T18:28:26.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ed5ffb640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7ec4066840 0x7f7ec4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:26.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ed5ffb640 1 -- 172.21.15.53:0/2968720034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ed011e960 con 0x7f7ee00cb980 2024-09-13T18:28:26.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.908+0000 7f7ee552f640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7ec4066840 0x7f7ec4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:26.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.912+0000 7f7ee552f640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7ec4066840 0x7f7ec4068d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ee01f87f0 tx=0x7f7edc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:26.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:26.912+0000 7f7ed5ffb640 1 -- 172.21.15.53:0/2968720034 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ed00ebc80 con 0x7f7ee00cb980 2024-09-13T18:28:27.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.128+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7ee00ade00 con 0x7f7ee00cb980 2024-09-13T18:28:27.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.128+0000 7f7ed5ffb640 1 -- 172.21.15.53:0/2968720034 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7ed00b0020 con 0x7f7ee00cb980 2024-09-13T18:28:27.136 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:27.136 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:28:27.136 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:28:27.136 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.136 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.137 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.138 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:28:27.139 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.141 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.142 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.143 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:28:27.144 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:28:27.146 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:28:27.147 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:28:27.149 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:27.150 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:28:27.150 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:28:27.150 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:28:27.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.150 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:27.150 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:28:27.150 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:28:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7ec4066840 msgr2=0x7f7ec4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7ec4066840 0x7f7ec4068d00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ee01f87f0 tx=0x7f7edc008040 comp rx=0 tx=0).stop 2024-09-13T18:28:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee00cb980 msgr2=0x7f7ee0151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee00cb980 0x7f7ee0151dd0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00ae040 tx=0x7f7ed0019200 comp rx=0 tx=0).stop 2024-09-13T18:28:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 shutdown_connections 2024-09-13T18:28:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7ec4066840 0x7f7ec4068d00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ee00cbd60 0x7f7ee0152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee00cb980 0x7f7ee0151dd0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 --2- 172.21.15.53:0/2968720034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ee006b850 0x7f7ee0147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 >> 172.21.15.53:0/2968720034 conn(0x7f7ee0065c80 msgr2=0x7f7ee0158600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 shutdown_connections 2024-09-13T18:28:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.132+0000 7f7ee7793640 1 -- 172.21.15.53:0/2968720034 wait complete. 2024-09-13T18:28:27.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:27.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 Processor -- start 2024-09-13T18:28:27.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 -- start start 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb99815a440 0x7fb9980afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 0x7fb9980b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb9980ae660 0x7fb9980b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980aeb40 con 0x7fb99815a440 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980aee20 con 0x7fb9980ae660 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99e6be640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980af100 con 0x7fb99815a820 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb99815a440 0x7fb9980afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb99815a440 0x7fb9980afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58168/0 (socket says 172.21.15.53:58168) 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 -- 172.21.15.53:0/3459494148 learned_addr learned my addr 172.21.15.53:0/3459494148 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb9977fe640 1 --2- 172.21.15.53:0/3459494148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 0x7fb9980b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb99cc5b640 1 --2- 172.21.15.53:0/3459494148 >> v2:172.21.15.87:3300/0 conn(0x7fb9980ae660 0x7fb9980b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 -- 172.21.15.53:0/3459494148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 msgr2=0x7fb9980b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 --2- 172.21.15.53:0/3459494148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 0x7fb9980b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 -- 172.21.15.53:0/3459494148 >> v2:172.21.15.87:3300/0 conn(0x7fb9980ae660 msgr2=0x7fb9980b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 --2- 172.21.15.53:0/3459494148 >> v2:172.21.15.87:3300/0 conn(0x7fb9980ae660 0x7fb9980b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.276+0000 7fb997fff640 1 -- 172.21.15.53:0/3459494148 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980af3e0 con 0x7fb99815a440 2024-09-13T18:28:27.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb997fff640 1 --2- 172.21.15.53:0/3459494148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb99815a440 0x7fb9980afc10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9980b5b60 tx=0x7fb99001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443e93e53fc63bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb996ffd640 1 -- 172.21.15.53:0/3459494148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900a56c0 con 0x7fb99815a440 2024-09-13T18:28:27.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb996ffd640 1 -- 172.21.15.53:0/3459494148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9900a5820 con 0x7fb99815a440 2024-09-13T18:28:27.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb996ffd640 1 -- 172.21.15.53:0/3459494148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900a5bb0 con 0x7fb99815a440 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 -- 172.21.15.53:0/3459494148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb99815a440 msgr2=0x7fb9980afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 --2- 172.21.15.53:0/3459494148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb99815a440 0x7fb9980afc10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9980b5b60 tx=0x7fb99001c930 comp rx=0 tx=0).stop 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 -- 172.21.15.53:0/3459494148 shutdown_connections 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 --2- 172.21.15.53:0/3459494148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 0x7fb9980b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 --2- 172.21.15.53:0/3459494148 >> v2:172.21.15.87:3300/0 conn(0x7fb9980ae660 0x7fb9980b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 --2- 172.21.15.53:0/3459494148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb99815a440 0x7fb9980afc10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 -- 172.21.15.53:0/3459494148 >> 172.21.15.53:0/3459494148 conn(0x7fb998071a50 msgr2=0x7fb998099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:27.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 -- 172.21.15.53:0/3459494148 shutdown_connections 2024-09-13T18:28:27.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 -- 172.21.15.53:0/3459494148 wait complete. 2024-09-13T18:28:27.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 Processor -- start 2024-09-13T18:28:27.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.280+0000 7fb99e6be640 1 -- start start 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9980ae660 0x7fb99814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99815a440 0x7fb99814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 0x7fb9981553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998154fa0 con 0x7fb9980ae660 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99806bf80 con 0x7fb99815a440 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981546b0 con 0x7fb99815a820 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9980ae660 0x7fb99814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9980ae660 0x7fb99814e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58172/0 (socket says 172.21.15.53:58172) 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 -- 172.21.15.53:0/2810950173 learned_addr learned my addr 172.21.15.53:0/2810950173 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb9977fe640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99815a440 0x7fb99814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 -- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 msgr2=0x7fb9981553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 0x7fb9981553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 -- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99815a440 msgr2=0x7fb99814cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99815a440 0x7fb99814cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 -- 172.21.15.53:0/2810950173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009b30 con 0x7fb9980ae660 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb9977fe640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99815a440 0x7fb99814cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb997fff640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9980ae660 0x7fb99814e100 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb9900af040 tx=0x7fb9900196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb994ff9640 1 -- 172.21.15.53:0/2810950173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900b8670 con 0x7fb9980ae660 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb994ff9640 1 -- 172.21.15.53:0/2810950173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9900b87d0 con 0x7fb9980ae660 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb994ff9640 1 -- 172.21.15.53:0/2810950173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900b8b80 con 0x7fb9980ae660 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99814e800 con 0x7fb9980ae660 2024-09-13T18:28:27.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb998154bc0 con 0x7fb9980ae660 2024-09-13T18:28:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9981550e0 con 0x7fb9980ae660 2024-09-13T18:28:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb994ff9640 1 -- 172.21.15.53:0/2810950173 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fb9900b8ce0 con 0x7fb9980ae660 2024-09-13T18:28:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.284+0000 7fb994ff9640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb984066840 0x7fb984068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.288+0000 7fb994ff9640 1 -- 172.21.15.53:0/2810950173 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb99011f820 con 0x7fb9980ae660 2024-09-13T18:28:27.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.288+0000 7fb9977fe640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb984066840 0x7fb984068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.288+0000 7fb9977fe640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb984066840 0x7fb984068d00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb998164fc0 tx=0x7fb98c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.292+0000 7fb994ff9640 1 -- 172.21.15.53:0/2810950173 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb9900ecd70 con 0x7fb9980ae660 2024-09-13T18:28:27.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.452+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9980afc10 con 0x7fb9980ae660 2024-09-13T18:28:27.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb994ff9640 1 -- 172.21.15.53:0/2810950173 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fb9900f0390 con 0x7fb9980ae660 2024-09-13T18:28:27.460 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:27.461 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":56,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:26.742820+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb984066840 msgr2=0x7fb984068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb984066840 0x7fb984068d00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb998164fc0 tx=0x7fb98c008040 comp rx=0 tx=0).stop 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9980ae660 msgr2=0x7fb99814e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9980ae660 0x7fb99814e100 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb9900af040 tx=0x7fb9900196d0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 shutdown_connections 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb984066840 0x7fb984068d00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99815a820 0x7fb9981553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99815a440 0x7fb99814cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 --2- 172.21.15.53:0/2810950173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9980ae660 0x7fb99814e100 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 >> 172.21.15.53:0/2810950173 conn(0x7fb998071a50 msgr2=0x7fb9981507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:27.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 shutdown_connections 2024-09-13T18:28:27.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.456+0000 7fb99e6be640 1 -- 172.21.15.53:0/2810950173 wait complete. 2024-09-13T18:28:27.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:27.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:27.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.604+0000 7f717f410640 1 Processor -- start 2024-09-13T18:28:27.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.604+0000 7f717f410640 1 -- start start 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717f410640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71780caee0 0x7f71780cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717f410640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71780cd320 0x7f71780cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717f410640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717806f7a0 con 0x7f7178143e80 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717f410640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717806baa0 con 0x7f71780cd320 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717f410640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717806fd60 con 0x7f71780caee0 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71780cd320 0x7f71780cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71780cd320 0x7f71780cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58178/0 (socket says 172.21.15.53:58178) 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d1ac640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7178143e80 0x7f717806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49378/0 (socket says 172.21.15.53:49378) 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 -- 172.21.15.53:0/2352780924 learned_addr learned my addr 172.21.15.53:0/2352780924 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717c9ab640 1 --2- 172.21.15.53:0/2352780924 >> v2:172.21.15.87:3300/0 conn(0x7f71780caee0 0x7f71780cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 -- 172.21.15.53:0/2352780924 >> v2:172.21.15.87:3300/0 conn(0x7f71780caee0 msgr2=0x7f71780cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:27.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 --2- 172.21.15.53:0/2352780924 >> v2:172.21.15.87:3300/0 conn(0x7f71780caee0 0x7f71780cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 -- 172.21.15.53:0/2352780924 >> v1:172.21.15.53:6789/0 conn(0x7f7178143e80 legacy=0x7f717806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 -- 172.21.15.53:0/2352780924 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780cb960 con 0x7f71780cd320 2024-09-13T18:28:27.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f717d9ad640 1 --2- 172.21.15.53:0/2352780924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71780cd320 0x7f71780cd780 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7174009870 tx=0x7f717401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108ce2d4e0ce2b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.608+0000 7f716ffff640 1 -- 172.21.15.53:0/2352780924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740ab660 con 0x7f71780cd320 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f716ffff640 1 -- 172.21.15.53:0/2352780924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71740ab7c0 con 0x7f71780cd320 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f716ffff640 1 -- 172.21.15.53:0/2352780924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740abb50 con 0x7f71780cd320 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- 172.21.15.53:0/2352780924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71780cd320 msgr2=0x7f71780cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 --2- 172.21.15.53:0/2352780924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71780cd320 0x7f71780cd780 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7174009870 tx=0x7f717401c460 comp rx=0 tx=0).stop 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- 172.21.15.53:0/2352780924 shutdown_connections 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 --2- 172.21.15.53:0/2352780924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71780cd320 0x7f71780cd780 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 --2- 172.21.15.53:0/2352780924 >> v2:172.21.15.87:3300/0 conn(0x7f71780caee0 0x7f71780cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- 172.21.15.53:0/2352780924 >> 172.21.15.53:0/2352780924 conn(0x7f7178065c80 msgr2=0x7f7178066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- 172.21.15.53:0/2352780924 shutdown_connections 2024-09-13T18:28:27.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- 172.21.15.53:0/2352780924 wait complete. 2024-09-13T18:28:27.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 Processor -- start 2024-09-13T18:28:27.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- start start 2024-09-13T18:28:27.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780caee0 0x7f717815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71780cd320 0x7f7178159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7178143e80 0x7f71780a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717815b850 con 0x7f7178143e80 2024-09-13T18:28:27.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780af3f0 con 0x7f71780caee0 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780af6d0 con 0x7f71780cd320 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7178143e80 0x7f71780a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7178143e80 0x7f71780a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58182/0 (socket says 172.21.15.53:58182) 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 -- 172.21.15.53:0/1287880419 learned_addr learned my addr 172.21.15.53:0/1287880419 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d1ac640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780caee0 0x7f717815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717c9ab640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71780cd320 0x7f7178159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 -- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71780cd320 msgr2=0x7f7178159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71780cd320 0x7f7178159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 -- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780caee0 msgr2=0x7f717815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780caee0 0x7f717815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 -- 172.21.15.53:0/1287880419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71740094d0 con 0x7f7178143e80 2024-09-13T18:28:27.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717d9ad640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7178143e80 0x7f71780a84d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f71740ad040 tx=0x7f717401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f716dffb640 1 -- 172.21.15.53:0/1287880419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740ab660 con 0x7f7178143e80 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f716dffb640 1 -- 172.21.15.53:0/1287880419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71740b4800 con 0x7f7178143e80 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f716dffb640 1 -- 172.21.15.53:0/1287880419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740b4b90 con 0x7f7178143e80 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.612+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71780af9b0 con 0x7f7178143e80 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.616+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717813d430 con 0x7f7178143e80 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.616+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71780cb350 con 0x7f7178143e80 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.616+0000 7f716dffb640 1 -- 172.21.15.53:0/1287880419 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f71740a9070 con 0x7f7178143e80 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.616+0000 7f716dffb640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f715c066840 0x7f715c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.616+0000 7f716dffb640 1 -- 172.21.15.53:0/1287880419 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f717411ed10 con 0x7f7178143e80 2024-09-13T18:28:27.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.616+0000 7f717d1ac640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f715c066840 0x7f715c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.616+0000 7f717d1ac640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f715c066840 0x7f715c068d00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f71700012f0 tx=0x7f7170001640 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.620+0000 7f716dffb640 1 -- 172.21.15.53:0/1287880419 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71740ec380 con 0x7f7178143e80 2024-09-13T18:28:27.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.780+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71780712e0 con 0x7f7178143e80 2024-09-13T18:28:27.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f716dffb640 1 -- 172.21.15.53:0/1287880419 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71740ef9a0 con 0x7f7178143e80 2024-09-13T18:28:27.789 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f715c066840 msgr2=0x7f715c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f715c066840 0x7f715c068d00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f71700012f0 tx=0x7f7170001640 comp rx=0 tx=0).stop 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7178143e80 msgr2=0x7f71780a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7178143e80 0x7f71780a84d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f71740ad040 tx=0x7f717401aca0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 shutdown_connections 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f715c066840 0x7f715c068d00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71780cd320 0x7f7178159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7178143e80 0x7f71780a84d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 --2- 172.21.15.53:0/1287880419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71780caee0 0x7f717815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 >> 172.21.15.53:0/1287880419 conn(0x7f7178065c80 msgr2=0x7f71780cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:27.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 shutdown_connections 2024-09-13T18:28:27.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.784+0000 7f717f410640 1 -- 172.21.15.53:0/1287880419 wait complete. 2024-09-13T18:28:27.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:28:27.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.924+0000 7fe9854cb640 1 Processor -- start 2024-09-13T18:28:27.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.924+0000 7fe9854cb640 1 -- start start 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe9854cb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe98015a470 0x7fe9800cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe9854cb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe980071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe9854cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9800b1c10 0x7fe9800b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe9854cb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98006f880 con 0x7fe9800b1c10 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe9854cb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9800b2600 con 0x7fe98015a470 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe9854cb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98006f550 con 0x7fe98015cc60 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9800b1c10 0x7fe9800b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9800b1c10 0x7fe9800b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58188/0 (socket says 172.21.15.53:58188) 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 -- 172.21.15.53:0/4214633442 learned_addr learned my addr 172.21.15.53:0/4214633442 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97effd640 1 --2- 172.21.15.53:0/4214633442 >> v2:172.21.15.87:3300/0 conn(0x7fe98015a470 0x7fe9800cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97e7fc640 1 --2- 172.21.15.53:0/4214633442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe980071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 -- 172.21.15.53:0/4214633442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 msgr2=0x7fe980071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 --2- 172.21.15.53:0/4214633442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe980071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 -- 172.21.15.53:0/4214633442 >> v2:172.21.15.87:3300/0 conn(0x7fe98015a470 msgr2=0x7fe9800cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 --2- 172.21.15.53:0/4214633442 >> v2:172.21.15.87:3300/0 conn(0x7fe98015a470 0x7fe9800cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 -- 172.21.15.53:0/4214633442 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98015dc40 con 0x7fe9800b1c10 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97e7fc640 1 --2- 172.21.15.53:0/4214633442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe980071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:27.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.928+0000 7fe97f7fe640 1 --2- 172.21.15.53:0/4214633442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1c10 0x7fe9800b20c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe980069f50 tx=0x7fe97801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd98cfbca0b3848 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe97dffb640 1 -- 172.21.15.53:0/4214633442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780a5870 con 0x7fe9800b1c10 2024-09-13T18:28:27.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe97dffb640 1 -- 172.21.15.53:0/4214633442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9780a59d0 con 0x7fe9800b1c10 2024-09-13T18:28:27.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe97dffb640 1 -- 172.21.15.53:0/4214633442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780a5d60 con 0x7fe9800b1c10 2024-09-13T18:28:27.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- 172.21.15.53:0/4214633442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1c10 msgr2=0x7fe9800b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 --2- 172.21.15.53:0/4214633442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1c10 0x7fe9800b20c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe980069f50 tx=0x7fe97801c9f0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- 172.21.15.53:0/4214633442 shutdown_connections 2024-09-13T18:28:27.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 --2- 172.21.15.53:0/4214633442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe980071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 --2- 172.21.15.53:0/4214633442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1c10 0x7fe9800b20c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 --2- 172.21.15.53:0/4214633442 >> v2:172.21.15.87:3300/0 conn(0x7fe98015a470 0x7fe9800cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- 172.21.15.53:0/4214633442 >> 172.21.15.53:0/4214633442 conn(0x7fe980065c80 msgr2=0x7fe980066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:27.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- 172.21.15.53:0/4214633442 shutdown_connections 2024-09-13T18:28:27.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- 172.21.15.53:0/4214633442 wait complete. 2024-09-13T18:28:27.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 Processor -- start 2024-09-13T18:28:27.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- start start 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800b1c10 0x7fe9800ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe98015a470 0x7fe980151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe9801590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9801525b0 con 0x7fe98015a470 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe980156880 con 0x7fe9800b1c10 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe9854cb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe980156b60 con 0x7fe98015cc60 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe97e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe98015a470 0x7fe980151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe97e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe98015a470 0x7fe980151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58194/0 (socket says 172.21.15.53:58194) 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.932+0000 7fe97e7fc640 1 -- 172.21.15.53:0/3456495018 learned_addr learned my addr 172.21.15.53:0/3456495018 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:27.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97effd640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800b1c10 0x7fe9800ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97f7fe640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe9801590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97e7fc640 1 -- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 msgr2=0x7fe9801590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97e7fc640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe9801590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97e7fc640 1 -- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800b1c10 msgr2=0x7fe9800ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97e7fc640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800b1c10 0x7fe9800ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97e7fc640 1 -- 172.21.15.53:0/3456495018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009b30 con 0x7fe98015a470 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97e7fc640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe98015a470 0x7fe980151cd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe97400d7d0 tx=0x7fe97400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9677fe640 1 -- 172.21.15.53:0/3456495018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9740096a0 con 0x7fe98015a470 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9677fe640 1 -- 172.21.15.53:0/3456495018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe974009800 con 0x7fe98015a470 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9677fe640 1 -- 172.21.15.53:0/3456495018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974009bb0 con 0x7fe98015a470 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe980156e40 con 0x7fe98015a470 2024-09-13T18:28:27.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe980157400 con 0x7fe98015a470 2024-09-13T18:28:27.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe980067400 con 0x7fe98015a470 2024-09-13T18:28:27.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9677fe640 1 -- 172.21.15.53:0/3456495018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe974009d10 con 0x7fe98015a470 2024-09-13T18:28:27.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9677fe640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe96c066840 0x7fe96c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:27.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe9677fe640 1 -- 172.21.15.53:0/3456495018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe9740847a0 con 0x7fe98015a470 2024-09-13T18:28:27.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97effd640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe96c066840 0x7fe96c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:27.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.936+0000 7fe97effd640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe96c066840 0x7fe96c068d00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe970009a70 tx=0x7fe970008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:27.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:27.940+0000 7fe9677fe640 1 -- 172.21.15.53:0/3456495018 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe974051c70 con 0x7fe98015a470 2024-09-13T18:28:28.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.096+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe980070870 con 0x7fe98015a470 2024-09-13T18:28:28.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.096+0000 7fe9677fe640 1 -- 172.21.15.53:0/3456495018 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe97400b440 con 0x7fe98015a470 2024-09-13T18:28:28.103 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:28.103 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:28:28.103 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:28.104 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:28:28.104 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:28:28.104 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:28.104 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:28:28.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe96c066840 msgr2=0x7fe96c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe96c066840 0x7fe96c068d00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe970009a70 tx=0x7fe970008040 comp rx=0 tx=0).stop 2024-09-13T18:28:28.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe98015a470 msgr2=0x7fe980151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe98015a470 0x7fe980151cd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe97400d7d0 tx=0x7fe97400dc90 comp rx=0 tx=0).stop 2024-09-13T18:28:28.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 shutdown_connections 2024-09-13T18:28:28.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe96c066840 0x7fe96c068d00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe98015cc60 0x7fe9801590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe98015a470 0x7fe980151cd0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 --2- 172.21.15.53:0/3456495018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9800b1c10 0x7fe9800ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 >> 172.21.15.53:0/3456495018 conn(0x7fe980065c80 msgr2=0x7fe9800aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:28.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 shutdown_connections 2024-09-13T18:28:28.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.100+0000 7fe9854cb640 1 -- 172.21.15.53:0/3456495018 wait complete. 2024-09-13T18:28:28.121 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:28:28.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:28:28.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01c834640 1 Processor -- start 2024-09-13T18:28:28.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01c834640 1 -- start start 2024-09-13T18:28:28.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01c834640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa018145400 0x7fa0180ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01c834640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa018145e50 0x7fa0180ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01c834640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0180706a0 con 0x7fa018145900 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01c834640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180b26d0 con 0x7fa018145400 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01c834640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180b3920 con 0x7fa018145e50 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa015d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa018145900 0x7fa01806f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49388/0 (socket says 172.21.15.53:49388) 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa018145400 0x7fa0180ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa015d9b640 1 -- 172.21.15.53:0/550007860 learned_addr learned my addr 172.21.15.53:0/550007860 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa016d9d640 1 --2- 172.21.15.53:0/550007860 >> v2:172.21.15.87:3300/0 conn(0x7fa018145e50 0x7fa0180ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01559a640 1 -- 172.21.15.53:0/550007860 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334601570 0 0) 0x7fa00c001120 con 0x7fa018145900 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01559a640 1 -- 172.21.15.53:0/550007860 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa000003530 con 0x7fa018145900 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01659c640 1 -- 172.21.15.53:0/550007860 >> v2:172.21.15.87:3300/0 conn(0x7fa018145e50 msgr2=0x7fa0180ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01659c640 1 --2- 172.21.15.53:0/550007860 >> v2:172.21.15.87:3300/0 conn(0x7fa018145e50 0x7fa0180ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01659c640 1 -- 172.21.15.53:0/550007860 >> v1:172.21.15.53:6789/0 conn(0x7fa018145900 legacy=0x7fa01806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa01659c640 1 -- 172.21.15.53:0/550007860 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa018160410 con 0x7fa018145400 2024-09-13T18:28:28.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.240+0000 7fa016d9d640 1 --2- 172.21.15.53:0/550007860 >> v2:172.21.15.87:3300/0 conn(0x7fa018145e50 0x7fa0180ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:28.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01659c640 1 --2- 172.21.15.53:0/550007860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ac8e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa018146480 tx=0x7fa00801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a46b783a882ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:28.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01559a640 1 -- 172.21.15.53:0/550007860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080a8050 con 0x7fa018145400 2024-09-13T18:28:28.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01559a640 1 -- 172.21.15.53:0/550007860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080ac5f0 con 0x7fa018145400 2024-09-13T18:28:28.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01559a640 1 -- 172.21.15.53:0/550007860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080ac960 con 0x7fa018145400 2024-09-13T18:28:28.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 -- 172.21.15.53:0/550007860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 msgr2=0x7fa0180ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 --2- 172.21.15.53:0/550007860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ac8e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa018146480 tx=0x7fa00801c450 comp rx=0 tx=0).stop 2024-09-13T18:28:28.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 -- 172.21.15.53:0/550007860 shutdown_connections 2024-09-13T18:28:28.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 --2- 172.21.15.53:0/550007860 >> v2:172.21.15.87:3300/0 conn(0x7fa018145e50 0x7fa0180ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 --2- 172.21.15.53:0/550007860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ac8e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 -- 172.21.15.53:0/550007860 >> 172.21.15.53:0/550007860 conn(0x7fa018073330 msgr2=0x7fa018065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:28.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 -- 172.21.15.53:0/550007860 shutdown_connections 2024-09-13T18:28:28.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 -- 172.21.15.53:0/550007860 wait complete. 2024-09-13T18:28:28.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 Processor -- start 2024-09-13T18:28:28.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.244+0000 7fa01c834640 1 -- start start 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018145900 0x7fa01813dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa018145e50 0x7fa01813f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180cdbd0 con 0x7fa018145400 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01813f430 con 0x7fa018145900 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180cd330 con 0x7fa018145e50 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58206/0 (socket says 172.21.15.53:58206) 2024-09-13T18:28:28.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 -- 172.21.15.53:0/1474518586 learned_addr learned my addr 172.21.15.53:0/1474518586 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa016d9d640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa018145e50 0x7fa01813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa015d9b640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018145900 0x7fa01813dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 -- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa018145e50 msgr2=0x7fa01813f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa018145e50 0x7fa01813f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 -- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018145900 msgr2=0x7fa01813dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018145900 0x7fa01813dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 -- 172.21.15.53:0/1474518586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008009420 con 0x7fa018145400 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01659c640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ccca0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa0080af040 tx=0x7fa0080191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa006ffd640 1 -- 172.21.15.53:0/1474518586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080a8040 con 0x7fa018145400 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa006ffd640 1 -- 172.21.15.53:0/1474518586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080acb70 con 0x7fa018145400 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0180cd610 con 0x7fa018145400 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa006ffd640 1 -- 172.21.15.53:0/1474518586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008003620 con 0x7fa018145400 2024-09-13T18:28:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0180cb4e0 con 0x7fa018145400 2024-09-13T18:28:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0180cace0 con 0x7fa018145400 2024-09-13T18:28:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa006ffd640 1 -- 172.21.15.53:0/1474518586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa008003780 con 0x7fa018145400 2024-09-13T18:28:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa006ffd640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9ff8066840 0x7f9ff8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa006ffd640 1 -- 172.21.15.53:0/1474518586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa00811de90 con 0x7fa018145400 2024-09-13T18:28:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.248+0000 7fa015d9b640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9ff8066840 0x7f9ff8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.252+0000 7fa015d9b640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9ff8066840 0x7f9ff8068d00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa0180cc900 tx=0x7fa00c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.252+0000 7fa006ffd640 1 -- 172.21.15.53:0/1474518586 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa0080eb250 con 0x7fa018145400 2024-09-13T18:28:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:28.412+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa0180cb6d0 con 0x7fa018145400 2024-09-13T18:28:29.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.428+0000 7fa006ffd640 1 -- 172.21.15.53:0/1474518586 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa0080ee870 con 0x7fa018145400 2024-09-13T18:28:29.433 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:28:29.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9ff8066840 msgr2=0x7f9ff8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9ff8066840 0x7f9ff8068d00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa0180cc900 tx=0x7fa00c009040 comp rx=0 tx=0).stop 2024-09-13T18:28:29.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 msgr2=0x7fa0180ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ccca0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa0080af040 tx=0x7fa0080191f0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 shutdown_connections 2024-09-13T18:28:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9ff8066840 0x7f9ff8068d00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa018145e50 0x7fa01813f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa018145900 0x7fa01813dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 --2- 172.21.15.53:0/1474518586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa018145400 0x7fa0180ccca0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 >> 172.21.15.53:0/1474518586 conn(0x7fa018073330 msgr2=0x7fa0180ae100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 shutdown_connections 2024-09-13T18:28:29.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.432+0000 7fa01c834640 1 -- 172.21.15.53:0/1474518586 wait complete. 2024-09-13T18:28:29.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:28:29.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82429e640 1 Processor -- start 2024-09-13T18:28:29.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82429e640 1 -- start start 2024-09-13T18:28:29.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82429e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa81c143e80 0x7fa81c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82429e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa81c0cda30 0x7fa81c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82429e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c06f7a0 con 0x7fa81c0caee0 2024-09-13T18:28:29.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82429e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c06fd60 con 0x7fa81c143e80 2024-09-13T18:28:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82429e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0cb960 con 0x7fa81c0cda30 2024-09-13T18:28:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82203a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa81c143e80 0x7fa81c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82203a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa81c143e80 0x7fa81c06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58222/0 (socket says 172.21.15.53:58222) 2024-09-13T18:28:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82203a640 1 -- 172.21.15.53:0/386139408 learned_addr learned my addr 172.21.15.53:0/386139408 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa821839640 1 --1- 172.21.15.53:0/386139408 >> v1:172.21.15.53:6789/0 conn(0x7fa81c0caee0 0x7fa81c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49394/0 (socket says 172.21.15.53:49394) 2024-09-13T18:28:29.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82283b640 1 --2- 172.21.15.53:0/386139408 >> v2:172.21.15.87:3300/0 conn(0x7fa81c0cda30 0x7fa81c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82203a640 1 -- 172.21.15.53:0/386139408 >> v2:172.21.15.87:3300/0 conn(0x7fa81c0cda30 msgr2=0x7fa81c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:29.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82203a640 1 --2- 172.21.15.53:0/386139408 >> v2:172.21.15.87:3300/0 conn(0x7fa81c0cda30 0x7fa81c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82203a640 1 -- 172.21.15.53:0/386139408 >> v1:172.21.15.53:6789/0 conn(0x7fa81c0caee0 legacy=0x7fa81c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82203a640 1 -- 172.21.15.53:0/386139408 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0cbc40 con 0x7fa81c143e80 2024-09-13T18:28:29.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.596+0000 7fa82283b640 1 --2- 172.21.15.53:0/386139408 >> v2:172.21.15.87:3300/0 conn(0x7fa81c0cda30 0x7fa81c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82203a640 1 --2- 172.21.15.53:0/386139408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c143e80 0x7fa81c06b390 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa81c06d370 tx=0x7fa81801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f090b49b96439058 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821038640 1 -- 172.21.15.53:0/386139408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180ac410 con 0x7fa81c143e80 2024-09-13T18:28:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821038640 1 -- 172.21.15.53:0/386139408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8180ac570 con 0x7fa81c143e80 2024-09-13T18:28:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821038640 1 -- 172.21.15.53:0/386139408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180ac900 con 0x7fa81c143e80 2024-09-13T18:28:29.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- 172.21.15.53:0/386139408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c143e80 msgr2=0x7fa81c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 --2- 172.21.15.53:0/386139408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c143e80 0x7fa81c06b390 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa81c06d370 tx=0x7fa81801c3d0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- 172.21.15.53:0/386139408 shutdown_connections 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 --2- 172.21.15.53:0/386139408 >> v2:172.21.15.87:3300/0 conn(0x7fa81c0cda30 0x7fa81c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 --2- 172.21.15.53:0/386139408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c143e80 0x7fa81c06b390 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- 172.21.15.53:0/386139408 >> 172.21.15.53:0/386139408 conn(0x7fa81c065c80 msgr2=0x7fa81c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- 172.21.15.53:0/386139408 shutdown_connections 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- 172.21.15.53:0/386139408 wait complete. 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 Processor -- start 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- start start 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa81c0caee0 0x7fa81c13bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c0cda30 0x7fa81c1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa81c143e80 0x7fa81c141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c13ac80 con 0x7fa81c0cda30 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c13af60 con 0x7fa81c143e80 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82429e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c13b240 con 0x7fa81c0caee0 2024-09-13T18:28:29.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c0cda30 0x7fa81c1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c0cda30 0x7fa81c1413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58224/0 (socket says 172.21.15.53:58224) 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 -- 172.21.15.53:0/462922068 learned_addr learned my addr 172.21.15.53:0/462922068 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82203a640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa81c0caee0 0x7fa81c13bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82283b640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa81c143e80 0x7fa81c141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 -- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa81c0caee0 msgr2=0x7fa81c13bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa81c0caee0 0x7fa81c13bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 -- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa81c143e80 msgr2=0x7fa81c141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa81c143e80 0x7fa81c141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa821839640 1 -- 172.21.15.53:0/462922068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180094d0 con 0x7fa81c0cda30 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.600+0000 7fa82203a640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa81c0caee0 0x7fa81c13bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa821839640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c0cda30 0x7fa81c1413d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c490 tx=0x7fa80c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa812ffd640 1 -- 172.21.15.53:0/462922068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c007480 con 0x7fa81c0cda30 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa812ffd640 1 -- 172.21.15.53:0/462922068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c0075e0 con 0x7fa81c0cda30 2024-09-13T18:28:29.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa812ffd640 1 -- 172.21.15.53:0/462922068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c004a10 con 0x7fa81c0cda30 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c13b520 con 0x7fa81c0cda30 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c13c260 con 0x7fa81c0cda30 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c0cb350 con 0x7fa81c0cda30 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa812ffd640 1 -- 172.21.15.53:0/462922068 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa80c004b70 con 0x7fa81c0cda30 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa812ffd640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa800066840 0x7fa800068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa812ffd640 1 -- 172.21.15.53:0/462922068 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa80c083470 con 0x7fa81c0cda30 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa82203a640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa800066840 0x7fa800068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:29.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.604+0000 7fa82203a640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa800066840 0x7fa800068d00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa8180ae000 tx=0x7fa818008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:29.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.608+0000 7fa812ffd640 1 -- 172.21.15.53:0/462922068 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa80c050750 con 0x7fa81c0cda30 2024-09-13T18:28:29.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:29.764+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa81c13b9d0 con 0x7fa81c0cda30 2024-09-13T18:28:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.440+0000 7fa812ffd640 1 -- 172.21.15.53:0/462922068 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa80c053d70 con 0x7fa81c0cda30 2024-09-13T18:28:30.447 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:28:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa800066840 msgr2=0x7fa800068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa800066840 0x7fa800068d00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa8180ae000 tx=0x7fa818008040 comp rx=0 tx=0).stop 2024-09-13T18:28:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c0cda30 msgr2=0x7fa81c1413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c0cda30 0x7fa81c1413d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c490 tx=0x7fa80c00c950 comp rx=0 tx=0).stop 2024-09-13T18:28:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 shutdown_connections 2024-09-13T18:28:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa800066840 0x7fa800068d00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa81c143e80 0x7fa81c141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa81c0cda30 0x7fa81c1413d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 --2- 172.21.15.53:0/462922068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa81c0caee0 0x7fa81c13bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 >> 172.21.15.53:0/462922068 conn(0x7fa81c065c80 msgr2=0x7fa81c0b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.452+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 shutdown_connections 2024-09-13T18:28:30.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.456+0000 7fa82429e640 1 -- 172.21.15.53:0/462922068 wait complete. 2024-09-13T18:28:30.496 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:28:30.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f30c4640 1 Processor -- start 2024-09-13T18:28:30.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f30c4640 1 -- start start 2024-09-13T18:28:30.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f30c4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17ec15c830 0x7f17ec0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f30c4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f30c4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0b7db0 con 0x7f17ec0d2c80 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f30c4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec0d0650 con 0x7f17ec15c830 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f30c4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0d0c10 con 0x7f17ec0ccd10 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f0e60640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17ec15c830 0x7f17ec0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f1661640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f17ec0d2c80 0x7f17ec0b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49400/0 (socket says 172.21.15.53:49400) 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.616+0000 7f17f1661640 1 -- 172.21.15.53:0/1157052690 learned_addr learned my addr 172.21.15.53:0/1157052690 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17ebfff640 1 --2- 172.21.15.53:0/1157052690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17eb7fe640 1 -- 172.21.15.53:0/1157052690 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907611836 0 0) 0x7f17ec0b7db0 con 0x7f17ec0d2c80 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17eb7fe640 1 -- 172.21.15.53:0/1157052690 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d4003530 con 0x7f17ec0d2c80 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f0e60640 1 -- 172.21.15.53:0/1157052690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 msgr2=0x7f17ec0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f0e60640 1 --2- 172.21.15.53:0/1157052690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f0e60640 1 -- 172.21.15.53:0/1157052690 >> v1:172.21.15.53:6789/0 conn(0x7f17ec0d2c80 legacy=0x7f17ec0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f0e60640 1 -- 172.21.15.53:0/1157052690 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0cd7d0 con 0x7f17ec15c830 2024-09-13T18:28:30.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f0e60640 1 --2- 172.21.15.53:0/1157052690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec0d10a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0097c0 tx=0x7f17dc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2137091ec6446e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17eb7fe640 1 -- 172.21.15.53:0/1157052690 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0ab600 con 0x7f17ec15c830 2024-09-13T18:28:30.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17eb7fe640 1 -- 172.21.15.53:0/1157052690 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc0a7050 con 0x7f17ec15c830 2024-09-13T18:28:30.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17eb7fe640 1 -- 172.21.15.53:0/1157052690 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0ab980 con 0x7f17ec15c830 2024-09-13T18:28:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 -- 172.21.15.53:0/1157052690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 msgr2=0x7f17ec0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 --2- 172.21.15.53:0/1157052690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec0d10a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0097c0 tx=0x7f17dc01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 -- 172.21.15.53:0/1157052690 shutdown_connections 2024-09-13T18:28:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 --2- 172.21.15.53:0/1157052690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 --2- 172.21.15.53:0/1157052690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec0d10a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 -- 172.21.15.53:0/1157052690 >> 172.21.15.53:0/1157052690 conn(0x7f17ec070970 msgr2=0x7f17ec070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 -- 172.21.15.53:0/1157052690 shutdown_connections 2024-09-13T18:28:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.620+0000 7f17f30c4640 1 -- 172.21.15.53:0/1157052690 wait complete. 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 Processor -- start 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 -- start start 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17ec0d2c80 0x7f17ec151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec15cd20 con 0x7f17ec15c830 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec15d5c0 con 0x7f17ec0d2c80 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec15bca0 con 0x7f17ec0ccd10 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58242/0 (socket says 172.21.15.53:58242) 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 -- 172.21.15.53:0/2866552753 learned_addr learned my addr 172.21.15.53:0/2866552753 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f0e60640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17ebfff640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17ec0d2c80 0x7f17ec151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 -- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 msgr2=0x7f17ec152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 -- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17ec0d2c80 msgr2=0x7f17ec151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17ec0d2c80 0x7f17ec151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 -- 172.21.15.53:0/2866552753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc009420 con 0x7f17ec15c830 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f1661640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec1547b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f17e400cad0 tx=0x7f17e400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17e97fa640 1 -- 172.21.15.53:0/2866552753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400abd0 con 0x7f17ec15c830 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17e97fa640 1 -- 172.21.15.53:0/2866552753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e400ad30 con 0x7f17ec15c830 2024-09-13T18:28:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec15cf70 con 0x7f17ec15c830 2024-09-13T18:28:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17e97fa640 1 -- 172.21.15.53:0/2866552753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400aea0 con 0x7f17ec15c830 2024-09-13T18:28:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec151650 con 0x7f17ec15c830 2024-09-13T18:28:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.624+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec15d700 con 0x7f17ec15c830 2024-09-13T18:28:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.628+0000 7f17e97fa640 1 -- 172.21.15.53:0/2866552753 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f17e4007070 con 0x7f17ec15c830 2024-09-13T18:28:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.628+0000 7f17e97fa640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f17d8066840 0x7f17d8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.628+0000 7f17e97fa640 1 -- 172.21.15.53:0/2866552753 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f17e4084790 con 0x7f17ec15c830 2024-09-13T18:28:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.628+0000 7f17f0e60640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f17d8066840 0x7f17d8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.628+0000 7f17f0e60640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f17d8066840 0x7f17d8068d00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0ad000 tx=0x7f17dc0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.632+0000 7f17e97fa640 1 -- 172.21.15.53:0/2866552753 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f17e40519d0 con 0x7f17ec15c830 2024-09-13T18:28:30.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.832+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f17ec0d1080 con 0x7f17ec15c830 2024-09-13T18:28:30.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.840+0000 7f17e97fa640 1 -- 172.21.15.53:0/2866552753 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) v1 ==== 172+0+0 (secure 0 0 0) 0x7f17e4054ff0 con 0x7f17ec15c830 2024-09-13T18:28:30.853 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 8 and data pool 9 2024-09-13T18:28:30.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.844+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f17d8066840 msgr2=0x7f17d8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.844+0000 7f17f30c4640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f17d8066840 0x7f17d8068d00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0ad000 tx=0x7f17dc0a6000 comp rx=0 tx=0).stop 2024-09-13T18:28:30.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.844+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 msgr2=0x7f17ec1547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.844+0000 7f17f30c4640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec1547b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f17e400cad0 tx=0x7f17e400cf90 comp rx=0 tx=0).stop 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 shutdown_connections 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f17d8066840 0x7f17d8068d00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17ec15c830 0x7f17ec1547b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17ec0d2c80 0x7f17ec151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 --2- 172.21.15.53:0/2866552753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17ec0ccd10 0x7f17ec152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 >> 172.21.15.53:0/2866552753 conn(0x7f17ec070970 msgr2=0x7f17ec0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 shutdown_connections 2024-09-13T18:28:30.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.848+0000 7f17f30c4640 1 -- 172.21.15.53:0/2866552753 wait complete. 2024-09-13T18:28:30.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.992+0000 7f196fa39640 1 Processor -- start 2024-09-13T18:28:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.992+0000 7f196fa39640 1 -- start start 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19681582a0 0x7f196806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f196815b7c0 0x7f196806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f1968071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196815aaf0 con 0x7f196815b7c0 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196806d760 con 0x7f19681582a0 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1968071650 con 0x7f1968070c90 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f196815b7c0 0x7f196806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f196815b7c0 0x7f196806ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58246/0 (socket says 172.21.15.53:58246) 2024-09-13T18:28:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 -- 172.21.15.53:0/3727589842 learned_addr learned my addr 172.21.15.53:0/3727589842 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196d7d5640 1 --2- 172.21.15.53:0/3727589842 >> v2:172.21.15.87:3300/0 conn(0x7f19681582a0 0x7f196806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196dfd6640 1 --2- 172.21.15.53:0/3727589842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f1968071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 -- 172.21.15.53:0/3727589842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 msgr2=0x7f1968071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 --2- 172.21.15.53:0/3727589842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f1968071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 -- 172.21.15.53:0/3727589842 >> v2:172.21.15.87:3300/0 conn(0x7f19681582a0 msgr2=0x7f196806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 --2- 172.21.15.53:0/3727589842 >> v2:172.21.15.87:3300/0 conn(0x7f19681582a0 0x7f196806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 -- 172.21.15.53:0/3727589842 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196806d480 con 0x7f196815b7c0 2024-09-13T18:28:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196cfd4640 1 --2- 172.21.15.53:0/3727589842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f196806ce40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1968069f50 tx=0x7f195801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b388a998d6943c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f195ffff640 1 -- 172.21.15.53:0/3727589842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19580aa610 con 0x7f196815b7c0 2024-09-13T18:28:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f195ffff640 1 -- 172.21.15.53:0/3727589842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19580a6040 con 0x7f196815b7c0 2024-09-13T18:28:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f195ffff640 1 -- 172.21.15.53:0/3727589842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19580aa990 con 0x7f196815b7c0 2024-09-13T18:28:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- 172.21.15.53:0/3727589842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 msgr2=0x7f196806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 --2- 172.21.15.53:0/3727589842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f196806ce40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1968069f50 tx=0x7f195801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- 172.21.15.53:0/3727589842 shutdown_connections 2024-09-13T18:28:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 --2- 172.21.15.53:0/3727589842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f1968071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 --2- 172.21.15.53:0/3727589842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f196806ce40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 --2- 172.21.15.53:0/3727589842 >> v2:172.21.15.87:3300/0 conn(0x7f19681582a0 0x7f196806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- 172.21.15.53:0/3727589842 >> 172.21.15.53:0/3727589842 conn(0x7f1968065c80 msgr2=0x7f1968066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- 172.21.15.53:0/3727589842 shutdown_connections 2024-09-13T18:28:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:30.996+0000 7f196fa39640 1 -- 172.21.15.53:0/3727589842 wait complete. 2024-09-13T18:28:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 Processor -- start 2024-09-13T18:28:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 -- start start 2024-09-13T18:28:31.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f196813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19681582a0 0x7f19680ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f19680ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1968140230 con 0x7f196815b7c0 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19680b27e0 con 0x7f19681582a0 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19680b2ac0 con 0x7f1968070c90 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f19680ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f19680ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58256/0 (socket says 172.21.15.53:58256) 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 -- 172.21.15.53:0/2007462365 learned_addr learned my addr 172.21.15.53:0/2007462365 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196cfd4640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19681582a0 0x7f19680ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196d7d5640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f196813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 -- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 msgr2=0x7f196813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f196813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 -- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19681582a0 msgr2=0x7f19680ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19681582a0 0x7f19680ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 -- 172.21.15.53:0/2007462365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580094d0 con 0x7f196815b7c0 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196dfd6640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f19680ace20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1960007e60 tx=0x7f196000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f195dffb640 1 -- 172.21.15.53:0/2007462365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960014620 con 0x7f196815b7c0 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f195dffb640 1 -- 172.21.15.53:0/2007462365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196000ee90 con 0x7f196815b7c0 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19680b2da0 con 0x7f196815b7c0 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f195dffb640 1 -- 172.21.15.53:0/2007462365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600149e0 con 0x7f196815b7c0 2024-09-13T18:28:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.000+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19680b3360 con 0x7f196815b7c0 2024-09-13T18:28:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.004+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1968067400 con 0x7f196815b7c0 2024-09-13T18:28:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.004+0000 7f195dffb640 1 -- 172.21.15.53:0/2007462365 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f1960014b40 con 0x7f196815b7c0 2024-09-13T18:28:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.004+0000 7f195dffb640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f194c066840 0x7f194c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.004+0000 7f195dffb640 1 -- 172.21.15.53:0/2007462365 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1960084db0 con 0x7f196815b7c0 2024-09-13T18:28:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.004+0000 7f196d7d5640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f194c066840 0x7f194c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.004+0000 7f196d7d5640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f194c066840 0x7f194c068d00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f196400b9d0 tx=0x7f1964008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.008+0000 7f195dffb640 1 -- 172.21.15.53:0/2007462365 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1960089070 con 0x7f196815b7c0 2024-09-13T18:28:31.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.168+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1968070110 con 0x7f196815b7c0 2024-09-13T18:28:31.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.168+0000 7f195dffb640 1 -- 172.21.15.53:0/2007462365 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f1960051e90 con 0x7f196815b7c0 2024-09-13T18:28:31.176 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:31.176 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":59,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:30.837162+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f194c066840 msgr2=0x7f194c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f194c066840 0x7f194c068d00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f196400b9d0 tx=0x7f1964008040 comp rx=0 tx=0).stop 2024-09-13T18:28:31.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 msgr2=0x7f19680ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f19680ace20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1960007e60 tx=0x7f196000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 shutdown_connections 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f194c066840 0x7f194c068d00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f196815b7c0 0x7f19680ace20 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19681582a0 0x7f19680ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 --2- 172.21.15.53:0/2007462365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1968070c90 0x7f196813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 >> 172.21.15.53:0/2007462365 conn(0x7f1968065c80 msgr2=0x7f19681554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 shutdown_connections 2024-09-13T18:28:31.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.172+0000 7f196fa39640 1 -- 172.21.15.53:0/2007462365 wait complete. 2024-09-13T18:28:31.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:31.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.312+0000 7fc4f687f640 1 Processor -- start 2024-09-13T18:28:31.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.312+0000 7fc4f687f640 1 -- start start 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4f687f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4f687f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4f00b2b80 0x7fc4f00ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4f687f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f01601a0 con 0x7fc4f00cd320 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4f687f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f006a990 con 0x7fc4f00b2b80 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4f687f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00cd7d0 con 0x7fc4f015fdc0 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4effff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4ef7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4f00b2b80 0x7fc4f00ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4effff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:43604/0 (socket says 172.21.15.53:43604) 2024-09-13T18:28:31.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4effff640 1 -- 172.21.15.53:0/3287725105 learned_addr learned my addr 172.21.15.53:0/3287725105 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:31.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4ef7fe640 1 -- 172.21.15.53:0/3287725105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 msgr2=0x7fc4f00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:31.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4ef7fe640 1 --2- 172.21.15.53:0/3287725105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4ef7fe640 1 -- 172.21.15.53:0/3287725105 >> v1:172.21.15.87:6789/0 conn(0x7fc4f00cd320 legacy=0x7fc4f006d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4eeffd640 1 -- 172.21.15.53:0/3287725105 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537810044 0 0) 0x7fc4e8001120 con 0x7fc4f00cd320 2024-09-13T18:28:31.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.316+0000 7fc4ef7fe640 1 -- 172.21.15.53:0/3287725105 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00cf9a0 con 0x7fc4f00b2b80 2024-09-13T18:28:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4ef7fe640 1 --2- 172.21.15.53:0/3287725105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 0x7fc4f00ccde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009dc0 tx=0x7fc4e001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a457249c1b9212 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4eeffd640 1 -- 172.21.15.53:0/3287725105 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00a5870 con 0x7fc4f00b2b80 2024-09-13T18:28:31.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4eeffd640 1 -- 172.21.15.53:0/3287725105 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e00a59d0 con 0x7fc4f00b2b80 2024-09-13T18:28:31.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4eeffd640 1 -- 172.21.15.53:0/3287725105 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00a5d60 con 0x7fc4f00b2b80 2024-09-13T18:28:31.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 -- 172.21.15.53:0/3287725105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 msgr2=0x7fc4f00ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 --2- 172.21.15.53:0/3287725105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 0x7fc4f00ccde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009dc0 tx=0x7fc4e001c890 comp rx=0 tx=0).stop 2024-09-13T18:28:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 -- 172.21.15.53:0/3287725105 shutdown_connections 2024-09-13T18:28:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 --2- 172.21.15.53:0/3287725105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 0x7fc4f00ccde0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 --2- 172.21.15.53:0/3287725105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 -- 172.21.15.53:0/3287725105 >> 172.21.15.53:0/3287725105 conn(0x7fc4f00b2060 msgr2=0x7fc4f00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 -- 172.21.15.53:0/3287725105 shutdown_connections 2024-09-13T18:28:31.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 -- 172.21.15.53:0/3287725105 wait complete. 2024-09-13T18:28:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 Processor -- start 2024-09-13T18:28:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.320+0000 7fc4f687f640 1 -- start start 2024-09-13T18:28:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 0x7fc4f0158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4f00cd320 0x7fc4f00c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f0158bb0 con 0x7fc4f00cd320 2024-09-13T18:28:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00c4f60 con 0x7fc4f00b2b80 2024-09-13T18:28:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00c4350 con 0x7fc4f015fdc0 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4f00cd320 0x7fc4f00c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4f00cd320 0x7fc4f00c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58270/0 (socket says 172.21.15.53:58270) 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 -- 172.21.15.53:0/1446866974 learned_addr learned my addr 172.21.15.53:0/1446866974 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f4e1c640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4effff640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 0x7fc4f0158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 -- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 msgr2=0x7fc4f00af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 -- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 msgr2=0x7fc4f0158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 0x7fc4f0158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 -- 172.21.15.53:0/1446866974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0009a70 con 0x7fc4f00cd320 2024-09-13T18:28:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ef7fe640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4f00cd320 0x7fc4f00c53f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009d60 tx=0x7fc4e0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ecff9640 1 -- 172.21.15.53:0/1446866974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00b9650 con 0x7fc4f00cd320 2024-09-13T18:28:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ecff9640 1 -- 172.21.15.53:0/1446866974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e00b97b0 con 0x7fc4f00cd320 2024-09-13T18:28:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f00c4630 con 0x7fc4f00cd320 2024-09-13T18:28:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ecff9640 1 -- 172.21.15.53:0/1446866974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00b9b40 con 0x7fc4f00cd320 2024-09-13T18:28:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f00c4bf0 con 0x7fc4f00cd320 2024-09-13T18:28:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f00ccde0 con 0x7fc4f00cd320 2024-09-13T18:28:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ecff9640 1 -- 172.21.15.53:0/1446866974 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc4e00b9ca0 con 0x7fc4f00cd320 2024-09-13T18:28:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ecff9640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4d0066840 0x7fc4d0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.324+0000 7fc4ecff9640 1 -- 172.21.15.53:0/1446866974 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4e011f7c0 con 0x7fc4f00cd320 2024-09-13T18:28:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.328+0000 7fc4effff640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4d0066840 0x7fc4d0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.328+0000 7fc4effff640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4d0066840 0x7fc4d0068d00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009ae0 tx=0x7fc4d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.332+0000 7fc4ecff9640 1 -- 172.21.15.53:0/1446866974 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4e00ec830 con 0x7fc4f00cd320 2024-09-13T18:28:31.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.492+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f00b17b0 con 0x7fc4f00cd320 2024-09-13T18:28:31.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4ecff9640 1 -- 172.21.15.53:0/1446866974 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16518 (secure 0 0 0) 0x7fc4e00efe50 con 0x7fc4f00cd320 2024-09-13T18:28:31.501 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:31.501 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":59,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:30.837162+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4d0066840 msgr2=0x7fc4d0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4d0066840 0x7fc4d0068d00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009ae0 tx=0x7fc4d8008040 comp rx=0 tx=0).stop 2024-09-13T18:28:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4f00cd320 msgr2=0x7fc4f00c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4f00cd320 0x7fc4f00c53f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009d60 tx=0x7fc4e0019630 comp rx=0 tx=0).stop 2024-09-13T18:28:31.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 shutdown_connections 2024-09-13T18:28:31.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4d0066840 0x7fc4d0068d00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4f015fdc0 0x7fc4f00af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4f00cd320 0x7fc4f00c53f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 --2- 172.21.15.53:0/1446866974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4f00b2b80 0x7fc4f0158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 >> 172.21.15.53:0/1446866974 conn(0x7fc4f00b2060 msgr2=0x7fc4f006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 shutdown_connections 2024-09-13T18:28:31.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.496+0000 7fc4f687f640 1 -- 172.21.15.53:0/1446866974 wait complete. 2024-09-13T18:28:31.520 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:28:31.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.640+0000 7f5679aad640 1 Processor -- start 2024-09-13T18:28:31.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.640+0000 7f5679aad640 1 -- start start 2024-09-13T18:28:31.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5679aad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5674154a40 0x7f567406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5679aad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56740cac00 0x7f56740ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5679aad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f567406cf00 0x7f56740ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5679aad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5674154e20 con 0x7f56740cac00 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5679aad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567406b330 con 0x7f5674154a40 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5679aad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567406b610 con 0x7f567406cf00 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56740cac00 0x7f56740ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56740cac00 0x7f56740ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58284/0 (socket says 172.21.15.53:58284) 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 -- 172.21.15.53:0/557949581 learned_addr learned my addr 172.21.15.53:0/557949581 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f56737fe640 1 --2- 172.21.15.53:0/557949581 >> v2:172.21.15.87:3300/0 conn(0x7f5674154a40 0x7f567406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5673fff640 1 --2- 172.21.15.53:0/557949581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f567406cf00 0x7f56740ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 -- 172.21.15.53:0/557949581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f567406cf00 msgr2=0x7f56740ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 --2- 172.21.15.53:0/557949581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f567406cf00 0x7f56740ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 -- 172.21.15.53:0/557949581 >> v2:172.21.15.87:3300/0 conn(0x7f5674154a40 msgr2=0x7f567406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:31.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 --2- 172.21.15.53:0/557949581 >> v2:172.21.15.87:3300/0 conn(0x7f5674154a40 0x7f567406c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 -- 172.21.15.53:0/557949581 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567406b8f0 con 0x7f56740cac00 2024-09-13T18:28:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.644+0000 7f5672ffd640 1 --2- 172.21.15.53:0/557949581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740ce3e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f567406d620 tx=0x7f566801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47281e72992eb42f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f56727fc640 1 -- 172.21.15.53:0/557949581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680aa610 con 0x7f56740cac00 2024-09-13T18:28:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f56727fc640 1 -- 172.21.15.53:0/557949581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56680a6040 con 0x7f56740cac00 2024-09-13T18:28:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f56727fc640 1 -- 172.21.15.53:0/557949581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680aa990 con 0x7f56740cac00 2024-09-13T18:28:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- 172.21.15.53:0/557949581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 msgr2=0x7f56740ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 --2- 172.21.15.53:0/557949581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740ce3e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f567406d620 tx=0x7f566801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- 172.21.15.53:0/557949581 shutdown_connections 2024-09-13T18:28:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 --2- 172.21.15.53:0/557949581 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f567406cf00 0x7f56740ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 --2- 172.21.15.53:0/557949581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740ce3e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 --2- 172.21.15.53:0/557949581 >> v2:172.21.15.87:3300/0 conn(0x7f5674154a40 0x7f567406c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- 172.21.15.53:0/557949581 >> 172.21.15.53:0/557949581 conn(0x7f5674065e50 msgr2=0x7f5674066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- 172.21.15.53:0/557949581 shutdown_connections 2024-09-13T18:28:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- 172.21.15.53:0/557949581 wait complete. 2024-09-13T18:28:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 Processor -- start 2024-09-13T18:28:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- start start 2024-09-13T18:28:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f567406cf00 0x7f5674142410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5674154a40 0x7f5674152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741542a0 con 0x7f56740cac00 2024-09-13T18:28:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5674141970 con 0x7f567406cf00 2024-09-13T18:28:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567414fd20 con 0x7f5674154a40 2024-09-13T18:28:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58296/0 (socket says 172.21.15.53:58296) 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 -- 172.21.15.53:0/2929244078 learned_addr learned my addr 172.21.15.53:0/2929244078 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f56737fe640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f567406cf00 0x7f5674142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5673fff640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5674154a40 0x7f5674152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 -- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5674154a40 msgr2=0x7f5674152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5674154a40 0x7f5674152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 -- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f567406cf00 msgr2=0x7f5674142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f567406cf00 0x7f5674142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 -- 172.21.15.53:0/2929244078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680094d0 con 0x7f56740cac00 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5672ffd640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740973a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f566801aba0 tx=0x7f566801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f565bfff640 1 -- 172.21.15.53:0/2929244078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680bd5f0 con 0x7f56740cac00 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f565bfff640 1 -- 172.21.15.53:0/2929244078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56680bd750 con 0x7f56740cac00 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5674141c10 con 0x7f56740cac00 2024-09-13T18:28:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f565bfff640 1 -- 172.21.15.53:0/2929244078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680bdb00 con 0x7f56740cac00 2024-09-13T18:28:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.648+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5674150000 con 0x7f56740cac00 2024-09-13T18:28:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.652+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5674142130 con 0x7f56740cac00 2024-09-13T18:28:31.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.652+0000 7f565bfff640 1 -- 172.21.15.53:0/2929244078 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f56680b33f0 con 0x7f56740cac00 2024-09-13T18:28:31.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.652+0000 7f565bfff640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5660066840 0x7f5660068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.652+0000 7f565bfff640 1 -- 172.21.15.53:0/2929244078 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f566811f300 con 0x7f56740cac00 2024-09-13T18:28:31.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.652+0000 7f56737fe640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5660066840 0x7f5660068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.652+0000 7f56737fe640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5660066840 0x7f5660068d00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f56740cdbc0 tx=0x7f5664008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.656+0000 7f565bfff640 1 -- 172.21.15.53:0/2929244078 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56680ec370 con 0x7f56740cac00 2024-09-13T18:28:31.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:31.848+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5674142130 con 0x7f56740cac00 2024-09-13T18:28:32.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-13T18:28:32.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-13T18:28:32.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-13T18:28:32.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.848+0000 7f565bfff640 1 -- 172.21.15.53:0/2929244078 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5674142130 con 0x7f56740cac00 2024-09-13T18:28:32.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5660066840 msgr2=0x7f5660068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5660066840 0x7f5660068d00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f56740cdbc0 tx=0x7f5664008040 comp rx=0 tx=0).stop 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 msgr2=0x7f56740973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740973a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f566801aba0 tx=0x7f566801ad30 comp rx=0 tx=0).stop 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 shutdown_connections 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5660066840 0x7f5660068d00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5674154a40 0x7f5674152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56740cac00 0x7f56740973a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 --2- 172.21.15.53:0/2929244078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f567406cf00 0x7f5674142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 >> 172.21.15.53:0/2929244078 conn(0x7f5674065e50 msgr2=0x7f56740ab1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 shutdown_connections 2024-09-13T18:28:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:32.852+0000 7f5679aad640 1 -- 172.21.15.53:0/2929244078 wait complete. 2024-09-13T18:28:32.882 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:28:32.882 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:28:33.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.008+0000 7fe68e7ef640 1 Processor -- start 2024-09-13T18:28:33.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.008+0000 7fe68e7ef640 1 -- start start 2024-09-13T18:28:33.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe68e7ef640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6880caee0 0x7fe6880cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe68e7ef640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6880cd320 0x7fe6880cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe68e7ef640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68806f7a0 con 0x7fe688143e80 2024-09-13T18:28:33.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe68e7ef640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68806baa0 con 0x7fe6880caee0 2024-09-13T18:28:33.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe68e7ef640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68806fd60 con 0x7fe6880cd320 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe6877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6880caee0 0x7fe6880cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe6877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6880caee0 0x7fe6880cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58300/0 (socket says 172.21.15.53:58300) 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe6877fe640 1 -- 172.21.15.53:0/2565422926 learned_addr learned my addr 172.21.15.53:0/2565422926 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe68cd8c640 1 --2- 172.21.15.53:0/2565422926 >> v2:172.21.15.87:3300/0 conn(0x7fe6880cd320 0x7fe6880cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe6877fe640 1 -- 172.21.15.53:0/2565422926 >> v2:172.21.15.87:3300/0 conn(0x7fe6880cd320 msgr2=0x7fe6880cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe6877fe640 1 --2- 172.21.15.53:0/2565422926 >> v2:172.21.15.87:3300/0 conn(0x7fe6880cd320 0x7fe6880cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe6877fe640 1 -- 172.21.15.53:0/2565422926 >> v1:172.21.15.87:6789/0 conn(0x7fe688143e80 legacy=0x7fe68806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:33.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.012+0000 7fe6877fe640 1 -- 172.21.15.53:0/2565422926 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6880cb960 con 0x7fe6880caee0 2024-09-13T18:28:33.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe6877fe640 1 --2- 172.21.15.53:0/2565422926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe6880cb350 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe670009870 tx=0x7fe67001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185dd0330ca8a263 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:33.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe686ffd640 1 -- 172.21.15.53:0/2565422926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700ab620 con 0x7fe6880caee0 2024-09-13T18:28:33.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe686ffd640 1 -- 172.21.15.53:0/2565422926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6700ab780 con 0x7fe6880caee0 2024-09-13T18:28:33.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe686ffd640 1 -- 172.21.15.53:0/2565422926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700abb10 con 0x7fe6880caee0 2024-09-13T18:28:33.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2565422926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 msgr2=0x7fe6880cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2565422926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe6880cb350 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe670009870 tx=0x7fe67001c420 comp rx=0 tx=0).stop 2024-09-13T18:28:33.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2565422926 shutdown_connections 2024-09-13T18:28:33.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2565422926 >> v2:172.21.15.87:3300/0 conn(0x7fe6880cd320 0x7fe6880cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2565422926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe6880cb350 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2565422926 >> 172.21.15.53:0/2565422926 conn(0x7fe688065c80 msgr2=0x7fe688066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:33.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2565422926 shutdown_connections 2024-09-13T18:28:33.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2565422926 wait complete. 2024-09-13T18:28:33.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 Processor -- start 2024-09-13T18:28:33.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- start start 2024-09-13T18:28:33.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe688140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd320 0x7fe68815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe688143e80 0x7fe68815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880ab270 con 0x7fe6880caee0 2024-09-13T18:28:33.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe688140eb0 con 0x7fe6880cd320 2024-09-13T18:28:33.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.016+0000 7fe68e7ef640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880abd00 con 0x7fe688143e80 2024-09-13T18:28:33.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe6877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd320 0x7fe68815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe687fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe688140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe6877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd320 0x7fe68815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:42362/0 (socket says 172.21.15.53:42362) 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe6877fe640 1 -- 172.21.15.53:0/2266764008 learned_addr learned my addr 172.21.15.53:0/2266764008 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe68cd8c640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe688143e80 0x7fe68815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe687fff640 1 -- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe688143e80 msgr2=0x7fe68815b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe687fff640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe688143e80 0x7fe68815b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe687fff640 1 -- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd320 msgr2=0x7fe68815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe687fff640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd320 0x7fe68815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe687fff640 1 -- 172.21.15.53:0/2266764008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700094d0 con 0x7fe6880caee0 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe687fff640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe688140970 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe67800b410 tx=0x7fe67800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe684ff9640 1 -- 172.21.15.53:0/2266764008 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678004020 con 0x7fe6880caee0 2024-09-13T18:28:33.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe684ff9640 1 -- 172.21.15.53:0/2266764008 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678004180 con 0x7fe6880caee0 2024-09-13T18:28:33.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe684ff9640 1 -- 172.21.15.53:0/2266764008 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678011630 con 0x7fe6880caee0 2024-09-13T18:28:33.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6880abfe0 con 0x7fe6880caee0 2024-09-13T18:28:33.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6880ac5a0 con 0x7fe6880caee0 2024-09-13T18:28:33.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6880cb350 con 0x7fe6880caee0 2024-09-13T18:28:33.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe684ff9640 1 -- 172.21.15.53:0/2266764008 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fe678011790 con 0x7fe6880caee0 2024-09-13T18:28:33.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe684ff9640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe668066840 0x7fe668068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:33.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe684ff9640 1 -- 172.21.15.53:0/2266764008 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe678083fe0 con 0x7fe6880caee0 2024-09-13T18:28:33.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.020+0000 7fe6877fe640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe668066840 0x7fe668068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:33.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.024+0000 7fe6877fe640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe668066840 0x7fe668068d00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe670009870 tx=0x7fe6700b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:33.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.024+0000 7fe684ff9640 1 -- 172.21.15.53:0/2266764008 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe678051180 con 0x7fe6880caee0 2024-09-13T18:28:33.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.212+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe688141140 con 0x7fe6880caee0 2024-09-13T18:28:33.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.852+0000 7fe684ff9640 1 -- 172.21.15.53:0/2266764008 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe6780547a0 con 0x7fe6880caee0 2024-09-13T18:28:33.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe668066840 msgr2=0x7fe668068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe668066840 0x7fe668068d00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe670009870 tx=0x7fe6700b6040 comp rx=0 tx=0).stop 2024-09-13T18:28:33.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 msgr2=0x7fe688140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:33.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe688140970 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe67800b410 tx=0x7fe67800b8d0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 shutdown_connections 2024-09-13T18:28:33.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe668066840 0x7fe668068d00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe688143e80 0x7fe68815b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd320 0x7fe68815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 --2- 172.21.15.53:0/2266764008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6880caee0 0x7fe688140970 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 >> 172.21.15.53:0/2266764008 conn(0x7fe688065c80 msgr2=0x7fe68815bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 shutdown_connections 2024-09-13T18:28:33.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:33.856+0000 7fe68e7ef640 1 -- 172.21.15.53:0/2266764008 wait complete. 2024-09-13T18:28:33.884 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:28:33.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:34.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.004+0000 7fd4f2323640 1 Processor -- start 2024-09-13T18:28:34.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.004+0000 7fd4f2323640 1 -- start start 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f2323640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 0x7fd4ec0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f2323640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec0b1ac0 con 0x7fd4ec0cb980 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f2323640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec159ac0 con 0x7fd4ec06b850 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f2323640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec159da0 con 0x7fd4ec0cbd60 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4ebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd4ec0cb980 0x7fd4ec06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49412/0 (socket says 172.21.15.53:49412) 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4ebfff640 1 -- 172.21.15.53:0/3583864447 learned_addr learned my addr 172.21.15.53:0/3583864447 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f08c0640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 0x7fd4ec0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910951560 0 0) 0x7fd4ec0b1ac0 con 0x7fd4ec0cb980 2024-09-13T18:28:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d4003530 con 0x7fd4ec0cb980 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265257152 0 0) 0x7fd4d4003530 con 0x7fd4ec0cb980 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 msgr2=0x7fd4ec0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 0x7fd4ec0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 >> v1:172.21.15.87:6789/0 conn(0x7fd4ec06b850 legacy=0x7fd4ec0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec15a080 con 0x7fd4ec0cb980 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd4dc001680 con 0x7fd4ec0cb980 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 >> v1:172.21.15.53:6789/0 conn(0x7fd4ec0cb980 legacy=0x7fd4ec06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 0x7fd4d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4d4003ef0 0x7fd4d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4d4004d10 0x7fd4d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec159da0 con 0x7fd4d4004d10 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d400baa0 con 0x7fd4d4003ef0 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d400bc60 con 0x7fd4ec0cbd60 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f08c0640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4d4004d10 0x7fd4d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4eb7fe640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4d4003ef0 0x7fd4d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4ebfff640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 0x7fd4d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f08c0640 1 -- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 msgr2=0x7fd4d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f08c0640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0cbd60 0x7fd4d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f08c0640 1 -- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4d4003ef0 msgr2=0x7fd4d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f08c0640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4d4003ef0 0x7fd4d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.008+0000 7fd4f08c0640 1 -- 172.21.15.53:0/3583864447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d4003530 con 0x7fd4d4004d10 2024-09-13T18:28:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f08c0640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4d4004d10 0x7fd4d4005190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0b38f0 tx=0x7fd4e401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff3ff6d983d823a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40a5c30 con 0x7fd4d4004d10 2024-09-13T18:28:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400f040 con 0x7fd4d4004d10 2024-09-13T18:28:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4eaffd640 1 -- 172.21.15.53:0/3583864447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40ad440 con 0x7fd4d4004d10 2024-09-13T18:28:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- 172.21.15.53:0/3583864447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4d4004d10 msgr2=0x7fd4d4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 --2- 172.21.15.53:0/3583864447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4d4004d10 0x7fd4d4005190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0b38f0 tx=0x7fd4e401cc20 comp rx=0 tx=0).stop 2024-09-13T18:28:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f08c0640 1 -- 172.21.15.53:0/3583864447 reap_dead start 2024-09-13T18:28:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- 172.21.15.53:0/3583864447 shutdown_connections 2024-09-13T18:28:34.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- 172.21.15.53:0/3583864447 >> 172.21.15.53:0/3583864447 conn(0x7fd4ec065c80 msgr2=0x7fd4ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- 172.21.15.53:0/3583864447 shutdown_connections 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- 172.21.15.53:0/3583864447 wait complete. 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 Processor -- start 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- start start 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4ec1431a0 0x7fd4ec06f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec143580 0x7fd4ec06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0ac8e0 0x7fd4ec0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0a8650 con 0x7fd4ec143580 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0a8910 con 0x7fd4ec1431a0 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f2323640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0a8bf0 con 0x7fd4ec0ac8e0 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec143580 0x7fd4ec06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec143580 0x7fd4ec06fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58334/0 (socket says 172.21.15.53:58334) 2024-09-13T18:28:34.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4eb7fe640 1 -- 172.21.15.53:0/1776918044 learned_addr learned my addr 172.21.15.53:0/1776918044 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4ebfff640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4ec1431a0 0x7fd4ec06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.012+0000 7fd4f08c0640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0ac8e0 0x7fd4ec0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4eb7fe640 1 -- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0ac8e0 msgr2=0x7fd4ec0acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4eb7fe640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0ac8e0 0x7fd4ec0acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4eb7fe640 1 -- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4ec1431a0 msgr2=0x7fd4ec06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4eb7fe640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4ec1431a0 0x7fd4ec06f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4eb7fe640 1 -- 172.21.15.53:0/1776918044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0a8ed0 con 0x7fd4ec143580 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4ebfff640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4ec1431a0 0x7fd4ec06f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4eb7fe640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec143580 0x7fd4ec06fb40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0011c60 tx=0x7fd4e000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4e8ff9640 1 -- 172.21.15.53:0/1776918044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000fcb0 con 0x7fd4ec143580 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4e8ff9640 1 -- 172.21.15.53:0/1776918044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000fe10 con 0x7fd4ec143580 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec0ad2a0 con 0x7fd4ec143580 2024-09-13T18:28:34.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4e8ff9640 1 -- 172.21.15.53:0/1776918044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00050d0 con 0x7fd4ec143580 2024-09-13T18:28:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec0b1f00 con 0x7fd4ec143580 2024-09-13T18:28:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec067400 con 0x7fd4ec143580 2024-09-13T18:28:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4e8ff9640 1 -- 172.21.15.53:0/1776918044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd4e0005230 con 0x7fd4ec143580 2024-09-13T18:28:34.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4e8ff9640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd4d8066860 0x7fd4d8068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4e8ff9640 1 -- 172.21.15.53:0/1776918044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4e00876a0 con 0x7fd4ec143580 2024-09-13T18:28:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4ebfff640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd4d8066860 0x7fd4d8068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.016+0000 7fd4ebfff640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd4d8066860 0x7fd4d8068d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc004850 tx=0x7fd4dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.020+0000 7fd4e8ff9640 1 -- 172.21.15.53:0/1776918044 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4e0054790 con 0x7fd4ec143580 2024-09-13T18:28:34.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.216+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4ec159a20 con 0x7fd4ec143580 2024-09-13T18:28:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4e8ff9640 1 -- 172.21.15.53:0/1776918044 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4731 (secure 0 0 0) 0x7fd4e0057db0 con 0x7fd4ec143580 2024-09-13T18:28:34.225 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:34.225 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5396,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1852087146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1852087146},{"type":"v1","addr":"172.21.15.87:6835","nonce":1852087146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1364711247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1364711247},{"type":"v1","addr":"172.21.15.87:6837","nonce":1364711247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/763471722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":763471722},{"type":"v1","addr":"172.21.15.53:6833","nonce":763471722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:30.838100+0000","modified":"2024-09-13T18:28:33.851103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3738594836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3738594836},{"type":"v1","addr":"172.21.15.53:6835","nonce":3738594836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:28:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 31 2024-09-13T18:28:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd4d8066860 msgr2=0x7fd4d8068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd4d8066860 0x7fd4d8068d20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc004850 tx=0x7fd4dc009040 comp rx=0 tx=0).stop 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec143580 msgr2=0x7fd4ec06fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec143580 0x7fd4ec06fb40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0011c60 tx=0x7fd4e000f5a0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 shutdown_connections 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd4d8066860 0x7fd4d8068d20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4ec0ac8e0 0x7fd4ec0acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4ec143580 0x7fd4ec06fb40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 --2- 172.21.15.53:0/1776918044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4ec1431a0 0x7fd4ec06f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 >> 172.21.15.53:0/1776918044 conn(0x7fd4ec065c80 msgr2=0x7fd4ec0ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 shutdown_connections 2024-09-13T18:28:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.220+0000 7fd4f2323640 1 -- 172.21.15.53:0/1776918044 wait complete. 2024-09-13T18:28:34.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3beca42640 1 Processor -- start 2024-09-13T18:28:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3beca42640 1 -- start start 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3beca42640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3be806b850 0x7f3be80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3beca42640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3be80cbd60 0x7f3be80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3beca42640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80b1ac0 con 0x7f3be80cb980 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3beca42640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80b3010 con 0x7f3be80cbd60 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3beca42640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be8159ac0 con 0x7f3be806b850 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3be80cbd60 0x7f3be80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3be80cbd60 0x7f3be80cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58340/0 (socket says 172.21.15.53:58340) 2024-09-13T18:28:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be6d9d640 1 -- 172.21.15.53:0/23106816 learned_addr learned my addr 172.21.15.53:0/23106816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be5d9b640 1 --2- 172.21.15.53:0/23106816 >> v2:172.21.15.87:3300/0 conn(0x7f3be806b850 0x7f3be80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be6d9d640 1 -- 172.21.15.53:0/23106816 >> v2:172.21.15.87:3300/0 conn(0x7f3be806b850 msgr2=0x7f3be80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be6d9d640 1 --2- 172.21.15.53:0/23106816 >> v2:172.21.15.87:3300/0 conn(0x7f3be806b850 0x7f3be80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be6d9d640 1 -- 172.21.15.53:0/23106816 >> v1:172.21.15.87:6789/0 conn(0x7f3be80cb980 legacy=0x7f3be806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.364+0000 7f3be6d9d640 1 -- 172.21.15.53:0/23106816 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8159da0 con 0x7f3be80cbd60 2024-09-13T18:28:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 --2- 172.21.15.53:0/23106816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be80cdd40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3be80709a0 tx=0x7f3be001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b15ee616d5526e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be559a640 1 -- 172.21.15.53:0/23106816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00a5760 con 0x7f3be80cbd60 2024-09-13T18:28:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be559a640 1 -- 172.21.15.53:0/23106816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00a58c0 con 0x7f3be80cbd60 2024-09-13T18:28:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be559a640 1 -- 172.21.15.53:0/23106816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00a5c50 con 0x7f3be80cbd60 2024-09-13T18:28:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- 172.21.15.53:0/23106816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 msgr2=0x7f3be80cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 --2- 172.21.15.53:0/23106816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be80cdd40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3be80709a0 tx=0x7f3be001c8a0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- 172.21.15.53:0/23106816 shutdown_connections 2024-09-13T18:28:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 --2- 172.21.15.53:0/23106816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be80cdd40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 --2- 172.21.15.53:0/23106816 >> v2:172.21.15.87:3300/0 conn(0x7f3be806b850 0x7f3be80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- 172.21.15.53:0/23106816 >> 172.21.15.53:0/23106816 conn(0x7f3be8065c80 msgr2=0x7f3be8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- 172.21.15.53:0/23106816 shutdown_connections 2024-09-13T18:28:34.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- 172.21.15.53:0/23106816 wait complete. 2024-09-13T18:28:34.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 Processor -- start 2024-09-13T18:28:34.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- start start 2024-09-13T18:28:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3be806b850 0x7f3be8148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3be80cb980 0x7f3be813fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be8165020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8147f20 con 0x7f3be80cbd60 2024-09-13T18:28:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8148200 con 0x7f3be806b850 2024-09-13T18:28:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3beca42640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81484e0 con 0x7f3be80cb980 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be8165020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be8165020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58352/0 (socket says 172.21.15.53:58352) 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 -- 172.21.15.53:0/795760246 learned_addr learned my addr 172.21.15.53:0/795760246 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be659c640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3be806b850 0x7f3be8148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be5d9b640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3be80cb980 0x7f3be813fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 -- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3be80cb980 msgr2=0x7f3be813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3be80cb980 0x7f3be813fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 -- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3be806b850 msgr2=0x7f3be8148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3be806b850 0x7f3be8148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 -- 172.21.15.53:0/795760246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0009b30 con 0x7f3be80cbd60 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be5d9b640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3be80cb980 0x7f3be813fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3be6d9d640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be8165020 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3be00af040 tx=0x7f3be0019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3bdeffd640 1 -- 172.21.15.53:0/795760246 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00b8670 con 0x7f3be80cbd60 2024-09-13T18:28:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3bdeffd640 1 -- 172.21.15.53:0/795760246 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00b87d0 con 0x7f3be80cbd60 2024-09-13T18:28:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.368+0000 7f3bdeffd640 1 -- 172.21.15.53:0/795760246 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00b8b60 con 0x7f3be80cbd60 2024-09-13T18:28:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be81487c0 con 0x7f3be80cbd60 2024-09-13T18:28:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be8140530 con 0x7f3be80cbd60 2024-09-13T18:28:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be8149500 con 0x7f3be80cbd60 2024-09-13T18:28:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3bdeffd640 1 -- 172.21.15.53:0/795760246 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f3be00b8cc0 con 0x7f3be80cbd60 2024-09-13T18:28:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3bdeffd640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3bc8066840 0x7f3bc8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3bdeffd640 1 -- 172.21.15.53:0/795760246 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3be011fb40 con 0x7f3be80cbd60 2024-09-13T18:28:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3be659c640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3bc8066840 0x7f3bc8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.372+0000 7f3be659c640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3bc8066840 0x7f3bc8068d00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8000f70 tx=0x7f3bd8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.376+0000 7f3bdeffd640 1 -- 172.21.15.53:0/795760246 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3be00ecc50 con 0x7f3be80cbd60 2024-09-13T18:28:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.532+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3be8067400 con 0x7f3be80cbd60 2024-09-13T18:28:34.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3bdeffd640 1 -- 172.21.15.53:0/795760246 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f3be00f0270 con 0x7f3be80cbd60 2024-09-13T18:28:34.541 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:34.541 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:31.841305+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3bc8066840 msgr2=0x7f3bc8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3bc8066840 0x7f3bc8068d00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8000f70 tx=0x7f3bd8009040 comp rx=0 tx=0).stop 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 msgr2=0x7f3be8165020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be8165020 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3be00af040 tx=0x7f3be0019640 comp rx=0 tx=0).stop 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 shutdown_connections 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3bc8066840 0x7f3bc8068d00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3be80cb980 0x7f3be813fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be80cbd60 0x7f3be8165020 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 --2- 172.21.15.53:0/795760246 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3be806b850 0x7f3be8148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 >> 172.21.15.53:0/795760246 conn(0x7f3be8065c80 msgr2=0x7f3be8066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 shutdown_connections 2024-09-13T18:28:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.536+0000 7f3beca42640 1 -- 172.21.15.53:0/795760246 wait complete. 2024-09-13T18:28:34.559 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:28:34.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:34.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6c875640 1 Processor -- start 2024-09-13T18:28:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6c875640 1 -- start start 2024-09-13T18:28:34.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6c875640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7a680cb980 0x7f7a680b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6c875640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a680cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6c875640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a680b1ac0 con 0x7f7a6806b850 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6c875640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a680b3010 con 0x7f7a680cb980 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6c875640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68159ac0 con 0x7f7a680cbd60 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a65d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7a6806b850 0x7f7a6806fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49422/0 (socket says 172.21.15.53:49422) 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a65d9b640 1 -- 172.21.15.53:0/2350410416 learned_addr learned my addr 172.21.15.53:0/2350410416 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6659c640 1 --2- 172.21.15.53:0/2350410416 >> v2:172.21.15.87:3300/0 conn(0x7f7a680cb980 0x7f7a680b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a66d9d640 1 --2- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a680cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6559a640 1 -- 172.21.15.53:0/2350410416 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738246252 0 0) 0x7f7a680b1ac0 con 0x7f7a6806b850 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6559a640 1 -- 172.21.15.53:0/2350410416 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a50003530 con 0x7f7a6806b850 2024-09-13T18:28:34.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6659c640 1 -- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 msgr2=0x7f7a680cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6659c640 1 --2- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a680cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6659c640 1 -- 172.21.15.53:0/2350410416 >> v1:172.21.15.53:6789/0 conn(0x7f7a6806b850 legacy=0x7f7a6806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6559a640 1 -- 172.21.15.53:0/2350410416 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646807210 0 0) 0x7f7a50003530 con 0x7f7a6806b850 2024-09-13T18:28:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.668+0000 7f7a6659c640 1 -- 172.21.15.53:0/2350410416 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a68159da0 con 0x7f7a680cb980 2024-09-13T18:28:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6659c640 1 --2- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a680cb980 0x7f7a680b33b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097c0 tx=0x7f7a5801c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d7eb67fbe055571 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6559a640 1 -- 172.21.15.53:0/2350410416 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c001680 con 0x7f7a680cb980 2024-09-13T18:28:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6559a640 1 -- 172.21.15.53:0/2350410416 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a580a7050 con 0x7f7a680cb980 2024-09-13T18:28:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6559a640 1 -- 172.21.15.53:0/2350410416 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a580ab600 con 0x7f7a680cb980 2024-09-13T18:28:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 -- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a680cb980 msgr2=0x7f7a680b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a680cb980 0x7f7a680b33b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097c0 tx=0x7f7a5801c300 comp rx=0 tx=0).stop 2024-09-13T18:28:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 -- 172.21.15.53:0/2350410416 shutdown_connections 2024-09-13T18:28:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a680cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2350410416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a680cb980 0x7f7a680b33b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 -- 172.21.15.53:0/2350410416 >> 172.21.15.53:0/2350410416 conn(0x7f7a68065c80 msgr2=0x7f7a68066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 -- 172.21.15.53:0/2350410416 shutdown_connections 2024-09-13T18:28:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 -- 172.21.15.53:0/2350410416 wait complete. 2024-09-13T18:28:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 Processor -- start 2024-09-13T18:28:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.672+0000 7f7a6c875640 1 -- start start 2024-09-13T18:28:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a6806b850 0x7f7a6815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a680cb980 0x7f7a680ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a6815d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a681f8d80 con 0x7f7a680cb980 2024-09-13T18:28:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a68143450 con 0x7f7a6806b850 2024-09-13T18:28:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a681f8170 con 0x7f7a680cbd60 2024-09-13T18:28:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a680cb980 0x7f7a680ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a680cb980 0x7f7a680ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58354/0 (socket says 172.21.15.53:58354) 2024-09-13T18:28:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 -- 172.21.15.53:0/2396997323 learned_addr learned my addr 172.21.15.53:0/2396997323 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6659c640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a6806b850 0x7f7a6815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a66d9d640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a6815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 -- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 msgr2=0x7f7a6815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a6815d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 -- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a6806b850 msgr2=0x7f7a6815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a6806b850 0x7f7a6815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 -- 172.21.15.53:0/2396997323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58009420 con 0x7f7a680cb980 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a66d9d640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a6815d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a65d9b640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a680cb980 0x7f7a680ae420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c780 tx=0x7f7a5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a56ffd640 1 -- 172.21.15.53:0/2396997323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c005ae0 con 0x7f7a680cb980 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a56ffd640 1 -- 172.21.15.53:0/2396997323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c005c40 con 0x7f7a680cb980 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a681f8450 con 0x7f7a680cb980 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a56ffd640 1 -- 172.21.15.53:0/2396997323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c007070 con 0x7f7a680cb980 2024-09-13T18:28:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a681f8a10 con 0x7f7a680cb980 2024-09-13T18:28:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a68067400 con 0x7f7a680cb980 2024-09-13T18:28:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a56ffd640 1 -- 172.21.15.53:0/2396997323 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f7a5c0071f0 con 0x7f7a680cb980 2024-09-13T18:28:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a56ffd640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7a48066840 0x7f7a48068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a56ffd640 1 -- 172.21.15.53:0/2396997323 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a5c0841d0 con 0x7f7a680cb980 2024-09-13T18:28:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.676+0000 7f7a6659c640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7a48066840 0x7f7a48068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.680+0000 7f7a6659c640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7a48066840 0x7f7a48068d00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7a580ad000 tx=0x7f7a580a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.680+0000 7f7a56ffd640 1 -- 172.21.15.53:0/2396997323 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a5c0512c0 con 0x7f7a680cb980 2024-09-13T18:28:34.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.836+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a680b2be0 con 0x7f7a48066840 2024-09-13T18:28:34.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a56ffd640 1 -- 172.21.15.53:0/2396997323 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276856 (secure 0 0 0) 0x7f7a680b2be0 con 0x7f7a48066840 2024-09-13T18:28:34.867 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:34.869 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7a48066840 msgr2=0x7f7a48068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7a48066840 0x7f7a48068d00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7a580ad000 tx=0x7f7a580a6000 comp rx=0 tx=0).stop 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a680cb980 msgr2=0x7f7a680ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a680cb980 0x7f7a680ae420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c780 tx=0x7f7a5c00cc40 comp rx=0 tx=0).stop 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 shutdown_connections 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7a48066840 0x7f7a48068d00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a680cbd60 0x7f7a6815d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a680cb980 0x7f7a680ae420 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 --2- 172.21.15.53:0/2396997323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a6806b850 0x7f7a6815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 >> 172.21.15.53:0/2396997323 conn(0x7f7a68065c80 msgr2=0x7f7a680b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 shutdown_connections 2024-09-13T18:28:34.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:34.860+0000 7f7a6c875640 1 -- 172.21.15.53:0/2396997323 wait complete. 2024-09-13T18:28:34.884 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-13T18:28:32.974044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":255428,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719292,"statfs":{"total":773094113280,"available":772832555008,"internally_reserved":0,"allocated":6647808,"data_stored":3428591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001023"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439674+0000","last_change":"2024-09-13T18:28:29.439674+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439674+0000","last_undegraded":"2024-09-13T18:28:29.439674+0000","last_fullsized":"2024-09-13T18:28:29.439674+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438633+0000","last_change":"2024-09-13T18:28:29.438633+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438633+0000","last_undegraded":"2024-09-13T18:28:29.438633+0000","last_fullsized":"2024-09-13T18:28:29.438633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:56.284668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440545+0000","last_change":"2024-09-13T18:28:29.440545+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440545+0000","last_undegraded":"2024-09-13T18:28:29.440545+0000","last_fullsized":"2024-09-13T18:28:29.440545+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440484+0000","last_change":"2024-09-13T18:28:29.440484+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440484+0000","last_undegraded":"2024-09-13T18:28:29.440484+0000","last_fullsized":"2024-09-13T18:28:29.440484+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:01.316915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436397+0000","last_change":"2024-09-13T18:28:29.436397+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436397+0000","last_undegraded":"2024-09-13T18:28:29.436397+0000","last_fullsized":"2024-09-13T18:28:29.436397+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439961+0000","last_change":"2024-09-13T18:28:29.439961+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439961+0000","last_undegraded":"2024-09-13T18:28:29.439961+0000","last_fullsized":"2024-09-13T18:28:29.439961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441339+0000","last_change":"2024-09-13T18:28:29.441339+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441339+0000","last_undegraded":"2024-09-13T18:28:29.441339+0000","last_fullsized":"2024-09-13T18:28:29.441339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436465+0000","last_change":"2024-09-13T18:28:29.436465+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436465+0000","last_undegraded":"2024-09-13T18:28:29.436465+0000","last_fullsized":"2024-09-13T18:28:29.436465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445190+0000","last_change":"2024-09-13T18:28:29.445190+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445190+0000","last_undegraded":"2024-09-13T18:28:29.445190+0000","last_fullsized":"2024-09-13T18:28:29.445190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438010+0000","last_change":"2024-09-13T18:28:29.438010+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438010+0000","last_undegraded":"2024-09-13T18:28:29.438010+0000","last_fullsized":"2024-09-13T18:28:29.438010+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:17.208941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445146+0000","last_change":"2024-09-13T18:28:29.445146+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445146+0000","last_undegraded":"2024-09-13T18:28:29.445146+0000","last_fullsized":"2024-09-13T18:28:29.445146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436566+0000","last_change":"2024-09-13T18:28:29.436566+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436566+0000","last_undegraded":"2024-09-13T18:28:29.436566+0000","last_fullsized":"2024-09-13T18:28:29.436566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439618+0000","last_change":"2024-09-13T18:28:29.439618+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439618+0000","last_undegraded":"2024-09-13T18:28:29.439618+0000","last_fullsized":"2024-09-13T18:28:29.439618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:58.957985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446040+0000","last_change":"2024-09-13T18:28:29.446040+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446040+0000","last_undegraded":"2024-09-13T18:28:29.446040+0000","last_fullsized":"2024-09-13T18:28:29.446040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438784+0000","last_change":"2024-09-13T18:28:29.438784+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438784+0000","last_undegraded":"2024-09-13T18:28:29.438784+0000","last_fullsized":"2024-09-13T18:28:29.438784+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:03.613090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445348+0000","last_change":"2024-09-13T18:28:29.445348+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445348+0000","last_undegraded":"2024-09-13T18:28:29.445348+0000","last_fullsized":"2024-09-13T18:28:29.445348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438127+0000","last_change":"2024-09-13T18:28:29.438127+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438127+0000","last_undegraded":"2024-09-13T18:28:29.438127+0000","last_fullsized":"2024-09-13T18:28:29.438127+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:49.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441114+0000","last_change":"2024-09-13T18:28:29.441114+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441114+0000","last_undegraded":"2024-09-13T18:28:29.441114+0000","last_fullsized":"2024-09-13T18:28:29.441114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438896+0000","last_change":"2024-09-13T18:28:29.438896+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438896+0000","last_undegraded":"2024-09-13T18:28:29.438896+0000","last_fullsized":"2024-09-13T18:28:29.438896+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:17.107893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441109+0000","last_change":"2024-09-13T18:28:29.441109+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441109+0000","last_undegraded":"2024-09-13T18:28:29.441109+0000","last_fullsized":"2024-09-13T18:28:29.441109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.437909+0000","last_change":"2024-09-13T18:28:29.437909+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.437909+0000","last_undegraded":"2024-09-13T18:28:29.437909+0000","last_fullsized":"2024-09-13T18:28:29.437909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:58.095328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434925+0000","last_change":"2024-09-13T18:28:29.434925+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434925+0000","last_undegraded":"2024-09-13T18:28:29.434925+0000","last_fullsized":"2024-09-13T18:28:29.434925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439026+0000","last_change":"2024-09-13T18:28:29.439026+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439026+0000","last_undegraded":"2024-09-13T18:28:29.439026+0000","last_fullsized":"2024-09-13T18:28:29.439026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434225+0000","last_change":"2024-09-13T18:28:29.434225+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434225+0000","last_undegraded":"2024-09-13T18:28:29.434225+0000","last_fullsized":"2024-09-13T18:28:29.434225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.232562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440516+0000","last_change":"2024-09-13T18:28:29.440516+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440516+0000","last_undegraded":"2024-09-13T18:28:29.440516+0000","last_fullsized":"2024-09-13T18:28:29.440516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446072+0000","last_change":"2024-09-13T18:28:29.446072+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446072+0000","last_undegraded":"2024-09-13T18:28:29.446072+0000","last_fullsized":"2024-09-13T18:28:29.446072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438821+0000","last_change":"2024-09-13T18:28:29.438821+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438821+0000","last_undegraded":"2024-09-13T18:28:29.438821+0000","last_fullsized":"2024-09-13T18:28:29.438821+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434027+0000","last_change":"2024-09-13T18:28:29.434027+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434027+0000","last_undegraded":"2024-09-13T18:28:29.434027+0000","last_fullsized":"2024-09-13T18:28:29.434027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436394+0000","last_change":"2024-09-13T18:28:29.436394+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436394+0000","last_undegraded":"2024-09-13T18:28:29.436394+0000","last_fullsized":"2024-09-13T18:28:29.436394+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.435073+0000","last_change":"2024-09-13T18:28:29.435073+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.435073+0000","last_undegraded":"2024-09-13T18:28:29.435073+0000","last_fullsized":"2024-09-13T18:28:29.435073+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:49.247597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438697+0000","last_change":"2024-09-13T18:28:29.438697+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438697+0000","last_undegraded":"2024-09-13T18:28:29.438697+0000","last_fullsized":"2024-09-13T18:28:29.438697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:11.595273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445708+0000","last_change":"2024-09-13T18:28:29.445708+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445708+0000","last_undegraded":"2024-09-13T18:28:29.445708+0000","last_fullsized":"2024-09-13T18:28:29.445708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.604812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:28:27.501415+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:28:27.501415+0000","last_peered":"2024-09-13T18:28:27.501415+0000","last_clean":"2024-09-13T18:28:27.501415+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:28:27.501415+0000","last_undegraded":"2024-09-13T18:28:27.501415+0000","last_fullsized":"2024-09-13T18:28:27.501415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.90800000000000003,"15min":0.876},"min":{"1min":0.77500000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.21,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.51200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.198,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.69399999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.095,"5min":1.448,"15min":1.448},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.93400000000000005,"15min":0.90600000000000003},"min":{"1min":0.75900000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90200000000000002,"15min":0.89300000000000002},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.1899999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.95399999999999996,"15min":0.94499999999999995},"min":{"1min":0.68799999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.056,"15min":1.0549999999999999},"min":{"1min":0.77800000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5609999999999999,"5min":1.877,"15min":1.877},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.996,"15min":0.97799999999999998},"min":{"1min":0.66600000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.069,"15min":1.0629999999999999},"min":{"1min":0.82299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3169999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.095,"5min":1.022,"15min":0.99199999999999999},"min":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.82899999999999996,"15min":0.83599999999999997},"min":{"1min":0.58799999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.198,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.80800000000000005,"15min":0.78200000000000003},"min":{"1min":0.60399999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.252,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1819999999999999,"5min":1.577,"15min":1.577},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.81200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.464,"15min":1.464},"last":1.0009999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.268,"15min":1.268},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.77600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2110000000000001,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.60999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89000000000000001,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.306,"15min":1.306},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98099999999999998,"15min":0.98699999999999999},"min":{"1min":0.64400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3149999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0109999999999999,"15min":0.995},"min":{"1min":0.76900000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.23,"5min":1.526,"15min":1.526},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.65900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.137,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.76400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3089999999999999,"5min":2.762,"15min":2.762},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0269999999999999,"15min":1.0429999999999999},"min":{"1min":0.65300000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.339,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.034,"15min":1.046},"min":{"1min":0.72599999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1579999999999999,"5min":1.72,"15min":1.72},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1659999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.90600000000000003,"15min":0.91600000000000004},"min":{"1min":0.60499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.84999999999999998,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.22,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82399999999999995},"min":{"1min":0.625,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.05,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1220000000000001,"5min":1.167,"15min":1.167},"last":1.087},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.96699999999999997,"15min":0.98199999999999998},"min":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2609999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.70299999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.0820000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.72599999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.181,"5min":1.871,"15min":1.871},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94299999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3029999999999999,"5min":1.413,"15min":1.413},"last":1.054},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.65100000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.24,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.012,"15min":1.0389999999999999},"min":{"1min":0.64700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0109999999999999,"15min":1.042},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1850000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0920000000000001,"15min":1.1339999999999999},"min":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.216,"5min":2.246,"15min":2.246},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2749999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.96299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.81599999999999995,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.133,"5min":1.252,"15min":1.252},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.177,"5min":1.256,"15min":1.256},"last":1.0840000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.64600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2170000000000001,"5min":1.329,"15min":1.329},"last":1.143},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88600000000000001,"15min":0.872},"min":{"1min":0.754,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1060000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.89700000000000002,"15min":0.89200000000000002},"min":{"1min":0.71799999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.171}]},{"osd":3,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.091,"5min":1.222,"15min":1.222},"last":0.871},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.74399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1459999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1240000000000001,"5min":1.298,"15min":1.298},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.252,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98999999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.129,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.012,"15min":1.024},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.377,"15min":1.377},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.048,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.26,"5min":1.482,"15min":1.482},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.0840000000000001},"min":{"1min":0.79600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.284,"5min":1.466,"15min":1.466},"last":1.0569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0349999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73199999999999998,"15min":0.69999999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.069,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.704,"15min":1.704},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94599999999999995,"5min":1.647,"15min":1.647},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75800000000000001,"15min":0.72899999999999998},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":1.399,"15min":1.399},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.76300000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.075,"5min":1.446,"15min":1.446},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1060000000000001,"15min":1.1339999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2909999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.996}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.034,"15min":1.026},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2529999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.93200000000000005},"min":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1830000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.375,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0509999999999999},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3129999999999999,"5min":1.96,"15min":1.96},"last":1.115}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.109},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4550000000000001,"5min":3,"15min":3},"last":0.624},{"interface":"front","average":{"1min":1.004,"5min":1.0009999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.258,"5min":1.702,"15min":1.702},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.98999999999999999,"5min":1.335,"15min":1.335},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.47199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.423,"15min":1.423},"last":0.437}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1830000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.194,"5min":1.274,"15min":1.274},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3240000000000001,"5min":1.611,"15min":1.611},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.179,"5min":1.492,"15min":1.492},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3140000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3680000000000001,"5min":1.702,"15min":1.702},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95899999999999996,"15min":0.95599999999999996},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2410000000000001,"5min":1.54,"15min":1.54},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2909999999999999,"5min":1.452,"15min":1.452},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.333,"5min":1.657,"15min":1.657},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.157,"5min":1.097,"15min":1.091},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4119999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.177,"15min":1.177},"last":0.89800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0389999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.03,"5min":1.117,"15min":1.117},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.72899999999999998,"15min":0.71899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1240000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.99099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.91900000000000004,"15min":0.90400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.248,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.127},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92300000000000004},"min":{"1min":0.64900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.284,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.056}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2190000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.88},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.01,"15min":1.0269999999999999},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1839999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.276}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.359,"5min":1.653,"15min":1.653},"last":1.224},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.64700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5580000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.66200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.3660000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36460,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335380,"statfs":{"total":96636764160,"available":96599429120,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.98299999999999998,"5min":1.147,"15min":1.147},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.085,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64600000000000002,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91400000000000003,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.153,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1200000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1970000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.071},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.996,"15min":0.998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.252,"5min":1.986,"15min":1.986},"last":1}]},{"osd":5,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.014},"min":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.357,"5min":2.641,"15min":2.641},"last":1.115},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3320000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.097}]},{"osd":6,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.083,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2769999999999999,"5min":1.891,"15min":1.891},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2310000000000001,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3160000000000001,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.1160000000000001,"15min":1.1060000000000001},"min":{"1min":0.79300000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.45,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.167}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:34.890 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:35.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf64c11640 1 Processor -- start 2024-09-13T18:28:35.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf64c11640 1 -- start start 2024-09-13T18:28:35.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf64c11640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbf601582a0 0x7fbf6006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf64c11640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6006d480 con 0x7fbf600713a0 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf64c11640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6015ace0 con 0x7fbf6015b7c0 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf64c11640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6015aaf0 con 0x7fbf601582a0 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbf601582a0 0x7fbf6006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbf600713a0 0x7fbf601640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49426/0 (socket says 172.21.15.53:49426) 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5ed9d640 1 -- 172.21.15.53:0/2889718533 learned_addr learned my addr 172.21.15.53:0/2889718533 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5e59c640 1 -- 172.21.15.53:0/2889718533 >> v1:172.21.15.87:6789/0 conn(0x7fbf6015b7c0 legacy=0x7fbf60070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5e59c640 1 -- 172.21.15.53:0/2889718533 >> v1:172.21.15.53:6789/0 conn(0x7fbf600713a0 legacy=0x7fbf601640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5e59c640 1 -- 172.21.15.53:0/2889718533 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6015afc0 con 0x7fbf601582a0 2024-09-13T18:28:35.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5d59a640 1 -- 172.21.15.53:0/2889718533 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801803306 0 0) 0x7fbf6006d480 con 0x7fbf600713a0 2024-09-13T18:28:35.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.048+0000 7fbf5e59c640 1 --2- 172.21.15.53:0/2889718533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf601582a0 0x7fbf6006c900 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbf500097c0 tx=0x7fbf5001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a328b7f27fe8f826 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5d59a640 1 -- 172.21.15.53:0/2889718533 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500ab600 con 0x7fbf601582a0 2024-09-13T18:28:35.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5d59a640 1 -- 172.21.15.53:0/2889718533 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf500a7050 con 0x7fbf601582a0 2024-09-13T18:28:35.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5d59a640 1 -- 172.21.15.53:0/2889718533 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500ab980 con 0x7fbf601582a0 2024-09-13T18:28:35.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- 172.21.15.53:0/2889718533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf601582a0 msgr2=0x7fbf6006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 --2- 172.21.15.53:0/2889718533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf601582a0 0x7fbf6006c900 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbf500097c0 tx=0x7fbf5001c460 comp rx=0 tx=0).stop 2024-09-13T18:28:35.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- 172.21.15.53:0/2889718533 shutdown_connections 2024-09-13T18:28:35.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 --2- 172.21.15.53:0/2889718533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf601582a0 0x7fbf6006c900 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- 172.21.15.53:0/2889718533 >> 172.21.15.53:0/2889718533 conn(0x7fbf60065c80 msgr2=0x7fbf60066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- 172.21.15.53:0/2889718533 shutdown_connections 2024-09-13T18:28:35.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- 172.21.15.53:0/2889718533 wait complete. 2024-09-13T18:28:35.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 Processor -- start 2024-09-13T18:28:35.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- start start 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf600713a0 0x7fbf601532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf601582a0 0x7fbf601490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf6015b7c0 0x7fbf601448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600b1520 con 0x7fbf600713a0 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601495f0 con 0x7fbf6015b7c0 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6014a2d0 con 0x7fbf601582a0 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf600713a0 0x7fbf601532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf600713a0 0x7fbf601532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58384/0 (socket says 172.21.15.53:58384) 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 -- 172.21.15.53:0/3488309163 learned_addr learned my addr 172.21.15.53:0/3488309163 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:35.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5ed9d640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf6015b7c0 0x7fbf601448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 -- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf601582a0 msgr2=0x7fbf601490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf601582a0 0x7fbf601490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 -- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf6015b7c0 msgr2=0x7fbf601448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf6015b7c0 0x7fbf601448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 -- 172.21.15.53:0/3488309163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50009420 con 0x7fbf600713a0 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5ed9d640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf6015b7c0 0x7fbf601448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf5e59c640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf600713a0 0x7fbf601532e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009710 tx=0x7fbf5001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf56ffd640 1 -- 172.21.15.53:0/3488309163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500b7650 con 0x7fbf600713a0 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf56ffd640 1 -- 172.21.15.53:0/3488309163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf500b77b0 con 0x7fbf600713a0 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf600b1a70 con 0x7fbf600713a0 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf56ffd640 1 -- 172.21.15.53:0/3488309163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500b7b60 con 0x7fbf600713a0 2024-09-13T18:28:35.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.052+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf60153c80 con 0x7fbf600713a0 2024-09-13T18:28:35.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.056+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf60067400 con 0x7fbf600713a0 2024-09-13T18:28:35.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.056+0000 7fbf56ffd640 1 -- 172.21.15.53:0/3488309163 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fbf500b7cc0 con 0x7fbf600713a0 2024-09-13T18:28:35.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.056+0000 7fbf56ffd640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbf40066840 0x7fbf40068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.056+0000 7fbf56ffd640 1 -- 172.21.15.53:0/3488309163 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf5011f1d0 con 0x7fbf600713a0 2024-09-13T18:28:35.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.056+0000 7fbf5dd9b640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbf40066840 0x7fbf40068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.056+0000 7fbf5dd9b640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbf40066840 0x7fbf40068d00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbf601f9370 tx=0x7fbf48009230 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.060+0000 7fbf56ffd640 1 -- 172.21.15.53:0/3488309163 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf500ec3b0 con 0x7fbf600713a0 2024-09-13T18:28:35.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.208+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf600cd8f0 con 0x7fbf40066840 2024-09-13T18:28:35.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf56ffd640 1 -- 172.21.15.53:0/3488309163 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276856 (secure 0 0 0) 0x7fbf600cd8f0 con 0x7fbf40066840 2024-09-13T18:28:35.237 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:35.239 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:28:35.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbf40066840 msgr2=0x7fbf40068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbf40066840 0x7fbf40068d00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbf601f9370 tx=0x7fbf48009230 comp rx=0 tx=0).stop 2024-09-13T18:28:35.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf600713a0 msgr2=0x7fbf601532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf600713a0 0x7fbf601532e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009710 tx=0x7fbf5001aca0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 shutdown_connections 2024-09-13T18:28:35.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fbf40066840 0x7fbf40068d00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbf601582a0 0x7fbf601490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf6015b7c0 0x7fbf601448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 --2- 172.21.15.53:0/3488309163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbf600713a0 0x7fbf601532e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 >> 172.21.15.53:0/3488309163 conn(0x7fbf60065c80 msgr2=0x7fbf600af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 shutdown_connections 2024-09-13T18:28:35.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.232+0000 7fbf64c11640 1 -- 172.21.15.53:0/3488309163 wait complete. 2024-09-13T18:28:35.254 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-13T18:28:34.974615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":255428,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719292,"statfs":{"total":773094113280,"available":772832555008,"internally_reserved":0,"allocated":6647808,"data_stored":3428591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.542106"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439674+0000","last_change":"2024-09-13T18:28:29.439674+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439674+0000","last_undegraded":"2024-09-13T18:28:29.439674+0000","last_fullsized":"2024-09-13T18:28:29.439674+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438633+0000","last_change":"2024-09-13T18:28:29.438633+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438633+0000","last_undegraded":"2024-09-13T18:28:29.438633+0000","last_fullsized":"2024-09-13T18:28:29.438633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:56.284668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440545+0000","last_change":"2024-09-13T18:28:29.440545+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440545+0000","last_undegraded":"2024-09-13T18:28:29.440545+0000","last_fullsized":"2024-09-13T18:28:29.440545+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440484+0000","last_change":"2024-09-13T18:28:29.440484+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440484+0000","last_undegraded":"2024-09-13T18:28:29.440484+0000","last_fullsized":"2024-09-13T18:28:29.440484+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:01.316915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436397+0000","last_change":"2024-09-13T18:28:29.436397+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436397+0000","last_undegraded":"2024-09-13T18:28:29.436397+0000","last_fullsized":"2024-09-13T18:28:29.436397+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439961+0000","last_change":"2024-09-13T18:28:29.439961+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439961+0000","last_undegraded":"2024-09-13T18:28:29.439961+0000","last_fullsized":"2024-09-13T18:28:29.439961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441339+0000","last_change":"2024-09-13T18:28:29.441339+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441339+0000","last_undegraded":"2024-09-13T18:28:29.441339+0000","last_fullsized":"2024-09-13T18:28:29.441339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436465+0000","last_change":"2024-09-13T18:28:29.436465+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436465+0000","last_undegraded":"2024-09-13T18:28:29.436465+0000","last_fullsized":"2024-09-13T18:28:29.436465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445190+0000","last_change":"2024-09-13T18:28:29.445190+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445190+0000","last_undegraded":"2024-09-13T18:28:29.445190+0000","last_fullsized":"2024-09-13T18:28:29.445190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438010+0000","last_change":"2024-09-13T18:28:29.438010+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438010+0000","last_undegraded":"2024-09-13T18:28:29.438010+0000","last_fullsized":"2024-09-13T18:28:29.438010+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:17.208941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445146+0000","last_change":"2024-09-13T18:28:29.445146+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445146+0000","last_undegraded":"2024-09-13T18:28:29.445146+0000","last_fullsized":"2024-09-13T18:28:29.445146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436566+0000","last_change":"2024-09-13T18:28:29.436566+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436566+0000","last_undegraded":"2024-09-13T18:28:29.436566+0000","last_fullsized":"2024-09-13T18:28:29.436566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439618+0000","last_change":"2024-09-13T18:28:29.439618+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439618+0000","last_undegraded":"2024-09-13T18:28:29.439618+0000","last_fullsized":"2024-09-13T18:28:29.439618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:58.957985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446040+0000","last_change":"2024-09-13T18:28:29.446040+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446040+0000","last_undegraded":"2024-09-13T18:28:29.446040+0000","last_fullsized":"2024-09-13T18:28:29.446040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438784+0000","last_change":"2024-09-13T18:28:29.438784+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438784+0000","last_undegraded":"2024-09-13T18:28:29.438784+0000","last_fullsized":"2024-09-13T18:28:29.438784+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:03.613090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445348+0000","last_change":"2024-09-13T18:28:29.445348+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445348+0000","last_undegraded":"2024-09-13T18:28:29.445348+0000","last_fullsized":"2024-09-13T18:28:29.445348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438127+0000","last_change":"2024-09-13T18:28:29.438127+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438127+0000","last_undegraded":"2024-09-13T18:28:29.438127+0000","last_fullsized":"2024-09-13T18:28:29.438127+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:49.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441114+0000","last_change":"2024-09-13T18:28:29.441114+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441114+0000","last_undegraded":"2024-09-13T18:28:29.441114+0000","last_fullsized":"2024-09-13T18:28:29.441114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438896+0000","last_change":"2024-09-13T18:28:29.438896+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438896+0000","last_undegraded":"2024-09-13T18:28:29.438896+0000","last_fullsized":"2024-09-13T18:28:29.438896+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:17.107893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441109+0000","last_change":"2024-09-13T18:28:29.441109+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441109+0000","last_undegraded":"2024-09-13T18:28:29.441109+0000","last_fullsized":"2024-09-13T18:28:29.441109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.437909+0000","last_change":"2024-09-13T18:28:29.437909+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.437909+0000","last_undegraded":"2024-09-13T18:28:29.437909+0000","last_fullsized":"2024-09-13T18:28:29.437909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:58.095328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434925+0000","last_change":"2024-09-13T18:28:29.434925+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434925+0000","last_undegraded":"2024-09-13T18:28:29.434925+0000","last_fullsized":"2024-09-13T18:28:29.434925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439026+0000","last_change":"2024-09-13T18:28:29.439026+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439026+0000","last_undegraded":"2024-09-13T18:28:29.439026+0000","last_fullsized":"2024-09-13T18:28:29.439026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434225+0000","last_change":"2024-09-13T18:28:29.434225+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434225+0000","last_undegraded":"2024-09-13T18:28:29.434225+0000","last_fullsized":"2024-09-13T18:28:29.434225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.232562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440516+0000","last_change":"2024-09-13T18:28:29.440516+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440516+0000","last_undegraded":"2024-09-13T18:28:29.440516+0000","last_fullsized":"2024-09-13T18:28:29.440516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446072+0000","last_change":"2024-09-13T18:28:29.446072+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446072+0000","last_undegraded":"2024-09-13T18:28:29.446072+0000","last_fullsized":"2024-09-13T18:28:29.446072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438821+0000","last_change":"2024-09-13T18:28:29.438821+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438821+0000","last_undegraded":"2024-09-13T18:28:29.438821+0000","last_fullsized":"2024-09-13T18:28:29.438821+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434027+0000","last_change":"2024-09-13T18:28:29.434027+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434027+0000","last_undegraded":"2024-09-13T18:28:29.434027+0000","last_fullsized":"2024-09-13T18:28:29.434027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436394+0000","last_change":"2024-09-13T18:28:29.436394+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436394+0000","last_undegraded":"2024-09-13T18:28:29.436394+0000","last_fullsized":"2024-09-13T18:28:29.436394+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.435073+0000","last_change":"2024-09-13T18:28:29.435073+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.435073+0000","last_undegraded":"2024-09-13T18:28:29.435073+0000","last_fullsized":"2024-09-13T18:28:29.435073+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:49.247597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438697+0000","last_change":"2024-09-13T18:28:29.438697+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438697+0000","last_undegraded":"2024-09-13T18:28:29.438697+0000","last_fullsized":"2024-09-13T18:28:29.438697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:11.595273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445708+0000","last_change":"2024-09-13T18:28:29.445708+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445708+0000","last_undegraded":"2024-09-13T18:28:29.445708+0000","last_fullsized":"2024-09-13T18:28:29.445708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.604812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:28:27.501415+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:28:27.501415+0000","last_peered":"2024-09-13T18:28:27.501415+0000","last_clean":"2024-09-13T18:28:27.501415+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:28:27.501415+0000","last_undegraded":"2024-09-13T18:28:27.501415+0000","last_fullsized":"2024-09-13T18:28:27.501415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.90800000000000003,"15min":0.876},"min":{"1min":0.77500000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.21,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.51200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.198,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.69399999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.095,"5min":1.448,"15min":1.448},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.93400000000000005,"15min":0.90600000000000003},"min":{"1min":0.75900000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90200000000000002,"15min":0.89300000000000002},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.1899999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.95399999999999996,"15min":0.94499999999999995},"min":{"1min":0.68799999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.056,"15min":1.0549999999999999},"min":{"1min":0.77800000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5609999999999999,"5min":1.877,"15min":1.877},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.996,"15min":0.97799999999999998},"min":{"1min":0.66600000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.069,"15min":1.0629999999999999},"min":{"1min":0.82299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3169999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.095,"5min":1.022,"15min":0.99199999999999999},"min":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.82899999999999996,"15min":0.83599999999999997},"min":{"1min":0.58799999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.198,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.80800000000000005,"15min":0.78200000000000003},"min":{"1min":0.60399999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.252,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1819999999999999,"5min":1.577,"15min":1.577},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.81200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.464,"15min":1.464},"last":1.0009999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.268,"15min":1.268},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.77600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2110000000000001,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.60999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89000000000000001,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.306,"15min":1.306},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98099999999999998,"15min":0.98699999999999999},"min":{"1min":0.64400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3149999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0109999999999999,"15min":0.995},"min":{"1min":0.76900000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.23,"5min":1.526,"15min":1.526},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.65900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.137,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.76400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3089999999999999,"5min":2.762,"15min":2.762},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0269999999999999,"15min":1.0429999999999999},"min":{"1min":0.65300000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.339,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.034,"15min":1.046},"min":{"1min":0.72599999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1579999999999999,"5min":1.72,"15min":1.72},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1659999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.90600000000000003,"15min":0.91600000000000004},"min":{"1min":0.60499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.84999999999999998,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.22,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82399999999999995},"min":{"1min":0.625,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.05,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1220000000000001,"5min":1.167,"15min":1.167},"last":1.087},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.96699999999999997,"15min":0.98199999999999998},"min":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2609999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.70299999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.0820000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.72599999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.181,"5min":1.871,"15min":1.871},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94299999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3029999999999999,"5min":1.413,"15min":1.413},"last":1.054},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.65100000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.24,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.012,"15min":1.0389999999999999},"min":{"1min":0.64700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0109999999999999,"15min":1.042},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1850000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0920000000000001,"15min":1.1339999999999999},"min":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.216,"5min":2.246,"15min":2.246},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2749999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.96299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.81599999999999995,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.133,"5min":1.252,"15min":1.252},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.177,"5min":1.256,"15min":1.256},"last":1.0840000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.64600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2170000000000001,"5min":1.329,"15min":1.329},"last":1.143},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88600000000000001,"15min":0.872},"min":{"1min":0.754,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1060000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.89700000000000002,"15min":0.89200000000000002},"min":{"1min":0.71799999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.171}]},{"osd":3,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.091,"5min":1.222,"15min":1.222},"last":0.871},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.74399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1459999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1240000000000001,"5min":1.298,"15min":1.298},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.252,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98999999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.129,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.012,"15min":1.024},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.377,"15min":1.377},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.048,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.26,"5min":1.482,"15min":1.482},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.0840000000000001},"min":{"1min":0.79600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.284,"5min":1.466,"15min":1.466},"last":1.0569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0349999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73199999999999998,"15min":0.69999999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.069,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.704,"15min":1.704},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94599999999999995,"5min":1.647,"15min":1.647},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75800000000000001,"15min":0.72899999999999998},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":1.399,"15min":1.399},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.76300000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.075,"5min":1.446,"15min":1.446},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1060000000000001,"15min":1.1339999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2909999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.996}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.034,"15min":1.026},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2529999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.93200000000000005},"min":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1830000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.375,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0509999999999999},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3129999999999999,"5min":1.96,"15min":1.96},"last":1.115}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.109},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4550000000000001,"5min":3,"15min":3},"last":0.624},{"interface":"front","average":{"1min":1.004,"5min":1.0009999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.258,"5min":1.702,"15min":1.702},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.98999999999999999,"5min":1.335,"15min":1.335},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.47199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.423,"15min":1.423},"last":0.437}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1830000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.194,"5min":1.274,"15min":1.274},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3240000000000001,"5min":1.611,"15min":1.611},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.179,"5min":1.492,"15min":1.492},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3140000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3680000000000001,"5min":1.702,"15min":1.702},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95899999999999996,"15min":0.95599999999999996},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2410000000000001,"5min":1.54,"15min":1.54},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2909999999999999,"5min":1.452,"15min":1.452},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.333,"5min":1.657,"15min":1.657},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.157,"5min":1.097,"15min":1.091},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4119999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.177,"15min":1.177},"last":0.89800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0389999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.03,"5min":1.117,"15min":1.117},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.72899999999999998,"15min":0.71899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1240000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.99099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.91900000000000004,"15min":0.90400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.248,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.127},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92300000000000004},"min":{"1min":0.64900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.284,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.056}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2190000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.88},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.01,"15min":1.0269999999999999},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1839999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.276}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.359,"5min":1.653,"15min":1.653},"last":1.224},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.64700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5580000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.66200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.3660000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36460,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335380,"statfs":{"total":96636764160,"available":96599429120,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.98299999999999998,"5min":1.147,"15min":1.147},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.085,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64600000000000002,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91400000000000003,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.153,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1200000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1970000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.071},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.996,"15min":0.998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.252,"5min":1.986,"15min":1.986},"last":1}]},{"osd":5,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.014},"min":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.357,"5min":2.641,"15min":2.641},"last":1.115},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3320000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.097}]},{"osd":6,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.083,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2769999999999999,"5min":1.891,"15min":1.891},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2310000000000001,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3160000000000001,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.1160000000000001,"15min":1.1060000000000001},"min":{"1min":0.79300000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.45,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.167}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:35.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.412+0000 7f0b5ee6c640 1 Processor -- start 2024-09-13T18:28:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.412+0000 7f0b5ee6c640 1 -- start start 2024-09-13T18:28:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5ee6c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 0x7f0b580afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5ee6c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b580ad530 con 0x7f0b580b1960 2024-09-13T18:28:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5ee6c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b580ad810 con 0x7f0b580ae5d0 2024-09-13T18:28:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5ee6c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580ae1b0 con 0x7f0b5815db40 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b57fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0b580b1960 0x7f0b580b02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49430/0 (socket says 172.21.15.53:49430) 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b57fff640 1 -- 172.21.15.53:0/254116756 learned_addr learned my addr 172.21.15.53:0/254116756 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5cc08640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 0x7f0b580afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177387005 0 0) 0x7f0b580ad530 con 0x7f0b580b1960 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b44003530 con 0x7f0b580b1960 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785821098 0 0) 0x7f0b44003530 con 0x7f0b580b1960 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 msgr2=0x7f0b580afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 0x7f0b580afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 >> v1:172.21.15.87:6789/0 conn(0x7f0b580ae5d0 legacy=0x7f0b580aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b580adaf0 con 0x7f0b580b1960 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0b40001680 con 0x7f0b580b1960 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 >> v1:172.21.15.53:6789/0 conn(0x7f0b580b1960 legacy=0x7f0b580b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 0x7f0b440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b44003f30 0x7f0b440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44004d10 0x7f0b44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580ae1b0 con 0x7f0b44004d10 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4400bb20 con 0x7f0b44003f30 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4400bce0 con 0x7f0b5815db40 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5d409640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44004d10 0x7f0b44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b57fff640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b44003f30 0x7f0b440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5cc08640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 0x7f0b440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5d409640 1 -- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 msgr2=0x7f0b440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5d409640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b5815db40 0x7f0b440039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5d409640 1 -- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b44003f30 msgr2=0x7f0b440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5d409640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b44003f30 0x7f0b440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.416+0000 7f0b5d409640 1 -- 172.21.15.53:0/254116756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44003530 con 0x7f0b44004d10 2024-09-13T18:28:35.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5d409640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44004d10 0x7f0b44005190 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0b48001780 tx=0x7f0b4801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffe0b531f3e24d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b480052d0 con 0x7f0b44004d10 2024-09-13T18:28:35.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b480a7050 con 0x7f0b44004d10 2024-09-13T18:28:35.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b577fe640 1 -- 172.21.15.53:0/254116756 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48003600 con 0x7f0b44004d10 2024-09-13T18:28:35.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/254116756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44004d10 msgr2=0x7f0b44005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 --2- 172.21.15.53:0/254116756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44004d10 0x7f0b44005190 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0b48001780 tx=0x7f0b4801c420 comp rx=0 tx=0).stop 2024-09-13T18:28:35.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5d409640 1 -- 172.21.15.53:0/254116756 reap_dead start 2024-09-13T18:28:35.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/254116756 shutdown_connections 2024-09-13T18:28:35.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/254116756 >> 172.21.15.53:0/254116756 conn(0x7f0b580b20d0 msgr2=0x7f0b580b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/254116756 shutdown_connections 2024-09-13T18:28:35.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/254116756 wait complete. 2024-09-13T18:28:35.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 Processor -- start 2024-09-13T18:28:35.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- start start 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b44004d10 0x7f0b5815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b580c8dc0 0x7f0b580c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b581527f0 0x7f0b5809bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580c7af0 con 0x7f0b580c8dc0 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580c8930 con 0x7f0b581527f0 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5ee6c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580c9220 con 0x7f0b44004d10 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b580c8dc0 0x7f0b580c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b580c8dc0 0x7f0b580c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58398/0 (socket says 172.21.15.53:58398) 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 -- 172.21.15.53:0/1677884808 learned_addr learned my addr 172.21.15.53:0/1677884808 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:35.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5cc08640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b44004d10 0x7f0b5815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5d409640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b581527f0 0x7f0b5809bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 -- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b44004d10 msgr2=0x7f0b5815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b44004d10 0x7f0b5815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 -- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b581527f0 msgr2=0x7f0b5809bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b581527f0 0x7f0b5809bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b57fff640 1 -- 172.21.15.53:0/1677884808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b580c7d20 con 0x7f0b580c8dc0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.420+0000 7f0b5d409640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b581527f0 0x7f0b5809bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b57fff640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b580c8dc0 0x7f0b580c75b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0b40001cc0 tx=0x7f0b40011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b557fa640 1 -- 172.21.15.53:0/1677884808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000fb60 con 0x7f0b580c8dc0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b557fa640 1 -- 172.21.15.53:0/1677884808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000fcc0 con 0x7f0b580c8dc0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b580c8000 con 0x7f0b580c8dc0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b557fa640 1 -- 172.21.15.53:0/1677884808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40015630 con 0x7f0b580c8dc0 2024-09-13T18:28:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b580c85c0 con 0x7f0b580c8dc0 2024-09-13T18:28:35.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b580c8ae0 con 0x7f0b580c8dc0 2024-09-13T18:28:35.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b557fa640 1 -- 172.21.15.53:0/1677884808 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f0b40015790 con 0x7f0b580c8dc0 2024-09-13T18:28:35.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b557fa640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0b38066870 0x7f0b38068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b557fa640 1 -- 172.21.15.53:0/1677884808 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b40087820 con 0x7f0b580c8dc0 2024-09-13T18:28:35.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b5cc08640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0b38066870 0x7f0b38068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.424+0000 7f0b5cc08640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0b38066870 0x7f0b38068d30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0b500074a0 tx=0x7f0b5000d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.428+0000 7f0b557fa640 1 -- 172.21.15.53:0/1677884808 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b580c8ae0 con 0x7f0b580c8dc0 2024-09-13T18:28:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.588+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b580cf2d0 con 0x7f0b38066870 2024-09-13T18:28:35.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.608+0000 7f0b557fa640 1 -- 172.21.15.53:0/1677884808 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276856 (secure 0 0 0) 0x7f0b500163d0 con 0x7f0b38066870 2024-09-13T18:28:35.616 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:35.619 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0b38066870 msgr2=0x7f0b38068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0b38066870 0x7f0b38068d30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0b500074a0 tx=0x7f0b5000d040 comp rx=0 tx=0).stop 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b580c8dc0 msgr2=0x7f0b580c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b580c8dc0 0x7f0b580c75b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0b40001cc0 tx=0x7f0b40011d70 comp rx=0 tx=0).stop 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 shutdown_connections 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0b38066870 0x7f0b38068d30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b581527f0 0x7f0b5809bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b580c8dc0 0x7f0b580c75b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 --2- 172.21.15.53:0/1677884808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b44004d10 0x7f0b5815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 >> 172.21.15.53:0/1677884808 conn(0x7f0b580b20d0 msgr2=0x7f0b5806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 shutdown_connections 2024-09-13T18:28:35.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.612+0000 7f0b5ee6c640 1 -- 172.21.15.53:0/1677884808 wait complete. 2024-09-13T18:28:35.637 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-13T18:28:34.974615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":255428,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719292,"statfs":{"total":773094113280,"available":772832555008,"internally_reserved":0,"allocated":6647808,"data_stored":3428591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.542106"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439674+0000","last_change":"2024-09-13T18:28:29.439674+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439674+0000","last_undegraded":"2024-09-13T18:28:29.439674+0000","last_fullsized":"2024-09-13T18:28:29.439674+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438633+0000","last_change":"2024-09-13T18:28:29.438633+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438633+0000","last_undegraded":"2024-09-13T18:28:29.438633+0000","last_fullsized":"2024-09-13T18:28:29.438633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:56.284668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440545+0000","last_change":"2024-09-13T18:28:29.440545+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440545+0000","last_undegraded":"2024-09-13T18:28:29.440545+0000","last_fullsized":"2024-09-13T18:28:29.440545+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440484+0000","last_change":"2024-09-13T18:28:29.440484+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440484+0000","last_undegraded":"2024-09-13T18:28:29.440484+0000","last_fullsized":"2024-09-13T18:28:29.440484+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:01.316915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436397+0000","last_change":"2024-09-13T18:28:29.436397+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436397+0000","last_undegraded":"2024-09-13T18:28:29.436397+0000","last_fullsized":"2024-09-13T18:28:29.436397+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439961+0000","last_change":"2024-09-13T18:28:29.439961+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439961+0000","last_undegraded":"2024-09-13T18:28:29.439961+0000","last_fullsized":"2024-09-13T18:28:29.439961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441339+0000","last_change":"2024-09-13T18:28:29.441339+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441339+0000","last_undegraded":"2024-09-13T18:28:29.441339+0000","last_fullsized":"2024-09-13T18:28:29.441339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436465+0000","last_change":"2024-09-13T18:28:29.436465+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436465+0000","last_undegraded":"2024-09-13T18:28:29.436465+0000","last_fullsized":"2024-09-13T18:28:29.436465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445190+0000","last_change":"2024-09-13T18:28:29.445190+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445190+0000","last_undegraded":"2024-09-13T18:28:29.445190+0000","last_fullsized":"2024-09-13T18:28:29.445190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438010+0000","last_change":"2024-09-13T18:28:29.438010+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438010+0000","last_undegraded":"2024-09-13T18:28:29.438010+0000","last_fullsized":"2024-09-13T18:28:29.438010+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:17.208941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445146+0000","last_change":"2024-09-13T18:28:29.445146+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445146+0000","last_undegraded":"2024-09-13T18:28:29.445146+0000","last_fullsized":"2024-09-13T18:28:29.445146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436566+0000","last_change":"2024-09-13T18:28:29.436566+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436566+0000","last_undegraded":"2024-09-13T18:28:29.436566+0000","last_fullsized":"2024-09-13T18:28:29.436566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439618+0000","last_change":"2024-09-13T18:28:29.439618+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439618+0000","last_undegraded":"2024-09-13T18:28:29.439618+0000","last_fullsized":"2024-09-13T18:28:29.439618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:58.957985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446040+0000","last_change":"2024-09-13T18:28:29.446040+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446040+0000","last_undegraded":"2024-09-13T18:28:29.446040+0000","last_fullsized":"2024-09-13T18:28:29.446040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438784+0000","last_change":"2024-09-13T18:28:29.438784+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438784+0000","last_undegraded":"2024-09-13T18:28:29.438784+0000","last_fullsized":"2024-09-13T18:28:29.438784+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:03.613090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445348+0000","last_change":"2024-09-13T18:28:29.445348+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445348+0000","last_undegraded":"2024-09-13T18:28:29.445348+0000","last_fullsized":"2024-09-13T18:28:29.445348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438127+0000","last_change":"2024-09-13T18:28:29.438127+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438127+0000","last_undegraded":"2024-09-13T18:28:29.438127+0000","last_fullsized":"2024-09-13T18:28:29.438127+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:49.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441114+0000","last_change":"2024-09-13T18:28:29.441114+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441114+0000","last_undegraded":"2024-09-13T18:28:29.441114+0000","last_fullsized":"2024-09-13T18:28:29.441114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438896+0000","last_change":"2024-09-13T18:28:29.438896+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438896+0000","last_undegraded":"2024-09-13T18:28:29.438896+0000","last_fullsized":"2024-09-13T18:28:29.438896+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:17.107893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441109+0000","last_change":"2024-09-13T18:28:29.441109+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441109+0000","last_undegraded":"2024-09-13T18:28:29.441109+0000","last_fullsized":"2024-09-13T18:28:29.441109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.437909+0000","last_change":"2024-09-13T18:28:29.437909+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.437909+0000","last_undegraded":"2024-09-13T18:28:29.437909+0000","last_fullsized":"2024-09-13T18:28:29.437909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:58.095328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434925+0000","last_change":"2024-09-13T18:28:29.434925+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434925+0000","last_undegraded":"2024-09-13T18:28:29.434925+0000","last_fullsized":"2024-09-13T18:28:29.434925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439026+0000","last_change":"2024-09-13T18:28:29.439026+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439026+0000","last_undegraded":"2024-09-13T18:28:29.439026+0000","last_fullsized":"2024-09-13T18:28:29.439026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434225+0000","last_change":"2024-09-13T18:28:29.434225+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434225+0000","last_undegraded":"2024-09-13T18:28:29.434225+0000","last_fullsized":"2024-09-13T18:28:29.434225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.232562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440516+0000","last_change":"2024-09-13T18:28:29.440516+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440516+0000","last_undegraded":"2024-09-13T18:28:29.440516+0000","last_fullsized":"2024-09-13T18:28:29.440516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446072+0000","last_change":"2024-09-13T18:28:29.446072+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446072+0000","last_undegraded":"2024-09-13T18:28:29.446072+0000","last_fullsized":"2024-09-13T18:28:29.446072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438821+0000","last_change":"2024-09-13T18:28:29.438821+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438821+0000","last_undegraded":"2024-09-13T18:28:29.438821+0000","last_fullsized":"2024-09-13T18:28:29.438821+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434027+0000","last_change":"2024-09-13T18:28:29.434027+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434027+0000","last_undegraded":"2024-09-13T18:28:29.434027+0000","last_fullsized":"2024-09-13T18:28:29.434027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436394+0000","last_change":"2024-09-13T18:28:29.436394+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436394+0000","last_undegraded":"2024-09-13T18:28:29.436394+0000","last_fullsized":"2024-09-13T18:28:29.436394+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.435073+0000","last_change":"2024-09-13T18:28:29.435073+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.435073+0000","last_undegraded":"2024-09-13T18:28:29.435073+0000","last_fullsized":"2024-09-13T18:28:29.435073+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:49.247597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438697+0000","last_change":"2024-09-13T18:28:29.438697+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438697+0000","last_undegraded":"2024-09-13T18:28:29.438697+0000","last_fullsized":"2024-09-13T18:28:29.438697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:11.595273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445708+0000","last_change":"2024-09-13T18:28:29.445708+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445708+0000","last_undegraded":"2024-09-13T18:28:29.445708+0000","last_fullsized":"2024-09-13T18:28:29.445708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.604812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:28:27.501415+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:28:27.501415+0000","last_peered":"2024-09-13T18:28:27.501415+0000","last_clean":"2024-09-13T18:28:27.501415+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:28:27.501415+0000","last_undegraded":"2024-09-13T18:28:27.501415+0000","last_fullsized":"2024-09-13T18:28:27.501415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.90800000000000003,"15min":0.876},"min":{"1min":0.77500000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.21,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.51200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.198,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.69399999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.095,"5min":1.448,"15min":1.448},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.93400000000000005,"15min":0.90600000000000003},"min":{"1min":0.75900000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90200000000000002,"15min":0.89300000000000002},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.1899999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.95399999999999996,"15min":0.94499999999999995},"min":{"1min":0.68799999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.056,"15min":1.0549999999999999},"min":{"1min":0.77800000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5609999999999999,"5min":1.877,"15min":1.877},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.996,"15min":0.97799999999999998},"min":{"1min":0.66600000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.069,"15min":1.0629999999999999},"min":{"1min":0.82299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3169999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.095,"5min":1.022,"15min":0.99199999999999999},"min":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.82899999999999996,"15min":0.83599999999999997},"min":{"1min":0.58799999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.198,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.80800000000000005,"15min":0.78200000000000003},"min":{"1min":0.60399999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.252,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1819999999999999,"5min":1.577,"15min":1.577},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.81200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.464,"15min":1.464},"last":1.0009999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.268,"15min":1.268},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.77600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2110000000000001,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.60999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89000000000000001,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.306,"15min":1.306},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98099999999999998,"15min":0.98699999999999999},"min":{"1min":0.64400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3149999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0109999999999999,"15min":0.995},"min":{"1min":0.76900000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.23,"5min":1.526,"15min":1.526},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.65900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.137,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.76400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3089999999999999,"5min":2.762,"15min":2.762},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0269999999999999,"15min":1.0429999999999999},"min":{"1min":0.65300000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.339,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.034,"15min":1.046},"min":{"1min":0.72599999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1579999999999999,"5min":1.72,"15min":1.72},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1659999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.90600000000000003,"15min":0.91600000000000004},"min":{"1min":0.60499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.84999999999999998,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.22,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82399999999999995},"min":{"1min":0.625,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.05,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1220000000000001,"5min":1.167,"15min":1.167},"last":1.087},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.96699999999999997,"15min":0.98199999999999998},"min":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2609999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.70299999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.0820000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.72599999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.181,"5min":1.871,"15min":1.871},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94299999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3029999999999999,"5min":1.413,"15min":1.413},"last":1.054},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.65100000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.24,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.012,"15min":1.0389999999999999},"min":{"1min":0.64700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0109999999999999,"15min":1.042},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1850000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0920000000000001,"15min":1.1339999999999999},"min":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.216,"5min":2.246,"15min":2.246},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2749999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.96299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.81599999999999995,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.133,"5min":1.252,"15min":1.252},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.177,"5min":1.256,"15min":1.256},"last":1.0840000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.64600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2170000000000001,"5min":1.329,"15min":1.329},"last":1.143},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88600000000000001,"15min":0.872},"min":{"1min":0.754,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1060000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.89700000000000002,"15min":0.89200000000000002},"min":{"1min":0.71799999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.171}]},{"osd":3,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.091,"5min":1.222,"15min":1.222},"last":0.871},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.74399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1459999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1240000000000001,"5min":1.298,"15min":1.298},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.252,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98999999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.129,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.012,"15min":1.024},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.377,"15min":1.377},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.048,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.26,"5min":1.482,"15min":1.482},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.0840000000000001},"min":{"1min":0.79600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.284,"5min":1.466,"15min":1.466},"last":1.0569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0349999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73199999999999998,"15min":0.69999999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.069,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.704,"15min":1.704},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94599999999999995,"5min":1.647,"15min":1.647},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75800000000000001,"15min":0.72899999999999998},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":1.399,"15min":1.399},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.76300000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.075,"5min":1.446,"15min":1.446},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1060000000000001,"15min":1.1339999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2909999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.996}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.034,"15min":1.026},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2529999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.93200000000000005},"min":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1830000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.375,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0509999999999999},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3129999999999999,"5min":1.96,"15min":1.96},"last":1.115}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.109},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4550000000000001,"5min":3,"15min":3},"last":0.624},{"interface":"front","average":{"1min":1.004,"5min":1.0009999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.258,"5min":1.702,"15min":1.702},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.98999999999999999,"5min":1.335,"15min":1.335},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.47199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.423,"15min":1.423},"last":0.437}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1830000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.194,"5min":1.274,"15min":1.274},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3240000000000001,"5min":1.611,"15min":1.611},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.179,"5min":1.492,"15min":1.492},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3140000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3680000000000001,"5min":1.702,"15min":1.702},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95899999999999996,"15min":0.95599999999999996},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2410000000000001,"5min":1.54,"15min":1.54},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2909999999999999,"5min":1.452,"15min":1.452},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.333,"5min":1.657,"15min":1.657},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.157,"5min":1.097,"15min":1.091},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4119999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.177,"15min":1.177},"last":0.89800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0389999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.03,"5min":1.117,"15min":1.117},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.72899999999999998,"15min":0.71899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1240000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.99099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.91900000000000004,"15min":0.90400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.248,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.127},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92300000000000004},"min":{"1min":0.64900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.284,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.056}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2190000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.88},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.01,"15min":1.0269999999999999},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1839999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.276}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.359,"5min":1.653,"15min":1.653},"last":1.224},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.64700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5580000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.66200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.3660000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36460,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335380,"statfs":{"total":96636764160,"available":96599429120,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.98299999999999998,"5min":1.147,"15min":1.147},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.085,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64600000000000002,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91400000000000003,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.153,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1200000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1970000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.071},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.996,"15min":0.998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.252,"5min":1.986,"15min":1.986},"last":1}]},{"osd":5,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.014},"min":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.357,"5min":2.641,"15min":2.641},"last":1.115},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3320000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.097}]},{"osd":6,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.083,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2769999999999999,"5min":1.891,"15min":1.891},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2310000000000001,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3160000000000001,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.1160000000000001,"15min":1.1060000000000001},"min":{"1min":0.79300000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.45,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.167}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:35.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-09-13T18:28:35.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-09-13T18:28:35.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-09-13T18:28:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.439674+0000', 'last_change': '2024-09-13T18:28:29.439674+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.439674+0000', 'last_undegraded': '2024-09-13T18:28:29.439674+0000', 'last_fullsized': '2024-09-13T18:28:29.439674+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.438633+0000', 'last_change': '2024-09-13T18:28:29.438633+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.438633+0000', 'last_undegraded': '2024-09-13T18:28:29.438633+0000', 'last_fullsized': '2024-09-13T18:28:29.438633+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:49:56.284668+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.440545+0000', 'last_change': '2024-09-13T18:28:29.440545+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.440545+0000', 'last_undegraded': '2024-09-13T18:28:29.440545+0000', 'last_fullsized': '2024-09-13T18:28:29.440545+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-09-13T18:28:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.440484+0000', 'last_change': '2024-09-13T18:28:29.440484+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.440484+0000', 'last_undegraded': '2024-09-13T18:28:29.440484+0000', 'last_fullsized': '2024-09-13T18:28:29.440484+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:20:01.316915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.436397+0000', 'last_change': '2024-09-13T18:28:29.436397+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.436397+0000', 'last_undegraded': '2024-09-13T18:28:29.436397+0000', 'last_fullsized': '2024-09-13T18:28:29.436397+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.439961+0000', 'last_change': '2024-09-13T18:28:29.439961+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.439961+0000', 'last_undegraded': '2024-09-13T18:28:29.439961+0000', 'last_fullsized': '2024-09-13T18:28:29.439961+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.441339+0000', 'last_change': '2024-09-13T18:28:29.441339+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.441339+0000', 'last_undegraded': '2024-09-13T18:28:29.441339+0000', 'last_fullsized': '2024-09-13T18:28:29.441339+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.436465+0000', 'last_change': '2024-09-13T18:28:29.436465+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.436465+0000', 'last_undegraded': '2024-09-13T18:28:29.436465+0000', 'last_fullsized': '2024-09-13T18:28:29.436465+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.445190+0000', 'last_change': '2024-09-13T18:28:29.445190+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.445190+0000', 'last_undegraded': '2024-09-13T18:28:29.445190+0000', 'last_fullsized': '2024-09-13T18:28:29.445190+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:28:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.438010+0000', 'last_change': '2024-09-13T18:28:29.438010+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.438010+0000', 'last_undegraded': '2024-09-13T18:28:29.438010+0000', 'last_fullsized': '2024-09-13T18:28:29.438010+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:16:17.208941+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.445146+0000', 'last_change': '2024-09-13T18:28:29.445146+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.445146+0000', 'last_undegraded': '2024-09-13T18:28:29.445146+0000', 'last_fullsized': '2024-09-13T18:28:29.445146+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:28:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-09-13T18:28:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-09-13T18:28:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.436566+0000', 'last_change': '2024-09-13T18:28:29.436566+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.436566+0000', 'last_undegraded': '2024-09-13T18:28:29.436566+0000', 'last_fullsized': '2024-09-13T18:28:29.436566+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-09-13T18:28:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-09-13T18:28:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.439618+0000', 'last_change': '2024-09-13T18:28:29.439618+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.439618+0000', 'last_undegraded': '2024-09-13T18:28:29.439618+0000', 'last_fullsized': '2024-09-13T18:28:29.439618+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:25:58.957985+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:35.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-09-13T18:28:35.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-09-13T18:28:35.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.446040+0000', 'last_change': '2024-09-13T18:28:29.446040+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.446040+0000', 'last_undegraded': '2024-09-13T18:28:29.446040+0000', 'last_fullsized': '2024-09-13T18:28:29.446040+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.438784+0000', 'last_change': '2024-09-13T18:28:29.438784+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.438784+0000', 'last_undegraded': '2024-09-13T18:28:29.438784+0000', 'last_fullsized': '2024-09-13T18:28:29.438784+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:57:03.613090+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.445348+0000', 'last_change': '2024-09-13T18:28:29.445348+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.445348+0000', 'last_undegraded': '2024-09-13T18:28:29.445348+0000', 'last_fullsized': '2024-09-13T18:28:29.445348+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-09-13T18:28:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.438127+0000', 'last_change': '2024-09-13T18:28:29.438127+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.438127+0000', 'last_undegraded': '2024-09-13T18:28:29.438127+0000', 'last_fullsized': '2024-09-13T18:28:29.438127+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:51:49.632247+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.441114+0000', 'last_change': '2024-09-13T18:28:29.441114+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.441114+0000', 'last_undegraded': '2024-09-13T18:28:29.441114+0000', 'last_fullsized': '2024-09-13T18:28:29.441114+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.438896+0000', 'last_change': '2024-09-13T18:28:29.438896+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.438896+0000', 'last_undegraded': '2024-09-13T18:28:29.438896+0000', 'last_fullsized': '2024-09-13T18:28:29.438896+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:02:17.107893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-09-13T18:28:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.441109+0000', 'last_change': '2024-09-13T18:28:29.441109+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.441109+0000', 'last_undegraded': '2024-09-13T18:28:29.441109+0000', 'last_fullsized': '2024-09-13T18:28:29.441109+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.437909+0000', 'last_change': '2024-09-13T18:28:29.437909+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.437909+0000', 'last_undegraded': '2024-09-13T18:28:29.437909+0000', 'last_fullsized': '2024-09-13T18:28:29.437909+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:04:58.095328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.434925+0000', 'last_change': '2024-09-13T18:28:29.434925+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.434925+0000', 'last_undegraded': '2024-09-13T18:28:29.434925+0000', 'last_fullsized': '2024-09-13T18:28:29.434925+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.439026+0000', 'last_change': '2024-09-13T18:28:29.439026+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.439026+0000', 'last_undegraded': '2024-09-13T18:28:29.439026+0000', 'last_fullsized': '2024-09-13T18:28:29.439026+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.434225+0000', 'last_change': '2024-09-13T18:28:29.434225+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.434225+0000', 'last_undegraded': '2024-09-13T18:28:29.434225+0000', 'last_fullsized': '2024-09-13T18:28:29.434225+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:24:09.232562+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.440516+0000', 'last_change': '2024-09-13T18:28:29.440516+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.440516+0000', 'last_undegraded': '2024-09-13T18:28:29.440516+0000', 'last_fullsized': '2024-09-13T18:28:29.440516+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-09-13T18:28:35.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.446072+0000', 'last_change': '2024-09-13T18:28:29.446072+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.446072+0000', 'last_undegraded': '2024-09-13T18:28:29.446072+0000', 'last_fullsized': '2024-09-13T18:28:29.446072+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.438821+0000', 'last_change': '2024-09-13T18:28:29.438821+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.438821+0000', 'last_undegraded': '2024-09-13T18:28:29.438821+0000', 'last_fullsized': '2024-09-13T18:28:29.438821+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.434027+0000', 'last_change': '2024-09-13T18:28:29.434027+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.434027+0000', 'last_undegraded': '2024-09-13T18:28:29.434027+0000', 'last_fullsized': '2024-09-13T18:28:29.434027+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-09-13T18:28:35.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.436394+0000', 'last_change': '2024-09-13T18:28:29.436394+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.436394+0000', 'last_undegraded': '2024-09-13T18:28:29.436394+0000', 'last_fullsized': '2024-09-13T18:28:29.436394+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.435073+0000', 'last_change': '2024-09-13T18:28:29.435073+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.435073+0000', 'last_undegraded': '2024-09-13T18:28:29.435073+0000', 'last_fullsized': '2024-09-13T18:28:29.435073+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:32:49.247597+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.438697+0000', 'last_change': '2024-09-13T18:28:29.438697+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.438697+0000', 'last_undegraded': '2024-09-13T18:28:29.438697+0000', 'last_fullsized': '2024-09-13T18:28:29.438697+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:17:11.595273+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-09-13T18:28:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:28:30.429156+0000', 'last_change': '2024-09-13T18:28:30.429156+0000', 'last_active': '2024-09-13T18:28:30.429156+0000', 'last_peered': '2024-09-13T18:28:30.429156+0000', 'last_clean': '2024-09-13T18:28:30.429156+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:30.429156+0000', 'last_undegraded': '2024-09-13T18:28:30.429156+0000', 'last_fullsized': '2024-09-13T18:28:30.429156+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:30.429156+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:28:35.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-09-13T18:28:35.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:28:29.445708+0000', 'last_change': '2024-09-13T18:28:29.445708+0000', 'last_active': '2024-09-13T18:28:29.414065+0000', 'last_peered': '2024-09-13T18:28:29.414065+0000', 'last_clean': '2024-09-13T18:28:29.414065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:28:29.445708+0000', 'last_undegraded': '2024-09-13T18:28:29.445708+0000', 'last_fullsized': '2024-09-13T18:28:29.445708+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'last_clean_scrub_stamp': '2024-09-13T18:28:29.414065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:29:33.604812+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:28:35.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:28:35.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.800+0000 7f060f967640 1 Processor -- start 2024-09-13T18:28:35.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.800+0000 7f060f967640 1 -- start start 2024-09-13T18:28:35.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.800+0000 7f060f967640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0608158ba0 0x7f060806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.800+0000 7f060f967640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06080cbb60 0x7f06080b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.800+0000 7f060f967640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080b2340 con 0x7f060806f370 2024-09-13T18:28:35.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.800+0000 7f060f967640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06080b2860 con 0x7f06080cbb60 2024-09-13T18:28:35.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.800+0000 7f060f967640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0608158f80 con 0x7f0608158ba0 2024-09-13T18:28:35.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060df04640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f060806f370 0x7f06080cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49438/0 (socket says 172.21.15.53:49438) 2024-09-13T18:28:35.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060df04640 1 -- 172.21.15.53:0/718230003 learned_addr learned my addr 172.21.15.53:0/718230003 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0608158ba0 0x7f060806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060cf02640 1 --2- 172.21.15.53:0/718230003 >> v2:172.21.15.87:3300/0 conn(0x7f06080cbb60 0x7f06080b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219042867 0 0) 0x7f0600001120 con 0x7f060806f370 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f4005740 con 0x7f060806f370 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1510031100 0 0) 0x7f05f4005740 con 0x7f060806f370 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0608158ba0 msgr2=0x7f060806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0608158ba0 0x7f060806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 >> v2:172.21.15.87:3300/0 conn(0x7f06080cbb60 msgr2=0x7f06080b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 --2- 172.21.15.53:0/718230003 >> v2:172.21.15.87:3300/0 conn(0x7f06080cbb60 0x7f06080b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080b2580 con 0x7f060806f370 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0600001810 con 0x7f060806f370 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 >> v1:172.21.15.53:6789/0 conn(0x7f060806f370 legacy=0x7f06080cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05f4005b90 0x7f05f4005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0608158ba0 0x7f05f40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05f4006f20 0x7f05f40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080b2860 con 0x7f05f4005b90 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0608158f80 con 0x7f05f4006f20 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f400dba0 con 0x7f0608158ba0 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05f4005b90 0x7f05f4005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 -- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0608158ba0 msgr2=0x7f05f40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0608158ba0 0x7f05f40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 -- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05f4006f20 msgr2=0x7f05f40073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05f4006f20 0x7f05f40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 -- 172.21.15.53:0/718230003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f4005740 con 0x7f05f4005b90 2024-09-13T18:28:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f060d703640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05f4005b90 0x7f05f4005fb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f060400acb0 tx=0x7f060401ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2610dd5ea2280329 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060400f040 con 0x7f05f4005b90 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06040a9070 con 0x7f05f4005b90 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.804+0000 7f05fffff640 1 -- 172.21.15.53:0/718230003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040a5db0 con 0x7f05f4005b90 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- 172.21.15.53:0/718230003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05f4005b90 msgr2=0x7f05f4005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 --2- 172.21.15.53:0/718230003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05f4005b90 0x7f05f4005fb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f060400acb0 tx=0x7f060401ccb0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060df04640 1 -- 172.21.15.53:0/718230003 reap_dead start 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- 172.21.15.53:0/718230003 shutdown_connections 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- 172.21.15.53:0/718230003 >> 172.21.15.53:0/718230003 conn(0x7f0608065c80 msgr2=0x7f0608066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- 172.21.15.53:0/718230003 shutdown_connections 2024-09-13T18:28:35.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- 172.21.15.53:0/718230003 wait complete. 2024-09-13T18:28:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 Processor -- start 2024-09-13T18:28:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- start start 2024-09-13T18:28:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05f4005b90 0x7f060814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060814d070 0x7f0608152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f060814e840 0x7f06080b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060814d4f0 con 0x7f060814d070 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0608152e70 con 0x7f060814e840 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060814d7a0 con 0x7f05f4005b90 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060814d070 0x7f0608152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060814d070 0x7f0608152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58406/0 (socket says 172.21.15.53:58406) 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 -- 172.21.15.53:0/2681090760 learned_addr learned my addr 172.21.15.53:0/2681090760 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060d703640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05f4005b90 0x7f060814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060df04640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f060814e840 0x7f06080b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 -- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05f4005b90 msgr2=0x7f060814fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05f4005b90 0x7f060814fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 -- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f060814e840 msgr2=0x7f06080b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f060814e840 0x7f06080b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 -- 172.21.15.53:0/2681090760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060814da80 con 0x7f060814d070 2024-09-13T18:28:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060cf02640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060814d070 0x7f0608152930 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e7f0 tx=0x7f05f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f05fdffb640 1 -- 172.21.15.53:0/2681090760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800c940 con 0x7f060814d070 2024-09-13T18:28:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f05fdffb640 1 -- 172.21.15.53:0/2681090760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800caa0 con 0x7f060814d070 2024-09-13T18:28:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060814dd60 con 0x7f060814d070 2024-09-13T18:28:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f05fdffb640 1 -- 172.21.15.53:0/2681090760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800ce30 con 0x7f060814d070 2024-09-13T18:28:35.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.808+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060814e320 con 0x7f060814d070 2024-09-13T18:28:35.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.812+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0608067400 con 0x7f060814d070 2024-09-13T18:28:35.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.812+0000 7f05fdffb640 1 -- 172.21.15.53:0/2681090760 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f05f8013470 con 0x7f060814d070 2024-09-13T18:28:35.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.812+0000 7f05fdffb640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f05ec066840 0x7f05ec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:35.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.812+0000 7f05fdffb640 1 -- 172.21.15.53:0/2681090760 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05f8084560 con 0x7f060814d070 2024-09-13T18:28:35.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.812+0000 7f060d703640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f05ec066840 0x7f05ec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:35.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.812+0000 7f060d703640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f05ec066840 0x7f05ec068d00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f06040b0000 tx=0x7f060400e040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:35.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:35.816+0000 7f05fdffb640 1 -- 172.21.15.53:0/2681090760 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05f8051650 con 0x7f060814d070 2024-09-13T18:28:36.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.024+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f06080cd9a0 con 0x7f060814d070 2024-09-13T18:28:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f05fdffb640 1 -- 172.21.15.53:0/2681090760 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1108 (secure 0 0 0) 0x7f05f8054c70 con 0x7f060814d070 2024-09-13T18:28:36.087 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:36.087 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":241,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1726251884,"num_in_osds":8,"osd_in_since":1726251876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":261558272,"bytes_avail":772832555008,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":31,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6324}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-13T18:27:48.958854+0000","services":{}},"progress_events":{}} 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f05ec066840 msgr2=0x7f05ec068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f05ec066840 0x7f05ec068d00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f06040b0000 tx=0x7f060400e040 comp rx=0 tx=0).stop 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060814d070 msgr2=0x7f0608152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060814d070 0x7f0608152930 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e7f0 tx=0x7f05f800ecb0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 shutdown_connections 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f05ec066840 0x7f05ec068d00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f060814e840 0x7f06080b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060814d070 0x7f0608152930 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 --2- 172.21.15.53:0/2681090760 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05f4005b90 0x7f060814fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 >> 172.21.15.53:0/2681090760 conn(0x7f0608065c80 msgr2=0x7f0608066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 shutdown_connections 2024-09-13T18:28:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.028+0000 7f060f967640 1 -- 172.21.15.53:0/2681090760 wait complete. 2024-09-13T18:28:36.090 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:28:36.090 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:36.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54ee21a640 1 Processor -- start 2024-09-13T18:28:36.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54ee21a640 1 -- start start 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54ee21a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54e80ce3d0 0x7f54e80b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54ee21a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f54e80b5570 0x7f54e80b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54ee21a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e80cf5f0 con 0x7f54e81593a0 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54ee21a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e80b59e0 con 0x7f54e80ce3d0 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54ee21a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e80ce9e0 con 0x7f54e80b5570 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54dffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54e80ce3d0 0x7f54e80b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54e77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f54e81593a0 0x7f54e8070aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49446/0 (socket says 172.21.15.53:49446) 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54e77fe640 1 -- 172.21.15.53:0/1588308678 learned_addr learned my addr 172.21.15.53:0/1588308678 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54e7fff640 1 --2- 172.21.15.53:0/1588308678 >> v2:172.21.15.87:3300/0 conn(0x7f54e80b5570 0x7f54e80b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54dffff640 1 -- 172.21.15.53:0/1588308678 >> v2:172.21.15.87:3300/0 conn(0x7f54e80b5570 msgr2=0x7f54e80b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54dffff640 1 --2- 172.21.15.53:0/1588308678 >> v2:172.21.15.87:3300/0 conn(0x7f54e80b5570 0x7f54e80b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54dffff640 1 -- 172.21.15.53:0/1588308678 >> v1:172.21.15.53:6789/0 conn(0x7f54e81593a0 legacy=0x7f54e8070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54e6ffd640 1 -- 172.21.15.53:0/1588308678 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805850168 0 0) 0x7f54e80cf5f0 con 0x7f54e81593a0 2024-09-13T18:28:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.208+0000 7f54dffff640 1 -- 172.21.15.53:0/1588308678 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80cecc0 con 0x7f54e80ce3d0 2024-09-13T18:28:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 --2- 172.21.15.53:0/1588308678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e80b5030 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f54e806aed0 tx=0x7f54d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2257f3f9ef45d925 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54e6ffd640 1 -- 172.21.15.53:0/1588308678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00ab650 con 0x7f54e80ce3d0 2024-09-13T18:28:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54e6ffd640 1 -- 172.21.15.53:0/1588308678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d00ab7b0 con 0x7f54e80ce3d0 2024-09-13T18:28:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54e6ffd640 1 -- 172.21.15.53:0/1588308678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00abb40 con 0x7f54e80ce3d0 2024-09-13T18:28:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- 172.21.15.53:0/1588308678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 msgr2=0x7f54e80b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1588308678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e80b5030 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f54e806aed0 tx=0x7f54d001c450 comp rx=0 tx=0).stop 2024-09-13T18:28:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- 172.21.15.53:0/1588308678 shutdown_connections 2024-09-13T18:28:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1588308678 >> v2:172.21.15.87:3300/0 conn(0x7f54e80b5570 0x7f54e80b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1588308678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e80b5030 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- 172.21.15.53:0/1588308678 >> 172.21.15.53:0/1588308678 conn(0x7f54e8069f50 msgr2=0x7f54e806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- 172.21.15.53:0/1588308678 shutdown_connections 2024-09-13T18:28:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- 172.21.15.53:0/1588308678 wait complete. 2024-09-13T18:28:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 Processor -- start 2024-09-13T18:28:36.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- start start 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54e80b5570 0x7f54e814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e813cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54e81593a0 0x7f54e813d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e814f670 con 0x7f54e80ce3d0 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8157aa0 con 0x7f54e81593a0 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54ee21a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8157d80 con 0x7f54e80b5570 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e813cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e813cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58430/0 (socket says 172.21.15.53:58430) 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 -- 172.21.15.53:0/1877215614 learned_addr learned my addr 172.21.15.53:0/1877215614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54e7fff640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54e81593a0 0x7f54e813d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54e77fe640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54e80b5570 0x7f54e814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 -- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54e80b5570 msgr2=0x7f54e814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54e80b5570 0x7f54e814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 -- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54e81593a0 msgr2=0x7f54e813d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54e81593a0 0x7f54e813d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54dffff640 1 -- 172.21.15.53:0/1877215614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0009420 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.212+0000 7f54e77fe640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54e80b5570 0x7f54e814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54dffff640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e813cd50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ad040 tx=0x7f54d001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e4ff9640 1 -- 172.21.15.53:0/1877215614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00b5810 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e4ff9640 1 -- 172.21.15.53:0/1877215614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d00b5990 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e8158060 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e4ff9640 1 -- 172.21.15.53:0/1877215614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00b5d40 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e8158620 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e80b3230 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e4ff9640 1 -- 172.21.15.53:0/1877215614 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f54d00bf410 con 0x7f54e80ce3d0 2024-09-13T18:28:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e4ff9640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f54c8066840 0x7f54c8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e4ff9640 1 -- 172.21.15.53:0/1877215614 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54d011f080 con 0x7f54e80ce3d0 2024-09-13T18:28:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e77fe640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f54c8066840 0x7f54c8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.216+0000 7f54e77fe640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f54c8066840 0x7f54c8068d00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f54d8007fd0 tx=0x7f54d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:36.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.220+0000 7f54e4ff9640 1 -- 172.21.15.53:0/1877215614 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f54d00ec170 con 0x7f54e80ce3d0 2024-09-13T18:28:36.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.376+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54e8152370 con 0x7f54c8066840 2024-09-13T18:28:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.396+0000 7f54e4ff9640 1 -- 172.21.15.53:0/1877215614 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276856 (secure 0 0 0) 0x7f54e8152370 con 0x7f54c8066840 2024-09-13T18:28:36.405 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f54c8066840 msgr2=0x7f54c8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f54c8066840 0x7f54c8068d00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f54d8007fd0 tx=0x7f54d8009040 comp rx=0 tx=0).stop 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 msgr2=0x7f54e813cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e813cd50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ad040 tx=0x7f54d001ac90 comp rx=0 tx=0).stop 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 shutdown_connections 2024-09-13T18:28:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f54c8066840 0x7f54c8068d00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54e81593a0 0x7f54e813d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54e80ce3d0 0x7f54e813cd50 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 --2- 172.21.15.53:0/1877215614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54e80b5570 0x7f54e814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 >> 172.21.15.53:0/1877215614 conn(0x7f54e8069f50 msgr2=0x7f54e80cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 shutdown_connections 2024-09-13T18:28:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:36.400+0000 7f54ee21a640 1 -- 172.21.15.53:0/1877215614 wait complete. 2024-09-13T18:28:36.422 INFO:tasks.ceph.mds.c.smithi053.stderr:2024-09-13T18:28:36.416+0000 7f1e6b16b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:28:36.423 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-13T18:28:34.974615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":255428,"kb_used_data":6492,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719292,"statfs":{"total":773094113280,"available":772832555008,"internally_reserved":0,"allocated":6647808,"data_stored":3428591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.542106"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439674+0000","last_change":"2024-09-13T18:28:29.439674+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439674+0000","last_undegraded":"2024-09-13T18:28:29.439674+0000","last_fullsized":"2024-09-13T18:28:29.439674+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438633+0000","last_change":"2024-09-13T18:28:29.438633+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438633+0000","last_undegraded":"2024-09-13T18:28:29.438633+0000","last_fullsized":"2024-09-13T18:28:29.438633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:56.284668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440545+0000","last_change":"2024-09-13T18:28:29.440545+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440545+0000","last_undegraded":"2024-09-13T18:28:29.440545+0000","last_fullsized":"2024-09-13T18:28:29.440545+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440484+0000","last_change":"2024-09-13T18:28:29.440484+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440484+0000","last_undegraded":"2024-09-13T18:28:29.440484+0000","last_fullsized":"2024-09-13T18:28:29.440484+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:01.316915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436397+0000","last_change":"2024-09-13T18:28:29.436397+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436397+0000","last_undegraded":"2024-09-13T18:28:29.436397+0000","last_fullsized":"2024-09-13T18:28:29.436397+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439961+0000","last_change":"2024-09-13T18:28:29.439961+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439961+0000","last_undegraded":"2024-09-13T18:28:29.439961+0000","last_fullsized":"2024-09-13T18:28:29.439961+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441339+0000","last_change":"2024-09-13T18:28:29.441339+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441339+0000","last_undegraded":"2024-09-13T18:28:29.441339+0000","last_fullsized":"2024-09-13T18:28:29.441339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436465+0000","last_change":"2024-09-13T18:28:29.436465+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436465+0000","last_undegraded":"2024-09-13T18:28:29.436465+0000","last_fullsized":"2024-09-13T18:28:29.436465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445190+0000","last_change":"2024-09-13T18:28:29.445190+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445190+0000","last_undegraded":"2024-09-13T18:28:29.445190+0000","last_fullsized":"2024-09-13T18:28:29.445190+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438010+0000","last_change":"2024-09-13T18:28:29.438010+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438010+0000","last_undegraded":"2024-09-13T18:28:29.438010+0000","last_fullsized":"2024-09-13T18:28:29.438010+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:17.208941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445146+0000","last_change":"2024-09-13T18:28:29.445146+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445146+0000","last_undegraded":"2024-09-13T18:28:29.445146+0000","last_fullsized":"2024-09-13T18:28:29.445146+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436566+0000","last_change":"2024-09-13T18:28:29.436566+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436566+0000","last_undegraded":"2024-09-13T18:28:29.436566+0000","last_fullsized":"2024-09-13T18:28:29.436566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439618+0000","last_change":"2024-09-13T18:28:29.439618+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439618+0000","last_undegraded":"2024-09-13T18:28:29.439618+0000","last_fullsized":"2024-09-13T18:28:29.439618+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:58.957985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446040+0000","last_change":"2024-09-13T18:28:29.446040+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446040+0000","last_undegraded":"2024-09-13T18:28:29.446040+0000","last_fullsized":"2024-09-13T18:28:29.446040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438784+0000","last_change":"2024-09-13T18:28:29.438784+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438784+0000","last_undegraded":"2024-09-13T18:28:29.438784+0000","last_fullsized":"2024-09-13T18:28:29.438784+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:03.613090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445348+0000","last_change":"2024-09-13T18:28:29.445348+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445348+0000","last_undegraded":"2024-09-13T18:28:29.445348+0000","last_fullsized":"2024-09-13T18:28:29.445348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438127+0000","last_change":"2024-09-13T18:28:29.438127+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438127+0000","last_undegraded":"2024-09-13T18:28:29.438127+0000","last_fullsized":"2024-09-13T18:28:29.438127+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:49.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441114+0000","last_change":"2024-09-13T18:28:29.441114+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441114+0000","last_undegraded":"2024-09-13T18:28:29.441114+0000","last_fullsized":"2024-09-13T18:28:29.441114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438896+0000","last_change":"2024-09-13T18:28:29.438896+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438896+0000","last_undegraded":"2024-09-13T18:28:29.438896+0000","last_fullsized":"2024-09-13T18:28:29.438896+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:17.107893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.441109+0000","last_change":"2024-09-13T18:28:29.441109+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.441109+0000","last_undegraded":"2024-09-13T18:28:29.441109+0000","last_fullsized":"2024-09-13T18:28:29.441109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.437909+0000","last_change":"2024-09-13T18:28:29.437909+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.437909+0000","last_undegraded":"2024-09-13T18:28:29.437909+0000","last_fullsized":"2024-09-13T18:28:29.437909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:58.095328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434925+0000","last_change":"2024-09-13T18:28:29.434925+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434925+0000","last_undegraded":"2024-09-13T18:28:29.434925+0000","last_fullsized":"2024-09-13T18:28:29.434925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.439026+0000","last_change":"2024-09-13T18:28:29.439026+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.439026+0000","last_undegraded":"2024-09-13T18:28:29.439026+0000","last_fullsized":"2024-09-13T18:28:29.439026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434225+0000","last_change":"2024-09-13T18:28:29.434225+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434225+0000","last_undegraded":"2024-09-13T18:28:29.434225+0000","last_fullsized":"2024-09-13T18:28:29.434225+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.232562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.440516+0000","last_change":"2024-09-13T18:28:29.440516+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.440516+0000","last_undegraded":"2024-09-13T18:28:29.440516+0000","last_fullsized":"2024-09-13T18:28:29.440516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.446072+0000","last_change":"2024-09-13T18:28:29.446072+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.446072+0000","last_undegraded":"2024-09-13T18:28:29.446072+0000","last_fullsized":"2024-09-13T18:28:29.446072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438821+0000","last_change":"2024-09-13T18:28:29.438821+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438821+0000","last_undegraded":"2024-09-13T18:28:29.438821+0000","last_fullsized":"2024-09-13T18:28:29.438821+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.434027+0000","last_change":"2024-09-13T18:28:29.434027+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.434027+0000","last_undegraded":"2024-09-13T18:28:29.434027+0000","last_fullsized":"2024-09-13T18:28:29.434027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.436394+0000","last_change":"2024-09-13T18:28:29.436394+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.436394+0000","last_undegraded":"2024-09-13T18:28:29.436394+0000","last_fullsized":"2024-09-13T18:28:29.436394+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.435073+0000","last_change":"2024-09-13T18:28:29.435073+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.435073+0000","last_undegraded":"2024-09-13T18:28:29.435073+0000","last_fullsized":"2024-09-13T18:28:29.435073+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:49.247597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.438697+0000","last_change":"2024-09-13T18:28:29.438697+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.438697+0000","last_undegraded":"2024-09-13T18:28:29.438697+0000","last_fullsized":"2024-09-13T18:28:29.438697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:11.595273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:28:30.429156+0000","last_change":"2024-09-13T18:28:30.429156+0000","last_active":"2024-09-13T18:28:30.429156+0000","last_peered":"2024-09-13T18:28:30.429156+0000","last_clean":"2024-09-13T18:28:30.429156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:30.429156+0000","last_undegraded":"2024-09-13T18:28:30.429156+0000","last_fullsized":"2024-09-13T18:28:30.429156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-13T18:28:29.445708+0000","last_change":"2024-09-13T18:28:29.445708+0000","last_active":"2024-09-13T18:28:29.414065+0000","last_peered":"2024-09-13T18:28:29.414065+0000","last_clean":"2024-09-13T18:28:29.414065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:28:29.445708+0000","last_undegraded":"2024-09-13T18:28:29.445708+0000","last_fullsized":"2024-09-13T18:28:29.445708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.604812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T18:28:27.501415+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:28:27.501415+0000","last_peered":"2024-09-13T18:28:27.501415+0000","last_clean":"2024-09-13T18:28:27.501415+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:28:27.501415+0000","last_undegraded":"2024-09-13T18:28:27.501415+0000","last_fullsized":"2024-09-13T18:28:27.501415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.90800000000000003,"15min":0.876},"min":{"1min":0.77500000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.21,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.51200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.198,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.69399999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.095,"5min":1.448,"15min":1.448},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.93400000000000005,"15min":0.90600000000000003},"min":{"1min":0.75900000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90200000000000002,"15min":0.89300000000000002},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.1899999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.95399999999999996,"15min":0.94499999999999995},"min":{"1min":0.68799999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.056,"15min":1.0549999999999999},"min":{"1min":0.77800000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5609999999999999,"5min":1.877,"15min":1.877},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.996,"15min":0.97799999999999998},"min":{"1min":0.66600000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.069,"15min":1.0629999999999999},"min":{"1min":0.82299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3169999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.095,"5min":1.022,"15min":0.99199999999999999},"min":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.82899999999999996,"15min":0.83599999999999997},"min":{"1min":0.58799999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.198,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.80800000000000005,"15min":0.78200000000000003},"min":{"1min":0.60399999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.252,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1819999999999999,"5min":1.577,"15min":1.577},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.81200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.464,"15min":1.464},"last":1.0009999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.268,"15min":1.268},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.77600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2110000000000001,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.60999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89000000000000001,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.306,"15min":1.306},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98099999999999998,"15min":0.98699999999999999},"min":{"1min":0.64400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3149999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0109999999999999,"15min":0.995},"min":{"1min":0.76900000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.23,"5min":1.526,"15min":1.526},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.65900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.137,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.76400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3089999999999999,"5min":2.762,"15min":2.762},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0269999999999999,"15min":1.0429999999999999},"min":{"1min":0.65300000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.339,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.034,"15min":1.046},"min":{"1min":0.72599999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1579999999999999,"5min":1.72,"15min":1.72},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":275892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1659999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.90600000000000003,"15min":0.91600000000000004},"min":{"1min":0.60499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.84999999999999998,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.22,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82399999999999995},"min":{"1min":0.625,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.05,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1220000000000001,"5min":1.167,"15min":1.167},"last":1.087},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.96699999999999997,"15min":0.98199999999999998},"min":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2609999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.70299999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.0820000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.72599999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.181,"5min":1.871,"15min":1.871},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94299999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3029999999999999,"5min":1.413,"15min":1.413},"last":1.054},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.65100000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.24,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.012,"15min":1.0389999999999999},"min":{"1min":0.64700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0109999999999999,"15min":1.042},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1850000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.014}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0920000000000001,"15min":1.1339999999999999},"min":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.216,"5min":2.246,"15min":2.246},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2749999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.96299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.81599999999999995,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.133,"5min":1.252,"15min":1.252},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.177,"5min":1.256,"15min":1.256},"last":1.0840000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.64600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2170000000000001,"5min":1.329,"15min":1.329},"last":1.143},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88600000000000001,"15min":0.872},"min":{"1min":0.754,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1060000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.89700000000000002,"15min":0.89200000000000002},"min":{"1min":0.71799999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.171}]},{"osd":3,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.091,"5min":1.222,"15min":1.222},"last":0.871},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.74399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1459999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1240000000000001,"5min":1.298,"15min":1.298},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.252,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.95199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98999999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.129,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.012,"15min":1.024},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.377,"15min":1.377},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.048,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.26,"5min":1.482,"15min":1.482},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.0840000000000001},"min":{"1min":0.79600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.284,"5min":1.466,"15min":1.466},"last":1.0569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0349999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73199999999999998,"15min":0.69999999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.069,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.704,"15min":1.704},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94599999999999995,"5min":1.647,"15min":1.647},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75800000000000001,"15min":0.72899999999999998},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":1.399,"15min":1.399},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.76300000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.075,"5min":1.446,"15min":1.446},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1060000000000001,"15min":1.1339999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2909999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.996}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.034,"15min":1.026},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2529999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.93200000000000005},"min":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1830000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.375,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0509999999999999},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3129999999999999,"5min":1.96,"15min":1.96},"last":1.115}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.109},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4550000000000001,"5min":3,"15min":3},"last":0.624},{"interface":"front","average":{"1min":1.004,"5min":1.0009999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.258,"5min":1.702,"15min":1.702},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.98999999999999999,"5min":1.335,"15min":1.335},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.47199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.423,"15min":1.423},"last":0.437}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1830000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.194,"5min":1.274,"15min":1.274},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3240000000000001,"5min":1.611,"15min":1.611},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.179,"5min":1.492,"15min":1.492},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3140000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3680000000000001,"5min":1.702,"15min":1.702},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95899999999999996,"15min":0.95599999999999996},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2410000000000001,"5min":1.54,"15min":1.54},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2909999999999999,"5min":1.452,"15min":1.452},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.333,"5min":1.657,"15min":1.657},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.157,"5min":1.097,"15min":1.091},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4119999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":684032,"data_stored":281709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.62},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.177,"15min":1.177},"last":0.89800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0389999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.03,"5min":1.117,"15min":1.117},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.72899999999999998,"15min":0.71899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1240000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.99099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.91900000000000004,"15min":0.90400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.248,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.127},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92300000000000004},"min":{"1min":0.64900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.284,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.056}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2190000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.88},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.01,"15min":1.0269999999999999},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1839999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.276}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.359,"5min":1.653,"15min":1.653},"last":1.224},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.64700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5580000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.66200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.3660000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36460,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335380,"statfs":{"total":96636764160,"available":96599429120,"internally_reserved":0,"allocated":1277952,"data_stored":872077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.98299999999999998,"5min":1.147,"15min":1.147},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.085,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64600000000000002,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91400000000000003,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.153,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1200000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1970000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.071},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.996,"15min":0.998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.252,"5min":1.986,"15min":1.986},"last":1}]},{"osd":5,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.014},"min":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.357,"5min":2.641,"15min":2.641},"last":1.115},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3320000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.097}]},{"osd":6,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.083,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2769999999999999,"5min":1.891,"15min":1.891},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2310000000000001,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3160000000000001,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.1160000000000001,"15min":1.1060000000000001},"min":{"1min":0.79300000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.45,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.167}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:39.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:28:39.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5ab826640 1 Processor -- start 2024-09-13T18:28:39.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5ab826640 1 -- start start 2024-09-13T18:28:39.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5ab826640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5a41582a0 0x7fd5a406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5ab826640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a406d480 con 0x7fd5a415b7c0 2024-09-13T18:28:39.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5ab826640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a415ace0 con 0x7fd5a40713a0 2024-09-13T18:28:39.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5ab826640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a415aaf0 con 0x7fd5a41582a0 2024-09-13T18:28:39.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a8dc1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd5a415b7c0 0x7fd5a4070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40008/0 (socket says 172.21.15.53:40008) 2024-09-13T18:28:39.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a8dc1640 1 -- 172.21.15.53:0/367508166 learned_addr learned my addr 172.21.15.53:0/367508166 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980177905 0 0) 0x7fd5a406d480 con 0x7fd5a415b7c0 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd590003530 con 0x7fd5a415b7c0 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/367508166 >> v2:172.21.15.87:3300/0 conn(0x7fd5a41582a0 0x7fd5a406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3909820307 0 0) 0x7fd590003530 con 0x7fd5a415b7c0 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 >> v2:172.21.15.87:3300/0 conn(0x7fd5a41582a0 msgr2=0x7fd5a406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 --2- 172.21.15.53:0/367508166 >> v2:172.21.15.87:3300/0 conn(0x7fd5a41582a0 0x7fd5a406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 >> v1:172.21.15.87:6789/0 conn(0x7fd5a40713a0 legacy=0x7fd5a41640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a415afc0 con 0x7fd5a415b7c0 2024-09-13T18:28:39.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd594001680 con 0x7fd5a415b7c0 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 >> v1:172.21.15.53:6789/0 conn(0x7fd5a415b7c0 legacy=0x7fd5a4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd590003980 0x7fd590003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5900047d0 0x7fd590004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590005190 0x7fd59000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59000c000 con 0x7fd590003980 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59000c170 con 0x7fd5900047d0 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59000c330 con 0x7fd590005190 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd590003980 0x7fd590003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a9dc3640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590005190 0x7fd59000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a8dc1640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5900047d0 0x7fd590004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a95c2640 1 -- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590005190 msgr2=0x7fd59000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590005190 0x7fd59000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a95c2640 1 -- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5900047d0 msgr2=0x7fd590004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:39.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5900047d0 0x7fd590004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a9dc3640 1 -- 172.21.15.53:0/367508166 reap_dead start 2024-09-13T18:28:39.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a95c2640 1 -- 172.21.15.53:0/367508166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590003530 con 0x7fd590003980 2024-09-13T18:28:39.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.560+0000 7fd5a8dc1640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5900047d0 0x7fd590004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd590003980 0x7fd590003da0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009ae0 tx=0x7fd5a001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e73383a6338054 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00a55e0 con 0x7fd590003980 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a00a5740 con 0x7fd590003980 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd59bfff640 1 -- 172.21.15.53:0/367508166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00a5af0 con 0x7fd590003980 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5ab826640 1 -- 172.21.15.53:0/367508166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd590003980 msgr2=0x7fd590003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5ab826640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd590003980 0x7fd590003da0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009ae0 tx=0x7fd5a001ca70 comp rx=0 tx=0).stop 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5ab826640 1 -- 172.21.15.53:0/367508166 shutdown_connections 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5ab826640 1 --2- 172.21.15.53:0/367508166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd590003980 0x7fd590003da0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5ab826640 1 -- 172.21.15.53:0/367508166 >> 172.21.15.53:0/367508166 conn(0x7fd5a4065c80 msgr2=0x7fd5a4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5ab826640 1 -- 172.21.15.53:0/367508166 shutdown_connections 2024-09-13T18:28:39.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.564+0000 7fd5ab826640 1 -- 172.21.15.53:0/367508166 wait complete. 2024-09-13T18:28:39.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 Processor -- start 2024-09-13T18:28:39.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 -- start start 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590003980 0x7fd5a4152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5a4140390 0x7fd5a41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5a4155a10 0x7fd5a4150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4155ec0 con 0x7fd5a4140390 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4140810 con 0x7fd5a4155a10 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4140b30 con 0x7fd590003980 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5a4140390 0x7fd5a41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5a4140390 0x7fd5a41554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38898/0 (socket says 172.21.15.53:38898) 2024-09-13T18:28:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 -- 172.21.15.53:0/3288501333 learned_addr learned my addr 172.21.15.53:0/3288501333 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590003980 0x7fd5a4152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a9dc3640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5a4155a10 0x7fd5a4150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 -- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590003980 msgr2=0x7fd5a4152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590003980 0x7fd5a4152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 -- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5a4155a10 msgr2=0x7fd5a4150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5a4155a10 0x7fd5a4150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 -- 172.21.15.53:0/3288501333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4140e10 con 0x7fd5a4140390 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5a8dc1640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5a4140390 0x7fd5a41554d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd594007fd0 tx=0x7fd59400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd599ffb640 1 -- 172.21.15.53:0/3288501333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940072d0 con 0x7fd5a4140390 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd599ffb640 1 -- 172.21.15.53:0/3288501333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd594007430 con 0x7fd5a4140390 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a41410f0 con 0x7fd5a4140390 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd599ffb640 1 -- 172.21.15.53:0/3288501333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940047f0 con 0x7fd5a4140390 2024-09-13T18:28:39.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a41416b0 con 0x7fd5a4140390 2024-09-13T18:28:39.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a4067400 con 0x7fd5a4140390 2024-09-13T18:28:39.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd599ffb640 1 -- 172.21.15.53:0/3288501333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fd594004950 con 0x7fd5a4140390 2024-09-13T18:28:39.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.568+0000 7fd599ffb640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd588066870 0x7fd588068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.572+0000 7fd599ffb640 1 -- 172.21.15.53:0/3288501333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd594083f00 con 0x7fd5a4140390 2024-09-13T18:28:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.572+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd588066870 0x7fd588068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.572+0000 7fd5a95c2640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd588066870 0x7fd588068d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00af000 tx=0x7fd5a00046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.576+0000 7fd599ffb640 1 -- 172.21.15.53:0/3288501333 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5940510d0 con 0x7fd5a4140390 2024-09-13T18:28:39.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.728+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5a406f370 con 0x7fd588066870 2024-09-13T18:28:39.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.752+0000 7fd599ffb640 1 -- 172.21.15.53:0/3288501333 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287807 (secure 0 0 0) 0x7fd5a00a58b0 con 0x7fd588066870 2024-09-13T18:28:39.760 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:39.762 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd588066870 msgr2=0x7fd588068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd588066870 0x7fd588068d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00af000 tx=0x7fd5a00046d0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5a4140390 msgr2=0x7fd5a41554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5a4140390 0x7fd5a41554d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd594007fd0 tx=0x7fd59400db50 comp rx=0 tx=0).stop 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 shutdown_connections 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd588066870 0x7fd588068d30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5a4155a10 0x7fd5a4150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5a4140390 0x7fd5a41554d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 --2- 172.21.15.53:0/3288501333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd590003980 0x7fd5a4152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 >> 172.21.15.53:0/3288501333 conn(0x7fd5a4065c80 msgr2=0x7fd5a40cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 shutdown_connections 2024-09-13T18:28:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.756+0000 7fd5ab826640 1 -- 172.21.15.53:0/3288501333 wait complete. 2024-09-13T18:28:39.778 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-13T18:28:38.976064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255784,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754718936,"statfs":{"total":773094113280,"available":772832190464,"internally_reserved":0,"allocated":7020544,"data_stored":3593868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.132455"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.508075+0000","last_change":"2024-09-13T18:28:30.862761+0000","last_active":"2024-09-13T18:28:32.508075+0000","last_peered":"2024-09-13T18:28:32.508075+0000","last_clean":"2024-09-13T18:28:32.508075+0000","last_became_active":"2024-09-13T18:28:30.861824+0000","last_became_peered":"2024-09-13T18:28:30.861824+0000","last_unstale":"2024-09-13T18:28:32.508075+0000","last_undegraded":"2024-09-13T18:28:32.508075+0000","last_fullsized":"2024-09-13T18:28:32.508075+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:34.619903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852899+0000","last_change":"2024-09-13T18:28:30.860852+0000","last_active":"2024-09-13T18:28:31.852899+0000","last_peered":"2024-09-13T18:28:31.852899+0000","last_clean":"2024-09-13T18:28:31.852899+0000","last_became_active":"2024-09-13T18:28:30.860540+0000","last_became_peered":"2024-09-13T18:28:30.860540+0000","last_unstale":"2024-09-13T18:28:31.852899+0000","last_undegraded":"2024-09-13T18:28:31.852899+0000","last_fullsized":"2024-09-13T18:28:31.852899+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:12.340200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855489+0000","last_change":"2024-09-13T18:28:30.892604+0000","last_active":"2024-09-13T18:28:31.855489+0000","last_peered":"2024-09-13T18:28:31.855489+0000","last_clean":"2024-09-13T18:28:31.855489+0000","last_became_active":"2024-09-13T18:28:30.891939+0000","last_became_peered":"2024-09-13T18:28:30.891939+0000","last_unstale":"2024-09-13T18:28:31.855489+0000","last_undegraded":"2024-09-13T18:28:31.855489+0000","last_fullsized":"2024-09-13T18:28:31.855489+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:57.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505523+0000","last_change":"2024-09-13T18:28:30.895974+0000","last_active":"2024-09-13T18:28:32.505523+0000","last_peered":"2024-09-13T18:28:32.505523+0000","last_clean":"2024-09-13T18:28:32.505523+0000","last_became_active":"2024-09-13T18:28:30.894755+0000","last_became_peered":"2024-09-13T18:28:30.894755+0000","last_unstale":"2024-09-13T18:28:32.505523+0000","last_undegraded":"2024-09-13T18:28:32.505523+0000","last_fullsized":"2024-09-13T18:28:32.505523+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:16.943505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.507537+0000","last_change":"2024-09-13T18:28:30.888428+0000","last_active":"2024-09-13T18:28:32.507537+0000","last_peered":"2024-09-13T18:28:32.507537+0000","last_clean":"2024-09-13T18:28:32.507537+0000","last_became_active":"2024-09-13T18:28:30.888184+0000","last_became_peered":"2024-09-13T18:28:30.888184+0000","last_unstale":"2024-09-13T18:28:32.507537+0000","last_undegraded":"2024-09-13T18:28:32.507537+0000","last_fullsized":"2024-09-13T18:28:32.507537+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:26.936022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.506284+0000","last_change":"2024-09-13T18:28:30.851681+0000","last_active":"2024-09-13T18:28:32.506284+0000","last_peered":"2024-09-13T18:28:32.506284+0000","last_clean":"2024-09-13T18:28:32.506284+0000","last_became_active":"2024-09-13T18:28:30.851417+0000","last_became_peered":"2024-09-13T18:28:30.851417+0000","last_unstale":"2024-09-13T18:28:32.506284+0000","last_undegraded":"2024-09-13T18:28:32.506284+0000","last_fullsized":"2024-09-13T18:28:32.506284+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:16.943505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855285+0000","last_change":"2024-09-13T18:28:30.889889+0000","last_active":"2024-09-13T18:28:31.855285+0000","last_peered":"2024-09-13T18:28:31.855285+0000","last_clean":"2024-09-13T18:28:31.855285+0000","last_became_active":"2024-09-13T18:28:30.889168+0000","last_became_peered":"2024-09-13T18:28:30.889168+0000","last_unstale":"2024-09-13T18:28:31.855285+0000","last_undegraded":"2024-09-13T18:28:31.855285+0000","last_fullsized":"2024-09-13T18:28:31.855285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:27.371121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.851667+0000","last_change":"2024-09-13T18:28:30.865389+0000","last_active":"2024-09-13T18:28:31.851667+0000","last_peered":"2024-09-13T18:28:31.851667+0000","last_clean":"2024-09-13T18:28:31.851667+0000","last_became_active":"2024-09-13T18:28:30.865118+0000","last_became_peered":"2024-09-13T18:28:30.865118+0000","last_unstale":"2024-09-13T18:28:31.851667+0000","last_undegraded":"2024-09-13T18:28:31.851667+0000","last_fullsized":"2024-09-13T18:28:31.851667+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:43.342042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.856982+0000","last_change":"2024-09-13T18:28:30.854663+0000","last_active":"2024-09-13T18:28:31.856982+0000","last_peered":"2024-09-13T18:28:31.856982+0000","last_clean":"2024-09-13T18:28:31.856982+0000","last_became_active":"2024-09-13T18:28:30.853849+0000","last_became_peered":"2024-09-13T18:28:30.853849+0000","last_unstale":"2024-09-13T18:28:31.856982+0000","last_undegraded":"2024-09-13T18:28:31.856982+0000","last_fullsized":"2024-09-13T18:28:31.856982+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:25.911275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.508658+0000","last_change":"2024-09-13T18:28:30.877171+0000","last_active":"2024-09-13T18:28:32.508658+0000","last_peered":"2024-09-13T18:28:32.508658+0000","last_clean":"2024-09-13T18:28:32.508658+0000","last_became_active":"2024-09-13T18:28:30.876790+0000","last_became_peered":"2024-09-13T18:28:30.876790+0000","last_unstale":"2024-09-13T18:28:32.508658+0000","last_undegraded":"2024-09-13T18:28:32.508658+0000","last_fullsized":"2024-09-13T18:28:32.508658+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:22.778248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.508223+0000","last_change":"2024-09-13T18:28:30.865267+0000","last_active":"2024-09-13T18:28:32.508223+0000","last_peered":"2024-09-13T18:28:32.508223+0000","last_clean":"2024-09-13T18:28:32.508223+0000","last_became_active":"2024-09-13T18:28:30.864979+0000","last_became_peered":"2024-09-13T18:28:30.864979+0000","last_unstale":"2024-09-13T18:28:32.508223+0000","last_undegraded":"2024-09-13T18:28:32.508223+0000","last_fullsized":"2024-09-13T18:28:32.508223+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:48.262262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505794+0000","last_change":"2024-09-13T18:28:30.895426+0000","last_active":"2024-09-13T18:28:32.505794+0000","last_peered":"2024-09-13T18:28:32.505794+0000","last_clean":"2024-09-13T18:28:32.505794+0000","last_became_active":"2024-09-13T18:28:30.893980+0000","last_became_peered":"2024-09-13T18:28:30.893980+0000","last_unstale":"2024-09-13T18:28:32.505794+0000","last_undegraded":"2024-09-13T18:28:32.505794+0000","last_fullsized":"2024-09-13T18:28:32.505794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:50.722776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.504780+0000","last_change":"2024-09-13T18:28:30.878544+0000","last_active":"2024-09-13T18:28:32.504780+0000","last_peered":"2024-09-13T18:28:32.504780+0000","last_clean":"2024-09-13T18:28:32.504780+0000","last_became_active":"2024-09-13T18:28:30.877770+0000","last_became_peered":"2024-09-13T18:28:30.877770+0000","last_unstale":"2024-09-13T18:28:32.504780+0000","last_undegraded":"2024-09-13T18:28:32.504780+0000","last_fullsized":"2024-09-13T18:28:32.504780+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:04.489054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.856095+0000","last_change":"2024-09-13T18:28:30.853955+0000","last_active":"2024-09-13T18:28:31.856095+0000","last_peered":"2024-09-13T18:28:31.856095+0000","last_clean":"2024-09-13T18:28:31.856095+0000","last_became_active":"2024-09-13T18:28:30.853244+0000","last_became_peered":"2024-09-13T18:28:30.853244+0000","last_unstale":"2024-09-13T18:28:31.856095+0000","last_undegraded":"2024-09-13T18:28:31.856095+0000","last_fullsized":"2024-09-13T18:28:31.856095+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:48.658327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855651+0000","last_change":"2024-09-13T18:28:30.853296+0000","last_active":"2024-09-13T18:28:31.855651+0000","last_peered":"2024-09-13T18:28:31.855651+0000","last_clean":"2024-09-13T18:28:31.855651+0000","last_became_active":"2024-09-13T18:28:30.852564+0000","last_became_peered":"2024-09-13T18:28:30.852564+0000","last_unstale":"2024-09-13T18:28:31.855651+0000","last_undegraded":"2024-09-13T18:28:31.855651+0000","last_fullsized":"2024-09-13T18:28:31.855651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:28.824816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.504341+0000","last_change":"2024-09-13T18:28:30.877794+0000","last_active":"2024-09-13T18:28:32.504341+0000","last_peered":"2024-09-13T18:28:32.504341+0000","last_clean":"2024-09-13T18:28:32.504341+0000","last_became_active":"2024-09-13T18:28:30.877499+0000","last_became_peered":"2024-09-13T18:28:30.877499+0000","last_unstale":"2024-09-13T18:28:32.504341+0000","last_undegraded":"2024-09-13T18:28:32.504341+0000","last_fullsized":"2024-09-13T18:28:32.504341+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:57.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852911+0000","last_change":"2024-09-13T18:28:30.878972+0000","last_active":"2024-09-13T18:28:31.852911+0000","last_peered":"2024-09-13T18:28:31.852911+0000","last_clean":"2024-09-13T18:28:31.852911+0000","last_became_active":"2024-09-13T18:28:30.878588+0000","last_became_peered":"2024-09-13T18:28:30.878588+0000","last_unstale":"2024-09-13T18:28:31.852911+0000","last_undegraded":"2024-09-13T18:28:31.852911+0000","last_fullsized":"2024-09-13T18:28:31.852911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:15.398235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855105+0000","last_change":"2024-09-13T18:28:30.871669+0000","last_active":"2024-09-13T18:28:31.855105+0000","last_peered":"2024-09-13T18:28:31.855105+0000","last_clean":"2024-09-13T18:28:31.855105+0000","last_became_active":"2024-09-13T18:28:30.870650+0000","last_became_peered":"2024-09-13T18:28:30.870650+0000","last_unstale":"2024-09-13T18:28:31.855105+0000","last_undegraded":"2024-09-13T18:28:31.855105+0000","last_fullsized":"2024-09-13T18:28:31.855105+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:49.648830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.508091+0000","last_change":"2024-09-13T18:28:30.865270+0000","last_active":"2024-09-13T18:28:32.508091+0000","last_peered":"2024-09-13T18:28:32.508091+0000","last_clean":"2024-09-13T18:28:32.508091+0000","last_became_active":"2024-09-13T18:28:30.864725+0000","last_became_peered":"2024-09-13T18:28:30.864725+0000","last_unstale":"2024-09-13T18:28:32.508091+0000","last_undegraded":"2024-09-13T18:28:32.508091+0000","last_fullsized":"2024-09-13T18:28:32.508091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:46.205910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852062+0000","last_change":"2024-09-13T18:28:30.860650+0000","last_active":"2024-09-13T18:28:31.852062+0000","last_peered":"2024-09-13T18:28:31.852062+0000","last_clean":"2024-09-13T18:28:31.852062+0000","last_became_active":"2024-09-13T18:28:30.859624+0000","last_became_peered":"2024-09-13T18:28:30.859624+0000","last_unstale":"2024-09-13T18:28:31.852062+0000","last_undegraded":"2024-09-13T18:28:31.852062+0000","last_fullsized":"2024-09-13T18:28:31.852062+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:08.555558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855235+0000","last_change":"2024-09-13T18:28:30.902194+0000","last_active":"2024-09-13T18:28:31.855235+0000","last_peered":"2024-09-13T18:28:31.855235+0000","last_clean":"2024-09-13T18:28:31.855235+0000","last_became_active":"2024-09-13T18:28:30.901515+0000","last_became_peered":"2024-09-13T18:28:30.901515+0000","last_unstale":"2024-09-13T18:28:31.855235+0000","last_undegraded":"2024-09-13T18:28:31.855235+0000","last_fullsized":"2024-09-13T18:28:31.855235+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:16.943505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852042+0000","last_change":"2024-09-13T18:28:30.868907+0000","last_active":"2024-09-13T18:28:31.852042+0000","last_peered":"2024-09-13T18:28:31.852042+0000","last_clean":"2024-09-13T18:28:31.852042+0000","last_became_active":"2024-09-13T18:28:30.868473+0000","last_became_peered":"2024-09-13T18:28:30.868473+0000","last_unstale":"2024-09-13T18:28:31.852042+0000","last_undegraded":"2024-09-13T18:28:31.852042+0000","last_fullsized":"2024-09-13T18:28:31.852042+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:19.678897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.854824+0000","last_change":"2024-09-13T18:28:30.880706+0000","last_active":"2024-09-13T18:28:31.854824+0000","last_peered":"2024-09-13T18:28:31.854824+0000","last_clean":"2024-09-13T18:28:31.854824+0000","last_became_active":"2024-09-13T18:28:30.874842+0000","last_became_peered":"2024-09-13T18:28:30.874842+0000","last_unstale":"2024-09-13T18:28:31.854824+0000","last_undegraded":"2024-09-13T18:28:31.854824+0000","last_fullsized":"2024-09-13T18:28:31.854824+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:53.513753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.504494+0000","last_change":"2024-09-13T18:28:30.877025+0000","last_active":"2024-09-13T18:28:32.504494+0000","last_peered":"2024-09-13T18:28:32.504494+0000","last_clean":"2024-09-13T18:28:32.504494+0000","last_became_active":"2024-09-13T18:28:30.875988+0000","last_became_peered":"2024-09-13T18:28:30.875988+0000","last_unstale":"2024-09-13T18:28:32.504494+0000","last_undegraded":"2024-09-13T18:28:32.504494+0000","last_fullsized":"2024-09-13T18:28:32.504494+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:12.178201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.508212+0000","last_change":"2024-09-13T18:28:30.858890+0000","last_active":"2024-09-13T18:28:32.508212+0000","last_peered":"2024-09-13T18:28:32.508212+0000","last_clean":"2024-09-13T18:28:32.508212+0000","last_became_active":"2024-09-13T18:28:30.858508+0000","last_became_peered":"2024-09-13T18:28:30.858508+0000","last_unstale":"2024-09-13T18:28:32.508212+0000","last_undegraded":"2024-09-13T18:28:32.508212+0000","last_fullsized":"2024-09-13T18:28:32.508212+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:51.712251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.504893+0000","last_change":"2024-09-13T18:28:30.897093+0000","last_active":"2024-09-13T18:28:32.504893+0000","last_peered":"2024-09-13T18:28:32.504893+0000","last_clean":"2024-09-13T18:28:32.504893+0000","last_became_active":"2024-09-13T18:28:30.896407+0000","last_became_peered":"2024-09-13T18:28:30.896407+0000","last_unstale":"2024-09-13T18:28:32.504893+0000","last_undegraded":"2024-09-13T18:28:32.504893+0000","last_fullsized":"2024-09-13T18:28:32.504893+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:53.513753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505765+0000","last_change":"2024-09-13T18:28:30.884884+0000","last_active":"2024-09-13T18:28:32.505765+0000","last_peered":"2024-09-13T18:28:32.505765+0000","last_clean":"2024-09-13T18:28:32.505765+0000","last_became_active":"2024-09-13T18:28:30.884606+0000","last_became_peered":"2024-09-13T18:28:30.884606+0000","last_unstale":"2024-09-13T18:28:32.505765+0000","last_undegraded":"2024-09-13T18:28:32.505765+0000","last_fullsized":"2024-09-13T18:28:32.505765+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:59.110419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.508029+0000","last_change":"2024-09-13T18:28:30.901148+0000","last_active":"2024-09-13T18:28:32.508029+0000","last_peered":"2024-09-13T18:28:32.508029+0000","last_clean":"2024-09-13T18:28:32.508029+0000","last_became_active":"2024-09-13T18:28:30.900886+0000","last_became_peered":"2024-09-13T18:28:30.900886+0000","last_unstale":"2024-09-13T18:28:32.508029+0000","last_undegraded":"2024-09-13T18:28:32.508029+0000","last_fullsized":"2024-09-13T18:28:32.508029+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:41.130988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852562+0000","last_change":"2024-09-13T18:28:30.888532+0000","last_active":"2024-09-13T18:28:31.852562+0000","last_peered":"2024-09-13T18:28:31.852562+0000","last_clean":"2024-09-13T18:28:31.852562+0000","last_became_active":"2024-09-13T18:28:30.888212+0000","last_became_peered":"2024-09-13T18:28:30.888212+0000","last_unstale":"2024-09-13T18:28:31.852562+0000","last_undegraded":"2024-09-13T18:28:31.852562+0000","last_fullsized":"2024-09-13T18:28:31.852562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:30.108205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855624+0000","last_change":"2024-09-13T18:28:30.892591+0000","last_active":"2024-09-13T18:28:31.855624+0000","last_peered":"2024-09-13T18:28:31.855624+0000","last_clean":"2024-09-13T18:28:31.855624+0000","last_became_active":"2024-09-13T18:28:30.891843+0000","last_became_peered":"2024-09-13T18:28:30.891843+0000","last_unstale":"2024-09-13T18:28:31.855624+0000","last_undegraded":"2024-09-13T18:28:31.855624+0000","last_fullsized":"2024-09-13T18:28:31.855624+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:12.610364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505913+0000","last_change":"2024-09-13T18:28:30.855258+0000","last_active":"2024-09-13T18:28:32.505913+0000","last_peered":"2024-09-13T18:28:32.505913+0000","last_clean":"2024-09-13T18:28:32.505913+0000","last_became_active":"2024-09-13T18:28:30.854865+0000","last_became_peered":"2024-09-13T18:28:30.854865+0000","last_unstale":"2024-09-13T18:28:32.505913+0000","last_undegraded":"2024-09-13T18:28:32.505913+0000","last_fullsized":"2024-09-13T18:28:32.505913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.779749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505019+0000","last_change":"2024-09-13T18:28:30.862882+0000","last_active":"2024-09-13T18:28:32.505019+0000","last_peered":"2024-09-13T18:28:32.505019+0000","last_clean":"2024-09-13T18:28:32.505019+0000","last_became_active":"2024-09-13T18:28:30.857799+0000","last_became_peered":"2024-09-13T18:28:30.857799+0000","last_unstale":"2024-09-13T18:28:32.505019+0000","last_undegraded":"2024-09-13T18:28:32.505019+0000","last_fullsized":"2024-09-13T18:28:32.505019+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:49.648830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.506018+0000","last_change":"2024-09-13T18:28:30.870100+0000","last_active":"2024-09-13T18:28:32.506018+0000","last_peered":"2024-09-13T18:28:32.506018+0000","last_clean":"2024-09-13T18:28:32.506018+0000","last_became_active":"2024-09-13T18:28:30.869207+0000","last_became_peered":"2024-09-13T18:28:30.869207+0000","last_unstale":"2024-09-13T18:28:32.506018+0000","last_undegraded":"2024-09-13T18:28:32.506018+0000","last_fullsized":"2024-09-13T18:28:32.506018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:27.884167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.900866+0000","last_change":"2024-09-13T18:28:30.479471+0000","last_active":"2024-09-13T18:28:30.900866+0000","last_peered":"2024-09-13T18:28:30.900866+0000","last_clean":"2024-09-13T18:28:30.900866+0000","last_became_active":"2024-09-13T18:28:30.479106+0000","last_became_peered":"2024-09-13T18:28:30.479106+0000","last_unstale":"2024-09-13T18:28:30.900866+0000","last_undegraded":"2024-09-13T18:28:30.900866+0000","last_fullsized":"2024-09-13T18:28:30.900866+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.508975+0000","last_change":"2024-09-13T18:28:30.873220+0000","last_active":"2024-09-13T18:28:32.508975+0000","last_peered":"2024-09-13T18:28:32.508975+0000","last_clean":"2024-09-13T18:28:32.508975+0000","last_became_active":"2024-09-13T18:28:30.872378+0000","last_became_peered":"2024-09-13T18:28:30.872378+0000","last_unstale":"2024-09-13T18:28:32.508975+0000","last_undegraded":"2024-09-13T18:28:32.508975+0000","last_fullsized":"2024-09-13T18:28:32.508975+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:39.016729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.874089+0000","last_change":"2024-09-13T18:28:30.476429+0000","last_active":"2024-09-13T18:28:30.874089+0000","last_peered":"2024-09-13T18:28:30.874089+0000","last_clean":"2024-09-13T18:28:30.874089+0000","last_became_active":"2024-09-13T18:28:30.475095+0000","last_became_peered":"2024-09-13T18:28:30.475095+0000","last_unstale":"2024-09-13T18:28:30.874089+0000","last_undegraded":"2024-09-13T18:28:30.874089+0000","last_fullsized":"2024-09-13T18:28:30.874089+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:56.284668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.506100+0000","last_change":"2024-09-13T18:28:30.850418+0000","last_active":"2024-09-13T18:28:32.506100+0000","last_peered":"2024-09-13T18:28:32.506100+0000","last_clean":"2024-09-13T18:28:32.506100+0000","last_became_active":"2024-09-13T18:28:30.850240+0000","last_became_peered":"2024-09-13T18:28:30.850240+0000","last_unstale":"2024-09-13T18:28:32.506100+0000","last_undegraded":"2024-09-13T18:28:32.506100+0000","last_fullsized":"2024-09-13T18:28:32.506100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:12.610364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.871209+0000","last_change":"2024-09-13T18:28:30.469328+0000","last_active":"2024-09-13T18:28:30.871209+0000","last_peered":"2024-09-13T18:28:30.871209+0000","last_clean":"2024-09-13T18:28:30.871209+0000","last_became_active":"2024-09-13T18:28:30.468942+0000","last_became_peered":"2024-09-13T18:28:30.468942+0000","last_unstale":"2024-09-13T18:28:30.871209+0000","last_undegraded":"2024-09-13T18:28:30.871209+0000","last_fullsized":"2024-09-13T18:28:30.871209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.506045+0000","last_change":"2024-09-13T18:28:30.888025+0000","last_active":"2024-09-13T18:28:32.506045+0000","last_peered":"2024-09-13T18:28:32.506045+0000","last_clean":"2024-09-13T18:28:32.506045+0000","last_became_active":"2024-09-13T18:28:30.887739+0000","last_became_peered":"2024-09-13T18:28:30.887739+0000","last_unstale":"2024-09-13T18:28:32.506045+0000","last_undegraded":"2024-09-13T18:28:32.506045+0000","last_fullsized":"2024-09-13T18:28:32.506045+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:50.722776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.900948+0000","last_change":"2024-09-13T18:28:30.478391+0000","last_active":"2024-09-13T18:28:30.900948+0000","last_peered":"2024-09-13T18:28:30.900948+0000","last_clean":"2024-09-13T18:28:30.900948+0000","last_became_active":"2024-09-13T18:28:30.477592+0000","last_became_peered":"2024-09-13T18:28:30.477592+0000","last_unstale":"2024-09-13T18:28:30.900948+0000","last_undegraded":"2024-09-13T18:28:30.900948+0000","last_fullsized":"2024-09-13T18:28:30.900948+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:01.316915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852217+0000","last_change":"2024-09-13T18:28:30.868745+0000","last_active":"2024-09-13T18:28:31.852217+0000","last_peered":"2024-09-13T18:28:31.852217+0000","last_clean":"2024-09-13T18:28:31.852217+0000","last_became_active":"2024-09-13T18:28:30.868137+0000","last_became_peered":"2024-09-13T18:28:30.868137+0000","last_unstale":"2024-09-13T18:28:31.852217+0000","last_undegraded":"2024-09-13T18:28:31.852217+0000","last_fullsized":"2024-09-13T18:28:31.852217+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:03.766823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.873410+0000","last_change":"2024-09-13T18:28:30.478608+0000","last_active":"2024-09-13T18:28:30.873410+0000","last_peered":"2024-09-13T18:28:30.873410+0000","last_clean":"2024-09-13T18:28:30.873410+0000","last_became_active":"2024-09-13T18:28:30.474412+0000","last_became_peered":"2024-09-13T18:28:30.474412+0000","last_unstale":"2024-09-13T18:28:30.873410+0000","last_undegraded":"2024-09-13T18:28:30.873410+0000","last_fullsized":"2024-09-13T18:28:30.873410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852240+0000","last_change":"2024-09-13T18:28:30.860857+0000","last_active":"2024-09-13T18:28:31.852240+0000","last_peered":"2024-09-13T18:28:31.852240+0000","last_clean":"2024-09-13T18:28:31.852240+0000","last_became_active":"2024-09-13T18:28:30.860629+0000","last_became_peered":"2024-09-13T18:28:30.860629+0000","last_unstale":"2024-09-13T18:28:31.852240+0000","last_undegraded":"2024-09-13T18:28:31.852240+0000","last_fullsized":"2024-09-13T18:28:31.852240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:48.337396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.885714+0000","last_change":"2024-09-13T18:28:30.463081+0000","last_active":"2024-09-13T18:28:30.885714+0000","last_peered":"2024-09-13T18:28:30.885714+0000","last_clean":"2024-09-13T18:28:30.885714+0000","last_became_active":"2024-09-13T18:28:30.462782+0000","last_became_peered":"2024-09-13T18:28:30.462782+0000","last_unstale":"2024-09-13T18:28:30.885714+0000","last_undegraded":"2024-09-13T18:28:30.885714+0000","last_fullsized":"2024-09-13T18:28:30.885714+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.504496+0000","last_change":"2024-09-13T18:28:30.885261+0000","last_active":"2024-09-13T18:28:32.504496+0000","last_peered":"2024-09-13T18:28:32.504496+0000","last_clean":"2024-09-13T18:28:32.504496+0000","last_became_active":"2024-09-13T18:28:30.884594+0000","last_became_peered":"2024-09-13T18:28:30.884594+0000","last_unstale":"2024-09-13T18:28:32.504496+0000","last_undegraded":"2024-09-13T18:28:32.504496+0000","last_fullsized":"2024-09-13T18:28:32.504496+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:32.418147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.878048+0000","last_change":"2024-09-13T18:28:30.483667+0000","last_active":"2024-09-13T18:28:30.878048+0000","last_peered":"2024-09-13T18:28:30.878048+0000","last_clean":"2024-09-13T18:28:30.878048+0000","last_became_active":"2024-09-13T18:28:30.483003+0000","last_became_peered":"2024-09-13T18:28:30.483003+0000","last_unstale":"2024-09-13T18:28:30.878048+0000","last_undegraded":"2024-09-13T18:28:30.878048+0000","last_fullsized":"2024-09-13T18:28:30.878048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:51.262497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.851726+0000","last_change":"2024-09-13T18:28:30.885724+0000","last_active":"2024-09-13T18:28:31.851726+0000","last_peered":"2024-09-13T18:28:31.851726+0000","last_clean":"2024-09-13T18:28:31.851726+0000","last_became_active":"2024-09-13T18:28:30.885466+0000","last_became_peered":"2024-09-13T18:28:30.885466+0000","last_unstale":"2024-09-13T18:28:31.851726+0000","last_undegraded":"2024-09-13T18:28:31.851726+0000","last_fullsized":"2024-09-13T18:28:31.851726+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:19.916116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.848026+0000","last_change":"2024-09-13T18:28:30.479139+0000","last_active":"2024-09-13T18:28:30.848026+0000","last_peered":"2024-09-13T18:28:30.848026+0000","last_clean":"2024-09-13T18:28:30.848026+0000","last_became_active":"2024-09-13T18:28:30.478080+0000","last_became_peered":"2024-09-13T18:28:30.478080+0000","last_unstale":"2024-09-13T18:28:30.848026+0000","last_undegraded":"2024-09-13T18:28:30.848026+0000","last_fullsized":"2024-09-13T18:28:30.848026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.857122+0000","last_change":"2024-09-13T18:28:30.853285+0000","last_active":"2024-09-13T18:28:31.857122+0000","last_peered":"2024-09-13T18:28:31.857122+0000","last_clean":"2024-09-13T18:28:31.857122+0000","last_became_active":"2024-09-13T18:28:30.852527+0000","last_became_peered":"2024-09-13T18:28:30.852527+0000","last_unstale":"2024-09-13T18:28:31.857122+0000","last_undegraded":"2024-09-13T18:28:31.857122+0000","last_fullsized":"2024-09-13T18:28:31.857122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:18.224031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.863398+0000","last_change":"2024-09-13T18:28:30.483862+0000","last_active":"2024-09-13T18:28:30.863398+0000","last_peered":"2024-09-13T18:28:30.863398+0000","last_clean":"2024-09-13T18:28:30.863398+0000","last_became_active":"2024-09-13T18:28:30.483202+0000","last_became_peered":"2024-09-13T18:28:30.483202+0000","last_unstale":"2024-09-13T18:28:30.863398+0000","last_undegraded":"2024-09-13T18:28:30.863398+0000","last_fullsized":"2024-09-13T18:28:30.863398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:49.539289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.856106+0000","last_change":"2024-09-13T18:28:30.884774+0000","last_active":"2024-09-13T18:28:31.856106+0000","last_peered":"2024-09-13T18:28:31.856106+0000","last_clean":"2024-09-13T18:28:31.856106+0000","last_became_active":"2024-09-13T18:28:30.884038+0000","last_became_peered":"2024-09-13T18:28:30.884038+0000","last_unstale":"2024-09-13T18:28:31.856106+0000","last_undegraded":"2024-09-13T18:28:31.856106+0000","last_fullsized":"2024-09-13T18:28:31.856106+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:01.431018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.857455+0000","last_change":"2024-09-13T18:28:30.474109+0000","last_active":"2024-09-13T18:28:30.857455+0000","last_peered":"2024-09-13T18:28:30.857455+0000","last_clean":"2024-09-13T18:28:30.857455+0000","last_became_active":"2024-09-13T18:28:30.469970+0000","last_became_peered":"2024-09-13T18:28:30.469970+0000","last_unstale":"2024-09-13T18:28:30.857455+0000","last_undegraded":"2024-09-13T18:28:30.857455+0000","last_fullsized":"2024-09-13T18:28:30.857455+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:17.208941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.504823+0000","last_change":"2024-09-13T18:28:30.878046+0000","last_active":"2024-09-13T18:28:32.504823+0000","last_peered":"2024-09-13T18:28:32.504823+0000","last_clean":"2024-09-13T18:28:32.504823+0000","last_became_active":"2024-09-13T18:28:30.877696+0000","last_became_peered":"2024-09-13T18:28:30.877696+0000","last_unstale":"2024-09-13T18:28:32.504823+0000","last_undegraded":"2024-09-13T18:28:32.504823+0000","last_fullsized":"2024-09-13T18:28:32.504823+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:34.294100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.885069+0000","last_change":"2024-09-13T18:28:30.486499+0000","last_active":"2024-09-13T18:28:30.885069+0000","last_peered":"2024-09-13T18:28:30.885069+0000","last_clean":"2024-09-13T18:28:30.885069+0000","last_became_active":"2024-09-13T18:28:30.485762+0000","last_became_peered":"2024-09-13T18:28:30.485762+0000","last_unstale":"2024-09-13T18:28:30.885069+0000","last_undegraded":"2024-09-13T18:28:30.885069+0000","last_fullsized":"2024-09-13T18:28:30.885069+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:43.491003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855735+0000","last_change":"2024-09-13T18:28:30.881768+0000","last_active":"2024-09-13T18:28:31.855735+0000","last_peered":"2024-09-13T18:28:31.855735+0000","last_clean":"2024-09-13T18:28:31.855735+0000","last_became_active":"2024-09-13T18:28:30.881058+0000","last_became_peered":"2024-09-13T18:28:30.881058+0000","last_unstale":"2024-09-13T18:28:31.855735+0000","last_undegraded":"2024-09-13T18:28:31.855735+0000","last_fullsized":"2024-09-13T18:28:31.855735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:59.110419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.898120+0000","last_change":"2024-09-13T18:28:30.477972+0000","last_active":"2024-09-13T18:28:30.898120+0000","last_peered":"2024-09-13T18:28:30.898120+0000","last_clean":"2024-09-13T18:28:30.898120+0000","last_became_active":"2024-09-13T18:28:30.474386+0000","last_became_peered":"2024-09-13T18:28:30.474386+0000","last_unstale":"2024-09-13T18:28:30.898120+0000","last_undegraded":"2024-09-13T18:28:30.898120+0000","last_fullsized":"2024-09-13T18:28:30.898120+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505132+0000","last_change":"2024-09-13T18:28:30.893438+0000","last_active":"2024-09-13T18:28:32.505132+0000","last_peered":"2024-09-13T18:28:32.505132+0000","last_clean":"2024-09-13T18:28:32.505132+0000","last_became_active":"2024-09-13T18:28:30.888178+0000","last_became_peered":"2024-09-13T18:28:30.888178+0000","last_unstale":"2024-09-13T18:28:32.505132+0000","last_undegraded":"2024-09-13T18:28:32.505132+0000","last_fullsized":"2024-09-13T18:28:32.505132+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:27.884167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.864346+0000","last_change":"2024-09-13T18:28:30.460196+0000","last_active":"2024-09-13T18:28:30.864346+0000","last_peered":"2024-09-13T18:28:30.864346+0000","last_clean":"2024-09-13T18:28:30.864346+0000","last_became_active":"2024-09-13T18:28:30.459428+0000","last_became_peered":"2024-09-13T18:28:30.459428+0000","last_unstale":"2024-09-13T18:28:30.864346+0000","last_undegraded":"2024-09-13T18:28:30.864346+0000","last_fullsized":"2024-09-13T18:28:30.864346+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:58.957985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855472+0000","last_change":"2024-09-13T18:28:30.889472+0000","last_active":"2024-09-13T18:28:31.855472+0000","last_peered":"2024-09-13T18:28:31.855472+0000","last_clean":"2024-09-13T18:28:31.855472+0000","last_became_active":"2024-09-13T18:28:30.888869+0000","last_became_peered":"2024-09-13T18:28:30.888869+0000","last_unstale":"2024-09-13T18:28:31.855472+0000","last_undegraded":"2024-09-13T18:28:31.855472+0000","last_fullsized":"2024-09-13T18:28:31.855472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:27.371121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.856302+0000","last_change":"2024-09-13T18:28:30.472798+0000","last_active":"2024-09-13T18:28:30.856302+0000","last_peered":"2024-09-13T18:28:30.856302+0000","last_clean":"2024-09-13T18:28:30.856302+0000","last_became_active":"2024-09-13T18:28:30.471899+0000","last_became_peered":"2024-09-13T18:28:30.471899+0000","last_unstale":"2024-09-13T18:28:30.856302+0000","last_undegraded":"2024-09-13T18:28:30.856302+0000","last_fullsized":"2024-09-13T18:28:30.856302+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.854805+0000","last_change":"2024-09-13T18:28:30.872276+0000","last_active":"2024-09-13T18:28:31.854805+0000","last_peered":"2024-09-13T18:28:31.854805+0000","last_clean":"2024-09-13T18:28:31.854805+0000","last_became_active":"2024-09-13T18:28:30.871496+0000","last_became_peered":"2024-09-13T18:28:30.871496+0000","last_unstale":"2024-09-13T18:28:31.854805+0000","last_undegraded":"2024-09-13T18:28:31.854805+0000","last_fullsized":"2024-09-13T18:28:31.854805+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:46.341229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.878294+0000","last_change":"2024-09-13T18:28:30.477542+0000","last_active":"2024-09-13T18:28:30.878294+0000","last_peered":"2024-09-13T18:28:30.878294+0000","last_clean":"2024-09-13T18:28:30.878294+0000","last_became_active":"2024-09-13T18:28:30.476825+0000","last_became_peered":"2024-09-13T18:28:30.476825+0000","last_unstale":"2024-09-13T18:28:30.878294+0000","last_undegraded":"2024-09-13T18:28:30.878294+0000","last_fullsized":"2024-09-13T18:28:30.878294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:03.613090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855072+0000","last_change":"2024-09-13T18:28:30.876640+0000","last_active":"2024-09-13T18:28:31.855072+0000","last_peered":"2024-09-13T18:28:31.855072+0000","last_clean":"2024-09-13T18:28:31.855072+0000","last_became_active":"2024-09-13T18:28:30.875960+0000","last_became_peered":"2024-09-13T18:28:30.875960+0000","last_unstale":"2024-09-13T18:28:31.855072+0000","last_undegraded":"2024-09-13T18:28:31.855072+0000","last_fullsized":"2024-09-13T18:28:31.855072+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.531078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.902979+0000","last_change":"2024-09-13T18:28:30.485283+0000","last_active":"2024-09-13T18:28:30.902979+0000","last_peered":"2024-09-13T18:28:30.902979+0000","last_clean":"2024-09-13T18:28:30.902979+0000","last_became_active":"2024-09-13T18:28:30.484615+0000","last_became_peered":"2024-09-13T18:28:30.484615+0000","last_unstale":"2024-09-13T18:28:30.902979+0000","last_undegraded":"2024-09-13T18:28:30.902979+0000","last_fullsized":"2024-09-13T18:28:30.902979+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855240+0000","last_change":"2024-09-13T18:28:30.893048+0000","last_active":"2024-09-13T18:28:31.855240+0000","last_peered":"2024-09-13T18:28:31.855240+0000","last_clean":"2024-09-13T18:28:31.855240+0000","last_became_active":"2024-09-13T18:28:30.892145+0000","last_became_peered":"2024-09-13T18:28:30.892145+0000","last_unstale":"2024-09-13T18:28:31.855240+0000","last_undegraded":"2024-09-13T18:28:31.855240+0000","last_fullsized":"2024-09-13T18:28:31.855240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:27.884167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.864262+0000","last_change":"2024-09-13T18:28:30.474901+0000","last_active":"2024-09-13T18:28:30.864262+0000","last_peered":"2024-09-13T18:28:30.864262+0000","last_clean":"2024-09-13T18:28:30.864262+0000","last_became_active":"2024-09-13T18:28:30.474416+0000","last_became_peered":"2024-09-13T18:28:30.474416+0000","last_unstale":"2024-09-13T18:28:30.864262+0000","last_undegraded":"2024-09-13T18:28:30.864262+0000","last_fullsized":"2024-09-13T18:28:30.864262+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:49.632247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505594+0000","last_change":"2024-09-13T18:28:30.887964+0000","last_active":"2024-09-13T18:28:32.505594+0000","last_peered":"2024-09-13T18:28:32.505594+0000","last_clean":"2024-09-13T18:28:32.505594+0000","last_became_active":"2024-09-13T18:28:30.887052+0000","last_became_peered":"2024-09-13T18:28:30.887052+0000","last_unstale":"2024-09-13T18:28:32.505594+0000","last_undegraded":"2024-09-13T18:28:32.505594+0000","last_fullsized":"2024-09-13T18:28:32.505594+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:12.610364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.868210+0000","last_change":"2024-09-13T18:28:30.472075+0000","last_active":"2024-09-13T18:28:30.868210+0000","last_peered":"2024-09-13T18:28:30.868210+0000","last_clean":"2024-09-13T18:28:30.868210+0000","last_became_active":"2024-09-13T18:28:30.471808+0000","last_became_peered":"2024-09-13T18:28:30.471808+0000","last_unstale":"2024-09-13T18:28:30.868210+0000","last_undegraded":"2024-09-13T18:28:30.868210+0000","last_fullsized":"2024-09-13T18:28:30.868210+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852636+0000","last_change":"2024-09-13T18:28:30.877954+0000","last_active":"2024-09-13T18:28:31.852636+0000","last_peered":"2024-09-13T18:28:31.852636+0000","last_clean":"2024-09-13T18:28:31.852636+0000","last_became_active":"2024-09-13T18:28:30.877593+0000","last_became_peered":"2024-09-13T18:28:30.877593+0000","last_unstale":"2024-09-13T18:28:31.852636+0000","last_undegraded":"2024-09-13T18:28:31.852636+0000","last_fullsized":"2024-09-13T18:28:31.852636+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:07.473792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.900601+0000","last_change":"2024-09-13T18:28:30.481521+0000","last_active":"2024-09-13T18:28:30.900601+0000","last_peered":"2024-09-13T18:28:30.900601+0000","last_clean":"2024-09-13T18:28:30.900601+0000","last_became_active":"2024-09-13T18:28:30.480758+0000","last_became_peered":"2024-09-13T18:28:30.480758+0000","last_unstale":"2024-09-13T18:28:30.900601+0000","last_undegraded":"2024-09-13T18:28:30.900601+0000","last_fullsized":"2024-09-13T18:28:30.900601+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:17.107893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855969+0000","last_change":"2024-09-13T18:28:30.884734+0000","last_active":"2024-09-13T18:28:31.855969+0000","last_peered":"2024-09-13T18:28:31.855969+0000","last_clean":"2024-09-13T18:28:31.855969+0000","last_became_active":"2024-09-13T18:28:30.883962+0000","last_became_peered":"2024-09-13T18:28:30.883962+0000","last_unstale":"2024-09-13T18:28:31.855969+0000","last_undegraded":"2024-09-13T18:28:31.855969+0000","last_fullsized":"2024-09-13T18:28:31.855969+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:59.973076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.843480+0000","last_change":"2024-09-13T18:28:30.477775+0000","last_active":"2024-09-13T18:28:30.843480+0000","last_peered":"2024-09-13T18:28:30.843480+0000","last_clean":"2024-09-13T18:28:30.843480+0000","last_became_active":"2024-09-13T18:28:30.477314+0000","last_became_peered":"2024-09-13T18:28:30.477314+0000","last_unstale":"2024-09-13T18:28:30.843480+0000","last_undegraded":"2024-09-13T18:28:30.843480+0000","last_fullsized":"2024-09-13T18:28:30.843480+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:39.643769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505327+0000","last_change":"2024-09-13T18:28:30.887422+0000","last_active":"2024-09-13T18:28:32.505327+0000","last_peered":"2024-09-13T18:28:32.505327+0000","last_clean":"2024-09-13T18:28:32.505327+0000","last_became_active":"2024-09-13T18:28:30.886678+0000","last_became_peered":"2024-09-13T18:28:30.886678+0000","last_unstale":"2024-09-13T18:28:32.505327+0000","last_undegraded":"2024-09-13T18:28:32.505327+0000","last_fullsized":"2024-09-13T18:28:32.505327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:57.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.869073+0000","last_change":"2024-09-13T18:28:30.478300+0000","last_active":"2024-09-13T18:28:30.869073+0000","last_peered":"2024-09-13T18:28:30.869073+0000","last_clean":"2024-09-13T18:28:30.869073+0000","last_became_active":"2024-09-13T18:28:30.477783+0000","last_became_peered":"2024-09-13T18:28:30.477783+0000","last_unstale":"2024-09-13T18:28:30.869073+0000","last_undegraded":"2024-09-13T18:28:30.869073+0000","last_fullsized":"2024-09-13T18:28:30.869073+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:04:58.095328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505601+0000","last_change":"2024-09-13T18:28:30.878711+0000","last_active":"2024-09-13T18:28:32.505601+0000","last_peered":"2024-09-13T18:28:32.505601+0000","last_clean":"2024-09-13T18:28:32.505601+0000","last_became_active":"2024-09-13T18:28:30.878436+0000","last_became_peered":"2024-09-13T18:28:30.878436+0000","last_unstale":"2024-09-13T18:28:32.505601+0000","last_undegraded":"2024-09-13T18:28:32.505601+0000","last_fullsized":"2024-09-13T18:28:32.505601+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:59.973076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.847401+0000","last_change":"2024-09-13T18:28:30.468193+0000","last_active":"2024-09-13T18:28:30.847401+0000","last_peered":"2024-09-13T18:28:30.847401+0000","last_clean":"2024-09-13T18:28:30.847401+0000","last_became_active":"2024-09-13T18:28:30.467835+0000","last_became_peered":"2024-09-13T18:28:30.467835+0000","last_unstale":"2024-09-13T18:28:30.847401+0000","last_undegraded":"2024-09-13T18:28:30.847401+0000","last_fullsized":"2024-09-13T18:28:30.847401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505469+0000","last_change":"2024-09-13T18:28:30.864437+0000","last_active":"2024-09-13T18:28:32.505469+0000","last_peered":"2024-09-13T18:28:32.505469+0000","last_clean":"2024-09-13T18:28:32.505469+0000","last_became_active":"2024-09-13T18:28:30.864073+0000","last_became_peered":"2024-09-13T18:28:30.864073+0000","last_unstale":"2024-09-13T18:28:32.505469+0000","last_undegraded":"2024-09-13T18:28:32.505469+0000","last_fullsized":"2024-09-13T18:28:32.505469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:27.371121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.869744+0000","last_change":"2024-09-13T18:28:30.476593+0000","last_active":"2024-09-13T18:28:30.869744+0000","last_peered":"2024-09-13T18:28:30.869744+0000","last_clean":"2024-09-13T18:28:30.869744+0000","last_became_active":"2024-09-13T18:28:30.475776+0000","last_became_peered":"2024-09-13T18:28:30.475776+0000","last_unstale":"2024-09-13T18:28:30.869744+0000","last_undegraded":"2024-09-13T18:28:30.869744+0000","last_fullsized":"2024-09-13T18:28:30.869744+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:45.540181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505148+0000","last_change":"2024-09-13T18:28:30.887504+0000","last_active":"2024-09-13T18:28:32.505148+0000","last_peered":"2024-09-13T18:28:32.505148+0000","last_clean":"2024-09-13T18:28:32.505148+0000","last_became_active":"2024-09-13T18:28:30.886785+0000","last_became_peered":"2024-09-13T18:28:30.886785+0000","last_unstale":"2024-09-13T18:28:32.505148+0000","last_undegraded":"2024-09-13T18:28:32.505148+0000","last_fullsized":"2024-09-13T18:28:32.505148+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:49.648830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.869617+0000","last_change":"2024-09-13T18:28:30.464219+0000","last_active":"2024-09-13T18:28:30.869617+0000","last_peered":"2024-09-13T18:28:30.869617+0000","last_clean":"2024-09-13T18:28:30.869617+0000","last_became_active":"2024-09-13T18:28:30.463662+0000","last_became_peered":"2024-09-13T18:28:30.463662+0000","last_unstale":"2024-09-13T18:28:30.869617+0000","last_undegraded":"2024-09-13T18:28:30.869617+0000","last_fullsized":"2024-09-13T18:28:30.869617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:09.232562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505844+0000","last_change":"2024-09-13T18:28:30.899063+0000","last_active":"2024-09-13T18:28:32.505844+0000","last_peered":"2024-09-13T18:28:32.505844+0000","last_clean":"2024-09-13T18:28:32.505844+0000","last_became_active":"2024-09-13T18:28:30.896295+0000","last_became_peered":"2024-09-13T18:28:30.896295+0000","last_unstale":"2024-09-13T18:28:32.505844+0000","last_undegraded":"2024-09-13T18:28:32.505844+0000","last_fullsized":"2024-09-13T18:28:32.505844+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.531078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.843825+0000","last_change":"2024-09-13T18:28:30.470921+0000","last_active":"2024-09-13T18:28:30.843825+0000","last_peered":"2024-09-13T18:28:30.843825+0000","last_clean":"2024-09-13T18:28:30.843825+0000","last_became_active":"2024-09-13T18:28:30.470505+0000","last_became_peered":"2024-09-13T18:28:30.470505+0000","last_unstale":"2024-09-13T18:28:30.843825+0000","last_undegraded":"2024-09-13T18:28:30.843825+0000","last_fullsized":"2024-09-13T18:28:30.843825+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.505074+0000","last_change":"2024-09-13T18:28:30.853238+0000","last_active":"2024-09-13T18:28:32.505074+0000","last_peered":"2024-09-13T18:28:32.505074+0000","last_clean":"2024-09-13T18:28:32.505074+0000","last_became_active":"2024-09-13T18:28:30.853001+0000","last_became_peered":"2024-09-13T18:28:30.853001+0000","last_unstale":"2024-09-13T18:28:32.505074+0000","last_undegraded":"2024-09-13T18:28:32.505074+0000","last_fullsized":"2024-09-13T18:28:32.505074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:53.267785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.862063+0000","last_change":"2024-09-13T18:28:30.476829+0000","last_active":"2024-09-13T18:28:30.862063+0000","last_peered":"2024-09-13T18:28:30.862063+0000","last_clean":"2024-09-13T18:28:30.862063+0000","last_became_active":"2024-09-13T18:28:30.475861+0000","last_became_peered":"2024-09-13T18:28:30.475861+0000","last_unstale":"2024-09-13T18:28:30.862063+0000","last_undegraded":"2024-09-13T18:28:30.862063+0000","last_fullsized":"2024-09-13T18:28:30.862063+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:40.115898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.506349+0000","last_change":"2024-09-13T18:28:30.888660+0000","last_active":"2024-09-13T18:28:32.506349+0000","last_peered":"2024-09-13T18:28:32.506349+0000","last_clean":"2024-09-13T18:28:32.506349+0000","last_became_active":"2024-09-13T18:28:30.888392+0000","last_became_peered":"2024-09-13T18:28:30.888392+0000","last_unstale":"2024-09-13T18:28:32.506349+0000","last_undegraded":"2024-09-13T18:28:32.506349+0000","last_fullsized":"2024-09-13T18:28:32.506349+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:25.531078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.878968+0000","last_change":"2024-09-13T18:28:30.483425+0000","last_active":"2024-09-13T18:28:30.878968+0000","last_peered":"2024-09-13T18:28:30.878968+0000","last_clean":"2024-09-13T18:28:30.878968+0000","last_became_active":"2024-09-13T18:28:30.482589+0000","last_became_peered":"2024-09-13T18:28:30.482589+0000","last_unstale":"2024-09-13T18:28:30.878968+0000","last_undegraded":"2024-09-13T18:28:30.878968+0000","last_fullsized":"2024-09-13T18:28:30.878968+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:20.601047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.852361+0000","last_change":"2024-09-13T18:28:30.859827+0000","last_active":"2024-09-13T18:28:31.852361+0000","last_peered":"2024-09-13T18:28:31.852361+0000","last_clean":"2024-09-13T18:28:31.852361+0000","last_became_active":"2024-09-13T18:28:30.859547+0000","last_became_peered":"2024-09-13T18:28:30.859547+0000","last_unstale":"2024-09-13T18:28:31.852361+0000","last_undegraded":"2024-09-13T18:28:31.852361+0000","last_fullsized":"2024-09-13T18:28:31.852361+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:52.831737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.847596+0000","last_change":"2024-09-13T18:28:30.475880+0000","last_active":"2024-09-13T18:28:30.847596+0000","last_peered":"2024-09-13T18:28:30.847596+0000","last_clean":"2024-09-13T18:28:30.847596+0000","last_became_active":"2024-09-13T18:28:30.475439+0000","last_became_peered":"2024-09-13T18:28:30.475439+0000","last_unstale":"2024-09-13T18:28:30.847596+0000","last_undegraded":"2024-09-13T18:28:30.847596+0000","last_fullsized":"2024-09-13T18:28:30.847596+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:50.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.855707+0000","last_change":"2024-09-13T18:28:30.876343+0000","last_active":"2024-09-13T18:28:31.855707+0000","last_peered":"2024-09-13T18:28:31.855707+0000","last_clean":"2024-09-13T18:28:31.855707+0000","last_became_active":"2024-09-13T18:28:30.875607+0000","last_became_peered":"2024-09-13T18:28:30.875607+0000","last_unstale":"2024-09-13T18:28:31.855707+0000","last_undegraded":"2024-09-13T18:28:31.855707+0000","last_fullsized":"2024-09-13T18:28:31.855707+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:50.722776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.847725+0000","last_change":"2024-09-13T18:28:30.474768+0000","last_active":"2024-09-13T18:28:30.847725+0000","last_peered":"2024-09-13T18:28:30.847725+0000","last_clean":"2024-09-13T18:28:30.847725+0000","last_became_active":"2024-09-13T18:28:30.474069+0000","last_became_peered":"2024-09-13T18:28:30.474069+0000","last_unstale":"2024-09-13T18:28:30.847725+0000","last_undegraded":"2024-09-13T18:28:30.847725+0000","last_fullsized":"2024-09-13T18:28:30.847725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:53.577351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:32.504238+0000","last_change":"2024-09-13T18:28:30.877572+0000","last_active":"2024-09-13T18:28:32.504238+0000","last_peered":"2024-09-13T18:28:32.504238+0000","last_clean":"2024-09-13T18:28:32.504238+0000","last_became_active":"2024-09-13T18:28:30.877071+0000","last_became_peered":"2024-09-13T18:28:30.877071+0000","last_unstale":"2024-09-13T18:28:32.504238+0000","last_undegraded":"2024-09-13T18:28:32.504238+0000","last_fullsized":"2024-09-13T18:28:32.504238+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:45.702959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.848457+0000","last_change":"2024-09-13T18:28:30.465968+0000","last_active":"2024-09-13T18:28:30.848457+0000","last_peered":"2024-09-13T18:28:30.848457+0000","last_clean":"2024-09-13T18:28:30.848457+0000","last_became_active":"2024-09-13T18:28:30.465491+0000","last_became_peered":"2024-09-13T18:28:30.465491+0000","last_unstale":"2024-09-13T18:28:30.848457+0000","last_undegraded":"2024-09-13T18:28:30.848457+0000","last_fullsized":"2024-09-13T18:28:30.848457+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:49.247597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.851870+0000","last_change":"2024-09-13T18:28:30.885707+0000","last_active":"2024-09-13T18:28:31.851870+0000","last_peered":"2024-09-13T18:28:31.851870+0000","last_clean":"2024-09-13T18:28:31.851870+0000","last_became_active":"2024-09-13T18:28:30.885431+0000","last_became_peered":"2024-09-13T18:28:30.885431+0000","last_unstale":"2024-09-13T18:28:31.851870+0000","last_undegraded":"2024-09-13T18:28:31.851870+0000","last_fullsized":"2024-09-13T18:28:31.851870+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:30:31.712546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.849674+0000","last_change":"2024-09-13T18:28:30.476165+0000","last_active":"2024-09-13T18:28:30.849674+0000","last_peered":"2024-09-13T18:28:30.849674+0000","last_clean":"2024-09-13T18:28:30.849674+0000","last_became_active":"2024-09-13T18:28:30.474587+0000","last_became_peered":"2024-09-13T18:28:30.474587+0000","last_unstale":"2024-09-13T18:28:30.849674+0000","last_undegraded":"2024-09-13T18:28:30.849674+0000","last_fullsized":"2024-09-13T18:28:30.849674+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:11.595273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-13T18:28:31.851721+0000","last_change":"2024-09-13T18:28:30.861519+0000","last_active":"2024-09-13T18:28:31.851721+0000","last_peered":"2024-09-13T18:28:31.851721+0000","last_clean":"2024-09-13T18:28:31.851721+0000","last_became_active":"2024-09-13T18:28:30.860218+0000","last_became_peered":"2024-09-13T18:28:30.860218+0000","last_unstale":"2024-09-13T18:28:31.851721+0000","last_undegraded":"2024-09-13T18:28:31.851721+0000","last_fullsized":"2024-09-13T18:28:31.851721+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:30.429156+0000","last_clean_scrub_stamp":"2024-09-13T18:28:30.429156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:27.673227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.855114+0000","last_change":"2024-09-13T18:28:30.476728+0000","last_active":"2024-09-13T18:28:30.855114+0000","last_peered":"2024-09-13T18:28:30.855114+0000","last_clean":"2024-09-13T18:28:30.855114+0000","last_became_active":"2024-09-13T18:28:30.475744+0000","last_became_peered":"2024-09-13T18:28:30.475744+0000","last_unstale":"2024-09-13T18:28:30.855114+0000","last_undegraded":"2024-09-13T18:28:30.855114+0000","last_fullsized":"2024-09-13T18:28:30.855114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:28:29.414065+0000","last_clean_scrub_stamp":"2024-09-13T18:28:29.414065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.604812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-13T18:28:30.861805+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:28:30.861805+0000","last_peered":"2024-09-13T18:28:30.861805+0000","last_clean":"2024-09-13T18:28:30.861805+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:28:30.861805+0000","last_undegraded":"2024-09-13T18:28:30.861805+0000","last_fullsized":"2024-09-13T18:28:30.861805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1323008,"data_stored":891579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.89800000000000002,"15min":0.877},"min":{"1min":0.61599999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.90800000000000003,"15min":0.876},"min":{"1min":0.77500000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.97199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.21,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.92700000000000005,"15min":0.91700000000000004},"min":{"1min":0.64300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.4890000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.51200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88200000000000001,"15min":0.876},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.198,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.5309999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.69399999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.095,"5min":1.448,"15min":1.448},"last":1.349},{"interface":"front","average":{"1min":0.999,"5min":0.93400000000000005,"15min":0.90600000000000003},"min":{"1min":0.75900000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.036}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90200000000000002,"15min":0.89300000000000002},"min":{"1min":0.64300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.1899999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.95399999999999996,"15min":0.94499999999999995},"min":{"1min":0.68799999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0760000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.056,"15min":1.0549999999999999},"min":{"1min":0.77800000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5609999999999999,"5min":1.877,"15min":1.877},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.996,"15min":0.97799999999999998},"min":{"1min":0.66600000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":1.119}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.069,"15min":1.0629999999999999},"min":{"1min":0.82299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3169999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.022,"15min":0.99199999999999999},"min":{"1min":0.69499999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":720896,"data_stored":301051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.82899999999999996,"15min":0.83599999999999997},"min":{"1min":0.58799999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.198,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.80800000000000005,"15min":0.78200000000000003},"min":{"1min":0.60399999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.252,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.95499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.55700000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1819999999999999,"5min":1.577,"15min":1.577},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.92000000000000004,"15min":0.88800000000000001},"min":{"1min":0.81200000000000006,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.464,"15min":1.464},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0940000000000001,"5min":1.268,"15min":1.268},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96599999999999997,"15min":0.98399999999999999},"min":{"1min":0.77600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2110000000000001,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.876}]},{"osd":3,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88400000000000001,"15min":0.876},"min":{"1min":0.60999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.89000000000000001,"15min":0.88500000000000001},"min":{"1min":0.68899999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1719999999999999,"5min":1.306,"15min":1.306},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.98099999999999998,"15min":0.98699999999999999},"min":{"1min":0.64400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3149999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0109999999999999,"15min":0.995},"min":{"1min":0.76900000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.23,"5min":1.526,"15min":1.526},"last":1.0940000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.65900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.137,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0900000000000001,"15min":1.1140000000000001},"min":{"1min":0.76400000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3089999999999999,"5min":2.762,"15min":2.762},"last":1.016}]},{"osd":7,"last update":"Fri Sep 13 18:27:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0269999999999999,"15min":1.0429999999999999},"min":{"1min":0.65300000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.339,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.034,"15min":1.046},"min":{"1min":0.72599999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1579999999999999,"5min":1.72,"15min":1.72},"last":0.80600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":301703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1659999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.90600000000000003,"15min":0.91600000000000004},"min":{"1min":0.60499999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.1459999999999999,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.93600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.84999999999999998,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.22,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.874},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.83699999999999997,"15min":0.82399999999999995},"min":{"1min":0.625,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.05,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.89600000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.88700000000000001,"15min":0.877},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1220000000000001,"5min":1.167,"15min":1.167},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.96699999999999997,"15min":0.98199999999999998},"min":{"1min":0.64700000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.2609999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.96699999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.70299999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.0820000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.72599999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.181,"5min":1.871,"15min":1.871},"last":0.92500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94299999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3029999999999999,"5min":1.413,"15min":1.413},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.65100000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.24,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.012,"15min":1.0389999999999999},"min":{"1min":0.64700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":1.0109999999999999,"15min":1.042},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.1850000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:27:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0920000000000001,"15min":1.1339999999999999},"min":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.216,"5min":2.246,"15min":2.246},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.1200000000000001,"15min":1.1539999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2749999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.044}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":302615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.81599999999999995,"15min":0.79800000000000004},"min":{"1min":0.63600000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.133,"5min":1.252,"15min":1.252},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.86299999999999999,"15min":0.87},"min":{"1min":0.54700000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.177,"5min":1.256,"15min":1.256},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.64600000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2170000000000001,"5min":1.329,"15min":1.329},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88600000000000001,"15min":0.872},"min":{"1min":0.754,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1060000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.89700000000000002,"15min":0.89200000000000002},"min":{"1min":0.71799999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.69399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.091,"5min":1.222,"15min":1.222},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.74399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1459999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93999999999999995,"15min":0.95199999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1240000000000001,"5min":1.298,"15min":1.298},"last":1.038},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.252,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98999999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.129,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":1.012,"15min":1.024},"min":{"1min":0.67500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.377,"15min":1.377},"last":0.97099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:27:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.048,"15min":1.046},"min":{"1min":0.81399999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.26,"5min":1.482,"15min":1.482},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.0840000000000001},"min":{"1min":0.79600000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.284,"5min":1.466,"15min":1.466},"last":0.93700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":729088,"data_stored":301107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.64400000000000002,"15min":0.60999999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0349999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":2.113},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73199999999999998,"15min":0.69999999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.069,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":2.0089999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.379,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0649999999999999,"5min":1.704,"15min":1.704},"last":1.4199999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":2.6360000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69199999999999995,"15min":0.70199999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.94599999999999995,"5min":1.647,"15min":1.647},"last":1.742},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.75800000000000001,"15min":0.72899999999999998},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":1.399,"15min":1.399},"last":1.1679999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.76300000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.075,"5min":1.446,"15min":1.446},"last":2.7450000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1060000000000001,"15min":1.1339999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2909999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.484}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.034,"15min":1.026},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2529999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.93000000000000005,"15min":0.93200000000000005},"min":{"1min":0.63600000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1830000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":2.8340000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.375,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0509999999999999},"min":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3129999999999999,"5min":1.96,"15min":1.96},"last":1.343}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.109},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4550000000000001,"5min":3,"15min":3},"last":1.665},{"interface":"front","average":{"1min":1.004,"5min":1.0009999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.258,"5min":1.702,"15min":1.702},"last":2.9220000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35924,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335916,"statfs":{"total":96636764160,"available":96599977984,"internally_reserved":0,"allocated":729088,"data_stored":301107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.95699999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.98999999999999999,"5min":1.335,"15min":1.335},"last":0.26300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.47199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.423,"15min":1.423},"last":0.318}]},{"osd":3,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.73999999999999999,"15min":0.72699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1830000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.443},{"interface":"front","average":{"1min":0.878,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.194,"5min":1.274,"15min":1.274},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.93000000000000005,"15min":0.91200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3240000000000001,"5min":1.611,"15min":1.611},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92800000000000005,"15min":0.92400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.179,"5min":1.492,"15min":1.492},"last":0.498}]},{"osd":5,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0069999999999999,"15min":1.0129999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3140000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.028,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3680000000000001,"5min":1.702,"15min":1.702},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95899999999999996,"15min":0.95599999999999996},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.2410000000000001,"5min":1.54,"15min":1.54},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0489999999999999,"15min":1.0549999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2909999999999999,"5min":1.452,"15min":1.452},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:27:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.333,"5min":1.657,"15min":1.657},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.157,"5min":1.097,"15min":1.091},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4119999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.751}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35920,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335920,"statfs":{"total":96636764160,"available":96599982080,"internally_reserved":0,"allocated":724992,"data_stored":301141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.59699999999999998},"min":{"1min":0.318,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.177,"15min":1.177},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81200000000000006,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0389999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.76400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.03,"5min":1.117,"15min":1.117},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.72899999999999998,"15min":0.71899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1240000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.91900000000000004,"15min":0.90400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.248,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92300000000000004},"min":{"1min":0.64900000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.284,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2190000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.01,"15min":1.0269999999999999},"min":{"1min":0.62,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1839999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.359,"5min":1.653,"15min":1.653},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.64700000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.5580000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:27:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.66200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.081},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.0489999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36512,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335328,"statfs":{"total":96636764160,"available":96599375872,"internally_reserved":0,"allocated":1331200,"data_stored":893565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.98299999999999998,"5min":1.147,"15min":1.147},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.36699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.085,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.90800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64600000000000002,"15min":0.61399999999999999},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91400000000000003,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.153,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1200000000000001,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.056}]},{"osd":4,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1970000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.996,"15min":0.998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.252,"5min":1.986,"15min":1.986},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.014},"min":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.357,"5min":2.641,"15min":2.641},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.052,"15min":1.046},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3320000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.226}]},{"osd":6,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.083,"15min":1.079},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.2769999999999999,"5min":1.891,"15min":1.891},"last":1.161},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2310000000000001,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3160000000000001,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.194},{"interface":"front","average":{"1min":1.119,"5min":1.1160000000000001,"15min":1.1060000000000001},"min":{"1min":0.79300000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.45,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.133}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:28:39.783 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:28:39.784 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:28:39.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f011ddb3640 1 Processor -- start 2024-09-13T18:28:39.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f011ddb3640 1 -- start start 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f011ddb3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01181457c0 0x7f01180b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f011ddb3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f011806b390 0x7f011806b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f011ddb3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0118146180 con 0x7f01180b1a40 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f011ddb3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180702d0 con 0x7f011806b390 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f011ddb3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011806c4c0 con 0x7f01181457c0 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0117fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f011806b390 0x7f011806b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0116ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f01180b1a40 0x7f0118070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:51748/0 (socket says 172.21.15.53:51748) 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0117fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f011806b390 0x7f011806b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38900/0 (socket says 172.21.15.53:38900) 2024-09-13T18:28:39.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0116ffd640 1 -- 172.21.15.53:0/2639819801 learned_addr learned my addr 172.21.15.53:0/2639819801 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:39.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f01177fe640 1 --2- 172.21.15.53:0/2639819801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01181457c0 0x7f01180b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0117fff640 1 -- 172.21.15.53:0/2639819801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01181457c0 msgr2=0x7f01180b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:39.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0117fff640 1 --2- 172.21.15.53:0/2639819801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01181457c0 0x7f01180b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0117fff640 1 -- 172.21.15.53:0/2639819801 >> v1:172.21.15.87:6789/0 conn(0x7f01180b1a40 legacy=0x7f0118070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.948+0000 7f0117fff640 1 -- 172.21.15.53:0/2639819801 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011806bf00 con 0x7f011806b390 2024-09-13T18:28:39.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f0117fff640 1 --2- 172.21.15.53:0/2639819801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011806b390 0x7f011806b800 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21434a0d0c58b42d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f01167fc640 1 -- 172.21.15.53:0/2639819801 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01080a5a30 con 0x7f011806b390 2024-09-13T18:28:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f01167fc640 1 -- 172.21.15.53:0/2639819801 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01080a5b90 con 0x7f011806b390 2024-09-13T18:28:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f01167fc640 1 -- 172.21.15.53:0/2639819801 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01080ad440 con 0x7f011806b390 2024-09-13T18:28:39.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- 172.21.15.53:0/2639819801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011806b390 msgr2=0x7f011806b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2639819801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011806b390 0x7f011806b800 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010801c970 comp rx=0 tx=0).stop 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- 172.21.15.53:0/2639819801 shutdown_connections 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2639819801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f011806b390 0x7f011806b800 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2639819801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01181457c0 0x7f01180b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- 172.21.15.53:0/2639819801 >> 172.21.15.53:0/2639819801 conn(0x7f0118065c80 msgr2=0x7f0118066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- 172.21.15.53:0/2639819801 shutdown_connections 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- 172.21.15.53:0/2639819801 wait complete. 2024-09-13T18:28:39.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 Processor -- start 2024-09-13T18:28:39.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- start start 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011806b390 0x7f011815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01180b1a40 0x7f01181f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01181457c0 0x7f011815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011815f6b0 con 0x7f01180b1a40 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011815cb10 con 0x7f01181457c0 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f011ddb3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011815cdf0 con 0x7f011806b390 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.952+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01180b1a40 0x7f01181f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01180b1a40 0x7f01181f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38912/0 (socket says 172.21.15.53:38912) 2024-09-13T18:28:39.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 -- 172.21.15.53:0/2585934600 learned_addr learned my addr 172.21.15.53:0/2585934600 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f01177fe640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011806b390 0x7f011815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0117fff640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01181457c0 0x7f011815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 -- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011806b390 msgr2=0x7f011815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011806b390 0x7f011815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 -- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01181457c0 msgr2=0x7f011815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01181457c0 0x7f011815eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 -- 172.21.15.53:0/2585934600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0108009a70 con 0x7f01180b1a40 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f01177fe640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011806b390 0x7f011815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f0116ffd640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01180b1a40 0x7f01181f55c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f011000c3c0 tx=0x7f011000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f010ffff640 1 -- 172.21.15.53:0/2585934600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110005cf0 con 0x7f01180b1a40 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f010ffff640 1 -- 172.21.15.53:0/2585934600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110005e50 con 0x7f01180b1a40 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011815d0d0 con 0x7f01180b1a40 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f010ffff640 1 -- 172.21.15.53:0/2585934600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01100072d0 con 0x7f01180b1a40 2024-09-13T18:28:39.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01180b01a0 con 0x7f01180b1a40 2024-09-13T18:28:39.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0118145010 con 0x7f01180b1a40 2024-09-13T18:28:39.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f010ffff640 1 -- 172.21.15.53:0/2585934600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f0110007430 con 0x7f01180b1a40 2024-09-13T18:28:39.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f010ffff640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f00fc066840 0x7f00fc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:39.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f010ffff640 1 -- 172.21.15.53:0/2585934600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0110083900 con 0x7f01180b1a40 2024-09-13T18:28:39.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f01177fe640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f00fc066840 0x7f00fc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:39.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.956+0000 7f01177fe640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f00fc066840 0x7f00fc068d00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0100009bb0 tx=0x7f0100008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:39.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:39.960+0000 7f010ffff640 1 -- 172.21.15.53:0/2585934600 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0110050a80 con 0x7f01180b1a40 2024-09-13T18:28:40.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.184+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f011815d5f0 con 0x7f01180b1a40 2024-09-13T18:28:40.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.188+0000 7f010ffff640 1 -- 172.21.15.53:0/2585934600 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f011815d5f0 con 0x7f01180b1a40 2024-09-13T18:28:40.196 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:28:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f00fc066840 msgr2=0x7f00fc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f00fc066840 0x7f00fc068d00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0100009bb0 tx=0x7f0100008040 comp rx=0 tx=0).stop 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01180b1a40 msgr2=0x7f01181f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01180b1a40 0x7f01181f55c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f011000c3c0 tx=0x7f011000c880 comp rx=0 tx=0).stop 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 shutdown_connections 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f00fc066840 0x7f00fc068d00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01181457c0 0x7f011815eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01180b1a40 0x7f01181f55c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 --2- 172.21.15.53:0/2585934600 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011806b390 0x7f011815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 >> 172.21.15.53:0/2585934600 conn(0x7f0118065c80 msgr2=0x7f011813f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 shutdown_connections 2024-09-13T18:28:40.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.192+0000 7f011ddb3640 1 -- 172.21.15.53:0/2585934600 wait complete. 2024-09-13T18:28:40.215 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:40.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50b05dc640 1 Processor -- start 2024-09-13T18:28:40.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50b05dc640 1 -- start start 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50b05dc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50a81582a0 0x7f50a806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50b05dc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50b05dc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a806d480 con 0x7f50a8070c90 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50b05dc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a815aaf0 con 0x7f50a81582a0 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50b05dc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a806d760 con 0x7f50a815b7c0 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50ae378640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50a81582a0 0x7f50a806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50ae378640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50a81582a0 0x7f50a806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38914/0 (socket says 172.21.15.53:38914) 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50ae378640 1 -- 172.21.15.53:0/2809258977 learned_addr learned my addr 172.21.15.53:0/2809258977 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:40.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50adb77640 1 --2- 172.21.15.53:0/2809258977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50ae378640 1 -- 172.21.15.53:0/2809258977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 msgr2=0x7f50a806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:40.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50ae378640 1 --2- 172.21.15.53:0/2809258977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50ae378640 1 -- 172.21.15.53:0/2809258977 >> v1:172.21.15.87:6789/0 conn(0x7f50a8070c90 legacy=0x7f50a806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.340+0000 7f50ae378640 1 -- 172.21.15.53:0/2809258977 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a815ace0 con 0x7f50a81582a0 2024-09-13T18:28:40.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50ae378640 1 --2- 172.21.15.53:0/2809258977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a81582a0 0x7f50a806c900 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009870 tx=0x7f50a401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6964d6c3113af58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50ad376640 1 -- 172.21.15.53:0/2809258977 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40a7070 con 0x7f50a81582a0 2024-09-13T18:28:40.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50ad376640 1 -- 172.21.15.53:0/2809258977 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a40ab430 con 0x7f50a81582a0 2024-09-13T18:28:40.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50ad376640 1 -- 172.21.15.53:0/2809258977 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40ab7c0 con 0x7f50a81582a0 2024-09-13T18:28:40.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 -- 172.21.15.53:0/2809258977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a81582a0 msgr2=0x7f50a806c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 --2- 172.21.15.53:0/2809258977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a81582a0 0x7f50a806c900 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009870 tx=0x7f50a401c530 comp rx=0 tx=0).stop 2024-09-13T18:28:40.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 -- 172.21.15.53:0/2809258977 shutdown_connections 2024-09-13T18:28:40.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 --2- 172.21.15.53:0/2809258977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 --2- 172.21.15.53:0/2809258977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a81582a0 0x7f50a806c900 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 -- 172.21.15.53:0/2809258977 >> 172.21.15.53:0/2809258977 conn(0x7f50a8065c80 msgr2=0x7f50a8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 -- 172.21.15.53:0/2809258977 shutdown_connections 2024-09-13T18:28:40.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.344+0000 7f50b05dc640 1 -- 172.21.15.53:0/2809258977 wait complete. 2024-09-13T18:28:40.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 Processor -- start 2024-09-13T18:28:40.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 -- start start 2024-09-13T18:28:40.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8070c90 0x7f50a8145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a81582a0 0x7f50a814efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a80ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8150a50 con 0x7f50a8070c90 2024-09-13T18:28:40.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a814fb60 con 0x7f50a81582a0 2024-09-13T18:28:40.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81f53b0 con 0x7f50a815b7c0 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8070c90 0x7f50a8145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8070c90 0x7f50a8145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38922/0 (socket says 172.21.15.53:38922) 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 -- 172.21.15.53:0/1617752953 learned_addr learned my addr 172.21.15.53:0/1617752953 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50adb77640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a81582a0 0x7f50a814efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50aeb79640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a80ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 -- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 msgr2=0x7f50a80ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a80ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 -- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a81582a0 msgr2=0x7f50a814efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a81582a0 0x7f50a814efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 -- 172.21.15.53:0/1617752953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40094d0 con 0x7f50a8070c90 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50ae378640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8070c90 0x7f50a8145390 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ad040 tx=0x7f50a40192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f509affd640 1 -- 172.21.15.53:0/1617752953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40b4620 con 0x7f50a8070c90 2024-09-13T18:28:40.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f509affd640 1 -- 172.21.15.53:0/1617752953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a40b47a0 con 0x7f50a8070c90 2024-09-13T18:28:40.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a814f880 con 0x7f50a8070c90 2024-09-13T18:28:40.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f509affd640 1 -- 172.21.15.53:0/1617752953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40b4b50 con 0x7f50a8070c90 2024-09-13T18:28:40.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.347+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a81f58a0 con 0x7f50a8070c90 2024-09-13T18:28:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.351+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a8067400 con 0x7f50a8070c90 2024-09-13T18:28:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.351+0000 7f509affd640 1 -- 172.21.15.53:0/1617752953 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f50a40b4cb0 con 0x7f50a8070c90 2024-09-13T18:28:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.351+0000 7f509affd640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f508c066840 0x7f508c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.351+0000 7f509affd640 1 -- 172.21.15.53:0/1617752953 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50a411e940 con 0x7f50a8070c90 2024-09-13T18:28:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.351+0000 7f50adb77640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f508c066840 0x7f508c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.351+0000 7f50adb77640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f508c066840 0x7f508c068d00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f50a80cc330 tx=0x7f509c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.355+0000 7f509affd640 1 -- 172.21.15.53:0/1617752953 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50a40eb880 con 0x7f50a8070c90 2024-09-13T18:28:40.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.551+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50a806f370 con 0x7f50a8070c90 2024-09-13T18:28:40.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.551+0000 7f509affd640 1 -- 172.21.15.53:0/1617752953 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f50a40eeea0 con 0x7f50a8070c90 2024-09-13T18:28:40.559 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:40.559 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5396,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1852087146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1852087146},{"type":"v1","addr":"172.21.15.87:6835","nonce":1852087146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1364711247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1364711247},{"type":"v1","addr":"172.21.15.87:6837","nonce":1364711247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/763471722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":763471722},{"type":"v1","addr":"172.21.15.53:6833","nonce":763471722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:30.838100+0000","modified":"2024-09-13T18:28:33.851103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3738594836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3738594836},{"type":"v1","addr":"172.21.15.53:6835","nonce":3738594836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:28:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 31 2024-09-13T18:28:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f508c066840 msgr2=0x7f508c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f508c066840 0x7f508c068d00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f50a80cc330 tx=0x7f509c009190 comp rx=0 tx=0).stop 2024-09-13T18:28:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8070c90 msgr2=0x7f50a8145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8070c90 0x7f50a8145390 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ad040 tx=0x7f50a40192d0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 shutdown_connections 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f508c066840 0x7f508c068d00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50a815b7c0 0x7f50a80ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a81582a0 0x7f50a814efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 --2- 172.21.15.53:0/1617752953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8070c90 0x7f50a8145390 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 >> 172.21.15.53:0/1617752953 conn(0x7f50a8065c80 msgr2=0x7f50a80cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 shutdown_connections 2024-09-13T18:28:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:40.555+0000 7f50b05dc640 1 -- 172.21.15.53:0/1617752953 wait complete. 2024-09-13T18:28:40.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:28:30.838100+0000', 'modified': '2024-09-13T18:28:33.851103+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6324}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6324': {'gid': 6324, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3738594836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3738594836}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3738594836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:28:40.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:28:40.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:28:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f524c2640 1 Processor -- start 2024-09-13T18:28:41.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f524c2640 1 -- start start 2024-09-13T18:28:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f524c2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 0x7f5f4c0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f524c2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0ad230 con 0x7f5f4c0ae980 2024-09-13T18:28:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f524c2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0ad510 con 0x7f5f4c066390 2024-09-13T18:28:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f524c2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0ad7f0 con 0x7f5f4c15c750 2024-09-13T18:28:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5f4c0ae980 0x7f5f4c065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40020/0 (socket says 172.21.15.53:40020) 2024-09-13T18:28:41.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4b7fe640 1 -- 172.21.15.53:0/1761316355 learned_addr learned my addr 172.21.15.53:0/1761316355 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:41.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 0x7f5f4c0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229862400 0 0) 0x7f5f4c0ad230 con 0x7f5f4c0ae980 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f34003530 con 0x7f5f4c0ae980 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812473381 0 0) 0x7f5f4c0ad510 con 0x7f5f4c066390 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f4c0ad230 con 0x7f5f4c066390 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238831900 0 0) 0x7f5f34003530 con 0x7f5f4c0ae980 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 msgr2=0x7f5f4c0acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 0x7f5f4c0acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 >> v1:172.21.15.87:6789/0 conn(0x7f5f4c066390 legacy=0x7f5f4c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0adad0 con 0x7f5f4c0ae980 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5f40001680 con 0x7f5f4c0ae980 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 >> v1:172.21.15.53:6789/0 conn(0x7f5f4c0ae980 legacy=0x7f5f4c065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f34003b40 0x7f5f34003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f340047d0 0x7f5f34004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 0x7f5f340051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0ad7f0 con 0x7f5f34003b40 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3400baa0 con 0x7f5f340047d0 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3400bc60 con 0x7f5f4c15c750 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f34003b40 0x7f5f34003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f340047d0 0x7f5f34004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 0x7f5f340051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4bfff640 1 -- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 msgr2=0x7f5f340051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f4c15c750 0x7f5f340051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4bfff640 1 -- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f340047d0 msgr2=0x7f5f34004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f340047d0 0x7f5f34004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.115+0000 7f5f4bfff640 1 -- 172.21.15.53:0/1761316355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34003530 con 0x7f5f34003b40 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f34003b40 0x7f5f34003f40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009fc0 tx=0x7f5f4401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c1ee2af2f24321 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440a5b80 con 0x7f5f34003b40 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400f040 con 0x7f5f34003b40 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f4affd640 1 -- 172.21.15.53:0/1761316355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ad440 con 0x7f5f34003b40 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 -- 172.21.15.53:0/1761316355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f34003b40 msgr2=0x7f5f34003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 --2- 172.21.15.53:0/1761316355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f34003b40 0x7f5f34003f40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009fc0 tx=0x7f5f4401cc80 comp rx=0 tx=0).stop 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f50a5f640 1 -- 172.21.15.53:0/1761316355 reap_dead start 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 -- 172.21.15.53:0/1761316355 shutdown_connections 2024-09-13T18:28:41.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 -- 172.21.15.53:0/1761316355 >> 172.21.15.53:0/1761316355 conn(0x7f5f4c0b1310 msgr2=0x7f5f4c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 -- 172.21.15.53:0/1761316355 shutdown_connections 2024-09-13T18:28:41.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 -- 172.21.15.53:0/1761316355 wait complete. 2024-09-13T18:28:41.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 Processor -- start 2024-09-13T18:28:41.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.119+0000 7f5f524c2640 1 -- start start 2024-09-13T18:28:41.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f34003b40 0x7f5f4c14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f4c160b90 0x7f5f4c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f4c1f5b00 0x7f5f4c1f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c155460 con 0x7f5f4c160b90 2024-09-13T18:28:41.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c153070 con 0x7f5f4c1f5b00 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c160ff0 con 0x7f5f34003b40 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f4c160b90 0x7f5f4c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f4c160b90 0x7f5f4c152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38938/0 (socket says 172.21.15.53:38938) 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 -- 172.21.15.53:0/3474455176 learned_addr learned my addr 172.21.15.53:0/3474455176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f4c1f5b00 0x7f5f4c1f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f34003b40 0x7f5f4c14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 -- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f34003b40 msgr2=0x7f5f4c14feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f34003b40 0x7f5f4c14feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 -- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f4c1f5b00 msgr2=0x7f5f4c1f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f4c1f5b00 0x7f5f4c1f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 -- 172.21.15.53:0/3474455176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0aef70 con 0x7f5f4c160b90 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f4c1f5b00 0x7f5f4c1f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f4c160b90 0x7f5f4c152b30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5f40000fc0 tx=0x7f5f4000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f48ff9640 1 -- 172.21.15.53:0/3474455176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000c6c0 con 0x7f5f4c160b90 2024-09-13T18:28:41.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f48ff9640 1 -- 172.21.15.53:0/3474455176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4000c820 con 0x7f5f4c160b90 2024-09-13T18:28:41.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c154ac0 con 0x7f5f4c160b90 2024-09-13T18:28:41.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f48ff9640 1 -- 172.21.15.53:0/3474455176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000cbd0 con 0x7f5f4c160b90 2024-09-13T18:28:41.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c155080 con 0x7f5f4c160b90 2024-09-13T18:28:41.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.123+0000 7f5f48ff9640 1 -- 172.21.15.53:0/3474455176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f5f4000cd30 con 0x7f5f4c160b90 2024-09-13T18:28:41.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f48ff9640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f38066870 0x7f5f38068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f48ff9640 1 -- 172.21.15.53:0/3474455176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f400842b0 con 0x7f5f4c160b90 2024-09-13T18:28:41.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f38066870 0x7f5f38068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 Processor -- start 2024-09-13T18:28:41.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- start start 2024-09-13T18:28:41.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f38066870 0x7f5f38068d30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5f440af000 tx=0x7f5f440a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65885d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d653e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d653eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d6406e80 con 0x55c4d653e740 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d6394af0 con 0x55c4d6588b10 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4d63920c0 con 0x55c4d65881f0 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d653eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d653eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38946/0 (socket says 172.21.15.53:38946) 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 -- 172.21.15.53:0/3119153403 learned_addr learned my addr 172.21.15.53:0/3119153403 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d653e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 -- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 msgr2=0x55c4d65885d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65885d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 -- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 msgr2=0x55c4d653e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d653e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 -- 172.21.15.53:0/3119153403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d6089890 con 0x55c4d653e740 2024-09-13T18:28:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d653eb20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000fc0 tx=0x7f5f3c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15d1219c54a368 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f31ffb640 1 -- 172.21.15.53:0/3119153403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c018070 con 0x55c4d653e740 2024-09-13T18:28:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f31ffb640 1 -- 172.21.15.53:0/3119153403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c00d050 con 0x55c4d653e740 2024-09-13T18:28:41.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f31ffb640 1 -- 172.21.15.53:0/3119153403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0052e0 con 0x55c4d653e740 2024-09-13T18:28:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- 172.21.15.53:0/3119153403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 msgr2=0x55c4d653eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d653eb20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000fc0 tx=0x7f5f3c007f90 comp rx=0 tx=0).stop 2024-09-13T18:28:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- 172.21.15.53:0/3119153403 shutdown_connections 2024-09-13T18:28:41.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d653eb20 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d653e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3119153403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65885d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- 172.21.15.53:0/3119153403 >> 172.21.15.53:0/3119153403 conn(0x55c4d6544fb0 msgr2=0x55c4d6545390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- 172.21.15.53:0/3119153403 shutdown_connections 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- 172.21.15.53:0/3119153403 wait complete. 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 -- start start 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.127+0000 7f5f5560b000 1 Processor -- start 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d6549fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d654a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d654aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d638d9b0 con 0x55c4d653e740 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d632cc00 con 0x55c4d6588b10 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4d634b070 con 0x55c4d65881f0 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 10 client.0 _ll_register_callbacks cb 0x55c4d652aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d6549fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d6549fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38954/0 (socket says 172.21.15.53:38954) 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 -- 172.21.15.53:0/1584608381 learned_addr learned my addr 172.21.15.53:0/1584608381 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d654aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d654a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 -- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 msgr2=0x55c4d654a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d654a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 -- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 msgr2=0x55c4d654aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d654aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 -- 172.21.15.53:0/1584608381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c0ad230 con 0x55c4d653e740 2024-09-13T18:28:41.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d654aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d6549fb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5f4401c6f0 tx=0x7f5f34005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d4b89c3df8e09e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 1 -- 172.21.15.53:0/1584608381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ad7c0 con 0x55c4d653e740 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4d634a5f0 con 0x55c4d653e740 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 1 -- 172.21.15.53:0/1584608381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f440ad920 con 0x55c4d653e740 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 1 -- 172.21.15.53:0/1584608381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f440adae0 con 0x55c4d653e740 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 10 client.6498 fetch_fsmap learned FSMap version 31 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55c4d6352ab0 con 0x55c4d653e740 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 1 -- 172.21.15.53:0/1584608381 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4d634a5f0 con 0x55c4d653e740 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 1 -- 172.21.15.53:0/1584608381 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 31) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5f440adc40 con 0x55c4d653e740 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 10 client.6498 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 10 client.6498 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:28:41.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 20 client.6498 populate_metadata read hostname 'smithi053' 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d654b440 0x55c4d659a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 4 client.6498 mds_command: new command op to 6324 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 --> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4d638a790 con 0x55c4d654b440 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d654b440 0x55c4d659a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 10 client.6498 ms_handle_connect on v2:172.21.15.53:6834/3738594836 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d654b440 0x55c4d659a2a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27800839ef38ba95 server_cookie=43a24f4a9b7f5702 in_seq=0 out_seq=0 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 1 -- 172.21.15.53:0/1584608381 <== mds.0 v2:172.21.15.53:6834/3738594836 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c4d638a790 con 0x55c4d654b440 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 10 client.6498 handle_command_reply: tid=0 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 client.6498 shutdown 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 msgr2=0x55c4d6549fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d6549fb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5f4401c6f0 tx=0x7f5f34005800 comp rx=0 tx=0).stop 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 shutdown_connections 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d654b440 0x55c4d659a2a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d654a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d654aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 --2- 172.21.15.53:0/1584608381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d6549fb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f2affd640 0 client.6498 ms_handle_reset on v2:172.21.15.53:6834/3738594836 2024-09-13T18:28:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 >> 172.21.15.53:0/1584608381 conn(0x55c4d6544fb0 msgr2=0x55c4d653d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 shutdown_connections 2024-09-13T18:28:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 1 -- 172.21.15.53:0/1584608381 wait complete. 2024-09-13T18:28:41.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.131+0000 7f5f5560b000 20 client.6498 trim_cache size 0 max 16384 2024-09-13T18:28:41.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.147+0000 7f5f5560b000 1 Processor -- start 2024-09-13T18:28:41.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.147+0000 7f5f5560b000 1 -- start start 2024-09-13T18:28:41.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d65881f0 0x55c4d65e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d6588b10 0x55c4d65e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d604a940 con 0x55c4d653e740 2024-09-13T18:28:41.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d632fbe0 con 0x55c4d65881f0 2024-09-13T18:28:41.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4d638ffa0 con 0x55c4d6588b10 2024-09-13T18:28:41.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38960/0 (socket says 172.21.15.53:38960) 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/3746978947 learned_addr learned my addr 172.21.15.53:0/3746978947 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d65881f0 0x55c4d65e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d6588b10 0x55c4d65e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d6588b10 msgr2=0x55c4d65e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d6588b10 0x55c4d65e4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d65881f0 msgr2=0x55c4d65e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d65881f0 0x55c4d65e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/3746978947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d6338c00 con 0x55c4d653e740 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e4540 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5f440093e0 tx=0x7f5f440c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b074dc6a4e94f87a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f327fc640 1 -- 172.21.15.53:0/3746978947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440b9810 con 0x55c4d653e740 2024-09-13T18:28:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f327fc640 1 -- 172.21.15.53:0/3746978947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440c0040 con 0x55c4d653e740 2024-09-13T18:28:41.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f327fc640 1 -- 172.21.15.53:0/3746978947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ad5c0 con 0x55c4d653e740 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- 172.21.15.53:0/3746978947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 msgr2=0x55c4d65e4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e4540 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5f440093e0 tx=0x7f5f440c1000 comp rx=0 tx=0).stop 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- 172.21.15.53:0/3746978947 shutdown_connections 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d6588b10 0x55c4d65e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d65881f0 0x55c4d65e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- 172.21.15.53:0/3746978947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e4540 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- 172.21.15.53:0/3746978947 >> 172.21.15.53:0/3746978947 conn(0x55c4d6544fb0 msgr2=0x55c4d653c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- 172.21.15.53:0/3746978947 shutdown_connections 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- 172.21.15.53:0/3746978947 wait complete. 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- start start 2024-09-13T18:28:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 Processor -- start 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d65ea030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d63891a0 con 0x55c4d653e740 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d6346f80 con 0x55c4d6588b10 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4d634f6c0 con 0x55c4d65881f0 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f5560b000 10 client.0 _ll_register_callbacks cb 0x7f5f3c007c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38966/0 (socket says 172.21.15.53:38966) 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/942052682 learned_addr learned my addr 172.21.15.53:0/942052682 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d65ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 msgr2=0x55c4d65e9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65e9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 msgr2=0x55c4d65ea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d65ea030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f4bfff640 1 -- 172.21.15.53:0/942052682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4d6352ab0 con 0x55c4d653e740 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.151+0000 7f5f50a5f640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d65ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f4bfff640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e95b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5f440986a0 tx=0x7f5f44004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463c529f2bb88d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 1 -- 172.21.15.53:0/942052682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ad9d0 con 0x55c4d653e740 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 1 -- 172.21.15.53:0/942052682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f440adb30 con 0x55c4d653e740 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4d635d460 con 0x55c4d653e740 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 1 -- 172.21.15.53:0/942052682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f440add30 con 0x55c4d653e740 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 10 client.6504 fetch_fsmap learned FSMap version 31 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55c4d6089cc0 con 0x55c4d653e740 2024-09-13T18:28:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 1 -- 172.21.15.53:0/942052682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4d635d460 con 0x55c4d653e740 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 1 -- 172.21.15.53:0/942052682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 31) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5f440dd400 con 0x55c4d653e740 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 10 client.6504 fetch_fsmap finished waiting for FSMap version 31 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 10 client.6504 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 20 client.6504 populate_metadata read hostname 'smithi053' 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d65e61f0 0x55c4d65e65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 4 client.6504 mds_command: new command op to 6324 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 --> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c4d63569c0 con 0x55c4d65e61f0 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d65e61f0 0x55c4d65e65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f4b7fe640 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d65e61f0 0x55c4d65e65d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=211452917620b624 server_cookie=34a6e6b3204d020c in_seq=0 out_seq=0 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 10 client.6504 ms_handle_connect on v2:172.21.15.53:6834/3738594836 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 1 -- 172.21.15.53:0/942052682 <== mds.0 v2:172.21.15.53:6834/3738594836 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c4d63569c0 con 0x55c4d65e61f0 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 10 client.6504 handle_command_reply: tid=0 2024-09-13T18:28:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 client.6504 shutdown 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 msgr2=0x55c4d65e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e95b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5f440986a0 tx=0x7f5f44004a50 comp rx=0 tx=0).stop 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 shutdown_connections 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:6834/3738594836,v1:172.21.15.53:6835/3738594836] conn(0x55c4d65e61f0 0x55c4d65e65d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55c4d65881f0 0x55c4d65e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55c4d6588b10 0x55c4d65ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f2affd640 0 client.6504 ms_handle_reset on v2:172.21.15.53:6834/3738594836 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 --2- 172.21.15.53:0/942052682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4d653e740 0x55c4d65e95b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 >> 172.21.15.53:0/942052682 conn(0x55c4d6544fb0 msgr2=0x55c4d653d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 shutdown_connections 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 1 -- 172.21.15.53:0/942052682 wait complete. 2024-09-13T18:28:41.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f5560b000 20 client.6504 trim_cache size 0 max 16384 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6324, 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.320197908999999, 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 31, 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 60, 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 60, 2024-09-13T18:28:41.168 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.650115996 2024-09-13T18:28:41.169 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:28:41.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f38066870 msgr2=0x7f5f38068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f38066870 0x7f5f38068d30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5f440af000 tx=0x7f5f440a7040 comp rx=0 tx=0).stop 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f4c160b90 msgr2=0x7f5f4c152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f4c160b90 0x7f5f4c152b30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5f40000fc0 tx=0x7f5f4000eb50 comp rx=0 tx=0).stop 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 shutdown_connections 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5f38066870 0x7f5f38068d30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f4c1f5b00 0x7f5f4c1f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f4c160b90 0x7f5f4c152b30 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 --2- 172.21.15.53:0/3474455176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f34003b40 0x7f5f4c14feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 >> 172.21.15.53:0/3474455176 conn(0x7f5f4c0b1310 msgr2=0x7f5f4c065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 shutdown_connections 2024-09-13T18:28:41.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.155+0000 7f5f524c2640 1 -- 172.21.15.53:0/3474455176 wait complete. 2024-09-13T18:28:41.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:28:41.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.287+0000 7f11547bd640 1 Processor -- start 2024-09-13T18:28:41.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f11547bd640 1 -- start start 2024-09-13T18:28:41.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f11547bd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f114c0d19c0 0x7f114c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f11547bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c0cf600 0x7f114c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f11547bd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c0d2400 con 0x7f114c15cab0 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f11547bd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114c0cfa90 con 0x7f114c0d19c0 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f11547bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0d1530 con 0x7f114c0cf600 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f114c0d19c0 0x7f114c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f114c0d19c0 0x7f114c0cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38968/0 (socket says 172.21.15.53:38968) 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 -- 172.21.15.53:0/1479145195 learned_addr learned my addr 172.21.15.53:0/1479145195 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1152d5a640 1 --2- 172.21.15.53:0/1479145195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c0cf600 0x7f114c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 -- 172.21.15.53:0/1479145195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c0cf600 msgr2=0x7f114c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 --2- 172.21.15.53:0/1479145195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c0cf600 0x7f114c0b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 -- 172.21.15.53:0/1479145195 >> v1:172.21.15.87:6789/0 conn(0x7f114c15cab0 legacy=0x7f114c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:41.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 -- 172.21.15.53:0/1479145195 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c0cddd0 con 0x7f114c0d19c0 2024-09-13T18:28:41.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151d58640 1 --2- 172.21.15.53:0/1479145195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c0cf0c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511f4c8bf7391e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151557640 1 -- 172.21.15.53:0/1479145195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0ac630 con 0x7f114c0d19c0 2024-09-13T18:28:41.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151557640 1 -- 172.21.15.53:0/1479145195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c0ac790 con 0x7f114c0d19c0 2024-09-13T18:28:41.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.291+0000 7f1151557640 1 -- 172.21.15.53:0/1479145195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0acb20 con 0x7f114c0d19c0 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- 172.21.15.53:0/1479145195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 msgr2=0x7f114c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 --2- 172.21.15.53:0/1479145195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c0cf0c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c01c520 comp rx=0 tx=0).stop 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- 172.21.15.53:0/1479145195 shutdown_connections 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 --2- 172.21.15.53:0/1479145195 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c0cf600 0x7f114c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 --2- 172.21.15.53:0/1479145195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c0cf0c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- 172.21.15.53:0/1479145195 >> 172.21.15.53:0/1479145195 conn(0x7f114c065c80 msgr2=0x7f114c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- 172.21.15.53:0/1479145195 shutdown_connections 2024-09-13T18:28:41.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- 172.21.15.53:0/1479145195 wait complete. 2024-09-13T18:28:41.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 Processor -- start 2024-09-13T18:28:41.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- start start 2024-09-13T18:28:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0cf600 0x7f114c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c14e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c15cab0 0x7f114c14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c151c80 con 0x7f114c0d19c0 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c154020 con 0x7f114c0cf600 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c15cf20 con 0x7f114c15cab0 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c14e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38984/0 (socket says 172.21.15.53:38984) 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 -- 172.21.15.53:0/2951489264 learned_addr learned my addr 172.21.15.53:0/2951489264 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1152559640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0cf600 0x7f114c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1152d5a640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c15cab0 0x7f114c14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 -- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c15cab0 msgr2=0x7f114c14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c15cab0 0x7f114c14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 -- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0cf600 msgr2=0x7f114c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0cf600 0x7f114c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 -- 172.21.15.53:0/2951489264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0094d0 con 0x7f114c0d19c0 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1151d58640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c14e440 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f113c0af040 tx=0x7f113c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1142ffd640 1 -- 172.21.15.53:0/2951489264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0b7830 con 0x7f114c0d19c0 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1142ffd640 1 -- 172.21.15.53:0/2951489264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c0b7990 con 0x7f114c0d19c0 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c1516c0 con 0x7f114c0d19c0 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f1142ffd640 1 -- 172.21.15.53:0/2951489264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0b7d40 con 0x7f114c0d19c0 2024-09-13T18:28:41.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.295+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c154230 con 0x7f114c0d19c0 2024-09-13T18:28:41.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.299+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c0b5870 con 0x7f114c0d19c0 2024-09-13T18:28:41.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.299+0000 7f1142ffd640 1 -- 172.21.15.53:0/2951489264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f113c0b3040 con 0x7f114c0d19c0 2024-09-13T18:28:41.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.299+0000 7f1142ffd640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1130066840 0x7f1130068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.299+0000 7f1142ffd640 1 -- 172.21.15.53:0/2951489264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f114c0b65c0 con 0x7f114c0d19c0 2024-09-13T18:28:41.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.299+0000 7f1152559640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1130066840 0x7f1130068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.299+0000 7f1152559640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1130066840 0x7f1130068d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f114800b810 tx=0x7f1148008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.303+0000 7f1142ffd640 1 -- 172.21.15.53:0/2951489264 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f113c0eba60 con 0x7f114c0d19c0 2024-09-13T18:28:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.499+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f114c067910 con 0x7f114c0d19c0 2024-09-13T18:28:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.499+0000 7f1142ffd640 1 -- 172.21.15.53:0/2951489264 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f113c0b1060 con 0x7f114c0d19c0 2024-09-13T18:28:41.506 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:28:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1130066840 msgr2=0x7f1130068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1130066840 0x7f1130068d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f114800b810 tx=0x7f1148008040 comp rx=0 tx=0).stop 2024-09-13T18:28:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 msgr2=0x7f114c14e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c14e440 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f113c0af040 tx=0x7f113c01ad60 comp rx=0 tx=0).stop 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 shutdown_connections 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1130066840 0x7f1130068d00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f114c15cab0 0x7f114c14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114c0d19c0 0x7f114c14e440 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 --2- 172.21.15.53:0/2951489264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f114c0cf600 0x7f114c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 >> 172.21.15.53:0/2951489264 conn(0x7f114c065c80 msgr2=0x7f114c0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 shutdown_connections 2024-09-13T18:28:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:41.503+0000 7f11547bd640 1 -- 172.21.15.53:0/2951489264 wait complete. 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:28:41.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:28:41.527 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:41.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:41.527 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:28:41.533 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:41.534 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42275sec preferred_lft 42275sec 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:28:41.535 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:41.536 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:28:41.537 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:28:41.537 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:41.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:41.537 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:28:41.586 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:28:41.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:41.588 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:28:41.638 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:28:41.638 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:28:41.638 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:28:41.638 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:28:41.638 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:28:41.639 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:28:41.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:41.639 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:28:41.639 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:28:41.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:28:41.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:28:41.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:28:41.639 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:28:41.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:41.714 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:28:41.761 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:28:41.761 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:28:41.761 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:41.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:41.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:28:41.817 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:28:41.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:41.818 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:41.865 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:41.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:41.865 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:41.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:28:41.970 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:41.970 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:42.024 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:42.026 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:42.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:42.026 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:28:42.077 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:28:42.078 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:28:42.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:28:42.136 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:42.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:42.192 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:42.193 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:42.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:42.194 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:28:42.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:28:42.195+0000 7f0c6bf55580 -1 init, newargv = 0x55aa7e59e390 newargc=15 2024-09-13T18:28:42.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[43114]: starting ceph client 2024-09-13T18:28:42.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[43114]: starting fuse 2024-09-13T18:28:43.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:28:43.326 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:43.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:43.381 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:43.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:43.382 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:28:43.429 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:28:43.429 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:28:43.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:28:43.430 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:28:43.431 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:28:43.553 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.43114.asok 2024-09-13T18:28:43.736 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43114.asok 2024-09-13T18:28:43.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:43.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43114.asok status 2024-09-13T18:28:43.899 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:28:43.899 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "43114", 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6519, 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:28:43.900 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 6519 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 285407977 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 285407977 2024-09-13T18:28:43.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.6519 192.168.0.1:0/285407977", 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/285407977", 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 31, 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 60, 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:28:43.902 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:28:43.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:43.915 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:28:43.915 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:43.921 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:28:43.921 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:43.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:43.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:43.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:28:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa48214c640 1 Processor -- start 2024-09-13T18:28:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa48214c640 1 -- start start 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa48214c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa47c06b850 0x7fa47c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa48214c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 0x7fa47c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa48214c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c0b1ac0 con 0x7fa47c0cb980 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa48214c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47c0b3010 con 0x7fa47c06b850 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa48214c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c159ac0 con 0x7fa47c0cbd60 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa47c0cb980 0x7fa47c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40036/0 (socket says 172.21.15.53:40036) 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47b7fe640 1 -- 172.21.15.53:0/2045389544 learned_addr learned my addr 172.21.15.53:0/2045389544 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47bfff640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 0x7fa47c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa473fff640 1 --2- 172.21.15.53:0/2045389544 >> v2:172.21.15.87:3300/0 conn(0x7fa47c06b850 0x7fa47c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976035821 0 0) 0x7fa47c0b1ac0 con 0x7fa47c0cb980 2024-09-13T18:28:44.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa468003530 con 0x7fa47c0cb980 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068167241 0 0) 0x7fa468003530 con 0x7fa47c0cb980 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 msgr2=0x7fa47c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 0x7fa47c0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 >> v2:172.21.15.87:3300/0 conn(0x7fa47c06b850 msgr2=0x7fa47c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 --2- 172.21.15.53:0/2045389544 >> v2:172.21.15.87:3300/0 conn(0x7fa47c06b850 0x7fa47c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c159da0 con 0x7fa47c0cb980 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa46c001680 con 0x7fa47c0cb980 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 >> v1:172.21.15.53:6789/0 conn(0x7fa47c0cb980 legacy=0x7fa47c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 0x7fa468003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 0x7fa4680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468004d10 0x7fa468005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0b3010 con 0x7fa468004d10 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c159ac0 con 0x7fa468003980 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800b990 con 0x7fa47c0cbd60 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47bfff640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468004d10 0x7fa468005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 0x7fa468003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa473fff640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 0x7fa4680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47bfff640 1 -- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 msgr2=0x7fa4680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47bfff640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cbd60 0x7fa4680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47bfff640 1 -- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 msgr2=0x7fa468003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47bfff640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 0x7fa468003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.139+0000 7fa47bfff640 1 -- 172.21.15.53:0/2045389544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468003530 con 0x7fa468004d10 2024-09-13T18:28:44.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa47bfff640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468004d10 0x7fa468005190 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa474009f90 tx=0x7fa47401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f130317b614449bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740a5b40 con 0x7fa468004d10 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47400f040 con 0x7fa468004d10 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa47affd640 1 -- 172.21.15.53:0/2045389544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740ad440 con 0x7fa468004d10 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 -- 172.21.15.53:0/2045389544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468004d10 msgr2=0x7fa468005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 --2- 172.21.15.53:0/2045389544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468004d10 0x7fa468005190 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa474009f90 tx=0x7fa47401cc40 comp rx=0 tx=0).stop 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa47bfff640 1 -- 172.21.15.53:0/2045389544 reap_dead start 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 -- 172.21.15.53:0/2045389544 shutdown_connections 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 -- 172.21.15.53:0/2045389544 >> 172.21.15.53:0/2045389544 conn(0x7fa47c065c80 msgr2=0x7fa47c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 -- 172.21.15.53:0/2045389544 shutdown_connections 2024-09-13T18:28:44.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 -- 172.21.15.53:0/2045389544 wait complete. 2024-09-13T18:28:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 Processor -- start 2024-09-13T18:28:44.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.143+0000 7fa48214c640 1 -- start start 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c1f2940 0x7fa47c1f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c1f3260 0x7fa47c0ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0ad8d0 0x7fa47c14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c14ae90 con 0x7fa47c1f2940 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0add50 con 0x7fa47c0ad8d0 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c146070 con 0x7fa47c1f3260 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c1f2940 0x7fa47c1f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c1f2940 0x7fa47c1f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38994/0 (socket says 172.21.15.53:38994) 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 -- 172.21.15.53:0/256054863 learned_addr learned my addr 172.21.15.53:0/256054863 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa473fff640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c1f3260 0x7fa47c0ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47bfff640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0ad8d0 0x7fa47c14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 -- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c1f3260 msgr2=0x7fa47c0ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:44.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c1f3260 0x7fa47c0ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 -- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0ad8d0 msgr2=0x7fa47c14b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0ad8d0 0x7fa47c14b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 -- 172.21.15.53:0/256054863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c1493d0 con 0x7fa47c1f2940 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa47b7fe640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c1f2940 0x7fa47c1f2d20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0118e0 tx=0x7fa46c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa478ff9640 1 -- 172.21.15.53:0/256054863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00fc20 con 0x7fa47c1f2940 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa478ff9640 1 -- 172.21.15.53:0/256054863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c00fd80 con 0x7fa47c1f2940 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c1496b0 con 0x7fa47c1f2940 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa478ff9640 1 -- 172.21.15.53:0/256054863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c015630 con 0x7fa47c1f2940 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c14b380 con 0x7fa47c1f2940 2024-09-13T18:28:44.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c067400 con 0x7fa47c1f2940 2024-09-13T18:28:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa478ff9640 1 -- 172.21.15.53:0/256054863 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa46c015790 con 0x7fa47c1f2940 2024-09-13T18:28:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa478ff9640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa45c066840 0x7fa45c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa478ff9640 1 -- 172.21.15.53:0/256054863 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa46c087a50 con 0x7fa47c1f2940 2024-09-13T18:28:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.147+0000 7fa473fff640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa45c066840 0x7fa45c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:44.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.151+0000 7fa473fff640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa45c066840 0x7fa45c068d00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa47c14d8b0 tx=0x7fa464008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.151+0000 7fa478ff9640 1 -- 172.21.15.53:0/256054863 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa46c054aa0 con 0x7fa47c1f2940 2024-09-13T18:28:44.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa47c1f3640 con 0x7fa47c1f2940 2024-09-13T18:28:44.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa478ff9640 1 -- 172.21.15.53:0/256054863 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa46c0580c0 con 0x7fa47c1f2940 2024-09-13T18:28:44.366 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa45c066840 msgr2=0x7fa45c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa45c066840 0x7fa45c068d00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa47c14d8b0 tx=0x7fa464008040 comp rx=0 tx=0).stop 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c1f2940 msgr2=0x7fa47c1f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c1f2940 0x7fa47c1f2d20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0118e0 tx=0x7fa46c011da0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 shutdown_connections 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa45c066840 0x7fa45c068d00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c1f3260 0x7fa47c0ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0ad8d0 0x7fa47c14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 --2- 172.21.15.53:0/256054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c1f2940 0x7fa47c1f2d20 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.359+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 >> 172.21.15.53:0/256054863 conn(0x7fa47c065c80 msgr2=0x7fa47c0aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.363+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 shutdown_connections 2024-09-13T18:28:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:44.363+0000 7fa48214c640 1 -- 172.21.15.53:0/256054863 wait complete. 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:28:44.385 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:28:44.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:44.385 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:44.393 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42278sec preferred_lft 42278sec 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:44.394 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:44.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:44.396 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:28:44.448 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:28:44.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:44.450 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:28:44.503 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:28:44.504 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:28:44.504 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:28:44.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:44.504 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:28:44.504 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:28:44.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:28:44.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:28:44.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:28:44.504 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:28:44.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:44.581 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:28:44.629 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:28:44.629 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:28:44.629 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:28:44.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:44.630 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:28:44.686 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:28:44.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:44.686 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:44.733 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:28:44.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:44.733 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:44.781 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:28:44.838 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:44.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:44.892 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:44.893 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:44.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:44.894 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:28:44.941 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:28:44.941 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:28:44.986 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:28:45.000 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:45.000 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:45.054 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:45.055 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:45.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:45.056 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:28:45.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:28:45.059+0000 7f4ac069b580 -1 init, newargv = 0x555639b3fd40 newargc=15 2024-09-13T18:28:45.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35533]: starting ceph client 2024-09-13T18:28:45.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35533]: starting fuse 2024-09-13T18:28:46.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:28:46.187 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:28:46.187 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:28:46.245 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:28:46.246 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:28:46.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:46.246 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:28:46.293 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:28:46.293 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:28:46.293 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:28:46.294 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:28:46.295 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:28:46.296 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:28:46.413 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.35533.asok 2024-09-13T18:28:46.595 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35533.asok 2024-09-13T18:28:46.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:46.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35533.asok status 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35533", 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:28:46.750 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 6022, 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 6022 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3882627706 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:28:46.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3882627706 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.6022 192.168.0.1:0/3882627706", 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/3882627706", 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 31, 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 60, 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:28:46.752 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:28:46.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:46.763 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:28:46.763 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:46.769 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:28:46.769 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:46.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:46.770 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:46.824 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:28:46.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.959+0000 7f09d0e0d640 1 Processor -- start 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.959+0000 7f09d0e0d640 1 -- start start 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09d0e0d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09cc0b1dc0 0x7f09cc0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09d0e0d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f09cc0b5d40 0x7f09cc0d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09d0e0d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc0cd6e0 con 0x7f09cc15c850 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09d0e0d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc0d0340 con 0x7f09cc0b1dc0 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09d0e0d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc0cd970 con 0x7f09cc0b5d40 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09cc0b1dc0 0x7f09cc0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09cc0b1dc0 0x7f09cc0b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46324/0 (socket says 172.21.15.53:46324) 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 -- 172.21.15.53:0/2847129396 learned_addr learned my addr 172.21.15.53:0/2847129396 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09cad9d640 1 --2- 172.21.15.53:0/2847129396 >> v2:172.21.15.87:3300/0 conn(0x7f09cc0b5d40 0x7f09cc0d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 -- 172.21.15.53:0/2847129396 >> v2:172.21.15.87:3300/0 conn(0x7f09cc0b5d40 msgr2=0x7f09cc0d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 --2- 172.21.15.53:0/2847129396 >> v2:172.21.15.87:3300/0 conn(0x7f09cc0b5d40 0x7f09cc0d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 -- 172.21.15.53:0/2847129396 >> v1:172.21.15.87:6789/0 conn(0x7f09cc15c850 legacy=0x7f09cc0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:46.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 -- 172.21.15.53:0/2847129396 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0cdc50 con 0x7f09cc0b1dc0 2024-09-13T18:28:46.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c3fff640 1 --2- 172.21.15.53:0/2847129396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b1dc0 0x7f09cc0b5800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0d02d0 tx=0x7f09b401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b70c53dc38f5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:46.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c9d9b640 1 -- 172.21.15.53:0/2847129396 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40a89d0 con 0x7f09cc0b1dc0 2024-09-13T18:28:46.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c9d9b640 1 -- 172.21.15.53:0/2847129396 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40a8b30 con 0x7f09cc0b1dc0 2024-09-13T18:28:46.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.963+0000 7f09c9d9b640 1 -- 172.21.15.53:0/2847129396 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40b0440 con 0x7f09cc0b1dc0 2024-09-13T18:28:46.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- 172.21.15.53:0/2847129396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b1dc0 msgr2=0x7f09cc0b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/2847129396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b1dc0 0x7f09cc0b5800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0d02d0 tx=0x7f09b401ecd0 comp rx=0 tx=0).stop 2024-09-13T18:28:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- 172.21.15.53:0/2847129396 shutdown_connections 2024-09-13T18:28:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/2847129396 >> v2:172.21.15.87:3300/0 conn(0x7f09cc0b5d40 0x7f09cc0d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/2847129396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b1dc0 0x7f09cc0b5800 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- 172.21.15.53:0/2847129396 >> 172.21.15.53:0/2847129396 conn(0x7f09cc065c80 msgr2=0x7f09cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- 172.21.15.53:0/2847129396 shutdown_connections 2024-09-13T18:28:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- 172.21.15.53:0/2847129396 wait complete. 2024-09-13T18:28:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 Processor -- start 2024-09-13T18:28:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- start start 2024-09-13T18:28:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09cc0b1dc0 0x7f09cc15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b5d40 0x7f09cc15e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09cc15c850 0x7f09cc15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc15fbf0 con 0x7f09cc0b5d40 2024-09-13T18:28:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc15d400 con 0x7f09cc15c850 2024-09-13T18:28:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09d0e0d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc15d6e0 con 0x7f09cc0b1dc0 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b5d40 0x7f09cc15e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09ca59c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09cc0b1dc0 0x7f09cc15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09cad9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09cc15c850 0x7f09cc15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09ca59c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09cc0b1dc0 0x7f09cc15cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52012/0 (socket says 172.21.15.53:52012) 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09ca59c640 1 -- 172.21.15.53:0/1230742343 learned_addr learned my addr 172.21.15.53:0/1230742343 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.967+0000 7f09c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b5d40 0x7f09cc15e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46328/0 (socket says 172.21.15.53:46328) 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c3fff640 1 -- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09cc0b1dc0 msgr2=0x7f09cc15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c3fff640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09cc0b1dc0 0x7f09cc15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c3fff640 1 -- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09cc15c850 msgr2=0x7f09cc15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c3fff640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09cc15c850 0x7f09cc15f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c3fff640 1 -- 172.21.15.53:0/1230742343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40094d0 con 0x7f09cc0b5d40 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c3fff640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b5d40 0x7f09cc15e4a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f09b40af000 tx=0x7f09b401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c2ffd640 1 -- 172.21.15.53:0/1230742343 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40bf070 con 0x7f09cc0b5d40 2024-09-13T18:28:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c2ffd640 1 -- 172.21.15.53:0/1230742343 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40a87d0 con 0x7f09cc0b5d40 2024-09-13T18:28:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c2ffd640 1 -- 172.21.15.53:0/1230742343 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40bb6e0 con 0x7f09cc0b5d40 2024-09-13T18:28:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc15d9c0 con 0x7f09cc0b5d40 2024-09-13T18:28:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc15df80 con 0x7f09cc0b5d40 2024-09-13T18:28:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc15e170 con 0x7f09cc0b5d40 2024-09-13T18:28:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c2ffd640 1 -- 172.21.15.53:0/1230742343 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f09b40c4410 con 0x7f09cc0b5d40 2024-09-13T18:28:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c2ffd640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09ac066840 0x7f09ac068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09c2ffd640 1 -- 172.21.15.53:0/1230742343 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09b4121f90 con 0x7f09cc0b5d40 2024-09-13T18:28:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09ca59c640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09ac066840 0x7f09ac068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.971+0000 7f09ca59c640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09ac066840 0x7f09ac068d00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0099b0 tx=0x7f09bc009110 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:46.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:46.975+0000 7f09c2ffd640 1 -- 172.21.15.53:0/1230742343 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09b40ef070 con 0x7f09cc0b5d40 2024-09-13T18:28:47.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.171+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09cc15e170 con 0x7f09cc0b5d40 2024-09-13T18:28:47.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.215+0000 7f09c2ffd640 1 -- 172.21.15.53:0/1230742343 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 136+0+0 (secure 0 0 0) 0x7f09b40f2690 con 0x7f09cc0b5d40 2024-09-13T18:28:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.215+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09ac066840 msgr2=0x7f09ac068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.215+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09ac066840 0x7f09ac068d00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0099b0 tx=0x7f09bc009110 comp rx=0 tx=0).stop 2024-09-13T18:28:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.215+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b5d40 msgr2=0x7f09cc15e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.215+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b5d40 0x7f09cc15e4a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f09b40af000 tx=0x7f09b401ba70 comp rx=0 tx=0).stop 2024-09-13T18:28:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.215+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 shutdown_connections 2024-09-13T18:28:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.219+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f09ac066840 0x7f09ac068d00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.219+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09cc15c850 0x7f09cc15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.219+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09cc0b5d40 0x7f09cc15e4a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.219+0000 7f09d0e0d640 1 --2- 172.21.15.53:0/1230742343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09cc0b1dc0 0x7f09cc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.219+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 >> 172.21.15.53:0/1230742343 conn(0x7f09cc065c80 msgr2=0x7f09cc0ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.219+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 shutdown_connections 2024-09-13T18:28:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.219+0000 7f09d0e0d640 1 -- 172.21.15.53:0/1230742343 wait complete. 2024-09-13T18:28:47.242 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:28:47.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886e507640 1 Processor -- start 2024-09-13T18:28:47.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886e507640 1 -- start start 2024-09-13T18:28:47.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886e507640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f886806b850 0x7f88680b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886e507640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88680cbd60 0x7f88680cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886e507640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88680b1ac0 con 0x7f88680cb980 2024-09-13T18:28:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886e507640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680b3010 con 0x7f88680cbd60 2024-09-13T18:28:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886e507640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868159ac0 con 0x7f886806b850 2024-09-13T18:28:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886caa4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88680cbd60 0x7f88680cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886caa4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88680cbd60 0x7f88680cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46344/0 (socket says 172.21.15.53:46344) 2024-09-13T18:28:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886caa4640 1 -- 172.21.15.53:0/2754034805 learned_addr learned my addr 172.21.15.53:0/2754034805 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f88677fe640 1 --2- 172.21.15.53:0/2754034805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f886806b850 0x7f88680b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886caa4640 1 -- 172.21.15.53:0/2754034805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f886806b850 msgr2=0x7f88680b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886caa4640 1 --2- 172.21.15.53:0/2754034805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f886806b850 0x7f88680b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886caa4640 1 -- 172.21.15.53:0/2754034805 >> v1:172.21.15.87:6789/0 conn(0x7f88680cb980 legacy=0x7f886806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.363+0000 7f886caa4640 1 -- 172.21.15.53:0/2754034805 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868159da0 con 0x7f88680cbd60 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886caa4640 1 --2- 172.21.15.53:0/2754034805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680cbd60 0x7f88680cdd40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8858009870 tx=0x7f885801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5763b455488c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f8866ffd640 1 -- 172.21.15.53:0/2754034805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580ab620 con 0x7f88680cbd60 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f8866ffd640 1 -- 172.21.15.53:0/2754034805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88580ab780 con 0x7f88680cbd60 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f8866ffd640 1 -- 172.21.15.53:0/2754034805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580abb10 con 0x7f88680cbd60 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 -- 172.21.15.53:0/2754034805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680cbd60 msgr2=0x7f88680cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 --2- 172.21.15.53:0/2754034805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680cbd60 0x7f88680cdd40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8858009870 tx=0x7f885801c460 comp rx=0 tx=0).stop 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 -- 172.21.15.53:0/2754034805 shutdown_connections 2024-09-13T18:28:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 --2- 172.21.15.53:0/2754034805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88680cbd60 0x7f88680cdd40 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 --2- 172.21.15.53:0/2754034805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f886806b850 0x7f88680b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 -- 172.21.15.53:0/2754034805 >> 172.21.15.53:0/2754034805 conn(0x7f8868065c80 msgr2=0x7f8868066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 -- 172.21.15.53:0/2754034805 shutdown_connections 2024-09-13T18:28:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 -- 172.21.15.53:0/2754034805 wait complete. 2024-09-13T18:28:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.367+0000 7f886e507640 1 Processor -- start 2024-09-13T18:28:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 -- start start 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f886806b850 0x7f8868154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88680cb980 0x7f88681474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88680cbd60 0x7f8868153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8868155380 con 0x7f886806b850 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88681479f0 con 0x7f88680cb980 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868154080 con 0x7f88680cbd60 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f886806b850 0x7f8868154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f886806b850 0x7f8868154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46348/0 (socket says 172.21.15.53:46348) 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 -- 172.21.15.53:0/4083535810 learned_addr learned my addr 172.21.15.53:0/4083535810 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f88677fe640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88680cb980 0x7f88681474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886caa4640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88680cbd60 0x7f8868153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 -- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88680cbd60 msgr2=0x7f8868153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88680cbd60 0x7f8868153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 -- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88680cb980 msgr2=0x7f88681474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88680cb980 0x7f88681474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 -- 172.21.15.53:0/4083535810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580094d0 con 0x7f886806b850 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f88677fe640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88680cb980 0x7f88681474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886caa4640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88680cbd60 0x7f8868153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8867fff640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f886806b850 0x7f8868154e40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f886000c450 tx=0x7f886000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8864ff9640 1 -- 172.21.15.53:0/4083535810 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860012830 con 0x7f886806b850 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8864ff9640 1 -- 172.21.15.53:0/4083535810 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88600129b0 con 0x7f886806b850 2024-09-13T18:28:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8868154360 con 0x7f886806b850 2024-09-13T18:28:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8864ff9640 1 -- 172.21.15.53:0/4083535810 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860012d60 con 0x7f886806b850 2024-09-13T18:28:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8868154920 con 0x7f886806b850 2024-09-13T18:28:47.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8868067400 con 0x7f886806b850 2024-09-13T18:28:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8864ff9640 1 -- 172.21.15.53:0/4083535810 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f886001c460 con 0x7f886806b850 2024-09-13T18:28:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8864ff9640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8850066870 0x7f8850068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.371+0000 7f8864ff9640 1 -- 172.21.15.53:0/4083535810 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88600843e0 con 0x7f886806b850 2024-09-13T18:28:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.375+0000 7f88677fe640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8850066870 0x7f8850068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.375+0000 7f88677fe640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8850066870 0x7f8850068d30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f886815c820 tx=0x7f885400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:47.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.379+0000 7f8864ff9640 1 -- 172.21.15.53:0/4083535810 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8860051430 con 0x7f886806b850 2024-09-13T18:28:47.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.559+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8868154b40 con 0x7f8850066870 2024-09-13T18:28:47.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f8864ff9640 1 -- 172.21.15.53:0/4083535810 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8868154b40 con 0x7f8850066870 2024-09-13T18:28:47.568 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:28:47.568 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:47.568 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:28:47.569 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:47.569 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:28:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8850066870 msgr2=0x7f8850068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8850066870 0x7f8850068d30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f886815c820 tx=0x7f885400b040 comp rx=0 tx=0).stop 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f886806b850 msgr2=0x7f8868154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f886806b850 0x7f8868154e40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f886000c450 tx=0x7f886000c910 comp rx=0 tx=0).stop 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 shutdown_connections 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8850066870 0x7f8850068d30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88680cbd60 0x7f8868153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88680cb980 0x7f88681474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 --2- 172.21.15.53:0/4083535810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f886806b850 0x7f8868154e40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 >> 172.21.15.53:0/4083535810 conn(0x7f8868065c80 msgr2=0x7f886806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 shutdown_connections 2024-09-13T18:28:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.563+0000 7f886e507640 1 -- 172.21.15.53:0/4083535810 wait complete. 2024-09-13T18:28:47.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:28:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.711+0000 7f8535516640 1 Processor -- start 2024-09-13T18:28:47.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f8535516640 1 -- start start 2024-09-13T18:28:47.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f8535516640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 0x7f853006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f8535516640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853006f7a0 con 0x7f85300cda30 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f8535516640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853006fd60 con 0x7f85300caee0 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f8535516640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300cb960 con 0x7f8530143e80 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f85300cda30 0x7f85300701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46326/0 (socket says 172.21.15.53:46326) 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 -- 172.21.15.53:0/2445374585 learned_addr learned my addr 172.21.15.53:0/2445374585 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852effd640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 0x7f853006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466383381 0 0) 0x7f853006f7a0 con 0x7f85300cda30 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8518003530 con 0x7f85300cda30 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739586942 0 0) 0x7f8518003530 con 0x7f85300cda30 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 msgr2=0x7f853006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 0x7f853006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 >> v1:172.21.15.87:6789/0 conn(0x7f85300caee0 legacy=0x7f85300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300cbc40 con 0x7f85300cda30 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8528001a00 con 0x7f85300cda30 2024-09-13T18:28:47.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 >> v1:172.21.15.53:6789/0 conn(0x7f85300cda30 legacy=0x7f85300701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 0x7f85180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8518003f30 0x7f85180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8518004d10 0x7f8518005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300cb960 con 0x7f8518004d10 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851800bb20 con 0x7f8518003f30 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851800bce0 con 0x7f8530143e80 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8518004d10 0x7f8518005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852e7fc640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8518003f30 0x7f85180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852effd640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 0x7f85180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 -- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 msgr2=0x7f85180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 0x7f85180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 -- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8518003f30 msgr2=0x7f85180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8518003f30 0x7f85180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852f7fe640 1 -- 172.21.15.53:0/2445374585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518003530 con 0x7f8518004d10 2024-09-13T18:28:47.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.715+0000 7f852effd640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8530143e80 0x7f85180039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:47.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f852f7fe640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8518004d10 0x7f8518005190 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f852800a820 tx=0x7f852801faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772bc1a7d6c0b50c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280aa6d0 con 0x7f8518004d10 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85280aa830 con 0x7f8518004d10 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f852dffb640 1 -- 172.21.15.53:0/2445374585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280aac20 con 0x7f8518004d10 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 -- 172.21.15.53:0/2445374585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8518004d10 msgr2=0x7f8518005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 --2- 172.21.15.53:0/2445374585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8518004d10 0x7f8518005190 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f852800a820 tx=0x7f852801faa0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f852f7fe640 1 -- 172.21.15.53:0/2445374585 reap_dead start 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 -- 172.21.15.53:0/2445374585 shutdown_connections 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 -- 172.21.15.53:0/2445374585 >> 172.21.15.53:0/2445374585 conn(0x7f8530065c80 msgr2=0x7f8530066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 -- 172.21.15.53:0/2445374585 shutdown_connections 2024-09-13T18:28:47.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 -- 172.21.15.53:0/2445374585 wait complete. 2024-09-13T18:28:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 Processor -- start 2024-09-13T18:28:47.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.719+0000 7f8535516640 1 -- start start 2024-09-13T18:28:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8518004d10 0x7f85301e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85300a84d0 0x7f85300a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85300b0340 0x7f85300b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300b0d00 con 0x7f85300a84d0 2024-09-13T18:28:47.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853012f010 con 0x7f85300b0340 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853012ea50 con 0x7f8518004d10 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85300a84d0 0x7f85300a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85300a84d0 0x7f85300a8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46368/0 (socket says 172.21.15.53:46368) 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 -- 172.21.15.53:0/4074277729 learned_addr learned my addr 172.21.15.53:0/4074277729 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852effd640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8518004d10 0x7f85301e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852f7fe640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85300b0340 0x7f85300b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 -- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8518004d10 msgr2=0x7f85301e9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8518004d10 0x7f85301e9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 -- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85300b0340 msgr2=0x7f85300b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85300b0340 0x7f85300b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 -- 172.21.15.53:0/4074277729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85301e9c70 con 0x7f85300a84d0 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852e7fc640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85300a84d0 0x7f85300a8950 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f852000e510 tx=0x7f852000e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f85177fe640 1 -- 172.21.15.53:0/4074277729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85200052e0 con 0x7f85300a84d0 2024-09-13T18:28:47.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f85177fe640 1 -- 172.21.15.53:0/4074277729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520005440 con 0x7f85300a84d0 2024-09-13T18:28:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300a9040 con 0x7f85300a84d0 2024-09-13T18:28:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f85177fe640 1 -- 172.21.15.53:0/4074277729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520003820 con 0x7f85300a84d0 2024-09-13T18:28:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853012eca0 con 0x7f85300a84d0 2024-09-13T18:28:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853012ee60 con 0x7f85300a84d0 2024-09-13T18:28:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f85177fe640 1 -- 172.21.15.53:0/4074277729 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f8520003980 con 0x7f85300a84d0 2024-09-13T18:28:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f85177fe640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f851c066870 0x7f851c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f85177fe640 1 -- 172.21.15.53:0/4074277729 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8520084180 con 0x7f85300a84d0 2024-09-13T18:28:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.723+0000 7f852effd640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f851c066870 0x7f851c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:47.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.727+0000 7f852effd640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f851c066870 0x7f851c068d30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8524009ac0 tx=0x7f8524008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.731+0000 7f85177fe640 1 -- 172.21.15.53:0/4074277729 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8520051270 con 0x7f85300a84d0 2024-09-13T18:28:47.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.887+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f85300cb320 con 0x7f85300a84d0 2024-09-13T18:28:47.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.887+0000 7f85177fe640 1 -- 172.21.15.53:0/4074277729 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8520054890 con 0x7f85300a84d0 2024-09-13T18:28:47.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f851c066870 msgr2=0x7f851c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f851c066870 0x7f851c068d30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8524009ac0 tx=0x7f8524008040 comp rx=0 tx=0).stop 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85300a84d0 msgr2=0x7f85300a8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85300a84d0 0x7f85300a8950 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f852000e510 tx=0x7f852000e9d0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 shutdown_connections 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f851c066870 0x7f851c068d30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85300b0340 0x7f85300b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85300a84d0 0x7f85300a8950 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 --2- 172.21.15.53:0/4074277729 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8518004d10 0x7f85301e9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 >> 172.21.15.53:0/4074277729 conn(0x7f8530065c80 msgr2=0x7f8530155000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 shutdown_connections 2024-09-13T18:28:47.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:47.891+0000 7f8535516640 1 -- 172.21.15.53:0/4074277729 wait complete. 2024-09-13T18:28:47.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:47.915 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol39580) 2024-09-13T18:28:47.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:47.939 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:28:47.986 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:28:47.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:47.987 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/_nogroup/subvol39580) 2024-09-13T18:28:48.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol70591 2024-09-13T18:28:48.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7ffcc6640 1 Processor -- start 2024-09-13T18:28:48.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7ffcc6640 1 -- start start 2024-09-13T18:28:48.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7ffcc6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa7f8143e80 0x7fa7f806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7ffcc6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f806f7a0 con 0x7fa7f80caee0 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7ffcc6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f806fd60 con 0x7fa7f80cda30 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7ffcc6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f80cb960 con 0x7fa7f8143e80 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fd261640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa7f80caee0 0x7fa7f80cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46338/0 (socket says 172.21.15.53:46338) 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fd261640 1 -- 172.21.15.53:0/2637816618 learned_addr learned my addr 172.21.15.53:0/2637816618 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fda62640 1 --2- 172.21.15.53:0/2637816618 >> v2:172.21.15.53:3300/0 conn(0x7fa7f8143e80 0x7fa7f806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fca60640 1 -- 172.21.15.53:0/2637816618 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767664745 0 0) 0x7fa7f806f7a0 con 0x7fa7f80caee0 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fca60640 1 -- 172.21.15.53:0/2637816618 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e0003530 con 0x7fa7f80caee0 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fda62640 1 -- 172.21.15.53:0/2637816618 >> v1:172.21.15.87:6789/0 conn(0x7fa7f80cda30 legacy=0x7fa7f80701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fda62640 1 -- 172.21.15.53:0/2637816618 >> v1:172.21.15.53:6789/0 conn(0x7fa7f80caee0 legacy=0x7fa7f80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.203+0000 7fa7fda62640 1 -- 172.21.15.53:0/2637816618 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80cbc40 con 0x7fa7f8143e80 2024-09-13T18:28:48.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7fda62640 1 --2- 172.21.15.53:0/2637816618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f8143e80 0x7fa7f806b390 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80097c0 tx=0x7fa7e801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c81094a450e2ded server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:48.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7fca60640 1 -- 172.21.15.53:0/2637816618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80ab600 con 0x7fa7f8143e80 2024-09-13T18:28:48.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7fca60640 1 -- 172.21.15.53:0/2637816618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e80a7050 con 0x7fa7f8143e80 2024-09-13T18:28:48.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7fca60640 1 -- 172.21.15.53:0/2637816618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80ab980 con 0x7fa7f8143e80 2024-09-13T18:28:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2637816618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f8143e80 msgr2=0x7fa7f806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2637816618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f8143e80 0x7fa7f806b390 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80097c0 tx=0x7fa7e801c350 comp rx=0 tx=0).stop 2024-09-13T18:28:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2637816618 shutdown_connections 2024-09-13T18:28:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2637816618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f8143e80 0x7fa7f806b390 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2637816618 >> 172.21.15.53:0/2637816618 conn(0x7fa7f8065c80 msgr2=0x7fa7f8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2637816618 shutdown_connections 2024-09-13T18:28:48.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2637816618 wait complete. 2024-09-13T18:28:48.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 Processor -- start 2024-09-13T18:28:48.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- start start 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7f80caee0 0x7fa7f813fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f80cda30 0x7fa7f81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f8159e20 0x7fa7f815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f813d560 con 0x7fa7f80cda30 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f815cb50 con 0x7fa7f8159e20 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.207+0000 7fa7ffcc6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f815a290 con 0x7fa7f80caee0 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f80cda30 0x7fa7f81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f80cda30 0x7fa7f81598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46398/0 (socket says 172.21.15.53:46398) 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 -- 172.21.15.53:0/2054773290 learned_addr learned my addr 172.21.15.53:0/2054773290 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fe263640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f8159e20 0x7fa7f815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fda62640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7f80caee0 0x7fa7f813fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 -- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7f80caee0 msgr2=0x7fa7f813fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7f80caee0 0x7fa7f813fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 -- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f8159e20 msgr2=0x7fa7f815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f8159e20 0x7fa7f815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 -- 172.21.15.53:0/2054773290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8009420 con 0x7fa7f80cda30 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7fd261640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f80cda30 0x7fa7f81598e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00cbc0 tx=0x7fa7ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7f67fc640 1 -- 172.21.15.53:0/2054773290 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00ad40 con 0x7fa7f80cda30 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7f67fc640 1 -- 172.21.15.53:0/2054773290 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec012400 con 0x7fa7f80cda30 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7f67fc640 1 -- 172.21.15.53:0/2054773290 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00aea0 con 0x7fa7f80cda30 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f80ab5a0 con 0x7fa7f80cda30 2024-09-13T18:28:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f80abb60 con 0x7fa7f80cda30 2024-09-13T18:28:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f8070320 con 0x7fa7f80cda30 2024-09-13T18:28:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7f67fc640 1 -- 172.21.15.53:0/2054773290 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 9) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa7ec007070 con 0x7fa7f80cda30 2024-09-13T18:28:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7f67fc640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa7e4066870 0x7fa7e4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.211+0000 7fa7f67fc640 1 -- 172.21.15.53:0/2054773290 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7ec0847c0 con 0x7fa7f80cda30 2024-09-13T18:28:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.215+0000 7fa7fda62640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa7e4066870 0x7fa7e4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.215+0000 7fa7fda62640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa7e4066870 0x7fa7e4068d30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80ad000 tx=0x7fa7e8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:48.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.215+0000 7fa7f67fc640 1 -- 172.21.15.53:0/2054773290 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7ec051a20 con 0x7fa7f80cda30 2024-09-13T18:28:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.399+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol70591", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7f80cb700 con 0x7fa7e4066870 2024-09-13T18:28:48.417 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:48.415+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:48.417 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:48.415+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:48.417 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:48.415+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:48.417 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:48.415+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:48.417 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:48.415+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:48.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7f67fc640 1 -- 172.21.15.53:0/2054773290 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa7e8006e20 con 0x7fa7e4066870 2024-09-13T18:28:48.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa7e4066870 msgr2=0x7fa7e4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa7e4066870 0x7fa7e4068d30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80ad000 tx=0x7fa7e8008040 comp rx=0 tx=0).stop 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f80cda30 msgr2=0x7fa7f81598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f80cda30 0x7fa7f81598e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00cbc0 tx=0x7fa7ec00a430 comp rx=0 tx=0).stop 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 shutdown_connections 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa7e4066870 0x7fa7e4068d30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7f8159e20 0x7fa7f815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7f80cda30 0x7fa7f81598e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 --2- 172.21.15.53:0/2054773290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7f80caee0 0x7fa7f813fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 >> 172.21.15.53:0/2054773290 conn(0x7fa7f8065c80 msgr2=0x7fa7f81425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 shutdown_connections 2024-09-13T18:28:48.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:48.483+0000 7fa7ffcc6640 1 -- 172.21.15.53:0/2054773290 wait complete. 2024-09-13T18:28:48.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:48.510 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp ./volumes/_nogroup/subvol70591/.meta ./volumes/_nogroup/subvol39580) 2024-09-13T18:28:50.536 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol39580 2024-09-13T18:28:50.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 Processor -- start 2024-09-13T18:28:50.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 -- start start 2024-09-13T18:28:50.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32bc15c830 0x7f32bc0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:50.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:50.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f32bc0d2c80 0x7f32bc0d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:50.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc0d3670 con 0x7f32bc15c830 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc0b7db0 con 0x7f32bc0d2c80 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32c2111640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0d0650 con 0x7f32bc0ccd10 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32bc15c830 0x7f32bc0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32bc15c830 0x7f32bc0d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46412/0 (socket says 172.21.15.53:46412) 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 -- 172.21.15.53:0/3886727851 learned_addr learned my addr 172.21.15.53:0/3886727851 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bbfff640 1 --2- 172.21.15.53:0/3886727851 >> v2:172.21.15.87:3300/0 conn(0x7f32bc0d2c80 0x7f32bc0d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32baffd640 1 --2- 172.21.15.53:0/3886727851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 -- 172.21.15.53:0/3886727851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 msgr2=0x7f32bc0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 --2- 172.21.15.53:0/3886727851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 -- 172.21.15.53:0/3886727851 >> v2:172.21.15.87:3300/0 conn(0x7f32bc0d2c80 msgr2=0x7f32bc0d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 --2- 172.21.15.53:0/3886727851 >> v2:172.21.15.87:3300/0 conn(0x7f32bc0d2c80 0x7f32bc0d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bb7fe640 1 -- 172.21.15.53:0/3886727851 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0d0c10 con 0x7f32bc15c830 2024-09-13T18:28:50.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.667+0000 7f32bbfff640 1 --2- 172.21.15.53:0/3886727851 >> v2:172.21.15.87:3300/0 conn(0x7f32bc0d2c80 0x7f32bc0d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:50.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32bb7fe640 1 --2- 172.21.15.53:0/3886727851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0d10a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0d0190 tx=0x7f32a401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc491a9c55c7b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:50.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32ba7fc640 1 -- 172.21.15.53:0/3886727851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40a89d0 con 0x7f32bc15c830 2024-09-13T18:28:50.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32ba7fc640 1 -- 172.21.15.53:0/3886727851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a40a8b30 con 0x7f32bc15c830 2024-09-13T18:28:50.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32ba7fc640 1 -- 172.21.15.53:0/3886727851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40b0440 con 0x7f32bc15c830 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 -- 172.21.15.53:0/3886727851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 msgr2=0x7f32bc0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 --2- 172.21.15.53:0/3886727851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0d10a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0d0190 tx=0x7f32a401ed10 comp rx=0 tx=0).stop 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 -- 172.21.15.53:0/3886727851 shutdown_connections 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 --2- 172.21.15.53:0/3886727851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 --2- 172.21.15.53:0/3886727851 >> v2:172.21.15.87:3300/0 conn(0x7f32bc0d2c80 0x7f32bc0d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 --2- 172.21.15.53:0/3886727851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0d10a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 -- 172.21.15.53:0/3886727851 >> 172.21.15.53:0/3886727851 conn(0x7f32bc070970 msgr2=0x7f32bc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 -- 172.21.15.53:0/3886727851 shutdown_connections 2024-09-13T18:28:50.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 -- 172.21.15.53:0/3886727851 wait complete. 2024-09-13T18:28:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 Processor -- start 2024-09-13T18:28:50.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 -- start start 2024-09-13T18:28:50.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32bc0d2c80 0x7f32bc0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.671+0000 7f32c2111640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32c2111640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc1f29e0 con 0x7f32bc15c830 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32c2111640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc1f2cc0 con 0x7f32bc0d2c80 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32c2111640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0a9670 con 0x7f32bc0ccd10 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46418/0 (socket says 172.21.15.53:46418) 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 -- 172.21.15.53:0/3876603696 learned_addr learned my addr 172.21.15.53:0/3876603696 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32baffd640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32bc0d2c80 0x7f32bc0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bb7fe640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 -- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 msgr2=0x7f32bc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 -- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32bc0d2c80 msgr2=0x7f32bc0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32bc0d2c80 0x7f32bc0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 -- 172.21.15.53:0/3876603696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a40094d0 con 0x7f32bc15c830 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bbfff640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0b39a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f32b400cef0 tx=0x7f32b400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32b3fff640 1 -- 172.21.15.53:0/3876603696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400d840 con 0x7f32bc15c830 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32b3fff640 1 -- 172.21.15.53:0/3876603696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b400d9c0 con 0x7f32bc15c830 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32b3fff640 1 -- 172.21.15.53:0/3876603696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400dd70 con 0x7f32bc15c830 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc0a9950 con 0x7f32bc15c830 2024-09-13T18:28:50.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc0aa690 con 0x7f32bc15c830 2024-09-13T18:28:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc0cd150 con 0x7f32bc15c830 2024-09-13T18:28:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32b3fff640 1 -- 172.21.15.53:0/3876603696 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 10) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f32b401e3b0 con 0x7f32bc15c830 2024-09-13T18:28:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32b3fff640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f329c0668d0 0x7f329c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32b3fff640 1 -- 172.21.15.53:0/3876603696 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32b4084f80 con 0x7f32bc15c830 2024-09-13T18:28:50.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.675+0000 7f32bb7fe640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f329c0668d0 0x7f329c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:50.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.679+0000 7f32bb7fe640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f329c0668d0 0x7f329c068d90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f32a40b2000 tx=0x7f32a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:50.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.679+0000 7f32b3fff640 1 -- 172.21.15.53:0/3876603696 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32b40b6db0 con 0x7f32bc15c830 2024-09-13T18:28:50.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.867+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol39580", "target": ["mon-mgr", ""]}) v1 -- 0x7f32bc0d08a0 con 0x7f329c0668d0 2024-09-13T18:28:50.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.931+0000 7f32b3fff640 1 -- 172.21.15.53:0/3876603696 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7f32a40a87d0 con 0x7f329c0668d0 2024-09-13T18:28:50.938 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol39580 2024-09-13T18:28:50.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f329c0668d0 msgr2=0x7f329c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:50.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f329c0668d0 0x7f329c068d90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f32a40b2000 tx=0x7f32a4008040 comp rx=0 tx=0).stop 2024-09-13T18:28:50.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 msgr2=0x7f32bc0b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0b39a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f32b400cef0 tx=0x7f32b400a710 comp rx=0 tx=0).stop 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 shutdown_connections 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f329c0668d0 0x7f329c068d90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32bc15c830 0x7f32bc0b39a0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32bc0d2c80 0x7f32bc0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 --2- 172.21.15.53:0/3876603696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32bc0ccd10 0x7f32bc0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 >> 172.21.15.53:0/3876603696 conn(0x7f32bc070970 msgr2=0x7f32bc0b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 shutdown_connections 2024-09-13T18:28:50.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:50.935+0000 7f32c2111640 1 -- 172.21.15.53:0/3876603696 wait complete. 2024-09-13T18:28:50.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol39580 2024-09-13T18:28:51.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.083+0000 7f08577b9640 1 Processor -- start 2024-09-13T18:28:51.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.083+0000 7f08577b9640 1 -- start start 2024-09-13T18:28:51.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f08577b9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0850157020 0x7f085006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f08577b9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085006d6e0 con 0x7f085006d270 2024-09-13T18:28:51.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f08577b9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08500715f0 con 0x7f0850156c40 2024-09-13T18:28:51.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f08577b9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08500b15a0 con 0x7f0850157020 2024-09-13T18:28:51.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855d56640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f085006d270 0x7f085006f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46348/0 (socket says 172.21.15.53:46348) 2024-09-13T18:28:51.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855d56640 1 -- 172.21.15.53:0/2257017106 learned_addr learned my addr 172.21.15.53:0/2257017106 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0854d54640 1 --2- 172.21.15.53:0/2257017106 >> v2:172.21.15.87:3300/0 conn(0x7f0850157020 0x7f085006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603459303 0 0) 0x7f085006d6e0 con 0x7f085006d270 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f083c003530 con 0x7f085006d270 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038062381 0 0) 0x7f083c003530 con 0x7f085006d270 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 >> v2:172.21.15.87:3300/0 conn(0x7f0850157020 msgr2=0x7f085006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 --2- 172.21.15.53:0/2257017106 >> v2:172.21.15.87:3300/0 conn(0x7f0850157020 0x7f085006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 >> v1:172.21.15.87:6789/0 conn(0x7f0850156c40 legacy=0x7f0850070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500b1880 con 0x7f085006d270 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0848001a00 con 0x7f085006d270 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 >> v1:172.21.15.53:6789/0 conn(0x7f085006d270 legacy=0x7f085006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f083c003980 0x7f083c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f083c0047d0 0x7f083c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c005190 0x7f083c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b15a0 con 0x7f083c003980 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c00c030 con 0x7f083c005190 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c00c1f0 con 0x7f083c0047d0 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855555640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f083c003980 0x7f083c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855d56640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c005190 0x7f083c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855555640 1 -- 172.21.15.53:0/2257017106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f083c0047d0 msgr2=0x7f083c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855555640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f083c0047d0 0x7f083c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855555640 1 -- 172.21.15.53:0/2257017106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c005190 msgr2=0x7f083c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855555640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c005190 0x7f083c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855555640 1 -- 172.21.15.53:0/2257017106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c003530 con 0x7f083c003980 2024-09-13T18:28:51.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.087+0000 7f0855d56640 1 -- 172.21.15.53:0/2257017106 reap_dead start 2024-09-13T18:28:51.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0855555640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f083c003980 0x7f083c003da0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f084c001780 tx=0x7f084c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2ebfe6f1bc1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:51.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c0052d0 con 0x7f083c003980 2024-09-13T18:28:51.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c0a7050 con 0x7f083c003980 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0847fff640 1 -- 172.21.15.53:0/2257017106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c003600 con 0x7f083c003980 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- 172.21.15.53:0/2257017106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f083c003980 msgr2=0x7f083c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f083c003980 0x7f083c003da0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f084c001780 tx=0x7f084c01c3d0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- 172.21.15.53:0/2257017106 shutdown_connections 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 --2- 172.21.15.53:0/2257017106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f083c003980 0x7f083c003da0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- 172.21.15.53:0/2257017106 >> 172.21.15.53:0/2257017106 conn(0x7f0850065c80 msgr2=0x7f0850066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- 172.21.15.53:0/2257017106 shutdown_connections 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- 172.21.15.53:0/2257017106 wait complete. 2024-09-13T18:28:51.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 Processor -- start 2024-09-13T18:28:51.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- start start 2024-09-13T18:28:51.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c003980 0x7f085014d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0850152590 0x7f0850155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085014ddb0 0x7f085015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0850152d70 con 0x7f0850152590 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0850155620 con 0x7f083c003980 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f08577b9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0850152a90 con 0x7f085014ddb0 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0854d54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0850152590 0x7f0850155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0854d54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0850152590 0x7f0850155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46434/0 (socket says 172.21.15.53:46434) 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0854d54640 1 -- 172.21.15.53:0/670048179 learned_addr learned my addr 172.21.15.53:0/670048179 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0855d56640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085014ddb0 0x7f085015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0855555640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c003980 0x7f085014d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0854d54640 1 -- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085014ddb0 msgr2=0x7f085015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:51.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.091+0000 7f0854d54640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085014ddb0 0x7f085015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0854d54640 1 -- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c003980 msgr2=0x7f085014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0854d54640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c003980 0x7f085014d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0854d54640 1 -- 172.21.15.53:0/670048179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850154fd0 con 0x7f0850152590 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0854d54640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0850152590 0x7f0850155ab0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f084000e770 tx=0x7f084000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0845ffb640 1 -- 172.21.15.53:0/670048179 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000ee80 con 0x7f0850152590 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0845ffb640 1 -- 172.21.15.53:0/670048179 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084000c8c0 con 0x7f0850152590 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08501552b0 con 0x7f0850152590 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0845ffb640 1 -- 172.21.15.53:0/670048179 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084000cc50 con 0x7f0850152590 2024-09-13T18:28:51.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085014e450 con 0x7f0850152590 2024-09-13T18:28:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0850154e00 con 0x7f0850152590 2024-09-13T18:28:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0845ffb640 1 -- 172.21.15.53:0/670048179 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 10) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f0840013470 con 0x7f0850152590 2024-09-13T18:28:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0845ffb640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0834066900 0x7f0834068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0845ffb640 1 -- 172.21.15.53:0/670048179 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0840084620 con 0x7f0850152590 2024-09-13T18:28:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0855555640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0834066900 0x7f0834068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:51.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.095+0000 7f0855555640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0834066900 0x7f0834068dc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f084c001750 tx=0x7f084c0011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.099+0000 7f0845ffb640 1 -- 172.21.15.53:0/670048179 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0840051500 con 0x7f0850152590 2024-09-13T18:28:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.287+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol39580", "target": ["mon-mgr", ""]}) v1 -- 0x7f08501e9fa0 con 0x7f0834066900 2024-09-13T18:28:51.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f0845ffb640 1 -- 172.21.15.53:0/670048179 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7f08501e9fa0 con 0x7f0834066900 2024-09-13T18:28:51.305 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol39580 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0834066900 msgr2=0x7f0834068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0834066900 0x7f0834068dc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f084c001750 tx=0x7f084c0011a0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0850152590 msgr2=0x7f0850155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0850152590 0x7f0850155ab0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f084000e770 tx=0x7f084000ec30 comp rx=0 tx=0).stop 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 shutdown_connections 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0834066900 0x7f0834068dc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f085014ddb0 0x7f085015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0850152590 0x7f0850155ab0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 --2- 172.21.15.53:0/670048179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f083c003980 0x7f085014d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 >> 172.21.15.53:0/670048179 conn(0x7f0850065c80 msgr2=0x7f08501e9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:51.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 shutdown_connections 2024-09-13T18:28:51.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:51.299+0000 7f08577b9640 1 -- 172.21.15.53:0/670048179 wait complete. 2024-09-13T18:28:51.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:51.324 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/c1154d6a5c3201a315d52d351777b430.meta) 2024-09-13T18:28:54.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:54.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:28:55.526 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:28:55.526 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:28:55.527 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:28:55.527 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol39580 2024-09-13T18:28:55.527 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:28:55.527 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:55.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume authorize cephfs subvol39580 alice 2024-09-13T18:28:55.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.659+0000 7f0c3da4f640 1 Processor -- start 2024-09-13T18:28:55.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.659+0000 7f0c3da4f640 1 -- start start 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c3da4f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0c3815c860 0x7f0c380cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c3da4f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c380d1410 0x7f0c380cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c3da4f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c380d1d10 con 0x7f0c380d1860 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c3da4f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c380d1ff0 con 0x7f0c380d1410 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c3da4f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c380d22d0 con 0x7f0c3815c860 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c2ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c380d1410 0x7f0c380cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c377fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0c380d1860 0x7f0c380b4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46354/0 (socket says 172.21.15.53:46354) 2024-09-13T18:28:55.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c377fe640 1 -- 172.21.15.53:0/2092177499 learned_addr learned my addr 172.21.15.53:0/2092177499 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:55.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c36ffd640 1 --2- 172.21.15.53:0/2092177499 >> v2:172.21.15.87:3300/0 conn(0x7f0c3815c860 0x7f0c380cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c2ffff640 1 -- 172.21.15.53:0/2092177499 >> v2:172.21.15.87:3300/0 conn(0x7f0c3815c860 msgr2=0x7f0c380cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:55.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c2ffff640 1 --2- 172.21.15.53:0/2092177499 >> v2:172.21.15.87:3300/0 conn(0x7f0c3815c860 0x7f0c380cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c2ffff640 1 -- 172.21.15.53:0/2092177499 >> v1:172.21.15.53:6789/0 conn(0x7f0c380d1860 legacy=0x7f0c380b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c2ffff640 1 -- 172.21.15.53:0/2092177499 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380b5be0 con 0x7f0c380d1410 2024-09-13T18:28:55.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c2ffff640 1 --2- 172.21.15.53:0/2092177499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c380d1410 0x7f0c380cf0e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0c3808b570 tx=0x7f0c2001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96986972060636f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c367fc640 1 -- 172.21.15.53:0/2092177499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200a8970 con 0x7f0c380d1410 2024-09-13T18:28:55.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c367fc640 1 -- 172.21.15.53:0/2092177499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c200a8ad0 con 0x7f0c380d1410 2024-09-13T18:28:55.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c367fc640 1 -- 172.21.15.53:0/2092177499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200a8e60 con 0x7f0c380d1410 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.663+0000 7f0c3da4f640 1 -- 172.21.15.53:0/2092177499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c380d1410 msgr2=0x7f0c380cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/2092177499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c380d1410 0x7f0c380cf0e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0c3808b570 tx=0x7f0c2001ec70 comp rx=0 tx=0).stop 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- 172.21.15.53:0/2092177499 shutdown_connections 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/2092177499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c380d1410 0x7f0c380cf0e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/2092177499 >> v2:172.21.15.87:3300/0 conn(0x7f0c3815c860 0x7f0c380cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- 172.21.15.53:0/2092177499 >> 172.21.15.53:0/2092177499 conn(0x7f0c38065c80 msgr2=0x7f0c38066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- 172.21.15.53:0/2092177499 shutdown_connections 2024-09-13T18:28:55.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- 172.21.15.53:0/2092177499 wait complete. 2024-09-13T18:28:55.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 Processor -- start 2024-09-13T18:28:55.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- start start 2024-09-13T18:28:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c380d1410 0x7f0c381519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c380d1860 0x7f0c380c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c3815c860 0x7f0c38152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380c7020 con 0x7f0c3815c860 2024-09-13T18:28:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38151ef0 con 0x7f0c380d1860 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380c8720 con 0x7f0c380d1410 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c3815c860 0x7f0c38152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c3815c860 0x7f0c38152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46456/0 (socket says 172.21.15.53:46456) 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 -- 172.21.15.53:0/3939373657 learned_addr learned my addr 172.21.15.53:0/3939373657 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c2ffff640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c380d1860 0x7f0c380c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c36ffd640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c380d1410 0x7f0c381519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 -- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c380d1410 msgr2=0x7f0c381519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c380d1410 0x7f0c381519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 -- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c380d1860 msgr2=0x7f0c380c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c380d1860 0x7f0c380c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 -- 172.21.15.53:0/3939373657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c20009420 con 0x7f0c3815c860 2024-09-13T18:28:55.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c377fe640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c3815c860 0x7f0c38152330 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000caf0 tx=0x7f0c3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c34ff9640 1 -- 172.21.15.53:0/3939373657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000aca0 con 0x7f0c3815c860 2024-09-13T18:28:55.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c34ff9640 1 -- 172.21.15.53:0/3939373657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3000ae00 con 0x7f0c3815c860 2024-09-13T18:28:55.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c380c8a00 con 0x7f0c3815c860 2024-09-13T18:28:55.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c34ff9640 1 -- 172.21.15.53:0/3939373657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30012600 con 0x7f0c3815c860 2024-09-13T18:28:55.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.667+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c380c8fc0 con 0x7f0c3815c860 2024-09-13T18:28:55.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.671+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c380c5d80 con 0x7f0c3815c860 2024-09-13T18:28:55.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.671+0000 7f0c34ff9640 1 -- 172.21.15.53:0/3939373657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 10) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f0c30007070 con 0x7f0c3815c860 2024-09-13T18:28:55.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.671+0000 7f0c34ff9640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c180668d0 0x7f0c18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:55.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.671+0000 7f0c34ff9640 1 -- 172.21.15.53:0/3939373657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c30084370 con 0x7f0c3815c860 2024-09-13T18:28:55.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.671+0000 7f0c36ffd640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c180668d0 0x7f0c18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:55.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.671+0000 7f0c36ffd640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c180668d0 0x7f0c18068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0c38156590 tx=0x7f0c28008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:55.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.675+0000 7f0c34ff9640 1 -- 172.21.15.53:0/3939373657 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c300514c0 con 0x7f0c3815c860 2024-09-13T18:28:55.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.863+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume authorize", "vol_name": "cephfs", "sub_name": "subvol39580", "auth_id": "alice", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c380b5890 con 0x7f0c180668d0 2024-09-13T18:28:55.887 INFO:tasks.ceph.mgr.x.smithi087.stderr:Creating meta for ID alice with tenant None 2024-09-13T18:28:55.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.943+0000 7f0c34ff9640 1 -- 172.21.15.53:0/3939373657 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0c2800b5c0 con 0x7f0c180668d0 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c180668d0 msgr2=0x7f0c18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c180668d0 0x7f0c18068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0c38156590 tx=0x7f0c28008040 comp rx=0 tx=0).stop 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c3815c860 msgr2=0x7f0c38152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c3815c860 0x7f0c38152330 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000caf0 tx=0x7f0c3000a060 comp rx=0 tx=0).stop 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 shutdown_connections 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0c180668d0 0x7f0c18068d90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c3815c860 0x7f0c38152330 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c380d1860 0x7f0c380c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 --2- 172.21.15.53:0/3939373657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c380d1410 0x7f0c381519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 >> 172.21.15.53:0/3939373657 conn(0x7f0c38065c80 msgr2=0x7f0c380cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 shutdown_connections 2024-09-13T18:28:55.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:55.947+0000 7f0c3da4f640 1 -- 172.21.15.53:0/3939373657 wait complete. 2024-09-13T18:28:55.973 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.alice --format=json-pretty 2024-09-13T18:28:56.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05c76a640 1 Processor -- start 2024-09-13T18:28:56.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05c76a640 1 -- start start 2024-09-13T18:28:56.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05c76a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cb980 0x7fa0540b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05c76a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0540b1ac0 con 0x7fa0540cbd60 2024-09-13T18:28:56.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05c76a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa054159ac0 con 0x7fa05406b850 2024-09-13T18:28:56.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05c76a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054159da0 con 0x7fa0540cb980 2024-09-13T18:28:56.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05ad07640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa0540cbd60 0x7fa0540b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46358/0 (socket says 172.21.15.53:46358) 2024-09-13T18:28:56.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05ad07640 1 -- 172.21.15.53:0/1479469449 learned_addr learned my addr 172.21.15.53:0/1479469449 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05a506640 1 --2- 172.21.15.53:0/1479469449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cb980 0x7fa0540b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa059504640 1 -- 172.21.15.53:0/1479469449 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584984991 0 0) 0x7fa0540b1ac0 con 0x7fa0540cbd60 2024-09-13T18:28:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa059504640 1 -- 172.21.15.53:0/1479469449 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa040003530 con 0x7fa0540cbd60 2024-09-13T18:28:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05a506640 1 -- 172.21.15.53:0/1479469449 >> v1:172.21.15.87:6789/0 conn(0x7fa05406b850 legacy=0x7fa05406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05a506640 1 -- 172.21.15.53:0/1479469449 >> v1:172.21.15.53:6789/0 conn(0x7fa0540cbd60 legacy=0x7fa0540b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.095+0000 7fa05a506640 1 -- 172.21.15.53:0/1479469449 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05415a080 con 0x7fa0540cb980 2024-09-13T18:28:56.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05a506640 1 --2- 172.21.15.53:0/1479469449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cb980 0x7fa0540b33b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa050009820 tx=0x7fa05001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838a0405a5f64c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa059504640 1 -- 172.21.15.53:0/1479469449 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500ab600 con 0x7fa0540cb980 2024-09-13T18:28:56.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa059504640 1 -- 172.21.15.53:0/1479469449 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0500ab760 con 0x7fa0540cb980 2024-09-13T18:28:56.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa059504640 1 -- 172.21.15.53:0/1479469449 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500abad0 con 0x7fa0540cb980 2024-09-13T18:28:56.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 -- 172.21.15.53:0/1479469449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cb980 msgr2=0x7fa0540b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 --2- 172.21.15.53:0/1479469449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cb980 0x7fa0540b33b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa050009820 tx=0x7fa05001c400 comp rx=0 tx=0).stop 2024-09-13T18:28:56.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 -- 172.21.15.53:0/1479469449 shutdown_connections 2024-09-13T18:28:56.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 --2- 172.21.15.53:0/1479469449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cb980 0x7fa0540b33b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 -- 172.21.15.53:0/1479469449 >> 172.21.15.53:0/1479469449 conn(0x7fa054065c80 msgr2=0x7fa054066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 -- 172.21.15.53:0/1479469449 shutdown_connections 2024-09-13T18:28:56.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 -- 172.21.15.53:0/1479469449 wait complete. 2024-09-13T18:28:56.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 Processor -- start 2024-09-13T18:28:56.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.099+0000 7fa05c76a640 1 -- start start 2024-09-13T18:28:56.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa05406b850 0x7fa054146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0540cb980 0x7fa0541682d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cbd60 0x7fa0540aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0541671d0 con 0x7fa05406b850 2024-09-13T18:28:56.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa054167470 con 0x7fa0540cb980 2024-09-13T18:28:56.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054167750 con 0x7fa0540cbd60 2024-09-13T18:28:56.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa05406b850 0x7fa054146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa05406b850 0x7fa054146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46472/0 (socket says 172.21.15.53:46472) 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 -- 172.21.15.53:0/2385594004 learned_addr learned my addr 172.21.15.53:0/2385594004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05ad07640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cbd60 0x7fa0540aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa059d05640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0540cb980 0x7fa0541682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 -- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cbd60 msgr2=0x7fa0540aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cbd60 0x7fa0540aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 -- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0540cb980 msgr2=0x7fa0541682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0540cb980 0x7fa0541682d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 -- 172.21.15.53:0/2385594004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009420 con 0x7fa05406b850 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa059d05640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0540cb980 0x7fa0541682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05a506640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa05406b850 0x7fa054146b30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa05001aab0 tx=0x7fa0500191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa04affd640 1 -- 172.21.15.53:0/2385594004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050004450 con 0x7fa05406b850 2024-09-13T18:28:56.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa04affd640 1 -- 172.21.15.53:0/2385594004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0500ab8d0 con 0x7fa05406b850 2024-09-13T18:28:56.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa054167a30 con 0x7fa05406b850 2024-09-13T18:28:56.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa04affd640 1 -- 172.21.15.53:0/2385594004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500abcc0 con 0x7fa05406b850 2024-09-13T18:28:56.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa054168810 con 0x7fa05406b850 2024-09-13T18:28:56.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa054067400 con 0x7fa05406b850 2024-09-13T18:28:56.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa04affd640 1 -- 172.21.15.53:0/2385594004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 10) v1 ==== 86296+0+0 (secure 0 0 0) 0x7fa050003620 con 0x7fa05406b850 2024-09-13T18:28:56.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa04affd640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0380668d0 0x7fa038068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa04affd640 1 -- 172.21.15.53:0/2385594004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa05011eb20 con 0x7fa05406b850 2024-09-13T18:28:56.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.103+0000 7fa059d05640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0380668d0 0x7fa038068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.107+0000 7fa059d05640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0380668d0 0x7fa038068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa0541fc8e0 tx=0x7fa044009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.107+0000 7fa04affd640 1 -- 172.21.15.53:0/2385594004 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa0500ebb30 con 0x7fa05406b850 2024-09-13T18:28:56.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.327+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"} v 0) v1 -- 0x7fa054168ac0 con 0x7fa05406b850 2024-09-13T18:28:56.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.327+0000 7fa04affd640 1 -- 172.21.15.53:0/2385594004 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"}]=0 v18) v1 ==== 107+0+280 (secure 0 0 0) 0x7fa0500c10b0 con 0x7fa05406b850 2024-09-13T18:28:56.336 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:28:56.336 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:28:56.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:28:56.336 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.alice", 2024-09-13T18:28:56.337 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBnhORm8thNNhAA250ElbV6JMWwA3fq0LWh0A==", 2024-09-13T18:28:56.337 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:28:56.337 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol39580", 2024-09-13T18:28:56.337 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:28:56.337 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-13T18:28:56.338 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:56.338 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:28:56.338 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:28:56.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0380668d0 msgr2=0x7fa038068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0380668d0 0x7fa038068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa0541fc8e0 tx=0x7fa044009040 comp rx=0 tx=0).stop 2024-09-13T18:28:56.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa05406b850 msgr2=0x7fa054146b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa05406b850 0x7fa054146b30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa05001aab0 tx=0x7fa0500191a0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 shutdown_connections 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0380668d0 0x7fa038068d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0540cbd60 0x7fa0540aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0540cb980 0x7fa0541682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 --2- 172.21.15.53:0/2385594004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa05406b850 0x7fa054146b30 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 >> 172.21.15.53:0/2385594004 conn(0x7fa054065c80 msgr2=0x7fa05406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 shutdown_connections 2024-09-13T18:28:56.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.331+0000 7fa05c76a640 1 -- 172.21.15.53:0/2385594004 wait complete. 2024-09-13T18:28:56.355 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol39580 2024-09-13T18:28:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e285bd640 1 Processor -- start 2024-09-13T18:28:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e285bd640 1 -- start start 2024-09-13T18:28:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e285bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e20157020 0x7f5e2006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e285bd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e2006d270 0x7f5e2006f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e285bd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2006d6e0 con 0x7f5e20156c40 2024-09-13T18:28:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e285bd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e200715f0 con 0x7f5e2006d270 2024-09-13T18:28:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e285bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200b15a0 con 0x7f5e20157020 2024-09-13T18:28:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26b5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e2006d270 0x7f5e2006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e25b58640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e20157020 0x7f5e2006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26b5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e2006d270 0x7f5e2006f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:45952/0 (socket says 172.21.15.53:45952) 2024-09-13T18:28:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26359640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5e20156c40 0x7f5e20070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:59270/0 (socket says 172.21.15.53:59270) 2024-09-13T18:28:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26b5a640 1 -- 172.21.15.53:0/919241176 learned_addr learned my addr 172.21.15.53:0/919241176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26b5a640 1 -- 172.21.15.53:0/919241176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e20157020 msgr2=0x7f5e2006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26b5a640 1 --2- 172.21.15.53:0/919241176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e20157020 0x7f5e2006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26b5a640 1 -- 172.21.15.53:0/919241176 >> v1:172.21.15.87:6789/0 conn(0x7f5e20156c40 legacy=0x7f5e20070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.483+0000 7f5e26b5a640 1 -- 172.21.15.53:0/919241176 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200b1880 con 0x7f5e2006d270 2024-09-13T18:28:56.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e26b5a640 1 --2- 172.21.15.53:0/919241176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e2006d270 0x7f5e2006f330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800d150 tx=0x7f5e1801ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=974c89e366b1ad00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e25357640 1 -- 172.21.15.53:0/919241176 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e180a7cd0 con 0x7f5e2006d270 2024-09-13T18:28:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e25357640 1 -- 172.21.15.53:0/919241176 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e180a7e30 con 0x7f5e2006d270 2024-09-13T18:28:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e25357640 1 -- 172.21.15.53:0/919241176 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800b2f0 con 0x7f5e2006d270 2024-09-13T18:28:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- 172.21.15.53:0/919241176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e2006d270 msgr2=0x7f5e2006f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 --2- 172.21.15.53:0/919241176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e2006d270 0x7f5e2006f330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800d150 tx=0x7f5e1801ec00 comp rx=0 tx=0).stop 2024-09-13T18:28:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- 172.21.15.53:0/919241176 shutdown_connections 2024-09-13T18:28:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 --2- 172.21.15.53:0/919241176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e2006d270 0x7f5e2006f330 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 --2- 172.21.15.53:0/919241176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e20157020 0x7f5e2006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- 172.21.15.53:0/919241176 >> 172.21.15.53:0/919241176 conn(0x7f5e20065c80 msgr2=0x7f5e20066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- 172.21.15.53:0/919241176 shutdown_connections 2024-09-13T18:28:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- 172.21.15.53:0/919241176 wait complete. 2024-09-13T18:28:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 Processor -- start 2024-09-13T18:28:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- start start 2024-09-13T18:28:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e2006d270 0x7f5e201458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e20156c40 0x7f5e20151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e2015bd20 0x7f5e20152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2014d330 con 0x7f5e2015bd20 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e20145de0 con 0x7f5e20156c40 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e285bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2014c890 con 0x7f5e2006d270 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e26b5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e2015bd20 0x7f5e20152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e26b5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e2015bd20 0x7f5e20152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46476/0 (socket says 172.21.15.53:46476) 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.487+0000 7f5e26b5a640 1 -- 172.21.15.53:0/2552058059 learned_addr learned my addr 172.21.15.53:0/2552058059 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26359640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e2006d270 0x7f5e201458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e25b58640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e20156c40 0x7f5e20151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26b5a640 1 -- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e2006d270 msgr2=0x7f5e201458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26b5a640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e2006d270 0x7f5e201458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26b5a640 1 -- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e20156c40 msgr2=0x7f5e20151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26b5a640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e20156c40 0x7f5e20151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26b5a640 1 -- 172.21.15.53:0/2552058059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1800bd40 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26b5a640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e2015bd20 0x7f5e20152250 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f5e1801f4a0 tx=0x7f5e1801b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e16ffd640 1 -- 172.21.15.53:0/2552058059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18009800 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e16ffd640 1 -- 172.21.15.53:0/2552058059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e180099a0 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2015c510 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e16ffd640 1 -- 172.21.15.53:0/2552058059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18009d50 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2014cb30 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2006f330 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e16ffd640 1 -- 172.21.15.53:0/2552058059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 10) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f5e180b7410 con 0x7f5e2015bd20 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e16ffd640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e040668d0 0x7f5e04068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e16ffd640 1 -- 172.21.15.53:0/2552058059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e1811f310 con 0x7f5e2015bd20 2024-09-13T18:28:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26359640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e040668d0 0x7f5e04068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.491+0000 7f5e26359640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e040668d0 0x7f5e04068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000f70 tx=0x7f5e1c007e90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.495+0000 7f5e16ffd640 1 -- 172.21.15.53:0/2552058059 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e180ec3d0 con 0x7f5e2015bd20 2024-09-13T18:28:56.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.679+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol39580", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e200b2360 con 0x7f5e040668d0 2024-09-13T18:28:56.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.707+0000 7f5e16ffd640 1 -- 172.21.15.53:0/2552058059 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5e200b2360 con 0x7f5e040668d0 2024-09-13T18:28:56.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e040668d0 msgr2=0x7f5e04068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e040668d0 0x7f5e04068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000f70 tx=0x7f5e1c007e90 comp rx=0 tx=0).stop 2024-09-13T18:28:56.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e2015bd20 msgr2=0x7f5e20152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e2015bd20 0x7f5e20152250 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f5e1801f4a0 tx=0x7f5e1801b9a0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 shutdown_connections 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e040668d0 0x7f5e04068d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e2015bd20 0x7f5e20152250 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e20156c40 0x7f5e20151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 --2- 172.21.15.53:0/2552058059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e2006d270 0x7f5e201458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 >> 172.21.15.53:0/2552058059 conn(0x7f5e20065c80 msgr2=0x7f5e20070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 shutdown_connections 2024-09-13T18:28:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.711+0000 7f5e285bd640 1 -- 172.21.15.53:0/2552058059 wait complete. 2024-09-13T18:28:56.723 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.719+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.723 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.719+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.723 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.719+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.723 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.719+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.723 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.719+0000 7f3e9d618640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol70591 2024-09-13T18:28:56.744 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.739+0000 7f3e9de19640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.744 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.739+0000 7f3e9de19640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.744 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.739+0000 7f3e9de19640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.744 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.739+0000 7f3e9de19640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.744 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:28:56.739+0000 7f3e9de19640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:28:56.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2bb07640 1 Processor -- start 2024-09-13T18:28:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2bb07640 1 -- start start 2024-09-13T18:28:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2bb07640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 0x7f9b240cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2bb07640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2406f7a0 con 0x7f9b24143e80 2024-09-13T18:28:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2bb07640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2406fd60 con 0x7f9b240cd320 2024-09-13T18:28:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2bb07640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2406baa0 con 0x7f9b240caee0 2024-09-13T18:28:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b24143e80 0x7f9b2406b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57654/0 (socket says 172.21.15.53:57654) 2024-09-13T18:28:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 -- 172.21.15.53:0/2708834087 learned_addr learned my addr 172.21.15.53:0/2708834087 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b290a2640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 0x7f9b240cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923222762 0 0) 0x7f9b2406f7a0 con 0x7f9b24143e80 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b10003530 con 0x7f9b24143e80 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1750887174 0 0) 0x7f9b10003530 con 0x7f9b24143e80 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 msgr2=0x7f9b240cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 0x7f9b240cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 >> v1:172.21.15.87:6789/0 conn(0x7f9b240cd320 legacy=0x7f9b240cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240cb960 con 0x7f9b24143e80 2024-09-13T18:28:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9b20001680 con 0x7f9b24143e80 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 >> v1:172.21.15.53:6789/0 conn(0x7f9b24143e80 legacy=0x7f9b2406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100039b0 0x7f9b10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 0x7f9b100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b10004d10 0x7f9b10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2406baa0 con 0x7f9b100039b0 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1000baf0 con 0x7f9b10004d10 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1000bcb0 con 0x7f9b240caee0 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100039b0 0x7f9b10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b290a2640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 0x7f9b100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2a0a4640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b10004d10 0x7f9b10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 -- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 msgr2=0x7f9b100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240caee0 0x7f9b100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 -- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b10004d10 msgr2=0x7f9b10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:28:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b10004d10 0x7f9b10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b298a3640 1 -- 172.21.15.53:0/2708834087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10003530 con 0x7f9b100039b0 2024-09-13T18:28:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.855+0000 7f9b2a0a4640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b10004d10 0x7f9b10005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b298a3640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100039b0 0x7f9b10003dd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c240 tx=0x7f9b2001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad557c4ed9551ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20005ae0 con 0x7f9b100039b0 2024-09-13T18:28:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b20005c40 con 0x7f9b100039b0 2024-09-13T18:28:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b288a1640 1 -- 172.21.15.53:0/2708834087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b200a5760 con 0x7f9b100039b0 2024-09-13T18:28:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 -- 172.21.15.53:0/2708834087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100039b0 msgr2=0x7f9b10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 --2- 172.21.15.53:0/2708834087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100039b0 0x7f9b10003dd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c240 tx=0x7f9b2001cb70 comp rx=0 tx=0).stop 2024-09-13T18:28:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2a0a4640 1 -- 172.21.15.53:0/2708834087 reap_dead start 2024-09-13T18:28:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 -- 172.21.15.53:0/2708834087 shutdown_connections 2024-09-13T18:28:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 -- 172.21.15.53:0/2708834087 >> 172.21.15.53:0/2708834087 conn(0x7f9b24065c80 msgr2=0x7f9b24066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 -- 172.21.15.53:0/2708834087 shutdown_connections 2024-09-13T18:28:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 -- 172.21.15.53:0/2708834087 wait complete. 2024-09-13T18:28:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 Processor -- start 2024-09-13T18:28:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.859+0000 7f9b2bb07640 1 -- start start 2024-09-13T18:28:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b100039b0 0x7f9b241f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240ad3f0 0x7f9b241f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b240b0720 0x7f9b240b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240b10e0 con 0x7f9b240b0720 2024-09-13T18:28:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240c5050 con 0x7f9b100039b0 2024-09-13T18:28:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240c4d70 con 0x7f9b240ad3f0 2024-09-13T18:28:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b240b0720 0x7f9b240b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b240b0720 0x7f9b240b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34412/0 (socket says 172.21.15.53:34412) 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 -- 172.21.15.53:0/3846758284 learned_addr learned my addr 172.21.15.53:0/3846758284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b290a2640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240ad3f0 0x7f9b241f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b298a3640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b100039b0 0x7f9b241f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 -- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240ad3f0 msgr2=0x7f9b241f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240ad3f0 0x7f9b241f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 -- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b100039b0 msgr2=0x7f9b241f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b100039b0 0x7f9b241f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 -- 172.21.15.53:0/3846758284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240b2050 con 0x7f9b240b0720 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b290a2640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240ad3f0 0x7f9b241f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2a0a4640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b240b0720 0x7f9b240b0ba0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c000f90 tx=0x7f9b1c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b1a7fc640 1 -- 172.21.15.53:0/3846758284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c017070 con 0x7f9b240b0720 2024-09-13T18:28:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b1a7fc640 1 -- 172.21.15.53:0/3846758284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c006b60 con 0x7f9b240b0720 2024-09-13T18:28:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b1a7fc640 1 -- 172.21.15.53:0/3846758284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c006d10 con 0x7f9b240b0720 2024-09-13T18:28:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b240b2330 con 0x7f9b240b0720 2024-09-13T18:28:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b241f8550 con 0x7f9b240b0720 2024-09-13T18:28:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b240b1eb0 con 0x7f9b240b0720 2024-09-13T18:28:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b1a7fc640 1 -- 172.21.15.53:0/3846758284 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 10) v1 ==== 86296+0+0 (secure 0 0 0) 0x7f9b1c003980 con 0x7f9b240b0720 2024-09-13T18:28:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b1a7fc640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9b080668d0 0x7f9b08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b1a7fc640 1 -- 172.21.15.53:0/3846758284 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b1c083d20 con 0x7f9b240b0720 2024-09-13T18:28:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.863+0000 7f9b298a3640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9b080668d0 0x7f9b08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.867+0000 7f9b298a3640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9b080668d0 0x7f9b08068d90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b200ab000 tx=0x7f9b200a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:56.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:56.867+0000 7f9b1a7fc640 1 -- 172.21.15.53:0/3846758284 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9b240b1eb0 con 0x7f9b240b0720 2024-09-13T18:28:57.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.051+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol70591", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b240ce160 con 0x7f9b080668d0 2024-09-13T18:28:57.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b1a7fc640 1 -- 172.21.15.53:0/3846758284 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9b200b5040 con 0x7f9b080668d0 2024-09-13T18:28:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9b080668d0 msgr2=0x7f9b08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9b080668d0 0x7f9b08068d90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b200ab000 tx=0x7f9b200a7070 comp rx=0 tx=0).stop 2024-09-13T18:28:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b240b0720 msgr2=0x7f9b240b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b240b0720 0x7f9b240b0ba0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c000f90 tx=0x7f9b1c00eb90 comp rx=0 tx=0).stop 2024-09-13T18:28:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 shutdown_connections 2024-09-13T18:28:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9b080668d0 0x7f9b08068d90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9b240ad3f0 0x7f9b241f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b240b0720 0x7f9b240b0ba0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 --2- 172.21.15.53:0/3846758284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b100039b0 0x7f9b241f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 >> 172.21.15.53:0/3846758284 conn(0x7f9b24065c80 msgr2=0x7f9b2415df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 shutdown_connections 2024-09-13T18:28:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:28:57.087+0000 7f9b2bb07640 1 -- 172.21.15.53:0/3846758284 wait complete. 2024-09-13T18:28:57.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:57.113 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:28:57.123 INFO:teuthology.orchestra.run.smithi053.stdout:3 2024-09-13T18:29:02.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:02.125 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:29:02.138 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-09-13T18:29:02.139 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:29:02.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:29:02.262 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:29:02.354 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:29:02.354 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:29:02.354 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:02.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.531+0000 7fa1f4d11640 1 Processor -- start 2024-09-13T18:29:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.531+0000 7fa1f4d11640 1 -- start start 2024-09-13T18:29:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1f4d11640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f00b1650 0x7fa1f00b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1f4d11640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1f00b4c80 0x7fa1f00d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1f4d11640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00b50b0 con 0x7fa1f015c840 2024-09-13T18:29:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1f4d11640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00cdd80 con 0x7fa1f00b4c80 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1f4d11640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0160a70 con 0x7fa1f00b1650 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1f00b4c80 0x7fa1f00d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1f00b4c80 0x7fa1f00d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34414/0 (socket says 172.21.15.53:34414) 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 -- 172.21.15.53:0/200338733 learned_addr learned my addr 172.21.15.53:0/200338733 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1e5d9b640 1 --2- 172.21.15.53:0/200338733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f00b1650 0x7fa1f00b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 -- 172.21.15.53:0/200338733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f00b1650 msgr2=0x7fa1f00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 --2- 172.21.15.53:0/200338733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f00b1650 0x7fa1f00b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 -- 172.21.15.53:0/200338733 >> v1:172.21.15.87:6789/0 conn(0x7fa1f015c840 legacy=0x7fa1f0160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 -- 172.21.15.53:0/200338733 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0160d50 con 0x7fa1f00b4c80 2024-09-13T18:29:02.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1eed9d640 1 --2- 172.21.15.53:0/200338733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b4c80 0x7fa1f00d0e10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009e50 tx=0x7fa1e801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988e04b4c5786359 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1edd9b640 1 -- 172.21.15.53:0/200338733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80a58d0 con 0x7fa1f00b4c80 2024-09-13T18:29:02.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1edd9b640 1 -- 172.21.15.53:0/200338733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e80a5a30 con 0x7fa1f00b4c80 2024-09-13T18:29:02.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.535+0000 7fa1edd9b640 1 -- 172.21.15.53:0/200338733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80a5dc0 con 0x7fa1f00b4c80 2024-09-13T18:29:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- 172.21.15.53:0/200338733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b4c80 msgr2=0x7fa1f00d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/200338733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b4c80 0x7fa1f00d0e10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009e50 tx=0x7fa1e801ca00 comp rx=0 tx=0).stop 2024-09-13T18:29:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- 172.21.15.53:0/200338733 shutdown_connections 2024-09-13T18:29:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/200338733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b4c80 0x7fa1f00d0e10 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/200338733 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f00b1650 0x7fa1f00b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- 172.21.15.53:0/200338733 >> 172.21.15.53:0/200338733 conn(0x7fa1f0066080 msgr2=0x7fa1f0066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- 172.21.15.53:0/200338733 shutdown_connections 2024-09-13T18:29:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- 172.21.15.53:0/200338733 wait complete. 2024-09-13T18:29:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 Processor -- start 2024-09-13T18:29:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- start start 2024-09-13T18:29:02.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b1650 0x7fa1f00b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1f00b4c80 0x7fa1f01550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f015c840 0x7fa1f00c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0153360 con 0x7fa1f00b1650 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00b2c00 con 0x7fa1f00b4c80 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0154320 con 0x7fa1f015c840 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b1650 0x7fa1f00b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1e5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1f00b4c80 0x7fa1f01550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b1650 0x7fa1f00b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34416/0 (socket says 172.21.15.53:34416) 2024-09-13T18:29:02.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1eed9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f015c840 0x7fa1f00c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 -- 172.21.15.53:0/4012192794 learned_addr learned my addr 172.21.15.53:0/4012192794 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 -- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f015c840 msgr2=0x7fa1f00c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f015c840 0x7fa1f00c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 -- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1f00b4c80 msgr2=0x7fa1f01550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1f00b4c80 0x7fa1f01550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 -- 172.21.15.53:0/4012192794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009b30 con 0x7fa1f00b1650 2024-09-13T18:29:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1ee59c640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b1650 0x7fa1f00b26c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c3c0 tx=0x7fa1e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1e77fe640 1 -- 172.21.15.53:0/4012192794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00052d0 con 0x7fa1f00b1650 2024-09-13T18:29:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1e77fe640 1 -- 172.21.15.53:0/4012192794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e0005430 con 0x7fa1f00b1650 2024-09-13T18:29:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1e77fe640 1 -- 172.21.15.53:0/4012192794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0003840 con 0x7fa1f00b1650 2024-09-13T18:29:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f0154600 con 0x7fa1f00b1650 2024-09-13T18:29:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.539+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f0154bc0 con 0x7fa1f00b1650 2024-09-13T18:29:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.543+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f0154de0 con 0x7fa1f00b1650 2024-09-13T18:29:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.543+0000 7fa1e77fe640 1 -- 172.21.15.53:0/4012192794 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fa1e00039a0 con 0x7fa1f00b1650 2024-09-13T18:29:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.543+0000 7fa1e77fe640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1d00669f0 0x7fa1d0068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.543+0000 7fa1e77fe640 1 -- 172.21.15.53:0/4012192794 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1e0083b50 con 0x7fa1f00b1650 2024-09-13T18:29:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.543+0000 7fa1e5d9b640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1d00669f0 0x7fa1d0068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.543+0000 7fa1e5d9b640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1d00669f0 0x7fa1d0068eb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00c96a0 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.547+0000 7fa1e77fe640 1 -- 172.21.15.53:0/4012192794 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1e0050b60 con 0x7fa1f00b1650 2024-09-13T18:29:02.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.707+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f00b4740 con 0x7fa1f00b1650 2024-09-13T18:29:02.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.711+0000 7fa1e77fe640 1 -- 172.21.15.53:0/4012192794 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fa1e0017090 con 0x7fa1f00b1650 2024-09-13T18:29:02.719 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:02.719 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:31.841305+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1d00669f0 msgr2=0x7fa1d0068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1d00669f0 0x7fa1d0068eb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00c96a0 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b1650 msgr2=0x7fa1f00b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b1650 0x7fa1f00b26c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c3c0 tx=0x7fa1e000c880 comp rx=0 tx=0).stop 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 shutdown_connections 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa1d00669f0 0x7fa1d0068eb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa1f015c840 0x7fa1f00c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1f00b4c80 0x7fa1f01550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 --2- 172.21.15.53:0/4012192794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1f00b1650 0x7fa1f00b26c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 >> 172.21.15.53:0/4012192794 conn(0x7fa1f0066080 msgr2=0x7fa1f00cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 shutdown_connections 2024-09-13T18:29:02.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.715+0000 7fa1f4d11640 1 -- 172.21.15.53:0/4012192794 wait complete. 2024-09-13T18:29:02.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:28.459143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:29.809417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:02.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f805a91c640 1 Processor -- start 2024-09-13T18:29:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f805a91c640 1 -- start start 2024-09-13T18:29:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f805a91c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8054143f80 0x7f80540ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f805a91c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f805406c990 0x7f8054065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f805a91c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805415baa0 con 0x7f80540661c0 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f805a91c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8054144360 con 0x7f8054143f80 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f805a91c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8054066630 con 0x7f805406c990 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f8053fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8054143f80 0x7f80540ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f8053fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8054143f80 0x7f80540ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34418/0 (socket says 172.21.15.53:34418) 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f8053fff640 1 -- 172.21.15.53:0/534429905 learned_addr learned my addr 172.21.15.53:0/534429905 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f80537fe640 1 --2- 172.21.15.53:0/534429905 >> v2:172.21.15.87:3300/0 conn(0x7f805406c990 0x7f8054065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f8053fff640 1 -- 172.21.15.53:0/534429905 >> v2:172.21.15.87:3300/0 conn(0x7f805406c990 msgr2=0x7f8054065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f8053fff640 1 --2- 172.21.15.53:0/534429905 >> v2:172.21.15.87:3300/0 conn(0x7f805406c990 0x7f8054065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f8053fff640 1 -- 172.21.15.53:0/534429905 >> v1:172.21.15.87:6789/0 conn(0x7f80540661c0 legacy=0x7f8054070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.863+0000 7f8053fff640 1 -- 172.21.15.53:0/534429905 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805406d170 con 0x7f8054143f80 2024-09-13T18:29:02.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f8053fff640 1 --2- 172.21.15.53:0/534429905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f80540ccd10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f80540b1f10 tx=0x7f803c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bbf437404e5e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f8052ffd640 1 -- 172.21.15.53:0/534429905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c0af400 con 0x7f8054143f80 2024-09-13T18:29:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f8052ffd640 1 -- 172.21.15.53:0/534429905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c0ab050 con 0x7f8054143f80 2024-09-13T18:29:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f8052ffd640 1 -- 172.21.15.53:0/534429905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c0af780 con 0x7f8054143f80 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 -- 172.21.15.53:0/534429905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 msgr2=0x7f80540ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 --2- 172.21.15.53:0/534429905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f80540ccd10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f80540b1f10 tx=0x7f803c01f1e0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 -- 172.21.15.53:0/534429905 shutdown_connections 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 --2- 172.21.15.53:0/534429905 >> v2:172.21.15.87:3300/0 conn(0x7f805406c990 0x7f8054065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 --2- 172.21.15.53:0/534429905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f80540ccd10 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 -- 172.21.15.53:0/534429905 >> 172.21.15.53:0/534429905 conn(0x7f80540b1310 msgr2=0x7f80540b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 -- 172.21.15.53:0/534429905 shutdown_connections 2024-09-13T18:29:02.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.867+0000 7f805a91c640 1 -- 172.21.15.53:0/534429905 wait complete. 2024-09-13T18:29:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 Processor -- start 2024-09-13T18:29:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 -- start start 2024-09-13T18:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80540661c0 0x7f8054139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f805406c990 0x7f805413a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f805413ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805413b580 con 0x7f8054143f80 2024-09-13T18:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805413b860 con 0x7f805406c990 2024-09-13T18:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805413bb40 con 0x7f80540661c0 2024-09-13T18:29:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f805413ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f805413ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34424/0 (socket says 172.21.15.53:34424) 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 -- 172.21.15.53:0/4251398051 learned_addr learned my addr 172.21.15.53:0/4251398051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8053fff640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80540661c0 0x7f8054139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f80537fe640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f805406c990 0x7f805413a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 -- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80540661c0 msgr2=0x7f8054139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80540661c0 0x7f8054139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 -- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f805406c990 msgr2=0x7f805413a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f805406c990 0x7f805413a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 -- 172.21.15.53:0/4251398051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c009b30 con 0x7f8054143f80 2024-09-13T18:29:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f80537fe640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f805406c990 0x7f805413a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8058eb9640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f805413ad50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c430 tx=0x7f804c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8050ff9640 1 -- 172.21.15.53:0/4251398051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c005220 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8050ff9640 1 -- 172.21.15.53:0/4251398051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c005380 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805413be20 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8050ff9640 1 -- 172.21.15.53:0/4251398051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c007270 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805413b290 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805406cde0 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.871+0000 7f8050ff9640 1 -- 172.21.15.53:0/4251398051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f804c0073d0 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.875+0000 7f8050ff9640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f80380669f0 0x7f8038068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.875+0000 7f8050ff9640 1 -- 172.21.15.53:0/4251398051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f804c083cc0 con 0x7f8054143f80 2024-09-13T18:29:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.875+0000 7f8053fff640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f80380669f0 0x7f8038068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.875+0000 7f8053fff640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f80380669f0 0x7f8038068eb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f803c0b1000 tx=0x7f803c0aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:02.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:02.879+0000 7f8050ff9640 1 -- 172.21.15.53:0/4251398051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f804c050c20 con 0x7f8054143f80 2024-09-13T18:29:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.039+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f805413c2d0 con 0x7f8054143f80 2024-09-13T18:29:03.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f8050ff9640 1 -- 172.21.15.53:0/4251398051 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f804c054240 con 0x7f8054143f80 2024-09-13T18:29:03.048 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f80380669f0 msgr2=0x7f8038068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f80380669f0 0x7f8038068eb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f803c0b1000 tx=0x7f803c0aa000 comp rx=0 tx=0).stop 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 msgr2=0x7f805413ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f805413ad50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c430 tx=0x7f804c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 shutdown_connections 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f80380669f0 0x7f8038068eb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054143f80 0x7f805413ad50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f805406c990 0x7f805413a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 --2- 172.21.15.53:0/4251398051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80540661c0 0x7f8054139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 >> 172.21.15.53:0/4251398051 conn(0x7f80540b1310 msgr2=0x7f805406a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 shutdown_connections 2024-09-13T18:29:03.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.043+0000 7f805a91c640 1 -- 172.21.15.53:0/4251398051 wait complete. 2024-09-13T18:29:03.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67fd1b4640 1 Processor -- start 2024-09-13T18:29:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67fd1b4640 1 -- start start 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67fd1b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 0x7f67f80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67fd1b4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f80b7db0 con 0x7f67f80ccd10 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67fd1b4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f80d0650 con 0x7f67f815c830 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67fd1b4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80d0c10 con 0x7f67f80d3390 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f67f80ccd10 0x7f67f80d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57658/0 (socket says 172.21.15.53:57658) 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 -- 172.21.15.53:0/3755199563 learned_addr learned my addr 172.21.15.53:0/3755199563 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050139678 0 0) 0x7f67f80b7db0 con 0x7f67f80ccd10 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e0003530 con 0x7f67f80ccd10 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f759e640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 0x7f67f80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3360499065 0 0) 0x7f67e0003530 con 0x7f67f80ccd10 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 msgr2=0x7f67f80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 0x7f67f80cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 >> v1:172.21.15.87:6789/0 conn(0x7f67f815c830 legacy=0x7f67f80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80d17b0 con 0x7f67f80ccd10 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f67ec001680 con 0x7f67f80ccd10 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 >> v1:172.21.15.53:6789/0 conn(0x7f67f80ccd10 legacy=0x7f67f80d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67e00039b0 0x7f67e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67e00047d0 0x7f67e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 0x7f67e0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80d0c10 con 0x7f67e00047d0 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e000bb50 con 0x7f67e00039b0 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e000bd10 con 0x7f67f80d3390 2024-09-13T18:29:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67e00047d0 0x7f67e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f6d9d640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67e00039b0 0x7f67e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f759e640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 0x7f67e0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 -- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 msgr2=0x7f67e0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 0x7f67e0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 -- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67e00039b0 msgr2=0x7f67e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67e00039b0 0x7f67e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f659c640 1 -- 172.21.15.53:0/3755199563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0003530 con 0x7f67e00047d0 2024-09-13T18:29:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.179+0000 7f67f759e640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67f80d3390 0x7f67e0005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f659c640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67e00047d0 0x7f67e0004c50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f67ec007fd0 tx=0x7f67ec01f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9eb21bb503e22b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0a8ce0 con 0x7f67e00047d0 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0a8e40 con 0x7f67e00047d0 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f5d9b640 1 -- 172.21.15.53:0/3755199563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec005b20 con 0x7f67e00047d0 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- 172.21.15.53:0/3755199563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67e00047d0 msgr2=0x7f67e0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 --2- 172.21.15.53:0/3755199563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67e00047d0 0x7f67e0004c50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f67ec007fd0 tx=0x7f67ec01f2b0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 -- 172.21.15.53:0/3755199563 reap_dead start 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- 172.21.15.53:0/3755199563 shutdown_connections 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- 172.21.15.53:0/3755199563 >> 172.21.15.53:0/3755199563 conn(0x7f67f8070970 msgr2=0x7f67f8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- 172.21.15.53:0/3755199563 shutdown_connections 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- 172.21.15.53:0/3755199563 wait complete. 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 Processor -- start 2024-09-13T18:29:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- start start 2024-09-13T18:29:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67e00047d0 0x7f67f80cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67f80b0af0 0x7f67f80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67f815ede0 0x7f67f815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80b0f70 con 0x7f67f815ede0 2024-09-13T18:29:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f815f7a0 con 0x7f67f80b0af0 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67fd1b4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81563d0 con 0x7f67e00047d0 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67f815ede0 0x7f67f815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67f815ede0 0x7f67f815f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34456/0 (socket says 172.21.15.53:34456) 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 -- 172.21.15.53:0/421019182 learned_addr learned my addr 172.21.15.53:0/421019182 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f6d9d640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67e00047d0 0x7f67f80cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f659c640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67f80b0af0 0x7f67f80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 -- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67e00047d0 msgr2=0x7f67f80cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67e00047d0 0x7f67f80cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 -- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67f80b0af0 msgr2=0x7f67f80cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67f80b0af0 0x7f67f80cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f759e640 1 -- 172.21.15.53:0/421019182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f81566b0 con 0x7f67f815ede0 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f6d9d640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67e00047d0 0x7f67f80cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.183+0000 7f67f659c640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67f80b0af0 0x7f67f80cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67f759e640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67f815ede0 0x7f67f815f260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f67f806aec0 tx=0x7f67f0009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67df7fe640 1 -- 172.21.15.53:0/421019182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0007d50 con 0x7f67f815ede0 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67df7fe640 1 -- 172.21.15.53:0/421019182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0014400 con 0x7f67f815ede0 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f8156990 con 0x7f67f815ede0 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67df7fe640 1 -- 172.21.15.53:0/421019182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00147b0 con 0x7f67f815ede0 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f8156f50 con 0x7f67f815ede0 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f80cd180 con 0x7f67f815ede0 2024-09-13T18:29:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67df7fe640 1 -- 172.21.15.53:0/421019182 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f67f001d3b0 con 0x7f67f815ede0 2024-09-13T18:29:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67df7fe640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066a20 0x7f67e4068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67df7fe640 1 -- 172.21.15.53:0/421019182 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67f0084410 con 0x7f67f815ede0 2024-09-13T18:29:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67f6d9d640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066a20 0x7f67e4068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.187+0000 7f67f6d9d640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066a20 0x7f67e4068ee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f67e8000c10 tx=0x7f67e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.191+0000 7f67df7fe640 1 -- 172.21.15.53:0/421019182 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f67f0051370 con 0x7f67f815ede0 2024-09-13T18:29:03.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.347+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67f80b6c80 con 0x7f67f815ede0 2024-09-13T18:29:03.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67df7fe640 1 -- 172.21.15.53:0/421019182 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67f0054990 con 0x7f67f815ede0 2024-09-13T18:29:03.356 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:29:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066a20 msgr2=0x7f67e4068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066a20 0x7f67e4068ee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f67e8000c10 tx=0x7f67e8009040 comp rx=0 tx=0).stop 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67f815ede0 msgr2=0x7f67f815f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67f815ede0 0x7f67f815f260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f67f806aec0 tx=0x7f67f0009dc0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 shutdown_connections 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67e4066a20 0x7f67e4068ee0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67f815ede0 0x7f67f815f260 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67f80b0af0 0x7f67f80cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 --2- 172.21.15.53:0/421019182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67e00047d0 0x7f67f80cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 >> 172.21.15.53:0/421019182 conn(0x7f67f8070970 msgr2=0x7f67f80b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 shutdown_connections 2024-09-13T18:29:03.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.351+0000 7f67fd1b4640 1 -- 172.21.15.53:0/421019182 wait complete. 2024-09-13T18:29:03.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:03.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.499+0000 7f0cff2a3640 1 Processor -- start 2024-09-13T18:29:03.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.499+0000 7f0cff2a3640 1 -- start start 2024-09-13T18:29:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cff2a3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cf815c830 0x7f0cf80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cff2a3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0cf80d3390 0x7f0cf80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cff2a3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf80b7db0 con 0x7f0cf80ccd10 2024-09-13T18:29:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cff2a3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80d0650 con 0x7f0cf815c830 2024-09-13T18:29:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cff2a3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80d0c10 con 0x7f0cf80d3390 2024-09-13T18:29:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cf815c830 0x7f0cf80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cf815c830 0x7f0cf80d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34466/0 (socket says 172.21.15.53:34466) 2024-09-13T18:29:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1491760319 learned_addr learned my addr 172.21.15.53:0/1491760319 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd840640 1 --2- 172.21.15.53:0/1491760319 >> v2:172.21.15.87:3300/0 conn(0x7f0cf80d3390 0x7f0cf80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1491760319 >> v2:172.21.15.87:3300/0 conn(0x7f0cf80d3390 msgr2=0x7f0cf80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 --2- 172.21.15.53:0/1491760319 >> v2:172.21.15.87:3300/0 conn(0x7f0cf80d3390 0x7f0cf80cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1491760319 >> v1:172.21.15.87:6789/0 conn(0x7f0cf80ccd10 legacy=0x7f0cf80d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1491760319 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80cd7d0 con 0x7f0cf815c830 2024-09-13T18:29:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cfd03f640 1 --2- 172.21.15.53:0/1491760319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf815c830 0x7f0cf80d10a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80b80d0 tx=0x7f0cec01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e157d6a916516fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cebfff640 1 -- 172.21.15.53:0/1491760319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0ac630 con 0x7f0cf815c830 2024-09-13T18:29:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cebfff640 1 -- 172.21.15.53:0/1491760319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0ac790 con 0x7f0cf815c830 2024-09-13T18:29:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.503+0000 7f0cebfff640 1 -- 172.21.15.53:0/1491760319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0acb20 con 0x7f0cf815c830 2024-09-13T18:29:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1491760319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf815c830 msgr2=0x7f0cf80d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1491760319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf815c830 0x7f0cf80d10a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80b80d0 tx=0x7f0cec01c4e0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1491760319 shutdown_connections 2024-09-13T18:29:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1491760319 >> v2:172.21.15.87:3300/0 conn(0x7f0cf80d3390 0x7f0cf80cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1491760319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf815c830 0x7f0cf80d10a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1491760319 >> 172.21.15.53:0/1491760319 conn(0x7f0cf8070970 msgr2=0x7f0cf8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1491760319 shutdown_connections 2024-09-13T18:29:03.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1491760319 wait complete. 2024-09-13T18:29:03.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 Processor -- start 2024-09-13T18:29:03.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- start start 2024-09-13T18:29:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf80ccd10 0x7f0cf8152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cf80d3390 0x7f0cf814dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cf815c830 0x7f0cf8150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf814fa40 con 0x7f0cf80ccd10 2024-09-13T18:29:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8153000 con 0x7f0cf815c830 2024-09-13T18:29:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81537f0 con 0x7f0cf80d3390 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf80ccd10 0x7f0cf8152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf80ccd10 0x7f0cf8152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34474/0 (socket says 172.21.15.53:34474) 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1498372227 learned_addr learned my addr 172.21.15.53:0/1498372227 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd840640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cf815c830 0x7f0cf8150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfc83e640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cf80d3390 0x7f0cf814dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cf80d3390 msgr2=0x7f0cf814dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cf80d3390 0x7f0cf814dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cf815c830 msgr2=0x7f0cf8150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cf815c830 0x7f0cf8150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 -- 172.21.15.53:0/1498372227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0094d0 con 0x7f0cf80ccd10 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd840640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cf815c830 0x7f0cf8150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cfd03f640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf80ccd10 0x7f0cf8152ac0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0af040 tx=0x7f0cec019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0ce9ffb640 1 -- 172.21.15.53:0/1498372227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0b5640 con 0x7f0cf80ccd10 2024-09-13T18:29:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0ce9ffb640 1 -- 172.21.15.53:0/1498372227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0b57c0 con 0x7f0cf80ccd10 2024-09-13T18:29:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0ce9ffb640 1 -- 172.21.15.53:0/1498372227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0b5b70 con 0x7f0cf80ccd10 2024-09-13T18:29:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf8153230 con 0x7f0cf80ccd10 2024-09-13T18:29:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.507+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf80caa40 con 0x7f0cf80ccd10 2024-09-13T18:29:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.511+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf80cd160 con 0x7f0cf80ccd10 2024-09-13T18:29:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.511+0000 7f0ce9ffb640 1 -- 172.21.15.53:0/1498372227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f0cec0b3070 con 0x7f0cf80ccd10 2024-09-13T18:29:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.511+0000 7f0ce9ffb640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0cdc0669f0 0x7f0cdc068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.511+0000 7f0ce9ffb640 1 -- 172.21.15.53:0/1498372227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cec11e700 con 0x7f0cf80ccd10 2024-09-13T18:29:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.511+0000 7f0cfc83e640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0cdc0669f0 0x7f0cdc068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.511+0000 7f0cfc83e640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0cdc0669f0 0x7f0cdc068eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80cc5b0 tx=0x7f0cf4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.515+0000 7f0ce9ffb640 1 -- 172.21.15.53:0/1498372227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cec0eb620 con 0x7f0cf80ccd10 2024-09-13T18:29:03.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.671+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cf815c390 con 0x7f0cf80ccd10 2024-09-13T18:29:03.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.671+0000 7f0ce9ffb640 1 -- 172.21.15.53:0/1498372227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cec0eec40 con 0x7f0cf80ccd10 2024-09-13T18:29:03.678 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:29:03.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0cdc0669f0 msgr2=0x7f0cdc068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0cdc0669f0 0x7f0cdc068eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80cc5b0 tx=0x7f0cf4009040 comp rx=0 tx=0).stop 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf80ccd10 msgr2=0x7f0cf8152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf80ccd10 0x7f0cf8152ac0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0af040 tx=0x7f0cec019280 comp rx=0 tx=0).stop 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 shutdown_connections 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0cdc0669f0 0x7f0cdc068eb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cf80d3390 0x7f0cf814dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cf815c830 0x7f0cf8150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 --2- 172.21.15.53:0/1498372227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cf80ccd10 0x7f0cf8152ac0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 >> 172.21.15.53:0/1498372227 conn(0x7f0cf8070970 msgr2=0x7f0cf80d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 shutdown_connections 2024-09-13T18:29:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.675+0000 7f0cff2a3640 1 -- 172.21.15.53:0/1498372227 wait complete. 2024-09-13T18:29:03.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:29:03.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b8987640 1 Processor -- start 2024-09-13T18:29:03.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b8987640 1 -- start start 2024-09-13T18:29:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b8987640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1b415a470 0x7fc1b40cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b8987640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1b415cc60 0x7fc1b4071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b8987640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b406f550 con 0x7fc1b40b1c10 2024-09-13T18:29:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b8987640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b406f880 con 0x7fc1b415cc60 2024-09-13T18:29:03.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b8987640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b415dc40 con 0x7fc1b415a470 2024-09-13T18:29:03.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1a9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1b415cc60 0x7fc1b4071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b2d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc1b40b1c10 0x7fc1b406fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57664/0 (socket says 172.21.15.53:57664) 2024-09-13T18:29:03.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b2d9d640 1 -- 172.21.15.53:0/3590905316 learned_addr learned my addr 172.21.15.53:0/3590905316 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:03.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b259c640 1 --2- 172.21.15.53:0/3590905316 >> v2:172.21.15.87:3300/0 conn(0x7fc1b415a470 0x7fc1b40cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b1d9b640 1 -- 172.21.15.53:0/3590905316 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730052807 0 0) 0x7fc1b406f550 con 0x7fc1b40b1c10 2024-09-13T18:29:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1b1d9b640 1 -- 172.21.15.53:0/3590905316 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a0003530 con 0x7fc1b40b1c10 2024-09-13T18:29:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1a9d9b640 1 -- 172.21.15.53:0/3590905316 >> v2:172.21.15.87:3300/0 conn(0x7fc1b415a470 msgr2=0x7fc1b40cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1a9d9b640 1 --2- 172.21.15.53:0/3590905316 >> v2:172.21.15.87:3300/0 conn(0x7fc1b415a470 0x7fc1b40cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1a9d9b640 1 -- 172.21.15.53:0/3590905316 >> v1:172.21.15.53:6789/0 conn(0x7fc1b40b1c10 legacy=0x7fc1b406fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.803+0000 7fc1a9d9b640 1 -- 172.21.15.53:0/3590905316 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40715a0 con 0x7fc1b415cc60 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1a9d9b640 1 --2- 172.21.15.53:0/3590905316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415cc60 0x7fc1b4071060 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4069f50 tx=0x7fc19c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76970b861290a89f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b1d9b640 1 -- 172.21.15.53:0/3590905316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0ab680 con 0x7fc1b415cc60 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b1d9b640 1 -- 172.21.15.53:0/3590905316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c0ab7e0 con 0x7fc1b415cc60 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b1d9b640 1 -- 172.21.15.53:0/3590905316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0abb50 con 0x7fc1b415cc60 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- 172.21.15.53:0/3590905316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415cc60 msgr2=0x7fc1b4071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 --2- 172.21.15.53:0/3590905316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415cc60 0x7fc1b4071060 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4069f50 tx=0x7fc19c01c480 comp rx=0 tx=0).stop 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- 172.21.15.53:0/3590905316 shutdown_connections 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 --2- 172.21.15.53:0/3590905316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415cc60 0x7fc1b4071060 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 --2- 172.21.15.53:0/3590905316 >> v2:172.21.15.87:3300/0 conn(0x7fc1b415a470 0x7fc1b40cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- 172.21.15.53:0/3590905316 >> 172.21.15.53:0/3590905316 conn(0x7fc1b4065c80 msgr2=0x7fc1b4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- 172.21.15.53:0/3590905316 shutdown_connections 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- 172.21.15.53:0/3590905316 wait complete. 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 Processor -- start 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- start start 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b40b1c10 0x7fc1b414b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415a470 0x7fc1b41584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b415cc60 0x7fc1b40cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4136360 con 0x7fc1b415a470 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4158f20 con 0x7fc1b415cc60 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.807+0000 7fc1b8987640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4159200 con 0x7fc1b40b1c10 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415a470 0x7fc1b41584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415a470 0x7fc1b41584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34478/0 (socket says 172.21.15.53:34478) 2024-09-13T18:29:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 -- 172.21.15.53:0/479307683 learned_addr learned my addr 172.21.15.53:0/479307683 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b259c640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b40b1c10 0x7fc1b414b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 -- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b40b1c10 msgr2=0x7fc1b414b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b40b1c10 0x7fc1b414b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 -- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b415cc60 msgr2=0x7fc1b40cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b2d9d640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b415cc60 0x7fc1b40cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b415cc60 0x7fc1b40cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 -- 172.21.15.53:0/479307683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c009420 con 0x7fc1b415a470 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b259c640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b40b1c10 0x7fc1b414b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1a9d9b640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415a470 0x7fc1b41584f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc19c01ab30 tx=0x7fc19c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1ab7fe640 1 -- 172.21.15.53:0/479307683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0044d0 con 0x7fc1b415a470 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1ab7fe640 1 -- 172.21.15.53:0/479307683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c0ab950 con 0x7fc1b415a470 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1ab7fe640 1 -- 172.21.15.53:0/479307683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0abcc0 con 0x7fc1b415a470 2024-09-13T18:29:03.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b40b25b0 con 0x7fc1b415a470 2024-09-13T18:29:03.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b41597c0 con 0x7fc1b415a470 2024-09-13T18:29:03.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b4067400 con 0x7fc1b415a470 2024-09-13T18:29:03.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1ab7fe640 1 -- 172.21.15.53:0/479307683 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fc19c003620 con 0x7fc1b415a470 2024-09-13T18:29:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1ab7fe640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc194066a20 0x7fc194068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1ab7fe640 1 -- 172.21.15.53:0/479307683 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc19c11eaa0 con 0x7fc1b415a470 2024-09-13T18:29:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b259c640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc194066a20 0x7fc194068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:03.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.811+0000 7fc1b259c640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc194066a20 0x7fc194068ee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009840 tx=0x7fc1a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:03.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.815+0000 7fc1ab7fe640 1 -- 172.21.15.53:0/479307683 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc19c0eba50 con 0x7fc1b415a470 2024-09-13T18:29:03.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.983+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1b40707c0 con 0x7fc1b415a470 2024-09-13T18:29:03.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.983+0000 7fc1ab7fe640 1 -- 172.21.15.53:0/479307683 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc19c0ef070 con 0x7fc1b415a470 2024-09-13T18:29:03.991 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc194066a20 msgr2=0x7fc194068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc194066a20 0x7fc194068ee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009840 tx=0x7fc1a4008040 comp rx=0 tx=0).stop 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415a470 msgr2=0x7fc1b41584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415a470 0x7fc1b41584f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc19c01ab30 tx=0x7fc19c019220 comp rx=0 tx=0).stop 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 shutdown_connections 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc194066a20 0x7fc194068ee0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b415cc60 0x7fc1b40cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b415a470 0x7fc1b41584f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 --2- 172.21.15.53:0/479307683 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b40b1c10 0x7fc1b414b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 >> 172.21.15.53:0/479307683 conn(0x7fc1b4065c80 msgr2=0x7fc1b40b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 shutdown_connections 2024-09-13T18:29:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:03.987+0000 7fc1b8987640 1 -- 172.21.15.53:0/479307683 wait complete. 2024-09-13T18:29:04.009 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:29:04.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:04.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:04.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[43114]: fuse finished with error 0 and tester_r 0 2024-09-13T18:29:04.021 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:29:04.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:04.022 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:29:04.190 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:29:04.190 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:04.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddea0d640 1 Processor -- start 2024-09-13T18:29:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddea0d640 1 -- start start 2024-09-13T18:29:04.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddea0d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6dd815a470 0x7f6dd80cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddea0d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 0x7f6dd80b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddea0d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd806f550 con 0x7f6dd815cc60 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddea0d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd806f880 con 0x7f6dd815a470 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddea0d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80b25e0 con 0x7f6dd80b1c10 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6dd815cc60 0x7f6dd8071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57676/0 (socket says 172.21.15.53:57676) 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 -- 172.21.15.53:0/111285858 learned_addr learned my addr 172.21.15.53:0/111285858 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd7fff640 1 --2- 172.21.15.53:0/111285858 >> v2:172.21.15.87:3300/0 conn(0x7f6dd815a470 0x7f6dd80cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454380921 0 0) 0x7f6dd806f550 con 0x7f6dd815cc60 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc0003530 con 0x7f6dd815cc60 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddcfaa640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 0x7f6dd80b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133364396 0 0) 0x7f6dc0003530 con 0x7f6dd815cc60 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 msgr2=0x7f6dd80b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 0x7f6dd80b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 >> v2:172.21.15.87:3300/0 conn(0x7f6dd815a470 msgr2=0x7f6dd80cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 --2- 172.21.15.53:0/111285858 >> v2:172.21.15.87:3300/0 conn(0x7f6dd815a470 0x7f6dd80cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd815dc40 con 0x7f6dd815cc60 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6dc8001680 con 0x7f6dd815cc60 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 >> v1:172.21.15.53:6789/0 conn(0x7f6dd815cc60 legacy=0x7f6dd8071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0003980 0x7f6dc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc00047d0 0x7f6dc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 0x7f6dc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd806f880 con 0x7f6dc00047d0 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80b25e0 con 0x7f6dc0003980 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc000b990 con 0x7f6dd80b1c10 2024-09-13T18:29:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc00047d0 0x7f6dc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd7fff640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0003980 0x7f6dc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddcfaa640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 0x7f6dc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 -- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 msgr2=0x7f6dc0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 0x7f6dc0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 -- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0003980 msgr2=0x7f6dc0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc0003980 0x7f6dc0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6dd77fe640 1 -- 172.21.15.53:0/111285858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0003530 con 0x7f6dc00047d0 2024-09-13T18:29:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.347+0000 7f6ddcfaa640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd80b1c10 0x7f6dc0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6dd77fe640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc00047d0 0x7f6dc0004c50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c240 tx=0x7f6dc801f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3596ba289ed54379 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8005ae0 con 0x7f6dc00047d0 2024-09-13T18:29:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80ab070 con 0x7f6dc00047d0 2024-09-13T18:29:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6dd6ffd640 1 -- 172.21.15.53:0/111285858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8007070 con 0x7f6dc00047d0 2024-09-13T18:29:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 -- 172.21.15.53:0/111285858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc00047d0 msgr2=0x7f6dc0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 --2- 172.21.15.53:0/111285858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc00047d0 0x7f6dc0004c50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c240 tx=0x7f6dc801f3f0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddcfaa640 1 -- 172.21.15.53:0/111285858 reap_dead start 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 -- 172.21.15.53:0/111285858 shutdown_connections 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 -- 172.21.15.53:0/111285858 >> 172.21.15.53:0/111285858 conn(0x7f6dd8065c80 msgr2=0x7f6dd8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 -- 172.21.15.53:0/111285858 shutdown_connections 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 -- 172.21.15.53:0/111285858 wait complete. 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 Processor -- start 2024-09-13T18:29:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.351+0000 7f6ddea0d640 1 -- start start 2024-09-13T18:29:04.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc00047d0 0x7f6dd8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dd8156280 0x7f6dd8158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd81f3180 0x7f6dd8151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8156c90 con 0x7f6dd8156280 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8158950 con 0x7f6dc00047d0 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80caa40 con 0x7f6dd81f3180 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dd8156280 0x7f6dd8158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dd8156280 0x7f6dd8158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34490/0 (socket says 172.21.15.53:34490) 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 -- 172.21.15.53:0/120707447 learned_addr learned my addr 172.21.15.53:0/120707447 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddcfaa640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd81f3180 0x7f6dd8151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd7fff640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc00047d0 0x7f6dd8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 -- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd81f3180 msgr2=0x7f6dd8151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd81f3180 0x7f6dd8151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 -- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc00047d0 msgr2=0x7f6dd8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc00047d0 0x7f6dd8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 -- 172.21.15.53:0/120707447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8156710 con 0x7f6dd8156280 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd77fe640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dd8156280 0x7f6dd8158dc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c240 tx=0x7f6dc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd4ff9640 1 -- 172.21.15.53:0/120707447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80b7070 con 0x7f6dd8156280 2024-09-13T18:29:04.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd4ff9640 1 -- 172.21.15.53:0/120707447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80047f0 con 0x7f6dd8156280 2024-09-13T18:29:04.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd8156e70 con 0x7f6dd8156280 2024-09-13T18:29:04.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd4ff9640 1 -- 172.21.15.53:0/120707447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004b60 con 0x7f6dd8156280 2024-09-13T18:29:04.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd81f3630 con 0x7f6dd8156280 2024-09-13T18:29:04.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd8067400 con 0x7f6dd8156280 2024-09-13T18:29:04.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd4ff9640 1 -- 172.21.15.53:0/120707447 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f6dc80ad020 con 0x7f6dd8156280 2024-09-13T18:29:04.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd4ff9640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6dc40669f0 0x7f6dc4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd4ff9640 1 -- 172.21.15.53:0/120707447 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dc81218d0 con 0x7f6dd8156280 2024-09-13T18:29:04.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.355+0000 7f6dd7fff640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6dc40669f0 0x7f6dc4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.359+0000 7f6dd7fff640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6dc40669f0 0x7f6dc4068eb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8159920 tx=0x7f6dcc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:04.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.359+0000 7f6dd4ff9640 1 -- 172.21.15.53:0/120707447 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6dc80f2180 con 0x7f6dd8156280 2024-09-13T18:29:04.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.523+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dd8070dc0 con 0x7f6dd8156280 2024-09-13T18:29:04.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6dd4ff9640 1 -- 172.21.15.53:0/120707447 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f6dd8070dc0 con 0x7f6dd8156280 2024-09-13T18:29:04.533 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:04.533 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:31.841305+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:04.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6dc40669f0 msgr2=0x7f6dc4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6dc40669f0 0x7f6dc4068eb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8159920 tx=0x7f6dcc008040 comp rx=0 tx=0).stop 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dd8156280 msgr2=0x7f6dd8158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dd8156280 0x7f6dd8158dc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c240 tx=0x7f6dc0005800 comp rx=0 tx=0).stop 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 shutdown_connections 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6dc40669f0 0x7f6dc4068eb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dd81f3180 0x7f6dd8151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dd8156280 0x7f6dd8158dc0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 --2- 172.21.15.53:0/120707447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dc00047d0 0x7f6dd8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 >> 172.21.15.53:0/120707447 conn(0x7f6dd8065c80 msgr2=0x7f6dd8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:04.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.527+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 shutdown_connections 2024-09-13T18:29:04.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.531+0000 7f6ddea0d640 1 -- 172.21.15.53:0/120707447 wait complete. 2024-09-13T18:29:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:28.459143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:29.809417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:04.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e989fe640 1 Processor -- start 2024-09-13T18:29:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e989fe640 1 -- start start 2024-09-13T18:29:04.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e989fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e940b1dd0 0x7f2e940b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e989fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2e9406ff40 0x7f2e94070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e989fe640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9406bc20 con 0x7f2e94158ba0 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e989fe640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9406c530 con 0x7f2e940b1dd0 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e989fe640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e94070890 con 0x7f2e9406ff40 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e940b1dd0 0x7f2e940b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e940b1dd0 0x7f2e940b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34504/0 (socket says 172.21.15.53:34504) 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 -- 172.21.15.53:0/1829507021 learned_addr learned my addr 172.21.15.53:0/1829507021 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e92d9d640 1 --2- 172.21.15.53:0/1829507021 >> v2:172.21.15.87:3300/0 conn(0x7f2e9406ff40 0x7f2e94070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 -- 172.21.15.53:0/1829507021 >> v2:172.21.15.87:3300/0 conn(0x7f2e9406ff40 msgr2=0x7f2e94070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 --2- 172.21.15.53:0/1829507021 >> v2:172.21.15.87:3300/0 conn(0x7f2e9406ff40 0x7f2e94070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 -- 172.21.15.53:0/1829507021 >> v1:172.21.15.87:6789/0 conn(0x7f2e94158ba0 legacy=0x7f2e940cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 -- 172.21.15.53:0/1829507021 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94158f80 con 0x7f2e940b1dd0 2024-09-13T18:29:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.679+0000 7f2e91d9b640 1 --2- 172.21.15.53:0/1829507021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e940b1dd0 0x7f2e940b3120 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f2e9406fed0 tx=0x7f2e8401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985f45d94c4ae536 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:04.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e9159a640 1 -- 172.21.15.53:0/1829507021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840ac640 con 0x7f2e940b1dd0 2024-09-13T18:29:04.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e9159a640 1 -- 172.21.15.53:0/1829507021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840ac7a0 con 0x7f2e940b1dd0 2024-09-13T18:29:04.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e9159a640 1 -- 172.21.15.53:0/1829507021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840acb30 con 0x7f2e940b1dd0 2024-09-13T18:29:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- 172.21.15.53:0/1829507021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e940b1dd0 msgr2=0x7f2e940b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 --2- 172.21.15.53:0/1829507021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e940b1dd0 0x7f2e940b3120 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f2e9406fed0 tx=0x7f2e8401c390 comp rx=0 tx=0).stop 2024-09-13T18:29:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- 172.21.15.53:0/1829507021 shutdown_connections 2024-09-13T18:29:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 --2- 172.21.15.53:0/1829507021 >> v2:172.21.15.87:3300/0 conn(0x7f2e9406ff40 0x7f2e94070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 --2- 172.21.15.53:0/1829507021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e940b1dd0 0x7f2e940b3120 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- 172.21.15.53:0/1829507021 >> 172.21.15.53:0/1829507021 conn(0x7f2e94065c80 msgr2=0x7f2e94066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:04.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- 172.21.15.53:0/1829507021 shutdown_connections 2024-09-13T18:29:04.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- 172.21.15.53:0/1829507021 wait complete. 2024-09-13T18:29:04.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 Processor -- start 2024-09-13T18:29:04.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- start start 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e9406ff40 0x7f2e941f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e940b1dd0 0x7f2e9414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e94158ba0 0x7f2e941507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94152c70 con 0x7f2e94158ba0 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9414e3b0 con 0x7f2e940b1dd0 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.683+0000 7f2e989fe640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94152ec0 con 0x7f2e9406ff40 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e91d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e940b1dd0 0x7f2e9414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e91d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e940b1dd0 0x7f2e9414de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:46236/0 (socket says 172.21.15.53:46236) 2024-09-13T18:29:04.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e91d9b640 1 -- 172.21.15.53:0/510910487 learned_addr learned my addr 172.21.15.53:0/510910487 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:04.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e9259c640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e9406ff40 0x7f2e941f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e92d9d640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e94158ba0 0x7f2e941507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e92d9d640 1 -- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e9406ff40 msgr2=0x7f2e941f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e92d9d640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e9406ff40 0x7f2e941f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e92d9d640 1 -- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e940b1dd0 msgr2=0x7f2e9414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e92d9d640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e940b1dd0 0x7f2e9414de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e92d9d640 1 -- 172.21.15.53:0/510910487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840094d0 con 0x7f2e94158ba0 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e92d9d640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e94158ba0 0x7f2e941507a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00ccb0 tx=0x7f2e8c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e82ffd640 1 -- 172.21.15.53:0/510910487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c003ba0 con 0x7f2e94158ba0 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e82ffd640 1 -- 172.21.15.53:0/510910487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c003d00 con 0x7f2e94158ba0 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e941531a0 con 0x7f2e94158ba0 2024-09-13T18:29:04.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e82ffd640 1 -- 172.21.15.53:0/510910487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c004240 con 0x7f2e94158ba0 2024-09-13T18:29:04.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e94153760 con 0x7f2e94158ba0 2024-09-13T18:29:04.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e94070350 con 0x7f2e94158ba0 2024-09-13T18:29:04.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e82ffd640 1 -- 172.21.15.53:0/510910487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f2e8c0043a0 con 0x7f2e94158ba0 2024-09-13T18:29:04.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e82ffd640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2e740669f0 0x7f2e74068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:04.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e82ffd640 1 -- 172.21.15.53:0/510910487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e8c012070 con 0x7f2e94158ba0 2024-09-13T18:29:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.687+0000 7f2e9259c640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2e740669f0 0x7f2e74068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.691+0000 7f2e9259c640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2e740669f0 0x7f2e74068eb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098e0 tx=0x7f2e88009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:04.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.691+0000 7f2e82ffd640 1 -- 172.21.15.53:0/510910487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e8c051f20 con 0x7f2e94158ba0 2024-09-13T18:29:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.851+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e940ade50 con 0x7f2e94158ba0 2024-09-13T18:29:04.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.851+0000 7f2e82ffd640 1 -- 172.21.15.53:0/510910487 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e8c055540 con 0x7f2e94158ba0 2024-09-13T18:29:04.859 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2e740669f0 msgr2=0x7f2e74068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2e740669f0 0x7f2e74068eb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098e0 tx=0x7f2e88009060 comp rx=0 tx=0).stop 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e94158ba0 msgr2=0x7f2e941507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e94158ba0 0x7f2e941507a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00ccb0 tx=0x7f2e8c00a660 comp rx=0 tx=0).stop 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 shutdown_connections 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2e740669f0 0x7f2e74068eb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e94158ba0 0x7f2e941507a0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e940b1dd0 0x7f2e9414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 --2- 172.21.15.53:0/510910487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e9406ff40 0x7f2e941f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 >> 172.21.15.53:0/510910487 conn(0x7f2e94065c80 msgr2=0x7f2e940cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 shutdown_connections 2024-09-13T18:29:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:04.855+0000 7f2e989fe640 1 -- 172.21.15.53:0/510910487 wait complete. 2024-09-13T18:29:04.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:05.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cdbdd4640 1 Processor -- start 2024-09-13T18:29:05.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cdbdd4640 1 -- start start 2024-09-13T18:29:05.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cdbdd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 0x7f2cd4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cdbdd4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40b15a0 con 0x7f2cd4157020 2024-09-13T18:29:05.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cdbdd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40b1880 con 0x7f2cd406d440 2024-09-13T18:29:05.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cdbdd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40b1b60 con 0x7f2cd4156c40 2024-09-13T18:29:05.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2cd4157020 0x7f2cd406cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57680/0 (socket says 172.21.15.53:57680) 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 -- 172.21.15.53:0/3620006377 learned_addr learned my addr 172.21.15.53:0/3620006377 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435161249 0 0) 0x7f2cd40b15a0 con 0x7f2cd4157020 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd9b70640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 0x7f2cd4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc0005740 con 0x7f2cd4157020 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852159078 0 0) 0x7f2cc0005740 con 0x7f2cd4157020 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 msgr2=0x7f2cd4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 0x7f2cd4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 >> v1:172.21.15.87:6789/0 conn(0x7f2cd406d440 legacy=0x7f2cd406f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40b1e40 con 0x7f2cd4157020 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f2cc4001680 con 0x7f2cd4157020 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 >> v1:172.21.15.53:6789/0 conn(0x7f2cd4157020 legacy=0x7f2cd406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0005bc0 0x7f2cc0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cc0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 0x7f2cc00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40b1b60 con 0x7f2cc00069e0 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000dc50 con 0x7f2cc0005bc0 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000de10 con 0x7f2cd4156c40 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cc0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd9b70640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0005bc0 0x7f2cc0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cda371640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 0x7f2cc00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 -- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 msgr2=0x7f2cc00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4156c40 0x7f2cc00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 -- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0005bc0 msgr2=0x7f2cc0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0005bc0 0x7f2cc0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd936f640 1 -- 172.21.15.53:0/3620006377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0005740 con 0x7f2cc00069e0 2024-09-13T18:29:05.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.003+0000 7f2cd9b70640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc0005bc0 0x7f2cc0005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:05.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cd936f640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cc0006e60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c210 tx=0x7f2cc401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280f5fe97286e263 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4005ae0 con 0x7f2cc00069e0 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc40ab070 con 0x7f2cc00069e0 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cd8b6e640 1 -- 172.21.15.53:0/3620006377 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4007070 con 0x7f2cc00069e0 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/3620006377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 msgr2=0x7f2cc0006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 --2- 172.21.15.53:0/3620006377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cc0006e60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c210 tx=0x7f2cc401f370 comp rx=0 tx=0).stop 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cda371640 1 -- 172.21.15.53:0/3620006377 reap_dead start 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/3620006377 shutdown_connections 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/3620006377 >> 172.21.15.53:0/3620006377 conn(0x7f2cd4065c80 msgr2=0x7f2cd4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/3620006377 shutdown_connections 2024-09-13T18:29:05.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/3620006377 wait complete. 2024-09-13T18:29:05.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 Processor -- start 2024-09-13T18:29:05.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.007+0000 7f2cdbdd4640 1 -- start start 2024-09-13T18:29:05.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cd4142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cd40afc20 0x7f2cd4154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4155470 0x7f2cd40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4155910 con 0x7f2cc00069e0 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4155bf0 con 0x7f2cd40afc20 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4155ed0 con 0x7f2cd4155470 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cd4142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cd4142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34528/0 (socket says 172.21.15.53:34528) 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 -- 172.21.15.53:0/1758227837 learned_addr learned my addr 172.21.15.53:0/1758227837 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd936f640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cd40afc20 0x7f2cd4154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cda371640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4155470 0x7f2cd40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 -- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4155470 msgr2=0x7f2cd40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4155470 0x7f2cd40ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 -- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cd40afc20 msgr2=0x7f2cd4154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cd40afc20 0x7f2cd4154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 -- 172.21.15.53:0/1758227837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd41561b0 con 0x7f2cc00069e0 2024-09-13T18:29:05.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd936f640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cd40afc20 0x7f2cd4154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:05.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd9b70640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cd4142490 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009fd0 tx=0x7f2cd0011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cca7fc640 1 -- 172.21.15.53:0/1758227837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0004220 con 0x7f2cc00069e0 2024-09-13T18:29:05.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cca7fc640 1 -- 172.21.15.53:0/1758227837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0004380 con 0x7f2cc00069e0 2024-09-13T18:29:05.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd4156490 con 0x7f2cc00069e0 2024-09-13T18:29:05.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cca7fc640 1 -- 172.21.15.53:0/1758227837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd000f9e0 con 0x7f2cc00069e0 2024-09-13T18:29:05.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd40ace20 con 0x7f2cc00069e0 2024-09-13T18:29:05.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd4070ee0 con 0x7f2cc00069e0 2024-09-13T18:29:05.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cca7fc640 1 -- 172.21.15.53:0/1758227837 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f2cd000fb40 con 0x7f2cc00069e0 2024-09-13T18:29:05.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cca7fc640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2cb80669f0 0x7f2cb8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cca7fc640 1 -- 172.21.15.53:0/1758227837 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd0084d40 con 0x7f2cc00069e0 2024-09-13T18:29:05.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.011+0000 7f2cd936f640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2cb80669f0 0x7f2cb8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.015+0000 7f2cd936f640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2cb80669f0 0x7f2cb8068eb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40af000 tx=0x7f2cc40aa000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.015+0000 7f2cca7fc640 1 -- 172.21.15.53:0/1758227837 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2cd0051c60 con 0x7f2cc00069e0 2024-09-13T18:29:05.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.183+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cd4158fc0 con 0x7f2cc00069e0 2024-09-13T18:29:05.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.183+0000 7f2cca7fc640 1 -- 172.21.15.53:0/1758227837 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cd00220a0 con 0x7f2cc00069e0 2024-09-13T18:29:05.189 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:29:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.183+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2cb80669f0 msgr2=0x7f2cb8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.183+0000 7f2cdbdd4640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2cb80669f0 0x7f2cb8068eb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40af000 tx=0x7f2cc40aa000 comp rx=0 tx=0).stop 2024-09-13T18:29:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.183+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 msgr2=0x7f2cd4142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.183+0000 7f2cdbdd4640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cd4142490 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009fd0 tx=0x7f2cd0011b30 comp rx=0 tx=0).stop 2024-09-13T18:29:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 shutdown_connections 2024-09-13T18:29:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2cb80669f0 0x7f2cb8068eb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cd4155470 0x7f2cd40ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cd40afc20 0x7f2cd4154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 --2- 172.21.15.53:0/1758227837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc00069e0 0x7f2cd4142490 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 >> 172.21.15.53:0/1758227837 conn(0x7f2cd4065c80 msgr2=0x7f2cd40b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 shutdown_connections 2024-09-13T18:29:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.187+0000 7f2cdbdd4640 1 -- 172.21.15.53:0/1758227837 wait complete. 2024-09-13T18:29:05.210 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:05.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6cce1640 1 Processor -- start 2024-09-13T18:29:05.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6cce1640 1 -- start start 2024-09-13T18:29:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6cce1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e680ccd10 0x7f5e680cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6cce1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e680d2c80 0x7f5e680d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6cce1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680b7db0 con 0x7f5e6815c830 2024-09-13T18:29:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6cce1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e680d3650 con 0x7f5e680ccd10 2024-09-13T18:29:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6cce1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e680d0650 con 0x7f5e680d2c80 2024-09-13T18:29:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e65d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e680ccd10 0x7f5e680cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5e6815c830 0x7f5e680d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57686/0 (socket says 172.21.15.53:57686) 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e65d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e680ccd10 0x7f5e680cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34530/0 (socket says 172.21.15.53:34530) 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6659c640 1 -- 172.21.15.53:0/974856663 learned_addr learned my addr 172.21.15.53:0/974856663 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e66d9d640 1 --2- 172.21.15.53:0/974856663 >> v2:172.21.15.87:3300/0 conn(0x7f5e680d2c80 0x7f5e680d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e65d9b640 1 -- 172.21.15.53:0/974856663 >> v2:172.21.15.87:3300/0 conn(0x7f5e680d2c80 msgr2=0x7f5e680d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e65d9b640 1 --2- 172.21.15.53:0/974856663 >> v2:172.21.15.87:3300/0 conn(0x7f5e680d2c80 0x7f5e680d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e65d9b640 1 -- 172.21.15.53:0/974856663 >> v1:172.21.15.53:6789/0 conn(0x7f5e6815c830 legacy=0x7f5e680d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e65d9b640 1 -- 172.21.15.53:0/974856663 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680d0c10 con 0x7f5e680ccd10 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e66d9d640 1 --2- 172.21.15.53:0/974856663 >> v2:172.21.15.87:3300/0 conn(0x7f5e680d2c80 0x7f5e680d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.327+0000 7f5e6559a640 1 -- 172.21.15.53:0/974856663 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117003033 0 0) 0x7f5e680b7db0 con 0x7f5e6815c830 2024-09-13T18:29:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e65d9b640 1 --2- 172.21.15.53:0/974856663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e680ccd10 0x7f5e680cd180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5e680b4290 tx=0x7f5e5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ba6e56bc5c8880 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6559a640 1 -- 172.21.15.53:0/974856663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0ab600 con 0x7f5e680ccd10 2024-09-13T18:29:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6559a640 1 -- 172.21.15.53:0/974856663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c0a7050 con 0x7f5e680ccd10 2024-09-13T18:29:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6559a640 1 -- 172.21.15.53:0/974856663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0ab980 con 0x7f5e680ccd10 2024-09-13T18:29:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- 172.21.15.53:0/974856663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e680ccd10 msgr2=0x7f5e680cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/974856663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e680ccd10 0x7f5e680cd180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5e680b4290 tx=0x7f5e5c01c480 comp rx=0 tx=0).stop 2024-09-13T18:29:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- 172.21.15.53:0/974856663 shutdown_connections 2024-09-13T18:29:05.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/974856663 >> v2:172.21.15.87:3300/0 conn(0x7f5e680d2c80 0x7f5e680d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/974856663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e680ccd10 0x7f5e680cd180 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- 172.21.15.53:0/974856663 >> 172.21.15.53:0/974856663 conn(0x7f5e68070970 msgr2=0x7f5e68070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- 172.21.15.53:0/974856663 shutdown_connections 2024-09-13T18:29:05.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- 172.21.15.53:0/974856663 wait complete. 2024-09-13T18:29:05.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 Processor -- start 2024-09-13T18:29:05.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- start start 2024-09-13T18:29:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e680ccd10 0x7f5e6815e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e680d2c80 0x7f5e68155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6815c830 0x7f5e68151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6815e7b0 con 0x7f5e6815c830 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e681541b0 con 0x7f5e680d2c80 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.331+0000 7f5e6cce1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68154490 con 0x7f5e680ccd10 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6815c830 0x7f5e68151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6815c830 0x7f5e68151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34532/0 (socket says 172.21.15.53:34532) 2024-09-13T18:29:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 -- 172.21.15.53:0/348028323 learned_addr learned my addr 172.21.15.53:0/348028323 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e65d9b640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e680d2c80 0x7f5e68155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e6659c640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e680ccd10 0x7f5e6815e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 -- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e680ccd10 msgr2=0x7f5e6815e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e680ccd10 0x7f5e6815e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 -- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e680d2c80 msgr2=0x7f5e68155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e680d2c80 0x7f5e68155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 -- 172.21.15.53:0/348028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c009420 con 0x7f5e6815c830 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e66d9d640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6815c830 0x7f5e68151240 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000cef0 tx=0x7f5e6000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e56ffd640 1 -- 172.21.15.53:0/348028323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000d840 con 0x7f5e6815c830 2024-09-13T18:29:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e56ffd640 1 -- 172.21.15.53:0/348028323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000d9c0 con 0x7f5e6815c830 2024-09-13T18:29:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e68154770 con 0x7f5e6815c830 2024-09-13T18:29:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e56ffd640 1 -- 172.21.15.53:0/348028323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000dd70 con 0x7f5e6815c830 2024-09-13T18:29:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68154d30 con 0x7f5e6815c830 2024-09-13T18:29:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e68154f20 con 0x7f5e6815c830 2024-09-13T18:29:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e56ffd640 1 -- 172.21.15.53:0/348028323 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f5e6001e3b0 con 0x7f5e6815c830 2024-09-13T18:29:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e56ffd640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e480669f0 0x7f5e48068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e56ffd640 1 -- 172.21.15.53:0/348028323 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e60085190 con 0x7f5e6815c830 2024-09-13T18:29:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.335+0000 7f5e6659c640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e480669f0 0x7f5e48068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.339+0000 7f5e6659c640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e480669f0 0x7f5e48068eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5e58000f70 tx=0x7f5e58007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.339+0000 7f5e56ffd640 1 -- 172.21.15.53:0/348028323 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e600521b0 con 0x7f5e6815c830 2024-09-13T18:29:05.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.495+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e680cd180 con 0x7f5e6815c830 2024-09-13T18:29:05.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.495+0000 7f5e56ffd640 1 -- 172.21.15.53:0/348028323 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e600557d0 con 0x7f5e6815c830 2024-09-13T18:29:05.503 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:29:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e480669f0 msgr2=0x7f5e48068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e480669f0 0x7f5e48068eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5e58000f70 tx=0x7f5e58007c10 comp rx=0 tx=0).stop 2024-09-13T18:29:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6815c830 msgr2=0x7f5e68151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6815c830 0x7f5e68151240 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000cef0 tx=0x7f5e6000a710 comp rx=0 tx=0).stop 2024-09-13T18:29:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 shutdown_connections 2024-09-13T18:29:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e480669f0 0x7f5e48068eb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6815c830 0x7f5e68151240 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e680d2c80 0x7f5e68155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 --2- 172.21.15.53:0/348028323 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e680ccd10 0x7f5e6815e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 >> 172.21.15.53:0/348028323 conn(0x7f5e68070970 msgr2=0x7f5e680b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 shutdown_connections 2024-09-13T18:29:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.499+0000 7f5e6cce1640 1 -- 172.21.15.53:0/348028323 wait complete. 2024-09-13T18:29:05.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:29:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f88052640 1 Processor -- start 2024-09-13T18:29:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f88052640 1 -- start start 2024-09-13T18:29:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f88052640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7f8015b7c0 0x7f7f80070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f88052640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8006d480 con 0x7f7f801582a0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f88052640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8015ace0 con 0x7f7f800711d0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f88052640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f80071680 con 0x7f7f8015b7c0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f85dee640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f801582a0 0x7f7f8006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57702/0 (socket says 172.21.15.53:57702) 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f85dee640 1 -- 172.21.15.53:0/3019496705 learned_addr learned my addr 172.21.15.53:0/3019496705 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f855ed640 1 --2- 172.21.15.53:0/3019496705 >> v2:172.21.15.87:3300/0 conn(0x7f7f8015b7c0 0x7f7f80070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155083333 0 0) 0x7f7f8006d480 con 0x7f7f801582a0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f6c003530 con 0x7f7f801582a0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4187897274 0 0) 0x7f7f6c003530 con 0x7f7f801582a0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 >> v2:172.21.15.87:3300/0 conn(0x7f7f8015b7c0 msgr2=0x7f7f80070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 --2- 172.21.15.53:0/3019496705 >> v2:172.21.15.87:3300/0 conn(0x7f7f8015b7c0 0x7f7f80070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 >> v1:172.21.15.87:6789/0 conn(0x7f7f800711d0 legacy=0x7f7f801640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8015afc0 con 0x7f7f801582a0 2024-09-13T18:29:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7f7c001680 con 0x7f7f801582a0 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 >> v1:172.21.15.53:6789/0 conn(0x7f7f801582a0 legacy=0x7f7f8006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f6c003980 0x7f7f6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c005190 0x7f7f6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80071680 con 0x7f7f6c005190 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c00c030 con 0x7f7f6c0047d0 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c00c1f0 con 0x7f7f6c003980 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f865ef640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c005190 0x7f7f6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f85dee640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f6c003980 0x7f7f6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f855ed640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f865ef640 1 -- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f6c003980 msgr2=0x7f7f6c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f865ef640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f6c003980 0x7f7f6c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f865ef640 1 -- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c0047d0 msgr2=0x7f7f6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f865ef640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.627+0000 7f7f865ef640 1 -- 172.21.15.53:0/3019496705 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c003530 con 0x7f7f6c005190 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f865ef640 1 -- 172.21.15.53:0/3019496705 reap_dead start 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f865ef640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c005190 0x7f7f6c00b990 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7f78001e70 tx=0x7f7f7801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68fc338f677f5a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78003b80 con 0x7f7f6c005190 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f78003d20 con 0x7f7f6c005190 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f84dec640 1 -- 172.21.15.53:0/3019496705 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78005260 con 0x7f7f6c005190 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f88052640 1 -- 172.21.15.53:0/3019496705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c005190 msgr2=0x7f7f6c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f88052640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c005190 0x7f7f6c00b990 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7f78001e70 tx=0x7f7f7801c780 comp rx=0 tx=0).stop 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f88052640 1 -- 172.21.15.53:0/3019496705 shutdown_connections 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f88052640 1 --2- 172.21.15.53:0/3019496705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c005190 0x7f7f6c00b990 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f88052640 1 -- 172.21.15.53:0/3019496705 >> 172.21.15.53:0/3019496705 conn(0x7f7f80065c80 msgr2=0x7f7f80066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f88052640 1 -- 172.21.15.53:0/3019496705 shutdown_connections 2024-09-13T18:29:05.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.631+0000 7f7f88052640 1 -- 172.21.15.53:0/3019496705 wait complete. 2024-09-13T18:29:05.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 Processor -- start 2024-09-13T18:29:05.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 -- start start 2024-09-13T18:29:05.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c005190 0x7f7f801534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f801542d0 0x7f7f801f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f80154750 0x7f7f801f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801557d0 con 0x7f7f801542d0 2024-09-13T18:29:05.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80155ab0 con 0x7f7f6c005190 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80155d90 con 0x7f7f80154750 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f801542d0 0x7f7f801f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f801542d0 0x7f7f801f1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34548/0 (socket says 172.21.15.53:34548) 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 -- 172.21.15.53:0/4094154227 learned_addr learned my addr 172.21.15.53:0/4094154227 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f85dee640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c005190 0x7f7f801534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f865ef640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f80154750 0x7f7f801f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 -- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f80154750 msgr2=0x7f7f801f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f80154750 0x7f7f801f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 -- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c005190 msgr2=0x7f7f801534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c005190 0x7f7f801534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 -- 172.21.15.53:0/4094154227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80156070 con 0x7f7f801542d0 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f85dee640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c005190 0x7f7f801534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f855ed640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f801542d0 0x7f7f801f1390 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7f70011560 tx=0x7f7f70011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f767fc640 1 -- 172.21.15.53:0/4094154227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70015930 con 0x7f7f801542d0 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f767fc640 1 -- 172.21.15.53:0/4094154227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70015a90 con 0x7f7f801542d0 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f80156350 con 0x7f7f801542d0 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f767fc640 1 -- 172.21.15.53:0/4094154227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70015e60 con 0x7f7f801542d0 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8014e2e0 con 0x7f7f801542d0 2024-09-13T18:29:05.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f80067400 con 0x7f7f801542d0 2024-09-13T18:29:05.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f767fc640 1 -- 172.21.15.53:0/4094154227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f7f7000f460 con 0x7f7f801542d0 2024-09-13T18:29:05.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f767fc640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f640669f0 0x7f7f64068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:05.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f767fc640 1 -- 172.21.15.53:0/4094154227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f70084f00 con 0x7f7f801542d0 2024-09-13T18:29:05.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.635+0000 7f7f85dee640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f640669f0 0x7f7f64068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:05.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.639+0000 7f7f85dee640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f640669f0 0x7f7f64068eb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c001060 tx=0x7f7f7c000fb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:05.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.643+0000 7f7f767fc640 1 -- 172.21.15.53:0/4094154227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f70051e60 con 0x7f7f801542d0 2024-09-13T18:29:05.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f8006c900 con 0x7f7f801542d0 2024-09-13T18:29:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f767fc640 1 -- 172.21.15.53:0/4094154227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f70055480 con 0x7f7f801542d0 2024-09-13T18:29:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:29:05.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f640669f0 msgr2=0x7f7f64068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f640669f0 0x7f7f64068eb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c001060 tx=0x7f7f7c000fb0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f801542d0 msgr2=0x7f7f801f1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f801542d0 0x7f7f801f1390 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7f70011560 tx=0x7f7f70011a20 comp rx=0 tx=0).stop 2024-09-13T18:29:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 shutdown_connections 2024-09-13T18:29:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f640669f0 0x7f7f64068eb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f80154750 0x7f7f801f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f801542d0 0x7f7f801f1390 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 --2- 172.21.15.53:0/4094154227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f6c005190 0x7f7f801534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:05.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.815+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 >> 172.21.15.53:0/4094154227 conn(0x7f7f80065c80 msgr2=0x7f7f800ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:05.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.819+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 shutdown_connections 2024-09-13T18:29:05.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:05.819+0000 7f7f88052640 1 -- 172.21.15.53:0/4094154227 wait complete. 2024-09-13T18:29:05.841 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:29:05.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:05.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:05.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35533]: fuse finished with error 0 and tester_r 0 2024-09-13T18:29:05.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:29:05.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:05.858 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:29:05.933 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:29:05.933 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:05.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:29:05.939 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:29:05.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:05.939 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:29:05.988 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:29:05.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:29:05.990 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:29:05.990 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:05.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:29:05.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:29:05.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:05.996 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:29:06.049 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:29:06.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:29:06.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bc5f5640 1 Processor -- start 2024-09-13T18:29:06.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bc5f5640 1 -- start start 2024-09-13T18:29:06.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bc5f5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67b40cbd60 0x7f67b40b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bc5f5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b40b1ac0 con 0x7f67b40cb980 2024-09-13T18:29:06.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bc5f5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b4159ac0 con 0x7f67b406b850 2024-09-13T18:29:06.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bc5f5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b4159da0 con 0x7f67b40cbd60 2024-09-13T18:29:06.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67ba391640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f67b40cb980 0x7f67b406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57712/0 (socket says 172.21.15.53:57712) 2024-09-13T18:29:06.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67ba391640 1 -- 172.21.15.53:0/1792099492 learned_addr learned my addr 172.21.15.53:0/1792099492 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:06.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bab92640 1 --2- 172.21.15.53:0/1792099492 >> v2:172.21.15.53:3300/0 conn(0x7f67b40cbd60 0x7f67b40b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67b938f640 1 -- 172.21.15.53:0/1792099492 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175660051 0 0) 0x7f67b40b1ac0 con 0x7f67b40cb980 2024-09-13T18:29:06.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67b938f640 1 -- 172.21.15.53:0/1792099492 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a0005740 con 0x7f67b40cb980 2024-09-13T18:29:06.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bab92640 1 -- 172.21.15.53:0/1792099492 >> v1:172.21.15.87:6789/0 conn(0x7f67b406b850 legacy=0x7f67b40b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bab92640 1 -- 172.21.15.53:0/1792099492 >> v1:172.21.15.53:6789/0 conn(0x7f67b40cb980 legacy=0x7f67b406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.175+0000 7f67bab92640 1 -- 172.21.15.53:0/1792099492 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b415a080 con 0x7f67b40cbd60 2024-09-13T18:29:06.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 --2- 172.21.15.53:0/1792099492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b40b33b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009d90 tx=0x7f67ac01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6cf0aa8aa679e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67b938f640 1 -- 172.21.15.53:0/1792099492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0a58e0 con 0x7f67b40cbd60 2024-09-13T18:29:06.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67b938f640 1 -- 172.21.15.53:0/1792099492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac0a5a40 con 0x7f67b40cbd60 2024-09-13T18:29:06.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67b938f640 1 -- 172.21.15.53:0/1792099492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0a5dd0 con 0x7f67b40cbd60 2024-09-13T18:29:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1792099492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 msgr2=0x7f67b40b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1792099492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b40b33b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009d90 tx=0x7f67ac01c820 comp rx=0 tx=0).stop 2024-09-13T18:29:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1792099492 shutdown_connections 2024-09-13T18:29:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1792099492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b40b33b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1792099492 >> 172.21.15.53:0/1792099492 conn(0x7f67b4065c80 msgr2=0x7f67b4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1792099492 shutdown_connections 2024-09-13T18:29:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1792099492 wait complete. 2024-09-13T18:29:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 Processor -- start 2024-09-13T18:29:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- start start 2024-09-13T18:29:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67b406b850 0x7f67b414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67b40cb980 0x7f67b4147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b4152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4148e60 con 0x7f67b40cbd60 2024-09-13T18:29:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4149140 con 0x7f67b406b850 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bc5f5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4149420 con 0x7f67b40cb980 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b4152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b4152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34556/0 (socket says 172.21.15.53:34556) 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 -- 172.21.15.53:0/1174683707 learned_addr learned my addr 172.21.15.53:0/1174683707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67ba391640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67b406b850 0x7f67b414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67b9b90640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67b40cb980 0x7f67b4147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 -- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67b40cb980 msgr2=0x7f67b4147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67b40cb980 0x7f67b4147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 -- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67b406b850 msgr2=0x7f67b414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67b406b850 0x7f67b414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67bab92640 1 -- 172.21.15.53:0/1174683707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac009a70 con 0x7f67b40cbd60 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67ba391640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67b406b850 0x7f67b414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.179+0000 7f67b9b90640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67b40cb980 0x7f67b4147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67bab92640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b4152a80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0b0040 tx=0x7f67ac0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67aaffd640 1 -- 172.21.15.53:0/1174683707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0b9860 con 0x7f67b40cbd60 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67aaffd640 1 -- 172.21.15.53:0/1174683707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac0b99c0 con 0x7f67b40cbd60 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b4149700 con 0x7f67b40cbd60 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67aaffd640 1 -- 172.21.15.53:0/1174683707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac0b9d70 con 0x7f67b40cbd60 2024-09-13T18:29:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b4147f60 con 0x7f67b40cbd60 2024-09-13T18:29:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b4067400 con 0x7f67b40cbd60 2024-09-13T18:29:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67aaffd640 1 -- 172.21.15.53:0/1174683707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f67ac0ad440 con 0x7f67b40cbd60 2024-09-13T18:29:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67aaffd640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67980669f0 0x7f6798068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67aaffd640 1 -- 172.21.15.53:0/1174683707 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67ac11fae0 con 0x7f67b40cbd60 2024-09-13T18:29:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67ba391640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67980669f0 0x7f6798068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.183+0000 7f67ba391640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67980669f0 0x7f6798068eb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f67b0005890 tx=0x7f67b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.187+0000 7f67aaffd640 1 -- 172.21.15.53:0/1174683707 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f67ac0ecb60 con 0x7f67b40cbd60 2024-09-13T18:29:06.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.375+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67b41480f0 con 0x7f67b40cbd60 2024-09-13T18:29:06.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.375+0000 7f67aaffd640 1 -- 172.21.15.53:0/1174683707 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f67ac0f0180 con 0x7f67b40cbd60 2024-09-13T18:29:06.384 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:06.384 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5396,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1852087146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1852087146},{"type":"v1","addr":"172.21.15.87:6835","nonce":1852087146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1364711247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1364711247},{"type":"v1","addr":"172.21.15.87:6837","nonce":1364711247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/763471722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":763471722},{"type":"v1","addr":"172.21.15.53:6833","nonce":763471722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:30.838100+0000","modified":"2024-09-13T18:28:33.851103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3738594836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3738594836},{"type":"v1","addr":"172.21.15.53:6835","nonce":3738594836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:29:06.385 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 32 2024-09-13T18:29:06.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67980669f0 msgr2=0x7f6798068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67980669f0 0x7f6798068eb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f67b0005890 tx=0x7f67b0009040 comp rx=0 tx=0).stop 2024-09-13T18:29:06.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 msgr2=0x7f67b4152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b4152a80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0b0040 tx=0x7f67ac0195c0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 shutdown_connections 2024-09-13T18:29:06.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f67980669f0 0x7f6798068eb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67b40cb980 0x7f67b4147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67b40cbd60 0x7f67b4152a80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 --2- 172.21.15.53:0/1174683707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67b406b850 0x7f67b414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 >> 172.21.15.53:0/1174683707 conn(0x7f67b4065c80 msgr2=0x7f67b406f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 shutdown_connections 2024-09-13T18:29:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.379+0000 7f67bc5f5640 1 -- 172.21.15.53:0/1174683707 wait complete. 2024-09-13T18:29:06.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf72ca640 1 Processor -- start 2024-09-13T18:29:06.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf72ca640 1 -- start start 2024-09-13T18:29:06.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf72ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fabf006a740 0x7fabf006ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf72ca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fabf00b1dc0 0x7fabf00afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf72ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf006b060 con 0x7fabf00b0530 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf72ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00b0d20 con 0x7fabf006a740 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf72ca640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00b1000 con 0x7fabf00b1dc0 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5066640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fabf006a740 0x7fabf006ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5867640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fabf00b0530 0x7fabf00ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57714/0 (socket says 172.21.15.53:57714) 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5867640 1 -- 172.21.15.53:0/4024007320 learned_addr learned my addr 172.21.15.53:0/4024007320 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf4865640 1 --2- 172.21.15.53:0/4024007320 >> v2:172.21.15.87:3300/0 conn(0x7fabf00b1dc0 0x7fabf00afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5066640 1 -- 172.21.15.53:0/4024007320 >> v2:172.21.15.87:3300/0 conn(0x7fabf00b1dc0 msgr2=0x7fabf00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5066640 1 --2- 172.21.15.53:0/4024007320 >> v2:172.21.15.87:3300/0 conn(0x7fabf00b1dc0 0x7fabf00afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5066640 1 -- 172.21.15.53:0/4024007320 >> v1:172.21.15.53:6789/0 conn(0x7fabf00b0530 legacy=0x7fabf00ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5066640 1 -- 172.21.15.53:0/4024007320 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00b12e0 con 0x7fabf006a740 2024-09-13T18:29:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabe7fff640 1 -- 172.21.15.53:0/4024007320 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936700393 0 0) 0x7fabf006b060 con 0x7fabf00b0530 2024-09-13T18:29:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.507+0000 7fabf5066640 1 --2- 172.21.15.53:0/4024007320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf006a740 0x7fabf006ab20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fabf0066c30 tx=0x7fabec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accf14ddeb8c609f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabe7fff640 1 -- 172.21.15.53:0/4024007320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0ac620 con 0x7fabf006a740 2024-09-13T18:29:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabe7fff640 1 -- 172.21.15.53:0/4024007320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf00ae400 con 0x7fabf006a740 2024-09-13T18:29:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabe7fff640 1 -- 172.21.15.53:0/4024007320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0ac9a0 con 0x7fabf006a740 2024-09-13T18:29:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- 172.21.15.53:0/4024007320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf006a740 msgr2=0x7fabf006ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 --2- 172.21.15.53:0/4024007320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf006a740 0x7fabf006ab20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fabf0066c30 tx=0x7fabec01c3c0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- 172.21.15.53:0/4024007320 shutdown_connections 2024-09-13T18:29:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 --2- 172.21.15.53:0/4024007320 >> v2:172.21.15.87:3300/0 conn(0x7fabf00b1dc0 0x7fabf00afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 --2- 172.21.15.53:0/4024007320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf006a740 0x7fabf006ab20 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- 172.21.15.53:0/4024007320 >> 172.21.15.53:0/4024007320 conn(0x7fabf00b5a20 msgr2=0x7fabf00b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- 172.21.15.53:0/4024007320 shutdown_connections 2024-09-13T18:29:06.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- 172.21.15.53:0/4024007320 wait complete. 2024-09-13T18:29:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 Processor -- start 2024-09-13T18:29:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- start start 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabf006a740 0x7fabf009b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabf00b0530 0x7fabf0151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00b1dc0 0x7fabf014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf009d560 con 0x7fabf00b1dc0 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf009d840 con 0x7fabf00b0530 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf72ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf009db20 con 0x7fabf006a740 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf5867640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00b1dc0 0x7fabf014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf5867640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00b1dc0 0x7fabf014f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34578/0 (socket says 172.21.15.53:34578) 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf5867640 1 -- 172.21.15.53:0/3170777449 learned_addr learned my addr 172.21.15.53:0/3170777449 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf4865640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabf00b0530 0x7fabf0151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.511+0000 7fabf5066640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabf006a740 0x7fabf009b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5867640 1 -- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabf006a740 msgr2=0x7fabf009b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5867640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabf006a740 0x7fabf009b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5867640 1 -- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabf00b0530 msgr2=0x7fabf0151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5867640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabf00b0530 0x7fabf0151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5867640 1 -- 172.21.15.53:0/3170777449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009420 con 0x7fabf00b1dc0 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5867640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00b1dc0 0x7fabf014f2d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fabe8001570 tx=0x7fabe800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabe5ffb640 1 -- 172.21.15.53:0/3170777449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800a640 con 0x7fabf00b1dc0 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabe5ffb640 1 -- 172.21.15.53:0/3170777449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe800a7c0 con 0x7fabf00b1dc0 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf009de00 con 0x7fabf00b1dc0 2024-09-13T18:29:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabe5ffb640 1 -- 172.21.15.53:0/3170777449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800ab70 con 0x7fabf00b1dc0 2024-09-13T18:29:06.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf0150120 con 0x7fabf00b1dc0 2024-09-13T18:29:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf009e320 con 0x7fabf00b1dc0 2024-09-13T18:29:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabe5ffb640 1 -- 172.21.15.53:0/3170777449 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fabe800acd0 con 0x7fabf00b1dc0 2024-09-13T18:29:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabe5ffb640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabd40669f0 0x7fabd4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabe5ffb640 1 -- 172.21.15.53:0/3170777449 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabe8084030 con 0x7fabf00b1dc0 2024-09-13T18:29:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5066640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabd40669f0 0x7fabd4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.515+0000 7fabf5066640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabd40669f0 0x7fabd4068eb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabec0ae000 tx=0x7fabec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.523+0000 7fabe5ffb640 1 -- 172.21.15.53:0/3170777449 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fabe80b5db0 con 0x7fabf00b1dc0 2024-09-13T18:29:06.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.679+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabf00afff0 con 0x7fabf00b1dc0 2024-09-13T18:29:06.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.683+0000 7fabe5ffb640 1 -- 172.21.15.53:0/3170777449 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fabe8018020 con 0x7fabf00b1dc0 2024-09-13T18:29:06.690 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:06.690 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:31.841305+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabd40669f0 msgr2=0x7fabd4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabd40669f0 0x7fabd4068eb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabec0ae000 tx=0x7fabec008040 comp rx=0 tx=0).stop 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00b1dc0 msgr2=0x7fabf014f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00b1dc0 0x7fabf014f2d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fabe8001570 tx=0x7fabe800cca0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 shutdown_connections 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fabd40669f0 0x7fabd4068eb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00b1dc0 0x7fabf014f2d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fabf00b0530 0x7fabf0151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 --2- 172.21.15.53:0/3170777449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fabf006a740 0x7fabf009b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 >> 172.21.15.53:0/3170777449 conn(0x7fabf00b5a20 msgr2=0x7fabf0156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 shutdown_connections 2024-09-13T18:29:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.687+0000 7fabf72ca640 1 -- 172.21.15.53:0/3170777449 wait complete. 2024-09-13T18:29:06.710 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:28:28.459143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:28:29.809417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:06.710 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:06.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.823+0000 7f4ba0023640 1 Processor -- start 2024-09-13T18:29:06.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.823+0000 7f4ba0023640 1 -- start start 2024-09-13T18:29:06.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4ba0023640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b980cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4ba0023640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4b980b2f00 0x7f4b9806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4ba0023640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b98160ed0 con 0x7f4b980cb670 2024-09-13T18:29:06.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4ba0023640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b980b23d0 con 0x7f4b980b2f00 2024-09-13T18:29:06.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4ba0023640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9806d700 con 0x7f4b9806bdd0 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9e5c0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4b980b2f00 0x7f4b9806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9d5be640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4b980cb670 0x7f4b980b27f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:51324/0 (socket says 172.21.15.53:51324) 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9ddbf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b980cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9d5be640 1 -- 172.21.15.53:0/2273410612 learned_addr learned my addr 172.21.15.53:0/2273410612 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9ddbf640 1 -- 172.21.15.53:0/2273410612 >> v2:172.21.15.87:3300/0 conn(0x7f4b980b2f00 msgr2=0x7f4b9806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9ddbf640 1 --2- 172.21.15.53:0/2273410612 >> v2:172.21.15.87:3300/0 conn(0x7f4b980b2f00 0x7f4b9806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9ddbf640 1 -- 172.21.15.53:0/2273410612 >> v1:172.21.15.87:6789/0 conn(0x7f4b980cb670 legacy=0x7f4b980b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9ddbf640 1 -- 172.21.15.53:0/2273410612 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980b1500 con 0x7f4b9806bdd0 2024-09-13T18:29:06.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.827+0000 7f4b9e5c0640 1 --2- 172.21.15.53:0/2273410612 >> v2:172.21.15.87:3300/0 conn(0x7f4b980b2f00 0x7f4b9806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:06.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4b9ddbf640 1 --2- 172.21.15.53:0/2273410612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b980cb130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b940097c0 tx=0x7f4b9401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed418a211ea4960a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4b9cdbd640 1 -- 172.21.15.53:0/2273410612 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b940ab600 con 0x7f4b9806bdd0 2024-09-13T18:29:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4b9cdbd640 1 -- 172.21.15.53:0/2273410612 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b940a7050 con 0x7f4b9806bdd0 2024-09-13T18:29:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4b9cdbd640 1 -- 172.21.15.53:0/2273410612 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b940ab980 con 0x7f4b9806bdd0 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- 172.21.15.53:0/2273410612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 msgr2=0x7f4b980cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 --2- 172.21.15.53:0/2273410612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b980cb130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b940097c0 tx=0x7f4b9401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- 172.21.15.53:0/2273410612 shutdown_connections 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 --2- 172.21.15.53:0/2273410612 >> v2:172.21.15.87:3300/0 conn(0x7f4b980b2f00 0x7f4b9806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 --2- 172.21.15.53:0/2273410612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b980cb130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- 172.21.15.53:0/2273410612 >> 172.21.15.53:0/2273410612 conn(0x7f4b98065c80 msgr2=0x7f4b98066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- 172.21.15.53:0/2273410612 shutdown_connections 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- 172.21.15.53:0/2273410612 wait complete. 2024-09-13T18:29:06.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 Processor -- start 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- start start 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b9814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b980b2f00 0x7f4b98157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b980cb670 0x7f4b9806c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98159910 con 0x7f4b980cb670 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98158870 con 0x7f4b980b2f00 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.831+0000 7f4ba0023640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98158b50 con 0x7f4b9806bdd0 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b980cb670 0x7f4b9806c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b980cb670 0x7f4b9806c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41556/0 (socket says 172.21.15.53:41556) 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 -- 172.21.15.53:0/1444462827 learned_addr learned my addr 172.21.15.53:0/1444462827 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9ddbf640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b9814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9d5be640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b980b2f00 0x7f4b98157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 -- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 msgr2=0x7f4b9814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b9814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 -- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b980b2f00 msgr2=0x7f4b98157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b980b2f00 0x7f4b98157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 -- 172.21.15.53:0/1444462827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90009a70 con 0x7f4b980cb670 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9ddbf640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b9814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9e5c0640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b980cb670 0x7f4b9806c1b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000efb0 tx=0x7f4b9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b8a7fc640 1 -- 172.21.15.53:0/1444462827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90009d50 con 0x7f4b980cb670 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b8a7fc640 1 -- 172.21.15.53:0/1444462827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9000f040 con 0x7f4b980cb670 2024-09-13T18:29:06.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b94009420 con 0x7f4b980cb670 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b8a7fc640 1 -- 172.21.15.53:0/1444462827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900146a0 con 0x7f4b980cb670 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b98159110 con 0x7f4b980cb670 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98070470 con 0x7f4b980cb670 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b8a7fc640 1 -- 172.21.15.53:0/1444462827 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f4b90014800 con 0x7f4b980cb670 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b8a7fc640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4b7c066990 0x7f4b7c068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b8a7fc640 1 -- 172.21.15.53:0/1444462827 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b900855e0 con 0x7f4b980cb670 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.835+0000 7f4b9ddbf640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4b7c066990 0x7f4b7c068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:06.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.839+0000 7f4b9ddbf640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4b7c066990 0x7f4b7c068e50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b940ad000 tx=0x7f4b940a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:06.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.839+0000 7f4b8a7fc640 1 -- 172.21.15.53:0/1444462827 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b900525a0 con 0x7f4b980cb670 2024-09-13T18:29:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b980cb130 con 0x7f4b980cb670 2024-09-13T18:29:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4b8a7fc640 1 -- 172.21.15.53:0/1444462827 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b90055bc0 con 0x7f4b980cb670 2024-09-13T18:29:07.000 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:07.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4b7c066990 msgr2=0x7f4b7c068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4b7c066990 0x7f4b7c068e50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b940ad000 tx=0x7f4b940a6000 comp rx=0 tx=0).stop 2024-09-13T18:29:07.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b980cb670 msgr2=0x7f4b9806c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b980cb670 0x7f4b9806c1b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000efb0 tx=0x7f4b9000c490 comp rx=0 tx=0).stop 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 shutdown_connections 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f4b7c066990 0x7f4b7c068e50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b980cb670 0x7f4b9806c1b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b980b2f00 0x7f4b98157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 --2- 172.21.15.53:0/1444462827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9806bdd0 0x7f4b9814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 >> 172.21.15.53:0/1444462827 conn(0x7f4b98065c80 msgr2=0x7f4b980ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 shutdown_connections 2024-09-13T18:29:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:06.995+0000 7f4ba0023640 1 -- 172.21.15.53:0/1444462827 wait complete. 2024-09-13T18:29:07.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:07.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f10428d5640 1 Processor -- start 2024-09-13T18:29:07.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f10428d5640 1 -- start start 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f10428d5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f103c0ccd10 0x7f103c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f10428d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f103c0d2c80 0x7f103c0d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f10428d5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0b7db0 con 0x7f103c15c830 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f10428d5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0d3650 con 0x7f103c0d2c80 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f10428d5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0d0650 con 0x7f103c0ccd10 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f103bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f103c15c830 0x7f103c0d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59566/0 (socket says 172.21.15.53:59566) 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f103bfff640 1 -- 172.21.15.53:0/2974986935 learned_addr learned my addr 172.21.15.53:0/2974986935 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f1040e72640 1 --2- 172.21.15.53:0/2974986935 >> v2:172.21.15.53:3300/0 conn(0x7f103c0d2c80 0x7f103c0d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f103b7fe640 1 --2- 172.21.15.53:0/2974986935 >> v2:172.21.15.87:3300/0 conn(0x7f103c0ccd10 0x7f103c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f103affd640 1 -- 172.21.15.53:0/2974986935 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946870634 0 0) 0x7f103c0b7db0 con 0x7f103c15c830 2024-09-13T18:29:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f103affd640 1 -- 172.21.15.53:0/2974986935 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1024003530 con 0x7f103c15c830 2024-09-13T18:29:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f1040e72640 1 -- 172.21.15.53:0/2974986935 >> v2:172.21.15.87:3300/0 conn(0x7f103c0ccd10 msgr2=0x7f103c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f1040e72640 1 --2- 172.21.15.53:0/2974986935 >> v2:172.21.15.87:3300/0 conn(0x7f103c0ccd10 0x7f103c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f1040e72640 1 -- 172.21.15.53:0/2974986935 >> v1:172.21.15.53:6789/0 conn(0x7f103c15c830 legacy=0x7f103c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.139+0000 7f1040e72640 1 -- 172.21.15.53:0/2974986935 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0d0c10 con 0x7f103c0d2c80 2024-09-13T18:29:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 --2- 172.21.15.53:0/2974986935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c0d2c80 0x7f103c0d3110 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f103c0b43f0 tx=0x7f103401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c180168c7de86b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f103affd640 1 -- 172.21.15.53:0/2974986935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340ab600 con 0x7f103c0d2c80 2024-09-13T18:29:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f103affd640 1 -- 172.21.15.53:0/2974986935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10340a7050 con 0x7f103c0d2c80 2024-09-13T18:29:07.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f103affd640 1 -- 172.21.15.53:0/2974986935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340ab960 con 0x7f103c0d2c80 2024-09-13T18:29:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- 172.21.15.53:0/2974986935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c0d2c80 msgr2=0x7f103c0d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 --2- 172.21.15.53:0/2974986935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c0d2c80 0x7f103c0d3110 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f103c0b43f0 tx=0x7f103401c480 comp rx=0 tx=0).stop 2024-09-13T18:29:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- 172.21.15.53:0/2974986935 shutdown_connections 2024-09-13T18:29:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 --2- 172.21.15.53:0/2974986935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c0d2c80 0x7f103c0d3110 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 --2- 172.21.15.53:0/2974986935 >> v2:172.21.15.87:3300/0 conn(0x7f103c0ccd10 0x7f103c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- 172.21.15.53:0/2974986935 >> 172.21.15.53:0/2974986935 conn(0x7f103c070970 msgr2=0x7f103c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- 172.21.15.53:0/2974986935 shutdown_connections 2024-09-13T18:29:07.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- 172.21.15.53:0/2974986935 wait complete. 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 Processor -- start 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- start start 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f103c0ccd10 0x7f103c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f103c0d2c80 0x7f103c155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c15c830 0x7f103c155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c15c450 con 0x7f103c15c830 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c157520 con 0x7f103c0ccd10 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f10428d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c15c1b0 con 0x7f103c0d2c80 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c15c830 0x7f103c155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c15c830 0x7f103c155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41576/0 (socket says 172.21.15.53:41576) 2024-09-13T18:29:07.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 -- 172.21.15.53:0/601023568 learned_addr learned my addr 172.21.15.53:0/601023568 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f103b7fe640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f103c0d2c80 0x7f103c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f103bfff640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f103c0ccd10 0x7f103c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 -- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f103c0d2c80 msgr2=0x7f103c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f103c0d2c80 0x7f103c155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 -- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f103c0ccd10 msgr2=0x7f103c1579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f103c0ccd10 0x7f103c1579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 -- 172.21.15.53:0/601023568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034009420 con 0x7f103c15c830 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.143+0000 7f1040e72640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c15c830 0x7f103c155e50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1034019090 tx=0x7f1034019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f1038ff9640 1 -- 172.21.15.53:0/601023568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034006e20 con 0x7f103c15c830 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f1038ff9640 1 -- 172.21.15.53:0/601023568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10340b4400 con 0x7f103c15c830 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c156f10 con 0x7f103c15c830 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f1038ff9640 1 -- 172.21.15.53:0/601023568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340b4770 con 0x7f103c15c830 2024-09-13T18:29:07.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c152fa0 con 0x7f103c15c830 2024-09-13T18:29:07.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c156d70 con 0x7f103c15c830 2024-09-13T18:29:07.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f1038ff9640 1 -- 172.21.15.53:0/601023568 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f10340b2040 con 0x7f103c15c830 2024-09-13T18:29:07.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f1038ff9640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1028066960 0x7f1028068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f1038ff9640 1 -- 172.21.15.53:0/601023568 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f103411e5e0 con 0x7f103c15c830 2024-09-13T18:29:07.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f103bfff640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1028066960 0x7f1028068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.147+0000 7f103bfff640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1028066960 0x7f1028068e20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f102c005c10 tx=0x7f102c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.151+0000 7f1038ff9640 1 -- 172.21.15.53:0/601023568 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f103c156d70 con 0x7f103c15c830 2024-09-13T18:29:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f103c156d70 con 0x7f103c15c830 2024-09-13T18:29:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f1038ff9640 1 -- 172.21.15.53:0/601023568 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f103c156d70 con 0x7f103c15c830 2024-09-13T18:29:07.317 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1028066960 msgr2=0x7f1028068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1028066960 0x7f1028068e20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f102c005c10 tx=0x7f102c009040 comp rx=0 tx=0).stop 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c15c830 msgr2=0x7f103c155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c15c830 0x7f103c155e50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1034019090 tx=0x7f1034019220 comp rx=0 tx=0).stop 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 shutdown_connections 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1028066960 0x7f1028068e20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f103c0d2c80 0x7f103c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f103c15c830 0x7f103c155e50 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 --2- 172.21.15.53:0/601023568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f103c0ccd10 0x7f103c1579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 >> 172.21.15.53:0/601023568 conn(0x7f103c070970 msgr2=0x7f103c15f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 shutdown_connections 2024-09-13T18:29:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.311+0000 7f10428d5640 1 -- 172.21.15.53:0/601023568 wait complete. 2024-09-13T18:29:07.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:07.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9d09c640 1 Processor -- start 2024-09-13T18:29:07.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9d09c640 1 -- start start 2024-09-13T18:29:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9d09c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9d98072d30 0x7f9d98071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9d09c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d980cb670 0x7f9d980cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9d09c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980cc000 con 0x7f9d9815a6d0 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9d09c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980713f0 con 0x7f9d98072d30 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9d09c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9815aab0 con 0x7f9d980cb670 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d96d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9d9815a6d0 0x7f9d980cd5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59570/0 (socket says 172.21.15.53:59570) 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d96d9d640 1 -- 172.21.15.53:0/4273929365 learned_addr learned my addr 172.21.15.53:0/4273929365 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9659c640 1 --2- 172.21.15.53:0/4273929365 >> v2:172.21.15.53:3300/0 conn(0x7f9d98072d30 0x7f9d98071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9759e640 1 --2- 172.21.15.53:0/4273929365 >> v2:172.21.15.87:3300/0 conn(0x7f9d980cb670 0x7f9d980cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9659c640 1 -- 172.21.15.53:0/4273929365 >> v2:172.21.15.87:3300/0 conn(0x7f9d980cb670 msgr2=0x7f9d980cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9659c640 1 --2- 172.21.15.53:0/4273929365 >> v2:172.21.15.87:3300/0 conn(0x7f9d980cb670 0x7f9d980cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9659c640 1 -- 172.21.15.53:0/4273929365 >> v1:172.21.15.53:6789/0 conn(0x7f9d9815a6d0 legacy=0x7f9d980cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9659c640 1 -- 172.21.15.53:0/4273929365 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98073310 con 0x7f9d98072d30 2024-09-13T18:29:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d95d9b640 1 -- 172.21.15.53:0/4273929365 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855622422 0 0) 0x7f9d900014a0 con 0x7f9d9815a6d0 2024-09-13T18:29:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.455+0000 7f9d9759e640 1 --2- 172.21.15.53:0/4273929365 >> v2:172.21.15.87:3300/0 conn(0x7f9d980cb670 0x7f9d980cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9659c640 1 --2- 172.21.15.53:0/4273929365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d98072d30 0x7f9d98071880 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9d980b19b0 tx=0x7f9d8c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aa1a6f24b5272e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d95d9b640 1 -- 172.21.15.53:0/4273929365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0a8050 con 0x7f9d98072d30 2024-09-13T18:29:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d95d9b640 1 -- 172.21.15.53:0/4273929365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0ac5f0 con 0x7f9d98072d30 2024-09-13T18:29:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d95d9b640 1 -- 172.21.15.53:0/4273929365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0ac980 con 0x7f9d98072d30 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 -- 172.21.15.53:0/4273929365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d98072d30 msgr2=0x7f9d98071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/4273929365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d98072d30 0x7f9d98071880 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9d980b19b0 tx=0x7f9d8c01c480 comp rx=0 tx=0).stop 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 -- 172.21.15.53:0/4273929365 shutdown_connections 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/4273929365 >> v2:172.21.15.87:3300/0 conn(0x7f9d980cb670 0x7f9d980cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/4273929365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d98072d30 0x7f9d98071880 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 -- 172.21.15.53:0/4273929365 >> 172.21.15.53:0/4273929365 conn(0x7f9d980b0a30 msgr2=0x7f9d980b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 -- 172.21.15.53:0/4273929365 shutdown_connections 2024-09-13T18:29:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 -- 172.21.15.53:0/4273929365 wait complete. 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 Processor -- start 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 -- start start 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d98072d30 0x7f9d98157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d980cb670 0x7f9d9814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.459+0000 7f9d9d09c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d9815a6d0 0x7f9d9814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9d09c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98147240 con 0x7f9d9815a6d0 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9d09c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98147de0 con 0x7f9d980cb670 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9d09c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98159af0 con 0x7f9d98072d30 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d9815a6d0 0x7f9d9814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d9815a6d0 0x7f9d9814df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41598/0 (socket says 172.21.15.53:41598) 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 -- 172.21.15.53:0/3415361249 learned_addr learned my addr 172.21.15.53:0/3415361249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9659c640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d980cb670 0x7f9d9814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d96d9d640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d98072d30 0x7f9d98157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 -- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d98072d30 msgr2=0x7f9d98157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d98072d30 0x7f9d98157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 -- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d980cb670 msgr2=0x7f9d9814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d980cb670 0x7f9d9814b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 -- 172.21.15.53:0/3415361249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c009420 con 0x7f9d9815a6d0 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9759e640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d9815a6d0 0x7f9d9814df00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e810 tx=0x7f9d8800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d7f7fe640 1 -- 172.21.15.53:0/3415361249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800c6d0 con 0x7f9d9815a6d0 2024-09-13T18:29:07.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d7f7fe640 1 -- 172.21.15.53:0/3415361249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800c830 con 0x7f9d9815a6d0 2024-09-13T18:29:07.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d98159dd0 con 0x7f9d9815a6d0 2024-09-13T18:29:07.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d7f7fe640 1 -- 172.21.15.53:0/3415361249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800cbe0 con 0x7f9d9815a6d0 2024-09-13T18:29:07.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d98148310 con 0x7f9d9815a6d0 2024-09-13T18:29:07.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d98148500 con 0x7f9d9815a6d0 2024-09-13T18:29:07.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d7f7fe640 1 -- 172.21.15.53:0/3415361249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f9d8800cd40 con 0x7f9d9815a6d0 2024-09-13T18:29:07.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d7f7fe640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d840669f0 0x7f9d84068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d7f7fe640 1 -- 172.21.15.53:0/3415361249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d88084520 con 0x7f9d9815a6d0 2024-09-13T18:29:07.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.463+0000 7f9d96d9d640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d840669f0 0x7f9d84068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.467+0000 7f9d96d9d640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d840669f0 0x7f9d84068eb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9d900012f0 tx=0x7f9d90005ec0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.467+0000 7f9d7f7fe640 1 -- 172.21.15.53:0/3415361249 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d88051400 con 0x7f9d9815a6d0 2024-09-13T18:29:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.627+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d980cc460 con 0x7f9d9815a6d0 2024-09-13T18:29:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.627+0000 7f9d7f7fe640 1 -- 172.21.15.53:0/3415361249 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d88054a20 con 0x7f9d9815a6d0 2024-09-13T18:29:07.635 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:29:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d840669f0 msgr2=0x7f9d84068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d840669f0 0x7f9d84068eb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9d900012f0 tx=0x7f9d90005ec0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d9815a6d0 msgr2=0x7f9d9814df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d9815a6d0 0x7f9d9814df00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e810 tx=0x7f9d8800ecd0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 shutdown_connections 2024-09-13T18:29:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9d840669f0 0x7f9d84068eb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d9815a6d0 0x7f9d9814df00 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d980cb670 0x7f9d9814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 --2- 172.21.15.53:0/3415361249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d98072d30 0x7f9d98157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 >> 172.21.15.53:0/3415361249 conn(0x7f9d980b0a30 msgr2=0x7f9d980afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 shutdown_connections 2024-09-13T18:29:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.631+0000 7f9d9d09c640 1 -- 172.21.15.53:0/3415361249 wait complete. 2024-09-13T18:29:07.655 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.771+0000 7fecd8cd0640 1 Processor -- start 2024-09-13T18:29:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.771+0000 7fecd8cd0640 1 -- start start 2024-09-13T18:29:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd8cd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 0x7fecd4070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd8cd0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd406d480 con 0x7fecd41582a0 2024-09-13T18:29:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd8cd0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd415ace0 con 0x7fecd40711d0 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd8cd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd415aaf0 con 0x7fecd415b7c0 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fecd41582a0 0x7fecd406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59576/0 (socket says 172.21.15.53:59576) 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 -- 172.21.15.53:0/1593044110 learned_addr learned my addr 172.21.15.53:0/1593044110 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd1d9b640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 0x7fecd4070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420778494 0 0) 0x7fecd406d480 con 0x7fecd41582a0 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecbc003530 con 0x7fecd41582a0 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2801943996 0 0) 0x7fecbc003530 con 0x7fecd41582a0 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 msgr2=0x7fecd4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 0x7fecd4070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 >> v1:172.21.15.87:6789/0 conn(0x7fecd40711d0 legacy=0x7fecd41640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd415afc0 con 0x7fecd41582a0 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fecc4001680 con 0x7fecd41582a0 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 >> v1:172.21.15.53:6789/0 conn(0x7fecd41582a0 legacy=0x7fecd406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecbc0039b0 0x7fecbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 0x7fecbc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecbc004d10 0x7fecbc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc00ba40 con 0x7fecbc0039b0 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc00bbb0 con 0x7fecbc004d10 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc00bd70 con 0x7fecd415b7c0 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecbc0039b0 0x7fecbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd1d9b640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 0x7fecbc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd2d9d640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecbc004d10 0x7fecbc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 -- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 msgr2=0x7fecbc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecd415b7c0 0x7fecbc0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 -- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecbc004d10 msgr2=0x7fecbc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecbc004d10 0x7fecbc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd259c640 1 -- 172.21.15.53:0/1593044110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc003530 con 0x7fecbc0039b0 2024-09-13T18:29:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.775+0000 7fecd2d9d640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecbc004d10 0x7fecbc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:07.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd259c640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecbc0039b0 0x7fecbc003dd0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c190 tx=0x7fecc401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4598fedf6b111d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4005ae0 con 0x7fecbc0039b0 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4005c40 con 0x7fecbc0039b0 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd159a640 1 -- 172.21.15.53:0/1593044110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4007070 con 0x7fecbc0039b0 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- 172.21.15.53:0/1593044110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecbc0039b0 msgr2=0x7fecbc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 --2- 172.21.15.53:0/1593044110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecbc0039b0 0x7fecbc003dd0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c190 tx=0x7fecc401cc20 comp rx=0 tx=0).stop 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 -- 172.21.15.53:0/1593044110 reap_dead start 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- 172.21.15.53:0/1593044110 shutdown_connections 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- 172.21.15.53:0/1593044110 >> 172.21.15.53:0/1593044110 conn(0x7fecd4065c80 msgr2=0x7fecd4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- 172.21.15.53:0/1593044110 shutdown_connections 2024-09-13T18:29:07.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- 172.21.15.53:0/1593044110 wait complete. 2024-09-13T18:29:07.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 Processor -- start 2024-09-13T18:29:07.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- start start 2024-09-13T18:29:07.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecbc0039b0 0x7fecd413c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecd40ad5a0 0x7fecd413f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40ac8e0 0x7fecd40acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd414f550 con 0x7fecd40ac8e0 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40ad2a0 con 0x7fecd40ad5a0 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd8cd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41400e0 con 0x7fecbc0039b0 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40ac8e0 0x7fecd40acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40ac8e0 0x7fecd40acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41618/0 (socket says 172.21.15.53:41618) 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 -- 172.21.15.53:0/3068701410 learned_addr learned my addr 172.21.15.53:0/3068701410 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd1d9b640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecd40ad5a0 0x7fecd413f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd259c640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecbc0039b0 0x7fecd413c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 -- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecbc0039b0 msgr2=0x7fecd413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecbc0039b0 0x7fecd413c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 -- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecd40ad5a0 msgr2=0x7fecd413f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecd40ad5a0 0x7fecd413f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.779+0000 7fecd2d9d640 1 -- 172.21.15.53:0/3068701410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd413f840 con 0x7fecd40ac8e0 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecd2d9d640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40ac8e0 0x7fecd40acd60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fecd40cbf70 tx=0x7feccc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecc2ffd640 1 -- 172.21.15.53:0/3068701410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc006d60 con 0x7fecd40ac8e0 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecc2ffd640 1 -- 172.21.15.53:0/3068701410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc003980 con 0x7fecd40ac8e0 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd413fb20 con 0x7fecd40ac8e0 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecc2ffd640 1 -- 172.21.15.53:0/3068701410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc003d30 con 0x7fecd40ac8e0 2024-09-13T18:29:07.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd413d200 con 0x7fecd40ac8e0 2024-09-13T18:29:07.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd4067400 con 0x7fecd40ac8e0 2024-09-13T18:29:07.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecc2ffd640 1 -- 172.21.15.53:0/3068701410 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7feccc005070 con 0x7fecd40ac8e0 2024-09-13T18:29:07.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecc2ffd640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecb40669f0 0x7fecb4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:07.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecc2ffd640 1 -- 172.21.15.53:0/3068701410 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feccc0845f0 con 0x7fecd40ac8e0 2024-09-13T18:29:07.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecd259c640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecb40669f0 0x7fecb4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:07.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.783+0000 7fecd259c640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecb40669f0 0x7fecb4068eb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ab000 tx=0x7fecc40a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:07.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.787+0000 7fecc2ffd640 1 -- 172.21.15.53:0/3068701410 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feccc051490 con 0x7fecd40ac8e0 2024-09-13T18:29:07.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.983+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecd406c900 con 0x7fecd40ac8e0 2024-09-13T18:29:07.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.983+0000 7fecc2ffd640 1 -- 172.21.15.53:0/3068701410 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4731 (secure 0 0 0) 0x7feccc054ab0 con 0x7fecd40ac8e0 2024-09-13T18:29:07.990 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:07.990 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5396,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1852087146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1852087146},{"type":"v1","addr":"172.21.15.87:6835","nonce":1852087146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1364711247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1364711247},{"type":"v1","addr":"172.21.15.87:6837","nonce":1364711247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/763471722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":763471722},{"type":"v1","addr":"172.21.15.53:6833","nonce":763471722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:30.838100+0000","modified":"2024-09-13T18:28:33.851103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3738594836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3738594836},{"type":"v1","addr":"172.21.15.53:6835","nonce":3738594836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:29:07.990 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 32 2024-09-13T18:29:07.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecb40669f0 msgr2=0x7fecb4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecb40669f0 0x7fecb4068eb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecc40ab000 tx=0x7fecc40a7070 comp rx=0 tx=0).stop 2024-09-13T18:29:07.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40ac8e0 msgr2=0x7fecd40acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:07.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40ac8e0 0x7fecd40acd60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fecd40cbf70 tx=0x7feccc00dc00 comp rx=0 tx=0).stop 2024-09-13T18:29:07.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 shutdown_connections 2024-09-13T18:29:07.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fecb40669f0 0x7fecb4068eb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecd40ac8e0 0x7fecd40acd60 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecd40ad5a0 0x7fecd413f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 --2- 172.21.15.53:0/3068701410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecbc0039b0 0x7fecd413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:07.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 >> 172.21.15.53:0/3068701410 conn(0x7fecd4065c80 msgr2=0x7fecd40af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:07.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 shutdown_connections 2024-09-13T18:29:07.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:07.987+0000 7fecd8cd0640 1 -- 172.21.15.53:0/3068701410 wait complete. 2024-09-13T18:29:08.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:08.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abed53640 1 Processor -- start 2024-09-13T18:29:08.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abed53640 1 -- start start 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abed53640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abed53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ab806b850 0x7f7ab80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abed53640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80b1ac0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abed53640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab80b3010 con 0x7f7ab806b850 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abed53640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab8159ac0 con 0x7f7ab80cb980 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7aaffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ab806b850 0x7f7ab80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7aaffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ab806b850 0x7f7ab80cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41620/0 (socket says 172.21.15.53:41620) 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7aaffff640 1 -- 172.21.15.53:0/3526141902 learned_addr learned my addr 172.21.15.53:0/3526141902 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abcaef640 1 --2- 172.21.15.53:0/3526141902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7aaffff640 1 -- 172.21.15.53:0/3526141902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 msgr2=0x7f7ab80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7aaffff640 1 --2- 172.21.15.53:0/3526141902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7aaffff640 1 -- 172.21.15.53:0/3526141902 >> v1:172.21.15.87:6789/0 conn(0x7f7ab80cbd60 legacy=0x7f7ab806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7aaffff640 1 -- 172.21.15.53:0/3526141902 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8159da0 con 0x7f7ab806b850 2024-09-13T18:29:08.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.131+0000 7f7abcaef640 1 --2- 172.21.15.53:0/3526141902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:08.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7aaffff640 1 --2- 172.21.15.53:0/3526141902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab806b850 0x7f7ab80cdd40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800bb40 tx=0x7f7aa801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0396d16538937c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7aaf7fe640 1 -- 172.21.15.53:0/3526141902 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80a7c20 con 0x7f7ab806b850 2024-09-13T18:29:08.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7aaf7fe640 1 -- 172.21.15.53:0/3526141902 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80a7d80 con 0x7f7ab806b850 2024-09-13T18:29:08.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7aaf7fe640 1 -- 172.21.15.53:0/3526141902 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80af660 con 0x7f7ab806b850 2024-09-13T18:29:08.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 -- 172.21.15.53:0/3526141902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab806b850 msgr2=0x7f7ab80cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 --2- 172.21.15.53:0/3526141902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab806b850 0x7f7ab80cdd40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800bb40 tx=0x7f7aa801eb50 comp rx=0 tx=0).stop 2024-09-13T18:29:08.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 -- 172.21.15.53:0/3526141902 shutdown_connections 2024-09-13T18:29:08.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 --2- 172.21.15.53:0/3526141902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab806b850 0x7f7ab80cdd40 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 --2- 172.21.15.53:0/3526141902 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 -- 172.21.15.53:0/3526141902 >> 172.21.15.53:0/3526141902 conn(0x7f7ab8065c80 msgr2=0x7f7ab8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 -- 172.21.15.53:0/3526141902 shutdown_connections 2024-09-13T18:29:08.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 -- 172.21.15.53:0/3526141902 wait complete. 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.135+0000 7f7abed53640 1 Processor -- start 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 -- start start 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ab806b850 0x7f7ab8148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab80cbd60 0x7f7ab8158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab81f50f0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab814c710 con 0x7f7ab806b850 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab8149330 con 0x7f7ab80cb980 2024-09-13T18:29:08.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab80cbd60 0x7f7ab8158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab80cbd60 0x7f7ab8158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41636/0 (socket says 172.21.15.53:41636) 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 -- 172.21.15.53:0/880605870 learned_addr learned my addr 172.21.15.53:0/880605870 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abcaef640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ab806b850 0x7f7ab8148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7aaffff640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 -- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 msgr2=0x7f7ab81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab81583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 -- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ab806b850 msgr2=0x7f7ab8148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ab806b850 0x7f7ab8148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 -- 172.21.15.53:0/880605870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa800b770 con 0x7f7ab80cbd60 2024-09-13T18:29:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abd2f0640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab80cbd60 0x7f7ab8158930 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c770 tx=0x7f7ab000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7aad7fa640 1 -- 172.21.15.53:0/880605870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0003b80 con 0x7f7ab80cbd60 2024-09-13T18:29:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7aad7fa640 1 -- 172.21.15.53:0/880605870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab0003ce0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7aad7fa640 1 -- 172.21.15.53:0/880605870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab000aa90 con 0x7f7ab80cbd60 2024-09-13T18:29:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab8149610 con 0x7f7ab80cbd60 2024-09-13T18:29:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab814c3a0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab8067400 con 0x7f7ab80cbd60 2024-09-13T18:29:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7aad7fa640 1 -- 172.21.15.53:0/880605870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f7ab000abf0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7aad7fa640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7aa40669f0 0x7f7aa4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7aad7fa640 1 -- 172.21.15.53:0/880605870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ab0084640 con 0x7f7ab80cbd60 2024-09-13T18:29:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.139+0000 7f7abcaef640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7aa40669f0 0x7f7aa4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.143+0000 7f7abcaef640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7aa40669f0 0x7f7aa4068eb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80ae8c0 tx=0x7f7ab4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.143+0000 7f7aad7fa640 1 -- 172.21.15.53:0/880605870 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ab00514a0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.303+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ab80b2bf0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.307+0000 7f7aad7fa640 1 -- 172.21.15.53:0/880605870 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7ab0054ac0 con 0x7f7ab80cbd60 2024-09-13T18:29:08.314 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:08.314 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:31.841305+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:08.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7aa40669f0 msgr2=0x7f7aa4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7aa40669f0 0x7f7aa4068eb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80ae8c0 tx=0x7f7ab4008040 comp rx=0 tx=0).stop 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab80cbd60 msgr2=0x7f7ab8158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab80cbd60 0x7f7ab8158930 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000c770 tx=0x7f7ab000cc30 comp rx=0 tx=0).stop 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 shutdown_connections 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7aa40669f0 0x7f7aa4068eb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7ab80cb980 0x7f7ab81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ab80cbd60 0x7f7ab8158930 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 --2- 172.21.15.53:0/880605870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ab806b850 0x7f7ab8148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 >> 172.21.15.53:0/880605870 conn(0x7f7ab8065c80 msgr2=0x7f7ab80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 shutdown_connections 2024-09-13T18:29:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.311+0000 7f7abed53640 1 -- 172.21.15.53:0/880605870 wait complete. 2024-09-13T18:29:08.334 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:29:08.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:08.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.451+0000 7f965ddf0640 1 Processor -- start 2024-09-13T18:29:08.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.451+0000 7f965ddf0640 1 -- start start 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f965ddf0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f965806fa80 0x7f965806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f965ddf0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96580cbb60 0x7f96580b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f965ddf0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96580b2340 con 0x7f9658158ba0 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f965ddf0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96580b2860 con 0x7f96580cbb60 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f965ddf0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9658158f80 con 0x7f965806fa80 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f96577fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9658158ba0 0x7f965806f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59584/0 (socket says 172.21.15.53:59584) 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f96577fe640 1 -- 172.21.15.53:0/472057082 learned_addr learned my addr 172.21.15.53:0/472057082 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9657fff640 1 --2- 172.21.15.53:0/472057082 >> v2:172.21.15.53:3300/0 conn(0x7f96580cbb60 0x7f96580b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9656ffd640 1 --2- 172.21.15.53:0/472057082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f965806fa80 0x7f965806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f96567fc640 1 -- 172.21.15.53:0/472057082 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334610499 0 0) 0x7f9648001120 con 0x7f9658158ba0 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f96567fc640 1 -- 172.21.15.53:0/472057082 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9640003530 con 0x7f9658158ba0 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9657fff640 1 -- 172.21.15.53:0/472057082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f965806fa80 msgr2=0x7f965806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9657fff640 1 --2- 172.21.15.53:0/472057082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f965806fa80 0x7f965806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9657fff640 1 -- 172.21.15.53:0/472057082 >> v1:172.21.15.53:6789/0 conn(0x7f9658158ba0 legacy=0x7f965806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9657fff640 1 -- 172.21.15.53:0/472057082 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580b2580 con 0x7f96580cbb60 2024-09-13T18:29:08.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9656ffd640 1 --2- 172.21.15.53:0/472057082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f965806fa80 0x7f965806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:08.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f9657fff640 1 --2- 172.21.15.53:0/472057082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96580cbb60 0x7f96580b1e00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9650009d90 tx=0x7f965001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dc084dcbdb0804 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f96567fc640 1 -- 172.21.15.53:0/472057082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5920 con 0x7f96580cbb60 2024-09-13T18:29:08.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f96567fc640 1 -- 172.21.15.53:0/472057082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500a5a80 con 0x7f96580cbb60 2024-09-13T18:29:08.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.455+0000 7f96567fc640 1 -- 172.21.15.53:0/472057082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5e10 con 0x7f96580cbb60 2024-09-13T18:29:08.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- 172.21.15.53:0/472057082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96580cbb60 msgr2=0x7f96580b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 --2- 172.21.15.53:0/472057082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96580cbb60 0x7f96580b1e00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9650009d90 tx=0x7f965001c8e0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- 172.21.15.53:0/472057082 shutdown_connections 2024-09-13T18:29:08.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 --2- 172.21.15.53:0/472057082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96580cbb60 0x7f96580b1e00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 --2- 172.21.15.53:0/472057082 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f965806fa80 0x7f965806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- 172.21.15.53:0/472057082 >> 172.21.15.53:0/472057082 conn(0x7f9658065c80 msgr2=0x7f9658066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- 172.21.15.53:0/472057082 shutdown_connections 2024-09-13T18:29:08.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- 172.21.15.53:0/472057082 wait complete. 2024-09-13T18:29:08.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 Processor -- start 2024-09-13T18:29:08.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- start start 2024-09-13T18:29:08.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f965806fa80 0x7f965813cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96580cbb60 0x7f9658159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9658158ba0 0x7f96580ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965815af60 con 0x7f965806fa80 2024-09-13T18:29:08.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965815a2e0 con 0x7f96580cbb60 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965815a5c0 con 0x7f9658158ba0 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f965806fa80 0x7f965813cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f965806fa80 0x7f965813cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41654/0 (socket says 172.21.15.53:41654) 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 -- 172.21.15.53:0/4258468661 learned_addr learned my addr 172.21.15.53:0/4258468661 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f9656ffd640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96580cbb60 0x7f9658159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f9657fff640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9658158ba0 0x7f96580ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 -- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9658158ba0 msgr2=0x7f96580ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9658158ba0 0x7f96580ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 -- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96580cbb60 msgr2=0x7f9658159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96580cbb60 0x7f9658159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 -- 172.21.15.53:0/4258468661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009a70 con 0x7f965806fa80 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f9656ffd640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96580cbb60 0x7f9658159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f96577fe640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f965806fa80 0x7f965813cb00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f964800c400 tx=0x7f964800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f963ffff640 1 -- 172.21.15.53:0/4258468661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648005cf0 con 0x7f965806fa80 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f963ffff640 1 -- 172.21.15.53:0/4258468661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9648005e70 con 0x7f965806fa80 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f963ffff640 1 -- 172.21.15.53:0/4258468661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480072f0 con 0x7f965806fa80 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965815a8a0 con 0x7f965806fa80 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.459+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9658152250 con 0x7f965806fa80 2024-09-13T18:29:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.463+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9658067400 con 0x7f965806fa80 2024-09-13T18:29:08.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.463+0000 7f963ffff640 1 -- 172.21.15.53:0/4258468661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f9648007450 con 0x7f965806fa80 2024-09-13T18:29:08.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.463+0000 7f963ffff640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96440669f0 0x7f9644068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.463+0000 7f963ffff640 1 -- 172.21.15.53:0/4258468661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9648083ba0 con 0x7f965806fa80 2024-09-13T18:29:08.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.463+0000 7f9656ffd640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96440669f0 0x7f9644068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.463+0000 7f9656ffd640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96440669f0 0x7f9644068eb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f964c006e90 tx=0x7f964c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.467+0000 7f963ffff640 1 -- 172.21.15.53:0/4258468661 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9648054550 con 0x7f965806fa80 2024-09-13T18:29:08.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96580b2340 con 0x7f965806fa80 2024-09-13T18:29:08.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f963ffff640 1 -- 172.21.15.53:0/4258468661 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f96580b2340 con 0x7f965806fa80 2024-09-13T18:29:08.670 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:08.670 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5396,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1852087146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1852087146},{"type":"v1","addr":"172.21.15.87:6835","nonce":1852087146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1364711247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1364711247},{"type":"v1","addr":"172.21.15.87:6837","nonce":1364711247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/763471722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":763471722},{"type":"v1","addr":"172.21.15.53:6833","nonce":763471722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:30.838100+0000","modified":"2024-09-13T18:28:33.851103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3738594836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3738594836},{"type":"v1","addr":"172.21.15.53:6835","nonce":3738594836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:29:08.670 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 32 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96440669f0 msgr2=0x7f9644068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96440669f0 0x7f9644068eb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f964c006e90 tx=0x7f964c008040 comp rx=0 tx=0).stop 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f965806fa80 msgr2=0x7f965813cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f965806fa80 0x7f965813cb00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f964800c400 tx=0x7f964800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 shutdown_connections 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f96440669f0 0x7f9644068eb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9658158ba0 0x7f96580ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96580cbb60 0x7f9658159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 --2- 172.21.15.53:0/4258468661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f965806fa80 0x7f965813cb00 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.663+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 >> 172.21.15.53:0/4258468661 conn(0x7f9658065c80 msgr2=0x7f965806f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.667+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 shutdown_connections 2024-09-13T18:29:08.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.667+0000 7f965ddf0640 1 -- 172.21.15.53:0/4258468661 wait complete. 2024-09-13T18:29:08.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92f685640 1 Processor -- start 2024-09-13T18:29:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92f685640 1 -- start start 2024-09-13T18:29:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92f685640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280ce3d0 0x7fa9280b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92f685640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9280b5570 0x7fa9280b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92f685640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280cf5f0 con 0x7fa9281593a0 2024-09-13T18:29:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92f685640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9280b5a00 con 0x7fa9280b5570 2024-09-13T18:29:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92f685640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280ce9e0 con 0x7fa9280ce3d0 2024-09-13T18:29:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92d421640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa9281593a0 0x7fa928070aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59600/0 (socket says 172.21.15.53:59600) 2024-09-13T18:29:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92d421640 1 -- 172.21.15.53:0/1169975248 learned_addr learned my addr 172.21.15.53:0/1169975248 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92dc22640 1 --2- 172.21.15.53:0/1169975248 >> v2:172.21.15.53:3300/0 conn(0x7fa9280b5570 0x7fa9280b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92cc20640 1 --2- 172.21.15.53:0/1169975248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280ce3d0 0x7fa9280b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92dc22640 1 -- 172.21.15.53:0/1169975248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280ce3d0 msgr2=0x7fa9280b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92dc22640 1 --2- 172.21.15.53:0/1169975248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280ce3d0 0x7fa9280b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92dc22640 1 -- 172.21.15.53:0/1169975248 >> v1:172.21.15.53:6789/0 conn(0x7fa9281593a0 legacy=0x7fa928070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa91ffff640 1 -- 172.21.15.53:0/1169975248 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344605413 0 0) 0x7fa9280cf5f0 con 0x7fa9281593a0 2024-09-13T18:29:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.811+0000 7fa92dc22640 1 -- 172.21.15.53:0/1169975248 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9280cecc0 con 0x7fa9280b5570 2024-09-13T18:29:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 --2- 172.21.15.53:0/1169975248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9280b5570 0x7fa9280b3230 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa920009d90 tx=0x7fa92001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b4514d2bbb97d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa91ffff640 1 -- 172.21.15.53:0/1169975248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200a5920 con 0x7fa9280b5570 2024-09-13T18:29:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa91ffff640 1 -- 172.21.15.53:0/1169975248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9200a5a80 con 0x7fa9280b5570 2024-09-13T18:29:08.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa91ffff640 1 -- 172.21.15.53:0/1169975248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200a5e10 con 0x7fa9280b5570 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- 172.21.15.53:0/1169975248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9280b5570 msgr2=0x7fa9280b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 --2- 172.21.15.53:0/1169975248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9280b5570 0x7fa9280b3230 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fa920009d90 tx=0x7fa92001c970 comp rx=0 tx=0).stop 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- 172.21.15.53:0/1169975248 shutdown_connections 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 --2- 172.21.15.53:0/1169975248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9280b5570 0x7fa9280b3230 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 --2- 172.21.15.53:0/1169975248 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280ce3d0 0x7fa9280b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- 172.21.15.53:0/1169975248 >> 172.21.15.53:0/1169975248 conn(0x7fa928069f50 msgr2=0x7fa92806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- 172.21.15.53:0/1169975248 shutdown_connections 2024-09-13T18:29:08.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- 172.21.15.53:0/1169975248 wait complete. 2024-09-13T18:29:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 Processor -- start 2024-09-13T18:29:08.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- start start 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280b5570 0x7fa9281f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9280ce3d0 0x7fa9281f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9281593a0 0x7fa92815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa928159990 con 0x7fa9281593a0 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92815a7f0 con 0x7fa9280ce3d0 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92f685640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa928159be0 con 0x7fa9280b5570 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9281593a0 0x7fa92815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9281593a0 0x7fa92815bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41670/0 (socket says 172.21.15.53:41670) 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 -- 172.21.15.53:0/1485246886 learned_addr learned my addr 172.21.15.53:0/1485246886 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92cc20640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9280ce3d0 0x7fa9281f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92d421640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280b5570 0x7fa9281f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 -- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280b5570 msgr2=0x7fa9281f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280b5570 0x7fa9281f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 -- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9280ce3d0 msgr2=0x7fa9281f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9280ce3d0 0x7fa9281f7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92dc22640 1 -- 172.21.15.53:0/1485246886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009a70 con 0x7fa9281593a0 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.815+0000 7fa92cc20640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9280ce3d0 0x7fa9281f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa92dc22640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9281593a0 0x7fa92815bd30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa92001a5a0 tx=0x7fa920019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa91dffb640 1 -- 172.21.15.53:0/1485246886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200bf070 con 0x7fa9281593a0 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa91dffb640 1 -- 172.21.15.53:0/1485246886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920009450 con 0x7fa9281593a0 2024-09-13T18:29:08.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa928159ec0 con 0x7fa9281593a0 2024-09-13T18:29:08.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa91dffb640 1 -- 172.21.15.53:0/1485246886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200aed80 con 0x7fa9281593a0 2024-09-13T18:29:08.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92815a480 con 0x7fa9281593a0 2024-09-13T18:29:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92815a960 con 0x7fa9281593a0 2024-09-13T18:29:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa91dffb640 1 -- 172.21.15.53:0/1485246886 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fa9200b4050 con 0x7fa9281593a0 2024-09-13T18:29:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa91dffb640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa90c066a20 0x7fa90c068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa91dffb640 1 -- 172.21.15.53:0/1485246886 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa92011f1f0 con 0x7fa9281593a0 2024-09-13T18:29:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa92d421640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa90c066a20 0x7fa90c068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:08.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.819+0000 7fa92d421640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa90c066a20 0x7fa90c068ee0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa924000f70 tx=0x7fa924007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:08.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:08.823+0000 7fa91dffb640 1 -- 172.21.15.53:0/1485246886 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9200ec150 con 0x7fa9281593a0 2024-09-13T18:29:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9281569b0 con 0x7fa9281593a0 2024-09-13T18:29:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa91dffb640 1 -- 172.21.15.53:0/1485246886 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4731 (secure 0 0 0) 0x7fa9200ef770 con 0x7fa9281593a0 2024-09-13T18:29:09.025 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:09.025 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5396,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1852087146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1852087146},{"type":"v1","addr":"172.21.15.87:6835","nonce":1852087146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1364711247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1364711247},{"type":"v1","addr":"172.21.15.87:6837","nonce":1364711247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/763471722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":763471722},{"type":"v1","addr":"172.21.15.53:6833","nonce":763471722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:28:30.838100+0000","modified":"2024-09-13T18:28:33.851103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3738594836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3738594836},{"type":"v1","addr":"172.21.15.53:6835","nonce":3738594836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:29:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 32 2024-09-13T18:29:09.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa90c066a20 msgr2=0x7fa90c068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa90c066a20 0x7fa90c068ee0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa924000f70 tx=0x7fa924007c10 comp rx=0 tx=0).stop 2024-09-13T18:29:09.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9281593a0 msgr2=0x7fa92815bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9281593a0 0x7fa92815bd30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa92001a5a0 tx=0x7fa920019710 comp rx=0 tx=0).stop 2024-09-13T18:29:09.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 shutdown_connections 2024-09-13T18:29:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa90c066a20 0x7fa90c068ee0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9281593a0 0x7fa92815bd30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9280ce3d0 0x7fa9281f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 --2- 172.21.15.53:0/1485246886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9280b5570 0x7fa9281f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 >> 172.21.15.53:0/1485246886 conn(0x7fa928069f50 msgr2=0x7fa928156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 shutdown_connections 2024-09-13T18:29:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.019+0000 7fa92f685640 1 -- 172.21.15.53:0/1485246886 wait complete. 2024-09-13T18:29:09.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:09.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.163+0000 7fca8d0a8640 1 Processor -- start 2024-09-13T18:29:09.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.163+0000 7fca8d0a8640 1 -- start start 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8d0a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cb980 0x7fca880b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8d0a8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca8806b850 0x7fca880cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8d0a8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880b1ac0 con 0x7fca880cbd60 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8d0a8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880b3010 con 0x7fca8806b850 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8d0a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca88159ac0 con 0x7fca880cb980 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca8806b850 0x7fca880cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca8806b850 0x7fca880cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41682/0 (socket says 172.21.15.53:41682) 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 -- 172.21.15.53:0/3136345225 learned_addr learned my addr 172.21.15.53:0/3136345225 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca86d9d640 1 --2- 172.21.15.53:0/3136345225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cb980 0x7fca880b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 -- 172.21.15.53:0/3136345225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cb980 msgr2=0x7fca880b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 --2- 172.21.15.53:0/3136345225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cb980 0x7fca880b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 -- 172.21.15.53:0/3136345225 >> v1:172.21.15.87:6789/0 conn(0x7fca880cbd60 legacy=0x7fca8806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 -- 172.21.15.53:0/3136345225 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88159da0 con 0x7fca8806b850 2024-09-13T18:29:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.167+0000 7fca8659c640 1 --2- 172.21.15.53:0/3136345225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca880cdd40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0098a0 tx=0x7fca7c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50189c0dbf2ffc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca85d9b640 1 -- 172.21.15.53:0/3136345225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0ab680 con 0x7fca8806b850 2024-09-13T18:29:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca85d9b640 1 -- 172.21.15.53:0/3136345225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0ab7e0 con 0x7fca8806b850 2024-09-13T18:29:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca85d9b640 1 -- 172.21.15.53:0/3136345225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0abb70 con 0x7fca8806b850 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- 172.21.15.53:0/3136345225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 msgr2=0x7fca880cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/3136345225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca880cdd40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0098a0 tx=0x7fca7c01c480 comp rx=0 tx=0).stop 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- 172.21.15.53:0/3136345225 shutdown_connections 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/3136345225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca880cdd40 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/3136345225 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cb980 0x7fca880b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- 172.21.15.53:0/3136345225 >> 172.21.15.53:0/3136345225 conn(0x7fca88065c80 msgr2=0x7fca88066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- 172.21.15.53:0/3136345225 shutdown_connections 2024-09-13T18:29:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- 172.21.15.53:0/3136345225 wait complete. 2024-09-13T18:29:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 Processor -- start 2024-09-13T18:29:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- start start 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca881f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880cb980 0x7fca88153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cbd60 0x7fca880af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8814b8e0 con 0x7fca8806b850 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88149d00 con 0x7fca880cb980 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8d0a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca880ae800 con 0x7fca880cbd60 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca881f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca881f3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41696/0 (socket says 172.21.15.53:41696) 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 -- 172.21.15.53:0/4260957642 learned_addr learned my addr 172.21.15.53:0/4260957642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8759e640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cbd60 0x7fca880af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8659c640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880cb980 0x7fca88153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 -- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cbd60 msgr2=0x7fca880af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cbd60 0x7fca880af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 -- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880cb980 msgr2=0x7fca88153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880cb980 0x7fca88153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 -- 172.21.15.53:0/4260957642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0094d0 con 0x7fca8806b850 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca8759e640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cbd60 0x7fca880af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.171+0000 7fca86d9d640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca881f3010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fca7800d800 tx=0x7fca7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca6f7fe640 1 -- 172.21.15.53:0/4260957642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800b6c0 con 0x7fca8806b850 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca6f7fe640 1 -- 172.21.15.53:0/4260957642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800b820 con 0x7fca8806b850 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca6f7fe640 1 -- 172.21.15.53:0/4260957642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800bb90 con 0x7fca8806b850 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca880aeae0 con 0x7fca8806b850 2024-09-13T18:29:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca881f3550 con 0x7fca8806b850 2024-09-13T18:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca88067400 con 0x7fca8806b850 2024-09-13T18:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca6f7fe640 1 -- 172.21.15.53:0/4260957642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fca7800bcf0 con 0x7fca8806b850 2024-09-13T18:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca6f7fe640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca740669f0 0x7fca74068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca6f7fe640 1 -- 172.21.15.53:0/4260957642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca78084bd0 con 0x7fca8806b850 2024-09-13T18:29:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca8659c640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca740669f0 0x7fca74068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.175+0000 7fca8659c640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca740669f0 0x7fca74068eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0af000 tx=0x7fca7c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.179+0000 7fca6f7fe640 1 -- 172.21.15.53:0/4260957642 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca78051bc0 con 0x7fca8806b850 2024-09-13T18:29:09.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.339+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca880b2ba0 con 0x7fca8806b850 2024-09-13T18:29:09.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.339+0000 7fca6f7fe640 1 -- 172.21.15.53:0/4260957642 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fca78011340 con 0x7fca8806b850 2024-09-13T18:29:09.346 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:09.346 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":60,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:28:31.841305+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:28:28.459143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:28:29.809417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca740669f0 msgr2=0x7fca74068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca740669f0 0x7fca74068eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0af000 tx=0x7fca7c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 msgr2=0x7fca881f3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca881f3010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fca7800d800 tx=0x7fca7800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 shutdown_connections 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fca740669f0 0x7fca74068eb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca880cbd60 0x7fca880af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca880cb980 0x7fca88153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 --2- 172.21.15.53:0/4260957642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca8806b850 0x7fca881f3010 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 >> 172.21.15.53:0/4260957642 conn(0x7fca88065c80 msgr2=0x7fca880cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 shutdown_connections 2024-09-13T18:29:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.343+0000 7fca8d0a8640 1 -- 172.21.15.53:0/4260957642 wait complete. 2024-09-13T18:29:09.364 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:29:09.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8f6239640 1 Processor -- start 2024-09-13T18:29:09.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8f6239640 1 -- start start 2024-09-13T18:29:09.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8f6239640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8f01582a0 0x7fa8f006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8f6239640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8f00713a0 0x7fa8f006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8f6239640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f006d480 con 0x7fa8f015b7c0 2024-09-13T18:29:09.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8f6239640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f015aaf0 con 0x7fa8f00713a0 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8f6239640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f006d760 con 0x7fa8f01582a0 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8effff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8f00713a0 0x7fa8f006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8effff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8f00713a0 0x7fa8f006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41704/0 (socket says 172.21.15.53:41704) 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8effff640 1 -- 172.21.15.53:0/1295550858 learned_addr learned my addr 172.21.15.53:0/1295550858 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8ef7fe640 1 --2- 172.21.15.53:0/1295550858 >> v2:172.21.15.87:3300/0 conn(0x7fa8f01582a0 0x7fa8f006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8effff640 1 -- 172.21.15.53:0/1295550858 >> v2:172.21.15.87:3300/0 conn(0x7fa8f01582a0 msgr2=0x7fa8f006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8effff640 1 --2- 172.21.15.53:0/1295550858 >> v2:172.21.15.87:3300/0 conn(0x7fa8f01582a0 0x7fa8f006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8effff640 1 -- 172.21.15.53:0/1295550858 >> v1:172.21.15.87:6789/0 conn(0x7fa8f015b7c0 legacy=0x7fa8f0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8effff640 1 -- 172.21.15.53:0/1295550858 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f015ace0 con 0x7fa8f00713a0 2024-09-13T18:29:09.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.471+0000 7fa8ef7fe640 1 --2- 172.21.15.53:0/1295550858 >> v2:172.21.15.87:3300/0 conn(0x7fa8f01582a0 0x7fa8f006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:09.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8effff640 1 --2- 172.21.15.53:0/1295550858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f006ce40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0069f50 tx=0x7fa8e801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546472c8cbc76644 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8ee7fc640 1 -- 172.21.15.53:0/1295550858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a5880 con 0x7fa8f00713a0 2024-09-13T18:29:09.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8ee7fc640 1 -- 172.21.15.53:0/1295550858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80a59e0 con 0x7fa8f00713a0 2024-09-13T18:29:09.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8ee7fc640 1 -- 172.21.15.53:0/1295550858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a5d70 con 0x7fa8f00713a0 2024-09-13T18:29:09.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- 172.21.15.53:0/1295550858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 msgr2=0x7fa8f006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 --2- 172.21.15.53:0/1295550858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f006ce40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0069f50 tx=0x7fa8e801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- 172.21.15.53:0/1295550858 shutdown_connections 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 --2- 172.21.15.53:0/1295550858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f006ce40 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 --2- 172.21.15.53:0/1295550858 >> v2:172.21.15.87:3300/0 conn(0x7fa8f01582a0 0x7fa8f006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- 172.21.15.53:0/1295550858 >> 172.21.15.53:0/1295550858 conn(0x7fa8f0065c80 msgr2=0x7fa8f0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- 172.21.15.53:0/1295550858 shutdown_connections 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- 172.21.15.53:0/1295550858 wait complete. 2024-09-13T18:29:09.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 Processor -- start 2024-09-13T18:29:09.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- start start 2024-09-13T18:29:09.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f013ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f01582a0 0x7fa8f00b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f015b7c0 0x7fa8f0151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f01482e0 con 0x7fa8f00713a0 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00cc3a0 con 0x7fa8f015b7c0 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8f6239640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00b29c0 con 0x7fa8f01582a0 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f013ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f013ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41720/0 (socket says 172.21.15.53:41720) 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.475+0000 7fa8ef7fe640 1 -- 172.21.15.53:0/3653116930 learned_addr learned my addr 172.21.15.53:0/3653116930 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8effff640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f015b7c0 0x7fa8f0151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8ef7fe640 1 -- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f01582a0 msgr2=0x7fa8f00b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8eeffd640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f01582a0 0x7fa8f00b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8ef7fe640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f01582a0 0x7fa8f00b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8ef7fe640 1 -- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f015b7c0 msgr2=0x7fa8f0151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8ef7fe640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f015b7c0 0x7fa8f0151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8ef7fe640 1 -- 172.21.15.53:0/3653116930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8009b30 con 0x7fa8f00713a0 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8effff640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f015b7c0 0x7fa8f0151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8ef7fe640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f013ada0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000e810 tx=0x7fa8e000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8d7fff640 1 -- 172.21.15.53:0/3653116930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000c870 con 0x7fa8f00713a0 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8d7fff640 1 -- 172.21.15.53:0/3653116930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e000c9d0 con 0x7fa8f00713a0 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8d7fff640 1 -- 172.21.15.53:0/3653116930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000cd60 con 0x7fa8f00713a0 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f00b2c20 con 0x7fa8f00713a0 2024-09-13T18:29:09.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f00b31e0 con 0x7fa8f00713a0 2024-09-13T18:29:09.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8d7fff640 1 -- 172.21.15.53:0/3653116930 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fa8e0013410 con 0x7fa8f00713a0 2024-09-13T18:29:09.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f0067400 con 0x7fa8f00713a0 2024-09-13T18:29:09.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8d7fff640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa8dc0669f0 0x7fa8dc068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8d7fff640 1 -- 172.21.15.53:0/3653116930 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8e0084520 con 0x7fa8f00713a0 2024-09-13T18:29:09.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8eeffd640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa8dc0669f0 0x7fa8dc068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.479+0000 7fa8eeffd640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa8dc0669f0 0x7fa8dc068eb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4007fd0 tx=0x7fa8e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.483+0000 7fa8d7fff640 1 -- 172.21.15.53:0/3653116930 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8e00513c0 con 0x7fa8f00713a0 2024-09-13T18:29:09.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.679+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa8f00ca840 con 0x7fa8f00713a0 2024-09-13T18:29:09.686 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:29:09.679+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:29:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8d7fff640 1 -- 172.21.15.53:0/3653116930 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa8e0009480 con 0x7fa8f00713a0 2024-09-13T18:29:09.700 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:29:09.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa8dc0669f0 msgr2=0x7fa8dc068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa8dc0669f0 0x7fa8dc068eb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4007fd0 tx=0x7fa8e4009040 comp rx=0 tx=0).stop 2024-09-13T18:29:09.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 msgr2=0x7fa8f013ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f013ada0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000e810 tx=0x7fa8e000ecd0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 shutdown_connections 2024-09-13T18:29:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa8dc0669f0 0x7fa8dc068eb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f01582a0 0x7fa8f00b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f015b7c0 0x7fa8f0151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 --2- 172.21.15.53:0/3653116930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f00713a0 0x7fa8f013ada0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 >> 172.21.15.53:0/3653116930 conn(0x7fa8f0065c80 msgr2=0x7fa8f00ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 shutdown_connections 2024-09-13T18:29:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.695+0000 7fa8f6239640 1 -- 172.21.15.53:0/3653116930 wait complete. 2024-09-13T18:29:09.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:29:09.751 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:29:09.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 Processor -- start 2024-09-13T18:29:09.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 -- start start 2024-09-13T18:29:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c14156c40 0x7f2c14070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c14157020 0x7f2c1406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2c1406d270 0x7f2c1415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1406d6e0 con 0x7f2c1406d270 2024-09-13T18:29:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c140b15a0 con 0x7f2c14157020 2024-09-13T18:29:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c1a1bf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b1880 con 0x7f2c14156c40 2024-09-13T18:29:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2c1406d270 0x7f2c1415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2c1406d270 0x7f2c1415cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41756/0 (socket says 172.21.15.53:41756) 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 -- 172.21.15.53:0/3929372734 learned_addr learned my addr 172.21.15.53:0/3929372734 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c137fe640 1 --2- 172.21.15.53:0/3929372734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c14156c40 0x7f2c14070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c12ffd640 1 --2- 172.21.15.53:0/3929372734 >> v2:172.21.15.87:3300/0 conn(0x7f2c14157020 0x7f2c1406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 -- 172.21.15.53:0/3929372734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c14156c40 msgr2=0x7f2c14070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 --2- 172.21.15.53:0/3929372734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c14156c40 0x7f2c14070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 -- 172.21.15.53:0/3929372734 >> v2:172.21.15.87:3300/0 conn(0x7f2c14157020 msgr2=0x7f2c1406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 --2- 172.21.15.53:0/3929372734 >> v2:172.21.15.87:3300/0 conn(0x7f2c14157020 0x7f2c1406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.835+0000 7f2c13fff640 1 -- 172.21.15.53:0/3929372734 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140b1b60 con 0x7f2c1406d270 2024-09-13T18:29:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c13fff640 1 --2- 172.21.15.53:0/3929372734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1415cde0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2c14066930 tx=0x7f2c0c01e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84eee482ac3cb4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c127fc640 1 -- 172.21.15.53:0/3929372734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0a7990 con 0x7f2c1406d270 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c127fc640 1 -- 172.21.15.53:0/3929372734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c0a7af0 con 0x7f2c1406d270 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c127fc640 1 -- 172.21.15.53:0/3929372734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0a7e80 con 0x7f2c1406d270 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/3929372734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 msgr2=0x7f2c1415cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/3929372734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1415cde0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2c14066930 tx=0x7f2c0c01e900 comp rx=0 tx=0).stop 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/3929372734 shutdown_connections 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/3929372734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1415cde0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/3929372734 >> v2:172.21.15.87:3300/0 conn(0x7f2c14157020 0x7f2c1406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/3929372734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c14156c40 0x7f2c14070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/3929372734 >> 172.21.15.53:0/3929372734 conn(0x7f2c14065c80 msgr2=0x7f2c14066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/3929372734 shutdown_connections 2024-09-13T18:29:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/3929372734 wait complete. 2024-09-13T18:29:09.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 Processor -- start 2024-09-13T18:29:09.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- start start 2024-09-13T18:29:09.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c14156c40 0x7f2c1414d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c140ac8e0 0x7f2c140acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c141403a0 con 0x7f2c1406d270 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140ad2d0 con 0x7f2c14156c40 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140ae820 con 0x7f2c140ac8e0 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1413fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41762/0 (socket says 172.21.15.53:41762) 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 -- 172.21.15.53:0/830625315 learned_addr learned my addr 172.21.15.53:0/830625315 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c12ffd640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c14156c40 0x7f2c1414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c13fff640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c140ac8e0 0x7f2c140acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 -- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c140ac8e0 msgr2=0x7f2c140acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c140ac8e0 0x7f2c140acd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 -- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c14156c40 msgr2=0x7f2c1414d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c14156c40 0x7f2c1414d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 -- 172.21.15.53:0/830625315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c00b770 con 0x7f2c1406d270 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c137fe640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1413fe60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800d860 tx=0x7f2c0800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2bfbfff640 1 -- 172.21.15.53:0/830625315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800de50 con 0x7f2c1406d270 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2bfbfff640 1 -- 172.21.15.53:0/830625315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800b8d0 con 0x7f2c1406d270 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c14151cd0 con 0x7f2c1406d270 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2bfbfff640 1 -- 172.21.15.53:0/830625315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800bc40 con 0x7f2c1406d270 2024-09-13T18:29:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.839+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c140ae1d0 con 0x7f2c1406d270 2024-09-13T18:29:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.843+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1415cde0 con 0x7f2c1406d270 2024-09-13T18:29:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.843+0000 7f2bfbfff640 1 -- 172.21.15.53:0/830625315 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f2c0801e460 con 0x7f2c1406d270 2024-09-13T18:29:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.843+0000 7f2bfbfff640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c00066a20 0x7f2c00068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.843+0000 7f2bfbfff640 1 -- 172.21.15.53:0/830625315 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2c08084c00 con 0x7f2c1406d270 2024-09-13T18:29:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.843+0000 7f2c12ffd640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c00066a20 0x7f2c00068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.843+0000 7f2c12ffd640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c00066a20 0x7f2c00068ee0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2c04003fd0 tx=0x7f2c04003ce0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:09.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:09.847+0000 7f2bfbfff640 1 -- 172.21.15.53:0/830625315 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c08051b00 con 0x7f2c1406d270 2024-09-13T18:29:10.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.035+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2c1406feb0 con 0x7f2c1406d270 2024-09-13T18:29:10.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.695+0000 7f2bfbfff640 1 -- 172.21.15.53:0/830625315 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2c08055120 con 0x7f2c1406d270 2024-09-13T18:29:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c00066a20 msgr2=0x7f2c00068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c00066a20 0x7f2c00068ee0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2c04003fd0 tx=0x7f2c04003ce0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 msgr2=0x7f2c1413fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1413fe60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800d860 tx=0x7f2c0800dd20 comp rx=0 tx=0).stop 2024-09-13T18:29:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 shutdown_connections 2024-09-13T18:29:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2c00066a20 0x7f2c00068ee0 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2c04003fd0 tx=0x7f2c04003ce0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2c140ac8e0 0x7f2c140acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c14156c40 0x7f2c1414d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 --2- 172.21.15.53:0/830625315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c1406d270 0x7f2c1413fe60 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.699+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 >> 172.21.15.53:0/830625315 conn(0x7f2c14065c80 msgr2=0x7f2c1406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.703+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 shutdown_connections 2024-09-13T18:29:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.703+0000 7f2c1a1bf640 1 -- 172.21.15.53:0/830625315 wait complete. 2024-09-13T18:29:10.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:29:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e1434e640 1 Processor -- start 2024-09-13T18:29:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e1434e640 1 -- start start 2024-09-13T18:29:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e1434e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e0c0cd6f0 0x7f8e0c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e1434e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e1434e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0b3020 con 0x7f8e0c143d50 2024-09-13T18:29:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e1434e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c0b1f80 con 0x7f8e0c0cd6f0 2024-09-13T18:29:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e1434e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0b2260 con 0x7f8e0c0cdad0 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e120ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e0c0cd6f0 0x7f8e0c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e128eb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8e0c143d50 0x7f8e0c15dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59610/0 (socket says 172.21.15.53:59610) 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e128eb640 1 -- 172.21.15.53:0/1144109015 learned_addr learned my addr 172.21.15.53:0/1144109015 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e118e9640 1 --2- 172.21.15.53:0/1144109015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e120ea640 1 -- 172.21.15.53:0/1144109015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 msgr2=0x7f8e0c143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e120ea640 1 --2- 172.21.15.53:0/1144109015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e120ea640 1 -- 172.21.15.53:0/1144109015 >> v1:172.21.15.53:6789/0 conn(0x7f8e0c143d50 legacy=0x7f8e0c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e120ea640 1 -- 172.21.15.53:0/1144109015 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0b2540 con 0x7f8e0c0cd6f0 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e110e8640 1 -- 172.21.15.53:0/1144109015 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531825725 0 0) 0x7f8e0c0b3020 con 0x7f8e0c143d50 2024-09-13T18:29:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.907+0000 7f8e118e9640 1 --2- 172.21.15.53:0/1144109015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e120ea640 1 --2- 172.21.15.53:0/1144109015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c0b1490 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8e080097c0 tx=0x7f8e0801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05f167f04022f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e110e8640 1 -- 172.21.15.53:0/1144109015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e080ab600 con 0x7f8e0c0cd6f0 2024-09-13T18:29:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e110e8640 1 -- 172.21.15.53:0/1144109015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e080a7050 con 0x7f8e0c0cd6f0 2024-09-13T18:29:10.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e110e8640 1 -- 172.21.15.53:0/1144109015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e080ab980 con 0x7f8e0c0cd6f0 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 -- 172.21.15.53:0/1144109015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c0cd6f0 msgr2=0x7f8e0c0b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 --2- 172.21.15.53:0/1144109015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c0b1490 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8e080097c0 tx=0x7f8e0801c470 comp rx=0 tx=0).stop 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 -- 172.21.15.53:0/1144109015 shutdown_connections 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 --2- 172.21.15.53:0/1144109015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 --2- 172.21.15.53:0/1144109015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c0b1490 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 -- 172.21.15.53:0/1144109015 >> 172.21.15.53:0/1144109015 conn(0x7f8e0c073330 msgr2=0x7f8e0c065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 -- 172.21.15.53:0/1144109015 shutdown_connections 2024-09-13T18:29:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.911+0000 7f8e1434e640 1 -- 172.21.15.53:0/1144109015 wait complete. 2024-09-13T18:29:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 Processor -- start 2024-09-13T18:29:10.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 -- start start 2024-09-13T18:29:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c0aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c143d50 0x7f8e0c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0ac300 con 0x7f8e0c143d50 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0a90c0 con 0x7f8e0c0cd6f0 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0a93a0 con 0x7f8e0c0cdad0 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c143d50 0x7f8e0c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c143d50 0x7f8e0c0ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41778/0 (socket says 172.21.15.53:41778) 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 -- 172.21.15.53:0/3422355697 learned_addr learned my addr 172.21.15.53:0/3422355697 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e118e9640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c0aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e120ea640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 -- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 msgr2=0x7f8e0c0aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c0aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 -- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0cd6f0 msgr2=0x7f8e0c15acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c15acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 -- 172.21.15.53:0/3422355697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08009420 con 0x7f8e0c143d50 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e118e9640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c0aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e120ea640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c15acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e128eb640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c143d50 0x7f8e0c0ab400 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8e04001570 tx=0x7f8e0400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e02ffd640 1 -- 172.21.15.53:0/3422355697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400a640 con 0x7f8e0c143d50 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e02ffd640 1 -- 172.21.15.53:0/3422355697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0400a7c0 con 0x7f8e0c143d50 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c0a9680 con 0x7f8e0c143d50 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e02ffd640 1 -- 172.21.15.53:0/3422355697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400ab70 con 0x7f8e0c143d50 2024-09-13T18:29:10.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c1413d0 con 0x7f8e0c143d50 2024-09-13T18:29:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c1415f0 con 0x7f8e0c143d50 2024-09-13T18:29:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e02ffd640 1 -- 172.21.15.53:0/3422355697 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f8e0400acd0 con 0x7f8e0c143d50 2024-09-13T18:29:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e02ffd640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8df00669f0 0x7f8df0068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.915+0000 7f8e02ffd640 1 -- 172.21.15.53:0/3422355697 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8e040840d0 con 0x7f8e0c143d50 2024-09-13T18:29:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.919+0000 7f8e120ea640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8df00669f0 0x7f8df0068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.919+0000 7f8e120ea640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8df00669f0 0x7f8df0068eb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8e080ad000 tx=0x7f8e08008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:10.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:10.919+0000 7f8e02ffd640 1 -- 172.21.15.53:0/3422355697 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e04050ed0 con 0x7f8e0c143d50 2024-09-13T18:29:11.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.083+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e0c0b1490 con 0x7f8e0c143d50 2024-09-13T18:29:11.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.703+0000 7f8e02ffd640 1 -- 172.21.15.53:0/3422355697 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e040544f0 con 0x7f8e0c143d50 2024-09-13T18:29:11.709 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:29:11.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8df00669f0 msgr2=0x7f8df0068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8df00669f0 0x7f8df0068eb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8e080ad000 tx=0x7f8e08008040 comp rx=0 tx=0).stop 2024-09-13T18:29:11.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c143d50 msgr2=0x7f8e0c0ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c143d50 0x7f8e0c0ab400 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8e04001570 tx=0x7f8e0400cca0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 shutdown_connections 2024-09-13T18:29:11.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8df00669f0 0x7f8df0068eb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e0c0cdad0 0x7f8e0c0aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e0c143d50 0x7f8e0c0ab400 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 --2- 172.21.15.53:0/3422355697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e0c0cd6f0 0x7f8e0c15acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 >> 172.21.15.53:0/3422355697 conn(0x7f8e0c073330 msgr2=0x7f8e0c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:11.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 shutdown_connections 2024-09-13T18:29:11.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.707+0000 7f8e1434e640 1 -- 172.21.15.53:0/3422355697 wait complete. 2024-09-13T18:29:11.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:29:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec875c2640 1 Processor -- start 2024-09-13T18:29:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec875c2640 1 -- start start 2024-09-13T18:29:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec875c2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 0x7fec800b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec875c2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fec800cdad0 0x7fec80143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec875c2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800b3020 con 0x7fec80143d50 2024-09-13T18:29:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec875c2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec800b1f80 con 0x7fec800cdad0 2024-09-13T18:29:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec875c2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800b2260 con 0x7fec800cd6f0 2024-09-13T18:29:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec85b5f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fec80143d50 0x7fec8015dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59622/0 (socket says 172.21.15.53:59622) 2024-09-13T18:29:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec85b5f640 1 -- 172.21.15.53:0/4090467591 learned_addr learned my addr 172.21.15.53:0/4090467591 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec84b5d640 1 --2- 172.21.15.53:0/4090467591 >> v2:172.21.15.87:3300/0 conn(0x7fec800cdad0 0x7fec80143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec8535e640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 0x7fec800b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915481587 0 0) 0x7fec800b3020 con 0x7fec80143d50 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec6c003530 con 0x7fec80143d50 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858268917 0 0) 0x7fec6c003530 con 0x7fec80143d50 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 msgr2=0x7fec800b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 0x7fec800b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 >> v2:172.21.15.87:3300/0 conn(0x7fec800cdad0 msgr2=0x7fec80143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 --2- 172.21.15.53:0/4090467591 >> v2:172.21.15.87:3300/0 conn(0x7fec800cdad0 0x7fec80143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800b2540 con 0x7fec80143d50 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fec78001a00 con 0x7fec80143d50 2024-09-13T18:29:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 >> v1:172.21.15.53:6789/0 conn(0x7fec80143d50 legacy=0x7fec8015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c003980 0x7fec6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c0047d0 0x7fec6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 0x7fec6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800b1f80 con 0x7fec6c003980 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800b2260 con 0x7fec6c0047d0 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c00b990 con 0x7fec800cd6f0 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec8535e640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c003980 0x7fec6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec84b5d640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c0047d0 0x7fec6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec85b5f640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 0x7fec6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec8535e640 1 -- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 msgr2=0x7fec6c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec8535e640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800cd6f0 0x7fec6c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec8535e640 1 -- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c0047d0 msgr2=0x7fec6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec8535e640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c0047d0 0x7fec6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec8535e640 1 -- 172.21.15.53:0/4090467591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c003530 con 0x7fec6c003980 2024-09-13T18:29:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.871+0000 7fec84b5d640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c0047d0 0x7fec6c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec8535e640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c003980 0x7fec6c003da0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009ae0 tx=0x7fec7c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7385fdbaf5cc742 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0a6450 con 0x7fec6c003980 2024-09-13T18:29:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0a65b0 con 0x7fec6c003980 2024-09-13T18:29:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec73fff640 1 -- 172.21.15.53:0/4090467591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0a6960 con 0x7fec6c003980 2024-09-13T18:29:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec875c2640 1 -- 172.21.15.53:0/4090467591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c003980 msgr2=0x7fec6c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec875c2640 1 --2- 172.21.15.53:0/4090467591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c003980 0x7fec6c003da0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009ae0 tx=0x7fec7c01ca40 comp rx=0 tx=0).stop 2024-09-13T18:29:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec85b5f640 1 -- 172.21.15.53:0/4090467591 reap_dead start 2024-09-13T18:29:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec875c2640 1 -- 172.21.15.53:0/4090467591 shutdown_connections 2024-09-13T18:29:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec875c2640 1 -- 172.21.15.53:0/4090467591 >> 172.21.15.53:0/4090467591 conn(0x7fec80073330 msgr2=0x7fec80065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec875c2640 1 -- 172.21.15.53:0/4090467591 shutdown_connections 2024-09-13T18:29:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec875c2640 1 -- 172.21.15.53:0/4090467591 wait complete. 2024-09-13T18:29:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.875+0000 7fec875c2640 1 Processor -- start 2024-09-13T18:29:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 -- start start 2024-09-13T18:29:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c003980 0x7fec80159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800afc20 0x7fec800b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec801347b0 0x7fec80134c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80132fb0 con 0x7fec801347b0 2024-09-13T18:29:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec801326e0 con 0x7fec6c003980 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800b05e0 con 0x7fec800afc20 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec801347b0 0x7fec80134c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec801347b0 0x7fec80134c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41800/0 (socket says 172.21.15.53:41800) 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 -- 172.21.15.53:0/1251508802 learned_addr learned my addr 172.21.15.53:0/1251508802 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec8535e640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c003980 0x7fec80159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec84b5d640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800afc20 0x7fec800b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 -- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800afc20 msgr2=0x7fec800b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800afc20 0x7fec800b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 -- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c003980 msgr2=0x7fec80159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c003980 0x7fec80159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 -- 172.21.15.53:0/1251508802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80135bd0 con 0x7fec801347b0 2024-09-13T18:29:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec8535e640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c003980 0x7fec80159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec85b5f640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec801347b0 0x7fec80134c30 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fec800ce380 tx=0x7fec7800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec71ffb640 1 -- 172.21.15.53:0/1251508802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800eb90 con 0x7fec801347b0 2024-09-13T18:29:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec71ffb640 1 -- 172.21.15.53:0/1251508802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7800ecf0 con 0x7fec801347b0 2024-09-13T18:29:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec80135510 con 0x7fec801347b0 2024-09-13T18:29:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec71ffb640 1 -- 172.21.15.53:0/1251508802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78013660 con 0x7fec801347b0 2024-09-13T18:29:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec80132bd0 con 0x7fec801347b0 2024-09-13T18:29:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec801330f0 con 0x7fec801347b0 2024-09-13T18:29:11.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec71ffb640 1 -- 172.21.15.53:0/1251508802 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fec780137c0 con 0x7fec801347b0 2024-09-13T18:29:11.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec71ffb640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec64066a20 0x7fec64068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:11.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.879+0000 7fec71ffb640 1 -- 172.21.15.53:0/1251508802 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fec780848f0 con 0x7fec801347b0 2024-09-13T18:29:11.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.883+0000 7fec8535e640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec64066a20 0x7fec64068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:11.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.883+0000 7fec8535e640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec64066a20 0x7fec64068ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0ad000 tx=0x7fec7c0b2040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:11.887+0000 7fec71ffb640 1 -- 172.21.15.53:0/1251508802 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec801330f0 con 0x7fec801347b0 2024-09-13T18:29:12.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.047+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec80132d90 con 0x7fec801347b0 2024-09-13T18:29:12.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.715+0000 7fec71ffb640 1 -- 172.21.15.53:0/1251508802 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7fec780519b0 con 0x7fec801347b0 2024-09-13T18:29:12.721 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:29:12.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec64066a20 msgr2=0x7fec64068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec64066a20 0x7fec64068ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0ad000 tx=0x7fec7c0b2040 comp rx=0 tx=0).stop 2024-09-13T18:29:12.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec801347b0 msgr2=0x7fec80134c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec801347b0 0x7fec80134c30 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fec800ce380 tx=0x7fec7800e530 comp rx=0 tx=0).stop 2024-09-13T18:29:12.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 shutdown_connections 2024-09-13T18:29:12.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fec64066a20 0x7fec64068ee0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec800afc20 0x7fec800b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec801347b0 0x7fec80134c30 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 --2- 172.21.15.53:0/1251508802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c003980 0x7fec80159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 >> 172.21.15.53:0/1251508802 conn(0x7fec80073330 msgr2=0x7fec800b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 shutdown_connections 2024-09-13T18:29:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.719+0000 7fec875c2640 1 -- 172.21.15.53:0/1251508802 wait complete. 2024-09-13T18:29:12.749 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:29:12.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.871+0000 7fddd1af9640 1 Processor -- start 2024-09-13T18:29:12.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddd1af9640 1 -- start start 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddd1af9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fddcc143e80 0x7fddcc06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddd1af9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fddcc0caee0 0x7fddcc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddd1af9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc06f7a0 con 0x7fddcc0cd320 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddd1af9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc06fd60 con 0x7fddcc0caee0 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddd1af9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0cb960 con 0x7fddcc143e80 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fddcc0caee0 0x7fddcc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fddcc0caee0 0x7fddcc0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41814/0 (socket says 172.21.15.53:41814) 2024-09-13T18:29:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 -- 172.21.15.53:0/2788781486 learned_addr learned my addr 172.21.15.53:0/2788781486 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcb7fe640 1 --2- 172.21.15.53:0/2788781486 >> v2:172.21.15.87:3300/0 conn(0x7fddcc143e80 0x7fddcc06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 -- 172.21.15.53:0/2788781486 >> v2:172.21.15.87:3300/0 conn(0x7fddcc143e80 msgr2=0x7fddcc06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 --2- 172.21.15.53:0/2788781486 >> v2:172.21.15.87:3300/0 conn(0x7fddcc143e80 0x7fddcc06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 -- 172.21.15.53:0/2788781486 >> v1:172.21.15.87:6789/0 conn(0x7fddcc0cd320 legacy=0x7fddcc0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 -- 172.21.15.53:0/2788781486 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0cbc40 con 0x7fddcc0caee0 2024-09-13T18:29:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcb7fe640 1 --2- 172.21.15.53:0/2788781486 >> v2:172.21.15.87:3300/0 conn(0x7fddcc143e80 0x7fddcc06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddcaffd640 1 --2- 172.21.15.53:0/2788781486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0caee0 0x7fddcc0cb350 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009870 tx=0x7fddc001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff2d4507ed90061 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddca7fc640 1 -- 172.21.15.53:0/2788781486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00ab600 con 0x7fddcc0caee0 2024-09-13T18:29:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddca7fc640 1 -- 172.21.15.53:0/2788781486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc00ab760 con 0x7fddcc0caee0 2024-09-13T18:29:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.875+0000 7fddca7fc640 1 -- 172.21.15.53:0/2788781486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00abaf0 con 0x7fddcc0caee0 2024-09-13T18:29:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- 172.21.15.53:0/2788781486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0caee0 msgr2=0x7fddcc0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 --2- 172.21.15.53:0/2788781486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0caee0 0x7fddcc0cb350 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009870 tx=0x7fddc001c420 comp rx=0 tx=0).stop 2024-09-13T18:29:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- 172.21.15.53:0/2788781486 shutdown_connections 2024-09-13T18:29:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 --2- 172.21.15.53:0/2788781486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0caee0 0x7fddcc0cb350 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 --2- 172.21.15.53:0/2788781486 >> v2:172.21.15.87:3300/0 conn(0x7fddcc143e80 0x7fddcc06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- 172.21.15.53:0/2788781486 >> 172.21.15.53:0/2788781486 conn(0x7fddcc065c80 msgr2=0x7fddcc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- 172.21.15.53:0/2788781486 shutdown_connections 2024-09-13T18:29:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- 172.21.15.53:0/2788781486 wait complete. 2024-09-13T18:29:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 Processor -- start 2024-09-13T18:29:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- start start 2024-09-13T18:29:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddcc0caee0 0x7fddcc0b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0cd320 0x7fddcc0aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddcc143e80 0x7fddcc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b0350 con 0x7fddcc0cd320 2024-09-13T18:29:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0af6d0 con 0x7fddcc0caee0 2024-09-13T18:29:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0af9b0 con 0x7fddcc143e80 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0cd320 0x7fddcc0aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0cd320 0x7fddcc0aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41826/0 (socket says 172.21.15.53:41826) 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 -- 172.21.15.53:0/1253449169 learned_addr learned my addr 172.21.15.53:0/1253449169 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcb7fe640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddcc0caee0 0x7fddcc0b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcbfff640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddcc143e80 0x7fddcc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 -- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddcc143e80 msgr2=0x7fddcc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddcc143e80 0x7fddcc0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 -- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddcc0caee0 msgr2=0x7fddcc0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddcc0caee0 0x7fddcc0b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 -- 172.21.15.53:0/1253449169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00094d0 con 0x7fddcc0cd320 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddcaffd640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0cd320 0x7fddcc0aeae0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fddc00ad040 tx=0x7fddc001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddb3fff640 1 -- 172.21.15.53:0/1253449169 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00b4800 con 0x7fddcc0cd320 2024-09-13T18:29:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddb3fff640 1 -- 172.21.15.53:0/1253449169 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc00b4980 con 0x7fddcc0cd320 2024-09-13T18:29:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddb3fff640 1 -- 172.21.15.53:0/1253449169 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00b4d30 con 0x7fddcc0cd320 2024-09-13T18:29:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0afc90 con 0x7fddcc0cd320 2024-09-13T18:29:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.879+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc0af330 con 0x7fddcc0cd320 2024-09-13T18:29:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.883+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc0b0490 con 0x7fddcc0cd320 2024-09-13T18:29:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.883+0000 7fddb3fff640 1 -- 172.21.15.53:0/1253449169 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fddc00b3380 con 0x7fddcc0cd320 2024-09-13T18:29:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.883+0000 7fddb3fff640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fddb80669f0 0x7fddb8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.883+0000 7fddb3fff640 1 -- 172.21.15.53:0/1253449169 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fddc011ebe0 con 0x7fddcc0cd320 2024-09-13T18:29:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.883+0000 7fddcb7fe640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fddb80669f0 0x7fddb8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.883+0000 7fddcb7fe640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fddb80669f0 0x7fddb8068eb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:12.887+0000 7fddb3fff640 1 -- 172.21.15.53:0/1253449169 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fddcc0b0490 con 0x7fddcc0cd320 2024-09-13T18:29:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.047+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fddcc0b0490 con 0x7fddcc0cd320 2024-09-13T18:29:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.051+0000 7fddb3fff640 1 -- 172.21.15.53:0/1253449169 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fddcc0b0490 con 0x7fddcc0cd320 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.051+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fddb80669f0 msgr2=0x7fddb8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.051+0000 7fddd1af9640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fddb80669f0 0x7fddb8068eb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc008040 comp rx=0 tx=0).stop 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.051+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0cd320 msgr2=0x7fddcc0aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.051+0000 7fddd1af9640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0cd320 0x7fddcc0aeae0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fddc00ad040 tx=0x7fddc001ac60 comp rx=0 tx=0).stop 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 shutdown_connections 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fddb80669f0 0x7fddb8068eb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fddcc143e80 0x7fddcc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddcc0cd320 0x7fddcc0aeae0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 --2- 172.21.15.53:0/1253449169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fddcc0caee0 0x7fddcc0b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 >> 172.21.15.53:0/1253449169 conn(0x7fddcc065c80 msgr2=0x7fddcc15cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 shutdown_connections 2024-09-13T18:29:13.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.055+0000 7fddd1af9640 1 -- 172.21.15.53:0/1253449169 wait complete. 2024-09-13T18:29:13.077 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-13T18:29:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb69779b640 1 Processor -- start 2024-09-13T18:29:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb69779b640 1 -- start start 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb69779b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015a470 0x7fb6900cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb69779b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb69015cc60 0x7fb690071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb69779b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69006f550 con 0x7fb6900b1c10 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb69779b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69006f880 con 0x7fb69015cc60 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb69779b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015dc40 con 0x7fb69015a470 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb694d36640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb69015cc60 0x7fb690071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb694d36640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb69015cc60 0x7fb690071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41842/0 (socket says 172.21.15.53:41842) 2024-09-13T18:29:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb694d36640 1 -- 172.21.15.53:0/1765277885 learned_addr learned my addr 172.21.15.53:0/1765277885 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb695537640 1 --2- 172.21.15.53:0/1765277885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015a470 0x7fb6900cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb694d36640 1 -- 172.21.15.53:0/1765277885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015a470 msgr2=0x7fb6900cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb694d36640 1 --2- 172.21.15.53:0/1765277885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015a470 0x7fb6900cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb694d36640 1 -- 172.21.15.53:0/1765277885 >> v1:172.21.15.87:6789/0 conn(0x7fb6900b1c10 legacy=0x7fb69006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb694d36640 1 -- 172.21.15.53:0/1765277885 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900715a0 con 0x7fb69015cc60 2024-09-13T18:29:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.195+0000 7fb695537640 1 --2- 172.21.15.53:0/1765277885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015a470 0x7fb6900cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb694d36640 1 --2- 172.21.15.53:0/1765277885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69015cc60 0x7fb690071060 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb684009870 tx=0x7fb68401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cd305c5b12b6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb68ffff640 1 -- 172.21.15.53:0/1765277885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840a9620 con 0x7fb69015cc60 2024-09-13T18:29:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb68ffff640 1 -- 172.21.15.53:0/1765277885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6840a9780 con 0x7fb69015cc60 2024-09-13T18:29:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb68ffff640 1 -- 172.21.15.53:0/1765277885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840a9b10 con 0x7fb69015cc60 2024-09-13T18:29:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 -- 172.21.15.53:0/1765277885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69015cc60 msgr2=0x7fb690071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 --2- 172.21.15.53:0/1765277885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69015cc60 0x7fb690071060 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb684009870 tx=0x7fb68401c560 comp rx=0 tx=0).stop 2024-09-13T18:29:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 -- 172.21.15.53:0/1765277885 shutdown_connections 2024-09-13T18:29:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 --2- 172.21.15.53:0/1765277885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb69015cc60 0x7fb690071060 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 --2- 172.21.15.53:0/1765277885 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015a470 0x7fb6900cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 -- 172.21.15.53:0/1765277885 >> 172.21.15.53:0/1765277885 conn(0x7fb690065c80 msgr2=0x7fb690066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 -- 172.21.15.53:0/1765277885 shutdown_connections 2024-09-13T18:29:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 -- 172.21.15.53:0/1765277885 wait complete. 2024-09-13T18:29:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 Processor -- start 2024-09-13T18:29:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.199+0000 7fb69779b640 1 -- start start 2024-09-13T18:29:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6900b1c10 0x7fb69014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69015a470 0x7fb69015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015cc60 0x7fb69015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69014be10 con 0x7fb6900b1c10 2024-09-13T18:29:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb690158820 con 0x7fb69015a470 2024-09-13T18:29:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb690158b00 con 0x7fb69015cc60 2024-09-13T18:29:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6900b1c10 0x7fb69014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6900b1c10 0x7fb69014b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41852/0 (socket says 172.21.15.53:41852) 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 -- 172.21.15.53:0/1176780605 learned_addr learned my addr 172.21.15.53:0/1176780605 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb694d36640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69015a470 0x7fb69015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695d38640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015cc60 0x7fb69015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 -- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015cc60 msgr2=0x7fb69015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015cc60 0x7fb69015be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 -- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69015a470 msgr2=0x7fb69015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69015a470 0x7fb69015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 -- 172.21.15.53:0/1176780605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840094d0 con 0x7fb6900b1c10 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb695537640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6900b1c10 0x7fb69014b8d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c7c0 tx=0x7fb68800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb68dffb640 1 -- 172.21.15.53:0/1176780605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688007a30 con 0x7fb6900b1c10 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb68dffb640 1 -- 172.21.15.53:0/1176780605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688007b90 con 0x7fb6900b1c10 2024-09-13T18:29:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb690158de0 con 0x7fb6900b1c10 2024-09-13T18:29:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb68dffb640 1 -- 172.21.15.53:0/1176780605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800ce70 con 0x7fb6900b1c10 2024-09-13T18:29:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6901593a0 con 0x7fb6900b1c10 2024-09-13T18:29:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb690067400 con 0x7fb6900b1c10 2024-09-13T18:29:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb68dffb640 1 -- 172.21.15.53:0/1176780605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fb6880113f0 con 0x7fb6900b1c10 2024-09-13T18:29:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb68dffb640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb67c0669f0 0x7fb67c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb68dffb640 1 -- 172.21.15.53:0/1176780605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb6880849f0 con 0x7fb6900b1c10 2024-09-13T18:29:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.203+0000 7fb694d36640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb67c0669f0 0x7fb67c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.207+0000 7fb694d36640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb67c0669f0 0x7fb67c068eb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb6840ae000 tx=0x7fb6840b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.207+0000 7fb68dffb640 1 -- 172.21.15.53:0/1176780605 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb688051cd0 con 0x7fb6900b1c10 2024-09-13T18:29:13.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.427+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fb6900cc270 con 0x7fb6900b1c10 2024-09-13T18:29:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.719+0000 7fb68dffb640 1 -- 172.21.15.53:0/1176780605 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v234) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb6880552f0 con 0x7fb6900b1c10 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb67c0669f0 msgr2=0x7fb67c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb67c0669f0 0x7fb67c068eb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb6840ae000 tx=0x7fb6840b3040 comp rx=0 tx=0).stop 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6900b1c10 msgr2=0x7fb69014b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6900b1c10 0x7fb69014b8d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c7c0 tx=0x7fb68800cc80 comp rx=0 tx=0).stop 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 shutdown_connections 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb67c0669f0 0x7fb67c068eb0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb69015cc60 0x7fb69015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb69015a470 0x7fb69015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 --2- 172.21.15.53:0/1176780605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6900b1c10 0x7fb69014b8d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 >> 172.21.15.53:0/1176780605 conn(0x7fb690065c80 msgr2=0x7fb690066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 shutdown_connections 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.723+0000 7fb69779b640 1 -- 172.21.15.53:0/1176780605 wait complete. 2024-09-13T18:29:13.751 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ok 2024-09-13T18:29:13.752 INFO:tasks.cephfs_test_runner:Starting test: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:29:13.752 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:13.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a3ddbc640 1 Processor -- start 2024-09-13T18:29:13.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a3ddbc640 1 -- start start 2024-09-13T18:29:13.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a3ddbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5a380cbd60 0x7f5a380b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a3ddbc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a380b1ac0 con 0x7f5a380cb980 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a3ddbc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a38159ac0 con 0x7f5a3806b850 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a3ddbc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a38159da0 con 0x7f5a380cbd60 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a377fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5a380cb980 0x7f5a3806fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59630/0 (socket says 172.21.15.53:59630) 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a377fe640 1 -- 172.21.15.53:0/589944187 learned_addr learned my addr 172.21.15.53:0/589944187 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a37fff640 1 --2- 172.21.15.53:0/589944187 >> v2:172.21.15.53:3300/0 conn(0x7f5a380cbd60 0x7f5a380b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a36ffd640 1 -- 172.21.15.53:0/589944187 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475064252 0 0) 0x7f5a380b1ac0 con 0x7f5a380cb980 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a36ffd640 1 -- 172.21.15.53:0/589944187 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a24003530 con 0x7f5a380cb980 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a37fff640 1 -- 172.21.15.53:0/589944187 >> v1:172.21.15.87:6789/0 conn(0x7f5a3806b850 legacy=0x7f5a380b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a37fff640 1 -- 172.21.15.53:0/589944187 >> v1:172.21.15.53:6789/0 conn(0x7f5a380cb980 legacy=0x7f5a3806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.887+0000 7f5a37fff640 1 -- 172.21.15.53:0/589944187 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3815a080 con 0x7f5a380cbd60 2024-09-13T18:29:13.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a37fff640 1 --2- 172.21.15.53:0/589944187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a380cbd60 0x7f5a380b33b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009d90 tx=0x7f5a3001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97eeb59411eda02b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a36ffd640 1 -- 172.21.15.53:0/589944187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a58e0 con 0x7f5a380cbd60 2024-09-13T18:29:13.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a36ffd640 1 -- 172.21.15.53:0/589944187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300a5a40 con 0x7f5a380cbd60 2024-09-13T18:29:13.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a36ffd640 1 -- 172.21.15.53:0/589944187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a5dd0 con 0x7f5a380cbd60 2024-09-13T18:29:13.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/589944187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a380cbd60 msgr2=0x7f5a380b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/589944187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a380cbd60 0x7f5a380b33b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009d90 tx=0x7f5a3001c820 comp rx=0 tx=0).stop 2024-09-13T18:29:13.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/589944187 shutdown_connections 2024-09-13T18:29:13.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/589944187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a380cbd60 0x7f5a380b33b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/589944187 >> 172.21.15.53:0/589944187 conn(0x7f5a38065c80 msgr2=0x7f5a38066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/589944187 shutdown_connections 2024-09-13T18:29:13.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/589944187 wait complete. 2024-09-13T18:29:13.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 Processor -- start 2024-09-13T18:29:13.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- start start 2024-09-13T18:29:13.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a3806b850 0x7f5a38145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a380cb980 0x7f5a38154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380cbd60 0x7f5a380af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a38145f40 con 0x7f5a3806b850 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381519a0 con 0x7f5a380cbd60 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a3ddbc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a38151c80 con 0x7f5a380cb980 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a3806b850 0x7f5a38145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a3806b850 0x7f5a38145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41860/0 (socket says 172.21.15.53:41860) 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.891+0000 7f5a377fe640 1 -- 172.21.15.53:0/2064998802 learned_addr learned my addr 172.21.15.53:0/2064998802 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a2ffff640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a380cb980 0x7f5a38154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a37fff640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380cbd60 0x7f5a380af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a377fe640 1 -- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a380cb980 msgr2=0x7f5a38154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a377fe640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a380cb980 0x7f5a38154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a377fe640 1 -- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380cbd60 msgr2=0x7f5a380af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a377fe640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380cbd60 0x7f5a380af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a377fe640 1 -- 172.21.15.53:0/2064998802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009a70 con 0x7f5a3806b850 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a37fff640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380cbd60 0x7f5a380af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a2ffff640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a380cb980 0x7f5a38154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a377fe640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a3806b850 0x7f5a38145a00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c4d0 tx=0x7f5a2800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a34ff9640 1 -- 172.21.15.53:0/2064998802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28005cf0 con 0x7f5a3806b850 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a34ff9640 1 -- 172.21.15.53:0/2064998802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28005e50 con 0x7f5a3806b850 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a38151f60 con 0x7f5a3806b850 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a34ff9640 1 -- 172.21.15.53:0/2064998802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28007270 con 0x7f5a3806b850 2024-09-13T18:29:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a38152520 con 0x7f5a3806b850 2024-09-13T18:29:13.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a38067400 con 0x7f5a3806b850 2024-09-13T18:29:13.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a34ff9640 1 -- 172.21.15.53:0/2064998802 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f5a280073d0 con 0x7f5a3806b850 2024-09-13T18:29:13.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a34ff9640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a18066a20 0x7f5a18068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a34ff9640 1 -- 172.21.15.53:0/2064998802 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5a28083a20 con 0x7f5a3806b850 2024-09-13T18:29:13.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.895+0000 7f5a2ffff640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a18066a20 0x7f5a18068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.899+0000 7f5a2ffff640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a18066a20 0x7f5a18068ee0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5a380ada70 tx=0x7f5a20009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:13.899+0000 7f5a34ff9640 1 -- 172.21.15.53:0/2064998802 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5a28054740 con 0x7f5a3806b850 2024-09-13T18:29:14.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.063+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a381567f0 con 0x7f5a3806b850 2024-09-13T18:29:14.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.063+0000 7f5a34ff9640 1 -- 172.21.15.53:0/2064998802 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12926 (secure 0 0 0) 0x7f5a28017070 con 0x7f5a3806b850 2024-09-13T18:29:14.071 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:14.071 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:12.710891+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/3738594836":"2024-09-14T18:29:09.685358+0000","172.21.15.53:6834/3738594836":"2024-09-14T18:29:09.685358+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a18066a20 msgr2=0x7f5a18068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a18066a20 0x7f5a18068ee0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5a380ada70 tx=0x7f5a20009040 comp rx=0 tx=0).stop 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a3806b850 msgr2=0x7f5a38145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a3806b850 0x7f5a38145a00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c4d0 tx=0x7f5a2800c990 comp rx=0 tx=0).stop 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 shutdown_connections 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5a18066a20 0x7f5a18068ee0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a380cb980 0x7f5a38154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a380cbd60 0x7f5a380af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 --2- 172.21.15.53:0/2064998802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a3806b850 0x7f5a38145a00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 >> 172.21.15.53:0/2064998802 conn(0x7f5a38065c80 msgr2=0x7f5a380cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 shutdown_connections 2024-09-13T18:29:14.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.067+0000 7f5a3ddbc640 1 -- 172.21.15.53:0/2064998802 wait complete. 2024-09-13T18:29:14.091 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:14.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:14.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8879d2f640 1 Processor -- start 2024-09-13T18:29:14.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8879d2f640 1 -- start start 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8879d2f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8874156c40 0x7f8874070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8879d2f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874157020 0x7f887406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8879d2f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887406d6e0 con 0x7f887406d270 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8879d2f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8874070340 con 0x7f8874156c40 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8879d2f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88740b15a0 con 0x7f8874157020 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8873fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f887406d270 0x7f887415cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59636/0 (socket says 172.21.15.53:59636) 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8873fff640 1 -- 172.21.15.53:0/3025240149 learned_addr learned my addr 172.21.15.53:0/3025240149 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f88737fe640 1 --2- 172.21.15.53:0/3025240149 >> v2:172.21.15.53:3300/0 conn(0x7f8874156c40 0x7f8874070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f886bfff640 1 --2- 172.21.15.53:0/3025240149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874157020 0x7f887406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8872ffd640 1 -- 172.21.15.53:0/3025240149 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716257264 0 0) 0x7f887406d6e0 con 0x7f887406d270 2024-09-13T18:29:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f8872ffd640 1 -- 172.21.15.53:0/3025240149 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8860005740 con 0x7f887406d270 2024-09-13T18:29:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f88737fe640 1 -- 172.21.15.53:0/3025240149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874157020 msgr2=0x7f887406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f88737fe640 1 --2- 172.21.15.53:0/3025240149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874157020 0x7f887406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f88737fe640 1 -- 172.21.15.53:0/3025240149 >> v1:172.21.15.53:6789/0 conn(0x7f887406d270 legacy=0x7f887415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.219+0000 7f88737fe640 1 -- 172.21.15.53:0/3025240149 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740b1880 con 0x7f8874156c40 2024-09-13T18:29:14.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f88737fe640 1 --2- 172.21.15.53:0/3025240149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8874156c40 0x7f8874070ee0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f88640097c0 tx=0x7f886401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162eb4934fe8058b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8872ffd640 1 -- 172.21.15.53:0/3025240149 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640ad640 con 0x7f8874156c40 2024-09-13T18:29:14.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8872ffd640 1 -- 172.21.15.53:0/3025240149 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88640ad7a0 con 0x7f8874156c40 2024-09-13T18:29:14.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8872ffd640 1 -- 172.21.15.53:0/3025240149 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640adb30 con 0x7f8874156c40 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- 172.21.15.53:0/3025240149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8874156c40 msgr2=0x7f8874070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 --2- 172.21.15.53:0/3025240149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8874156c40 0x7f8874070ee0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f88640097c0 tx=0x7f886401c470 comp rx=0 tx=0).stop 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- 172.21.15.53:0/3025240149 shutdown_connections 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 --2- 172.21.15.53:0/3025240149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874157020 0x7f887406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 --2- 172.21.15.53:0/3025240149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8874156c40 0x7f8874070ee0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- 172.21.15.53:0/3025240149 >> 172.21.15.53:0/3025240149 conn(0x7f8874065c80 msgr2=0x7f8874066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- 172.21.15.53:0/3025240149 shutdown_connections 2024-09-13T18:29:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- 172.21.15.53:0/3025240149 wait complete. 2024-09-13T18:29:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 Processor -- start 2024-09-13T18:29:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- start start 2024-09-13T18:29:14.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f887406d270 0x7f8874144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874156c40 0x7f8874146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88741423b0 0x7f88740ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874146870 con 0x7f88741423b0 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874159120 con 0x7f887406d270 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8879d2f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88741462f0 con 0x7f8874156c40 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8873fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88741423b0 0x7f88740ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8873fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88741423b0 0x7f88740ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41876/0 (socket says 172.21.15.53:41876) 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f8873fff640 1 -- 172.21.15.53:0/921208836 learned_addr learned my addr 172.21.15.53:0/921208836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f88737fe640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f887406d270 0x7f8874144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.223+0000 7f886bfff640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874156c40 0x7f8874146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8873fff640 1 -- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874156c40 msgr2=0x7f8874146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8873fff640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874156c40 0x7f8874146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8873fff640 1 -- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f887406d270 msgr2=0x7f8874144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8873fff640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f887406d270 0x7f8874144040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8873fff640 1 -- 172.21.15.53:0/921208836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864009420 con 0x7f88741423b0 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8873fff640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88741423b0 0x7f88740ac8e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f886c00cad0 tx=0x7f886c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8870ff9640 1 -- 172.21.15.53:0/921208836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00ab70 con 0x7f88741423b0 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8870ff9640 1 -- 172.21.15.53:0/921208836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c00acd0 con 0x7f88741423b0 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8874147260 con 0x7f88741423b0 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8870ff9640 1 -- 172.21.15.53:0/921208836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c012620 con 0x7f88741423b0 2024-09-13T18:29:14.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8874158db0 con 0x7f88741423b0 2024-09-13T18:29:14.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8874158c10 con 0x7f88741423b0 2024-09-13T18:29:14.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8870ff9640 1 -- 172.21.15.53:0/921208836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f886c007070 con 0x7f88741423b0 2024-09-13T18:29:14.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8870ff9640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f88540669f0 0x7f8854068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f8870ff9640 1 -- 172.21.15.53:0/921208836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f886c084130 con 0x7f88741423b0 2024-09-13T18:29:14.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f88737fe640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f88540669f0 0x7f8854068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.227+0000 7f88737fe640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f88540669f0 0x7f8854068eb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f88640af000 tx=0x7f8864008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.231+0000 7f8870ff9640 1 -- 172.21.15.53:0/921208836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8874158c10 con 0x7f88741423b0 2024-09-13T18:29:14.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8874158c10 con 0x7f88741423b0 2024-09-13T18:29:14.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8870ff9640 1 -- 172.21.15.53:0/921208836 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8874158c10 con 0x7f88741423b0 2024-09-13T18:29:14.396 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f88540669f0 msgr2=0x7f8854068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f88540669f0 0x7f8854068eb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f88640af000 tx=0x7f8864008040 comp rx=0 tx=0).stop 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88741423b0 msgr2=0x7f88740ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88741423b0 0x7f88740ac8e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f886c00cad0 tx=0x7f886c00cf90 comp rx=0 tx=0).stop 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 shutdown_connections 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f88540669f0 0x7f8854068eb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8874156c40 0x7f8874146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88741423b0 0x7f88740ac8e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 --2- 172.21.15.53:0/921208836 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f887406d270 0x7f8874144040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 >> 172.21.15.53:0/921208836 conn(0x7f8874065c80 msgr2=0x7f887415a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 shutdown_connections 2024-09-13T18:29:14.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.391+0000 7f8879d2f640 1 -- 172.21.15.53:0/921208836 wait complete. 2024-09-13T18:29:14.417 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-13T18:29:14.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.535+0000 7f49954ab640 1 Processor -- start 2024-09-13T18:29:14.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f49954ab640 1 -- start start 2024-09-13T18:29:14.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f49954ab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f499006fa80 0x7f499006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f49954ab640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49900b2860 con 0x7f4990158ba0 2024-09-13T18:29:14.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f49954ab640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4990158f80 con 0x7f49900cbb60 2024-09-13T18:29:14.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f49954ab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900b2580 con 0x7f499006fa80 2024-09-13T18:29:14.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f499006fa80 0x7f499006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4990158ba0 0x7f499006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59640/0 (socket says 172.21.15.53:59640) 2024-09-13T18:29:14.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498effd640 1 -- 172.21.15.53:0/933090679 learned_addr learned my addr 172.21.15.53:0/933090679 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:14.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498e7fc640 1 -- 172.21.15.53:0/933090679 >> v1:172.21.15.87:6789/0 conn(0x7f49900cbb60 legacy=0x7f49900cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:14.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498e7fc640 1 -- 172.21.15.53:0/933090679 >> v1:172.21.15.53:6789/0 conn(0x7f4990158ba0 legacy=0x7f499006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498dffb640 1 -- 172.21.15.53:0/933090679 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648239845 0 0) 0x7f49900b2860 con 0x7f4990158ba0 2024-09-13T18:29:14.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498e7fc640 1 -- 172.21.15.53:0/933090679 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900cc3a0 con 0x7f499006fa80 2024-09-13T18:29:14.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498e7fc640 1 --2- 172.21.15.53:0/933090679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f499006fa80 0x7f499006b390 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f49840097c0 tx=0x7f498401d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a7416202d061fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.539+0000 7f498dffb640 1 -- 172.21.15.53:0/933090679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840ab670 con 0x7f499006fa80 2024-09-13T18:29:14.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498dffb640 1 -- 172.21.15.53:0/933090679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49840ab7d0 con 0x7f499006fa80 2024-09-13T18:29:14.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498dffb640 1 -- 172.21.15.53:0/933090679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840abb60 con 0x7f499006fa80 2024-09-13T18:29:14.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- 172.21.15.53:0/933090679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f499006fa80 msgr2=0x7f499006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 --2- 172.21.15.53:0/933090679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f499006fa80 0x7f499006b390 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f49840097c0 tx=0x7f498401d520 comp rx=0 tx=0).stop 2024-09-13T18:29:14.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- 172.21.15.53:0/933090679 shutdown_connections 2024-09-13T18:29:14.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 --2- 172.21.15.53:0/933090679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f499006fa80 0x7f499006b390 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- 172.21.15.53:0/933090679 >> 172.21.15.53:0/933090679 conn(0x7f4990065c80 msgr2=0x7f4990066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- 172.21.15.53:0/933090679 shutdown_connections 2024-09-13T18:29:14.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- 172.21.15.53:0/933090679 wait complete. 2024-09-13T18:29:14.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 Processor -- start 2024-09-13T18:29:14.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- start start 2024-09-13T18:29:14.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f499006fa80 0x7f4990149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49900cbb60 0x7f4990156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4990158ba0 0x7f4990150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900ad040 con 0x7f4990158ba0 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990147450 con 0x7f499006fa80 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990157ea0 con 0x7f49900cbb60 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4990158ba0 0x7f4990150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4990158ba0 0x7f4990150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41890/0 (socket says 172.21.15.53:41890) 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 -- 172.21.15.53:0/1212260568 learned_addr learned my addr 172.21.15.53:0/1212260568 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498e7fc640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49900cbb60 0x7f4990156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498effd640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f499006fa80 0x7f4990149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 -- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49900cbb60 msgr2=0x7f4990156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49900cbb60 0x7f4990156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 -- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f499006fa80 msgr2=0x7f4990149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f499006fa80 0x7f4990149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 -- 172.21.15.53:0/1212260568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984009420 con 0x7f4990158ba0 2024-09-13T18:29:14.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f498f7fe640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4990158ba0 0x7f4990150b50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f498800c7a0 tx=0x7f498800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49777fe640 1 -- 172.21.15.53:0/1212260568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988003b80 con 0x7f4990158ba0 2024-09-13T18:29:14.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49777fe640 1 -- 172.21.15.53:0/1212260568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4988003ce0 con 0x7f4990158ba0 2024-09-13T18:29:14.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49777fe640 1 -- 172.21.15.53:0/1212260568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800aa30 con 0x7f4990158ba0 2024-09-13T18:29:14.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49901470b0 con 0x7f4990158ba0 2024-09-13T18:29:14.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.543+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49901496b0 con 0x7f4990158ba0 2024-09-13T18:29:14.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.547+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4990067400 con 0x7f4990158ba0 2024-09-13T18:29:14.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.547+0000 7f49777fe640 1 -- 172.21.15.53:0/1212260568 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f498800ab90 con 0x7f4990158ba0 2024-09-13T18:29:14.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.547+0000 7f49777fe640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f497c0669f0 0x7f497c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.547+0000 7f49777fe640 1 -- 172.21.15.53:0/1212260568 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4988084320 con 0x7f4990158ba0 2024-09-13T18:29:14.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.547+0000 7f498effd640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f497c0669f0 0x7f497c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.547+0000 7f498effd640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f497c0669f0 0x7f497c068eb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4980007fd0 tx=0x7f4980007ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.551+0000 7f49777fe640 1 -- 172.21.15.53:0/1212260568 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4988051480 con 0x7f4990158ba0 2024-09-13T18:29:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:14.763+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) v1 -- 0x7f4990147590 con 0x7f4990158ba0 2024-09-13T18:29:15.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.723+0000 7f49777fe640 1 -- 172.21.15.53:0/1212260568 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v236) v1 ==== 134+0+0 (secure 0 0 0) 0x7f4990147590 con 0x7f4990158ba0 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f497c0669f0 msgr2=0x7f497c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f497c0669f0 0x7f497c068eb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4980007fd0 tx=0x7f4980007ba0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4990158ba0 msgr2=0x7f4990150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4990158ba0 0x7f4990150b50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f498800c7a0 tx=0x7f498800cc60 comp rx=0 tx=0).stop 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 shutdown_connections 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f497c0669f0 0x7f497c068eb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49900cbb60 0x7f4990156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4990158ba0 0x7f4990150b50 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 --2- 172.21.15.53:0/1212260568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f499006fa80 0x7f4990149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 >> 172.21.15.53:0/1212260568 conn(0x7f4990065c80 msgr2=0x7f499006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 shutdown_connections 2024-09-13T18:29:15.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.727+0000 7f49954ab640 1 -- 172.21.15.53:0/1212260568 wait complete. 2024-09-13T18:29:15.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cbb7d2640 1 Processor -- start 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cbb7d2640 1 -- start start 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cbb7d2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6cb415c830 0x7f6cb40d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cbb7d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cb40ccd10 0x7f6cb40cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cbb7d2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40b7db0 con 0x7f6cb40d2c80 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cbb7d2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb40d0650 con 0x7f6cb40ccd10 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cbb7d2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb40d0c10 con 0x7f6cb415c830 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb8d6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cb40ccd10 0x7f6cb40cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb8d6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cb40ccd10 0x7f6cb40cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41906/0 (socket says 172.21.15.53:41906) 2024-09-13T18:29:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb8d6d640 1 -- 172.21.15.53:0/566495110 learned_addr learned my addr 172.21.15.53:0/566495110 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb956e640 1 --2- 172.21.15.53:0/566495110 >> v2:172.21.15.87:3300/0 conn(0x7f6cb415c830 0x7f6cb40d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb8d6d640 1 -- 172.21.15.53:0/566495110 >> v2:172.21.15.87:3300/0 conn(0x7f6cb415c830 msgr2=0x7f6cb40d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb8d6d640 1 --2- 172.21.15.53:0/566495110 >> v2:172.21.15.87:3300/0 conn(0x7f6cb415c830 0x7f6cb40d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb8d6d640 1 -- 172.21.15.53:0/566495110 >> v1:172.21.15.87:6789/0 conn(0x7f6cb40d2c80 legacy=0x7f6cb40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.875+0000 7f6cb8d6d640 1 -- 172.21.15.53:0/566495110 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40cd7d0 con 0x7f6cb40ccd10 2024-09-13T18:29:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cb8d6d640 1 --2- 172.21.15.53:0/566495110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb40cd180 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40d0240 tx=0x7f6ca401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e55cac26bba80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cabfff640 1 -- 172.21.15.53:0/566495110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40ab600 con 0x7f6cb40ccd10 2024-09-13T18:29:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cabfff640 1 -- 172.21.15.53:0/566495110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca40a7050 con 0x7f6cb40ccd10 2024-09-13T18:29:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cabfff640 1 -- 172.21.15.53:0/566495110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40ab980 con 0x7f6cb40ccd10 2024-09-13T18:29:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/566495110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 msgr2=0x7f6cb40cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/566495110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb40cd180 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40d0240 tx=0x7f6ca401c520 comp rx=0 tx=0).stop 2024-09-13T18:29:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/566495110 shutdown_connections 2024-09-13T18:29:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/566495110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb40cd180 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/566495110 >> v2:172.21.15.87:3300/0 conn(0x7f6cb415c830 0x7f6cb40d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/566495110 >> 172.21.15.53:0/566495110 conn(0x7f6cb4070970 msgr2=0x7f6cb4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/566495110 shutdown_connections 2024-09-13T18:29:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/566495110 wait complete. 2024-09-13T18:29:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 Processor -- start 2024-09-13T18:29:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- start start 2024-09-13T18:29:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb40d2c80 0x7f6cb4158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6cb415c830 0x7f6cb4156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4157eb0 con 0x7f6cb40ccd10 2024-09-13T18:29:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41578f0 con 0x7f6cb40d2c80 2024-09-13T18:29:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cbb7d2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4157bd0 con 0x7f6cb415c830 2024-09-13T18:29:15.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cb956e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cb956e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb415d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41910/0 (socket says 172.21.15.53:41910) 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cb956e640 1 -- 172.21.15.53:0/1245172998 learned_addr learned my addr 172.21.15.53:0/1245172998 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cb8d6d640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb40d2c80 0x7f6cb4158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.879+0000 7f6cb9d6f640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6cb415c830 0x7f6cb4156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb956e640 1 -- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6cb415c830 msgr2=0x7f6cb4156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb956e640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6cb415c830 0x7f6cb4156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb956e640 1 -- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb40d2c80 msgr2=0x7f6cb4158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb956e640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb40d2c80 0x7f6cb4158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb956e640 1 -- 172.21.15.53:0/1245172998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40094d0 con 0x7f6cb40ccd10 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb956e640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb415d9e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000d800 tx=0x7f6cb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6ca9ffb640 1 -- 172.21.15.53:0/1245172998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000b6c0 con 0x7f6cb40ccd10 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6ca9ffb640 1 -- 172.21.15.53:0/1245172998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb000b820 con 0x7f6cb40ccd10 2024-09-13T18:29:15.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb40d3620 con 0x7f6cb40ccd10 2024-09-13T18:29:15.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6ca9ffb640 1 -- 172.21.15.53:0/1245172998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb000bb90 con 0x7f6cb40ccd10 2024-09-13T18:29:15.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb40cae30 con 0x7f6cb40ccd10 2024-09-13T18:29:15.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb40cd180 con 0x7f6cb40ccd10 2024-09-13T18:29:15.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6ca9ffb640 1 -- 172.21.15.53:0/1245172998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f6cb000bcf0 con 0x7f6cb40ccd10 2024-09-13T18:29:15.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6ca9ffb640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c980669f0 0x7f6c98068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6ca9ffb640 1 -- 172.21.15.53:0/1245172998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6cb0084980 con 0x7f6cb40ccd10 2024-09-13T18:29:15.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb8d6d640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c980669f0 0x7f6c98068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.883+0000 7f6cb8d6d640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c980669f0 0x7f6c98068eb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40ad000 tx=0x7f6ca4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:15.887+0000 7f6ca9ffb640 1 -- 172.21.15.53:0/1245172998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6cb0051be0 con 0x7f6cb40ccd10 2024-09-13T18:29:16.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.047+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6cb415a030 con 0x7f6cb40ccd10 2024-09-13T18:29:16.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.051+0000 7f6ca9ffb640 1 -- 172.21.15.53:0/1245172998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6cb0055200 con 0x7f6cb40ccd10 2024-09-13T18:29:16.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c980669f0 msgr2=0x7f6c98068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c980669f0 0x7f6c98068eb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40ad000 tx=0x7f6ca4008040 comp rx=0 tx=0).stop 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 msgr2=0x7f6cb415d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb415d9e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000d800 tx=0x7f6cb000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 shutdown_connections 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6c980669f0 0x7f6c98068eb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6cb415c830 0x7f6cb4156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6cb40d2c80 0x7f6cb4158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 --2- 172.21.15.53:0/1245172998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cb40ccd10 0x7f6cb415d9e0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 >> 172.21.15.53:0/1245172998 conn(0x7f6cb4070970 msgr2=0x7f6cb4156490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 shutdown_connections 2024-09-13T18:29:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.055+0000 7f6cbb7d2640 1 -- 172.21.15.53:0/1245172998 wait complete. 2024-09-13T18:29:16.079 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:29:16.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:29:16.133 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:29:16.214 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:29:16.214 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:29:16.214 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:16.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:29:16.221 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:29:16.221 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:16.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:29:16.227 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:29:16.227 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:16.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:29:16.269 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:29:16.269 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:16.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:29:16.275 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:29:16.275 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:16.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 Processor -- start 2024-09-13T18:29:16.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 -- start start 2024-09-13T18:29:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e7415cab0 0x7f5e740d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 0x7f5e740cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5e740cdb00 0x7f5e740cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740d2400 con 0x7f5e7415cab0 2024-09-13T18:29:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740d1530 con 0x7f5e740cdb00 2024-09-13T18:29:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7888f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740d0920 con 0x7f5e740cd6c0 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e7415cab0 0x7f5e740d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e7415cab0 0x7f5e740d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41924/0 (socket says 172.21.15.53:41924) 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 -- 172.21.15.53:0/2742866992 learned_addr learned my addr 172.21.15.53:0/2742866992 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 -- 172.21.15.53:0/2742866992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 msgr2=0x7f5e740cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 --2- 172.21.15.53:0/2742866992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 0x7f5e740cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 -- 172.21.15.53:0/2742866992 >> v2:172.21.15.87:3300/0 conn(0x7f5e740cdb00 msgr2=0x7f5e740cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e72d9d640 1 --2- 172.21.15.53:0/2742866992 >> v2:172.21.15.87:3300/0 conn(0x7f5e740cdb00 0x7f5e740cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 --2- 172.21.15.53:0/2742866992 >> v2:172.21.15.87:3300/0 conn(0x7f5e740cdb00 0x7f5e740cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 -- 172.21.15.53:0/2742866992 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e740d0c00 con 0x7f5e7415cab0 2024-09-13T18:29:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e72d9d640 1 --2- 172.21.15.53:0/2742866992 >> v2:172.21.15.87:3300/0 conn(0x7f5e740cdb00 0x7f5e740cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:16.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.439+0000 7f5e7259c640 1 --2- 172.21.15.53:0/2742866992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740d19c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5e740b7fe0 tx=0x7f5e6401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e8fb4f2df5cfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7159a640 1 -- 172.21.15.53:0/2742866992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640aa610 con 0x7f5e7415cab0 2024-09-13T18:29:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7159a640 1 -- 172.21.15.53:0/2742866992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e640a6040 con 0x7f5e7415cab0 2024-09-13T18:29:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7159a640 1 -- 172.21.15.53:0/2742866992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640aa990 con 0x7f5e7415cab0 2024-09-13T18:29:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- 172.21.15.53:0/2742866992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 msgr2=0x7f5e740d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 --2- 172.21.15.53:0/2742866992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740d19c0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5e740b7fe0 tx=0x7f5e6401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- 172.21.15.53:0/2742866992 shutdown_connections 2024-09-13T18:29:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 --2- 172.21.15.53:0/2742866992 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 0x7f5e740cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 --2- 172.21.15.53:0/2742866992 >> v2:172.21.15.87:3300/0 conn(0x7f5e740cdb00 0x7f5e740cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 --2- 172.21.15.53:0/2742866992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740d19c0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- 172.21.15.53:0/2742866992 >> 172.21.15.53:0/2742866992 conn(0x7f5e74065c80 msgr2=0x7f5e74066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- 172.21.15.53:0/2742866992 shutdown_connections 2024-09-13T18:29:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- 172.21.15.53:0/2742866992 wait complete. 2024-09-13T18:29:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 Processor -- start 2024-09-13T18:29:16.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- start start 2024-09-13T18:29:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 0x7f5e74152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740cdb00 0x7f5e74151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74159320 con 0x7f5e7415cab0 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740cce40 con 0x7f5e740cdb00 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74158a80 con 0x7f5e740cd6c0 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41940/0 (socket says 172.21.15.53:41940) 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 -- 172.21.15.53:0/1920283741 learned_addr learned my addr 172.21.15.53:0/1920283741 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7259c640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 0x7f5e74152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e71d9b640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740cdb00 0x7f5e74151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 -- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 msgr2=0x7f5e74152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 0x7f5e74152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 -- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740cdb00 msgr2=0x7f5e74151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740cdb00 0x7f5e74151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 -- 172.21.15.53:0/1920283741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640094d0 con 0x7f5e7415cab0 2024-09-13T18:29:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e72d9d640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740cc900 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00cd80 tx=0x7f5e6c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e62ffd640 1 -- 172.21.15.53:0/1920283741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00f680 con 0x7f5e7415cab0 2024-09-13T18:29:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e62ffd640 1 -- 172.21.15.53:0/1920283741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00f800 con 0x7f5e7415cab0 2024-09-13T18:29:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e74158d60 con 0x7f5e7415cab0 2024-09-13T18:29:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.443+0000 7f5e62ffd640 1 -- 172.21.15.53:0/1920283741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00fbb0 con 0x7f5e7415cab0 2024-09-13T18:29:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.447+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e74152290 con 0x7f5e7415cab0 2024-09-13T18:29:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.447+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e741520f0 con 0x7f5e7415cab0 2024-09-13T18:29:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.447+0000 7f5e62ffd640 1 -- 172.21.15.53:0/1920283741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f5e6c00b040 con 0x7f5e7415cab0 2024-09-13T18:29:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.447+0000 7f5e62ffd640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e540669f0 0x7f5e54068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.447+0000 7f5e62ffd640 1 -- 172.21.15.53:0/1920283741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5e6c084fb0 con 0x7f5e7415cab0 2024-09-13T18:29:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.447+0000 7f5e7259c640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e540669f0 0x7f5e54068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.447+0000 7f5e7259c640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e540669f0 0x7f5e54068eb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5e640ae000 tx=0x7f5e640a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.451+0000 7f5e62ffd640 1 -- 172.21.15.53:0/1920283741 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e741520f0 con 0x7f5e7415cab0 2024-09-13T18:29:16.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.647+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e741520f0 con 0x7f5e7415cab0 2024-09-13T18:29:16.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.647+0000 7f5e62ffd640 1 -- 172.21.15.53:0/1920283741 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f5e741520f0 con 0x7f5e7415cab0 2024-09-13T18:29:16.654 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:16.654 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5396,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1852087146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1852087146},{"type":"v1","addr":"172.21.15.87:6835","nonce":1852087146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1364711247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1364711247},{"type":"v1","addr":"172.21.15.87:6837","nonce":1364711247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/763471722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":763471722},{"type":"v1","addr":"172.21.15.53:6833","nonce":763471722}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6762,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1900300197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1900300197},{"type":"v1","addr":"172.21.15.53:6835","nonce":1900300197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2024-09-13T18:29:16.654 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 34 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e540669f0 msgr2=0x7f5e54068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e540669f0 0x7f5e54068eb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5e640ae000 tx=0x7f5e640a7000 comp rx=0 tx=0).stop 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 msgr2=0x7f5e740cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740cc900 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00cd80 tx=0x7f5e6c00a650 comp rx=0 tx=0).stop 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 shutdown_connections 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5e540669f0 0x7f5e54068eb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e7415cab0 0x7f5e740cc900 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e740cdb00 0x7f5e74151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 --2- 172.21.15.53:0/1920283741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e740cd6c0 0x7f5e74152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 >> 172.21.15.53:0/1920283741 conn(0x7f5e74065c80 msgr2=0x7f5e740b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:16.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 shutdown_connections 2024-09-13T18:29:16.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.651+0000 7f5e7888f640 1 -- 172.21.15.53:0/1920283741 wait complete. 2024-09-13T18:29:16.674 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:29:16.674 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:29:16.674 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:29:16.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:16.675 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:29:16.675 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:29:16.675 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:29:16.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:16.675 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:29:16.675 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:29:16.676 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:29:16.676 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:16.676 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:29:16.676 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:29:16.676 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:29:16.676 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:16.686 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:29:16.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:29:16.687 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:29:16.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:29:16.691 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:29:16.691 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:29:16.692 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:29:16.692 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:29:16.733 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:29:16.733 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:16.734 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:29:16.735 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:29:16.735 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:29:16.735 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:16.735 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:16.735 DEBUG:teuthology.parallel:result is None 2024-09-13T18:29:16.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:29:16.795 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:29:16.803 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:29:16.804 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:29:16.806 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:29:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10f1a70640 1 Processor -- start 2024-09-13T18:29:16.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10f1a70640 1 -- start start 2024-09-13T18:29:16.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10f1a70640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f10ec06b850 0x7f10ec0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10f1a70640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec0b1ac0 con 0x7f10ec0cb980 2024-09-13T18:29:16.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10f1a70640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec159ac0 con 0x7f10ec0cbd60 2024-09-13T18:29:16.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10f1a70640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec159da0 con 0x7f10ec06b850 2024-09-13T18:29:16.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10eb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f10ec0cb980 0x7f10ec06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48830/0 (socket says 172.21.15.53:48830) 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10eb7fe640 1 -- 172.21.15.53:0/484529447 learned_addr learned my addr 172.21.15.53:0/484529447 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10eaffd640 1 --2- 172.21.15.53:0/484529447 >> v2:172.21.15.87:3300/0 conn(0x7f10ec06b850 0x7f10ec0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10ea7fc640 1 -- 172.21.15.53:0/484529447 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749996698 0 0) 0x7f10ec0b1ac0 con 0x7f10ec0cb980 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10ea7fc640 1 -- 172.21.15.53:0/484529447 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d4003530 con 0x7f10ec0cb980 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10ea7fc640 1 -- 172.21.15.53:0/484529447 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171735501 0 0) 0x7f10ec159ac0 con 0x7f10ec0cbd60 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10ea7fc640 1 -- 172.21.15.53:0/484529447 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ec0b1ac0 con 0x7f10ec0cbd60 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10eaffd640 1 -- 172.21.15.53:0/484529447 >> v1:172.21.15.87:6789/0 conn(0x7f10ec0cbd60 legacy=0x7f10ec0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10eaffd640 1 -- 172.21.15.53:0/484529447 >> v1:172.21.15.53:6789/0 conn(0x7f10ec0cb980 legacy=0x7f10ec06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.855+0000 7f10eaffd640 1 -- 172.21.15.53:0/484529447 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec15a080 con 0x7f10ec06b850 2024-09-13T18:29:16.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10eaffd640 1 --2- 172.21.15.53:0/484529447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec06b850 0x7f10ec0b33b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001e560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d545ec0d6e048fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10ea7fc640 1 -- 172.21.15.53:0/484529447 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00ab630 con 0x7f10ec06b850 2024-09-13T18:29:16.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10ea7fc640 1 -- 172.21.15.53:0/484529447 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e00ab790 con 0x7f10ec06b850 2024-09-13T18:29:16.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10ea7fc640 1 -- 172.21.15.53:0/484529447 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00abb20 con 0x7f10ec06b850 2024-09-13T18:29:16.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 -- 172.21.15.53:0/484529447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec06b850 msgr2=0x7f10ec0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 --2- 172.21.15.53:0/484529447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec06b850 0x7f10ec0b33b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001e560 comp rx=0 tx=0).stop 2024-09-13T18:29:16.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 -- 172.21.15.53:0/484529447 shutdown_connections 2024-09-13T18:29:16.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 --2- 172.21.15.53:0/484529447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec06b850 0x7f10ec0b33b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 -- 172.21.15.53:0/484529447 >> 172.21.15.53:0/484529447 conn(0x7f10ec065c80 msgr2=0x7f10ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:16.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 -- 172.21.15.53:0/484529447 shutdown_connections 2024-09-13T18:29:16.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 -- 172.21.15.53:0/484529447 wait complete. 2024-09-13T18:29:16.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 Processor -- start 2024-09-13T18:29:16.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.859+0000 7f10f1a70640 1 -- start start 2024-09-13T18:29:16.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec06b850 0x7f10ec14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec0cb980 0x7f10ec1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec0cbd60 0x7f10ec147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec14a610 con 0x7f10ec0cbd60 2024-09-13T18:29:16.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec14a8f0 con 0x7f10ec0cb980 2024-09-13T18:29:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec14abd0 con 0x7f10ec06b850 2024-09-13T18:29:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec0cbd60 0x7f10ec147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec0cbd60 0x7f10ec147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53104/0 (socket says 172.21.15.53:53104) 2024-09-13T18:29:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eaffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec0cb980 0x7f10ec1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10ebfff640 1 -- 172.21.15.53:0/2704111157 learned_addr learned my addr 172.21.15.53:0/2704111157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec06b850 0x7f10ec14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eaffd640 1 -- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec06b850 msgr2=0x7f10ec14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec06b850 0x7f10ec14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eaffd640 1 -- 172.21.15.53:0/2704111157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec0cbd60 msgr2=0x7f10ec147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec0cbd60 0x7f10ec147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eaffd640 1 -- 172.21.15.53:0/2704111157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0009420 con 0x7f10ec0cb980 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10ebfff640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec0cbd60 0x7f10ec147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eaffd640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec0cb980 0x7f10ec1488c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ac000 tx=0x7f10e001cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10d3fff640 1 -- 172.21.15.53:0/2704111157 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00bc680 con 0x7f10ec0cb980 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10d3fff640 1 -- 172.21.15.53:0/2704111157 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e00bc7e0 con 0x7f10ec0cb980 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec14aeb0 con 0x7f10ec0cb980 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10d3fff640 1 -- 172.21.15.53:0/2704111157 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00bcb90 con 0x7f10ec0cb980 2024-09-13T18:29:16.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec14a250 con 0x7f10ec0cb980 2024-09-13T18:29:16.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec067400 con 0x7f10ec0cb980 2024-09-13T18:29:16.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10d3fff640 1 -- 172.21.15.53:0/2704111157 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f10e00b33f0 con 0x7f10ec0cb980 2024-09-13T18:29:16.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10d3fff640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f10d80669f0 0x7f10d8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10d3fff640 1 -- 172.21.15.53:0/2704111157 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10e0121350 con 0x7f10ec0cb980 2024-09-13T18:29:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.863+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f10d80669f0 0x7f10d8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.867+0000 7f10eb7fe640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f10d80669f0 0x7f10d8068eb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f10dc005890 tx=0x7f10dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:16.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:16.871+0000 7f10d3fff640 1 -- 172.21.15.53:0/2704111157 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10e00ee410 con 0x7f10ec0cb980 2024-09-13T18:29:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.039+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f10ec14ad10 con 0x7f10ec0cb980 2024-09-13T18:29:17.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.859+0000 7f10d3fff640 1 -- 172.21.15.53:0/2704111157 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f10ec14ad10 con 0x7f10ec0cb980 2024-09-13T18:29:17.861 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:29:17.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f10d80669f0 msgr2=0x7f10d8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:17.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f10d80669f0 0x7f10d8068eb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f10dc005890 tx=0x7f10dc009040 comp rx=0 tx=0).stop 2024-09-13T18:29:17.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec0cb980 msgr2=0x7f10ec1488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:17.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec0cb980 0x7f10ec1488c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ac000 tx=0x7f10e001cda0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 shutdown_connections 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f10d80669f0 0x7f10d8068eb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10ec0cbd60 0x7f10ec147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10ec0cb980 0x7f10ec1488c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 --2- 172.21.15.53:0/2704111157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10ec06b850 0x7f10ec14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 >> 172.21.15.53:0/2704111157 conn(0x7f10ec065c80 msgr2=0x7f10ec06c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 shutdown_connections 2024-09-13T18:29:17.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:17.863+0000 7f10f1a70640 1 -- 172.21.15.53:0/2704111157 wait complete. 2024-09-13T18:29:17.888 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:29:18.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cc5b6f640 1 Processor -- start 2024-09-13T18:29:18.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cc5b6f640 1 -- start start 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cc5b6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9cc01582a0 0x7f9cc006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cc5b6f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc015b7c0 0x7f9cc006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cc5b6f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc006d480 con 0x7f9cc0070c90 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cc5b6f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc015aaf0 con 0x7f9cc01582a0 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cc5b6f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc006d760 con 0x7f9cc015b7c0 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9cc0070c90 0x7f9cc006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48836/0 (socket says 172.21.15.53:48836) 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbffff640 1 -- 172.21.15.53:0/2212102157 learned_addr learned my addr 172.21.15.53:0/2212102157 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbf7fe640 1 --2- 172.21.15.53:0/2212102157 >> v2:172.21.15.53:3300/0 conn(0x7f9cc01582a0 0x7f9cc006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbeffd640 1 --2- 172.21.15.53:0/2212102157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc015b7c0 0x7f9cc006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbe7fc640 1 -- 172.21.15.53:0/2212102157 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391845203 0 0) 0x7f9cc006d480 con 0x7f9cc0070c90 2024-09-13T18:29:18.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbe7fc640 1 -- 172.21.15.53:0/2212102157 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca8003530 con 0x7f9cc0070c90 2024-09-13T18:29:18.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbf7fe640 1 -- 172.21.15.53:0/2212102157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc015b7c0 msgr2=0x7f9cc006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:18.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbf7fe640 1 --2- 172.21.15.53:0/2212102157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc015b7c0 0x7f9cc006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbf7fe640 1 -- 172.21.15.53:0/2212102157 >> v1:172.21.15.53:6789/0 conn(0x7f9cc0070c90 legacy=0x7f9cc006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbf7fe640 1 -- 172.21.15.53:0/2212102157 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc015ace0 con 0x7f9cc01582a0 2024-09-13T18:29:18.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.015+0000 7f9cbeffd640 1 --2- 172.21.15.53:0/2212102157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc015b7c0 0x7f9cc006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:18.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbf7fe640 1 --2- 172.21.15.53:0/2212102157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc006c900 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009d90 tx=0x7f9cb001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7179a3120bd01df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbe7fc640 1 -- 172.21.15.53:0/2212102157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00a5900 con 0x7f9cc01582a0 2024-09-13T18:29:18.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbe7fc640 1 -- 172.21.15.53:0/2212102157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb00a5a60 con 0x7f9cc01582a0 2024-09-13T18:29:18.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbe7fc640 1 -- 172.21.15.53:0/2212102157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00a5df0 con 0x7f9cc01582a0 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/2212102157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 msgr2=0x7f9cc006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/2212102157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc006c900 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009d90 tx=0x7f9cb001c940 comp rx=0 tx=0).stop 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/2212102157 shutdown_connections 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/2212102157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc015b7c0 0x7f9cc006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/2212102157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc006c900 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/2212102157 >> 172.21.15.53:0/2212102157 conn(0x7f9cc0065c80 msgr2=0x7f9cc0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/2212102157 shutdown_connections 2024-09-13T18:29:18.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/2212102157 wait complete. 2024-09-13T18:29:18.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 Processor -- start 2024-09-13T18:29:18.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- start start 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc0070c90 0x7f9cc01f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc015b7c0 0x7f9cc00ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0152fa0 con 0x7f9cc01582a0 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0152cc0 con 0x7f9cc015b7c0 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cc5b6f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0157620 con 0x7f9cc0070c90 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc00ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53110/0 (socket says 172.21.15.53:53110) 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 -- 172.21.15.53:0/3247553104 learned_addr learned my addr 172.21.15.53:0/3247553104 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 -- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc0070c90 msgr2=0x7f9cc01f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc0070c90 0x7f9cc01f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 -- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc015b7c0 msgr2=0x7f9cc00ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc015b7c0 0x7f9cc00ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 -- 172.21.15.53:0/3247553104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0009a70 con 0x7f9cc01582a0 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9cbeffd640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc00ac8e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400d800 tx=0x7f9cb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.019+0000 7f9ca7fff640 1 -- 172.21.15.53:0/3247553104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40096c0 con 0x7f9cc01582a0 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9ca7fff640 1 -- 172.21.15.53:0/3247553104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb4009820 con 0x7f9cc01582a0 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc0157900 con 0x7f9cc01582a0 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9ca7fff640 1 -- 172.21.15.53:0/3247553104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4009bd0 con 0x7f9cc01582a0 2024-09-13T18:29:18.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01f5960 con 0x7f9cc01582a0 2024-09-13T18:29:18.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc0067400 con 0x7f9cc01582a0 2024-09-13T18:29:18.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9ca7fff640 1 -- 172.21.15.53:0/3247553104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f9cb4009d30 con 0x7f9cc01582a0 2024-09-13T18:29:18.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9ca7fff640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9cac0669f0 0x7f9cac068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9ca7fff640 1 -- 172.21.15.53:0/3247553104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9cb4084b10 con 0x7f9cc01582a0 2024-09-13T18:29:18.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9cbf7fe640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9cac0669f0 0x7f9cac068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.023+0000 7f9cbf7fe640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9cac0669f0 0x7f9cac068eb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00af000 tx=0x7f9cb0004ac0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.027+0000 7f9ca7fff640 1 -- 172.21.15.53:0/3247553104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9cb4051d30 con 0x7f9cc01582a0 2024-09-13T18:29:18.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.243+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9cc0156590 con 0x7f9cc01582a0 2024-09-13T18:29:18.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.243+0000 7f9ca7fff640 1 -- 172.21.15.53:0/3247553104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5617 (secure 0 0 0) 0x7f9cc0156590 con 0x7f9cc01582a0 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:29:18.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.247 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.248 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.250 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:29:18.256 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:29:18.257 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.alice", 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBnhORm8thNNhAA250ElbV6JMWwA3fq0LWh0A==", 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol39580", 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:29:18.258 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:29:18.259 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:29:18.260 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.260 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:18.260 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:29:18.260 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9cac0669f0 msgr2=0x7f9cac068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9cac0669f0 0x7f9cac068eb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00af000 tx=0x7f9cb0004ac0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 msgr2=0x7f9cc00ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc00ac8e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400d800 tx=0x7f9cb400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 shutdown_connections 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f9cac0669f0 0x7f9cac068eb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cc015b7c0 0x7f9cc00ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc01582a0 0x7f9cc00ac8e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 --2- 172.21.15.53:0/3247553104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cc0070c90 0x7f9cc01f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 >> 172.21.15.53:0/3247553104 conn(0x7f9cc0065c80 msgr2=0x7f9cc01511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 shutdown_connections 2024-09-13T18:29:18.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.247+0000 7f9cc5b6f640 1 -- 172.21.15.53:0/3247553104 wait complete. 2024-09-13T18:29:18.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.alice 2024-09-13T18:29:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2b004a640 1 Processor -- start 2024-09-13T18:29:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2b004a640 1 -- start start 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2b004a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2a81582a0 0x7fc2a806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2b004a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2a815b7c0 0x7fc2a806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2b004a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a806d480 con 0x7fc2a8070c90 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2b004a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a815aaf0 con 0x7fc2a815b7c0 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2b004a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a806d760 con 0x7fc2a81582a0 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2ad5e5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2a815b7c0 0x7fc2a806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2ae5e7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc2a8070c90 0x7fc2a806f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48838/0 (socket says 172.21.15.53:48838) 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2ae5e7640 1 -- 172.21.15.53:0/403067887 learned_addr learned my addr 172.21.15.53:0/403067887 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2adde6640 1 --2- 172.21.15.53:0/403067887 >> v2:172.21.15.87:3300/0 conn(0x7fc2a81582a0 0x7fc2a806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2ad5e5640 1 -- 172.21.15.53:0/403067887 >> v2:172.21.15.87:3300/0 conn(0x7fc2a81582a0 msgr2=0x7fc2a806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2ad5e5640 1 --2- 172.21.15.53:0/403067887 >> v2:172.21.15.87:3300/0 conn(0x7fc2a81582a0 0x7fc2a806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2ad5e5640 1 -- 172.21.15.53:0/403067887 >> v1:172.21.15.53:6789/0 conn(0x7fc2a8070c90 legacy=0x7fc2a806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.383+0000 7fc2ad5e5640 1 -- 172.21.15.53:0/403067887 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a815ace0 con 0x7fc2a815b7c0 2024-09-13T18:29:18.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2ad5e5640 1 --2- 172.21.15.53:0/403067887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a806ce40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8069f50 tx=0x7fc29801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece3ba7d0248767 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2acde4640 1 -- 172.21.15.53:0/403067887 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980ab600 con 0x7fc2a815b7c0 2024-09-13T18:29:18.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2acde4640 1 -- 172.21.15.53:0/403067887 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2980a7050 con 0x7fc2a815b7c0 2024-09-13T18:29:18.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2acde4640 1 -- 172.21.15.53:0/403067887 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980ab980 con 0x7fc2a815b7c0 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 -- 172.21.15.53:0/403067887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 msgr2=0x7fc2a806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 --2- 172.21.15.53:0/403067887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a806ce40 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8069f50 tx=0x7fc29801c310 comp rx=0 tx=0).stop 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 -- 172.21.15.53:0/403067887 shutdown_connections 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 --2- 172.21.15.53:0/403067887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a806ce40 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 --2- 172.21.15.53:0/403067887 >> v2:172.21.15.87:3300/0 conn(0x7fc2a81582a0 0x7fc2a806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 -- 172.21.15.53:0/403067887 >> 172.21.15.53:0/403067887 conn(0x7fc2a8065c80 msgr2=0x7fc2a8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 -- 172.21.15.53:0/403067887 shutdown_connections 2024-09-13T18:29:18.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 -- 172.21.15.53:0/403067887 wait complete. 2024-09-13T18:29:18.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 Processor -- start 2024-09-13T18:29:18.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.387+0000 7fc2b004a640 1 -- start start 2024-09-13T18:29:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2a8070c90 0x7fc2a8138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2a81582a0 0x7fc2a813abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a813b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a814bea0 con 0x7fc2a815b7c0 2024-09-13T18:29:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8154af0 con 0x7fc2a81582a0 2024-09-13T18:29:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8154570 con 0x7fc2a8070c90 2024-09-13T18:29:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a813b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a813b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53136/0 (socket says 172.21.15.53:53136) 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 -- 172.21.15.53:0/240293973 learned_addr learned my addr 172.21.15.53:0/240293973 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ad5e5640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2a81582a0 0x7fc2a813abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 -- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2a8070c90 msgr2=0x7fc2a8138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2a8070c90 0x7fc2a8138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 -- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2a81582a0 msgr2=0x7fc2a813abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2a81582a0 0x7fc2a813abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 -- 172.21.15.53:0/240293973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc298009420 con 0x7fc2a815b7c0 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ad5e5640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2a81582a0 0x7fc2a813abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2ae5e7640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a813b130 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000e780 tx=0x7fc2a000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc29e7fc640 1 -- 172.21.15.53:0/240293973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000f930 con 0x7fc2a815b7c0 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc29e7fc640 1 -- 172.21.15.53:0/240293973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000fa90 con 0x7fc2a815b7c0 2024-09-13T18:29:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc29e7fc640 1 -- 172.21.15.53:0/240293973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000fe60 con 0x7fc2a815b7c0 2024-09-13T18:29:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a8154810 con 0x7fc2a815b7c0 2024-09-13T18:29:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a8138c20 con 0x7fc2a815b7c0 2024-09-13T18:29:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a814b580 con 0x7fc2a815b7c0 2024-09-13T18:29:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc29e7fc640 1 -- 172.21.15.53:0/240293973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fc2a0015070 con 0x7fc2a815b7c0 2024-09-13T18:29:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc29e7fc640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc28c0669f0 0x7fc28c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc29e7fc640 1 -- 172.21.15.53:0/240293973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2a0086cc0 con 0x7fc2a815b7c0 2024-09-13T18:29:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.391+0000 7fc2adde6640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc28c0669f0 0x7fc28c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.395+0000 7fc2adde6640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc28c0669f0 0x7fc28c068eb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8154500 tx=0x7fc2a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.395+0000 7fc29e7fc640 1 -- 172.21.15.53:0/240293973 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2a0054000 con 0x7fc2a815b7c0 2024-09-13T18:29:18.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.611+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.alice"} v 0) v1 -- 0x7fc2a8067400 con 0x7fc2a815b7c0 2024-09-13T18:29:18.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.615+0000 7fc29e7fc640 1 -- 172.21.15.53:0/240293973 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.alice"}]=0 v19) v1 ==== 82+0+0 (secure 0 0 0) 0x7fc2a0057620 con 0x7fc2a815b7c0 2024-09-13T18:29:18.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc28c0669f0 msgr2=0x7fc28c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc28c0669f0 0x7fc28c068eb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8154500 tx=0x7fc2a4008040 comp rx=0 tx=0).stop 2024-09-13T18:29:18.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 msgr2=0x7fc2a813b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a813b130 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000e780 tx=0x7fc2a000ec40 comp rx=0 tx=0).stop 2024-09-13T18:29:18.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 shutdown_connections 2024-09-13T18:29:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc28c0669f0 0x7fc28c068eb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a815b7c0 0x7fc2a813b130 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2a81582a0 0x7fc2a813abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 --2- 172.21.15.53:0/240293973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2a8070c90 0x7fc2a8138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 >> 172.21.15.53:0/240293973 conn(0x7fc2a8065c80 msgr2=0x7fc2a806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 shutdown_connections 2024-09-13T18:29:18.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.619+0000 7fc2b004a640 1 -- 172.21.15.53:0/240293973 wait complete. 2024-09-13T18:29:18.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e3789640 1 Processor -- start 2024-09-13T18:29:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e3789640 1 -- start start 2024-09-13T18:29:18.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e3789640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc3dc15c810 0x7fc3dc06a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e3789640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3dc15d9d0 0x7fc3dc06ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e3789640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc15dff0 con 0x7fc3dc15cbf0 2024-09-13T18:29:18.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e3789640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc15dde0 con 0x7fc3dc15d9d0 2024-09-13T18:29:18.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e3789640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc15e2d0 con 0x7fc3dc15c810 2024-09-13T18:29:18.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e1d26640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3dc15d9d0 0x7fc3dc06ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e0d24640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc3dc15cbf0 0x7fc3dc15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48846/0 (socket says 172.21.15.53:48846) 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e0d24640 1 -- 172.21.15.53:0/61325354 learned_addr learned my addr 172.21.15.53:0/61325354 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e1525640 1 --2- 172.21.15.53:0/61325354 >> v2:172.21.15.87:3300/0 conn(0x7fc3dc15c810 0x7fc3dc06a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3d3fff640 1 -- 172.21.15.53:0/61325354 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776106924 0 0) 0x7fc3dc15dff0 con 0x7fc3dc15cbf0 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e1d26640 1 -- 172.21.15.53:0/61325354 >> v2:172.21.15.87:3300/0 conn(0x7fc3dc15c810 msgr2=0x7fc3dc06a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e1d26640 1 --2- 172.21.15.53:0/61325354 >> v2:172.21.15.87:3300/0 conn(0x7fc3dc15c810 0x7fc3dc06a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e1d26640 1 -- 172.21.15.53:0/61325354 >> v1:172.21.15.53:6789/0 conn(0x7fc3dc15cbf0 legacy=0x7fc3dc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e1d26640 1 -- 172.21.15.53:0/61325354 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc15e5b0 con 0x7fc3dc15d9d0 2024-09-13T18:29:18.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.755+0000 7fc3e1525640 1 --2- 172.21.15.53:0/61325354 >> v2:172.21.15.87:3300/0 conn(0x7fc3dc15c810 0x7fc3dc06a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:18.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1d26640 1 --2- 172.21.15.53:0/61325354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15d9d0 0x7fc3dc06ac80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b3210 tx=0x7fc3d401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934787a42d188405 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3d3fff640 1 -- 172.21.15.53:0/61325354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40a5930 con 0x7fc3dc15d9d0 2024-09-13T18:29:18.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3d3fff640 1 -- 172.21.15.53:0/61325354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d40a5a90 con 0x7fc3dc15d9d0 2024-09-13T18:29:18.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3d3fff640 1 -- 172.21.15.53:0/61325354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40a5e20 con 0x7fc3dc15d9d0 2024-09-13T18:29:18.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- 172.21.15.53:0/61325354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15d9d0 msgr2=0x7fc3dc06ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 --2- 172.21.15.53:0/61325354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15d9d0 0x7fc3dc06ac80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b3210 tx=0x7fc3d401c870 comp rx=0 tx=0).stop 2024-09-13T18:29:18.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- 172.21.15.53:0/61325354 shutdown_connections 2024-09-13T18:29:18.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 --2- 172.21.15.53:0/61325354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15d9d0 0x7fc3dc06ac80 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 --2- 172.21.15.53:0/61325354 >> v2:172.21.15.87:3300/0 conn(0x7fc3dc15c810 0x7fc3dc06a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- 172.21.15.53:0/61325354 >> 172.21.15.53:0/61325354 conn(0x7fc3dc071a50 msgr2=0x7fc3dc099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:18.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- 172.21.15.53:0/61325354 shutdown_connections 2024-09-13T18:29:18.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- 172.21.15.53:0/61325354 wait complete. 2024-09-13T18:29:18.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 Processor -- start 2024-09-13T18:29:18.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- start start 2024-09-13T18:29:18.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15c810 0x7fc3dc157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3dc15cbf0 0x7fc3dc0adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3dc15d9d0 0x7fc3dc0ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0d13d0 con 0x7fc3dc15c810 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc09a5f0 con 0x7fc3dc15d9d0 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc157670 con 0x7fc3dc15cbf0 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15c810 0x7fc3dc157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15c810 0x7fc3dc157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53148/0 (socket says 172.21.15.53:53148) 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 -- 172.21.15.53:0/2340473407 learned_addr learned my addr 172.21.15.53:0/2340473407 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1d26640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3dc15d9d0 0x7fc3dc0ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e0d24640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3dc15cbf0 0x7fc3dc0adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 -- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3dc15cbf0 msgr2=0x7fc3dc0adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3dc15cbf0 0x7fc3dc0adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 -- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3dc15d9d0 msgr2=0x7fc3dc0ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3dc15d9d0 0x7fc3dc0ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 -- 172.21.15.53:0/2340473407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d4009a70 con 0x7fc3dc15c810 2024-09-13T18:29:18.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e1525640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15c810 0x7fc3dc157130 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c7c0 tx=0x7fc3d800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3d1ffb640 1 -- 172.21.15.53:0/2340473407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8007a30 con 0x7fc3dc15c810 2024-09-13T18:29:18.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3d1ffb640 1 -- 172.21.15.53:0/2340473407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d8007b90 con 0x7fc3dc15c810 2024-09-13T18:29:18.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc09dab0 con 0x7fc3dc15c810 2024-09-13T18:29:18.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3d1ffb640 1 -- 172.21.15.53:0/2340473407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800ce70 con 0x7fc3dc15c810 2024-09-13T18:29:18.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.759+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc09e070 con 0x7fc3dc15c810 2024-09-13T18:29:18.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.763+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc15d770 con 0x7fc3dc15c810 2024-09-13T18:29:18.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.763+0000 7fc3d1ffb640 1 -- 172.21.15.53:0/2340473407 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fc3d80113f0 con 0x7fc3dc15c810 2024-09-13T18:29:18.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.763+0000 7fc3d1ffb640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc3c00669f0 0x7fc3c0068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:18.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.763+0000 7fc3d1ffb640 1 -- 172.21.15.53:0/2340473407 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3d8084970 con 0x7fc3dc15c810 2024-09-13T18:29:18.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.763+0000 7fc3e0d24640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc3c00669f0 0x7fc3c0068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:18.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.763+0000 7fc3e0d24640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc3c00669f0 0x7fc3c0068eb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc15c230 tx=0x7fc3cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:18.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.767+0000 7fc3d1ffb640 1 -- 172.21.15.53:0/2340473407 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3d8051ad0 con 0x7fc3dc15c810 2024-09-13T18:29:18.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.927+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3dc09a760 con 0x7fc3dc15c810 2024-09-13T18:29:18.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.927+0000 7fc3d1ffb640 1 -- 172.21.15.53:0/2340473407 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12797 (secure 0 0 0) 0x7fc3d80550f0 con 0x7fc3dc15c810 2024-09-13T18:29:18.931 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:18.931 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":68,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:17.852720+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc3c00669f0 msgr2=0x7fc3c0068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc3c00669f0 0x7fc3c0068eb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc15c230 tx=0x7fc3cc009040 comp rx=0 tx=0).stop 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15c810 msgr2=0x7fc3dc157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15c810 0x7fc3dc157130 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c7c0 tx=0x7fc3d800cc80 comp rx=0 tx=0).stop 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 shutdown_connections 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc3c00669f0 0x7fc3c0068eb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc3dc15cbf0 0x7fc3dc0adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc3dc15d9d0 0x7fc3dc0ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 --2- 172.21.15.53:0/2340473407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3dc15c810 0x7fc3dc157130 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:18.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 >> 172.21.15.53:0/2340473407 conn(0x7fc3dc071a50 msgr2=0x7fc3dc06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:18.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 shutdown_connections 2024-09-13T18:29:18.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:18.931+0000 7fc3e3789640 1 -- 172.21.15.53:0/2340473407 wait complete. 2024-09-13T18:29:18.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:18.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.079+0000 7f878a1f5640 1 Processor -- start 2024-09-13T18:29:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.079+0000 7f878a1f5640 1 -- start start 2024-09-13T18:29:19.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f878a1f5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f878415c830 0x7f87840d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f878a1f5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87840ccd10 0x7f87840cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f878a1f5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87840d2c80 0x7f87840d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f878a1f5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840d3670 con 0x7f87840d2c80 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f878a1f5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840b7db0 con 0x7f878415c830 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f878a1f5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87840d0650 con 0x7f87840ccd10 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87840d2c80 0x7f87840d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87840d2c80 0x7f87840d3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53156/0 (socket says 172.21.15.53:53156) 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 -- 172.21.15.53:0/700216721 learned_addr learned my addr 172.21.15.53:0/700216721 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f87837fe640 1 --2- 172.21.15.53:0/700216721 >> v2:172.21.15.87:3300/0 conn(0x7f878415c830 0x7f87840d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8782ffd640 1 --2- 172.21.15.53:0/700216721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87840ccd10 0x7f87840cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 -- 172.21.15.53:0/700216721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87840ccd10 msgr2=0x7f87840cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 --2- 172.21.15.53:0/700216721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87840ccd10 0x7f87840cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 -- 172.21.15.53:0/700216721 >> v2:172.21.15.87:3300/0 conn(0x7f878415c830 msgr2=0x7f87840d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 --2- 172.21.15.53:0/700216721 >> v2:172.21.15.87:3300/0 conn(0x7f878415c830 0x7f87840d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 -- 172.21.15.53:0/700216721 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87840d0c10 con 0x7f87840d2c80 2024-09-13T18:29:19.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f87837fe640 1 --2- 172.21.15.53:0/700216721 >> v2:172.21.15.87:3300/0 conn(0x7f878415c830 0x7f87840d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:19.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f8783fff640 1 --2- 172.21.15.53:0/700216721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f87840d3130 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f87840d0240 tx=0x7f877c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273ddd568025ea0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f87827fc640 1 -- 172.21.15.53:0/700216721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0af400 con 0x7f87840d2c80 2024-09-13T18:29:19.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f87827fc640 1 -- 172.21.15.53:0/700216721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c0ab050 con 0x7f87840d2c80 2024-09-13T18:29:19.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.083+0000 7f87827fc640 1 -- 172.21.15.53:0/700216721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0af780 con 0x7f87840d2c80 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- 172.21.15.53:0/700216721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 msgr2=0x7f87840d3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 --2- 172.21.15.53:0/700216721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f87840d3130 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f87840d0240 tx=0x7f877c01f1e0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- 172.21.15.53:0/700216721 shutdown_connections 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 --2- 172.21.15.53:0/700216721 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87840ccd10 0x7f87840cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 --2- 172.21.15.53:0/700216721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f87840d3130 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 --2- 172.21.15.53:0/700216721 >> v2:172.21.15.87:3300/0 conn(0x7f878415c830 0x7f87840d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- 172.21.15.53:0/700216721 >> 172.21.15.53:0/700216721 conn(0x7f8784070970 msgr2=0x7f8784070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- 172.21.15.53:0/700216721 shutdown_connections 2024-09-13T18:29:19.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- 172.21.15.53:0/700216721 wait complete. 2024-09-13T18:29:19.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 Processor -- start 2024-09-13T18:29:19.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- start start 2024-09-13T18:29:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87840ccd10 0x7f8784156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f8784153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878415c830 0x7f87841f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87841503e0 con 0x7f87840d2c80 2024-09-13T18:29:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784157d50 con 0x7f87840ccd10 2024-09-13T18:29:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8784158030 con 0x7f878415c830 2024-09-13T18:29:19.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f8784153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f8784153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53158/0 (socket says 172.21.15.53:53158) 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 -- 172.21.15.53:0/3230267285 learned_addr learned my addr 172.21.15.53:0/3230267285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f87837fe640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87840ccd10 0x7f8784156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8783fff640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878415c830 0x7f87841f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 -- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878415c830 msgr2=0x7f87841f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878415c830 0x7f87841f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 -- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87840ccd10 msgr2=0x7f8784156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87840ccd10 0x7f8784156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 -- 172.21.15.53:0/3230267285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c009b30 con 0x7f87840d2c80 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8783fff640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878415c830 0x7f87841f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f8782ffd640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f8784153b10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f877800d5d0 tx=0x7f877800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f876bfff640 1 -- 172.21.15.53:0/3230267285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778004240 con 0x7f87840d2c80 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f876bfff640 1 -- 172.21.15.53:0/3230267285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87780043a0 con 0x7f87840d2c80 2024-09-13T18:29:19.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8784158310 con 0x7f87840d2c80 2024-09-13T18:29:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f876bfff640 1 -- 172.21.15.53:0/3230267285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778003840 con 0x7f87840d2c80 2024-09-13T18:29:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.087+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87841588d0 con 0x7f87840d2c80 2024-09-13T18:29:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.091+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87840cd150 con 0x7f87840d2c80 2024-09-13T18:29:19.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.091+0000 7f876bfff640 1 -- 172.21.15.53:0/3230267285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f87780039a0 con 0x7f87840d2c80 2024-09-13T18:29:19.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.091+0000 7f876bfff640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f87700669f0 0x7f8770068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.091+0000 7f876bfff640 1 -- 172.21.15.53:0/3230267285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8778084560 con 0x7f87840d2c80 2024-09-13T18:29:19.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.091+0000 7f87837fe640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f87700669f0 0x7f8770068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.091+0000 7f87837fe640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f87700669f0 0x7f8770068eb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f87840b7790 tx=0x7f8774008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.095+0000 7f876bfff640 1 -- 172.21.15.53:0/3230267285 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87780517a0 con 0x7f87840d2c80 2024-09-13T18:29:19.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.259+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87840b84a0 con 0x7f87840d2c80 2024-09-13T18:29:19.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.259+0000 7f876bfff640 1 -- 172.21.15.53:0/3230267285 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8778054dc0 con 0x7f87840d2c80 2024-09-13T18:29:19.262 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f87700669f0 msgr2=0x7f8770068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f87700669f0 0x7f8770068eb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f87840b7790 tx=0x7f8774008040 comp rx=0 tx=0).stop 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 msgr2=0x7f8784153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f8784153b10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f877800d5d0 tx=0x7f877800da90 comp rx=0 tx=0).stop 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 shutdown_connections 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f87700669f0 0x7f8770068eb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878415c830 0x7f87841f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87840d2c80 0x7f8784153b10 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 --2- 172.21.15.53:0/3230267285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87840ccd10 0x7f8784156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 >> 172.21.15.53:0/3230267285 conn(0x7f8784070970 msgr2=0x7f87840b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 shutdown_connections 2024-09-13T18:29:19.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.263+0000 7f878a1f5640 1 -- 172.21.15.53:0/3230267285 wait complete. 2024-09-13T18:29:19.281 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:29:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.403+0000 7f221590b640 1 Processor -- start 2024-09-13T18:29:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.403+0000 7f221590b640 1 -- start start 2024-09-13T18:29:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f221590b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22100b4bf0 0x7f22100b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f221590b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f221006dbf0 0x7f22100ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f221590b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221006ce80 con 0x7f22100cee80 2024-09-13T18:29:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f221590b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221015baa0 con 0x7f22100b4bf0 2024-09-13T18:29:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f221590b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22100cf650 con 0x7f221006dbf0 2024-09-13T18:29:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22100b4bf0 0x7f22100b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220e7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f221006dbf0 0x7f22100ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220f7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f22100cee80 0x7f2210065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:37142/0 (socket says 172.21.15.53:37142) 2024-09-13T18:29:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220f7fe640 1 -- 172.21.15.53:0/2011833702 learned_addr learned my addr 172.21.15.53:0/2011833702 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220effd640 1 -- 172.21.15.53:0/2011833702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f221006dbf0 msgr2=0x7f22100ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220effd640 1 --2- 172.21.15.53:0/2011833702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f221006dbf0 0x7f22100ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220effd640 1 -- 172.21.15.53:0/2011833702 >> v1:172.21.15.87:6789/0 conn(0x7f22100cee80 legacy=0x7f2210065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.407+0000 7f220effd640 1 -- 172.21.15.53:0/2011833702 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100b5510 con 0x7f22100b4bf0 2024-09-13T18:29:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f220effd640 1 --2- 172.21.15.53:0/2011833702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22100b4bf0 0x7f22100b4fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f52d635e98fbe271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f220dffb640 1 -- 172.21.15.53:0/2011833702 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000a5970 con 0x7f22100b4bf0 2024-09-13T18:29:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f220dffb640 1 -- 172.21.15.53:0/2011833702 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22000a5ad0 con 0x7f22100b4bf0 2024-09-13T18:29:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f220dffb640 1 -- 172.21.15.53:0/2011833702 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000a5e60 con 0x7f22100b4bf0 2024-09-13T18:29:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 -- 172.21.15.53:0/2011833702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22100b4bf0 msgr2=0x7f22100b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 --2- 172.21.15.53:0/2011833702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22100b4bf0 0x7f22100b4fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2200009d90 tx=0x7f220001c8b0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 -- 172.21.15.53:0/2011833702 shutdown_connections 2024-09-13T18:29:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 --2- 172.21.15.53:0/2011833702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f221006dbf0 0x7f22100ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 --2- 172.21.15.53:0/2011833702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22100b4bf0 0x7f22100b4fd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 -- 172.21.15.53:0/2011833702 >> 172.21.15.53:0/2011833702 conn(0x7f2210069f50 msgr2=0x7f221006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 -- 172.21.15.53:0/2011833702 shutdown_connections 2024-09-13T18:29:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 -- 172.21.15.53:0/2011833702 wait complete. 2024-09-13T18:29:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 Processor -- start 2024-09-13T18:29:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.411+0000 7f221590b640 1 -- start start 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006dbf0 0x7f22100b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22100b4bf0 0x7f22100c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22100cee80 0x7f2210151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22100b2f20 con 0x7f22100cee80 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22100ae820 con 0x7f221006dbf0 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22100b4420 con 0x7f22100b4bf0 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22100cee80 0x7f2210151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22100cee80 0x7f2210151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53174/0 (socket says 172.21.15.53:53174) 2024-09-13T18:29:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 -- 172.21.15.53:0/576506230 learned_addr learned my addr 172.21.15.53:0/576506230 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220effd640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006dbf0 0x7f22100b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220e7fc640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22100b4bf0 0x7f22100c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 -- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22100b4bf0 msgr2=0x7f22100c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22100b4bf0 0x7f22100c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 -- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006dbf0 msgr2=0x7f22100b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006dbf0 0x7f22100b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 -- 172.21.15.53:0/576506230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009a70 con 0x7f22100cee80 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220f7fe640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22100cee80 0x7f2210151c20 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f220800c400 tx=0x7f220800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f21f7fff640 1 -- 172.21.15.53:0/576506230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208005cf0 con 0x7f22100cee80 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f21f7fff640 1 -- 172.21.15.53:0/576506230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208005e50 con 0x7f22100cee80 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22100b49c0 con 0x7f22100cee80 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f21f7fff640 1 -- 172.21.15.53:0/576506230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22080072f0 con 0x7f22100cee80 2024-09-13T18:29:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22100ae540 con 0x7f22100cee80 2024-09-13T18:29:19.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2210159140 con 0x7f22100cee80 2024-09-13T18:29:19.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f21f7fff640 1 -- 172.21.15.53:0/576506230 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f2208007450 con 0x7f22100cee80 2024-09-13T18:29:19.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f21f7fff640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f21fc0669f0 0x7f21fc068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f21f7fff640 1 -- 172.21.15.53:0/576506230 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2208083890 con 0x7f22100cee80 2024-09-13T18:29:19.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.415+0000 7f220effd640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f21fc0669f0 0x7f21fc068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.419+0000 7f220effd640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f21fc0669f0 0x7f21fc068eb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f22000af000 tx=0x7f22000a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.419+0000 7f21f7fff640 1 -- 172.21.15.53:0/576506230 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2210159140 con 0x7f22100cee80 2024-09-13T18:29:19.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.583+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2210159140 con 0x7f22100cee80 2024-09-13T18:29:19.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.583+0000 7f21f7fff640 1 -- 172.21.15.53:0/576506230 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2210159140 con 0x7f22100cee80 2024-09-13T18:29:19.586 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:19.586 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:29:19.586 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:19.587 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:29:19.587 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:29:19.587 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:19.587 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f21fc0669f0 msgr2=0x7f21fc068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f21fc0669f0 0x7f21fc068eb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f22000af000 tx=0x7f22000a7070 comp rx=0 tx=0).stop 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22100cee80 msgr2=0x7f2210151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22100cee80 0x7f2210151c20 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f220800c400 tx=0x7f220800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 shutdown_connections 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f21fc0669f0 0x7f21fc068eb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22100b4bf0 0x7f22100c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22100cee80 0x7f2210151c20 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 --2- 172.21.15.53:0/576506230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006dbf0 0x7f22100b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 >> 172.21.15.53:0/576506230 conn(0x7f2210069f50 msgr2=0x7f2210065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 shutdown_connections 2024-09-13T18:29:19.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.587+0000 7f221590b640 1 -- 172.21.15.53:0/576506230 wait complete. 2024-09-13T18:29:19.606 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:29:19.606 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:29:19.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc7bcc1640 1 Processor -- start 2024-09-13T18:29:19.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc7bcc1640 1 -- start start 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc7bcc1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 0x7fcc74143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc7bcc1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc740b1ba0 con 0x7fcc740cd6f0 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc7bcc1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc740b3020 con 0x7fcc74143d50 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc7bcc1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740b1f80 con 0x7fcc740cdad0 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc79a5d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcc740cd6f0 0x7fcc740b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48852/0 (socket says 172.21.15.53:48852) 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc79a5d640 1 -- 172.21.15.53:0/1502900838 learned_addr learned my addr 172.21.15.53:0/1502900838 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc7925c640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 0x7fcc74143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403423507 0 0) 0x7fcc740b1ba0 con 0x7fcc740cd6f0 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc60003530 con 0x7fcc740cd6f0 2024-09-13T18:29:19.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913742963 0 0) 0x7fcc60003530 con 0x7fcc740cd6f0 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 msgr2=0x7fcc74143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 0x7fcc74143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 >> v1:172.21.15.87:6789/0 conn(0x7fcc74143d50 legacy=0x7fcc7406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc740b2260 con 0x7fcc740cd6f0 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fcc70001680 con 0x7fcc740cd6f0 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 >> v1:172.21.15.53:6789/0 conn(0x7fcc740cd6f0 legacy=0x7fcc740b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc600047d0 0x7fcc60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 0x7fcc60005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740b1f80 con 0x7fcc600039b0 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6000ba40 con 0x7fcc600047d0 2024-09-13T18:29:19.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6000bc00 con 0x7fcc740cdad0 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.727+0000 7fcc79a5d640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7925c640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc600047d0 0x7fcc60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7a25e640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 0x7fcc60005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc79a5d640 1 -- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 msgr2=0x7fcc60005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc79a5d640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc740cdad0 0x7fcc60005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc79a5d640 1 -- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc600047d0 msgr2=0x7fcc60004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc79a5d640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc600047d0 0x7fcc60004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc79a5d640 1 -- 172.21.15.53:0/1502900838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc60003530 con 0x7fcc600039b0 2024-09-13T18:29:19.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7925c640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc600047d0 0x7fcc60004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc79a5d640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c190 tx=0x7fcc7001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64244c1c857244b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70005ae0 con 0x7fcc600039b0 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70005c60 con 0x7fcc600039b0 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc78a5b640 1 -- 172.21.15.53:0/1502900838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc700a57c0 con 0x7fcc600039b0 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/1502900838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 msgr2=0x7fcc60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7bcc1640 1 --2- 172.21.15.53:0/1502900838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c190 tx=0x7fcc7001cbd0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7a25e640 1 -- 172.21.15.53:0/1502900838 reap_dead start 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/1502900838 shutdown_connections 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/1502900838 >> 172.21.15.53:0/1502900838 conn(0x7fcc74073330 msgr2=0x7fcc74065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/1502900838 shutdown_connections 2024-09-13T18:29:19.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.731+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/1502900838 wait complete. 2024-09-13T18:29:19.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 Processor -- start 2024-09-13T18:29:19.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 -- start start 2024-09-13T18:29:19.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc741607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc741400f0 0x7fcc741417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc74141d10 0x7fcc7415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc74142190 con 0x7fcc600039b0 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740a8e80 con 0x7fcc74141d10 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740a9160 con 0x7fcc741400f0 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc741607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc741607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53194/0 (socket says 172.21.15.53:53194) 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 -- 172.21.15.53:0/313852215 learned_addr learned my addr 172.21.15.53:0/313852215 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7925c640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc741400f0 0x7fcc741417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7a25e640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc74141d10 0x7fcc7415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 -- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc741400f0 msgr2=0x7fcc741417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc741400f0 0x7fcc741417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 -- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc74141d10 msgr2=0x7fcc7415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc74141d10 0x7fcc7415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 -- 172.21.15.53:0/313852215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc740a9440 con 0x7fcc600039b0 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc79a5d640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc741607b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fcc7001ca00 tx=0x7fcc60005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc6a7fc640 1 -- 172.21.15.53:0/313852215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc700b4070 con 0x7fcc600039b0 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc6a7fc640 1 -- 172.21.15.53:0/313852215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc70005e90 con 0x7fcc600039b0 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc740a9720 con 0x7fcc600039b0 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc6a7fc640 1 -- 172.21.15.53:0/313852215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70001660 con 0x7fcc600039b0 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc74160cf0 con 0x7fcc600039b0 2024-09-13T18:29:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7406b320 con 0x7fcc600039b0 2024-09-13T18:29:19.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.735+0000 7fcc6a7fc640 1 -- 172.21.15.53:0/313852215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fcc700a57c0 con 0x7fcc600039b0 2024-09-13T18:29:19.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.739+0000 7fcc6a7fc640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc58066a20 0x7fcc58068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:19.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.739+0000 7fcc6a7fc640 1 -- 172.21.15.53:0/313852215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcc7011dea0 con 0x7fcc600039b0 2024-09-13T18:29:19.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.739+0000 7fcc7925c640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc58066a20 0x7fcc58068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:19.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.739+0000 7fcc7925c640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc58066a20 0x7fcc58068ee0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcc740ca6b0 tx=0x7fcc64008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:19.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.743+0000 7fcc6a7fc640 1 -- 172.21.15.53:0/313852215 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcc700eb050 con 0x7fcc600039b0 2024-09-13T18:29:19.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:19.903+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcc740ad730 con 0x7fcc600039b0 2024-09-13T18:29:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.767+0000 7fcc6a7fc640 1 -- 172.21.15.53:0/313852215 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcc700ee670 con 0x7fcc600039b0 2024-09-13T18:29:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:29:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc58066a20 msgr2=0x7fcc58068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc58066a20 0x7fcc58068ee0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcc740ca6b0 tx=0x7fcc64008040 comp rx=0 tx=0).stop 2024-09-13T18:29:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 msgr2=0x7fcc741607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc741607b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fcc7001ca00 tx=0x7fcc60005800 comp rx=0 tx=0).stop 2024-09-13T18:29:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 shutdown_connections 2024-09-13T18:29:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc58066a20 0x7fcc58068ee0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc741400f0 0x7fcc741417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc74141d10 0x7fcc7415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 --2- 172.21.15.53:0/313852215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc600039b0 0x7fcc741607b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.775+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 >> 172.21.15.53:0/313852215 conn(0x7fcc74073330 msgr2=0x7fcc740af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.779+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 shutdown_connections 2024-09-13T18:29:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.779+0000 7fcc7bcc1640 1 -- 172.21.15.53:0/313852215 wait complete. 2024-09-13T18:29:20.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:29:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba84d17640 1 Processor -- start 2024-09-13T18:29:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba84d17640 1 -- start start 2024-09-13T18:29:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba84d17640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba800d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba84d17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba800d3390 0x7fba800cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba84d17640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba800b7db0 con 0x7fba800ccd10 2024-09-13T18:29:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba84d17640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba800d0650 con 0x7fba800d3390 2024-09-13T18:29:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba84d17640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba800d0c10 con 0x7fba8015c830 2024-09-13T18:29:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba800d3390 0x7fba800cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba800d3390 0x7fba800cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53196/0 (socket says 172.21.15.53:53196) 2024-09-13T18:29:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7ed9d640 1 -- 172.21.15.53:0/3348218658 learned_addr learned my addr 172.21.15.53:0/3348218658 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:20.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7e59c640 1 --2- 172.21.15.53:0/3348218658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba800d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7ed9d640 1 -- 172.21.15.53:0/3348218658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 msgr2=0x7fba800d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7ed9d640 1 --2- 172.21.15.53:0/3348218658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba800d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7ed9d640 1 -- 172.21.15.53:0/3348218658 >> v1:172.21.15.87:6789/0 conn(0x7fba800ccd10 legacy=0x7fba800d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:20.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.939+0000 7fba7ed9d640 1 -- 172.21.15.53:0/3348218658 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba800cd7d0 con 0x7fba800d3390 2024-09-13T18:29:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7ed9d640 1 --2- 172.21.15.53:0/3348218658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800d3390 0x7fba800cd150 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fba78009e50 tx=0x7fba7801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ae9fe0aa4d229e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7d59a640 1 -- 172.21.15.53:0/3348218658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780a5760 con 0x7fba800d3390 2024-09-13T18:29:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7d59a640 1 -- 172.21.15.53:0/3348218658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba780a58c0 con 0x7fba800d3390 2024-09-13T18:29:20.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7d59a640 1 -- 172.21.15.53:0/3348218658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780a5c50 con 0x7fba800d3390 2024-09-13T18:29:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- 172.21.15.53:0/3348218658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800d3390 msgr2=0x7fba800cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 --2- 172.21.15.53:0/3348218658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800d3390 0x7fba800cd150 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fba78009e50 tx=0x7fba7801c9f0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- 172.21.15.53:0/3348218658 shutdown_connections 2024-09-13T18:29:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 --2- 172.21.15.53:0/3348218658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800d3390 0x7fba800cd150 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 --2- 172.21.15.53:0/3348218658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba800d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- 172.21.15.53:0/3348218658 >> 172.21.15.53:0/3348218658 conn(0x7fba80070970 msgr2=0x7fba80070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- 172.21.15.53:0/3348218658 shutdown_connections 2024-09-13T18:29:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- 172.21.15.53:0/3348218658 wait complete. 2024-09-13T18:29:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 Processor -- start 2024-09-13T18:29:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- start start 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800ccd10 0x7fba800ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800d3390 0x7fba800cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba801523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba800cb890 con 0x7fba800ccd10 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba801531c0 con 0x7fba800d3390 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba84d17640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba800caa30 con 0x7fba8015c830 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800ccd10 0x7fba800ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800ccd10 0x7fba800ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53198/0 (socket says 172.21.15.53:53198) 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7e59c640 1 -- 172.21.15.53:0/743675998 learned_addr learned my addr 172.21.15.53:0/743675998 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.943+0000 7fba7ed9d640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba801523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7dd9b640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800d3390 0x7fba800cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7e59c640 1 -- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 msgr2=0x7fba801523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7e59c640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba801523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7e59c640 1 -- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800d3390 msgr2=0x7fba800cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7e59c640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800d3390 0x7fba800cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7e59c640 1 -- 172.21.15.53:0/743675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009b30 con 0x7fba800ccd10 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7e59c640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800ccd10 0x7fba800ca4f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c7f0 tx=0x7fba6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba76ffd640 1 -- 172.21.15.53:0/743675998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68007820 con 0x7fba800ccd10 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba76ffd640 1 -- 172.21.15.53:0/743675998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68007980 con 0x7fba800ccd10 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8015c270 con 0x7fba800ccd10 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8015bf90 con 0x7fba800ccd10 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba76ffd640 1 -- 172.21.15.53:0/743675998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68007d30 con 0x7fba800ccd10 2024-09-13T18:29:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba64005260 con 0x7fba800ccd10 2024-09-13T18:29:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba76ffd640 1 -- 172.21.15.53:0/743675998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fba68024480 con 0x7fba800ccd10 2024-09-13T18:29:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba76ffd640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fba600669f0 0x7fba60068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:20.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba76ffd640 1 -- 172.21.15.53:0/743675998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fba68084c50 con 0x7fba800ccd10 2024-09-13T18:29:20.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.947+0000 7fba7dd9b640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fba600669f0 0x7fba60068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:20.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.951+0000 7fba7dd9b640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fba600669f0 0x7fba60068eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba80152ee0 tx=0x7fba70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:20.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:20.951+0000 7fba76ffd640 1 -- 172.21.15.53:0/743675998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba68051d50 con 0x7fba800ccd10 2024-09-13T18:29:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.111+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fba64005510 con 0x7fba800ccd10 2024-09-13T18:29:21.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.783+0000 7fba76ffd640 1 -- 172.21.15.53:0/743675998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7fba68055370 con 0x7fba800ccd10 2024-09-13T18:29:21.788 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fba600669f0 msgr2=0x7fba60068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fba600669f0 0x7fba60068eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba80152ee0 tx=0x7fba70009040 comp rx=0 tx=0).stop 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800ccd10 msgr2=0x7fba800ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800ccd10 0x7fba800ca4f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c7f0 tx=0x7fba6800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 shutdown_connections 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fba600669f0 0x7fba60068eb0 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba80152ee0 tx=0x7fba70009040 comp rx=0 tx=0).stop 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba8015c830 0x7fba801523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba800d3390 0x7fba800cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 --2- 172.21.15.53:0/743675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800ccd10 0x7fba800ca4f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.799+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 >> 172.21.15.53:0/743675998 conn(0x7fba80070970 msgr2=0x7fba800d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:21.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.803+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 shutdown_connections 2024-09-13T18:29:21.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.803+0000 7fba84d17640 1 -- 172.21.15.53:0/743675998 wait complete. 2024-09-13T18:29:21.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:29:21.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.955+0000 7fa3e0200640 1 Processor -- start 2024-09-13T18:29:21.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.955+0000 7fa3e0200640 1 -- start start 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3e0200640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3d815c830 0x7fa3d80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3e0200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 0x7fa3d80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3e0200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d80b7db0 con 0x7fa3d80d2c80 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3e0200640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d80d0650 con 0x7fa3d815c830 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3e0200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80d0c10 con 0x7fa3d80ccd10 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3de79d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa3d80d2c80 0x7fa3d80b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48862/0 (socket says 172.21.15.53:48862) 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3de79d640 1 -- 172.21.15.53:0/3142192015 learned_addr learned my addr 172.21.15.53:0/3142192015 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/3142192015 >> v2:172.21.15.87:3300/0 conn(0x7fa3d815c830 0x7fa3d80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dd79b640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 0x7fa3d80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704138640 0 0) 0x7fa3d80b7db0 con 0x7fa3d80d2c80 2024-09-13T18:29:21.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c4003530 con 0x7fa3d80d2c80 2024-09-13T18:29:21.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3833027264 0 0) 0x7fa3c4003530 con 0x7fa3d80d2c80 2024-09-13T18:29:21.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 msgr2=0x7fa3d80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 0x7fa3d80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 >> v2:172.21.15.87:3300/0 conn(0x7fa3d815c830 msgr2=0x7fa3d80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 --2- 172.21.15.53:0/3142192015 >> v2:172.21.15.87:3300/0 conn(0x7fa3d815c830 0x7fa3d80d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d80cd7d0 con 0x7fa3d80d2c80 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa3d0001a00 con 0x7fa3d80d2c80 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 >> v1:172.21.15.53:6789/0 conn(0x7fa3d80d2c80 legacy=0x7fa3d80b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4003980 0x7fa3c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c40047d0 0x7fa3c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 0x7fa3c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80d0650 con 0x7fa3c4003980 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80d0c10 con 0x7fa3c40047d0 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c400b990 con 0x7fa3d80ccd10 2024-09-13T18:29:21.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4003980 0x7fa3c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dd79b640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c40047d0 0x7fa3c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3de79d640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 0x7fa3c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3ddf9c640 1 -- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 msgr2=0x7fa3c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d80ccd10 0x7fa3c4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3ddf9c640 1 -- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c40047d0 msgr2=0x7fa3c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c40047d0 0x7fa3c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3ddf9c640 1 -- 172.21.15.53:0/3142192015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4003530 con 0x7fa3c4003980 2024-09-13T18:29:21.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.959+0000 7fa3dd79b640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3c40047d0 0x7fa3c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4003980 0x7fa3c4003da0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009ae0 tx=0x7fa3d401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50bf660f48ca888 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40a8410 con 0x7fa3c4003980 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d40a8570 con 0x7fa3c4003980 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3dcf9a640 1 -- 172.21.15.53:0/3142192015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40a8920 con 0x7fa3c4003980 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- 172.21.15.53:0/3142192015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4003980 msgr2=0x7fa3c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 --2- 172.21.15.53:0/3142192015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4003980 0x7fa3c4003da0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009ae0 tx=0x7fa3d401cab0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 -- 172.21.15.53:0/3142192015 reap_dead start 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- 172.21.15.53:0/3142192015 shutdown_connections 2024-09-13T18:29:21.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- 172.21.15.53:0/3142192015 >> 172.21.15.53:0/3142192015 conn(0x7fa3d8070970 msgr2=0x7fa3d8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- 172.21.15.53:0/3142192015 shutdown_connections 2024-09-13T18:29:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- 172.21.15.53:0/3142192015 wait complete. 2024-09-13T18:29:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 Processor -- start 2024-09-13T18:29:21.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- start start 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3c4003980 0x7fa3d814e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d815dd60 0x7fa3d8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d81576a0 0x7fa3d8157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8162e20 con 0x7fa3d81576a0 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d815a170 con 0x7fa3d815dd60 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3e0200640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d815a450 con 0x7fa3c4003980 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d81576a0 0x7fa3d8157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d81576a0 0x7fa3d8157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53218/0 (socket says 172.21.15.53:53218) 2024-09-13T18:29:21.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 -- 172.21.15.53:0/1247853651 learned_addr learned my addr 172.21.15.53:0/1247853651 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3c4003980 0x7fa3d814e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3dd79b640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d815dd60 0x7fa3d8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 -- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3c4003980 msgr2=0x7fa3d814e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3c4003980 0x7fa3d814e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 -- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d815dd60 msgr2=0x7fa3d8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d815dd60 0x7fa3d8157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.963+0000 7fa3de79d640 1 -- 172.21.15.53:0/1247853651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d815a730 con 0x7fa3d81576a0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3de79d640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d81576a0 0x7fa3d8157b40 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa3d806aec0 tx=0x7fa3d000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ce7fc640 1 -- 172.21.15.53:0/1247853651 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004d70 con 0x7fa3d81576a0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ce7fc640 1 -- 172.21.15.53:0/1247853651 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d000bb80 con 0x7fa3d81576a0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d815aa10 con 0x7fa3d81576a0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ce7fc640 1 -- 172.21.15.53:0/1247853651 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0007110 con 0x7fa3d81576a0 2024-09-13T18:29:21.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d8159df0 con 0x7fa3d81576a0 2024-09-13T18:29:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d80d1080 con 0x7fa3d81576a0 2024-09-13T18:29:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ce7fc640 1 -- 172.21.15.53:0/1247853651 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fa3d0007270 con 0x7fa3d81576a0 2024-09-13T18:29:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ce7fc640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa3bc0669f0 0x7fa3bc068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ce7fc640 1 -- 172.21.15.53:0/1247853651 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa3d00851d0 con 0x7fa3d81576a0 2024-09-13T18:29:21.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa3bc0669f0 0x7fa3bc068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:21.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.967+0000 7fa3ddf9c640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa3bc0669f0 0x7fa3bc068eb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40af000 tx=0x7fa3d40b2040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:21.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:21.971+0000 7fa3ce7fc640 1 -- 172.21.15.53:0/1247853651 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3d0052210 con 0x7fa3d81576a0 2024-09-13T18:29:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.167+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa3d80d15b0 con 0x7fa3d81576a0 2024-09-13T18:29:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.175+0000 7fa3ce7fc640 1 -- 172.21.15.53:0/1247853651 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa3d0055830 con 0x7fa3d81576a0 2024-09-13T18:29:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 10 and data pool 11 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa3bc0669f0 msgr2=0x7fa3bc068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa3bc0669f0 0x7fa3bc068eb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40af000 tx=0x7fa3d40b2040 comp rx=0 tx=0).stop 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d81576a0 msgr2=0x7fa3d8157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d81576a0 0x7fa3d8157b40 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa3d806aec0 tx=0x7fa3d000b4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 shutdown_connections 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa3bc0669f0 0x7fa3bc068eb0 secure :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40af000 tx=0x7fa3d40b2040 comp rx=0 tx=0).stop 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d81576a0 0x7fa3d8157b40 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d815dd60 0x7fa3d8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 --2- 172.21.15.53:0/1247853651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3c4003980 0x7fa3d814e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.183+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 >> 172.21.15.53:0/1247853651 conn(0x7fa3d8070970 msgr2=0x7fa3d8165ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:22.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.191+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 shutdown_connections 2024-09-13T18:29:22.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.191+0000 7fa3e0200640 1 -- 172.21.15.53:0/1247853651 wait complete. 2024-09-13T18:29:22.216 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:22.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.327+0000 7f42d81b3640 1 Processor -- start 2024-09-13T18:29:22.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.327+0000 7f42d81b3640 1 -- start start 2024-09-13T18:29:22.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d81b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d81b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42d015b7c0 0x7f42d006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d81b3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d006d480 con 0x7f42d0070c90 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d81b3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d015aaf0 con 0x7f42d015b7c0 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d81b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d006d760 con 0x7f42d01582a0 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42d015b7c0 0x7f42d006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42d015b7c0 0x7f42d006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53224/0 (socket says 172.21.15.53:53224) 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 -- 172.21.15.53:0/75485639 learned_addr learned my addr 172.21.15.53:0/75485639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d5f4f640 1 --2- 172.21.15.53:0/75485639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 -- 172.21.15.53:0/75485639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 msgr2=0x7f42d006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 --2- 172.21.15.53:0/75485639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 -- 172.21.15.53:0/75485639 >> v1:172.21.15.87:6789/0 conn(0x7f42d0070c90 legacy=0x7f42d006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 -- 172.21.15.53:0/75485639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d015ace0 con 0x7f42d015b7c0 2024-09-13T18:29:22.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d5f4f640 1 --2- 172.21.15.53:0/75485639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:22.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d574e640 1 --2- 172.21.15.53:0/75485639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d006ce40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009870 tx=0x7f42c001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6411a6f3f58acd6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d4f4d640 1 -- 172.21.15.53:0/75485639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00ac410 con 0x7f42d015b7c0 2024-09-13T18:29:22.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d4f4d640 1 -- 172.21.15.53:0/75485639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c00ac570 con 0x7f42d015b7c0 2024-09-13T18:29:22.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.331+0000 7f42d4f4d640 1 -- 172.21.15.53:0/75485639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00ac900 con 0x7f42d015b7c0 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- 172.21.15.53:0/75485639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 msgr2=0x7f42d006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 --2- 172.21.15.53:0/75485639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d006ce40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009870 tx=0x7f42c001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- 172.21.15.53:0/75485639 shutdown_connections 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 --2- 172.21.15.53:0/75485639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d006ce40 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 --2- 172.21.15.53:0/75485639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- 172.21.15.53:0/75485639 >> 172.21.15.53:0/75485639 conn(0x7f42d0065c80 msgr2=0x7f42d0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- 172.21.15.53:0/75485639 shutdown_connections 2024-09-13T18:29:22.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- 172.21.15.53:0/75485639 wait complete. 2024-09-13T18:29:22.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 Processor -- start 2024-09-13T18:29:22.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- start start 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d0070c90 0x7f42d00b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d013d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00b1c80 con 0x7f42d015b7c0 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00b25e0 con 0x7f42d0070c90 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d0150fc0 con 0x7f42d01582a0 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d013d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d013d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53236/0 (socket says 172.21.15.53:53236) 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 -- 172.21.15.53:0/2242103996 learned_addr learned my addr 172.21.15.53:0/2242103996 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d5f4f640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d0070c90 0x7f42d00b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d574e640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 -- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 msgr2=0x7f42d014ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d014ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 -- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d0070c90 msgr2=0x7f42d00b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d0070c90 0x7f42d00b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 -- 172.21.15.53:0/2242103996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00094d0 con 0x7f42d015b7c0 2024-09-13T18:29:22.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d6750640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d013d9d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c780 tx=0x7f42c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42c67fc640 1 -- 172.21.15.53:0/2242103996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8004b70 con 0x7f42d015b7c0 2024-09-13T18:29:22.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42c67fc640 1 -- 172.21.15.53:0/2242103996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800ce90 con 0x7f42d015b7c0 2024-09-13T18:29:22.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d0150ce0 con 0x7f42d015b7c0 2024-09-13T18:29:22.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.335+0000 7f42c67fc640 1 -- 172.21.15.53:0/2242103996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800a850 con 0x7f42d015b7c0 2024-09-13T18:29:22.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.339+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d00b18a0 con 0x7f42d015b7c0 2024-09-13T18:29:22.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.339+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d0067400 con 0x7f42d015b7c0 2024-09-13T18:29:22.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.339+0000 7f42c67fc640 1 -- 172.21.15.53:0/2242103996 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f42c8006b60 con 0x7f42d015b7c0 2024-09-13T18:29:22.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.339+0000 7f42c67fc640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f42b40669f0 0x7f42b4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.339+0000 7f42c67fc640 1 -- 172.21.15.53:0/2242103996 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42c8084f30 con 0x7f42d015b7c0 2024-09-13T18:29:22.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.339+0000 7f42d5f4f640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f42b40669f0 0x7f42b4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.339+0000 7f42d5f4f640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f42b40669f0 0x7f42b4068eb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00ab60 tx=0x7f42cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.343+0000 7f42c67fc640 1 -- 172.21.15.53:0/2242103996 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42c80b0db0 con 0x7f42d015b7c0 2024-09-13T18:29:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.499+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42d00b1dc0 con 0x7f42d015b7c0 2024-09-13T18:29:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42c67fc640 1 -- 172.21.15.53:0/2242103996 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16521 (secure 0 0 0) 0x7f42d00b1dc0 con 0x7f42d015b7c0 2024-09-13T18:29:22.505 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:22.505 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":71,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:22.170041+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f42b40669f0 msgr2=0x7f42b4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f42b40669f0 0x7f42b4068eb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00ab60 tx=0x7f42cc008040 comp rx=0 tx=0).stop 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 msgr2=0x7f42d013d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d013d9d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c780 tx=0x7f42c800cc40 comp rx=0 tx=0).stop 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 shutdown_connections 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f42b40669f0 0x7f42b4068eb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d01582a0 0x7f42d014ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d015b7c0 0x7f42d013d9d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 --2- 172.21.15.53:0/2242103996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d0070c90 0x7f42d00b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 >> 172.21.15.53:0/2242103996 conn(0x7f42d0065c80 msgr2=0x7f42d0151260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 shutdown_connections 2024-09-13T18:29:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.503+0000 7f42d81b3640 1 -- 172.21.15.53:0/2242103996 wait complete. 2024-09-13T18:29:22.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e2742640 1 Processor -- start 2024-09-13T18:29:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e2742640 1 -- start start 2024-09-13T18:29:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e2742640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc1582a0 0x7fb9dc06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e2742640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9dc0713a0 0x7fb9dc06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e2742640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc06d480 con 0x7fb9dc15b7c0 2024-09-13T18:29:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e2742640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc15aaf0 con 0x7fb9dc0713a0 2024-09-13T18:29:22.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e2742640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc06d760 con 0x7fb9dc1582a0 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e0cdf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9dc0713a0 0x7fb9dc06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e0cdf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9dc0713a0 0x7fb9dc06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53242/0 (socket says 172.21.15.53:53242) 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9db7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb9dc15b7c0 0x7fb9dc070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48876/0 (socket says 172.21.15.53:48876) 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e0cdf640 1 -- 172.21.15.53:0/1167029812 learned_addr learned my addr 172.21.15.53:0/1167029812 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9dbfff640 1 --2- 172.21.15.53:0/1167029812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc1582a0 0x7fb9dc06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e0cdf640 1 -- 172.21.15.53:0/1167029812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc1582a0 msgr2=0x7fb9dc06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e0cdf640 1 --2- 172.21.15.53:0/1167029812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc1582a0 0x7fb9dc06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e0cdf640 1 -- 172.21.15.53:0/1167029812 >> v1:172.21.15.53:6789/0 conn(0x7fb9dc15b7c0 legacy=0x7fb9dc070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9daffd640 1 -- 172.21.15.53:0/1167029812 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956135308 0 0) 0x7fb9dc06d480 con 0x7fb9dc15b7c0 2024-09-13T18:29:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.643+0000 7fb9e0cdf640 1 -- 172.21.15.53:0/1167029812 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc15ace0 con 0x7fb9dc0713a0 2024-09-13T18:29:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e0cdf640 1 --2- 172.21.15.53:0/1167029812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc06ce40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009870 tx=0x7fb9d401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859ed27b65a01d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9daffd640 1 -- 172.21.15.53:0/1167029812 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40a95f0 con 0x7fb9dc0713a0 2024-09-13T18:29:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9daffd640 1 -- 172.21.15.53:0/1167029812 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40a9750 con 0x7fb9dc0713a0 2024-09-13T18:29:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9daffd640 1 -- 172.21.15.53:0/1167029812 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40a9ae0 con 0x7fb9dc0713a0 2024-09-13T18:29:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- 172.21.15.53:0/1167029812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 msgr2=0x7fb9dc06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1167029812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc06ce40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009870 tx=0x7fb9d401c530 comp rx=0 tx=0).stop 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- 172.21.15.53:0/1167029812 shutdown_connections 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1167029812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc06ce40 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1167029812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc1582a0 0x7fb9dc06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- 172.21.15.53:0/1167029812 >> 172.21.15.53:0/1167029812 conn(0x7fb9dc065c80 msgr2=0x7fb9dc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- 172.21.15.53:0/1167029812 shutdown_connections 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- 172.21.15.53:0/1167029812 wait complete. 2024-09-13T18:29:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 Processor -- start 2024-09-13T18:29:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- start start 2024-09-13T18:29:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc13bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc1582a0 0x7fb9dc0ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc15b7c0 0x7fb9dc0ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0b2340 con 0x7fb9dc0713a0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc13c1b0 con 0x7fb9dc1582a0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc14ec70 con 0x7fb9dc15b7c0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc13bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc13bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53250/0 (socket says 172.21.15.53:53250) 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 -- 172.21.15.53:0/1708990063 learned_addr learned my addr 172.21.15.53:0/1708990063 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e0cdf640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc15b7c0 0x7fb9dc0ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 -- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc15b7c0 msgr2=0x7fb9dc0ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9db7fe640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc1582a0 0x7fb9dc0ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc15b7c0 0x7fb9dc0ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 -- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc1582a0 msgr2=0x7fb9dc0ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc1582a0 0x7fb9dc0ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 -- 172.21.15.53:0/1708990063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40094d0 con 0x7fb9dc0713a0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9dbfff640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc13bc70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007ef0 tx=0x7fb9cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9d8ff9640 1 -- 172.21.15.53:0/1708990063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc014620 con 0x7fb9dc0713a0 2024-09-13T18:29:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9d8ff9640 1 -- 172.21.15.53:0/1708990063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc014780 con 0x7fb9dc0713a0 2024-09-13T18:29:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc0b16c0 con 0x7fb9dc0713a0 2024-09-13T18:29:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9d8ff9640 1 -- 172.21.15.53:0/1708990063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc014b30 con 0x7fb9dc0713a0 2024-09-13T18:29:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.647+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc0b1c80 con 0x7fb9dc0713a0 2024-09-13T18:29:22.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.651+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc067400 con 0x7fb9dc0713a0 2024-09-13T18:29:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.651+0000 7fb9d8ff9640 1 -- 172.21.15.53:0/1708990063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fb9cc014c90 con 0x7fb9dc0713a0 2024-09-13T18:29:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.651+0000 7fb9d8ff9640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb9c80669f0 0x7fb9c8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.651+0000 7fb9d8ff9640 1 -- 172.21.15.53:0/1708990063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9cc085f40 con 0x7fb9dc0713a0 2024-09-13T18:29:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.651+0000 7fb9db7fe640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb9c80669f0 0x7fb9c8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.651+0000 7fb9db7fe640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb9c80669f0 0x7fb9c8068eb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0cc390 tx=0x7fb9d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.655+0000 7fb9d8ff9640 1 -- 172.21.15.53:0/1708990063 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb9cc052f10 con 0x7fb9dc0713a0 2024-09-13T18:29:22.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.819+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9dc0afe70 con 0x7fb9dc0713a0 2024-09-13T18:29:22.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9d8ff9640 1 -- 172.21.15.53:0/1708990063 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16521 (secure 0 0 0) 0x7fb9cc01b310 con 0x7fb9dc0713a0 2024-09-13T18:29:22.825 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:22.825 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":71,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:22.170041+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb9c80669f0 msgr2=0x7fb9c8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb9c80669f0 0x7fb9c8068eb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0cc390 tx=0x7fb9d0009040 comp rx=0 tx=0).stop 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 msgr2=0x7fb9dc13bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc13bc70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007ef0 tx=0x7fb9cc00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 shutdown_connections 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb9c80669f0 0x7fb9c8068eb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9dc15b7c0 0x7fb9dc0ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9dc1582a0 0x7fb9dc0ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 --2- 172.21.15.53:0/1708990063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9dc0713a0 0x7fb9dc13bc70 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 >> 172.21.15.53:0/1708990063 conn(0x7fb9dc065c80 msgr2=0x7fb9dc06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:22.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 shutdown_connections 2024-09-13T18:29:22.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.823+0000 7fb9e2742640 1 -- 172.21.15.53:0/1708990063 wait complete. 2024-09-13T18:29:22.843 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:29:22.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d9e39c640 1 Processor -- start 2024-09-13T18:29:22.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d9e39c640 1 -- start start 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d9e39c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d9815c830 0x7f8d980d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d9e39c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d980cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d9e39c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980b7db0 con 0x7f8d980d2c80 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d9e39c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980d0650 con 0x7f8d9815c830 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d9e39c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980d0c10 con 0x7f8d980ccd10 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d97fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d9815c830 0x7f8d980d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d97fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d9815c830 0x7f8d980d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53254/0 (socket says 172.21.15.53:53254) 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d97fff640 1 -- 172.21.15.53:0/1881628778 learned_addr learned my addr 172.21.15.53:0/1881628778 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:22.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d977fe640 1 --2- 172.21.15.53:0/1881628778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d980cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d97fff640 1 -- 172.21.15.53:0/1881628778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 msgr2=0x7f8d980cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:22.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d97fff640 1 --2- 172.21.15.53:0/1881628778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d980cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d97fff640 1 -- 172.21.15.53:0/1881628778 >> v1:172.21.15.87:6789/0 conn(0x7f8d980d2c80 legacy=0x7f8d980b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d97fff640 1 -- 172.21.15.53:0/1881628778 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980cd7d0 con 0x7f8d9815c830 2024-09-13T18:29:22.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.971+0000 7f8d977fe640 1 --2- 172.21.15.53:0/1881628778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d980cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:22.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d97fff640 1 --2- 172.21.15.53:0/1881628778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d980d10a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009870 tx=0x7f8d8801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f252dfe6f48bb879 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d96ffd640 1 -- 172.21.15.53:0/1881628778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880ad660 con 0x7f8d9815c830 2024-09-13T18:29:22.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d96ffd640 1 -- 172.21.15.53:0/1881628778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d880ad7c0 con 0x7f8d9815c830 2024-09-13T18:29:22.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d96ffd640 1 -- 172.21.15.53:0/1881628778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d880adb50 con 0x7f8d9815c830 2024-09-13T18:29:22.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 -- 172.21.15.53:0/1881628778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 msgr2=0x7f8d980d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/1881628778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d980d10a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009870 tx=0x7f8d8801c560 comp rx=0 tx=0).stop 2024-09-13T18:29:22.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 -- 172.21.15.53:0/1881628778 shutdown_connections 2024-09-13T18:29:22.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/1881628778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d980cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/1881628778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d980d10a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 -- 172.21.15.53:0/1881628778 >> 172.21.15.53:0/1881628778 conn(0x7f8d98070970 msgr2=0x7f8d98070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:22.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 -- 172.21.15.53:0/1881628778 shutdown_connections 2024-09-13T18:29:22.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 -- 172.21.15.53:0/1881628778 wait complete. 2024-09-13T18:29:22.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.975+0000 7f8d9e39c640 1 Processor -- start 2024-09-13T18:29:22.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 -- start start 2024-09-13T18:29:22.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d9814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d980d2c80 0x7f8d9815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d9815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980cb880 con 0x7f8d9815c830 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9815b870 con 0x7f8d980d2c80 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9815b590 con 0x7f8d980ccd10 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d9815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d9815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53260/0 (socket says 172.21.15.53:53260) 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 -- 172.21.15.53:0/636796177 learned_addr learned my addr 172.21.15.53:0/636796177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d97fff640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d9814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d977fe640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d980d2c80 0x7f8d9815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 -- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 msgr2=0x7f8d9814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d9814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 -- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d980d2c80 msgr2=0x7f8d9815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d980d2c80 0x7f8d9815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:22.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 -- 172.21.15.53:0/636796177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880094d0 con 0x7f8d9815c830 2024-09-13T18:29:22.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d977fe640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d980d2c80 0x7f8d9815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:22.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9c939640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d9815bfb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c730 tx=0x7f8d9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d94ff9640 1 -- 172.21.15.53:0/636796177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003b80 con 0x7f8d9815c830 2024-09-13T18:29:22.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d94ff9640 1 -- 172.21.15.53:0/636796177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90003ce0 con 0x7f8d9815c830 2024-09-13T18:29:22.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d980cada0 con 0x7f8d9815c830 2024-09-13T18:29:22.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d94ff9640 1 -- 172.21.15.53:0/636796177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000aa30 con 0x7f8d9815c830 2024-09-13T18:29:22.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d980cb360 con 0x7f8d9815c830 2024-09-13T18:29:22.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980cb580 con 0x7f8d9815c830 2024-09-13T18:29:22.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d94ff9640 1 -- 172.21.15.53:0/636796177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f8d9000ab90 con 0x7f8d9815c830 2024-09-13T18:29:22.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d94ff9640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d840669f0 0x7f8d84068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:22.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.979+0000 7f8d94ff9640 1 -- 172.21.15.53:0/636796177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d900845c0 con 0x7f8d9815c830 2024-09-13T18:29:22.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.983+0000 7f8d97fff640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d840669f0 0x7f8d84068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:22.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.983+0000 7f8d97fff640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d840669f0 0x7f8d84068eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8d880af000 tx=0x7f8d880a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:22.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:22.987+0000 7f8d94ff9640 1 -- 172.21.15.53:0/636796177 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d90051420 con 0x7f8d9815c830 2024-09-13T18:29:23.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:23.175+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d980d1080 con 0x7f8d9815c830 2024-09-13T18:29:24.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.187+0000 7f8d94ff9640 1 -- 172.21.15.53:0/636796177 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8d90054a40 con 0x7f8d9815c830 2024-09-13T18:29:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d840669f0 msgr2=0x7f8d84068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:24.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d840669f0 0x7f8d84068eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8d880af000 tx=0x7f8d880a7000 comp rx=0 tx=0).stop 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 msgr2=0x7f8d9815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d9815bfb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c730 tx=0x7f8d9000cbf0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 shutdown_connections 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8d840669f0 0x7f8d84068eb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d9815c830 0x7f8d9815bfb0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d980d2c80 0x7f8d9815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 --2- 172.21.15.53:0/636796177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d980ccd10 0x7f8d9814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 >> 172.21.15.53:0/636796177 conn(0x7f8d98070970 msgr2=0x7f8d9814c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 shutdown_connections 2024-09-13T18:29:24.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.191+0000 7f8d9e39c640 1 -- 172.21.15.53:0/636796177 wait complete. 2024-09-13T18:29:24.219 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:29:24.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:29:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f51086e7640 1 Processor -- start 2024-09-13T18:29:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f51086e7640 1 -- start start 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f51086e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51000caee0 0x7f51000cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f51086e7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51000cd320 0x7f51000cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f51086e7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510006f7a0 con 0x7f5100143e80 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f51086e7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510006baa0 con 0x7f51000caee0 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f51086e7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510006fd60 con 0x7f51000cd320 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5105c82640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51000caee0 0x7f51000cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5105c82640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51000caee0 0x7f51000cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53270/0 (socket says 172.21.15.53:53270) 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5105c82640 1 -- 172.21.15.53:0/1982579049 learned_addr learned my addr 172.21.15.53:0/1982579049 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5106c84640 1 --2- 172.21.15.53:0/1982579049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51000cd320 0x7f51000cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5105c82640 1 -- 172.21.15.53:0/1982579049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51000cd320 msgr2=0x7f51000cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5105c82640 1 --2- 172.21.15.53:0/1982579049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51000cd320 0x7f51000cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5105c82640 1 -- 172.21.15.53:0/1982579049 >> v1:172.21.15.87:6789/0 conn(0x7f5100143e80 legacy=0x7f510006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:24.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5105c82640 1 -- 172.21.15.53:0/1982579049 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000cdd10 con 0x7f51000caee0 2024-09-13T18:29:24.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.351+0000 7f5106c84640 1 --2- 172.21.15.53:0/1982579049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51000cd320 0x7f51000cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:24.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f5105c82640 1 --2- 172.21.15.53:0/1982579049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000caee0 0x7f51000cb350 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f50f00098a0 tx=0x7f50f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd79bab80ff02e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:24.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f5105481640 1 -- 172.21.15.53:0/1982579049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ab600 con 0x7f51000caee0 2024-09-13T18:29:24.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f5105481640 1 -- 172.21.15.53:0/1982579049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00ab760 con 0x7f51000caee0 2024-09-13T18:29:24.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f5105481640 1 -- 172.21.15.53:0/1982579049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00abaf0 con 0x7f51000caee0 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 -- 172.21.15.53:0/1982579049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000caee0 msgr2=0x7f51000cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 --2- 172.21.15.53:0/1982579049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000caee0 0x7f51000cb350 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f50f00098a0 tx=0x7f50f001c440 comp rx=0 tx=0).stop 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 -- 172.21.15.53:0/1982579049 shutdown_connections 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 --2- 172.21.15.53:0/1982579049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51000cd320 0x7f51000cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 --2- 172.21.15.53:0/1982579049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000caee0 0x7f51000cb350 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 -- 172.21.15.53:0/1982579049 >> 172.21.15.53:0/1982579049 conn(0x7f5100065c80 msgr2=0x7f5100066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 -- 172.21.15.53:0/1982579049 shutdown_connections 2024-09-13T18:29:24.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 -- 172.21.15.53:0/1982579049 wait complete. 2024-09-13T18:29:24.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 Processor -- start 2024-09-13T18:29:24.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.355+0000 7f51086e7640 1 -- start start 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51000caee0 0x7f5100159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000cd320 0x7f51000afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5100143e80 0x7f510013ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100159570 con 0x7f51000cd320 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510013b930 con 0x7f51000caee0 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51001588f0 con 0x7f5100143e80 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000cd320 0x7f51000afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:24.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000cd320 0x7f51000afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53274/0 (socket says 172.21.15.53:53274) 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 -- 172.21.15.53:0/1764031553 learned_addr learned my addr 172.21.15.53:0/1764031553 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5106c84640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5100143e80 0x7f510013ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5106483640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51000caee0 0x7f5100159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 -- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5100143e80 msgr2=0x7f510013ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5100143e80 0x7f510013ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 -- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51000caee0 msgr2=0x7f5100159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51000caee0 0x7f5100159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 -- 172.21.15.53:0/1764031553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00094d0 con 0x7f51000cd320 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5106c84640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5100143e80 0x7f510013ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5105c82640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000cd320 0x7f51000afba0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f50f001aaf0 tx=0x7f50f001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f50f6ffd640 1 -- 172.21.15.53:0/1764031553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00b4800 con 0x7f51000cd320 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5100158bd0 con 0x7f51000cd320 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f50f6ffd640 1 -- 172.21.15.53:0/1764031553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00b4960 con 0x7f51000cd320 2024-09-13T18:29:24.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100159190 con 0x7f51000cd320 2024-09-13T18:29:24.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f50f6ffd640 1 -- 172.21.15.53:0/1764031553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00b4cd0 con 0x7f51000cd320 2024-09-13T18:29:24.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51000cb350 con 0x7f51000cd320 2024-09-13T18:29:24.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f50f6ffd640 1 -- 172.21.15.53:0/1764031553 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f50f00c7440 con 0x7f51000cd320 2024-09-13T18:29:24.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f50f6ffd640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50e40669f0 0x7f50e4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:24.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f50f6ffd640 1 -- 172.21.15.53:0/1764031553 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50f011f4c0 con 0x7f51000cd320 2024-09-13T18:29:24.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.359+0000 7f5106483640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50e40669f0 0x7f50e4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:24.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.363+0000 7f5106483640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50e40669f0 0x7f50e4068eb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b810 tx=0x7f50fc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:24.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.363+0000 7f50f6ffd640 1 -- 172.21.15.53:0/1764031553 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50f00ec2e0 con 0x7f51000cd320 2024-09-13T18:29:24.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:24.555+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5100157d20 con 0x7f51000cd320 2024-09-13T18:29:25.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:29:25.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:29:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.191+0000 7f50f6ffd640 1 -- 172.21.15.53:0/1764031553 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f50f00ef900 con 0x7f51000cd320 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50e40669f0 msgr2=0x7f50e4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50e40669f0 0x7f50e4068eb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00b810 tx=0x7f50fc008040 comp rx=0 tx=0).stop 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000cd320 msgr2=0x7f51000afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000cd320 0x7f51000afba0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f50f001aaf0 tx=0x7f50f001ac80 comp rx=0 tx=0).stop 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 shutdown_connections 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f50e40669f0 0x7f50e4068eb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5100143e80 0x7f510013ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51000cd320 0x7f51000afba0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 --2- 172.21.15.53:0/1764031553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51000caee0 0x7f5100159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 >> 172.21.15.53:0/1764031553 conn(0x7f5100065c80 msgr2=0x7f510006b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 shutdown_connections 2024-09-13T18:29:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.195+0000 7f51086e7640 1 -- 172.21.15.53:0/1764031553 wait complete. 2024-09-13T18:29:25.219 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:29:25.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:25.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.347+0000 7fcc84b7a640 1 Processor -- start 2024-09-13T18:29:25.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.347+0000 7fcc84b7a640 1 -- start start 2024-09-13T18:29:25.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc84b7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcc800cbb60 0x7fcc8006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc84b7a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800b2860 con 0x7fcc80158ba0 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc84b7a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc80158f80 con 0x7fcc8006fa80 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc84b7a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800b2580 con 0x7fcc800cbb60 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcc80158ba0 0x7fcc8006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48882/0 (socket says 172.21.15.53:48882) 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7e59c640 1 -- 172.21.15.53:0/427077824 learned_addr learned my addr 172.21.15.53:0/427077824 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7ed9d640 1 --2- 172.21.15.53:0/427077824 >> v2:172.21.15.53:3300/0 conn(0x7fcc800cbb60 0x7fcc8006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7dd9b640 1 -- 172.21.15.53:0/427077824 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931175697 0 0) 0x7fcc800b2860 con 0x7fcc80158ba0 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7dd9b640 1 -- 172.21.15.53:0/427077824 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c003530 con 0x7fcc80158ba0 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7ed9d640 1 -- 172.21.15.53:0/427077824 >> v1:172.21.15.87:6789/0 conn(0x7fcc8006fa80 legacy=0x7fcc800cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7ed9d640 1 -- 172.21.15.53:0/427077824 >> v1:172.21.15.53:6789/0 conn(0x7fcc80158ba0 legacy=0x7fcc8006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7ed9d640 1 -- 172.21.15.53:0/427077824 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800cc3a0 con 0x7fcc800cbb60 2024-09-13T18:29:25.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7ed9d640 1 --2- 172.21.15.53:0/427077824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc800cbb60 0x7fcc8006b390 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009d90 tx=0x7fcc7801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666d800f243062a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:25.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7dd9b640 1 -- 172.21.15.53:0/427077824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780a59a0 con 0x7fcc800cbb60 2024-09-13T18:29:25.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7dd9b640 1 -- 172.21.15.53:0/427077824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc780a5b00 con 0x7fcc800cbb60 2024-09-13T18:29:25.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.351+0000 7fcc7dd9b640 1 -- 172.21.15.53:0/427077824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780a5e90 con 0x7fcc800cbb60 2024-09-13T18:29:25.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- 172.21.15.53:0/427077824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc800cbb60 msgr2=0x7fcc8006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/427077824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc800cbb60 0x7fcc8006b390 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009d90 tx=0x7fcc7801c8e0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- 172.21.15.53:0/427077824 shutdown_connections 2024-09-13T18:29:25.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/427077824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc800cbb60 0x7fcc8006b390 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- 172.21.15.53:0/427077824 >> 172.21.15.53:0/427077824 conn(0x7fcc80065c80 msgr2=0x7fcc80066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:25.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- 172.21.15.53:0/427077824 shutdown_connections 2024-09-13T18:29:25.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- 172.21.15.53:0/427077824 wait complete. 2024-09-13T18:29:25.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 Processor -- start 2024-09-13T18:29:25.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- start start 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc8006fa80 0x7fcc80154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc800cbb60 0x7fcc80153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc80158ba0 0x7fcc8014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801599b0 con 0x7fcc80158ba0 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80155150 con 0x7fcc8006fa80 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801592f0 con 0x7fcc800cbb60 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc80158ba0 0x7fcc8014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc80158ba0 0x7fcc8014ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53296/0 (socket says 172.21.15.53:53296) 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 -- 172.21.15.53:0/584634737 learned_addr learned my addr 172.21.15.53:0/584634737 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7e59c640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc8006fa80 0x7fcc80154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc75d9b640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc800cbb60 0x7fcc80153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 -- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc800cbb60 msgr2=0x7fcc80153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc800cbb60 0x7fcc80153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 -- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc8006fa80 msgr2=0x7fcc80154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc8006fa80 0x7fcc80154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 -- 172.21.15.53:0/584634737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009a70 con 0x7fcc80158ba0 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc75d9b640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc800cbb60 0x7fcc80153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7e59c640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc8006fa80 0x7fcc80154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc7ed9d640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc80158ba0 0x7fcc8014ce10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcc780b0040 tx=0x7fcc78019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc777fe640 1 -- 172.21.15.53:0/584634737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780add90 con 0x7fcc80158ba0 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc777fe640 1 -- 172.21.15.53:0/584634737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78009450 con 0x7fcc80158ba0 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc777fe640 1 -- 172.21.15.53:0/584634737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780b9690 con 0x7fcc80158ba0 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc801595d0 con 0x7fcc80158ba0 2024-09-13T18:29:25.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.355+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8014d520 con 0x7fcc80158ba0 2024-09-13T18:29:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.359+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80067400 con 0x7fcc80158ba0 2024-09-13T18:29:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.359+0000 7fcc777fe640 1 -- 172.21.15.53:0/584634737 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fcc780b97f0 con 0x7fcc80158ba0 2024-09-13T18:29:25.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.359+0000 7fcc777fe640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc600669f0 0x7fcc60068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.359+0000 7fcc777fe640 1 -- 172.21.15.53:0/584634737 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc78120070 con 0x7fcc80158ba0 2024-09-13T18:29:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.359+0000 7fcc7e59c640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc600669f0 0x7fcc60068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.359+0000 7fcc7e59c640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc600669f0 0x7fcc60068eb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcc700011f0 tx=0x7fcc70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:25.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.363+0000 7fcc777fe640 1 -- 172.21.15.53:0/584634737 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcc780ed160 con 0x7fcc80158ba0 2024-09-13T18:29:25.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.555+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc80159150 con 0x7fcc80158ba0 2024-09-13T18:29:25.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc777fe640 1 -- 172.21.15.53:0/584634737 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4727 (secure 0 0 0) 0x7fcc80159150 con 0x7fcc80158ba0 2024-09-13T18:29:25.560 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:25.560 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:29:25.560 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2024-09-13T18:29:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc600669f0 msgr2=0x7fcc60068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc600669f0 0x7fcc60068eb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcc700011f0 tx=0x7fcc70009040 comp rx=0 tx=0).stop 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc80158ba0 msgr2=0x7fcc8014ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc80158ba0 0x7fcc8014ce10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcc780b0040 tx=0x7fcc78019680 comp rx=0 tx=0).stop 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 shutdown_connections 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcc600669f0 0x7fcc60068eb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc800cbb60 0x7fcc80153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc80158ba0 0x7fcc8014ce10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 --2- 172.21.15.53:0/584634737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc8006fa80 0x7fcc80154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 >> 172.21.15.53:0/584634737 conn(0x7fcc80065c80 msgr2=0x7fcc80166b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 shutdown_connections 2024-09-13T18:29:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.559+0000 7fcc84b7a640 1 -- 172.21.15.53:0/584634737 wait complete. 2024-09-13T18:29:25.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 Processor -- start 2024-09-13T18:29:25.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 -- start start 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f976815b300 0x7f97680cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9768161170 0x7f9768162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9768162850 0x7f97680cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97680cc3f0 con 0x7f976815b300 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9768161930 con 0x7f9768161170 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.699+0000 7f976f4db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9768161c10 con 0x7f9768162850 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f976815b300 0x7f97680cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f976815b300 0x7f97680cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53298/0 (socket says 172.21.15.53:53298) 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 -- 172.21.15.53:0/1338949989 learned_addr learned my addr 172.21.15.53:0/1338949989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976da78640 1 --2- 172.21.15.53:0/1338949989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9768162850 0x7f97680cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976ca76640 1 --2- 172.21.15.53:0/1338949989 >> v2:172.21.15.87:3300/0 conn(0x7f9768161170 0x7f9768162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 -- 172.21.15.53:0/1338949989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9768162850 msgr2=0x7f97680cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 --2- 172.21.15.53:0/1338949989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9768162850 0x7f97680cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 -- 172.21.15.53:0/1338949989 >> v2:172.21.15.87:3300/0 conn(0x7f9768161170 msgr2=0x7f9768162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 --2- 172.21.15.53:0/1338949989 >> v2:172.21.15.87:3300/0 conn(0x7f9768161170 0x7f9768162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 -- 172.21.15.53:0/1338949989 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768161ef0 con 0x7f976815b300 2024-09-13T18:29:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976da78640 1 --2- 172.21.15.53:0/1338949989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9768162850 0x7f97680cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976ca76640 1 --2- 172.21.15.53:0/1338949989 >> v2:172.21.15.87:3300/0 conn(0x7f9768161170 0x7f9768162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:25.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f976d277640 1 --2- 172.21.15.53:0/1338949989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f976815b300 0x7f97680cd780 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f97680cbc20 tx=0x7f976401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd45103b8d79b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:25.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f975ffff640 1 -- 172.21.15.53:0/1338949989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640ab5f0 con 0x7f976815b300 2024-09-13T18:29:25.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f975ffff640 1 -- 172.21.15.53:0/1338949989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640ab750 con 0x7f976815b300 2024-09-13T18:29:25.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.703+0000 7f975ffff640 1 -- 172.21.15.53:0/1338949989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640abae0 con 0x7f976815b300 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/1338949989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f976815b300 msgr2=0x7f97680cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 --2- 172.21.15.53:0/1338949989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f976815b300 0x7f97680cd780 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f97680cbc20 tx=0x7f976401c520 comp rx=0 tx=0).stop 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/1338949989 shutdown_connections 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 --2- 172.21.15.53:0/1338949989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9768162850 0x7f97680cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 --2- 172.21.15.53:0/1338949989 >> v2:172.21.15.87:3300/0 conn(0x7f9768161170 0x7f9768162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 --2- 172.21.15.53:0/1338949989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f976815b300 0x7f97680cd780 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/1338949989 >> 172.21.15.53:0/1338949989 conn(0x7f9768065c80 msgr2=0x7f9768066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/1338949989 shutdown_connections 2024-09-13T18:29:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/1338949989 wait complete. 2024-09-13T18:29:25.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 Processor -- start 2024-09-13T18:29:25.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- start start 2024-09-13T18:29:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f976815b300 0x7f9768154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9768161170 0x7f97680a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768162850 0x7f97680a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768153c10 con 0x7f9768162850 2024-09-13T18:29:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768150720 con 0x7f9768161170 2024-09-13T18:29:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9768153eb0 con 0x7f976815b300 2024-09-13T18:29:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768162850 0x7f97680a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768162850 0x7f97680a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53314/0 (socket says 172.21.15.53:53314) 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 -- 172.21.15.53:0/2808370157 learned_addr learned my addr 172.21.15.53:0/2808370157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976ca76640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9768161170 0x7f97680a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 -- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f976815b300 msgr2=0x7f9768154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976d277640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f976815b300 0x7f9768154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f976815b300 0x7f9768154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 -- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9768161170 msgr2=0x7f97680a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9768161170 0x7f97680a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 -- 172.21.15.53:0/2808370157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640094d0 con 0x7f9768162850 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976ca76640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9768161170 0x7f97680a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976da78640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768162850 0x7f97680a8a10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f976000cd50 tx=0x7f976000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f975dffb640 1 -- 172.21.15.53:0/2808370157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000f680 con 0x7f9768162850 2024-09-13T18:29:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f975dffb640 1 -- 172.21.15.53:0/2808370157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000f800 con 0x7f9768162850 2024-09-13T18:29:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9768154190 con 0x7f9768162850 2024-09-13T18:29:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f975dffb640 1 -- 172.21.15.53:0/2808370157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000fbb0 con 0x7f9768162850 2024-09-13T18:29:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9768152fe0 con 0x7f9768162850 2024-09-13T18:29:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.707+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9768067400 con 0x7f9768162850 2024-09-13T18:29:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.711+0000 7f975dffb640 1 -- 172.21.15.53:0/2808370157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f976000b040 con 0x7f9768162850 2024-09-13T18:29:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.711+0000 7f975dffb640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f974c0669f0 0x7f974c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.711+0000 7f975dffb640 1 -- 172.21.15.53:0/2808370157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9760085220 con 0x7f9768162850 2024-09-13T18:29:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.711+0000 7f976d277640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f974c0669f0 0x7f974c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.711+0000 7f976d277640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f974c0669f0 0x7f974c068eb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f97640af000 tx=0x7f9764008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:25.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.715+0000 7f975dffb640 1 -- 172.21.15.53:0/2808370157 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9760052000 con 0x7f9768162850 2024-09-13T18:29:25.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.875+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9768162310 con 0x7f9768162850 2024-09-13T18:29:25.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.879+0000 7f975dffb640 1 -- 172.21.15.53:0/2808370157 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16508 (secure 0 0 0) 0x7f9760055620 con 0x7f9768162850 2024-09-13T18:29:25.881 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:25.881 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":72,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:23.172477+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f974c0669f0 msgr2=0x7f974c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f974c0669f0 0x7f974c068eb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f97640af000 tx=0x7f9764008040 comp rx=0 tx=0).stop 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768162850 msgr2=0x7f97680a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768162850 0x7f97680a8a10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f976000cd50 tx=0x7f976000a650 comp rx=0 tx=0).stop 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 shutdown_connections 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f974c0669f0 0x7f974c068eb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9768162850 0x7f97680a8a10 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9768161170 0x7f97680a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 --2- 172.21.15.53:0/2808370157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f976815b300 0x7f9768154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:25.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 >> 172.21.15.53:0/2808370157 conn(0x7f9768065c80 msgr2=0x7f97680af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:25.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 shutdown_connections 2024-09-13T18:29:25.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:25.883+0000 7f976f4db640 1 -- 172.21.15.53:0/2808370157 wait complete. 2024-09-13T18:29:25.900 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:29:25.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.007+0000 7f22b6427640 1 Processor -- start 2024-09-13T18:29:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.007+0000 7f22b6427640 1 -- start start 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22b6427640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22b6427640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22b00cbb60 0x7f22b00b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22b6427640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00b2340 con 0x7f22b006f370 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22b6427640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b00b2860 con 0x7f22b00cbb60 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22b6427640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0158f80 con 0x7f22b0158ba0 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22b00cbb60 0x7f22b00b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22b00cbb60 0x7f22b00b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53318/0 (socket says 172.21.15.53:53318) 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 -- 172.21.15.53:0/601795628 learned_addr learned my addr 172.21.15.53:0/601795628 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22affff640 1 --2- 172.21.15.53:0/601795628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 -- 172.21.15.53:0/601795628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 msgr2=0x7f22b006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 --2- 172.21.15.53:0/601795628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b006b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 -- 172.21.15.53:0/601795628 >> v1:172.21.15.87:6789/0 conn(0x7f22b006f370 legacy=0x7f22b00cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 -- 172.21.15.53:0/601795628 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00b2580 con 0x7f22b00cbb60 2024-09-13T18:29:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22af7fe640 1 --2- 172.21.15.53:0/601795628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00b1e00 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009870 tx=0x7f22a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c999469bb573192 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22aeffd640 1 -- 172.21.15.53:0/601795628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40ab650 con 0x7f22b00cbb60 2024-09-13T18:29:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22aeffd640 1 -- 172.21.15.53:0/601795628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a40ab7b0 con 0x7f22b00cbb60 2024-09-13T18:29:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.011+0000 7f22aeffd640 1 -- 172.21.15.53:0/601795628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40abb40 con 0x7f22b00cbb60 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- 172.21.15.53:0/601795628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 msgr2=0x7f22b00b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 --2- 172.21.15.53:0/601795628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00b1e00 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009870 tx=0x7f22a401c490 comp rx=0 tx=0).stop 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- 172.21.15.53:0/601795628 shutdown_connections 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 --2- 172.21.15.53:0/601795628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00b1e00 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 --2- 172.21.15.53:0/601795628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- 172.21.15.53:0/601795628 >> 172.21.15.53:0/601795628 conn(0x7f22b0065c80 msgr2=0x7f22b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- 172.21.15.53:0/601795628 shutdown_connections 2024-09-13T18:29:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- 172.21.15.53:0/601795628 wait complete. 2024-09-13T18:29:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 Processor -- start 2024-09-13T18:29:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- start start 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b006f370 0x7f22b01f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b00a8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b01f5580 con 0x7f22b00cbb60 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b01f5860 con 0x7f22b006f370 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b01f5b40 con 0x7f22b0158ba0 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53322/0 (socket says 172.21.15.53:53322) 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 -- 172.21.15.53:0/3462765303 learned_addr learned my addr 172.21.15.53:0/3462765303 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:26.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22affff640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b006f370 0x7f22b01f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b49c4640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b00a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 -- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 msgr2=0x7f22b00a8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b00a8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 -- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b006f370 msgr2=0x7f22b01f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b006f370 0x7f22b01f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 -- 172.21.15.53:0/3462765303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40094d0 con 0x7f22b00cbb60 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22affff640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b006f370 0x7f22b01f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22af7fe640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00aebf0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f22a401ab40 tx=0x7f22a401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22acff9640 1 -- 172.21.15.53:0/3462765303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40b48c0 con 0x7f22b00cbb60 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22acff9640 1 -- 172.21.15.53:0/3462765303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a40b4a40 con 0x7f22b00cbb60 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b01f5e20 con 0x7f22b00cbb60 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22acff9640 1 -- 172.21.15.53:0/3462765303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40b4df0 con 0x7f22b00cbb60 2024-09-13T18:29:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.015+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b00a8bd0 con 0x7f22b00cbb60 2024-09-13T18:29:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.019+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0067400 con 0x7f22b00cbb60 2024-09-13T18:29:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.019+0000 7f22acff9640 1 -- 172.21.15.53:0/3462765303 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f22a40c7440 con 0x7f22b00cbb60 2024-09-13T18:29:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.019+0000 7f22acff9640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f229c0669f0 0x7f229c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.019+0000 7f22acff9640 1 -- 172.21.15.53:0/3462765303 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22a411f230 con 0x7f22b00cbb60 2024-09-13T18:29:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.019+0000 7f22affff640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f229c0669f0 0x7f229c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.019+0000 7f22affff640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f229c0669f0 0x7f229c068eb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f22a0006fd0 tx=0x7f22a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.023+0000 7f22acff9640 1 -- 172.21.15.53:0/3462765303 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22a40ec340 con 0x7f22b00cbb60 2024-09-13T18:29:26.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.175+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22b00b2340 con 0x7f229c0669f0 2024-09-13T18:29:26.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.199+0000 7f22acff9640 1 -- 172.21.15.53:0/3462765303 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273361 (secure 0 0 0) 0x7f22b00b2340 con 0x7f229c0669f0 2024-09-13T18:29:26.205 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:26.206 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:29:26.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f229c0669f0 msgr2=0x7f229c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f229c0669f0 0x7f229c068eb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f22a0006fd0 tx=0x7f22a0008040 comp rx=0 tx=0).stop 2024-09-13T18:29:26.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 msgr2=0x7f22b00aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00aebf0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f22a401ab40 tx=0x7f22a401acd0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 shutdown_connections 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f229c0669f0 0x7f229c068eb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f22b0158ba0 0x7f22b00a8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22b00cbb60 0x7f22b00aebf0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 --2- 172.21.15.53:0/3462765303 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b006f370 0x7f22b01f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 >> 172.21.15.53:0/3462765303 conn(0x7f22b0065c80 msgr2=0x7f22b0066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 shutdown_connections 2024-09-13T18:29:26.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.203+0000 7f22b6427640 1 -- 172.21.15.53:0/3462765303 wait complete. 2024-09-13T18:29:26.223 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-13T18:29:24.991639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260704,"kb_used_data":7624,"kb_used_omap":12,"kb_used_meta":252915,"kb_avail":754714016,"statfs":{"total":773094113280,"available":772827152384,"internally_reserved":0,"allocated":7806976,"data_stored":3935928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":258985528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.221030"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T18:29:17.487371+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:29:17.487371+0000","last_peered":"2024-09-13T18:29:17.487371+0000","last_clean":"2024-09-13T18:29:17.487371+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:29:17.487371+0000","last_undegraded":"2024-09-13T18:29:17.487371+0000","last_fullsized":"2024-09-13T18:29:17.487371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1421312,"data_stored":934767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.88300000000000001},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3080000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1839999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4179999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93400000000000005,"15min":0.92000000000000004},"min":{"1min":0.60499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4890000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82699999999999996,"15min":0.79900000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1060000000000001,"5min":1.276,"15min":1.276},"last":0.755},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5309999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.349,"5min":1.448,"15min":1.448},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94899999999999995,"15min":0.91100000000000003},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2,"5min":1.397,"15min":1.397},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.55800000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2809999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.94099999999999995},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0469999999999999},"min":{"1min":0.70299999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.278,"5min":1.877,"15min":1.877},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.63100000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.78100000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3919999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.1579999999999999,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.78600000000000003},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2170000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.88300000000000001},"min":{"1min":0.626,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.155,"5min":1.577,"15min":1.577},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93400000000000005,"15min":0.89200000000000002},"min":{"1min":0.56399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.157,"5min":1.464,"15min":1.464},"last":0.86199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0669999999999999,"5min":1.268,"15min":1.268},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.208,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88800000000000001,"15min":0.877},"min":{"1min":0.68000000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0800000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1339999999999999,"5min":1.306,"15min":1.306},"last":0.93100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1839999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.036,"5min":1.02,"15min":0.998},"min":{"1min":0.69399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.212,"5min":1.526,"15min":1.526},"last":1.026}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.59699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0469999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.069,"15min":1.107},"min":{"1min":0.73199999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3520000000000001,"5min":2.762,"15min":2.762},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0189999999999999,"15min":1.0409999999999999},"min":{"1min":0.74199999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0429999999999999},"min":{"1min":0.69199999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2410000000000001,"5min":1.72,"15min":1.72},"last":0.81699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89400000000000002,"15min":0.91200000000000003},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.2010000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.96999999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85999999999999999,"15min":0.82799999999999996},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0780000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.71199999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1890000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94199999999999995,"15min":0.96199999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.272,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.087},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":0.98099999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1859999999999999,"5min":1.871,"15min":1.871},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2410000000000001,"5min":1.413,"15min":1.413},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3149999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2050000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.99299999999999999,"15min":1.036},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2410000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1259999999999999},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4039999999999999,"5min":2.246,"15min":2.246},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.145},"min":{"1min":0.74299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2769999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.129}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31940,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.80100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.874,"15min":0.874},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.256,"15min":1.256},"last":1.1120000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.46300000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.874},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.087,"5min":1.147,"15min":1.147},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.66600000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.1859999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.044},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92500000000000004,"15min":0.92900000000000005},"min":{"1min":0.65600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.077}]},{"osd":5,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.298,"15min":1.298},"last":0.996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.94799999999999995,"15min":0.96499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.333,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94099999999999995,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.181,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.022},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1,"15min":1.02},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.377,"15min":1.377},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.042},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.286,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.044,"15min":1.0760000000000001},"min":{"1min":0.72899999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2010000000000001,"5min":1.466,"15min":1.466},"last":1.147}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68100000000000005,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.5},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.77400000000000002,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.90800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4199999999999999,"5min":1.704,"15min":1.704},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.67000000000000004,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.79000000000000004,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.399,"15min":1.399},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.97099999999999997,"15min":0.96299999999999997},"min":{"1min":0.77000000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0880000000000001,"15min":1.1279999999999999},"min":{"1min":0.78600000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.028,"15min":1.024},"min":{"1min":0.69499999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2689999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.089},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.96199999999999997,"15min":0.94299999999999995},"min":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.0549999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0680000000000001,"15min":1.0780000000000001},"min":{"1min":0.65900000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5800000000000001,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0629999999999999,"15min":1.054},"min":{"1min":0.83799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.377,"5min":1.96,"15min":1.96},"last":1.0089999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.624,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.665,"5min":3,"15min":3},"last":0.751},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.04,"15min":1.0049999999999999},"min":{"1min":0.75,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.88100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36024,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.68300000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.879,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.91100000000000003,"5min":1.423,"15min":1.423},"last":0.499}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0860000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.745},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79100000000000004,"15min":0.77700000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.274,"15min":1.274},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.91000000000000003},"min":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1890000000000001,"5min":1.611,"15min":1.611},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0620000000000001,"5min":1.492,"15min":1.492},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.99399999999999999,"15min":1.0089999999999999},"min":{"1min":0.68300000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.224,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2230000000000001,"5min":1.702,"15min":1.702},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.155,"5min":1.54,"15min":1.54},"last":0.879},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.036,"15min":1.05},"min":{"1min":0.66000000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.206,"5min":1.452,"15min":1.452},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.657,"15min":1.657},"last":1.018},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.089},"min":{"1min":0.73299999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.345,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1020000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36024,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63900000000000001,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.90000000000000002,"5min":1.177,"15min":1.177},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.98699999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.40300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1359999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.2010000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.92800000000000005,"15min":0.90700000000000003},"min":{"1min":0.70699999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1279999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.347,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.01,"15min":0.996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.25,"5min":1.653,"15min":1.653},"last":1.077},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.997,"15min":0.98899999999999999},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2629999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.133}]},{"osd":7,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.048,"15min":1.042},"min":{"1min":0.748,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3779999999999999,"5min":1.458,"15min":1.458},"last":1.171},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0429999999999999,"15min":1.0129999999999999},"min":{"1min":0.67100000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.995}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1421312,"data_stored":934767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.998,"5min":1.147,"15min":1.147},"last":0.5},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.244,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68200000000000005,"15min":0.626},"min":{"1min":0.44,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.628},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1639999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3160000000000001,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.77200000000000002,"15min":0.73699999999999999},"min":{"1min":0.51800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2769999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.64400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.026},{"interface":"front","average":{"1min":0.998,"5min":0.996,"15min":0.998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4079999999999999,"5min":1.986,"15min":1.986},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.014,"15min":1.016},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8799999999999999,"5min":2.641,"15min":2.641},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.83399999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.343,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.095,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.466,"5min":1.891,"15min":1.891},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.512,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.94899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.03,"15min":1.034},"min":{"1min":0.622,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4319999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.133,"5min":1.1220000000000001,"15min":1.1080000000000001},"min":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.724,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.98199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:26.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:26.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.387+0000 7f3ba8a28640 1 Processor -- start 2024-09-13T18:29:26.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.387+0000 7f3ba8a28640 1 -- start start 2024-09-13T18:29:26.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba8a28640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ba415b7c0 0x7f3ba4070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba8a28640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ba40711d0 0x7f3ba41640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba8a28640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba406d480 con 0x7f3ba41582a0 2024-09-13T18:29:26.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba8a28640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba4071680 con 0x7f3ba40711d0 2024-09-13T18:29:26.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba8a28640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba415aaf0 con 0x7f3ba415b7c0 2024-09-13T18:29:26.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ba40711d0 0x7f3ba41640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3ba41582a0 0x7f3ba406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48886/0 (socket says 172.21.15.53:48886) 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba259c640 1 -- 172.21.15.53:0/2916211848 learned_addr learned my addr 172.21.15.53:0/2916211848 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3b99d9b640 1 --2- 172.21.15.53:0/2916211848 >> v2:172.21.15.87:3300/0 conn(0x7f3ba415b7c0 0x7f3ba4070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba1d9b640 1 -- 172.21.15.53:0/2916211848 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714497277 0 0) 0x7f3ba406d480 con 0x7f3ba41582a0 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba1d9b640 1 -- 172.21.15.53:0/2916211848 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b90003530 con 0x7f3ba41582a0 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba2d9d640 1 -- 172.21.15.53:0/2916211848 >> v2:172.21.15.87:3300/0 conn(0x7f3ba415b7c0 msgr2=0x7f3ba4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba2d9d640 1 --2- 172.21.15.53:0/2916211848 >> v2:172.21.15.87:3300/0 conn(0x7f3ba415b7c0 0x7f3ba4070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba2d9d640 1 -- 172.21.15.53:0/2916211848 >> v1:172.21.15.53:6789/0 conn(0x7f3ba41582a0 legacy=0x7f3ba406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba2d9d640 1 -- 172.21.15.53:0/2916211848 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba415ace0 con 0x7f3ba40711d0 2024-09-13T18:29:26.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.391+0000 7f3ba2d9d640 1 --2- 172.21.15.53:0/2916211848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba41640f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40ce220 tx=0x7f3b9c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2219a69afbac2015 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba1d9b640 1 -- 172.21.15.53:0/2916211848 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0a58e0 con 0x7f3ba40711d0 2024-09-13T18:29:26.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba1d9b640 1 -- 172.21.15.53:0/2916211848 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c0a5a40 con 0x7f3ba40711d0 2024-09-13T18:29:26.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba1d9b640 1 -- 172.21.15.53:0/2916211848 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0a5db0 con 0x7f3ba40711d0 2024-09-13T18:29:26.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- 172.21.15.53:0/2916211848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 msgr2=0x7f3ba41640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/2916211848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba41640f0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40ce220 tx=0x7f3b9c01c930 comp rx=0 tx=0).stop 2024-09-13T18:29:26.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- 172.21.15.53:0/2916211848 shutdown_connections 2024-09-13T18:29:26.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/2916211848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba41640f0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/2916211848 >> v2:172.21.15.87:3300/0 conn(0x7f3ba415b7c0 0x7f3ba4070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- 172.21.15.53:0/2916211848 >> 172.21.15.53:0/2916211848 conn(0x7f3ba4065c80 msgr2=0x7f3ba4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:26.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- 172.21.15.53:0/2916211848 shutdown_connections 2024-09-13T18:29:26.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- 172.21.15.53:0/2916211848 wait complete. 2024-09-13T18:29:26.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 Processor -- start 2024-09-13T18:29:26.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- start start 2024-09-13T18:29:26.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba40aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba41582a0 0x7f3ba41586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ba415b7c0 0x7f3ba4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4150da0 con 0x7f3ba40711d0 2024-09-13T18:29:26.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4158c30 con 0x7f3ba41582a0 2024-09-13T18:29:26.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba8a28640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40b18b0 con 0x7f3ba415b7c0 2024-09-13T18:29:26.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba40aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba40aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53342/0 (socket says 172.21.15.53:53342) 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.395+0000 7f3ba259c640 1 -- 172.21.15.53:0/1996621642 learned_addr learned my addr 172.21.15.53:0/1996621642 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba259c640 1 -- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ba415b7c0 msgr2=0x7f3ba4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba259c640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ba415b7c0 0x7f3ba4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba259c640 1 -- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba41582a0 msgr2=0x7f3ba41586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba259c640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba41582a0 0x7f3ba41586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba259c640 1 -- 172.21.15.53:0/1996621642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c009a70 con 0x7f3ba40711d0 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba259c640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba40aca30 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c450 tx=0x7f3b9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/1996621642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94005cf0 con 0x7f3ba40711d0 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/1996621642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b94005e50 con 0x7f3ba40711d0 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba40b1b70 con 0x7f3ba40711d0 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/1996621642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94007290 con 0x7f3ba40711d0 2024-09-13T18:29:26.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba40b2130 con 0x7f3ba40711d0 2024-09-13T18:29:26.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4067400 con 0x7f3ba40711d0 2024-09-13T18:29:26.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/1996621642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f3b940073f0 con 0x7f3ba40711d0 2024-09-13T18:29:26.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b9b7fe640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b840669f0 0x7f3b84068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/1996621642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b94083ca0 con 0x7f3ba40711d0 2024-09-13T18:29:26.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b99d9b640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b840669f0 0x7f3b84068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.399+0000 7f3b99d9b640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b840669f0 0x7f3b84068eb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006aa0 tx=0x7f3b8c006a30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.403+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/1996621642 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b94050c00 con 0x7f3ba40711d0 2024-09-13T18:29:26.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.555+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ba4166e50 con 0x7f3b840669f0 2024-09-13T18:29:26.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.575+0000 7f3b9b7fe640 1 -- 172.21.15.53:0/1996621642 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273361 (secure 0 0 0) 0x7f3b8c00e7a0 con 0x7f3b840669f0 2024-09-13T18:29:26.580 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:26.582 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:29:26.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b840669f0 msgr2=0x7f3b84068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b840669f0 0x7f3b84068eb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006aa0 tx=0x7f3b8c006a30 comp rx=0 tx=0).stop 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 msgr2=0x7f3ba40aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba40aca30 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c450 tx=0x7f3b9400c910 comp rx=0 tx=0).stop 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 shutdown_connections 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f3b840669f0 0x7f3b84068eb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ba415b7c0 0x7f3ba4148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba41582a0 0x7f3ba41586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 --2- 172.21.15.53:0/1996621642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba40711d0 0x7f3ba40aca30 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 >> 172.21.15.53:0/1996621642 conn(0x7f3ba4065c80 msgr2=0x7f3ba40af910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 shutdown_connections 2024-09-13T18:29:26.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.579+0000 7f3ba8a28640 1 -- 172.21.15.53:0/1996621642 wait complete. 2024-09-13T18:29:26.596 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-13T18:29:24.991639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260704,"kb_used_data":7624,"kb_used_omap":12,"kb_used_meta":252915,"kb_avail":754714016,"statfs":{"total":773094113280,"available":772827152384,"internally_reserved":0,"allocated":7806976,"data_stored":3935928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":258985528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.221030"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T18:29:17.487371+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:29:17.487371+0000","last_peered":"2024-09-13T18:29:17.487371+0000","last_clean":"2024-09-13T18:29:17.487371+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:29:17.487371+0000","last_undegraded":"2024-09-13T18:29:17.487371+0000","last_fullsized":"2024-09-13T18:29:17.487371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1421312,"data_stored":934767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.88300000000000001},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3080000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1839999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4179999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93400000000000005,"15min":0.92000000000000004},"min":{"1min":0.60499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4890000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82699999999999996,"15min":0.79900000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1060000000000001,"5min":1.276,"15min":1.276},"last":0.755},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5309999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.349,"5min":1.448,"15min":1.448},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94899999999999995,"15min":0.91100000000000003},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2,"5min":1.397,"15min":1.397},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.55800000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2809999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.94099999999999995},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0469999999999999},"min":{"1min":0.70299999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.278,"5min":1.877,"15min":1.877},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.63100000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.78100000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3919999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.1579999999999999,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.78600000000000003},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2170000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.88300000000000001},"min":{"1min":0.626,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.155,"5min":1.577,"15min":1.577},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93400000000000005,"15min":0.89200000000000002},"min":{"1min":0.56399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.157,"5min":1.464,"15min":1.464},"last":0.86199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0669999999999999,"5min":1.268,"15min":1.268},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.208,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88800000000000001,"15min":0.877},"min":{"1min":0.68000000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0800000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1339999999999999,"5min":1.306,"15min":1.306},"last":0.93100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1839999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.036,"5min":1.02,"15min":0.998},"min":{"1min":0.69399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.212,"5min":1.526,"15min":1.526},"last":1.026}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.59699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0469999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.069,"15min":1.107},"min":{"1min":0.73199999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3520000000000001,"5min":2.762,"15min":2.762},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0189999999999999,"15min":1.0409999999999999},"min":{"1min":0.74199999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0429999999999999},"min":{"1min":0.69199999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2410000000000001,"5min":1.72,"15min":1.72},"last":0.81699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89400000000000002,"15min":0.91200000000000003},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.2010000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.96999999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85999999999999999,"15min":0.82799999999999996},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0780000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.71199999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1890000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94199999999999995,"15min":0.96199999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.272,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.087},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":0.98099999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1859999999999999,"5min":1.871,"15min":1.871},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2410000000000001,"5min":1.413,"15min":1.413},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3149999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2050000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.99299999999999999,"15min":1.036},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2410000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1259999999999999},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4039999999999999,"5min":2.246,"15min":2.246},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.145},"min":{"1min":0.74299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2769999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.129}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31940,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.80100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.874,"15min":0.874},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.256,"15min":1.256},"last":1.1120000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.46300000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.874},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.087,"5min":1.147,"15min":1.147},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.66600000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.1859999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.044},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92500000000000004,"15min":0.92900000000000005},"min":{"1min":0.65600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.077}]},{"osd":5,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.298,"15min":1.298},"last":0.996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.94799999999999995,"15min":0.96499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.333,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94099999999999995,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.181,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.022},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1,"15min":1.02},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.377,"15min":1.377},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.042},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.286,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.044,"15min":1.0760000000000001},"min":{"1min":0.72899999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2010000000000001,"5min":1.466,"15min":1.466},"last":1.147}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68100000000000005,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.5},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.77400000000000002,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.90800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4199999999999999,"5min":1.704,"15min":1.704},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.67000000000000004,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.79000000000000004,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.399,"15min":1.399},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.97099999999999997,"15min":0.96299999999999997},"min":{"1min":0.77000000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0880000000000001,"15min":1.1279999999999999},"min":{"1min":0.78600000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.028,"15min":1.024},"min":{"1min":0.69499999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2689999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.089},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.96199999999999997,"15min":0.94299999999999995},"min":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.0549999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0680000000000001,"15min":1.0780000000000001},"min":{"1min":0.65900000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5800000000000001,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0629999999999999,"15min":1.054},"min":{"1min":0.83799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.377,"5min":1.96,"15min":1.96},"last":1.0089999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.624,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.665,"5min":3,"15min":3},"last":0.751},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.04,"15min":1.0049999999999999},"min":{"1min":0.75,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.88100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36024,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.68300000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.879,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.91100000000000003,"5min":1.423,"15min":1.423},"last":0.499}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0860000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.745},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79100000000000004,"15min":0.77700000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.274,"15min":1.274},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.91000000000000003},"min":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1890000000000001,"5min":1.611,"15min":1.611},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0620000000000001,"5min":1.492,"15min":1.492},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.99399999999999999,"15min":1.0089999999999999},"min":{"1min":0.68300000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.224,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2230000000000001,"5min":1.702,"15min":1.702},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.155,"5min":1.54,"15min":1.54},"last":0.879},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.036,"15min":1.05},"min":{"1min":0.66000000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.206,"5min":1.452,"15min":1.452},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.657,"15min":1.657},"last":1.018},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.089},"min":{"1min":0.73299999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.345,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1020000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36024,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63900000000000001,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.90000000000000002,"5min":1.177,"15min":1.177},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.98699999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.40300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1359999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.2010000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.92800000000000005,"15min":0.90700000000000003},"min":{"1min":0.70699999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1279999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.347,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.01,"15min":0.996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.25,"5min":1.653,"15min":1.653},"last":1.077},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.997,"15min":0.98899999999999999},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2629999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.133}]},{"osd":7,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.048,"15min":1.042},"min":{"1min":0.748,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3779999999999999,"5min":1.458,"15min":1.458},"last":1.171},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0429999999999999,"15min":1.0129999999999999},"min":{"1min":0.67100000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.995}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1421312,"data_stored":934767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.998,"5min":1.147,"15min":1.147},"last":0.5},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.244,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68200000000000005,"15min":0.626},"min":{"1min":0.44,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.628},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1639999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3160000000000001,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.77200000000000002,"15min":0.73699999999999999},"min":{"1min":0.51800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2769999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.64400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.026},{"interface":"front","average":{"1min":0.998,"5min":0.996,"15min":0.998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4079999999999999,"5min":1.986,"15min":1.986},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.014,"15min":1.016},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8799999999999999,"5min":2.641,"15min":2.641},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.83399999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.343,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.095,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.466,"5min":1.891,"15min":1.891},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.512,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.94899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.03,"15min":1.034},"min":{"1min":0.622,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4319999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.133,"5min":1.1220000000000001,"15min":1.1080000000000001},"min":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.724,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.98199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:26.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:26.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.751+0000 7f0de5553640 1 Processor -- start 2024-09-13T18:29:26.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.751+0000 7f0de5553640 1 -- start start 2024-09-13T18:29:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0de5553640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de006fa80 0x7f0de006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0de5553640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0de00cbb60 0x7f0de00b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0de5553640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de00b2340 con 0x7f0de0158ba0 2024-09-13T18:29:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0de5553640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00b2860 con 0x7f0de00cbb60 2024-09-13T18:29:26.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0de5553640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0158f80 con 0x7f0de006fa80 2024-09-13T18:29:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0ddf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0de00cbb60 0x7f0de00b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0ddeffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0de0158ba0 0x7f0de006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:44884/0 (socket says 172.21.15.53:44884) 2024-09-13T18:29:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0ddeffd640 1 -- 172.21.15.53:0/1209398673 learned_addr learned my addr 172.21.15.53:0/1209398673 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:26.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0dde7fc640 1 --2- 172.21.15.53:0/1209398673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de006fa80 0x7f0de006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0dde7fc640 1 -- 172.21.15.53:0/1209398673 >> v2:172.21.15.87:3300/0 conn(0x7f0de00cbb60 msgr2=0x7f0de00b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0dde7fc640 1 --2- 172.21.15.53:0/1209398673 >> v2:172.21.15.87:3300/0 conn(0x7f0de00cbb60 0x7f0de00b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0dde7fc640 1 -- 172.21.15.53:0/1209398673 >> v1:172.21.15.87:6789/0 conn(0x7f0de0158ba0 legacy=0x7f0de006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0dde7fc640 1 -- 172.21.15.53:0/1209398673 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de00b2580 con 0x7f0de006fa80 2024-09-13T18:29:26.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.755+0000 7f0ddf7fe640 1 --2- 172.21.15.53:0/1209398673 >> v2:172.21.15.87:3300/0 conn(0x7f0de00cbb60 0x7f0de00b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:26.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0dde7fc640 1 --2- 172.21.15.53:0/1209398673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de006fa80 0x7f0de006b390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40097c0 tx=0x7f0dd401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8179276a6fac8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0dddffb640 1 -- 172.21.15.53:0/1209398673 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4004230 con 0x7f0de006fa80 2024-09-13T18:29:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0dddffb640 1 -- 172.21.15.53:0/1209398673 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40a7050 con 0x7f0de006fa80 2024-09-13T18:29:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0dddffb640 1 -- 172.21.15.53:0/1209398673 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4003620 con 0x7f0de006fa80 2024-09-13T18:29:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- 172.21.15.53:0/1209398673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de006fa80 msgr2=0x7f0de006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 --2- 172.21.15.53:0/1209398673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de006fa80 0x7f0de006b390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40097c0 tx=0x7f0dd401c350 comp rx=0 tx=0).stop 2024-09-13T18:29:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- 172.21.15.53:0/1209398673 shutdown_connections 2024-09-13T18:29:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 --2- 172.21.15.53:0/1209398673 >> v2:172.21.15.87:3300/0 conn(0x7f0de00cbb60 0x7f0de00b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 --2- 172.21.15.53:0/1209398673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de006fa80 0x7f0de006b390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- 172.21.15.53:0/1209398673 >> 172.21.15.53:0/1209398673 conn(0x7f0de0065c80 msgr2=0x7f0de0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- 172.21.15.53:0/1209398673 shutdown_connections 2024-09-13T18:29:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- 172.21.15.53:0/1209398673 wait complete. 2024-09-13T18:29:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 Processor -- start 2024-09-13T18:29:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- start start 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0de006fa80 0x7f0de0156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de00cbb60 0x7f0de014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0158ba0 0x7f0de014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01500f0 con 0x7f0de0158ba0 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01503d0 con 0x7f0de006fa80 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0de5553640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01506b0 con 0x7f0de00cbb60 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0ddf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0158ba0 0x7f0de014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0ddf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0158ba0 0x7f0de014da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45728/0 (socket says 172.21.15.53:45728) 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.759+0000 7f0ddf7fe640 1 -- 172.21.15.53:0/4034303449 learned_addr learned my addr 172.21.15.53:0/4034303449 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0dde7fc640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de00cbb60 0x7f0de014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddeffd640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0de006fa80 0x7f0de0156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddf7fe640 1 -- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de00cbb60 msgr2=0x7f0de014f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddf7fe640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de00cbb60 0x7f0de014f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddf7fe640 1 -- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0de006fa80 msgr2=0x7f0de0156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddf7fe640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0de006fa80 0x7f0de0156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddf7fe640 1 -- 172.21.15.53:0/4034303449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8009a70 con 0x7f0de0158ba0 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddeffd640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0de006fa80 0x7f0de0156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddf7fe640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0158ba0 0x7f0de014da40 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800efc0 tx=0x7f0dd8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0dc77fe640 1 -- 172.21.15.53:0/4034303449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8009d70 con 0x7f0de0158ba0 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0dc77fe640 1 -- 172.21.15.53:0/4034303449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd800f040 con 0x7f0de0158ba0 2024-09-13T18:29:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0dc77fe640 1 -- 172.21.15.53:0/4034303449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80039a0 con 0x7f0de0158ba0 2024-09-13T18:29:26.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd4009420 con 0x7f0de0158ba0 2024-09-13T18:29:26.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de0150c70 con 0x7f0de0158ba0 2024-09-13T18:29:26.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de0067400 con 0x7f0de0158ba0 2024-09-13T18:29:26.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0dc77fe640 1 -- 172.21.15.53:0/4034303449 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f0dd80144a0 con 0x7f0de0158ba0 2024-09-13T18:29:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0dc77fe640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0dcc0669f0 0x7f0dcc068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0dc77fe640 1 -- 172.21.15.53:0/4034303449 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dd8085390 con 0x7f0de0158ba0 2024-09-13T18:29:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.763+0000 7f0ddeffd640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0dcc0669f0 0x7f0dcc068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.767+0000 7f0ddeffd640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0dcc0669f0 0x7f0dcc068eb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0005890 tx=0x7f0dd0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:26.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.767+0000 7f0dc77fe640 1 -- 172.21.15.53:0/4034303449 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0dd8052270 con 0x7f0de0158ba0 2024-09-13T18:29:26.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.919+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0de00b1e00 con 0x7f0dcc0669f0 2024-09-13T18:29:26.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.939+0000 7f0dc77fe640 1 -- 172.21.15.53:0/4034303449 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273361 (secure 0 0 0) 0x7f0de00b1e00 con 0x7f0dcc0669f0 2024-09-13T18:29:26.942 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:26.945 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:29:26.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0dcc0669f0 msgr2=0x7f0dcc068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0dcc0669f0 0x7f0dcc068eb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0005890 tx=0x7f0dd0009040 comp rx=0 tx=0).stop 2024-09-13T18:29:26.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0158ba0 msgr2=0x7f0de014da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:26.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0158ba0 0x7f0de014da40 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800efc0 tx=0x7f0dd8009f90 comp rx=0 tx=0).stop 2024-09-13T18:29:26.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 shutdown_connections 2024-09-13T18:29:26.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0dcc0669f0 0x7f0dcc068eb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0de00cbb60 0x7f0de014f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0158ba0 0x7f0de014da40 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 --2- 172.21.15.53:0/4034303449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0de006fa80 0x7f0de0156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:26.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 >> 172.21.15.53:0/4034303449 conn(0x7f0de0065c80 msgr2=0x7f0de00cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:26.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 shutdown_connections 2024-09-13T18:29:26.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:26.943+0000 7f0de5553640 1 -- 172.21.15.53:0/4034303449 wait complete. 2024-09-13T18:29:26.961 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-13T18:29:24.991639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260704,"kb_used_data":7624,"kb_used_omap":12,"kb_used_meta":252915,"kb_avail":754714016,"statfs":{"total":773094113280,"available":772827152384,"internally_reserved":0,"allocated":7806976,"data_stored":3935928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":258985528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.221030"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:21.768256+0000","last_change":"2024-09-13T18:29:21.768256+0000","last_active":"2024-09-13T18:29:21.768256+0000","last_peered":"2024-09-13T18:29:21.768256+0000","last_clean":"2024-09-13T18:29:21.768256+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:21.768256+0000","last_undegraded":"2024-09-13T18:29:21.768256+0000","last_fullsized":"2024-09-13T18:29:21.768256+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:29:20.754434+0000","last_change":"2024-09-13T18:29:20.754434+0000","last_active":"2024-09-13T18:29:20.754434+0000","last_peered":"2024-09-13T18:29:20.754434+0000","last_clean":"2024-09-13T18:29:20.754434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:29:20.754434+0000","last_undegraded":"2024-09-13T18:29:20.754434+0000","last_fullsized":"2024-09-13T18:29:20.754434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-13T18:29:17.487371+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:29:17.487371+0000","last_peered":"2024-09-13T18:29:17.487371+0000","last_clean":"2024-09-13T18:29:17.487371+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:29:17.487371+0000","last_undegraded":"2024-09-13T18:29:17.487371+0000","last_fullsized":"2024-09-13T18:29:17.487371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1421312,"data_stored":934767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.88300000000000001},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3080000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1839999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4179999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93400000000000005,"15min":0.92000000000000004},"min":{"1min":0.60499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4890000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82699999999999996,"15min":0.79900000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1060000000000001,"5min":1.276,"15min":1.276},"last":0.755},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5309999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.349,"5min":1.448,"15min":1.448},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94899999999999995,"15min":0.91100000000000003},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2,"5min":1.397,"15min":1.397},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.55800000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2809999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.94099999999999995},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0469999999999999},"min":{"1min":0.70299999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.278,"5min":1.877,"15min":1.877},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.63100000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.78100000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3919999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.1579999999999999,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.78600000000000003},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2170000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.88300000000000001},"min":{"1min":0.626,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.155,"5min":1.577,"15min":1.577},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93400000000000005,"15min":0.89200000000000002},"min":{"1min":0.56399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.157,"5min":1.464,"15min":1.464},"last":0.86199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0669999999999999,"5min":1.268,"15min":1.268},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.208,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88800000000000001,"15min":0.877},"min":{"1min":0.68000000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0800000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1339999999999999,"5min":1.306,"15min":1.306},"last":0.93100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1839999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.036,"5min":1.02,"15min":0.998},"min":{"1min":0.69399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.212,"5min":1.526,"15min":1.526},"last":1.026}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.59699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0469999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.069,"15min":1.107},"min":{"1min":0.73199999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3520000000000001,"5min":2.762,"15min":2.762},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0189999999999999,"15min":1.0409999999999999},"min":{"1min":0.74199999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0429999999999999},"min":{"1min":0.69199999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2410000000000001,"5min":1.72,"15min":1.72},"last":0.81699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89400000000000002,"15min":0.91200000000000003},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.2010000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.96999999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85999999999999999,"15min":0.82799999999999996},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0780000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.71199999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1890000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94199999999999995,"15min":0.96199999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.272,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.087},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":0.98099999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1859999999999999,"5min":1.871,"15min":1.871},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2410000000000001,"5min":1.413,"15min":1.413},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3149999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2050000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.99299999999999999,"15min":1.036},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2410000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1259999999999999},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4039999999999999,"5min":2.246,"15min":2.246},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.145},"min":{"1min":0.74299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2769999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.129}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31940,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.80100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.874,"15min":0.874},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.256,"15min":1.256},"last":1.1120000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.46300000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.874},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.087,"5min":1.147,"15min":1.147},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.66600000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.1859999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.044},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92500000000000004,"15min":0.92900000000000005},"min":{"1min":0.65600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.077}]},{"osd":5,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.298,"15min":1.298},"last":0.996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.94799999999999995,"15min":0.96499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.333,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94099999999999995,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.181,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.022},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1,"15min":1.02},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.377,"15min":1.377},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.042},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.286,"5min":1.482,"15min":1.482},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.044,"15min":1.0760000000000001},"min":{"1min":0.72899999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2010000000000001,"5min":1.466,"15min":1.466},"last":1.147}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31932,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68100000000000005,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.5},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.77400000000000002,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.90800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4199999999999999,"5min":1.704,"15min":1.704},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.67000000000000004,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.79000000000000004,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.399,"15min":1.399},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.97099999999999997,"15min":0.96299999999999997},"min":{"1min":0.77000000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0880000000000001,"15min":1.1279999999999999},"min":{"1min":0.78600000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.028,"15min":1.024},"min":{"1min":0.69499999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2689999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.089},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.96199999999999997,"15min":0.94299999999999995},"min":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.0549999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0680000000000001,"15min":1.0780000000000001},"min":{"1min":0.65900000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5800000000000001,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0629999999999999,"15min":1.054},"min":{"1min":0.83799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.377,"5min":1.96,"15min":1.96},"last":1.0089999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.624,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.665,"5min":3,"15min":3},"last":0.751},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.04,"15min":1.0049999999999999},"min":{"1min":0.75,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.88100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36024,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.68300000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.879,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.91100000000000003,"5min":1.423,"15min":1.423},"last":0.499}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0860000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.745},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79100000000000004,"15min":0.77700000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.274,"15min":1.274},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.91000000000000003},"min":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1890000000000001,"5min":1.611,"15min":1.611},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0620000000000001,"5min":1.492,"15min":1.492},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.99399999999999999,"15min":1.0089999999999999},"min":{"1min":0.68300000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.224,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2230000000000001,"5min":1.702,"15min":1.702},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.155,"5min":1.54,"15min":1.54},"last":0.879},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.036,"15min":1.05},"min":{"1min":0.66000000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.206,"5min":1.452,"15min":1.452},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.657,"15min":1.657},"last":1.018},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.089},"min":{"1min":0.73299999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.345,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1020000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36024,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":827392,"data_stored":344399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63900000000000001,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.90000000000000002,"5min":1.177,"15min":1.177},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.98699999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.40300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1359999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.2010000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.92800000000000005,"15min":0.90700000000000003},"min":{"1min":0.70699999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1279999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.347,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.01,"15min":0.996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.25,"5min":1.653,"15min":1.653},"last":1.077},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.997,"15min":0.98899999999999999},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2629999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.133}]},{"osd":7,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.048,"15min":1.042},"min":{"1min":0.748,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3779999999999999,"5min":1.458,"15min":1.458},"last":1.171},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0429999999999999,"15min":1.0129999999999999},"min":{"1min":0.67100000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.995}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1421312,"data_stored":934767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.998,"5min":1.147,"15min":1.147},"last":0.5},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.244,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68200000000000005,"15min":0.626},"min":{"1min":0.44,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.628},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1639999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3160000000000001,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.77200000000000002,"15min":0.73699999999999999},"min":{"1min":0.51800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2769999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.64400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":1.026},{"interface":"front","average":{"1min":0.998,"5min":0.996,"15min":0.998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4079999999999999,"5min":1.986,"15min":1.986},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.014,"15min":1.016},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8799999999999999,"5min":2.641,"15min":2.641},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.83399999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.343,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.095,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.466,"5min":1.891,"15min":1.891},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.512,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.94899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.03,"15min":1.034},"min":{"1min":0.622,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4319999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.133,"5min":1.1220000000000001,"15min":1.1080000000000001},"min":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.724,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.98199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-09-13T18:29:26.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-09-13T18:29:26.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-09-13T18:29:26.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-09-13T18:29:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-09-13T18:29:26.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2024-09-13T18:29:26.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-09-13T18:29:26.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2024-09-13T18:29:26.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-09-13T18:29:26.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-09-13T18:29:26.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:21.768256+0000', 'last_change': '2024-09-13T18:29:21.768256+0000', 'last_active': '2024-09-13T18:29:21.768256+0000', 'last_peered': '2024-09-13T18:29:21.768256+0000', 'last_clean': '2024-09-13T18:29:21.768256+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:21.768256+0000', 'last_undegraded': '2024-09-13T18:29:21.768256+0000', 'last_fullsized': '2024-09-13T18:29:21.768256+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:21.768256+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2024-09-13T18:29:26.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:29:20.754434+0000', 'last_change': '2024-09-13T18:29:20.754434+0000', 'last_active': '2024-09-13T18:29:20.754434+0000', 'last_peered': '2024-09-13T18:29:20.754434+0000', 'last_clean': '2024-09-13T18:29:20.754434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:29:20.754434+0000', 'last_undegraded': '2024-09-13T18:29:20.754434+0000', 'last_fullsized': '2024-09-13T18:29:20.754434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'last_clean_scrub_stamp': '2024-09-13T18:29:20.754434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:29:26.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:29:27.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.123+0000 7fd7f41e0640 1 Processor -- start 2024-09-13T18:29:27.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.123+0000 7fd7f41e0640 1 -- start start 2024-09-13T18:29:27.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f41e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec06b850 0x7fd7ec0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f41e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec0b1ac0 con 0x7fd7ec0cbd60 2024-09-13T18:29:27.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f41e0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec159ac0 con 0x7fd7ec0cb980 2024-09-13T18:29:27.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f41e0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec159da0 con 0x7fd7ec06b850 2024-09-13T18:29:27.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f277d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd7ec0cbd60 0x7fd7ec0b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36122/0 (socket says 172.21.15.53:36122) 2024-09-13T18:29:27.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f277d640 1 -- 172.21.15.53:0/2955220872 learned_addr learned my addr 172.21.15.53:0/2955220872 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:27.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f177b640 1 --2- 172.21.15.53:0/2955220872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec06b850 0x7fd7ec0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f0f7a640 1 -- 172.21.15.53:0/2955220872 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858031061 0 0) 0x7fd7ec0b1ac0 con 0x7fd7ec0cbd60 2024-09-13T18:29:27.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f0f7a640 1 -- 172.21.15.53:0/2955220872 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d8003530 con 0x7fd7ec0cbd60 2024-09-13T18:29:27.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f0f7a640 1 -- 172.21.15.53:0/2955220872 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593020689 0 0) 0x7fd7d8003530 con 0x7fd7ec0cbd60 2024-09-13T18:29:27.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f177b640 1 -- 172.21.15.53:0/2955220872 >> v1:172.21.15.87:6789/0 conn(0x7fd7ec0cb980 legacy=0x7fd7ec06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f177b640 1 -- 172.21.15.53:0/2955220872 >> v1:172.21.15.53:6789/0 conn(0x7fd7ec0cbd60 legacy=0x7fd7ec0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f177b640 1 -- 172.21.15.53:0/2955220872 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec15a080 con 0x7fd7ec06b850 2024-09-13T18:29:27.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f177b640 1 --2- 172.21.15.53:0/2955220872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec06b850 0x7fd7ec0b33b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0097f0 tx=0x7fd7dc01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4825cac831b55a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:27.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f0f7a640 1 -- 172.21.15.53:0/2955220872 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4001a00 con 0x7fd7ec06b850 2024-09-13T18:29:27.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f0f7a640 1 -- 172.21.15.53:0/2955220872 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc0a7050 con 0x7fd7ec06b850 2024-09-13T18:29:27.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.127+0000 7fd7f0f7a640 1 -- 172.21.15.53:0/2955220872 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0ab600 con 0x7fd7ec06b850 2024-09-13T18:29:27.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- 172.21.15.53:0/2955220872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec06b850 msgr2=0x7fd7ec0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/2955220872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec06b850 0x7fd7ec0b33b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0097f0 tx=0x7fd7dc01c340 comp rx=0 tx=0).stop 2024-09-13T18:29:27.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- 172.21.15.53:0/2955220872 shutdown_connections 2024-09-13T18:29:27.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/2955220872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec06b850 0x7fd7ec0b33b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- 172.21.15.53:0/2955220872 >> 172.21.15.53:0/2955220872 conn(0x7fd7ec065c80 msgr2=0x7fd7ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:27.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- 172.21.15.53:0/2955220872 shutdown_connections 2024-09-13T18:29:27.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- 172.21.15.53:0/2955220872 wait complete. 2024-09-13T18:29:27.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 Processor -- start 2024-09-13T18:29:27.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- start start 2024-09-13T18:29:27.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7ec06b850 0x7fd7ec14b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec0cb980 0x7fd7ec0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7ec0cbd60 0x7fd7ec14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec14bc70 con 0x7fd7ec06b850 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec14b2a0 con 0x7fd7ec0cbd60 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0adcc0 con 0x7fd7ec0cb980 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7ec06b850 0x7fd7ec14b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7ec06b850 0x7fd7ec14b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45732/0 (socket says 172.21.15.53:45732) 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 -- 172.21.15.53:0/1837837544 learned_addr learned my addr 172.21.15.53:0/1837837544 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f177b640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec0cb980 0x7fd7ec0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f277d640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7ec0cbd60 0x7fd7ec14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 -- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec0cb980 msgr2=0x7fd7ec0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec0cb980 0x7fd7ec0af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 -- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7ec0cbd60 msgr2=0x7fd7ec14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7ec0cbd60 0x7fd7ec14cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 -- 172.21.15.53:0/1837837544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc009420 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f1f7c640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7ec06b850 0x7fd7ec14b730 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800c500 tx=0x7fd7e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7e27fc640 1 -- 172.21.15.53:0/1837837544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8005220 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7e27fc640 1 -- 172.21.15.53:0/1837837544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8005380 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec0ad700 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.131+0000 7fd7e27fc640 1 -- 172.21.15.53:0/1837837544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8007270 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.135+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec14af30 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.135+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec067400 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.135+0000 7fd7e27fc640 1 -- 172.21.15.53:0/1837837544 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fd7e80073d0 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.135+0000 7fd7e27fc640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd7d00669f0 0x7fd7d0068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.135+0000 7fd7e27fc640 1 -- 172.21.15.53:0/1837837544 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7e8084c40 con 0x7fd7ec06b850 2024-09-13T18:29:27.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.135+0000 7fd7f177b640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd7d00669f0 0x7fd7d0068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.135+0000 7fd7f177b640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd7d00669f0 0x7fd7d0068eb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ad000 tx=0x7fd7dc0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:27.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.139+0000 7fd7e27fc640 1 -- 172.21.15.53:0/1837837544 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7e8051ce0 con 0x7fd7ec06b850 2024-09-13T18:29:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.363+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd7ec0cdcc0 con 0x7fd7ec06b850 2024-09-13T18:29:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.363+0000 7fd7e27fc640 1 -- 172.21.15.53:0/1837837544 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7fd7e8055300 con 0x7fd7ec06b850 2024-09-13T18:29:27.367 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:27.367 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":293,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1726251884,"num_in_osds":8,"osd_in_since":1726251876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":267362304,"bytes_avail":772826750976,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6861}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-13T18:27:48.958854+0000","services":{}},"progress_events":{}} 2024-09-13T18:29:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd7d00669f0 msgr2=0x7fd7d0068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd7d00669f0 0x7fd7d0068eb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ad000 tx=0x7fd7dc0a6000 comp rx=0 tx=0).stop 2024-09-13T18:29:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7ec06b850 msgr2=0x7fd7ec14b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7ec06b850 0x7fd7ec14b730 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800c500 tx=0x7fd7e800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 shutdown_connections 2024-09-13T18:29:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd7d00669f0 0x7fd7d0068eb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7ec0cb980 0x7fd7ec0af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd7ec0cbd60 0x7fd7ec14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 --2- 172.21.15.53:0/1837837544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7ec06b850 0x7fd7ec14b730 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 >> 172.21.15.53:0/1837837544 conn(0x7fd7ec065c80 msgr2=0x7fd7ec06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 shutdown_connections 2024-09-13T18:29:27.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.367+0000 7fd7f41e0640 1 -- 172.21.15.53:0/1837837544 wait complete. 2024-09-13T18:29:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:29:27.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4330dd4640 1 Processor -- start 2024-09-13T18:29:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4330dd4640 1 -- start start 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4330dd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 0x7f432c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4330dd4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c0b1ac0 con 0x7f432c0cb980 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4330dd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c159ac0 con 0x7f432c06b850 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4330dd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c159da0 con 0x7f432c0cbd60 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f432c0cb980 0x7f432c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36130/0 (socket says 172.21.15.53:36130) 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 -- 172.21.15.53:0/1056647812 learned_addr learned my addr 172.21.15.53:0/1056647812 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432ad9d640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 0x7f432c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158450138 0 0) 0x7f432c0b1ac0 con 0x7f432c0cb980 2024-09-13T18:29:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4318003530 con 0x7f432c0cb980 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1523172630 0 0) 0x7f4318003530 con 0x7f432c0cb980 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 msgr2=0x7f432c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 0x7f432c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 >> v1:172.21.15.87:6789/0 conn(0x7f432c06b850 legacy=0x7f432c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c15a080 con 0x7f432c0cb980 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f431c001680 con 0x7f432c0cb980 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 >> v1:172.21.15.53:6789/0 conn(0x7f432c0cb980 legacy=0x7f432c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180039b0 0x7f4318003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180047d0 0x7f4318004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 0x7f43180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c159da0 con 0x7f43180039b0 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431800bac0 con 0x7f43180047d0 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431800de90 con 0x7f432c0cbd60 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180039b0 0x7f4318003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432ad9d640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 0x7f43180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 -- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 msgr2=0x7f43180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c0cbd60 0x7f43180051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 -- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180047d0 msgr2=0x7f4318004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180047d0 0x7f4318004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.503+0000 7f432a59c640 1 -- 172.21.15.53:0/1056647812 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318003530 con 0x7f43180039b0 2024-09-13T18:29:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f432a59c640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180039b0 0x7f4318003dd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f431c00c240 tx=0x7f431c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdc38a1fea40587 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c0a5b10 con 0x7f43180039b0 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c0a5c70 con 0x7f43180039b0 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4329d9b640 1 -- 172.21.15.53:0/1056647812 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c005b20 con 0x7f43180039b0 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 -- 172.21.15.53:0/1056647812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180039b0 msgr2=0x7f4318003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 --2- 172.21.15.53:0/1056647812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43180039b0 0x7f4318003dd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f431c00c240 tx=0x7f431c01cc30 comp rx=0 tx=0).stop 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f432ad9d640 1 -- 172.21.15.53:0/1056647812 reap_dead start 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 -- 172.21.15.53:0/1056647812 shutdown_connections 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 -- 172.21.15.53:0/1056647812 >> 172.21.15.53:0/1056647812 conn(0x7f432c065c80 msgr2=0x7f432c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 -- 172.21.15.53:0/1056647812 shutdown_connections 2024-09-13T18:29:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 -- 172.21.15.53:0/1056647812 wait complete. 2024-09-13T18:29:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 Processor -- start 2024-09-13T18:29:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.507+0000 7f4330dd4640 1 -- start start 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180039b0 0x7f432c14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c1608f0 0x7f432c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0cc300 0x7f432c0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c162fb0 con 0x7f432c0cc300 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0cccd0 con 0x7f43180039b0 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c14f970 con 0x7f432c1608f0 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0cc300 0x7f432c0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0cc300 0x7f432c0cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45754/0 (socket says 172.21.15.53:45754) 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 -- 172.21.15.53:0/3553892784 learned_addr learned my addr 172.21.15.53:0/3553892784 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432a59c640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180039b0 0x7f432c14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4321d9b640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c1608f0 0x7f432c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 -- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c1608f0 msgr2=0x7f432c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c1608f0 0x7f432c0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 -- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180039b0 msgr2=0x7f432c14f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180039b0 0x7f432c14f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 -- 172.21.15.53:0/3553892784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c162710 con 0x7f432c0cc300 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432ad9d640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0cc300 0x7f432c0cc790 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f432c070a10 tx=0x7f432400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f43237fe640 1 -- 172.21.15.53:0/3553892784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324017400 con 0x7f432c0cc300 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f43237fe640 1 -- 172.21.15.53:0/3553892784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324011040 con 0x7f432c0cc300 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c1629f0 con 0x7f432c0cc300 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f43237fe640 1 -- 172.21.15.53:0/3553892784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240177e0 con 0x7f432c0cc300 2024-09-13T18:29:27.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c0aca80 con 0x7f432c0cc300 2024-09-13T18:29:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c067400 con 0x7f432c0cc300 2024-09-13T18:29:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f43237fe640 1 -- 172.21.15.53:0/3553892784 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f4324017940 con 0x7f432c0cc300 2024-09-13T18:29:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f43237fe640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f430c0669f0 0x7f430c068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f43237fe640 1 -- 172.21.15.53:0/3553892784 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4324084ba0 con 0x7f432c0cc300 2024-09-13T18:29:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.511+0000 7f432a59c640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f430c0669f0 0x7f430c068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:27.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.515+0000 7f432a59c640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f430c0669f0 0x7f430c068eb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ab000 tx=0x7f431c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:27.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.515+0000 7f43237fe640 1 -- 172.21.15.53:0/3553892784 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43240519f0 con 0x7f432c0cc300 2024-09-13T18:29:27.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.671+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f432c0ac8e0 con 0x7f430c0669f0 2024-09-13T18:29:27.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.695+0000 7f43237fe640 1 -- 172.21.15.53:0/3553892784 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288185 (secure 0 0 0) 0x7f432c0ac8e0 con 0x7f430c0669f0 2024-09-13T18:29:27.698 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:27.700 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:29:27.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f430c0669f0 msgr2=0x7f430c068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f430c0669f0 0x7f430c068eb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f431c0ab000 tx=0x7f431c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:29:27.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0cc300 msgr2=0x7f432c0cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:27.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0cc300 0x7f432c0cc790 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f432c070a10 tx=0x7f432400f4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 shutdown_connections 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f430c0669f0 0x7f430c068eb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f432c1608f0 0x7f432c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0cc300 0x7f432c0cc790 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 --2- 172.21.15.53:0/3553892784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43180039b0 0x7f432c14f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 >> 172.21.15.53:0/3553892784 conn(0x7f432c065c80 msgr2=0x7f432c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 shutdown_connections 2024-09-13T18:29:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:27.699+0000 7f4330dd4640 1 -- 172.21.15.53:0/3553892784 wait complete. 2024-09-13T18:29:27.717 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-13T18:29:26.992219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261096,"kb_used_data":8072,"kb_used_omap":12,"kb_used_meta":252915,"kb_avail":754713624,"statfs":{"total":773094113280,"available":772826750976,"internally_reserved":0,"allocated":8265728,"data_stored":4141988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":258985528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001695"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736994+0000","last_change":"2024-09-13T18:29:22.217519+0000","last_active":"2024-09-13T18:29:23.736994+0000","last_peered":"2024-09-13T18:29:23.736994+0000","last_clean":"2024-09-13T18:29:23.736994+0000","last_became_active":"2024-09-13T18:29:22.213107+0000","last_became_peered":"2024-09-13T18:29:22.213107+0000","last_unstale":"2024-09-13T18:29:23.736994+0000","last_undegraded":"2024-09-13T18:29:23.736994+0000","last_fullsized":"2024-09-13T18:29:23.736994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:07.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.711221+0000","last_change":"2024-09-13T18:29:22.230792+0000","last_active":"2024-09-13T18:29:23.711221+0000","last_peered":"2024-09-13T18:29:23.711221+0000","last_clean":"2024-09-13T18:29:23.711221+0000","last_became_active":"2024-09-13T18:29:22.230128+0000","last_became_peered":"2024-09-13T18:29:22.230128+0000","last_unstale":"2024-09-13T18:29:23.711221+0000","last_undegraded":"2024-09-13T18:29:23.711221+0000","last_fullsized":"2024-09-13T18:29:23.711221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.316748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737236+0000","last_change":"2024-09-13T18:29:22.190882+0000","last_active":"2024-09-13T18:29:23.737236+0000","last_peered":"2024-09-13T18:29:23.737236+0000","last_clean":"2024-09-13T18:29:23.737236+0000","last_became_active":"2024-09-13T18:29:22.190423+0000","last_became_peered":"2024-09-13T18:29:22.190423+0000","last_unstale":"2024-09-13T18:29:23.737236+0000","last_undegraded":"2024-09-13T18:29:23.737236+0000","last_fullsized":"2024-09-13T18:29:23.737236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:57.223454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178908+0000","last_change":"2024-09-13T18:29:22.229047+0000","last_active":"2024-09-13T18:29:23.178908+0000","last_peered":"2024-09-13T18:29:23.178908+0000","last_clean":"2024-09-13T18:29:23.178908+0000","last_became_active":"2024-09-13T18:29:22.228740+0000","last_became_peered":"2024-09-13T18:29:22.228740+0000","last_unstale":"2024-09-13T18:29:23.178908+0000","last_undegraded":"2024-09-13T18:29:23.178908+0000","last_fullsized":"2024-09-13T18:29:23.178908+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:36.762820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738817+0000","last_change":"2024-09-13T18:29:22.205666+0000","last_active":"2024-09-13T18:29:23.738817+0000","last_peered":"2024-09-13T18:29:23.738817+0000","last_clean":"2024-09-13T18:29:23.738817+0000","last_became_active":"2024-09-13T18:29:22.205378+0000","last_became_peered":"2024-09-13T18:29:22.205378+0000","last_unstale":"2024-09-13T18:29:23.738817+0000","last_undegraded":"2024-09-13T18:29:23.738817+0000","last_fullsized":"2024-09-13T18:29:23.738817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:10.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710225+0000","last_change":"2024-09-13T18:29:22.237421+0000","last_active":"2024-09-13T18:29:23.710225+0000","last_peered":"2024-09-13T18:29:23.710225+0000","last_clean":"2024-09-13T18:29:23.710225+0000","last_became_active":"2024-09-13T18:29:22.233385+0000","last_became_peered":"2024-09-13T18:29:22.233385+0000","last_unstale":"2024-09-13T18:29:23.710225+0000","last_undegraded":"2024-09-13T18:29:23.710225+0000","last_fullsized":"2024-09-13T18:29:23.710225+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:25.252709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736334+0000","last_change":"2024-09-13T18:29:22.204296+0000","last_active":"2024-09-13T18:29:23.736334+0000","last_peered":"2024-09-13T18:29:23.736334+0000","last_clean":"2024-09-13T18:29:23.736334+0000","last_became_active":"2024-09-13T18:29:22.203634+0000","last_became_peered":"2024-09-13T18:29:22.203634+0000","last_unstale":"2024-09-13T18:29:23.736334+0000","last_undegraded":"2024-09-13T18:29:23.736334+0000","last_fullsized":"2024-09-13T18:29:23.736334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710012+0000","last_change":"2024-09-13T18:29:22.216156+0000","last_active":"2024-09-13T18:29:23.710012+0000","last_peered":"2024-09-13T18:29:23.710012+0000","last_clean":"2024-09-13T18:29:23.710012+0000","last_became_active":"2024-09-13T18:29:22.215299+0000","last_became_peered":"2024-09-13T18:29:22.215299+0000","last_unstale":"2024-09-13T18:29:23.710012+0000","last_undegraded":"2024-09-13T18:29:23.710012+0000","last_fullsized":"2024-09-13T18:29:23.710012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:59.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739827+0000","last_change":"2024-09-13T18:29:22.192138+0000","last_active":"2024-09-13T18:29:23.739827+0000","last_peered":"2024-09-13T18:29:23.739827+0000","last_clean":"2024-09-13T18:29:23.739827+0000","last_became_active":"2024-09-13T18:29:22.191682+0000","last_became_peered":"2024-09-13T18:29:22.191682+0000","last_unstale":"2024-09-13T18:29:23.739827+0000","last_undegraded":"2024-09-13T18:29:23.739827+0000","last_fullsized":"2024-09-13T18:29:23.739827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:37.130797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181440+0000","last_change":"2024-09-13T18:29:22.193165+0000","last_active":"2024-09-13T18:29:23.181440+0000","last_peered":"2024-09-13T18:29:23.181440+0000","last_clean":"2024-09-13T18:29:23.181440+0000","last_became_active":"2024-09-13T18:29:22.189719+0000","last_became_peered":"2024-09-13T18:29:22.189719+0000","last_unstale":"2024-09-13T18:29:23.181440+0000","last_undegraded":"2024-09-13T18:29:23.181440+0000","last_fullsized":"2024-09-13T18:29:23.181440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:07.269438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736251+0000","last_change":"2024-09-13T18:29:22.211687+0000","last_active":"2024-09-13T18:29:23.736251+0000","last_peered":"2024-09-13T18:29:23.736251+0000","last_clean":"2024-09-13T18:29:23.736251+0000","last_became_active":"2024-09-13T18:29:22.208383+0000","last_became_peered":"2024-09-13T18:29:22.208383+0000","last_unstale":"2024-09-13T18:29:23.736251+0000","last_undegraded":"2024-09-13T18:29:23.736251+0000","last_fullsized":"2024-09-13T18:29:23.736251+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:02.483389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179174+0000","last_change":"2024-09-13T18:29:22.193463+0000","last_active":"2024-09-13T18:29:23.179174+0000","last_peered":"2024-09-13T18:29:23.179174+0000","last_clean":"2024-09-13T18:29:23.179174+0000","last_became_active":"2024-09-13T18:29:22.192863+0000","last_became_peered":"2024-09-13T18:29:22.192863+0000","last_unstale":"2024-09-13T18:29:23.179174+0000","last_undegraded":"2024-09-13T18:29:23.179174+0000","last_fullsized":"2024-09-13T18:29:23.179174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:45.836047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736594+0000","last_change":"2024-09-13T18:29:22.229071+0000","last_active":"2024-09-13T18:29:23.736594+0000","last_peered":"2024-09-13T18:29:23.736594+0000","last_clean":"2024-09-13T18:29:23.736594+0000","last_became_active":"2024-09-13T18:29:22.228659+0000","last_became_peered":"2024-09-13T18:29:22.228659+0000","last_unstale":"2024-09-13T18:29:23.736594+0000","last_undegraded":"2024-09-13T18:29:23.736594+0000","last_fullsized":"2024-09-13T18:29:23.736594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:57.285380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739153+0000","last_change":"2024-09-13T18:29:22.206289+0000","last_active":"2024-09-13T18:29:23.739153+0000","last_peered":"2024-09-13T18:29:23.739153+0000","last_clean":"2024-09-13T18:29:23.739153+0000","last_became_active":"2024-09-13T18:29:22.204880+0000","last_became_peered":"2024-09-13T18:29:22.204880+0000","last_unstale":"2024-09-13T18:29:23.739153+0000","last_undegraded":"2024-09-13T18:29:23.739153+0000","last_fullsized":"2024-09-13T18:29:23.739153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:18.955924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736207+0000","last_change":"2024-09-13T18:29:22.188014+0000","last_active":"2024-09-13T18:29:23.736207+0000","last_peered":"2024-09-13T18:29:23.736207+0000","last_clean":"2024-09-13T18:29:23.736207+0000","last_became_active":"2024-09-13T18:29:22.187511+0000","last_became_peered":"2024-09-13T18:29:22.187511+0000","last_unstale":"2024-09-13T18:29:23.736207+0000","last_undegraded":"2024-09-13T18:29:23.736207+0000","last_fullsized":"2024-09-13T18:29:23.736207+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:27.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180368+0000","last_change":"2024-09-13T18:29:22.229946+0000","last_active":"2024-09-13T18:29:23.180368+0000","last_peered":"2024-09-13T18:29:23.180368+0000","last_clean":"2024-09-13T18:29:23.180368+0000","last_became_active":"2024-09-13T18:29:22.229235+0000","last_became_peered":"2024-09-13T18:29:22.229235+0000","last_unstale":"2024-09-13T18:29:23.180368+0000","last_undegraded":"2024-09-13T18:29:23.180368+0000","last_fullsized":"2024-09-13T18:29:23.180368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739910+0000","last_change":"2024-09-13T18:29:22.191967+0000","last_active":"2024-09-13T18:29:23.739910+0000","last_peered":"2024-09-13T18:29:23.739910+0000","last_clean":"2024-09-13T18:29:23.739910+0000","last_became_active":"2024-09-13T18:29:22.191348+0000","last_became_peered":"2024-09-13T18:29:22.191348+0000","last_unstale":"2024-09-13T18:29:23.739910+0000","last_undegraded":"2024-09-13T18:29:23.739910+0000","last_fullsized":"2024-09-13T18:29:23.739910+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:39.886726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178997+0000","last_change":"2024-09-13T18:29:22.224034+0000","last_active":"2024-09-13T18:29:23.178997+0000","last_peered":"2024-09-13T18:29:23.178997+0000","last_clean":"2024-09-13T18:29:23.178997+0000","last_became_active":"2024-09-13T18:29:22.223791+0000","last_became_peered":"2024-09-13T18:29:22.223791+0000","last_unstale":"2024-09-13T18:29:23.178997+0000","last_undegraded":"2024-09-13T18:29:23.178997+0000","last_fullsized":"2024-09-13T18:29:23.178997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.839438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710585+0000","last_change":"2024-09-13T18:29:22.231594+0000","last_active":"2024-09-13T18:29:23.710585+0000","last_peered":"2024-09-13T18:29:23.710585+0000","last_clean":"2024-09-13T18:29:23.710585+0000","last_became_active":"2024-09-13T18:29:22.230865+0000","last_became_peered":"2024-09-13T18:29:22.230865+0000","last_unstale":"2024-09-13T18:29:23.710585+0000","last_undegraded":"2024-09-13T18:29:23.710585+0000","last_fullsized":"2024-09-13T18:29:23.710585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:37.955157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736547+0000","last_change":"2024-09-13T18:29:22.201787+0000","last_active":"2024-09-13T18:29:23.736547+0000","last_peered":"2024-09-13T18:29:23.736547+0000","last_clean":"2024-09-13T18:29:23.736547+0000","last_became_active":"2024-09-13T18:29:22.201492+0000","last_became_peered":"2024-09-13T18:29:22.201492+0000","last_unstale":"2024-09-13T18:29:23.736547+0000","last_undegraded":"2024-09-13T18:29:23.736547+0000","last_fullsized":"2024-09-13T18:29:23.736547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:30.863532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180709+0000","last_change":"2024-09-13T18:29:22.187687+0000","last_active":"2024-09-13T18:29:23.180709+0000","last_peered":"2024-09-13T18:29:23.180709+0000","last_clean":"2024-09-13T18:29:23.180709+0000","last_became_active":"2024-09-13T18:29:22.186982+0000","last_became_peered":"2024-09-13T18:29:22.186982+0000","last_unstale":"2024-09-13T18:29:23.180709+0000","last_undegraded":"2024-09-13T18:29:23.180709+0000","last_fullsized":"2024-09-13T18:29:23.180709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180759+0000","last_change":"2024-09-13T18:29:22.191064+0000","last_active":"2024-09-13T18:29:23.180759+0000","last_peered":"2024-09-13T18:29:23.180759+0000","last_clean":"2024-09-13T18:29:23.180759+0000","last_became_active":"2024-09-13T18:29:22.190408+0000","last_became_peered":"2024-09-13T18:29:22.190408+0000","last_unstale":"2024-09-13T18:29:23.180759+0000","last_undegraded":"2024-09-13T18:29:23.180759+0000","last_fullsized":"2024-09-13T18:29:23.180759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:27.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735598+0000","last_change":"2024-09-13T18:29:22.206460+0000","last_active":"2024-09-13T18:29:23.735598+0000","last_peered":"2024-09-13T18:29:23.735598+0000","last_clean":"2024-09-13T18:29:23.735598+0000","last_became_active":"2024-09-13T18:29:22.205790+0000","last_became_peered":"2024-09-13T18:29:22.205790+0000","last_unstale":"2024-09-13T18:29:23.735598+0000","last_undegraded":"2024-09-13T18:29:23.735598+0000","last_fullsized":"2024-09-13T18:29:23.735598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:36.806965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735462+0000","last_change":"2024-09-13T18:29:22.238885+0000","last_active":"2024-09-13T18:29:23.735462+0000","last_peered":"2024-09-13T18:29:23.735462+0000","last_clean":"2024-09-13T18:29:23.735462+0000","last_became_active":"2024-09-13T18:29:22.238304+0000","last_became_peered":"2024-09-13T18:29:22.238304+0000","last_unstale":"2024-09-13T18:29:23.735462+0000","last_undegraded":"2024-09-13T18:29:23.735462+0000","last_fullsized":"2024-09-13T18:29:23.735462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:01.430757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181437+0000","last_change":"2024-09-13T18:29:22.209217+0000","last_active":"2024-09-13T18:29:23.181437+0000","last_peered":"2024-09-13T18:29:23.181437+0000","last_clean":"2024-09-13T18:29:23.181437+0000","last_became_active":"2024-09-13T18:29:22.208470+0000","last_became_peered":"2024-09-13T18:29:22.208470+0000","last_unstale":"2024-09-13T18:29:23.181437+0000","last_undegraded":"2024-09-13T18:29:23.181437+0000","last_fullsized":"2024-09-13T18:29:23.181437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:45.858076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737456+0000","last_change":"2024-09-13T18:29:22.234575+0000","last_active":"2024-09-13T18:29:23.737456+0000","last_peered":"2024-09-13T18:29:23.737456+0000","last_clean":"2024-09-13T18:29:23.737456+0000","last_became_active":"2024-09-13T18:29:22.233930+0000","last_became_peered":"2024-09-13T18:29:22.233930+0000","last_unstale":"2024-09-13T18:29:23.737456+0000","last_undegraded":"2024-09-13T18:29:23.737456+0000","last_fullsized":"2024-09-13T18:29:23.737456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:32.365048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737392+0000","last_change":"2024-09-13T18:29:22.218013+0000","last_active":"2024-09-13T18:29:23.737392+0000","last_peered":"2024-09-13T18:29:23.737392+0000","last_clean":"2024-09-13T18:29:23.737392+0000","last_became_active":"2024-09-13T18:29:22.217697+0000","last_became_peered":"2024-09-13T18:29:22.217697+0000","last_unstale":"2024-09-13T18:29:23.737392+0000","last_undegraded":"2024-09-13T18:29:23.737392+0000","last_fullsized":"2024-09-13T18:29:23.737392+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:39.668594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181261+0000","last_change":"2024-09-13T18:29:22.192319+0000","last_active":"2024-09-13T18:29:23.181261+0000","last_peered":"2024-09-13T18:29:23.181261+0000","last_clean":"2024-09-13T18:29:23.181261+0000","last_became_active":"2024-09-13T18:29:22.191567+0000","last_became_peered":"2024-09-13T18:29:22.191567+0000","last_unstale":"2024-09-13T18:29:23.181261+0000","last_undegraded":"2024-09-13T18:29:23.181261+0000","last_fullsized":"2024-09-13T18:29:23.181261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:30.863532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737160+0000","last_change":"2024-09-13T18:29:22.200821+0000","last_active":"2024-09-13T18:29:23.737160+0000","last_peered":"2024-09-13T18:29:23.737160+0000","last_clean":"2024-09-13T18:29:23.737160+0000","last_became_active":"2024-09-13T18:29:22.200535+0000","last_became_peered":"2024-09-13T18:29:22.200535+0000","last_unstale":"2024-09-13T18:29:23.737160+0000","last_undegraded":"2024-09-13T18:29:23.737160+0000","last_fullsized":"2024-09-13T18:29:23.737160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:53.588081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736836+0000","last_change":"2024-09-13T18:29:22.240191+0000","last_active":"2024-09-13T18:29:23.736836+0000","last_peered":"2024-09-13T18:29:23.736836+0000","last_clean":"2024-09-13T18:29:23.736836+0000","last_became_active":"2024-09-13T18:29:22.238820+0000","last_became_peered":"2024-09-13T18:29:22.238820+0000","last_unstale":"2024-09-13T18:29:23.736836+0000","last_undegraded":"2024-09-13T18:29:23.736836+0000","last_fullsized":"2024-09-13T18:29:23.736836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:02.483389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736580+0000","last_change":"2024-09-13T18:29:22.199976+0000","last_active":"2024-09-13T18:29:23.736580+0000","last_peered":"2024-09-13T18:29:23.736580+0000","last_clean":"2024-09-13T18:29:23.736580+0000","last_became_active":"2024-09-13T18:29:22.199156+0000","last_became_peered":"2024-09-13T18:29:22.199156+0000","last_unstale":"2024-09-13T18:29:23.736580+0000","last_undegraded":"2024-09-13T18:29:23.736580+0000","last_fullsized":"2024-09-13T18:29:23.736580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:07.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710185+0000","last_change":"2024-09-13T18:29:22.219707+0000","last_active":"2024-09-13T18:29:23.710185+0000","last_peered":"2024-09-13T18:29:23.710185+0000","last_clean":"2024-09-13T18:29:23.710185+0000","last_became_active":"2024-09-13T18:29:22.216414+0000","last_became_peered":"2024-09-13T18:29:22.216414+0000","last_unstale":"2024-09-13T18:29:23.710185+0000","last_undegraded":"2024-09-13T18:29:23.710185+0000","last_fullsized":"2024-09-13T18:29:23.710185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:46.392068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736737+0000","last_change":"2024-09-13T18:29:22.235951+0000","last_active":"2024-09-13T18:29:23.736737+0000","last_peered":"2024-09-13T18:29:23.736737+0000","last_clean":"2024-09-13T18:29:23.736737+0000","last_became_active":"2024-09-13T18:29:22.235119+0000","last_became_peered":"2024-09-13T18:29:22.235119+0000","last_unstale":"2024-09-13T18:29:23.736737+0000","last_undegraded":"2024-09-13T18:29:23.736737+0000","last_fullsized":"2024-09-13T18:29:23.736737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:50.204435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737250+0000","last_change":"2024-09-13T18:29:21.818058+0000","last_active":"2024-09-13T18:29:23.737250+0000","last_peered":"2024-09-13T18:29:23.737250+0000","last_clean":"2024-09-13T18:29:23.737250+0000","last_became_active":"2024-09-13T18:29:21.817741+0000","last_became_peered":"2024-09-13T18:29:21.817741+0000","last_unstale":"2024-09-13T18:29:23.737250+0000","last_undegraded":"2024-09-13T18:29:23.737250+0000","last_fullsized":"2024-09-13T18:29:23.737250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.624867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739967+0000","last_change":"2024-09-13T18:29:22.192178+0000","last_active":"2024-09-13T18:29:23.739967+0000","last_peered":"2024-09-13T18:29:23.739967+0000","last_clean":"2024-09-13T18:29:23.739967+0000","last_became_active":"2024-09-13T18:29:22.190862+0000","last_became_peered":"2024-09-13T18:29:22.190862+0000","last_unstale":"2024-09-13T18:29:23.739967+0000","last_undegraded":"2024-09-13T18:29:23.739967+0000","last_fullsized":"2024-09-13T18:29:23.739967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:14.181008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737106+0000","last_change":"2024-09-13T18:29:21.800383+0000","last_active":"2024-09-13T18:29:23.737106+0000","last_peered":"2024-09-13T18:29:23.737106+0000","last_clean":"2024-09-13T18:29:23.737106+0000","last_became_active":"2024-09-13T18:29:21.800027+0000","last_became_peered":"2024-09-13T18:29:21.800027+0000","last_unstale":"2024-09-13T18:29:23.737106+0000","last_undegraded":"2024-09-13T18:29:23.737106+0000","last_fullsized":"2024-09-13T18:29:23.737106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:47.837033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710827+0000","last_change":"2024-09-13T18:29:22.235768+0000","last_active":"2024-09-13T18:29:23.710827+0000","last_peered":"2024-09-13T18:29:23.710827+0000","last_clean":"2024-09-13T18:29:23.710827+0000","last_became_active":"2024-09-13T18:29:22.235154+0000","last_became_peered":"2024-09-13T18:29:22.235154+0000","last_unstale":"2024-09-13T18:29:23.710827+0000","last_undegraded":"2024-09-13T18:29:23.710827+0000","last_fullsized":"2024-09-13T18:29:23.710827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:05.969097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181548+0000","last_change":"2024-09-13T18:29:21.821440+0000","last_active":"2024-09-13T18:29:23.181548+0000","last_peered":"2024-09-13T18:29:23.181548+0000","last_clean":"2024-09-13T18:29:23.181548+0000","last_became_active":"2024-09-13T18:29:21.820756+0000","last_became_peered":"2024-09-13T18:29:21.820756+0000","last_unstale":"2024-09-13T18:29:23.181548+0000","last_undegraded":"2024-09-13T18:29:23.181548+0000","last_fullsized":"2024-09-13T18:29:23.181548+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:29.718583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736497+0000","last_change":"2024-09-13T18:29:22.218556+0000","last_active":"2024-09-13T18:29:23.736497+0000","last_peered":"2024-09-13T18:29:23.736497+0000","last_clean":"2024-09-13T18:29:23.736497+0000","last_became_active":"2024-09-13T18:29:22.217454+0000","last_became_peered":"2024-09-13T18:29:22.217454+0000","last_unstale":"2024-09-13T18:29:23.736497+0000","last_undegraded":"2024-09-13T18:29:23.736497+0000","last_fullsized":"2024-09-13T18:29:23.736497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:48.164227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.711092+0000","last_change":"2024-09-13T18:29:21.818671+0000","last_active":"2024-09-13T18:29:23.711092+0000","last_peered":"2024-09-13T18:29:23.711092+0000","last_clean":"2024-09-13T18:29:23.711092+0000","last_became_active":"2024-09-13T18:29:21.817849+0000","last_became_peered":"2024-09-13T18:29:21.817849+0000","last_unstale":"2024-09-13T18:29:23.711092+0000","last_undegraded":"2024-09-13T18:29:23.711092+0000","last_fullsized":"2024-09-13T18:29:23.711092+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:04.316558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736679+0000","last_change":"2024-09-13T18:29:22.203871+0000","last_active":"2024-09-13T18:29:23.736679+0000","last_peered":"2024-09-13T18:29:23.736679+0000","last_clean":"2024-09-13T18:29:23.736679+0000","last_became_active":"2024-09-13T18:29:22.203176+0000","last_became_peered":"2024-09-13T18:29:22.203176+0000","last_unstale":"2024-09-13T18:29:23.736679+0000","last_undegraded":"2024-09-13T18:29:23.736679+0000","last_fullsized":"2024-09-13T18:29:23.736679+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:27.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737424+0000","last_change":"2024-09-13T18:29:21.812550+0000","last_active":"2024-09-13T18:29:23.737424+0000","last_peered":"2024-09-13T18:29:23.737424+0000","last_clean":"2024-09-13T18:29:23.737424+0000","last_became_active":"2024-09-13T18:29:21.812285+0000","last_became_peered":"2024-09-13T18:29:21.812285+0000","last_unstale":"2024-09-13T18:29:23.737424+0000","last_undegraded":"2024-09-13T18:29:23.737424+0000","last_fullsized":"2024-09-13T18:29:23.737424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:49.190613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181088+0000","last_change":"2024-09-13T18:29:22.200310+0000","last_active":"2024-09-13T18:29:23.181088+0000","last_peered":"2024-09-13T18:29:23.181088+0000","last_clean":"2024-09-13T18:29:23.181088+0000","last_became_active":"2024-09-13T18:29:22.199474+0000","last_became_peered":"2024-09-13T18:29:22.199474+0000","last_unstale":"2024-09-13T18:29:23.181088+0000","last_undegraded":"2024-09-13T18:29:23.181088+0000","last_fullsized":"2024-09-13T18:29:23.181088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:57.285380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710346+0000","last_change":"2024-09-13T18:29:21.820546+0000","last_active":"2024-09-13T18:29:23.710346+0000","last_peered":"2024-09-13T18:29:23.710346+0000","last_clean":"2024-09-13T18:29:23.710346+0000","last_became_active":"2024-09-13T18:29:21.819498+0000","last_became_peered":"2024-09-13T18:29:21.819498+0000","last_unstale":"2024-09-13T18:29:23.710346+0000","last_undegraded":"2024-09-13T18:29:23.710346+0000","last_fullsized":"2024-09-13T18:29:23.710346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:08.790994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738542+0000","last_change":"2024-09-13T18:29:22.205008+0000","last_active":"2024-09-13T18:29:23.738542+0000","last_peered":"2024-09-13T18:29:23.738542+0000","last_clean":"2024-09-13T18:29:23.738542+0000","last_became_active":"2024-09-13T18:29:22.204644+0000","last_became_peered":"2024-09-13T18:29:22.204644+0000","last_unstale":"2024-09-13T18:29:23.738542+0000","last_undegraded":"2024-09-13T18:29:23.738542+0000","last_fullsized":"2024-09-13T18:29:23.738542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:55.252815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178592+0000","last_change":"2024-09-13T18:29:21.807961+0000","last_active":"2024-09-13T18:29:23.178592+0000","last_peered":"2024-09-13T18:29:23.178592+0000","last_clean":"2024-09-13T18:29:23.178592+0000","last_became_active":"2024-09-13T18:29:21.807522+0000","last_became_peered":"2024-09-13T18:29:21.807522+0000","last_unstale":"2024-09-13T18:29:23.178592+0000","last_undegraded":"2024-09-13T18:29:23.178592+0000","last_fullsized":"2024-09-13T18:29:23.178592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:38.872904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736450+0000","last_change":"2024-09-13T18:29:22.205643+0000","last_active":"2024-09-13T18:29:23.736450+0000","last_peered":"2024-09-13T18:29:23.736450+0000","last_clean":"2024-09-13T18:29:23.736450+0000","last_became_active":"2024-09-13T18:29:22.205364+0000","last_became_peered":"2024-09-13T18:29:22.205364+0000","last_unstale":"2024-09-13T18:29:23.736450+0000","last_undegraded":"2024-09-13T18:29:23.736450+0000","last_fullsized":"2024-09-13T18:29:23.736450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:45.858076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738466+0000","last_change":"2024-09-13T18:29:21.805658+0000","last_active":"2024-09-13T18:29:23.738466+0000","last_peered":"2024-09-13T18:29:23.738466+0000","last_clean":"2024-09-13T18:29:23.738466+0000","last_became_active":"2024-09-13T18:29:21.805142+0000","last_became_peered":"2024-09-13T18:29:21.805142+0000","last_unstale":"2024-09-13T18:29:23.738466+0000","last_undegraded":"2024-09-13T18:29:23.738466+0000","last_fullsized":"2024-09-13T18:29:23.738466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:33.667319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737646+0000","last_change":"2024-09-13T18:29:22.210012+0000","last_active":"2024-09-13T18:29:23.737646+0000","last_peered":"2024-09-13T18:29:23.737646+0000","last_clean":"2024-09-13T18:29:23.737646+0000","last_became_active":"2024-09-13T18:29:22.209592+0000","last_became_peered":"2024-09-13T18:29:22.209592+0000","last_unstale":"2024-09-13T18:29:23.737646+0000","last_undegraded":"2024-09-13T18:29:23.737646+0000","last_fullsized":"2024-09-13T18:29:23.737646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:36.806965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181881+0000","last_change":"2024-09-13T18:29:21.807183+0000","last_active":"2024-09-13T18:29:23.181881+0000","last_peered":"2024-09-13T18:29:23.181881+0000","last_clean":"2024-09-13T18:29:23.181881+0000","last_became_active":"2024-09-13T18:29:21.806534+0000","last_became_peered":"2024-09-13T18:29:21.806534+0000","last_unstale":"2024-09-13T18:29:23.181881+0000","last_undegraded":"2024-09-13T18:29:23.181881+0000","last_fullsized":"2024-09-13T18:29:23.181881+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:24.238887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737006+0000","last_change":"2024-09-13T18:29:22.236980+0000","last_active":"2024-09-13T18:29:23.737006+0000","last_peered":"2024-09-13T18:29:23.737006+0000","last_clean":"2024-09-13T18:29:23.737006+0000","last_became_active":"2024-09-13T18:29:22.236266+0000","last_became_peered":"2024-09-13T18:29:22.236266+0000","last_unstale":"2024-09-13T18:29:23.737006+0000","last_undegraded":"2024-09-13T18:29:23.737006+0000","last_fullsized":"2024-09-13T18:29:23.737006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:38.897271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.711328+0000","last_change":"2024-09-13T18:29:21.822045+0000","last_active":"2024-09-13T18:29:23.711328+0000","last_peered":"2024-09-13T18:29:23.711328+0000","last_clean":"2024-09-13T18:29:23.711328+0000","last_became_active":"2024-09-13T18:29:21.821396+0000","last_became_peered":"2024-09-13T18:29:21.821396+0000","last_unstale":"2024-09-13T18:29:23.711328+0000","last_undegraded":"2024-09-13T18:29:23.711328+0000","last_fullsized":"2024-09-13T18:29:23.711328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710953+0000","last_change":"2024-09-13T18:29:22.230964+0000","last_active":"2024-09-13T18:29:23.710953+0000","last_peered":"2024-09-13T18:29:23.710953+0000","last_clean":"2024-09-13T18:29:23.710953+0000","last_became_active":"2024-09-13T18:29:22.230399+0000","last_became_peered":"2024-09-13T18:29:22.230399+0000","last_unstale":"2024-09-13T18:29:23.710953+0000","last_undegraded":"2024-09-13T18:29:23.710953+0000","last_fullsized":"2024-09-13T18:29:23.710953+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:54.393053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737529+0000","last_change":"2024-09-13T18:29:21.810642+0000","last_active":"2024-09-13T18:29:23.737529+0000","last_peered":"2024-09-13T18:29:23.737529+0000","last_clean":"2024-09-13T18:29:23.737529+0000","last_became_active":"2024-09-13T18:29:21.810249+0000","last_became_peered":"2024-09-13T18:29:21.810249+0000","last_unstale":"2024-09-13T18:29:23.737529+0000","last_undegraded":"2024-09-13T18:29:23.737529+0000","last_fullsized":"2024-09-13T18:29:23.737529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739121+0000","last_change":"2024-09-13T18:29:22.188643+0000","last_active":"2024-09-13T18:29:23.739121+0000","last_peered":"2024-09-13T18:29:23.739121+0000","last_clean":"2024-09-13T18:29:23.739121+0000","last_became_active":"2024-09-13T18:29:22.188416+0000","last_became_peered":"2024-09-13T18:29:22.188416+0000","last_unstale":"2024-09-13T18:29:23.739121+0000","last_undegraded":"2024-09-13T18:29:23.739121+0000","last_fullsized":"2024-09-13T18:29:23.739121+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:10.125747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179187+0000","last_change":"2024-09-13T18:29:21.804003+0000","last_active":"2024-09-13T18:29:23.179187+0000","last_peered":"2024-09-13T18:29:23.179187+0000","last_clean":"2024-09-13T18:29:23.179187+0000","last_became_active":"2024-09-13T18:29:21.803379+0000","last_became_peered":"2024-09-13T18:29:21.803379+0000","last_unstale":"2024-09-13T18:29:23.179187+0000","last_undegraded":"2024-09-13T18:29:23.179187+0000","last_fullsized":"2024-09-13T18:29:23.179187+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:13.167186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735607+0000","last_change":"2024-09-13T18:29:22.213213+0000","last_active":"2024-09-13T18:29:23.735607+0000","last_peered":"2024-09-13T18:29:23.735607+0000","last_clean":"2024-09-13T18:29:23.735607+0000","last_became_active":"2024-09-13T18:29:22.212487+0000","last_became_peered":"2024-09-13T18:29:22.212487+0000","last_unstale":"2024-09-13T18:29:23.735607+0000","last_undegraded":"2024-09-13T18:29:23.735607+0000","last_fullsized":"2024-09-13T18:29:23.735607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:30.863532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179294+0000","last_change":"2024-09-13T18:29:21.819249+0000","last_active":"2024-09-13T18:29:23.179294+0000","last_peered":"2024-09-13T18:29:23.179294+0000","last_clean":"2024-09-13T18:29:23.179294+0000","last_became_active":"2024-09-13T18:29:21.818944+0000","last_became_peered":"2024-09-13T18:29:21.818944+0000","last_unstale":"2024-09-13T18:29:23.179294+0000","last_undegraded":"2024-09-13T18:29:23.179294+0000","last_fullsized":"2024-09-13T18:29:23.179294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:28.455142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737165+0000","last_change":"2024-09-13T18:29:22.224460+0000","last_active":"2024-09-13T18:29:23.737165+0000","last_peered":"2024-09-13T18:29:23.737165+0000","last_clean":"2024-09-13T18:29:23.737165+0000","last_became_active":"2024-09-13T18:29:22.222678+0000","last_became_peered":"2024-09-13T18:29:22.222678+0000","last_unstale":"2024-09-13T18:29:23.737165+0000","last_undegraded":"2024-09-13T18:29:23.737165+0000","last_fullsized":"2024-09-13T18:29:23.737165+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:48.164227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710469+0000","last_change":"2024-09-13T18:29:21.813971+0000","last_active":"2024-09-13T18:29:23.710469+0000","last_peered":"2024-09-13T18:29:23.710469+0000","last_clean":"2024-09-13T18:29:23.710469+0000","last_became_active":"2024-09-13T18:29:21.813297+0000","last_became_peered":"2024-09-13T18:29:21.813297+0000","last_unstale":"2024-09-13T18:29:23.710469+0000","last_undegraded":"2024-09-13T18:29:23.710469+0000","last_fullsized":"2024-09-13T18:29:23.710469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:17.942102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736050+0000","last_change":"2024-09-13T18:29:22.229037+0000","last_active":"2024-09-13T18:29:23.736050+0000","last_peered":"2024-09-13T18:29:23.736050+0000","last_clean":"2024-09-13T18:29:23.736050+0000","last_became_active":"2024-09-13T18:29:22.228643+0000","last_became_peered":"2024-09-13T18:29:22.228643+0000","last_unstale":"2024-09-13T18:29:23.736050+0000","last_undegraded":"2024-09-13T18:29:23.736050+0000","last_fullsized":"2024-09-13T18:29:23.736050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736446+0000","last_change":"2024-09-13T18:29:21.804470+0000","last_active":"2024-09-13T18:29:23.736446+0000","last_peered":"2024-09-13T18:29:23.736446+0000","last_clean":"2024-09-13T18:29:23.736446+0000","last_became_active":"2024-09-13T18:29:21.803159+0000","last_became_peered":"2024-09-13T18:29:21.803159+0000","last_unstale":"2024-09-13T18:29:23.736446+0000","last_undegraded":"2024-09-13T18:29:23.736446+0000","last_fullsized":"2024-09-13T18:29:23.736446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:23.325554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738863+0000","last_change":"2024-09-13T18:29:22.191336+0000","last_active":"2024-09-13T18:29:23.738863+0000","last_peered":"2024-09-13T18:29:23.738863+0000","last_clean":"2024-09-13T18:29:23.738863+0000","last_became_active":"2024-09-13T18:29:22.190378+0000","last_became_peered":"2024-09-13T18:29:22.190378+0000","last_unstale":"2024-09-13T18:29:23.738863+0000","last_undegraded":"2024-09-13T18:29:23.738863+0000","last_fullsized":"2024-09-13T18:29:23.738863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:29.468964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180527+0000","last_change":"2024-09-13T18:29:21.818359+0000","last_active":"2024-09-13T18:29:23.180527+0000","last_peered":"2024-09-13T18:29:23.180527+0000","last_clean":"2024-09-13T18:29:23.180527+0000","last_became_active":"2024-09-13T18:29:21.817720+0000","last_became_peered":"2024-09-13T18:29:21.817720+0000","last_unstale":"2024-09-13T18:29:23.180527+0000","last_undegraded":"2024-09-13T18:29:23.180527+0000","last_fullsized":"2024-09-13T18:29:23.180527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:36.941334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181526+0000","last_change":"2024-09-13T18:29:22.185326+0000","last_active":"2024-09-13T18:29:23.181526+0000","last_peered":"2024-09-13T18:29:23.181526+0000","last_clean":"2024-09-13T18:29:23.181526+0000","last_became_active":"2024-09-13T18:29:22.184678+0000","last_became_peered":"2024-09-13T18:29:22.184678+0000","last_unstale":"2024-09-13T18:29:23.181526+0000","last_undegraded":"2024-09-13T18:29:23.181526+0000","last_fullsized":"2024-09-13T18:29:23.181526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:03.683811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710894+0000","last_change":"2024-09-13T18:29:21.816796+0000","last_active":"2024-09-13T18:29:23.710894+0000","last_peered":"2024-09-13T18:29:23.710894+0000","last_clean":"2024-09-13T18:29:23.710894+0000","last_became_active":"2024-09-13T18:29:21.816084+0000","last_became_peered":"2024-09-13T18:29:21.816084+0000","last_unstale":"2024-09-13T18:29:23.710894+0000","last_undegraded":"2024-09-13T18:29:23.710894+0000","last_fullsized":"2024-09-13T18:29:23.710894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:09.111925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737280+0000","last_change":"2024-09-13T18:29:22.220452+0000","last_active":"2024-09-13T18:29:23.737280+0000","last_peered":"2024-09-13T18:29:23.737280+0000","last_clean":"2024-09-13T18:29:23.737280+0000","last_became_active":"2024-09-13T18:29:22.219818+0000","last_became_peered":"2024-09-13T18:29:22.219818+0000","last_unstale":"2024-09-13T18:29:23.737280+0000","last_undegraded":"2024-09-13T18:29:23.737280+0000","last_fullsized":"2024-09-13T18:29:23.737280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181649+0000","last_change":"2024-09-13T18:29:21.818589+0000","last_active":"2024-09-13T18:29:23.181649+0000","last_peered":"2024-09-13T18:29:23.181649+0000","last_clean":"2024-09-13T18:29:23.181649+0000","last_became_active":"2024-09-13T18:29:21.818248+0000","last_became_peered":"2024-09-13T18:29:21.818248+0000","last_unstale":"2024-09-13T18:29:23.181649+0000","last_undegraded":"2024-09-13T18:29:23.181649+0000","last_fullsized":"2024-09-13T18:29:23.181649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:23.212115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179101+0000","last_change":"2024-09-13T18:29:22.188054+0000","last_active":"2024-09-13T18:29:23.179101+0000","last_peered":"2024-09-13T18:29:23.179101+0000","last_clean":"2024-09-13T18:29:23.179101+0000","last_became_active":"2024-09-13T18:29:22.187469+0000","last_became_peered":"2024-09-13T18:29:22.187469+0000","last_unstale":"2024-09-13T18:29:23.179101+0000","last_undegraded":"2024-09-13T18:29:23.179101+0000","last_fullsized":"2024-09-13T18:29:23.179101+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:27.713036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710836+0000","last_change":"2024-09-13T18:29:21.825157+0000","last_active":"2024-09-13T18:29:23.710836+0000","last_peered":"2024-09-13T18:29:23.710836+0000","last_clean":"2024-09-13T18:29:23.710836+0000","last_became_active":"2024-09-13T18:29:21.824780+0000","last_became_peered":"2024-09-13T18:29:21.824780+0000","last_unstale":"2024-09-13T18:29:23.710836+0000","last_undegraded":"2024-09-13T18:29:23.710836+0000","last_fullsized":"2024-09-13T18:29:23.710836+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:09.454642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739498+0000","last_change":"2024-09-13T18:29:22.204999+0000","last_active":"2024-09-13T18:29:23.739498+0000","last_peered":"2024-09-13T18:29:23.739498+0000","last_clean":"2024-09-13T18:29:23.739498+0000","last_became_active":"2024-09-13T18:29:22.204654+0000","last_became_peered":"2024-09-13T18:29:22.204654+0000","last_unstale":"2024-09-13T18:29:23.739498+0000","last_undegraded":"2024-09-13T18:29:23.739498+0000","last_fullsized":"2024-09-13T18:29:23.739498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:37.531684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736132+0000","last_change":"2024-09-13T18:29:21.825495+0000","last_active":"2024-09-13T18:29:23.736132+0000","last_peered":"2024-09-13T18:29:23.736132+0000","last_clean":"2024-09-13T18:29:23.736132+0000","last_became_active":"2024-09-13T18:29:21.824574+0000","last_became_peered":"2024-09-13T18:29:21.824574+0000","last_unstale":"2024-09-13T18:29:23.736132+0000","last_undegraded":"2024-09-13T18:29:23.736132+0000","last_fullsized":"2024-09-13T18:29:23.736132+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:47.837033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737320+0000","last_change":"2024-09-13T18:29:22.192454+0000","last_active":"2024-09-13T18:29:23.737320+0000","last_peered":"2024-09-13T18:29:23.737320+0000","last_clean":"2024-09-13T18:29:23.737320+0000","last_became_active":"2024-09-13T18:29:22.191981+0000","last_became_peered":"2024-09-13T18:29:22.191981+0000","last_unstale":"2024-09-13T18:29:23.737320+0000","last_undegraded":"2024-09-13T18:29:23.737320+0000","last_fullsized":"2024-09-13T18:29:23.737320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:58.585945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710626+0000","last_change":"2024-09-13T18:29:21.819912+0000","last_active":"2024-09-13T18:29:23.710626+0000","last_peered":"2024-09-13T18:29:23.710626+0000","last_clean":"2024-09-13T18:29:23.710626+0000","last_became_active":"2024-09-13T18:29:21.818833+0000","last_became_peered":"2024-09-13T18:29:21.818833+0000","last_unstale":"2024-09-13T18:29:23.710626+0000","last_undegraded":"2024-09-13T18:29:23.710626+0000","last_fullsized":"2024-09-13T18:29:23.710626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:36.116975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736956+0000","last_change":"2024-09-13T18:29:22.230019+0000","last_active":"2024-09-13T18:29:23.736956+0000","last_peered":"2024-09-13T18:29:23.736956+0000","last_clean":"2024-09-13T18:29:23.736956+0000","last_became_active":"2024-09-13T18:29:22.229707+0000","last_became_peered":"2024-09-13T18:29:22.229707+0000","last_unstale":"2024-09-13T18:29:23.736956+0000","last_undegraded":"2024-09-13T18:29:23.736956+0000","last_fullsized":"2024-09-13T18:29:23.736956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:56.050568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736672+0000","last_change":"2024-09-13T18:29:21.808188+0000","last_active":"2024-09-13T18:29:23.736672+0000","last_peered":"2024-09-13T18:29:23.736672+0000","last_clean":"2024-09-13T18:29:23.736672+0000","last_became_active":"2024-09-13T18:29:21.807531+0000","last_became_peered":"2024-09-13T18:29:21.807531+0000","last_unstale":"2024-09-13T18:29:23.736672+0000","last_undegraded":"2024-09-13T18:29:23.736672+0000","last_fullsized":"2024-09-13T18:29:23.736672+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:47.837033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736758+0000","last_change":"2024-09-13T18:29:22.229910+0000","last_active":"2024-09-13T18:29:23.736758+0000","last_peered":"2024-09-13T18:29:23.736758+0000","last_clean":"2024-09-13T18:29:23.736758+0000","last_became_active":"2024-09-13T18:29:22.229639+0000","last_became_peered":"2024-09-13T18:29:22.229639+0000","last_unstale":"2024-09-13T18:29:23.736758+0000","last_undegraded":"2024-09-13T18:29:23.736758+0000","last_fullsized":"2024-09-13T18:29:23.736758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:10.813922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735931+0000","last_change":"2024-09-13T18:29:21.803331+0000","last_active":"2024-09-13T18:29:23.735931+0000","last_peered":"2024-09-13T18:29:23.735931+0000","last_clean":"2024-09-13T18:29:23.735931+0000","last_became_active":"2024-09-13T18:29:21.802977+0000","last_became_peered":"2024-09-13T18:29:21.802977+0000","last_unstale":"2024-09-13T18:29:23.735931+0000","last_undegraded":"2024-09-13T18:29:23.735931+0000","last_fullsized":"2024-09-13T18:29:23.735931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.624867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737061+0000","last_change":"2024-09-13T18:29:22.189488+0000","last_active":"2024-09-13T18:29:23.737061+0000","last_peered":"2024-09-13T18:29:23.737061+0000","last_clean":"2024-09-13T18:29:23.737061+0000","last_became_active":"2024-09-13T18:29:22.189222+0000","last_became_peered":"2024-09-13T18:29:22.189222+0000","last_unstale":"2024-09-13T18:29:23.737061+0000","last_undegraded":"2024-09-13T18:29:23.737061+0000","last_fullsized":"2024-09-13T18:29:23.737061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710979+0000","last_change":"2024-09-13T18:29:21.816030+0000","last_active":"2024-09-13T18:29:23.710979+0000","last_peered":"2024-09-13T18:29:23.710979+0000","last_clean":"2024-09-13T18:29:23.710979+0000","last_became_active":"2024-09-13T18:29:21.815687+0000","last_became_peered":"2024-09-13T18:29:21.815687+0000","last_unstale":"2024-09-13T18:29:23.710979+0000","last_undegraded":"2024-09-13T18:29:23.710979+0000","last_fullsized":"2024-09-13T18:29:23.710979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:28.455142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737552+0000","last_change":"2024-09-13T18:29:22.210181+0000","last_active":"2024-09-13T18:29:23.737552+0000","last_peered":"2024-09-13T18:29:23.737552+0000","last_clean":"2024-09-13T18:29:23.737552+0000","last_became_active":"2024-09-13T18:29:22.203446+0000","last_became_peered":"2024-09-13T18:29:22.203446+0000","last_unstale":"2024-09-13T18:29:23.737552+0000","last_undegraded":"2024-09-13T18:29:23.737552+0000","last_fullsized":"2024-09-13T18:29:23.737552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:57.285380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737751+0000","last_change":"2024-09-13T18:29:21.807292+0000","last_active":"2024-09-13T18:29:23.737751+0000","last_peered":"2024-09-13T18:29:23.737751+0000","last_clean":"2024-09-13T18:29:23.737751+0000","last_became_active":"2024-09-13T18:29:21.806367+0000","last_became_peered":"2024-09-13T18:29:21.806367+0000","last_unstale":"2024-09-13T18:29:23.737751+0000","last_undegraded":"2024-09-13T18:29:23.737751+0000","last_fullsized":"2024-09-13T18:29:23.737751+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:29.861586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735947+0000","last_change":"2024-09-13T18:29:22.239628+0000","last_active":"2024-09-13T18:29:23.735947+0000","last_peered":"2024-09-13T18:29:23.735947+0000","last_clean":"2024-09-13T18:29:23.735947+0000","last_became_active":"2024-09-13T18:29:22.237867+0000","last_became_peered":"2024-09-13T18:29:22.237867+0000","last_unstale":"2024-09-13T18:29:23.735947+0000","last_undegraded":"2024-09-13T18:29:23.735947+0000","last_fullsized":"2024-09-13T18:29:23.735947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:04.989845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739439+0000","last_change":"2024-09-13T18:29:21.802394+0000","last_active":"2024-09-13T18:29:23.739439+0000","last_peered":"2024-09-13T18:29:23.739439+0000","last_clean":"2024-09-13T18:29:23.739439+0000","last_became_active":"2024-09-13T18:29:21.801585+0000","last_became_peered":"2024-09-13T18:29:21.801585+0000","last_unstale":"2024-09-13T18:29:23.739439+0000","last_undegraded":"2024-09-13T18:29:23.739439+0000","last_fullsized":"2024-09-13T18:29:23.739439+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:27.342969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736677+0000","last_change":"2024-09-13T18:29:22.217963+0000","last_active":"2024-09-13T18:29:23.736677+0000","last_peered":"2024-09-13T18:29:23.736677+0000","last_clean":"2024-09-13T18:29:23.736677+0000","last_became_active":"2024-09-13T18:29:22.212292+0000","last_became_peered":"2024-09-13T18:29:22.212292+0000","last_unstale":"2024-09-13T18:29:23.736677+0000","last_undegraded":"2024-09-13T18:29:23.736677+0000","last_fullsized":"2024-09-13T18:29:23.736677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:32.365048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736788+0000","last_change":"2024-09-13T18:29:21.810380+0000","last_active":"2024-09-13T18:29:23.736788+0000","last_peered":"2024-09-13T18:29:23.736788+0000","last_clean":"2024-09-13T18:29:23.736788+0000","last_became_active":"2024-09-13T18:29:21.810089+0000","last_became_peered":"2024-09-13T18:29:21.810089+0000","last_unstale":"2024-09-13T18:29:23.736788+0000","last_undegraded":"2024-09-13T18:29:23.736788+0000","last_fullsized":"2024-09-13T18:29:23.736788+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:29.861586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739428+0000","last_change":"2024-09-13T18:29:22.190909+0000","last_active":"2024-09-13T18:29:23.739428+0000","last_peered":"2024-09-13T18:29:23.739428+0000","last_clean":"2024-09-13T18:29:23.739428+0000","last_became_active":"2024-09-13T18:29:22.190555+0000","last_became_peered":"2024-09-13T18:29:22.190555+0000","last_unstale":"2024-09-13T18:29:23.739428+0000","last_undegraded":"2024-09-13T18:29:23.739428+0000","last_fullsized":"2024-09-13T18:29:23.739428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:08.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738841+0000","last_change":"2024-09-13T18:29:21.813226+0000","last_active":"2024-09-13T18:29:23.738841+0000","last_peered":"2024-09-13T18:29:23.738841+0000","last_clean":"2024-09-13T18:29:23.738841+0000","last_became_active":"2024-09-13T18:29:21.812763+0000","last_became_peered":"2024-09-13T18:29:21.812763+0000","last_unstale":"2024-09-13T18:29:23.738841+0000","last_undegraded":"2024-09-13T18:29:23.738841+0000","last_fullsized":"2024-09-13T18:29:23.738841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:27.562099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710632+0000","last_change":"2024-09-13T18:29:22.227579+0000","last_active":"2024-09-13T18:29:23.710632+0000","last_peered":"2024-09-13T18:29:23.710632+0000","last_clean":"2024-09-13T18:29:23.710632+0000","last_became_active":"2024-09-13T18:29:22.226878+0000","last_became_peered":"2024-09-13T18:29:22.226878+0000","last_unstale":"2024-09-13T18:29:23.710632+0000","last_undegraded":"2024-09-13T18:29:23.710632+0000","last_fullsized":"2024-09-13T18:29:23.710632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:16.810471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178870+0000","last_change":"2024-09-13T18:29:21.808719+0000","last_active":"2024-09-13T18:29:23.178870+0000","last_peered":"2024-09-13T18:29:23.178870+0000","last_clean":"2024-09-13T18:29:23.178870+0000","last_became_active":"2024-09-13T18:29:21.808441+0000","last_became_peered":"2024-09-13T18:29:21.808441+0000","last_unstale":"2024-09-13T18:29:23.178870+0000","last_undegraded":"2024-09-13T18:29:23.178870+0000","last_fullsized":"2024-09-13T18:29:23.178870+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178855+0000","last_change":"2024-09-13T18:29:22.192974+0000","last_active":"2024-09-13T18:29:23.178855+0000","last_peered":"2024-09-13T18:29:23.178855+0000","last_clean":"2024-09-13T18:29:23.178855+0000","last_became_active":"2024-09-13T18:29:22.192706+0000","last_became_peered":"2024-09-13T18:29:22.192706+0000","last_unstale":"2024-09-13T18:29:23.178855+0000","last_undegraded":"2024-09-13T18:29:23.178855+0000","last_fullsized":"2024-09-13T18:29:23.178855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:59.718204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180320+0000","last_change":"2024-09-13T18:29:21.817256+0000","last_active":"2024-09-13T18:29:23.180320+0000","last_peered":"2024-09-13T18:29:23.180320+0000","last_clean":"2024-09-13T18:29:23.180320+0000","last_became_active":"2024-09-13T18:29:21.816644+0000","last_became_peered":"2024-09-13T18:29:21.816644+0000","last_unstale":"2024-09-13T18:29:23.180320+0000","last_undegraded":"2024-09-13T18:29:23.180320+0000","last_fullsized":"2024-09-13T18:29:23.180320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:09.302926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.709874+0000","last_change":"2024-09-13T18:29:22.215267+0000","last_active":"2024-09-13T18:29:23.709874+0000","last_peered":"2024-09-13T18:29:23.709874+0000","last_clean":"2024-09-13T18:29:23.709874+0000","last_became_active":"2024-09-13T18:29:22.214570+0000","last_became_peered":"2024-09-13T18:29:22.214570+0000","last_unstale":"2024-09-13T18:29:23.709874+0000","last_undegraded":"2024-09-13T18:29:23.709874+0000","last_fullsized":"2024-09-13T18:29:23.709874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:09.489302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710212+0000","last_change":"2024-09-13T18:29:21.818006+0000","last_active":"2024-09-13T18:29:23.710212+0000","last_peered":"2024-09-13T18:29:23.710212+0000","last_clean":"2024-09-13T18:29:23.710212+0000","last_became_active":"2024-09-13T18:29:21.817500+0000","last_became_peered":"2024-09-13T18:29:21.817500+0000","last_unstale":"2024-09-13T18:29:23.710212+0000","last_undegraded":"2024-09-13T18:29:23.710212+0000","last_fullsized":"2024-09-13T18:29:23.710212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:31.836432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737502+0000","last_change":"2024-09-13T18:29:22.234252+0000","last_active":"2024-09-13T18:29:23.737502+0000","last_peered":"2024-09-13T18:29:23.737502+0000","last_clean":"2024-09-13T18:29:23.737502+0000","last_became_active":"2024-09-13T18:29:22.233929+0000","last_became_peered":"2024-09-13T18:29:22.233929+0000","last_unstale":"2024-09-13T18:29:23.737502+0000","last_undegraded":"2024-09-13T18:29:23.737502+0000","last_fullsized":"2024-09-13T18:29:23.737502+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:53.346889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710766+0000","last_change":"2024-09-13T18:29:21.818649+0000","last_active":"2024-09-13T18:29:23.710766+0000","last_peered":"2024-09-13T18:29:23.710766+0000","last_clean":"2024-09-13T18:29:23.710766+0000","last_became_active":"2024-09-13T18:29:21.817980+0000","last_became_peered":"2024-09-13T18:29:21.817980+0000","last_unstale":"2024-09-13T18:29:23.710766+0000","last_undegraded":"2024-09-13T18:29:23.710766+0000","last_fullsized":"2024-09-13T18:29:23.710766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:54.238993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:29:22.186354+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:29:22.186354+0000","last_peered":"2024-09-13T18:29:22.186354+0000","last_clean":"2024-09-13T18:29:22.186354+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:29:22.186354+0000","last_undegraded":"2024-09-13T18:29:22.186354+0000","last_fullsized":"2024-09-13T18:29:22.186354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1478656,"data_stored":960550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.88300000000000001},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3080000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1839999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.014}]},{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4179999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93400000000000005,"15min":0.92000000000000004},"min":{"1min":0.60499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4890000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1060000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82699999999999996,"15min":0.79900000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1060000000000001,"5min":1.276,"15min":1.276},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5309999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.349,"5min":1.448,"15min":1.448},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94899999999999995,"15min":0.91100000000000003},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2,"5min":1.397,"15min":1.397},"last":1.1319999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.55800000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2809999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.94099999999999995},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.153}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0469999999999999},"min":{"1min":0.70299999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.278,"5min":1.877,"15min":1.877},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.63100000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.89400000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.78100000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3919999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.175},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":1.2010000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":369658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.1579999999999999,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.78600000000000003},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2170000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.75900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.88300000000000001},"min":{"1min":0.626,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.155,"5min":1.577,"15min":1.577},"last":1.24},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93400000000000005,"15min":0.89200000000000002},"min":{"1min":0.56399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.157,"5min":1.464,"15min":1.464},"last":1.2070000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0669999999999999,"5min":1.268,"15min":1.268},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.208,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.85199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88800000000000001,"15min":0.877},"min":{"1min":0.68000000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0800000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1339999999999999,"5min":1.306,"15min":1.306},"last":1.046}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1839999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.02,"15min":0.998},"min":{"1min":0.69399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.212,"5min":1.526,"15min":1.526},"last":1.2829999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.59699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0469999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.069,"15min":1.107},"min":{"1min":0.73199999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3520000000000001,"5min":2.762,"15min":2.762},"last":1.169}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0189999999999999,"15min":1.0409999999999999},"min":{"1min":0.74199999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0429999999999999},"min":{"1min":0.69199999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2410000000000001,"5min":1.72,"15min":1.72},"last":1.153}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89400000000000002,"15min":0.91200000000000003},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.2010000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.0800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85999999999999999,"15min":0.82799999999999996},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0780000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1080000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.71199999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1890000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94199999999999995,"15min":0.96199999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.272,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":0.98099999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1859999999999999,"5min":1.871,"15min":1.871},"last":0.751}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2410000000000001,"5min":1.413,"15min":1.413},"last":1.22},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3149999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2050000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.133},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.99299999999999999,"15min":1.036},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2410000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.048}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1259999999999999},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4039999999999999,"5min":2.246,"15min":2.246},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.145},"min":{"1min":0.74299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2769999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.2829999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":880640,"data_stored":369636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.80100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.04},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.874,"15min":0.874},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.256,"15min":1.256},"last":1.4410000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.46300000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.874},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.874},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.2909999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.087,"5min":1.147,"15min":1.147},"last":1.216},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.66600000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92500000000000004,"15min":0.92900000000000005},"min":{"1min":0.65600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.1850000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.298,"15min":1.298},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.94799999999999995,"15min":0.96499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.333,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94099999999999995,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.181,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.006},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1,"15min":1.02},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.377,"15min":1.377},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.042},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.286,"5min":1.482,"15min":1.482},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.044,"15min":1.0760000000000001},"min":{"1min":0.72899999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2010000000000001,"5min":1.466,"15min":1.466},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":884736,"data_stored":369678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68100000000000005,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.77400000000000002,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4199999999999999,"5min":1.704,"15min":1.704},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.67000000000000004,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.495}]},{"osd":2,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.79000000000000004,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.399,"15min":1.399},"last":0.41499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.97099999999999997,"15min":0.96299999999999997},"min":{"1min":0.77000000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0880000000000001,"15min":1.1279999999999999},"min":{"1min":0.78600000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.028,"15min":1.024},"min":{"1min":0.69499999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2689999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.96199999999999997,"15min":0.94299999999999995},"min":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0680000000000001,"15min":1.0780000000000001},"min":{"1min":0.65900000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5800000000000001,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0629999999999999,"15min":1.054},"min":{"1min":0.83799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.377,"5min":1.96,"15min":1.96},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.624,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.665,"5min":3,"15min":3},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.04,"15min":1.0049999999999999},"min":{"1min":0.75,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.80200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":888832,"data_stored":371130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.68300000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.379},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.879,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.91100000000000003,"5min":1.423,"15min":1.423},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0860000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79100000000000004,"15min":0.77700000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.274,"15min":1.274},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.91000000000000003},"min":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1890000000000001,"5min":1.611,"15min":1.611},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0620000000000001,"5min":1.492,"15min":1.492},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.99399999999999999,"15min":1.0089999999999999},"min":{"1min":0.68300000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.224,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2230000000000001,"5min":1.702,"15min":1.702},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.155,"5min":1.54,"15min":1.54},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.036,"15min":1.05},"min":{"1min":0.66000000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.206,"5min":1.452,"15min":1.452},"last":0.88400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.657,"15min":1.657},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.089},"min":{"1min":0.73299999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.345,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.86399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":897024,"data_stored":371746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63900000000000001,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.90000000000000002,"5min":1.177,"15min":1.177},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.98699999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.40300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1359999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.92800000000000005,"15min":0.90700000000000003},"min":{"1min":0.70699999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1279999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.75},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.216}]},{"osd":5,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.347,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.01,"15min":0.996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.25,"5min":1.653,"15min":1.653},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.997,"15min":0.98899999999999999},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2629999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.048,"15min":1.042},"min":{"1min":0.748,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3779999999999999,"5min":1.458,"15min":1.458},"last":1.24},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0429999999999999,"15min":1.0129999999999999},"min":{"1min":0.67100000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.0209999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36648,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335192,"statfs":{"total":96636764160,"available":96599236608,"internally_reserved":0,"allocated":1470464,"data_stored":959934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.998,"5min":1.147,"15min":1.147},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.244,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.83099999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68200000000000005,"15min":0.626},"min":{"1min":0.44,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.626},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1639999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3160000000000001,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.77200000000000002,"15min":0.73699999999999999},"min":{"1min":0.51800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2769999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0209999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.64400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.998,"5min":0.996,"15min":0.998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4079999999999999,"5min":1.986,"15min":1.986},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.014,"15min":1.016},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8799999999999999,"5min":2.641,"15min":2.641},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.83399999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.343,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.095,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.466,"5min":1.891,"15min":1.891},"last":1.129},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.512,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.03,"15min":1.034},"min":{"1min":0.622,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4319999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.081},{"interface":"front","average":{"1min":1.133,"5min":1.1220000000000001,"15min":1.1080000000000001},"min":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.724,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.1619999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:27.751 INFO:tasks.ceph.mds.a.smithi053.stderr:2024-09-13T18:29:27.747+0000 7f94776b2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:29:30.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:29:30.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.855+0000 7faed809b640 1 Processor -- start 2024-09-13T18:29:30.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.855+0000 7faed809b640 1 -- start start 2024-09-13T18:29:30.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed809b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:30.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed809b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faed00cd6c0 0x7faed00cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:30.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed809b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faed00cdb00 0x7faed00cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed809b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00d2400 con 0x7faed00cd6c0 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed809b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00d1530 con 0x7faed00cdb00 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed809b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00d0920 con 0x7faed015cab0 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faed00cd6c0 0x7faed00cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faed00cd6c0 0x7faed00cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45760/0 (socket says 172.21.15.53:45760) 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 -- 172.21.15.53:0/334500157 learned_addr learned my addr 172.21.15.53:0/334500157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5e37640 1 --2- 172.21.15.53:0/334500157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed6638640 1 --2- 172.21.15.53:0/334500157 >> v2:172.21.15.87:3300/0 conn(0x7faed00cdb00 0x7faed00cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 -- 172.21.15.53:0/334500157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 msgr2=0x7faed00d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 --2- 172.21.15.53:0/334500157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 -- 172.21.15.53:0/334500157 >> v2:172.21.15.87:3300/0 conn(0x7faed00cdb00 msgr2=0x7faed00cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 --2- 172.21.15.53:0/334500157 >> v2:172.21.15.87:3300/0 conn(0x7faed00cdb00 0x7faed00cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 -- 172.21.15.53:0/334500157 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00d0c00 con 0x7faed00cd6c0 2024-09-13T18:29:30.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed5636640 1 --2- 172.21.15.53:0/334500157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cd6c0 0x7faed00cf0c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7faed00b7fe0 tx=0x7faec001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8281d2ec28b4d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:30.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed4e35640 1 -- 172.21.15.53:0/334500157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00aa610 con 0x7faed00cd6c0 2024-09-13T18:29:30.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed4e35640 1 -- 172.21.15.53:0/334500157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00a6040 con 0x7faed00cd6c0 2024-09-13T18:29:30.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.859+0000 7faed4e35640 1 -- 172.21.15.53:0/334500157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00aa990 con 0x7faed00cd6c0 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- 172.21.15.53:0/334500157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cd6c0 msgr2=0x7faed00cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 --2- 172.21.15.53:0/334500157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cd6c0 0x7faed00cf0c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7faed00b7fe0 tx=0x7faec001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- 172.21.15.53:0/334500157 shutdown_connections 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 --2- 172.21.15.53:0/334500157 >> v2:172.21.15.87:3300/0 conn(0x7faed00cdb00 0x7faed00cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 --2- 172.21.15.53:0/334500157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cd6c0 0x7faed00cf0c0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 --2- 172.21.15.53:0/334500157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- 172.21.15.53:0/334500157 >> 172.21.15.53:0/334500157 conn(0x7faed0065c80 msgr2=0x7faed0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- 172.21.15.53:0/334500157 shutdown_connections 2024-09-13T18:29:30.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- 172.21.15.53:0/334500157 wait complete. 2024-09-13T18:29:30.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 Processor -- start 2024-09-13T18:29:30.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- start start 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed00cd6c0 0x7faed0152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cdb00 0x7faed00b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00b47a0 con 0x7faed00cdb00 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0152de0 con 0x7faed00cd6c0 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00b49d0 con 0x7faed015cab0 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cdb00 0x7faed00b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cdb00 0x7faed00b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45764/0 (socket says 172.21.15.53:45764) 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 -- 172.21.15.53:0/3516414781 learned_addr learned my addr 172.21.15.53:0/3516414781 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5e37640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed00cd6c0 0x7faed0152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed6638640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 -- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 msgr2=0x7faed00c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 -- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed00cd6c0 msgr2=0x7faed0152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed00cd6c0 0x7faed0152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 -- 172.21.15.53:0/3516414781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00094d0 con 0x7faed00cdb00 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed5636640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cdb00 0x7faed00b4260 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7faec001aba0 tx=0x7faec001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faec67fc640 1 -- 172.21.15.53:0/3516414781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00bd5f0 con 0x7faed00cdb00 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faec67fc640 1 -- 172.21.15.53:0/3516414781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00bd750 con 0x7faed00cdb00 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed00ca310 con 0x7faed00cdb00 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faec67fc640 1 -- 172.21.15.53:0/3516414781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00bdb00 con 0x7faed00cdb00 2024-09-13T18:29:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.863+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed00b3d70 con 0x7faed00cdb00 2024-09-13T18:29:30.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.867+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0067910 con 0x7faed00cdb00 2024-09-13T18:29:30.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.867+0000 7faec67fc640 1 -- 172.21.15.53:0/3516414781 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7faec00b33f0 con 0x7faed00cdb00 2024-09-13T18:29:30.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.867+0000 7faec67fc640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faeb40669f0 0x7faeb4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:30.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.867+0000 7faec67fc640 1 -- 172.21.15.53:0/3516414781 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faec011f910 con 0x7faed00cdb00 2024-09-13T18:29:30.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.867+0000 7faed5e37640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faeb40669f0 0x7faeb4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:30.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.867+0000 7faed5e37640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faeb40669f0 0x7faeb4068eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faecc003fd0 tx=0x7faecc0039c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:30.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:30.871+0000 7faec67fc640 1 -- 172.21.15.53:0/3516414781 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faed0067910 con 0x7faed00cdb00 2024-09-13T18:29:31.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.027+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faed00b3920 con 0x7faeb40669f0 2024-09-13T18:29:31.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.047+0000 7faec67fc640 1 -- 172.21.15.53:0/3516414781 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288180 (secure 0 0 0) 0x7faed00b3920 con 0x7faeb40669f0 2024-09-13T18:29:31.054 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:29:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faeb40669f0 msgr2=0x7faeb4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faeb40669f0 0x7faeb4068eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faecc003fd0 tx=0x7faecc0039c0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cdb00 msgr2=0x7faed00b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cdb00 0x7faed00b4260 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7faec001aba0 tx=0x7faec001ad30 comp rx=0 tx=0).stop 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 shutdown_connections 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7faeb40669f0 0x7faeb4068eb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faed015cab0 0x7faed00c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faed00cdb00 0x7faed00b4260 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 --2- 172.21.15.53:0/3516414781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faed00cd6c0 0x7faed0152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 >> 172.21.15.53:0/3516414781 conn(0x7faed0065c80 msgr2=0x7faed0155a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 shutdown_connections 2024-09-13T18:29:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.055+0000 7faed809b640 1 -- 172.21.15.53:0/3516414781 wait complete. 2024-09-13T18:29:31.072 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-13T18:29:30.993610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261096,"kb_used_data":8072,"kb_used_omap":12,"kb_used_meta":252915,"kb_avail":754713624,"statfs":{"total":773094113280,"available":772826750976,"internally_reserved":0,"allocated":8265728,"data_stored":4141988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":258985528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.819191"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736994+0000","last_change":"2024-09-13T18:29:22.217519+0000","last_active":"2024-09-13T18:29:23.736994+0000","last_peered":"2024-09-13T18:29:23.736994+0000","last_clean":"2024-09-13T18:29:23.736994+0000","last_became_active":"2024-09-13T18:29:22.213107+0000","last_became_peered":"2024-09-13T18:29:22.213107+0000","last_unstale":"2024-09-13T18:29:23.736994+0000","last_undegraded":"2024-09-13T18:29:23.736994+0000","last_fullsized":"2024-09-13T18:29:23.736994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:07.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.711221+0000","last_change":"2024-09-13T18:29:22.230792+0000","last_active":"2024-09-13T18:29:23.711221+0000","last_peered":"2024-09-13T18:29:23.711221+0000","last_clean":"2024-09-13T18:29:23.711221+0000","last_became_active":"2024-09-13T18:29:22.230128+0000","last_became_peered":"2024-09-13T18:29:22.230128+0000","last_unstale":"2024-09-13T18:29:23.711221+0000","last_undegraded":"2024-09-13T18:29:23.711221+0000","last_fullsized":"2024-09-13T18:29:23.711221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.316748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737236+0000","last_change":"2024-09-13T18:29:22.190882+0000","last_active":"2024-09-13T18:29:23.737236+0000","last_peered":"2024-09-13T18:29:23.737236+0000","last_clean":"2024-09-13T18:29:23.737236+0000","last_became_active":"2024-09-13T18:29:22.190423+0000","last_became_peered":"2024-09-13T18:29:22.190423+0000","last_unstale":"2024-09-13T18:29:23.737236+0000","last_undegraded":"2024-09-13T18:29:23.737236+0000","last_fullsized":"2024-09-13T18:29:23.737236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:57.223454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178908+0000","last_change":"2024-09-13T18:29:22.229047+0000","last_active":"2024-09-13T18:29:23.178908+0000","last_peered":"2024-09-13T18:29:23.178908+0000","last_clean":"2024-09-13T18:29:23.178908+0000","last_became_active":"2024-09-13T18:29:22.228740+0000","last_became_peered":"2024-09-13T18:29:22.228740+0000","last_unstale":"2024-09-13T18:29:23.178908+0000","last_undegraded":"2024-09-13T18:29:23.178908+0000","last_fullsized":"2024-09-13T18:29:23.178908+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:36.762820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738817+0000","last_change":"2024-09-13T18:29:22.205666+0000","last_active":"2024-09-13T18:29:23.738817+0000","last_peered":"2024-09-13T18:29:23.738817+0000","last_clean":"2024-09-13T18:29:23.738817+0000","last_became_active":"2024-09-13T18:29:22.205378+0000","last_became_peered":"2024-09-13T18:29:22.205378+0000","last_unstale":"2024-09-13T18:29:23.738817+0000","last_undegraded":"2024-09-13T18:29:23.738817+0000","last_fullsized":"2024-09-13T18:29:23.738817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:10.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710225+0000","last_change":"2024-09-13T18:29:22.237421+0000","last_active":"2024-09-13T18:29:23.710225+0000","last_peered":"2024-09-13T18:29:23.710225+0000","last_clean":"2024-09-13T18:29:23.710225+0000","last_became_active":"2024-09-13T18:29:22.233385+0000","last_became_peered":"2024-09-13T18:29:22.233385+0000","last_unstale":"2024-09-13T18:29:23.710225+0000","last_undegraded":"2024-09-13T18:29:23.710225+0000","last_fullsized":"2024-09-13T18:29:23.710225+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:25.252709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736334+0000","last_change":"2024-09-13T18:29:22.204296+0000","last_active":"2024-09-13T18:29:23.736334+0000","last_peered":"2024-09-13T18:29:23.736334+0000","last_clean":"2024-09-13T18:29:23.736334+0000","last_became_active":"2024-09-13T18:29:22.203634+0000","last_became_peered":"2024-09-13T18:29:22.203634+0000","last_unstale":"2024-09-13T18:29:23.736334+0000","last_undegraded":"2024-09-13T18:29:23.736334+0000","last_fullsized":"2024-09-13T18:29:23.736334+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710012+0000","last_change":"2024-09-13T18:29:22.216156+0000","last_active":"2024-09-13T18:29:23.710012+0000","last_peered":"2024-09-13T18:29:23.710012+0000","last_clean":"2024-09-13T18:29:23.710012+0000","last_became_active":"2024-09-13T18:29:22.215299+0000","last_became_peered":"2024-09-13T18:29:22.215299+0000","last_unstale":"2024-09-13T18:29:23.710012+0000","last_undegraded":"2024-09-13T18:29:23.710012+0000","last_fullsized":"2024-09-13T18:29:23.710012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:59.234770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739827+0000","last_change":"2024-09-13T18:29:22.192138+0000","last_active":"2024-09-13T18:29:23.739827+0000","last_peered":"2024-09-13T18:29:23.739827+0000","last_clean":"2024-09-13T18:29:23.739827+0000","last_became_active":"2024-09-13T18:29:22.191682+0000","last_became_peered":"2024-09-13T18:29:22.191682+0000","last_unstale":"2024-09-13T18:29:23.739827+0000","last_undegraded":"2024-09-13T18:29:23.739827+0000","last_fullsized":"2024-09-13T18:29:23.739827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:37.130797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181440+0000","last_change":"2024-09-13T18:29:22.193165+0000","last_active":"2024-09-13T18:29:23.181440+0000","last_peered":"2024-09-13T18:29:23.181440+0000","last_clean":"2024-09-13T18:29:23.181440+0000","last_became_active":"2024-09-13T18:29:22.189719+0000","last_became_peered":"2024-09-13T18:29:22.189719+0000","last_unstale":"2024-09-13T18:29:23.181440+0000","last_undegraded":"2024-09-13T18:29:23.181440+0000","last_fullsized":"2024-09-13T18:29:23.181440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:07.269438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736251+0000","last_change":"2024-09-13T18:29:22.211687+0000","last_active":"2024-09-13T18:29:23.736251+0000","last_peered":"2024-09-13T18:29:23.736251+0000","last_clean":"2024-09-13T18:29:23.736251+0000","last_became_active":"2024-09-13T18:29:22.208383+0000","last_became_peered":"2024-09-13T18:29:22.208383+0000","last_unstale":"2024-09-13T18:29:23.736251+0000","last_undegraded":"2024-09-13T18:29:23.736251+0000","last_fullsized":"2024-09-13T18:29:23.736251+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:02.483389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179174+0000","last_change":"2024-09-13T18:29:22.193463+0000","last_active":"2024-09-13T18:29:23.179174+0000","last_peered":"2024-09-13T18:29:23.179174+0000","last_clean":"2024-09-13T18:29:23.179174+0000","last_became_active":"2024-09-13T18:29:22.192863+0000","last_became_peered":"2024-09-13T18:29:22.192863+0000","last_unstale":"2024-09-13T18:29:23.179174+0000","last_undegraded":"2024-09-13T18:29:23.179174+0000","last_fullsized":"2024-09-13T18:29:23.179174+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:45.836047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736594+0000","last_change":"2024-09-13T18:29:22.229071+0000","last_active":"2024-09-13T18:29:23.736594+0000","last_peered":"2024-09-13T18:29:23.736594+0000","last_clean":"2024-09-13T18:29:23.736594+0000","last_became_active":"2024-09-13T18:29:22.228659+0000","last_became_peered":"2024-09-13T18:29:22.228659+0000","last_unstale":"2024-09-13T18:29:23.736594+0000","last_undegraded":"2024-09-13T18:29:23.736594+0000","last_fullsized":"2024-09-13T18:29:23.736594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:57.285380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739153+0000","last_change":"2024-09-13T18:29:22.206289+0000","last_active":"2024-09-13T18:29:23.739153+0000","last_peered":"2024-09-13T18:29:23.739153+0000","last_clean":"2024-09-13T18:29:23.739153+0000","last_became_active":"2024-09-13T18:29:22.204880+0000","last_became_peered":"2024-09-13T18:29:22.204880+0000","last_unstale":"2024-09-13T18:29:23.739153+0000","last_undegraded":"2024-09-13T18:29:23.739153+0000","last_fullsized":"2024-09-13T18:29:23.739153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:18.955924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736207+0000","last_change":"2024-09-13T18:29:22.188014+0000","last_active":"2024-09-13T18:29:23.736207+0000","last_peered":"2024-09-13T18:29:23.736207+0000","last_clean":"2024-09-13T18:29:23.736207+0000","last_became_active":"2024-09-13T18:29:22.187511+0000","last_became_peered":"2024-09-13T18:29:22.187511+0000","last_unstale":"2024-09-13T18:29:23.736207+0000","last_undegraded":"2024-09-13T18:29:23.736207+0000","last_fullsized":"2024-09-13T18:29:23.736207+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:27.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180368+0000","last_change":"2024-09-13T18:29:22.229946+0000","last_active":"2024-09-13T18:29:23.180368+0000","last_peered":"2024-09-13T18:29:23.180368+0000","last_clean":"2024-09-13T18:29:23.180368+0000","last_became_active":"2024-09-13T18:29:22.229235+0000","last_became_peered":"2024-09-13T18:29:22.229235+0000","last_unstale":"2024-09-13T18:29:23.180368+0000","last_undegraded":"2024-09-13T18:29:23.180368+0000","last_fullsized":"2024-09-13T18:29:23.180368+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739910+0000","last_change":"2024-09-13T18:29:22.191967+0000","last_active":"2024-09-13T18:29:23.739910+0000","last_peered":"2024-09-13T18:29:23.739910+0000","last_clean":"2024-09-13T18:29:23.739910+0000","last_became_active":"2024-09-13T18:29:22.191348+0000","last_became_peered":"2024-09-13T18:29:22.191348+0000","last_unstale":"2024-09-13T18:29:23.739910+0000","last_undegraded":"2024-09-13T18:29:23.739910+0000","last_fullsized":"2024-09-13T18:29:23.739910+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:39.886726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178997+0000","last_change":"2024-09-13T18:29:22.224034+0000","last_active":"2024-09-13T18:29:23.178997+0000","last_peered":"2024-09-13T18:29:23.178997+0000","last_clean":"2024-09-13T18:29:23.178997+0000","last_became_active":"2024-09-13T18:29:22.223791+0000","last_became_peered":"2024-09-13T18:29:22.223791+0000","last_unstale":"2024-09-13T18:29:23.178997+0000","last_undegraded":"2024-09-13T18:29:23.178997+0000","last_fullsized":"2024-09-13T18:29:23.178997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:05.839438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710585+0000","last_change":"2024-09-13T18:29:22.231594+0000","last_active":"2024-09-13T18:29:23.710585+0000","last_peered":"2024-09-13T18:29:23.710585+0000","last_clean":"2024-09-13T18:29:23.710585+0000","last_became_active":"2024-09-13T18:29:22.230865+0000","last_became_peered":"2024-09-13T18:29:22.230865+0000","last_unstale":"2024-09-13T18:29:23.710585+0000","last_undegraded":"2024-09-13T18:29:23.710585+0000","last_fullsized":"2024-09-13T18:29:23.710585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:37.955157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736547+0000","last_change":"2024-09-13T18:29:22.201787+0000","last_active":"2024-09-13T18:29:23.736547+0000","last_peered":"2024-09-13T18:29:23.736547+0000","last_clean":"2024-09-13T18:29:23.736547+0000","last_became_active":"2024-09-13T18:29:22.201492+0000","last_became_peered":"2024-09-13T18:29:22.201492+0000","last_unstale":"2024-09-13T18:29:23.736547+0000","last_undegraded":"2024-09-13T18:29:23.736547+0000","last_fullsized":"2024-09-13T18:29:23.736547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:30.863532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180709+0000","last_change":"2024-09-13T18:29:22.187687+0000","last_active":"2024-09-13T18:29:23.180709+0000","last_peered":"2024-09-13T18:29:23.180709+0000","last_clean":"2024-09-13T18:29:23.180709+0000","last_became_active":"2024-09-13T18:29:22.186982+0000","last_became_peered":"2024-09-13T18:29:22.186982+0000","last_unstale":"2024-09-13T18:29:23.180709+0000","last_undegraded":"2024-09-13T18:29:23.180709+0000","last_fullsized":"2024-09-13T18:29:23.180709+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180759+0000","last_change":"2024-09-13T18:29:22.191064+0000","last_active":"2024-09-13T18:29:23.180759+0000","last_peered":"2024-09-13T18:29:23.180759+0000","last_clean":"2024-09-13T18:29:23.180759+0000","last_became_active":"2024-09-13T18:29:22.190408+0000","last_became_peered":"2024-09-13T18:29:22.190408+0000","last_unstale":"2024-09-13T18:29:23.180759+0000","last_undegraded":"2024-09-13T18:29:23.180759+0000","last_fullsized":"2024-09-13T18:29:23.180759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:27.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735598+0000","last_change":"2024-09-13T18:29:22.206460+0000","last_active":"2024-09-13T18:29:23.735598+0000","last_peered":"2024-09-13T18:29:23.735598+0000","last_clean":"2024-09-13T18:29:23.735598+0000","last_became_active":"2024-09-13T18:29:22.205790+0000","last_became_peered":"2024-09-13T18:29:22.205790+0000","last_unstale":"2024-09-13T18:29:23.735598+0000","last_undegraded":"2024-09-13T18:29:23.735598+0000","last_fullsized":"2024-09-13T18:29:23.735598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:36.806965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735462+0000","last_change":"2024-09-13T18:29:22.238885+0000","last_active":"2024-09-13T18:29:23.735462+0000","last_peered":"2024-09-13T18:29:23.735462+0000","last_clean":"2024-09-13T18:29:23.735462+0000","last_became_active":"2024-09-13T18:29:22.238304+0000","last_became_peered":"2024-09-13T18:29:22.238304+0000","last_unstale":"2024-09-13T18:29:23.735462+0000","last_undegraded":"2024-09-13T18:29:23.735462+0000","last_fullsized":"2024-09-13T18:29:23.735462+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:01.430757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181437+0000","last_change":"2024-09-13T18:29:22.209217+0000","last_active":"2024-09-13T18:29:23.181437+0000","last_peered":"2024-09-13T18:29:23.181437+0000","last_clean":"2024-09-13T18:29:23.181437+0000","last_became_active":"2024-09-13T18:29:22.208470+0000","last_became_peered":"2024-09-13T18:29:22.208470+0000","last_unstale":"2024-09-13T18:29:23.181437+0000","last_undegraded":"2024-09-13T18:29:23.181437+0000","last_fullsized":"2024-09-13T18:29:23.181437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:45.858076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737456+0000","last_change":"2024-09-13T18:29:22.234575+0000","last_active":"2024-09-13T18:29:23.737456+0000","last_peered":"2024-09-13T18:29:23.737456+0000","last_clean":"2024-09-13T18:29:23.737456+0000","last_became_active":"2024-09-13T18:29:22.233930+0000","last_became_peered":"2024-09-13T18:29:22.233930+0000","last_unstale":"2024-09-13T18:29:23.737456+0000","last_undegraded":"2024-09-13T18:29:23.737456+0000","last_fullsized":"2024-09-13T18:29:23.737456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:32.365048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737392+0000","last_change":"2024-09-13T18:29:22.218013+0000","last_active":"2024-09-13T18:29:23.737392+0000","last_peered":"2024-09-13T18:29:23.737392+0000","last_clean":"2024-09-13T18:29:23.737392+0000","last_became_active":"2024-09-13T18:29:22.217697+0000","last_became_peered":"2024-09-13T18:29:22.217697+0000","last_unstale":"2024-09-13T18:29:23.737392+0000","last_undegraded":"2024-09-13T18:29:23.737392+0000","last_fullsized":"2024-09-13T18:29:23.737392+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:39.668594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181261+0000","last_change":"2024-09-13T18:29:22.192319+0000","last_active":"2024-09-13T18:29:23.181261+0000","last_peered":"2024-09-13T18:29:23.181261+0000","last_clean":"2024-09-13T18:29:23.181261+0000","last_became_active":"2024-09-13T18:29:22.191567+0000","last_became_peered":"2024-09-13T18:29:22.191567+0000","last_unstale":"2024-09-13T18:29:23.181261+0000","last_undegraded":"2024-09-13T18:29:23.181261+0000","last_fullsized":"2024-09-13T18:29:23.181261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:30.863532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737160+0000","last_change":"2024-09-13T18:29:22.200821+0000","last_active":"2024-09-13T18:29:23.737160+0000","last_peered":"2024-09-13T18:29:23.737160+0000","last_clean":"2024-09-13T18:29:23.737160+0000","last_became_active":"2024-09-13T18:29:22.200535+0000","last_became_peered":"2024-09-13T18:29:22.200535+0000","last_unstale":"2024-09-13T18:29:23.737160+0000","last_undegraded":"2024-09-13T18:29:23.737160+0000","last_fullsized":"2024-09-13T18:29:23.737160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:53.588081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736836+0000","last_change":"2024-09-13T18:29:22.240191+0000","last_active":"2024-09-13T18:29:23.736836+0000","last_peered":"2024-09-13T18:29:23.736836+0000","last_clean":"2024-09-13T18:29:23.736836+0000","last_became_active":"2024-09-13T18:29:22.238820+0000","last_became_peered":"2024-09-13T18:29:22.238820+0000","last_unstale":"2024-09-13T18:29:23.736836+0000","last_undegraded":"2024-09-13T18:29:23.736836+0000","last_fullsized":"2024-09-13T18:29:23.736836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:02.483389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736580+0000","last_change":"2024-09-13T18:29:22.199976+0000","last_active":"2024-09-13T18:29:23.736580+0000","last_peered":"2024-09-13T18:29:23.736580+0000","last_clean":"2024-09-13T18:29:23.736580+0000","last_became_active":"2024-09-13T18:29:22.199156+0000","last_became_peered":"2024-09-13T18:29:22.199156+0000","last_unstale":"2024-09-13T18:29:23.736580+0000","last_undegraded":"2024-09-13T18:29:23.736580+0000","last_fullsized":"2024-09-13T18:29:23.736580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:07.441174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710185+0000","last_change":"2024-09-13T18:29:22.219707+0000","last_active":"2024-09-13T18:29:23.710185+0000","last_peered":"2024-09-13T18:29:23.710185+0000","last_clean":"2024-09-13T18:29:23.710185+0000","last_became_active":"2024-09-13T18:29:22.216414+0000","last_became_peered":"2024-09-13T18:29:22.216414+0000","last_unstale":"2024-09-13T18:29:23.710185+0000","last_undegraded":"2024-09-13T18:29:23.710185+0000","last_fullsized":"2024-09-13T18:29:23.710185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:46.392068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736737+0000","last_change":"2024-09-13T18:29:22.235951+0000","last_active":"2024-09-13T18:29:23.736737+0000","last_peered":"2024-09-13T18:29:23.736737+0000","last_clean":"2024-09-13T18:29:23.736737+0000","last_became_active":"2024-09-13T18:29:22.235119+0000","last_became_peered":"2024-09-13T18:29:22.235119+0000","last_unstale":"2024-09-13T18:29:23.736737+0000","last_undegraded":"2024-09-13T18:29:23.736737+0000","last_fullsized":"2024-09-13T18:29:23.736737+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:50.204435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737250+0000","last_change":"2024-09-13T18:29:21.818058+0000","last_active":"2024-09-13T18:29:23.737250+0000","last_peered":"2024-09-13T18:29:23.737250+0000","last_clean":"2024-09-13T18:29:23.737250+0000","last_became_active":"2024-09-13T18:29:21.817741+0000","last_became_peered":"2024-09-13T18:29:21.817741+0000","last_unstale":"2024-09-13T18:29:23.737250+0000","last_undegraded":"2024-09-13T18:29:23.737250+0000","last_fullsized":"2024-09-13T18:29:23.737250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.624867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739967+0000","last_change":"2024-09-13T18:29:22.192178+0000","last_active":"2024-09-13T18:29:23.739967+0000","last_peered":"2024-09-13T18:29:23.739967+0000","last_clean":"2024-09-13T18:29:23.739967+0000","last_became_active":"2024-09-13T18:29:22.190862+0000","last_became_peered":"2024-09-13T18:29:22.190862+0000","last_unstale":"2024-09-13T18:29:23.739967+0000","last_undegraded":"2024-09-13T18:29:23.739967+0000","last_fullsized":"2024-09-13T18:29:23.739967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:14.181008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737106+0000","last_change":"2024-09-13T18:29:21.800383+0000","last_active":"2024-09-13T18:29:23.737106+0000","last_peered":"2024-09-13T18:29:23.737106+0000","last_clean":"2024-09-13T18:29:23.737106+0000","last_became_active":"2024-09-13T18:29:21.800027+0000","last_became_peered":"2024-09-13T18:29:21.800027+0000","last_unstale":"2024-09-13T18:29:23.737106+0000","last_undegraded":"2024-09-13T18:29:23.737106+0000","last_fullsized":"2024-09-13T18:29:23.737106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:47.837033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710827+0000","last_change":"2024-09-13T18:29:22.235768+0000","last_active":"2024-09-13T18:29:23.710827+0000","last_peered":"2024-09-13T18:29:23.710827+0000","last_clean":"2024-09-13T18:29:23.710827+0000","last_became_active":"2024-09-13T18:29:22.235154+0000","last_became_peered":"2024-09-13T18:29:22.235154+0000","last_unstale":"2024-09-13T18:29:23.710827+0000","last_undegraded":"2024-09-13T18:29:23.710827+0000","last_fullsized":"2024-09-13T18:29:23.710827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:05.969097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181548+0000","last_change":"2024-09-13T18:29:21.821440+0000","last_active":"2024-09-13T18:29:23.181548+0000","last_peered":"2024-09-13T18:29:23.181548+0000","last_clean":"2024-09-13T18:29:23.181548+0000","last_became_active":"2024-09-13T18:29:21.820756+0000","last_became_peered":"2024-09-13T18:29:21.820756+0000","last_unstale":"2024-09-13T18:29:23.181548+0000","last_undegraded":"2024-09-13T18:29:23.181548+0000","last_fullsized":"2024-09-13T18:29:23.181548+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:29.718583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736497+0000","last_change":"2024-09-13T18:29:22.218556+0000","last_active":"2024-09-13T18:29:23.736497+0000","last_peered":"2024-09-13T18:29:23.736497+0000","last_clean":"2024-09-13T18:29:23.736497+0000","last_became_active":"2024-09-13T18:29:22.217454+0000","last_became_peered":"2024-09-13T18:29:22.217454+0000","last_unstale":"2024-09-13T18:29:23.736497+0000","last_undegraded":"2024-09-13T18:29:23.736497+0000","last_fullsized":"2024-09-13T18:29:23.736497+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:48.164227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.711092+0000","last_change":"2024-09-13T18:29:21.818671+0000","last_active":"2024-09-13T18:29:23.711092+0000","last_peered":"2024-09-13T18:29:23.711092+0000","last_clean":"2024-09-13T18:29:23.711092+0000","last_became_active":"2024-09-13T18:29:21.817849+0000","last_became_peered":"2024-09-13T18:29:21.817849+0000","last_unstale":"2024-09-13T18:29:23.711092+0000","last_undegraded":"2024-09-13T18:29:23.711092+0000","last_fullsized":"2024-09-13T18:29:23.711092+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:04.316558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736679+0000","last_change":"2024-09-13T18:29:22.203871+0000","last_active":"2024-09-13T18:29:23.736679+0000","last_peered":"2024-09-13T18:29:23.736679+0000","last_clean":"2024-09-13T18:29:23.736679+0000","last_became_active":"2024-09-13T18:29:22.203176+0000","last_became_peered":"2024-09-13T18:29:22.203176+0000","last_unstale":"2024-09-13T18:29:23.736679+0000","last_undegraded":"2024-09-13T18:29:23.736679+0000","last_fullsized":"2024-09-13T18:29:23.736679+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:27.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737424+0000","last_change":"2024-09-13T18:29:21.812550+0000","last_active":"2024-09-13T18:29:23.737424+0000","last_peered":"2024-09-13T18:29:23.737424+0000","last_clean":"2024-09-13T18:29:23.737424+0000","last_became_active":"2024-09-13T18:29:21.812285+0000","last_became_peered":"2024-09-13T18:29:21.812285+0000","last_unstale":"2024-09-13T18:29:23.737424+0000","last_undegraded":"2024-09-13T18:29:23.737424+0000","last_fullsized":"2024-09-13T18:29:23.737424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:49.190613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181088+0000","last_change":"2024-09-13T18:29:22.200310+0000","last_active":"2024-09-13T18:29:23.181088+0000","last_peered":"2024-09-13T18:29:23.181088+0000","last_clean":"2024-09-13T18:29:23.181088+0000","last_became_active":"2024-09-13T18:29:22.199474+0000","last_became_peered":"2024-09-13T18:29:22.199474+0000","last_unstale":"2024-09-13T18:29:23.181088+0000","last_undegraded":"2024-09-13T18:29:23.181088+0000","last_fullsized":"2024-09-13T18:29:23.181088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:57.285380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710346+0000","last_change":"2024-09-13T18:29:21.820546+0000","last_active":"2024-09-13T18:29:23.710346+0000","last_peered":"2024-09-13T18:29:23.710346+0000","last_clean":"2024-09-13T18:29:23.710346+0000","last_became_active":"2024-09-13T18:29:21.819498+0000","last_became_peered":"2024-09-13T18:29:21.819498+0000","last_unstale":"2024-09-13T18:29:23.710346+0000","last_undegraded":"2024-09-13T18:29:23.710346+0000","last_fullsized":"2024-09-13T18:29:23.710346+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:08.790994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738542+0000","last_change":"2024-09-13T18:29:22.205008+0000","last_active":"2024-09-13T18:29:23.738542+0000","last_peered":"2024-09-13T18:29:23.738542+0000","last_clean":"2024-09-13T18:29:23.738542+0000","last_became_active":"2024-09-13T18:29:22.204644+0000","last_became_peered":"2024-09-13T18:29:22.204644+0000","last_unstale":"2024-09-13T18:29:23.738542+0000","last_undegraded":"2024-09-13T18:29:23.738542+0000","last_fullsized":"2024-09-13T18:29:23.738542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:55.252815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178592+0000","last_change":"2024-09-13T18:29:21.807961+0000","last_active":"2024-09-13T18:29:23.178592+0000","last_peered":"2024-09-13T18:29:23.178592+0000","last_clean":"2024-09-13T18:29:23.178592+0000","last_became_active":"2024-09-13T18:29:21.807522+0000","last_became_peered":"2024-09-13T18:29:21.807522+0000","last_unstale":"2024-09-13T18:29:23.178592+0000","last_undegraded":"2024-09-13T18:29:23.178592+0000","last_fullsized":"2024-09-13T18:29:23.178592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:38.872904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736450+0000","last_change":"2024-09-13T18:29:22.205643+0000","last_active":"2024-09-13T18:29:23.736450+0000","last_peered":"2024-09-13T18:29:23.736450+0000","last_clean":"2024-09-13T18:29:23.736450+0000","last_became_active":"2024-09-13T18:29:22.205364+0000","last_became_peered":"2024-09-13T18:29:22.205364+0000","last_unstale":"2024-09-13T18:29:23.736450+0000","last_undegraded":"2024-09-13T18:29:23.736450+0000","last_fullsized":"2024-09-13T18:29:23.736450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:37:45.858076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738466+0000","last_change":"2024-09-13T18:29:21.805658+0000","last_active":"2024-09-13T18:29:23.738466+0000","last_peered":"2024-09-13T18:29:23.738466+0000","last_clean":"2024-09-13T18:29:23.738466+0000","last_became_active":"2024-09-13T18:29:21.805142+0000","last_became_peered":"2024-09-13T18:29:21.805142+0000","last_unstale":"2024-09-13T18:29:23.738466+0000","last_undegraded":"2024-09-13T18:29:23.738466+0000","last_fullsized":"2024-09-13T18:29:23.738466+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:33.667319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737646+0000","last_change":"2024-09-13T18:29:22.210012+0000","last_active":"2024-09-13T18:29:23.737646+0000","last_peered":"2024-09-13T18:29:23.737646+0000","last_clean":"2024-09-13T18:29:23.737646+0000","last_became_active":"2024-09-13T18:29:22.209592+0000","last_became_peered":"2024-09-13T18:29:22.209592+0000","last_unstale":"2024-09-13T18:29:23.737646+0000","last_undegraded":"2024-09-13T18:29:23.737646+0000","last_fullsized":"2024-09-13T18:29:23.737646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:36.806965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181881+0000","last_change":"2024-09-13T18:29:21.807183+0000","last_active":"2024-09-13T18:29:23.181881+0000","last_peered":"2024-09-13T18:29:23.181881+0000","last_clean":"2024-09-13T18:29:23.181881+0000","last_became_active":"2024-09-13T18:29:21.806534+0000","last_became_peered":"2024-09-13T18:29:21.806534+0000","last_unstale":"2024-09-13T18:29:23.181881+0000","last_undegraded":"2024-09-13T18:29:23.181881+0000","last_fullsized":"2024-09-13T18:29:23.181881+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:24.238887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737006+0000","last_change":"2024-09-13T18:29:22.236980+0000","last_active":"2024-09-13T18:29:23.737006+0000","last_peered":"2024-09-13T18:29:23.737006+0000","last_clean":"2024-09-13T18:29:23.737006+0000","last_became_active":"2024-09-13T18:29:22.236266+0000","last_became_peered":"2024-09-13T18:29:22.236266+0000","last_unstale":"2024-09-13T18:29:23.737006+0000","last_undegraded":"2024-09-13T18:29:23.737006+0000","last_fullsized":"2024-09-13T18:29:23.737006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:38.897271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.711328+0000","last_change":"2024-09-13T18:29:21.822045+0000","last_active":"2024-09-13T18:29:23.711328+0000","last_peered":"2024-09-13T18:29:23.711328+0000","last_clean":"2024-09-13T18:29:23.711328+0000","last_became_active":"2024-09-13T18:29:21.821396+0000","last_became_peered":"2024-09-13T18:29:21.821396+0000","last_unstale":"2024-09-13T18:29:23.711328+0000","last_undegraded":"2024-09-13T18:29:23.711328+0000","last_fullsized":"2024-09-13T18:29:23.711328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710953+0000","last_change":"2024-09-13T18:29:22.230964+0000","last_active":"2024-09-13T18:29:23.710953+0000","last_peered":"2024-09-13T18:29:23.710953+0000","last_clean":"2024-09-13T18:29:23.710953+0000","last_became_active":"2024-09-13T18:29:22.230399+0000","last_became_peered":"2024-09-13T18:29:22.230399+0000","last_unstale":"2024-09-13T18:29:23.710953+0000","last_undegraded":"2024-09-13T18:29:23.710953+0000","last_fullsized":"2024-09-13T18:29:23.710953+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:54.393053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737529+0000","last_change":"2024-09-13T18:29:21.810642+0000","last_active":"2024-09-13T18:29:23.737529+0000","last_peered":"2024-09-13T18:29:23.737529+0000","last_clean":"2024-09-13T18:29:23.737529+0000","last_became_active":"2024-09-13T18:29:21.810249+0000","last_became_peered":"2024-09-13T18:29:21.810249+0000","last_unstale":"2024-09-13T18:29:23.737529+0000","last_undegraded":"2024-09-13T18:29:23.737529+0000","last_fullsized":"2024-09-13T18:29:23.737529+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:00.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739121+0000","last_change":"2024-09-13T18:29:22.188643+0000","last_active":"2024-09-13T18:29:23.739121+0000","last_peered":"2024-09-13T18:29:23.739121+0000","last_clean":"2024-09-13T18:29:23.739121+0000","last_became_active":"2024-09-13T18:29:22.188416+0000","last_became_peered":"2024-09-13T18:29:22.188416+0000","last_unstale":"2024-09-13T18:29:23.739121+0000","last_undegraded":"2024-09-13T18:29:23.739121+0000","last_fullsized":"2024-09-13T18:29:23.739121+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:10.125747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179187+0000","last_change":"2024-09-13T18:29:21.804003+0000","last_active":"2024-09-13T18:29:23.179187+0000","last_peered":"2024-09-13T18:29:23.179187+0000","last_clean":"2024-09-13T18:29:23.179187+0000","last_became_active":"2024-09-13T18:29:21.803379+0000","last_became_peered":"2024-09-13T18:29:21.803379+0000","last_unstale":"2024-09-13T18:29:23.179187+0000","last_undegraded":"2024-09-13T18:29:23.179187+0000","last_fullsized":"2024-09-13T18:29:23.179187+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:13.167186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735607+0000","last_change":"2024-09-13T18:29:22.213213+0000","last_active":"2024-09-13T18:29:23.735607+0000","last_peered":"2024-09-13T18:29:23.735607+0000","last_clean":"2024-09-13T18:29:23.735607+0000","last_became_active":"2024-09-13T18:29:22.212487+0000","last_became_peered":"2024-09-13T18:29:22.212487+0000","last_unstale":"2024-09-13T18:29:23.735607+0000","last_undegraded":"2024-09-13T18:29:23.735607+0000","last_fullsized":"2024-09-13T18:29:23.735607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:30.863532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179294+0000","last_change":"2024-09-13T18:29:21.819249+0000","last_active":"2024-09-13T18:29:23.179294+0000","last_peered":"2024-09-13T18:29:23.179294+0000","last_clean":"2024-09-13T18:29:23.179294+0000","last_became_active":"2024-09-13T18:29:21.818944+0000","last_became_peered":"2024-09-13T18:29:21.818944+0000","last_unstale":"2024-09-13T18:29:23.179294+0000","last_undegraded":"2024-09-13T18:29:23.179294+0000","last_fullsized":"2024-09-13T18:29:23.179294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:28.455142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737165+0000","last_change":"2024-09-13T18:29:22.224460+0000","last_active":"2024-09-13T18:29:23.737165+0000","last_peered":"2024-09-13T18:29:23.737165+0000","last_clean":"2024-09-13T18:29:23.737165+0000","last_became_active":"2024-09-13T18:29:22.222678+0000","last_became_peered":"2024-09-13T18:29:22.222678+0000","last_unstale":"2024-09-13T18:29:23.737165+0000","last_undegraded":"2024-09-13T18:29:23.737165+0000","last_fullsized":"2024-09-13T18:29:23.737165+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:48.164227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710469+0000","last_change":"2024-09-13T18:29:21.813971+0000","last_active":"2024-09-13T18:29:23.710469+0000","last_peered":"2024-09-13T18:29:23.710469+0000","last_clean":"2024-09-13T18:29:23.710469+0000","last_became_active":"2024-09-13T18:29:21.813297+0000","last_became_peered":"2024-09-13T18:29:21.813297+0000","last_unstale":"2024-09-13T18:29:23.710469+0000","last_undegraded":"2024-09-13T18:29:23.710469+0000","last_fullsized":"2024-09-13T18:29:23.710469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:17.942102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736050+0000","last_change":"2024-09-13T18:29:22.229037+0000","last_active":"2024-09-13T18:29:23.736050+0000","last_peered":"2024-09-13T18:29:23.736050+0000","last_clean":"2024-09-13T18:29:23.736050+0000","last_became_active":"2024-09-13T18:29:22.228643+0000","last_became_peered":"2024-09-13T18:29:22.228643+0000","last_unstale":"2024-09-13T18:29:23.736050+0000","last_undegraded":"2024-09-13T18:29:23.736050+0000","last_fullsized":"2024-09-13T18:29:23.736050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736446+0000","last_change":"2024-09-13T18:29:21.804470+0000","last_active":"2024-09-13T18:29:23.736446+0000","last_peered":"2024-09-13T18:29:23.736446+0000","last_clean":"2024-09-13T18:29:23.736446+0000","last_became_active":"2024-09-13T18:29:21.803159+0000","last_became_peered":"2024-09-13T18:29:21.803159+0000","last_unstale":"2024-09-13T18:29:23.736446+0000","last_undegraded":"2024-09-13T18:29:23.736446+0000","last_fullsized":"2024-09-13T18:29:23.736446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:23.325554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738863+0000","last_change":"2024-09-13T18:29:22.191336+0000","last_active":"2024-09-13T18:29:23.738863+0000","last_peered":"2024-09-13T18:29:23.738863+0000","last_clean":"2024-09-13T18:29:23.738863+0000","last_became_active":"2024-09-13T18:29:22.190378+0000","last_became_peered":"2024-09-13T18:29:22.190378+0000","last_unstale":"2024-09-13T18:29:23.738863+0000","last_undegraded":"2024-09-13T18:29:23.738863+0000","last_fullsized":"2024-09-13T18:29:23.738863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:29.468964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180527+0000","last_change":"2024-09-13T18:29:21.818359+0000","last_active":"2024-09-13T18:29:23.180527+0000","last_peered":"2024-09-13T18:29:23.180527+0000","last_clean":"2024-09-13T18:29:23.180527+0000","last_became_active":"2024-09-13T18:29:21.817720+0000","last_became_peered":"2024-09-13T18:29:21.817720+0000","last_unstale":"2024-09-13T18:29:23.180527+0000","last_undegraded":"2024-09-13T18:29:23.180527+0000","last_fullsized":"2024-09-13T18:29:23.180527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:36.941334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181526+0000","last_change":"2024-09-13T18:29:22.185326+0000","last_active":"2024-09-13T18:29:23.181526+0000","last_peered":"2024-09-13T18:29:23.181526+0000","last_clean":"2024-09-13T18:29:23.181526+0000","last_became_active":"2024-09-13T18:29:22.184678+0000","last_became_peered":"2024-09-13T18:29:22.184678+0000","last_unstale":"2024-09-13T18:29:23.181526+0000","last_undegraded":"2024-09-13T18:29:23.181526+0000","last_fullsized":"2024-09-13T18:29:23.181526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:03.683811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710894+0000","last_change":"2024-09-13T18:29:21.816796+0000","last_active":"2024-09-13T18:29:23.710894+0000","last_peered":"2024-09-13T18:29:23.710894+0000","last_clean":"2024-09-13T18:29:23.710894+0000","last_became_active":"2024-09-13T18:29:21.816084+0000","last_became_peered":"2024-09-13T18:29:21.816084+0000","last_unstale":"2024-09-13T18:29:23.710894+0000","last_undegraded":"2024-09-13T18:29:23.710894+0000","last_fullsized":"2024-09-13T18:29:23.710894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:09.111925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737280+0000","last_change":"2024-09-13T18:29:22.220452+0000","last_active":"2024-09-13T18:29:23.737280+0000","last_peered":"2024-09-13T18:29:23.737280+0000","last_clean":"2024-09-13T18:29:23.737280+0000","last_became_active":"2024-09-13T18:29:22.219818+0000","last_became_peered":"2024-09-13T18:29:22.219818+0000","last_unstale":"2024-09-13T18:29:23.737280+0000","last_undegraded":"2024-09-13T18:29:23.737280+0000","last_fullsized":"2024-09-13T18:29:23.737280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:04.732217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.181649+0000","last_change":"2024-09-13T18:29:21.818589+0000","last_active":"2024-09-13T18:29:23.181649+0000","last_peered":"2024-09-13T18:29:23.181649+0000","last_clean":"2024-09-13T18:29:23.181649+0000","last_became_active":"2024-09-13T18:29:21.818248+0000","last_became_peered":"2024-09-13T18:29:21.818248+0000","last_unstale":"2024-09-13T18:29:23.181649+0000","last_undegraded":"2024-09-13T18:29:23.181649+0000","last_fullsized":"2024-09-13T18:29:23.181649+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:23.212115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.179101+0000","last_change":"2024-09-13T18:29:22.188054+0000","last_active":"2024-09-13T18:29:23.179101+0000","last_peered":"2024-09-13T18:29:23.179101+0000","last_clean":"2024-09-13T18:29:23.179101+0000","last_became_active":"2024-09-13T18:29:22.187469+0000","last_became_peered":"2024-09-13T18:29:22.187469+0000","last_unstale":"2024-09-13T18:29:23.179101+0000","last_undegraded":"2024-09-13T18:29:23.179101+0000","last_fullsized":"2024-09-13T18:29:23.179101+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:27.713036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710836+0000","last_change":"2024-09-13T18:29:21.825157+0000","last_active":"2024-09-13T18:29:23.710836+0000","last_peered":"2024-09-13T18:29:23.710836+0000","last_clean":"2024-09-13T18:29:23.710836+0000","last_became_active":"2024-09-13T18:29:21.824780+0000","last_became_peered":"2024-09-13T18:29:21.824780+0000","last_unstale":"2024-09-13T18:29:23.710836+0000","last_undegraded":"2024-09-13T18:29:23.710836+0000","last_fullsized":"2024-09-13T18:29:23.710836+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:09.454642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739498+0000","last_change":"2024-09-13T18:29:22.204999+0000","last_active":"2024-09-13T18:29:23.739498+0000","last_peered":"2024-09-13T18:29:23.739498+0000","last_clean":"2024-09-13T18:29:23.739498+0000","last_became_active":"2024-09-13T18:29:22.204654+0000","last_became_peered":"2024-09-13T18:29:22.204654+0000","last_unstale":"2024-09-13T18:29:23.739498+0000","last_undegraded":"2024-09-13T18:29:23.739498+0000","last_fullsized":"2024-09-13T18:29:23.739498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:37.531684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736132+0000","last_change":"2024-09-13T18:29:21.825495+0000","last_active":"2024-09-13T18:29:23.736132+0000","last_peered":"2024-09-13T18:29:23.736132+0000","last_clean":"2024-09-13T18:29:23.736132+0000","last_became_active":"2024-09-13T18:29:21.824574+0000","last_became_peered":"2024-09-13T18:29:21.824574+0000","last_unstale":"2024-09-13T18:29:23.736132+0000","last_undegraded":"2024-09-13T18:29:23.736132+0000","last_fullsized":"2024-09-13T18:29:23.736132+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:47.837033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737320+0000","last_change":"2024-09-13T18:29:22.192454+0000","last_active":"2024-09-13T18:29:23.737320+0000","last_peered":"2024-09-13T18:29:23.737320+0000","last_clean":"2024-09-13T18:29:23.737320+0000","last_became_active":"2024-09-13T18:29:22.191981+0000","last_became_peered":"2024-09-13T18:29:22.191981+0000","last_unstale":"2024-09-13T18:29:23.737320+0000","last_undegraded":"2024-09-13T18:29:23.737320+0000","last_fullsized":"2024-09-13T18:29:23.737320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:58.585945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710626+0000","last_change":"2024-09-13T18:29:21.819912+0000","last_active":"2024-09-13T18:29:23.710626+0000","last_peered":"2024-09-13T18:29:23.710626+0000","last_clean":"2024-09-13T18:29:23.710626+0000","last_became_active":"2024-09-13T18:29:21.818833+0000","last_became_peered":"2024-09-13T18:29:21.818833+0000","last_unstale":"2024-09-13T18:29:23.710626+0000","last_undegraded":"2024-09-13T18:29:23.710626+0000","last_fullsized":"2024-09-13T18:29:23.710626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:36.116975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736956+0000","last_change":"2024-09-13T18:29:22.230019+0000","last_active":"2024-09-13T18:29:23.736956+0000","last_peered":"2024-09-13T18:29:23.736956+0000","last_clean":"2024-09-13T18:29:23.736956+0000","last_became_active":"2024-09-13T18:29:22.229707+0000","last_became_peered":"2024-09-13T18:29:22.229707+0000","last_unstale":"2024-09-13T18:29:23.736956+0000","last_undegraded":"2024-09-13T18:29:23.736956+0000","last_fullsized":"2024-09-13T18:29:23.736956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:56.050568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736672+0000","last_change":"2024-09-13T18:29:21.808188+0000","last_active":"2024-09-13T18:29:23.736672+0000","last_peered":"2024-09-13T18:29:23.736672+0000","last_clean":"2024-09-13T18:29:23.736672+0000","last_became_active":"2024-09-13T18:29:21.807531+0000","last_became_peered":"2024-09-13T18:29:21.807531+0000","last_unstale":"2024-09-13T18:29:23.736672+0000","last_undegraded":"2024-09-13T18:29:23.736672+0000","last_fullsized":"2024-09-13T18:29:23.736672+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:47.837033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736758+0000","last_change":"2024-09-13T18:29:22.229910+0000","last_active":"2024-09-13T18:29:23.736758+0000","last_peered":"2024-09-13T18:29:23.736758+0000","last_clean":"2024-09-13T18:29:23.736758+0000","last_became_active":"2024-09-13T18:29:22.229639+0000","last_became_peered":"2024-09-13T18:29:22.229639+0000","last_unstale":"2024-09-13T18:29:23.736758+0000","last_undegraded":"2024-09-13T18:29:23.736758+0000","last_fullsized":"2024-09-13T18:29:23.736758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:10.813922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735931+0000","last_change":"2024-09-13T18:29:21.803331+0000","last_active":"2024-09-13T18:29:23.735931+0000","last_peered":"2024-09-13T18:29:23.735931+0000","last_clean":"2024-09-13T18:29:23.735931+0000","last_became_active":"2024-09-13T18:29:21.802977+0000","last_became_peered":"2024-09-13T18:29:21.802977+0000","last_unstale":"2024-09-13T18:29:23.735931+0000","last_undegraded":"2024-09-13T18:29:23.735931+0000","last_fullsized":"2024-09-13T18:29:23.735931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:15.624867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737061+0000","last_change":"2024-09-13T18:29:22.189488+0000","last_active":"2024-09-13T18:29:23.737061+0000","last_peered":"2024-09-13T18:29:23.737061+0000","last_clean":"2024-09-13T18:29:23.737061+0000","last_became_active":"2024-09-13T18:29:22.189222+0000","last_became_peered":"2024-09-13T18:29:22.189222+0000","last_unstale":"2024-09-13T18:29:23.737061+0000","last_undegraded":"2024-09-13T18:29:23.737061+0000","last_fullsized":"2024-09-13T18:29:23.737061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.214218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710979+0000","last_change":"2024-09-13T18:29:21.816030+0000","last_active":"2024-09-13T18:29:23.710979+0000","last_peered":"2024-09-13T18:29:23.710979+0000","last_clean":"2024-09-13T18:29:23.710979+0000","last_became_active":"2024-09-13T18:29:21.815687+0000","last_became_peered":"2024-09-13T18:29:21.815687+0000","last_unstale":"2024-09-13T18:29:23.710979+0000","last_undegraded":"2024-09-13T18:29:23.710979+0000","last_fullsized":"2024-09-13T18:29:23.710979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:28.455142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737552+0000","last_change":"2024-09-13T18:29:22.210181+0000","last_active":"2024-09-13T18:29:23.737552+0000","last_peered":"2024-09-13T18:29:23.737552+0000","last_clean":"2024-09-13T18:29:23.737552+0000","last_became_active":"2024-09-13T18:29:22.203446+0000","last_became_peered":"2024-09-13T18:29:22.203446+0000","last_unstale":"2024-09-13T18:29:23.737552+0000","last_undegraded":"2024-09-13T18:29:23.737552+0000","last_fullsized":"2024-09-13T18:29:23.737552+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:57.285380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:25.285228+0000","last_change":"2024-09-13T18:29:21.807292+0000","last_active":"2024-09-13T18:29:25.285228+0000","last_peered":"2024-09-13T18:29:25.285228+0000","last_clean":"2024-09-13T18:29:25.285228+0000","last_became_active":"2024-09-13T18:29:21.806367+0000","last_became_peered":"2024-09-13T18:29:21.806367+0000","last_unstale":"2024-09-13T18:29:25.285228+0000","last_undegraded":"2024-09-13T18:29:25.285228+0000","last_fullsized":"2024-09-13T18:29:25.285228+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:29.861586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.735947+0000","last_change":"2024-09-13T18:29:22.239628+0000","last_active":"2024-09-13T18:29:23.735947+0000","last_peered":"2024-09-13T18:29:23.735947+0000","last_clean":"2024-09-13T18:29:23.735947+0000","last_became_active":"2024-09-13T18:29:22.237867+0000","last_became_peered":"2024-09-13T18:29:22.237867+0000","last_unstale":"2024-09-13T18:29:23.735947+0000","last_undegraded":"2024-09-13T18:29:23.735947+0000","last_fullsized":"2024-09-13T18:29:23.735947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:04.989845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739439+0000","last_change":"2024-09-13T18:29:21.802394+0000","last_active":"2024-09-13T18:29:23.739439+0000","last_peered":"2024-09-13T18:29:23.739439+0000","last_clean":"2024-09-13T18:29:23.739439+0000","last_became_active":"2024-09-13T18:29:21.801585+0000","last_became_peered":"2024-09-13T18:29:21.801585+0000","last_unstale":"2024-09-13T18:29:23.739439+0000","last_undegraded":"2024-09-13T18:29:23.739439+0000","last_fullsized":"2024-09-13T18:29:23.739439+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:27.342969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736677+0000","last_change":"2024-09-13T18:29:22.217963+0000","last_active":"2024-09-13T18:29:23.736677+0000","last_peered":"2024-09-13T18:29:23.736677+0000","last_clean":"2024-09-13T18:29:23.736677+0000","last_became_active":"2024-09-13T18:29:22.212292+0000","last_became_peered":"2024-09-13T18:29:22.212292+0000","last_unstale":"2024-09-13T18:29:23.736677+0000","last_undegraded":"2024-09-13T18:29:23.736677+0000","last_fullsized":"2024-09-13T18:29:23.736677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:32.365048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.736788+0000","last_change":"2024-09-13T18:29:21.810380+0000","last_active":"2024-09-13T18:29:23.736788+0000","last_peered":"2024-09-13T18:29:23.736788+0000","last_clean":"2024-09-13T18:29:23.736788+0000","last_became_active":"2024-09-13T18:29:21.810089+0000","last_became_peered":"2024-09-13T18:29:21.810089+0000","last_unstale":"2024-09-13T18:29:23.736788+0000","last_undegraded":"2024-09-13T18:29:23.736788+0000","last_fullsized":"2024-09-13T18:29:23.736788+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:29.861586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.739428+0000","last_change":"2024-09-13T18:29:22.190909+0000","last_active":"2024-09-13T18:29:23.739428+0000","last_peered":"2024-09-13T18:29:23.739428+0000","last_clean":"2024-09-13T18:29:23.739428+0000","last_became_active":"2024-09-13T18:29:22.190555+0000","last_became_peered":"2024-09-13T18:29:22.190555+0000","last_unstale":"2024-09-13T18:29:23.739428+0000","last_undegraded":"2024-09-13T18:29:23.739428+0000","last_fullsized":"2024-09-13T18:29:23.739428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:08.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.738841+0000","last_change":"2024-09-13T18:29:21.813226+0000","last_active":"2024-09-13T18:29:23.738841+0000","last_peered":"2024-09-13T18:29:23.738841+0000","last_clean":"2024-09-13T18:29:23.738841+0000","last_became_active":"2024-09-13T18:29:21.812763+0000","last_became_peered":"2024-09-13T18:29:21.812763+0000","last_unstale":"2024-09-13T18:29:23.738841+0000","last_undegraded":"2024-09-13T18:29:23.738841+0000","last_fullsized":"2024-09-13T18:29:23.738841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:27.562099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710632+0000","last_change":"2024-09-13T18:29:22.227579+0000","last_active":"2024-09-13T18:29:23.710632+0000","last_peered":"2024-09-13T18:29:23.710632+0000","last_clean":"2024-09-13T18:29:23.710632+0000","last_became_active":"2024-09-13T18:29:22.226878+0000","last_became_peered":"2024-09-13T18:29:22.226878+0000","last_unstale":"2024-09-13T18:29:23.710632+0000","last_undegraded":"2024-09-13T18:29:23.710632+0000","last_fullsized":"2024-09-13T18:29:23.710632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:16.810471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178870+0000","last_change":"2024-09-13T18:29:21.808719+0000","last_active":"2024-09-13T18:29:23.178870+0000","last_peered":"2024-09-13T18:29:23.178870+0000","last_clean":"2024-09-13T18:29:23.178870+0000","last_became_active":"2024-09-13T18:29:21.808441+0000","last_became_peered":"2024-09-13T18:29:21.808441+0000","last_unstale":"2024-09-13T18:29:23.178870+0000","last_undegraded":"2024-09-13T18:29:23.178870+0000","last_fullsized":"2024-09-13T18:29:23.178870+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.178855+0000","last_change":"2024-09-13T18:29:22.192974+0000","last_active":"2024-09-13T18:29:23.178855+0000","last_peered":"2024-09-13T18:29:23.178855+0000","last_clean":"2024-09-13T18:29:23.178855+0000","last_became_active":"2024-09-13T18:29:22.192706+0000","last_became_peered":"2024-09-13T18:29:22.192706+0000","last_unstale":"2024-09-13T18:29:23.178855+0000","last_undegraded":"2024-09-13T18:29:23.178855+0000","last_fullsized":"2024-09-13T18:29:23.178855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:59.718204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.180320+0000","last_change":"2024-09-13T18:29:21.817256+0000","last_active":"2024-09-13T18:29:23.180320+0000","last_peered":"2024-09-13T18:29:23.180320+0000","last_clean":"2024-09-13T18:29:23.180320+0000","last_became_active":"2024-09-13T18:29:21.816644+0000","last_became_peered":"2024-09-13T18:29:21.816644+0000","last_unstale":"2024-09-13T18:29:23.180320+0000","last_undegraded":"2024-09-13T18:29:23.180320+0000","last_fullsized":"2024-09-13T18:29:23.180320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:09.302926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.709874+0000","last_change":"2024-09-13T18:29:22.215267+0000","last_active":"2024-09-13T18:29:23.709874+0000","last_peered":"2024-09-13T18:29:23.709874+0000","last_clean":"2024-09-13T18:29:23.709874+0000","last_became_active":"2024-09-13T18:29:22.214570+0000","last_became_peered":"2024-09-13T18:29:22.214570+0000","last_unstale":"2024-09-13T18:29:23.709874+0000","last_undegraded":"2024-09-13T18:29:23.709874+0000","last_fullsized":"2024-09-13T18:29:23.709874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:09.489302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710212+0000","last_change":"2024-09-13T18:29:21.818006+0000","last_active":"2024-09-13T18:29:23.710212+0000","last_peered":"2024-09-13T18:29:23.710212+0000","last_clean":"2024-09-13T18:29:23.710212+0000","last_became_active":"2024-09-13T18:29:21.817500+0000","last_became_peered":"2024-09-13T18:29:21.817500+0000","last_unstale":"2024-09-13T18:29:23.710212+0000","last_undegraded":"2024-09-13T18:29:23.710212+0000","last_fullsized":"2024-09-13T18:29:23.710212+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:31.836432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.737502+0000","last_change":"2024-09-13T18:29:22.234252+0000","last_active":"2024-09-13T18:29:23.737502+0000","last_peered":"2024-09-13T18:29:23.737502+0000","last_clean":"2024-09-13T18:29:23.737502+0000","last_became_active":"2024-09-13T18:29:22.233929+0000","last_became_peered":"2024-09-13T18:29:22.233929+0000","last_unstale":"2024-09-13T18:29:23.737502+0000","last_undegraded":"2024-09-13T18:29:23.737502+0000","last_fullsized":"2024-09-13T18:29:23.737502+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:21.768256+0000","last_clean_scrub_stamp":"2024-09-13T18:29:21.768256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:53.346889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-13T18:29:23.710766+0000","last_change":"2024-09-13T18:29:21.818649+0000","last_active":"2024-09-13T18:29:23.710766+0000","last_peered":"2024-09-13T18:29:23.710766+0000","last_clean":"2024-09-13T18:29:23.710766+0000","last_became_active":"2024-09-13T18:29:21.817980+0000","last_became_peered":"2024-09-13T18:29:21.817980+0000","last_unstale":"2024-09-13T18:29:23.710766+0000","last_undegraded":"2024-09-13T18:29:23.710766+0000","last_fullsized":"2024-09-13T18:29:23.710766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:29:20.754434+0000","last_clean_scrub_stamp":"2024-09-13T18:29:20.754434+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:54.238993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:29:22.186354+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:29:22.186354+0000","last_peered":"2024-09-13T18:29:22.186354+0000","last_clean":"2024-09-13T18:29:22.186354+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:29:22.186354+0000","last_undegraded":"2024-09-13T18:29:22.186354+0000","last_fullsized":"2024-09-13T18:29:22.186354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1478656,"data_stored":960550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.88300000000000001},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3080000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.88200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1839999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.028}]},{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4179999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93400000000000005,"15min":0.92000000000000004},"min":{"1min":0.60499999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4890000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.82699999999999996,"15min":0.79900000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1060000000000001,"5min":1.276,"15min":1.276},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.5309999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.437,"15min":0.437},"max":{"1min":1.349,"5min":1.448,"15min":1.448},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94899999999999995,"15min":0.91100000000000003},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2,"5min":1.397,"15min":1.397},"last":0.79800000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.55800000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2809999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.94099999999999995},"min":{"1min":0.61099999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.753}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0469999999999999},"min":{"1min":0.70299999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.278,"5min":1.877,"15min":1.877},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.63100000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.95899999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0660000000000001,"15min":1.0620000000000001},"min":{"1min":0.78100000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3919999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.03,"15min":0.995},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2210000000000001,"5min":1.506,"15min":1.506},"last":0.83299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":369658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.82999999999999996},"min":{"1min":0.52900000000000003,"5min":0.312,"15min":0.312},"max":{"1min":1.1579999999999999,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.78600000000000003},"min":{"1min":0.48799999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2170000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.90700000000000003,"15min":0.88300000000000001},"min":{"1min":0.626,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.155,"5min":1.577,"15min":1.577},"last":1.079},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93400000000000005,"15min":0.89200000000000002},"min":{"1min":0.56399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.157,"5min":1.464,"15min":1.464},"last":1.0600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.65600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0669999999999999,"5min":1.268,"15min":1.268},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95099999999999996,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.208,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.024}]},{"osd":3,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88800000000000001,"15min":0.877},"min":{"1min":0.68000000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0800000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1339999999999999,"5min":1.306,"15min":1.306},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.96099999999999997,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1839999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.02,"15min":0.998},"min":{"1min":0.69399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.212,"5min":1.526,"15min":1.526},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93899999999999995},"min":{"1min":0.59699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0469999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.069,"15min":1.107},"min":{"1min":0.73199999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3520000000000001,"5min":2.762,"15min":2.762},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:28:56 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0189999999999999,"15min":1.0409999999999999},"min":{"1min":0.74199999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":1,"5min":1.0229999999999999,"15min":1.0429999999999999},"min":{"1min":0.69199999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2410000000000001,"5min":1.72,"15min":1.72},"last":0.88500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":369656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.53900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1799999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89400000000000002,"15min":0.91200000000000003},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.2010000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.74399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85999999999999999,"15min":0.82799999999999996},"min":{"1min":0.49399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.018},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.84499999999999997,"15min":0.82699999999999996},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0780000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.79100000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89500000000000002,"15min":0.879},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.71199999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1890000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94199999999999995,"15min":0.96199999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.272,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97599999999999998,"15min":0.98099999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1859999999999999,"5min":1.871,"15min":1.871},"last":1.6719999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.91900000000000004,"15min":0.94199999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2410000000000001,"5min":1.413,"15min":1.413},"last":1.4370000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3149999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.89600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.98699999999999999,"15min":1.0309999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2050000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.99299999999999999,"15min":1.036},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2410000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.1259999999999999},"min":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.4039999999999999,"5min":2.246,"15min":2.246},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.0940000000000001,"15min":1.145},"min":{"1min":0.74299999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2769999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.5980000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":880640,"data_stored":369636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.82499999999999996,"15min":0.80100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.874,"15min":0.874},"min":{"1min":0.52300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.256,"15min":1.256},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84599999999999997},"min":{"1min":0.46300000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89200000000000002,"15min":0.874},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.1879999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.087,"5min":1.147,"15min":1.147},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.66600000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.92100000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92500000000000004,"15min":0.92900000000000005},"min":{"1min":0.65600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.389,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.242,"5min":1.298,"15min":1.298},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.94799999999999995,"15min":0.96499999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.333,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1180000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94099999999999995,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.181,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":1,"15min":1.02},"min":{"1min":0.70899999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.212,"5min":1.377,"15min":1.377},"last":1.2549999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0369999999999999,"15min":1.042},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.286,"5min":1.482,"15min":1.482},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.044,"15min":1.0760000000000001},"min":{"1min":0.72899999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2010000000000001,"5min":1.466,"15min":1.466},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":884736,"data_stored":369678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68100000000000005,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.77400000000000002,"15min":0.71399999999999997},"min":{"1min":0.50800000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.67000000000000004},"min":{"1min":0.44900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4199999999999999,"5min":1.704,"15min":1.704},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.67000000000000004,"15min":0.61599999999999999},"min":{"1min":0.40100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.76300000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.79000000000000004,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.399,"15min":1.399},"last":1.1379999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.97099999999999997,"15min":0.96299999999999997},"min":{"1min":0.77000000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0880000000000001,"15min":1.1279999999999999},"min":{"1min":0.78600000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.99299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.028,"15min":1.024},"min":{"1min":0.69499999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2689999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.96199999999999997,"15min":0.94299999999999995},"min":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.3260000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0680000000000001,"15min":1.0780000000000001},"min":{"1min":0.65900000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.5800000000000001,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.272},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0629999999999999,"15min":1.054},"min":{"1min":0.83799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.377,"5min":1.96,"15min":1.96},"last":1.3620000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:28:49 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.624,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.665,"5min":3,"15min":3},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.04,"15min":1.0049999999999999},"min":{"1min":0.75,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.9220000000000002,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.1899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":888832,"data_stored":371130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33200000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.68300000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.622},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0800000000000001,"5min":1.335,"15min":1.335},"last":0.92900000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.879,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.318,"5min":0.307,"15min":0.307},"max":{"1min":0.91100000000000003,"5min":1.423,"15min":1.423},"last":0.872}]},{"osd":3,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0860000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79100000000000004,"15min":0.77700000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.089,"5min":1.274,"15min":1.274},"last":1.228}]},{"osd":4,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92600000000000005,"15min":0.91000000000000003},"min":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1890000000000001,"5min":1.611,"15min":1.611},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0620000000000001,"5min":1.492,"15min":1.492},"last":1.01}]},{"osd":5,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.99399999999999999,"15min":1.0089999999999999},"min":{"1min":0.68300000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.224,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98199999999999998,"15min":0.97399999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2230000000000001,"5min":1.702,"15min":1.702},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.155,"5min":1.54,"15min":1.54},"last":1.171},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.036,"15min":1.05},"min":{"1min":0.66000000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.206,"5min":1.452,"15min":1.452},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.657,"15min":1.657},"last":1.081},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.091,"15min":1.089},"min":{"1min":0.73299999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.345,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0389999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":897024,"data_stored":371746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63900000000000001,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.90000000000000002,"5min":1.177,"15min":1.177},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.98699999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.879}]},{"osd":3,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.40300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1359999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.99399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.92800000000000005,"15min":0.90700000000000003},"min":{"1min":0.70699999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1279999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.92500000000000004,"15min":0.92400000000000004},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.76100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.92800000000000005,"15min":0.91600000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1819999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.347,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.01,"15min":0.996},"min":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.25,"5min":1.653,"15min":1.653},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.997,"15min":0.98899999999999999},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2629999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0860000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:28:48 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.048,"15min":1.042},"min":{"1min":0.748,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3779999999999999,"5min":1.458,"15min":1.458},"last":1.141},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0429999999999999,"15min":1.0129999999999999},"min":{"1min":0.67100000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3660000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.123}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36648,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335192,"statfs":{"total":96636764160,"available":96599236608,"internally_reserved":0,"allocated":1470464,"data_stored":959934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.998,"5min":1.147,"15min":1.147},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.244,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.68200000000000005,"15min":0.626},"min":{"1min":0.44,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1639999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.27300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3160000000000001,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.77200000000000002,"15min":0.73699999999999999},"min":{"1min":0.51800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2769999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"min":{"1min":0.64400000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2949999999999999,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.438},{"interface":"front","average":{"1min":0.998,"5min":0.996,"15min":0.998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4079999999999999,"5min":1.986,"15min":1.986},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.014,"15min":1.016},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8799999999999999,"5min":2.641,"15min":2.641},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.83399999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.343,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.095,"15min":1.083},"min":{"1min":0.66600000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.466,"5min":1.891,"15min":1.891},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.512,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:28:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.03,"15min":1.034},"min":{"1min":0.622,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4319999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.1220000000000001,"15min":1.1080000000000001},"min":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.724,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:29:31.077 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:29:31.078 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:29:31.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 Processor -- start 2024-09-13T18:29:31.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 -- start start 2024-09-13T18:29:31.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f74880cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74880b2bf0 0x7f74880cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74880ced50 0x7f74880b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880ccd60 con 0x7f74880ced50 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880cd830 con 0x7f74880b2bf0 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ed02640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880cc190 con 0x7f74880ccf10 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74880ced50 0x7f74880b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74880ced50 0x7f74880b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45768/0 (socket says 172.21.15.53:45768) 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 -- 172.21.15.53:0/853366917 learned_addr learned my addr 172.21.15.53:0/853366917 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f7487fff640 1 --2- 172.21.15.53:0/853366917 >> v2:172.21.15.87:3300/0 conn(0x7f74880b2bf0 0x7f74880cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ca9e640 1 --2- 172.21.15.53:0/853366917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f74880cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 -- 172.21.15.53:0/853366917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 msgr2=0x7f74880cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 --2- 172.21.15.53:0/853366917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f74880cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 -- 172.21.15.53:0/853366917 >> v2:172.21.15.87:3300/0 conn(0x7f74880b2bf0 msgr2=0x7f74880cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 --2- 172.21.15.53:0/853366917 >> v2:172.21.15.87:3300/0 conn(0x7f74880b2bf0 0x7f74880cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748d29f640 1 -- 172.21.15.53:0/853366917 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880ce270 con 0x7f74880ced50 2024-09-13T18:29:31.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f7487fff640 1 --2- 172.21.15.53:0/853366917 >> v2:172.21.15.87:3300/0 conn(0x7f74880b2bf0 0x7f74880cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.235+0000 7f748ca9e640 1 --2- 172.21.15.53:0/853366917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f74880cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748d29f640 1 --2- 172.21.15.53:0/853366917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f74880b33d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f7488067be0 tx=0x7f748001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f28c2bbfd86881 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f74877fe640 1 -- 172.21.15.53:0/853366917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800a57b0 con 0x7f74880ced50 2024-09-13T18:29:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f74877fe640 1 -- 172.21.15.53:0/853366917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74800a5910 con 0x7f74880ced50 2024-09-13T18:29:31.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f74877fe640 1 -- 172.21.15.53:0/853366917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800a5ca0 con 0x7f74880ced50 2024-09-13T18:29:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 -- 172.21.15.53:0/853366917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 msgr2=0x7f74880b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 --2- 172.21.15.53:0/853366917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f74880b33d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f7488067be0 tx=0x7f748001c930 comp rx=0 tx=0).stop 2024-09-13T18:29:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 -- 172.21.15.53:0/853366917 shutdown_connections 2024-09-13T18:29:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 --2- 172.21.15.53:0/853366917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f74880b33d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 --2- 172.21.15.53:0/853366917 >> v2:172.21.15.87:3300/0 conn(0x7f74880b2bf0 0x7f74880cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 --2- 172.21.15.53:0/853366917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f74880cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 -- 172.21.15.53:0/853366917 >> 172.21.15.53:0/853366917 conn(0x7f74880b20d0 msgr2=0x7f74880b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:31.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 -- 172.21.15.53:0/853366917 shutdown_connections 2024-09-13T18:29:31.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 -- 172.21.15.53:0/853366917 wait complete. 2024-09-13T18:29:31.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 Processor -- start 2024-09-13T18:29:31.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.239+0000 7f748ed02640 1 -- start start 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74880b2bf0 0x7f748806eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f7488151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f748809dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748806e650 con 0x7f74880ced50 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748806da40 con 0x7f74880b2bf0 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748806dd20 con 0x7f74880ccf10 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f748809dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f748809dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45782/0 (socket says 172.21.15.53:45782) 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 -- 172.21.15.53:0/1009143972 learned_addr learned my addr 172.21.15.53:0/1009143972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 -- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 msgr2=0x7f7488151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f7488151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 -- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74880b2bf0 msgr2=0x7f748806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ca9e640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74880b2bf0 0x7f748806eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74880b2bf0 0x7f748806eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 -- 172.21.15.53:0/1009143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7480009b30 con 0x7f74880ced50 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748d29f640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f748809dc00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f74800af040 tx=0x7f74800196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f74857fa640 1 -- 172.21.15.53:0/1009143972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800b8670 con 0x7f74880ced50 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f74857fa640 1 -- 172.21.15.53:0/1009143972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74800b87f0 con 0x7f74880ced50 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f74857fa640 1 -- 172.21.15.53:0/1009143972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800b8ba0 con 0x7f74880ced50 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74880b3ea0 con 0x7f74880ced50 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748806e2e0 con 0x7f74880ced50 2024-09-13T18:29:31.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748806e7c0 con 0x7f74880ced50 2024-09-13T18:29:31.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f74857fa640 1 -- 172.21.15.53:0/1009143972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f74800b8d00 con 0x7f74880ced50 2024-09-13T18:29:31.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f74857fa640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f74740669f0 0x7f7474068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f74857fa640 1 -- 172.21.15.53:0/1009143972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74801202b0 con 0x7f74880ced50 2024-09-13T18:29:31.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.243+0000 7f748ca9e640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f74740669f0 0x7f7474068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.247+0000 7f748ca9e640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f74740669f0 0x7f7474068eb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7478006fd0 tx=0x7f7478008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:31.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.247+0000 7f74857fa640 1 -- 172.21.15.53:0/1009143972 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74800ed3b0 con 0x7f74880ced50 2024-09-13T18:29:31.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.459+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f748815ec40 con 0x7f74880ced50 2024-09-13T18:29:31.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.467+0000 7f74857fa640 1 -- 172.21.15.53:0/1009143972 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f74800f09d0 con 0x7f74880ced50 2024-09-13T18:29:31.470 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f74740669f0 msgr2=0x7f7474068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f74740669f0 0x7f7474068eb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7478006fd0 tx=0x7f7478008040 comp rx=0 tx=0).stop 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 msgr2=0x7f748809dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f748809dc00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f74800af040 tx=0x7f74800196d0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 shutdown_connections 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f74740669f0 0x7f7474068eb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74880ccf10 0x7f7488151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74880ced50 0x7f748809dc00 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 --2- 172.21.15.53:0/1009143972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74880b2bf0 0x7f748806eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 >> 172.21.15.53:0/1009143972 conn(0x7f74880b20d0 msgr2=0x7f74880b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:31.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 shutdown_connections 2024-09-13T18:29:31.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.471+0000 7f748ed02640 1 -- 172.21.15.53:0/1009143972 wait complete. 2024-09-13T18:29:31.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:31.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.599+0000 7f646cce7640 1 Processor -- start 2024-09-13T18:29:31.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.599+0000 7f646cce7640 1 -- start start 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646cce7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f646815cab0 0x7f64680d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646cce7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f64680cf7d0 0x7f64680b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646cce7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64680d2400 con 0x7f64680cd6c0 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646cce7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64680d1530 con 0x7f646815cab0 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646cce7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64680d0920 con 0x7f64680cf7d0 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f646815cab0 0x7f64680d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f646815cab0 0x7f64680d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45798/0 (socket says 172.21.15.53:45798) 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 -- 172.21.15.53:0/2260056371 learned_addr learned my addr 172.21.15.53:0/2260056371 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f6466d9d640 1 --2- 172.21.15.53:0/2260056371 >> v2:172.21.15.87:3300/0 conn(0x7f64680cf7d0 0x7f64680b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 -- 172.21.15.53:0/2260056371 >> v2:172.21.15.87:3300/0 conn(0x7f64680cf7d0 msgr2=0x7f64680b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 --2- 172.21.15.53:0/2260056371 >> v2:172.21.15.87:3300/0 conn(0x7f64680cf7d0 0x7f64680b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 -- 172.21.15.53:0/2260056371 >> v1:172.21.15.87:6789/0 conn(0x7f64680cd6c0 legacy=0x7f64680cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:31.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 -- 172.21.15.53:0/2260056371 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64680d0c00 con 0x7f646815cab0 2024-09-13T18:29:31.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646659c640 1 --2- 172.21.15.53:0/2260056371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680d19c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f64680d14a0 tx=0x7f645801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5ca673a5f848f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:31.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646559a640 1 -- 172.21.15.53:0/2260056371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580aa610 con 0x7f646815cab0 2024-09-13T18:29:31.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646559a640 1 -- 172.21.15.53:0/2260056371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64580a6040 con 0x7f646815cab0 2024-09-13T18:29:31.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.603+0000 7f646559a640 1 -- 172.21.15.53:0/2260056371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580aa990 con 0x7f646815cab0 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- 172.21.15.53:0/2260056371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 msgr2=0x7f64680d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 --2- 172.21.15.53:0/2260056371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680d19c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f64680d14a0 tx=0x7f645801c4b0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- 172.21.15.53:0/2260056371 shutdown_connections 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 --2- 172.21.15.53:0/2260056371 >> v2:172.21.15.87:3300/0 conn(0x7f64680cf7d0 0x7f64680b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 --2- 172.21.15.53:0/2260056371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680d19c0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- 172.21.15.53:0/2260056371 >> 172.21.15.53:0/2260056371 conn(0x7f6468065c80 msgr2=0x7f6468066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- 172.21.15.53:0/2260056371 shutdown_connections 2024-09-13T18:29:31.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- 172.21.15.53:0/2260056371 wait complete. 2024-09-13T18:29:31.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 Processor -- start 2024-09-13T18:29:31.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- start start 2024-09-13T18:29:31.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64680cd6c0 0x7f6468152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64680cf7d0 0x7f646814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64680c9780 con 0x7f646815cab0 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64680c9a60 con 0x7f64680cd6c0 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64681530d0 con 0x7f64680cf7d0 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45812/0 (socket says 172.21.15.53:45812) 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 -- 172.21.15.53:0/212934374 learned_addr learned my addr 172.21.15.53:0/212934374 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6465d9b640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64680cf7d0 0x7f646814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646659c640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64680cd6c0 0x7f6468152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 -- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64680cf7d0 msgr2=0x7f646814f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64680cf7d0 0x7f646814f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 -- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64680cd6c0 msgr2=0x7f6468152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64680cd6c0 0x7f6468152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 -- 172.21.15.53:0/212934374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580094d0 con 0x7f646815cab0 2024-09-13T18:29:31.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6466d9d640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680b6a60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6460007de0 tx=0x7f646000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:31.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6456ffd640 1 -- 172.21.15.53:0/212934374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460014620 con 0x7f646815cab0 2024-09-13T18:29:31.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6456ffd640 1 -- 172.21.15.53:0/212934374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646000ee90 con 0x7f646815cab0 2024-09-13T18:29:31.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646814f040 con 0x7f646815cab0 2024-09-13T18:29:31.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f6456ffd640 1 -- 172.21.15.53:0/212934374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600149e0 con 0x7f646815cab0 2024-09-13T18:29:31.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.607+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646814f600 con 0x7f646815cab0 2024-09-13T18:29:31.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.611+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64680c9ba0 con 0x7f646815cab0 2024-09-13T18:29:31.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.611+0000 7f6456ffd640 1 -- 172.21.15.53:0/212934374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f6460014b40 con 0x7f646815cab0 2024-09-13T18:29:31.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.611+0000 7f6456ffd640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f64480669f0 0x7f6448068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:31.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.611+0000 7f6456ffd640 1 -- 172.21.15.53:0/212934374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6460085050 con 0x7f646815cab0 2024-09-13T18:29:31.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.611+0000 7f646659c640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f64480669f0 0x7f6448068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:31.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.611+0000 7f646659c640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f64480669f0 0x7f6448068eb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f64580ae000 tx=0x7f64580a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:31.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.615+0000 7f6456ffd640 1 -- 172.21.15.53:0/212934374 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f64680c9ba0 con 0x7f646815cab0 2024-09-13T18:29:31.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64680c9ba0 con 0x7f646815cab0 2024-09-13T18:29:31.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f6456ffd640 1 -- 172.21.15.53:0/212934374 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4727 (secure 0 0 0) 0x7f64680c9ba0 con 0x7f646815cab0 2024-09-13T18:29:31.809 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:31.809 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:29:31.809 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2024-09-13T18:29:31.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f64480669f0 msgr2=0x7f6448068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f64480669f0 0x7f6448068eb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f64580ae000 tx=0x7f64580a7000 comp rx=0 tx=0).stop 2024-09-13T18:29:31.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 msgr2=0x7f64680b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:31.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680b6a60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6460007de0 tx=0x7f646000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 shutdown_connections 2024-09-13T18:29:31.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f64480669f0 0x7f6448068eb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64680cf7d0 0x7f646814f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f646815cab0 0x7f64680b6a60 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 --2- 172.21.15.53:0/212934374 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64680cd6c0 0x7f6468152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:31.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 >> 172.21.15.53:0/212934374 conn(0x7f6468065c80 msgr2=0x7f6468153830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:31.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 shutdown_connections 2024-09-13T18:29:31.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:31.807+0000 7f646cce7640 1 -- 172.21.15.53:0/212934374 wait complete. 2024-09-13T18:29:32.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:29:22.170352+0000', 'modified': '2024-09-13T18:29:25.187357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6861': {'gid': 6861, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/1161349159', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 1161349159}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 1161349159}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:29:32.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:29:32.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:29:32.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.363+0000 7fa69f077640 1 Processor -- start 2024-09-13T18:29:32.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.363+0000 7fa69f077640 1 -- start start 2024-09-13T18:29:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69f077640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa69815b7c0 0x7fa698070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69f077640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69806d480 con 0x7fa6980711d0 2024-09-13T18:29:32.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69f077640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69815ace0 con 0x7fa6981582a0 2024-09-13T18:29:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69f077640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa698071680 con 0x7fa69815b7c0 2024-09-13T18:29:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69d614640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa6980711d0 0x7fa6981640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36134/0 (socket says 172.21.15.53:36134) 2024-09-13T18:29:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69d614640 1 -- 172.21.15.53:0/3624683419 learned_addr learned my addr 172.21.15.53:0/3624683419 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa697fff640 1 --2- 172.21.15.53:0/3624683419 >> v2:172.21.15.87:3300/0 conn(0x7fa69815b7c0 0x7fa698070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395759788 0 0) 0x7fa69806d480 con 0x7fa6980711d0 2024-09-13T18:29:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa680003530 con 0x7fa6980711d0 2024-09-13T18:29:32.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917303770 0 0) 0x7fa680003530 con 0x7fa6980711d0 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 >> v2:172.21.15.87:3300/0 conn(0x7fa69815b7c0 msgr2=0x7fa698070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 --2- 172.21.15.53:0/3624683419 >> v2:172.21.15.87:3300/0 conn(0x7fa69815b7c0 0x7fa698070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 >> v1:172.21.15.87:6789/0 conn(0x7fa6981582a0 legacy=0x7fa69806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69815afc0 con 0x7fa6980711d0 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa690001a00 con 0x7fa6980711d0 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 >> v1:172.21.15.53:6789/0 conn(0x7fa6980711d0 legacy=0x7fa6981640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa680003980 0x7fa680003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6800047d0 0x7fa680004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680005190 0x7fa68000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa698071680 con 0x7fa6800047d0 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000c030 con 0x7fa680005190 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68000c1f0 con 0x7fa680003980 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa697fff640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6800047d0 0x7fa680004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69ce13640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa680003980 0x7fa680003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69d614640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680005190 0x7fa68000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa697fff640 1 -- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa680003980 msgr2=0x7fa680003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa697fff640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa680003980 0x7fa680003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa697fff640 1 -- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680005190 msgr2=0x7fa68000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa697fff640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680005190 0x7fa68000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa697fff640 1 -- 172.21.15.53:0/3624683419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680003530 con 0x7fa6800047d0 2024-09-13T18:29:32.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.367+0000 7fa69d614640 1 -- 172.21.15.53:0/3624683419 reap_dead start 2024-09-13T18:29:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa697fff640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6800047d0 0x7fa680004c50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009ae0 tx=0x7fa68c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc97f2cf452f2d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0a5550 con 0x7fa6800047d0 2024-09-13T18:29:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c0a56b0 con 0x7fa6800047d0 2024-09-13T18:29:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa6977fe640 1 -- 172.21.15.53:0/3624683419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0a5a60 con 0x7fa6800047d0 2024-09-13T18:29:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 -- 172.21.15.53:0/3624683419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6800047d0 msgr2=0x7fa680004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6800047d0 0x7fa680004c50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009ae0 tx=0x7fa68c01ca70 comp rx=0 tx=0).stop 2024-09-13T18:29:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 -- 172.21.15.53:0/3624683419 shutdown_connections 2024-09-13T18:29:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 --2- 172.21.15.53:0/3624683419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6800047d0 0x7fa680004c50 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 -- 172.21.15.53:0/3624683419 >> 172.21.15.53:0/3624683419 conn(0x7fa698065c80 msgr2=0x7fa698066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 -- 172.21.15.53:0/3624683419 shutdown_connections 2024-09-13T18:29:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 -- 172.21.15.53:0/3624683419 wait complete. 2024-09-13T18:29:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 Processor -- start 2024-09-13T18:29:32.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.371+0000 7fa69f077640 1 -- start start 2024-09-13T18:29:32.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69813f330 0x7fa6981415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa698153300 0x7fa69813fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa69806f5e0 0x7fa69806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69806ffd0 con 0x7fa698153300 2024-09-13T18:29:32.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa698140500 con 0x7fa69813f330 2024-09-13T18:29:32.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981407e0 con 0x7fa69806f5e0 2024-09-13T18:29:32.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa698153300 0x7fa69813fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa698153300 0x7fa69813fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45836/0 (socket says 172.21.15.53:45836) 2024-09-13T18:29:32.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 -- 172.21.15.53:0/862587615 learned_addr learned my addr 172.21.15.53:0/862587615 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:32.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69d614640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa69806f5e0 0x7fa69806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69ce13640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69813f330 0x7fa6981415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 -- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa69806f5e0 msgr2=0x7fa69806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa69806f5e0 0x7fa69806fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 -- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69813f330 msgr2=0x7fa6981415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69813f330 0x7fa6981415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 -- 172.21.15.53:0/862587615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa698140ac0 con 0x7fa698153300 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69ce13640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69813f330 0x7fa6981415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:32.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69d614640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa69806f5e0 0x7fa69806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa697fff640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa698153300 0x7fa69813fb90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0b0040 tx=0x7fa68c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa6957fa640 1 -- 172.21.15.53:0/862587615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0bd070 con 0x7fa698153300 2024-09-13T18:29:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa6957fa640 1 -- 172.21.15.53:0/862587615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c0b8450 con 0x7fa698153300 2024-09-13T18:29:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa6957fa640 1 -- 172.21.15.53:0/862587615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0b8800 con 0x7fa698153300 2024-09-13T18:29:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa698140da0 con 0x7fa698153300 2024-09-13T18:29:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69813f710 con 0x7fa698153300 2024-09-13T18:29:32.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.375+0000 7fa6957fa640 1 -- 172.21.15.53:0/862587615 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fa68c0b4070 con 0x7fa698153300 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6957fa640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6840669f0 0x7fa684068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6957fa640 1 -- 172.21.15.53:0/862587615 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa68c11e520 con 0x7fa698153300 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6840669f0 0x7fa684068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 Processor -- start 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- start start 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40e261f0 0x563e40e265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 0x563e40ddc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40ddc740 0x563e40ddcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e40ca4e80 con 0x563e40e261f0 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e40c32af0 con 0x563e40ddc740 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e40c300c0 con 0x563e40e26b10 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6840669f0 0x7fa684068eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa688000c10 tx=0x7fa688009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40e261f0 0x563e40e265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40e261f0 0x563e40e265d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45846/0 (socket says 172.21.15.53:45846) 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 -- 172.21.15.53:0/2503399787 learned_addr learned my addr 172.21.15.53:0/2503399787 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa697fff640 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 0x563e40ddc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69d614640 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40ddc740 0x563e40ddcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 -- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 msgr2=0x563e40ddc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 0x563e40ddc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 -- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40ddc740 msgr2=0x563e40ddcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40ddc740 0x563e40ddcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 -- 172.21.15.53:0/2503399787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e40927890 con 0x563e40e261f0 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa69ce13640 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40e261f0 0x563e40e265d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa688001e90 tx=0x7fa688012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cab131234550f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa67e7fc640 1 -- 172.21.15.53:0/2503399787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880149a0 con 0x563e40e261f0 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa67e7fc640 1 -- 172.21.15.53:0/2503399787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800d050 con 0x563e40e261f0 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa67e7fc640 1 -- 172.21.15.53:0/2503399787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688014d00 con 0x563e40e261f0 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2503399787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40e261f0 msgr2=0x563e40e265d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40e261f0 0x563e40e265d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa688001e90 tx=0x7fa688012000 comp rx=0 tx=0).stop 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2503399787 shutdown_connections 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 0x563e40ddc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40ddc740 0x563e40ddcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2503399787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40e261f0 0x563e40e265d0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2503399787 >> 172.21.15.53:0/2503399787 conn(0x563e40de2fb0 msgr2=0x563e40de3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2503399787 shutdown_connections 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2503399787 wait complete. 2024-09-13T18:29:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 -- start start 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.379+0000 7fa6a21c0000 1 Processor -- start 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e25b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40de7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 0x563e40de84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e40c2b9b0 con 0x563e40ddc740 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e40bcac00 con 0x563e40e26b10 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e40be9070 con 0x563e40e261f0 2024-09-13T18:29:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 10 client.0 _ll_register_callbacks cb 0x563e40dc8ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e25b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e25b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45848/0 (socket says 172.21.15.53:45848) 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 -- 172.21.15.53:0/2946984494 learned_addr learned my addr 172.21.15.53:0/2946984494 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa697fff640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40de7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69d614640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 0x563e40de84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 -- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 msgr2=0x563e40de7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40de7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 -- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 msgr2=0x563e40de84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 0x563e40de84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 -- 172.21.15.53:0/2946984494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69815ace0 con 0x563e40ddc740 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa697fff640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40de7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa69ce13640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e25b00 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa688001ec0 tx=0x7fa6880011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46daf8b408914f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 1 -- 172.21.15.53:0/2946984494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688020ae0 con 0x563e40ddc740 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e40be85f0 con 0x563e40ddc740 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 1 -- 172.21.15.53:0/2946984494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa68801c040 con 0x563e40ddc740 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 1 -- 172.21.15.53:0/2946984494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa688020c40 con 0x563e40ddc740 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 10 client.7023 fetch_fsmap learned FSMap version 39 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x563e40bf0ab0 con 0x563e40ddc740 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 1 -- 172.21.15.53:0/2946984494 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e40be85f0 con 0x563e40ddc740 2024-09-13T18:29:32.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 1 -- 172.21.15.53:0/2946984494 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa688012070 con 0x563e40ddc740 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 10 client.7023 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 10 client.7023 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 20 client.7023 populate_metadata read hostname 'smithi053' 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40de9290 0x563e40e382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 4 client.7023 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 --> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e40c28790 con 0x563e40de9290 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa697fff640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40de9290 0x563e40e382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 10 client.7023 ms_handle_connect on v2:172.21.15.53:6834/1161349159 2024-09-13T18:29:32.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa697fff640 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40de9290 0x563e40e382a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7be26cbead56b3a server_cookie=7379d61639c724b3 in_seq=0 out_seq=0 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 1 -- 172.21.15.53:0/2946984494 <== mds.0 v2:172.21.15.53:6834/1161349159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563e40c28790 con 0x563e40de9290 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 10 client.7023 handle_command_reply: tid=0 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 client.7023 shutdown 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 msgr2=0x563e40e25b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e25b00 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa688001ec0 tx=0x7fa6880011a0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 shutdown_connections 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40de7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40de9290 0x563e40e382a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 0x563e40de84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/2946984494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e25b00 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 >> 172.21.15.53:0/2946984494 conn(0x563e40de2fb0 msgr2=0x563e40ddb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6777fe640 0 client.7023 ms_handle_reset on v2:172.21.15.53:6834/1161349159 2024-09-13T18:29:32.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 shutdown_connections 2024-09-13T18:29:32.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 1 -- 172.21.15.53:0/2946984494 wait complete. 2024-09-13T18:29:32.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.383+0000 7fa6a21c0000 20 client.7023 trim_cache size 0 max 16384 2024-09-13T18:29:32.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.399+0000 7fa6a21c0000 1 Processor -- start 2024-09-13T18:29:32.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.399+0000 7fa6a21c0000 1 -- start start 2024-09-13T18:29:32.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40de10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e261f0 0x563e40de1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 0x563e40de1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e40de05a0 con 0x563e40ddc740 2024-09-13T18:29:32.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e408e8940 con 0x563e40e261f0 2024-09-13T18:29:32.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e40bc8c10 con 0x563e40e26b10 2024-09-13T18:29:32.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40de10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40de10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45862/0 (socket says 172.21.15.53:45862) 2024-09-13T18:29:32.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/1628989036 learned_addr learned my addr 172.21.15.53:0/1628989036 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:32.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/1628989036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 msgr2=0x563e40de1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- 172.21.15.53:0/1628989036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 0x563e40de1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/1628989036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e261f0 msgr2=0x563e40de1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- 172.21.15.53:0/1628989036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e261f0 0x563e40de1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/1628989036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e40bd6c00 con 0x563e40ddc740 2024-09-13T18:29:32.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- 172.21.15.53:0/1628989036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40de10f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa688001e10 tx=0x7fa68802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea4fbf248a059df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa67effd640 1 -- 172.21.15.53:0/1628989036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68802a610 con 0x563e40ddc740 2024-09-13T18:29:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa67effd640 1 -- 172.21.15.53:0/1628989036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800d070 con 0x563e40ddc740 2024-09-13T18:29:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa67effd640 1 -- 172.21.15.53:0/1628989036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68802abd0 con 0x563e40ddc740 2024-09-13T18:29:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- 172.21.15.53:0/1628989036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 msgr2=0x563e40de10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/1628989036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40de10f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa688001e10 tx=0x7fa68802a000 comp rx=0 tx=0).stop 2024-09-13T18:29:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- 172.21.15.53:0/1628989036 shutdown_connections 2024-09-13T18:29:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/1628989036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e26b10 0x563e40de1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/1628989036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e261f0 0x563e40de1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/1628989036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40de10f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- 172.21.15.53:0/1628989036 >> 172.21.15.53:0/1628989036 conn(0x563e40de2fb0 msgr2=0x563e40e33770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- 172.21.15.53:0/1628989036 shutdown_connections 2024-09-13T18:29:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- 172.21.15.53:0/1628989036 wait complete. 2024-09-13T18:29:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- start start 2024-09-13T18:29:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 Processor -- start 2024-09-13T18:29:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e6ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40e3a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 0x563e40e3a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e40c2f9b0 con 0x563e40ddc740 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e40de0460 con 0x563e40e26b10 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e40c6e5f0 con 0x563e40e261f0 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 10 client.0 _ll_register_callbacks cb 0x7fa688017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e6ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e6ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45870/0 (socket says 172.21.15.53:45870) 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/4191169620 learned_addr learned my addr 172.21.15.53:0/4191169620 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/4191169620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 msgr2=0x563e40e3a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40e3a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/4191169620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 msgr2=0x563e40e3a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 0x563e40e3a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 -- 172.21.15.53:0/4191169620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e40bf0ab0 con 0x563e40ddc740 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa69ce13640 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e6ac40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa688009010 tx=0x7fa68800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f4ea2ba4a3acfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6777fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6777fe640 1 -- 172.21.15.53:0/4191169620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688020ae0 con 0x563e40ddc740 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6777fe640 1 -- 172.21.15.53:0/4191169620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa688020c40 con 0x563e40ddc740 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.403+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e40bfb460 con 0x563e40ddc740 2024-09-13T18:29:32.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6777fe640 1 -- 172.21.15.53:0/4191169620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa688020e00 con 0x563e40ddc740 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 10 client.7029 fetch_fsmap learned FSMap version 39 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x563e40927cc0 con 0x563e40ddc740 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6777fe640 1 -- 172.21.15.53:0/4191169620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e40bfb460 con 0x563e40ddc740 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6777fe640 1 -- 172.21.15.53:0/4191169620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa688012040 con 0x563e40ddc740 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 10 client.7029 fetch_fsmap finished waiting for FSMap version 39 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 10 client.7029 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 20 client.7029 populate_metadata read hostname 'smithi053' 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40e6b3d0 0x563e40e6b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 4 client.7029 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:29:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 --> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563e40bf49c0 con 0x563e40e6b3d0 2024-09-13T18:29:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa697fff640 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40e6b3d0 0x563e40e6b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6777fe640 10 client.7029 ms_handle_connect on v2:172.21.15.53:6834/1161349159 2024-09-13T18:29:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa697fff640 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40e6b3d0 0x563e40e6b7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4663774b3f0512e server_cookie=c13f5bddc8563d3d in_seq=0 out_seq=0 2024-09-13T18:29:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6777fe640 1 -- 172.21.15.53:0/4191169620 <== mds.0 v2:172.21.15.53:6834/1161349159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x563e40bf49c0 con 0x563e40e6b3d0 2024-09-13T18:29:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6777fe640 10 client.7029 handle_command_reply: tid=0 2024-09-13T18:29:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 client.7029 shutdown 2024-09-13T18:29:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 msgr2=0x563e40e6ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e6ac40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa688009010 tx=0x7fa68800a000 comp rx=0 tx=0).stop 2024-09-13T18:29:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 shutdown_connections 2024-09-13T18:29:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563e40e261f0 0x563e40e3a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:6834/1161349159,v1:172.21.15.53:6835/1161349159] conn(0x563e40e6b3d0 0x563e40e6b7b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563e40e26b10 0x563e40e3a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 --2- 172.21.15.53:0/4191169620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e40ddc740 0x563e40e6ac40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6777fe640 0 client.7029 ms_handle_reset on v2:172.21.15.53:6834/1161349159 2024-09-13T18:29:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 >> 172.21.15.53:0/4191169620 conn(0x563e40de2fb0 msgr2=0x563e40dda9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 shutdown_connections 2024-09-13T18:29:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 1 -- 172.21.15.53:0/4191169620 wait complete. 2024-09-13T18:29:32.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa6a21c0000 20 client.7029 trim_cache size 0 max 16384 2024-09-13T18:29:32.423 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:29:32.423 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:29:32.423 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:29:32.423 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6861, 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.235336626, 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 39, 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 72, 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 72, 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.60110323 2024-09-13T18:29:32.424 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:29:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6840669f0 msgr2=0x7fa684068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6840669f0 0x7fa684068eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa688000c10 tx=0x7fa688009040 comp rx=0 tx=0).stop 2024-09-13T18:29:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa698153300 msgr2=0x7fa69813fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa698153300 0x7fa69813fb90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0b0040 tx=0x7fa68c019810 comp rx=0 tx=0).stop 2024-09-13T18:29:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 shutdown_connections 2024-09-13T18:29:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa6840669f0 0x7fa684068eb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa69806f5e0 0x7fa69806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa698153300 0x7fa69813fb90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 --2- 172.21.15.53:0/862587615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa69813f330 0x7fa6981415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 >> 172.21.15.53:0/862587615 conn(0x7fa698065c80 msgr2=0x7fa69806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 shutdown_connections 2024-09-13T18:29:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.407+0000 7fa69f077640 1 -- 172.21.15.53:0/862587615 wait complete. 2024-09-13T18:29:32.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:29:32.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.535+0000 7f9807060640 1 Processor -- start 2024-09-13T18:29:32.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.535+0000 7f9807060640 1 -- start start 2024-09-13T18:29:32.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9807060640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98001582a0 0x7f980006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9807060640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 0x7f980006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9807060640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980006d480 con 0x7f980015b7c0 2024-09-13T18:29:32.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9807060640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980015aaf0 con 0x7f98001582a0 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9807060640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980006d760 con 0x7f98000713a0 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97fffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f980015b7c0 0x7f9800070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36150/0 (socket says 172.21.15.53:36150) 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97fffff640 1 -- 172.21.15.53:0/1608194312 learned_addr learned my addr 172.21.15.53:0/1608194312 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f98055fd640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 0x7f980006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9804dfc640 1 --2- 172.21.15.53:0/1608194312 >> v2:172.21.15.87:3300/0 conn(0x7f98001582a0 0x7f980006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464496271 0 0) 0x7f980006d480 con 0x7f980015b7c0 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e8003530 con 0x7f980015b7c0 2024-09-13T18:29:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312939315 0 0) 0x7f97e8003530 con 0x7f980015b7c0 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 msgr2=0x7f980006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 0x7f980006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 >> v2:172.21.15.87:3300/0 conn(0x7f98001582a0 msgr2=0x7f980006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 --2- 172.21.15.53:0/1608194312 >> v2:172.21.15.87:3300/0 conn(0x7f98001582a0 0x7f980006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980015ace0 con 0x7f980015b7c0 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f97f4001680 con 0x7f980015b7c0 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 >> v1:172.21.15.53:6789/0 conn(0x7f980015b7c0 legacy=0x7f9800070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f97e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80047d0 0x7f97e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 0x7f97e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e800b990 con 0x7f97e8003980 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e800bad0 con 0x7f97e80047d0 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e800bc10 con 0x7f98000713a0 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9804dfc640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f97e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f97fffff640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80047d0 0x7f97e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f98055fd640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 0x7f97e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9804dfc640 1 -- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 msgr2=0x7f97e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9804dfc640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f98000713a0 0x7f97e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9804dfc640 1 -- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80047d0 msgr2=0x7f97e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9804dfc640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97e80047d0 0x7f97e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.539+0000 7f9804dfc640 1 -- 172.21.15.53:0/1608194312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e8003530 con 0x7f97e8003980 2024-09-13T18:29:32.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9804dfc640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f97e8003da0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009ae0 tx=0x7f97f001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af55b7288b836c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00a6490 con 0x7f97e8003980 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f00a65f0 con 0x7f97e8003980 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f97ff7fe640 1 -- 172.21.15.53:0/1608194312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00a69a0 con 0x7f97e8003980 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- 172.21.15.53:0/1608194312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 msgr2=0x7f97e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 --2- 172.21.15.53:0/1608194312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f97e8003da0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009ae0 tx=0x7f97f001ca80 comp rx=0 tx=0).stop 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f98055fd640 1 -- 172.21.15.53:0/1608194312 reap_dead start 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- 172.21.15.53:0/1608194312 shutdown_connections 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- 172.21.15.53:0/1608194312 >> 172.21.15.53:0/1608194312 conn(0x7f9800065c80 msgr2=0x7f9800066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- 172.21.15.53:0/1608194312 shutdown_connections 2024-09-13T18:29:32.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- 172.21.15.53:0/1608194312 wait complete. 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 Processor -- start 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- start start 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f9800147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9800146910 0x7f98001487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9800146d90 0x7f98000ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800149100 con 0x7f97e8003980 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98001493e0 con 0x7f9800146910 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9807060640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98001496c0 con 0x7f9800146d90 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9804dfc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f9800147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9804dfc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f9800147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45886/0 (socket says 172.21.15.53:45886) 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f9804dfc640 1 -- 172.21.15.53:0/2653257376 learned_addr learned my addr 172.21.15.53:0/2653257376 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f97fffff640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9800146910 0x7f98001487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.543+0000 7f98055fd640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9800146d90 0x7f98000ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9804dfc640 1 -- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9800146d90 msgr2=0x7f98000ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9804dfc640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9800146d90 0x7f98000ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9804dfc640 1 -- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9800146910 msgr2=0x7f98001487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9804dfc640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9800146910 0x7f98001487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9804dfc640 1 -- 172.21.15.53:0/2653257376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98001499a0 con 0x7f97e8003980 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9804dfc640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f9800147590 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009ae0 tx=0x7f97e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fd7fa640 1 -- 172.21.15.53:0/2653257376 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000f000 con 0x7f97e8003980 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fd7fa640 1 -- 172.21.15.53:0/2653257376 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f00a7470 con 0x7f97e8003980 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9800149c80 con 0x7f97e8003980 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fd7fa640 1 -- 172.21.15.53:0/2653257376 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00a77e0 con 0x7f97e8003980 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9800148ec0 con 0x7f97e8003980 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9800067400 con 0x7f97e8003980 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fd7fa640 1 -- 172.21.15.53:0/2653257376 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f97f00a7940 con 0x7f97e8003980 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fd7fa640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97ec0669f0 0x7f97ec068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fd7fa640 1 -- 172.21.15.53:0/2653257376 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97f011ea70 con 0x7f97e8003980 2024-09-13T18:29:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fffff640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97ec0669f0 0x7f97ec068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.547+0000 7f97fffff640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97ec0669f0 0x7f97ec068eb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f97f4001060 tx=0x7f97f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.551+0000 7f97fd7fa640 1 -- 172.21.15.53:0/2653257376 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f97f00eb950 con 0x7f97e8003980 2024-09-13T18:29:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.739+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9800148ec0 con 0x7f97e8003980 2024-09-13T18:29:32.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f97fd7fa640 1 -- 172.21.15.53:0/2653257376 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9800148ec0 con 0x7f97e8003980 2024-09-13T18:29:32.743 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97ec0669f0 msgr2=0x7f97ec068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97ec0669f0 0x7f97ec068eb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f97f4001060 tx=0x7f97f4009040 comp rx=0 tx=0).stop 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 msgr2=0x7f9800147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f9800147590 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009ae0 tx=0x7f97e8005800 comp rx=0 tx=0).stop 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 shutdown_connections 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97ec0669f0 0x7f97ec068eb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9800146d90 0x7f98000ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9800146910 0x7f98001487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 --2- 172.21.15.53:0/2653257376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97e8003980 0x7f9800147590 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 >> 172.21.15.53:0/2653257376 conn(0x7f9800065c80 msgr2=0x7f98001536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 shutdown_connections 2024-09-13T18:29:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:32.743+0000 7f9807060640 1 -- 172.21.15.53:0/2653257376 wait complete. 2024-09-13T18:29:32.761 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:29:32.761 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:29:32.761 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:29:32.761 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:29:32.761 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:32.761 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:29:32.762 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:29:32.762 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:29:32.762 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:29:32.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:32.762 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:29:32.768 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:29:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:29:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:29:32.768 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42224sec preferred_lft 42224sec 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:29:32.769 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:29:32.770 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:29:32.771 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:29:32.772 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:32.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:32.772 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:29:32.820 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:29:32.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:32.822 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:29:32.869 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:29:32.869 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:29:32.869 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:29:32.869 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:29:32.870 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:29:32.870 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:29:32.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:32.870 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:29:32.870 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:29:32.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:29:32.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:29:32.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:29:32.870 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:29:32.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:32.945 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:29:32.993 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:29:32.993 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:29:32.993 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:29:32.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:32.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:29:33.049 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:29:33.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:29:33.050 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:33.096 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:29:33.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:29:33.097 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:33.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:29:33.205 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:33.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:33.261 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:33.262 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:33.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:33.262 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:29:33.308 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:29:33.308 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:29:33.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:29:33.368 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:33.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:33.423 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:33.424 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:33.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:33.424 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:29:33.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:29:33.431+0000 7f7608128580 -1 init, newargv = 0x560ecd2c88e0 newargc=15 2024-09-13T18:29:33.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[45085]: starting ceph client 2024-09-13T18:29:33.437 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[45085]: starting fuse 2024-09-13T18:29:34.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:29:34.553 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:34.554 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:34.607 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:34.608 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:34.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:34.609 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:29:34.660 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:29:34.661 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:29:34.661 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:29:34.662 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:29:34.663 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:29:34.663 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:29:34.663 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:29:34.663 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:29:34.663 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:29:34.783 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.45085.asok 2024-09-13T18:29:34.965 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45085.asok 2024-09-13T18:29:34.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:34.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45085.asok status 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:29:35.127 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "45085", 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 7041, 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 7041 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:35.128 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2821103288 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2821103288 2024-09-13T18:29:35.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.7041 192.168.0.1:0/2821103288", 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/2821103288", 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 39, 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 72, 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:29:35.130 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:29:35.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.141 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:29:35.141 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:35.147 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:29:35.147 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:35.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:35.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:29:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7faa19a640 1 Processor -- start 2024-09-13T18:29:35.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7faa19a640 1 -- start start 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7faa19a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7fa41582a0 0x7f7fa406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7faa19a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fa415b7c0 0x7f7fa406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7faa19a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa406d480 con 0x7f7fa4070c90 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7faa19a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa415aaf0 con 0x7f7fa415b7c0 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7faa19a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa406d760 con 0x7f7fa41582a0 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fa415b7c0 0x7f7fa406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fa415b7c0 0x7f7fa406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45896/0 (socket says 172.21.15.53:45896) 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa2ffd640 1 -- 172.21.15.53:0/1317732238 learned_addr learned my addr 172.21.15.53:0/1317732238 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa37fe640 1 --2- 172.21.15.53:0/1317732238 >> v2:172.21.15.87:3300/0 conn(0x7f7fa41582a0 0x7f7fa406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa2ffd640 1 -- 172.21.15.53:0/1317732238 >> v2:172.21.15.87:3300/0 conn(0x7f7fa41582a0 msgr2=0x7f7fa406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa2ffd640 1 --2- 172.21.15.53:0/1317732238 >> v2:172.21.15.87:3300/0 conn(0x7f7fa41582a0 0x7f7fa406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa2ffd640 1 -- 172.21.15.53:0/1317732238 >> v1:172.21.15.87:6789/0 conn(0x7f7fa4070c90 legacy=0x7f7fa406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:35.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.375+0000 7f7fa2ffd640 1 -- 172.21.15.53:0/1317732238 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa415ace0 con 0x7f7fa415b7c0 2024-09-13T18:29:35.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa2ffd640 1 --2- 172.21.15.53:0/1317732238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa415b7c0 0x7f7fa406ce40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4069f50 tx=0x7f7f8c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d189b8f58b787ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:35.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa27fc640 1 -- 172.21.15.53:0/1317732238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0ab5f0 con 0x7f7fa415b7c0 2024-09-13T18:29:35.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa27fc640 1 -- 172.21.15.53:0/1317732238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c0ab750 con 0x7f7fa415b7c0 2024-09-13T18:29:35.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa27fc640 1 -- 172.21.15.53:0/1317732238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0abae0 con 0x7f7fa415b7c0 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- 172.21.15.53:0/1317732238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa415b7c0 msgr2=0x7f7fa406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 --2- 172.21.15.53:0/1317732238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa415b7c0 0x7f7fa406ce40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4069f50 tx=0x7f7f8c01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- 172.21.15.53:0/1317732238 shutdown_connections 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 --2- 172.21.15.53:0/1317732238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa415b7c0 0x7f7fa406ce40 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 --2- 172.21.15.53:0/1317732238 >> v2:172.21.15.87:3300/0 conn(0x7f7fa41582a0 0x7f7fa406c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- 172.21.15.53:0/1317732238 >> 172.21.15.53:0/1317732238 conn(0x7f7fa4065c80 msgr2=0x7f7fa4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- 172.21.15.53:0/1317732238 shutdown_connections 2024-09-13T18:29:35.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- 172.21.15.53:0/1317732238 wait complete. 2024-09-13T18:29:35.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 Processor -- start 2024-09-13T18:29:35.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- start start 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa4070c90 0x7f7fa4156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fa41582a0 0x7f7fa413b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fa415b7c0 0x7f7fa413aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa41530b0 con 0x7f7fa4070c90 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa414b310 con 0x7f7fa415b7c0 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7faa19a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4152430 con 0x7f7fa41582a0 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa4070c90 0x7f7fa4156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa4070c90 0x7f7fa4156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45908/0 (socket says 172.21.15.53:45908) 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 -- 172.21.15.53:0/3199564599 learned_addr learned my addr 172.21.15.53:0/3199564599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa2ffd640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fa41582a0 0x7f7fa413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa3fff640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fa415b7c0 0x7f7fa413aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:35.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 -- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fa41582a0 msgr2=0x7f7fa413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fa41582a0 0x7f7fa413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 -- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fa415b7c0 msgr2=0x7f7fa413aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fa415b7c0 0x7f7fa413aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 -- 172.21.15.53:0/3199564599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0094d0 con 0x7f7fa4070c90 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.379+0000 7f7fa37fe640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa4070c90 0x7f7fa4156680 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007ef0 tx=0x7f7f9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7f9bfff640 1 -- 172.21.15.53:0/3199564599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94014620 con 0x7f7fa4070c90 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7f9bfff640 1 -- 172.21.15.53:0/3199564599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9400ee90 con 0x7f7fa4070c90 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa4152710 con 0x7f7fa4070c90 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7f9bfff640 1 -- 172.21.15.53:0/3199564599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f940149c0 con 0x7f7fa4070c90 2024-09-13T18:29:35.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa4152cd0 con 0x7f7fa4070c90 2024-09-13T18:29:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa4067400 con 0x7f7fa4070c90 2024-09-13T18:29:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7f9bfff640 1 -- 172.21.15.53:0/3199564599 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f7f94014b20 con 0x7f7fa4070c90 2024-09-13T18:29:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7f9bfff640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f840669f0 0x7f7f84068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7f9bfff640 1 -- 172.21.15.53:0/3199564599 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f94085040 con 0x7f7fa4070c90 2024-09-13T18:29:35.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7fa2ffd640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f840669f0 0x7f7f84068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:35.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.383+0000 7f7fa2ffd640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f840669f0 0x7f7f84068eb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0af000 tx=0x7f7f8c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:35.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.387+0000 7f7f9bfff640 1 -- 172.21.15.53:0/3199564599 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f940b6db0 con 0x7f7fa4070c90 2024-09-13T18:29:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7fa406f370 con 0x7f7fa4070c90 2024-09-13T18:29:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7f9bfff640 1 -- 172.21.15.53:0/3199564599 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7f94052030 con 0x7f7fa4070c90 2024-09-13T18:29:35.585 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f840669f0 msgr2=0x7f7f84068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f840669f0 0x7f7f84068eb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0af000 tx=0x7f7f8c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa4070c90 msgr2=0x7f7fa4156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa4070c90 0x7f7fa4156680 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007ef0 tx=0x7f7f9400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 shutdown_connections 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f7f840669f0 0x7f7f84068eb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fa41582a0 0x7f7fa413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fa415b7c0 0x7f7fa413aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 --2- 172.21.15.53:0/3199564599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fa4070c90 0x7f7fa4156680 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 >> 172.21.15.53:0/3199564599 conn(0x7f7fa4065c80 msgr2=0x7f7fa40af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 shutdown_connections 2024-09-13T18:29:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:35.583+0000 7f7faa19a640 1 -- 172.21.15.53:0/3199564599 wait complete. 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:29:35.602 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:29:35.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.602 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:29:35.609 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:29:35.609 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:29:35.609 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:29:35.610 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42227sec preferred_lft 42227sec 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:29:35.611 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:29:35.612 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:29:35.612 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.612 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:29:35.612 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:29:35.612 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:29:35.612 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:29:35.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.612 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:29:35.664 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:29:35.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.665 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:29:35.717 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:29:35.717 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:29:35.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.719 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:29:35.719 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:29:35.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:29:35.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:29:35.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:29:35.719 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:29:35.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.796 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:29:35.845 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:29:35.845 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:29:35.845 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:29:35.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:35.846 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:29:35.906 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:29:35.906 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:29:35.906 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:35.953 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:29:35.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:29:35.953 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:36.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:29:36.058 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:36.058 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:36.115 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:36.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:36.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:36.117 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:29:36.164 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:29:36.165 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:29:36.210 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:29:36.224 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:36.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:36.279 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:36.280 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:36.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:36.280 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:29:36.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:29:36.286+0000 7f960930d580 -1 init, newargv = 0x561704b08390 newargc=15 2024-09-13T18:29:36.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35721]: starting ceph client 2024-09-13T18:29:36.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35721]: starting fuse 2024-09-13T18:29:37.396 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:29:37.411 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:29:37.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:29:37.465 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:29:37.466 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:29:37.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:37.466 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:29:37.514 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:29:38.016 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:29:38.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:29:38.016 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:29:38.016 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:29:38.016 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:29:38.016 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:29:38.016 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:29:38.017 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:29:38.018 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:29:38.018 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:29:38.018 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:29:38.018 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:29:38.018 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:29:38.018 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:29:38.018 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:29:38.097 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.35721.asok 2024-09-13T18:29:38.280 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35721.asok 2024-09-13T18:29:38.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:38.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35721.asok status 2024-09-13T18:29:38.436 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:29:38.436 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:29:38.436 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:29:38.436 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35721", 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5801, 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:29:38.437 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 5801 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 762326728 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 762326728 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.5801 192.168.0.1:0/762326728", 2024-09-13T18:29:38.438 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/762326728", 2024-09-13T18:29:38.439 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:29:38.439 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 39, 2024-09-13T18:29:38.439 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 72, 2024-09-13T18:29:38.439 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:29:38.439 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:29:38.439 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:29:38.439 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:29:38.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:38.449 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:29:38.449 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:38.455 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:29:38.456 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:38.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:38.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:38.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:29:38.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc50b7d4640 1 Processor -- start 2024-09-13T18:29:38.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc50b7d4640 1 -- start start 2024-09-13T18:29:38.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc50b7d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5040cd6f0 0x7fc5040b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:38.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc50b7d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cdad0 0x7fc504143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:38.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc50b7d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5040b3020 con 0x7fc504143d50 2024-09-13T18:29:38.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc50b7d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5040b1f80 con 0x7fc5040cd6f0 2024-09-13T18:29:38.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc50b7d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040b2260 con 0x7fc5040cdad0 2024-09-13T18:29:38.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc509570640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5040cd6f0 0x7fc5040b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:38.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc509570640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5040cd6f0 0x7fc5040b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57104/0 (socket says 172.21.15.53:57104) 2024-09-13T18:29:38.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc508d6f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cdad0 0x7fc504143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:38.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc509570640 1 -- 172.21.15.53:0/3025453903 learned_addr learned my addr 172.21.15.53:0/3025453903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:38.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc509570640 1 -- 172.21.15.53:0/3025453903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cdad0 msgr2=0x7fc504143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:38.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc509570640 1 --2- 172.21.15.53:0/3025453903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cdad0 0x7fc504143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:38.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc509570640 1 -- 172.21.15.53:0/3025453903 >> v1:172.21.15.87:6789/0 conn(0x7fc504143d50 legacy=0x7fc50415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:38.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.651+0000 7fc509570640 1 -- 172.21.15.53:0/3025453903 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5040b2540 con 0x7fc5040cd6f0 2024-09-13T18:29:38.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc509570640 1 --2- 172.21.15.53:0/3025453903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cd6f0 0x7fc5040b1490 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc500009870 tx=0x7fc50001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f94cc8645ac546d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:38.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc4fbfff640 1 -- 172.21.15.53:0/3025453903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000ad660 con 0x7fc5040cd6f0 2024-09-13T18:29:38.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc4fbfff640 1 -- 172.21.15.53:0/3025453903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5000ad7c0 con 0x7fc5040cd6f0 2024-09-13T18:29:38.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc4fbfff640 1 -- 172.21.15.53:0/3025453903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000adb50 con 0x7fc5040cd6f0 2024-09-13T18:29:38.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3025453903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cd6f0 msgr2=0x7fc5040b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:38.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3025453903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cd6f0 0x7fc5040b1490 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc500009870 tx=0x7fc50001c530 comp rx=0 tx=0).stop 2024-09-13T18:29:38.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3025453903 shutdown_connections 2024-09-13T18:29:38.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3025453903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cdad0 0x7fc504143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:38.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3025453903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cd6f0 0x7fc5040b1490 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:38.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3025453903 >> 172.21.15.53:0/3025453903 conn(0x7fc504073330 msgr2=0x7fc504065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:38.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3025453903 shutdown_connections 2024-09-13T18:29:38.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.655+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3025453903 wait complete. 2024-09-13T18:29:38.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 Processor -- start 2024-09-13T18:29:38.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 -- start start 2024-09-13T18:29:38.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cd6f0 0x7fc50415fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:38.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cdad0 0x7fc50415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:38.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc504143d50 0x7fc5041610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:38.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504161b10 con 0x7fc5040cdad0 2024-09-13T18:29:38.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50415f070 con 0x7fc504143d50 2024-09-13T18:29:38.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50415f350 con 0x7fc5040cd6f0 2024-09-13T18:29:38.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cdad0 0x7fc50415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:38.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cdad0 0x7fc50415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57120/0 (socket says 172.21.15.53:57120) 2024-09-13T18:29:38.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 -- 172.21.15.53:0/3498044433 learned_addr learned my addr 172.21.15.53:0/3498044433 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:38.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc509570640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cd6f0 0x7fc50415fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:38.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc509d71640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc504143d50 0x7fc5041610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:38.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 -- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cd6f0 msgr2=0x7fc50415fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:38.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cd6f0 0x7fc50415fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:38.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 -- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc504143d50 msgr2=0x7fc5041610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:38.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc504143d50 0x7fc5041610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:38.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 -- 172.21.15.53:0/3498044433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000094d0 con 0x7fc5040cdad0 2024-09-13T18:29:38.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc509d71640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc504143d50 0x7fc5041610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:38.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc508d6f640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cdad0 0x7fc50415cff0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400e870 tx=0x7fc4f400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:38.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc4f9ffb640 1 -- 172.21.15.53:0/3498044433 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4009510 con 0x7fc5040cdad0 2024-09-13T18:29:38.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc4f9ffb640 1 -- 172.21.15.53:0/3498044433 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f400eec0 con 0x7fc5040cdad0 2024-09-13T18:29:38.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc4f9ffb640 1 -- 172.21.15.53:0/3498044433 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400cb40 con 0x7fc5040cdad0 2024-09-13T18:29:38.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50415f630 con 0x7fc5040cdad0 2024-09-13T18:29:38.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50415d530 con 0x7fc5040cdad0 2024-09-13T18:29:38.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5040b1490 con 0x7fc5040cdad0 2024-09-13T18:29:38.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.659+0000 7fc4f9ffb640 1 -- 172.21.15.53:0/3498044433 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fc4f400cca0 con 0x7fc5040cdad0 2024-09-13T18:29:38.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.663+0000 7fc4f9ffb640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4e80669f0 0x7fc4e8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:38.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.663+0000 7fc4f9ffb640 1 -- 172.21.15.53:0/3498044433 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4f4084710 con 0x7fc5040cdad0 2024-09-13T18:29:38.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.663+0000 7fc509570640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4e80669f0 0x7fc4e8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:38.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.663+0000 7fc509570640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4e80669f0 0x7fc4e8068eb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc5000af000 tx=0x7fc500008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:38.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.667+0000 7fc4f9ffb640 1 -- 172.21.15.53:0/3498044433 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4f40517a0 con 0x7fc5040cdad0 2024-09-13T18:29:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:38.863+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5040af2e0 con 0x7fc5040cdad0 2024-09-13T18:29:39.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.263+0000 7fc4f9ffb640 1 -- 172.21.15.53:0/3498044433 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 136+0+0 (secure 0 0 0) 0x7fc4f4054dc0 con 0x7fc5040cdad0 2024-09-13T18:29:39.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4e80669f0 msgr2=0x7fc4e8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4e80669f0 0x7fc4e8068eb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc5000af000 tx=0x7fc500008040 comp rx=0 tx=0).stop 2024-09-13T18:29:39.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cdad0 msgr2=0x7fc50415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cdad0 0x7fc50415cff0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400e870 tx=0x7fc4f400ec70 comp rx=0 tx=0).stop 2024-09-13T18:29:39.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 shutdown_connections 2024-09-13T18:29:39.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fc4e80669f0 0x7fc4e8068eb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc504143d50 0x7fc5041610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5040cdad0 0x7fc50415cff0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 --2- 172.21.15.53:0/3498044433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5040cd6f0 0x7fc50415fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 >> 172.21.15.53:0/3498044433 conn(0x7fc504073330 msgr2=0x7fc5040b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:39.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 shutdown_connections 2024-09-13T18:29:39.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.267+0000 7fc50b7d4640 1 -- 172.21.15.53:0/3498044433 wait complete. 2024-09-13T18:29:39.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:29:39.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8bb43640 1 Processor -- start 2024-09-13T18:29:39.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8bb43640 1 -- start start 2024-09-13T18:29:39.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8bb43640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b841583a0 0x7f6b840b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8bb43640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b840b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8bb43640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8415bde0 con 0x7f6b84157fc0 2024-09-13T18:29:39.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8bb43640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8415bc60 con 0x7f6b841583a0 2024-09-13T18:29:39.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8bb43640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8415c0c0 con 0x7f6b84158860 2024-09-13T18:29:39.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8a0e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b840b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b890de640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b841583a0 0x7f6b840b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8a0e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b840b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:38530/0 (socket says 172.21.15.53:38530) 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b890de640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b841583a0 0x7f6b840b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:51142/0 (socket says 172.21.15.53:51142) 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b8a0e0640 1 -- 172.21.15.53:0/2594003599 learned_addr learned my addr 172.21.15.53:0/2594003599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b898df640 1 --1- 172.21.15.53:0/2594003599 >> v1:172.21.15.87:6789/0 conn(0x7f6b84157fc0 0x7f6b840b3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:47596/0 (socket says 172.21.15.53:47596) 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b890de640 1 -- 172.21.15.53:0/2594003599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 msgr2=0x7f6b840b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b890de640 1 --2- 172.21.15.53:0/2594003599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b840b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b890de640 1 -- 172.21.15.53:0/2594003599 >> v1:172.21.15.87:6789/0 conn(0x7f6b84157fc0 legacy=0x7f6b840b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.415+0000 7f6b890de640 1 -- 172.21.15.53:0/2594003599 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8415c3a0 con 0x7f6b841583a0 2024-09-13T18:29:39.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b890de640 1 --2- 172.21.15.53:0/2594003599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b841583a0 0x7f6b840b4000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009d90 tx=0x7f6b7801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d1c3ab7dc3a601 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:39.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b888dd640 1 -- 172.21.15.53:0/2594003599 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780a5a00 con 0x7f6b841583a0 2024-09-13T18:29:39.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b888dd640 1 -- 172.21.15.53:0/2594003599 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b780a5b60 con 0x7f6b841583a0 2024-09-13T18:29:39.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b888dd640 1 -- 172.21.15.53:0/2594003599 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780ad440 con 0x7f6b841583a0 2024-09-13T18:29:39.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 -- 172.21.15.53:0/2594003599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b841583a0 msgr2=0x7f6b840b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/2594003599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b841583a0 0x7f6b840b4000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009d90 tx=0x7f6b7801c940 comp rx=0 tx=0).stop 2024-09-13T18:29:39.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 -- 172.21.15.53:0/2594003599 shutdown_connections 2024-09-13T18:29:39.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/2594003599 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b840b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/2594003599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b841583a0 0x7f6b840b4000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 -- 172.21.15.53:0/2594003599 >> 172.21.15.53:0/2594003599 conn(0x7f6b84071a50 msgr2=0x7f6b84099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 -- 172.21.15.53:0/2594003599 shutdown_connections 2024-09-13T18:29:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.419+0000 7f6b8bb43640 1 -- 172.21.15.53:0/2594003599 wait complete. 2024-09-13T18:29:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 Processor -- start 2024-09-13T18:29:39.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 -- start start 2024-09-13T18:29:39.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b84157fc0 0x7f6b84157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b841583a0 0x7f6b8413c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b84163780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841578b0 con 0x7f6b841583a0 2024-09-13T18:29:39.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84155840 con 0x7f6b84157fc0 2024-09-13T18:29:39.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84155a90 con 0x7f6b84158860 2024-09-13T18:29:39.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b841583a0 0x7f6b8413c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b841583a0 0x7f6b8413c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57132/0 (socket says 172.21.15.53:57132) 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 -- 172.21.15.53:0/1950416637 learned_addr learned my addr 172.21.15.53:0/1950416637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8a0e0640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b84163780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b898df640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b84157fc0 0x7f6b84157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 -- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 msgr2=0x7f6b84163780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b84163780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 -- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b84157fc0 msgr2=0x7f6b84157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b84157fc0 0x7f6b84157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 -- 172.21.15.53:0/1950416637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009a70 con 0x7f6b841583a0 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8a0e0640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b84163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b890de640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b841583a0 0x7f6b8413c350 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6b7801a590 tx=0x7f6b78019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b767fc640 1 -- 172.21.15.53:0/1950416637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780ade30 con 0x7f6b841583a0 2024-09-13T18:29:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b767fc640 1 -- 172.21.15.53:0/1950416637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78009450 con 0x7f6b841583a0 2024-09-13T18:29:39.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b84155d70 con 0x7f6b841583a0 2024-09-13T18:29:39.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b767fc640 1 -- 172.21.15.53:0/1950416637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780b9690 con 0x7f6b841583a0 2024-09-13T18:29:39.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b84156330 con 0x7f6b841583a0 2024-09-13T18:29:39.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8415de80 con 0x7f6b841583a0 2024-09-13T18:29:39.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.423+0000 7f6b767fc640 1 -- 172.21.15.53:0/1950416637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f6b780b97f0 con 0x7f6b841583a0 2024-09-13T18:29:39.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.427+0000 7f6b767fc640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b680669f0 0x7f6b68068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.427+0000 7f6b767fc640 1 -- 172.21.15.53:0/1950416637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6b7811fe70 con 0x7f6b841583a0 2024-09-13T18:29:39.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.427+0000 7f6b898df640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b680669f0 0x7f6b68068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.427+0000 7f6b898df640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b680669f0 0x7f6b68068eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000f70 tx=0x7f6b7c007c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:39.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.431+0000 7f6b767fc640 1 -- 172.21.15.53:0/1950416637 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b780eced0 con 0x7f6b841583a0 2024-09-13T18:29:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.607+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b840b3c10 con 0x7f6b680669f0 2024-09-13T18:29:39.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b767fc640 1 -- 172.21.15.53:0/1950416637 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6b7c005a60 con 0x7f6b680669f0 2024-09-13T18:29:39.612 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:29:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:29:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:29:39.612 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:29:39.613 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:29:39.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b680669f0 msgr2=0x7f6b68068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b680669f0 0x7f6b68068eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000f70 tx=0x7f6b7c007c90 comp rx=0 tx=0).stop 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b841583a0 msgr2=0x7f6b8413c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b841583a0 0x7f6b8413c350 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6b7801a590 tx=0x7f6b78019700 comp rx=0 tx=0).stop 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 shutdown_connections 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f6b680669f0 0x7f6b68068eb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b84158860 0x7f6b84163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b841583a0 0x7f6b8413c350 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 --2- 172.21.15.53:0/1950416637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b84157fc0 0x7f6b84157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 >> 172.21.15.53:0/1950416637 conn(0x7f6b84071a50 msgr2=0x7f6b840b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 shutdown_connections 2024-09-13T18:29:39.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.611+0000 7f6b8bb43640 1 -- 172.21.15.53:0/1950416637 wait complete. 2024-09-13T18:29:39.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:29:39.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d890af640 1 Processor -- start 2024-09-13T18:29:39.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d890af640 1 -- start start 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d890af640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d84160f30 0x7f0d84072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d890af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d8406c400 0x7f0d8406c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d890af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8406bc90 con 0x7f0d84160320 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d890af640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840b2e90 con 0x7f0d84160f30 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d890af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840b3080 con 0x7f0d8406c400 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d84160f30 0x7f0d84072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d84160f30 0x7f0d84072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57134/0 (socket says 172.21.15.53:57134) 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8259c640 1 -- 172.21.15.53:0/1068170452 learned_addr learned my addr 172.21.15.53:0/1068170452 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8359e640 1 --2- 172.21.15.53:0/1068170452 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d8406c400 0x7f0d8406c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8259c640 1 -- 172.21.15.53:0/1068170452 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d8406c400 msgr2=0x7f0d8406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8259c640 1 --2- 172.21.15.53:0/1068170452 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d8406c400 0x7f0d8406c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8259c640 1 -- 172.21.15.53:0/1068170452 >> v1:172.21.15.87:6789/0 conn(0x7f0d84160320 legacy=0x7f0d84160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:39.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.755+0000 7f0d8259c640 1 -- 172.21.15.53:0/1068170452 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d840b3360 con 0x7f0d84160f30 2024-09-13T18:29:39.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d8259c640 1 --2- 172.21.15.53:0/1068170452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d84160f30 0x7f0d84072ff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009870 tx=0x7f0d7801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e73e12f59bb2997 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:39.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d81d9b640 1 -- 172.21.15.53:0/1068170452 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780aa610 con 0x7f0d84160f30 2024-09-13T18:29:39.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d81d9b640 1 -- 172.21.15.53:0/1068170452 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d780a6040 con 0x7f0d84160f30 2024-09-13T18:29:39.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d81d9b640 1 -- 172.21.15.53:0/1068170452 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780aa990 con 0x7f0d84160f30 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- 172.21.15.53:0/1068170452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d84160f30 msgr2=0x7f0d84072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 --2- 172.21.15.53:0/1068170452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d84160f30 0x7f0d84072ff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009870 tx=0x7f0d7801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- 172.21.15.53:0/1068170452 shutdown_connections 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 --2- 172.21.15.53:0/1068170452 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d8406c400 0x7f0d8406c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 --2- 172.21.15.53:0/1068170452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d84160f30 0x7f0d84072ff0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- 172.21.15.53:0/1068170452 >> 172.21.15.53:0/1068170452 conn(0x7f0d840b0a30 msgr2=0x7f0d840b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- 172.21.15.53:0/1068170452 shutdown_connections 2024-09-13T18:29:39.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- 172.21.15.53:0/1068170452 wait complete. 2024-09-13T18:29:39.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 Processor -- start 2024-09-13T18:29:39.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- start start 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d8406c400 0x7f0d841534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d84160320 0x7f0d8409c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d84160f30 0x7f0d840ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84152380 con 0x7f0d8406c400 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d841505f0 con 0x7f0d84160320 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d890af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84152590 con 0x7f0d84160f30 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d82d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d8406c400 0x7f0d841534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d82d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d8406c400 0x7f0d841534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57144/0 (socket says 172.21.15.53:57144) 2024-09-13T18:29:39.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.759+0000 7f0d82d9d640 1 -- 172.21.15.53:0/3741402656 learned_addr learned my addr 172.21.15.53:0/3741402656 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d8359e640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d84160f30 0x7f0d840ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d8259c640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d84160320 0x7f0d8409c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d82d9d640 1 -- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d84160f30 msgr2=0x7f0d840ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d82d9d640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d84160f30 0x7f0d840ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d82d9d640 1 -- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d84160320 msgr2=0x7f0d8409c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d82d9d640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d84160320 0x7f0d8409c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d82d9d640 1 -- 172.21.15.53:0/3741402656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780094d0 con 0x7f0d8406c400 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d82d9d640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d8406c400 0x7f0d841534b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c480 tx=0x7f0d7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d6b7fe640 1 -- 172.21.15.53:0/3741402656 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74012830 con 0x7f0d8406c400 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d6b7fe640 1 -- 172.21.15.53:0/3741402656 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d740129b0 con 0x7f0d8406c400 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84152870 con 0x7f0d8406c400 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d6b7fe640 1 -- 172.21.15.53:0/3741402656 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74012d60 con 0x7f0d8406c400 2024-09-13T18:29:39.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84152e30 con 0x7f0d8406c400 2024-09-13T18:29:39.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8406c890 con 0x7f0d8406c400 2024-09-13T18:29:39.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d6b7fe640 1 -- 172.21.15.53:0/3741402656 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f0d7401c460 con 0x7f0d8406c400 2024-09-13T18:29:39.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d6b7fe640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0d700669f0 0x7f0d70068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:39.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d6b7fe640 1 -- 172.21.15.53:0/3741402656 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0d74084ff0 con 0x7f0d8406c400 2024-09-13T18:29:39.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.763+0000 7f0d8259c640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0d700669f0 0x7f0d70068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:39.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.767+0000 7f0d8259c640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0d700669f0 0x7f0d70068eb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d780ae000 tx=0x7f0d780a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:39.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.767+0000 7f0d6b7fe640 1 -- 172.21.15.53:0/3741402656 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d740520a0 con 0x7f0d8406c400 2024-09-13T18:29:39.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.927+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0d84166890 con 0x7f0d8406c400 2024-09-13T18:29:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.927+0000 7f0d6b7fe640 1 -- 172.21.15.53:0/3741402656 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d740556c0 con 0x7f0d8406c400 2024-09-13T18:29:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0d700669f0 msgr2=0x7f0d70068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0d700669f0 0x7f0d70068eb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0d780ae000 tx=0x7f0d780a7000 comp rx=0 tx=0).stop 2024-09-13T18:29:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d8406c400 msgr2=0x7f0d841534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d8406c400 0x7f0d841534b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c480 tx=0x7f0d7400c940 comp rx=0 tx=0).stop 2024-09-13T18:29:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 shutdown_connections 2024-09-13T18:29:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0d700669f0 0x7f0d70068eb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d84160f30 0x7f0d840ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d84160320 0x7f0d8409c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 --2- 172.21.15.53:0/3741402656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d8406c400 0x7f0d841534b0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:39.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 >> 172.21.15.53:0/3741402656 conn(0x7f0d840b0a30 msgr2=0x7f0d840b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:39.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 shutdown_connections 2024-09-13T18:29:39.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:39.931+0000 7f0d890af640 1 -- 172.21.15.53:0/3741402656 wait complete. 2024-09-13T18:29:39.950 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:29:39.950 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:39.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:40.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.115+0000 7fe73b4a8640 1 Processor -- start 2024-09-13T18:29:40.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.115+0000 7fe73b4a8640 1 -- start start 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe73b4a8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe73406b850 0x7fe7340b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe73b4a8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7340cbd60 0x7fe7340cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe73b4a8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7340b1ac0 con 0x7fe7340cb980 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe73b4a8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7340b3010 con 0x7fe7340cbd60 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe73b4a8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe734159ac0 con 0x7fe73406b850 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739a45640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7340cbd60 0x7fe7340cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739244640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe7340cb980 0x7fe73406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38090/0 (socket says 172.21.15.53:38090) 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739a45640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7340cbd60 0x7fe7340cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57158/0 (socket says 172.21.15.53:57158) 2024-09-13T18:29:40.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739244640 1 -- 172.21.15.53:0/543122871 learned_addr learned my addr 172.21.15.53:0/543122871 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:40.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe738a43640 1 --2- 172.21.15.53:0/543122871 >> v2:172.21.15.87:3300/0 conn(0x7fe73406b850 0x7fe7340b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739a45640 1 -- 172.21.15.53:0/543122871 >> v2:172.21.15.87:3300/0 conn(0x7fe73406b850 msgr2=0x7fe7340b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:40.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739a45640 1 --2- 172.21.15.53:0/543122871 >> v2:172.21.15.87:3300/0 conn(0x7fe73406b850 0x7fe7340b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739a45640 1 -- 172.21.15.53:0/543122871 >> v1:172.21.15.53:6789/0 conn(0x7fe7340cb980 legacy=0x7fe73406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739a45640 1 -- 172.21.15.53:0/543122871 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe734159da0 con 0x7fe7340cbd60 2024-09-13T18:29:40.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe72bfff640 1 -- 172.21.15.53:0/543122871 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345242813 0 0) 0x7fe7340b1ac0 con 0x7fe7340cb980 2024-09-13T18:29:40.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe739a45640 1 --2- 172.21.15.53:0/543122871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe7340cdd40 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe7340709a0 tx=0x7fe72c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfe01e1fc64e95f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe72bfff640 1 -- 172.21.15.53:0/543122871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ab600 con 0x7fe7340cbd60 2024-09-13T18:29:40.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe72bfff640 1 -- 172.21.15.53:0/543122871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0a7050 con 0x7fe7340cbd60 2024-09-13T18:29:40.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe72bfff640 1 -- 172.21.15.53:0/543122871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ab980 con 0x7fe7340cbd60 2024-09-13T18:29:40.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe73b4a8640 1 -- 172.21.15.53:0/543122871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 msgr2=0x7fe7340cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.119+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/543122871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe7340cdd40 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe7340709a0 tx=0x7fe72c01c330 comp rx=0 tx=0).stop 2024-09-13T18:29:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- 172.21.15.53:0/543122871 shutdown_connections 2024-09-13T18:29:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/543122871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe7340cdd40 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/543122871 >> v2:172.21.15.87:3300/0 conn(0x7fe73406b850 0x7fe7340b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- 172.21.15.53:0/543122871 >> 172.21.15.53:0/543122871 conn(0x7fe734065c80 msgr2=0x7fe734066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- 172.21.15.53:0/543122871 shutdown_connections 2024-09-13T18:29:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- 172.21.15.53:0/543122871 wait complete. 2024-09-13T18:29:40.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 Processor -- start 2024-09-13T18:29:40.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- start start 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73406b850 0x7fe73413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7340cb980 0x7fe73414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe73414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73414a880 con 0x7fe7340cbd60 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73414ab20 con 0x7fe73406b850 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73414ae00 con 0x7fe7340cb980 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe73414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe73414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57174/0 (socket says 172.21.15.53:57174) 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 -- 172.21.15.53:0/381910954 learned_addr learned my addr 172.21.15.53:0/381910954 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe738a43640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7340cb980 0x7fe73414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739244640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73406b850 0x7fe73413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 -- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7340cb980 msgr2=0x7fe73414d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7340cb980 0x7fe73414d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 -- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73406b850 msgr2=0x7fe73413db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73406b850 0x7fe73413db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 -- 172.21.15.53:0/381910954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c009420 con 0x7fe7340cbd60 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739244640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73406b850 0x7fe73413db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe739a45640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe73414db10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe72c01c810 tx=0x7fe72c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe729ffb640 1 -- 172.21.15.53:0/381910954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c004030 con 0x7fe7340cbd60 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe729ffb640 1 -- 172.21.15.53:0/381910954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c004190 con 0x7fe7340cbd60 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73414b0e0 con 0x7fe7340cbd60 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe729ffb640 1 -- 172.21.15.53:0/381910954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c004500 con 0x7fe7340cbd60 2024-09-13T18:29:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.123+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73413e0d0 con 0x7fe7340cbd60 2024-09-13T18:29:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.127+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe734067400 con 0x7fe7340cbd60 2024-09-13T18:29:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.127+0000 7fe729ffb640 1 -- 172.21.15.53:0/381910954 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fe72c0b2040 con 0x7fe7340cbd60 2024-09-13T18:29:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.127+0000 7fe729ffb640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe7180669f0 0x7fe718068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.127+0000 7fe729ffb640 1 -- 172.21.15.53:0/381910954 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe72c11ec10 con 0x7fe7340cbd60 2024-09-13T18:29:40.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.127+0000 7fe739244640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe7180669f0 0x7fe718068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.127+0000 7fe739244640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe7180669f0 0x7fe718068eb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe7300012f0 tx=0x7fe730009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.131+0000 7fe729ffb640 1 -- 172.21.15.53:0/381910954 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe72c0eb9b0 con 0x7fe7340cbd60 2024-09-13T18:29:40.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.295+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe734150bf0 con 0x7fe7340cbd60 2024-09-13T18:29:40.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.295+0000 7fe729ffb640 1 -- 172.21.15.53:0/381910954 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16606 (secure 0 0 0) 0x7fe734150bf0 con 0x7fe7340cbd60 2024-09-13T18:29:40.299 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:40.299 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:40.258533+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:40.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe7180669f0 msgr2=0x7fe718068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe7180669f0 0x7fe718068eb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe7300012f0 tx=0x7fe730009040 comp rx=0 tx=0).stop 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 msgr2=0x7fe73414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe73414db10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe72c01c810 tx=0x7fe72c0190d0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 shutdown_connections 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe7180669f0 0x7fe718068eb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7340cb980 0x7fe73414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7340cbd60 0x7fe73414db10 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 --2- 172.21.15.53:0/381910954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe73406b850 0x7fe73413db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 >> 172.21.15.53:0/381910954 conn(0x7fe734065c80 msgr2=0x7fe7340b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 shutdown_connections 2024-09-13T18:29:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.299+0000 7fe73b4a8640 1 -- 172.21.15.53:0/381910954 wait complete. 2024-09-13T18:29:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:19.948503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:21.156674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:40.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:40.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1258e4d640 1 Processor -- start 2024-09-13T18:29:40.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1258e4d640 1 -- start start 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1258e4d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 0x7f12540b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1258e4d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125406bc20 con 0x7f1254158ba0 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1258e4d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1254158f80 con 0x7f125406ff40 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1258e4d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125406c530 con 0x7f12540b1dd0 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f125259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1254158ba0 0x7f12540cb9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38104/0 (socket says 172.21.15.53:38104) 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f125259c640 1 -- 172.21.15.53:0/1876065562 learned_addr learned my addr 172.21.15.53:0/1876065562 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f124bfff640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 0x7f12540b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955534351 0 0) 0x7f125406bc20 con 0x7f1254158ba0 2024-09-13T18:29:40.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.439+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1234004640 con 0x7f1254158ba0 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 142694822 0 0) 0x7f1234004640 con 0x7f1254158ba0 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 msgr2=0x7f12540b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 0x7f12540b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 >> v1:172.21.15.87:6789/0 conn(0x7f125406ff40 legacy=0x7f125406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540b2340 con 0x7f1254158ba0 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f1244001680 con 0x7f1254158ba0 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 >> v1:172.21.15.53:6789/0 conn(0x7f1254158ba0 legacy=0x7f12540cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1234004ac0 0x7f1234004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12340058e0 0x7f1234005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 0x7f12340062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125406c530 con 0x7f12340058e0 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123400cc00 con 0x7f1234004ac0 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123400cdc0 con 0x7f12540b1dd0 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f124bfff640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12340058e0 0x7f1234005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1252d9d640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 0x7f12340062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f125259c640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1234004ac0 0x7f1234004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f124bfff640 1 -- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 msgr2=0x7f12340062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f124bfff640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540b1dd0 0x7f12340062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f124bfff640 1 -- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1234004ac0 msgr2=0x7f1234004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f124bfff640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1234004ac0 0x7f1234004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f124bfff640 1 -- 172.21.15.53:0/1876065562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234004640 con 0x7f12340058e0 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f124bfff640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12340058e0 0x7f1234005d60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f123c009ae0 tx=0x7f123c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e82fcd0d93e758d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0a5610 con 0x7f12340058e0 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c0a5770 con 0x7f12340058e0 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1251d9b640 1 -- 172.21.15.53:0/1876065562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0a5b20 con 0x7f12340058e0 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1258e4d640 1 -- 172.21.15.53:0/1876065562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12340058e0 msgr2=0x7f1234005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1258e4d640 1 --2- 172.21.15.53:0/1876065562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12340058e0 0x7f1234005d60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f123c009ae0 tx=0x7f123c01ca40 comp rx=0 tx=0).stop 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1252d9d640 1 -- 172.21.15.53:0/1876065562 reap_dead start 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1258e4d640 1 -- 172.21.15.53:0/1876065562 shutdown_connections 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1258e4d640 1 -- 172.21.15.53:0/1876065562 >> 172.21.15.53:0/1876065562 conn(0x7f1254065c80 msgr2=0x7f1254066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1258e4d640 1 -- 172.21.15.53:0/1876065562 shutdown_connections 2024-09-13T18:29:40.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.443+0000 7f1258e4d640 1 -- 172.21.15.53:0/1876065562 wait complete. 2024-09-13T18:29:40.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 Processor -- start 2024-09-13T18:29:40.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 -- start start 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12340058e0 0x7f12540ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12540c4700 0x7f125414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540c60a0 0x7f125415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540c4b80 con 0x7f12540c4700 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540af770 con 0x7f12340058e0 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ae700 con 0x7f12540c60a0 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12540c4700 0x7f125414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12540c4700 0x7f125414ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57194/0 (socket says 172.21.15.53:57194) 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 -- 172.21.15.53:0/736965504 learned_addr learned my addr 172.21.15.53:0/736965504 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1252d9d640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540c60a0 0x7f125415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f125259c640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12340058e0 0x7f12540ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 -- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540c60a0 msgr2=0x7f125415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540c60a0 0x7f125415ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 -- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12340058e0 msgr2=0x7f12540ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12340058e0 0x7f12540ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 -- 172.21.15.53:0/736965504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540708e0 con 0x7f12540c4700 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f125259c640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12340058e0 0x7f12540ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124bfff640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12540c4700 0x7f125414ced0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f123c009ae0 tx=0x7f1234006910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124affd640 1 -- 172.21.15.53:0/736965504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0a5610 con 0x7f12540c4700 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124affd640 1 -- 172.21.15.53:0/736965504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c004020 con 0x7f12540c4700 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540ae9e0 con 0x7f12540c4700 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f124affd640 1 -- 172.21.15.53:0/736965504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c004390 con 0x7f12540c4700 2024-09-13T18:29:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12540afe80 con 0x7f12540c4700 2024-09-13T18:29:40.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.447+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12540afcb0 con 0x7f12540c4700 2024-09-13T18:29:40.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.451+0000 7f124affd640 1 -- 172.21.15.53:0/736965504 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f123c0b4040 con 0x7f12540c4700 2024-09-13T18:29:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.451+0000 7f124affd640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1238066a20 0x7f1238068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.451+0000 7f124affd640 1 -- 172.21.15.53:0/736965504 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f123c11ed20 con 0x7f12540c4700 2024-09-13T18:29:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.451+0000 7f125259c640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1238066a20 0x7f1238068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.451+0000 7f125259c640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1238066a20 0x7f1238068ee0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1244001ec0 tx=0x7f1244001d70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.455+0000 7f124affd640 1 -- 172.21.15.53:0/736965504 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f123c0ebd80 con 0x7f12540c4700 2024-09-13T18:29:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.607+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f125406bba0 con 0x7f12540c4700 2024-09-13T18:29:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f124affd640 1 -- 172.21.15.53:0/736965504 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f123c0ef3a0 con 0x7f12540c4700 2024-09-13T18:29:40.612 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:40.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1238066a20 msgr2=0x7f1238068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1238066a20 0x7f1238068ee0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1244001ec0 tx=0x7f1244001d70 comp rx=0 tx=0).stop 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12540c4700 msgr2=0x7f125414ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12540c4700 0x7f125414ced0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f123c009ae0 tx=0x7f1234006910 comp rx=0 tx=0).stop 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 shutdown_connections 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1238066a20 0x7f1238068ee0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12540c60a0 0x7f125415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12540c4700 0x7f125414ced0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 --2- 172.21.15.53:0/736965504 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12340058e0 0x7f12540ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 >> 172.21.15.53:0/736965504 conn(0x7f1254065c80 msgr2=0x7f12540cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 shutdown_connections 2024-09-13T18:29:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.611+0000 7f1258e4d640 1 -- 172.21.15.53:0/736965504 wait complete. 2024-09-13T18:29:40.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:40.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d3c1d640 1 Processor -- start 2024-09-13T18:29:40.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d3c1d640 1 -- start start 2024-09-13T18:29:40.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d3c1d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd6cc143e80 0x7fd6cc06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d3c1d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0cda30 0x7fd6cc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d3c1d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc06f7a0 con 0x7fd6cc0caee0 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d3c1d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc06fd60 con 0x7fd6cc143e80 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d3c1d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0cb960 con 0x7fd6cc0cda30 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d11b8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd6cc0caee0 0x7fd6cc0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38116/0 (socket says 172.21.15.53:38116) 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d11b8640 1 -- 172.21.15.53:0/2104534794 learned_addr learned my addr 172.21.15.53:0/2104534794 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d21ba640 1 --2- 172.21.15.53:0/2104534794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0cda30 0x7fd6cc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d19b9640 1 --2- 172.21.15.53:0/2104534794 >> v2:172.21.15.87:3300/0 conn(0x7fd6cc143e80 0x7fd6cc06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d09b7640 1 -- 172.21.15.53:0/2104534794 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494058829 0 0) 0x7fd6cc06f7a0 con 0x7fd6cc0caee0 2024-09-13T18:29:40.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d09b7640 1 -- 172.21.15.53:0/2104534794 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b8003530 con 0x7fd6cc0caee0 2024-09-13T18:29:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d21ba640 1 -- 172.21.15.53:0/2104534794 >> v2:172.21.15.87:3300/0 conn(0x7fd6cc143e80 msgr2=0x7fd6cc06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d21ba640 1 --2- 172.21.15.53:0/2104534794 >> v2:172.21.15.87:3300/0 conn(0x7fd6cc143e80 0x7fd6cc06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d21ba640 1 -- 172.21.15.53:0/2104534794 >> v1:172.21.15.53:6789/0 conn(0x7fd6cc0caee0 legacy=0x7fd6cc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d09b7640 1 -- 172.21.15.53:0/2104534794 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168125969 0 0) 0x7fd6b8003530 con 0x7fd6cc0caee0 2024-09-13T18:29:40.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.751+0000 7fd6d21ba640 1 -- 172.21.15.53:0/2104534794 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0cbc40 con 0x7fd6cc0cda30 2024-09-13T18:29:40.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d21ba640 1 --2- 172.21.15.53:0/2104534794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0cda30 0x7fd6cc0cb350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009d90 tx=0x7fd6c401c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a131de7b1d45f317 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d09b7640 1 -- 172.21.15.53:0/2104534794 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc001680 con 0x7fd6cc0cda30 2024-09-13T18:29:40.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d09b7640 1 -- 172.21.15.53:0/2104534794 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c40a5520 con 0x7fd6cc0cda30 2024-09-13T18:29:40.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d09b7640 1 -- 172.21.15.53:0/2104534794 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40a58b0 con 0x7fd6cc0cda30 2024-09-13T18:29:40.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/2104534794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0cda30 msgr2=0x7fd6cc0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/2104534794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0cda30 0x7fd6cc0cb350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009d90 tx=0x7fd6c401c740 comp rx=0 tx=0).stop 2024-09-13T18:29:40.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/2104534794 shutdown_connections 2024-09-13T18:29:40.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/2104534794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0cda30 0x7fd6cc0cb350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/2104534794 >> v2:172.21.15.87:3300/0 conn(0x7fd6cc143e80 0x7fd6cc06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/2104534794 >> 172.21.15.53:0/2104534794 conn(0x7fd6cc065c80 msgr2=0x7fd6cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:40.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/2104534794 shutdown_connections 2024-09-13T18:29:40.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/2104534794 wait complete. 2024-09-13T18:29:40.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 Processor -- start 2024-09-13T18:29:40.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 -- start start 2024-09-13T18:29:40.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0caee0 0x7fd6cc1f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6cc0cda30 0x7fd6cc1f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.755+0000 7fd6d3c1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6cc143e80 0x7fd6cc15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d3c1d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc158cb0 con 0x7fd6cc143e80 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d3c1d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc1589d0 con 0x7fd6cc0cda30 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d3c1d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0afbc0 con 0x7fd6cc0caee0 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6cc143e80 0x7fd6cc15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6cc143e80 0x7fd6cc15a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57206/0 (socket says 172.21.15.53:57206) 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 -- 172.21.15.53:0/3344482332 learned_addr learned my addr 172.21.15.53:0/3344482332 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d11b8640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6cc0cda30 0x7fd6cc1f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d19b9640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0caee0 0x7fd6cc1f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 -- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0caee0 msgr2=0x7fd6cc1f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0caee0 0x7fd6cc1f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 -- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6cc0cda30 msgr2=0x7fd6cc1f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6cc0cda30 0x7fd6cc1f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 -- 172.21.15.53:0/3344482332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4009a70 con 0x7fd6cc143e80 2024-09-13T18:29:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d19b9640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0caee0 0x7fd6cc1f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d21ba640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6cc143e80 0x7fd6cc15a140 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd6c401cfe0 tx=0x7fd6c40194e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6c27fc640 1 -- 172.21.15.53:0/3344482332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40b9650 con 0x7fd6cc143e80 2024-09-13T18:29:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6c27fc640 1 -- 172.21.15.53:0/3344482332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c40b97b0 con 0x7fd6cc143e80 2024-09-13T18:29:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc0afea0 con 0x7fd6cc143e80 2024-09-13T18:29:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6c27fc640 1 -- 172.21.15.53:0/3344482332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40b9b40 con 0x7fd6cc143e80 2024-09-13T18:29:40.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc1f48c0 con 0x7fd6cc143e80 2024-09-13T18:29:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc0afa20 con 0x7fd6cc143e80 2024-09-13T18:29:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6c27fc640 1 -- 172.21.15.53:0/3344482332 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fd6c40b9ca0 con 0x7fd6cc143e80 2024-09-13T18:29:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6c27fc640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6b00669f0 0x7fd6b0068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6c27fc640 1 -- 172.21.15.53:0/3344482332 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6c411f850 con 0x7fd6cc143e80 2024-09-13T18:29:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d19b9640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6b00669f0 0x7fd6b0068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:40.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.759+0000 7fd6d19b9640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6b00669f0 0x7fd6b0068eb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009a40 tx=0x7fd6c8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:40.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.763+0000 7fd6c27fc640 1 -- 172.21.15.53:0/3344482332 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6cc0afa20 con 0x7fd6cc143e80 2024-09-13T18:29:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6cc0afa20 con 0x7fd6cc143e80 2024-09-13T18:29:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6c27fc640 1 -- 172.21.15.53:0/3344482332 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6cc0afa20 con 0x7fd6cc143e80 2024-09-13T18:29:40.920 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:29:40.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6b00669f0 msgr2=0x7fd6b0068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6b00669f0 0x7fd6b0068eb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009a40 tx=0x7fd6c8008040 comp rx=0 tx=0).stop 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6cc143e80 msgr2=0x7fd6cc15a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6cc143e80 0x7fd6cc15a140 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd6c401cfe0 tx=0x7fd6c40194e0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 shutdown_connections 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd6b00669f0 0x7fd6b0068eb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6cc143e80 0x7fd6cc15a140 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6cc0cda30 0x7fd6cc1f86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 --2- 172.21.15.53:0/3344482332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6cc0caee0 0x7fd6cc1f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 >> 172.21.15.53:0/3344482332 conn(0x7fd6cc065c80 msgr2=0x7fd6cc0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 shutdown_connections 2024-09-13T18:29:40.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:40.919+0000 7fd6d3c1d640 1 -- 172.21.15.53:0/3344482332 wait complete. 2024-09-13T18:29:40.938 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:41.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c8f6a640 1 Processor -- start 2024-09-13T18:29:41.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c8f6a640 1 -- start start 2024-09-13T18:29:41.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c8f6a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c41460d0 0x7fa0c40b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c8f6a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa0c4066390 0x7fa0c40ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c8f6a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c406d600 con 0x7fa0c406d080 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c8f6a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c406d8e0 con 0x7fa0c4066390 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c8f6a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c406dbc0 con 0x7fa0c41460d0 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa0c406d080 0x7fa0c4065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38124/0 (socket says 172.21.15.53:38124) 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1818295523 learned_addr learned my addr 172.21.15.53:0/1818295523 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c259c640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c41460d0 0x7fa0c40b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c2d9d640 1 --2- 172.21.15.53:0/1818295523 >> v2:172.21.15.87:3300/0 conn(0x7fa0c4066390 0x7fa0c40ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89611317 0 0) 0x7fa0c406d600 con 0x7fa0c406d080 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ac003530 con 0x7fa0c406d080 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974229504 0 0) 0x7fa0ac003530 con 0x7fa0c406d080 2024-09-13T18:29:41.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c41460d0 msgr2=0x7fa0c40b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c41460d0 0x7fa0c40b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 >> v2:172.21.15.87:3300/0 conn(0x7fa0c4066390 msgr2=0x7fa0c40ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 --2- 172.21.15.53:0/1818295523 >> v2:172.21.15.87:3300/0 conn(0x7fa0c4066390 0x7fa0c40ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c406dea0 con 0x7fa0c406d080 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa0b4001680 con 0x7fa0c406d080 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 >> v1:172.21.15.53:6789/0 conn(0x7fa0c406d080 legacy=0x7fa0c4065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac003980 0x7fa0ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0ac0047d0 0x7fa0ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0ac005190 0x7fa0ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c406d8e0 con 0x7fa0ac0047d0 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c406dbc0 con 0x7fa0ac003980 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac00bf00 con 0x7fa0ac005190 2024-09-13T18:29:41.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c259c640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c41460d0 0x7fa0c40b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0ac0047d0 0x7fa0ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c2d9d640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0ac005190 0x7fa0ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c259c640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac003980 0x7fa0ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0ac005190 msgr2=0x7fa0ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0ac005190 0x7fa0ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac003980 msgr2=0x7fa0ac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac003980 0x7fa0ac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.063+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1818295523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac003530 con 0x7fa0ac0047d0 2024-09-13T18:29:41.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c1d9b640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0ac0047d0 0x7fa0ac004c50 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c210 tx=0x7fa0b401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a88a5d0f88fc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40058e0 con 0x7fa0ac0047d0 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4005a40 con 0x7fa0ac0047d0 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c159a640 1 -- 172.21.15.53:0/1818295523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4005e10 con 0x7fa0ac0047d0 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1818295523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0ac0047d0 msgr2=0x7fa0ac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 --2- 172.21.15.53:0/1818295523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0ac0047d0 0x7fa0ac004c50 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c210 tx=0x7fa0b401cbd0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c2d9d640 1 -- 172.21.15.53:0/1818295523 reap_dead start 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1818295523 shutdown_connections 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1818295523 >> 172.21.15.53:0/1818295523 conn(0x7fa0c4069f50 msgr2=0x7fa0c406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1818295523 shutdown_connections 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1818295523 wait complete. 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 Processor -- start 2024-09-13T18:29:41.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.067+0000 7fa0c8f6a640 1 -- start start 2024-09-13T18:29:41.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0047d0 0x7fa0c40cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c40afd30 0x7fa0c40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c40c7290 0x7fa0c40c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4130cf0 con 0x7fa0c40afd30 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c7c50 con 0x7fa0ac0047d0 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40cbdd0 con 0x7fa0c40c7290 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c40afd30 0x7fa0c40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c40afd30 0x7fa0c40b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57230/0 (socket says 172.21.15.53:57230) 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1603302985 learned_addr learned my addr 172.21.15.53:0/1603302985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c259c640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0047d0 0x7fa0c40cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c2d9d640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c40c7290 0x7fa0c40c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c40c7290 msgr2=0x7fa0c40c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c40c7290 0x7fa0c40c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0047d0 msgr2=0x7fa0c40cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0047d0 0x7fa0c40cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 -- 172.21.15.53:0/1603302985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40b07f0 con 0x7fa0c40afd30 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c259c640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0047d0 0x7fa0c40cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c1d9b640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c40afd30 0x7fa0c40b01b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c210 tx=0x7fa0ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0b2ffd640 1 -- 172.21.15.53:0/1603302985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40a58d0 con 0x7fa0c40afd30 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0b2ffd640 1 -- 172.21.15.53:0/1603302985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40a5a30 con 0x7fa0c40afd30 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c40b0ad0 con 0x7fa0c40afd30 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0b2ffd640 1 -- 172.21.15.53:0/1603302985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40a5dc0 con 0x7fa0c40afd30 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c41311e0 con 0x7fa0c40afd30 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c40cf000 con 0x7fa0c40afd30 2024-09-13T18:29:41.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0b2ffd640 1 -- 172.21.15.53:0/1603302985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fa0b40047f0 con 0x7fa0c40afd30 2024-09-13T18:29:41.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0b2ffd640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0a4066a20 0x7fa0a4068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0b2ffd640 1 -- 172.21.15.53:0/1603302985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa0b411d960 con 0x7fa0c40afd30 2024-09-13T18:29:41.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.071+0000 7fa0c259c640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0a4066a20 0x7fa0a4068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.075+0000 7fa0c259c640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0a4066a20 0x7fa0a4068ee0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa0c406bfb0 tx=0x7fa0b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.075+0000 7fa0b2ffd640 1 -- 172.21.15.53:0/1603302985 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa0b40ea880 con 0x7fa0c40afd30 2024-09-13T18:29:41.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.239+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0c40b0cc0 con 0x7fa0c40afd30 2024-09-13T18:29:41.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.239+0000 7fa0b2ffd640 1 -- 172.21.15.53:0/1603302985 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0c40b0cc0 con 0x7fa0c40afd30 2024-09-13T18:29:41.242 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0a4066a20 msgr2=0x7fa0a4068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0a4066a20 0x7fa0a4068ee0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa0c406bfb0 tx=0x7fa0b8008040 comp rx=0 tx=0).stop 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c40afd30 msgr2=0x7fa0c40b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c40afd30 0x7fa0c40b01b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c210 tx=0x7fa0ac005800 comp rx=0 tx=0).stop 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 shutdown_connections 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fa0a4066a20 0x7fa0a4068ee0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0c40c7290 0x7fa0c40c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0c40afd30 0x7fa0c40b01b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 --2- 172.21.15.53:0/1603302985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0ac0047d0 0x7fa0c40cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 >> 172.21.15.53:0/1603302985 conn(0x7fa0c4069f50 msgr2=0x7fa0c41609f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:41.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 shutdown_connections 2024-09-13T18:29:41.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.243+0000 7fa0c8f6a640 1 -- 172.21.15.53:0/1603302985 wait complete. 2024-09-13T18:29:41.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:29:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81def69640 1 Processor -- start 2024-09-13T18:29:41.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81def69640 1 -- start start 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81def69640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f81d815b7c0 0x7f81d8070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81def69640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 0x7f81d81640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81def69640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d806d480 con 0x7f81d81582a0 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81def69640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d815aaf0 con 0x7f81d815b7c0 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81def69640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d806d760 con 0x7f81d80711d0 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81dcd05640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f81d81582a0 0x7f81d806c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38140/0 (socket says 172.21.15.53:38140) 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81dcd05640 1 -- 172.21.15.53:0/2658422905 learned_addr learned my addr 172.21.15.53:0/2658422905 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81dd506640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 0x7f81d81640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2658422905 >> v2:172.21.15.87:3300/0 conn(0x7f81d815b7c0 0x7f81d8070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165837570 0 0) 0x7f81d806d480 con 0x7f81d81582a0 2024-09-13T18:29:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c0003530 con 0x7f81d81582a0 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2189770248 0 0) 0x7f81c0003530 con 0x7f81d81582a0 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 msgr2=0x7f81d81640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 0x7f81d81640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 >> v2:172.21.15.87:3300/0 conn(0x7f81d815b7c0 msgr2=0x7f81d8070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 --2- 172.21.15.53:0/2658422905 >> v2:172.21.15.87:3300/0 conn(0x7f81d815b7c0 0x7f81d8070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d815ace0 con 0x7f81d81582a0 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f81c8001680 con 0x7f81d81582a0 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 >> v1:172.21.15.53:6789/0 conn(0x7f81d81582a0 legacy=0x7f81d806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c0003980 0x7f81c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81c00047d0 0x7f81c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 0x7f81c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0004620 con 0x7f81c00047d0 2024-09-13T18:29:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000b9c0 con 0x7f81c0003980 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000bb80 con 0x7f81d80711d0 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81c00047d0 0x7f81c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81dd506640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 0x7f81c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81dcd05640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c0003980 0x7f81c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d7fff640 1 -- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 msgr2=0x7f81c0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80711d0 0x7f81c0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d7fff640 1 -- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c0003980 msgr2=0x7f81c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c0003980 0x7f81c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.379+0000 7f81d7fff640 1 -- 172.21.15.53:0/2658422905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0003530 con 0x7f81c00047d0 2024-09-13T18:29:41.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81c00047d0 0x7f81c0004c50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009ae0 tx=0x7f81cc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912282c69cead52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0a64c0 con 0x7f81c00047d0 2024-09-13T18:29:41.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0a6620 con 0x7f81c00047d0 2024-09-13T18:29:41.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81d77fe640 1 -- 172.21.15.53:0/2658422905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0a69d0 con 0x7f81c00047d0 2024-09-13T18:29:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81def69640 1 -- 172.21.15.53:0/2658422905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81c00047d0 msgr2=0x7f81c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81def69640 1 --2- 172.21.15.53:0/2658422905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81c00047d0 0x7f81c0004c50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009ae0 tx=0x7f81cc01cab0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81dd506640 1 -- 172.21.15.53:0/2658422905 reap_dead start 2024-09-13T18:29:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81def69640 1 -- 172.21.15.53:0/2658422905 shutdown_connections 2024-09-13T18:29:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81def69640 1 -- 172.21.15.53:0/2658422905 >> 172.21.15.53:0/2658422905 conn(0x7f81d8065c80 msgr2=0x7f81d8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81def69640 1 -- 172.21.15.53:0/2658422905 shutdown_connections 2024-09-13T18:29:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.383+0000 7f81def69640 1 -- 172.21.15.53:0/2658422905 wait complete. 2024-09-13T18:29:41.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 Processor -- start 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 -- start start 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c00047d0 0x7f81d80af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d80c50b0 0x7f81d80c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80c5510 0x7f81d80c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80c4c90 con 0x7f81d80c50b0 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80c3e10 con 0x7f81c00047d0 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80c4010 con 0x7f81d80c5510 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d80c50b0 0x7f81d80c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d80c50b0 0x7f81d80c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57250/0 (socket says 172.21.15.53:57250) 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 -- 172.21.15.53:0/2473837951 learned_addr learned my addr 172.21.15.53:0/2473837951 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81dd506640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80c5510 0x7f81d80c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81dcd05640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c00047d0 0x7f81d80af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 -- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80c5510 msgr2=0x7f81d80c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80c5510 0x7f81d80c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 -- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c00047d0 msgr2=0x7f81d80af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c00047d0 0x7f81d80af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 -- 172.21.15.53:0/2473837951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80c42f0 con 0x7f81d80c50b0 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81dd506640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80c5510 0x7f81d80c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d7fff640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d80c50b0 0x7f81d80c3390 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f81cc01c8e0 tx=0x7f81c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d57fa640 1 -- 172.21.15.53:0/2473837951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0a6c60 con 0x7f81d80c50b0 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d57fa640 1 -- 172.21.15.53:0/2473837951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0a6de0 con 0x7f81d80c50b0 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d57fa640 1 -- 172.21.15.53:0/2473837951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc006280 con 0x7f81d80c50b0 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d80c45d0 con 0x7f81d80c50b0 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d80af910 con 0x7f81d80c50b0 2024-09-13T18:29:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d8067400 con 0x7f81d80c50b0 2024-09-13T18:29:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d57fa640 1 -- 172.21.15.53:0/2473837951 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f81cc0063e0 con 0x7f81d80c50b0 2024-09-13T18:29:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d57fa640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f81c40669f0 0x7f81c4068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.387+0000 7f81d57fa640 1 -- 172.21.15.53:0/2473837951 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f81cc0aa070 con 0x7f81d80c50b0 2024-09-13T18:29:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.391+0000 7f81dcd05640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f81c40669f0 0x7f81c4068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.391+0000 7f81dcd05640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f81c40669f0 0x7f81c4068eb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f81c8001ec0 tx=0x7f81c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.395+0000 7f81d57fa640 1 -- 172.21.15.53:0/2473837951 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81cc0ec940 con 0x7f81d80c50b0 2024-09-13T18:29:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81d80c4dd0 con 0x7f81d80c50b0 2024-09-13T18:29:41.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81d57fa640 1 -- 172.21.15.53:0/2473837951 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7f81d80c4dd0 con 0x7f81d80c50b0 2024-09-13T18:29:41.569 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:29:41.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f81c40669f0 msgr2=0x7f81c4068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f81c40669f0 0x7f81c4068eb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f81c8001ec0 tx=0x7f81c8009040 comp rx=0 tx=0).stop 2024-09-13T18:29:41.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d80c50b0 msgr2=0x7f81d80c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d80c50b0 0x7f81d80c3390 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f81cc01c8e0 tx=0x7f81c0005800 comp rx=0 tx=0).stop 2024-09-13T18:29:41.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 shutdown_connections 2024-09-13T18:29:41.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f81c40669f0 0x7f81c4068eb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81d80c5510 0x7f81d80c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d80c50b0 0x7f81d80c3390 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 --2- 172.21.15.53:0/2473837951 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81c00047d0 0x7f81d80af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 >> 172.21.15.53:0/2473837951 conn(0x7f81d8065c80 msgr2=0x7f81d80cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:41.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 shutdown_connections 2024-09-13T18:29:41.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.567+0000 7f81def69640 1 -- 172.21.15.53:0/2473837951 wait complete. 2024-09-13T18:29:41.589 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:29:41.589 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:41.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1ddb7c9640 1 Processor -- start 2024-09-13T18:29:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1ddb7c9640 1 -- start start 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1ddb7c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1dd415cab0 0x7f1dd40d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1ddb7c9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1dd40cf7d0 0x7f1dd40b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1ddb7c9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd40d2400 con 0x7f1dd40cd6c0 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1ddb7c9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd40d1530 con 0x7f1dd415cab0 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1ddb7c9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd40d0920 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1dd415cab0 0x7f1dd40d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1dd415cab0 0x7f1dd40d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57252/0 (socket says 172.21.15.53:57252) 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 -- 172.21.15.53:0/2650958779 learned_addr learned my addr 172.21.15.53:0/2650958779 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9d66640 1 --2- 172.21.15.53:0/2650958779 >> v2:172.21.15.87:3300/0 conn(0x7f1dd40cf7d0 0x7f1dd40b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 -- 172.21.15.53:0/2650958779 >> v2:172.21.15.87:3300/0 conn(0x7f1dd40cf7d0 msgr2=0x7f1dd40b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:41.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 --2- 172.21.15.53:0/2650958779 >> v2:172.21.15.87:3300/0 conn(0x7f1dd40cf7d0 0x7f1dd40b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 -- 172.21.15.53:0/2650958779 >> v1:172.21.15.53:6789/0 conn(0x7f1dd40cd6c0 legacy=0x7f1dd40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 -- 172.21.15.53:0/2650958779 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40d0c00 con 0x7f1dd415cab0 2024-09-13T18:29:41.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dcbfff640 1 -- 172.21.15.53:0/2650958779 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243203720 0 0) 0x7f1dd40d2400 con 0x7f1dd40cd6c0 2024-09-13T18:29:41.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dd9565640 1 --2- 172.21.15.53:0/2650958779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd415cab0 0x7f1dd40d19c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40d14a0 tx=0x7f1dd001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e22d83beae24ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dcbfff640 1 -- 172.21.15.53:0/2650958779 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00a5880 con 0x7f1dd415cab0 2024-09-13T18:29:41.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.763+0000 7f1dcbfff640 1 -- 172.21.15.53:0/2650958779 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd00a59e0 con 0x7f1dd415cab0 2024-09-13T18:29:41.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dcbfff640 1 -- 172.21.15.53:0/2650958779 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00a5d70 con 0x7f1dd415cab0 2024-09-13T18:29:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/2650958779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd415cab0 msgr2=0x7f1dd40d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/2650958779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd415cab0 0x7f1dd40d19c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40d14a0 tx=0x7f1dd001c9c0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/2650958779 shutdown_connections 2024-09-13T18:29:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/2650958779 >> v2:172.21.15.87:3300/0 conn(0x7f1dd40cf7d0 0x7f1dd40b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/2650958779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd415cab0 0x7f1dd40d19c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/2650958779 >> 172.21.15.53:0/2650958779 conn(0x7f1dd4065c80 msgr2=0x7f1dd4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:41.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/2650958779 shutdown_connections 2024-09-13T18:29:41.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/2650958779 wait complete. 2024-09-13T18:29:41.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 Processor -- start 2024-09-13T18:29:41.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- start start 2024-09-13T18:29:41.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd40cd6c0 0x7f1dd4160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd40cf7d0 0x7f1dd40c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dd415cab0 0x7f1dd4155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd40cd490 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41572f0 con 0x7f1dd40cd6c0 2024-09-13T18:29:41.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd415f140 con 0x7f1dd415cab0 2024-09-13T18:29:41.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd40cf7d0 0x7f1dd40c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd40cf7d0 0x7f1dd40c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57260/0 (socket says 172.21.15.53:57260) 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 -- 172.21.15.53:0/1762732415 learned_addr learned my addr 172.21.15.53:0/1762732415 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd9565640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd40cd6c0 0x7f1dd4160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd9d66640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dd415cab0 0x7f1dd4155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 -- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dd415cab0 msgr2=0x7f1dd4155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dd415cab0 0x7f1dd4155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 -- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd40cd6c0 msgr2=0x7f1dd4160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd40cd6c0 0x7f1dd4160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 -- 172.21.15.53:0/1762732415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0009b30 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dd8d64640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd40cf7d0 0x7f1dd40c83c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4001ec0 tx=0x7f1dc400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dc9ffb640 1 -- 172.21.15.53:0/1762732415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40054e0 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dc9ffb640 1 -- 172.21.15.53:0/1762732415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4003600 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd40cd1b0 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1dc9ffb640 1 -- 172.21.15.53:0/1762732415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40039b0 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.767+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd415f6c0 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.771+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd415f8e0 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.771+0000 7f1dc9ffb640 1 -- 172.21.15.53:0/1762732415 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f1dc4003b10 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.771+0000 7f1dc9ffb640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1db80669f0 0x7f1db8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:41.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.771+0000 7f1dc9ffb640 1 -- 172.21.15.53:0/1762732415 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1dc4083cc0 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.771+0000 7f1dd9565640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1db80669f0 0x7f1db8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:41.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.771+0000 7f1dd9565640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1db80669f0 0x7f1db8068eb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00ae000 tx=0x7f1dd00a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:41.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.775+0000 7f1dc9ffb640 1 -- 172.21.15.53:0/1762732415 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1dc4050be0 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.935+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dd40b5870 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1dc9ffb640 1 -- 172.21.15.53:0/1762732415 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f1dc4017070 con 0x7f1dd40cf7d0 2024-09-13T18:29:41.941 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:41.941 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:40.258533+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1db80669f0 msgr2=0x7f1db8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1db80669f0 0x7f1db8068eb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00ae000 tx=0x7f1dd00a7070 comp rx=0 tx=0).stop 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd40cf7d0 msgr2=0x7f1dd40c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd40cf7d0 0x7f1dd40c83c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4001ec0 tx=0x7f1dc400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 shutdown_connections 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f1db80669f0 0x7f1db8068eb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1dd415cab0 0x7f1dd4155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1dd40cf7d0 0x7f1dd40c83c0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 --2- 172.21.15.53:0/1762732415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd40cd6c0 0x7f1dd4160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:41.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 >> 172.21.15.53:0/1762732415 conn(0x7f1dd4065c80 msgr2=0x7f1dd415a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:41.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 shutdown_connections 2024-09-13T18:29:41.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:41.939+0000 7f1ddb7c9640 1 -- 172.21.15.53:0/1762732415 wait complete. 2024-09-13T18:29:41.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:19.948503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:21.156674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:41.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab63da8640 1 Processor -- start 2024-09-13T18:29:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab63da8640 1 -- start start 2024-09-13T18:29:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab63da8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab5c0ccd10 0x7fab5c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab63da8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c0d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab63da8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c0b7db0 con 0x7fab5c15c830 2024-09-13T18:29:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab63da8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c0d3650 con 0x7fab5c0ccd10 2024-09-13T18:29:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab63da8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0d0650 con 0x7fab5c0d2c80 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab61343640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab5c0ccd10 0x7fab5c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab62345640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c0d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab62345640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c0d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:38666/0 (socket says 172.21.15.53:38666) 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab62345640 1 -- 172.21.15.53:0/757657342 learned_addr learned my addr 172.21.15.53:0/757657342 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab61b44640 1 --1- 172.21.15.53:0/757657342 >> v1:172.21.15.87:6789/0 conn(0x7fab5c15c830 0x7fab5c0d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:47626/0 (socket says 172.21.15.53:47626) 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab62345640 1 -- 172.21.15.53:0/757657342 >> v2:172.21.15.87:3300/0 conn(0x7fab5c0ccd10 msgr2=0x7fab5c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab62345640 1 --2- 172.21.15.53:0/757657342 >> v2:172.21.15.87:3300/0 conn(0x7fab5c0ccd10 0x7fab5c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab62345640 1 -- 172.21.15.53:0/757657342 >> v1:172.21.15.87:6789/0 conn(0x7fab5c15c830 legacy=0x7fab5c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab62345640 1 -- 172.21.15.53:0/757657342 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0d0c10 con 0x7fab5c0d2c80 2024-09-13T18:29:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.083+0000 7fab61343640 1 --2- 172.21.15.53:0/757657342 >> v2:172.21.15.87:3300/0 conn(0x7fab5c0ccd10 0x7fab5c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab62345640 1 --2- 172.21.15.53:0/757657342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c0d3110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab54009e50 tx=0x7fab5401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffadb2d34abbc409 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab60b42640 1 -- 172.21.15.53:0/757657342 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a5700 con 0x7fab5c0d2c80 2024-09-13T18:29:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab60b42640 1 -- 172.21.15.53:0/757657342 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540a5860 con 0x7fab5c0d2c80 2024-09-13T18:29:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab60b42640 1 -- 172.21.15.53:0/757657342 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a5bf0 con 0x7fab5c0d2c80 2024-09-13T18:29:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 -- 172.21.15.53:0/757657342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 msgr2=0x7fab5c0d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 --2- 172.21.15.53:0/757657342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c0d3110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab54009e50 tx=0x7fab5401ca30 comp rx=0 tx=0).stop 2024-09-13T18:29:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 -- 172.21.15.53:0/757657342 shutdown_connections 2024-09-13T18:29:42.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 --2- 172.21.15.53:0/757657342 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c0d3110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 --2- 172.21.15.53:0/757657342 >> v2:172.21.15.87:3300/0 conn(0x7fab5c0ccd10 0x7fab5c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 -- 172.21.15.53:0/757657342 >> 172.21.15.53:0/757657342 conn(0x7fab5c070970 msgr2=0x7fab5c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:42.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 -- 172.21.15.53:0/757657342 shutdown_connections 2024-09-13T18:29:42.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.087+0000 7fab63da8640 1 -- 172.21.15.53:0/757657342 wait complete. 2024-09-13T18:29:42.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 Processor -- start 2024-09-13T18:29:42.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 -- start start 2024-09-13T18:29:42.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab5c0ccd10 0x7fab5c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab5c15c830 0x7fab5c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0c74d0 con 0x7fab5c15c830 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0c77b0 con 0x7fab5c0ccd10 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0c7a90 con 0x7fab5c0d2c80 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab5c15c830 0x7fab5c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab5c15c830 0x7fab5c15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57272/0 (socket says 172.21.15.53:57272) 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 -- 172.21.15.53:0/3085650471 learned_addr learned my addr 172.21.15.53:0/3085650471 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab61b44640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab5c0ccd10 0x7fab5c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab61343640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 -- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 msgr2=0x7fab5c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 -- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab5c0ccd10 msgr2=0x7fab5c152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab5c0ccd10 0x7fab5c152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 -- 172.21.15.53:0/3085650471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c009420 con 0x7fab5c15c830 2024-09-13T18:29:42.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab62345640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab5c15c830 0x7fab5c15b0d0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fab5401a660 tx=0x7fab540197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab527fc640 1 -- 172.21.15.53:0/3085650471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540b8670 con 0x7fab5c15c830 2024-09-13T18:29:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab527fc640 1 -- 172.21.15.53:0/3085650471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540b87f0 con 0x7fab5c15c830 2024-09-13T18:29:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab54009b30 con 0x7fab5c15c830 2024-09-13T18:29:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab527fc640 1 -- 172.21.15.53:0/3085650471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540b8ba0 con 0x7fab5c15c830 2024-09-13T18:29:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.091+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c0c8050 con 0x7fab5c15c830 2024-09-13T18:29:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.095+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c0c8240 con 0x7fab5c15c830 2024-09-13T18:29:42.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.095+0000 7fab527fc640 1 -- 172.21.15.53:0/3085650471 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fab540b8d00 con 0x7fab5c15c830 2024-09-13T18:29:42.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.095+0000 7fab527fc640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fab40066a20 0x7fab40068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.095+0000 7fab527fc640 1 -- 172.21.15.53:0/3085650471 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fab5411f9a0 con 0x7fab5c15c830 2024-09-13T18:29:42.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.095+0000 7fab61b44640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fab40066a20 0x7fab40068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.095+0000 7fab61b44640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fab40066a20 0x7fab40068ee0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fab58000f70 tx=0x7fab58007e50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.099+0000 7fab527fc640 1 -- 172.21.15.53:0/3085650471 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab540ecb50 con 0x7fab5c15c830 2024-09-13T18:29:42.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.255+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab5c0cd180 con 0x7fab5c15c830 2024-09-13T18:29:42.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.255+0000 7fab527fc640 1 -- 172.21.15.53:0/3085650471 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab540f0170 con 0x7fab5c15c830 2024-09-13T18:29:42.259 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fab40066a20 msgr2=0x7fab40068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fab40066a20 0x7fab40068ee0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fab58000f70 tx=0x7fab58007e50 comp rx=0 tx=0).stop 2024-09-13T18:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab5c15c830 msgr2=0x7fab5c15b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab5c15c830 0x7fab5c15b0d0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fab5401a660 tx=0x7fab540197d0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 shutdown_connections 2024-09-13T18:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fab40066a20 0x7fab40068ee0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab5c0d2c80 0x7fab5c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab5c15c830 0x7fab5c15b0d0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 --2- 172.21.15.53:0/3085650471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab5c0ccd10 0x7fab5c152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 >> 172.21.15.53:0/3085650471 conn(0x7fab5c070970 msgr2=0x7fab5c070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:42.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 shutdown_connections 2024-09-13T18:29:42.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.259+0000 7fab63da8640 1 -- 172.21.15.53:0/3085650471 wait complete. 2024-09-13T18:29:42.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd21e6f0640 1 Processor -- start 2024-09-13T18:29:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd21e6f0640 1 -- start start 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd21e6f0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218145f10 0x7fd2180aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd21e6f0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd218065c80 0x7fd2180660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd21e6f0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd218066600 con 0x7fd218160310 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd21e6f0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180af060 con 0x7fd218065c80 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd21e6f0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd218070480 con 0x7fd218145f10 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd2177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd218065c80 0x7fd2180660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd2177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd218065c80 0x7fd2180660c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57282/0 (socket says 172.21.15.53:57282) 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd2177fe640 1 -- 172.21.15.53:0/3819710164 learned_addr learned my addr 172.21.15.53:0/3819710164 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd217fff640 1 --2- 172.21.15.53:0/3819710164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218145f10 0x7fd2180aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd2177fe640 1 -- 172.21.15.53:0/3819710164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218145f10 msgr2=0x7fd2180aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:42.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd2177fe640 1 --2- 172.21.15.53:0/3819710164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218145f10 0x7fd2180aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd2177fe640 1 -- 172.21.15.53:0/3819710164 >> v1:172.21.15.87:6789/0 conn(0x7fd218160310 legacy=0x7fd218160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.395+0000 7fd2177fe640 1 -- 172.21.15.53:0/3819710164 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218070760 con 0x7fd218065c80 2024-09-13T18:29:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd2177fe640 1 --2- 172.21.15.53:0/3819710164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218065c80 0x7fd2180660c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009870 tx=0x7fd20c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac19c240ede4df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd216ffd640 1 -- 172.21.15.53:0/3819710164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0a95f0 con 0x7fd218065c80 2024-09-13T18:29:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd216ffd640 1 -- 172.21.15.53:0/3819710164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0a9750 con 0x7fd218065c80 2024-09-13T18:29:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd216ffd640 1 -- 172.21.15.53:0/3819710164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0a9ae0 con 0x7fd218065c80 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- 172.21.15.53:0/3819710164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218065c80 msgr2=0x7fd2180660c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/3819710164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218065c80 0x7fd2180660c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009870 tx=0x7fd20c01c530 comp rx=0 tx=0).stop 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- 172.21.15.53:0/3819710164 shutdown_connections 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/3819710164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218065c80 0x7fd2180660c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/3819710164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218145f10 0x7fd2180aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- 172.21.15.53:0/3819710164 >> 172.21.15.53:0/3819710164 conn(0x7fd218069f50 msgr2=0x7fd21806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- 172.21.15.53:0/3819710164 shutdown_connections 2024-09-13T18:29:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- 172.21.15.53:0/3819710164 wait complete. 2024-09-13T18:29:42.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 Processor -- start 2024-09-13T18:29:42.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- start start 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218065c80 0x7fd21813dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd218145f10 0x7fd2180cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218160310 0x7fd2180b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180b04b0 con 0x7fd218160310 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180af8a0 con 0x7fd218145f10 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21e6f0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180afb80 con 0x7fd218065c80 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21cc8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218160310 0x7fd2180b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21cc8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218160310 0x7fd2180b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57292/0 (socket says 172.21.15.53:57292) 2024-09-13T18:29:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd21cc8d640 1 -- 172.21.15.53:0/1713595895 learned_addr learned my addr 172.21.15.53:0/1713595895 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd217fff640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218065c80 0x7fd21813dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.399+0000 7fd2177fe640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd218145f10 0x7fd2180cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21cc8d640 1 -- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218065c80 msgr2=0x7fd21813dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21cc8d640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218065c80 0x7fd21813dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21cc8d640 1 -- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd218145f10 msgr2=0x7fd2180cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21cc8d640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd218145f10 0x7fd2180cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21cc8d640 1 -- 172.21.15.53:0/1713595895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0094d0 con 0x7fd218160310 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21cc8d640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218160310 0x7fd2180b0940 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c730 tx=0x7fd21000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd214ff9640 1 -- 172.21.15.53:0/1713595895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210003b80 con 0x7fd218160310 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd214ff9640 1 -- 172.21.15.53:0/1713595895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210003ce0 con 0x7fd218160310 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2180afe60 con 0x7fd218160310 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd214ff9640 1 -- 172.21.15.53:0/1713595895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000aa30 con 0x7fd218160310 2024-09-13T18:29:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21813e1c0 con 0x7fd218160310 2024-09-13T18:29:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2180b0620 con 0x7fd218160310 2024-09-13T18:29:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd214ff9640 1 -- 172.21.15.53:0/1713595895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fd21000ab90 con 0x7fd218160310 2024-09-13T18:29:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd214ff9640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd2040669f0 0x7fd204068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd214ff9640 1 -- 172.21.15.53:0/1713595895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd2100845d0 con 0x7fd218160310 2024-09-13T18:29:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd217fff640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd2040669f0 0x7fd204068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.403+0000 7fd217fff640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd2040669f0 0x7fd204068eb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd21813c830 tx=0x7fd208008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.407+0000 7fd214ff9640 1 -- 172.21.15.53:0/1713595895 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2100513f0 con 0x7fd218160310 2024-09-13T18:29:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2181462f0 con 0x7fd218160310 2024-09-13T18:29:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd214ff9640 1 -- 172.21.15.53:0/1713595895 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd210054a10 con 0x7fd218160310 2024-09-13T18:29:42.565 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd2040669f0 msgr2=0x7fd204068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd2040669f0 0x7fd204068eb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd21813c830 tx=0x7fd208008040 comp rx=0 tx=0).stop 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218160310 msgr2=0x7fd2180b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218160310 0x7fd2180b0940 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd21000c730 tx=0x7fd21000cbf0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 shutdown_connections 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fd2040669f0 0x7fd204068eb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218160310 0x7fd2180b0940 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd218145f10 0x7fd2180cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 --2- 172.21.15.53:0/1713595895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd218065c80 0x7fd21813dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 >> 172.21.15.53:0/1713595895 conn(0x7fd218069f50 msgr2=0x7fd2180ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:42.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 shutdown_connections 2024-09-13T18:29:42.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.563+0000 7fd21e6f0640 1 -- 172.21.15.53:0/1713595895 wait complete. 2024-09-13T18:29:42.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dc5380640 1 Processor -- start 2024-09-13T18:29:42.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dc5380640 1 -- start start 2024-09-13T18:29:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dc5380640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2dc00cda30 0x7f2dc00cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dc5380640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc006f7a0 con 0x7f2dc00caee0 2024-09-13T18:29:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dc5380640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc006fd60 con 0x7f2dc0143e80 2024-09-13T18:29:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dc5380640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc006baa0 con 0x7f2dc00cda30 2024-09-13T18:29:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbe7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2dc00caee0 0x7f2dc00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38170/0 (socket says 172.21.15.53:38170) 2024-09-13T18:29:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbe7fc640 1 -- 172.21.15.53:0/2868623147 learned_addr learned my addr 172.21.15.53:0/2868623147 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbf7fe640 1 --2- 172.21.15.53:0/2868623147 >> v2:172.21.15.87:3300/0 conn(0x7f2dc00cda30 0x7f2dc00cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbdffb640 1 -- 172.21.15.53:0/2868623147 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576487766 0 0) 0x7f2dc006f7a0 con 0x7f2dc00caee0 2024-09-13T18:29:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbdffb640 1 -- 172.21.15.53:0/2868623147 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da8003530 con 0x7f2dc00caee0 2024-09-13T18:29:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbf7fe640 1 -- 172.21.15.53:0/2868623147 >> v1:172.21.15.87:6789/0 conn(0x7f2dc0143e80 legacy=0x7f2dc006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbf7fe640 1 -- 172.21.15.53:0/2868623147 >> v1:172.21.15.53:6789/0 conn(0x7f2dc00caee0 legacy=0x7f2dc00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.707+0000 7f2dbf7fe640 1 -- 172.21.15.53:0/2868623147 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00cb960 con 0x7f2dc00cda30 2024-09-13T18:29:42.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dbf7fe640 1 --2- 172.21.15.53:0/2868623147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00cda30 0x7f2dc00cb350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009d90 tx=0x7f2db801c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d608fd30784446e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dbdffb640 1 -- 172.21.15.53:0/2868623147 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80a58e0 con 0x7f2dc00cda30 2024-09-13T18:29:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dbdffb640 1 -- 172.21.15.53:0/2868623147 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db80a5a40 con 0x7f2dc00cda30 2024-09-13T18:29:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dbdffb640 1 -- 172.21.15.53:0/2868623147 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80a5dd0 con 0x7f2dc00cda30 2024-09-13T18:29:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dc5380640 1 -- 172.21.15.53:0/2868623147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00cda30 msgr2=0x7f2dc00cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dc5380640 1 --2- 172.21.15.53:0/2868623147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00cda30 0x7f2dc00cb350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009d90 tx=0x7f2db801c820 comp rx=0 tx=0).stop 2024-09-13T18:29:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dc5380640 1 -- 172.21.15.53:0/2868623147 shutdown_connections 2024-09-13T18:29:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dc5380640 1 --2- 172.21.15.53:0/2868623147 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00cda30 0x7f2dc00cb350 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dc5380640 1 -- 172.21.15.53:0/2868623147 >> 172.21.15.53:0/2868623147 conn(0x7f2dc0065c80 msgr2=0x7f2dc0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dc5380640 1 -- 172.21.15.53:0/2868623147 shutdown_connections 2024-09-13T18:29:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.711+0000 7f2dc5380640 1 -- 172.21.15.53:0/2868623147 wait complete. 2024-09-13T18:29:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 Processor -- start 2024-09-13T18:29:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 -- start start 2024-09-13T18:29:42.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00caee0 0x7f2dc0136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00cda30 0x7f2dc00b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dc0143e80 0x7f2dc0142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc013be70 con 0x7f2dc00cda30 2024-09-13T18:29:42.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc013b9e0 con 0x7f2dc00caee0 2024-09-13T18:29:42.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc013aaf0 con 0x7f2dc0143e80 2024-09-13T18:29:42.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00cda30 0x7f2dc00b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00cda30 0x7f2dc00b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57300/0 (socket says 172.21.15.53:57300) 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 -- 172.21.15.53:0/3627125541 learned_addr learned my addr 172.21.15.53:0/3627125541 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbf7fe640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dc0143e80 0x7f2dc0142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbeffd640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00caee0 0x7f2dc0136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 -- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dc0143e80 msgr2=0x7f2dc0142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dc0143e80 0x7f2dc0142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 -- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00caee0 msgr2=0x7f2dc0136d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00caee0 0x7f2dc0136d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 -- 172.21.15.53:0/3627125541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db8009a70 con 0x7f2dc00cda30 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dbe7fc640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00cda30 0x7f2dc00b0780 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c420 tx=0x7f2db400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2da77fe640 1 -- 172.21.15.53:0/3627125541 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4005cf0 con 0x7f2dc00cda30 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2da77fe640 1 -- 172.21.15.53:0/3627125541 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4005e50 con 0x7f2dc00cda30 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2da77fe640 1 -- 172.21.15.53:0/3627125541 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40072d0 con 0x7f2dc00cda30 2024-09-13T18:29:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc013add0 con 0x7f2dc00cda30 2024-09-13T18:29:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc013b390 con 0x7f2dc00cda30 2024-09-13T18:29:42.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc00cb350 con 0x7f2dc00cda30 2024-09-13T18:29:42.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2da77fe640 1 -- 172.21.15.53:0/3627125541 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f2db4007430 con 0x7f2dc00cda30 2024-09-13T18:29:42.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.715+0000 7f2da77fe640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dac0669f0 0x7f2dac068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:42.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.719+0000 7f2da77fe640 1 -- 172.21.15.53:0/3627125541 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2db4083ca0 con 0x7f2dc00cda30 2024-09-13T18:29:42.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.719+0000 7f2dbeffd640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dac0669f0 0x7f2dac068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:42.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.719+0000 7f2dbeffd640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dac0669f0 0x7f2dac068eb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2db00015b0 tx=0x7f2db0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:42.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.723+0000 7f2da77fe640 1 -- 172.21.15.53:0/3627125541 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2db4050bc0 con 0x7f2dc00cda30 2024-09-13T18:29:42.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.883+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2dc00680e0 con 0x7f2dc00cda30 2024-09-13T18:29:42.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.883+0000 7f2da77fe640 1 -- 172.21.15.53:0/3627125541 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2db4017020 con 0x7f2dc00cda30 2024-09-13T18:29:42.886 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dac0669f0 msgr2=0x7f2dac068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dac0669f0 0x7f2dac068eb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2db00015b0 tx=0x7f2db0009040 comp rx=0 tx=0).stop 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00cda30 msgr2=0x7f2dc00b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00cda30 0x7f2dc00b0780 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c420 tx=0x7f2db400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 shutdown_connections 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f2dac0669f0 0x7f2dac068eb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2dc0143e80 0x7f2dc0142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2dc00cda30 0x7f2dc00b0780 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 --2- 172.21.15.53:0/3627125541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dc00caee0 0x7f2dc0136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 >> 172.21.15.53:0/3627125541 conn(0x7f2dc0065c80 msgr2=0x7f2dc0156770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 shutdown_connections 2024-09-13T18:29:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:42.887+0000 7f2dc5380640 1 -- 172.21.15.53:0/3627125541 wait complete. 2024-09-13T18:29:42.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:29:43.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 Processor -- start 2024-09-13T18:29:43.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 -- start start 2024-09-13T18:29:43.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c40afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:43.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3c40b1960 0x7fb3c40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3c40b07f0 0x7fb3c40ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40ae1b0 con 0x7fb3c40b07f0 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40b0c20 con 0x7fb3c40b1960 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3cb762640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40ad530 con 0x7fb3c415db40 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3c9cff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3c40b07f0 0x7fb3c40ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3c9cff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3c40b07f0 0x7fb3c40ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57302/0 (socket says 172.21.15.53:57302) 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3c9cff640 1 -- 172.21.15.53:0/2874852092 learned_addr learned my addr 172.21.15.53:0/2874852092 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.015+0000 7fb3c8cfd640 1 --2- 172.21.15.53:0/2874852092 >> v2:172.21.15.87:3300/0 conn(0x7fb3c40b1960 0x7fb3c40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3c94fe640 1 --2- 172.21.15.53:0/2874852092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c40afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3c9cff640 1 -- 172.21.15.53:0/2874852092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 msgr2=0x7fb3c40afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3c9cff640 1 --2- 172.21.15.53:0/2874852092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c40afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3c9cff640 1 -- 172.21.15.53:0/2874852092 >> v2:172.21.15.87:3300/0 conn(0x7fb3c40b1960 msgr2=0x7fb3c40b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:43.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3c9cff640 1 --2- 172.21.15.53:0/2874852092 >> v2:172.21.15.87:3300/0 conn(0x7fb3c40b1960 0x7fb3c40b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3c9cff640 1 -- 172.21.15.53:0/2874852092 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40ad810 con 0x7fb3c40b07f0 2024-09-13T18:29:43.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3c9cff640 1 --2- 172.21.15.53:0/2874852092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b07f0 0x7fb3c40ce2c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4070fa0 tx=0x7fb3bc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9d22674c0ac0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:43.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2874852092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0a57b0 con 0x7fb3c40b07f0 2024-09-13T18:29:43.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2874852092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc0a5910 con 0x7fb3c40b07f0 2024-09-13T18:29:43.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2874852092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0a5ca0 con 0x7fb3c40b07f0 2024-09-13T18:29:43.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 -- 172.21.15.53:0/2874852092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b07f0 msgr2=0x7fb3c40ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:43.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 --2- 172.21.15.53:0/2874852092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b07f0 0x7fb3c40ce2c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4070fa0 tx=0x7fb3bc01c930 comp rx=0 tx=0).stop 2024-09-13T18:29:43.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 -- 172.21.15.53:0/2874852092 shutdown_connections 2024-09-13T18:29:43.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 --2- 172.21.15.53:0/2874852092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b07f0 0x7fb3c40ce2c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 --2- 172.21.15.53:0/2874852092 >> v2:172.21.15.87:3300/0 conn(0x7fb3c40b1960 0x7fb3c40b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 --2- 172.21.15.53:0/2874852092 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c40afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 -- 172.21.15.53:0/2874852092 >> 172.21.15.53:0/2874852092 conn(0x7fb3c40b20d0 msgr2=0x7fb3c40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:43.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 -- 172.21.15.53:0/2874852092 shutdown_connections 2024-09-13T18:29:43.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.019+0000 7fb3cb762640 1 -- 172.21.15.53:0/2874852092 wait complete. 2024-09-13T18:29:43.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 Processor -- start 2024-09-13T18:29:43.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 -- start start 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c40b07f0 0x7fb3c406ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b1960 0x7fb3c406dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c4069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c406bfb0 con 0x7fb3c40b1960 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c406a9d0 con 0x7fb3c40b07f0 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c406acb0 con 0x7fb3c415db40 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b1960 0x7fb3c406dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b1960 0x7fb3c406dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57304/0 (socket says 172.21.15.53:57304) 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 -- 172.21.15.53:0/1775608054 learned_addr learned my addr 172.21.15.53:0/1775608054 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c9cff640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c4069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c94fe640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c40b07f0 0x7fb3c406ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:43.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 -- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 msgr2=0x7fb3c4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c4069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 -- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c40b07f0 msgr2=0x7fb3c406ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c40b07f0 0x7fb3c406ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 -- 172.21.15.53:0/1775608054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc009b30 con 0x7fb3c40b1960 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c8cfd640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b1960 0x7fb3c406dd60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400d800 tx=0x7fb3b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3b9ffb640 1 -- 172.21.15.53:0/1775608054 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40096a0 con 0x7fb3c40b1960 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3b9ffb640 1 -- 172.21.15.53:0/1775608054 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4009800 con 0x7fb3c40b1960 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c406af90 con 0x7fb3c40b1960 2024-09-13T18:29:43.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3b9ffb640 1 -- 172.21.15.53:0/1775608054 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4009b70 con 0x7fb3c40b1960 2024-09-13T18:29:43.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c406b550 con 0x7fb3c40b1960 2024-09-13T18:29:43.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c406b6e0 con 0x7fb3c40b1960 2024-09-13T18:29:43.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3b9ffb640 1 -- 172.21.15.53:0/1775608054 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fb3b4009cd0 con 0x7fb3c40b1960 2024-09-13T18:29:43.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3b9ffb640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a80669f0 0x7fb3a8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:43.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3b9ffb640 1 -- 172.21.15.53:0/1775608054 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb3b4085310 con 0x7fb3c40b1960 2024-09-13T18:29:43.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.023+0000 7fb3c94fe640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a80669f0 0x7fb3a8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:43.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.027+0000 7fb3c94fe640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a80669f0 0x7fb3a8068eb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb3c41f8530 tx=0x7fb3c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.027+0000 7fb3b9ffb640 1 -- 172.21.15.53:0/1775608054 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3b4052470 con 0x7fb3c40b1960 2024-09-13T18:29:43.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.191+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb3c4073a10 con 0x7fb3c40b1960 2024-09-13T18:29:43.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3b9ffb640 1 -- 172.21.15.53:0/1775608054 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb3b4055a90 con 0x7fb3c40b1960 2024-09-13T18:29:43.196 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:29:43.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a80669f0 msgr2=0x7fb3a8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a80669f0 0x7fb3a8068eb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb3c41f8530 tx=0x7fb3c0008040 comp rx=0 tx=0).stop 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b1960 msgr2=0x7fb3c406dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b1960 0x7fb3c406dd60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400d800 tx=0x7fb3b400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 shutdown_connections 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb3a80669f0 0x7fb3a8068eb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3c415db40 0x7fb3c4069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b1960 0x7fb3c406dd60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 --2- 172.21.15.53:0/1775608054 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3c40b07f0 0x7fb3c406ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 >> 172.21.15.53:0/1775608054 conn(0x7fb3c40b20d0 msgr2=0x7fb3c40caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 shutdown_connections 2024-09-13T18:29:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:43.195+0000 7fb3cb762640 1 -- 172.21.15.53:0/1775608054 wait complete. 2024-09-13T18:29:43.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:29:43.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:43.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:29:43.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[45085]: fuse finished with error 0 and tester_r 0 2024-09-13T18:29:43.225 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:49.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:29:49.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:49.327 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:29:49.336 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:29:49.336 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:49.342 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:49.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 Processor -- start 2024-09-13T18:29:49.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 -- start start 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18b015cab0 0x7f18b00d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b00cd6c0 0x7f18b00cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18b00cdb00 0x7f18b00cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00d2400 con 0x7f18b00cdb00 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00d1530 con 0x7f18b015cab0 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18b4c79640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00d0920 con 0x7f18b00cd6c0 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18b00cdb00 0x7f18b00cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18b00cdb00 0x7f18b00cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40262/0 (socket says 172.21.15.53:40262) 2024-09-13T18:29:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 -- 172.21.15.53:0/1191711573 learned_addr learned my addr 172.21.15.53:0/1191711573 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18add9b640 1 --2- 172.21.15.53:0/1191711573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b00cd6c0 0x7f18b00cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18ae59c640 1 --2- 172.21.15.53:0/1191711573 >> v2:172.21.15.87:3300/0 conn(0x7f18b015cab0 0x7f18b00d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 -- 172.21.15.53:0/1191711573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b00cd6c0 msgr2=0x7f18b00cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 --2- 172.21.15.53:0/1191711573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b00cd6c0 0x7f18b00cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 -- 172.21.15.53:0/1191711573 >> v2:172.21.15.87:3300/0 conn(0x7f18b015cab0 msgr2=0x7f18b00d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 --2- 172.21.15.53:0/1191711573 >> v2:172.21.15.87:3300/0 conn(0x7f18b015cab0 0x7f18b00d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.511+0000 7f18aed9d640 1 -- 172.21.15.53:0/1191711573 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00d0c00 con 0x7f18b00cdb00 2024-09-13T18:29:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18aed9d640 1 --2- 172.21.15.53:0/1191711573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b00cf600 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f18b0066930 tx=0x7f18a801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e3cdadda1a8cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18ad59a640 1 -- 172.21.15.53:0/1191711573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80a5840 con 0x7f18b00cdb00 2024-09-13T18:29:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18ad59a640 1 -- 172.21.15.53:0/1191711573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80a59a0 con 0x7f18b00cdb00 2024-09-13T18:29:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18ad59a640 1 -- 172.21.15.53:0/1191711573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80a5d30 con 0x7f18b00cdb00 2024-09-13T18:29:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 -- 172.21.15.53:0/1191711573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 msgr2=0x7f18b00cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 --2- 172.21.15.53:0/1191711573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b00cf600 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f18b0066930 tx=0x7f18a801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 -- 172.21.15.53:0/1191711573 shutdown_connections 2024-09-13T18:29:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 --2- 172.21.15.53:0/1191711573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b00cd6c0 0x7f18b00cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 --2- 172.21.15.53:0/1191711573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b00cf600 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 --2- 172.21.15.53:0/1191711573 >> v2:172.21.15.87:3300/0 conn(0x7f18b015cab0 0x7f18b00d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 -- 172.21.15.53:0/1191711573 >> 172.21.15.53:0/1191711573 conn(0x7f18b0065c80 msgr2=0x7f18b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:49.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 -- 172.21.15.53:0/1191711573 shutdown_connections 2024-09-13T18:29:49.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.515+0000 7f18b4c79640 1 -- 172.21.15.53:0/1191711573 wait complete. 2024-09-13T18:29:49.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 Processor -- start 2024-09-13T18:29:49.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 -- start start 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b00cd6c0 0x7f18b00b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b015cab0 0x7f18b015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b015d550 con 0x7f18b00cdb00 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b015d830 con 0x7f18b00cd6c0 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b015db10 con 0x7f18b015cab0 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b015e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40274/0 (socket says 172.21.15.53:40274) 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 -- 172.21.15.53:0/3369410898 learned_addr learned my addr 172.21.15.53:0/3369410898 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18aed9d640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b015cab0 0x7f18b015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18ae59c640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b00cd6c0 0x7f18b00b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 -- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b015cab0 msgr2=0x7f18b015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b015cab0 0x7f18b015ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 -- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b00cd6c0 msgr2=0x7f18b00b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b00cd6c0 0x7f18b00b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 -- 172.21.15.53:0/3369410898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009b30 con 0x7f18b00cdb00 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18add9b640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b015e8d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f18a400d7d0 tx=0x7f18a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f189effd640 1 -- 172.21.15.53:0/3369410898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4004020 con 0x7f18b00cdb00 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f189effd640 1 -- 172.21.15.53:0/3369410898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4004180 con 0x7f18b00cdb00 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b015ddf0 con 0x7f18b00cdb00 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f189effd640 1 -- 172.21.15.53:0/3369410898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4004330 con 0x7f18b00cdb00 2024-09-13T18:29:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b015e3b0 con 0x7f18b00cdb00 2024-09-13T18:29:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b00d19a0 con 0x7f18b00cdb00 2024-09-13T18:29:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.519+0000 7f189effd640 1 -- 172.21.15.53:0/3369410898 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f18a40096a0 con 0x7f18b00cdb00 2024-09-13T18:29:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.523+0000 7f189effd640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f18900669f0 0x7f1890068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.523+0000 7f189effd640 1 -- 172.21.15.53:0/3369410898 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f18a40849d0 con 0x7f18b00cdb00 2024-09-13T18:29:49.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.523+0000 7f18ae59c640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f18900669f0 0x7f1890068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.523+0000 7f18ae59c640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f18900669f0 0x7f1890068eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009a50 tx=0x7f18a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.527+0000 7f189effd640 1 -- 172.21.15.53:0/3369410898 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18a4051940 con 0x7f18b00cdb00 2024-09-13T18:29:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.683+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b015d030 con 0x7f18b00cdb00 2024-09-13T18:29:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.683+0000 7f189effd640 1 -- 172.21.15.53:0/3369410898 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f18a4054f60 con 0x7f18b00cdb00 2024-09-13T18:29:49.687 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:49.687 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:40.258533+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f18900669f0 msgr2=0x7f1890068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f18900669f0 0x7f1890068eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009a50 tx=0x7f18a0008040 comp rx=0 tx=0).stop 2024-09-13T18:29:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 msgr2=0x7f18b015e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b015e8d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f18a400d7d0 tx=0x7f18a400dc90 comp rx=0 tx=0).stop 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 shutdown_connections 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f18900669f0 0x7f1890068eb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18b015cab0 0x7f18b015ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18b00cdb00 0x7f18b015e8d0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 --2- 172.21.15.53:0/3369410898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18b00cd6c0 0x7f18b00b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 >> 172.21.15.53:0/3369410898 conn(0x7f18b0065c80 msgr2=0x7f18b00cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 shutdown_connections 2024-09-13T18:29:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.687+0000 7f18b4c79640 1 -- 172.21.15.53:0/3369410898 wait complete. 2024-09-13T18:29:49.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:19.948503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:21.156674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:49.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ec5f4e640 1 Processor -- start 2024-09-13T18:29:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ec5f4e640 1 -- start start 2024-09-13T18:29:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ec5f4e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 0x7f0ec00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ec5f4e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ec00ced50 0x7f0ec00b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ec5f4e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00ccd60 con 0x7f0ec00ccf10 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ec5f4e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00cc190 con 0x7f0ec00ced50 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ec5f4e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00ce270 con 0x7f0ec00b2bf0 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebf7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0ec00ccf10 0x7f0ec00cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60722/0 (socket says 172.21.15.53:60722) 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebf7fe640 1 -- 172.21.15.53:0/867801782 learned_addr learned my addr 172.21.15.53:0/867801782 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebffff640 1 --2- 172.21.15.53:0/867801782 >> v2:172.21.15.87:3300/0 conn(0x7f0ec00ced50 0x7f0ec00b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebeffd640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 0x7f0ec00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801017063 0 0) 0x7f0ec00ccd60 con 0x7f0ec00ccf10 2024-09-13T18:29:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8003530 con 0x7f0ec00ccf10 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3857062209 0 0) 0x7f0ea8003530 con 0x7f0ec00ccf10 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 msgr2=0x7f0ec00cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 0x7f0ec00cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 >> v2:172.21.15.87:3300/0 conn(0x7f0ec00ced50 msgr2=0x7f0ec00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 --2- 172.21.15.53:0/867801782 >> v2:172.21.15.87:3300/0 conn(0x7f0ec00ced50 0x7f0ec00b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00ce550 con 0x7f0ec00ccf10 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0eb0001680 con 0x7f0ec00ccf10 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 >> v1:172.21.15.53:6789/0 conn(0x7f0ec00ccf10 legacy=0x7f0ec00cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8003980 0x7f0ea8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 0x7f0ea80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cc190 con 0x7f0ea8004d10 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00ce270 con 0x7f0ea8003980 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea800b9c0 con 0x7f0ec00b2bf0 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebffff640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebf7fe640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8003980 0x7f0ea8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebeffd640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 0x7f0ea80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebffff640 1 -- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 msgr2=0x7f0ea80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebffff640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00b2bf0 0x7f0ea80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebffff640 1 -- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8003980 msgr2=0x7f0ea8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebffff640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ea8003980 0x7f0ea8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.831+0000 7f0ebffff640 1 -- 172.21.15.53:0/867801782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8003530 con 0x7f0ea8004d10 2024-09-13T18:29:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ebffff640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009fc0 tx=0x7f0eb801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d689abbaf6afc19b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80a5bc0 con 0x7f0ea8004d10 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800f040 con 0x7f0ea8004d10 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ebe7fc640 1 -- 172.21.15.53:0/867801782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80ad440 con 0x7f0ea8004d10 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/867801782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8004d10 msgr2=0x7f0ea8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ec5f4e640 1 --2- 172.21.15.53:0/867801782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8004d10 0x7f0ea8005190 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009fc0 tx=0x7f0eb801ccc0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ebffff640 1 -- 172.21.15.53:0/867801782 reap_dead start 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/867801782 shutdown_connections 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/867801782 >> 172.21.15.53:0/867801782 conn(0x7f0ec00b20d0 msgr2=0x7f0ec00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/867801782 shutdown_connections 2024-09-13T18:29:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.835+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/867801782 wait complete. 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 Processor -- start 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 -- start start 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00c4920 0x7f0ec0159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec00b44d0 0x7f0ec0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ec00c3460 0x7f0ec01f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec015a080 con 0x7f0ec00c3460 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec009e320 con 0x7f0ec00b44d0 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec009e040 con 0x7f0ec00c4920 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ec00c3460 0x7f0ec01f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ec00c3460 0x7f0ec01f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40294/0 (socket says 172.21.15.53:40294) 2024-09-13T18:29:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 -- 172.21.15.53:0/3341274223 learned_addr learned my addr 172.21.15.53:0/3341274223 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebf7fe640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00c4920 0x7f0ec0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebeffd640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec00b44d0 0x7f0ec0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 -- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00c4920 msgr2=0x7f0ec0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00c4920 0x7f0ec0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 -- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec00b44d0 msgr2=0x7f0ec0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec00b44d0 0x7f0ec0159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 -- 172.21.15.53:0/3341274223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec006a080 con 0x7f0ec00c3460 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebeffd640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec00b44d0 0x7f0ec0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ebffff640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ec00c3460 0x7f0ec01f57b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80b0040 tx=0x7f0eb8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ea7fff640 1 -- 172.21.15.53:0/3341274223 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80039a0 con 0x7f0ec00c3460 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ea7fff640 1 -- 172.21.15.53:0/3341274223 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb8003b20 con 0x7f0ec00c3460 2024-09-13T18:29:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec006a360 con 0x7f0ec00c3460 2024-09-13T18:29:49.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ea7fff640 1 -- 172.21.15.53:0/3341274223 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80ae890 con 0x7f0ec00c3460 2024-09-13T18:29:49.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec00c3f20 con 0x7f0ec00c3460 2024-09-13T18:29:49.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec006a810 con 0x7f0ec00c3460 2024-09-13T18:29:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.839+0000 7f0ea7fff640 1 -- 172.21.15.53:0/3341274223 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f0eb80b4040 con 0x7f0ec00c3460 2024-09-13T18:29:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.843+0000 7f0ea7fff640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eac0669f0 0x7f0eac068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.843+0000 7f0ea7fff640 1 -- 172.21.15.53:0/3341274223 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0eb811e4b0 con 0x7f0ec00c3460 2024-09-13T18:29:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.843+0000 7f0ebf7fe640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eac0669f0 0x7f0eac068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.843+0000 7f0ebf7fe640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eac0669f0 0x7f0eac068eb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000c10 tx=0x7f0eb0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:49.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:49.847+0000 7f0ea7fff640 1 -- 172.21.15.53:0/3341274223 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0eb80eb3d0 con 0x7f0ec00c3460 2024-09-13T18:29:50.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.007+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ec0066a00 con 0x7f0ec00c3460 2024-09-13T18:29:50.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.007+0000 7f0ea7fff640 1 -- 172.21.15.53:0/3341274223 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0eb80ee9f0 con 0x7f0ec00c3460 2024-09-13T18:29:50.009 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:50.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eac0669f0 msgr2=0x7f0eac068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eac0669f0 0x7f0eac068eb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000c10 tx=0x7f0eb0009040 comp rx=0 tx=0).stop 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ec00c3460 msgr2=0x7f0ec01f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ec00c3460 0x7f0ec01f57b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80b0040 tx=0x7f0eb8009750 comp rx=0 tx=0).stop 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 shutdown_connections 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f0eac0669f0 0x7f0eac068eb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ec00c3460 0x7f0ec01f57b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ec00b44d0 0x7f0ec0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 --2- 172.21.15.53:0/3341274223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ec00c4920 0x7f0ec0159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 >> 172.21.15.53:0/3341274223 conn(0x7f0ec00b20d0 msgr2=0x7f0ec00cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 shutdown_connections 2024-09-13T18:29:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.011+0000 7f0ec5f4e640 1 -- 172.21.15.53:0/3341274223 wait complete. 2024-09-13T18:29:50.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:50.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb746bf640 1 Processor -- start 2024-09-13T18:29:50.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb746bf640 1 -- start start 2024-09-13T18:29:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb746bf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb746bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb6c06ff40 0x7ffb6c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb746bf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c06bc20 con 0x7ffb6c158ba0 2024-09-13T18:29:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb746bf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6c06c530 con 0x7ffb6c06ff40 2024-09-13T18:29:50.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb746bf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0708b0 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb72c5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb6c06ff40 0x7ffb6c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb72c5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb6c06ff40 0x7ffb6c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40308/0 (socket says 172.21.15.53:40308) 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb72c5c640 1 -- 172.21.15.53:0/3860257110 learned_addr learned my addr 172.21.15.53:0/3860257110 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb71c5a640 1 --2- 172.21.15.53:0/3860257110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb72c5c640 1 -- 172.21.15.53:0/3860257110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b1dd0 msgr2=0x7ffb6c0b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb72c5c640 1 --2- 172.21.15.53:0/3860257110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb72c5c640 1 -- 172.21.15.53:0/3860257110 >> v1:172.21.15.87:6789/0 conn(0x7ffb6c158ba0 legacy=0x7ffb6c0cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.155+0000 7ffb72c5c640 1 -- 172.21.15.53:0/3860257110 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c158f80 con 0x7ffb6c06ff40 2024-09-13T18:29:50.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb72c5c640 1 --2- 172.21.15.53:0/3860257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c06ff40 0x7ffb6c070370 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400d150 tx=0x7ffb6401eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff346eee99f03600 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71459640 1 -- 172.21.15.53:0/3860257110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400b2d0 con 0x7ffb6c06ff40 2024-09-13T18:29:50.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71459640 1 -- 172.21.15.53:0/3860257110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6400b430 con 0x7ffb6c06ff40 2024-09-13T18:29:50.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71459640 1 -- 172.21.15.53:0/3860257110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640a7b50 con 0x7ffb6c06ff40 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- 172.21.15.53:0/3860257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c06ff40 msgr2=0x7ffb6c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 --2- 172.21.15.53:0/3860257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c06ff40 0x7ffb6c070370 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400d150 tx=0x7ffb6401eae0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- 172.21.15.53:0/3860257110 shutdown_connections 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 --2- 172.21.15.53:0/3860257110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c06ff40 0x7ffb6c070370 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 --2- 172.21.15.53:0/3860257110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- 172.21.15.53:0/3860257110 >> 172.21.15.53:0/3860257110 conn(0x7ffb6c065c80 msgr2=0x7ffb6c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- 172.21.15.53:0/3860257110 shutdown_connections 2024-09-13T18:29:50.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- 172.21.15.53:0/3860257110 wait complete. 2024-09-13T18:29:50.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 Processor -- start 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- start start 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c06ff40 0x7ffb6c145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c158ba0 0x7ffb6c0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c15ddc0 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c15e370 con 0x7ffb6c158ba0 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb746bf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c1463e0 con 0x7ffb6c06ff40 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40324/0 (socket says 172.21.15.53:40324) 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 -- 172.21.15.53:0/194136508 learned_addr learned my addr 172.21.15.53:0/194136508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 -- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c06ff40 msgr2=0x7ffb6c145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb72c5c640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c158ba0 0x7ffb6c0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb7245b640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c06ff40 0x7ffb6c145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c06ff40 0x7ffb6c145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 -- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c158ba0 msgr2=0x7ffb6c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c158ba0 0x7ffb6c0cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 -- 172.21.15.53:0/194136508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6400bd40 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb72c5c640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c158ba0 0x7ffb6c0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.159+0000 7ffb71c5a640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0ccb40 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00d830 tx=0x7ffb5c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb62ffd640 1 -- 172.21.15.53:0/194136508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00b6c0 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb62ffd640 1 -- 172.21.15.53:0/194136508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c00b860 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb62ffd640 1 -- 172.21.15.53:0/194136508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c00bc10 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c15e610 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c1633a0 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c15e7a0 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb62ffd640 1 -- 172.21.15.53:0/194136508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7ffb5c01e460 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb62ffd640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ffb500669f0 0x7ffb50068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb62ffd640 1 -- 172.21.15.53:0/194136508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffb5c084ec0 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb7245b640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ffb500669f0 0x7ffb50068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.163+0000 7ffb7245b640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ffb500669f0 0x7ffb50068eb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffb68007fd0 tx=0x7ffb68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.167+0000 7ffb62ffd640 1 -- 172.21.15.53:0/194136508 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb5c051de0 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.327+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb6c070370 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.327+0000 7ffb62ffd640 1 -- 172.21.15.53:0/194136508 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb5c055400 con 0x7ffb6c0b1dd0 2024-09-13T18:29:50.331 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:29:50.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ffb500669f0 msgr2=0x7ffb50068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ffb500669f0 0x7ffb50068eb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffb68007fd0 tx=0x7ffb68009040 comp rx=0 tx=0).stop 2024-09-13T18:29:50.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c0b1dd0 msgr2=0x7ffb6c0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0ccb40 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00d830 tx=0x7ffb5c00dcf0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 shutdown_connections 2024-09-13T18:29:50.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ffb500669f0 0x7ffb50068eb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c158ba0 0x7ffb6c0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb6c0b1dd0 0x7ffb6c0ccb40 secure :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00d830 tx=0x7ffb5c00dcf0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 --2- 172.21.15.53:0/194136508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb6c06ff40 0x7ffb6c145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 >> 172.21.15.53:0/194136508 conn(0x7ffb6c065c80 msgr2=0x7ffb6c15a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:50.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 shutdown_connections 2024-09-13T18:29:50.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.331+0000 7ffb746bf640 1 -- 172.21.15.53:0/194136508 wait complete. 2024-09-13T18:29:50.350 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:50.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.475+0000 7ff87afdf640 1 Processor -- start 2024-09-13T18:29:50.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.475+0000 7ff87afdf640 1 -- start start 2024-09-13T18:29:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87afdf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff87406d440 0x7ff874163e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87afdf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740715f0 con 0x7ff874156c40 2024-09-13T18:29:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87afdf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740b15a0 con 0x7ff874157020 2024-09-13T18:29:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87afdf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff874070340 con 0x7ff87406d440 2024-09-13T18:29:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87957c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff87406d440 0x7ff874163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff878d7b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff874156c40 0x7ff874070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60730/0 (socket says 172.21.15.53:60730) 2024-09-13T18:29:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff878d7b640 1 -- 172.21.15.53:0/891172900 learned_addr learned my addr 172.21.15.53:0/891172900 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:50.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87957c640 1 -- 172.21.15.53:0/891172900 >> v1:172.21.15.87:6789/0 conn(0x7ff874157020 legacy=0x7ff87406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87957c640 1 -- 172.21.15.53:0/891172900 >> v1:172.21.15.53:6789/0 conn(0x7ff874156c40 legacy=0x7ff874070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.479+0000 7ff87957c640 1 -- 172.21.15.53:0/891172900 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740b1880 con 0x7ff87406d440 2024-09-13T18:29:50.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87957c640 1 --2- 172.21.15.53:0/891172900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874163e90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009dc0 tx=0x7ff86c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94a79df0be818e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff8737fe640 1 -- 172.21.15.53:0/891172900 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0a59e0 con 0x7ff87406d440 2024-09-13T18:29:50.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff8737fe640 1 -- 172.21.15.53:0/891172900 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c0a5b40 con 0x7ff87406d440 2024-09-13T18:29:50.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff8737fe640 1 -- 172.21.15.53:0/891172900 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0ad440 con 0x7ff87406d440 2024-09-13T18:29:50.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- 172.21.15.53:0/891172900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 msgr2=0x7ff874163e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 --2- 172.21.15.53:0/891172900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874163e90 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009dc0 tx=0x7ff86c01c920 comp rx=0 tx=0).stop 2024-09-13T18:29:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- 172.21.15.53:0/891172900 shutdown_connections 2024-09-13T18:29:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 --2- 172.21.15.53:0/891172900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874163e90 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- 172.21.15.53:0/891172900 >> 172.21.15.53:0/891172900 conn(0x7ff874065c80 msgr2=0x7ff874066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- 172.21.15.53:0/891172900 shutdown_connections 2024-09-13T18:29:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- 172.21.15.53:0/891172900 wait complete. 2024-09-13T18:29:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 Processor -- start 2024-09-13T18:29:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- start start 2024-09-13T18:29:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff874156c40 0x7ff87414c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8740ad0d0 0x7ff87414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740ad650 con 0x7ff87406d440 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87415c880 con 0x7ff874156c40 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87afdf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87415bcb0 con 0x7ff8740ad0d0 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874141000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40332/0 (socket says 172.21.15.53:40332) 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 -- 172.21.15.53:0/4228752134 learned_addr learned my addr 172.21.15.53:0/4228752134 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff873fff640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff874156c40 0x7ff87414c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff87957c640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8740ad0d0 0x7ff87414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 -- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8740ad0d0 msgr2=0x7ff87414ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8740ad0d0 0x7ff87414ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 -- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff874156c40 msgr2=0x7ff87414c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff874156c40 0x7ff87414c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 -- 172.21.15.53:0/4228752134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009a70 con 0x7ff87406d440 2024-09-13T18:29:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff873fff640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff874156c40 0x7ff87414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:50.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.483+0000 7ff878d7b640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874141000 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c530 tx=0x7ff86400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff8717fa640 1 -- 172.21.15.53:0/4228752134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864005cf0 con 0x7ff87406d440 2024-09-13T18:29:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff8717fa640 1 -- 172.21.15.53:0/4228752134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864005e50 con 0x7ff87406d440 2024-09-13T18:29:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87415bf50 con 0x7ff87406d440 2024-09-13T18:29:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff8717fa640 1 -- 172.21.15.53:0/4228752134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864007270 con 0x7ff87406d440 2024-09-13T18:29:50.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87415c510 con 0x7ff87406d440 2024-09-13T18:29:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff874070ee0 con 0x7ff87406d440 2024-09-13T18:29:50.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff8717fa640 1 -- 172.21.15.53:0/4228752134 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7ff8640073d0 con 0x7ff87406d440 2024-09-13T18:29:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff8717fa640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff860066a20 0x7ff860068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff8717fa640 1 -- 172.21.15.53:0/4228752134 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff864083c90 con 0x7ff87406d440 2024-09-13T18:29:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff873fff640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff860066a20 0x7ff860068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.487+0000 7ff873fff640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff860066a20 0x7ff860068ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff87414d5a0 tx=0x7ff868009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.491+0000 7ff8717fa640 1 -- 172.21.15.53:0/4228752134 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff864050ad0 con 0x7ff87406d440 2024-09-13T18:29:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.647+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8741472b0 con 0x7ff87406d440 2024-09-13T18:29:50.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.647+0000 7ff8717fa640 1 -- 172.21.15.53:0/4228752134 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff864017070 con 0x7ff87406d440 2024-09-13T18:29:50.651 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff860066a20 msgr2=0x7ff860068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff860066a20 0x7ff860068ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff87414d5a0 tx=0x7ff868009040 comp rx=0 tx=0).stop 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 msgr2=0x7ff874141000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874141000 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c530 tx=0x7ff86400c9f0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 shutdown_connections 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7ff860066a20 0x7ff860068ee0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8740ad0d0 0x7ff87414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff874156c40 0x7ff87414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 --2- 172.21.15.53:0/4228752134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87406d440 0x7ff874141000 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 >> 172.21.15.53:0/4228752134 conn(0x7ff874065c80 msgr2=0x7ff87406c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:50.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 shutdown_connections 2024-09-13T18:29:50.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.651+0000 7ff87afdf640 1 -- 172.21.15.53:0/4228752134 wait complete. 2024-09-13T18:29:50.668 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:29:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e62d4f640 1 Processor -- start 2024-09-13T18:29:50.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e62d4f640 1 -- start start 2024-09-13T18:29:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e62d4f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e5c0cb980 0x7f8e5c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e62d4f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e5c0cbd60 0x7f8e5c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e62d4f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0b1ac0 con 0x7f8e5c06b850 2024-09-13T18:29:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e62d4f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c0b3010 con 0x7f8e5c0cb980 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e62d4f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c159ac0 con 0x7f8e5c0cbd60 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e60aeb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e5c0cb980 0x7f8e5c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e60aeb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e5c0cb980 0x7f8e5c0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40346/0 (socket says 172.21.15.53:40346) 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e60aeb640 1 -- 172.21.15.53:0/204214011 learned_addr learned my addr 172.21.15.53:0/204214011 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e612ec640 1 --2- 172.21.15.53:0/204214011 >> v2:172.21.15.87:3300/0 conn(0x7f8e5c0cbd60 0x7f8e5c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e60aeb640 1 -- 172.21.15.53:0/204214011 >> v2:172.21.15.87:3300/0 conn(0x7f8e5c0cbd60 msgr2=0x7f8e5c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e60aeb640 1 --2- 172.21.15.53:0/204214011 >> v2:172.21.15.87:3300/0 conn(0x7f8e5c0cbd60 0x7f8e5c0cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e60aeb640 1 -- 172.21.15.53:0/204214011 >> v1:172.21.15.87:6789/0 conn(0x7f8e5c06b850 legacy=0x7f8e5c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.779+0000 7f8e60aeb640 1 -- 172.21.15.53:0/204214011 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c159da0 con 0x7f8e5c0cb980 2024-09-13T18:29:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e60aeb640 1 --2- 172.21.15.53:0/204214011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c0b33b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0709a0 tx=0x7f8e4c01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7929b6b95ecbfa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e5b7fe640 1 -- 172.21.15.53:0/204214011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00b2d0 con 0x7f8e5c0cb980 2024-09-13T18:29:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e5b7fe640 1 -- 172.21.15.53:0/204214011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00b430 con 0x7f8e5c0cb980 2024-09-13T18:29:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e5b7fe640 1 -- 172.21.15.53:0/204214011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0a7be0 con 0x7f8e5c0cb980 2024-09-13T18:29:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- 172.21.15.53:0/204214011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 msgr2=0x7f8e5c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/204214011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c0b33b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0709a0 tx=0x7f8e4c01eaf0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- 172.21.15.53:0/204214011 shutdown_connections 2024-09-13T18:29:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/204214011 >> v2:172.21.15.87:3300/0 conn(0x7f8e5c0cbd60 0x7f8e5c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/204214011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c0b33b0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- 172.21.15.53:0/204214011 >> 172.21.15.53:0/204214011 conn(0x7f8e5c065c80 msgr2=0x7f8e5c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- 172.21.15.53:0/204214011 shutdown_connections 2024-09-13T18:29:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- 172.21.15.53:0/204214011 wait complete. 2024-09-13T18:29:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 Processor -- start 2024-09-13T18:29:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- start start 2024-09-13T18:29:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e5c06b850 0x7f8e5c146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e5c0cbd60 0x7f8e5c1624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c151e10 con 0x7f8e5c0cb980 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c146dc0 con 0x7f8e5c0cbd60 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.783+0000 7f8e62d4f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1f4850 con 0x7f8e5c06b850 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40354/0 (socket says 172.21.15.53:40354) 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 -- 172.21.15.53:0/1670628806 learned_addr learned my addr 172.21.15.53:0/1670628806 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e60aeb640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e5c06b850 0x7f8e5c146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e612ec640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e5c0cbd60 0x7f8e5c1624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 -- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e5c06b850 msgr2=0x7f8e5c146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e5c06b850 0x7f8e5c146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 -- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e5c0cbd60 msgr2=0x7f8e5c1624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e5c0cbd60 0x7f8e5c1624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 -- 172.21.15.53:0/1670628806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c00bd40 con 0x7f8e5c0cb980 2024-09-13T18:29:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e612ec640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e5c0cbd60 0x7f8e5c1624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e60aeb640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e5c06b850 0x7f8e5c146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e5bfff640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c150a40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b440 tx=0x7f8e5000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e597fa640 1 -- 172.21.15.53:0/1670628806 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011890 con 0x7f8e5c0cb980 2024-09-13T18:29:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e597fa640 1 -- 172.21.15.53:0/1670628806 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e500119f0 con 0x7f8e5c0cb980 2024-09-13T18:29:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c14a480 con 0x7f8e5c0cb980 2024-09-13T18:29:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e597fa640 1 -- 172.21.15.53:0/1670628806 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e50011da0 con 0x7f8e5c0cb980 2024-09-13T18:29:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c151850 con 0x7f8e5c0cb980 2024-09-13T18:29:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c067400 con 0x7f8e5c0cb980 2024-09-13T18:29:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e597fa640 1 -- 172.21.15.53:0/1670628806 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f8e5001a400 con 0x7f8e5c0cb980 2024-09-13T18:29:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e597fa640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e480669f0 0x7f8e48068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e597fa640 1 -- 172.21.15.53:0/1670628806 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8e50084b30 con 0x7f8e5c0cb980 2024-09-13T18:29:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e60aeb640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e480669f0 0x7f8e48068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.787+0000 7f8e60aeb640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e480669f0 0x7f8e48068eb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0b0000 tx=0x7f8e4c0a9070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.791+0000 7f8e597fa640 1 -- 172.21.15.53:0/1670628806 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e50051a70 con 0x7f8e5c0cb980 2024-09-13T18:29:50.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8e5c0679b0 con 0x7f8e5c0cb980 2024-09-13T18:29:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e597fa640 1 -- 172.21.15.53:0/1670628806 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8e50015020 con 0x7f8e5c0cb980 2024-09-13T18:29:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:29:50.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e480669f0 msgr2=0x7f8e48068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e480669f0 0x7f8e48068eb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0b0000 tx=0x7f8e4c0a9070 comp rx=0 tx=0).stop 2024-09-13T18:29:50.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 msgr2=0x7f8e5c150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c150a40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b440 tx=0x7f8e5000b900 comp rx=0 tx=0).stop 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 shutdown_connections 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f8e480669f0 0x7f8e48068eb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e5c0cbd60 0x7f8e5c1624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c0cb980 0x7f8e5c150a40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 --2- 172.21.15.53:0/1670628806 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8e5c06b850 0x7f8e5c146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 >> 172.21.15.53:0/1670628806 conn(0x7f8e5c065c80 msgr2=0x7f8e5c0ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 shutdown_connections 2024-09-13T18:29:50.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:50.963+0000 7f8e62d4f640 1 -- 172.21.15.53:0/1670628806 wait complete. 2024-09-13T18:29:50.983 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:29:50.983 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:29:50.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:29:51.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.107+0000 7f48a8b71640 1 Processor -- start 2024-09-13T18:29:51.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.107+0000 7f48a8b71640 1 -- start start 2024-09-13T18:29:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a8b71640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48a40cd630 0x7f48a40b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a8b71640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40b1af0 0x7f48a4069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a8b71640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40cfe80 con 0x7f48a406a490 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a8b71640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40d0120 con 0x7f48a40cd630 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a8b71640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a406ac20 con 0x7f48a40b1af0 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a2d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f48a406a490 0x7f48a40ad3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60736/0 (socket says 172.21.15.53:60736) 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a2d9d640 1 -- 172.21.15.53:0/1444782238 learned_addr learned my addr 172.21.15.53:0/1444782238 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a259c640 1 --2- 172.21.15.53:0/1444782238 >> v2:172.21.15.53:3300/0 conn(0x7f48a40cd630 0x7f48a40b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a1d9b640 1 --2- 172.21.15.53:0/1444782238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40b1af0 0x7f48a4069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a159a640 1 -- 172.21.15.53:0/1444782238 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326670699 0 0) 0x7f48a40cfe80 con 0x7f48a406a490 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a159a640 1 -- 172.21.15.53:0/1444782238 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f488c003530 con 0x7f48a406a490 2024-09-13T18:29:51.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a259c640 1 -- 172.21.15.53:0/1444782238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40b1af0 msgr2=0x7f48a4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a259c640 1 --2- 172.21.15.53:0/1444782238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40b1af0 0x7f48a4069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a259c640 1 -- 172.21.15.53:0/1444782238 >> v1:172.21.15.53:6789/0 conn(0x7f48a406a490 legacy=0x7f48a40ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a159a640 1 -- 172.21.15.53:0/1444782238 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3970980122 0 0) 0x7f488c003530 con 0x7f48a406a490 2024-09-13T18:29:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a259c640 1 -- 172.21.15.53:0/1444782238 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a406af00 con 0x7f48a40cd630 2024-09-13T18:29:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a259c640 1 --2- 172.21.15.53:0/1444782238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a40cd630 0x7f48a40b0cf0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f48940097c0 tx=0x7f489401c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd639b15375f7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a159a640 1 -- 172.21.15.53:0/1444782238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c001a00 con 0x7f48a40cd630 2024-09-13T18:29:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a159a640 1 -- 172.21.15.53:0/1444782238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48940a7050 con 0x7f48a40cd630 2024-09-13T18:29:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.111+0000 7f48a159a640 1 -- 172.21.15.53:0/1444782238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940ab620 con 0x7f48a40cd630 2024-09-13T18:29:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/1444782238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a40cd630 msgr2=0x7f48a40b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 --2- 172.21.15.53:0/1444782238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a40cd630 0x7f48a40b0cf0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f48940097c0 tx=0x7f489401c2a0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/1444782238 shutdown_connections 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 --2- 172.21.15.53:0/1444782238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40b1af0 0x7f48a4069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 --2- 172.21.15.53:0/1444782238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a40cd630 0x7f48a40b0cf0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/1444782238 >> 172.21.15.53:0/1444782238 conn(0x7f48a40b20d0 msgr2=0x7f48a40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/1444782238 shutdown_connections 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/1444782238 wait complete. 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 Processor -- start 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- start start 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a406a490 0x7f48a4159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a40b1af0 0x7f48a40adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40cd630 0x7f48a40ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40b3a20 con 0x7f48a406a490 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4158180 con 0x7f48a40b1af0 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4159950 con 0x7f48a40cd630 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a406a490 0x7f48a4159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a406a490 0x7f48a4159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40376/0 (socket says 172.21.15.53:40376) 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 -- 172.21.15.53:0/3298313057 learned_addr learned my addr 172.21.15.53:0/3298313057 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 -- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40cd630 msgr2=0x7f48a40ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40cd630 0x7f48a40ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 -- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a40b1af0 msgr2=0x7f48a40adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a40b1af0 0x7f48a40adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 -- 172.21.15.53:0/3298313057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894009420 con 0x7f48a406a490 2024-09-13T18:29:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a259c640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a406a490 0x7f48a4159410 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f489401a950 tx=0x7f4894019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f4892ffd640 1 -- 172.21.15.53:0/3298313057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940b4410 con 0x7f48a406a490 2024-09-13T18:29:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f4892ffd640 1 -- 172.21.15.53:0/3298313057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48940b4570 con 0x7f48a406a490 2024-09-13T18:29:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f4892ffd640 1 -- 172.21.15.53:0/3298313057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940b4920 con 0x7f48a406a490 2024-09-13T18:29:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a4158420 con 0x7f48a406a490 2024-09-13T18:29:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a40b33d0 con 0x7f48a406a490 2024-09-13T18:29:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.115+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a40b3b90 con 0x7f48a406a490 2024-09-13T18:29:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.119+0000 7f4892ffd640 1 -- 172.21.15.53:0/3298313057 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f48940b2040 con 0x7f48a406a490 2024-09-13T18:29:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.119+0000 7f4892ffd640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f48840669f0 0x7f4884068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.119+0000 7f4892ffd640 1 -- 172.21.15.53:0/3298313057 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f489411e930 con 0x7f48a406a490 2024-09-13T18:29:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.119+0000 7f48a1d9b640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f48840669f0 0x7f4884068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.119+0000 7f48a1d9b640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f48840669f0 0x7f4884068eb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f48a40aeb40 tx=0x7f4898008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.123+0000 7f4892ffd640 1 -- 172.21.15.53:0/3298313057 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48940eb640 con 0x7f48a406a490 2024-09-13T18:29:51.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.279+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48a4069f50 con 0x7f48a406a490 2024-09-13T18:29:51.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f4892ffd640 1 -- 172.21.15.53:0/3298313057 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f48940b0090 con 0x7f48a406a490 2024-09-13T18:29:51.284 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:51.284 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:29:40.258533+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:29:51.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f48840669f0 msgr2=0x7f4884068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f48840669f0 0x7f4884068eb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f48a40aeb40 tx=0x7f4898008040 comp rx=0 tx=0).stop 2024-09-13T18:29:51.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a406a490 msgr2=0x7f48a4159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a406a490 0x7f48a4159410 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f489401a950 tx=0x7f4894019040 comp rx=0 tx=0).stop 2024-09-13T18:29:51.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 shutdown_connections 2024-09-13T18:29:51.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f48840669f0 0x7f4884068eb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48a40cd630 0x7f48a40ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48a40b1af0 0x7f48a40adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 --2- 172.21.15.53:0/3298313057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48a406a490 0x7f48a4159410 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 >> 172.21.15.53:0/3298313057 conn(0x7f48a40b20d0 msgr2=0x7f48a40ad3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 shutdown_connections 2024-09-13T18:29:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.283+0000 7f48a8b71640 1 -- 172.21.15.53:0/3298313057 wait complete. 2024-09-13T18:29:51.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:19.948503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:21.156674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:29:51.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:29:51.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e900c640 1 Processor -- start 2024-09-13T18:29:51.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e900c640 1 -- start start 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e900c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e4146150 0x7f57e40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e900c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57e4066390 0x7f57e40ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e900c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e40acf30 con 0x7f57e406d420 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e900c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e406db90 con 0x7f57e4066390 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e900c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e406de70 con 0x7f57e4146150 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e359e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57e4066390 0x7f57e40ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e359e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57e4066390 0x7f57e40ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40380/0 (socket says 172.21.15.53:40380) 2024-09-13T18:29:51.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e359e640 1 -- 172.21.15.53:0/1329926276 learned_addr learned my addr 172.21.15.53:0/1329926276 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:51.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e2d9d640 1 --2- 172.21.15.53:0/1329926276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e4146150 0x7f57e40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e359e640 1 -- 172.21.15.53:0/1329926276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e4146150 msgr2=0x7f57e40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:51.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e359e640 1 --2- 172.21.15.53:0/1329926276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e4146150 0x7f57e40b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e359e640 1 -- 172.21.15.53:0/1329926276 >> v1:172.21.15.87:6789/0 conn(0x7f57e406d420 legacy=0x7f57e4065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:51.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.431+0000 7f57e359e640 1 -- 172.21.15.53:0/1329926276 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e406e150 con 0x7f57e4066390 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 --2- 172.21.15.53:0/1329926276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4066390 0x7f57e40ad3c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009e50 tx=0x7f57dc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6b20b628b64e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e1d9b640 1 -- 172.21.15.53:0/1329926276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0a5810 con 0x7f57e4066390 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e1d9b640 1 -- 172.21.15.53:0/1329926276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc0a5970 con 0x7f57e4066390 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e1d9b640 1 -- 172.21.15.53:0/1329926276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0a5d00 con 0x7f57e4066390 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- 172.21.15.53:0/1329926276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4066390 msgr2=0x7f57e40ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 --2- 172.21.15.53:0/1329926276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4066390 0x7f57e40ad3c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009e50 tx=0x7f57dc01ca30 comp rx=0 tx=0).stop 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- 172.21.15.53:0/1329926276 shutdown_connections 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 --2- 172.21.15.53:0/1329926276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4066390 0x7f57e40ad3c0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 --2- 172.21.15.53:0/1329926276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e4146150 0x7f57e40b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- 172.21.15.53:0/1329926276 >> 172.21.15.53:0/1329926276 conn(0x7f57e40b1310 msgr2=0x7f57e40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- 172.21.15.53:0/1329926276 shutdown_connections 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- 172.21.15.53:0/1329926276 wait complete. 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 Processor -- start 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- start start 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e4066390 0x7f57e4144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e406d420 0x7f57e413efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4146150 0x7f57e4160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4141560 con 0x7f57e4146150 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4141dc0 con 0x7f57e4066390 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e900c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4143d40 con 0x7f57e406d420 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4146150 0x7f57e4160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4146150 0x7f57e4160230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40386/0 (socket says 172.21.15.53:40386) 2024-09-13T18:29:51.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 -- 172.21.15.53:0/2111799849 learned_addr learned my addr 172.21.15.53:0/2111799849 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e259c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e406d420 0x7f57e413efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e2d9d640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e4066390 0x7f57e4144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 -- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e406d420 msgr2=0x7f57e413efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e406d420 0x7f57e413efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 -- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e4066390 msgr2=0x7f57e4144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e4066390 0x7f57e4144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e359e640 1 -- 172.21.15.53:0/2111799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc009b30 con 0x7f57e4146150 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.435+0000 7f57e259c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e406d420 0x7f57e413efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57e359e640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4146150 0x7f57e4160230 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f57dc01a660 tx=0x7f57dc0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57cb7fe640 1 -- 172.21.15.53:0/2111799849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0b8670 con 0x7f57e4146150 2024-09-13T18:29:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57cb7fe640 1 -- 172.21.15.53:0/2111799849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc0b87f0 con 0x7f57e4146150 2024-09-13T18:29:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57cb7fe640 1 -- 172.21.15.53:0/2111799849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0b8ba0 con 0x7f57e4146150 2024-09-13T18:29:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e4144750 con 0x7f57e4146150 2024-09-13T18:29:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e4141a50 con 0x7f57e4146150 2024-09-13T18:29:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e4141f30 con 0x7f57e4146150 2024-09-13T18:29:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57cb7fe640 1 -- 172.21.15.53:0/2111799849 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f57dc0b8d00 con 0x7f57e4146150 2024-09-13T18:29:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57cb7fe640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f57d00669f0 0x7f57d0068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57cb7fe640 1 -- 172.21.15.53:0/2111799849 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f57dc11fe60 con 0x7f57e4146150 2024-09-13T18:29:51.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57e2d9d640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f57d00669f0 0x7f57d0068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.439+0000 7f57e2d9d640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f57d00669f0 0x7f57d0068eb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009790 tx=0x7f57d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.443+0000 7f57cb7fe640 1 -- 172.21.15.53:0/2111799849 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f57dc0ecf30 con 0x7f57e4146150 2024-09-13T18:29:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.603+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57e40ad3c0 con 0x7f57e4146150 2024-09-13T18:29:51.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.603+0000 7f57cb7fe640 1 -- 172.21.15.53:0/2111799849 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57dc0f0550 con 0x7f57e4146150 2024-09-13T18:29:51.607 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f57d00669f0 msgr2=0x7f57d0068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f57d00669f0 0x7f57d0068eb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009790 tx=0x7f57d4008040 comp rx=0 tx=0).stop 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4146150 msgr2=0x7f57e4160230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4146150 0x7f57e4160230 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f57dc01a660 tx=0x7f57dc0197d0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 shutdown_connections 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f57d00669f0 0x7f57d0068eb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57e406d420 0x7f57e413efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57e4146150 0x7f57e4160230 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 --2- 172.21.15.53:0/2111799849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e4066390 0x7f57e4144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 >> 172.21.15.53:0/2111799849 conn(0x7f57e40b1310 msgr2=0x7f57e40ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 shutdown_connections 2024-09-13T18:29:51.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.607+0000 7f57e900c640 1 -- 172.21.15.53:0/2111799849 wait complete. 2024-09-13T18:29:51.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:29:51.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb1204d4640 1 Processor -- start 2024-09-13T18:29:51.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb1204d4640 1 -- start start 2024-09-13T18:29:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb1204d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1180caee0 0x7fb1180cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb1204d4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb1180cd320 0x7fb1180cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb1204d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11806f7a0 con 0x7fb118143e80 2024-09-13T18:29:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb1204d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11806baa0 con 0x7fb1180caee0 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb1204d4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11806fd60 con 0x7fb1180cd320 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11da6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1180caee0 0x7fb1180cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11da6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1180caee0 0x7fb1180cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40390/0 (socket says 172.21.15.53:40390) 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11da6f640 1 -- 172.21.15.53:0/2455267191 learned_addr learned my addr 172.21.15.53:0/2455267191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11ea71640 1 --2- 172.21.15.53:0/2455267191 >> v2:172.21.15.87:3300/0 conn(0x7fb1180cd320 0x7fb1180cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11da6f640 1 -- 172.21.15.53:0/2455267191 >> v2:172.21.15.87:3300/0 conn(0x7fb1180cd320 msgr2=0x7fb1180cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11da6f640 1 --2- 172.21.15.53:0/2455267191 >> v2:172.21.15.87:3300/0 conn(0x7fb1180cd320 0x7fb1180cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11da6f640 1 -- 172.21.15.53:0/2455267191 >> v1:172.21.15.87:6789/0 conn(0x7fb118143e80 legacy=0x7fb11806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.751+0000 7fb11da6f640 1 -- 172.21.15.53:0/2455267191 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1180cb960 con 0x7fb1180caee0 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb11da6f640 1 --2- 172.21.15.53:0/2455267191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180caee0 0x7fb1180cb350 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb108009870 tx=0x7fb10801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8329eeff5f6de4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb11d26e640 1 -- 172.21.15.53:0/2455267191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080ab660 con 0x7fb1180caee0 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb11d26e640 1 -- 172.21.15.53:0/2455267191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1080ab7c0 con 0x7fb1180caee0 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb11d26e640 1 -- 172.21.15.53:0/2455267191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080abb50 con 0x7fb1180caee0 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- 172.21.15.53:0/2455267191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180caee0 msgr2=0x7fb1180cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 --2- 172.21.15.53:0/2455267191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180caee0 0x7fb1180cb350 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb108009870 tx=0x7fb10801c460 comp rx=0 tx=0).stop 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- 172.21.15.53:0/2455267191 shutdown_connections 2024-09-13T18:29:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 --2- 172.21.15.53:0/2455267191 >> v2:172.21.15.87:3300/0 conn(0x7fb1180cd320 0x7fb1180cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 --2- 172.21.15.53:0/2455267191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180caee0 0x7fb1180cb350 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- 172.21.15.53:0/2455267191 >> 172.21.15.53:0/2455267191 conn(0x7fb118065c80 msgr2=0x7fb118066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- 172.21.15.53:0/2455267191 shutdown_connections 2024-09-13T18:29:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- 172.21.15.53:0/2455267191 wait complete. 2024-09-13T18:29:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 Processor -- start 2024-09-13T18:29:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- start start 2024-09-13T18:29:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1180caee0 0x7fb118140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180cd320 0x7fb1181404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb118143e80 0x7fb1180ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb118159050 con 0x7fb1180cd320 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb118159310 con 0x7fb1180caee0 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb1204d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1181595f0 con 0x7fb118143e80 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb11da6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180cd320 0x7fb1181404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb11da6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180cd320 0x7fb1181404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40404/0 (socket says 172.21.15.53:40404) 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.755+0000 7fb11da6f640 1 -- 172.21.15.53:0/3711788417 learned_addr learned my addr 172.21.15.53:0/3711788417 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11e270640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1180caee0 0x7fb118140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11ea71640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb118143e80 0x7fb1180ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11da6f640 1 -- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb118143e80 msgr2=0x7fb1180ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11da6f640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb118143e80 0x7fb1180ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11da6f640 1 -- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1180caee0 msgr2=0x7fb118140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11da6f640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1180caee0 0x7fb118140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11da6f640 1 -- 172.21.15.53:0/3711788417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080094d0 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11da6f640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180cd320 0x7fb1181404b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fb1080ad040 tx=0x7fb10801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb10effd640 1 -- 172.21.15.53:0/3711788417 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080b4800 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb10effd640 1 -- 172.21.15.53:0/3711788417 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1080b4960 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb10effd640 1 -- 172.21.15.53:0/3711788417 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080b4d10 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1181598d0 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1181412c0 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1180cb350 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb10effd640 1 -- 172.21.15.53:0/3711788417 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fb1080a9070 con 0x7fb1180cd320 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb10effd640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0fc0669f0 0x7fb0fc068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:51.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb10effd640 1 -- 172.21.15.53:0/3711788417 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb10811ede0 con 0x7fb1180cd320 2024-09-13T18:29:51.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11e270640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0fc0669f0 0x7fb0fc068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:51.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.759+0000 7fb11e270640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0fc0669f0 0x7fb0fc068eb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb114000f70 tx=0x7fb114009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:51.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.763+0000 7fb10effd640 1 -- 172.21.15.53:0/3711788417 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1080ebc70 con 0x7fb1180cd320 2024-09-13T18:29:51.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.915+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb118159730 con 0x7fb1180cd320 2024-09-13T18:29:51.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb10effd640 1 -- 172.21.15.53:0/3711788417 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb118159730 con 0x7fb1180cd320 2024-09-13T18:29:51.920 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:29:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0fc0669f0 msgr2=0x7fb0fc068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0fc0669f0 0x7fb0fc068eb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb114000f70 tx=0x7fb114009040 comp rx=0 tx=0).stop 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180cd320 msgr2=0x7fb1181404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180cd320 0x7fb1181404b0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fb1080ad040 tx=0x7fb10801aca0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 shutdown_connections 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fb0fc0669f0 0x7fb0fc068eb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb118143e80 0x7fb1180ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1180cd320 0x7fb1181404b0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 --2- 172.21.15.53:0/3711788417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1180caee0 0x7fb118140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 >> 172.21.15.53:0/3711788417 conn(0x7fb118065c80 msgr2=0x7fb11815bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 shutdown_connections 2024-09-13T18:29:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:51.919+0000 7fb1204d4640 1 -- 172.21.15.53:0/3711788417 wait complete. 2024-09-13T18:29:51.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:29:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.051+0000 7feec33e4640 1 Processor -- start 2024-09-13T18:29:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.051+0000 7feec33e4640 1 -- start start 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec33e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feebc0b1dd0 0x7feebc0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec33e4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feebc06ff40 0x7feebc070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec33e4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc06bc20 con 0x7feebc158ba0 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec33e4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc06c530 con 0x7feebc0b1dd0 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec33e4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc070890 con 0x7feebc06ff40 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feebc0b1dd0 0x7feebc0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feebc0b1dd0 0x7feebc0b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40408/0 (socket says 172.21.15.53:40408) 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 -- 172.21.15.53:0/1603404321 learned_addr learned my addr 172.21.15.53:0/1603404321 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec1981640 1 --2- 172.21.15.53:0/1603404321 >> v2:172.21.15.87:3300/0 conn(0x7feebc06ff40 0x7feebc070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 -- 172.21.15.53:0/1603404321 >> v2:172.21.15.87:3300/0 conn(0x7feebc06ff40 msgr2=0x7feebc070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 --2- 172.21.15.53:0/1603404321 >> v2:172.21.15.87:3300/0 conn(0x7feebc06ff40 0x7feebc070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 -- 172.21.15.53:0/1603404321 >> v1:172.21.15.87:6789/0 conn(0x7feebc158ba0 legacy=0x7feebc0cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 -- 172.21.15.53:0/1603404321 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc158f80 con 0x7feebc0b1dd0 2024-09-13T18:29:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feec097f640 1 --2- 172.21.15.53:0/1603404321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc0b1dd0 0x7feebc0b3120 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7feebc06fed0 tx=0x7feeb801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be352566ad835512 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feeb3fff640 1 -- 172.21.15.53:0/1603404321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80ad640 con 0x7feebc0b1dd0 2024-09-13T18:29:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feeb3fff640 1 -- 172.21.15.53:0/1603404321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb80ad7a0 con 0x7feebc0b1dd0 2024-09-13T18:29:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.055+0000 7feeb3fff640 1 -- 172.21.15.53:0/1603404321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80adb30 con 0x7feebc0b1dd0 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- 172.21.15.53:0/1603404321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc0b1dd0 msgr2=0x7feebc0b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 --2- 172.21.15.53:0/1603404321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc0b1dd0 0x7feebc0b3120 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7feebc06fed0 tx=0x7feeb801c390 comp rx=0 tx=0).stop 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- 172.21.15.53:0/1603404321 shutdown_connections 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 --2- 172.21.15.53:0/1603404321 >> v2:172.21.15.87:3300/0 conn(0x7feebc06ff40 0x7feebc070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 --2- 172.21.15.53:0/1603404321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc0b1dd0 0x7feebc0b3120 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- 172.21.15.53:0/1603404321 >> 172.21.15.53:0/1603404321 conn(0x7feebc065c80 msgr2=0x7feebc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- 172.21.15.53:0/1603404321 shutdown_connections 2024-09-13T18:29:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- 172.21.15.53:0/1603404321 wait complete. 2024-09-13T18:29:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 Processor -- start 2024-09-13T18:29:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- start start 2024-09-13T18:29:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feebc06ff40 0x7feebc153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feebc0b1dd0 0x7feebc156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc158ba0 0x7feebc157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0abb70 con 0x7feebc158ba0 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0aaef0 con 0x7feebc0b1dd0 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0ab1d0 con 0x7feebc06ff40 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc158ba0 0x7feebc157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc158ba0 0x7feebc157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40422/0 (socket says 172.21.15.53:40422) 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 -- 172.21.15.53:0/620356972 learned_addr learned my addr 172.21.15.53:0/620356972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1180640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feebc06ff40 0x7feebc153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec097f640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feebc0b1dd0 0x7feebc156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 -- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feebc06ff40 msgr2=0x7feebc153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feebc06ff40 0x7feebc153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 -- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feebc0b1dd0 msgr2=0x7feebc156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feebc0b1dd0 0x7feebc156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 -- 172.21.15.53:0/620356972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80094d0 con 0x7feebc158ba0 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec097f640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feebc0b1dd0 0x7feebc156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec1981640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc158ba0 0x7feebc157260 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7feeb400cd70 tx=0x7feeb400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feeb1ffb640 1 -- 172.21.15.53:0/620356972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4003ba0 con 0x7feebc158ba0 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feeb1ffb640 1 -- 172.21.15.53:0/620356972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4003d00 con 0x7feebc158ba0 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc0ab4b0 con 0x7feebc158ba0 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feeb1ffb640 1 -- 172.21.15.53:0/620356972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004240 con 0x7feebc158ba0 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.059+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc1540d0 con 0x7feebc158ba0 2024-09-13T18:29:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.063+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc0abcb0 con 0x7feebc158ba0 2024-09-13T18:29:52.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.063+0000 7feeb1ffb640 1 -- 172.21.15.53:0/620356972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7feeb40043a0 con 0x7feebc158ba0 2024-09-13T18:29:52.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.063+0000 7feeb1ffb640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feea00669f0 0x7feea0068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.063+0000 7feeb1ffb640 1 -- 172.21.15.53:0/620356972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feeb4012070 con 0x7feebc158ba0 2024-09-13T18:29:52.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.063+0000 7feec1180640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feea00669f0 0x7feea0068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.063+0000 7feec1180640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feea00669f0 0x7feea0068eb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7feeac00b810 tx=0x7feeac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:52.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.067+0000 7feeb1ffb640 1 -- 172.21.15.53:0/620356972 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feebc0abcb0 con 0x7feebc158ba0 2024-09-13T18:29:52.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.223+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feebc0abcb0 con 0x7feebc158ba0 2024-09-13T18:29:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.223+0000 7feeb1ffb640 1 -- 172.21.15.53:0/620356972 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7feebc0abcb0 con 0x7feebc158ba0 2024-09-13T18:29:52.227 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:29:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feea00669f0 msgr2=0x7feea0068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feea00669f0 0x7feea0068eb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7feeac00b810 tx=0x7feeac008040 comp rx=0 tx=0).stop 2024-09-13T18:29:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc158ba0 msgr2=0x7feebc157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc158ba0 0x7feebc157260 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7feeb400cd70 tx=0x7feeb400a660 comp rx=0 tx=0).stop 2024-09-13T18:29:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 shutdown_connections 2024-09-13T18:29:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7feea00669f0 0x7feea0068eb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feebc158ba0 0x7feebc157260 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feebc0b1dd0 0x7feebc156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 --2- 172.21.15.53:0/620356972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feebc06ff40 0x7feebc153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 >> 172.21.15.53:0/620356972 conn(0x7feebc065c80 msgr2=0x7feebc0ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 shutdown_connections 2024-09-13T18:29:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.227+0000 7feec33e4640 1 -- 172.21.15.53:0/620356972 wait complete. 2024-09-13T18:29:52.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:29:52.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf806e640 1 Processor -- start 2024-09-13T18:29:52.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf806e640 1 -- start start 2024-09-13T18:29:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf806e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf0066890 0x7f5bf00ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf806e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf006c970 con 0x7f5bf0143df0 2024-09-13T18:29:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf806e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf0070c90 con 0x7f5bf00ceaf0 2024-09-13T18:29:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf806e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0070f70 con 0x7f5bf0066890 2024-09-13T18:29:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf5e0a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5bf0143df0 0x7f5bf0070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60746/0 (socket says 172.21.15.53:60746) 2024-09-13T18:29:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf5e0a640 1 -- 172.21.15.53:0/1193844648 learned_addr learned my addr 172.21.15.53:0/1193844648 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf5609640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf0066890 0x7f5bf00ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056858906 0 0) 0x7f5bf006c970 con 0x7f5bf0143df0 2024-09-13T18:29:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bdc003530 con 0x7f5bf0143df0 2024-09-13T18:29:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2524147839 0 0) 0x7f5bdc003530 con 0x7f5bf0143df0 2024-09-13T18:29:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf0066890 msgr2=0x7f5bf00ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf0066890 0x7f5bf00ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 >> v1:172.21.15.87:6789/0 conn(0x7f5bf00ceaf0 legacy=0x7f5bf006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0071250 con 0x7f5bf0143df0 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.363+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5bec001a00 con 0x7f5bf0143df0 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 >> v1:172.21.15.53:6789/0 conn(0x7f5bf0143df0 legacy=0x7f5bf0070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bdc0039b0 0x7f5bdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf0066890 0x7f5bdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc004d10 0x7f5bdc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0070f70 con 0x7f5bdc004d10 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc00ba70 con 0x7f5bdc0039b0 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc00bc30 con 0x7f5bf0066890 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc004d10 0x7f5bdc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf5e0a640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bdc0039b0 0x7f5bdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 -- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf0066890 msgr2=0x7f5bdc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bf0066890 0x7f5bdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 -- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bdc0039b0 msgr2=0x7f5bdc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bdc0039b0 0x7f5bdc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 -- 172.21.15.53:0/1193844648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc003530 con 0x7f5bdc004d10 2024-09-13T18:29:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf5e0a640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bdc0039b0 0x7f5bdc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:52.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc004d10 0x7f5bdc005190 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f5be8001750 tx=0x7f5be801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d19310b6d950b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80052d0 con 0x7f5bdc004d10 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be80a7050 con 0x7f5bdc004d10 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf4e08640 1 -- 172.21.15.53:0/1193844648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8003600 con 0x7f5bdc004d10 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf806e640 1 -- 172.21.15.53:0/1193844648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc004d10 msgr2=0x7f5bdc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf806e640 1 --2- 172.21.15.53:0/1193844648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc004d10 0x7f5bdc005190 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f5be8001750 tx=0x7f5be801c3e0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf660b640 1 -- 172.21.15.53:0/1193844648 reap_dead start 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf806e640 1 -- 172.21.15.53:0/1193844648 shutdown_connections 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf806e640 1 -- 172.21.15.53:0/1193844648 >> 172.21.15.53:0/1193844648 conn(0x7f5bf00b1310 msgr2=0x7f5bf00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf806e640 1 -- 172.21.15.53:0/1193844648 shutdown_connections 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.367+0000 7f5bf806e640 1 -- 172.21.15.53:0/1193844648 wait complete. 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 Processor -- start 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 -- start start 2024-09-13T18:29:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bdc004d10 0x7f5bf013f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bf0159f00 0x7f5bf00aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf00ab330 0x7f5bf00a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00a84d0 con 0x7f5bf0159f00 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00ab7b0 con 0x7f5bf00ab330 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf013f600 con 0x7f5bdc004d10 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bf0159f00 0x7f5bf00aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bf0159f00 0x7f5bf00aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40442/0 (socket says 172.21.15.53:40442) 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 -- 172.21.15.53:0/1317736300 learned_addr learned my addr 172.21.15.53:0/1317736300 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5e0a640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bdc004d10 0x7f5bf013f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf660b640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf00ab330 0x7f5bf00a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 -- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bdc004d10 msgr2=0x7f5bf013f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bdc004d10 0x7f5bf013f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 -- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf00ab330 msgr2=0x7f5bf00a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf00ab330 0x7f5bf00a8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 -- 172.21.15.53:0/1317736300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf013f880 con 0x7f5bf0159f00 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf5609640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bf0159f00 0x7f5bf00aadf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f5be000e7f0 tx=0x7f5be000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5be67fc640 1 -- 172.21.15.53:0/1317736300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000eea0 con 0x7f5bf0159f00 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5be67fc640 1 -- 172.21.15.53:0/1317736300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000c8e0 con 0x7f5bf0159f00 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf013fb60 con 0x7f5bf0159f00 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5be67fc640 1 -- 172.21.15.53:0/1317736300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000cc90 con 0x7f5bf0159f00 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf00a86e0 con 0x7f5bf0159f00 2024-09-13T18:29:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf00cef70 con 0x7f5bf0159f00 2024-09-13T18:29:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5be67fc640 1 -- 172.21.15.53:0/1317736300 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f5be0013470 con 0x7f5bf0159f00 2024-09-13T18:29:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5be67fc640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5bd4066a20 0x7f5bd4068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.371+0000 7f5be67fc640 1 -- 172.21.15.53:0/1317736300 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5be0084690 con 0x7f5bf0159f00 2024-09-13T18:29:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.375+0000 7f5bf5e0a640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5bd4066a20 0x7f5bd4068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.375+0000 7f5bf5e0a640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5bd4066a20 0x7f5bd4068ee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5bec002020 tx=0x7f5bec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:52.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.375+0000 7f5be67fc640 1 -- 172.21.15.53:0/1317736300 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5be00515b0 con 0x7f5bf0159f00 2024-09-13T18:29:52.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.539+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5bf00ce5b0 con 0x7f5bf0159f00 2024-09-13T18:29:52.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5be67fc640 1 -- 172.21.15.53:0/1317736300 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5be0054bd0 con 0x7f5bf0159f00 2024-09-13T18:29:52.543 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5bd4066a20 msgr2=0x7f5bd4068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5bd4066a20 0x7f5bd4068ee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5bec002020 tx=0x7f5bec009040 comp rx=0 tx=0).stop 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bf0159f00 msgr2=0x7f5bf00aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bf0159f00 0x7f5bf00aadf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f5be000e7f0 tx=0x7f5be000ecb0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 shutdown_connections 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f5bd4066a20 0x7f5bd4068ee0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bf00ab330 0x7f5bf00a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bf0159f00 0x7f5bf00aadf0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 --2- 172.21.15.53:0/1317736300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5bdc004d10 0x7f5bf013f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:52.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 >> 172.21.15.53:0/1317736300 conn(0x7f5bf00b1310 msgr2=0x7f5bf015c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:52.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 shutdown_connections 2024-09-13T18:29:52.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:52.543+0000 7f5bf806e640 1 -- 172.21.15.53:0/1317736300 wait complete. 2024-09-13T18:29:52.561 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:29:52.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:52.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:29:52.575 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35721]: fuse finished with error 0 and tester_r 0 2024-09-13T18:29:52.576 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:29:55.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:29:55.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:29:58.678 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:29:58.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:29:58.679 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:29:58.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:58.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.819+0000 7fcb0181d640 1 Processor -- start 2024-09-13T18:29:58.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.819+0000 7fcb0181d640 1 -- start start 2024-09-13T18:29:58.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcb0181d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcafc0cb980 0x7fcafc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:58.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcb0181d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc06b850 0x7fcafc0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:58.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcb0181d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc0b1ac0 con 0x7fcafc0cbd60 2024-09-13T18:29:58.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcb0181d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc0b3010 con 0x7fcafc0cb980 2024-09-13T18:29:58.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcb0181d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc159ac0 con 0x7fcafc06b850 2024-09-13T18:29:58.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafaffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcafc0cb980 0x7fcafc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:58.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafb7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcafc0cbd60 0x7fcafc06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:42488/0 (socket says 172.21.15.53:42488) 2024-09-13T18:29:58.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafb7fe640 1 -- 172.21.15.53:0/1355100903 learned_addr learned my addr 172.21.15.53:0/1355100903 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:58.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafa7fc640 1 --2- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc06b850 0x7fcafc0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:58.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafaffd640 1 -- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc06b850 msgr2=0x7fcafc0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:58.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafaffd640 1 --2- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc06b850 0x7fcafc0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:58.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafaffd640 1 -- 172.21.15.53:0/1355100903 >> v1:172.21.15.87:6789/0 conn(0x7fcafc0cbd60 legacy=0x7fcafc06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:58.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafaffd640 1 -- 172.21.15.53:0/1355100903 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc159da0 con 0x7fcafc0cb980 2024-09-13T18:29:58.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.823+0000 7fcafa7fc640 1 --2- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc06b850 0x7fcafc0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:58.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcafaffd640 1 --2- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc0cb980 0x7fcafc0b33b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00097f0 tx=0x7fcaf001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eccc3780737291ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:58.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcaf9ffb640 1 -- 172.21.15.53:0/1355100903 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00ac640 con 0x7fcafc0cb980 2024-09-13T18:29:58.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcaf9ffb640 1 -- 172.21.15.53:0/1355100903 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf00ac7a0 con 0x7fcafc0cb980 2024-09-13T18:29:58.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcaf9ffb640 1 -- 172.21.15.53:0/1355100903 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00acb30 con 0x7fcafc0cb980 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 -- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc0cb980 msgr2=0x7fcafc0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 --2- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc0cb980 0x7fcafc0b33b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00097f0 tx=0x7fcaf001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 -- 172.21.15.53:0/1355100903 shutdown_connections 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 --2- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc06b850 0x7fcafc0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 --2- 172.21.15.53:0/1355100903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc0cb980 0x7fcafc0b33b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 -- 172.21.15.53:0/1355100903 >> 172.21.15.53:0/1355100903 conn(0x7fcafc065c80 msgr2=0x7fcafc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 -- 172.21.15.53:0/1355100903 shutdown_connections 2024-09-13T18:29:58.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 -- 172.21.15.53:0/1355100903 wait complete. 2024-09-13T18:29:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 Processor -- start 2024-09-13T18:29:58.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.827+0000 7fcb0181d640 1 -- start start 2024-09-13T18:29:58.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc06b850 0x7fcafc146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:58.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc0cb980 0x7fcafc14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcafc0cbd60 0x7fcafc158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc149d90 con 0x7fcafc0cbd60 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc152dd0 con 0x7fcafc06b850 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc147370 con 0x7fcafc0cb980 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcafc0cbd60 0x7fcafc158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcafc0cbd60 0x7fcafc158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46114/0 (socket says 172.21.15.53:46114) 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 -- 172.21.15.53:0/4095003991 learned_addr learned my addr 172.21.15.53:0/4095003991 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafa7fc640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc0cb980 0x7fcafc14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafaffd640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc06b850 0x7fcafc146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 -- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc0cb980 msgr2=0x7fcafc14f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:58.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc0cb980 0x7fcafc14f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 -- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc06b850 msgr2=0x7fcafc146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc06b850 0x7fcafc146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 -- 172.21.15.53:0/4095003991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec009420 con 0x7fcafc0cbd60 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafb7fe640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcafc0cbd60 0x7fcafc158870 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400cbc0 tx=0x7fcaf400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcae3fff640 1 -- 172.21.15.53:0/4095003991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400ad40 con 0x7fcafc0cbd60 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcae3fff640 1 -- 172.21.15.53:0/4095003991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4012400 con 0x7fcafc0cbd60 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf0009420 con 0x7fcafc0cbd60 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcae3fff640 1 -- 172.21.15.53:0/4095003991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400aea0 con 0x7fcafc0cbd60 2024-09-13T18:29:58.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc152a30 con 0x7fcafc0cbd60 2024-09-13T18:29:58.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcafc067400 con 0x7fcafc0cbd60 2024-09-13T18:29:58.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcae3fff640 1 -- 172.21.15.53:0/4095003991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7fcaf4007070 con 0x7fcafc0cbd60 2024-09-13T18:29:58.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcae3fff640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcae80669f0 0x7fcae8068eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:58.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcae3fff640 1 -- 172.21.15.53:0/4095003991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcaf40846b0 con 0x7fcafc0cbd60 2024-09-13T18:29:58.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.831+0000 7fcafaffd640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcae80669f0 0x7fcae8068eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:58.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.835+0000 7fcafaffd640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcae80669f0 0x7fcae8068eb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00ae000 tx=0x7fcaf00a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:58.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:58.835+0000 7fcae3fff640 1 -- 172.21.15.53:0/4095003991 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcaf4051580 con 0x7fcafc0cbd60 2024-09-13T18:29:59.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.031+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcafc152f10 con 0x7fcafc0cbd60 2024-09-13T18:29:59.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcae3fff640 1 -- 172.21.15.53:0/4095003991 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4727 (secure 0 0 0) 0x7fcafc152f10 con 0x7fcafc0cbd60 2024-09-13T18:29:59.036 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:59.036 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:29:59.036 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcae80669f0 msgr2=0x7fcae8068eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcae80669f0 0x7fcae8068eb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00ae000 tx=0x7fcaf00a7000 comp rx=0 tx=0).stop 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcafc0cbd60 msgr2=0x7fcafc158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcafc0cbd60 0x7fcafc158870 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400cbc0 tx=0x7fcaf400a430 comp rx=0 tx=0).stop 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 shutdown_connections 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fcae80669f0 0x7fcae8068eb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcafc0cb980 0x7fcafc14f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcafc0cbd60 0x7fcafc158870 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 --2- 172.21.15.53:0/4095003991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcafc06b850 0x7fcafc146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 >> 172.21.15.53:0/4095003991 conn(0x7fcafc065c80 msgr2=0x7fcafc06c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:59.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 shutdown_connections 2024-09-13T18:29:59.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.035+0000 7fcb0181d640 1 -- 172.21.15.53:0/4095003991 wait complete. 2024-09-13T18:29:59.055 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:29:59.200 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-09-13T18:29:59.200 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-13T18:29:59.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol51230 2024-09-13T18:29:59.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.331+0000 7f97d2546640 1 Processor -- start 2024-09-13T18:29:59.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.331+0000 7f97d2546640 1 -- start start 2024-09-13T18:29:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.331+0000 7f97d2546640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc157020 0x7f97cc06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.331+0000 7f97d2546640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc06d6e0 con 0x7f97cc06d270 2024-09-13T18:29:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.331+0000 7f97d2546640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97cc0715f0 con 0x7f97cc156c40 2024-09-13T18:29:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.331+0000 7f97d2546640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0b15a0 con 0x7f97cc157020 2024-09-13T18:29:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97d0ae3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f97cc06d270 0x7f97cc06f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48492/0 (socket says 172.21.15.53:48492) 2024-09-13T18:29:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97d0ae3640 1 -- 172.21.15.53:0/453130059 learned_addr learned my addr 172.21.15.53:0/453130059 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc157020 0x7f97cc06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944594685 0 0) 0x7f97cc06d6e0 con 0x7f97cc06d270 2024-09-13T18:29:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b4003530 con 0x7f97cc06d270 2024-09-13T18:29:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480310111 0 0) 0x7f97b4003530 con 0x7f97cc06d270 2024-09-13T18:29:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc157020 msgr2=0x7f97cc06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc157020 0x7f97cc06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 >> v1:172.21.15.87:6789/0 conn(0x7f97cc156c40 legacy=0x7f97cc070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc0b1880 con 0x7f97cc06d270 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f97c4001a00 con 0x7f97cc06d270 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 >> v1:172.21.15.53:6789/0 conn(0x7f97cc06d270 legacy=0x7f97cc06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97b40039b0 0x7f97b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97b40042d0 0x7f97b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97b4004f60 0x7f97b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0b15a0 con 0x7f97b40042d0 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b400bed0 con 0x7f97b4004f60 2024-09-13T18:29:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b400c010 con 0x7f97b40039b0 2024-09-13T18:29:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97b40042d0 0x7f97b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 -- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97b40039b0 msgr2=0x7f97b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97b40039b0 0x7f97b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 -- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97b4004f60 msgr2=0x7f97b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97b4004f60 0x7f97b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 -- 172.21.15.53:0/453130059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4003530 con 0x7f97b40042d0 2024-09-13T18:29:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97b40042d0 0x7f97b40047d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009ae0 tx=0x7f97bc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dab6eecad6879f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0a56a0 con 0x7f97b40042d0 2024-09-13T18:29:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc0a5800 con 0x7f97b40042d0 2024-09-13T18:29:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.335+0000 7f97caffd640 1 -- 172.21.15.53:0/453130059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0a5bb0 con 0x7f97b40042d0 2024-09-13T18:29:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- 172.21.15.53:0/453130059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97b40042d0 msgr2=0x7f97b40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 --2- 172.21.15.53:0/453130059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97b40042d0 0x7f97b40047d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009ae0 tx=0x7f97bc01cab0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d0ae3640 1 -- 172.21.15.53:0/453130059 reap_dead start 2024-09-13T18:29:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- 172.21.15.53:0/453130059 shutdown_connections 2024-09-13T18:29:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- 172.21.15.53:0/453130059 >> 172.21.15.53:0/453130059 conn(0x7f97cc065c80 msgr2=0x7f97cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- 172.21.15.53:0/453130059 shutdown_connections 2024-09-13T18:29:59.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- 172.21.15.53:0/453130059 wait complete. 2024-09-13T18:29:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 Processor -- start 2024-09-13T18:29:59.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- start start 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97cc149ee0 0x7f97cc15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc154240 0x7f97cc15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97cc15c650 0x7f97cc1f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc155120 con 0x7f97cc149ee0 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0c79b0 con 0x7f97cc15c650 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc155ba0 con 0x7f97cc154240 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97cc149ee0 0x7f97cc15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97cc149ee0 0x7f97cc15b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46130/0 (socket says 172.21.15.53:46130) 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d0ae3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97cc15c650 0x7f97cc1f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 -- 172.21.15.53:0/3159687383 learned_addr learned my addr 172.21.15.53:0/3159687383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc154240 0x7f97cc15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 -- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc154240 msgr2=0x7f97cc15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc154240 0x7f97cc15b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 -- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97cc15c650 msgr2=0x7f97cc1f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97cc15c650 0x7f97cc1f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 -- 172.21.15.53:0/3159687383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc15c400 con 0x7f97cc149ee0 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d0ae3640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97cc15c650 0x7f97cc1f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97cbfff640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97cc149ee0 0x7f97cc15b3f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f97c000fb20 tx=0x7f97c000aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97c8ff9640 1 -- 172.21.15.53:0/3159687383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0008480 con 0x7f97cc149ee0 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97c8ff9640 1 -- 172.21.15.53:0/3159687383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c000d7c0 con 0x7f97cc149ee0 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc155300 con 0x7f97cc149ee0 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97c8ff9640 1 -- 172.21.15.53:0/3159687383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000db70 con 0x7f97cc149ee0 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.339+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc1558c0 con 0x7f97cc149ee0 2024-09-13T18:29:59.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.343+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc070870 con 0x7f97cc149ee0 2024-09-13T18:29:59.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.343+0000 7f97c8ff9640 1 -- 172.21.15.53:0/3159687383 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f97c000dcd0 con 0x7f97cc149ee0 2024-09-13T18:29:59.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.343+0000 7f97c8ff9640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97b8066a20 0x7f97b8068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.343+0000 7f97c8ff9640 1 -- 172.21.15.53:0/3159687383 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f97c00876c0 con 0x7f97cc149ee0 2024-09-13T18:29:59.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.343+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97b8066a20 0x7f97b8068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.343+0000 7f97cb7fe640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97b8066a20 0x7f97b8068ee0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0af000 tx=0x7f97bc0046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:59.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.347+0000 7f97c8ff9640 1 -- 172.21.15.53:0/3159687383 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f97c0054570 con 0x7f97cc149ee0 2024-09-13T18:29:59.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.531+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 --> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol51230", "target": ["mon-mgr", ""]}) v1 -- 0x7f97cc0b2120 con 0x7f97b8066a20 2024-09-13T18:29:59.545 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:29:59.542+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:29:59.545 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:29:59.542+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:29:59.546 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:29:59.542+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:29:59.546 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:29:59.542+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:29:59.546 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:29:59.542+0000 7f3e9be15640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:29:59.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.591+0000 7f97c8ff9640 1 -- 172.21.15.53:0/3159687383 <== mgr.4111 v2:172.21.15.87:6832/133103669 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f97bc0a5970 con 0x7f97b8066a20 2024-09-13T18:29:59.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97b8066a20 msgr2=0x7f97b8068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97b8066a20 0x7f97b8068ee0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0af000 tx=0x7f97bc0046d0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97cc149ee0 msgr2=0x7f97cc15b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97cc149ee0 0x7f97cc15b3f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f97c000fb20 tx=0x7f97c000aef0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 shutdown_connections 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f97b8066a20 0x7f97b8068ee0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97cc154240 0x7f97cc15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97cc15c650 0x7f97cc1f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 --2- 172.21.15.53:0/3159687383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97cc149ee0 0x7f97cc15b3f0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 >> 172.21.15.53:0/3159687383 conn(0x7f97cc065c80 msgr2=0x7f97cc153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 shutdown_connections 2024-09-13T18:29:59.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.595+0000 7f97d2546640 1 -- 172.21.15.53:0/3159687383 wait complete. 2024-09-13T18:29:59.615 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:29:59.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.731+0000 7f19fb203640 1 Processor -- start 2024-09-13T18:29:59.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.731+0000 7f19fb203640 1 -- start start 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19fb203640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f19f406ae50 0x7f19f415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19fb203640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19fb203640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f415dd40 con 0x7f19f415c810 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19fb203640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f415dff0 con 0x7f19f406ae50 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19fb203640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f415e2d0 con 0x7f19f415cbf0 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f8f9f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f19f415c810 0x7f19f406a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48502/0 (socket says 172.21.15.53:48502) 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f8f9f640 1 -- 172.21.15.53:0/4102822840 learned_addr learned my addr 172.21.15.53:0/4102822840 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f3fff640 1 --2- 172.21.15.53:0/4102822840 >> v2:172.21.15.53:3300/0 conn(0x7f19f406ae50 0x7f19f415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f97a0640 1 --2- 172.21.15.53:0/4102822840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f37fe640 1 -- 172.21.15.53:0/4102822840 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352164304 0 0) 0x7f19f415dd40 con 0x7f19f415c810 2024-09-13T18:29:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f37fe640 1 -- 172.21.15.53:0/4102822840 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19e4003530 con 0x7f19f415c810 2024-09-13T18:29:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f3fff640 1 -- 172.21.15.53:0/4102822840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 msgr2=0x7f19f415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:29:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f3fff640 1 --2- 172.21.15.53:0/4102822840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f3fff640 1 -- 172.21.15.53:0/4102822840 >> v1:172.21.15.53:6789/0 conn(0x7f19f415c810 legacy=0x7f19f406a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f3fff640 1 -- 172.21.15.53:0/4102822840 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f415e5b0 con 0x7f19f406ae50 2024-09-13T18:29:59.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f3fff640 1 --2- 172.21.15.53:0/4102822840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f406ae50 0x7f19f415d2c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f19e00097c0 tx=0x7f19e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629eb5afb8db00a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:59.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f37fe640 1 -- 172.21.15.53:0/4102822840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00ab670 con 0x7f19f406ae50 2024-09-13T18:29:59.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f37fe640 1 -- 172.21.15.53:0/4102822840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00ab7d0 con 0x7f19f406ae50 2024-09-13T18:29:59.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.735+0000 7f19f37fe640 1 -- 172.21.15.53:0/4102822840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00abb60 con 0x7f19f406ae50 2024-09-13T18:29:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- 172.21.15.53:0/4102822840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f406ae50 msgr2=0x7f19f415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 --2- 172.21.15.53:0/4102822840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f406ae50 0x7f19f415d2c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f19e00097c0 tx=0x7f19e001c470 comp rx=0 tx=0).stop 2024-09-13T18:29:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- 172.21.15.53:0/4102822840 shutdown_connections 2024-09-13T18:29:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 --2- 172.21.15.53:0/4102822840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 --2- 172.21.15.53:0/4102822840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f406ae50 0x7f19f415d2c0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- 172.21.15.53:0/4102822840 >> 172.21.15.53:0/4102822840 conn(0x7f19f4071a50 msgr2=0x7f19f4099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- 172.21.15.53:0/4102822840 shutdown_connections 2024-09-13T18:29:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- 172.21.15.53:0/4102822840 wait complete. 2024-09-13T18:29:59.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 Processor -- start 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- start start 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19f406ae50 0x7f19f414f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f415c810 0x7f19f413bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f414fdf0 con 0x7f19f415c810 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40cac00 con 0x7f19f406ae50 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40caee0 con 0x7f19f415cbf0 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f415c810 0x7f19f413bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f415c810 0x7f19f413bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46160/0 (socket says 172.21.15.53:46160) 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 -- 172.21.15.53:0/1418467270 learned_addr learned my addr 172.21.15.53:0/1418467270 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:29:59.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f8f9f640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19f406ae50 0x7f19f414f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f97a0640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 -- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 msgr2=0x7f19f4155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f4155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 -- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19f406ae50 msgr2=0x7f19f414f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19f406ae50 0x7f19f414f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 -- 172.21.15.53:0/1418467270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e0009420 con 0x7f19f415c810 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f3fff640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f415c810 0x7f19f413bf10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f19e00ad040 tx=0x7f19e001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f17fa640 1 -- 172.21.15.53:0/1418467270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00bf610 con 0x7f19f415c810 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f17fa640 1 -- 172.21.15.53:0/1418467270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00bf7b0 con 0x7f19f415c810 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f40cb1c0 con 0x7f19f415c810 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19f17fa640 1 -- 172.21.15.53:0/1418467270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00bfb60 con 0x7f19f415c810 2024-09-13T18:29:59.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.739+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f413c450 con 0x7f19f415c810 2024-09-13T18:29:59.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.743+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f4067940 con 0x7f19f415c810 2024-09-13T18:29:59.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.743+0000 7f19f17fa640 1 -- 172.21.15.53:0/1418467270 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 11) v1 ==== 86398+0+0 (secure 0 0 0) 0x7f19e00b5400 con 0x7f19f415c810 2024-09-13T18:29:59.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.743+0000 7f19f17fa640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f19d8066a20 0x7f19d8068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:59.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.743+0000 7f19f17fa640 1 -- 172.21.15.53:0/1418467270 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f19e011f610 con 0x7f19f415c810 2024-09-13T18:29:59.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.743+0000 7f19f8f9f640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f19d8066a20 0x7f19d8068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:59.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.743+0000 7f19f8f9f640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f19d8066a20 0x7f19d8068ee0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19e80011f0 tx=0x7f19e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:59.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.747+0000 7f19f17fa640 1 -- 172.21.15.53:0/1418467270 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19f4067940 con 0x7f19f415c810 2024-09-13T18:29:59.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.939+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19f4067940 con 0x7f19f415c810 2024-09-13T18:29:59.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19f17fa640 1 -- 172.21.15.53:0/1418467270 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4727 (secure 0 0 0) 0x7f19f4067940 con 0x7f19f415c810 2024-09-13T18:29:59.943 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:29:59.943 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:29:59.944 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f19d8066a20 msgr2=0x7f19d8068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f19d8066a20 0x7f19d8068ee0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f19e80011f0 tx=0x7f19e8009040 comp rx=0 tx=0).stop 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f415c810 msgr2=0x7f19f413bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f415c810 0x7f19f413bf10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f19e00ad040 tx=0x7f19e001acb0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 shutdown_connections 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f19d8066a20 0x7f19d8068ee0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19f415cbf0 0x7f19f4155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f415c810 0x7f19f413bf10 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 --2- 172.21.15.53:0/1418467270 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19f406ae50 0x7f19f414f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 >> 172.21.15.53:0/1418467270 conn(0x7f19f4071a50 msgr2=0x7f19f406e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 shutdown_connections 2024-09-13T18:29:59.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:29:59.943+0000 7f19fb203640 1 -- 172.21.15.53:0/1418467270 wait complete. 2024-09-13T18:29:59.963 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:30:00.103 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":6496,"entity":{"name":{"type":"client","num":6496},"addr":{"type":"any","addr":"172.21.15.87:0","nonce":3809889825}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.53999467499999998,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.973353358890083,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6496 172.21.15.87:0/3809889825","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"x","hostname":"smithi087","pid":"28707","root":"/"}}] 2024-09-13T18:30:00.104 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi087", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28707", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.87:0", "nonce": 3809889825, "type": "any" }, "name": { "num": 6496, "type": "client" } }, "id": 6496, "inst": "client.6496 172.21.15.87:0/3809889825", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.973353358890083 }, "state": "open", "uptime": 0.539994675 } ] 2024-09-13T18:30:00.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-13T18:30:00.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f670223a640 1 Processor -- start 2024-09-13T18:30:00.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f670223a640 1 -- start start 2024-09-13T18:30:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f670223a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 0x7f66fc06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f670223a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66fc15b7c0 0x7f66fc06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f670223a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc06d480 con 0x7f66fc070c90 2024-09-13T18:30:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f670223a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc15aaf0 con 0x7f66fc15b7c0 2024-09-13T18:30:00.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f670223a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc06d760 con 0x7f66fc1582a0 2024-09-13T18:30:00.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f66fbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66fc070c90 0x7f66fc06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48506/0 (socket says 172.21.15.53:48506) 2024-09-13T18:30:00.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f66fbfff640 1 -- 172.21.15.53:0/3504278289 learned_addr learned my addr 172.21.15.53:0/3504278289 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f66faffd640 1 --2- 172.21.15.53:0/3504278289 >> v2:172.21.15.87:3300/0 conn(0x7f66fc15b7c0 0x7f66fc06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f66fb7fe640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 0x7f66fc06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.223+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762413109 0 0) 0x7f66fc06d480 con 0x7f66fc070c90 2024-09-13T18:30:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e8003530 con 0x7f66fc070c90 2024-09-13T18:30:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1616791971 0 0) 0x7f66e8003530 con 0x7f66fc070c90 2024-09-13T18:30:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 msgr2=0x7f66fc06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:00.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 0x7f66fc06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 >> v2:172.21.15.87:3300/0 conn(0x7f66fc15b7c0 msgr2=0x7f66fc06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 --2- 172.21.15.53:0/3504278289 >> v2:172.21.15.87:3300/0 conn(0x7f66fc15b7c0 0x7f66fc06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc15ace0 con 0x7f66fc070c90 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f66f4001a00 con 0x7f66fc070c90 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 >> v1:172.21.15.53:6789/0 conn(0x7f66fc070c90 legacy=0x7f66fc06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e8003980 0x7f66e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 0x7f66e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e8004d10 0x7f66e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e800b990 con 0x7f66e8004d10 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e800bad0 con 0x7f66e8003980 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e800bc10 con 0x7f66fc1582a0 2024-09-13T18:30:00.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fbfff640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e8004d10 0x7f66e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66faffd640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 0x7f66e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fb7fe640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e8003980 0x7f66e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fbfff640 1 -- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 msgr2=0x7f66e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fbfff640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66fc1582a0 0x7f66e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fbfff640 1 -- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e8003980 msgr2=0x7f66e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fbfff640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e8003980 0x7f66e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fbfff640 1 -- 172.21.15.53:0/3504278289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8003530 con 0x7f66e8004d10 2024-09-13T18:30:00.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fb7fe640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e8003980 0x7f66e8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fbfff640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e8004d10 0x7f66e8005190 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f66f400a830 tx=0x7f66f401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913f24e2cc233326 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40ad630 con 0x7f66e8004d10 2024-09-13T18:30:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f40a8070 con 0x7f66e8004d10 2024-09-13T18:30:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.227+0000 7f66fa7fc640 1 -- 172.21.15.53:0/3504278289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40ad9f0 con 0x7f66e8004d10 2024-09-13T18:30:00.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- 172.21.15.53:0/3504278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e8004d10 msgr2=0x7f66e8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:00.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 --2- 172.21.15.53:0/3504278289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e8004d10 0x7f66e8005190 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f66f400a830 tx=0x7f66f401d380 comp rx=0 tx=0).stop 2024-09-13T18:30:00.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 -- 172.21.15.53:0/3504278289 reap_dead start 2024-09-13T18:30:00.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- 172.21.15.53:0/3504278289 shutdown_connections 2024-09-13T18:30:00.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- 172.21.15.53:0/3504278289 >> 172.21.15.53:0/3504278289 conn(0x7f66fc065c80 msgr2=0x7f66fc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:00.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- 172.21.15.53:0/3504278289 shutdown_connections 2024-09-13T18:30:00.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- 172.21.15.53:0/3504278289 wait complete. 2024-09-13T18:30:00.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 Processor -- start 2024-09-13T18:30:00.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- start start 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e8004d10 0x7f66fc0c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66fc1f2410 0x7f66fc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66fc1f2890 0x7f66fc0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc14a800 con 0x7f66fc1f2890 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1477c0 con 0x7f66fc1f2410 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc149b80 con 0x7f66e8004d10 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66fc1f2890 0x7f66fc0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66fc1f2890 0x7f66fc0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46172/0 (socket says 172.21.15.53:46172) 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 -- 172.21.15.53:0/3499748407 learned_addr learned my addr 172.21.15.53:0/3499748407 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fb7fe640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e8004d10 0x7f66fc0c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66faffd640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66fc1f2410 0x7f66fc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 -- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e8004d10 msgr2=0x7f66fc0c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e8004d10 0x7f66fc0c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 -- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66fc1f2410 msgr2=0x7f66fc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66fc1f2410 0x7f66fc0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 -- 172.21.15.53:0/3499748407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc149e60 con 0x7f66fc1f2890 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66faffd640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66fc1f2410 0x7f66fc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66fbfff640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66fc1f2890 0x7f66fc0ace20 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f66f4098da0 tx=0x7f66e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66f3fff640 1 -- 172.21.15.53:0/3499748407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40017c0 con 0x7f66fc1f2890 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66f3fff640 1 -- 172.21.15.53:0/3499748407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4001920 con 0x7f66fc1f2890 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f66f3fff640 1 -- 172.21.15.53:0/3499748407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4004d70 con 0x7f66fc1f2890 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc14a140 con 0x7f66fc1f2890 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.231+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0c4f90 con 0x7f66fc1f2890 2024-09-13T18:30:00.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.235+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc067400 con 0x7f66fc1f2890 2024-09-13T18:30:00.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.235+0000 7f66f3fff640 1 -- 172.21.15.53:0/3499748407 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 12) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f66f40aa030 con 0x7f66fc1f2890 2024-09-13T18:30:00.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.235+0000 7f66f3fff640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66dc066a80 0x7f66dc068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:00.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.235+0000 7f66f3fff640 1 -- 172.21.15.53:0/3499748407 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f66f411e470 con 0x7f66fc1f2890 2024-09-13T18:30:00.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.235+0000 7f66fb7fe640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66dc066a80 0x7f66dc068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:00.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.235+0000 7f66fb7fe640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66dc066a80 0x7f66dc068f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f66e4006f90 tx=0x7f66e4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:00.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.239+0000 7f66f3fff640 1 -- 172.21.15.53:0/3499748407 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66f40eb0e0 con 0x7f66fc1f2890 2024-09-13T18:30:00.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.435+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f66fc06d3e0 con 0x7f66fc1f2890 2024-09-13T18:30:00.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.451+0000 7f66f3fff640 1 -- 172.21.15.53:0/3499748407 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v12) v1 ==== 81+0+449213 (secure 0 0 0) 0x7f66f40ee700 con 0x7f66fc1f2890 2024-09-13T18:30:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:00.457 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:30:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "epoch": 12, 2024-09-13T18:30:00.457 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "active_gid": 4111, 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "active_name": "x", 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "active_addrs": { 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:6832", 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 133103669 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:6833", 2024-09-13T18:30:00.458 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 133103669 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "active_addr": "172.21.15.87:6833/133103669", 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "active_change": "2024-09-13T18:24:38.889085+0000", 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "active_mgr_features": 4540138322906710015, 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "available": true, 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "standbys": [ 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "gid": 4098, 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "y", 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr_features": 4540138322906710015, 2024-09-13T18:30:00.459 INFO:teuthology.orchestra.run.smithi053.stdout: "available_modules": [ 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "alerts", 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.460 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.461 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.462 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.463 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.464 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.465 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_destination": { 2024-09-13T18:30:00.466 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_destination", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_from_name": { 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_from_name", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "Ceph", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email From: name", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.468 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_host": { 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_host", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP server", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.469 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_password": { 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_password", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Password to authenticate with", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.470 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_port": { 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_port", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "465", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP port", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.471 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_sender": { 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_sender", 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:30:00.472 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_ssl": { 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_ssl", 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.473 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_user": { 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_user", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.474 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "User to authenticate as", 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "balancer", 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: "active": { 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "active", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.476 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_time": { 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_time", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0000", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.477 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_weekday": { 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_weekday", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.478 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_max_iterations": { 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "25", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "250", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.479 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_metrics": { 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_metrics", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:30:00.480 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_step": { 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_step", 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.5", 2024-09-13T18:30:00.481 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0.001", 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "0.999", 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "end_time": { 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_time", 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.482 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2359", 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "end_weekday": { 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_weekday", 2024-09-13T18:30:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.485 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.486 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.487 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.488 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.489 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "min_score": { 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_score", 2024-09-13T18:30:00.490 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-09-13T18:30:00.491 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "upmap", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-compat", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "none", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap" 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Balancer mode", 2024-09-13T18:30:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_ids": { 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_ids", 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_deviation": { 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_deviation", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_optimizations": { 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_down_multiplier": { 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_down_multiplier", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.498 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_refresh_rate": { 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_refresh_rate", 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "20", 2024-09-13T18:30:00.499 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_starting_port": { 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_starting_port", 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.500 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4721", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_ptrace": { 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_ptrace", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.501 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_interval": { 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_interval", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.502 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.503 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.7", 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "cgroups_split": { 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cgroups_split", 2024-09-13T18:30:00.504 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "config_checks_enabled": { 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_checks_enabled", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "config_dashboard": { 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_dashboard", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.507 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_alertmanager": { 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_alertmanager", 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.508 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_base": { 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_base", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.509 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_elasticsearch": { 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.510 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "elasticsearch container image", 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_grafana": { 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_grafana", 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.511 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_haproxy": { 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_haproxy", 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.512 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "HAproxy container image", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_agent": { 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.513 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_collector": { 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:30:00.514 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_query": { 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:30:00.515 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger query container image", 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.516 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_keepalived": { 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_keepalived", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Keepalived container image", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.517 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_loki": { 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_loki", 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Loki container image", 2024-09-13T18:30:00.518 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_node_exporter": { 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_node_exporter", 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.519 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nvmeof": { 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nvmeof", 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:30:00.520 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nvme-of container image", 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_prometheus": { 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_prometheus", 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.521 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_promtail": { 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_promtail", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.522 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Promtail container image", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_snmp_gateway": { 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "container_init": { 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_init", 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.524 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "daemon_cache_timeout": { 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.525 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:30:00.526 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "900", 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.527 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "default_registry": { 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_registry", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.528 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "device_cache_timeout": { 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_cache_timeout", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1800", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.529 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "device_enhanced_scan": { 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_enhanced_scan", 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:30:00.530 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "facts_cache_timeout": { 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "facts_cache_timeout", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:30:00.531 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "host_check_interval": { 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "host_check_interval", 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.532 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "hw_monitoring": { 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hw_monitoring", 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.533 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "inventory_list_all": { 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "inventory_list_all", 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.534 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.535 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.536 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "log_refresh_metadata": { 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_refresh_metadata", 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:30:00.537 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:30:00.538 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.539 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.540 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.541 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.542 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "*", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.543 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "max_count_per_host": { 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_count_per_host", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.544 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd_draining_count": { 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_osd_draining_count", 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.545 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "migration_current": { 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "migration_current", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.546 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "internal - do not modify", 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "root", 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.547 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm-package", 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "root" 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "oob_default_addr": { 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "oob_default_addr", 2024-09-13T18:30:00.548 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "169.254.1.1", 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.549 INFO:teuthology.orchestra.run.smithi053.stdout: "prometheus_alerts_path": { 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.550 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_insecure": { 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_insecure", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_password": { 2024-09-13T18:30:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_password", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.552 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_url": { 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_url", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.553 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_username": { 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_username", 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.554 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "secure_monitoring_stack": { 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:30:00.555 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "service_discovery_port": { 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "service_discovery_port", 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8765", 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.556 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "ssh_config_file": { 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssh_config_file", 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.557 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "use_agent": { 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_agent", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.558 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "use_repo_digest": { 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_repo_digest", 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.559 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_failed_host_check": { 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:30:00.560 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_daemons": { 2024-09-13T18:30:00.561 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_hosts": { 2024-09-13T18:30:00.562 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.563 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crash", 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.564 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.565 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.566 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.567 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.568 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.569 INFO:teuthology.orchestra.run.smithi053.stdout: "retain_interval": { 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retain_interval", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "31536000", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.570 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_recent_interval": { 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_recent_interval", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1209600", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.571 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dashboard", 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.572 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.573 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.574 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.575 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.576 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:30:00.577 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:30:00.578 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.579 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.580 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.581 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.582 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.583 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.584 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.585 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.586 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.587 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:30:00.588 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_URL": { 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:30:00.589 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:30:00.590 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:30:00.591 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.592 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.593 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.594 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.595 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.596 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.597 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.598 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.599 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.600 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.601 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.602 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.603 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.604 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.605 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.606 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.607 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.608 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8", 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.609 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "45", 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:30:00.610 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.611 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.615 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.616 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.617 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.618 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "cross_origin_url": { 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cross_origin_url", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.619 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "crt_file": { 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crt_file", 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.620 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "debug": { 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "debug", 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "jwt_token_ttl": { 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "jwt_token_ttl", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "28800", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.622 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.623 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.624 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.625 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.626 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.627 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.628 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "motd": { 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "motd", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "The message of the day", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.632 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8080", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.634 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl_server_port": { 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl_server_port", 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8443", 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.635 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "redirect", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.636 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect" 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-09-13T18:30:00.637 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "url_prefix": { 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url_prefix", 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.638 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "devicehealth", 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.639 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_monitoring": { 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_monitoring", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "monitor device health metrics", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.640 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.641 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.642 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.643 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.644 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.645 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "mark_out_threshold": { 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mark_out_threshold", 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2419200", 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.646 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": { 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_name", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "device_health_metrics", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.647 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "retention_period": { 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retention_period", 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15552000", 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.648 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_frequency": { 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_frequency", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.649 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "self_heal": { 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "self_heal", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.650 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.651 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_threshold": { 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_threshold", 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.652 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7257600", 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.653 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "diskprediction_local", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.654 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.655 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.656 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.657 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.658 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "predict_interval": { 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predict_interval", 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.659 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "predictor_model": { 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predictor_model", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.660 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "prophetstor", 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.661 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.662 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "influx", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": false, 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "batch_size": { 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "batch_size", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5000", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.663 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "database": { 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "database", 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "ceph", 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.664 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": { 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hostname", 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.665 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.666 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "30", 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "5", 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.667 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.668 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.669 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.670 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.671 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.672 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "password": { 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "password", 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.673 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "port": { 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "port", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8086", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.674 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server port", 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "false", 2024-09-13T18:30:00.675 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "threads": { 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threads", 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.676 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "32", 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.677 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: "username": { 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "username", 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.678 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.679 INFO:teuthology.orchestra.run.smithi053.stdout: "verify_ssl": { 2024-09-13T18:30:00.680 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "verify_ssl", 2024-09-13T18:30:00.680 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.680 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.680 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.680 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "true", 2024-09-13T18:30:00.680 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.680 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.681 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.681 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:30:00.681 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.681 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.681 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.681 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.681 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "insights", 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.682 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.683 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.684 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.684 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.684 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.684 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.684 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.684 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.684 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.685 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.686 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.687 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.688 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "iostat", 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.689 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.690 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.691 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.692 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.693 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.694 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "localpool", 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.695 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "failure_domain": { 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "failure_domain", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "host", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.696 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.697 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.698 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.699 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.700 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.701 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": { 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_size", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.702 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "num_rep": { 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "num_rep", 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3", 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.703 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": { 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_num", 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.704 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "128", 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "prefix": { 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prefix", 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.705 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "subtree": { 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "subtree", 2024-09-13T18:30:00.706 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "rack", 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirroring", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.708 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.709 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.710 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.711 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.712 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "nfs", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.714 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.715 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.716 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.717 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.718 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "fail_fs": { 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "fail_fs", 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.720 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.721 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.722 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.724 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.725 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator": { 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.726 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm", 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "rook", 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "test_orchestrator" 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Orchestrator backend", 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_perf_query", 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.728 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.729 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.731 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.732 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_support", 2024-09-13T18:30:00.733 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.734 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.735 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.736 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.738 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_autoscaler", 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.739 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.740 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.741 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.742 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.743 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.745 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "threshold": { 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threshold", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1.0", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "scaling threshold", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.746 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "progress", 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_pg_recovery_event": { 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.747 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.748 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.749 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.750 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.751 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.752 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.753 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "max_completed_events": { 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_completed_events", 2024-09-13T18:30:00.754 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "50", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:00.755 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus", 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "cache": { 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cache", 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.757 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "exclude_perf_counters": { 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "exclude_perf_counters", 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.758 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.759 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.760 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.761 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.762 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.763 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.764 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools": { 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.765 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "300", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.766 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_interval": { 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_interval", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15.0", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.768 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "9283", 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:30:00.769 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "stale_cache_strategy": { 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stale_cache_strategy", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "log", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.770 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "default", 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "default", 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: "error" 2024-09-13T18:30:00.771 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-09-13T18:30:00.772 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_support", 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.773 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.774 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.775 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.776 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.777 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.778 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_snap_create": { 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.779 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.780 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "trash_purge_schedule": { 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "trash_purge_schedule", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.781 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "restful", 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.782 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_auth": { 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_auth", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.783 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.784 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.785 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.786 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.787 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.788 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.789 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.790 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.791 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "selftest", 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.792 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.793 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.794 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.795 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.796 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.797 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "roption1": { 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption1", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.798 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "roption2": { 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption2", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "xyz", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.799 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption1": { 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption1", 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.800 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption2": { 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption2", 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.801 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption3": { 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption3", 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.802 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption4": { 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption4", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.803 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption5": { 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption5", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.804 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption6": { 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption6", 2024-09-13T18:30:00.805 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.806 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption7": { 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption7", 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:00.807 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "42", 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "testkey": { 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testkey", 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.808 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "testlkey": { 2024-09-13T18:30:00.809 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testlkey", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.810 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "testnewline": { 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testnewline", 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.811 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snap_schedule", 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.812 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_m_granularity": { 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_m_granularity", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.813 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "dump_on_update": { 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dump_on_update", 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.814 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.815 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.816 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.817 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.818 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.819 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.820 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stats", 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.822 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.823 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.824 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.825 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.826 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.827 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.828 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "status", 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.829 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.830 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.831 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.832 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.833 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.834 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telegraf", 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.835 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "address": { 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "address", 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.836 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.837 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15", 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.838 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.839 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.840 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.842 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.843 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.844 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telemetry", 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.845 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_basic": { 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_basic", 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:30:00.846 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_crash": { 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_crash", 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.847 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_device": { 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_device", 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.848 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_ident": { 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_ident", 2024-09-13T18:30:00.849 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:30:00.850 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_perf": { 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_perf", 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.851 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "contact": { 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "contact", 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.852 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "description": { 2024-09-13T18:30:00.853 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "description", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "device_url": { 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_url", 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.855 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.856 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.857 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "24", 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "8", 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.858 INFO:teuthology.orchestra.run.smithi053.stdout: "last_opt_revision": { 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "last_opt_revision", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.859 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard": { 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard", 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.860 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard_description": { 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard_description", 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.861 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.862 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.864 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.865 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.866 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.867 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.868 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "organization": { 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "organization", 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.869 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "proxy": { 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "proxy", 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.870 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "url": { 2024-09-13T18:30:00.871 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.872 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "test_orchestrator", 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.873 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.874 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.875 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.876 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.877 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.878 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.879 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.880 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.881 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.882 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.883 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.884 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.885 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.886 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_clones": { 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_clones", 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4", 2024-09-13T18:30:00.887 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:30:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.888 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_delay": { 2024-09-13T18:30:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:30:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.889 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:30:00.890 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:30:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:30:00.891 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.892 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:30:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.893 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix", 2024-09-13T18:30:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.894 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: "discovery_interval": { 2024-09-13T18:30:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "discovery_interval", 2024-09-13T18:30:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.895 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "100", 2024-09-13T18:30:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.896 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: "identifier": { 2024-09-13T18:30:00.897 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "identifier", 2024-09-13T18:30:00.898 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.898 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.898 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.898 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.898 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.898 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.899 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.899 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.899 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.899 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.899 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.899 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:00.900 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:00.900 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.900 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.900 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.900 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.900 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.901 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.901 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.901 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.901 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.901 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.901 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.902 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.904 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.905 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.906 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.907 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_host": { 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_host", 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.908 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_port": { 2024-09-13T18:30:00.909 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_port", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10051", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.910 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_sender": { 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_sender", 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.911 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: "modules": [ 2024-09-13T18:30:00.912 INFO:teuthology.orchestra.run.smithi053.stdout: "iostat", 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "nfs", 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "restful" 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "available_modules": [ 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "alerts", 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:00.913 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.915 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.916 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.917 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.918 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.919 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.919 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.919 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.919 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.919 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.919 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.919 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.920 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_destination": { 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_destination", 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.921 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_from_name": { 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_from_name", 2024-09-13T18:30:00.922 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "Ceph", 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Email From: name", 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.923 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_host": { 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_host", 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.924 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP server", 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_password": { 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_password", 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.925 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Password to authenticate with", 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_port": { 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_port", 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "465", 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP port", 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_sender": { 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_sender", 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:30:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_ssl": { 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_ssl", 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "smtp_user": { 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "smtp_user", 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "User to authenticate as", 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "balancer", 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "active": { 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "active", 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_time": { 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_time", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0000", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:30:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "begin_weekday": { 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "begin_weekday", 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-09-13T18:30:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_max_iterations": { 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:30:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "25", 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "250", 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_metrics": { 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_metrics", 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:30:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "crush_compat_step": { 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crush_compat_step", 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.5", 2024-09-13T18:30:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0.001", 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "0.999", 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "end_time": { 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_time", 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2359", 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "end_weekday": { 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "end_weekday", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "0", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "6", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:30:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "min_score": { 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_score", 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-09-13T18:30:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "upmap", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "crush-compat", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "none", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap" 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Balancer mode", 2024-09-13T18:30:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_ids": { 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_ids", 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_deviation": { 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_deviation", 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.955 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "upmap_max_optimizations": { 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:00.957 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephadm", 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_down_multiplier": { 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_down_multiplier", 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.958 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.959 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_refresh_rate": { 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_refresh_rate", 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "20", 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:30:00.960 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "agent_starting_port": { 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "agent_starting_port", 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4721", 2024-09-13T18:30:00.961 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_ptrace": { 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_ptrace", 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.962 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_interval": { 2024-09-13T18:30:00.963 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_interval", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.964 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0.7", 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.965 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "cgroups_split": { 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cgroups_split", 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.966 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "config_checks_enabled": { 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_checks_enabled", 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.967 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "config_dashboard": { 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "config_dashboard", 2024-09-13T18:30:00.968 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.969 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_alertmanager": { 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_alertmanager", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.970 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_base": { 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_base", 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.971 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_elasticsearch": { 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:30:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "elasticsearch container image", 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_grafana": { 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_grafana", 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.973 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_haproxy": { 2024-09-13T18:30:00.974 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_haproxy", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "HAproxy container image", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.975 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_agent": { 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.976 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_collector": { 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:30:00.977 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_jaeger_query": { 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.978 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Jaeger query container image", 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_keepalived": { 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_keepalived", 2024-09-13T18:30:00.979 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Keepalived container image", 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.980 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_loki": { 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_loki", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Loki container image", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.981 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_node_exporter": { 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_node_exporter", 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.982 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_nvmeof": { 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_nvmeof", 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.983 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Nvme-of container image", 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_prometheus": { 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_prometheus", 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.984 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Prometheus container image", 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_promtail": { 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_promtail", 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.985 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Promtail container image", 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "container_image_snmp_gateway": { 2024-09-13T18:30:00.986 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.987 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "container_init": { 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "container_init", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.988 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "daemon_cache_timeout": { 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.989 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "900", 2024-09-13T18:30:00.990 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "default_registry": { 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "default_registry", 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:00.991 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "docker.io", 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.992 INFO:teuthology.orchestra.run.smithi053.stdout: "device_cache_timeout": { 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_cache_timeout", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1800", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.993 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "device_enhanced_scan": { 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_enhanced_scan", 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.994 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "facts_cache_timeout": { 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "facts_cache_timeout", 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.995 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.996 INFO:teuthology.orchestra.run.smithi053.stdout: "host_check_interval": { 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "host_check_interval", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.997 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "hw_monitoring": { 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hw_monitoring", 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:00.998 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "inventory_list_all": { 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "inventory_list_all", 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:00.999 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.000 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.001 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "log_refresh_metadata": { 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_refresh_metadata", 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.002 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.003 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.004 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.005 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.006 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.007 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:30:01.008 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "*", 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.009 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "max_count_per_host": { 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_count_per_host", 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.010 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "max_osd_draining_count": { 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_osd_draining_count", 2024-09-13T18:30:01.011 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "migration_current": { 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "migration_current", 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "internal - do not modify", 2024-09-13T18:30:01.013 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": { 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mode", 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "root", 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.014 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm-package", 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "root" 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "oob_default_addr": { 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "oob_default_addr", 2024-09-13T18:30:01.015 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "169.254.1.1", 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.016 INFO:teuthology.orchestra.run.smithi053.stdout: "prometheus_alerts_path": { 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.017 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_insecure": { 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_insecure", 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.018 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_password": { 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_password", 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.019 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_url": { 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_url", 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.020 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.021 INFO:teuthology.orchestra.run.smithi053.stdout: "registry_username": { 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "registry_username", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.022 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "secure_monitoring_stack": { 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.023 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "service_discovery_port": { 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "service_discovery_port", 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8765", 2024-09-13T18:30:01.024 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "ssh_config_file": { 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssh_config_file", 2024-09-13T18:30:01.025 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.026 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:30:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "use_agent": { 2024-09-13T18:30:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_agent", 2024-09-13T18:30:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.028 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "use_repo_digest": { 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "use_repo_digest", 2024-09-13T18:30:01.029 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_failed_host_check": { 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:30:01.031 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_daemons": { 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.032 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_on_stray_hosts": { 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.033 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.034 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crash", 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.035 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.036 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.037 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.038 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.039 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.040 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.041 INFO:teuthology.orchestra.run.smithi053.stdout: "retain_interval": { 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retain_interval", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "31536000", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.042 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_recent_interval": { 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_recent_interval", 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1209600", 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.043 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dashboard", 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.044 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.045 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.046 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.047 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:30:01.048 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.049 INFO:teuthology.orchestra.run.smithi053.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.050 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.051 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.052 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:30:01.053 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.054 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:30:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:30:01.055 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.056 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.057 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:30:01.058 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.061 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.061 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.061 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.061 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.062 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.062 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.062 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.062 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.062 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.062 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.063 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.063 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:30:01.063 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:30:01.063 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.063 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.064 INFO:teuthology.orchestra.run.smithi053.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.065 INFO:teuthology.orchestra.run.smithi053.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.066 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.067 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.068 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.068 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.068 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.068 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.068 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.068 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:30:01.069 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:30:01.069 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.069 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.069 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.069 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.069 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.069 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.070 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.070 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.070 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.070 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.070 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.071 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_URL": { 2024-09-13T18:30:01.071 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:30:01.071 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.071 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.071 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.071 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.071 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.072 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.072 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.072 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.072 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.072 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.072 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.073 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:30:01.073 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:30:01.073 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.073 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.073 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.073 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-09-13T18:30:01.074 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.074 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.074 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.074 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.074 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.074 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.074 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.075 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.076 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.076 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.076 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.076 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.076 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.076 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.077 INFO:teuthology.orchestra.run.smithi053.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:30:01.077 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:30:01.077 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.077 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.077 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.077 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.077 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.079 INFO:teuthology.orchestra.run.smithi053.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:30:01.079 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:30:01.079 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.079 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.079 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.079 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.080 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.080 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.080 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.080 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.080 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.080 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.080 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.081 INFO:teuthology.orchestra.run.smithi053.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:30:01.081 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:30:01.081 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.081 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.081 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.082 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.082 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.082 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.082 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.082 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.082 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.082 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.083 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.083 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:30:01.083 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:30:01.083 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.083 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.083 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.084 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.084 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.084 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.084 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.084 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.084 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.085 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.085 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.085 INFO:teuthology.orchestra.run.smithi053.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:30:01.085 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:30:01.085 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.085 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.086 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.086 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.086 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.086 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.086 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.086 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.087 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.087 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.087 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.087 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:30:01.087 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:30:01.088 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.088 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.088 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.088 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.088 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.088 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.089 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.089 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.089 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.089 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.089 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.089 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:30:01.090 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:30:01.090 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.090 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.090 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.090 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.090 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.090 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.091 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.091 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.091 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.091 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.091 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.091 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:30:01.092 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:30:01.092 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.092 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.092 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.092 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.092 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.092 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.093 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.093 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.093 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.093 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.093 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.093 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:30:01.094 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:30:01.094 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.094 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.094 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.094 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.094 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.094 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.095 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.095 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.095 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.095 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.095 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.096 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:30:01.096 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:30:01.096 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.096 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.096 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.096 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.097 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.097 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.097 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.097 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.097 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.097 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.097 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.098 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.099 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.099 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.099 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.099 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.099 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.099 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.100 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.101 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.102 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.103 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.104 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.105 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "45", 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.106 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.107 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "admin", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.108 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.109 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.110 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.111 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.112 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.113 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.114 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "cross_origin_url": { 2024-09-13T18:30:01.115 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cross_origin_url", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "crt_file": { 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "crt_file", 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.117 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "debug": { 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "debug", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:30:01.118 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "jwt_token_ttl": { 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "jwt_token_ttl", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "28800", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.119 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.120 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.121 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.122 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.123 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.124 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.125 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "motd": { 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "motd", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.126 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "The message of the day", 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.127 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-09-13T18:30:01.128 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-09-13T18:30:01.129 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8080", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-09-13T18:30:01.130 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.131 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl_server_port": { 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl_server_port", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8443", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.132 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "redirect", 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.133 INFO:teuthology.orchestra.run.smithi053.stdout: "redirect" 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.134 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "url_prefix": { 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url_prefix", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.135 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.136 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "devicehealth", 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_monitoring": { 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_monitoring", 2024-09-13T18:30:01.137 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "monitor device health metrics", 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.138 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.139 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.140 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.141 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.142 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.143 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "mark_out_threshold": { 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mark_out_threshold", 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "2419200", 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.144 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_name": { 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pool_name", 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "device_health_metrics", 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.145 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "retention_period": { 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "retention_period", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15552000", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.146 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_frequency": { 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_frequency", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.147 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "self_heal": { 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "self_heal", 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.148 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.149 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "warn_threshold": { 2024-09-13T18:30:01.150 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "warn_threshold", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "7257600", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "diskprediction_local", 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.152 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.153 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.154 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.155 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.156 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.157 INFO:teuthology.orchestra.run.smithi053.stdout: "predict_interval": { 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predict_interval", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "86400", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.158 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "predictor_model": { 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "predictor_model", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "prophetstor", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.159 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "600", 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.160 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "influx", 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": false, 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "batch_size": { 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "batch_size", 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.161 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5000", 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "database": { 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "database", 2024-09-13T18:30:01.162 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "ceph", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": { 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "hostname", 2024-09-13T18:30:01.163 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:01.164 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "30", 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "5", 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.165 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.166 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.167 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.168 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.169 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.170 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "password": { 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "password", 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.171 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "port": { 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "port", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.172 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "8086", 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "InfluxDB server port", 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "ssl": { 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "ssl", 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.173 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "false", 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.174 INFO:teuthology.orchestra.run.smithi053.stdout: "threads": { 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threads", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "32", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "username": { 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "username", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.176 INFO:teuthology.orchestra.run.smithi053.stdout: "verify_ssl": { 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "verify_ssl", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "true", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.177 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "insights", 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.178 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.179 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.180 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.183 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "iostat", 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.184 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.185 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.186 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.187 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.188 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.189 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.190 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "localpool", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "failure_domain": { 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "failure_domain", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "host", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:30:01.191 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:30:01.192 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.192 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.192 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.192 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.192 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.192 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.193 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.193 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.193 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.193 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.193 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.193 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.194 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.195 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.196 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.197 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.198 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "min_size": { 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "min_size", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:30:01.199 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "num_rep": { 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "num_rep", 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3", 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.200 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_num": { 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_num", 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.201 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "128", 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "prefix": { 2024-09-13T18:30:01.202 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prefix", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.203 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "subtree": { 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "subtree", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "rack", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:30:01.204 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirroring", 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.205 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.206 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.207 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.208 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.209 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.210 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.211 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "nfs", 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.212 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.213 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.213 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.213 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.213 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.213 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.213 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.213 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.214 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.214 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.214 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.214 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.215 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.217 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.218 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.219 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "fail_fs": { 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "fail_fs", 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.220 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.221 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.222 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.223 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.224 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.225 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.226 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator": { 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "orchestrator", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.227 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "cephadm", 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "rook", 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "test_orchestrator" 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Orchestrator backend", 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.228 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_perf_query", 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.229 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.230 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.231 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.232 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.233 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.234 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.234 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.234 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.234 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.234 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "osd_support", 2024-09-13T18:30:01.235 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.236 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.237 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.238 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.240 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.241 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "pg_autoscaler", 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.242 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.243 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.244 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.245 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.246 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.247 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:01.248 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "threshold": { 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "threshold", 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "3.0", 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1.0", 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "scaling threshold", 2024-09-13T18:30:01.250 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "progress", 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_pg_recovery_event": { 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:30:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-09-13T18:30:01.252 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.253 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.254 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.255 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.256 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.257 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.258 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "max_completed_events": { 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_completed_events", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "50", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.259 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "sleep_interval": { 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "sleep_interval", 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "5", 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:30:01.260 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "prometheus", 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "cache": { 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cache", 2024-09-13T18:30:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "exclude_perf_counters": { 2024-09-13T18:30:01.262 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "exclude_perf_counters", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.264 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.265 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.266 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.267 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.268 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools": { 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools", 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.269 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "300", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.270 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "scrape_interval": { 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "scrape_interval", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15.0", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.271 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "::", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:30:01.272 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "9283", 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.273 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "stale_cache_strategy": { 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stale_cache_strategy", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "log", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.274 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_behaviour": { 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_behaviour", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "default", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.275 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "default", 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "error" 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "standby_error_status_code": { 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "standby_error_status_code", 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.276 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "500", 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "400", 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "599", 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.277 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_support", 2024-09-13T18:30:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.278 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.279 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.280 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.281 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.282 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.283 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.284 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.285 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.286 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.287 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.288 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.289 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.289 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.289 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.289 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.290 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.290 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.290 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.290 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.290 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.290 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.291 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_snap_create": { 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10", 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.292 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:30:01.293 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.294 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.294 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.294 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.294 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.294 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.294 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.295 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.295 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.295 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.295 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.295 INFO:teuthology.orchestra.run.smithi053.stdout: "trash_purge_schedule": { 2024-09-13T18:30:01.295 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "trash_purge_schedule", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.296 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "restful", 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: "enable_auth": { 2024-09-13T18:30:01.297 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enable_auth", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "key_file": { 2024-09-13T18:30:01.298 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "key_file", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.299 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.300 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.301 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.302 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.303 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.304 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "server_addr": { 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_addr", 2024-09-13T18:30:01.305 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "server_port": { 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "server_port", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.306 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.307 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "selftest", 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.308 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.309 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.310 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.311 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.312 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.313 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "roption1": { 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption1", 2024-09-13T18:30:01.314 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "roption2": { 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "roption2", 2024-09-13T18:30:01.315 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "xyz", 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption1": { 2024-09-13T18:30:01.316 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption1", 2024-09-13T18:30:01.317 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.317 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.317 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.317 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.317 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption2": { 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption2", 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.318 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption3": { 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption3", 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "float", 2024-09-13T18:30:01.319 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption4": { 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption4", 2024-09-13T18:30:01.320 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption5": { 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption5", 2024-09-13T18:30:01.321 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption6": { 2024-09-13T18:30:01.322 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption6", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.323 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "rwoption7": { 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rwoption7", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "1", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "42", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.324 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "testkey": { 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testkey", 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.325 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "testlkey": { 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testlkey", 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "testnewline": { 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "testnewline", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.327 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snap_schedule", 2024-09-13T18:30:01.328 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "allow_m_granularity": { 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "allow_m_granularity", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:30:01.329 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "dump_on_update": { 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "dump_on_update", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:30:01.330 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.331 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.332 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.333 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.334 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.335 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "stats", 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.336 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.337 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.338 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.339 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.339 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.339 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.339 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.339 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.339 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.340 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.340 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.340 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.340 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.340 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.340 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.341 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.342 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.343 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "status", 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.344 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.345 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.346 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.347 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.348 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.349 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.350 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telegraf", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "address": { 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "address", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.351 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "15", 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.352 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.353 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.354 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.355 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.356 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.357 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.358 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "telemetry", 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_basic": { 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_basic", 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.359 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_crash": { 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_crash", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.360 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_device": { 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_device", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.361 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_ident": { 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_ident", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.362 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "channel_perf": { 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "channel_perf", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.363 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "contact": { 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "contact", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.364 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "description": { 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "description", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.365 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "device_url": { 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "device_url", 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.366 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "enabled": { 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "enabled", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.367 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.368 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "24", 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "8", 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "last_opt_revision": { 2024-09-13T18:30:01.369 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "last_opt_revision", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "1", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.370 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard": { 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.371 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "leaderboard_description": { 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "leaderboard_description", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.372 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.373 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.374 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.375 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.376 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.377 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "organization": { 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "organization", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.378 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "proxy": { 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "proxy", 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.379 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "url": { 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "url", 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:30:01.380 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "test_orchestrator", 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.381 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.382 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.384 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.385 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.386 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.387 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.388 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.389 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.390 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.391 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.392 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "max_concurrent_clones": { 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "max_concurrent_clones", 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "4", 2024-09-13T18:30:01.393 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_delay": { 2024-09-13T18:30:01.394 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "0", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.395 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "True", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.396 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix", 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: "can_run": true, 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: "error_string": "", 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: "module_options": { 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: "discovery_interval": { 2024-09-13T18:30:01.397 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "discovery_interval", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "uint", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "100", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.398 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "identifier": { 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "identifier", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.399 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "interval": { 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "interval", 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "secs", 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "60", 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.400 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "log_level": { 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_level", 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.401 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.402 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster": { 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.403 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_cluster_level": { 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_cluster_level", 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.404 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "info", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [ 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "critical", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "debug", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "error", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "info", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "warning" 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.405 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "log_to_file": { 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "log_to_file", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "bool", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 1, 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "False", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.406 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_host": { 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_host", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.407 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_port": { 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_port", 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "int", 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "10051", 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.408 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "zabbix_sender": { 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "zabbix_sender", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "str", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "level": "advanced", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "flags": 0, 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "min": "", 2024-09-13T18:30:01.409 INFO:teuthology.orchestra.run.smithi053.stdout: "max": "", 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "enum_allowed": [], 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "desc": "", 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "long_desc": "", 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "tags": [], 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "see_also": [] 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "services": {}, 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "always_on_modules": { 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "octopus": [ 2024-09-13T18:30:01.410 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "pacific": [ 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-09-13T18:30:01.411 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.412 INFO:teuthology.orchestra.run.smithi053.stdout: "quincy": [ 2024-09-13T18:30:01.413 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-09-13T18:30:01.413 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-09-13T18:30:01.413 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-09-13T18:30:01.413 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-09-13T18:30:01.413 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-09-13T18:30:01.413 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-09-13T18:30:01.413 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "reef": [ 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "balancer", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "crash", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "devicehealth", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "orchestrator", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "pg_autoscaler", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "progress", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "rbd_support", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "status", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "telemetry", 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: "volumes" 2024-09-13T18:30:01.414 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "last_failure_osd_epoch": 0, 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "active_clients": [ 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "devicehealth", 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 88211871 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.415 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "libcephsqlite", 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1598969345 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "rbd_support", 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.416 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2827842914 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.417 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2413981801 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3017576771 2024-09-13T18:30:01.418 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2553088179 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.419 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 969146036 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.420 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2229318564 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.421 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4172431564 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.422 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1484640503 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "volumes", 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.87:0", 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3809889825 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.423 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.424 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:01.424 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:01.424 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66dc066a80 msgr2=0x7f66dc068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66dc066a80 0x7f66dc068f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f66e4006f90 tx=0x7f66e4008040 comp rx=0 tx=0).stop 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66fc1f2890 msgr2=0x7f66fc0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66fc1f2890 0x7f66fc0ace20 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f66f4098da0 tx=0x7f66e8005800 comp rx=0 tx=0).stop 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 shutdown_connections 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7f66dc066a80 0x7f66dc068f40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66fc1f2890 0x7f66fc0ace20 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66fc1f2410 0x7f66fc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 --2- 172.21.15.53:0/3499748407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66e8004d10 0x7f66fc0c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 >> 172.21.15.53:0/3499748407 conn(0x7f66fc065c80 msgr2=0x7f66fc159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 shutdown_connections 2024-09-13T18:30:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:00.455+0000 7f670223a640 1 -- 172.21.15.53:0/3499748407 wait complete. 2024-09-13T18:30:01.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr fail x 2024-09-13T18:30:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66ae82640 1 Processor -- start 2024-09-13T18:30:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66ae82640 1 -- start start 2024-09-13T18:30:01.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66ae82640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 0x7fe6640b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66ae82640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe66406b850 0x7fe6640cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66ae82640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6640b1ac0 con 0x7fe6640cbd60 2024-09-13T18:30:01.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66ae82640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6640b3010 con 0x7fe66406b850 2024-09-13T18:30:01.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66ae82640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664159ac0 con 0x7fe6640cb980 2024-09-13T18:30:01.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66941f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe6640cbd60 0x7fe66406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48508/0 (socket says 172.21.15.53:48508) 2024-09-13T18:30:01.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe66941f640 1 -- 172.21.15.53:0/2281385359 learned_addr learned my addr 172.21.15.53:0/2281385359 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe663fff640 1 --2- 172.21.15.53:0/2281385359 >> v2:172.21.15.87:3300/0 conn(0x7fe66406b850 0x7fe6640cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.563+0000 7fe668c1e640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 0x7fe6640b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606813093 0 0) 0x7fe6640b1ac0 con 0x7fe6640cbd60 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c003530 con 0x7fe6640cbd60 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950783693 0 0) 0x7fe64c003530 con 0x7fe6640cbd60 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 msgr2=0x7fe6640b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 0x7fe6640b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 >> v2:172.21.15.87:3300/0 conn(0x7fe66406b850 msgr2=0x7fe6640cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 --2- 172.21.15.53:0/2281385359 >> v2:172.21.15.87:3300/0 conn(0x7fe66406b850 0x7fe6640cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664159da0 con 0x7fe6640cbd60 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe65c001680 con 0x7fe6640cbd60 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 >> v1:172.21.15.53:6789/0 conn(0x7fe6640cbd60 legacy=0x7fe66406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 0x7fe64c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c003f00 0x7fe64c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe64c004d10 0x7fe64c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640b3010 con 0x7fe64c003f00 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664159ac0 con 0x7fe64c004d10 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c00dbf0 con 0x7fe6640cb980 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe663fff640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c003f00 0x7fe64c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe668c1e640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 0x7fe64c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66941f640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe64c004d10 0x7fe64c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe663fff640 1 -- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 msgr2=0x7fe64c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe663fff640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6640cb980 0x7fe64c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe663fff640 1 -- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe64c004d10 msgr2=0x7fe64c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe663fff640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe64c004d10 0x7fe64c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe663fff640 1 -- 172.21.15.53:0/2281385359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c003530 con 0x7fe64c003f00 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe663fff640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c003f00 0x7fe64c0047d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe658009ab0 tx=0x7fe65801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce25410ba71113c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580a55f0 con 0x7fe64c003f00 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6580a5750 con 0x7fe64c003f00 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe6637fe640 1 -- 172.21.15.53:0/2281385359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580a5b00 con 0x7fe64c003f00 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66ae82640 1 -- 172.21.15.53:0/2281385359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c003f00 msgr2=0x7fe64c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66ae82640 1 --2- 172.21.15.53:0/2281385359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c003f00 0x7fe64c0047d0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe658009ab0 tx=0x7fe65801ca20 comp rx=0 tx=0).stop 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66941f640 1 -- 172.21.15.53:0/2281385359 reap_dead start 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66ae82640 1 -- 172.21.15.53:0/2281385359 shutdown_connections 2024-09-13T18:30:01.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66ae82640 1 -- 172.21.15.53:0/2281385359 >> 172.21.15.53:0/2281385359 conn(0x7fe664065c80 msgr2=0x7fe664066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:01.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66ae82640 1 -- 172.21.15.53:0/2281385359 shutdown_connections 2024-09-13T18:30:01.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.567+0000 7fe66ae82640 1 -- 172.21.15.53:0/2281385359 wait complete. 2024-09-13T18:30:01.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 Processor -- start 2024-09-13T18:30:01.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 -- start start 2024-09-13T18:30:01.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe64c003f00 0x7fe664149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe66413ed30 0x7fe6640ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6640ace20 0x7fe66415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664145ef0 con 0x7fe6640ace20 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66415bab0 con 0x7fe66413ed30 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640ad260 con 0x7fe64c003f00 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6640ace20 0x7fe66415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6640ace20 0x7fe66415aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46190/0 (socket says 172.21.15.53:46190) 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 -- 172.21.15.53:0/1989789649 learned_addr learned my addr 172.21.15.53:0/1989789649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe668c1e640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe64c003f00 0x7fe664149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe663fff640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe66413ed30 0x7fe6640ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 -- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe64c003f00 msgr2=0x7fe664149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe64c003f00 0x7fe664149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 -- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe66413ed30 msgr2=0x7fe6640ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe66413ed30 0x7fe6640ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 -- 172.21.15.53:0/1989789649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66415b7d0 con 0x7fe6640ace20 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66941f640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6640ace20 0x7fe66415aae0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e700 tx=0x7fe65c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00c640 con 0x7fe6640ace20 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00c7a0 con 0x7fe6640ace20 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00cb50 con 0x7fe6640ace20 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe664145830 con 0x7fe6640ace20 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66413f1b0 con 0x7fe6640ace20 2024-09-13T18:30:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.571+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe664067400 con 0x7fe6640ace20 2024-09-13T18:30:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.575+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 12) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe65c00ccb0 con 0x7fe6640ace20 2024-09-13T18:30:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.575+0000 7fe6617fa640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe650066a80 0x7fe650068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.575+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe65c0840a0 con 0x7fe6640ace20 2024-09-13T18:30:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.575+0000 7fe668c1e640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe650066a80 0x7fe650068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.575+0000 7fe668c1e640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe650066a80 0x7fe650068f40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe654007440 tx=0x7fe65400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.579+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe65c0b5db0 con 0x7fe6640ace20 2024-09-13T18:30:01.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.775+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr fail", "who": "x"} v 0) v1 -- 0x7fe66414f4b0 con 0x7fe6640ace20 2024-09-13T18:30:01.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.783+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 13) v1 ==== 43018+0+0 (secure 0 0 0) 0x7fe65c051210 con 0x7fe6640ace20 2024-09-13T18:30:01.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.783+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe650066a80 msgr2=0x7fe650068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.783+0000 7fe6617fa640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe650066a80 0x7fe650068f40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe654007440 tx=0x7fe65400b040 comp rx=0 tx=0).stop 2024-09-13T18:30:01.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.783+0000 7fe6617fa640 1 -- 172.21.15.53:0/1989789649 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "mgr fail", "who": "x"}]=0 v13) v1 ==== 68+0+0 (secure 0 0 0) 0x7fe65c07ffb0 con 0x7fe6640ace20 2024-09-13T18:30:01.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6640ace20 msgr2=0x7fe66415aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6640ace20 0x7fe66415aae0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e700 tx=0x7fe65c00ebc0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 shutdown_connections 2024-09-13T18:30:01.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:6832/133103669,v1:172.21.15.87:6833/133103669] conn(0x7fe650066a80 0x7fe650068f40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6640ace20 0x7fe66415aae0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe66413ed30 0x7fe6640ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 --2- 172.21.15.53:0/1989789649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe64c003f00 0x7fe664149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 >> 172.21.15.53:0/1989789649 conn(0x7fe664065c80 msgr2=0x7fe6640adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:01.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 shutdown_connections 2024-09-13T18:30:01.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.787+0000 7fe66ae82640 1 -- 172.21.15.53:0/1989789649 wait complete. 2024-09-13T18:30:01.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:01.890 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.887+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.891 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.887+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.891 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.887+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.891 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.887+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.891 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.887+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.891 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.891+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.892 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.891+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.892 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.891+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.892 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.891+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.892 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:30:01.891+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:30:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b6abd640 1 Processor -- start 2024-09-13T18:30:01.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b6abd640 1 -- start start 2024-09-13T18:30:01.950 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:01.946+0000 7f1044800180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b6abd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b0070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b6abd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24b00711d0 0x7f24b01640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b6abd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b006d480 con 0x7f24b01582a0 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b6abd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b015aaf0 con 0x7f24b00711d0 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b6abd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b006d760 con 0x7f24b015b7c0 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b4859640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f24b01582a0 0x7f24b006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48516/0 (socket says 172.21.15.53:48516) 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b4859640 1 -- 172.21.15.53:0/1615457718 learned_addr learned my addr 172.21.15.53:0/1615457718 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:01.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24affff640 1 --2- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b0070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24b505a640 1 --2- 172.21.15.53:0/1615457718 >> v2:172.21.15.87:3300/0 conn(0x7f24b00711d0 0x7f24b01640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24af7fe640 1 -- 172.21.15.53:0/1615457718 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878540155 0 0) 0x7f24b006d480 con 0x7f24b01582a0 2024-09-13T18:30:01.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.947+0000 7f24af7fe640 1 -- 172.21.15.53:0/1615457718 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a0003530 con 0x7f24b01582a0 2024-09-13T18:30:01.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24af7fe640 1 -- 172.21.15.53:0/1615457718 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 530963510 0 0) 0x7f24a0003530 con 0x7f24b01582a0 2024-09-13T18:30:01.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b505a640 1 -- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 msgr2=0x7f24b0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:01.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b505a640 1 --2- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b0070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b505a640 1 -- 172.21.15.53:0/1615457718 >> v1:172.21.15.53:6789/0 conn(0x7f24b01582a0 legacy=0x7f24b006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b505a640 1 -- 172.21.15.53:0/1615457718 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b015ace0 con 0x7f24b00711d0 2024-09-13T18:30:01.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b505a640 1 --2- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b00711d0 0x7f24b01640f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009d90 tx=0x7f24a801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ec7907804d42b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:01.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24af7fe640 1 -- 172.21.15.53:0/1615457718 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c001680 con 0x7f24b00711d0 2024-09-13T18:30:01.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24af7fe640 1 -- 172.21.15.53:0/1615457718 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a80a5580 con 0x7f24b00711d0 2024-09-13T18:30:01.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24af7fe640 1 -- 172.21.15.53:0/1615457718 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80a5910 con 0x7f24b00711d0 2024-09-13T18:30:01.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 -- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b00711d0 msgr2=0x7f24b01640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 --2- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b00711d0 0x7f24b01640f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009d90 tx=0x7f24a801c890 comp rx=0 tx=0).stop 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 -- 172.21.15.53:0/1615457718 shutdown_connections 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 --2- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b00711d0 0x7f24b01640f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 --2- 172.21.15.53:0/1615457718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b0070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 -- 172.21.15.53:0/1615457718 >> 172.21.15.53:0/1615457718 conn(0x7f24b0065c80 msgr2=0x7f24b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 -- 172.21.15.53:0/1615457718 shutdown_connections 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.951+0000 7f24b6abd640 1 -- 172.21.15.53:0/1615457718 wait complete. 2024-09-13T18:30:01.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 Processor -- start 2024-09-13T18:30:01.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 -- start start 2024-09-13T18:30:01.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b00711d0 0x7f24b014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b01582a0 0x7f24b00b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b00b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0156300 con 0x7f24b00711d0 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b01565e0 con 0x7f24b01582a0 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b01568c0 con 0x7f24b015b7c0 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b00711d0 0x7f24b014a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b00711d0 0x7f24b014a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46300/0 (socket says 172.21.15.53:46300) 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 -- 172.21.15.53:0/2127367073 learned_addr learned my addr 172.21.15.53:0/2127367073 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24affff640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b01582a0 0x7f24b00b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b505a640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b00b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:01.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 -- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 msgr2=0x7f24b00b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b00b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 -- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b01582a0 msgr2=0x7f24b00b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b01582a0 0x7f24b00b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 -- 172.21.15.53:0/2127367073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8009a70 con 0x7f24b00711d0 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24affff640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b01582a0 0x7f24b00b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b4859640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b00711d0 0x7f24b014a2e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c780 tx=0x7f249c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24ad7fa640 1 -- 172.21.15.53:0/2127367073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c005cf0 con 0x7f24b00711d0 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24ad7fa640 1 -- 172.21.15.53:0/2127367073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c005e50 con 0x7f24b00711d0 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b0156ba0 con 0x7f24b00711d0 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24ad7fa640 1 -- 172.21.15.53:0/2127367073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c0072b0 con 0x7f24b00711d0 2024-09-13T18:30:01.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b0157160 con 0x7f24b00711d0 2024-09-13T18:30:01.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24ad7fa640 1 -- 172.21.15.53:0/2127367073 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 13) v1 ==== 43018+0+0 (secure 0 0 0) 0x7f249c007410 con 0x7f24b00711d0 2024-09-13T18:30:01.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b0067400 con 0x7f24b00711d0 2024-09-13T18:30:01.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.955+0000 7f24ad7fa640 1 -- 172.21.15.53:0/2127367073 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f249c047b10 con 0x7f24b00711d0 2024-09-13T18:30:01.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:01.959+0000 7f24ad7fa640 1 -- 172.21.15.53:0/2127367073 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f249c00ce30 con 0x7f24b00711d0 2024-09-13T18:30:02.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.151+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24b006b970 con 0x7f24b00711d0 2024-09-13T18:30:02.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24ad7fa640 1 -- 172.21.15.53:0/2127367073 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4727 (secure 0 0 0) 0x7f249c01ab50 con 0x7f24b00711d0 2024-09-13T18:30:02.156 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:02.156 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:30:02.156 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2024-09-13T18:30:02.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b00711d0 msgr2=0x7f24b014a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:02.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b00711d0 0x7f24b014a2e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c780 tx=0x7f249c00cc40 comp rx=0 tx=0).stop 2024-09-13T18:30:02.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 shutdown_connections 2024-09-13T18:30:02.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24b015b7c0 0x7f24b00b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24b01582a0 0x7f24b00b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 --2- 172.21.15.53:0/2127367073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b00711d0 0x7f24b014a2e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 >> 172.21.15.53:0/2127367073 conn(0x7f24b0065c80 msgr2=0x7f24b0066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:02.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 shutdown_connections 2024-09-13T18:30:02.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.155+0000 7f24b6abd640 1 -- 172.21.15.53:0/2127367073 wait complete. 2024-09-13T18:30:02.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-13T18:30:02.306 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5960,"entity":{"name":{"type":"client","num":5960},"addr":{"type":"any","addr":"172.21.15.53:0","nonce":152102222}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.39999605900000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9981709463393582,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5960 172.21.15.53:0/152102222","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"y","hostname":"smithi053","pid":"28616","root":"/"}},{"id":5957,"entity":{"name":{"type":"client","num":5957},"addr":{"type":"any","addr":"172.21.15.53:0","nonce":3363929809}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.39999605900000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9981709463393582,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5957 172.21.15.53:0/3363929809","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3","ceph_version":"ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)","entity_id":"y","hostname":"smithi053","pid":"28616","root":"/"}}] 2024-09-13T18:30:02.307 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28616", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.53:0", "nonce": 152102222, "type": "any" }, "name": { "num": 5960, "type": "client" } }, "id": 5960, "inst": "client.5960 172.21.15.53:0/152102222", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9981709463393582 }, "state": "open", "uptime": 0.399996059 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28616", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.53:0", "nonce": 3363929809, "type": "any" }, "name": { "num": 5957, "type": "client" } }, "id": 5957, "inst": "client.5957 172.21.15.53:0/3363929809", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9981709463393582 }, "state": "open", "uptime": 0.399996059 } ] 2024-09-13T18:30:02.307 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:30:02.307 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:30:02.307 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:02.321 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:02.318+0000 7f1044800180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:30:02.389 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:02.451 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:02.446+0000 7f1044800180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:30:02.477 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:30:02.478 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:02.478 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:02.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:02.484 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:30:02.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:02.484 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:30:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T18:30:02.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:02.532 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:02.532 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:02.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:02.538 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:30:02.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:02.538 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:30:02.584 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-13T18:30:02.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:02.586 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:02.586 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:02.591 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:02.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:30:02.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:02.592 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:30:02.640 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:30:02.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:02.641 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:02.641 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:02.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:02.646 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:30:02.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:02.646 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:30:02.692 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:30:02.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:02.693 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:02.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 Processor -- start 2024-09-13T18:30:02.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 -- start start 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40940cb980 0x7f40940b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f409406b850 0x7f40940cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40940cbd60 0x7f409406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40940b1ac0 con 0x7f409406b850 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4094159ac0 con 0x7f40940cbd60 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409bd4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4094159da0 con 0x7f40940cb980 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f409406b850 0x7f40940cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:02.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f409406b850 0x7f40940cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46314/0 (socket says 172.21.15.53:46314) 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 -- 172.21.15.53:0/1946781940 learned_addr learned my addr 172.21.15.53:0/1946781940 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f4099ae6640 1 --2- 172.21.15.53:0/1946781940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40940cb980 0x7f40940b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f409a2e7640 1 --2- 172.21.15.53:0/1946781940 >> v2:172.21.15.87:3300/0 conn(0x7f40940cbd60 0x7f409406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 -- 172.21.15.53:0/1946781940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40940cb980 msgr2=0x7f40940b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 --2- 172.21.15.53:0/1946781940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40940cb980 0x7f40940b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 -- 172.21.15.53:0/1946781940 >> v2:172.21.15.87:3300/0 conn(0x7f40940cbd60 msgr2=0x7f409406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 --2- 172.21.15.53:0/1946781940 >> v2:172.21.15.87:3300/0 conn(0x7f40940cbd60 0x7f409406fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 -- 172.21.15.53:0/1946781940 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409415a080 con 0x7f409406b850 2024-09-13T18:30:02.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.831+0000 7f40992e5640 1 --2- 172.21.15.53:0/1946781940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409406b850 0x7f40940cdd40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f4084009870 tx=0x7f408401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe14b8480c752fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:02.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f4098ae4640 1 -- 172.21.15.53:0/1946781940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840ab600 con 0x7f409406b850 2024-09-13T18:30:02.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f4098ae4640 1 -- 172.21.15.53:0/1946781940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40840a7050 con 0x7f409406b850 2024-09-13T18:30:02.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f4098ae4640 1 -- 172.21.15.53:0/1946781940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840ab980 con 0x7f409406b850 2024-09-13T18:30:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- 172.21.15.53:0/1946781940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409406b850 msgr2=0x7f40940cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 --2- 172.21.15.53:0/1946781940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409406b850 0x7f40940cdd40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f4084009870 tx=0x7f408401c460 comp rx=0 tx=0).stop 2024-09-13T18:30:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- 172.21.15.53:0/1946781940 shutdown_connections 2024-09-13T18:30:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 --2- 172.21.15.53:0/1946781940 >> v2:172.21.15.87:3300/0 conn(0x7f40940cbd60 0x7f409406fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 --2- 172.21.15.53:0/1946781940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f409406b850 0x7f40940cdd40 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 --2- 172.21.15.53:0/1946781940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40940cb980 0x7f40940b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- 172.21.15.53:0/1946781940 >> 172.21.15.53:0/1946781940 conn(0x7f4094065c80 msgr2=0x7f4094066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:02.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- 172.21.15.53:0/1946781940 shutdown_connections 2024-09-13T18:30:02.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- 172.21.15.53:0/1946781940 wait complete. 2024-09-13T18:30:02.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 Processor -- start 2024-09-13T18:30:02.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- start start 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f409406b850 0x7f4094159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940cb980 0x7f4094143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40940cbd60 0x7f40941f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941556e0 con 0x7f40940cb980 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940ccdc0 con 0x7f40940cbd60 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409bd4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940cd0a0 con 0x7f409406b850 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940cb980 0x7f4094143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940cb980 0x7f4094143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46328/0 (socket says 172.21.15.53:46328) 2024-09-13T18:30:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 -- 172.21.15.53:0/337721362 learned_addr learned my addr 172.21.15.53:0/337721362 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f4099ae6640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f409406b850 0x7f4094159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409a2e7640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40940cbd60 0x7f40941f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 -- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f409406b850 msgr2=0x7f4094159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f409406b850 0x7f4094159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 -- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40940cbd60 msgr2=0x7f40941f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40940cbd60 0x7f40941f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f40992e5640 1 -- 172.21.15.53:0/337721362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40840094d0 con 0x7f40940cb980 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.835+0000 7f409a2e7640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40940cbd60 0x7f40941f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f40992e5640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940cb980 0x7f4094143a50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f40840ae040 tx=0x7f4084019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f408a7fc640 1 -- 172.21.15.53:0/337721362 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840b4440 con 0x7f40940cb980 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f408a7fc640 1 -- 172.21.15.53:0/337721362 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40840b45a0 con 0x7f40940cb980 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4094155090 con 0x7f40940cb980 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f408a7fc640 1 -- 172.21.15.53:0/337721362 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840b4950 con 0x7f40940cb980 2024-09-13T18:30:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40940cd380 con 0x7f40940cb980 2024-09-13T18:30:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f408a7fc640 1 -- 172.21.15.53:0/337721362 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7f40840b2070 con 0x7f40940cb980 2024-09-13T18:30:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4094067400 con 0x7f40940cb980 2024-09-13T18:30:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f408a7fc640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40780355f0 0x7f4078037ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:02.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f408a7fc640 1 -- 172.21.15.53:0/337721362 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f40840e2220 con 0x7f40940cb980 2024-09-13T18:30:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f4099ae6640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40780355f0 0x7f4078037ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.839+0000 7f4099ae6640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40780355f0 0x7f4078037ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4090007a60 tx=0x7f4090008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:02.843+0000 7f408a7fc640 1 -- 172.21.15.53:0/337721362 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40840b26e0 con 0x7f40940cb980 2024-09-13T18:30:02.873 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:02.870+0000 7f1044800180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:30:02.923 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:02.918+0000 7f1044800180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:30:02.971 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:02.966+0000 7f1044800180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:30:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.035+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4094155850 con 0x7f40940cb980 2024-09-13T18:30:03.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f408a7fc640 1 -- 172.21.15.53:0/337721362 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4727 (secure 0 0 0) 0x7f40840b0090 con 0x7f40940cb980 2024-09-13T18:30:03.039 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:03.039 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:30:03.040 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2024-09-13T18:30:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40780355f0 msgr2=0x7f4078037ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40780355f0 0x7f4078037ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4090007a60 tx=0x7f4090008040 comp rx=0 tx=0).stop 2024-09-13T18:30:03.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940cb980 msgr2=0x7f4094143a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940cb980 0x7f4094143a50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f40840ae040 tx=0x7f4084019200 comp rx=0 tx=0).stop 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 shutdown_connections 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40780355f0 0x7f4078037ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40940cbd60 0x7f40941f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940cb980 0x7f4094143a50 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 --2- 172.21.15.53:0/337721362 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f409406b850 0x7f4094159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 >> 172.21.15.53:0/337721362 conn(0x7f4094065c80 msgr2=0x7f40940adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 shutdown_connections 2024-09-13T18:30:03.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.039+0000 7f409bd4a640 1 -- 172.21.15.53:0/337721362 wait complete. 2024-09-13T18:30:03.044 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.042+0000 7f1044800180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:30:03.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:03.093 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.090+0000 7f1044800180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:30:03.166 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.162+0000 7f1044800180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:30:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.175+0000 7f03804a8640 1 Processor -- start 2024-09-13T18:30:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.175+0000 7f03804a8640 1 -- start start 2024-09-13T18:30:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f03804a8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03780cb980 0x7f03780b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f03804a8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03780cbd60 0x7f03780cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f03804a8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780b1ac0 con 0x7f037806b850 2024-09-13T18:30:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f03804a8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780b3010 con 0x7f03780cb980 2024-09-13T18:30:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f03804a8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0378159ac0 con 0x7f03780cbd60 2024-09-13T18:30:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03780cb980 0x7f03780b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03780cb980 0x7f03780b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46334/0 (socket says 172.21.15.53:46334) 2024-09-13T18:30:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 -- 172.21.15.53:0/3689378876 learned_addr learned my addr 172.21.15.53:0/3689378876 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037ea45640 1 --2- 172.21.15.53:0/3689378876 >> v2:172.21.15.87:3300/0 conn(0x7f03780cbd60 0x7f03780cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 -- 172.21.15.53:0/3689378876 >> v2:172.21.15.87:3300/0 conn(0x7f03780cbd60 msgr2=0x7f03780cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 --2- 172.21.15.53:0/3689378876 >> v2:172.21.15.87:3300/0 conn(0x7f03780cbd60 0x7f03780cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 -- 172.21.15.53:0/3689378876 >> v1:172.21.15.87:6789/0 conn(0x7f037806b850 legacy=0x7f037806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 -- 172.21.15.53:0/3689378876 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378159da0 con 0x7f03780cb980 2024-09-13T18:30:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037e244640 1 --2- 172.21.15.53:0/3689378876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03780cb980 0x7f03780b33b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f03780709a0 tx=0x7f037401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571dd92af4c32763 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037d242640 1 -- 172.21.15.53:0/3689378876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740ab620 con 0x7f03780cb980 2024-09-13T18:30:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037d242640 1 -- 172.21.15.53:0/3689378876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03740ab780 con 0x7f03780cb980 2024-09-13T18:30:03.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.179+0000 7f037d242640 1 -- 172.21.15.53:0/3689378876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740abb10 con 0x7f03780cb980 2024-09-13T18:30:03.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- 172.21.15.53:0/3689378876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03780cb980 msgr2=0x7f03780b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 --2- 172.21.15.53:0/3689378876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03780cb980 0x7f03780b33b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f03780709a0 tx=0x7f037401c420 comp rx=0 tx=0).stop 2024-09-13T18:30:03.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- 172.21.15.53:0/3689378876 shutdown_connections 2024-09-13T18:30:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 --2- 172.21.15.53:0/3689378876 >> v2:172.21.15.87:3300/0 conn(0x7f03780cbd60 0x7f03780cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 --2- 172.21.15.53:0/3689378876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03780cb980 0x7f03780b33b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- 172.21.15.53:0/3689378876 >> 172.21.15.53:0/3689378876 conn(0x7f0378065c80 msgr2=0x7f0378066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- 172.21.15.53:0/3689378876 shutdown_connections 2024-09-13T18:30:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- 172.21.15.53:0/3689378876 wait complete. 2024-09-13T18:30:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 Processor -- start 2024-09-13T18:30:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- start start 2024-09-13T18:30:03.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f037806b850 0x7f037814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03780cb980 0x7f037813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03780cbd60 0x7f0378152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037814bea0 con 0x7f037806b850 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037814b290 con 0x7f03780cbd60 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037814b570 con 0x7f03780cb980 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f037806b850 0x7f037814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f037806b850 0x7f037814c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46348/0 (socket says 172.21.15.53:46348) 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 -- 172.21.15.53:0/22102528 learned_addr learned my addr 172.21.15.53:0/22102528 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037ea45640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03780cbd60 0x7f0378152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037da43640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03780cb980 0x7f037813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 -- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03780cb980 msgr2=0x7f037813baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03780cb980 0x7f037813baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 -- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03780cbd60 msgr2=0x7f0378152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03780cbd60 0x7f0378152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 -- 172.21.15.53:0/22102528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740094d0 con 0x7f037806b850 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037ea45640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03780cbd60 0x7f0378152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f037e244640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f037806b850 0x7f037814c140 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f037401a050 tx=0x7f037401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f036effd640 1 -- 172.21.15.53:0/22102528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740be3f0 con 0x7f037806b850 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f036effd640 1 -- 172.21.15.53:0/22102528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03740be550 con 0x7f037806b850 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037814b850 con 0x7f037806b850 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f036effd640 1 -- 172.21.15.53:0/22102528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740be8e0 con 0x7f037806b850 2024-09-13T18:30:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.183+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037814c870 con 0x7f037806b850 2024-09-13T18:30:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.187+0000 7f036effd640 1 -- 172.21.15.53:0/22102528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7f03740b43f0 con 0x7f037806b850 2024-09-13T18:30:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.187+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0378067400 con 0x7f037806b850 2024-09-13T18:30:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.187+0000 7f036effd640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f035c0355f0 0x7f035c037ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.187+0000 7f036effd640 1 -- 172.21.15.53:0/22102528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f03740e2870 con 0x7f037806b850 2024-09-13T18:30:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.187+0000 7f037da43640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f035c0355f0 0x7f035c037ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.187+0000 7f037da43640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f035c0355f0 0x7f035c037ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f03780ccc10 tx=0x7f0368008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.191+0000 7f036effd640 1 -- 172.21.15.53:0/22102528 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03740b3380 con 0x7f037806b850 2024-09-13T18:30:03.216 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.210+0000 7f1044800180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:30:03.353 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.350+0000 7f1044800180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:30:03.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.351+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f037814b6b0 con 0x7f037806b850 2024-09-13T18:30:03.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f036effd640 1 -- 172.21.15.53:0/22102528 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+17412 (secure 0 0 0) 0x7f037814b6b0 con 0x7f037806b850 2024-09-13T18:30:03.355 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:03.356 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":75,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:01.777246+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/1484640503":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/4172431564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/969146036":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2229318564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/88211871":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2413981801":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2827842914":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3017576771":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6833/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2553088179":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6832/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3809889825":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/1598969345":"2024-09-14T18:30:01.777203+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:03.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f035c0355f0 msgr2=0x7f035c037ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f035c0355f0 0x7f035c037ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f03780ccc10 tx=0x7f0368008040 comp rx=0 tx=0).stop 2024-09-13T18:30:03.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f037806b850 msgr2=0x7f037814c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f037806b850 0x7f037814c140 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f037401a050 tx=0x7f037401ac60 comp rx=0 tx=0).stop 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 shutdown_connections 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f035c0355f0 0x7f035c037ab0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03780cb980 0x7f037813baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03780cbd60 0x7f0378152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 --2- 172.21.15.53:0/22102528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f037806b850 0x7f037814c140 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 >> 172.21.15.53:0/22102528 conn(0x7f0378065c80 msgr2=0x7f03780ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 shutdown_connections 2024-09-13T18:30:03.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.355+0000 7f03804a8640 1 -- 172.21.15.53:0/22102528 wait complete. 2024-09-13T18:30:03.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:29:19.948503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:29:21.156674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:03.374 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:03.403 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.398+0000 7f1044800180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:30:03.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.487+0000 7f41533b3640 1 Processor -- start 2024-09-13T18:30:03.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.487+0000 7f41533b3640 1 -- start start 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.487+0000 7f41533b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c157020 0x7f414c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f414c06d270 0x7f414c06f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c06d6e0 con 0x7f414c156c40 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0715f0 con 0x7f414c06d270 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0b15a0 con 0x7f414c157020 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f414c06d270 0x7f414c06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f414c06d270 0x7f414c06f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46352/0 (socket says 172.21.15.53:46352) 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 -- 172.21.15.53:0/3696412207 learned_addr learned my addr 172.21.15.53:0/3696412207 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f415094e640 1 --2- 172.21.15.53:0/3696412207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c157020 0x7f414c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 -- 172.21.15.53:0/3696412207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c157020 msgr2=0x7f414c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 --2- 172.21.15.53:0/3696412207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c157020 0x7f414c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 -- 172.21.15.53:0/3696412207 >> v1:172.21.15.87:6789/0 conn(0x7f414c156c40 legacy=0x7f414c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:03.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 -- 172.21.15.53:0/3696412207 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0b1880 con 0x7f414c06d270 2024-09-13T18:30:03.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4151950640 1 --2- 172.21.15.53:0/3696412207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c06d270 0x7f414c06f330 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae767d759076249c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4143fff640 1 -- 172.21.15.53:0/3696412207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440a95f0 con 0x7f414c06d270 2024-09-13T18:30:03.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4143fff640 1 -- 172.21.15.53:0/3696412207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440a9750 con 0x7f414c06d270 2024-09-13T18:30:03.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f4143fff640 1 -- 172.21.15.53:0/3696412207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440a9ae0 con 0x7f414c06d270 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- 172.21.15.53:0/3696412207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c06d270 msgr2=0x7f414c06f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 --2- 172.21.15.53:0/3696412207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c06d270 0x7f414c06f330 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414401c530 comp rx=0 tx=0).stop 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- 172.21.15.53:0/3696412207 shutdown_connections 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 --2- 172.21.15.53:0/3696412207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c06d270 0x7f414c06f330 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 --2- 172.21.15.53:0/3696412207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c157020 0x7f414c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- 172.21.15.53:0/3696412207 >> 172.21.15.53:0/3696412207 conn(0x7f414c065c80 msgr2=0x7f414c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- 172.21.15.53:0/3696412207 shutdown_connections 2024-09-13T18:30:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.491+0000 7f41533b3640 1 -- 172.21.15.53:0/3696412207 wait complete. 2024-09-13T18:30:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 Processor -- start 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 -- start start 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c06d270 0x7f414c143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c156c40 0x7f414c1f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c152a00 0x7f414c152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c144350 con 0x7f414c152a00 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c1f6250 con 0x7f414c156c40 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c150cc0 con 0x7f414c06d270 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c152a00 0x7f414c152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c152a00 0x7f414c152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46360/0 (socket says 172.21.15.53:46360) 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 -- 172.21.15.53:0/2940061657 learned_addr learned my addr 172.21.15.53:0/2940061657 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f415094e640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c156c40 0x7f414c1f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f415114f640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c06d270 0x7f414c143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 -- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c06d270 msgr2=0x7f414c143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c06d270 0x7f414c143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 -- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c156c40 msgr2=0x7f414c1f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c156c40 0x7f414c1f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 -- 172.21.15.53:0/2940061657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440094d0 con 0x7f414c152a00 2024-09-13T18:30:03.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4151950640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c152a00 0x7f414c152f70 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f41440ab040 tx=0x7f414401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4141ffb640 1 -- 172.21.15.53:0/2940061657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440b1800 con 0x7f414c152a00 2024-09-13T18:30:03.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4141ffb640 1 -- 172.21.15.53:0/2940061657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440b1960 con 0x7f414c152a00 2024-09-13T18:30:03.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4141ffb640 1 -- 172.21.15.53:0/2940061657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440b1d10 con 0x7f414c152a00 2024-09-13T18:30:03.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c150f10 con 0x7f414c152a00 2024-09-13T18:30:03.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c15a990 con 0x7f414c152a00 2024-09-13T18:30:03.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4141ffb640 1 -- 172.21.15.53:0/2940061657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7f41440ba3a0 con 0x7f414c152a00 2024-09-13T18:30:03.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c06f330 con 0x7f414c152a00 2024-09-13T18:30:03.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4141ffb640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41300355f0 0x7f4130037ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f4141ffb640 1 -- 172.21.15.53:0/2940061657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f41440e2fc0 con 0x7f414c152a00 2024-09-13T18:30:03.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f415114f640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41300355f0 0x7f4130037ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.495+0000 7f415114f640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41300355f0 0x7f4130037ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f414c153de0 tx=0x7f4148009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.499+0000 7f4141ffb640 1 -- 172.21.15.53:0/2940061657 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41440a95b0 con 0x7f414c152a00 2024-09-13T18:30:03.621 INFO:tasks.ceph.mgr.x.smithi087.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T18:30:03.621 INFO:tasks.ceph.mgr.x.smithi087.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T18:30:03.621 INFO:tasks.ceph.mgr.x.smithi087.stderr: from numpy import show_config as show_numpy_config 2024-09-13T18:30:03.628 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.626+0000 7f1044800180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:30:03.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f414c14ae50 con 0x7f414c152a00 2024-09-13T18:30:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f4141ffb640 1 -- 172.21.15.53:0/2940061657 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41440c2350 con 0x7f414c152a00 2024-09-13T18:30:03.660 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41300355f0 msgr2=0x7f4130037ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41300355f0 0x7f4130037ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f414c153de0 tx=0x7f4148009040 comp rx=0 tx=0).stop 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c152a00 msgr2=0x7f414c152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c152a00 0x7f414c152f70 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f41440ab040 tx=0x7f414401ad70 comp rx=0 tx=0).stop 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 shutdown_connections 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41300355f0 0x7f4130037ab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c152a00 0x7f414c152f70 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c156c40 0x7f414c1f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 --2- 172.21.15.53:0/2940061657 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c06d270 0x7f414c143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 >> 172.21.15.53:0/2940061657 conn(0x7f414c065c80 msgr2=0x7f414c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 shutdown_connections 2024-09-13T18:30:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.659+0000 7f41533b3640 1 -- 172.21.15.53:0/2940061657 wait complete. 2024-09-13T18:30:03.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:30:03.759 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.754+0000 7f1044800180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:30:03.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.803+0000 7f6c69530640 1 Processor -- start 2024-09-13T18:30:03.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.803+0000 7f6c69530640 1 -- start start 2024-09-13T18:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.803+0000 7f6c69530640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c640ccd10 0x7f6c640cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.803+0000 7f6c69530640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6c640d2c80 0x7f6c640d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.803+0000 7f6c69530640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c640b7db0 con 0x7f6c6415c830 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.803+0000 7f6c69530640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c640d3650 con 0x7f6c640ccd10 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.803+0000 7f6c69530640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c640d0650 con 0x7f6c640d2c80 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c640ccd10 0x7f6c640cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c640ccd10 0x7f6c640cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46372/0 (socket says 172.21.15.53:46372) 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 -- 172.21.15.53:0/140528092 learned_addr learned my addr 172.21.15.53:0/140528092 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c637fe640 1 --2- 172.21.15.53:0/140528092 >> v2:172.21.15.87:3300/0 conn(0x7f6c640d2c80 0x7f6c640d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 -- 172.21.15.53:0/140528092 >> v2:172.21.15.87:3300/0 conn(0x7f6c640d2c80 msgr2=0x7f6c640d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 --2- 172.21.15.53:0/140528092 >> v2:172.21.15.87:3300/0 conn(0x7f6c640d2c80 0x7f6c640d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 -- 172.21.15.53:0/140528092 >> v1:172.21.15.87:6789/0 conn(0x7f6c6415c830 legacy=0x7f6c640d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 -- 172.21.15.53:0/140528092 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640d0c10 con 0x7f6c640ccd10 2024-09-13T18:30:03.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c627fc640 1 --2- 172.21.15.53:0/140528092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c640ccd10 0x7f6c640cd180 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6c640b4290 tx=0x7f6c5401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b9e8487d9ca5a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c61ffb640 1 -- 172.21.15.53:0/140528092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c540a56c0 con 0x7f6c640ccd10 2024-09-13T18:30:03.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c61ffb640 1 -- 172.21.15.53:0/140528092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c540a5820 con 0x7f6c640ccd10 2024-09-13T18:30:03.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c61ffb640 1 -- 172.21.15.53:0/140528092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c540a5bb0 con 0x7f6c640ccd10 2024-09-13T18:30:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c69530640 1 -- 172.21.15.53:0/140528092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c640ccd10 msgr2=0x7f6c640cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c69530640 1 --2- 172.21.15.53:0/140528092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c640ccd10 0x7f6c640cd180 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6c640b4290 tx=0x7f6c5401c9f0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c69530640 1 -- 172.21.15.53:0/140528092 shutdown_connections 2024-09-13T18:30:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c69530640 1 --2- 172.21.15.53:0/140528092 >> v2:172.21.15.87:3300/0 conn(0x7f6c640d2c80 0x7f6c640d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c69530640 1 --2- 172.21.15.53:0/140528092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c640ccd10 0x7f6c640cd180 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c69530640 1 -- 172.21.15.53:0/140528092 >> 172.21.15.53:0/140528092 conn(0x7f6c64070970 msgr2=0x7f6c64070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:03.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.807+0000 7f6c69530640 1 -- 172.21.15.53:0/140528092 shutdown_connections 2024-09-13T18:30:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- 172.21.15.53:0/140528092 wait complete. 2024-09-13T18:30:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 Processor -- start 2024-09-13T18:30:03.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- start start 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c640ccd10 0x7f6c640c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c640d2c80 0x7f6c64152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c6415c830 0x7f6c64065c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6415ed60 con 0x7f6c6415c830 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6415ea80 con 0x7f6c640ccd10 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640c5f80 con 0x7f6c640d2c80 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c6415c830 0x7f6c64065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c6415c830 0x7f6c64065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46374/0 (socket says 172.21.15.53:46374) 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 -- 172.21.15.53:0/1405826038 learned_addr learned my addr 172.21.15.53:0/1405826038 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c627fc640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c640d2c80 0x7f6c64152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c62ffd640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c640ccd10 0x7f6c640c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 -- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c640d2c80 msgr2=0x7f6c64152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c640d2c80 0x7f6c64152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 -- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c640ccd10 msgr2=0x7f6c640c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c640ccd10 0x7f6c640c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 -- 172.21.15.53:0/1405826038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c54009b30 con 0x7f6c6415c830 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c637fe640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c6415c830 0x7f6c64065c80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00d800 tx=0x7f6c5c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c5b7fe640 1 -- 172.21.15.53:0/1405826038 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00b6c0 con 0x7f6c6415c830 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c5b7fe640 1 -- 172.21.15.53:0/1405826038 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c00b820 con 0x7f6c6415c830 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c640c6260 con 0x7f6c6415c830 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c5b7fe640 1 -- 172.21.15.53:0/1405826038 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00bbd0 con 0x7f6c6415c830 2024-09-13T18:30:03.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c640661c0 con 0x7f6c6415c830 2024-09-13T18:30:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c5b7fe640 1 -- 172.21.15.53:0/1405826038 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7f6c5c00bd30 con 0x7f6c6415c830 2024-09-13T18:30:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c5b7fe640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6c440355f0 0x7f6c44037ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:03.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.811+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c640cd180 con 0x7f6c6415c830 2024-09-13T18:30:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.815+0000 7f6c5b7fe640 1 -- 172.21.15.53:0/1405826038 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f6c5c048770 con 0x7f6c6415c830 2024-09-13T18:30:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.815+0000 7f6c62ffd640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6c440355f0 0x7f6c44037ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:03.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.815+0000 7f6c62ffd640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6c440355f0 0x7f6c44037ab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c007fd0 tx=0x7f6c4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:03.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.819+0000 7f6c5b7fe640 1 -- 172.21.15.53:0/1405826038 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6c5c014430 con 0x7f6c6415c830 2024-09-13T18:30:03.869 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.866+0000 7f1044800180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:30:03.935 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:03.930+0000 7f1044800180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:30:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.983+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c640c6710 con 0x7f6c6415c830 2024-09-13T18:30:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.983+0000 7f6c5b7fe640 1 -- 172.21.15.53:0/1405826038 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c5c03b020 con 0x7f6c6415c830 2024-09-13T18:30:03.986 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6c440355f0 msgr2=0x7f6c44037ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6c440355f0 0x7f6c44037ab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c007fd0 tx=0x7f6c4c009040 comp rx=0 tx=0).stop 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c6415c830 msgr2=0x7f6c64065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c6415c830 0x7f6c64065c80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00d800 tx=0x7f6c5c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 shutdown_connections 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6c440355f0 0x7f6c44037ab0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c640d2c80 0x7f6c64152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c6415c830 0x7f6c64065c80 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 --2- 172.21.15.53:0/1405826038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c640ccd10 0x7f6c640c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:03.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 >> 172.21.15.53:0/1405826038 conn(0x7f6c64070970 msgr2=0x7f6c640b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:03.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 shutdown_connections 2024-09-13T18:30:03.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:03.987+0000 7f6c69530640 1 -- 172.21.15.53:0/1405826038 wait complete. 2024-09-13T18:30:04.005 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:30:04.067 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:04.062+0000 7f1044800180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:30:04.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f077da59640 1 Processor -- start 2024-09-13T18:30:04.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f077da59640 1 -- start start 2024-09-13T18:30:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f077da59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07780ccd10 0x7f07780cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f077da59640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780b7db0 con 0x7f07780d2c80 2024-09-13T18:30:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f077da59640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780d0650 con 0x7f077815c830 2024-09-13T18:30:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f077da59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780d0c10 con 0x7f07780ccd10 2024-09-13T18:30:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f07777fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f07780d2c80 0x7f07780b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48520/0 (socket says 172.21.15.53:48520) 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f07777fe640 1 -- 172.21.15.53:0/1670485076 learned_addr learned my addr 172.21.15.53:0/1670485076 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f07767fc640 1 --2- 172.21.15.53:0/1670485076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07780ccd10 0x7f07780cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f0775ffb640 1 -- 172.21.15.53:0/1670485076 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767891344 0 0) 0x7f07780b7db0 con 0x7f07780d2c80 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f0775ffb640 1 -- 172.21.15.53:0/1670485076 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0760003530 con 0x7f07780d2c80 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f07767fc640 1 -- 172.21.15.53:0/1670485076 >> v1:172.21.15.87:6789/0 conn(0x7f077815c830 legacy=0x7f07780d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f0775ffb640 1 -- 172.21.15.53:0/1670485076 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896255015 0 0) 0x7f07780d0650 con 0x7f077815c830 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f07767fc640 1 -- 172.21.15.53:0/1670485076 >> v1:172.21.15.53:6789/0 conn(0x7f07780d2c80 legacy=0x7f07780b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.127+0000 7f07767fc640 1 -- 172.21.15.53:0/1670485076 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780d17b0 con 0x7f07780ccd10 2024-09-13T18:30:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f07767fc640 1 --2- 172.21.15.53:0/1670485076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07780ccd10 0x7f07780cd150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097f0 tx=0x7f076c01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70754b0a874fcc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f0775ffb640 1 -- 172.21.15.53:0/1670485076 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768001680 con 0x7f07780ccd10 2024-09-13T18:30:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f0775ffb640 1 -- 172.21.15.53:0/1670485076 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c0a7050 con 0x7f07780ccd10 2024-09-13T18:30:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f0775ffb640 1 -- 172.21.15.53:0/1670485076 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0ab600 con 0x7f07780ccd10 2024-09-13T18:30:04.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 -- 172.21.15.53:0/1670485076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07780ccd10 msgr2=0x7f07780cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 --2- 172.21.15.53:0/1670485076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07780ccd10 0x7f07780cd150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f076c0097f0 tx=0x7f076c01c320 comp rx=0 tx=0).stop 2024-09-13T18:30:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 -- 172.21.15.53:0/1670485076 shutdown_connections 2024-09-13T18:30:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 --2- 172.21.15.53:0/1670485076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07780ccd10 0x7f07780cd150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 -- 172.21.15.53:0/1670485076 >> 172.21.15.53:0/1670485076 conn(0x7f0778070970 msgr2=0x7f0778070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 -- 172.21.15.53:0/1670485076 shutdown_connections 2024-09-13T18:30:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 -- 172.21.15.53:0/1670485076 wait complete. 2024-09-13T18:30:04.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 Processor -- start 2024-09-13T18:30:04.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.131+0000 7f077da59640 1 -- start start 2024-09-13T18:30:04.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07780ccd10 0x7f07780d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07780d2c80 0x7f07781514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f077815c830 0x7f0778151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077815e020 con 0x7f07780d2c80 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780cc2d0 con 0x7f07780ccd10 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780cc5b0 con 0x7f077815c830 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07780d2c80 0x7f07781514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07780d2c80 0x7f07781514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46408/0 (socket says 172.21.15.53:46408) 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 -- 172.21.15.53:0/1586764370 learned_addr learned my addr 172.21.15.53:0/1586764370 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07777fe640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f077815c830 0x7f0778151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f0776ffd640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07780ccd10 0x7f07780d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 -- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f077815c830 msgr2=0x7f0778151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f077815c830 0x7f0778151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 -- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07780ccd10 msgr2=0x7f07780d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07780ccd10 0x7f07780d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 -- 172.21.15.53:0/1586764370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c009420 con 0x7f07780d2c80 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f0776ffd640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07780ccd10 0x7f07780d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f07767fc640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07780d2c80 0x7f07781514d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f076c019f50 tx=0x7f076c0190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f075ffff640 1 -- 172.21.15.53:0/1586764370 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c003ab0 con 0x7f07780d2c80 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f075ffff640 1 -- 172.21.15.53:0/1586764370 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c003c10 con 0x7f07780d2c80 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07780cc890 con 0x7f07780d2c80 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f075ffff640 1 -- 172.21.15.53:0/1586764370 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0ab400 con 0x7f07780d2c80 2024-09-13T18:30:04.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780cbea0 con 0x7f07780d2c80 2024-09-13T18:30:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f075ffff640 1 -- 172.21.15.53:0/1586764370 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7f076c0b2040 con 0x7f07780d2c80 2024-09-13T18:30:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07780ccad0 con 0x7f07780d2c80 2024-09-13T18:30:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f075ffff640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07640355f0 0x7f0764037ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f075ffff640 1 -- 172.21.15.53:0/1586764370 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f076c0e2360 con 0x7f07780d2c80 2024-09-13T18:30:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f0776ffd640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07640355f0 0x7f0764037ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.135+0000 7f0776ffd640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07640355f0 0x7f0764037ab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0770007fd0 tx=0x7f0770009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.139+0000 7f075ffff640 1 -- 172.21.15.53:0/1586764370 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07780ccad0 con 0x7f07780d2c80 2024-09-13T18:30:04.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.311+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07780ccad0 con 0x7f07780d2c80 2024-09-13T18:30:04.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.311+0000 7f075ffff640 1 -- 172.21.15.53:0/1586764370 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07780ccad0 con 0x7f07780d2c80 2024-09-13T18:30:04.313 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07640355f0 msgr2=0x7f0764037ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07640355f0 0x7f0764037ab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0770007fd0 tx=0x7f0770009040 comp rx=0 tx=0).stop 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07780d2c80 msgr2=0x7f07781514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07780d2c80 0x7f07781514d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f076c019f50 tx=0x7f076c0190c0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 shutdown_connections 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07640355f0 0x7f0764037ab0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f077815c830 0x7f0778151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07780d2c80 0x7f07781514d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 --2- 172.21.15.53:0/1586764370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07780ccd10 0x7f07780d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 >> 172.21.15.53:0/1586764370 conn(0x7f0778070970 msgr2=0x7f0778070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:04.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 shutdown_connections 2024-09-13T18:30:04.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.315+0000 7f077da59640 1 -- 172.21.15.53:0/1586764370 wait complete. 2024-09-13T18:30:04.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:04.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.451+0000 7fad89eb7640 1 Processor -- start 2024-09-13T18:30:04.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad89eb7640 1 -- start start 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad89eb7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 0x7fad840cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad89eb7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8415cc10 con 0x7fad8415c830 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad89eb7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad840b50c0 con 0x7fad840b7b40 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad89eb7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840b41d0 con 0x7fad840cf800 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad837fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fad8415c830 0x7fad840cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48532/0 (socket says 172.21.15.53:48532) 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad837fe640 1 -- 172.21.15.53:0/1928938203 learned_addr learned my addr 172.21.15.53:0/1928938203 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad82ffd640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 0x7fad840cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555480993 0 0) 0x7fad6c001120 con 0x7fad8415c830 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad70003530 con 0x7fad8415c830 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253986427 0 0) 0x7fad70003530 con 0x7fad8415c830 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 msgr2=0x7fad840cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:04.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 0x7fad840cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 >> v1:172.21.15.87:6789/0 conn(0x7fad840b7b40 legacy=0x7fad841662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840b44b0 con 0x7fad8415c830 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fad6c001810 con 0x7fad8415c830 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 >> v1:172.21.15.53:6789/0 conn(0x7fad8415c830 legacy=0x7fad840cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 0x7fad700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad70003f30 0x7fad700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840b41d0 con 0x7fad70004d10 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7000bb00 con 0x7fad70003f30 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7000bcc0 con 0x7fad840cf800 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad83fff640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad82ffd640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad70003f30 0x7fad700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad837fe640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 0x7fad700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad83fff640 1 -- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 msgr2=0x7fad700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad83fff640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cf800 0x7fad700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad83fff640 1 -- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad70003f30 msgr2=0x7fad700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad83fff640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad70003f30 0x7fad700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad83fff640 1 -- 172.21.15.53:0/1928938203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70003530 con 0x7fad70004d10 2024-09-13T18:30:04.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.455+0000 7fad82ffd640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad70003f30 0x7fad700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad83fff640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad70005190 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fad7c001e70 tx=0x7fad7c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f4da9906a53963 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003b80 con 0x7fad70004d10 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c003ce0 con 0x7fad70004d10 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad827fc640 1 -- 172.21.15.53:0/1928938203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0052c0 con 0x7fad70004d10 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- 172.21.15.53:0/1928938203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 msgr2=0x7fad70005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 --2- 172.21.15.53:0/1928938203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad70005190 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fad7c001e70 tx=0x7fad7c01c780 comp rx=0 tx=0).stop 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad83fff640 1 -- 172.21.15.53:0/1928938203 reap_dead start 2024-09-13T18:30:04.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- 172.21.15.53:0/1928938203 shutdown_connections 2024-09-13T18:30:04.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- 172.21.15.53:0/1928938203 >> 172.21.15.53:0/1928938203 conn(0x7fad84070970 msgr2=0x7fad84070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:04.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- 172.21.15.53:0/1928938203 shutdown_connections 2024-09-13T18:30:04.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- 172.21.15.53:0/1928938203 wait complete. 2024-09-13T18:30:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 Processor -- start 2024-09-13T18:30:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- start start 2024-09-13T18:30:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad8414c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cc680 0x7fad840c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad840d0980 0x7fad840d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840d1340 con 0x7fad70004d10 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840c8b50 con 0x7fad840d0980 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad89eb7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840c7f40 con 0x7fad840cc680 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad8414c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad8414c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46428/0 (socket says 172.21.15.53:46428) 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 -- 172.21.15.53:0/3912142704 learned_addr learned my addr 172.21.15.53:0/3912142704 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad82ffd640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cc680 0x7fad840c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad83fff640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad840d0980 0x7fad840d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 -- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cc680 msgr2=0x7fad840c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cc680 0x7fad840c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 -- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad840d0980 msgr2=0x7fad840d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad840d0980 0x7fad840d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.459+0000 7fad837fe640 1 -- 172.21.15.53:0/3912142704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840c8220 con 0x7fad70004d10 2024-09-13T18:30:04.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad837fe640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad8414c9a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fad6c007340 tx=0x7fad6c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad7bfff640 1 -- 172.21.15.53:0/3912142704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00fa20 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad7bfff640 1 -- 172.21.15.53:0/3912142704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c00fbc0 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad840c8500 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad7bfff640 1 -- 172.21.15.53:0/3912142704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0133f0 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8414cee0 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad7bfff640 1 -- 172.21.15.53:0/3912142704 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7fad6c013550 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad7bfff640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fad64035620 0x7fad64037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad7bfff640 1 -- 172.21.15.53:0/3912142704 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fad6c0483a0 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8415cc10 con 0x7fad70004d10 2024-09-13T18:30:04.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad82ffd640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fad64035620 0x7fad64037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.463+0000 7fad82ffd640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fad64035620 0x7fad64037ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fad840d2de0 tx=0x7fad74008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.467+0000 7fad7bfff640 1 -- 172.21.15.53:0/3912142704 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad8415cc10 con 0x7fad70004d10 2024-09-13T18:30:04.544 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:04.542+0000 7f1044800180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:30:04.616 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:04.614+0000 7f1044800180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:30:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.663+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad8415cc10 con 0x7fad70004d10 2024-09-13T18:30:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad7bfff640 1 -- 172.21.15.53:0/3912142704 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4727 (secure 0 0 0) 0x7fad8415cc10 con 0x7fad70004d10 2024-09-13T18:30:04.668 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:04.668 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:30:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2024-09-13T18:30:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fad64035620 msgr2=0x7fad64037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fad64035620 0x7fad64037ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fad840d2de0 tx=0x7fad74008040 comp rx=0 tx=0).stop 2024-09-13T18:30:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 msgr2=0x7fad8414c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad8414c9a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fad6c007340 tx=0x7fad6c007800 comp rx=0 tx=0).stop 2024-09-13T18:30:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 shutdown_connections 2024-09-13T18:30:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fad64035620 0x7fad64037ae0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad840cc680 0x7fad840c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad840d0980 0x7fad840d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 --2- 172.21.15.53:0/3912142704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad70004d10 0x7fad8414c9a0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 >> 172.21.15.53:0/3912142704 conn(0x7fad84070970 msgr2=0x7fad840b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 shutdown_connections 2024-09-13T18:30:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.667+0000 7fad89eb7640 1 -- 172.21.15.53:0/3912142704 wait complete. 2024-09-13T18:30:04.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:04.760 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:04.754+0000 7f1044800180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:30:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.803+0000 7f83fcb9e640 1 Processor -- start 2024-09-13T18:30:04.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.803+0000 7f83fcb9e640 1 -- start start 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83fcb9e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83f815cab0 0x7f83f80d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83fcb9e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cd6c0 0x7f83f80cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83fcb9e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80d2400 con 0x7f83f80cdb00 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83fcb9e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f80d1530 con 0x7f83f815cab0 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83fcb9e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80d0920 con 0x7f83f80cd6c0 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83f815cab0 0x7f83f80d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83f815cab0 0x7f83f80d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46442/0 (socket says 172.21.15.53:46442) 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 -- 172.21.15.53:0/3514853990 learned_addr learned my addr 172.21.15.53:0/3514853990 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:04.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f5d9b640 1 --2- 172.21.15.53:0/3514853990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cd6c0 0x7f83f80cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 -- 172.21.15.53:0/3514853990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cd6c0 msgr2=0x7f83f80cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 --2- 172.21.15.53:0/3514853990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cd6c0 0x7f83f80cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 -- 172.21.15.53:0/3514853990 >> v1:172.21.15.87:6789/0 conn(0x7f83f80cdb00 legacy=0x7f83f80b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 -- 172.21.15.53:0/3514853990 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80d0c00 con 0x7f83f815cab0 2024-09-13T18:30:04.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f5d9b640 1 --2- 172.21.15.53:0/3514853990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cd6c0 0x7f83f80cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:04.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f659c640 1 --2- 172.21.15.53:0/3514853990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f80d19c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009870 tx=0x7f83e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d14d940533496b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.807+0000 7f83f559a640 1 -- 172.21.15.53:0/3514853990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e80ac620 con 0x7f83f815cab0 2024-09-13T18:30:04.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f559a640 1 -- 172.21.15.53:0/3514853990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e80ac780 con 0x7f83f815cab0 2024-09-13T18:30:04.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f559a640 1 -- 172.21.15.53:0/3514853990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e80acb10 con 0x7f83f815cab0 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- 172.21.15.53:0/3514853990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 msgr2=0x7f83f80d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/3514853990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f80d19c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009870 tx=0x7f83e801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- 172.21.15.53:0/3514853990 shutdown_connections 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/3514853990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cd6c0 0x7f83f80cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/3514853990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f80d19c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- 172.21.15.53:0/3514853990 >> 172.21.15.53:0/3514853990 conn(0x7f83f8065c80 msgr2=0x7f83f8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- 172.21.15.53:0/3514853990 shutdown_connections 2024-09-13T18:30:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- 172.21.15.53:0/3514853990 wait complete. 2024-09-13T18:30:04.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 Processor -- start 2024-09-13T18:30:04.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- start start 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80cd6c0 0x7f83f80b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cdb00 0x7f83f80a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f8155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80cabb0 con 0x7f83f815cab0 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80b4660 con 0x7f83f80cd6c0 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80ca2c0 con 0x7f83f80cdb00 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f8155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f8155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46458/0 (socket says 172.21.15.53:46458) 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 -- 172.21.15.53:0/1154499076 learned_addr learned my addr 172.21.15.53:0/1154499076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f659c640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80cd6c0 0x7f83f80b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f5d9b640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cdb00 0x7f83f80a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 -- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cdb00 msgr2=0x7f83f80a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cdb00 0x7f83f80a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 -- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80cd6c0 msgr2=0x7f83f80b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80cd6c0 0x7f83f80b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 -- 172.21.15.53:0/1154499076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e80094d0 con 0x7f83f815cab0 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83f6d9d640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f8155a20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f83f000b9e0 tx=0x7f83f000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83e6ffd640 1 -- 172.21.15.53:0/1154499076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0003b80 con 0x7f83f815cab0 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83e6ffd640 1 -- 172.21.15.53:0/1154499076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0003ce0 con 0x7f83f815cab0 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f80b43c0 con 0x7f83f815cab0 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.811+0000 7f83e6ffd640 1 -- 172.21.15.53:0/1154499076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000cb60 con 0x7f83f815cab0 2024-09-13T18:30:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.815+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f80ca840 con 0x7f83f815cab0 2024-09-13T18:30:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.815+0000 7f83e6ffd640 1 -- 172.21.15.53:0/1154499076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7f83f000ccc0 con 0x7f83f815cab0 2024-09-13T18:30:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.815+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f80cad20 con 0x7f83f815cab0 2024-09-13T18:30:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.815+0000 7f83e6ffd640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83d8035620 0x7f83d8037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.815+0000 7f83e6ffd640 1 -- 172.21.15.53:0/1154499076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f83f0047fe0 con 0x7f83f815cab0 2024-09-13T18:30:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.815+0000 7f83f659c640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83d8035620 0x7f83d8037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.815+0000 7f83f659c640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83d8035620 0x7f83d8037ae0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83e80ae000 tx=0x7f83e80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.819+0000 7f83e6ffd640 1 -- 172.21.15.53:0/1154499076 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83f0079db0 con 0x7f83f815cab0 2024-09-13T18:30:04.830 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:04.826+0000 7f1044800180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:30:04.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.971+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83f80cf0c0 con 0x7f83f815cab0 2024-09-13T18:30:04.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.975+0000 7f83e6ffd640 1 -- 172.21.15.53:0/1154499076 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+17412 (secure 0 0 0) 0x7f83f0007730 con 0x7f83f815cab0 2024-09-13T18:30:04.978 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:04.978 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":75,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:01.777246+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/1484640503":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/4172431564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/969146036":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2229318564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/88211871":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2413981801":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2827842914":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3017576771":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6833/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2553088179":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6832/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3809889825":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/1598969345":"2024-09-14T18:30:01.777203+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:04.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83d8035620 msgr2=0x7f83d8037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83d8035620 0x7f83d8037ae0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83e80ae000 tx=0x7f83e80a7000 comp rx=0 tx=0).stop 2024-09-13T18:30:04.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 msgr2=0x7f83f8155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:04.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f8155a20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f83f000b9e0 tx=0x7f83f000bea0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 shutdown_connections 2024-09-13T18:30:04.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83d8035620 0x7f83d8037ae0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80cdb00 0x7f83f80a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83f815cab0 0x7f83f8155a20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 --2- 172.21.15.53:0/1154499076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80cd6c0 0x7f83f80b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:04.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 >> 172.21.15.53:0/1154499076 conn(0x7f83f8065c80 msgr2=0x7f83f80b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:04.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 shutdown_connections 2024-09-13T18:30:04.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:04.979+0000 7f83fcb9e640 1 -- 172.21.15.53:0/1154499076 wait complete. 2024-09-13T18:30:04.996 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:30:04.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:05.110 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:05.106+0000 7f1044800180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:30:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f990ae95640 1 Processor -- start 2024-09-13T18:30:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f990ae95640 1 -- start start 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f990ae95640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f99040cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f990ae95640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f990415cc60 0x7f9904071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f990ae95640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990406f550 con 0x7f99040b1c10 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f990ae95640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990406f880 con 0x7f990415cc60 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f990ae95640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990415dc40 con 0x7f990415a470 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9903fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f990415cc60 0x7f9904071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9909432640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f99040b1c10 0x7f990406fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48540/0 (socket says 172.21.15.53:48540) 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9909432640 1 -- 172.21.15.53:0/1561344354 learned_addr learned my addr 172.21.15.53:0/1561344354 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9908c31640 1 --2- 172.21.15.53:0/1561344354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f99040cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f99037fe640 1 -- 172.21.15.53:0/1561344354 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122051735 0 0) 0x7f990406f550 con 0x7f99040b1c10 2024-09-13T18:30:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f99037fe640 1 -- 172.21.15.53:0/1561344354 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ec003530 con 0x7f99040b1c10 2024-09-13T18:30:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9903fff640 1 -- 172.21.15.53:0/1561344354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 msgr2=0x7f99040cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9903fff640 1 --2- 172.21.15.53:0/1561344354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f99040cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9903fff640 1 -- 172.21.15.53:0/1561344354 >> v1:172.21.15.53:6789/0 conn(0x7f99040b1c10 legacy=0x7f990406fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.115+0000 7f9903fff640 1 -- 172.21.15.53:0/1561344354 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040715a0 con 0x7f990415cc60 2024-09-13T18:30:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f9903fff640 1 --2- 172.21.15.53:0/1561344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f990415cc60 0x7f9904071060 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f98f80097c0 tx=0x7f98f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1de9fdd562c58c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f99037fe640 1 -- 172.21.15.53:0/1561344354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f80a6040 con 0x7f990415cc60 2024-09-13T18:30:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f99037fe640 1 -- 172.21.15.53:0/1561344354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f80aa600 con 0x7f990415cc60 2024-09-13T18:30:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f99037fe640 1 -- 172.21.15.53:0/1561344354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f80aa970 con 0x7f990415cc60 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- 172.21.15.53:0/1561344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f990415cc60 msgr2=0x7f9904071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 --2- 172.21.15.53:0/1561344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f990415cc60 0x7f9904071060 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f98f80097c0 tx=0x7f98f801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- 172.21.15.53:0/1561344354 shutdown_connections 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 --2- 172.21.15.53:0/1561344354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f990415cc60 0x7f9904071060 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 --2- 172.21.15.53:0/1561344354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f99040cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- 172.21.15.53:0/1561344354 >> 172.21.15.53:0/1561344354 conn(0x7f9904065c80 msgr2=0x7f9904066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- 172.21.15.53:0/1561344354 shutdown_connections 2024-09-13T18:30:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- 172.21.15.53:0/1561344354 wait complete. 2024-09-13T18:30:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 Processor -- start 2024-09-13T18:30:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- start start 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99040b1c10 0x7f9904149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f9904155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f990415cc60 0x7f9904158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990415b820 con 0x7f99040b1c10 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990415bb00 con 0x7f990415cc60 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f990ae95640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990415bde0 con 0x7f990415a470 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.119+0000 7f9908c31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99040b1c10 0x7f9904149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99040b1c10 0x7f9904149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46464/0 (socket says 172.21.15.53:46464) 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 -- 172.21.15.53:0/178437650 learned_addr learned my addr 172.21.15.53:0/178437650 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9903fff640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f9904155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9909432640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f990415cc60 0x7f9904158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 -- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 msgr2=0x7f9904155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f9904155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 -- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f990415cc60 msgr2=0x7f9904158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f990415cc60 0x7f9904158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 -- 172.21.15.53:0/178437650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f8009420 con 0x7f99040b1c10 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9908c31640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99040b1c10 0x7f9904149be0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f98f4007ef0 tx=0x7f98f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4014620 con 0x7f99040b1c10 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4014780 con 0x7f99040b1c10 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990415c0c0 con 0x7f99040b1c10 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4014b30 con 0x7f99040b1c10 2024-09-13T18:30:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990414a120 con 0x7f99040b1c10 2024-09-13T18:30:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9904067400 con 0x7f99040b1c10 2024-09-13T18:30:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 14) v1 ==== 43353+0+0 (secure 0 0 0) 0x7f98f4014c90 con 0x7f99040b1c10 2024-09-13T18:30:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f99017fa640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98f00355f0 0x7f98f0037ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f98f4048d20 con 0x7f99040b1c10 2024-09-13T18:30:05.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9903fff640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98f00355f0 0x7f98f0037ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.123+0000 7f9903fff640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98f00355f0 0x7f98f0037ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ae000 tx=0x7f98f80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.127+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mgrmap(e 15) v1 ==== 43409+0+0 (secure 0 0 0) 0x7f98f401c360 con 0x7f99040b1c10 2024-09-13T18:30:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.131+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98f401edb0 con 0x7f99040b1c10 2024-09-13T18:30:05.168 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-09-13T18:30:05.166+0000 7f1044800180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:30:05.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.327+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99040cc270 con 0x7f99040b1c10 2024-09-13T18:30:05.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f99017fa640 1 -- 172.21.15.53:0/178437650 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4727 (secure 0 0 0) 0x7f98f401d3c0 con 0x7f99040b1c10 2024-09-13T18:30:05.331 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:05.331 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:30:05.332 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98f00355f0 msgr2=0x7f98f0037ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98f00355f0 0x7f98f0037ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ae000 tx=0x7f98f80a7000 comp rx=0 tx=0).stop 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99040b1c10 msgr2=0x7f9904149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99040b1c10 0x7f9904149be0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f98f4007ef0 tx=0x7f98f400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 shutdown_connections 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98f00355f0 0x7f98f0037ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f990415a470 0x7f9904155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f990415cc60 0x7f9904158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 --2- 172.21.15.53:0/178437650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99040b1c10 0x7f9904149be0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 >> 172.21.15.53:0/178437650 conn(0x7f9904065c80 msgr2=0x7f99040ad030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 shutdown_connections 2024-09-13T18:30:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.331+0000 7f990ae95640 1 -- 172.21.15.53:0/178437650 wait complete. 2024-09-13T18:30:05.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.467+0000 7f8fde3cc640 1 Processor -- start 2024-09-13T18:30:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.467+0000 7f8fde3cc640 1 -- start start 2024-09-13T18:30:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fde3cc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 0x7f8fd80d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fde3cc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80d2400 con 0x7f8fd80cd6c0 2024-09-13T18:30:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fde3cc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80d1530 con 0x7f8fd80cf7d0 2024-09-13T18:30:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fde3cc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80d0920 con 0x7f8fd815cab0 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8fd80cd6c0 0x7f8fd80cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48556/0 (socket says 172.21.15.53:48556) 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 -- 172.21.15.53:0/4248028523 learned_addr learned my addr 172.21.15.53:0/4248028523 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd7fff640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 0x7f8fd80d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253389164 0 0) 0x7f8fd80d2400 con 0x7f8fd80cd6c0 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc0003530 con 0x7f8fd80cd6c0 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3019168801 0 0) 0x7f8fc0003530 con 0x7f8fd80cd6c0 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 msgr2=0x7f8fd80d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 0x7f8fd80d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 >> v1:172.21.15.87:6789/0 conn(0x7f8fd80cf7d0 legacy=0x7f8fd80b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80d0c00 con 0x7f8fd80cd6c0 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8fcc001680 con 0x7f8fd80cd6c0 2024-09-13T18:30:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 >> v1:172.21.15.53:6789/0 conn(0x7f8fd80cd6c0 legacy=0x7f8fd80cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00039b0 0x7f8fc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc00047d0 0x7f8fc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 0x7f8fc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80d0920 con 0x7f8fc00047d0 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc000ba40 con 0x7f8fc00039b0 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc000bc00 con 0x7f8fd815cab0 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc00047d0 0x7f8fc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd7fff640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00039b0 0x7f8fc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fdc969640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 0x7f8fc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 -- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 msgr2=0x7f8fc0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815cab0 0x7f8fc0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 -- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00039b0 msgr2=0x7f8fc0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00039b0 0x7f8fc0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd77fe640 1 -- 172.21.15.53:0/4248028523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0003530 con 0x7f8fc00047d0 2024-09-13T18:30:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.471+0000 7f8fd7fff640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00039b0 0x7f8fc0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fd77fe640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc00047d0 0x7f8fc0004c50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80b20e0 tx=0x7f8fcc01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ee6f9bee0a77e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc005ae0 con 0x7f8fc00047d0 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0ab070 con 0x7f8fc00047d0 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fd6ffd640 1 -- 172.21.15.53:0/4248028523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc005ea0 con 0x7f8fc00047d0 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- 172.21.15.53:0/4248028523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc00047d0 msgr2=0x7f8fc0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 --2- 172.21.15.53:0/4248028523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc00047d0 0x7f8fc0004c50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80b20e0 tx=0x7f8fcc01f350 comp rx=0 tx=0).stop 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 -- 172.21.15.53:0/4248028523 reap_dead start 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- 172.21.15.53:0/4248028523 shutdown_connections 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- 172.21.15.53:0/4248028523 >> 172.21.15.53:0/4248028523 conn(0x7f8fd8065c80 msgr2=0x7f8fd8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- 172.21.15.53:0/4248028523 shutdown_connections 2024-09-13T18:30:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- 172.21.15.53:0/4248028523 wait complete. 2024-09-13T18:30:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 Processor -- start 2024-09-13T18:30:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- start start 2024-09-13T18:30:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00047d0 0x7f8fd80b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815b910 0x7f8fd80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fd80ac1c0 0x7f8fd80ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80cc300 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd814ca80 con 0x7f8fc00047d0 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fde3cc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80acb80 con 0x7f8fd815b910 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fd80ac1c0 0x7f8fd80ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fd80ac1c0 0x7f8fd80ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46494/0 (socket says 172.21.15.53:46494) 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 -- 172.21.15.53:0/544603373 learned_addr learned my addr 172.21.15.53:0/544603373 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fd77fe640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815b910 0x7f8fd80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fd7fff640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00047d0 0x7f8fd80b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 -- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815b910 msgr2=0x7f8fd80cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815b910 0x7f8fd80cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 -- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00047d0 msgr2=0x7f8fd80b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00047d0 0x7f8fd80b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 -- 172.21.15.53:0/544603373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80b1000 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fd7fff640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00047d0 0x7f8fd80b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.475+0000 7f8fdc969640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fd80ac1c0 0x7f8fd80ac640 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80b51d0 tx=0x7f8fd000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd4ff9640 1 -- 172.21.15.53:0/544603373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000eed0 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd4ff9640 1 -- 172.21.15.53:0/544603373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0003980 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd80cba60 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd4ff9640 1 -- 172.21.15.53:0/544603373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0003d30 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd80cc020 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd4ff9640 1 -- 172.21.15.53:0/544603373 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 15) v1 ==== 43409+0+0 (secure 0 0 0) 0x7f8fd00050d0 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd814c7e0 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd4ff9640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fc40356b0 0x7f8fc4037b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd4ff9640 1 -- 172.21.15.53:0/544603373 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f8fd0048130 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd7fff640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fc40356b0 0x7f8fc4037b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.479+0000 7f8fd7fff640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fc40356b0 0x7f8fc4037b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009b70 tx=0x7f8fc8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.483+0000 7f8fd4ff9640 1 -- 172.21.15.53:0/544603373 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fd814c7e0 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.679+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fd814cbc0 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.679+0000 7f8fd4ff9640 1 -- 172.21.15.53:0/544603373 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4727 (secure 0 0 0) 0x7f8fd814cbc0 con 0x7f8fd80ac1c0 2024-09-13T18:30:05.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:05.681 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:29:22.170352+0000","modified":"2024-09-13T18:29:25.187357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1161349159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1161349159},{"type":"v1","addr":"172.21.15.53:6835","nonce":1161349159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:30:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2024-09-13T18:30:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fc40356b0 msgr2=0x7f8fc4037b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fc40356b0 0x7f8fc4037b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009b70 tx=0x7f8fc8008040 comp rx=0 tx=0).stop 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fd80ac1c0 msgr2=0x7f8fd80ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fd80ac1c0 0x7f8fd80ac640 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80b51d0 tx=0x7f8fd000eb90 comp rx=0 tx=0).stop 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 shutdown_connections 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fc40356b0 0x7f8fc4037b70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fd815b910 0x7f8fd80cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fd80ac1c0 0x7f8fd80ac640 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 --2- 172.21.15.53:0/544603373 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc00047d0 0x7f8fd80b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 >> 172.21.15.53:0/544603373 conn(0x7f8fd8065c80 msgr2=0x7f8fd815ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 shutdown_connections 2024-09-13T18:30:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.683+0000 7f8fde3cc640 1 -- 172.21.15.53:0/544603373 wait complete. 2024-09-13T18:30:05.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:05.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.815+0000 7feaeccc4640 1 Processor -- start 2024-09-13T18:30:05.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.815+0000 7feaeccc4640 1 -- start start 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feaeccc4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 0x7feae806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feaeccc4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae806d480 con 0x7feae80713a0 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feaeccc4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae815ace0 con 0x7feae815b7c0 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feaeccc4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae815aaf0 con 0x7feae81582a0 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae6d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7feae80713a0 0x7feae81640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48558/0 (socket says 172.21.15.53:48558) 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae6d9d640 1 -- 172.21.15.53:0/1542180703 learned_addr learned my addr 172.21.15.53:0/1542180703 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae659c640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 0x7feae806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088209015 0 0) 0x7feae806d480 con 0x7feae80713a0 2024-09-13T18:30:05.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead0003530 con 0x7feae80713a0 2024-09-13T18:30:05.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128042576 0 0) 0x7fead0003530 con 0x7feae80713a0 2024-09-13T18:30:05.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 msgr2=0x7feae806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:05.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 0x7feae806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 >> v1:172.21.15.87:6789/0 conn(0x7feae815b7c0 legacy=0x7feae8070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae815afc0 con 0x7feae80713a0 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7feae0001a00 con 0x7feae80713a0 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 >> v1:172.21.15.53:6789/0 conn(0x7feae80713a0 legacy=0x7feae81640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead00047d0 0x7fead0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 0x7fead0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead000ba40 con 0x7fead00039b0 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead000bb80 con 0x7fead00047d0 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead000bd40 con 0x7feae81582a0 2024-09-13T18:30:05.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae659c640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae5d9b640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead00047d0 0x7fead0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae6d9d640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 0x7fead0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae659c640 1 -- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 msgr2=0x7fead0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae659c640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 0x7fead0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae659c640 1 -- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead00047d0 msgr2=0x7fead0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae659c640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead00047d0 0x7fead0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae659c640 1 -- 172.21.15.53:0/1542180703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0003530 con 0x7fead00039b0 2024-09-13T18:30:05.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae5d9b640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead00047d0 0x7fead0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:05.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.819+0000 7feae6d9d640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae81582a0 0x7fead0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:05.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fead8009ab0 tx=0x7fead801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a196416218e6bf44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80a5510 con 0x7fead00039b0 2024-09-13T18:30:05.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead80a5670 con 0x7fead00039b0 2024-09-13T18:30:05.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae559a640 1 -- 172.21.15.53:0/1542180703 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80a5a20 con 0x7fead00039b0 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- 172.21.15.53:0/1542180703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 msgr2=0x7fead0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 --2- 172.21.15.53:0/1542180703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fead8009ab0 tx=0x7fead801ca30 comp rx=0 tx=0).stop 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae6d9d640 1 -- 172.21.15.53:0/1542180703 reap_dead start 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- 172.21.15.53:0/1542180703 shutdown_connections 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- 172.21.15.53:0/1542180703 >> 172.21.15.53:0/1542180703 conn(0x7feae8065c80 msgr2=0x7feae8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- 172.21.15.53:0/1542180703 shutdown_connections 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- 172.21.15.53:0/1542180703 wait complete. 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 Processor -- start 2024-09-13T18:30:05.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- start start 2024-09-13T18:30:05.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7feae8142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feae8164740 0x7feae8164ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae8160930 0x7feae8160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81612f0 con 0x7fead00039b0 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8165200 con 0x7feae8164740 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feaeccc4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae81537a0 con 0x7feae8160930 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7feae8142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feae8164740 0x7feae8164ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae5d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feae8164740 0x7feae8164ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:45998/0 (socket says 172.21.15.53:45998) 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae5d9b640 1 -- 172.21.15.53:0/3006465636 learned_addr learned my addr 172.21.15.53:0/3006465636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae6d9d640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae8160930 0x7feae8160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 -- 172.21.15.53:0/3006465636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae8160930 msgr2=0x7feae8160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae8160930 0x7feae8160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 -- 172.21.15.53:0/3006465636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feae8164740 msgr2=0x7feae8164ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feae8164740 0x7feae8164ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 -- 172.21.15.53:0/3006465636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8153a80 con 0x7fead00039b0 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7feae659c640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7feae8142ad0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fead80ac000 tx=0x7fead0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7fead6ffd640 1 -- 172.21.15.53:0/3006465636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80a5e20 con 0x7fead00039b0 2024-09-13T18:30:05.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7fead6ffd640 1 -- 172.21.15.53:0/3006465636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8004020 con 0x7fead00039b0 2024-09-13T18:30:05.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.823+0000 7fead6ffd640 1 -- 172.21.15.53:0/3006465636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80043d0 con 0x7fead00039b0 2024-09-13T18:30:05.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae8153d60 con 0x7fead00039b0 2024-09-13T18:30:05.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8143010 con 0x7fead00039b0 2024-09-13T18:30:05.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7fead6ffd640 1 -- 172.21.15.53:0/3006465636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 15) v1 ==== 43409+0+0 (secure 0 0 0) 0x7fead80b4040 con 0x7fead00039b0 2024-09-13T18:30:05.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8067400 con 0x7fead00039b0 2024-09-13T18:30:05.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7fead6ffd640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feac8035680 0x7feac8037b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:05.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7fead6ffd640 1 -- 172.21.15.53:0/3006465636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fead80e2460 con 0x7fead00039b0 2024-09-13T18:30:05.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7feae5d9b640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feac8035680 0x7feac8037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:05.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.827+0000 7feae5d9b640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feac8035680 0x7feac8037b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feae815c950 tx=0x7feadc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:05.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.831+0000 7fead6ffd640 1 -- 172.21.15.53:0/3006465636 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fead80b5dd0 con 0x7fead00039b0 2024-09-13T18:30:05.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.987+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feae80caa20 con 0x7fead00039b0 2024-09-13T18:30:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7fead6ffd640 1 -- 172.21.15.53:0/3006465636 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+17412 (secure 0 0 0) 0x7fead80b2020 con 0x7fead00039b0 2024-09-13T18:30:05.992 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:05.992 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":75,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:01.777246+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:29:19.948503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:29:21.156674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.87:0/1484640503":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/4172431564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/969146036":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2229318564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/88211871":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2413981801":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2827842914":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3017576771":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6833/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2553088179":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6832/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3809889825":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/1598969345":"2024-09-14T18:30:01.777203+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feac8035680 msgr2=0x7feac8037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feac8035680 0x7feac8037b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feae815c950 tx=0x7feadc009040 comp rx=0 tx=0).stop 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 msgr2=0x7feae8142ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7feae8142ad0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fead80ac000 tx=0x7fead0005800 comp rx=0 tx=0).stop 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 shutdown_connections 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feac8035680 0x7feac8037b40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feae8160930 0x7feae8160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feae8164740 0x7feae8164ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 --2- 172.21.15.53:0/3006465636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fead00039b0 0x7feae8142ad0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 >> 172.21.15.53:0/3006465636 conn(0x7feae8065c80 msgr2=0x7feae81518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 shutdown_connections 2024-09-13T18:30:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:05.991+0000 7feaeccc4640 1 -- 172.21.15.53:0/3006465636 wait complete. 2024-09-13T18:30:06.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:30:06.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f43606c6640 1 Processor -- start 2024-09-13T18:30:06.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f43606c6640 1 -- start start 2024-09-13T18:30:06.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f43606c6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580d19c0 0x7f43580cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f43606c6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43580d2400 con 0x7f43580cf600 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f43606c6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43580d1530 con 0x7f435815cab0 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f43606c6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580cfab0 con 0x7f43580d19c0 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435ec63640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f43580cf600 0x7f43580b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48560/0 (socket says 172.21.15.53:48560) 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435ec63640 1 -- 172.21.15.53:0/3710049261 learned_addr learned my addr 172.21.15.53:0/3710049261 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435dc61640 1 --2- 172.21.15.53:0/3710049261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580d19c0 0x7f43580cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435d460640 1 -- 172.21.15.53:0/3710049261 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634185870 0 0) 0x7f43580d2400 con 0x7f43580cf600 2024-09-13T18:30:06.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435d460640 1 -- 172.21.15.53:0/3710049261 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4344003530 con 0x7f43580cf600 2024-09-13T18:30:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435dc61640 1 -- 172.21.15.53:0/3710049261 >> v1:172.21.15.87:6789/0 conn(0x7f435815cab0 legacy=0x7f43580cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435dc61640 1 -- 172.21.15.53:0/3710049261 >> v1:172.21.15.53:6789/0 conn(0x7f43580cf600 legacy=0x7f43580b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.131+0000 7f435dc61640 1 -- 172.21.15.53:0/3710049261 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580cddd0 con 0x7f43580d19c0 2024-09-13T18:30:06.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.135+0000 7f435dc61640 1 --2- 172.21.15.53:0/3710049261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580d19c0 0x7f43580cf0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f43480097f0 tx=0x7f434801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97f1ba889e7f342 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f435d460640 1 -- 172.21.15.53:0/3710049261 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480ac630 con 0x7f43580d19c0 2024-09-13T18:30:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f435d460640 1 -- 172.21.15.53:0/3710049261 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480ac790 con 0x7f43580d19c0 2024-09-13T18:30:06.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f435d460640 1 -- 172.21.15.53:0/3710049261 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480acb20 con 0x7f43580d19c0 2024-09-13T18:30:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f43606c6640 1 -- 172.21.15.53:0/3710049261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580d19c0 msgr2=0x7f43580cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f43606c6640 1 --2- 172.21.15.53:0/3710049261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580d19c0 0x7f43580cf0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f43480097f0 tx=0x7f434801c4e0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f43606c6640 1 -- 172.21.15.53:0/3710049261 shutdown_connections 2024-09-13T18:30:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f43606c6640 1 --2- 172.21.15.53:0/3710049261 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580d19c0 0x7f43580cf0c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f43606c6640 1 -- 172.21.15.53:0/3710049261 >> 172.21.15.53:0/3710049261 conn(0x7f4358065c80 msgr2=0x7f4358066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f43606c6640 1 -- 172.21.15.53:0/3710049261 shutdown_connections 2024-09-13T18:30:06.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.139+0000 7f43606c6640 1 -- 172.21.15.53:0/3710049261 wait complete. 2024-09-13T18:30:06.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 Processor -- start 2024-09-13T18:30:06.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 -- start start 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580cf600 0x7f43581f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43580d19c0 0x7f435814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435815cab0 0x7f435814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435814bc40 con 0x7f43580d19c0 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43581f6aa0 con 0x7f435815cab0 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f43606c6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435815b700 con 0x7f43580cf600 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435e462640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580cf600 0x7f43581f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435e462640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580cf600 0x7f43581f98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:51352/0 (socket says 172.21.15.53:51352) 2024-09-13T18:30:06.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435e462640 1 -- 172.21.15.53:0/1820482572 learned_addr learned my addr 172.21.15.53:0/1820482572 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435dc61640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43580d19c0 0x7f435814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435ec63640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435815cab0 0x7f435814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435dc61640 1 -- 172.21.15.53:0/1820482572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580cf600 msgr2=0x7f43581f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435dc61640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580cf600 0x7f43581f98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435dc61640 1 -- 172.21.15.53:0/1820482572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435815cab0 msgr2=0x7f435814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435dc61640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435815cab0 0x7f435814abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435dc61640 1 -- 172.21.15.53:0/1820482572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348009420 con 0x7f43580d19c0 2024-09-13T18:30:06.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.143+0000 7f435dc61640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43580d19c0 0x7f435814a670 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f43480ac000 tx=0x7f4348019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:06.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f434effd640 1 -- 172.21.15.53:0/1820482572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480b5600 con 0x7f43580d19c0 2024-09-13T18:30:06.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435815f130 con 0x7f43580d19c0 2024-09-13T18:30:06.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f434effd640 1 -- 172.21.15.53:0/1820482572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480b5760 con 0x7f43580d19c0 2024-09-13T18:30:06.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435815f3d0 con 0x7f43580d19c0 2024-09-13T18:30:06.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f434effd640 1 -- 172.21.15.53:0/1820482572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480b5af0 con 0x7f43580d19c0 2024-09-13T18:30:06.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358067910 con 0x7f43580d19c0 2024-09-13T18:30:06.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f434effd640 1 -- 172.21.15.53:0/1820482572 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f43480b3040 con 0x7f43580d19c0 2024-09-13T18:30:06.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f434effd640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f433c0667e0 0x7f433c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f434effd640 1 -- 172.21.15.53:0/1820482572 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f434811df60 con 0x7f43580d19c0 2024-09-13T18:30:06.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f435e462640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f433c0667e0 0x7f433c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.147+0000 7f435e462640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f433c0667e0 0x7f433c068ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43540018b0 tx=0x7f4354009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:06.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.151+0000 7f434effd640 1 -- 172.21.15.53:0/1820482572 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4358067910 con 0x7f43580d19c0 2024-09-13T18:30:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.351+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4358067910 con 0x7f43580d19c0 2024-09-13T18:30:06.354 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:30:06.351+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:30:06.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f434effd640 1 -- 172.21.15.53:0/1820482572 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4358067910 con 0x7f43580d19c0 2024-09-13T18:30:06.371 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f433c0667e0 msgr2=0x7f433c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f433c0667e0 0x7f433c068ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43540018b0 tx=0x7f4354009040 comp rx=0 tx=0).stop 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43580d19c0 msgr2=0x7f435814a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43580d19c0 0x7f435814a670 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f43480ac000 tx=0x7f4348019280 comp rx=0 tx=0).stop 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 shutdown_connections 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f433c0667e0 0x7f433c068ca0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f435815cab0 0x7f435814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43580d19c0 0x7f435814a670 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 --2- 172.21.15.53:0/1820482572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43580cf600 0x7f43581f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 >> 172.21.15.53:0/1820482572 conn(0x7f4358065c80 msgr2=0x7f4358066230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:06.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 shutdown_connections 2024-09-13T18:30:06.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.371+0000 7f43606c6640 1 -- 172.21.15.53:0/1820482572 wait complete. 2024-09-13T18:30:06.381 INFO:tasks.ceph.mds.a.smithi053.stderr: -6752> 2024-09-13T18:29:27.747+0000 7f94776b2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:30:06.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:30:06.424 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:30:06.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 Processor -- start 2024-09-13T18:30:06.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 -- start start 2024-09-13T18:30:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdeac156c40 0x7fdeac070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac157020 0x7fdeac06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdeac06d270 0x7fdeac15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac06d6e0 con 0x7fdeac06d270 2024-09-13T18:30:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac0b15a0 con 0x7fdeac156c40 2024-09-13T18:30:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb3632640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0b1880 con 0x7fdeac157020 2024-09-13T18:30:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb13ce640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdeac156c40 0x7fdeac070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb13ce640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdeac156c40 0x7fdeac070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:46026/0 (socket says 172.21.15.53:46026) 2024-09-13T18:30:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.511+0000 7fdeb13ce640 1 -- 172.21.15.53:0/3194286352 learned_addr learned my addr 172.21.15.53:0/3194286352 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb0bcd640 1 --2- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac157020 0x7fdeac06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb1bcf640 1 --2- 172.21.15.53:0/3194286352 >> v2:172.21.15.53:3300/0 conn(0x7fdeac06d270 0x7fdeac15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb13ce640 1 -- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac157020 msgr2=0x7fdeac06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb13ce640 1 --2- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac157020 0x7fdeac06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb13ce640 1 -- 172.21.15.53:0/3194286352 >> v2:172.21.15.53:3300/0 conn(0x7fdeac06d270 msgr2=0x7fdeac15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb13ce640 1 --2- 172.21.15.53:0/3194286352 >> v2:172.21.15.53:3300/0 conn(0x7fdeac06d270 0x7fdeac15cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb13ce640 1 -- 172.21.15.53:0/3194286352 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0b1b60 con 0x7fdeac156c40 2024-09-13T18:30:06.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdeb13ce640 1 --2- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac156c40 0x7fdeac070ee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdeac067650 tx=0x7fdea4020b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=394b76932d7e7f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdea3fff640 1 -- 172.21.15.53:0/3194286352 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40a99b0 con 0x7fdeac156c40 2024-09-13T18:30:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdea3fff640 1 -- 172.21.15.53:0/3194286352 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea40a9b10 con 0x7fdeac156c40 2024-09-13T18:30:06.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.515+0000 7fdea3fff640 1 -- 172.21.15.53:0/3194286352 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40a9ea0 con 0x7fdeac156c40 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac156c40 msgr2=0x7fdeac070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 --2- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac156c40 0x7fdeac070ee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdeac067650 tx=0x7fdea4020b20 comp rx=0 tx=0).stop 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- 172.21.15.53:0/3194286352 shutdown_connections 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 --2- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac157020 0x7fdeac06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 --2- 172.21.15.53:0/3194286352 >> v2:172.21.15.53:3300/0 conn(0x7fdeac06d270 0x7fdeac15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 --2- 172.21.15.53:0/3194286352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac156c40 0x7fdeac070ee0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- 172.21.15.53:0/3194286352 >> 172.21.15.53:0/3194286352 conn(0x7fdeac065c80 msgr2=0x7fdeac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- 172.21.15.53:0/3194286352 shutdown_connections 2024-09-13T18:30:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- 172.21.15.53:0/3194286352 wait complete. 2024-09-13T18:30:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 Processor -- start 2024-09-13T18:30:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- start start 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac06d270 0x7fdeac14a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac156c40 0x7fdeac0ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac159820 0x7fdeac159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac14a540 con 0x7fdeac159820 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac1509a0 con 0x7fdeac06d270 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15a1e0 con 0x7fdeac156c40 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac159820 0x7fdeac159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac159820 0x7fdeac159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46554/0 (socket says 172.21.15.53:46554) 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 -- 172.21.15.53:0/1926121177 learned_addr learned my addr 172.21.15.53:0/1926121177 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb13ce640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac06d270 0x7fdeac14a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb0bcd640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac156c40 0x7fdeac0ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 -- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac156c40 msgr2=0x7fdeac0ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac156c40 0x7fdeac0ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 -- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac06d270 msgr2=0x7fdeac14a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac06d270 0x7fdeac14a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 -- 172.21.15.53:0/1926121177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4009b30 con 0x7fdeac159820 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb1bcf640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac159820 0x7fdeac159ca0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e930 tx=0x7fdea800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdea1ffb640 1 -- 172.21.15.53:0/1926121177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea80096b0 con 0x7fdeac159820 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdea1ffb640 1 -- 172.21.15.53:0/1926121177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800c9a0 con 0x7fdeac159820 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac155e50 con 0x7fdeac159820 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.519+0000 7fdea1ffb640 1 -- 172.21.15.53:0/1926121177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800cd30 con 0x7fdeac159820 2024-09-13T18:30:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.523+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac1555b0 con 0x7fdeac159820 2024-09-13T18:30:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.523+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac15cde0 con 0x7fdeac159820 2024-09-13T18:30:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.523+0000 7fdea1ffb640 1 -- 172.21.15.53:0/1926121177 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fdea8013470 con 0x7fdeac159820 2024-09-13T18:30:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.523+0000 7fdea1ffb640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde900667b0 0x7fde90068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.523+0000 7fdea1ffb640 1 -- 172.21.15.53:0/1926121177 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6412+0+0 (secure 0 0 0) 0x7fdea8084fe0 con 0x7fdeac159820 2024-09-13T18:30:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.523+0000 7fdeb13ce640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde900667b0 0x7fde90068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:06.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.523+0000 7fdeb13ce640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde900667b0 0x7fde90068c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdea40b2000 tx=0x7fdea40ab070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:06.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.527+0000 7fdea1ffb640 1 -- 172.21.15.53:0/1926121177 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdea80520d0 con 0x7fdeac159820 2024-09-13T18:30:06.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:06.719+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdeac0cc3d0 con 0x7fdeac159820 2024-09-13T18:30:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.371+0000 7fdea1ffb640 1 -- 172.21.15.53:0/1926121177 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdea80556f0 con 0x7fdeac159820 2024-09-13T18:30:07.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.371+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde900667b0 msgr2=0x7fde90068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:07.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.371+0000 7fdeb3632640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde900667b0 0x7fde90068c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdea40b2000 tx=0x7fdea40ab070 comp rx=0 tx=0).stop 2024-09-13T18:30:07.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.371+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac159820 msgr2=0x7fdeac159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:07.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.371+0000 7fdeb3632640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac159820 0x7fdeac159ca0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e930 tx=0x7fdea800edf0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 shutdown_connections 2024-09-13T18:30:07.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde900667b0 0x7fde90068c70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdeac156c40 0x7fdeac0ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac159820 0x7fdeac159ca0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 --2- 172.21.15.53:0/1926121177 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac06d270 0x7fdeac14a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 >> 172.21.15.53:0/1926121177 conn(0x7fdeac065c80 msgr2=0x7fdeac06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:07.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 shutdown_connections 2024-09-13T18:30:07.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.375+0000 7fdeb3632640 1 -- 172.21.15.53:0/1926121177 wait complete. 2024-09-13T18:30:07.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:30:07.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9bac392640 1 Processor -- start 2024-09-13T18:30:07.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9bac392640 1 -- start start 2024-09-13T18:30:07.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9bac392640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 0x7f9ba4143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9bac392640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40b1ba0 con 0x7f9ba40cd6f0 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9bac392640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40b3020 con 0x7f9ba4143d50 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9bac392640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40b1f80 con 0x7f9ba40cdad0 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9baa12e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9ba40cd6f0 0x7f9ba40b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47542/0 (socket says 172.21.15.53:47542) 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9baa12e640 1 -- 172.21.15.53:0/711903654 learned_addr learned my addr 172.21.15.53:0/711903654 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba992d640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 0x7f9ba4143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924300704 0 0) 0x7f9ba40b1ba0 con 0x7f9ba40cd6f0 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b90003530 con 0x7f9ba40cd6f0 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 662497060 0 0) 0x7f9b90003530 con 0x7f9ba40cd6f0 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 msgr2=0x7f9ba4143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 0x7f9ba4143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 >> v1:172.21.15.87:6789/0 conn(0x7f9ba4143d50 legacy=0x7f9ba406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:07.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40b2260 con 0x7f9ba40cd6f0 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9ba0001680 con 0x7f9ba40cd6f0 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 >> v1:172.21.15.53:6789/0 conn(0x7f9ba40cd6f0 legacy=0x7f9ba40b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9b90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 0x7f9b900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b90004d10 0x7f9b90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40b1f80 con 0x7f9b900039b0 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9000b990 con 0x7f9b90004d10 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.571+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9000bb50 con 0x7f9ba40cdad0 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa12e640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9b90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9ba992d640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 0x7f9b900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa12e640 1 -- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 msgr2=0x7f9b900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:07.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa12e640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 0x7f9b900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa12e640 1 -- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b90004d10 msgr2=0x7f9b90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:07.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa12e640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b90004d10 0x7f9b90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa12e640 1 -- 172.21.15.53:0/711903654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90003530 con 0x7f9b900039b0 2024-09-13T18:30:07.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9ba992d640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba40cdad0 0x7f9b900047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:07.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa12e640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9b90003d90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c1c0 tx=0x7f9ba001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a5df6f394d88e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:07.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0005ae0 con 0x7f9b900039b0 2024-09-13T18:30:07.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0005c40 con 0x7f9b900039b0 2024-09-13T18:30:07.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9ba912c640 1 -- 172.21.15.53:0/711903654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0007070 con 0x7f9b900039b0 2024-09-13T18:30:07.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9bac392640 1 -- 172.21.15.53:0/711903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 msgr2=0x7f9b90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9bac392640 1 --2- 172.21.15.53:0/711903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9b90003d90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c1c0 tx=0x7f9ba001cb70 comp rx=0 tx=0).stop 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9baa92f640 1 -- 172.21.15.53:0/711903654 reap_dead start 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9bac392640 1 -- 172.21.15.53:0/711903654 shutdown_connections 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9bac392640 1 -- 172.21.15.53:0/711903654 >> 172.21.15.53:0/711903654 conn(0x7f9ba4073330 msgr2=0x7f9ba4065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9bac392640 1 -- 172.21.15.53:0/711903654 shutdown_connections 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.575+0000 7f9bac392640 1 -- 172.21.15.53:0/711903654 wait complete. 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 Processor -- start 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 -- start start 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9ba413fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba41425d0 0x7f9ba4142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ba40a8f30 0x7f9ba40a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40abdd0 con 0x7f9b900039b0 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4142f70 con 0x7f9ba40a8f30 2024-09-13T18:30:07.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40ab150 con 0x7f9ba41425d0 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9ba413fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9ba413fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53258/0 (socket says 172.21.15.53:53258) 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 -- 172.21.15.53:0/1259429260 learned_addr learned my addr 172.21.15.53:0/1259429260 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9ba992d640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba41425d0 0x7f9ba4142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa92f640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ba40a8f30 0x7f9ba40a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 -- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba41425d0 msgr2=0x7f9ba4142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba41425d0 0x7f9ba4142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 -- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ba40a8f30 msgr2=0x7f9ba40a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ba40a8f30 0x7f9ba40a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 -- 172.21.15.53:0/1259429260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40ab430 con 0x7f9b900039b0 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9baa12e640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9ba413fd40 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c1c0 tx=0x7f9b90005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9b96ffd640 1 -- 172.21.15.53:0/1259429260 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00b4070 con 0x7f9b900039b0 2024-09-13T18:30:07.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9b96ffd640 1 -- 172.21.15.53:0/1259429260 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0001500 con 0x7f9b900039b0 2024-09-13T18:30:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba40ab710 con 0x7f9b900039b0 2024-09-13T18:30:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9b96ffd640 1 -- 172.21.15.53:0/1259429260 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0007090 con 0x7f9b900039b0 2024-09-13T18:30:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba4140280 con 0x7f9b900039b0 2024-09-13T18:30:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba40cb330 con 0x7f9b900039b0 2024-09-13T18:30:07.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9b96ffd640 1 -- 172.21.15.53:0/1259429260 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f9ba00071f0 con 0x7f9b900039b0 2024-09-13T18:30:07.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9b96ffd640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9b880667e0 0x7f9b88068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:07.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9b96ffd640 1 -- 172.21.15.53:0/1259429260 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6412+0+0 (secure 0 0 0) 0x7f9ba011d850 con 0x7f9b900039b0 2024-09-13T18:30:07.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.579+0000 7f9ba992d640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9b880667e0 0x7f9b88068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:07.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.583+0000 7f9ba992d640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9b880667e0 0x7f9b88068ca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40caec0 tx=0x7f9b98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:07.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.587+0000 7f9b96ffd640 1 -- 172.21.15.53:0/1259429260 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ba00ea7f0 con 0x7f9b900039b0 2024-09-13T18:30:07.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:07.739+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ba406b320 con 0x7f9b900039b0 2024-09-13T18:30:08.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.375+0000 7f9b96ffd640 1 -- 172.21.15.53:0/1259429260 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9ba00ede10 con 0x7f9b900039b0 2024-09-13T18:30:08.377 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:30:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9b880667e0 msgr2=0x7f9b88068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9b880667e0 0x7f9b88068ca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40caec0 tx=0x7f9b98008040 comp rx=0 tx=0).stop 2024-09-13T18:30:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 msgr2=0x7f9ba413fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9ba413fd40 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c1c0 tx=0x7f9b90005800 comp rx=0 tx=0).stop 2024-09-13T18:30:08.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 shutdown_connections 2024-09-13T18:30:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9b880667e0 0x7f9b88068ca0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ba41425d0 0x7f9ba4142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ba40a8f30 0x7f9ba40a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 --2- 172.21.15.53:0/1259429260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b900039b0 0x7f9ba413fd40 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 >> 172.21.15.53:0/1259429260 conn(0x7f9ba4073330 msgr2=0x7f9ba40cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 shutdown_connections 2024-09-13T18:30:08.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.379+0000 7f9bac392640 1 -- 172.21.15.53:0/1259429260 wait complete. 2024-09-13T18:30:08.406 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:30:08.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8aec2640 1 Processor -- start 2024-09-13T18:30:08.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8aec2640 1 -- start start 2024-09-13T18:30:08.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8aec2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5b8406d6d0 0x7f5b8415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8aec2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8415ea60 con 0x7f5b8406d240 2024-09-13T18:30:08.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8aec2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8415ed40 con 0x7f5b840cc630 2024-09-13T18:30:08.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8aec2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8415ad40 con 0x7f5b8406d6d0 2024-09-13T18:30:08.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b83fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5b8406d240 0x7f5b8415b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47550/0 (socket says 172.21.15.53:47550) 2024-09-13T18:30:08.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b83fff640 1 -- 172.21.15.53:0/397333223 learned_addr learned my addr 172.21.15.53:0/397333223 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:08.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8945f640 1 --2- 172.21.15.53:0/397333223 >> v2:172.21.15.87:3300/0 conn(0x7f5b8406d6d0 0x7f5b8415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510989896 0 0) 0x7f5b8415ea60 con 0x7f5b8406d240 2024-09-13T18:30:08.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b70003530 con 0x7f5b8406d240 2024-09-13T18:30:08.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140704393 0 0) 0x7f5b70003530 con 0x7f5b8406d240 2024-09-13T18:30:08.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 >> v2:172.21.15.87:3300/0 conn(0x7f5b8406d6d0 msgr2=0x7f5b8415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:08.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 --2- 172.21.15.53:0/397333223 >> v2:172.21.15.87:3300/0 conn(0x7f5b8406d6d0 0x7f5b8415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 >> v1:172.21.15.87:6789/0 conn(0x7f5b840cc630 legacy=0x7f5b8415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8415b020 con 0x7f5b8406d240 2024-09-13T18:30:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5b74001a00 con 0x7f5b8406d240 2024-09-13T18:30:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b8945f640 1 --2- 172.21.15.53:0/397333223 >> v2:172.21.15.87:3300/0 conn(0x7f5b8406d6d0 0x7f5b8415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 >> v1:172.21.15.53:6789/0 conn(0x7f5b8406d240 legacy=0x7f5b8415b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b70003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b700047d0 0x7f5b70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b70005190 0x7f5b7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8415ad40 con 0x7f5b700039d0 2024-09-13T18:30:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7000c090 con 0x7f5b70005190 2024-09-13T18:30:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.543+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7000c250 con 0x7f5b700047d0 2024-09-13T18:30:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b88c5e640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b70003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b8945f640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b70005190 0x7f5b7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b83fff640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b700047d0 0x7f5b70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b88c5e640 1 -- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b700047d0 msgr2=0x7f5b70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b88c5e640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b700047d0 0x7f5b70004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b88c5e640 1 -- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b70005190 msgr2=0x7f5b7000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b88c5e640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b70005190 0x7f5b7000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b8945f640 1 -- 172.21.15.53:0/397333223 reap_dead start 2024-09-13T18:30:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b88c5e640 1 -- 172.21.15.53:0/397333223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70003530 con 0x7f5b700039d0 2024-09-13T18:30:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b88c5e640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b70003df0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c001780 tx=0x7f5b6c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b95cf1ee24c82f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0052d0 con 0x7f5b700039d0 2024-09-13T18:30:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0a7050 con 0x7f5b700039d0 2024-09-13T18:30:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.547+0000 7f5b837fe640 1 -- 172.21.15.53:0/397333223 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c003600 con 0x7f5b700039d0 2024-09-13T18:30:08.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- 172.21.15.53:0/397333223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 msgr2=0x7f5b70003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b70003df0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c001780 tx=0x7f5b6c01c400 comp rx=0 tx=0).stop 2024-09-13T18:30:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- 172.21.15.53:0/397333223 shutdown_connections 2024-09-13T18:30:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/397333223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b70003df0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- 172.21.15.53:0/397333223 >> 172.21.15.53:0/397333223 conn(0x7f5b8406a550 msgr2=0x7f5b840b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- 172.21.15.53:0/397333223 shutdown_connections 2024-09-13T18:30:08.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- 172.21.15.53:0/397333223 wait complete. 2024-09-13T18:30:08.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 Processor -- start 2024-09-13T18:30:08.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- start start 2024-09-13T18:30:08.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b841478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8406ffa0 0x7f5b84148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8414b6e0 0x7f5b84150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840706d0 con 0x7f5b700039d0 2024-09-13T18:30:08.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84070940 con 0x7f5b8406ffa0 2024-09-13T18:30:08.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84070c20 con 0x7f5b8414b6e0 2024-09-13T18:30:08.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b841478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b841478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53276/0 (socket says 172.21.15.53:53276) 2024-09-13T18:30:08.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 -- 172.21.15.53:0/2637326101 learned_addr learned my addr 172.21.15.53:0/2637326101 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:08.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b83fff640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8406ffa0 0x7f5b84148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8945f640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8414b6e0 0x7f5b84150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 -- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8414b6e0 msgr2=0x7f5b84150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:08.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8414b6e0 0x7f5b84150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 -- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8406ffa0 msgr2=0x7f5b84148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:08.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8406ffa0 0x7f5b84148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:08.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 -- 172.21.15.53:0/2637326101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84070f00 con 0x7f5b700039d0 2024-09-13T18:30:08.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b88c5e640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b841478a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c10 tx=0x7f5b70005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:08.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b817fa640 1 -- 172.21.15.53:0/2637326101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0072f0 con 0x7f5b700039d0 2024-09-13T18:30:08.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b817fa640 1 -- 172.21.15.53:0/2637326101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c007450 con 0x7f5b700039d0 2024-09-13T18:30:08.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b84147de0 con 0x7f5b700039d0 2024-09-13T18:30:08.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b817fa640 1 -- 172.21.15.53:0/2637326101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0067e0 con 0x7f5b700039d0 2024-09-13T18:30:08.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.551+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b841490b0 con 0x7f5b700039d0 2024-09-13T18:30:08.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.555+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8415ea60 con 0x7f5b700039d0 2024-09-13T18:30:08.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.555+0000 7f5b817fa640 1 -- 172.21.15.53:0/2637326101 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f5b6c006940 con 0x7f5b700039d0 2024-09-13T18:30:08.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.555+0000 7f5b817fa640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b640667e0 0x7f5b64068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:08.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.555+0000 7f5b817fa640 1 -- 172.21.15.53:0/2637326101 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5974+0+0 (secure 0 0 0) 0x7f5b6c11e5e0 con 0x7f5b700039d0 2024-09-13T18:30:08.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.555+0000 7f5b83fff640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b640667e0 0x7f5b64068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:08.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.555+0000 7f5b83fff640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b640667e0 0x7f5b64068ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b740013e0 tx=0x7f5b74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:08.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.559+0000 7f5b817fa640 1 -- 172.21.15.53:0/2637326101 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b6c0eb6b0 con 0x7f5b700039d0 2024-09-13T18:30:08.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:08.723+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5b840cb720 con 0x7f5b700039d0 2024-09-13T18:30:09.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.387+0000 7f5b817fa640 1 -- 172.21.15.53:0/2637326101 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5b6c0eecd0 con 0x7f5b700039d0 2024-09-13T18:30:09.391 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:30:09.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b640667e0 msgr2=0x7f5b64068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b640667e0 0x7f5b64068ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b740013e0 tx=0x7f5b74009040 comp rx=0 tx=0).stop 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 msgr2=0x7f5b841478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b841478a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c10 tx=0x7f5b70005800 comp rx=0 tx=0).stop 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 shutdown_connections 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b640667e0 0x7f5b64068ca0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8414b6e0 0x7f5b84150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8406ffa0 0x7f5b84148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 --2- 172.21.15.53:0/2637326101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b700039d0 0x7f5b841478a0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 >> 172.21.15.53:0/2637326101 conn(0x7f5b8406a550 msgr2=0x7f5b840b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 shutdown_connections 2024-09-13T18:30:09.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.395+0000 7f5b8aec2640 1 -- 172.21.15.53:0/2637326101 wait complete. 2024-09-13T18:30:09.418 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:30:09.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28b205f640 1 Processor -- start 2024-09-13T18:30:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28b205f640 1 -- start start 2024-09-13T18:30:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28b205f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28ac15c830 0x7f28ac0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28b205f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 0x7f28ac0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28b205f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0b7db0 con 0x7f28ac0d2c80 2024-09-13T18:30:09.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28b205f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0d0650 con 0x7f28ac15c830 2024-09-13T18:30:09.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28b205f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0d0c10 con 0x7f28ac0ccd10 2024-09-13T18:30:09.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28abfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f28ac0d2c80 0x7f28ac0b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47564/0 (socket says 172.21.15.53:47564) 2024-09-13T18:30:09.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.539+0000 7f28abfff640 1 -- 172.21.15.53:0/3893177791 learned_addr learned my addr 172.21.15.53:0/3893177791 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aaffd640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 0x7f28ac0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28ab7fe640 1 --2- 172.21.15.53:0/3893177791 >> v2:172.21.15.87:3300/0 conn(0x7f28ac15c830 0x7f28ac0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672125128 0 0) 0x7f28ac0b7db0 con 0x7f28ac0d2c80 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2894003530 con 0x7f28ac0d2c80 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3173420592 0 0) 0x7f2894003530 con 0x7f28ac0d2c80 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 msgr2=0x7f28ac0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 0x7f28ac0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 >> v2:172.21.15.87:3300/0 conn(0x7f28ac15c830 msgr2=0x7f28ac0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 --2- 172.21.15.53:0/3893177791 >> v2:172.21.15.87:3300/0 conn(0x7f28ac15c830 0x7f28ac0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0cd7d0 con 0x7f28ac0d2c80 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f28a4001680 con 0x7f28ac0d2c80 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 >> v1:172.21.15.53:6789/0 conn(0x7f28ac0d2c80 legacy=0x7f28ac0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894003980 0x7f2894003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 0x7f28940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2894004d10 0x7f2894005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0d0650 con 0x7f2894004d10 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0d0c10 con 0x7f2894003980 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289400b990 con 0x7f28ac0ccd10 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2894004d10 0x7f2894005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28ab7fe640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894003980 0x7f2894003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aaffd640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 0x7f28940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 -- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 msgr2=0x7f28940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 0x7f28940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 -- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894003980 msgr2=0x7f2894003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894003980 0x7f2894003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 -- 172.21.15.53:0/3893177791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894003530 con 0x7f2894004d10 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aaffd640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0ccd10 0x7f28940047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2894004d10 0x7f2894005190 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c1c0 tx=0x7f28a401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4487d393512d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40058e0 con 0x7f2894004d10 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4005a60 con 0x7f2894004d10 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28aa7fc640 1 -- 172.21.15.53:0/3893177791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4005e10 con 0x7f2894004d10 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28b205f640 1 -- 172.21.15.53:0/3893177791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2894004d10 msgr2=0x7f2894005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28b205f640 1 --2- 172.21.15.53:0/3893177791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2894004d10 0x7f2894005190 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c1c0 tx=0x7f28a401cc20 comp rx=0 tx=0).stop 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.543+0000 7f28abfff640 1 -- 172.21.15.53:0/3893177791 reap_dead start 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- 172.21.15.53:0/3893177791 shutdown_connections 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- 172.21.15.53:0/3893177791 >> 172.21.15.53:0/3893177791 conn(0x7f28ac070970 msgr2=0x7f28ac070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- 172.21.15.53:0/3893177791 shutdown_connections 2024-09-13T18:30:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- 172.21.15.53:0/3893177791 wait complete. 2024-09-13T18:30:09.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 Processor -- start 2024-09-13T18:30:09.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- start start 2024-09-13T18:30:09.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894004d10 0x7f28ac0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28ac1f1d20 0x7f28ac155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0b2a20 0x7f28ac0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0b33f0 con 0x7f28ac1f1d20 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0cb710 con 0x7f2894004d10 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c9d70 con 0x7f28ac0b2a20 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28ac1f1d20 0x7f28ac155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28ac1f1d20 0x7f28ac155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53292/0 (socket says 172.21.15.53:53292) 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 -- 172.21.15.53:0/3859077292 learned_addr learned my addr 172.21.15.53:0/3859077292 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28ab7fe640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894004d10 0x7f28ac0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28abfff640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0b2a20 0x7f28ac0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 -- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0b2a20 msgr2=0x7f28ac0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0b2a20 0x7f28ac0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 -- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894004d10 msgr2=0x7f28ac0c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894004d10 0x7f28ac0c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 -- 172.21.15.53:0/3859077292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0ca050 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28aaffd640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28ac1f1d20 0x7f28ac155da0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009fd0 tx=0x7f28a0010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f2893fff640 1 -- 172.21.15.53:0/3859077292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000eb00 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f2893fff640 1 -- 172.21.15.53:0/3859077292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a000ec60 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac0ca330 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f2893fff640 1 -- 172.21.15.53:0/3859077292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a001c400 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.547+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac159680 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.551+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac15fdb0 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.551+0000 7f2893fff640 1 -- 172.21.15.53:0/3859077292 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f28a001c560 con 0x7f28ac1f1d20 2024-09-13T18:30:09.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.551+0000 7f2893fff640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28980667e0 0x7f2898068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.551+0000 7f2893fff640 1 -- 172.21.15.53:0/3859077292 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f28a0084700 con 0x7f28ac1f1d20 2024-09-13T18:30:09.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.551+0000 7f28ab7fe640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28980667e0 0x7f2898068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.551+0000 7f28ab7fe640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28980667e0 0x7f2898068ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f289c003b90 tx=0x7f289c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:09.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.555+0000 7f2893fff640 1 -- 172.21.15.53:0/3859077292 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28a0051a30 con 0x7f28ac1f1d20 2024-09-13T18:30:09.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.715+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f28ac0d1670 con 0x7f28ac1f1d20 2024-09-13T18:30:09.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f2893fff640 1 -- 172.21.15.53:0/3859077292 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f28a0055050 con 0x7f28ac1f1d20 2024-09-13T18:30:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28980667e0 msgr2=0x7f2898068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28980667e0 0x7f2898068ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f289c003b90 tx=0x7f289c00b040 comp rx=0 tx=0).stop 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28ac1f1d20 msgr2=0x7f28ac155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28ac1f1d20 0x7f28ac155da0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009fd0 tx=0x7f28a0010d60 comp rx=0 tx=0).stop 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 shutdown_connections 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28980667e0 0x7f2898068ca0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28ac0b2a20 0x7f28ac0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28ac1f1d20 0x7f28ac155da0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 --2- 172.21.15.53:0/3859077292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2894004d10 0x7f28ac0c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 >> 172.21.15.53:0/3859077292 conn(0x7f28ac070970 msgr2=0x7f28ac065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 shutdown_connections 2024-09-13T18:30:09.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.719+0000 7f28b205f640 1 -- 172.21.15.53:0/3859077292 wait complete. 2024-09-13T18:30:09.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-13T18:30:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.855+0000 7f80a34de640 1 Processor -- start 2024-09-13T18:30:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a34de640 1 -- start start 2024-09-13T18:30:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a34de640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f809c15b7c0 0x7f809c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a34de640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f809c0711d0 0x7f809c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a34de640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c06d480 con 0x7f809c1582a0 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a34de640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c071680 con 0x7f809c15b7c0 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a34de640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c15aaf0 con 0x7f809c0711d0 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a0a79640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f809c15b7c0 0x7f809c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a127a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f809c1582a0 0x7f809c06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47570/0 (socket says 172.21.15.53:47570) 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a127a640 1 -- 172.21.15.53:0/2978102529 learned_addr learned my addr 172.21.15.53:0/2978102529 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a0a79640 1 -- 172.21.15.53:0/2978102529 >> v2:172.21.15.87:3300/0 conn(0x7f809c0711d0 msgr2=0x7f809c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a0a79640 1 --2- 172.21.15.53:0/2978102529 >> v2:172.21.15.87:3300/0 conn(0x7f809c0711d0 0x7f809c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a0a79640 1 -- 172.21.15.53:0/2978102529 >> v1:172.21.15.53:6789/0 conn(0x7f809c1582a0 legacy=0x7f809c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a0a79640 1 -- 172.21.15.53:0/2978102529 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c15ace0 con 0x7f809c15b7c0 2024-09-13T18:30:09.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f8093fff640 1 -- 172.21.15.53:0/2978102529 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511196759 0 0) 0x7f809c06d480 con 0x7f809c1582a0 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f80a0a79640 1 --2- 172.21.15.53:0/2978102529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c15b7c0 0x7f809c070c90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f809c158680 tx=0x7f809801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c4778fd1fbb848 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f8093fff640 1 -- 172.21.15.53:0/2978102529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80980ab600 con 0x7f809c15b7c0 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f8093fff640 1 -- 172.21.15.53:0/2978102529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80980a7050 con 0x7f809c15b7c0 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.859+0000 7f8093fff640 1 -- 172.21.15.53:0/2978102529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80980ab980 con 0x7f809c15b7c0 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- 172.21.15.53:0/2978102529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c15b7c0 msgr2=0x7f809c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 --2- 172.21.15.53:0/2978102529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c15b7c0 0x7f809c070c90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f809c158680 tx=0x7f809801c480 comp rx=0 tx=0).stop 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- 172.21.15.53:0/2978102529 shutdown_connections 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 --2- 172.21.15.53:0/2978102529 >> v2:172.21.15.87:3300/0 conn(0x7f809c0711d0 0x7f809c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 --2- 172.21.15.53:0/2978102529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c15b7c0 0x7f809c070c90 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- 172.21.15.53:0/2978102529 >> 172.21.15.53:0/2978102529 conn(0x7f809c065c80 msgr2=0x7f809c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- 172.21.15.53:0/2978102529 shutdown_connections 2024-09-13T18:30:09.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- 172.21.15.53:0/2978102529 wait complete. 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 Processor -- start 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- start start 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0711d0 0x7f809c14c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c1582a0 0x7f809c154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f809c15b7c0 0x7f809c1f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c14eba0 con 0x7f809c1582a0 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c14f700 con 0x7f809c0711d0 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c1558f0 con 0x7f809c15b7c0 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c1582a0 0x7f809c154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c1582a0 0x7f809c154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53310/0 (socket says 172.21.15.53:53310) 2024-09-13T18:30:09.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 -- 172.21.15.53:0/2673799604 learned_addr learned my addr 172.21.15.53:0/2673799604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 -- 172.21.15.53:0/2673799604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f809c15b7c0 msgr2=0x7f809c1f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f809c15b7c0 0x7f809c1f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 -- 172.21.15.53:0/2673799604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0711d0 msgr2=0x7f809c14c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0711d0 0x7f809c14c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 -- 172.21.15.53:0/2673799604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098009420 con 0x7f809c1582a0 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a0a79640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c1582a0 0x7f809c154ec0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f809801a0b0 tx=0x7f809801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f8091ffb640 1 -- 172.21.15.53:0/2673799604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098004230 con 0x7f809c1582a0 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f8091ffb640 1 -- 172.21.15.53:0/2673799604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8098004390 con 0x7f809c1582a0 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c14edd0 con 0x7f809c1582a0 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f8091ffb640 1 -- 172.21.15.53:0/2673799604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098003820 con 0x7f809c1582a0 2024-09-13T18:30:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.863+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c14f390 con 0x7f809c1582a0 2024-09-13T18:30:09.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.867+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c067400 con 0x7f809c1582a0 2024-09-13T18:30:09.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.867+0000 7f8091ffb640 1 -- 172.21.15.53:0/2673799604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8098003980 con 0x7f809c1582a0 2024-09-13T18:30:09.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.867+0000 7f8091ffb640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f80800667e0 0x7f8080068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:09.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.867+0000 7f8091ffb640 1 -- 172.21.15.53:0/2673799604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f809811efe0 con 0x7f809c1582a0 2024-09-13T18:30:09.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.867+0000 7f80a127a640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f80800667e0 0x7f8080068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:09.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.867+0000 7f80a127a640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f80800667e0 0x7f8080068ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f808c0011f0 tx=0x7f808c007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:09.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:09.871+0000 7f8091ffb640 1 -- 172.21.15.53:0/2673799604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f80980ec3f0 con 0x7f809c1582a0 2024-09-13T18:30:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.087+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) v1 -- 0x7f809c0b0ff0 con 0x7f809c1582a0 2024-09-13T18:30:10.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.387+0000 7f8091ffb640 1 -- 172.21.15.53:0/2673799604 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v282) v1 ==== 131+0+0 (secure 0 0 0) 0x7f80980c40c0 con 0x7f809c1582a0 2024-09-13T18:30:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f80800667e0 msgr2=0x7f8080068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f80800667e0 0x7f8080068ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f808c0011f0 tx=0x7f808c007930 comp rx=0 tx=0).stop 2024-09-13T18:30:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c1582a0 msgr2=0x7f809c154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c1582a0 0x7f809c154ec0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f809801a0b0 tx=0x7f809801acc0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 shutdown_connections 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f80800667e0 0x7f8080068ca0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f809c15b7c0 0x7f809c1f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f809c1582a0 0x7f809c154ec0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 --2- 172.21.15.53:0/2673799604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f809c0711d0 0x7f809c14c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 >> 172.21.15.53:0/2673799604 conn(0x7f809c065c80 msgr2=0x7f809c14cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 shutdown_connections 2024-09-13T18:30:10.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.391+0000 7f80a34de640 1 -- 172.21.15.53:0/2673799604 wait complete. 2024-09-13T18:30:10.413 INFO:tasks.cephfs_test_runner:test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-13T18:30:10.413 INFO:tasks.cephfs_test_runner:Starting test: test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) Test the creating vols, subvols subvolgroups fails when their names uses 2024-09-13T18:30:10.413 INFO:tasks.cephfs_test_runner:test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:30:10.414 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:10.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.539+0000 7fb25fe33640 1 Processor -- start 2024-09-13T18:30:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.539+0000 7fb25fe33640 1 -- start start 2024-09-13T18:30:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25fe33640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb25815c840 0x7fb258160220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25fe33640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2580b1650 0x7fb2580b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25fe33640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2580b50b0 con 0x7fb2580b4c80 2024-09-13T18:30:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25fe33640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580cdd80 con 0x7fb25815c840 2024-09-13T18:30:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25fe33640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb258160a70 con 0x7fb2580b1650 2024-09-13T18:30:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25e3d0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb2580b4c80 0x7fb2580cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47572/0 (socket says 172.21.15.53:47572) 2024-09-13T18:30:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25e3d0640 1 -- 172.21.15.53:0/1782160409 learned_addr learned my addr 172.21.15.53:0/1782160409 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25dbcf640 1 --2- 172.21.15.53:0/1782160409 >> v2:172.21.15.53:3300/0 conn(0x7fb25815c840 0x7fb258160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25d3ce640 1 --2- 172.21.15.53:0/1782160409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2580b1650 0x7fb2580b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25dbcf640 1 -- 172.21.15.53:0/1782160409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2580b1650 msgr2=0x7fb2580b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25dbcf640 1 --2- 172.21.15.53:0/1782160409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2580b1650 0x7fb2580b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25dbcf640 1 -- 172.21.15.53:0/1782160409 >> v1:172.21.15.53:6789/0 conn(0x7fb2580b4c80 legacy=0x7fb2580cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25dbcf640 1 -- 172.21.15.53:0/1782160409 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258160d50 con 0x7fb25815c840 2024-09-13T18:30:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25d3ce640 1 --2- 172.21.15.53:0/1782160409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2580b1650 0x7fb2580b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25dbcf640 1 --2- 172.21.15.53:0/1782160409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb25815c840 0x7fb258160220 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097c0 tx=0x7fb25401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39a7f9899f88d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25cbcd640 1 -- 172.21.15.53:0/1782160409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540ab670 con 0x7fb25815c840 2024-09-13T18:30:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25cbcd640 1 -- 172.21.15.53:0/1782160409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2540ab7d0 con 0x7fb25815c840 2024-09-13T18:30:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.543+0000 7fb25cbcd640 1 -- 172.21.15.53:0/1782160409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540abb60 con 0x7fb25815c840 2024-09-13T18:30:10.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- 172.21.15.53:0/1782160409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb25815c840 msgr2=0x7fb258160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1782160409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb25815c840 0x7fb258160220 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097c0 tx=0x7fb25401c470 comp rx=0 tx=0).stop 2024-09-13T18:30:10.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- 172.21.15.53:0/1782160409 shutdown_connections 2024-09-13T18:30:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1782160409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2580b1650 0x7fb2580b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1782160409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb25815c840 0x7fb258160220 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- 172.21.15.53:0/1782160409 >> 172.21.15.53:0/1782160409 conn(0x7fb258066080 msgr2=0x7fb258066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- 172.21.15.53:0/1782160409 shutdown_connections 2024-09-13T18:30:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- 172.21.15.53:0/1782160409 wait complete. 2024-09-13T18:30:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 Processor -- start 2024-09-13T18:30:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- start start 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2580b1650 0x7fb258155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2580b4c80 0x7fb2580b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb25815c840 0x7fb25815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25815ccb0 con 0x7fb2580b1650 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb258156760 con 0x7fb2580b4c80 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb258156a40 con 0x7fb25815c840 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2580b1650 0x7fb258155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2580b1650 0x7fb258155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53320/0 (socket says 172.21.15.53:53320) 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 -- 172.21.15.53:0/1099608829 learned_addr learned my addr 172.21.15.53:0/1099608829 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25e3d0640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb25815c840 0x7fb25815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25d3ce640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2580b4c80 0x7fb2580b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 -- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb25815c840 msgr2=0x7fb25815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb25815c840 0x7fb25815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 -- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2580b4c80 msgr2=0x7fb2580b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2580b4c80 0x7fb2580b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 -- 172.21.15.53:0/1099608829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254009420 con 0x7fb2580b1650 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25e3d0640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb25815c840 0x7fb25815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25dbcf640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2580b1650 0x7fb258155e60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fb2540ad040 tx=0x7fb25401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb24e7fc640 1 -- 172.21.15.53:0/1099608829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540b5810 con 0x7fb2580b1650 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb24e7fc640 1 -- 172.21.15.53:0/1099608829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2540b5970 con 0x7fb2580b1650 2024-09-13T18:30:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb24e7fc640 1 -- 172.21.15.53:0/1099608829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540b5d20 con 0x7fb2580b1650 2024-09-13T18:30:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25815cec0 con 0x7fb2580b1650 2024-09-13T18:30:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.547+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2581563a0 con 0x7fb2580b1650 2024-09-13T18:30:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.551+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb258156c50 con 0x7fb2580b1650 2024-09-13T18:30:10.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.551+0000 7fb24e7fc640 1 -- 172.21.15.53:0/1099608829 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fb2540bf410 con 0x7fb2580b1650 2024-09-13T18:30:10.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.551+0000 7fb24e7fc640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb23c0667b0 0x7fb23c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.551+0000 7fb24e7fc640 1 -- 172.21.15.53:0/1099608829 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5502+0+0 (secure 0 0 0) 0x7fb25411ef90 con 0x7fb2580b1650 2024-09-13T18:30:10.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.551+0000 7fb25d3ce640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb23c0667b0 0x7fb23c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.551+0000 7fb25d3ce640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb23c0667b0 0x7fb23c068c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb248006fd0 tx=0x7fb248008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:10.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.555+0000 7fb24e7fc640 1 -- 172.21.15.53:0/1099608829 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb258156c50 con 0x7fb2580b1650 2024-09-13T18:30:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.715+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb258156c50 con 0x7fb2580b1650 2024-09-13T18:30:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb24e7fc640 1 -- 172.21.15.53:0/1099608829 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13734 (secure 0 0 0) 0x7fb258156c50 con 0x7fb2580b1650 2024-09-13T18:30:10.720 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:10.720 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":78,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:09.381656+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1161349159":"2024-09-14T18:30:06.353682+0000","172.21.15.53:6834/1161349159":"2024-09-14T18:30:06.353682+0000","172.21.15.87:0/1598969345":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3809889825":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6832/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2553088179":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/3017576771":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2827842914":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2413981801":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/88211871":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/2229318564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/969146036":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/4172431564":"2024-09-14T18:30:01.777203+0000","172.21.15.87:6833/133103669":"2024-09-14T18:30:01.777203+0000","172.21.15.87:0/1484640503":"2024-09-14T18:30:01.777203+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb23c0667b0 msgr2=0x7fb23c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb23c0667b0 0x7fb23c068c70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb248006fd0 tx=0x7fb248008040 comp rx=0 tx=0).stop 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2580b1650 msgr2=0x7fb258155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2580b1650 0x7fb258155e60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fb2540ad040 tx=0x7fb25401acb0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 shutdown_connections 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb23c0667b0 0x7fb23c068c70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb25815c840 0x7fb25815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2580b4c80 0x7fb2580b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 --2- 172.21.15.53:0/1099608829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2580b1650 0x7fb258155e60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 >> 172.21.15.53:0/1099608829 conn(0x7fb258066080 msgr2=0x7fb258066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 shutdown_connections 2024-09-13T18:30:10.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.719+0000 7fb25fe33640 1 -- 172.21.15.53:0/1099608829 wait complete. 2024-09-13T18:30:10.740 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:10.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:10.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6b1a1640 1 Processor -- start 2024-09-13T18:30:10.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6b1a1640 1 -- start start 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6b1a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f64143e80 0x7f8f6406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6b1a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f640cda30 0x7f8f640cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6b1a1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6406f7a0 con 0x7f8f640caee0 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6b1a1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6406fd60 con 0x7f8f640cda30 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6b1a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640cb960 con 0x7f8f64143e80 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6973e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f640cda30 0x7f8f640cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6973e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f640cda30 0x7f8f640cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53324/0 (socket says 172.21.15.53:53324) 2024-09-13T18:30:10.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6973e640 1 -- 172.21.15.53:0/1610936827 learned_addr learned my addr 172.21.15.53:0/1610936827 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:10.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f68f3d640 1 --2- 172.21.15.53:0/1610936827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f64143e80 0x7f8f6406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6973e640 1 -- 172.21.15.53:0/1610936827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f64143e80 msgr2=0x7f8f6406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:10.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6973e640 1 --2- 172.21.15.53:0/1610936827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f64143e80 0x7f8f6406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6973e640 1 -- 172.21.15.53:0/1610936827 >> v1:172.21.15.87:6789/0 conn(0x7f8f640caee0 legacy=0x7f8f640cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.871+0000 7f8f6973e640 1 -- 172.21.15.53:0/1610936827 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640cbc40 con 0x7f8f640cda30 2024-09-13T18:30:10.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 --2- 172.21.15.53:0/1610936827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f640cda30 0x7f8f640cb320 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009e50 tx=0x7f8f5c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cb26e5b7a4bdb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:10.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f637fe640 1 -- 172.21.15.53:0/1610936827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0a5810 con 0x7f8f640cda30 2024-09-13T18:30:10.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f637fe640 1 -- 172.21.15.53:0/1610936827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0a5970 con 0x7f8f640cda30 2024-09-13T18:30:10.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f637fe640 1 -- 172.21.15.53:0/1610936827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0a5d00 con 0x7f8f640cda30 2024-09-13T18:30:10.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/1610936827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f640cda30 msgr2=0x7f8f640cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/1610936827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f640cda30 0x7f8f640cb320 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009e50 tx=0x7f8f5c01c970 comp rx=0 tx=0).stop 2024-09-13T18:30:10.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/1610936827 shutdown_connections 2024-09-13T18:30:10.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/1610936827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f640cda30 0x7f8f640cb320 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/1610936827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f64143e80 0x7f8f6406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/1610936827 >> 172.21.15.53:0/1610936827 conn(0x7f8f64065c80 msgr2=0x7f8f64066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/1610936827 shutdown_connections 2024-09-13T18:30:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/1610936827 wait complete. 2024-09-13T18:30:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 Processor -- start 2024-09-13T18:30:10.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- start start 2024-09-13T18:30:10.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f640caee0 0x7f8f640a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f640cda30 0x7f8f641f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f64143e80 0x7f8f64142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641f5310 con 0x7f8f64143e80 2024-09-13T18:30:10.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641f55f0 con 0x7f8f640cda30 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6b1a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b20e0 con 0x7f8f640caee0 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f64143e80 0x7f8f64142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f64143e80 0x7f8f64142910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53334/0 (socket says 172.21.15.53:53334) 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 -- 172.21.15.53:0/2093382132 learned_addr learned my addr 172.21.15.53:0/2093382132 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f68f3d640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f640caee0 0x7f8f640a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f63fff640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f640cda30 0x7f8f641f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 -- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f640caee0 msgr2=0x7f8f640a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f640caee0 0x7f8f640a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 -- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f640cda30 msgr2=0x7f8f641f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f640cda30 0x7f8f641f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.875+0000 7f8f6973e640 1 -- 172.21.15.53:0/2093382132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009b30 con 0x7f8f64143e80 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f6973e640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f64143e80 0x7f8f64142910 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0af040 tx=0x7f8f5c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:10.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f617fa640 1 -- 172.21.15.53:0/2093382132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0b8670 con 0x7f8f64143e80 2024-09-13T18:30:10.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f617fa640 1 -- 172.21.15.53:0/2093382132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0b87d0 con 0x7f8f64143e80 2024-09-13T18:30:10.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f640b23c0 con 0x7f8f64143e80 2024-09-13T18:30:10.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f617fa640 1 -- 172.21.15.53:0/2093382132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0b8b60 con 0x7f8f64143e80 2024-09-13T18:30:10.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f64157370 con 0x7f8f64143e80 2024-09-13T18:30:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f640b25b0 con 0x7f8f64143e80 2024-09-13T18:30:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f617fa640 1 -- 172.21.15.53:0/2093382132 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8f5c0b8cc0 con 0x7f8f64143e80 2024-09-13T18:30:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f617fa640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f500667b0 0x7f8f50068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f617fa640 1 -- 172.21.15.53:0/2093382132 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f8f5c11feb0 con 0x7f8f64143e80 2024-09-13T18:30:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f68f3d640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f500667b0 0x7f8f50068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:10.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.879+0000 7f8f68f3d640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f500667b0 0x7f8f50068c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f640ad560 tx=0x7f8f54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:10.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:10.883+0000 7f8f617fa640 1 -- 172.21.15.53:0/2093382132 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f5c0ed2e0 con 0x7f8f64143e80 2024-09-13T18:30:11.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.043+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f640cb320 con 0x7f8f64143e80 2024-09-13T18:30:11.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.043+0000 7f8f617fa640 1 -- 172.21.15.53:0/2093382132 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f5c0f0900 con 0x7f8f64143e80 2024-09-13T18:30:11.045 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:11.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f500667b0 msgr2=0x7f8f50068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:11.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f500667b0 0x7f8f50068c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f640ad560 tx=0x7f8f54008040 comp rx=0 tx=0).stop 2024-09-13T18:30:11.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f64143e80 msgr2=0x7f8f64142910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:11.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f64143e80 0x7f8f64142910 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0af040 tx=0x7f8f5c019710 comp rx=0 tx=0).stop 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 shutdown_connections 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f500667b0 0x7f8f50068c70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f64143e80 0x7f8f64142910 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f640cda30 0x7f8f641f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 --2- 172.21.15.53:0/2093382132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f640caee0 0x7f8f640a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 >> 172.21.15.53:0/2093382132 conn(0x7f8f64065c80 msgr2=0x7f8f640b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 shutdown_connections 2024-09-13T18:30:11.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.047+0000 7f8f6b1a1640 1 -- 172.21.15.53:0/2093382132 wait complete. 2024-09-13T18:30:11.065 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-13T18:30:11.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f9834460640 1 Processor -- start 2024-09-13T18:30:11.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f9834460640 1 -- start start 2024-09-13T18:30:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f9834460640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f982c15b7c0 0x7f982c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f9834460640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0711d0 0x7f982c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f9834460640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c06d480 con 0x7f982c1582a0 2024-09-13T18:30:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f9834460640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c15aaf0 con 0x7f982c15b7c0 2024-09-13T18:30:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f9834460640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c06d760 con 0x7f982c0711d0 2024-09-13T18:30:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98319fb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f982c15b7c0 0x7f982c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98319fb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f982c15b7c0 0x7f982c070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53338/0 (socket says 172.21.15.53:53338) 2024-09-13T18:30:11.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98319fb640 1 -- 172.21.15.53:0/779680709 learned_addr learned my addr 172.21.15.53:0/779680709 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:11.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98329fd640 1 --2- 172.21.15.53:0/779680709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0711d0 0x7f982c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:11.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98319fb640 1 -- 172.21.15.53:0/779680709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0711d0 msgr2=0x7f982c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:11.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98319fb640 1 --2- 172.21.15.53:0/779680709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0711d0 0x7f982c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98319fb640 1 -- 172.21.15.53:0/779680709 >> v1:172.21.15.87:6789/0 conn(0x7f982c1582a0 legacy=0x7f982c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:11.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.183+0000 7f98319fb640 1 -- 172.21.15.53:0/779680709 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c15ace0 con 0x7f982c15b7c0 2024-09-13T18:30:11.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98319fb640 1 --2- 172.21.15.53:0/779680709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c15b7c0 0x7f982c070c90 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f981c009870 tx=0x7f981c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387a73dd7cb093c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:11.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98311fa640 1 -- 172.21.15.53:0/779680709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0ab650 con 0x7f982c15b7c0 2024-09-13T18:30:11.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98311fa640 1 -- 172.21.15.53:0/779680709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0ab7b0 con 0x7f982c15b7c0 2024-09-13T18:30:11.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98311fa640 1 -- 172.21.15.53:0/779680709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0abb40 con 0x7f982c15b7c0 2024-09-13T18:30:11.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- 172.21.15.53:0/779680709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c15b7c0 msgr2=0x7f982c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:11.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 --2- 172.21.15.53:0/779680709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c15b7c0 0x7f982c070c90 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f981c009870 tx=0x7f981c01c560 comp rx=0 tx=0).stop 2024-09-13T18:30:11.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- 172.21.15.53:0/779680709 shutdown_connections 2024-09-13T18:30:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 --2- 172.21.15.53:0/779680709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c0711d0 0x7f982c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 --2- 172.21.15.53:0/779680709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c15b7c0 0x7f982c070c90 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- 172.21.15.53:0/779680709 >> 172.21.15.53:0/779680709 conn(0x7f982c065c80 msgr2=0x7f982c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- 172.21.15.53:0/779680709 shutdown_connections 2024-09-13T18:30:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- 172.21.15.53:0/779680709 wait complete. 2024-09-13T18:30:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 Processor -- start 2024-09-13T18:30:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- start start 2024-09-13T18:30:11.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c0711d0 0x7f982c14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:11.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c1582a0 0x7f982c14f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:11.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c15b7c0 0x7f982c145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:11.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c14e390 con 0x7f982c0711d0 2024-09-13T18:30:11.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1519a0 con 0x7f982c1582a0 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f9834460640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c151c00 con 0x7f982c15b7c0 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c0711d0 0x7f982c14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c0711d0 0x7f982c14da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53350/0 (socket says 172.21.15.53:53350) 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 -- 172.21.15.53:0/3441527855 learned_addr learned my addr 172.21.15.53:0/3441527855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98319fb640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c1582a0 0x7f982c14f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98329fd640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c15b7c0 0x7f982c145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 -- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c15b7c0 msgr2=0x7f982c145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c15b7c0 0x7f982c145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 -- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c1582a0 msgr2=0x7f982c14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c1582a0 0x7f982c14f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 -- 172.21.15.53:0/3441527855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c0094d0 con 0x7f982c0711d0 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.187+0000 7f98321fc640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c0711d0 0x7f982c14da90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f982800c7f0 tx=0x7f982800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9822ffd640 1 -- 172.21.15.53:0/3441527855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828003b80 con 0x7f982c0711d0 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9822ffd640 1 -- 172.21.15.53:0/3441527855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828003ce0 con 0x7f982c0711d0 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c151ee0 con 0x7f982c0711d0 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9822ffd640 1 -- 172.21.15.53:0/3441527855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800aa90 con 0x7f982c0711d0 2024-09-13T18:30:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c14dfd0 con 0x7f982c0711d0 2024-09-13T18:30:11.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c067400 con 0x7f982c0711d0 2024-09-13T18:30:11.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9822ffd640 1 -- 172.21.15.53:0/3441527855 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f982800abf0 con 0x7f982c0711d0 2024-09-13T18:30:11.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9822ffd640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98100667b0 0x7f9810068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:11.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f9822ffd640 1 -- 172.21.15.53:0/3441527855 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f98280840c0 con 0x7f982c0711d0 2024-09-13T18:30:11.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f98319fb640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98100667b0 0x7f9810068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:11.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.191+0000 7f98319fb640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98100667b0 0x7f9810068c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f981c0af000 tx=0x7f981c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:11.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.195+0000 7f9822ffd640 1 -- 172.21.15.53:0/3441527855 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9828051480 con 0x7f982c0711d0 2024-09-13T18:30:11.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:11.407+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) v1 -- 0x7f982c1520d0 con 0x7f982c0711d0 2024-09-13T18:30:12.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.399+0000 7f9822ffd640 1 -- 172.21.15.53:0/3441527855 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v284) v1 ==== 149+0+0 (secure 0 0 0) 0x7f9828054aa0 con 0x7f982c0711d0 2024-09-13T18:30:12.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98100667b0 msgr2=0x7f9810068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98100667b0 0x7f9810068c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f981c0af000 tx=0x7f981c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:30:12.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c0711d0 msgr2=0x7f982c14da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c0711d0 0x7f982c14da90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f982800c7f0 tx=0x7f982800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 shutdown_connections 2024-09-13T18:30:12.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f98100667b0 0x7f9810068c70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f982c15b7c0 0x7f982c145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f982c1582a0 0x7f982c14f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 --2- 172.21.15.53:0/3441527855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f982c0711d0 0x7f982c14da90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 >> 172.21.15.53:0/3441527855 conn(0x7f982c065c80 msgr2=0x7f982c06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:12.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 shutdown_connections 2024-09-13T18:30:12.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.403+0000 7f9834460640 1 -- 172.21.15.53:0/3441527855 wait complete. 2024-09-13T18:30:12.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:30:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.563+0000 7fc21d460640 1 Processor -- start 2024-09-13T18:30:12.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.563+0000 7fc21d460640 1 -- start start 2024-09-13T18:30:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc21d460640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 0x7fc2180cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc21d460640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21806f7a0 con 0x7fc2180caee0 2024-09-13T18:30:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc21d460640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21806fd60 con 0x7fc218143e80 2024-09-13T18:30:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc21d460640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21806baa0 con 0x7fc2180cda30 2024-09-13T18:30:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc2180caee0 0x7fc2180cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47582/0 (socket says 172.21.15.53:47582) 2024-09-13T18:30:12.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 -- 172.21.15.53:0/3547472250 learned_addr learned my addr 172.21.15.53:0/3547472250 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2177fe640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 0x7fc2180cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521624769 0 0) 0x7fc21806f7a0 con 0x7fc2180caee0 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc200003530 con 0x7fc2180caee0 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 873654354 0 0) 0x7fc200003530 con 0x7fc2180caee0 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 msgr2=0x7fc2180cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 0x7fc2180cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 >> v1:172.21.15.87:6789/0 conn(0x7fc218143e80 legacy=0x7fc21806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180cb960 con 0x7fc2180caee0 2024-09-13T18:30:12.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc20c001680 con 0x7fc2180caee0 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 >> v1:172.21.15.53:6789/0 conn(0x7fc2180caee0 legacy=0x7fc2180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000039b0 0x7fc200003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2000047d0 0x7fc200004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 0x7fc2000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21806baa0 con 0x7fc2000047d0 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20000bac0 con 0x7fc2000039b0 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20000bc80 con 0x7fc2180cda30 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2000047d0 0x7fc200004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2177fe640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 0x7fc2000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc216ffd640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000039b0 0x7fc200003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 -- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 msgr2=0x7fc2000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 0x7fc2000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 -- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000039b0 msgr2=0x7fc200003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:12.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000039b0 0x7fc200003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2167fc640 1 -- 172.21.15.53:0/3547472250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200003530 con 0x7fc2000047d0 2024-09-13T18:30:12.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc2177fe640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180cda30 0x7fc2000051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:12.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.567+0000 7fc216ffd640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000039b0 0x7fc200003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc2167fc640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2000047d0 0x7fc200004c50 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c210 tx=0x7fc20c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea076aef71e139ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c005ae0 con 0x7fc2000047d0 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c005c40 con 0x7fc2000047d0 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc215ffb640 1 -- 172.21.15.53:0/3547472250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0a5820 con 0x7fc2000047d0 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 -- 172.21.15.53:0/3547472250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2000047d0 msgr2=0x7fc200004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 --2- 172.21.15.53:0/3547472250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2000047d0 0x7fc200004c50 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c210 tx=0x7fc20c01cc30 comp rx=0 tx=0).stop 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc2177fe640 1 -- 172.21.15.53:0/3547472250 reap_dead start 2024-09-13T18:30:12.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 -- 172.21.15.53:0/3547472250 shutdown_connections 2024-09-13T18:30:12.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 -- 172.21.15.53:0/3547472250 >> 172.21.15.53:0/3547472250 conn(0x7fc218065c80 msgr2=0x7fc218066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:12.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 -- 172.21.15.53:0/3547472250 shutdown_connections 2024-09-13T18:30:12.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 -- 172.21.15.53:0/3547472250 wait complete. 2024-09-13T18:30:12.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 Processor -- start 2024-09-13T18:30:12.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.571+0000 7fc21d460640 1 -- start start 2024-09-13T18:30:12.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000047d0 0x7fc2181574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc218138740 0x7fc2180b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180ac8e0 0x7fc2180acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180ad2a0 con 0x7fc218138740 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180b3690 con 0x7fc2000047d0 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21813fa10 con 0x7fc2180ac8e0 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc218138740 0x7fc2180b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc218138740 0x7fc2180b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53364/0 (socket says 172.21.15.53:53364) 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 -- 172.21.15.53:0/895002840 learned_addr learned my addr 172.21.15.53:0/895002840 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc216ffd640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000047d0 0x7fc2181574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2177fe640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180ac8e0 0x7fc2180acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 -- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180ac8e0 msgr2=0x7fc2180acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180ac8e0 0x7fc2180acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 -- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000047d0 msgr2=0x7fc2181574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000047d0 0x7fc2181574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 -- 172.21.15.53:0/895002840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21813f120 con 0x7fc218138740 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc2167fc640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc218138740 0x7fc2180b2d90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c210 tx=0x7fc200005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc1ff7fe640 1 -- 172.21.15.53:0/895002840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0b4070 con 0x7fc218138740 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc1ff7fe640 1 -- 172.21.15.53:0/895002840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c001010 con 0x7fc218138740 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21813f3c0 con 0x7fc218138740 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc1ff7fe640 1 -- 172.21.15.53:0/895002840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c001660 con 0x7fc218138740 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc218157a00 con 0x7fc218138740 2024-09-13T18:30:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.575+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2180cd320 con 0x7fc218138740 2024-09-13T18:30:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.579+0000 7fc1ff7fe640 1 -- 172.21.15.53:0/895002840 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc20c0a5820 con 0x7fc218138740 2024-09-13T18:30:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.579+0000 7fc1ff7fe640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2040667b0 0x7fc204068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.579+0000 7fc1ff7fe640 1 -- 172.21.15.53:0/895002840 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5502+0+0 (secure 0 0 0) 0x7fc20c11dca0 con 0x7fc218138740 2024-09-13T18:30:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.579+0000 7fc216ffd640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2040667b0 0x7fc204068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:12.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.579+0000 7fc216ffd640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2040667b0 0x7fc204068c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc21815c630 tx=0x7fc208009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:12.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.583+0000 7fc1ff7fe640 1 -- 172.21.15.53:0/895002840 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc20c0eb070 con 0x7fc218138740 2024-09-13T18:30:12.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.739+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc21815c660 con 0x7fc218138740 2024-09-13T18:30:12.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc1ff7fe640 1 -- 172.21.15.53:0/895002840 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc20c0ee690 con 0x7fc218138740 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2040667b0 msgr2=0x7fc204068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2040667b0 0x7fc204068c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc21815c630 tx=0x7fc208009040 comp rx=0 tx=0).stop 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc218138740 msgr2=0x7fc2180b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc218138740 0x7fc2180b2d90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00c210 tx=0x7fc200005800 comp rx=0 tx=0).stop 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 shutdown_connections 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2040667b0 0x7fc204068c70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2180ac8e0 0x7fc2180acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc218138740 0x7fc2180b2d90 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 --2- 172.21.15.53:0/895002840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2000047d0 0x7fc2181574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 >> 172.21.15.53:0/895002840 conn(0x7fc218065c80 msgr2=0x7fc2180af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.747+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 shutdown_connections 2024-09-13T18:30:12.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:12.751+0000 7fc21d460640 1 -- 172.21.15.53:0/895002840 wait complete. 2024-09-13T18:30:12.768 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:30:12.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:12.845 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:12.921 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:30:12.921 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:12.922 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:12.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:12.928 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:12.928 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:12.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:12.935 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:12.935 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:12.976 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:12.976 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:12.977 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:12.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:12.982 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:30:12.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3fa20640 1 Processor -- start 2024-09-13T18:30:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3fa20640 1 -- start start 2024-09-13T18:30:13.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3fa20640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 0x7f0e380d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3fa20640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e380d2400 con 0x7f0e380cd6c0 2024-09-13T18:30:13.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3fa20640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e380d1530 con 0x7f0e380cf7d0 2024-09-13T18:30:13.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3fa20640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380d0920 con 0x7f0e3815cab0 2024-09-13T18:30:13.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3cfbb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0e380cd6c0 0x7f0e380cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47596/0 (socket says 172.21.15.53:47596) 2024-09-13T18:30:13.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3cfbb640 1 -- 172.21.15.53:0/3822702587 learned_addr learned my addr 172.21.15.53:0/3822702587 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3d7bc640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 0x7f0e380d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359621380 0 0) 0x7f0e380d2400 con 0x7f0e380cd6c0 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e24003530 con 0x7f0e380cd6c0 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221493117 0 0) 0x7f0e24003530 con 0x7f0e380cd6c0 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 msgr2=0x7f0e380d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 0x7f0e380d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 >> v1:172.21.15.87:6789/0 conn(0x7f0e380cf7d0 legacy=0x7f0e380b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380d0c00 con 0x7f0e380cd6c0 2024-09-13T18:30:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0e28001680 con 0x7f0e380cd6c0 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 >> v1:172.21.15.53:6789/0 conn(0x7f0e380cd6c0 legacy=0x7f0e380cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e240039b0 0x7f0e24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 0x7f0e240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e24004d10 0x7f0e24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380d0920 con 0x7f0e24004d10 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2400ba40 con 0x7f0e240039b0 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2400bc00 con 0x7f0e3815cab0 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3dfbd640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e24004d10 0x7f0e24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3d7bc640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e240039b0 0x7f0e24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3cfbb640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 0x7f0e240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3dfbd640 1 -- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 msgr2=0x7f0e240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3dfbd640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e3815cab0 0x7f0e240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3dfbd640 1 -- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e240039b0 msgr2=0x7f0e24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3dfbd640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e240039b0 0x7f0e24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.151+0000 7f0e3dfbd640 1 -- 172.21.15.53:0/3822702587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24003530 con 0x7f0e24004d10 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3dfbd640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e24004d10 0x7f0e24005190 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0e380b51d0 tx=0x7f0e3001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eee0bb800d055a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30003b80 con 0x7f0e24004d10 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30003ce0 con 0x7f0e24004d10 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e2ffff640 1 -- 172.21.15.53:0/3822702587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300052c0 con 0x7f0e24004d10 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3822702587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e24004d10 msgr2=0x7f0e24005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 --2- 172.21.15.53:0/3822702587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e24004d10 0x7f0e24005190 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0e380b51d0 tx=0x7f0e3001c720 comp rx=0 tx=0).stop 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3dfbd640 1 -- 172.21.15.53:0/3822702587 reap_dead start 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3822702587 shutdown_connections 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3822702587 >> 172.21.15.53:0/3822702587 conn(0x7f0e38065c80 msgr2=0x7f0e38066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:13.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3822702587 shutdown_connections 2024-09-13T18:30:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3822702587 wait complete. 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 Processor -- start 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.155+0000 7f0e3fa20640 1 -- start start 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e24004d10 0x7f0e380ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e3814e9d0 0x7f0e380abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e3814ee30 0x7f0e380ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380aa430 con 0x7f0e3814e9d0 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380aa710 con 0x7f0e3814ee30 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380aa9f0 con 0x7f0e24004d10 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e3814e9d0 0x7f0e380abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e3814e9d0 0x7f0e380abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53390/0 (socket says 172.21.15.53:53390) 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 -- 172.21.15.53:0/3423654794 learned_addr learned my addr 172.21.15.53:0/3423654794 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3d7bc640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e24004d10 0x7f0e380ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3dfbd640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e3814ee30 0x7f0e380ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 -- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e24004d10 msgr2=0x7f0e380ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e24004d10 0x7f0e380ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 -- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e3814ee30 msgr2=0x7f0e380ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e3814ee30 0x7f0e380ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 -- 172.21.15.53:0/3423654794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380aacd0 con 0x7f0e3814e9d0 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3cfbb640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e3814e9d0 0x7f0e380abf10 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001ca0 tx=0x7f0e2800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e2dffb640 1 -- 172.21.15.53:0/3423654794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800c6c0 con 0x7f0e3814e9d0 2024-09-13T18:30:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e2dffb640 1 -- 172.21.15.53:0/3423654794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2800c820 con 0x7f0e3814e9d0 2024-09-13T18:30:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e380aafb0 con 0x7f0e3814e9d0 2024-09-13T18:30:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e2dffb640 1 -- 172.21.15.53:0/3423654794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800cbd0 con 0x7f0e3814e9d0 2024-09-13T18:30:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e380a9890 con 0x7f0e3814e9d0 2024-09-13T18:30:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e380ab1d0 con 0x7f0e3814e9d0 2024-09-13T18:30:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e2dffb640 1 -- 172.21.15.53:0/3423654794 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f0e2800cd30 con 0x7f0e3814e9d0 2024-09-13T18:30:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e2dffb640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0e1c0667b0 0x7f0e1c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e2dffb640 1 -- 172.21.15.53:0/3423654794 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f0e28084200 con 0x7f0e3814e9d0 2024-09-13T18:30:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.159+0000 7f0e3d7bc640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0e1c0667b0 0x7f0e1c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.163+0000 7f0e3d7bc640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0e1c0667b0 0x7f0e1c068c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009970 tx=0x7f0e34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.163+0000 7f0e2dffb640 1 -- 172.21.15.53:0/3423654794 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e28054fc0 con 0x7f0e3814e9d0 2024-09-13T18:30:13.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.359+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e380d19c0 con 0x7f0e3814e9d0 2024-09-13T18:30:13.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.359+0000 7f0e2dffb640 1 -- 172.21.15.53:0/3423654794 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3517 (secure 0 0 0) 0x7f0e28054b50 con 0x7f0e3814e9d0 2024-09-13T18:30:13.361 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:13.361 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/88553095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":88553095},{"type":"v1","addr":"172.21.15.87:6835","nonce":88553095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5693,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/1131867883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6836","nonce":1131867883},{"type":"v1","addr":"172.21.15.87:6837","nonce":1131867883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/973210828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":973210828},{"type":"v1","addr":"172.21.15.53:6833","nonce":973210828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/498039801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":498039801},{"type":"v1","addr":"172.21.15.53:6835","nonce":498039801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2024-09-13T18:30:13.362 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 42 2024-09-13T18:30:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.359+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0e1c0667b0 msgr2=0x7f0e1c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.359+0000 7f0e3fa20640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0e1c0667b0 0x7f0e1c068c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009970 tx=0x7f0e34008040 comp rx=0 tx=0).stop 2024-09-13T18:30:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.359+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e3814e9d0 msgr2=0x7f0e380abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.359+0000 7f0e3fa20640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e3814e9d0 0x7f0e380abf10 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001ca0 tx=0x7f0e2800eba0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 shutdown_connections 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0e1c0667b0 0x7f0e1c068c70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e3814ee30 0x7f0e380ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e3814e9d0 0x7f0e380abf10 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 --2- 172.21.15.53:0/3423654794 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e24004d10 0x7f0e380ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 >> 172.21.15.53:0/3423654794 conn(0x7f0e38065c80 msgr2=0x7f0e380b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 shutdown_connections 2024-09-13T18:30:13.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.363+0000 7f0e3fa20640 1 -- 172.21.15.53:0/3423654794 wait complete. 2024-09-13T18:30:13.380 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:30:13.381 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:30:13.381 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:30:13.381 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:13.381 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:30:13.381 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:30:13.381 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:30:13.382 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:13.382 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:30:13.382 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:30:13.382 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:30:13.382 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:13.382 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:30:13.382 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:30:13.383 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:30:13.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:13.391 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:30:13.391 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:30:13.394 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:30:13.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:30:13.395 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:30:13.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:30:13.396 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:30:13.396 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:30:13.436 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:30:13.436 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:13.437 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:30:13.437 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:13.441 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:30:13.441 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:13.442 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:30:13.442 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:13.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:30:13.500 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:30:13.505 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:30:13.512 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:30:13.514 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:30:13.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 Processor -- start 2024-09-13T18:30:13.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 -- start start 2024-09-13T18:30:13.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f60e815a440 0x7f60e80afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e80b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60e80ae660 0x7f60e80b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80aeb40 con 0x7f60e815a440 2024-09-13T18:30:13.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80aee20 con 0x7f60e80ae660 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60ed79b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80af100 con 0x7f60e815a820 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f60e815a440 0x7f60e80afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f60e815a440 0x7f60e80afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53444/0 (socket says 172.21.15.53:53444) 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 -- 172.21.15.53:0/1365419249 learned_addr learned my addr 172.21.15.53:0/1365419249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e67fc640 1 --2- 172.21.15.53:0/1365419249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e80b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e77fe640 1 --2- 172.21.15.53:0/1365419249 >> v2:172.21.15.87:3300/0 conn(0x7f60e80ae660 0x7f60e80b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 -- 172.21.15.53:0/1365419249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 msgr2=0x7f60e80b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 --2- 172.21.15.53:0/1365419249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e80b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 -- 172.21.15.53:0/1365419249 >> v2:172.21.15.87:3300/0 conn(0x7f60e80ae660 msgr2=0x7f60e80b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 --2- 172.21.15.53:0/1365419249 >> v2:172.21.15.87:3300/0 conn(0x7f60e80ae660 0x7f60e80b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.567+0000 7f60e6ffd640 1 -- 172.21.15.53:0/1365419249 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80af3e0 con 0x7f60e815a440 2024-09-13T18:30:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 --2- 172.21.15.53:0/1365419249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e815a440 0x7f60e80afc10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f60e80b5b60 tx=0x7f60d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f2f6aaaa753a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e5ffb640 1 -- 172.21.15.53:0/1365419249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80ab600 con 0x7f60e815a440 2024-09-13T18:30:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e5ffb640 1 -- 172.21.15.53:0/1365419249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d80a7050 con 0x7f60e815a440 2024-09-13T18:30:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e5ffb640 1 -- 172.21.15.53:0/1365419249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80ab980 con 0x7f60e815a440 2024-09-13T18:30:13.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- 172.21.15.53:0/1365419249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e815a440 msgr2=0x7f60e80afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 --2- 172.21.15.53:0/1365419249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e815a440 0x7f60e80afc10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f60e80b5b60 tx=0x7f60d801c460 comp rx=0 tx=0).stop 2024-09-13T18:30:13.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- 172.21.15.53:0/1365419249 shutdown_connections 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 --2- 172.21.15.53:0/1365419249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e80b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 --2- 172.21.15.53:0/1365419249 >> v2:172.21.15.87:3300/0 conn(0x7f60e80ae660 0x7f60e80b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 --2- 172.21.15.53:0/1365419249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e815a440 0x7f60e80afc10 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- 172.21.15.53:0/1365419249 >> 172.21.15.53:0/1365419249 conn(0x7f60e8071a50 msgr2=0x7f60e8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- 172.21.15.53:0/1365419249 shutdown_connections 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- 172.21.15.53:0/1365419249 wait complete. 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 Processor -- start 2024-09-13T18:30:13.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- start start 2024-09-13T18:30:13.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e80ae660 0x7f60e815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e815a440 0x7f60e814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e8155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8152120 con 0x7f60e80ae660 2024-09-13T18:30:13.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e815d020 con 0x7f60e815a440 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60ed79b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e815d300 con 0x7f60e815a820 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e80ae660 0x7f60e815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e80ae660 0x7f60e815db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53460/0 (socket says 172.21.15.53:53460) 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 -- 172.21.15.53:0/558961568 learned_addr learned my addr 172.21.15.53:0/558961568 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e77fe640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e8155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e67fc640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e815a440 0x7f60e814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 -- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 msgr2=0x7f60e8155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e8155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 -- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e815a440 msgr2=0x7f60e814cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e815a440 0x7f60e814cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e6ffd640 1 -- 172.21.15.53:0/558961568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d80094d0 con 0x7f60e80ae660 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.571+0000 7f60e77fe640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e8155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60e6ffd640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e80ae660 0x7f60e815db00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f60d80ae040 tx=0x7f60d8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:13.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60cf7fe640 1 -- 172.21.15.53:0/558961568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80b6670 con 0x7f60e80ae660 2024-09-13T18:30:13.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60cf7fe640 1 -- 172.21.15.53:0/558961568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d80b67f0 con 0x7f60e80ae660 2024-09-13T18:30:13.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e815d5e0 con 0x7f60e80ae660 2024-09-13T18:30:13.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60cf7fe640 1 -- 172.21.15.53:0/558961568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80b6ba0 con 0x7f60e80ae660 2024-09-13T18:30:13.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e814d1d0 con 0x7f60e80ae660 2024-09-13T18:30:13.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e806f6a0 con 0x7f60e80ae660 2024-09-13T18:30:13.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60cf7fe640 1 -- 172.21.15.53:0/558961568 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f60d80b2070 con 0x7f60e80ae660 2024-09-13T18:30:13.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60cf7fe640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f60d40667b0 0x7f60d4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:13.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60e67fc640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f60d40667b0 0x7f60d4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:13.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60cf7fe640 1 -- 172.21.15.53:0/558961568 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f60d811eb00 con 0x7f60e80ae660 2024-09-13T18:30:13.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.575+0000 7f60e67fc640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f60d40667b0 0x7f60d4068c70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60e80b2ff0 tx=0x7f60dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:13.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.579+0000 7f60cf7fe640 1 -- 172.21.15.53:0/558961568 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60d80ebd20 con 0x7f60e80ae660 2024-09-13T18:30:13.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:13.751+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f60e8159cc0 con 0x7f60e80ae660 2024-09-13T18:30:14.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.555+0000 7f60cf7fe640 1 -- 172.21.15.53:0/558961568 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) v1 ==== 97+0+0 (secure 0 0 0) 0x7f60d80b0020 con 0x7f60e80ae660 2024-09-13T18:30:14.557 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:30:14.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f60d40667b0 msgr2=0x7f60d4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f60d40667b0 0x7f60d4068c70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60e80b2ff0 tx=0x7f60dc008040 comp rx=0 tx=0).stop 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e80ae660 msgr2=0x7f60e815db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e80ae660 0x7f60e815db00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f60d80ae040 tx=0x7f60d8019200 comp rx=0 tx=0).stop 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 shutdown_connections 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f60d40667b0 0x7f60d4068c70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f60e815a820 0x7f60e8155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e815a440 0x7f60e814cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 --2- 172.21.15.53:0/558961568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e80ae660 0x7f60e815db00 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 >> 172.21.15.53:0/558961568 conn(0x7f60e8071a50 msgr2=0x7f60e8156700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 shutdown_connections 2024-09-13T18:30:14.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.559+0000 7f60ed79b640 1 -- 172.21.15.53:0/558961568 wait complete. 2024-09-13T18:30:14.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:30:14.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3599318640 1 Processor -- start 2024-09-13T18:30:14.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3599318640 1 -- start start 2024-09-13T18:30:14.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3599318640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 0x7f359415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3599318640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3594069f50 0x7f359406a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3599318640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940cd570 con 0x7f359415b990 2024-09-13T18:30:14.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3599318640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359406a940 con 0x7f3594069f50 2024-09-13T18:30:14.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3599318640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35940cd7b0 con 0x7f359415a630 2024-09-13T18:30:14.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f358bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f359415b990 0x7f35940cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47630/0 (socket says 172.21.15.53:47630) 2024-09-13T18:30:14.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f358bfff640 1 -- 172.21.15.53:0/1371421278 learned_addr learned my addr 172.21.15.53:0/1371421278 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428772037 0 0) 0x7f357c0012a0 con 0x7f359415b990 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35937fe640 1 --2- 172.21.15.53:0/1371421278 >> v2:172.21.15.87:3300/0 conn(0x7f3594069f50 0x7f359406a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 0x7f359415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3580003530 con 0x7f359415b990 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3861621984 0 0) 0x7f3580003530 con 0x7f359415b990 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 msgr2=0x7f359415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 0x7f359415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 >> v2:172.21.15.87:3300/0 conn(0x7f3594069f50 msgr2=0x7f359406a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 --2- 172.21.15.53:0/1371421278 >> v2:172.21.15.87:3300/0 conn(0x7f3594069f50 0x7f359406a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940cda90 con 0x7f359415b990 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f357c001990 con 0x7f359415b990 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 0x7f359415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 >> v1:172.21.15.53:6789/0 conn(0x7f359415b990 legacy=0x7f35940cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3580003980 0x7f3580003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 0x7f35800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3580004d10 0x7f3580005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359406a940 con 0x7f3580003980 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940cd7b0 con 0x7f3580004d10 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358000ba90 con 0x7f359415a630 2024-09-13T18:30:14.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3580003980 0x7f3580003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f35937fe640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3580004d10 0x7f3580005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f358bfff640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 0x7f35800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 -- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 msgr2=0x7f35800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:14.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f359415a630 0x7f35800047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 -- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3580004d10 msgr2=0x7f3580005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:14.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3580004d10 0x7f3580005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.707+0000 7f3592ffd640 1 -- 172.21.15.53:0/1371421278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3580003530 con 0x7f3580003980 2024-09-13T18:30:14.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3592ffd640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3580003980 0x7f3580003da0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f35840098d0 tx=0x7f358401c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b8608e42b63024 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:14.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840aa640 con 0x7f3580003980 2024-09-13T18:30:14.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35840aa7a0 con 0x7f3580003980 2024-09-13T18:30:14.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f35927fc640 1 -- 172.21.15.53:0/1371421278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840aab10 con 0x7f3580003980 2024-09-13T18:30:14.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- 172.21.15.53:0/1371421278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3580003980 msgr2=0x7f3580003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 --2- 172.21.15.53:0/1371421278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3580003980 0x7f3580003da0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f35840098d0 tx=0x7f358401c5a0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f35937fe640 1 -- 172.21.15.53:0/1371421278 reap_dead start 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- 172.21.15.53:0/1371421278 shutdown_connections 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- 172.21.15.53:0/1371421278 >> 172.21.15.53:0/1371421278 conn(0x7f35940b0a30 msgr2=0x7f35940b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- 172.21.15.53:0/1371421278 shutdown_connections 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- 172.21.15.53:0/1371421278 wait complete. 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 Processor -- start 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- start start 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3580003980 0x7f3594156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35941555e0 0x7f359409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359409c320 0x7f35940cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594156690 con 0x7f35941555e0 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594155d80 con 0x7f359409c320 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3599318640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359409c9a0 con 0x7f3580003980 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f358bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35941555e0 0x7f359409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f358bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35941555e0 0x7f359409bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53476/0 (socket says 172.21.15.53:53476) 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f358bfff640 1 -- 172.21.15.53:0/3894292785 learned_addr learned my addr 172.21.15.53:0/3894292785 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.711+0000 7f3592ffd640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3580003980 0x7f3594156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f35937fe640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359409c320 0x7f35940cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358bfff640 1 -- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3580003980 msgr2=0x7f3594156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358bfff640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3580003980 0x7f3594156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358bfff640 1 -- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359409c320 msgr2=0x7f35940cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358bfff640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359409c320 0x7f35940cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358bfff640 1 -- 172.21.15.53:0/3894292785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594155fd0 con 0x7f35941555e0 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358bfff640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35941555e0 0x7f359409bde0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f357c007fd0 tx=0x7f357c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358b7fe640 1 -- 172.21.15.53:0/3894292785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c007480 con 0x7f35941555e0 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358b7fe640 1 -- 172.21.15.53:0/3894292785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0075e0 con 0x7f35941555e0 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358b7fe640 1 -- 172.21.15.53:0/3894292785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c0059d0 con 0x7f35941555e0 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35941562b0 con 0x7f35941555e0 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359409a7d0 con 0x7f35941555e0 2024-09-13T18:30:14.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35941567d0 con 0x7f35941555e0 2024-09-13T18:30:14.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358b7fe640 1 -- 172.21.15.53:0/3894292785 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f357c005b30 con 0x7f35941555e0 2024-09-13T18:30:14.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358b7fe640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f35740667b0 0x7f3574068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:14.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f3592ffd640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f35740667b0 0x7f3574068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:14.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f358b7fe640 1 -- 172.21.15.53:0/3894292785 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f357c083ff0 con 0x7f35941555e0 2024-09-13T18:30:14.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.715+0000 7f3592ffd640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f35740667b0 0x7f3574068c70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f35840ae000 tx=0x7f35840b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:14.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.719+0000 7f358b7fe640 1 -- 172.21.15.53:0/3894292785 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f35941567d0 con 0x7f35941555e0 2024-09-13T18:30:14.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.939+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f35940cd570 con 0x7f35941555e0 2024-09-13T18:30:14.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.939+0000 7f358b7fe640 1 -- 172.21.15.53:0/3894292785 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f35940cd570 con 0x7f35941555e0 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.943 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:30:14.944 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.945 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:30:14.946 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.947 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:30:14.949 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.950 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:30:14.951 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.952 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.953 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:30:14.954 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.955 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:14.956 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:14.956 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f35740667b0 msgr2=0x7f3574068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f35740667b0 0x7f3574068c70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f35840ae000 tx=0x7f35840b5040 comp rx=0 tx=0).stop 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35941555e0 msgr2=0x7f359409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35941555e0 0x7f359409bde0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f357c007fd0 tx=0x7f357c00dc00 comp rx=0 tx=0).stop 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 shutdown_connections 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f35740667b0 0x7f3574068c70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359409c320 0x7f35940cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35941555e0 0x7f359409bde0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 --2- 172.21.15.53:0/3894292785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3580003980 0x7f3594156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 >> 172.21.15.53:0/3894292785 conn(0x7f35940b0a30 msgr2=0x7f359406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 shutdown_connections 2024-09-13T18:30:14.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:14.943+0000 7f3599318640 1 -- 172.21.15.53:0/3894292785 wait complete. 2024-09-13T18:30:14.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b5694d640 1 Processor -- start 2024-09-13T18:30:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b5694d640 1 -- start start 2024-09-13T18:30:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b5694d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b50157f50 0x7f8b50065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b5694d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b5006c470 0x7f8b500661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b5694d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5015b6d0 con 0x7f8b500cc400 2024-09-13T18:30:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b5694d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5015a910 con 0x7f8b50157f50 2024-09-13T18:30:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b5694d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500ccf60 con 0x7f8b5006c470 2024-09-13T18:30:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b50157f50 0x7f8b50065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8b50157f50 0x7f8b50065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53480/0 (socket says 172.21.15.53:53480) 2024-09-13T18:30:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4ffff640 1 -- 172.21.15.53:0/2235540805 learned_addr learned my addr 172.21.15.53:0/2235540805 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4f7fe640 1 --2- 172.21.15.53:0/2235540805 >> v2:172.21.15.87:3300/0 conn(0x7f8b5006c470 0x7f8b500661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4ffff640 1 -- 172.21.15.53:0/2235540805 >> v2:172.21.15.87:3300/0 conn(0x7f8b5006c470 msgr2=0x7f8b500661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4ffff640 1 --2- 172.21.15.53:0/2235540805 >> v2:172.21.15.87:3300/0 conn(0x7f8b5006c470 0x7f8b500661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4ffff640 1 -- 172.21.15.53:0/2235540805 >> v1:172.21.15.87:6789/0 conn(0x7f8b500cc400 legacy=0x7f8b500cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.075+0000 7f8b4ffff640 1 -- 172.21.15.53:0/2235540805 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5015ab00 con 0x7f8b50157f50 2024-09-13T18:30:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4ffff640 1 --2- 172.21.15.53:0/2235540805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b50157f50 0x7f8b50065c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8b500669f0 tx=0x7f8b4001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83229a869d40e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4effd640 1 -- 172.21.15.53:0/2235540805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400aa610 con 0x7f8b50157f50 2024-09-13T18:30:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4effd640 1 -- 172.21.15.53:0/2235540805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b400a6040 con 0x7f8b50157f50 2024-09-13T18:30:15.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4effd640 1 -- 172.21.15.53:0/2235540805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400aa990 con 0x7f8b50157f50 2024-09-13T18:30:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- 172.21.15.53:0/2235540805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b50157f50 msgr2=0x7f8b50065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 --2- 172.21.15.53:0/2235540805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b50157f50 0x7f8b50065c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8b500669f0 tx=0x7f8b4001c4b0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- 172.21.15.53:0/2235540805 shutdown_connections 2024-09-13T18:30:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 --2- 172.21.15.53:0/2235540805 >> v2:172.21.15.87:3300/0 conn(0x7f8b5006c470 0x7f8b500661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 --2- 172.21.15.53:0/2235540805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b50157f50 0x7f8b50065c80 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- 172.21.15.53:0/2235540805 >> 172.21.15.53:0/2235540805 conn(0x7f8b50073130 msgr2=0x7f8b50069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:15.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- 172.21.15.53:0/2235540805 shutdown_connections 2024-09-13T18:30:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- 172.21.15.53:0/2235540805 wait complete. 2024-09-13T18:30:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 Processor -- start 2024-09-13T18:30:15.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- start start 2024-09-13T18:30:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b5006c470 0x7f8b501f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b500cc400 0x7f8b500b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50157f50 0x7f8b500b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50156650 con 0x7f8b500cc400 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50156930 con 0x7f8b50157f50 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50156c10 con 0x7f8b5006c470 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b500cc400 0x7f8b500b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b500cc400 0x7f8b500b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53488/0 (socket says 172.21.15.53:53488) 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 -- 172.21.15.53:0/1521571666 learned_addr learned my addr 172.21.15.53:0/1521571666 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4ffff640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b5006c470 0x7f8b501f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b54eea640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50157f50 0x7f8b500b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 -- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b5006c470 msgr2=0x7f8b501f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b5006c470 0x7f8b501f8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 -- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50157f50 msgr2=0x7f8b500b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50157f50 0x7f8b500b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 -- 172.21.15.53:0/1521571666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b400094d0 con 0x7f8b500cc400 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b54eea640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50157f50 0x7f8b500b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4f7fe640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b500cc400 0x7f8b500b3560 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c7f0 tx=0x7f8b4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4cff9640 1 -- 172.21.15.53:0/1521571666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44004220 con 0x7f8b500cc400 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4cff9640 1 -- 172.21.15.53:0/1521571666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b440043a0 con 0x7f8b500cc400 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b50156ef0 con 0x7f8b500cc400 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b4cff9640 1 -- 172.21.15.53:0/1521571666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44004510 con 0x7f8b500cc400 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.079+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b501576f0 con 0x7f8b500cc400 2024-09-13T18:30:15.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.083+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50157410 con 0x7f8b500cc400 2024-09-13T18:30:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.083+0000 7f8b4cff9640 1 -- 172.21.15.53:0/1521571666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8b44003860 con 0x7f8b500cc400 2024-09-13T18:30:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.083+0000 7f8b4cff9640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8b3c0667b0 0x7f8b3c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.083+0000 7f8b4cff9640 1 -- 172.21.15.53:0/1521571666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8b44083e80 con 0x7f8b500cc400 2024-09-13T18:30:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.083+0000 7f8b4ffff640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8b3c0667b0 0x7f8b3c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.083+0000 7f8b4ffff640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8b3c0667b0 0x7f8b3c068c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b400ae000 tx=0x7f8b40008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.087+0000 7f8b4cff9640 1 -- 172.21.15.53:0/1521571666 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b44051320 con 0x7f8b500cc400 2024-09-13T18:30:15.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b50071220 con 0x7f8b500cc400 2024-09-13T18:30:15.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b4cff9640 1 -- 172.21.15.53:0/1521571666 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+12798 (secure 0 0 0) 0x7f8b44054940 con 0x7f8b500cc400 2024-09-13T18:30:15.252 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:15.252 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":83,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:14.546573+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:15.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8b3c0667b0 msgr2=0x7f8b3c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8b3c0667b0 0x7f8b3c068c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b400ae000 tx=0x7f8b40008040 comp rx=0 tx=0).stop 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b500cc400 msgr2=0x7f8b500b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b500cc400 0x7f8b500b3560 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c7f0 tx=0x7f8b4400ccb0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 shutdown_connections 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8b3c0667b0 0x7f8b3c068c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b50157f50 0x7f8b500b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b500cc400 0x7f8b500b3560 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 --2- 172.21.15.53:0/1521571666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8b5006c470 0x7f8b501f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 >> 172.21.15.53:0/1521571666 conn(0x7f8b50073130 msgr2=0x7f8b50154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 shutdown_connections 2024-09-13T18:30:15.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.251+0000 7f8b5694d640 1 -- 172.21.15.53:0/1521571666 wait complete. 2024-09-13T18:30:15.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:15.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c8826640 1 Processor -- start 2024-09-13T18:30:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c8826640 1 -- start start 2024-09-13T18:30:15.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c8826640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83c415c830 0x7f83c40d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c8826640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c40cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c8826640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c40b7db0 con 0x7f83c40d2c80 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c8826640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40d0650 con 0x7f83c415c830 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c8826640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40d0c10 con 0x7f83c40ccd10 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83c415c830 0x7f83c40d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83c415c830 0x7f83c40d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53496/0 (socket says 172.21.15.53:53496) 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c259c640 1 -- 172.21.15.53:0/1837588627 learned_addr learned my addr 172.21.15.53:0/1837588627 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c1d9b640 1 --2- 172.21.15.53:0/1837588627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c40cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c259c640 1 -- 172.21.15.53:0/1837588627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 msgr2=0x7f83c40cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c259c640 1 --2- 172.21.15.53:0/1837588627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c40cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.395+0000 7f83c259c640 1 -- 172.21.15.53:0/1837588627 >> v1:172.21.15.87:6789/0 conn(0x7f83c40d2c80 legacy=0x7f83c40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c259c640 1 -- 172.21.15.53:0/1837588627 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40cd7d0 con 0x7f83c415c830 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c259c640 1 --2- 172.21.15.53:0/1837588627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c40d10a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009870 tx=0x7f83b401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cce39bafb567cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c159a640 1 -- 172.21.15.53:0/1837588627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40ad660 con 0x7f83c415c830 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c159a640 1 -- 172.21.15.53:0/1837588627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b40ad7c0 con 0x7f83c415c830 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c159a640 1 -- 172.21.15.53:0/1837588627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40adb50 con 0x7f83c415c830 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 -- 172.21.15.53:0/1837588627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 msgr2=0x7f83c40d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 --2- 172.21.15.53:0/1837588627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c40d10a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009870 tx=0x7f83b401c560 comp rx=0 tx=0).stop 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 -- 172.21.15.53:0/1837588627 shutdown_connections 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 --2- 172.21.15.53:0/1837588627 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c40cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 --2- 172.21.15.53:0/1837588627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c40d10a0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 -- 172.21.15.53:0/1837588627 >> 172.21.15.53:0/1837588627 conn(0x7f83c4070970 msgr2=0x7f83c4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 -- 172.21.15.53:0/1837588627 shutdown_connections 2024-09-13T18:30:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.399+0000 7f83c8826640 1 -- 172.21.15.53:0/1837588627 wait complete. 2024-09-13T18:30:15.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 Processor -- start 2024-09-13T18:30:15.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 -- start start 2024-09-13T18:30:15.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c4150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c40d2c80 0x7f83c414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c4152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4152300 con 0x7f83c415c830 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c41528c0 con 0x7f83c40d2c80 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40ca8c0 con 0x7f83c40ccd10 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c4152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c4152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53500/0 (socket says 172.21.15.53:53500) 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 -- 172.21.15.53:0/498611134 learned_addr learned my addr 172.21.15.53:0/498611134 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c259c640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c4150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c1d9b640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c40d2c80 0x7f83c414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 -- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 msgr2=0x7f83c4150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c4150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 -- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c40d2c80 msgr2=0x7f83c414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c40d2c80 0x7f83c414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 -- 172.21.15.53:0/498611134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b40094d0 con 0x7f83c415c830 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c259c640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c4150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c1d9b640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c40d2c80 0x7f83c414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c2d9d640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c4152ce0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c730 tx=0x7f83bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83b2ffd640 1 -- 172.21.15.53:0/498611134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc003b80 con 0x7f83c415c830 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83b2ffd640 1 -- 172.21.15.53:0/498611134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc003ce0 con 0x7f83c415c830 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c40ca340 con 0x7f83c415c830 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83b2ffd640 1 -- 172.21.15.53:0/498611134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00aa30 con 0x7f83c415c830 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c40ca5e0 con 0x7f83c415c830 2024-09-13T18:30:15.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.403+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c4152a00 con 0x7f83c415c830 2024-09-13T18:30:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.407+0000 7f83b2ffd640 1 -- 172.21.15.53:0/498611134 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f83bc00ab90 con 0x7f83c415c830 2024-09-13T18:30:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.407+0000 7f83b2ffd640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83a40667b0 0x7f83a4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.407+0000 7f83b2ffd640 1 -- 172.21.15.53:0/498611134 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f83bc083d20 con 0x7f83c415c830 2024-09-13T18:30:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.407+0000 7f83c259c640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83a40667b0 0x7f83a4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.407+0000 7f83c259c640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83a40667b0 0x7f83a4068c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83b40af000 tx=0x7f83b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.411+0000 7f83b2ffd640 1 -- 172.21.15.53:0/498611134 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83c4152a00 con 0x7f83c415c830 2024-09-13T18:30:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.567+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83c4152a00 con 0x7f83c415c830 2024-09-13T18:30:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.567+0000 7f83b2ffd640 1 -- 172.21.15.53:0/498611134 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83c4152a00 con 0x7f83c415c830 2024-09-13T18:30:15.570 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83a40667b0 msgr2=0x7f83a4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83a40667b0 0x7f83a4068c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83b40af000 tx=0x7f83b4008040 comp rx=0 tx=0).stop 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 msgr2=0x7f83c4152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c4152ce0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c730 tx=0x7f83bc00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 shutdown_connections 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83a40667b0 0x7f83a4068c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83c415c830 0x7f83c4152ce0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83c40d2c80 0x7f83c414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 --2- 172.21.15.53:0/498611134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83c40ccd10 0x7f83c4150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 >> 172.21.15.53:0/498611134 conn(0x7f83c4070970 msgr2=0x7f83c40b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 shutdown_connections 2024-09-13T18:30:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.571+0000 7f83c8826640 1 -- 172.21.15.53:0/498611134 wait complete. 2024-09-13T18:30:15.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:30:15.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.695+0000 7feb22ef9640 1 Processor -- start 2024-09-13T18:30:15.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.695+0000 7feb22ef9640 1 -- start start 2024-09-13T18:30:15.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb22ef9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb1c06b850 0x7feb1c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb22ef9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb1c0cbd60 0x7feb1c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb22ef9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0b1ac0 con 0x7feb1c0cb980 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb22ef9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c0b3010 con 0x7feb1c06b850 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb22ef9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c159ac0 con 0x7feb1c0cbd60 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb1c06b850 0x7feb1c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feb1c06b850 0x7feb1c0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53506/0 (socket says 172.21.15.53:53506) 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 -- 172.21.15.53:0/3120501981 learned_addr learned my addr 172.21.15.53:0/3120501981 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 -- 172.21.15.53:0/3120501981 >> v2:172.21.15.87:3300/0 conn(0x7feb1c0cbd60 msgr2=0x7feb1c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb21496640 1 --2- 172.21.15.53:0/3120501981 >> v2:172.21.15.87:3300/0 conn(0x7feb1c0cbd60 0x7feb1c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 --2- 172.21.15.53:0/3120501981 >> v2:172.21.15.87:3300/0 conn(0x7feb1c0cbd60 0x7feb1c0cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 -- 172.21.15.53:0/3120501981 >> v1:172.21.15.87:6789/0 conn(0x7feb1c0cb980 legacy=0x7feb1c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 -- 172.21.15.53:0/3120501981 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c159da0 con 0x7feb1c06b850 2024-09-13T18:30:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1bfff640 1 --2- 172.21.15.53:0/3120501981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c06b850 0x7feb1c0b33b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0709a0 tx=0x7feb1001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae42704e5eaf6221 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1b7fe640 1 -- 172.21.15.53:0/3120501981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100ab600 con 0x7feb1c06b850 2024-09-13T18:30:15.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1b7fe640 1 -- 172.21.15.53:0/3120501981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb100a7050 con 0x7feb1c06b850 2024-09-13T18:30:15.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.699+0000 7feb1b7fe640 1 -- 172.21.15.53:0/3120501981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100ab980 con 0x7feb1c06b850 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- 172.21.15.53:0/3120501981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c06b850 msgr2=0x7feb1c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 --2- 172.21.15.53:0/3120501981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c06b850 0x7feb1c0b33b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0709a0 tx=0x7feb1001c370 comp rx=0 tx=0).stop 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- 172.21.15.53:0/3120501981 shutdown_connections 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 --2- 172.21.15.53:0/3120501981 >> v2:172.21.15.87:3300/0 conn(0x7feb1c0cbd60 0x7feb1c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 --2- 172.21.15.53:0/3120501981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c06b850 0x7feb1c0b33b0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- 172.21.15.53:0/3120501981 >> 172.21.15.53:0/3120501981 conn(0x7feb1c065c80 msgr2=0x7feb1c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- 172.21.15.53:0/3120501981 shutdown_connections 2024-09-13T18:30:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- 172.21.15.53:0/3120501981 wait complete. 2024-09-13T18:30:15.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 Processor -- start 2024-09-13T18:30:15.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- start start 2024-09-13T18:30:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb1c06b850 0x7feb1c13eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb1c0cb980 0x7feb1c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c0cbd60 0x7feb1c1f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c14be20 con 0x7feb1c0cbd60 2024-09-13T18:30:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c14cc80 con 0x7feb1c0cb980 2024-09-13T18:30:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb22ef9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c14c070 con 0x7feb1c06b850 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c0cbd60 0x7feb1c1f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c0cbd60 0x7feb1c1f51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53514/0 (socket says 172.21.15.53:53514) 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 -- 172.21.15.53:0/1202522000 learned_addr learned my addr 172.21.15.53:0/1202522000 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb1bfff640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb1c0cb980 0x7feb1c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb20c95640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb1c06b850 0x7feb1c13eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 -- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb1c06b850 msgr2=0x7feb1c13eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb1c06b850 0x7feb1c13eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 -- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb1c0cb980 msgr2=0x7feb1c153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb1c0cb980 0x7feb1c153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 -- 172.21.15.53:0/1202522000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb100094d0 con 0x7feb1c0cbd60 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb1bfff640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb1c0cb980 0x7feb1c153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb20c95640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb1c06b850 0x7feb1c13eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.703+0000 7feb21496640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c0cbd60 0x7feb1c1f51d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7feb1400cda0 tx=0x7feb1400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb197fa640 1 -- 172.21.15.53:0/1202522000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14003ba0 con 0x7feb1c0cbd60 2024-09-13T18:30:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb197fa640 1 -- 172.21.15.53:0/1202522000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14003d00 con 0x7feb1c0cbd60 2024-09-13T18:30:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb197fa640 1 -- 172.21.15.53:0/1202522000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14004240 con 0x7feb1c0cbd60 2024-09-13T18:30:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c14c350 con 0x7feb1c0cbd60 2024-09-13T18:30:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c14c910 con 0x7feb1c0cbd60 2024-09-13T18:30:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c067400 con 0x7feb1c0cbd60 2024-09-13T18:30:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb197fa640 1 -- 172.21.15.53:0/1202522000 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7feb140043a0 con 0x7feb1c0cbd60 2024-09-13T18:30:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb197fa640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feb080667b0 0x7feb08068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb197fa640 1 -- 172.21.15.53:0/1202522000 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb14012070 con 0x7feb1c0cbd60 2024-09-13T18:30:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb20c95640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feb080667b0 0x7feb08068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.707+0000 7feb20c95640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feb080667b0 0x7feb08068c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb0c003ec0 tx=0x7feb0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:15.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.711+0000 7feb197fa640 1 -- 172.21.15.53:0/1202522000 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb14051f40 con 0x7feb1c0cbd60 2024-09-13T18:30:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.867+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feb1c0b2ba0 con 0x7feb1c0cbd60 2024-09-13T18:30:15.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.867+0000 7feb197fa640 1 -- 172.21.15.53:0/1202522000 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) v1 ==== 84+0+65 (secure 0 0 0) 0x7feb14055560 con 0x7feb1c0cbd60 2024-09-13T18:30:15.869 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:15.869 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:30:15.869 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:15.869 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:30:15.869 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:30:15.869 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:15.870 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:30:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feb080667b0 msgr2=0x7feb08068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feb080667b0 0x7feb08068c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb0c003ec0 tx=0x7feb0c009040 comp rx=0 tx=0).stop 2024-09-13T18:30:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c0cbd60 msgr2=0x7feb1c1f51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c0cbd60 0x7feb1c1f51d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7feb1400cda0 tx=0x7feb1400a660 comp rx=0 tx=0).stop 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 shutdown_connections 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feb080667b0 0x7feb08068c70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c0cbd60 0x7feb1c1f51d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb1c0cb980 0x7feb1c153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 --2- 172.21.15.53:0/1202522000 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb1c06b850 0x7feb1c13eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 >> 172.21.15.53:0/1202522000 conn(0x7feb1c065c80 msgr2=0x7feb1c0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 shutdown_connections 2024-09-13T18:30:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:15.871+0000 7feb22ef9640 1 -- 172.21.15.53:0/1202522000 wait complete. 2024-09-13T18:30:15.887 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:30:15.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:30:16.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79aaae640 1 Processor -- start 2024-09-13T18:30:16.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79aaae640 1 -- start start 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79aaae640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff79415a270 0x7ff79415d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79aaae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff794066390 0x7ff79415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79aaae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79415da80 con 0x7ff7940b4270 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79aaae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7940b2f30 con 0x7ff794066390 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79aaae640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7940b31d0 con 0x7ff79415a270 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79904b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff794066390 0x7ff79415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79904b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff794066390 0x7ff79415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53520/0 (socket says 172.21.15.53:53520) 2024-09-13T18:30:16.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79904b640 1 -- 172.21.15.53:0/2799267448 learned_addr learned my addr 172.21.15.53:0/2799267448 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.003+0000 7ff79884a640 1 --2- 172.21.15.53:0/2799267448 >> v2:172.21.15.87:3300/0 conn(0x7ff79415a270 0x7ff79415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79904b640 1 -- 172.21.15.53:0/2799267448 >> v2:172.21.15.87:3300/0 conn(0x7ff79415a270 msgr2=0x7ff79415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79904b640 1 --2- 172.21.15.53:0/2799267448 >> v2:172.21.15.87:3300/0 conn(0x7ff79415a270 0x7ff79415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79904b640 1 -- 172.21.15.53:0/2799267448 >> v1:172.21.15.53:6789/0 conn(0x7ff7940b4270 legacy=0x7ff794065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff78b7fe640 1 -- 172.21.15.53:0/2799267448 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848419435 0 0) 0x7ff79415da80 con 0x7ff7940b4270 2024-09-13T18:30:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79904b640 1 -- 172.21.15.53:0/2799267448 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940b34b0 con 0x7ff794066390 2024-09-13T18:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79904b640 1 --2- 172.21.15.53:0/2799267448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415dc80 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff794066960 tx=0x7ff78c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4944238b0c2b04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff78b7fe640 1 -- 172.21.15.53:0/2799267448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0aa5f0 con 0x7ff794066390 2024-09-13T18:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff78b7fe640 1 -- 172.21.15.53:0/2799267448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c0aa750 con 0x7ff794066390 2024-09-13T18:30:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff78b7fe640 1 -- 172.21.15.53:0/2799267448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0aaae0 con 0x7ff794066390 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 -- 172.21.15.53:0/2799267448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 msgr2=0x7ff79415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 --2- 172.21.15.53:0/2799267448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415dc80 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ff794066960 tx=0x7ff78c01c490 comp rx=0 tx=0).stop 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 -- 172.21.15.53:0/2799267448 shutdown_connections 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 --2- 172.21.15.53:0/2799267448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415dc80 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 --2- 172.21.15.53:0/2799267448 >> v2:172.21.15.87:3300/0 conn(0x7ff79415a270 0x7ff79415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 -- 172.21.15.53:0/2799267448 >> 172.21.15.53:0/2799267448 conn(0x7ff7940b1680 msgr2=0x7ff7940b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 -- 172.21.15.53:0/2799267448 shutdown_connections 2024-09-13T18:30:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.007+0000 7ff79aaae640 1 -- 172.21.15.53:0/2799267448 wait complete. 2024-09-13T18:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 Processor -- start 2024-09-13T18:30:16.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 -- start start 2024-09-13T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940b4270 0x7ff794150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff79415a270 0x7ff7941479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79415ac20 con 0x7ff794066390 2024-09-13T18:30:16.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940b04c0 con 0x7ff7940b4270 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79415c540 con 0x7ff79415a270 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53524/0 (socket says 172.21.15.53:53524) 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 -- 172.21.15.53:0/3102894360 learned_addr learned my addr 172.21.15.53:0/3102894360 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff78bfff640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940b4270 0x7ff794150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 -- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff79415a270 msgr2=0x7ff7941479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79904b640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff79415a270 0x7ff7941479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff79415a270 0x7ff7941479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 -- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940b4270 msgr2=0x7ff794150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940b4270 0x7ff794150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 -- 172.21.15.53:0/3102894360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c0094d0 con 0x7ff794066390 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff78bfff640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940b4270 0x7ff794150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:16.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79884a640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415a6e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ff790007e40 tx=0x7ff79000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:16.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff7897fa640 1 -- 172.21.15.53:0/3102894360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790014620 con 0x7ff794066390 2024-09-13T18:30:16.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff7897fa640 1 -- 172.21.15.53:0/3102894360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79000ee90 con 0x7ff794066390 2024-09-13T18:30:16.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff7897fa640 1 -- 172.21.15.53:0/3102894360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900149c0 con 0x7ff794066390 2024-09-13T18:30:16.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7940b0760 con 0x7ff794066390 2024-09-13T18:30:16.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79415c820 con 0x7ff794066390 2024-09-13T18:30:16.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7940b4670 con 0x7ff794066390 2024-09-13T18:30:16.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff7897fa640 1 -- 172.21.15.53:0/3102894360 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7ff790014b20 con 0x7ff794066390 2024-09-13T18:30:16.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff7897fa640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7800667e0 0x7ff780068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff78bfff640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7800667e0 0x7ff780068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.011+0000 7ff7897fa640 1 -- 172.21.15.53:0/3102894360 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff790084920 con 0x7ff794066390 2024-09-13T18:30:16.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.015+0000 7ff78bfff640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7800667e0 0x7ff780068ca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff79414de70 tx=0x7ff784009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:16.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.015+0000 7ff7897fa640 1 -- 172.21.15.53:0/3102894360 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff7940b4670 con 0x7ff794066390 2024-09-13T18:30:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.167+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff7940b4670 con 0x7ff794066390 2024-09-13T18:30:16.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.427+0000 7ff7897fa640 1 -- 172.21.15.53:0/3102894360 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff7940b4670 con 0x7ff794066390 2024-09-13T18:30:16.427 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:30:16.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7800667e0 msgr2=0x7ff780068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7800667e0 0x7ff780068ca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff79414de70 tx=0x7ff784009040 comp rx=0 tx=0).stop 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 msgr2=0x7ff79415a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415a6e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ff790007e40 tx=0x7ff79000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 shutdown_connections 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7800667e0 0x7ff780068ca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff79415a270 0x7ff7941479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7940b4270 0x7ff794150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 --2- 172.21.15.53:0/3102894360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff794066390 0x7ff79415a6e0 secure :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ff790007e40 tx=0x7ff79000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.431+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 >> 172.21.15.53:0/3102894360 conn(0x7ff7940b1680 msgr2=0x7ff7940adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.435+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 shutdown_connections 2024-09-13T18:30:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.435+0000 7ff79aaae640 1 -- 172.21.15.53:0/3102894360 wait complete. 2024-09-13T18:30:16.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:30:16.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.579+0000 7f2a847e7640 1 Processor -- start 2024-09-13T18:30:16.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.579+0000 7f2a847e7640 1 -- start start 2024-09-13T18:30:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a847e7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a7c143e80 0x7f2a7c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a847e7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a847e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a7c0cd320 0x7f2a7c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a847e7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c06f7a0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a847e7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c06fd60 con 0x7f2a7c143e80 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a847e7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0cb960 con 0x7f2a7c0caee0 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a7c0cd320 0x7f2a7c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a7c0cd320 0x7f2a7c0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58718/0 (socket says 172.21.15.53:58718) 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 -- 172.21.15.53:0/2507638966 learned_addr learned my addr 172.21.15.53:0/2507638966 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a81d82640 1 --2- 172.21.15.53:0/2507638966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82583640 1 --2- 172.21.15.53:0/2507638966 >> v2:172.21.15.87:3300/0 conn(0x7f2a7c143e80 0x7f2a7c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 -- 172.21.15.53:0/2507638966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 msgr2=0x7f2a7c0cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 --2- 172.21.15.53:0/2507638966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c0cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 -- 172.21.15.53:0/2507638966 >> v2:172.21.15.87:3300/0 conn(0x7f2a7c143e80 msgr2=0x7f2a7c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 --2- 172.21.15.53:0/2507638966 >> v2:172.21.15.87:3300/0 conn(0x7f2a7c143e80 0x7f2a7c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 -- 172.21.15.53:0/2507638966 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0cbc40 con 0x7f2a7c0cd320 2024-09-13T18:30:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a82d84640 1 --2- 172.21.15.53:0/2507638966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c0cd7b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0676d0 tx=0x7f2a7401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bbcc2ed7c6d292 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a81581640 1 -- 172.21.15.53:0/2507638966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740ab620 con 0x7f2a7c0cd320 2024-09-13T18:30:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a81581640 1 -- 172.21.15.53:0/2507638966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740ab780 con 0x7f2a7c0cd320 2024-09-13T18:30:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.583+0000 7f2a81581640 1 -- 172.21.15.53:0/2507638966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740abb10 con 0x7f2a7c0cd320 2024-09-13T18:30:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- 172.21.15.53:0/2507638966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 msgr2=0x7f2a7c0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 --2- 172.21.15.53:0/2507638966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c0cd7b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0676d0 tx=0x7f2a7401c460 comp rx=0 tx=0).stop 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- 172.21.15.53:0/2507638966 shutdown_connections 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 --2- 172.21.15.53:0/2507638966 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 --2- 172.21.15.53:0/2507638966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c0cd7b0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 --2- 172.21.15.53:0/2507638966 >> v2:172.21.15.87:3300/0 conn(0x7f2a7c143e80 0x7f2a7c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- 172.21.15.53:0/2507638966 >> 172.21.15.53:0/2507638966 conn(0x7f2a7c065c80 msgr2=0x7f2a7c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- 172.21.15.53:0/2507638966 shutdown_connections 2024-09-13T18:30:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- 172.21.15.53:0/2507638966 wait complete. 2024-09-13T18:30:16.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 Processor -- start 2024-09-13T18:30:16.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- start start 2024-09-13T18:30:16.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c13d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7c143e80 0x7f2a7c13c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c13dd90 con 0x7f2a7c0cd320 2024-09-13T18:30:16.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c154de0 con 0x7f2a7c143e80 2024-09-13T18:30:16.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a847e7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1f5a10 con 0x7f2a7c0caee0 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c1f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58722/0 (socket says 172.21.15.53:58722) 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 -- 172.21.15.53:0/1758043382 learned_addr learned my addr 172.21.15.53:0/1758043382 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a82d84640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7c143e80 0x7f2a7c13c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a82583640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c13d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 -- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 msgr2=0x7f2a7c13d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c13d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 -- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7c143e80 msgr2=0x7f2a7c13c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7c143e80 0x7f2a7c13c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 -- 172.21.15.53:0/1758043382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a740094d0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a82583640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c13d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:16.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.587+0000 7f2a81d82640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c1f49b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00d830 tx=0x7f2a6c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:16.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a72ffd640 1 -- 172.21.15.53:0/1758043382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c00be10 con 0x7f2a7c0cd320 2024-09-13T18:30:16.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a72ffd640 1 -- 172.21.15.53:0/1758043382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c0098b0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c1f4ef0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a72ffd640 1 -- 172.21.15.53:0/1758043382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c009a40 con 0x7f2a7c0cd320 2024-09-13T18:30:16.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c1f5450 con 0x7f2a7c0cd320 2024-09-13T18:30:16.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c0709e0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a72ffd640 1 -- 172.21.15.53:0/1758043382 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f2a6c009ba0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a72ffd640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a600667b0 0x7f2a60068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:16.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a72ffd640 1 -- 172.21.15.53:0/1758043382 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2a6c0844a0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a82583640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a600667b0 0x7f2a60068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:16.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.591+0000 7f2a82583640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a600667b0 0x7f2a60068c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2a78003fd0 tx=0x7f2a780039e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:16.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.595+0000 7f2a72ffd640 1 -- 172.21.15.53:0/1758043382 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a6c0518e0 con 0x7f2a7c0cd320 2024-09-13T18:30:16.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:16.755+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2a7c0742d0 con 0x7f2a7c0cd320 2024-09-13T18:30:17.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.431+0000 7f2a72ffd640 1 -- 172.21.15.53:0/1758043382 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2a6c00b3a0 con 0x7f2a7c0cd320 2024-09-13T18:30:17.435 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:30:17.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.439+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a600667b0 msgr2=0x7f2a60068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.439+0000 7f2a847e7640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a600667b0 0x7f2a60068c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2a78003fd0 tx=0x7f2a780039e0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.439+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 msgr2=0x7f2a7c1f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.439+0000 7f2a847e7640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c1f49b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00d830 tx=0x7f2a6c00dcf0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 shutdown_connections 2024-09-13T18:30:17.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a600667b0 0x7f2a60068c70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7c143e80 0x7f2a7c13c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a7c0cd320 0x7f2a7c1f49b0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 --2- 172.21.15.53:0/1758043382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7c0caee0 0x7f2a7c13d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 >> 172.21.15.53:0/1758043382 conn(0x7f2a7c065c80 msgr2=0x7f2a7c0af450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:17.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 shutdown_connections 2024-09-13T18:30:17.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.447+0000 7f2a847e7640 1 -- 172.21.15.53:0/1758043382 wait complete. 2024-09-13T18:30:17.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:30:17.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4966dcb640 1 Processor -- start 2024-09-13T18:30:17.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4966dcb640 1 -- start start 2024-09-13T18:30:17.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4966dcb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f496015b470 0x7f49600abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4966dcb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496006c980 con 0x7f4960154a50 2024-09-13T18:30:17.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4966dcb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496006bd70 con 0x7f49600ac2e0 2024-09-13T18:30:17.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4966dcb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49600ac770 con 0x7f496015b470 2024-09-13T18:30:17.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f495ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f496015b470 0x7f49600abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4964b67640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4960154a50 0x7f496006ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60300/0 (socket says 172.21.15.53:60300) 2024-09-13T18:30:17.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f4964b67640 1 -- 172.21.15.53:0/3256726281 learned_addr learned my addr 172.21.15.53:0/3256726281 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:17.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f495ffff640 1 -- 172.21.15.53:0/3256726281 >> v1:172.21.15.87:6789/0 conn(0x7f49600ac2e0 legacy=0x7f49600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:17.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f495ffff640 1 -- 172.21.15.53:0/3256726281 >> v1:172.21.15.53:6789/0 conn(0x7f4960154a50 legacy=0x7f496006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f495f7fe640 1 -- 172.21.15.53:0/3256726281 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573634061 0 0) 0x7f496006c980 con 0x7f4960154a50 2024-09-13T18:30:17.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.607+0000 7f495ffff640 1 -- 172.21.15.53:0/3256726281 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496006c050 con 0x7f496015b470 2024-09-13T18:30:17.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f495ffff640 1 --2- 172.21.15.53:0/3256726281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496015b470 0x7f49600abda0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f49480097c0 tx=0x7f494801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bd9c597dd2a9d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:17.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f495f7fe640 1 -- 172.21.15.53:0/3256726281 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480a7070 con 0x7f496015b470 2024-09-13T18:30:17.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f495f7fe640 1 -- 172.21.15.53:0/3256726281 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480ab430 con 0x7f496015b470 2024-09-13T18:30:17.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f495f7fe640 1 -- 172.21.15.53:0/3256726281 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480ab7c0 con 0x7f496015b470 2024-09-13T18:30:17.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 -- 172.21.15.53:0/3256726281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496015b470 msgr2=0x7f49600abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 --2- 172.21.15.53:0/3256726281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496015b470 0x7f49600abda0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f49480097c0 tx=0x7f494801c430 comp rx=0 tx=0).stop 2024-09-13T18:30:17.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 -- 172.21.15.53:0/3256726281 shutdown_connections 2024-09-13T18:30:17.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 --2- 172.21.15.53:0/3256726281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496015b470 0x7f49600abda0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 -- 172.21.15.53:0/3256726281 >> 172.21.15.53:0/3256726281 conn(0x7f4960069f50 msgr2=0x7f496006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:17.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 -- 172.21.15.53:0/3256726281 shutdown_connections 2024-09-13T18:30:17.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 -- 172.21.15.53:0/3256726281 wait complete. 2024-09-13T18:30:17.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 Processor -- start 2024-09-13T18:30:17.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.611+0000 7f4966dcb640 1 -- start start 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49600ac2e0 0x7f49601431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4960154a50 0x7f49600b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f496015b470 0x7f4960154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4960143a40 con 0x7f4960154a50 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4960157970 con 0x7f49600ac2e0 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cb140 con 0x7f496015b470 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4960154a50 0x7f49600b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4960154a50 0x7f49600b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58732/0 (socket says 172.21.15.53:58732) 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 -- 172.21.15.53:0/736095302 learned_addr learned my addr 172.21.15.53:0/736095302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4964b67640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49600ac2e0 0x7f49601431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4965368640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f496015b470 0x7f4960154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 -- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f496015b470 msgr2=0x7f4960154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f496015b470 0x7f4960154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 -- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49600ac2e0 msgr2=0x7f49601431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49600ac2e0 0x7f49601431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 -- 172.21.15.53:0/736095302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4948009420 con 0x7f4960154a50 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495ffff640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4960154a50 0x7f49600b11d0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f4948019040 tx=0x7f49480191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495d7fa640 1 -- 172.21.15.53:0/736095302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480bf450 con 0x7f4960154a50 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495d7fa640 1 -- 172.21.15.53:0/736095302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480bf5d0 con 0x7f4960154a50 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4960157040 con 0x7f4960154a50 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f495d7fa640 1 -- 172.21.15.53:0/736095302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49480bf980 con 0x7f4960154a50 2024-09-13T18:30:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4960157600 con 0x7f4960154a50 2024-09-13T18:30:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.615+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496006cdf0 con 0x7f4960154a50 2024-09-13T18:30:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.619+0000 7f495d7fa640 1 -- 172.21.15.53:0/736095302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f49480c9480 con 0x7f4960154a50 2024-09-13T18:30:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.619+0000 7f495d7fa640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f49400667e0 0x7f4940068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.619+0000 7f495d7fa640 1 -- 172.21.15.53:0/736095302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f494811ef70 con 0x7f4960154a50 2024-09-13T18:30:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.619+0000 7f4964b67640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f49400667e0 0x7f4940068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.619+0000 7f4964b67640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f49400667e0 0x7f4940068ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4950000f70 tx=0x7f4950007b80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:17.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.623+0000 7f495d7fa640 1 -- 172.21.15.53:0/736095302 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49480ec100 con 0x7f4960154a50 2024-09-13T18:30:17.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.819+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f496015ac50 con 0x7f4960154a50 2024-09-13T18:30:17.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.831+0000 7f495d7fa640 1 -- 172.21.15.53:0/736095302 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f49480c40c0 con 0x7f4960154a50 2024-09-13T18:30:17.834 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 12 and data pool 13 2024-09-13T18:30:17.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f49400667e0 msgr2=0x7f4940068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f49400667e0 0x7f4940068ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4950000f70 tx=0x7f4950007b80 comp rx=0 tx=0).stop 2024-09-13T18:30:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4960154a50 msgr2=0x7f49600b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4960154a50 0x7f49600b11d0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f4948019040 tx=0x7f49480191d0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 shutdown_connections 2024-09-13T18:30:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f49400667e0 0x7f4940068ca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f496015b470 0x7f4960154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4960154a50 0x7f49600b11d0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 --2- 172.21.15.53:0/736095302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49600ac2e0 0x7f49601431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 >> 172.21.15.53:0/736095302 conn(0x7f4960069f50 msgr2=0x7f49600af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 shutdown_connections 2024-09-13T18:30:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.843+0000 7f4966dcb640 1 -- 172.21.15.53:0/736095302 wait complete. 2024-09-13T18:30:17.874 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:17.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e29f2640 1 Processor -- start 2024-09-13T18:30:17.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e29f2640 1 -- start start 2024-09-13T18:30:17.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e29f2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66dc0cf7d0 0x7f66dc0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e29f2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0d2400 con 0x7f66dc0d19c0 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e29f2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0d1530 con 0x7f66dc15cab0 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e29f2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc0cddd0 con 0x7f66dc0cf7d0 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66dc0d19c0 0x7f66dc0cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60314/0 (socket says 172.21.15.53:60314) 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 -- 172.21.15.53:0/3204451718 learned_addr learned my addr 172.21.15.53:0/3204451718 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e0f8f640 1 --2- 172.21.15.53:0/3204451718 >> v2:172.21.15.87:3300/0 conn(0x7f66dc0cf7d0 0x7f66dc0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198545680 0 0) 0x7f66dc0d2400 con 0x7f66dc0d19c0 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c4003530 con 0x7f66dc0d19c0 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772137881 0 0) 0x7f66c4003530 con 0x7f66dc0d19c0 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 >> v2:172.21.15.87:3300/0 conn(0x7f66dc0cf7d0 msgr2=0x7f66dc0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 --2- 172.21.15.53:0/3204451718 >> v2:172.21.15.87:3300/0 conn(0x7f66dc0cf7d0 0x7f66dc0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 >> v1:172.21.15.87:6789/0 conn(0x7f66dc15cab0 legacy=0x7f66dc0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0d1e30 con 0x7f66dc0d19c0 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f66d0001680 con 0x7f66dc0d19c0 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 >> v1:172.21.15.53:6789/0 conn(0x7f66dc0d19c0 legacy=0x7f66dc0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c4003980 0x7f66c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c40047d0 0x7f66c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c4005190 0x7f66c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0cddd0 con 0x7f66c40047d0 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c400c030 con 0x7f66c4005190 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c400c1f0 con 0x7f66c4003980 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c40047d0 0x7f66c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e0f8f640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c4005190 0x7f66c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66dbfff640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c4003980 0x7f66c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 -- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c4003980 msgr2=0x7f66c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:17.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c4003980 0x7f66c4003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 -- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c4005190 msgr2=0x7f66c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:17.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66c4005190 0x7f66c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66db7fe640 1 -- 172.21.15.53:0/3204451718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4003530 con 0x7f66c40047d0 2024-09-13T18:30:17.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.987+0000 7f66e0f8f640 1 -- 172.21.15.53:0/3204451718 reap_dead start 2024-09-13T18:30:17.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66db7fe640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c40047d0 0x7f66c4004c50 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f66d000c240 tx=0x7f66d001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca0e237da47e175 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:17.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0005ae0 con 0x7f66c40047d0 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d00ab070 con 0x7f66c40047d0 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66daffd640 1 -- 172.21.15.53:0/3204451718 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0005ea0 con 0x7f66c40047d0 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 -- 172.21.15.53:0/3204451718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c40047d0 msgr2=0x7f66c4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c40047d0 0x7f66c4004c50 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f66d000c240 tx=0x7f66d001f390 comp rx=0 tx=0).stop 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 -- 172.21.15.53:0/3204451718 shutdown_connections 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 --2- 172.21.15.53:0/3204451718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66c40047d0 0x7f66c4004c50 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 -- 172.21.15.53:0/3204451718 >> 172.21.15.53:0/3204451718 conn(0x7f66dc065c80 msgr2=0x7f66dc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 -- 172.21.15.53:0/3204451718 shutdown_connections 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 -- 172.21.15.53:0/3204451718 wait complete. 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 Processor -- start 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 -- start start 2024-09-13T18:30:17.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c40047d0 0x7f66dc158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66dc14cd90 0x7f66dc0cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66dc0cb850 0x7f66dc1f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.991+0000 7f66e29f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc159500 con 0x7f66dc0cb850 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e29f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0cbcd0 con 0x7f66dc14cd90 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e29f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc157ec0 con 0x7f66c40047d0 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66dc0cb850 0x7f66dc1f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66dc0cb850 0x7f66dc1f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58748/0 (socket says 172.21.15.53:58748) 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 -- 172.21.15.53:0/1081768961 learned_addr learned my addr 172.21.15.53:0/1081768961 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66dbfff640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c40047d0 0x7f66dc158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66db7fe640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66dc14cd90 0x7f66dc0cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 -- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c40047d0 msgr2=0x7f66dc158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c40047d0 0x7f66dc158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 -- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66dc14cd90 msgr2=0x7f66dc0cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66dc14cd90 0x7f66dc0cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 -- 172.21.15.53:0/1081768961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc157100 con 0x7f66dc0cb850 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66db7fe640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66dc14cd90 0x7f66dc0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e0f8f640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66dc0cb850 0x7f66dc1f25c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f66dc06af60 tx=0x7f66d40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1081768961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d400e070 con 0x7f66dc0cb850 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1081768961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4011e10 con 0x7f66dc0cb850 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc1573e0 con 0x7f66dc0cb850 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1081768961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40039a0 con 0x7f66dc0cb850 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc1579a0 con 0x7f66dc0cb850 2024-09-13T18:30:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc157b90 con 0x7f66dc0cb850 2024-09-13T18:30:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1081768961 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f66d4003b00 con 0x7f66dc0cb850 2024-09-13T18:30:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66d8ff9640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66c80667b0 0x7f66c8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1081768961 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66d4085970 con 0x7f66dc0cb850 2024-09-13T18:30:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66dbfff640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66c80667b0 0x7f66c8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.995+0000 7f66dbfff640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66c80667b0 0x7f66c8068c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66cc001660 tx=0x7f66cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:17.999+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1081768961 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66d4052b10 con 0x7f66dc0cb850 2024-09-13T18:30:18.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.163+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66dc0d05b0 con 0x7f66dc0cb850 2024-09-13T18:30:18.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.163+0000 7f66d8ff9640 1 -- 172.21.15.53:0/1081768961 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16513 (secure 0 0 0) 0x7f66d4056130 con 0x7f66dc0cb850 2024-09-13T18:30:18.166 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:18.166 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":86,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:17.823714+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:18.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66c80667b0 msgr2=0x7f66c8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66c80667b0 0x7f66c8068c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66cc001660 tx=0x7f66cc009040 comp rx=0 tx=0).stop 2024-09-13T18:30:18.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66dc0cb850 msgr2=0x7f66dc1f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66dc0cb850 0x7f66dc1f25c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f66dc06af60 tx=0x7f66d40115a0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 shutdown_connections 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66c80667b0 0x7f66c8068c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66dc0cb850 0x7f66dc1f25c0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66dc14cd90 0x7f66dc0cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 --2- 172.21.15.53:0/1081768961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66c40047d0 0x7f66dc158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 >> 172.21.15.53:0/1081768961 conn(0x7f66dc065c80 msgr2=0x7f66dc15ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 shutdown_connections 2024-09-13T18:30:18.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.167+0000 7f66e29f2640 1 -- 172.21.15.53:0/1081768961 wait complete. 2024-09-13T18:30:18.186 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d3ad7640 1 Processor -- start 2024-09-13T18:30:18.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d3ad7640 1 -- start start 2024-09-13T18:30:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d3ad7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2cc158ba0 0x7fc2cc06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d3ad7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2cc06fa80 0x7fc2cc0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d3ad7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc0b2340 con 0x7fc2cc0cbb60 2024-09-13T18:30:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d3ad7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc0b2860 con 0x7fc2cc158ba0 2024-09-13T18:30:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d3ad7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc158f80 con 0x7fc2cc06fa80 2024-09-13T18:30:18.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d1072640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc2cc0cbb60 0x7fc2cc06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60316/0 (socket says 172.21.15.53:60316) 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d1072640 1 -- 172.21.15.53:0/1873704787 learned_addr learned my addr 172.21.15.53:0/1873704787 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d1873640 1 --2- 172.21.15.53:0/1873704787 >> v2:172.21.15.53:3300/0 conn(0x7fc2cc158ba0 0x7fc2cc06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d2074640 1 --2- 172.21.15.53:0/1873704787 >> v2:172.21.15.87:3300/0 conn(0x7fc2cc06fa80 0x7fc2cc0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d0871640 1 -- 172.21.15.53:0/1873704787 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495009367 0 0) 0x7fc2bc001120 con 0x7fc2cc0cbb60 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d0871640 1 -- 172.21.15.53:0/1873704787 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b8005740 con 0x7fc2cc0cbb60 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d1873640 1 -- 172.21.15.53:0/1873704787 >> v2:172.21.15.87:3300/0 conn(0x7fc2cc06fa80 msgr2=0x7fc2cc0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d1873640 1 --2- 172.21.15.53:0/1873704787 >> v2:172.21.15.87:3300/0 conn(0x7fc2cc06fa80 0x7fc2cc0b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d1873640 1 -- 172.21.15.53:0/1873704787 >> v1:172.21.15.53:6789/0 conn(0x7fc2cc0cbb60 legacy=0x7fc2cc06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.303+0000 7fc2d1873640 1 -- 172.21.15.53:0/1873704787 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0b2580 con 0x7fc2cc158ba0 2024-09-13T18:30:18.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 --2- 172.21.15.53:0/1873704787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc06b390 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80097c0 tx=0x7fc2c801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de18e9d6f302f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d0871640 1 -- 172.21.15.53:0/1873704787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8004230 con 0x7fc2cc158ba0 2024-09-13T18:30:18.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d0871640 1 -- 172.21.15.53:0/1873704787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80a7050 con 0x7fc2cc158ba0 2024-09-13T18:30:18.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d0871640 1 -- 172.21.15.53:0/1873704787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003620 con 0x7fc2cc158ba0 2024-09-13T18:30:18.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1873704787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc158ba0 msgr2=0x7fc2cc06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1873704787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc06b390 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80097c0 tx=0x7fc2c801c3d0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1873704787 shutdown_connections 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1873704787 >> v2:172.21.15.87:3300/0 conn(0x7fc2cc06fa80 0x7fc2cc0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1873704787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc06b390 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1873704787 >> 172.21.15.53:0/1873704787 conn(0x7fc2cc065c80 msgr2=0x7fc2cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1873704787 shutdown_connections 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1873704787 wait complete. 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 Processor -- start 2024-09-13T18:30:18.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- start start 2024-09-13T18:30:18.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc06fa80 0x7fc2cc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2cc0cbb60 0x7fc2cc13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc13f200 con 0x7fc2cc06fa80 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0ca210 con 0x7fc2cc158ba0 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d3ad7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0c9f30 con 0x7fc2cc0cbb60 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc06fa80 0x7fc2cc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc06fa80 0x7fc2cc0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58770/0 (socket says 172.21.15.53:58770) 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 -- 172.21.15.53:0/1601763332 learned_addr learned my addr 172.21.15.53:0/1601763332 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d2074640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1072640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2cc0cbb60 0x7fc2cc13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 -- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2cc0cbb60 msgr2=0x7fc2cc13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2cc0cbb60 0x7fc2cc13ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 -- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2cc158ba0 msgr2=0x7fc2cc0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d1873640 1 -- 172.21.15.53:0/1601763332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c8009420 con 0x7fc2cc06fa80 2024-09-13T18:30:18.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.307+0000 7fc2d2074640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:18.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2d1873640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc06fa80 0x7fc2cc0c9900 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80ae040 tx=0x7fc2c8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2c27fc640 1 -- 172.21.15.53:0/1601763332 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003af0 con 0x7fc2cc06fa80 2024-09-13T18:30:18.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2c27fc640 1 -- 172.21.15.53:0/1601763332 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8003c50 con 0x7fc2cc06fa80 2024-09-13T18:30:18.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc0c45d0 con 0x7fc2cc06fa80 2024-09-13T18:30:18.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2c27fc640 1 -- 172.21.15.53:0/1601763332 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80ab440 con 0x7fc2cc06fa80 2024-09-13T18:30:18.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc0c4b90 con 0x7fc2cc06fa80 2024-09-13T18:30:18.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc067400 con 0x7fc2cc06fa80 2024-09-13T18:30:18.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2c27fc640 1 -- 172.21.15.53:0/1601763332 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc2c80b2040 con 0x7fc2cc06fa80 2024-09-13T18:30:18.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2c27fc640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2b00667b0 0x7fc2b0068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2c27fc640 1 -- 172.21.15.53:0/1601763332 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2c811e260 con 0x7fc2cc06fa80 2024-09-13T18:30:18.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2d1072640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2b00667b0 0x7fc2b0068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.311+0000 7fc2d1072640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2b00667b0 0x7fc2b0068c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc142610 tx=0x7fc2bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.315+0000 7fc2c27fc640 1 -- 172.21.15.53:0/1601763332 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2c80eb3b0 con 0x7fc2cc06fa80 2024-09-13T18:30:18.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.475+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2cc0b1e00 con 0x7fc2cc06fa80 2024-09-13T18:30:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2c27fc640 1 -- 172.21.15.53:0/1601763332 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16513 (secure 0 0 0) 0x7fc2c80ee9d0 con 0x7fc2cc06fa80 2024-09-13T18:30:18.479 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:18.480 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":86,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:17.823714+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2b00667b0 msgr2=0x7fc2b0068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2b00667b0 0x7fc2b0068c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc142610 tx=0x7fc2bc009040 comp rx=0 tx=0).stop 2024-09-13T18:30:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc06fa80 msgr2=0x7fc2cc0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc06fa80 0x7fc2cc0c9900 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80ae040 tx=0x7fc2c8019170 comp rx=0 tx=0).stop 2024-09-13T18:30:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 shutdown_connections 2024-09-13T18:30:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc2b00667b0 0x7fc2b0068c70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2cc0cbb60 0x7fc2cc13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2cc158ba0 0x7fc2cc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 --2- 172.21.15.53:0/1601763332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2cc06fa80 0x7fc2cc0c9900 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 >> 172.21.15.53:0/1601763332 conn(0x7fc2cc065c80 msgr2=0x7fc2cc15a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 shutdown_connections 2024-09-13T18:30:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.479+0000 7fc2d3ad7640 1 -- 172.21.15.53:0/1601763332 wait complete. 2024-09-13T18:30:18.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:30:18.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.627+0000 7f65076db640 1 Processor -- start 2024-09-13T18:30:18.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.627+0000 7f65076db640 1 -- start start 2024-09-13T18:30:18.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6500159530 0x7f65000b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65000cdaa0 con 0x7f65000b1d30 2024-09-13T18:30:18.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65000ce570 con 0x7f6500071b00 2024-09-13T18:30:18.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65000ceb10 con 0x7f6500159530 2024-09-13T18:30:18.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f6505477640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6500159530 0x7f65000b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f6505477640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6500159530 0x7f65000b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58774/0 (socket says 172.21.15.53:58774) 2024-09-13T18:30:18.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f6505477640 1 -- 172.21.15.53:0/1234058859 learned_addr learned my addr 172.21.15.53:0/1234058859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:18.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f6505477640 1 -- 172.21.15.53:0/1234058859 >> v1:172.21.15.87:6789/0 conn(0x7f6500071b00 legacy=0x7f6500071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:18.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f6505477640 1 -- 172.21.15.53:0/1234058859 >> v1:172.21.15.53:6789/0 conn(0x7f65000b1d30 legacy=0x7f6500070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f6505477640 1 -- 172.21.15.53:0/1234058859 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65000ce830 con 0x7f6500159530 2024-09-13T18:30:18.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f6505477640 1 --2- 172.21.15.53:0/1234058859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6500159530 0x7f65000b35a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc3ae43fcbdee4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f64f7fff640 1 -- 172.21.15.53:0/1234058859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0a7070 con 0x7f6500159530 2024-09-13T18:30:18.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f64f7fff640 1 -- 172.21.15.53:0/1234058859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0ab430 con 0x7f6500159530 2024-09-13T18:30:18.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f64f7fff640 1 -- 172.21.15.53:0/1234058859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0ab7c0 con 0x7f6500159530 2024-09-13T18:30:18.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- 172.21.15.53:0/1234058859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6500159530 msgr2=0x7f65000b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 --2- 172.21.15.53:0/1234058859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6500159530 0x7f65000b35a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc01c520 comp rx=0 tx=0).stop 2024-09-13T18:30:18.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- 172.21.15.53:0/1234058859 shutdown_connections 2024-09-13T18:30:18.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 --2- 172.21.15.53:0/1234058859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6500159530 0x7f65000b35a0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- 172.21.15.53:0/1234058859 >> 172.21.15.53:0/1234058859 conn(0x7f65000b0a30 msgr2=0x7f65000b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:18.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- 172.21.15.53:0/1234058859 shutdown_connections 2024-09-13T18:30:18.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.631+0000 7f65076db640 1 -- 172.21.15.53:0/1234058859 wait complete. 2024-09-13T18:30:18.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 Processor -- start 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 -- start start 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6500071b00 0x7f650014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65000b1d30 0x7f650014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500159530 0x7f65001522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6500158410 con 0x7f65000b1d30 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65001586f0 con 0x7f6500159530 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65001589d0 con 0x7f6500071b00 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65000b1d30 0x7f650014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65000b1d30 0x7f650014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58788/0 (socket says 172.21.15.53:58788) 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 -- 172.21.15.53:0/261853646 learned_addr learned my addr 172.21.15.53:0/261853646 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6505477640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6500071b00 0x7f650014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6505c78640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500159530 0x7f65001522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 -- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6500071b00 msgr2=0x7f650014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6500071b00 0x7f650014d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 -- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500159530 msgr2=0x7f65001522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500159530 0x7f65001522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 -- 172.21.15.53:0/261853646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0094d0 con 0x7f65000b1d30 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f6504c76640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65000b1d30 0x7f650014ded0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c500 tx=0x7f64f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f64f5ffb640 1 -- 172.21.15.53:0/261853646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0005220 con 0x7f65000b1d30 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f64f5ffb640 1 -- 172.21.15.53:0/261853646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0005380 con 0x7f65000b1d30 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650014ff70 con 0x7f65000b1d30 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f64f5ffb640 1 -- 172.21.15.53:0/261853646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0007270 con 0x7f65000b1d30 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.635+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650014db40 con 0x7f65000b1d30 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.639+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65000cdf10 con 0x7f65000b1d30 2024-09-13T18:30:18.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.639+0000 7f64f5ffb640 1 -- 172.21.15.53:0/261853646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f64f00073d0 con 0x7f65000b1d30 2024-09-13T18:30:18.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.639+0000 7f64f5ffb640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f64e40667b0 0x7f64e4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.639+0000 7f64f5ffb640 1 -- 172.21.15.53:0/261853646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f0083ca0 con 0x7f65000b1d30 2024-09-13T18:30:18.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.639+0000 7f6505477640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f64e40667b0 0x7f64e4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.639+0000 7f6505477640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f64e40667b0 0x7f64e4068c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0af000 tx=0x7f64fc0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.643+0000 7f64f5ffb640 1 -- 172.21.15.53:0/261853646 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65000cdf10 con 0x7f65000b1d30 2024-09-13T18:30:18.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:18.839+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f65000cdf10 con 0x7f65000b1d30 2024-09-13T18:30:19.419 INFO:tasks.ceph.mds.a.smithi053.stderr:2024-09-13T18:30:19.415+0000 7f0f98c9e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:30:19.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.839+0000 7f64f5ffb640 1 -- 172.21.15.53:0/261853646 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f65000cdf10 con 0x7f65000b1d30 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f64e40667b0 msgr2=0x7f64e4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f64e40667b0 0x7f64e4068c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0af000 tx=0x7f64fc0a7000 comp rx=0 tx=0).stop 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65000b1d30 msgr2=0x7f650014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65000b1d30 0x7f650014ded0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f64f000c500 tx=0x7f64f000c9c0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 shutdown_connections 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f64e40667b0 0x7f64e4068c70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6500159530 0x7f65001522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65000b1d30 0x7f650014ded0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 --2- 172.21.15.53:0/261853646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6500071b00 0x7f650014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 >> 172.21.15.53:0/261853646 conn(0x7f65000b0a30 msgr2=0x7f65000b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:19.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 shutdown_connections 2024-09-13T18:30:19.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:19.843+0000 7f65076db640 1 -- 172.21.15.53:0/261853646 wait complete. 2024-09-13T18:30:19.867 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:30:19.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:30:20.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194c825640 1 Processor -- start 2024-09-13T18:30:20.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194c825640 1 -- start start 2024-09-13T18:30:20.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194c825640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19480b2bf0 0x7f19480b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194c825640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194806bee0 con 0x7f19480c34f0 2024-09-13T18:30:20.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194c825640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19480aff40 con 0x7f1948160db0 2024-09-13T18:30:20.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194c825640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194806a2c0 con 0x7f19480b2bf0 2024-09-13T18:30:20.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f19480c34f0 0x7f19480c38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60324/0 (socket says 172.21.15.53:60324) 2024-09-13T18:30:20.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194659c640 1 -- 172.21.15.53:0/710384433 learned_addr learned my addr 172.21.15.53:0/710384433 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:20.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1946d9d640 1 --2- 172.21.15.53:0/710384433 >> v2:172.21.15.87:3300/0 conn(0x7f19480b2bf0 0x7f19480b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592058546 0 0) 0x7f194806bee0 con 0x7f19480c34f0 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1934003530 con 0x7f19480c34f0 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718729430 0 0) 0x7f1934003530 con 0x7f19480c34f0 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 >> v2:172.21.15.87:3300/0 conn(0x7f19480b2bf0 msgr2=0x7f19480b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 --2- 172.21.15.53:0/710384433 >> v2:172.21.15.87:3300/0 conn(0x7f19480b2bf0 0x7f19480b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 >> v1:172.21.15.87:6789/0 conn(0x7f1948160db0 legacy=0x7f19480ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194806a5a0 con 0x7f19480c34f0 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f1930001680 con 0x7f19480c34f0 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 >> v1:172.21.15.53:6789/0 conn(0x7f19480c34f0 legacy=0x7f19480c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1934003980 0x7f1934003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19340047d0 0x7f1934004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1934005190 0x7f193400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194806a2c0 con 0x7f1934005190 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193400c030 con 0x7f19340047d0 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193400c1f0 con 0x7f1934003980 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1946d9d640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1934005190 0x7f193400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1945d9b640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19340047d0 0x7f1934004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f194659c640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1934003980 0x7f1934003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1946d9d640 1 -- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1934003980 msgr2=0x7f1934003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1946d9d640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1934003980 0x7f1934003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1946d9d640 1 -- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19340047d0 msgr2=0x7f1934004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1946d9d640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19340047d0 0x7f1934004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1946d9d640 1 -- 172.21.15.53:0/710384433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934003530 con 0x7f1934005190 2024-09-13T18:30:20.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.003+0000 7f1945d9b640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19340047d0 0x7f1934004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f1946d9d640 1 -- 172.21.15.53:0/710384433 reap_dead start 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f1946d9d640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1934005190 0x7f193400b990 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1940009ab0 tx=0x7f194001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5725e92417443065 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940004020 con 0x7f1934005190 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940004180 con 0x7f1934005190 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194559a640 1 -- 172.21.15.53:0/710384433 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400a5680 con 0x7f1934005190 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194c825640 1 -- 172.21.15.53:0/710384433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1934005190 msgr2=0x7f193400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194c825640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1934005190 0x7f193400b990 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1940009ab0 tx=0x7f194001ca90 comp rx=0 tx=0).stop 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194c825640 1 -- 172.21.15.53:0/710384433 shutdown_connections 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194c825640 1 --2- 172.21.15.53:0/710384433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1934005190 0x7f193400b990 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194c825640 1 -- 172.21.15.53:0/710384433 >> 172.21.15.53:0/710384433 conn(0x7f19480b20d0 msgr2=0x7f19480b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194c825640 1 -- 172.21.15.53:0/710384433 shutdown_connections 2024-09-13T18:30:20.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.007+0000 7f194c825640 1 -- 172.21.15.53:0/710384433 wait complete. 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 Processor -- start 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 -- start start 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1934005190 0x7f19481f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19480c7dc0 0x7f194815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19480c99b0 0x7f19480c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480cbb80 con 0x7f19480c7dc0 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19481f6fd0 con 0x7f1934005190 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480c8380 con 0x7f19480c99b0 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19480c7dc0 0x7f194815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19480c7dc0 0x7f194815a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58806/0 (socket says 172.21.15.53:58806) 2024-09-13T18:30:20.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 -- 172.21.15.53:0/3390561204 learned_addr learned my addr 172.21.15.53:0/3390561204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194659c640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1934005190 0x7f19481f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1946d9d640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19480c99b0 0x7f19480c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 -- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19480c99b0 msgr2=0x7f19480c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19480c99b0 0x7f19480c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 -- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1934005190 msgr2=0x7f19481f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1934005190 0x7f19481f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 -- 172.21.15.53:0/3390561204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480c6b40 con 0x7f19480c7dc0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f1945d9b640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19480c7dc0 0x7f194815a3b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f193800e7f0 tx=0x7f193800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f193effd640 1 -- 172.21.15.53:0/3390561204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938003b90 con 0x7f19480c7dc0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f193effd640 1 -- 172.21.15.53:0/3390561204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938003cf0 con 0x7f19480c7dc0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19480c6e20 con 0x7f19480c7dc0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f193effd640 1 -- 172.21.15.53:0/3390561204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938005310 con 0x7f19480c7dc0 2024-09-13T18:30:20.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194815a8f0 con 0x7f19480c7dc0 2024-09-13T18:30:20.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19480c72d0 con 0x7f19480c7dc0 2024-09-13T18:30:20.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.011+0000 7f193effd640 1 -- 172.21.15.53:0/3390561204 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f1938005470 con 0x7f19480c7dc0 2024-09-13T18:30:20.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.015+0000 7f193effd640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19280667b0 0x7f1928068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.015+0000 7f193effd640 1 -- 172.21.15.53:0/3390561204 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1938084490 con 0x7f19480c7dc0 2024-09-13T18:30:20.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.015+0000 7f194659c640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19280667b0 0x7f1928068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.015+0000 7f194659c640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19280667b0 0x7f1928068c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19300019e0 tx=0x7f1930009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:20.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.019+0000 7f193effd640 1 -- 172.21.15.53:0/3390561204 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1938051650 con 0x7f19480c7dc0 2024-09-13T18:30:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.211+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f19480b1c70 con 0x7f19480c7dc0 2024-09-13T18:30:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.842+0000 7f193effd640 1 -- 172.21.15.53:0/3390561204 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1938003e60 con 0x7f19480c7dc0 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.842+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19280667b0 msgr2=0x7f1928068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.842+0000 7f194c825640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19280667b0 0x7f1928068c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19300019e0 tx=0x7f1930009040 comp rx=0 tx=0).stop 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.842+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19480c7dc0 msgr2=0x7f194815a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.842+0000 7f194c825640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19480c7dc0 0x7f194815a3b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f193800e7f0 tx=0x7f193800ecb0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 shutdown_connections 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19280667b0 0x7f1928068c70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f19480c99b0 0x7f19480c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19480c7dc0 0x7f194815a3b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 --2- 172.21.15.53:0/3390561204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1934005190 0x7f19481f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 >> 172.21.15.53:0/3390561204 conn(0x7f19480b20d0 msgr2=0x7f194815fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 shutdown_connections 2024-09-13T18:30:20.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.846+0000 7f194c825640 1 -- 172.21.15.53:0/3390561204 wait complete. 2024-09-13T18:30:20.867 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:30:20.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.990+0000 7f288e61c640 1 Processor -- start 2024-09-13T18:30:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.990+0000 7f288e61c640 1 -- start start 2024-09-13T18:30:20.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f288e61c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f288815b7c0 0x7f2888070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f288e61c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288806d480 con 0x7f28881582a0 2024-09-13T18:30:20.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f288e61c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288815ace0 con 0x7f28880711d0 2024-09-13T18:30:20.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f288e61c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288815aaf0 con 0x7f288815b7c0 2024-09-13T18:30:20.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2887fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f28881582a0 0x7f288806c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60336/0 (socket says 172.21.15.53:60336) 2024-09-13T18:30:20.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2887fff640 1 -- 172.21.15.53:0/2960703886 learned_addr learned my addr 172.21.15.53:0/2960703886 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f28877fe640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f288815b7c0 0x7f2888070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753362402 0 0) 0x7f288806d480 con 0x7f28881582a0 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2870003530 con 0x7f28881582a0 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744972357 0 0) 0x7f2870003530 con 0x7f28881582a0 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f288815b7c0 msgr2=0x7f2888070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f288815b7c0 0x7f2888070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 >> v1:172.21.15.87:6789/0 conn(0x7f28880711d0 legacy=0x7f28881640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288815afc0 con 0x7f28881582a0 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f2878001680 con 0x7f28881582a0 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 >> v1:172.21.15.53:6789/0 conn(0x7f28881582a0 legacy=0x7f288806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28700039b0 0x7f2870003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28700047d0 0x7f2870004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f288815b7c0 0x7f2870005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287000ba40 con 0x7f28700047d0 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287000bbb0 con 0x7f28700039b0 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287000bd70 con 0x7f288815b7c0 2024-09-13T18:30:20.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f28877fe640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28700047d0 0x7f2870004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f2887fff640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28700039b0 0x7f2870003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f28877fe640 1 -- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f288815b7c0 msgr2=0x7f2870005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f28877fe640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f288815b7c0 0x7f2870005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f28877fe640 1 -- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28700039b0 msgr2=0x7f2870003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f28877fe640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28700039b0 0x7f2870003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.994+0000 7f28877fe640 1 -- 172.21.15.53:0/2960703886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2870003530 con 0x7f28700047d0 2024-09-13T18:30:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f28877fe640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28700047d0 0x7f2870004c50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f287c009ab0 tx=0x7f287c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4249b7f4e5ecaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0a5550 con 0x7f28700047d0 2024-09-13T18:30:21.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0a56b0 con 0x7f28700047d0 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f2886ffd640 1 -- 172.21.15.53:0/2960703886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0a5a60 con 0x7f28700047d0 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- 172.21.15.53:0/2960703886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28700047d0 msgr2=0x7f2870004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 --2- 172.21.15.53:0/2960703886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28700047d0 0x7f2870004c50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f287c009ab0 tx=0x7f287c01ca70 comp rx=0 tx=0).stop 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 -- 172.21.15.53:0/2960703886 reap_dead start 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- 172.21.15.53:0/2960703886 shutdown_connections 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- 172.21.15.53:0/2960703886 >> 172.21.15.53:0/2960703886 conn(0x7f2888065c80 msgr2=0x7f2888066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- 172.21.15.53:0/2960703886 shutdown_connections 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- 172.21.15.53:0/2960703886 wait complete. 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 Processor -- start 2024-09-13T18:30:21.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- start start 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28700047d0 0x7f2888154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f288806fb70 0x7f2888155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288806fff0 0x7f28880b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888153cd0 con 0x7f288806fff0 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888153f70 con 0x7f288806fb70 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288e61c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2888154250 con 0x7f28700047d0 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288806fff0 0x7f28880b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288806fff0 0x7f28880b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58822/0 (socket says 172.21.15.53:58822) 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 -- 172.21.15.53:0/416410577 learned_addr learned my addr 172.21.15.53:0/416410577 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f2887fff640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28700047d0 0x7f2888154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f28877fe640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f288806fb70 0x7f2888155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 -- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28700047d0 msgr2=0x7f2888154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28700047d0 0x7f2888154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 -- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f288806fb70 msgr2=0x7f2888155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f288806fb70 0x7f2888155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 -- 172.21.15.53:0/416410577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888154530 con 0x7f288806fff0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f2887fff640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28700047d0 0x7f2888154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f28877fe640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f288806fb70 0x7f2888155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:20.998+0000 7f288cbb9640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288806fff0 0x7f28880b1520 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f288815bba0 tx=0x7f288000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2884ff9640 1 -- 172.21.15.53:0/416410577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880005d50 con 0x7f288806fff0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2884ff9640 1 -- 172.21.15.53:0/416410577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000ced0 con 0x7f288806fff0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28881f2e80 con 0x7f288806fff0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2884ff9640 1 -- 172.21.15.53:0/416410577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000a850 con 0x7f288806fff0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2888154f90 con 0x7f288806fff0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2888067400 con 0x7f288806fff0 2024-09-13T18:30:21.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2884ff9640 1 -- 172.21.15.53:0/416410577 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f288000a9b0 con 0x7f288806fff0 2024-09-13T18:30:21.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2884ff9640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28740667b0 0x7f2874068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2884ff9640 1 -- 172.21.15.53:0/416410577 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2880083260 con 0x7f288806fff0 2024-09-13T18:30:21.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2887fff640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28740667b0 0x7f2874068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.002+0000 7f2887fff640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28740667b0 0x7f2874068c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2878000c10 tx=0x7f2878009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.006+0000 7f2884ff9640 1 -- 172.21.15.53:0/416410577 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28800504c0 con 0x7f288806fff0 2024-09-13T18:30:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.198+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28880cb570 con 0x7f288806fff0 2024-09-13T18:30:21.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.198+0000 7f2884ff9640 1 -- 172.21.15.53:0/416410577 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f2880053ae0 con 0x7f288806fff0 2024-09-13T18:30:21.201 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:21.202 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2807450918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2807450918},{"type":"v1","addr":"172.21.15.87:6833","nonce":2807450918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3225281050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3225281050},{"type":"v1","addr":"172.21.15.87:6835","nonce":3225281050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3795700837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3795700837},{"type":"v1","addr":"172.21.15.53:6833","nonce":3795700837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:30:17.824687+0000","modified":"2024-09-13T18:30:20.838202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2118447408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2118447408},{"type":"v1","addr":"172.21.15.53:6835","nonce":2118447408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:30:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 48 2024-09-13T18:30:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28740667b0 msgr2=0x7f2874068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28740667b0 0x7f2874068c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2878000c10 tx=0x7f2878009040 comp rx=0 tx=0).stop 2024-09-13T18:30:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288806fff0 msgr2=0x7f28880b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288806fff0 0x7f28880b1520 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f288815bba0 tx=0x7f288000cb90 comp rx=0 tx=0).stop 2024-09-13T18:30:21.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 shutdown_connections 2024-09-13T18:30:21.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28740667b0 0x7f2874068c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288806fff0 0x7f28880b1520 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f288806fb70 0x7f2888155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 --2- 172.21.15.53:0/416410577 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28700047d0 0x7f2888154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 >> 172.21.15.53:0/416410577 conn(0x7f2888065c80 msgr2=0x7f2888159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 shutdown_connections 2024-09-13T18:30:21.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.202+0000 7f288e61c640 1 -- 172.21.15.53:0/416410577 wait complete. 2024-09-13T18:30:21.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb29008f640 1 Processor -- start 2024-09-13T18:30:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb29008f640 1 -- start start 2024-09-13T18:30:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb29008f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2881582a0 0x7fb28806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb29008f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb28806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb29008f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28806d480 con 0x7fb28815b7c0 2024-09-13T18:30:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb29008f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28815aaf0 con 0x7fb2881582a0 2024-09-13T18:30:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb29008f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28806d760 con 0x7fb2880713a0 2024-09-13T18:30:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb28de2b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2881582a0 0x7fb28806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb28e62c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb28806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb28de2b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2881582a0 0x7fb28806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:41248/0 (socket says 172.21.15.53:41248) 2024-09-13T18:30:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.330+0000 7fb28de2b640 1 -- 172.21.15.53:0/3400725999 learned_addr learned my addr 172.21.15.53:0/3400725999 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28e62c640 1 -- 172.21.15.53:0/3400725999 >> v2:172.21.15.87:3300/0 conn(0x7fb2881582a0 msgr2=0x7fb28806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28e62c640 1 --2- 172.21.15.53:0/3400725999 >> v2:172.21.15.87:3300/0 conn(0x7fb2881582a0 0x7fb28806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28e62c640 1 -- 172.21.15.53:0/3400725999 >> v1:172.21.15.87:6789/0 conn(0x7fb28815b7c0 legacy=0x7fb288070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28e62c640 1 -- 172.21.15.53:0/3400725999 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28815ace0 con 0x7fb2880713a0 2024-09-13T18:30:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28de2b640 1 --2- 172.21.15.53:0/3400725999 >> v2:172.21.15.87:3300/0 conn(0x7fb2881582a0 0x7fb28806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:21.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28e62c640 1 --2- 172.21.15.53:0/3400725999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb28806ce40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb280009d90 tx=0x7fb28001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da3f2122e437ed79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28ce29640 1 -- 172.21.15.53:0/3400725999 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800a5a00 con 0x7fb2880713a0 2024-09-13T18:30:21.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28ce29640 1 -- 172.21.15.53:0/3400725999 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2800a5b60 con 0x7fb2880713a0 2024-09-13T18:30:21.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb28ce29640 1 -- 172.21.15.53:0/3400725999 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800ad440 con 0x7fb2880713a0 2024-09-13T18:30:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 -- 172.21.15.53:0/3400725999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 msgr2=0x7fb28806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 --2- 172.21.15.53:0/3400725999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb28806ce40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb280009d90 tx=0x7fb28001c940 comp rx=0 tx=0).stop 2024-09-13T18:30:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 -- 172.21.15.53:0/3400725999 shutdown_connections 2024-09-13T18:30:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 --2- 172.21.15.53:0/3400725999 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb28806ce40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 --2- 172.21.15.53:0/3400725999 >> v2:172.21.15.87:3300/0 conn(0x7fb2881582a0 0x7fb28806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 -- 172.21.15.53:0/3400725999 >> 172.21.15.53:0/3400725999 conn(0x7fb288065c80 msgr2=0x7fb288066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 -- 172.21.15.53:0/3400725999 shutdown_connections 2024-09-13T18:30:21.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.334+0000 7fb29008f640 1 -- 172.21.15.53:0/3400725999 wait complete. 2024-09-13T18:30:21.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 Processor -- start 2024-09-13T18:30:21.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 -- start start 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb2880b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2881582a0 0x7fb2880ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28815b7c0 0x7fb2880ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880b2480 con 0x7fb2881582a0 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb288137a40 con 0x7fb28815b7c0 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb288136c80 con 0x7fb2880713a0 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2881582a0 0x7fb2880ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2881582a0 0x7fb2880ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58838/0 (socket says 172.21.15.53:58838) 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 -- 172.21.15.53:0/271825626 learned_addr learned my addr 172.21.15.53:0/271825626 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28de2b640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb2880b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28e62c640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28815b7c0 0x7fb2880ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 -- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 msgr2=0x7fb2880b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb2880b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 -- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28815b7c0 msgr2=0x7fb2880ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28815b7c0 0x7fb2880ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 -- 172.21.15.53:0/271825626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2780094d0 con 0x7fb2881582a0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb28d62a640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2881582a0 0x7fb2880ae280 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00c3c0 tx=0x7fb27c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb2867fc640 1 -- 172.21.15.53:0/271825626 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0052d0 con 0x7fb2881582a0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb2867fc640 1 -- 172.21.15.53:0/271825626 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c005430 con 0x7fb2881582a0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb280009a70 con 0x7fb2881582a0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb2867fc640 1 -- 172.21.15.53:0/271825626 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c003840 con 0x7fb2881582a0 2024-09-13T18:30:21.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb288137240 con 0x7fb2881582a0 2024-09-13T18:30:21.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb288067400 con 0x7fb2881582a0 2024-09-13T18:30:21.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.338+0000 7fb2867fc640 1 -- 172.21.15.53:0/271825626 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fb27c0039a0 con 0x7fb2881582a0 2024-09-13T18:30:21.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.342+0000 7fb2867fc640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb2740667b0 0x7fb274068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.342+0000 7fb2867fc640 1 -- 172.21.15.53:0/271825626 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb27c083a00 con 0x7fb2881582a0 2024-09-13T18:30:21.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.342+0000 7fb28de2b640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb2740667b0 0x7fb274068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.342+0000 7fb28de2b640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb2740667b0 0x7fb274068c70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb278006cb0 tx=0x7fb278009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.342+0000 7fb2867fc640 1 -- 172.21.15.53:0/271825626 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb27c050d10 con 0x7fb2881582a0 2024-09-13T18:30:21.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.502+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb288136dc0 con 0x7fb2881582a0 2024-09-13T18:30:21.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb2867fc640 1 -- 172.21.15.53:0/271825626 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16500 (secure 0 0 0) 0x7fb288136dc0 con 0x7fb2881582a0 2024-09-13T18:30:21.507 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:21.507 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":87,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:18.828254+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb2740667b0 msgr2=0x7fb274068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb2740667b0 0x7fb274068c70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb278006cb0 tx=0x7fb278009240 comp rx=0 tx=0).stop 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2881582a0 msgr2=0x7fb2880ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2881582a0 0x7fb2880ae280 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00c3c0 tx=0x7fb27c00c880 comp rx=0 tx=0).stop 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 shutdown_connections 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb2740667b0 0x7fb274068c70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb28815b7c0 0x7fb2880ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2881582a0 0x7fb2880ae280 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 --2- 172.21.15.53:0/271825626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb2880713a0 0x7fb2880b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 >> 172.21.15.53:0/271825626 conn(0x7fb288065c80 msgr2=0x7fb288066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 shutdown_connections 2024-09-13T18:30:21.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.506+0000 7fb29008f640 1 -- 172.21.15.53:0/271825626 wait complete. 2024-09-13T18:30:21.525 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:30:21.525 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:30:21.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86f22e640 1 Processor -- start 2024-09-13T18:30:21.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86f22e640 1 -- start start 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86f22e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8680cb980 0x7fc8680b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86f22e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc86806b850 0x7fc8680cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86f22e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8680b1ac0 con 0x7fc8680cbd60 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86f22e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8680b3010 con 0x7fc8680cb980 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86f22e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc868159ac0 con 0x7fc86806b850 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8680cb980 0x7fc8680b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8680cb980 0x7fc8680b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58848/0 (socket says 172.21.15.53:58848) 2024-09-13T18:30:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86d7cb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc8680cbd60 0x7fc86806fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60342/0 (socket says 172.21.15.53:60342) 2024-09-13T18:30:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 -- 172.21.15.53:0/1729826481 learned_addr learned my addr 172.21.15.53:0/1729826481 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc867fff640 1 --2- 172.21.15.53:0/1729826481 >> v2:172.21.15.87:3300/0 conn(0x7fc86806b850 0x7fc8680cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 -- 172.21.15.53:0/1729826481 >> v2:172.21.15.87:3300/0 conn(0x7fc86806b850 msgr2=0x7fc8680cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 --2- 172.21.15.53:0/1729826481 >> v2:172.21.15.87:3300/0 conn(0x7fc86806b850 0x7fc8680cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 -- 172.21.15.53:0/1729826481 >> v1:172.21.15.53:6789/0 conn(0x7fc8680cbd60 legacy=0x7fc86806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 -- 172.21.15.53:0/1729826481 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868159da0 con 0x7fc8680cb980 2024-09-13T18:30:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc8677fe640 1 -- 172.21.15.53:0/1729826481 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831926578 0 0) 0x7fc8680b1ac0 con 0x7fc8680cbd60 2024-09-13T18:30:21.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.638+0000 7fc86cfca640 1 --2- 172.21.15.53:0/1729826481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc8680b33b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc8680b38f0 tx=0x7fc85c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa80ea56c130bc96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc8677fe640 1 -- 172.21.15.53:0/1729826481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0ab660 con 0x7fc8680cb980 2024-09-13T18:30:21.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc8677fe640 1 -- 172.21.15.53:0/1729826481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c0ab7c0 con 0x7fc8680cb980 2024-09-13T18:30:21.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc8677fe640 1 -- 172.21.15.53:0/1729826481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0abb50 con 0x7fc8680cb980 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- 172.21.15.53:0/1729826481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 msgr2=0x7fc8680b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 --2- 172.21.15.53:0/1729826481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc8680b33b0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc8680b38f0 tx=0x7fc85c01c460 comp rx=0 tx=0).stop 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- 172.21.15.53:0/1729826481 shutdown_connections 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 --2- 172.21.15.53:0/1729826481 >> v2:172.21.15.87:3300/0 conn(0x7fc86806b850 0x7fc8680cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 --2- 172.21.15.53:0/1729826481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc8680b33b0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- 172.21.15.53:0/1729826481 >> 172.21.15.53:0/1729826481 conn(0x7fc868065c80 msgr2=0x7fc868066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- 172.21.15.53:0/1729826481 shutdown_connections 2024-09-13T18:30:21.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- 172.21.15.53:0/1729826481 wait complete. 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 Processor -- start 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- start start 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86806b850 0x7fc8681414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc868148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8680cbd60 0x7fc868149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868151c60 con 0x7fc8680cb980 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868152a50 con 0x7fc86806b850 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc868151e40 con 0x7fc8680cbd60 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc868148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc868148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58852/0 (socket says 172.21.15.53:58852) 2024-09-13T18:30:21.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 -- 172.21.15.53:0/4164037401 learned_addr learned my addr 172.21.15.53:0/4164037401 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86d7cb640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8680cbd60 0x7fc868149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86cfca640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86806b850 0x7fc8681414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 -- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8680cbd60 msgr2=0x7fc868149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8680cbd60 0x7fc868149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 -- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86806b850 msgr2=0x7fc8681414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86806b850 0x7fc8681414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 -- 172.21.15.53:0/4164037401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0094d0 con 0x7fc8680cb980 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc867fff640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc868148b20 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c7f0 tx=0x7fc85400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc8657fa640 1 -- 172.21.15.53:0/4164037401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540077c0 con 0x7fc8680cb980 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc8657fa640 1 -- 172.21.15.53:0/4164037401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854007920 con 0x7fc8680cb980 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc8657fa640 1 -- 172.21.15.53:0/4164037401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854007cd0 con 0x7fc8680cb980 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc868152120 con 0x7fc8680cb980 2024-09-13T18:30:21.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.642+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8681526e0 con 0x7fc8680cb980 2024-09-13T18:30:21.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.646+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc868067400 con 0x7fc8680cb980 2024-09-13T18:30:21.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.646+0000 7fc8657fa640 1 -- 172.21.15.53:0/4164037401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc8540113f0 con 0x7fc8680cb980 2024-09-13T18:30:21.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.646+0000 7fc8657fa640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc84c0667b0 0x7fc84c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.646+0000 7fc86cfca640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc84c0667b0 0x7fc84c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.646+0000 7fc8657fa640 1 -- 172.21.15.53:0/4164037401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc854084750 con 0x7fc8680cb980 2024-09-13T18:30:21.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.646+0000 7fc86cfca640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc84c0667b0 0x7fc84c068c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0af000 tx=0x7fc85c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.650+0000 7fc8657fa640 1 -- 172.21.15.53:0/4164037401 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc854051800 con 0x7fc8680cb980 2024-09-13T18:30:21.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.798+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8680b2810 con 0x7fc84c0667b0 2024-09-13T18:30:21.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.806+0000 7fc8657fa640 1 -- 172.21.15.53:0/4164037401 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285166 (secure 0 0 0) 0x7fc85c0bb090 con 0x7fc84c0667b0 2024-09-13T18:30:21.812 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:21.814 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:30:21.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc84c0667b0 msgr2=0x7fc84c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc84c0667b0 0x7fc84c068c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0af000 tx=0x7fc85c008040 comp rx=0 tx=0).stop 2024-09-13T18:30:21.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 msgr2=0x7fc868148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc868148b20 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c7f0 tx=0x7fc85400ccb0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 shutdown_connections 2024-09-13T18:30:21.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc84c0667b0 0x7fc84c068c70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8680cbd60 0x7fc868149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8680cb980 0x7fc868148b20 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 --2- 172.21.15.53:0/4164037401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc86806b850 0x7fc8681414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 >> 172.21.15.53:0/4164037401 conn(0x7fc868065c80 msgr2=0x7fc8680adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 shutdown_connections 2024-09-13T18:30:21.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.810+0000 7fc86f22e640 1 -- 172.21.15.53:0/4164037401 wait complete. 2024-09-13T18:30:21.829 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:30:19.824891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":274624,"kb_used_data":9296,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754700096,"statfs":{"total":773094113280,"available":772812898304,"internally_reserved":0,"allocated":9519104,"data_stored":4757058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001518"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.461818+0000","last_change":"2024-09-13T18:30:17.461818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.461818+0000","last_undegraded":"2024-09-13T18:30:17.461818+0000","last_fullsized":"2024-09-13T18:30:17.461818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:36.892959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449518+0000","last_change":"2024-09-13T18:30:17.449518+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449518+0000","last_undegraded":"2024-09-13T18:30:17.449518+0000","last_fullsized":"2024-09-13T18:30:17.449518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:42.841502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448555+0000","last_change":"2024-09-13T18:30:17.448555+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448555+0000","last_undegraded":"2024-09-13T18:30:17.448555+0000","last_fullsized":"2024-09-13T18:30:17.448555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440969+0000","last_change":"2024-09-13T18:30:17.440969+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440969+0000","last_undegraded":"2024-09-13T18:30:17.440969+0000","last_fullsized":"2024-09-13T18:30:17.440969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:14.566181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438188+0000","last_change":"2024-09-13T18:30:17.438188+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438188+0000","last_undegraded":"2024-09-13T18:30:17.438188+0000","last_fullsized":"2024-09-13T18:30:17.438188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444899+0000","last_change":"2024-09-13T18:30:17.444899+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444899+0000","last_undegraded":"2024-09-13T18:30:17.444899+0000","last_fullsized":"2024-09-13T18:30:17.444899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:47.133367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442413+0000","last_change":"2024-09-13T18:30:17.442413+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442413+0000","last_undegraded":"2024-09-13T18:30:17.442413+0000","last_fullsized":"2024-09-13T18:30:17.442413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442303+0000","last_change":"2024-09-13T18:30:17.442303+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442303+0000","last_undegraded":"2024-09-13T18:30:17.442303+0000","last_fullsized":"2024-09-13T18:30:17.442303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.412169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445210+0000","last_change":"2024-09-13T18:30:17.445210+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445210+0000","last_undegraded":"2024-09-13T18:30:17.445210+0000","last_fullsized":"2024-09-13T18:30:17.445210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446689+0000","last_change":"2024-09-13T18:30:17.446689+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446689+0000","last_undegraded":"2024-09-13T18:30:17.446689+0000","last_fullsized":"2024-09-13T18:30:17.446689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:25.340119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449397+0000","last_change":"2024-09-13T18:30:17.449397+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449397+0000","last_undegraded":"2024-09-13T18:30:17.449397+0000","last_fullsized":"2024-09-13T18:30:17.449397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:33.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.457353+0000","last_change":"2024-09-13T18:30:17.457353+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.457353+0000","last_undegraded":"2024-09-13T18:30:17.457353+0000","last_fullsized":"2024-09-13T18:30:17.457353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:17.869422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454691+0000","last_change":"2024-09-13T18:30:17.454691+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454691+0000","last_undegraded":"2024-09-13T18:30:17.454691+0000","last_fullsized":"2024-09-13T18:30:17.454691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440482+0000","last_change":"2024-09-13T18:30:17.440482+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440482+0000","last_undegraded":"2024-09-13T18:30:17.440482+0000","last_fullsized":"2024-09-13T18:30:17.440482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448148+0000","last_change":"2024-09-13T18:30:17.448148+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448148+0000","last_undegraded":"2024-09-13T18:30:17.448148+0000","last_fullsized":"2024-09-13T18:30:17.448148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:56.712509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439514+0000","last_change":"2024-09-13T18:30:17.439514+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439514+0000","last_undegraded":"2024-09-13T18:30:17.439514+0000","last_fullsized":"2024-09-13T18:30:17.439514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:19.248527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436190+0000","last_change":"2024-09-13T18:30:17.436190+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436190+0000","last_undegraded":"2024-09-13T18:30:17.436190+0000","last_fullsized":"2024-09-13T18:30:17.436190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441571+0000","last_change":"2024-09-13T18:30:17.441571+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441571+0000","last_undegraded":"2024-09-13T18:30:17.441571+0000","last_fullsized":"2024-09-13T18:30:17.441571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441812+0000","last_change":"2024-09-13T18:30:17.441812+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441812+0000","last_undegraded":"2024-09-13T18:30:17.441812+0000","last_fullsized":"2024-09-13T18:30:17.441812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440351+0000","last_change":"2024-09-13T18:30:17.440351+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440351+0000","last_undegraded":"2024-09-13T18:30:17.440351+0000","last_fullsized":"2024-09-13T18:30:17.440351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:25.520535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440746+0000","last_change":"2024-09-13T18:30:17.440746+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440746+0000","last_undegraded":"2024-09-13T18:30:17.440746+0000","last_fullsized":"2024-09-13T18:30:17.440746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.182666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450183+0000","last_change":"2024-09-13T18:30:17.450183+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450183+0000","last_undegraded":"2024-09-13T18:30:17.450183+0000","last_fullsized":"2024-09-13T18:30:17.450183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:07.120328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440569+0000","last_change":"2024-09-13T18:30:17.440569+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440569+0000","last_undegraded":"2024-09-13T18:30:17.440569+0000","last_fullsized":"2024-09-13T18:30:17.440569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.423940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448827+0000","last_change":"2024-09-13T18:30:17.448827+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448827+0000","last_undegraded":"2024-09-13T18:30:17.448827+0000","last_fullsized":"2024-09-13T18:30:17.448827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.084744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.453058+0000","last_change":"2024-09-13T18:30:17.453058+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.453058+0000","last_undegraded":"2024-09-13T18:30:17.453058+0000","last_fullsized":"2024-09-13T18:30:17.453058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439982+0000","last_change":"2024-09-13T18:30:17.439982+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439982+0000","last_undegraded":"2024-09-13T18:30:17.439982+0000","last_fullsized":"2024-09-13T18:30:17.439982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.456285+0000","last_change":"2024-09-13T18:30:17.456285+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.456285+0000","last_undegraded":"2024-09-13T18:30:17.456285+0000","last_fullsized":"2024-09-13T18:30:17.456285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:23.365461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450329+0000","last_change":"2024-09-13T18:30:17.450329+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450329+0000","last_undegraded":"2024-09-13T18:30:17.450329+0000","last_fullsized":"2024-09-13T18:30:17.450329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:34.937843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449400+0000","last_change":"2024-09-13T18:30:17.449400+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449400+0000","last_undegraded":"2024-09-13T18:30:17.449400+0000","last_fullsized":"2024-09-13T18:30:17.449400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:46.395539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435185+0000","last_change":"2024-09-13T18:30:17.435185+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435185+0000","last_undegraded":"2024-09-13T18:30:17.435185+0000","last_fullsized":"2024-09-13T18:30:17.435185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.458552+0000","last_change":"2024-09-13T18:30:17.458552+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.458552+0000","last_undegraded":"2024-09-13T18:30:17.458552+0000","last_fullsized":"2024-09-13T18:30:17.458552+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:37.191193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438520+0000","last_change":"2024-09-13T18:30:17.438520+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438520+0000","last_undegraded":"2024-09-13T18:30:17.438520+0000","last_fullsized":"2024-09-13T18:30:17.438520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475101+0000","last_change":"2024-09-13T18:30:17.465337+0000","last_active":"2024-09-13T18:30:17.475101+0000","last_peered":"2024-09-13T18:30:17.475101+0000","last_clean":"2024-09-13T18:30:17.475101+0000","last_became_active":"2024-09-13T18:30:17.463016+0000","last_became_peered":"2024-09-13T18:30:17.463016+0000","last_unstale":"2024-09-13T18:30:17.475101+0000","last_undegraded":"2024-09-13T18:30:17.475101+0000","last_fullsized":"2024-09-13T18:30:17.475101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:46.075323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.460796+0000","last_change":"2024-09-13T18:30:17.460796+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.460796+0000","last_undegraded":"2024-09-13T18:30:17.460796+0000","last_fullsized":"2024-09-13T18:30:17.460796+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:29.618508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469556+0000","last_change":"2024-09-13T18:30:17.461838+0000","last_active":"2024-09-13T18:30:17.469556+0000","last_peered":"2024-09-13T18:30:17.469556+0000","last_clean":"2024-09-13T18:30:17.469556+0000","last_became_active":"2024-09-13T18:30:17.459072+0000","last_became_peered":"2024-09-13T18:30:17.459072+0000","last_unstale":"2024-09-13T18:30:17.469556+0000","last_undegraded":"2024-09-13T18:30:17.469556+0000","last_fullsized":"2024-09-13T18:30:17.469556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:52.437657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.455122+0000","last_change":"2024-09-13T18:30:17.455122+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.455122+0000","last_undegraded":"2024-09-13T18:30:17.455122+0000","last_fullsized":"2024-09-13T18:30:17.455122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:48.577132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.455815+0000","last_change":"2024-09-13T18:30:17.451931+0000","last_active":"2024-09-13T18:30:17.455815+0000","last_peered":"2024-09-13T18:30:17.455815+0000","last_clean":"2024-09-13T18:30:17.455815+0000","last_became_active":"2024-09-13T18:30:17.451250+0000","last_became_peered":"2024-09-13T18:30:17.451250+0000","last_unstale":"2024-09-13T18:30:17.455815+0000","last_undegraded":"2024-09-13T18:30:17.455815+0000","last_fullsized":"2024-09-13T18:30:17.455815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:51.328595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447412+0000","last_change":"2024-09-13T18:30:17.447412+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447412+0000","last_undegraded":"2024-09-13T18:30:17.447412+0000","last_fullsized":"2024-09-13T18:30:17.447412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.456592+0000","last_change":"2024-09-13T18:30:17.453282+0000","last_active":"2024-09-13T18:30:17.456592+0000","last_peered":"2024-09-13T18:30:17.456592+0000","last_clean":"2024-09-13T18:30:17.456592+0000","last_became_active":"2024-09-13T18:30:17.452864+0000","last_became_peered":"2024-09-13T18:30:17.452864+0000","last_unstale":"2024-09-13T18:30:17.456592+0000","last_undegraded":"2024-09-13T18:30:17.456592+0000","last_fullsized":"2024-09-13T18:30:17.456592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:35.883538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443205+0000","last_change":"2024-09-13T18:30:17.443205+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443205+0000","last_undegraded":"2024-09-13T18:30:17.443205+0000","last_fullsized":"2024-09-13T18:30:17.443205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.468491+0000","last_change":"2024-09-13T18:30:17.449969+0000","last_active":"2024-09-13T18:30:17.468491+0000","last_peered":"2024-09-13T18:30:17.468491+0000","last_clean":"2024-09-13T18:30:17.468491+0000","last_became_active":"2024-09-13T18:30:17.449279+0000","last_became_peered":"2024-09-13T18:30:17.449279+0000","last_unstale":"2024-09-13T18:30:17.468491+0000","last_undegraded":"2024-09-13T18:30:17.468491+0000","last_fullsized":"2024-09-13T18:30:17.468491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:36.181772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435798+0000","last_change":"2024-09-13T18:30:17.435798+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435798+0000","last_undegraded":"2024-09-13T18:30:17.435798+0000","last_fullsized":"2024-09-13T18:30:17.435798+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469427+0000","last_change":"2024-09-13T18:30:17.461206+0000","last_active":"2024-09-13T18:30:17.469427+0000","last_peered":"2024-09-13T18:30:17.469427+0000","last_clean":"2024-09-13T18:30:17.469427+0000","last_became_active":"2024-09-13T18:30:17.460470+0000","last_became_peered":"2024-09-13T18:30:17.460470+0000","last_unstale":"2024-09-13T18:30:17.469427+0000","last_undegraded":"2024-09-13T18:30:17.469427+0000","last_fullsized":"2024-09-13T18:30:17.469427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474559+0000","last_change":"2024-09-13T18:30:17.474092+0000","last_active":"2024-09-13T18:30:17.474559+0000","last_peered":"2024-09-13T18:30:17.474559+0000","last_clean":"2024-09-13T18:30:17.474559+0000","last_became_active":"2024-09-13T18:30:17.473815+0000","last_became_peered":"2024-09-13T18:30:17.473815+0000","last_unstale":"2024-09-13T18:30:17.474559+0000","last_undegraded":"2024-09-13T18:30:17.474559+0000","last_fullsized":"2024-09-13T18:30:17.474559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:28.609087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447486+0000","last_change":"2024-09-13T18:30:17.447486+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447486+0000","last_undegraded":"2024-09-13T18:30:17.447486+0000","last_fullsized":"2024-09-13T18:30:17.447486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:37.194826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458389+0000","last_change":"2024-09-13T18:30:17.455292+0000","last_active":"2024-09-13T18:30:17.458389+0000","last_peered":"2024-09-13T18:30:17.458389+0000","last_clean":"2024-09-13T18:30:17.458389+0000","last_became_active":"2024-09-13T18:30:17.454937+0000","last_became_peered":"2024-09-13T18:30:17.454937+0000","last_unstale":"2024-09-13T18:30:17.458389+0000","last_undegraded":"2024-09-13T18:30:17.458389+0000","last_fullsized":"2024-09-13T18:30:17.458389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:22.782961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443246+0000","last_change":"2024-09-13T18:30:17.443246+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443246+0000","last_undegraded":"2024-09-13T18:30:17.443246+0000","last_fullsized":"2024-09-13T18:30:17.443246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:45.041871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478396+0000","last_change":"2024-09-13T18:30:17.474124+0000","last_active":"2024-09-13T18:30:17.478396+0000","last_peered":"2024-09-13T18:30:17.478396+0000","last_clean":"2024-09-13T18:30:17.478396+0000","last_became_active":"2024-09-13T18:30:17.469795+0000","last_became_peered":"2024-09-13T18:30:17.469795+0000","last_unstale":"2024-09-13T18:30:17.478396+0000","last_undegraded":"2024-09-13T18:30:17.478396+0000","last_fullsized":"2024-09-13T18:30:17.478396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:32.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443848+0000","last_change":"2024-09-13T18:30:17.443848+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443848+0000","last_undegraded":"2024-09-13T18:30:17.443848+0000","last_fullsized":"2024-09-13T18:30:17.443848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:52.338016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476975+0000","last_change":"2024-09-13T18:30:17.472015+0000","last_active":"2024-09-13T18:30:17.476975+0000","last_peered":"2024-09-13T18:30:17.476975+0000","last_clean":"2024-09-13T18:30:17.476975+0000","last_became_active":"2024-09-13T18:30:17.471329+0000","last_became_peered":"2024-09-13T18:30:17.471329+0000","last_unstale":"2024-09-13T18:30:17.476975+0000","last_undegraded":"2024-09-13T18:30:17.476975+0000","last_fullsized":"2024-09-13T18:30:17.476975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:05.307653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444732+0000","last_change":"2024-09-13T18:30:17.444732+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444732+0000","last_undegraded":"2024-09-13T18:30:17.444732+0000","last_fullsized":"2024-09-13T18:30:17.444732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476847+0000","last_change":"2024-09-13T18:30:17.470926+0000","last_active":"2024-09-13T18:30:17.476847+0000","last_peered":"2024-09-13T18:30:17.476847+0000","last_clean":"2024-09-13T18:30:17.476847+0000","last_became_active":"2024-09-13T18:30:17.470211+0000","last_became_peered":"2024-09-13T18:30:17.470211+0000","last_unstale":"2024-09-13T18:30:17.476847+0000","last_undegraded":"2024-09-13T18:30:17.476847+0000","last_fullsized":"2024-09-13T18:30:17.476847+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.832081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438897+0000","last_change":"2024-09-13T18:30:17.438897+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438897+0000","last_undegraded":"2024-09-13T18:30:17.438897+0000","last_fullsized":"2024-09-13T18:30:17.438897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.470724+0000","last_change":"2024-09-13T18:30:17.461445+0000","last_active":"2024-09-13T18:30:17.470724+0000","last_peered":"2024-09-13T18:30:17.470724+0000","last_clean":"2024-09-13T18:30:17.470724+0000","last_became_active":"2024-09-13T18:30:17.460719+0000","last_became_peered":"2024-09-13T18:30:17.460719+0000","last_unstale":"2024-09-13T18:30:17.470724+0000","last_undegraded":"2024-09-13T18:30:17.470724+0000","last_fullsized":"2024-09-13T18:30:17.470724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442120+0000","last_change":"2024-09-13T18:30:17.442120+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442120+0000","last_undegraded":"2024-09-13T18:30:17.442120+0000","last_fullsized":"2024-09-13T18:30:17.442120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458009+0000","last_change":"2024-09-13T18:30:17.452963+0000","last_active":"2024-09-13T18:30:17.458009+0000","last_peered":"2024-09-13T18:30:17.458009+0000","last_clean":"2024-09-13T18:30:17.458009+0000","last_became_active":"2024-09-13T18:30:17.452659+0000","last_became_peered":"2024-09-13T18:30:17.452659+0000","last_unstale":"2024-09-13T18:30:17.458009+0000","last_undegraded":"2024-09-13T18:30:17.458009+0000","last_fullsized":"2024-09-13T18:30:17.458009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:30.685201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448927+0000","last_change":"2024-09-13T18:30:17.448927+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448927+0000","last_undegraded":"2024-09-13T18:30:17.448927+0000","last_fullsized":"2024-09-13T18:30:17.448927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461506+0000","last_change":"2024-09-13T18:30:17.459076+0000","last_active":"2024-09-13T18:30:17.461506+0000","last_peered":"2024-09-13T18:30:17.461506+0000","last_clean":"2024-09-13T18:30:17.461506+0000","last_became_active":"2024-09-13T18:30:17.458664+0000","last_became_peered":"2024-09-13T18:30:17.458664+0000","last_unstale":"2024-09-13T18:30:17.461506+0000","last_undegraded":"2024-09-13T18:30:17.461506+0000","last_fullsized":"2024-09-13T18:30:17.461506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:57.981653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442723+0000","last_change":"2024-09-13T18:30:17.442723+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442723+0000","last_undegraded":"2024-09-13T18:30:17.442723+0000","last_fullsized":"2024-09-13T18:30:17.442723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474249+0000","last_change":"2024-09-13T18:30:17.470482+0000","last_active":"2024-09-13T18:30:17.474249+0000","last_peered":"2024-09-13T18:30:17.474249+0000","last_clean":"2024-09-13T18:30:17.474249+0000","last_became_active":"2024-09-13T18:30:17.469740+0000","last_became_peered":"2024-09-13T18:30:17.469740+0000","last_unstale":"2024-09-13T18:30:17.474249+0000","last_undegraded":"2024-09-13T18:30:17.474249+0000","last_fullsized":"2024-09-13T18:30:17.474249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444435+0000","last_change":"2024-09-13T18:30:17.444435+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444435+0000","last_undegraded":"2024-09-13T18:30:17.444435+0000","last_fullsized":"2024-09-13T18:30:17.444435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:48.836972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466100+0000","last_change":"2024-09-13T18:30:17.464881+0000","last_active":"2024-09-13T18:30:17.466100+0000","last_peered":"2024-09-13T18:30:17.466100+0000","last_clean":"2024-09-13T18:30:17.466100+0000","last_became_active":"2024-09-13T18:30:17.464384+0000","last_became_peered":"2024-09-13T18:30:17.464384+0000","last_unstale":"2024-09-13T18:30:17.466100+0000","last_undegraded":"2024-09-13T18:30:17.466100+0000","last_fullsized":"2024-09-13T18:30:17.466100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:22.742563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449896+0000","last_change":"2024-09-13T18:30:17.449896+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449896+0000","last_undegraded":"2024-09-13T18:30:17.449896+0000","last_fullsized":"2024-09-13T18:30:17.449896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478426+0000","last_change":"2024-09-13T18:30:17.474878+0000","last_active":"2024-09-13T18:30:17.478426+0000","last_peered":"2024-09-13T18:30:17.478426+0000","last_clean":"2024-09-13T18:30:17.478426+0000","last_became_active":"2024-09-13T18:30:17.472672+0000","last_became_peered":"2024-09-13T18:30:17.472672+0000","last_unstale":"2024-09-13T18:30:17.478426+0000","last_undegraded":"2024-09-13T18:30:17.478426+0000","last_fullsized":"2024-09-13T18:30:17.478426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:47.827551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448734+0000","last_change":"2024-09-13T18:30:17.448734+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448734+0000","last_undegraded":"2024-09-13T18:30:17.448734+0000","last_fullsized":"2024-09-13T18:30:17.448734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:13.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.471412+0000","last_change":"2024-09-13T18:30:17.470804+0000","last_active":"2024-09-13T18:30:17.471412+0000","last_peered":"2024-09-13T18:30:17.471412+0000","last_clean":"2024-09-13T18:30:17.471412+0000","last_became_active":"2024-09-13T18:30:17.470398+0000","last_became_peered":"2024-09-13T18:30:17.470398+0000","last_unstale":"2024-09-13T18:30:17.471412+0000","last_undegraded":"2024-09-13T18:30:17.471412+0000","last_fullsized":"2024-09-13T18:30:17.471412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:52.402748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437738+0000","last_change":"2024-09-13T18:30:17.437738+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437738+0000","last_undegraded":"2024-09-13T18:30:17.437738+0000","last_fullsized":"2024-09-13T18:30:17.437738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466115+0000","last_change":"2024-09-13T18:30:17.464795+0000","last_active":"2024-09-13T18:30:17.466115+0000","last_peered":"2024-09-13T18:30:17.466115+0000","last_clean":"2024-09-13T18:30:17.466115+0000","last_became_active":"2024-09-13T18:30:17.464223+0000","last_became_peered":"2024-09-13T18:30:17.464223+0000","last_unstale":"2024-09-13T18:30:17.466115+0000","last_undegraded":"2024-09-13T18:30:17.466115+0000","last_fullsized":"2024-09-13T18:30:17.466115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:46.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440049+0000","last_change":"2024-09-13T18:30:17.440049+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440049+0000","last_undegraded":"2024-09-13T18:30:17.440049+0000","last_fullsized":"2024-09-13T18:30:17.440049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461517+0000","last_change":"2024-09-13T18:30:17.459067+0000","last_active":"2024-09-13T18:30:17.461517+0000","last_peered":"2024-09-13T18:30:17.461517+0000","last_clean":"2024-09-13T18:30:17.461517+0000","last_became_active":"2024-09-13T18:30:17.458693+0000","last_became_peered":"2024-09-13T18:30:17.458693+0000","last_unstale":"2024-09-13T18:30:17.461517+0000","last_undegraded":"2024-09-13T18:30:17.461517+0000","last_fullsized":"2024-09-13T18:30:17.461517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442547+0000","last_change":"2024-09-13T18:30:17.442547+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442547+0000","last_undegraded":"2024-09-13T18:30:17.442547+0000","last_fullsized":"2024-09-13T18:30:17.442547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:23.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.450723+0000","last_change":"2024-09-13T18:30:17.449547+0000","last_active":"2024-09-13T18:30:17.450723+0000","last_peered":"2024-09-13T18:30:17.450723+0000","last_clean":"2024-09-13T18:30:17.450723+0000","last_became_active":"2024-09-13T18:30:17.449159+0000","last_became_peered":"2024-09-13T18:30:17.449159+0000","last_unstale":"2024-09-13T18:30:17.450723+0000","last_undegraded":"2024-09-13T18:30:17.450723+0000","last_fullsized":"2024-09-13T18:30:17.450723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:23.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439476+0000","last_change":"2024-09-13T18:30:17.439476+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439476+0000","last_undegraded":"2024-09-13T18:30:17.439476+0000","last_fullsized":"2024-09-13T18:30:17.439476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:41.845328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465034+0000","last_change":"2024-09-13T18:30:17.463039+0000","last_active":"2024-09-13T18:30:17.465034+0000","last_peered":"2024-09-13T18:30:17.465034+0000","last_clean":"2024-09-13T18:30:17.465034+0000","last_became_active":"2024-09-13T18:30:17.462645+0000","last_became_peered":"2024-09-13T18:30:17.462645+0000","last_unstale":"2024-09-13T18:30:17.465034+0000","last_undegraded":"2024-09-13T18:30:17.465034+0000","last_fullsized":"2024-09-13T18:30:17.465034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:33.468494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442507+0000","last_change":"2024-09-13T18:30:17.442507+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442507+0000","last_undegraded":"2024-09-13T18:30:17.442507+0000","last_fullsized":"2024-09-13T18:30:17.442507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:23.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.460967+0000","last_change":"2024-09-13T18:30:17.456332+0000","last_active":"2024-09-13T18:30:17.460967+0000","last_peered":"2024-09-13T18:30:17.460967+0000","last_clean":"2024-09-13T18:30:17.460967+0000","last_became_active":"2024-09-13T18:30:17.455964+0000","last_became_peered":"2024-09-13T18:30:17.455964+0000","last_unstale":"2024-09-13T18:30:17.460967+0000","last_undegraded":"2024-09-13T18:30:17.460967+0000","last_fullsized":"2024-09-13T18:30:17.460967+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.827618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437372+0000","last_change":"2024-09-13T18:30:17.437372+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437372+0000","last_undegraded":"2024-09-13T18:30:17.437372+0000","last_fullsized":"2024-09-13T18:30:17.437372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.463757+0000","last_change":"2024-09-13T18:30:17.462879+0000","last_active":"2024-09-13T18:30:17.463757+0000","last_peered":"2024-09-13T18:30:17.463757+0000","last_clean":"2024-09-13T18:30:17.463757+0000","last_became_active":"2024-09-13T18:30:17.462602+0000","last_became_peered":"2024-09-13T18:30:17.462602+0000","last_unstale":"2024-09-13T18:30:17.463757+0000","last_undegraded":"2024-09-13T18:30:17.463757+0000","last_fullsized":"2024-09-13T18:30:17.463757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:36.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454211+0000","last_change":"2024-09-13T18:30:17.454211+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454211+0000","last_undegraded":"2024-09-13T18:30:17.454211+0000","last_fullsized":"2024-09-13T18:30:17.454211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.457978+0000","last_change":"2024-09-13T18:30:17.451616+0000","last_active":"2024-09-13T18:30:17.457978+0000","last_peered":"2024-09-13T18:30:17.457978+0000","last_clean":"2024-09-13T18:30:17.457978+0000","last_became_active":"2024-09-13T18:30:17.451294+0000","last_became_peered":"2024-09-13T18:30:17.451294+0000","last_unstale":"2024-09-13T18:30:17.457978+0000","last_undegraded":"2024-09-13T18:30:17.457978+0000","last_fullsized":"2024-09-13T18:30:17.457978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:05.389105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448384+0000","last_change":"2024-09-13T18:30:17.448384+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448384+0000","last_undegraded":"2024-09-13T18:30:17.448384+0000","last_fullsized":"2024-09-13T18:30:17.448384+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.093622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466414+0000","last_change":"2024-09-13T18:30:17.461240+0000","last_active":"2024-09-13T18:30:17.466414+0000","last_peered":"2024-09-13T18:30:17.466414+0000","last_clean":"2024-09-13T18:30:17.466414+0000","last_became_active":"2024-09-13T18:30:17.460378+0000","last_became_peered":"2024-09-13T18:30:17.460378+0000","last_unstale":"2024-09-13T18:30:17.466414+0000","last_undegraded":"2024-09-13T18:30:17.466414+0000","last_fullsized":"2024-09-13T18:30:17.466414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:11.697682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436106+0000","last_change":"2024-09-13T18:30:17.436106+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436106+0000","last_undegraded":"2024-09-13T18:30:17.436106+0000","last_fullsized":"2024-09-13T18:30:17.436106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475139+0000","last_change":"2024-09-13T18:30:17.465881+0000","last_active":"2024-09-13T18:30:17.475139+0000","last_peered":"2024-09-13T18:30:17.475139+0000","last_clean":"2024-09-13T18:30:17.475139+0000","last_became_active":"2024-09-13T18:30:17.465092+0000","last_became_peered":"2024-09-13T18:30:17.465092+0000","last_unstale":"2024-09-13T18:30:17.475139+0000","last_undegraded":"2024-09-13T18:30:17.475139+0000","last_fullsized":"2024-09-13T18:30:17.475139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:33.928423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443818+0000","last_change":"2024-09-13T18:30:17.443818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443818+0000","last_undegraded":"2024-09-13T18:30:17.443818+0000","last_fullsized":"2024-09-13T18:30:17.443818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466114+0000","last_change":"2024-09-13T18:30:17.464900+0000","last_active":"2024-09-13T18:30:17.466114+0000","last_peered":"2024-09-13T18:30:17.466114+0000","last_clean":"2024-09-13T18:30:17.466114+0000","last_became_active":"2024-09-13T18:30:17.464577+0000","last_became_peered":"2024-09-13T18:30:17.464577+0000","last_unstale":"2024-09-13T18:30:17.466114+0000","last_undegraded":"2024-09-13T18:30:17.466114+0000","last_fullsized":"2024-09-13T18:30:17.466114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:11.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442776+0000","last_change":"2024-09-13T18:30:17.442776+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442776+0000","last_undegraded":"2024-09-13T18:30:17.442776+0000","last_fullsized":"2024-09-13T18:30:17.442776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469378+0000","last_change":"2024-09-13T18:30:17.458897+0000","last_active":"2024-09-13T18:30:17.469378+0000","last_peered":"2024-09-13T18:30:17.469378+0000","last_clean":"2024-09-13T18:30:17.469378+0000","last_became_active":"2024-09-13T18:30:17.458107+0000","last_became_peered":"2024-09-13T18:30:17.458107+0000","last_unstale":"2024-09-13T18:30:17.469378+0000","last_undegraded":"2024-09-13T18:30:17.469378+0000","last_fullsized":"2024-09-13T18:30:17.469378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446454+0000","last_change":"2024-09-13T18:30:17.446454+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446454+0000","last_undegraded":"2024-09-13T18:30:17.446454+0000","last_fullsized":"2024-09-13T18:30:17.446454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475165+0000","last_change":"2024-09-13T18:30:17.466750+0000","last_active":"2024-09-13T18:30:17.475165+0000","last_peered":"2024-09-13T18:30:17.475165+0000","last_clean":"2024-09-13T18:30:17.475165+0000","last_became_active":"2024-09-13T18:30:17.465572+0000","last_became_peered":"2024-09-13T18:30:17.465572+0000","last_unstale":"2024-09-13T18:30:17.475165+0000","last_undegraded":"2024-09-13T18:30:17.475165+0000","last_fullsized":"2024-09-13T18:30:17.475165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:45.386119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446420+0000","last_change":"2024-09-13T18:30:17.446420+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446420+0000","last_undegraded":"2024-09-13T18:30:17.446420+0000","last_fullsized":"2024-09-13T18:30:17.446420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:37.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.472200+0000","last_change":"2024-09-13T18:30:17.469644+0000","last_active":"2024-09-13T18:30:17.472200+0000","last_peered":"2024-09-13T18:30:17.472200+0000","last_clean":"2024-09-13T18:30:17.472200+0000","last_became_active":"2024-09-13T18:30:17.468475+0000","last_became_peered":"2024-09-13T18:30:17.468475+0000","last_unstale":"2024-09-13T18:30:17.472200+0000","last_undegraded":"2024-09-13T18:30:17.472200+0000","last_fullsized":"2024-09-13T18:30:17.472200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:28.084201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445440+0000","last_change":"2024-09-13T18:30:17.445440+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445440+0000","last_undegraded":"2024-09-13T18:30:17.445440+0000","last_fullsized":"2024-09-13T18:30:17.445440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465858+0000","last_change":"2024-09-13T18:30:17.463051+0000","last_active":"2024-09-13T18:30:17.465858+0000","last_peered":"2024-09-13T18:30:17.465858+0000","last_clean":"2024-09-13T18:30:17.465858+0000","last_became_active":"2024-09-13T18:30:17.462356+0000","last_became_peered":"2024-09-13T18:30:17.462356+0000","last_unstale":"2024-09-13T18:30:17.465858+0000","last_undegraded":"2024-09-13T18:30:17.465858+0000","last_fullsized":"2024-09-13T18:30:17.465858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:33.324949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T18:30:16.440164+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:30:16.440164+0000","last_peered":"2024-09-13T18:30:16.440164+0000","last_clean":"2024-09-13T18:30:16.440164+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:30:16.440164+0000","last_undegraded":"2024-09-13T18:30:16.440164+0000","last_fullsized":"2024-09-13T18:30:16.440164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1638400,"data_stored":1038977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.026},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94999999999999996,"15min":0.89000000000000001},"min":{"1min":0.67400000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1870000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.58899999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.278,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2849999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84199999999999997,"15min":0.80400000000000005},"min":{"1min":0.55500000000000005,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.133,"5min":1.276,"15min":1.276},"last":0.995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89800000000000002,"15min":0.88100000000000001},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.296,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.1519999999999999,"5min":1.448,"15min":1.448},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95999999999999996,"15min":0.91400000000000003},"min":{"1min":0.68400000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.256,"5min":1.397,"15min":1.397},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2210000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.01,"15min":1.04},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.877,"15min":1.877},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0069999999999999,"15min":0.98199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3180000000000001,"5min":1.321,"15min":1.321},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.68500000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.274,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.044,"15min":1},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2969999999999999,"5min":1.506,"15min":1.506},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.78700000000000003},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.56100000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.24,"5min":1.577,"15min":1.577},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.998,"5min":0.95999999999999996,"15min":0.90100000000000002},"min":{"1min":0.68899999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.218,"5min":1.464,"15min":1.464},"last":0.98099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1080000000000001,"5min":1.268,"15min":1.268},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.92800000000000005,"15min":0.97099999999999997},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88600000000000001,"15min":0.876},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.131,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.024},{"interface":"front","average":{"1min":0.875,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1040000000000001,"5min":1.306,"15min":1.306},"last":0.80900000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.67000000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.157,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.02,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":1.526},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.57699999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1950000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.627},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.036,"15min":1.0960000000000001},"min":{"1min":0.60499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.228,"5min":2.762,"15min":2.762},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.002,"15min":1.0349999999999999},"min":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.01,"15min":1.038},"min":{"1min":0.63100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":1.72,"15min":1.72},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0580000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.876,"15min":0.90600000000000003},"min":{"1min":0.46800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.165,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.105}]},{"osd":1,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.875,"15min":0.83299999999999996},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1870000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.82899999999999996},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.157,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.88100000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.27,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.149},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93000000000000005,"15min":0.96999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.383,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.72099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.349,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6719999999999999,"5min":1.871,"15min":1.871},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.92400000000000004,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98699999999999999,"15min":1.0489999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4059999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98299999999999998,"15min":1.0289999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":1.026},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0389999999999999,"15min":1.117},"min":{"1min":0.84699999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.268,"5min":2.246,"15min":2.246},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.077,"15min":1.139},"min":{"1min":0.81299999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5980000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.0209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84099999999999997,"15min":0.80600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.357,"15min":1.357},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88,"15min":0.876},"min":{"1min":0.59899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.96699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":1.536,"15min":1.536},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.88},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1859999999999999,"5min":1.323,"15min":1.323},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1379999999999999,"5min":1.476,"15min":1.476},"last":1.071},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92600000000000005,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.94599999999999995},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.72099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3240000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93100000000000005,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.234,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.095},{"interface":"front","average":{"1min":1.054,"5min":1.004,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.145}]},{"osd":7,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3640000000000001,"5min":1.482,"15min":1.482},"last":1.125},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.073},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.179}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68899999999999995,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0700000000000001,"5min":2.113,"15min":2.113},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79100000000000004,"15min":0.71899999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1619999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.97699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.095,"5min":1.704,"15min":1.704},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.61899999999999999},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0620000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.70599999999999996},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1479999999999999,"5min":1.742,"15min":1.742},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80500000000000005,"15min":0.745},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.2010000000000001,"5min":1.399,"15min":1.399},"last":1.1339999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.70699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3089999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.113},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.264,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.94499999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3260000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.04,"15min":1.069},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.272,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0640000000000001,"15min":1.054},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.6890000000000001,"5min":1.96,"15min":1.96},"last":1.256}]},{"osd":7,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0680000000000001,"15min":1.1000000000000001},"min":{"1min":0.67600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.359,"5min":3,"15min":3},"last":1.087},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0429999999999999,"15min":1.006},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1032192,"data_stored":442334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.97999999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.34000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.92900000000000005,"5min":1.335,"15min":1.335},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.41099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.423,"15min":1.423},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.101,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.77700000000000002},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2669999999999999,"5min":1.274,"15min":1.274},"last":0.314}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92200000000000004,"15min":0.90900000000000003},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1950000000000001,"5min":1.611,"15min":1.611},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.90800000000000003,"15min":0.91700000000000004},"min":{"1min":0.66200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.321,"5min":1.492,"15min":1.492},"last":0.623}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97699999999999998,"15min":1.0029999999999999},"min":{"1min":0.65600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2989999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.702,"15min":1.702},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.55400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.171,"5min":1.54,"15min":1.54},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0229999999999999,"15min":1.046},"min":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":1.452,"15min":1.452},"last":0.93200000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.109,"5min":1.657,"15min":1.657},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.071,"15min":1.0820000000000001},"min":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.375,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.81599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.876},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.60899999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0149999999999999,"5min":1.177,"15min":1.177},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.69999999999999996},"min":{"1min":0.39400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.82099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.216,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93300000000000005,"15min":0.91800000000000004},"min":{"1min":0.747,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0209999999999999,"15min":1},"min":{"1min":0.64000000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5900000000000001,"5min":1.653,"15min":1.653},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.78900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2669999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0669999999999999,"15min":1.048},"min":{"1min":0.61899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0620000000000001,"15min":1.0189999999999999},"min":{"1min":0.71299999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.323,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":1626112,"data_stored":1032702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86199999999999999,"5min":1.147,"15min":1.147},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.056,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2310000000000001,"5min":1.333,"15min":1.333},"last":1.085},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70699999999999996,"15min":0.69899999999999995},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92800000000000005,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.73799999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0209999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.94799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4710000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98999999999999999,"15min":0.996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.986,"15min":1.986},"last":1.1830000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2030000000000001,"5min":2.641,"15min":2.641},"last":1.3},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.044},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2370000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.272}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0760000000000001,"15min":1.077},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.296,"5min":1.891,"15min":1.891},"last":1.323},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0289999999999999},"min":{"1min":0.61899999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5549999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.018,"15min":1.03},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.109,"15min":1.1040000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.25}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:30:21.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:30:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f894a33d640 1 Processor -- start 2024-09-13T18:30:21.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f894a33d640 1 -- start start 2024-09-13T18:30:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f894a33d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f89441582a0 0x7f894406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f894a33d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89440713a0 0x7f894406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f894a33d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894406d480 con 0x7f894415b7c0 2024-09-13T18:30:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f894a33d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894415aaf0 con 0x7f89441582a0 2024-09-13T18:30:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f894a33d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894406d760 con 0x7f89440713a0 2024-09-13T18:30:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f89437fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f894415b7c0 0x7f8944070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60356/0 (socket says 172.21.15.53:60356) 2024-09-13T18:30:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f89437fe640 1 -- 172.21.15.53:0/3456422833 learned_addr learned my addr 172.21.15.53:0/3456422833 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:21.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8943fff640 1 --2- 172.21.15.53:0/3456422833 >> v2:172.21.15.53:3300/0 conn(0x7f89441582a0 0x7f894406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f89488da640 1 --2- 172.21.15.53:0/3456422833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89440713a0 0x7f894406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8942ffd640 1 -- 172.21.15.53:0/3456422833 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83321270 0 0) 0x7f894406d480 con 0x7f894415b7c0 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8942ffd640 1 -- 172.21.15.53:0/3456422833 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f892c003530 con 0x7f894415b7c0 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8943fff640 1 -- 172.21.15.53:0/3456422833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89440713a0 msgr2=0x7f894406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8943fff640 1 --2- 172.21.15.53:0/3456422833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89440713a0 0x7f894406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8943fff640 1 -- 172.21.15.53:0/3456422833 >> v1:172.21.15.53:6789/0 conn(0x7f894415b7c0 legacy=0x7f8944070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8942ffd640 1 -- 172.21.15.53:0/3456422833 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 572783665 0 0) 0x7f892c003530 con 0x7f894415b7c0 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f8943fff640 1 -- 172.21.15.53:0/3456422833 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894415ace0 con 0x7f89441582a0 2024-09-13T18:30:21.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.982+0000 7f89488da640 1 --2- 172.21.15.53:0/3456422833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89440713a0 0x7f894406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f8943fff640 1 --2- 172.21.15.53:0/3456422833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f894406c900 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f89340097c0 tx=0x7f893401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6fcd66246f3e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f8942ffd640 1 -- 172.21.15.53:0/3456422833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938001680 con 0x7f89441582a0 2024-09-13T18:30:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f8942ffd640 1 -- 172.21.15.53:0/3456422833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89340a7050 con 0x7f89441582a0 2024-09-13T18:30:21.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f8942ffd640 1 -- 172.21.15.53:0/3456422833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340ab620 con 0x7f89441582a0 2024-09-13T18:30:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- 172.21.15.53:0/3456422833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 msgr2=0x7f894406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 --2- 172.21.15.53:0/3456422833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f894406c900 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f89340097c0 tx=0x7f893401c390 comp rx=0 tx=0).stop 2024-09-13T18:30:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- 172.21.15.53:0/3456422833 shutdown_connections 2024-09-13T18:30:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 --2- 172.21.15.53:0/3456422833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89440713a0 0x7f894406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 --2- 172.21.15.53:0/3456422833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f894406c900 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- 172.21.15.53:0/3456422833 >> 172.21.15.53:0/3456422833 conn(0x7f8944065c80 msgr2=0x7f8944066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- 172.21.15.53:0/3456422833 shutdown_connections 2024-09-13T18:30:21.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- 172.21.15.53:0/3456422833 wait complete. 2024-09-13T18:30:21.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 Processor -- start 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- start start 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89440713a0 0x7f89441467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f8944157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894415b7c0 0x7f89440ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944146d30 con 0x7f89441582a0 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944147220 con 0x7f89440713a0 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f894a33d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894414b820 con 0x7f894415b7c0 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.986+0000 7f89437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f8944157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f8944157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58878/0 (socket says 172.21.15.53:58878) 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 -- 172.21.15.53:0/1303548791 learned_addr learned my addr 172.21.15.53:0/1303548791 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89488da640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894415b7c0 0x7f89440ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8943fff640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89440713a0 0x7f89441467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 -- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894415b7c0 msgr2=0x7f89440ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894415b7c0 0x7f89440ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 -- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89440713a0 msgr2=0x7f89441467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89440713a0 0x7f89441467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 -- 172.21.15.53:0/1303548791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934009420 con 0x7f89441582a0 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f89437fe640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f8944157280 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f893800c750 tx=0x7f893800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8940ff9640 1 -- 172.21.15.53:0/1303548791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938005ae0 con 0x7f89441582a0 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8940ff9640 1 -- 172.21.15.53:0/1303548791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938005c40 con 0x7f89441582a0 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894414bb00 con 0x7f89441582a0 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8940ff9640 1 -- 172.21.15.53:0/1303548791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938007070 con 0x7f89441582a0 2024-09-13T18:30:21.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894414c0c0 con 0x7f89441582a0 2024-09-13T18:30:21.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8944067400 con 0x7f89441582a0 2024-09-13T18:30:21.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8940ff9640 1 -- 172.21.15.53:0/1303548791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f89380071f0 con 0x7f89441582a0 2024-09-13T18:30:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8940ff9640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f89300667b0 0x7f8930068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8940ff9640 1 -- 172.21.15.53:0/1303548791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8938084150 con 0x7f89441582a0 2024-09-13T18:30:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8943fff640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f89300667b0 0x7f8930068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.990+0000 7f8943fff640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f89300667b0 0x7f8930068c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89340ad000 tx=0x7f89340a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:21.994+0000 7f8940ff9640 1 -- 172.21.15.53:0/1303548791 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89380513b0 con 0x7f89441582a0 2024-09-13T18:30:22.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.150+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89440cc580 con 0x7f89300667b0 2024-09-13T18:30:22.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.162+0000 7f8940ff9640 1 -- 172.21.15.53:0/1303548791 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285166 (secure 0 0 0) 0x7f89440cc580 con 0x7f89300667b0 2024-09-13T18:30:22.170 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:30:22.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f89300667b0 msgr2=0x7f8930068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f89300667b0 0x7f8930068c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89340ad000 tx=0x7f89340a6000 comp rx=0 tx=0).stop 2024-09-13T18:30:22.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 msgr2=0x7f8944157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f8944157280 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f893800c750 tx=0x7f893800cc10 comp rx=0 tx=0).stop 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 shutdown_connections 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f89300667b0 0x7f8930068c70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f894415b7c0 0x7f89440ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89441582a0 0x7f8944157280 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 --2- 172.21.15.53:0/1303548791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89440713a0 0x7f89441467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.166+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 >> 172.21.15.53:0/1303548791 conn(0x7f8944065c80 msgr2=0x7f8944159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.170+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 shutdown_connections 2024-09-13T18:30:22.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.170+0000 7f894a33d640 1 -- 172.21.15.53:0/1303548791 wait complete. 2024-09-13T18:30:22.188 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T18:30:21.825472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":274624,"kb_used_data":9296,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754700096,"statfs":{"total":773094113280,"available":772812898304,"internally_reserved":0,"allocated":9519104,"data_stored":4757058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.400530"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.461818+0000","last_change":"2024-09-13T18:30:17.461818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.461818+0000","last_undegraded":"2024-09-13T18:30:17.461818+0000","last_fullsized":"2024-09-13T18:30:17.461818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:36.892959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449518+0000","last_change":"2024-09-13T18:30:17.449518+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449518+0000","last_undegraded":"2024-09-13T18:30:17.449518+0000","last_fullsized":"2024-09-13T18:30:17.449518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:42.841502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448555+0000","last_change":"2024-09-13T18:30:17.448555+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448555+0000","last_undegraded":"2024-09-13T18:30:17.448555+0000","last_fullsized":"2024-09-13T18:30:17.448555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440969+0000","last_change":"2024-09-13T18:30:17.440969+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440969+0000","last_undegraded":"2024-09-13T18:30:17.440969+0000","last_fullsized":"2024-09-13T18:30:17.440969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:14.566181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438188+0000","last_change":"2024-09-13T18:30:17.438188+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438188+0000","last_undegraded":"2024-09-13T18:30:17.438188+0000","last_fullsized":"2024-09-13T18:30:17.438188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444899+0000","last_change":"2024-09-13T18:30:17.444899+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444899+0000","last_undegraded":"2024-09-13T18:30:17.444899+0000","last_fullsized":"2024-09-13T18:30:17.444899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:47.133367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442413+0000","last_change":"2024-09-13T18:30:17.442413+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442413+0000","last_undegraded":"2024-09-13T18:30:17.442413+0000","last_fullsized":"2024-09-13T18:30:17.442413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442303+0000","last_change":"2024-09-13T18:30:17.442303+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442303+0000","last_undegraded":"2024-09-13T18:30:17.442303+0000","last_fullsized":"2024-09-13T18:30:17.442303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.412169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445210+0000","last_change":"2024-09-13T18:30:17.445210+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445210+0000","last_undegraded":"2024-09-13T18:30:17.445210+0000","last_fullsized":"2024-09-13T18:30:17.445210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446689+0000","last_change":"2024-09-13T18:30:17.446689+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446689+0000","last_undegraded":"2024-09-13T18:30:17.446689+0000","last_fullsized":"2024-09-13T18:30:17.446689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:25.340119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449397+0000","last_change":"2024-09-13T18:30:17.449397+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449397+0000","last_undegraded":"2024-09-13T18:30:17.449397+0000","last_fullsized":"2024-09-13T18:30:17.449397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:33.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.457353+0000","last_change":"2024-09-13T18:30:17.457353+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.457353+0000","last_undegraded":"2024-09-13T18:30:17.457353+0000","last_fullsized":"2024-09-13T18:30:17.457353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:17.869422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454691+0000","last_change":"2024-09-13T18:30:17.454691+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454691+0000","last_undegraded":"2024-09-13T18:30:17.454691+0000","last_fullsized":"2024-09-13T18:30:17.454691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440482+0000","last_change":"2024-09-13T18:30:17.440482+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440482+0000","last_undegraded":"2024-09-13T18:30:17.440482+0000","last_fullsized":"2024-09-13T18:30:17.440482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448148+0000","last_change":"2024-09-13T18:30:17.448148+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448148+0000","last_undegraded":"2024-09-13T18:30:17.448148+0000","last_fullsized":"2024-09-13T18:30:17.448148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:56.712509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439514+0000","last_change":"2024-09-13T18:30:17.439514+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439514+0000","last_undegraded":"2024-09-13T18:30:17.439514+0000","last_fullsized":"2024-09-13T18:30:17.439514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:19.248527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436190+0000","last_change":"2024-09-13T18:30:17.436190+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436190+0000","last_undegraded":"2024-09-13T18:30:17.436190+0000","last_fullsized":"2024-09-13T18:30:17.436190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441571+0000","last_change":"2024-09-13T18:30:17.441571+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441571+0000","last_undegraded":"2024-09-13T18:30:17.441571+0000","last_fullsized":"2024-09-13T18:30:17.441571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441812+0000","last_change":"2024-09-13T18:30:17.441812+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441812+0000","last_undegraded":"2024-09-13T18:30:17.441812+0000","last_fullsized":"2024-09-13T18:30:17.441812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440351+0000","last_change":"2024-09-13T18:30:17.440351+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440351+0000","last_undegraded":"2024-09-13T18:30:17.440351+0000","last_fullsized":"2024-09-13T18:30:17.440351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:25.520535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440746+0000","last_change":"2024-09-13T18:30:17.440746+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440746+0000","last_undegraded":"2024-09-13T18:30:17.440746+0000","last_fullsized":"2024-09-13T18:30:17.440746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.182666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450183+0000","last_change":"2024-09-13T18:30:17.450183+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450183+0000","last_undegraded":"2024-09-13T18:30:17.450183+0000","last_fullsized":"2024-09-13T18:30:17.450183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:07.120328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440569+0000","last_change":"2024-09-13T18:30:17.440569+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440569+0000","last_undegraded":"2024-09-13T18:30:17.440569+0000","last_fullsized":"2024-09-13T18:30:17.440569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.423940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448827+0000","last_change":"2024-09-13T18:30:17.448827+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448827+0000","last_undegraded":"2024-09-13T18:30:17.448827+0000","last_fullsized":"2024-09-13T18:30:17.448827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.084744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.453058+0000","last_change":"2024-09-13T18:30:17.453058+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.453058+0000","last_undegraded":"2024-09-13T18:30:17.453058+0000","last_fullsized":"2024-09-13T18:30:17.453058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439982+0000","last_change":"2024-09-13T18:30:17.439982+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439982+0000","last_undegraded":"2024-09-13T18:30:17.439982+0000","last_fullsized":"2024-09-13T18:30:17.439982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.456285+0000","last_change":"2024-09-13T18:30:17.456285+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.456285+0000","last_undegraded":"2024-09-13T18:30:17.456285+0000","last_fullsized":"2024-09-13T18:30:17.456285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:23.365461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450329+0000","last_change":"2024-09-13T18:30:17.450329+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450329+0000","last_undegraded":"2024-09-13T18:30:17.450329+0000","last_fullsized":"2024-09-13T18:30:17.450329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:34.937843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449400+0000","last_change":"2024-09-13T18:30:17.449400+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449400+0000","last_undegraded":"2024-09-13T18:30:17.449400+0000","last_fullsized":"2024-09-13T18:30:17.449400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:46.395539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435185+0000","last_change":"2024-09-13T18:30:17.435185+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435185+0000","last_undegraded":"2024-09-13T18:30:17.435185+0000","last_fullsized":"2024-09-13T18:30:17.435185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.458552+0000","last_change":"2024-09-13T18:30:17.458552+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.458552+0000","last_undegraded":"2024-09-13T18:30:17.458552+0000","last_fullsized":"2024-09-13T18:30:17.458552+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:37.191193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438520+0000","last_change":"2024-09-13T18:30:17.438520+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438520+0000","last_undegraded":"2024-09-13T18:30:17.438520+0000","last_fullsized":"2024-09-13T18:30:17.438520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475101+0000","last_change":"2024-09-13T18:30:17.465337+0000","last_active":"2024-09-13T18:30:17.475101+0000","last_peered":"2024-09-13T18:30:17.475101+0000","last_clean":"2024-09-13T18:30:17.475101+0000","last_became_active":"2024-09-13T18:30:17.463016+0000","last_became_peered":"2024-09-13T18:30:17.463016+0000","last_unstale":"2024-09-13T18:30:17.475101+0000","last_undegraded":"2024-09-13T18:30:17.475101+0000","last_fullsized":"2024-09-13T18:30:17.475101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:46.075323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.460796+0000","last_change":"2024-09-13T18:30:17.460796+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.460796+0000","last_undegraded":"2024-09-13T18:30:17.460796+0000","last_fullsized":"2024-09-13T18:30:17.460796+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:29.618508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469556+0000","last_change":"2024-09-13T18:30:17.461838+0000","last_active":"2024-09-13T18:30:17.469556+0000","last_peered":"2024-09-13T18:30:17.469556+0000","last_clean":"2024-09-13T18:30:17.469556+0000","last_became_active":"2024-09-13T18:30:17.459072+0000","last_became_peered":"2024-09-13T18:30:17.459072+0000","last_unstale":"2024-09-13T18:30:17.469556+0000","last_undegraded":"2024-09-13T18:30:17.469556+0000","last_fullsized":"2024-09-13T18:30:17.469556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:52.437657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.455122+0000","last_change":"2024-09-13T18:30:17.455122+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.455122+0000","last_undegraded":"2024-09-13T18:30:17.455122+0000","last_fullsized":"2024-09-13T18:30:17.455122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:48.577132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.455815+0000","last_change":"2024-09-13T18:30:17.451931+0000","last_active":"2024-09-13T18:30:17.455815+0000","last_peered":"2024-09-13T18:30:17.455815+0000","last_clean":"2024-09-13T18:30:17.455815+0000","last_became_active":"2024-09-13T18:30:17.451250+0000","last_became_peered":"2024-09-13T18:30:17.451250+0000","last_unstale":"2024-09-13T18:30:17.455815+0000","last_undegraded":"2024-09-13T18:30:17.455815+0000","last_fullsized":"2024-09-13T18:30:17.455815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:51.328595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447412+0000","last_change":"2024-09-13T18:30:17.447412+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447412+0000","last_undegraded":"2024-09-13T18:30:17.447412+0000","last_fullsized":"2024-09-13T18:30:17.447412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.456592+0000","last_change":"2024-09-13T18:30:17.453282+0000","last_active":"2024-09-13T18:30:17.456592+0000","last_peered":"2024-09-13T18:30:17.456592+0000","last_clean":"2024-09-13T18:30:17.456592+0000","last_became_active":"2024-09-13T18:30:17.452864+0000","last_became_peered":"2024-09-13T18:30:17.452864+0000","last_unstale":"2024-09-13T18:30:17.456592+0000","last_undegraded":"2024-09-13T18:30:17.456592+0000","last_fullsized":"2024-09-13T18:30:17.456592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:35.883538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443205+0000","last_change":"2024-09-13T18:30:17.443205+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443205+0000","last_undegraded":"2024-09-13T18:30:17.443205+0000","last_fullsized":"2024-09-13T18:30:17.443205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.468491+0000","last_change":"2024-09-13T18:30:17.449969+0000","last_active":"2024-09-13T18:30:17.468491+0000","last_peered":"2024-09-13T18:30:17.468491+0000","last_clean":"2024-09-13T18:30:17.468491+0000","last_became_active":"2024-09-13T18:30:17.449279+0000","last_became_peered":"2024-09-13T18:30:17.449279+0000","last_unstale":"2024-09-13T18:30:17.468491+0000","last_undegraded":"2024-09-13T18:30:17.468491+0000","last_fullsized":"2024-09-13T18:30:17.468491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:36.181772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435798+0000","last_change":"2024-09-13T18:30:17.435798+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435798+0000","last_undegraded":"2024-09-13T18:30:17.435798+0000","last_fullsized":"2024-09-13T18:30:17.435798+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469427+0000","last_change":"2024-09-13T18:30:17.461206+0000","last_active":"2024-09-13T18:30:17.469427+0000","last_peered":"2024-09-13T18:30:17.469427+0000","last_clean":"2024-09-13T18:30:17.469427+0000","last_became_active":"2024-09-13T18:30:17.460470+0000","last_became_peered":"2024-09-13T18:30:17.460470+0000","last_unstale":"2024-09-13T18:30:17.469427+0000","last_undegraded":"2024-09-13T18:30:17.469427+0000","last_fullsized":"2024-09-13T18:30:17.469427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474559+0000","last_change":"2024-09-13T18:30:17.474092+0000","last_active":"2024-09-13T18:30:17.474559+0000","last_peered":"2024-09-13T18:30:17.474559+0000","last_clean":"2024-09-13T18:30:17.474559+0000","last_became_active":"2024-09-13T18:30:17.473815+0000","last_became_peered":"2024-09-13T18:30:17.473815+0000","last_unstale":"2024-09-13T18:30:17.474559+0000","last_undegraded":"2024-09-13T18:30:17.474559+0000","last_fullsized":"2024-09-13T18:30:17.474559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:28.609087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447486+0000","last_change":"2024-09-13T18:30:17.447486+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447486+0000","last_undegraded":"2024-09-13T18:30:17.447486+0000","last_fullsized":"2024-09-13T18:30:17.447486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:37.194826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458389+0000","last_change":"2024-09-13T18:30:17.455292+0000","last_active":"2024-09-13T18:30:17.458389+0000","last_peered":"2024-09-13T18:30:17.458389+0000","last_clean":"2024-09-13T18:30:17.458389+0000","last_became_active":"2024-09-13T18:30:17.454937+0000","last_became_peered":"2024-09-13T18:30:17.454937+0000","last_unstale":"2024-09-13T18:30:17.458389+0000","last_undegraded":"2024-09-13T18:30:17.458389+0000","last_fullsized":"2024-09-13T18:30:17.458389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:22.782961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443246+0000","last_change":"2024-09-13T18:30:17.443246+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443246+0000","last_undegraded":"2024-09-13T18:30:17.443246+0000","last_fullsized":"2024-09-13T18:30:17.443246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:45.041871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478396+0000","last_change":"2024-09-13T18:30:17.474124+0000","last_active":"2024-09-13T18:30:17.478396+0000","last_peered":"2024-09-13T18:30:17.478396+0000","last_clean":"2024-09-13T18:30:17.478396+0000","last_became_active":"2024-09-13T18:30:17.469795+0000","last_became_peered":"2024-09-13T18:30:17.469795+0000","last_unstale":"2024-09-13T18:30:17.478396+0000","last_undegraded":"2024-09-13T18:30:17.478396+0000","last_fullsized":"2024-09-13T18:30:17.478396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:32.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443848+0000","last_change":"2024-09-13T18:30:17.443848+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443848+0000","last_undegraded":"2024-09-13T18:30:17.443848+0000","last_fullsized":"2024-09-13T18:30:17.443848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:52.338016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476975+0000","last_change":"2024-09-13T18:30:17.472015+0000","last_active":"2024-09-13T18:30:17.476975+0000","last_peered":"2024-09-13T18:30:17.476975+0000","last_clean":"2024-09-13T18:30:17.476975+0000","last_became_active":"2024-09-13T18:30:17.471329+0000","last_became_peered":"2024-09-13T18:30:17.471329+0000","last_unstale":"2024-09-13T18:30:17.476975+0000","last_undegraded":"2024-09-13T18:30:17.476975+0000","last_fullsized":"2024-09-13T18:30:17.476975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:05.307653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444732+0000","last_change":"2024-09-13T18:30:17.444732+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444732+0000","last_undegraded":"2024-09-13T18:30:17.444732+0000","last_fullsized":"2024-09-13T18:30:17.444732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476847+0000","last_change":"2024-09-13T18:30:17.470926+0000","last_active":"2024-09-13T18:30:17.476847+0000","last_peered":"2024-09-13T18:30:17.476847+0000","last_clean":"2024-09-13T18:30:17.476847+0000","last_became_active":"2024-09-13T18:30:17.470211+0000","last_became_peered":"2024-09-13T18:30:17.470211+0000","last_unstale":"2024-09-13T18:30:17.476847+0000","last_undegraded":"2024-09-13T18:30:17.476847+0000","last_fullsized":"2024-09-13T18:30:17.476847+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.832081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438897+0000","last_change":"2024-09-13T18:30:17.438897+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438897+0000","last_undegraded":"2024-09-13T18:30:17.438897+0000","last_fullsized":"2024-09-13T18:30:17.438897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.470724+0000","last_change":"2024-09-13T18:30:17.461445+0000","last_active":"2024-09-13T18:30:17.470724+0000","last_peered":"2024-09-13T18:30:17.470724+0000","last_clean":"2024-09-13T18:30:17.470724+0000","last_became_active":"2024-09-13T18:30:17.460719+0000","last_became_peered":"2024-09-13T18:30:17.460719+0000","last_unstale":"2024-09-13T18:30:17.470724+0000","last_undegraded":"2024-09-13T18:30:17.470724+0000","last_fullsized":"2024-09-13T18:30:17.470724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442120+0000","last_change":"2024-09-13T18:30:17.442120+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442120+0000","last_undegraded":"2024-09-13T18:30:17.442120+0000","last_fullsized":"2024-09-13T18:30:17.442120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458009+0000","last_change":"2024-09-13T18:30:17.452963+0000","last_active":"2024-09-13T18:30:17.458009+0000","last_peered":"2024-09-13T18:30:17.458009+0000","last_clean":"2024-09-13T18:30:17.458009+0000","last_became_active":"2024-09-13T18:30:17.452659+0000","last_became_peered":"2024-09-13T18:30:17.452659+0000","last_unstale":"2024-09-13T18:30:17.458009+0000","last_undegraded":"2024-09-13T18:30:17.458009+0000","last_fullsized":"2024-09-13T18:30:17.458009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:30.685201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448927+0000","last_change":"2024-09-13T18:30:17.448927+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448927+0000","last_undegraded":"2024-09-13T18:30:17.448927+0000","last_fullsized":"2024-09-13T18:30:17.448927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461506+0000","last_change":"2024-09-13T18:30:17.459076+0000","last_active":"2024-09-13T18:30:17.461506+0000","last_peered":"2024-09-13T18:30:17.461506+0000","last_clean":"2024-09-13T18:30:17.461506+0000","last_became_active":"2024-09-13T18:30:17.458664+0000","last_became_peered":"2024-09-13T18:30:17.458664+0000","last_unstale":"2024-09-13T18:30:17.461506+0000","last_undegraded":"2024-09-13T18:30:17.461506+0000","last_fullsized":"2024-09-13T18:30:17.461506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:57.981653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442723+0000","last_change":"2024-09-13T18:30:17.442723+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442723+0000","last_undegraded":"2024-09-13T18:30:17.442723+0000","last_fullsized":"2024-09-13T18:30:17.442723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474249+0000","last_change":"2024-09-13T18:30:17.470482+0000","last_active":"2024-09-13T18:30:17.474249+0000","last_peered":"2024-09-13T18:30:17.474249+0000","last_clean":"2024-09-13T18:30:17.474249+0000","last_became_active":"2024-09-13T18:30:17.469740+0000","last_became_peered":"2024-09-13T18:30:17.469740+0000","last_unstale":"2024-09-13T18:30:17.474249+0000","last_undegraded":"2024-09-13T18:30:17.474249+0000","last_fullsized":"2024-09-13T18:30:17.474249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444435+0000","last_change":"2024-09-13T18:30:17.444435+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444435+0000","last_undegraded":"2024-09-13T18:30:17.444435+0000","last_fullsized":"2024-09-13T18:30:17.444435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:48.836972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466100+0000","last_change":"2024-09-13T18:30:17.464881+0000","last_active":"2024-09-13T18:30:17.466100+0000","last_peered":"2024-09-13T18:30:17.466100+0000","last_clean":"2024-09-13T18:30:17.466100+0000","last_became_active":"2024-09-13T18:30:17.464384+0000","last_became_peered":"2024-09-13T18:30:17.464384+0000","last_unstale":"2024-09-13T18:30:17.466100+0000","last_undegraded":"2024-09-13T18:30:17.466100+0000","last_fullsized":"2024-09-13T18:30:17.466100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:22.742563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449896+0000","last_change":"2024-09-13T18:30:17.449896+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449896+0000","last_undegraded":"2024-09-13T18:30:17.449896+0000","last_fullsized":"2024-09-13T18:30:17.449896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478426+0000","last_change":"2024-09-13T18:30:17.474878+0000","last_active":"2024-09-13T18:30:17.478426+0000","last_peered":"2024-09-13T18:30:17.478426+0000","last_clean":"2024-09-13T18:30:17.478426+0000","last_became_active":"2024-09-13T18:30:17.472672+0000","last_became_peered":"2024-09-13T18:30:17.472672+0000","last_unstale":"2024-09-13T18:30:17.478426+0000","last_undegraded":"2024-09-13T18:30:17.478426+0000","last_fullsized":"2024-09-13T18:30:17.478426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:47.827551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448734+0000","last_change":"2024-09-13T18:30:17.448734+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448734+0000","last_undegraded":"2024-09-13T18:30:17.448734+0000","last_fullsized":"2024-09-13T18:30:17.448734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:13.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.471412+0000","last_change":"2024-09-13T18:30:17.470804+0000","last_active":"2024-09-13T18:30:17.471412+0000","last_peered":"2024-09-13T18:30:17.471412+0000","last_clean":"2024-09-13T18:30:17.471412+0000","last_became_active":"2024-09-13T18:30:17.470398+0000","last_became_peered":"2024-09-13T18:30:17.470398+0000","last_unstale":"2024-09-13T18:30:17.471412+0000","last_undegraded":"2024-09-13T18:30:17.471412+0000","last_fullsized":"2024-09-13T18:30:17.471412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:52.402748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437738+0000","last_change":"2024-09-13T18:30:17.437738+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437738+0000","last_undegraded":"2024-09-13T18:30:17.437738+0000","last_fullsized":"2024-09-13T18:30:17.437738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466115+0000","last_change":"2024-09-13T18:30:17.464795+0000","last_active":"2024-09-13T18:30:17.466115+0000","last_peered":"2024-09-13T18:30:17.466115+0000","last_clean":"2024-09-13T18:30:17.466115+0000","last_became_active":"2024-09-13T18:30:17.464223+0000","last_became_peered":"2024-09-13T18:30:17.464223+0000","last_unstale":"2024-09-13T18:30:17.466115+0000","last_undegraded":"2024-09-13T18:30:17.466115+0000","last_fullsized":"2024-09-13T18:30:17.466115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:46.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440049+0000","last_change":"2024-09-13T18:30:17.440049+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440049+0000","last_undegraded":"2024-09-13T18:30:17.440049+0000","last_fullsized":"2024-09-13T18:30:17.440049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461517+0000","last_change":"2024-09-13T18:30:17.459067+0000","last_active":"2024-09-13T18:30:17.461517+0000","last_peered":"2024-09-13T18:30:17.461517+0000","last_clean":"2024-09-13T18:30:17.461517+0000","last_became_active":"2024-09-13T18:30:17.458693+0000","last_became_peered":"2024-09-13T18:30:17.458693+0000","last_unstale":"2024-09-13T18:30:17.461517+0000","last_undegraded":"2024-09-13T18:30:17.461517+0000","last_fullsized":"2024-09-13T18:30:17.461517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442547+0000","last_change":"2024-09-13T18:30:17.442547+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442547+0000","last_undegraded":"2024-09-13T18:30:17.442547+0000","last_fullsized":"2024-09-13T18:30:17.442547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:23.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.450723+0000","last_change":"2024-09-13T18:30:17.449547+0000","last_active":"2024-09-13T18:30:17.450723+0000","last_peered":"2024-09-13T18:30:17.450723+0000","last_clean":"2024-09-13T18:30:17.450723+0000","last_became_active":"2024-09-13T18:30:17.449159+0000","last_became_peered":"2024-09-13T18:30:17.449159+0000","last_unstale":"2024-09-13T18:30:17.450723+0000","last_undegraded":"2024-09-13T18:30:17.450723+0000","last_fullsized":"2024-09-13T18:30:17.450723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:23.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439476+0000","last_change":"2024-09-13T18:30:17.439476+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439476+0000","last_undegraded":"2024-09-13T18:30:17.439476+0000","last_fullsized":"2024-09-13T18:30:17.439476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:41.845328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465034+0000","last_change":"2024-09-13T18:30:17.463039+0000","last_active":"2024-09-13T18:30:17.465034+0000","last_peered":"2024-09-13T18:30:17.465034+0000","last_clean":"2024-09-13T18:30:17.465034+0000","last_became_active":"2024-09-13T18:30:17.462645+0000","last_became_peered":"2024-09-13T18:30:17.462645+0000","last_unstale":"2024-09-13T18:30:17.465034+0000","last_undegraded":"2024-09-13T18:30:17.465034+0000","last_fullsized":"2024-09-13T18:30:17.465034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:33.468494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442507+0000","last_change":"2024-09-13T18:30:17.442507+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442507+0000","last_undegraded":"2024-09-13T18:30:17.442507+0000","last_fullsized":"2024-09-13T18:30:17.442507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:23.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.460967+0000","last_change":"2024-09-13T18:30:17.456332+0000","last_active":"2024-09-13T18:30:17.460967+0000","last_peered":"2024-09-13T18:30:17.460967+0000","last_clean":"2024-09-13T18:30:17.460967+0000","last_became_active":"2024-09-13T18:30:17.455964+0000","last_became_peered":"2024-09-13T18:30:17.455964+0000","last_unstale":"2024-09-13T18:30:17.460967+0000","last_undegraded":"2024-09-13T18:30:17.460967+0000","last_fullsized":"2024-09-13T18:30:17.460967+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.827618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437372+0000","last_change":"2024-09-13T18:30:17.437372+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437372+0000","last_undegraded":"2024-09-13T18:30:17.437372+0000","last_fullsized":"2024-09-13T18:30:17.437372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.463757+0000","last_change":"2024-09-13T18:30:17.462879+0000","last_active":"2024-09-13T18:30:17.463757+0000","last_peered":"2024-09-13T18:30:17.463757+0000","last_clean":"2024-09-13T18:30:17.463757+0000","last_became_active":"2024-09-13T18:30:17.462602+0000","last_became_peered":"2024-09-13T18:30:17.462602+0000","last_unstale":"2024-09-13T18:30:17.463757+0000","last_undegraded":"2024-09-13T18:30:17.463757+0000","last_fullsized":"2024-09-13T18:30:17.463757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:36.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454211+0000","last_change":"2024-09-13T18:30:17.454211+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454211+0000","last_undegraded":"2024-09-13T18:30:17.454211+0000","last_fullsized":"2024-09-13T18:30:17.454211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.457978+0000","last_change":"2024-09-13T18:30:17.451616+0000","last_active":"2024-09-13T18:30:17.457978+0000","last_peered":"2024-09-13T18:30:17.457978+0000","last_clean":"2024-09-13T18:30:17.457978+0000","last_became_active":"2024-09-13T18:30:17.451294+0000","last_became_peered":"2024-09-13T18:30:17.451294+0000","last_unstale":"2024-09-13T18:30:17.457978+0000","last_undegraded":"2024-09-13T18:30:17.457978+0000","last_fullsized":"2024-09-13T18:30:17.457978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:05.389105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448384+0000","last_change":"2024-09-13T18:30:17.448384+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448384+0000","last_undegraded":"2024-09-13T18:30:17.448384+0000","last_fullsized":"2024-09-13T18:30:17.448384+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.093622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466414+0000","last_change":"2024-09-13T18:30:17.461240+0000","last_active":"2024-09-13T18:30:17.466414+0000","last_peered":"2024-09-13T18:30:17.466414+0000","last_clean":"2024-09-13T18:30:17.466414+0000","last_became_active":"2024-09-13T18:30:17.460378+0000","last_became_peered":"2024-09-13T18:30:17.460378+0000","last_unstale":"2024-09-13T18:30:17.466414+0000","last_undegraded":"2024-09-13T18:30:17.466414+0000","last_fullsized":"2024-09-13T18:30:17.466414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:11.697682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436106+0000","last_change":"2024-09-13T18:30:17.436106+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436106+0000","last_undegraded":"2024-09-13T18:30:17.436106+0000","last_fullsized":"2024-09-13T18:30:17.436106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475139+0000","last_change":"2024-09-13T18:30:17.465881+0000","last_active":"2024-09-13T18:30:17.475139+0000","last_peered":"2024-09-13T18:30:17.475139+0000","last_clean":"2024-09-13T18:30:17.475139+0000","last_became_active":"2024-09-13T18:30:17.465092+0000","last_became_peered":"2024-09-13T18:30:17.465092+0000","last_unstale":"2024-09-13T18:30:17.475139+0000","last_undegraded":"2024-09-13T18:30:17.475139+0000","last_fullsized":"2024-09-13T18:30:17.475139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:33.928423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443818+0000","last_change":"2024-09-13T18:30:17.443818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443818+0000","last_undegraded":"2024-09-13T18:30:17.443818+0000","last_fullsized":"2024-09-13T18:30:17.443818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466114+0000","last_change":"2024-09-13T18:30:17.464900+0000","last_active":"2024-09-13T18:30:17.466114+0000","last_peered":"2024-09-13T18:30:17.466114+0000","last_clean":"2024-09-13T18:30:17.466114+0000","last_became_active":"2024-09-13T18:30:17.464577+0000","last_became_peered":"2024-09-13T18:30:17.464577+0000","last_unstale":"2024-09-13T18:30:17.466114+0000","last_undegraded":"2024-09-13T18:30:17.466114+0000","last_fullsized":"2024-09-13T18:30:17.466114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:11.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442776+0000","last_change":"2024-09-13T18:30:17.442776+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442776+0000","last_undegraded":"2024-09-13T18:30:17.442776+0000","last_fullsized":"2024-09-13T18:30:17.442776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469378+0000","last_change":"2024-09-13T18:30:17.458897+0000","last_active":"2024-09-13T18:30:17.469378+0000","last_peered":"2024-09-13T18:30:17.469378+0000","last_clean":"2024-09-13T18:30:17.469378+0000","last_became_active":"2024-09-13T18:30:17.458107+0000","last_became_peered":"2024-09-13T18:30:17.458107+0000","last_unstale":"2024-09-13T18:30:17.469378+0000","last_undegraded":"2024-09-13T18:30:17.469378+0000","last_fullsized":"2024-09-13T18:30:17.469378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446454+0000","last_change":"2024-09-13T18:30:17.446454+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446454+0000","last_undegraded":"2024-09-13T18:30:17.446454+0000","last_fullsized":"2024-09-13T18:30:17.446454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475165+0000","last_change":"2024-09-13T18:30:17.466750+0000","last_active":"2024-09-13T18:30:17.475165+0000","last_peered":"2024-09-13T18:30:17.475165+0000","last_clean":"2024-09-13T18:30:17.475165+0000","last_became_active":"2024-09-13T18:30:17.465572+0000","last_became_peered":"2024-09-13T18:30:17.465572+0000","last_unstale":"2024-09-13T18:30:17.475165+0000","last_undegraded":"2024-09-13T18:30:17.475165+0000","last_fullsized":"2024-09-13T18:30:17.475165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:45.386119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446420+0000","last_change":"2024-09-13T18:30:17.446420+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446420+0000","last_undegraded":"2024-09-13T18:30:17.446420+0000","last_fullsized":"2024-09-13T18:30:17.446420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:37.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.472200+0000","last_change":"2024-09-13T18:30:17.469644+0000","last_active":"2024-09-13T18:30:17.472200+0000","last_peered":"2024-09-13T18:30:17.472200+0000","last_clean":"2024-09-13T18:30:17.472200+0000","last_became_active":"2024-09-13T18:30:17.468475+0000","last_became_peered":"2024-09-13T18:30:17.468475+0000","last_unstale":"2024-09-13T18:30:17.472200+0000","last_undegraded":"2024-09-13T18:30:17.472200+0000","last_fullsized":"2024-09-13T18:30:17.472200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:28.084201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445440+0000","last_change":"2024-09-13T18:30:17.445440+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445440+0000","last_undegraded":"2024-09-13T18:30:17.445440+0000","last_fullsized":"2024-09-13T18:30:17.445440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465858+0000","last_change":"2024-09-13T18:30:17.463051+0000","last_active":"2024-09-13T18:30:17.465858+0000","last_peered":"2024-09-13T18:30:17.465858+0000","last_clean":"2024-09-13T18:30:17.465858+0000","last_became_active":"2024-09-13T18:30:17.462356+0000","last_became_peered":"2024-09-13T18:30:17.462356+0000","last_unstale":"2024-09-13T18:30:17.465858+0000","last_undegraded":"2024-09-13T18:30:17.465858+0000","last_fullsized":"2024-09-13T18:30:17.465858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:33.324949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T18:30:16.440164+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:30:16.440164+0000","last_peered":"2024-09-13T18:30:16.440164+0000","last_clean":"2024-09-13T18:30:16.440164+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:30:16.440164+0000","last_undegraded":"2024-09-13T18:30:16.440164+0000","last_fullsized":"2024-09-13T18:30:16.440164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1638400,"data_stored":1038977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.026},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94999999999999996,"15min":0.89000000000000001},"min":{"1min":0.67400000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1870000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.58899999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.278,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2849999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84199999999999997,"15min":0.80400000000000005},"min":{"1min":0.55500000000000005,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.133,"5min":1.276,"15min":1.276},"last":0.995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89800000000000002,"15min":0.88100000000000001},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.296,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.1519999999999999,"5min":1.448,"15min":1.448},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95999999999999996,"15min":0.91400000000000003},"min":{"1min":0.68400000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.256,"5min":1.397,"15min":1.397},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2210000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.01,"15min":1.04},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.877,"15min":1.877},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0069999999999999,"15min":0.98199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3180000000000001,"5min":1.321,"15min":1.321},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.68500000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.274,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.044,"15min":1},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2969999999999999,"5min":1.506,"15min":1.506},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.78700000000000003},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.56100000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.24,"5min":1.577,"15min":1.577},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.998,"5min":0.95999999999999996,"15min":0.90100000000000002},"min":{"1min":0.68899999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.218,"5min":1.464,"15min":1.464},"last":0.98099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1080000000000001,"5min":1.268,"15min":1.268},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.92800000000000005,"15min":0.97099999999999997},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88600000000000001,"15min":0.876},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.131,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.024},{"interface":"front","average":{"1min":0.875,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1040000000000001,"5min":1.306,"15min":1.306},"last":0.80900000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.67000000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.157,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.02,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":1.526},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.57699999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1950000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.627},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.036,"15min":1.0960000000000001},"min":{"1min":0.60499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.228,"5min":2.762,"15min":2.762},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.002,"15min":1.0349999999999999},"min":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.01,"15min":1.038},"min":{"1min":0.63100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":1.72,"15min":1.72},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0580000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.876,"15min":0.90600000000000003},"min":{"1min":0.46800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.165,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.105}]},{"osd":1,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.875,"15min":0.83299999999999996},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1870000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.82899999999999996},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.157,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.88100000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.27,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.149},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93000000000000005,"15min":0.96999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.383,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.72099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.349,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6719999999999999,"5min":1.871,"15min":1.871},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.92400000000000004,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98699999999999999,"15min":1.0489999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4059999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98299999999999998,"15min":1.0289999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":1.026},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0389999999999999,"15min":1.117},"min":{"1min":0.84699999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.268,"5min":2.246,"15min":2.246},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.077,"15min":1.139},"min":{"1min":0.81299999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5980000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.0209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84099999999999997,"15min":0.80600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.357,"15min":1.357},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88,"15min":0.876},"min":{"1min":0.59899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.96699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":1.536,"15min":1.536},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.88},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1859999999999999,"5min":1.323,"15min":1.323},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1379999999999999,"5min":1.476,"15min":1.476},"last":1.071},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92600000000000005,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.94599999999999995},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.72099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3240000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93100000000000005,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.234,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.095},{"interface":"front","average":{"1min":1.054,"5min":1.004,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.145}]},{"osd":7,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3640000000000001,"5min":1.482,"15min":1.482},"last":1.125},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.073},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.179}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68899999999999995,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0700000000000001,"5min":2.113,"15min":2.113},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79100000000000004,"15min":0.71899999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1619999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.97699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.095,"5min":1.704,"15min":1.704},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.61899999999999999},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0620000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.70599999999999996},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1479999999999999,"5min":1.742,"15min":1.742},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80500000000000005,"15min":0.745},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.2010000000000001,"5min":1.399,"15min":1.399},"last":1.1339999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.70699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3089999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.113},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.264,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.94499999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3260000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.04,"15min":1.069},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.272,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0640000000000001,"15min":1.054},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.6890000000000001,"5min":1.96,"15min":1.96},"last":1.256}]},{"osd":7,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0680000000000001,"15min":1.1000000000000001},"min":{"1min":0.67600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.359,"5min":3,"15min":3},"last":1.087},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0429999999999999,"15min":1.006},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1032192,"data_stored":442334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.97999999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.34000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.92900000000000005,"5min":1.335,"15min":1.335},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.41099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.423,"15min":1.423},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.101,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.77700000000000002},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2669999999999999,"5min":1.274,"15min":1.274},"last":0.314}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92200000000000004,"15min":0.90900000000000003},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1950000000000001,"5min":1.611,"15min":1.611},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.90800000000000003,"15min":0.91700000000000004},"min":{"1min":0.66200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.321,"5min":1.492,"15min":1.492},"last":0.623}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97699999999999998,"15min":1.0029999999999999},"min":{"1min":0.65600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2989999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.702,"15min":1.702},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.55400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.171,"5min":1.54,"15min":1.54},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0229999999999999,"15min":1.046},"min":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":1.452,"15min":1.452},"last":0.93200000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.109,"5min":1.657,"15min":1.657},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.071,"15min":1.0820000000000001},"min":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.375,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.81599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.876},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.60899999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0149999999999999,"5min":1.177,"15min":1.177},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.69999999999999996},"min":{"1min":0.39400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.82099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.216,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93300000000000005,"15min":0.91800000000000004},"min":{"1min":0.747,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0209999999999999,"15min":1},"min":{"1min":0.64000000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5900000000000001,"5min":1.653,"15min":1.653},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.78900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2669999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0669999999999999,"15min":1.048},"min":{"1min":0.61899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0620000000000001,"15min":1.0189999999999999},"min":{"1min":0.71299999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.323,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":1626112,"data_stored":1032702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86199999999999999,"5min":1.147,"15min":1.147},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.056,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2310000000000001,"5min":1.333,"15min":1.333},"last":1.085},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70699999999999996,"15min":0.69899999999999995},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92800000000000005,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.73799999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0209999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.94799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4710000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98999999999999999,"15min":0.996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.986,"15min":1.986},"last":1.1830000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2030000000000001,"5min":2.641,"15min":2.641},"last":1.3},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.044},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2370000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.272}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0760000000000001,"15min":1.077},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.296,"5min":1.891,"15min":1.891},"last":1.323},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0289999999999999},"min":{"1min":0.61899999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5549999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.018,"15min":1.03},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.109,"15min":1.1040000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.25}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:30:22.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:30:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.354+0000 7f83d859c640 1 Processor -- start 2024-09-13T18:30:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.354+0000 7f83d859c640 1 -- start start 2024-09-13T18:30:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d859c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83d0143df0 0x7f83d0070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d859c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0066890 0x7f83d00ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d859c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d006c970 con 0x7f83d00ceaf0 2024-09-13T18:30:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d859c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d0070c90 con 0x7f83d0143df0 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d859c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0070f70 con 0x7f83d0066890 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d6338640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83d0143df0 0x7f83d0070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d6b39640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f83d00ceaf0 0x7f83d015aa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60362/0 (socket says 172.21.15.53:60362) 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d6b39640 1 -- 172.21.15.53:0/2884570734 learned_addr learned my addr 172.21.15.53:0/2884570734 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d5b37640 1 --2- 172.21.15.53:0/2884570734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0066890 0x7f83d00ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d6338640 1 -- 172.21.15.53:0/2884570734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0066890 msgr2=0x7f83d00ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d6338640 1 --2- 172.21.15.53:0/2884570734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0066890 0x7f83d00ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d6338640 1 -- 172.21.15.53:0/2884570734 >> v1:172.21.15.53:6789/0 conn(0x7f83d00ceaf0 legacy=0x7f83d015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d6338640 1 -- 172.21.15.53:0/2884570734 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0071250 con 0x7f83d0143df0 2024-09-13T18:30:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.358+0000 7f83d5336640 1 -- 172.21.15.53:0/2884570734 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759589850 0 0) 0x7f83d006c970 con 0x7f83d00ceaf0 2024-09-13T18:30:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 --2- 172.21.15.53:0/2884570734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0143df0 0x7f83d0070440 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009d90 tx=0x7f83cc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5c2e2b9c47f9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d5336640 1 -- 172.21.15.53:0/2884570734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d015b9b0 con 0x7f83d0143df0 2024-09-13T18:30:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d5336640 1 -- 172.21.15.53:0/2884570734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc0a5910 con 0x7f83d0143df0 2024-09-13T18:30:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d5336640 1 -- 172.21.15.53:0/2884570734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0a5ca0 con 0x7f83d0143df0 2024-09-13T18:30:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- 172.21.15.53:0/2884570734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0143df0 msgr2=0x7f83d0070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 --2- 172.21.15.53:0/2884570734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0143df0 0x7f83d0070440 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009d90 tx=0x7f83cc01c940 comp rx=0 tx=0).stop 2024-09-13T18:30:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- 172.21.15.53:0/2884570734 shutdown_connections 2024-09-13T18:30:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 --2- 172.21.15.53:0/2884570734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0066890 0x7f83d00ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 --2- 172.21.15.53:0/2884570734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0143df0 0x7f83d0070440 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- 172.21.15.53:0/2884570734 >> 172.21.15.53:0/2884570734 conn(0x7f83d00b1310 msgr2=0x7f83d00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- 172.21.15.53:0/2884570734 shutdown_connections 2024-09-13T18:30:22.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- 172.21.15.53:0/2884570734 wait complete. 2024-09-13T18:30:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 Processor -- start 2024-09-13T18:30:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- start start 2024-09-13T18:30:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0066890 0x7f83d015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d00ceaf0 0x7f83d00ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0143df0 0x7f83d013f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d015c580 con 0x7f83d0066890 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d015c2a0 con 0x7f83d00ceaf0 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d859c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00aca80 con 0x7f83d0143df0 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0066890 0x7f83d015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0066890 0x7f83d015bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58896/0 (socket says 172.21.15.53:58896) 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 -- 172.21.15.53:0/649356676 learned_addr learned my addr 172.21.15.53:0/649356676 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6b39640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0143df0 0x7f83d013f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d5b37640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d00ceaf0 0x7f83d00ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 -- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0143df0 msgr2=0x7f83d013f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0143df0 0x7f83d013f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 -- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d00ceaf0 msgr2=0x7f83d00ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d00ceaf0 0x7f83d00ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6338640 1 -- 172.21.15.53:0/649356676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc009a70 con 0x7f83d0066890 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.362+0000 7f83d6b39640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0143df0 0x7f83d013f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83d6338640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0066890 0x7f83d015bcc0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f83cc01a570 tx=0x7f83cc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83c6ffd640 1 -- 172.21.15.53:0/649356676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0ad850 con 0x7f83d0066890 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83c6ffd640 1 -- 172.21.15.53:0/649356676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc0ad9b0 con 0x7f83d0066890 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d00acd60 con 0x7f83d0066890 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83c6ffd640 1 -- 172.21.15.53:0/649356676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0add80 con 0x7f83d0066890 2024-09-13T18:30:22.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d015a050 con 0x7f83d0066890 2024-09-13T18:30:22.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d00ac8e0 con 0x7f83d0066890 2024-09-13T18:30:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83c6ffd640 1 -- 172.21.15.53:0/649356676 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f83cc0b4050 con 0x7f83d0066890 2024-09-13T18:30:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83c6ffd640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83b40667b0 0x7f83b4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83c6ffd640 1 -- 172.21.15.53:0/649356676 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83cc11f670 con 0x7f83d0066890 2024-09-13T18:30:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83d5b37640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83b40667b0 0x7f83b4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.366+0000 7f83d5b37640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83b40667b0 0x7f83b4068c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83d00cbc10 tx=0x7f83c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:22.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.370+0000 7f83c6ffd640 1 -- 172.21.15.53:0/649356676 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83d00ac8e0 con 0x7f83d0066890 2024-09-13T18:30:22.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.522+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83d0071e10 con 0x7f83b40667b0 2024-09-13T18:30:22.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83c6ffd640 1 -- 172.21.15.53:0/649356676 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285166 (secure 0 0 0) 0x7f83d0071e10 con 0x7f83b40667b0 2024-09-13T18:30:22.537 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:22.539 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:30:22.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83b40667b0 msgr2=0x7f83b4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83b40667b0 0x7f83b4068c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83d00cbc10 tx=0x7f83c0008040 comp rx=0 tx=0).stop 2024-09-13T18:30:22.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0066890 msgr2=0x7f83d015bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0066890 0x7f83d015bcc0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f83cc01a570 tx=0x7f83cc0196e0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 shutdown_connections 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f83b40667b0 0x7f83b4068c70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83d0143df0 0x7f83d013f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83d00ceaf0 0x7f83d00ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 --2- 172.21.15.53:0/649356676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83d0066890 0x7f83d015bcc0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.534+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 >> 172.21.15.53:0/649356676 conn(0x7f83d00b1310 msgr2=0x7f83d013d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.538+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 shutdown_connections 2024-09-13T18:30:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.538+0000 7f83d859c640 1 -- 172.21.15.53:0/649356676 wait complete. 2024-09-13T18:30:22.558 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T18:30:21.825472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":274624,"kb_used_data":9296,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754700096,"statfs":{"total":773094113280,"available":772812898304,"internally_reserved":0,"allocated":9519104,"data_stored":4757058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.400530"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.461818+0000","last_change":"2024-09-13T18:30:17.461818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.461818+0000","last_undegraded":"2024-09-13T18:30:17.461818+0000","last_fullsized":"2024-09-13T18:30:17.461818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:36.892959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449518+0000","last_change":"2024-09-13T18:30:17.449518+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449518+0000","last_undegraded":"2024-09-13T18:30:17.449518+0000","last_fullsized":"2024-09-13T18:30:17.449518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:42.841502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448555+0000","last_change":"2024-09-13T18:30:17.448555+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448555+0000","last_undegraded":"2024-09-13T18:30:17.448555+0000","last_fullsized":"2024-09-13T18:30:17.448555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440969+0000","last_change":"2024-09-13T18:30:17.440969+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440969+0000","last_undegraded":"2024-09-13T18:30:17.440969+0000","last_fullsized":"2024-09-13T18:30:17.440969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:14.566181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438188+0000","last_change":"2024-09-13T18:30:17.438188+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438188+0000","last_undegraded":"2024-09-13T18:30:17.438188+0000","last_fullsized":"2024-09-13T18:30:17.438188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444899+0000","last_change":"2024-09-13T18:30:17.444899+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444899+0000","last_undegraded":"2024-09-13T18:30:17.444899+0000","last_fullsized":"2024-09-13T18:30:17.444899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:47.133367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442413+0000","last_change":"2024-09-13T18:30:17.442413+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442413+0000","last_undegraded":"2024-09-13T18:30:17.442413+0000","last_fullsized":"2024-09-13T18:30:17.442413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442303+0000","last_change":"2024-09-13T18:30:17.442303+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442303+0000","last_undegraded":"2024-09-13T18:30:17.442303+0000","last_fullsized":"2024-09-13T18:30:17.442303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.412169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445210+0000","last_change":"2024-09-13T18:30:17.445210+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445210+0000","last_undegraded":"2024-09-13T18:30:17.445210+0000","last_fullsized":"2024-09-13T18:30:17.445210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446689+0000","last_change":"2024-09-13T18:30:17.446689+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446689+0000","last_undegraded":"2024-09-13T18:30:17.446689+0000","last_fullsized":"2024-09-13T18:30:17.446689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:25.340119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449397+0000","last_change":"2024-09-13T18:30:17.449397+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449397+0000","last_undegraded":"2024-09-13T18:30:17.449397+0000","last_fullsized":"2024-09-13T18:30:17.449397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:33.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.457353+0000","last_change":"2024-09-13T18:30:17.457353+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.457353+0000","last_undegraded":"2024-09-13T18:30:17.457353+0000","last_fullsized":"2024-09-13T18:30:17.457353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:17.869422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454691+0000","last_change":"2024-09-13T18:30:17.454691+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454691+0000","last_undegraded":"2024-09-13T18:30:17.454691+0000","last_fullsized":"2024-09-13T18:30:17.454691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440482+0000","last_change":"2024-09-13T18:30:17.440482+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440482+0000","last_undegraded":"2024-09-13T18:30:17.440482+0000","last_fullsized":"2024-09-13T18:30:17.440482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448148+0000","last_change":"2024-09-13T18:30:17.448148+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448148+0000","last_undegraded":"2024-09-13T18:30:17.448148+0000","last_fullsized":"2024-09-13T18:30:17.448148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:56.712509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439514+0000","last_change":"2024-09-13T18:30:17.439514+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439514+0000","last_undegraded":"2024-09-13T18:30:17.439514+0000","last_fullsized":"2024-09-13T18:30:17.439514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:19.248527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436190+0000","last_change":"2024-09-13T18:30:17.436190+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436190+0000","last_undegraded":"2024-09-13T18:30:17.436190+0000","last_fullsized":"2024-09-13T18:30:17.436190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441571+0000","last_change":"2024-09-13T18:30:17.441571+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441571+0000","last_undegraded":"2024-09-13T18:30:17.441571+0000","last_fullsized":"2024-09-13T18:30:17.441571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441812+0000","last_change":"2024-09-13T18:30:17.441812+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441812+0000","last_undegraded":"2024-09-13T18:30:17.441812+0000","last_fullsized":"2024-09-13T18:30:17.441812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440351+0000","last_change":"2024-09-13T18:30:17.440351+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440351+0000","last_undegraded":"2024-09-13T18:30:17.440351+0000","last_fullsized":"2024-09-13T18:30:17.440351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:25.520535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440746+0000","last_change":"2024-09-13T18:30:17.440746+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440746+0000","last_undegraded":"2024-09-13T18:30:17.440746+0000","last_fullsized":"2024-09-13T18:30:17.440746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.182666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450183+0000","last_change":"2024-09-13T18:30:17.450183+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450183+0000","last_undegraded":"2024-09-13T18:30:17.450183+0000","last_fullsized":"2024-09-13T18:30:17.450183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:07.120328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440569+0000","last_change":"2024-09-13T18:30:17.440569+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440569+0000","last_undegraded":"2024-09-13T18:30:17.440569+0000","last_fullsized":"2024-09-13T18:30:17.440569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.423940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448827+0000","last_change":"2024-09-13T18:30:17.448827+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448827+0000","last_undegraded":"2024-09-13T18:30:17.448827+0000","last_fullsized":"2024-09-13T18:30:17.448827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.084744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.453058+0000","last_change":"2024-09-13T18:30:17.453058+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.453058+0000","last_undegraded":"2024-09-13T18:30:17.453058+0000","last_fullsized":"2024-09-13T18:30:17.453058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439982+0000","last_change":"2024-09-13T18:30:17.439982+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439982+0000","last_undegraded":"2024-09-13T18:30:17.439982+0000","last_fullsized":"2024-09-13T18:30:17.439982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.456285+0000","last_change":"2024-09-13T18:30:17.456285+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.456285+0000","last_undegraded":"2024-09-13T18:30:17.456285+0000","last_fullsized":"2024-09-13T18:30:17.456285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:23.365461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450329+0000","last_change":"2024-09-13T18:30:17.450329+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450329+0000","last_undegraded":"2024-09-13T18:30:17.450329+0000","last_fullsized":"2024-09-13T18:30:17.450329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:34.937843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449400+0000","last_change":"2024-09-13T18:30:17.449400+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449400+0000","last_undegraded":"2024-09-13T18:30:17.449400+0000","last_fullsized":"2024-09-13T18:30:17.449400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:46.395539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435185+0000","last_change":"2024-09-13T18:30:17.435185+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435185+0000","last_undegraded":"2024-09-13T18:30:17.435185+0000","last_fullsized":"2024-09-13T18:30:17.435185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.458552+0000","last_change":"2024-09-13T18:30:17.458552+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.458552+0000","last_undegraded":"2024-09-13T18:30:17.458552+0000","last_fullsized":"2024-09-13T18:30:17.458552+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:37.191193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438520+0000","last_change":"2024-09-13T18:30:17.438520+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438520+0000","last_undegraded":"2024-09-13T18:30:17.438520+0000","last_fullsized":"2024-09-13T18:30:17.438520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475101+0000","last_change":"2024-09-13T18:30:17.465337+0000","last_active":"2024-09-13T18:30:17.475101+0000","last_peered":"2024-09-13T18:30:17.475101+0000","last_clean":"2024-09-13T18:30:17.475101+0000","last_became_active":"2024-09-13T18:30:17.463016+0000","last_became_peered":"2024-09-13T18:30:17.463016+0000","last_unstale":"2024-09-13T18:30:17.475101+0000","last_undegraded":"2024-09-13T18:30:17.475101+0000","last_fullsized":"2024-09-13T18:30:17.475101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:46.075323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.460796+0000","last_change":"2024-09-13T18:30:17.460796+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.460796+0000","last_undegraded":"2024-09-13T18:30:17.460796+0000","last_fullsized":"2024-09-13T18:30:17.460796+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:29.618508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469556+0000","last_change":"2024-09-13T18:30:17.461838+0000","last_active":"2024-09-13T18:30:17.469556+0000","last_peered":"2024-09-13T18:30:17.469556+0000","last_clean":"2024-09-13T18:30:17.469556+0000","last_became_active":"2024-09-13T18:30:17.459072+0000","last_became_peered":"2024-09-13T18:30:17.459072+0000","last_unstale":"2024-09-13T18:30:17.469556+0000","last_undegraded":"2024-09-13T18:30:17.469556+0000","last_fullsized":"2024-09-13T18:30:17.469556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:52.437657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.455122+0000","last_change":"2024-09-13T18:30:17.455122+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.455122+0000","last_undegraded":"2024-09-13T18:30:17.455122+0000","last_fullsized":"2024-09-13T18:30:17.455122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:48.577132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.455815+0000","last_change":"2024-09-13T18:30:17.451931+0000","last_active":"2024-09-13T18:30:17.455815+0000","last_peered":"2024-09-13T18:30:17.455815+0000","last_clean":"2024-09-13T18:30:17.455815+0000","last_became_active":"2024-09-13T18:30:17.451250+0000","last_became_peered":"2024-09-13T18:30:17.451250+0000","last_unstale":"2024-09-13T18:30:17.455815+0000","last_undegraded":"2024-09-13T18:30:17.455815+0000","last_fullsized":"2024-09-13T18:30:17.455815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:51.328595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447412+0000","last_change":"2024-09-13T18:30:17.447412+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447412+0000","last_undegraded":"2024-09-13T18:30:17.447412+0000","last_fullsized":"2024-09-13T18:30:17.447412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.456592+0000","last_change":"2024-09-13T18:30:17.453282+0000","last_active":"2024-09-13T18:30:17.456592+0000","last_peered":"2024-09-13T18:30:17.456592+0000","last_clean":"2024-09-13T18:30:17.456592+0000","last_became_active":"2024-09-13T18:30:17.452864+0000","last_became_peered":"2024-09-13T18:30:17.452864+0000","last_unstale":"2024-09-13T18:30:17.456592+0000","last_undegraded":"2024-09-13T18:30:17.456592+0000","last_fullsized":"2024-09-13T18:30:17.456592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:35.883538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443205+0000","last_change":"2024-09-13T18:30:17.443205+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443205+0000","last_undegraded":"2024-09-13T18:30:17.443205+0000","last_fullsized":"2024-09-13T18:30:17.443205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.468491+0000","last_change":"2024-09-13T18:30:17.449969+0000","last_active":"2024-09-13T18:30:17.468491+0000","last_peered":"2024-09-13T18:30:17.468491+0000","last_clean":"2024-09-13T18:30:17.468491+0000","last_became_active":"2024-09-13T18:30:17.449279+0000","last_became_peered":"2024-09-13T18:30:17.449279+0000","last_unstale":"2024-09-13T18:30:17.468491+0000","last_undegraded":"2024-09-13T18:30:17.468491+0000","last_fullsized":"2024-09-13T18:30:17.468491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:36.181772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435798+0000","last_change":"2024-09-13T18:30:17.435798+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435798+0000","last_undegraded":"2024-09-13T18:30:17.435798+0000","last_fullsized":"2024-09-13T18:30:17.435798+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469427+0000","last_change":"2024-09-13T18:30:17.461206+0000","last_active":"2024-09-13T18:30:17.469427+0000","last_peered":"2024-09-13T18:30:17.469427+0000","last_clean":"2024-09-13T18:30:17.469427+0000","last_became_active":"2024-09-13T18:30:17.460470+0000","last_became_peered":"2024-09-13T18:30:17.460470+0000","last_unstale":"2024-09-13T18:30:17.469427+0000","last_undegraded":"2024-09-13T18:30:17.469427+0000","last_fullsized":"2024-09-13T18:30:17.469427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474559+0000","last_change":"2024-09-13T18:30:17.474092+0000","last_active":"2024-09-13T18:30:17.474559+0000","last_peered":"2024-09-13T18:30:17.474559+0000","last_clean":"2024-09-13T18:30:17.474559+0000","last_became_active":"2024-09-13T18:30:17.473815+0000","last_became_peered":"2024-09-13T18:30:17.473815+0000","last_unstale":"2024-09-13T18:30:17.474559+0000","last_undegraded":"2024-09-13T18:30:17.474559+0000","last_fullsized":"2024-09-13T18:30:17.474559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:28.609087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447486+0000","last_change":"2024-09-13T18:30:17.447486+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447486+0000","last_undegraded":"2024-09-13T18:30:17.447486+0000","last_fullsized":"2024-09-13T18:30:17.447486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:37.194826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458389+0000","last_change":"2024-09-13T18:30:17.455292+0000","last_active":"2024-09-13T18:30:17.458389+0000","last_peered":"2024-09-13T18:30:17.458389+0000","last_clean":"2024-09-13T18:30:17.458389+0000","last_became_active":"2024-09-13T18:30:17.454937+0000","last_became_peered":"2024-09-13T18:30:17.454937+0000","last_unstale":"2024-09-13T18:30:17.458389+0000","last_undegraded":"2024-09-13T18:30:17.458389+0000","last_fullsized":"2024-09-13T18:30:17.458389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:22.782961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443246+0000","last_change":"2024-09-13T18:30:17.443246+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443246+0000","last_undegraded":"2024-09-13T18:30:17.443246+0000","last_fullsized":"2024-09-13T18:30:17.443246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:45.041871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478396+0000","last_change":"2024-09-13T18:30:17.474124+0000","last_active":"2024-09-13T18:30:17.478396+0000","last_peered":"2024-09-13T18:30:17.478396+0000","last_clean":"2024-09-13T18:30:17.478396+0000","last_became_active":"2024-09-13T18:30:17.469795+0000","last_became_peered":"2024-09-13T18:30:17.469795+0000","last_unstale":"2024-09-13T18:30:17.478396+0000","last_undegraded":"2024-09-13T18:30:17.478396+0000","last_fullsized":"2024-09-13T18:30:17.478396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:32.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443848+0000","last_change":"2024-09-13T18:30:17.443848+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443848+0000","last_undegraded":"2024-09-13T18:30:17.443848+0000","last_fullsized":"2024-09-13T18:30:17.443848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:52.338016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476975+0000","last_change":"2024-09-13T18:30:17.472015+0000","last_active":"2024-09-13T18:30:17.476975+0000","last_peered":"2024-09-13T18:30:17.476975+0000","last_clean":"2024-09-13T18:30:17.476975+0000","last_became_active":"2024-09-13T18:30:17.471329+0000","last_became_peered":"2024-09-13T18:30:17.471329+0000","last_unstale":"2024-09-13T18:30:17.476975+0000","last_undegraded":"2024-09-13T18:30:17.476975+0000","last_fullsized":"2024-09-13T18:30:17.476975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:05.307653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444732+0000","last_change":"2024-09-13T18:30:17.444732+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444732+0000","last_undegraded":"2024-09-13T18:30:17.444732+0000","last_fullsized":"2024-09-13T18:30:17.444732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476847+0000","last_change":"2024-09-13T18:30:17.470926+0000","last_active":"2024-09-13T18:30:17.476847+0000","last_peered":"2024-09-13T18:30:17.476847+0000","last_clean":"2024-09-13T18:30:17.476847+0000","last_became_active":"2024-09-13T18:30:17.470211+0000","last_became_peered":"2024-09-13T18:30:17.470211+0000","last_unstale":"2024-09-13T18:30:17.476847+0000","last_undegraded":"2024-09-13T18:30:17.476847+0000","last_fullsized":"2024-09-13T18:30:17.476847+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.832081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438897+0000","last_change":"2024-09-13T18:30:17.438897+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438897+0000","last_undegraded":"2024-09-13T18:30:17.438897+0000","last_fullsized":"2024-09-13T18:30:17.438897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.470724+0000","last_change":"2024-09-13T18:30:17.461445+0000","last_active":"2024-09-13T18:30:17.470724+0000","last_peered":"2024-09-13T18:30:17.470724+0000","last_clean":"2024-09-13T18:30:17.470724+0000","last_became_active":"2024-09-13T18:30:17.460719+0000","last_became_peered":"2024-09-13T18:30:17.460719+0000","last_unstale":"2024-09-13T18:30:17.470724+0000","last_undegraded":"2024-09-13T18:30:17.470724+0000","last_fullsized":"2024-09-13T18:30:17.470724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442120+0000","last_change":"2024-09-13T18:30:17.442120+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442120+0000","last_undegraded":"2024-09-13T18:30:17.442120+0000","last_fullsized":"2024-09-13T18:30:17.442120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458009+0000","last_change":"2024-09-13T18:30:17.452963+0000","last_active":"2024-09-13T18:30:17.458009+0000","last_peered":"2024-09-13T18:30:17.458009+0000","last_clean":"2024-09-13T18:30:17.458009+0000","last_became_active":"2024-09-13T18:30:17.452659+0000","last_became_peered":"2024-09-13T18:30:17.452659+0000","last_unstale":"2024-09-13T18:30:17.458009+0000","last_undegraded":"2024-09-13T18:30:17.458009+0000","last_fullsized":"2024-09-13T18:30:17.458009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:30.685201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448927+0000","last_change":"2024-09-13T18:30:17.448927+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448927+0000","last_undegraded":"2024-09-13T18:30:17.448927+0000","last_fullsized":"2024-09-13T18:30:17.448927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461506+0000","last_change":"2024-09-13T18:30:17.459076+0000","last_active":"2024-09-13T18:30:17.461506+0000","last_peered":"2024-09-13T18:30:17.461506+0000","last_clean":"2024-09-13T18:30:17.461506+0000","last_became_active":"2024-09-13T18:30:17.458664+0000","last_became_peered":"2024-09-13T18:30:17.458664+0000","last_unstale":"2024-09-13T18:30:17.461506+0000","last_undegraded":"2024-09-13T18:30:17.461506+0000","last_fullsized":"2024-09-13T18:30:17.461506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:57.981653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442723+0000","last_change":"2024-09-13T18:30:17.442723+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442723+0000","last_undegraded":"2024-09-13T18:30:17.442723+0000","last_fullsized":"2024-09-13T18:30:17.442723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474249+0000","last_change":"2024-09-13T18:30:17.470482+0000","last_active":"2024-09-13T18:30:17.474249+0000","last_peered":"2024-09-13T18:30:17.474249+0000","last_clean":"2024-09-13T18:30:17.474249+0000","last_became_active":"2024-09-13T18:30:17.469740+0000","last_became_peered":"2024-09-13T18:30:17.469740+0000","last_unstale":"2024-09-13T18:30:17.474249+0000","last_undegraded":"2024-09-13T18:30:17.474249+0000","last_fullsized":"2024-09-13T18:30:17.474249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444435+0000","last_change":"2024-09-13T18:30:17.444435+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444435+0000","last_undegraded":"2024-09-13T18:30:17.444435+0000","last_fullsized":"2024-09-13T18:30:17.444435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:48.836972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466100+0000","last_change":"2024-09-13T18:30:17.464881+0000","last_active":"2024-09-13T18:30:17.466100+0000","last_peered":"2024-09-13T18:30:17.466100+0000","last_clean":"2024-09-13T18:30:17.466100+0000","last_became_active":"2024-09-13T18:30:17.464384+0000","last_became_peered":"2024-09-13T18:30:17.464384+0000","last_unstale":"2024-09-13T18:30:17.466100+0000","last_undegraded":"2024-09-13T18:30:17.466100+0000","last_fullsized":"2024-09-13T18:30:17.466100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:22.742563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449896+0000","last_change":"2024-09-13T18:30:17.449896+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449896+0000","last_undegraded":"2024-09-13T18:30:17.449896+0000","last_fullsized":"2024-09-13T18:30:17.449896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478426+0000","last_change":"2024-09-13T18:30:17.474878+0000","last_active":"2024-09-13T18:30:17.478426+0000","last_peered":"2024-09-13T18:30:17.478426+0000","last_clean":"2024-09-13T18:30:17.478426+0000","last_became_active":"2024-09-13T18:30:17.472672+0000","last_became_peered":"2024-09-13T18:30:17.472672+0000","last_unstale":"2024-09-13T18:30:17.478426+0000","last_undegraded":"2024-09-13T18:30:17.478426+0000","last_fullsized":"2024-09-13T18:30:17.478426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:47.827551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448734+0000","last_change":"2024-09-13T18:30:17.448734+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448734+0000","last_undegraded":"2024-09-13T18:30:17.448734+0000","last_fullsized":"2024-09-13T18:30:17.448734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:13.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.471412+0000","last_change":"2024-09-13T18:30:17.470804+0000","last_active":"2024-09-13T18:30:17.471412+0000","last_peered":"2024-09-13T18:30:17.471412+0000","last_clean":"2024-09-13T18:30:17.471412+0000","last_became_active":"2024-09-13T18:30:17.470398+0000","last_became_peered":"2024-09-13T18:30:17.470398+0000","last_unstale":"2024-09-13T18:30:17.471412+0000","last_undegraded":"2024-09-13T18:30:17.471412+0000","last_fullsized":"2024-09-13T18:30:17.471412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:52.402748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437738+0000","last_change":"2024-09-13T18:30:17.437738+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437738+0000","last_undegraded":"2024-09-13T18:30:17.437738+0000","last_fullsized":"2024-09-13T18:30:17.437738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466115+0000","last_change":"2024-09-13T18:30:17.464795+0000","last_active":"2024-09-13T18:30:17.466115+0000","last_peered":"2024-09-13T18:30:17.466115+0000","last_clean":"2024-09-13T18:30:17.466115+0000","last_became_active":"2024-09-13T18:30:17.464223+0000","last_became_peered":"2024-09-13T18:30:17.464223+0000","last_unstale":"2024-09-13T18:30:17.466115+0000","last_undegraded":"2024-09-13T18:30:17.466115+0000","last_fullsized":"2024-09-13T18:30:17.466115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:46.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440049+0000","last_change":"2024-09-13T18:30:17.440049+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440049+0000","last_undegraded":"2024-09-13T18:30:17.440049+0000","last_fullsized":"2024-09-13T18:30:17.440049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461517+0000","last_change":"2024-09-13T18:30:17.459067+0000","last_active":"2024-09-13T18:30:17.461517+0000","last_peered":"2024-09-13T18:30:17.461517+0000","last_clean":"2024-09-13T18:30:17.461517+0000","last_became_active":"2024-09-13T18:30:17.458693+0000","last_became_peered":"2024-09-13T18:30:17.458693+0000","last_unstale":"2024-09-13T18:30:17.461517+0000","last_undegraded":"2024-09-13T18:30:17.461517+0000","last_fullsized":"2024-09-13T18:30:17.461517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442547+0000","last_change":"2024-09-13T18:30:17.442547+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442547+0000","last_undegraded":"2024-09-13T18:30:17.442547+0000","last_fullsized":"2024-09-13T18:30:17.442547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:23.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.450723+0000","last_change":"2024-09-13T18:30:17.449547+0000","last_active":"2024-09-13T18:30:17.450723+0000","last_peered":"2024-09-13T18:30:17.450723+0000","last_clean":"2024-09-13T18:30:17.450723+0000","last_became_active":"2024-09-13T18:30:17.449159+0000","last_became_peered":"2024-09-13T18:30:17.449159+0000","last_unstale":"2024-09-13T18:30:17.450723+0000","last_undegraded":"2024-09-13T18:30:17.450723+0000","last_fullsized":"2024-09-13T18:30:17.450723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:23.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439476+0000","last_change":"2024-09-13T18:30:17.439476+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439476+0000","last_undegraded":"2024-09-13T18:30:17.439476+0000","last_fullsized":"2024-09-13T18:30:17.439476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:41.845328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465034+0000","last_change":"2024-09-13T18:30:17.463039+0000","last_active":"2024-09-13T18:30:17.465034+0000","last_peered":"2024-09-13T18:30:17.465034+0000","last_clean":"2024-09-13T18:30:17.465034+0000","last_became_active":"2024-09-13T18:30:17.462645+0000","last_became_peered":"2024-09-13T18:30:17.462645+0000","last_unstale":"2024-09-13T18:30:17.465034+0000","last_undegraded":"2024-09-13T18:30:17.465034+0000","last_fullsized":"2024-09-13T18:30:17.465034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:33.468494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442507+0000","last_change":"2024-09-13T18:30:17.442507+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442507+0000","last_undegraded":"2024-09-13T18:30:17.442507+0000","last_fullsized":"2024-09-13T18:30:17.442507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:23.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.460967+0000","last_change":"2024-09-13T18:30:17.456332+0000","last_active":"2024-09-13T18:30:17.460967+0000","last_peered":"2024-09-13T18:30:17.460967+0000","last_clean":"2024-09-13T18:30:17.460967+0000","last_became_active":"2024-09-13T18:30:17.455964+0000","last_became_peered":"2024-09-13T18:30:17.455964+0000","last_unstale":"2024-09-13T18:30:17.460967+0000","last_undegraded":"2024-09-13T18:30:17.460967+0000","last_fullsized":"2024-09-13T18:30:17.460967+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.827618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437372+0000","last_change":"2024-09-13T18:30:17.437372+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437372+0000","last_undegraded":"2024-09-13T18:30:17.437372+0000","last_fullsized":"2024-09-13T18:30:17.437372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.463757+0000","last_change":"2024-09-13T18:30:17.462879+0000","last_active":"2024-09-13T18:30:17.463757+0000","last_peered":"2024-09-13T18:30:17.463757+0000","last_clean":"2024-09-13T18:30:17.463757+0000","last_became_active":"2024-09-13T18:30:17.462602+0000","last_became_peered":"2024-09-13T18:30:17.462602+0000","last_unstale":"2024-09-13T18:30:17.463757+0000","last_undegraded":"2024-09-13T18:30:17.463757+0000","last_fullsized":"2024-09-13T18:30:17.463757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:36.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454211+0000","last_change":"2024-09-13T18:30:17.454211+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454211+0000","last_undegraded":"2024-09-13T18:30:17.454211+0000","last_fullsized":"2024-09-13T18:30:17.454211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.457978+0000","last_change":"2024-09-13T18:30:17.451616+0000","last_active":"2024-09-13T18:30:17.457978+0000","last_peered":"2024-09-13T18:30:17.457978+0000","last_clean":"2024-09-13T18:30:17.457978+0000","last_became_active":"2024-09-13T18:30:17.451294+0000","last_became_peered":"2024-09-13T18:30:17.451294+0000","last_unstale":"2024-09-13T18:30:17.457978+0000","last_undegraded":"2024-09-13T18:30:17.457978+0000","last_fullsized":"2024-09-13T18:30:17.457978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:05.389105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448384+0000","last_change":"2024-09-13T18:30:17.448384+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448384+0000","last_undegraded":"2024-09-13T18:30:17.448384+0000","last_fullsized":"2024-09-13T18:30:17.448384+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.093622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466414+0000","last_change":"2024-09-13T18:30:17.461240+0000","last_active":"2024-09-13T18:30:17.466414+0000","last_peered":"2024-09-13T18:30:17.466414+0000","last_clean":"2024-09-13T18:30:17.466414+0000","last_became_active":"2024-09-13T18:30:17.460378+0000","last_became_peered":"2024-09-13T18:30:17.460378+0000","last_unstale":"2024-09-13T18:30:17.466414+0000","last_undegraded":"2024-09-13T18:30:17.466414+0000","last_fullsized":"2024-09-13T18:30:17.466414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:11.697682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436106+0000","last_change":"2024-09-13T18:30:17.436106+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436106+0000","last_undegraded":"2024-09-13T18:30:17.436106+0000","last_fullsized":"2024-09-13T18:30:17.436106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475139+0000","last_change":"2024-09-13T18:30:17.465881+0000","last_active":"2024-09-13T18:30:17.475139+0000","last_peered":"2024-09-13T18:30:17.475139+0000","last_clean":"2024-09-13T18:30:17.475139+0000","last_became_active":"2024-09-13T18:30:17.465092+0000","last_became_peered":"2024-09-13T18:30:17.465092+0000","last_unstale":"2024-09-13T18:30:17.475139+0000","last_undegraded":"2024-09-13T18:30:17.475139+0000","last_fullsized":"2024-09-13T18:30:17.475139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:33.928423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443818+0000","last_change":"2024-09-13T18:30:17.443818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443818+0000","last_undegraded":"2024-09-13T18:30:17.443818+0000","last_fullsized":"2024-09-13T18:30:17.443818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466114+0000","last_change":"2024-09-13T18:30:17.464900+0000","last_active":"2024-09-13T18:30:17.466114+0000","last_peered":"2024-09-13T18:30:17.466114+0000","last_clean":"2024-09-13T18:30:17.466114+0000","last_became_active":"2024-09-13T18:30:17.464577+0000","last_became_peered":"2024-09-13T18:30:17.464577+0000","last_unstale":"2024-09-13T18:30:17.466114+0000","last_undegraded":"2024-09-13T18:30:17.466114+0000","last_fullsized":"2024-09-13T18:30:17.466114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:11.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442776+0000","last_change":"2024-09-13T18:30:17.442776+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442776+0000","last_undegraded":"2024-09-13T18:30:17.442776+0000","last_fullsized":"2024-09-13T18:30:17.442776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469378+0000","last_change":"2024-09-13T18:30:17.458897+0000","last_active":"2024-09-13T18:30:17.469378+0000","last_peered":"2024-09-13T18:30:17.469378+0000","last_clean":"2024-09-13T18:30:17.469378+0000","last_became_active":"2024-09-13T18:30:17.458107+0000","last_became_peered":"2024-09-13T18:30:17.458107+0000","last_unstale":"2024-09-13T18:30:17.469378+0000","last_undegraded":"2024-09-13T18:30:17.469378+0000","last_fullsized":"2024-09-13T18:30:17.469378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446454+0000","last_change":"2024-09-13T18:30:17.446454+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446454+0000","last_undegraded":"2024-09-13T18:30:17.446454+0000","last_fullsized":"2024-09-13T18:30:17.446454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475165+0000","last_change":"2024-09-13T18:30:17.466750+0000","last_active":"2024-09-13T18:30:17.475165+0000","last_peered":"2024-09-13T18:30:17.475165+0000","last_clean":"2024-09-13T18:30:17.475165+0000","last_became_active":"2024-09-13T18:30:17.465572+0000","last_became_peered":"2024-09-13T18:30:17.465572+0000","last_unstale":"2024-09-13T18:30:17.475165+0000","last_undegraded":"2024-09-13T18:30:17.475165+0000","last_fullsized":"2024-09-13T18:30:17.475165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:45.386119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446420+0000","last_change":"2024-09-13T18:30:17.446420+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446420+0000","last_undegraded":"2024-09-13T18:30:17.446420+0000","last_fullsized":"2024-09-13T18:30:17.446420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:37.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.472200+0000","last_change":"2024-09-13T18:30:17.469644+0000","last_active":"2024-09-13T18:30:17.472200+0000","last_peered":"2024-09-13T18:30:17.472200+0000","last_clean":"2024-09-13T18:30:17.472200+0000","last_became_active":"2024-09-13T18:30:17.468475+0000","last_became_peered":"2024-09-13T18:30:17.468475+0000","last_unstale":"2024-09-13T18:30:17.472200+0000","last_undegraded":"2024-09-13T18:30:17.472200+0000","last_fullsized":"2024-09-13T18:30:17.472200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:28.084201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445440+0000","last_change":"2024-09-13T18:30:17.445440+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445440+0000","last_undegraded":"2024-09-13T18:30:17.445440+0000","last_fullsized":"2024-09-13T18:30:17.445440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465858+0000","last_change":"2024-09-13T18:30:17.463051+0000","last_active":"2024-09-13T18:30:17.465858+0000","last_peered":"2024-09-13T18:30:17.465858+0000","last_clean":"2024-09-13T18:30:17.465858+0000","last_became_active":"2024-09-13T18:30:17.462356+0000","last_became_peered":"2024-09-13T18:30:17.462356+0000","last_unstale":"2024-09-13T18:30:17.465858+0000","last_undegraded":"2024-09-13T18:30:17.465858+0000","last_fullsized":"2024-09-13T18:30:17.465858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:33.324949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T18:30:16.440164+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:30:16.440164+0000","last_peered":"2024-09-13T18:30:16.440164+0000","last_clean":"2024-09-13T18:30:16.440164+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:30:16.440164+0000","last_undegraded":"2024-09-13T18:30:16.440164+0000","last_fullsized":"2024-09-13T18:30:16.440164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1638400,"data_stored":1038977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.026},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94999999999999996,"15min":0.89000000000000001},"min":{"1min":0.67400000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1870000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.58899999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.278,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2849999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84199999999999997,"15min":0.80400000000000005},"min":{"1min":0.55500000000000005,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.133,"5min":1.276,"15min":1.276},"last":0.995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89800000000000002,"15min":0.88100000000000001},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.296,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.1519999999999999,"5min":1.448,"15min":1.448},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95999999999999996,"15min":0.91400000000000003},"min":{"1min":0.68400000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.256,"5min":1.397,"15min":1.397},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2210000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.01,"15min":1.04},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.877,"15min":1.877},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0069999999999999,"15min":0.98199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3180000000000001,"5min":1.321,"15min":1.321},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.68500000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.274,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.044,"15min":1},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2969999999999999,"5min":1.506,"15min":1.506},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.78700000000000003},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.56100000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.24,"5min":1.577,"15min":1.577},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.998,"5min":0.95999999999999996,"15min":0.90100000000000002},"min":{"1min":0.68899999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.218,"5min":1.464,"15min":1.464},"last":0.98099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1080000000000001,"5min":1.268,"15min":1.268},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.92800000000000005,"15min":0.97099999999999997},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88600000000000001,"15min":0.876},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.131,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.024},{"interface":"front","average":{"1min":0.875,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1040000000000001,"5min":1.306,"15min":1.306},"last":0.80900000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.67000000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.157,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.02,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":1.526},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.57699999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1950000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.627},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.036,"15min":1.0960000000000001},"min":{"1min":0.60499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.228,"5min":2.762,"15min":2.762},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.002,"15min":1.0349999999999999},"min":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.01,"15min":1.038},"min":{"1min":0.63100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":1.72,"15min":1.72},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0580000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.876,"15min":0.90600000000000003},"min":{"1min":0.46800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.165,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.105}]},{"osd":1,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.875,"15min":0.83299999999999996},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1870000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.82899999999999996},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.157,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.88100000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.27,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.149},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93000000000000005,"15min":0.96999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.383,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.72099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.349,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6719999999999999,"5min":1.871,"15min":1.871},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.92400000000000004,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98699999999999999,"15min":1.0489999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4059999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98299999999999998,"15min":1.0289999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":1.026},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0389999999999999,"15min":1.117},"min":{"1min":0.84699999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.268,"5min":2.246,"15min":2.246},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.077,"15min":1.139},"min":{"1min":0.81299999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5980000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.0209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84099999999999997,"15min":0.80600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.357,"15min":1.357},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88,"15min":0.876},"min":{"1min":0.59899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.96699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":1.536,"15min":1.536},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.88},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1859999999999999,"5min":1.323,"15min":1.323},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1379999999999999,"5min":1.476,"15min":1.476},"last":1.071},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92600000000000005,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.94599999999999995},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.72099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3240000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93100000000000005,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.234,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.095},{"interface":"front","average":{"1min":1.054,"5min":1.004,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.145}]},{"osd":7,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3640000000000001,"5min":1.482,"15min":1.482},"last":1.125},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.073},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.179}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68899999999999995,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0700000000000001,"5min":2.113,"15min":2.113},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79100000000000004,"15min":0.71899999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1619999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.97699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.095,"5min":1.704,"15min":1.704},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.61899999999999999},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0620000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.70599999999999996},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1479999999999999,"5min":1.742,"15min":1.742},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80500000000000005,"15min":0.745},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.2010000000000001,"5min":1.399,"15min":1.399},"last":1.1339999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.70699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3089999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.113},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.264,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.94499999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3260000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.04,"15min":1.069},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.272,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0640000000000001,"15min":1.054},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.6890000000000001,"5min":1.96,"15min":1.96},"last":1.256}]},{"osd":7,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0680000000000001,"15min":1.1000000000000001},"min":{"1min":0.67600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.359,"5min":3,"15min":3},"last":1.087},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0429999999999999,"15min":1.006},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1032192,"data_stored":442334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.97999999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.34000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.92900000000000005,"5min":1.335,"15min":1.335},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.41099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.423,"15min":1.423},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.101,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.77700000000000002},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2669999999999999,"5min":1.274,"15min":1.274},"last":0.314}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92200000000000004,"15min":0.90900000000000003},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1950000000000001,"5min":1.611,"15min":1.611},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.90800000000000003,"15min":0.91700000000000004},"min":{"1min":0.66200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.321,"5min":1.492,"15min":1.492},"last":0.623}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97699999999999998,"15min":1.0029999999999999},"min":{"1min":0.65600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2989999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.702,"15min":1.702},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.55400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.171,"5min":1.54,"15min":1.54},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0229999999999999,"15min":1.046},"min":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":1.452,"15min":1.452},"last":0.93200000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.109,"5min":1.657,"15min":1.657},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.071,"15min":1.0820000000000001},"min":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.375,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.81599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.876},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.60899999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0149999999999999,"5min":1.177,"15min":1.177},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.69999999999999996},"min":{"1min":0.39400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.82099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.216,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93300000000000005,"15min":0.91800000000000004},"min":{"1min":0.747,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0209999999999999,"15min":1},"min":{"1min":0.64000000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5900000000000001,"5min":1.653,"15min":1.653},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.78900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2669999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0669999999999999,"15min":1.048},"min":{"1min":0.61899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0620000000000001,"15min":1.0189999999999999},"min":{"1min":0.71299999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.323,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":1626112,"data_stored":1032702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86199999999999999,"5min":1.147,"15min":1.147},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.056,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2310000000000001,"5min":1.333,"15min":1.333},"last":1.085},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70699999999999996,"15min":0.69899999999999995},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92800000000000005,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.73799999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0209999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.94799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4710000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98999999999999999,"15min":0.996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.986,"15min":1.986},"last":1.1830000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2030000000000001,"5min":2.641,"15min":2.641},"last":1.3},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.044},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2370000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.272}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0760000000000001,"15min":1.077},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.296,"5min":1.891,"15min":1.891},"last":1.323},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0289999999999999},"min":{"1min":0.61899999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5549999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.018,"15min":1.03},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.109,"15min":1.1040000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.25}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:30:22.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-09-13T18:30:22.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.461818+0000', 'last_change': '2024-09-13T18:30:17.461818+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.461818+0000', 'last_undegraded': '2024-09-13T18:30:17.461818+0000', 'last_fullsized': '2024-09-13T18:30:17.461818+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:29:36.892959+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-09-13T18:30:22.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.449518+0000', 'last_change': '2024-09-13T18:30:17.449518+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.449518+0000', 'last_undegraded': '2024-09-13T18:30:17.449518+0000', 'last_fullsized': '2024-09-13T18:30:17.449518+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:42:42.841502+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.448555+0000', 'last_change': '2024-09-13T18:30:17.448555+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.448555+0000', 'last_undegraded': '2024-09-13T18:30:17.448555+0000', 'last_fullsized': '2024-09-13T18:30:17.448555+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.440969+0000', 'last_change': '2024-09-13T18:30:17.440969+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.440969+0000', 'last_undegraded': '2024-09-13T18:30:17.440969+0000', 'last_fullsized': '2024-09-13T18:30:17.440969+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:52:14.566181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.438188+0000', 'last_change': '2024-09-13T18:30:17.438188+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.438188+0000', 'last_undegraded': '2024-09-13T18:30:17.438188+0000', 'last_fullsized': '2024-09-13T18:30:17.438188+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.444899+0000', 'last_change': '2024-09-13T18:30:17.444899+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.444899+0000', 'last_undegraded': '2024-09-13T18:30:17.444899+0000', 'last_fullsized': '2024-09-13T18:30:17.444899+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:15:47.133367+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.442413+0000', 'last_change': '2024-09-13T18:30:17.442413+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.442413+0000', 'last_undegraded': '2024-09-13T18:30:17.442413+0000', 'last_fullsized': '2024-09-13T18:30:17.442413+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.442303+0000', 'last_change': '2024-09-13T18:30:17.442303+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.442303+0000', 'last_undegraded': '2024-09-13T18:30:17.442303+0000', 'last_fullsized': '2024-09-13T18:30:17.442303+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:49:53.412169+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.445210+0000', 'last_change': '2024-09-13T18:30:17.445210+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.445210+0000', 'last_undegraded': '2024-09-13T18:30:17.445210+0000', 'last_fullsized': '2024-09-13T18:30:17.445210+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.446689+0000', 'last_change': '2024-09-13T18:30:17.446689+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.446689+0000', 'last_undegraded': '2024-09-13T18:30:17.446689+0000', 'last_fullsized': '2024-09-13T18:30:17.446689+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:06:25.340119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.449397+0000', 'last_change': '2024-09-13T18:30:17.449397+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.449397+0000', 'last_undegraded': '2024-09-13T18:30:17.449397+0000', 'last_fullsized': '2024-09-13T18:30:17.449397+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:50:33.942214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-09-13T18:30:22.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.457353+0000', 'last_change': '2024-09-13T18:30:17.457353+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.457353+0000', 'last_undegraded': '2024-09-13T18:30:17.457353+0000', 'last_fullsized': '2024-09-13T18:30:17.457353+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:36:17.869422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.454691+0000', 'last_change': '2024-09-13T18:30:17.454691+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.454691+0000', 'last_undegraded': '2024-09-13T18:30:17.454691+0000', 'last_fullsized': '2024-09-13T18:30:17.454691+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.440482+0000', 'last_change': '2024-09-13T18:30:17.440482+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.440482+0000', 'last_undegraded': '2024-09-13T18:30:17.440482+0000', 'last_fullsized': '2024-09-13T18:30:17.440482+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.448148+0000', 'last_change': '2024-09-13T18:30:17.448148+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.448148+0000', 'last_undegraded': '2024-09-13T18:30:17.448148+0000', 'last_fullsized': '2024-09-13T18:30:17.448148+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:45:56.712509+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.439514+0000', 'last_change': '2024-09-13T18:30:17.439514+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.439514+0000', 'last_undegraded': '2024-09-13T18:30:17.439514+0000', 'last_fullsized': '2024-09-13T18:30:17.439514+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:56:19.248527+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-09-13T18:30:22.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.436190+0000', 'last_change': '2024-09-13T18:30:17.436190+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.436190+0000', 'last_undegraded': '2024-09-13T18:30:17.436190+0000', 'last_fullsized': '2024-09-13T18:30:17.436190+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.441571+0000', 'last_change': '2024-09-13T18:30:17.441571+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.441571+0000', 'last_undegraded': '2024-09-13T18:30:17.441571+0000', 'last_fullsized': '2024-09-13T18:30:17.441571+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.441812+0000', 'last_change': '2024-09-13T18:30:17.441812+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.441812+0000', 'last_undegraded': '2024-09-13T18:30:17.441812+0000', 'last_fullsized': '2024-09-13T18:30:17.441812+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.440351+0000', 'last_change': '2024-09-13T18:30:17.440351+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.440351+0000', 'last_undegraded': '2024-09-13T18:30:17.440351+0000', 'last_fullsized': '2024-09-13T18:30:17.440351+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:09:25.520535+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.440746+0000', 'last_change': '2024-09-13T18:30:17.440746+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.440746+0000', 'last_undegraded': '2024-09-13T18:30:17.440746+0000', 'last_fullsized': '2024-09-13T18:30:17.440746+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:16:16.182666+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.450183+0000', 'last_change': '2024-09-13T18:30:17.450183+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.450183+0000', 'last_undegraded': '2024-09-13T18:30:17.450183+0000', 'last_fullsized': '2024-09-13T18:30:17.450183+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.447671+0000', 'last_change': '2024-09-13T18:30:17.447671+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.447671+0000', 'last_undegraded': '2024-09-13T18:30:17.447671+0000', 'last_fullsized': '2024-09-13T18:30:17.447671+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:48:07.120328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.440569+0000', 'last_change': '2024-09-13T18:30:17.440569+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.440569+0000', 'last_undegraded': '2024-09-13T18:30:17.440569+0000', 'last_fullsized': '2024-09-13T18:30:17.440569+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:53:13.423940+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.448827+0000', 'last_change': '2024-09-13T18:30:17.448827+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.448827+0000', 'last_undegraded': '2024-09-13T18:30:17.448827+0000', 'last_fullsized': '2024-09-13T18:30:17.448827+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:31:47.084744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.453058+0000', 'last_change': '2024-09-13T18:30:17.453058+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.453058+0000', 'last_undegraded': '2024-09-13T18:30:17.453058+0000', 'last_fullsized': '2024-09-13T18:30:17.453058+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.439982+0000', 'last_change': '2024-09-13T18:30:17.439982+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.439982+0000', 'last_undegraded': '2024-09-13T18:30:17.439982+0000', 'last_fullsized': '2024-09-13T18:30:17.439982+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.456285+0000', 'last_change': '2024-09-13T18:30:17.456285+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.456285+0000', 'last_undegraded': '2024-09-13T18:30:17.456285+0000', 'last_fullsized': '2024-09-13T18:30:17.456285+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:02:23.365461+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.450329+0000', 'last_change': '2024-09-13T18:30:17.450329+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.450329+0000', 'last_undegraded': '2024-09-13T18:30:17.450329+0000', 'last_fullsized': '2024-09-13T18:30:17.450329+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:26:34.937843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.449400+0000', 'last_change': '2024-09-13T18:30:17.449400+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.449400+0000', 'last_undegraded': '2024-09-13T18:30:17.449400+0000', 'last_fullsized': '2024-09-13T18:30:17.449400+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:01:46.395539+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.435185+0000', 'last_change': '2024-09-13T18:30:17.435185+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.435185+0000', 'last_undegraded': '2024-09-13T18:30:17.435185+0000', 'last_fullsized': '2024-09-13T18:30:17.435185+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.458552+0000', 'last_change': '2024-09-13T18:30:17.458552+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.458552+0000', 'last_undegraded': '2024-09-13T18:30:17.458552+0000', 'last_fullsized': '2024-09-13T18:30:17.458552+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:22:37.191193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-09-13T18:30:22.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.438520+0000', 'last_change': '2024-09-13T18:30:17.438520+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.438520+0000', 'last_undegraded': '2024-09-13T18:30:17.438520+0000', 'last_fullsized': '2024-09-13T18:30:17.438520+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.460796+0000', 'last_change': '2024-09-13T18:30:17.460796+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.460796+0000', 'last_undegraded': '2024-09-13T18:30:17.460796+0000', 'last_fullsized': '2024-09-13T18:30:17.460796+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:19:29.618508+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.455122+0000', 'last_change': '2024-09-13T18:30:17.455122+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.455122+0000', 'last_undegraded': '2024-09-13T18:30:17.455122+0000', 'last_fullsized': '2024-09-13T18:30:17.455122+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:57:48.577132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.447412+0000', 'last_change': '2024-09-13T18:30:17.447412+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.447412+0000', 'last_undegraded': '2024-09-13T18:30:17.447412+0000', 'last_fullsized': '2024-09-13T18:30:17.447412+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-09-13T18:30:22.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.443205+0000', 'last_change': '2024-09-13T18:30:17.443205+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.443205+0000', 'last_undegraded': '2024-09-13T18:30:17.443205+0000', 'last_fullsized': '2024-09-13T18:30:17.443205+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-09-13T18:30:22.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.435798+0000', 'last_change': '2024-09-13T18:30:17.435798+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.435798+0000', 'last_undegraded': '2024-09-13T18:30:17.435798+0000', 'last_fullsized': '2024-09-13T18:30:17.435798+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.447671+0000', 'last_change': '2024-09-13T18:30:17.447671+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.447671+0000', 'last_undegraded': '2024-09-13T18:30:17.447671+0000', 'last_fullsized': '2024-09-13T18:30:17.447671+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.447486+0000', 'last_change': '2024-09-13T18:30:17.447486+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.447486+0000', 'last_undegraded': '2024-09-13T18:30:17.447486+0000', 'last_fullsized': '2024-09-13T18:30:17.447486+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:57:37.194826+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.443246+0000', 'last_change': '2024-09-13T18:30:17.443246+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.443246+0000', 'last_undegraded': '2024-09-13T18:30:17.443246+0000', 'last_fullsized': '2024-09-13T18:30:17.443246+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:32:45.041871+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.443848+0000', 'last_change': '2024-09-13T18:30:17.443848+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.443848+0000', 'last_undegraded': '2024-09-13T18:30:17.443848+0000', 'last_fullsized': '2024-09-13T18:30:17.443848+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:33:52.338016+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.444732+0000', 'last_change': '2024-09-13T18:30:17.444732+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.444732+0000', 'last_undegraded': '2024-09-13T18:30:17.444732+0000', 'last_fullsized': '2024-09-13T18:30:17.444732+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:30:22.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.438897+0000', 'last_change': '2024-09-13T18:30:17.438897+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.438897+0000', 'last_undegraded': '2024-09-13T18:30:17.438897+0000', 'last_fullsized': '2024-09-13T18:30:17.438897+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.442120+0000', 'last_change': '2024-09-13T18:30:17.442120+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.442120+0000', 'last_undegraded': '2024-09-13T18:30:17.442120+0000', 'last_fullsized': '2024-09-13T18:30:17.442120+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.448927+0000', 'last_change': '2024-09-13T18:30:17.448927+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.448927+0000', 'last_undegraded': '2024-09-13T18:30:17.448927+0000', 'last_fullsized': '2024-09-13T18:30:17.448927+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.442723+0000', 'last_change': '2024-09-13T18:30:17.442723+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.442723+0000', 'last_undegraded': '2024-09-13T18:30:17.442723+0000', 'last_fullsized': '2024-09-13T18:30:17.442723+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.444435+0000', 'last_change': '2024-09-13T18:30:17.444435+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.444435+0000', 'last_undegraded': '2024-09-13T18:30:17.444435+0000', 'last_fullsized': '2024-09-13T18:30:17.444435+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:15:48.836972+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.449896+0000', 'last_change': '2024-09-13T18:30:17.449896+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.449896+0000', 'last_undegraded': '2024-09-13T18:30:17.449896+0000', 'last_fullsized': '2024-09-13T18:30:17.449896+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.448734+0000', 'last_change': '2024-09-13T18:30:17.448734+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.448734+0000', 'last_undegraded': '2024-09-13T18:30:17.448734+0000', 'last_fullsized': '2024-09-13T18:30:17.448734+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:59:13.870358+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.437738+0000', 'last_change': '2024-09-13T18:30:17.437738+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.437738+0000', 'last_undegraded': '2024-09-13T18:30:17.437738+0000', 'last_fullsized': '2024-09-13T18:30:17.437738+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.440049+0000', 'last_change': '2024-09-13T18:30:17.440049+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.440049+0000', 'last_undegraded': '2024-09-13T18:30:17.440049+0000', 'last_fullsized': '2024-09-13T18:30:17.440049+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.442547+0000', 'last_change': '2024-09-13T18:30:17.442547+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.442547+0000', 'last_undegraded': '2024-09-13T18:30:17.442547+0000', 'last_fullsized': '2024-09-13T18:30:17.442547+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:51:23.073928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:30:22.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.439476+0000', 'last_change': '2024-09-13T18:30:17.439476+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.439476+0000', 'last_undegraded': '2024-09-13T18:30:17.439476+0000', 'last_fullsized': '2024-09-13T18:30:17.439476+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:36:41.845328+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.442507+0000', 'last_change': '2024-09-13T18:30:17.442507+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.442507+0000', 'last_undegraded': '2024-09-13T18:30:17.442507+0000', 'last_fullsized': '2024-09-13T18:30:17.442507+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:19:23.751984+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.437372+0000', 'last_change': '2024-09-13T18:30:17.437372+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.437372+0000', 'last_undegraded': '2024-09-13T18:30:17.437372+0000', 'last_fullsized': '2024-09-13T18:30:17.437372+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.454211+0000', 'last_change': '2024-09-13T18:30:17.454211+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.454211+0000', 'last_undegraded': '2024-09-13T18:30:17.454211+0000', 'last_fullsized': '2024-09-13T18:30:17.454211+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-09-13T18:30:22.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.448384+0000', 'last_change': '2024-09-13T18:30:17.448384+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.448384+0000', 'last_undegraded': '2024-09-13T18:30:17.448384+0000', 'last_fullsized': '2024-09-13T18:30:17.448384+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:43:29.093622+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-09-13T18:30:22.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.436106+0000', 'last_change': '2024-09-13T18:30:17.436106+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.436106+0000', 'last_undegraded': '2024-09-13T18:30:17.436106+0000', 'last_fullsized': '2024-09-13T18:30:17.436106+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:30:22.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2024-09-13T18:30:22.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.443818+0000', 'last_change': '2024-09-13T18:30:17.443818+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.443818+0000', 'last_undegraded': '2024-09-13T18:30:17.443818+0000', 'last_fullsized': '2024-09-13T18:30:17.443818+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:30:22.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2024-09-13T18:30:22.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.442776+0000', 'last_change': '2024-09-13T18:30:17.442776+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.442776+0000', 'last_undegraded': '2024-09-13T18:30:17.442776+0000', 'last_fullsized': '2024-09-13T18:30:17.442776+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:30:22.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-09-13T18:30:22.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.446454+0000', 'last_change': '2024-09-13T18:30:17.446454+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.446454+0000', 'last_undegraded': '2024-09-13T18:30:17.446454+0000', 'last_fullsized': '2024-09-13T18:30:17.446454+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:30:22.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-09-13T18:30:22.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.446420+0000', 'last_change': '2024-09-13T18:30:17.446420+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.446420+0000', 'last_undegraded': '2024-09-13T18:30:17.446420+0000', 'last_fullsized': '2024-09-13T18:30:17.446420+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:21:37.490746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:30:22.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-09-13T18:30:22.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:30:17.445440+0000', 'last_change': '2024-09-13T18:30:17.445440+0000', 'last_active': '2024-09-13T18:30:17.422984+0000', 'last_peered': '2024-09-13T18:30:17.422984+0000', 'last_clean': '2024-09-13T18:30:17.422984+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:30:17.445440+0000', 'last_undegraded': '2024-09-13T18:30:17.445440+0000', 'last_fullsized': '2024-09-13T18:30:17.445440+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'last_clean_scrub_stamp': '2024-09-13T18:30:17.422984+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:30:22.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:30:22.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.714+0000 7f7f7c58e640 1 Processor -- start 2024-09-13T18:30:22.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.714+0000 7f7f7c58e640 1 -- start start 2024-09-13T18:30:22.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.714+0000 7f7f7c58e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 0x7f7f740b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.714+0000 7f7f7c58e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740b1ac0 con 0x7f7f7406b850 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.714+0000 7f7f7c58e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f74159ac0 con 0x7f7f740cbd60 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.714+0000 7f7f7c58e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74159da0 con 0x7f7f740cb980 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79b29640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f7406b850 0x7f7f7406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60374/0 (socket says 172.21.15.53:60374) 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79b29640 1 -- 172.21.15.53:0/1807654787 learned_addr learned my addr 172.21.15.53:0/1807654787 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247711202 0 0) 0x7f7f740b1ac0 con 0x7f7f7406b850 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f60003530 con 0x7f7f7406b850 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7a32a640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 0x7f7f740b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2743968388 0 0) 0x7f7f60003530 con 0x7f7f7406b850 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 msgr2=0x7f7f740b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 0x7f7f740b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 >> v1:172.21.15.87:6789/0 conn(0x7f7f740cbd60 legacy=0x7f7f740b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7415a080 con 0x7f7f7406b850 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7f64001680 con 0x7f7f7406b850 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 >> v1:172.21.15.53:6789/0 conn(0x7f7f7406b850 legacy=0x7f7f7406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 0x7f7f600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f60003fe0 0x7f7f600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f60004d10 0x7f7f60005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74159da0 con 0x7f7f60004d10 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6000bbd0 con 0x7f7f60003fe0 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6000dfa0 con 0x7f7f740cb980 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7ab2b640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f60004d10 0x7f7f60005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79b29640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f60003fe0 0x7f7f600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7a32a640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 0x7f7f600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 msgr2=0x7f7f600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7ab2b640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740cb980 0x7f7f600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f60003fe0 msgr2=0x7f7f600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7ab2b640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f60003fe0 0x7f7f600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/1807654787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f60003530 con 0x7f7f60004d10 2024-09-13T18:30:22.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7ab2b640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f60004d10 0x7f7f60005190 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001e70 tx=0x7f7f6c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c222636cb6d49a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:22.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c003b80 con 0x7f7f60004d10 2024-09-13T18:30:22.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c003ce0 con 0x7f7f60004d10 2024-09-13T18:30:22.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f79328640 1 -- 172.21.15.53:0/1807654787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0052c0 con 0x7f7f60004d10 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7c58e640 1 -- 172.21.15.53:0/1807654787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f60004d10 msgr2=0x7f7f60005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.718+0000 7f7f7c58e640 1 --2- 172.21.15.53:0/1807654787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f60004d10 0x7f7f60005190 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c001e70 tx=0x7f7f6c01c780 comp rx=0 tx=0).stop 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/1807654787 reap_dead start 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- 172.21.15.53:0/1807654787 shutdown_connections 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- 172.21.15.53:0/1807654787 >> 172.21.15.53:0/1807654787 conn(0x7f7f74065c80 msgr2=0x7f7f74066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- 172.21.15.53:0/1807654787 shutdown_connections 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- 172.21.15.53:0/1807654787 wait complete. 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 Processor -- start 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- start start 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f740ad630 0x7f7f741ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740ada10 0x7f7f7415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f740aba10 0x7f7f7415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7414c8b0 con 0x7f7f740aba10 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740a84d0 con 0x7f7f740ad630 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740a8790 con 0x7f7f740ada10 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f740aba10 0x7f7f7415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f740aba10 0x7f7f7415c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58904/0 (socket says 172.21.15.53:58904) 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/938172516 learned_addr learned my addr 172.21.15.53:0/938172516 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7a32a640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f740ad630 0x7f7f741ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f79b29640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740ada10 0x7f7f7415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740ada10 msgr2=0x7f7f7415bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740ada10 0x7f7f7415bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f740ad630 msgr2=0x7f7f741ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f740ad630 0x7f7f741ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 -- 172.21.15.53:0/938172516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740a8a70 con 0x7f7f740aba10 2024-09-13T18:30:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f79b29640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740ada10 0x7f7f7415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7a32a640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f740ad630 0x7f7f741ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7ab2b640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f740aba10 0x7f7f7415c480 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c01cc60 tx=0x7f7f60005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f6affd640 1 -- 172.21.15.53:0/938172516 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0b7070 con 0x7f7f740aba10 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f6affd640 1 -- 172.21.15.53:0/938172516 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c007dc0 con 0x7f7f740aba10 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f6affd640 1 -- 172.21.15.53:0/938172516 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c006da0 con 0x7f7f740aba10 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f740a8d50 con 0x7f7f740aba10 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7414b580 con 0x7f7f740aba10 2024-09-13T18:30:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.722+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f74067400 con 0x7f7f740aba10 2024-09-13T18:30:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.726+0000 7f7f6affd640 1 -- 172.21.15.53:0/938172516 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f7f6c0a9470 con 0x7f7f740aba10 2024-09-13T18:30:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.726+0000 7f7f6affd640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7f580667b0 0x7f7f58068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.726+0000 7f7f7a32a640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7f580667b0 0x7f7f58068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.726+0000 7f7f6affd640 1 -- 172.21.15.53:0/938172516 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f6c11e0d0 con 0x7f7f740aba10 2024-09-13T18:30:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.726+0000 7f7f7a32a640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7f580667b0 0x7f7f58068c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000ba70 tx=0x7f7f70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:22.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.730+0000 7f7f6affd640 1 -- 172.21.15.53:0/938172516 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f6c0eb220 con 0x7f7f740aba10 2024-09-13T18:30:22.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.950+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7f740b33b0 con 0x7f7f740aba10 2024-09-13T18:30:22.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.950+0000 7f7f6affd640 1 -- 172.21.15.53:0/938172516 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7f7f6c0ee840 con 0x7f7f740aba10 2024-09-13T18:30:22.953 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:22.954 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":348,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":87,"num_osds":8,"num_up_osds":8,"osd_up_since":1726251884,"num_in_osds":8,"osd_in_since":1726251876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":281214976,"bytes_avail":772812898304,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":48,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7431}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-13T18:27:48.958854+0000","services":{}},"progress_events":{}} 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7f580667b0 msgr2=0x7f7f58068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7f580667b0 0x7f7f58068c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000ba70 tx=0x7f7f70008040 comp rx=0 tx=0).stop 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f740aba10 msgr2=0x7f7f7415c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f740aba10 0x7f7f7415c480 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c01cc60 tx=0x7f7f60005800 comp rx=0 tx=0).stop 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 shutdown_connections 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7f580667b0 0x7f7f58068c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7f740ada10 0x7f7f7415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f740aba10 0x7f7f7415c480 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 --2- 172.21.15.53:0/938172516 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f740ad630 0x7f7f741ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:22.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 >> 172.21.15.53:0/938172516 conn(0x7f7f74065c80 msgr2=0x7f7f740adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:22.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 shutdown_connections 2024-09-13T18:30:22.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:22.954+0000 7f7f7c58e640 1 -- 172.21.15.53:0/938172516 wait complete. 2024-09-13T18:30:22.972 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:30:22.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:30:23.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e86a44640 1 Processor -- start 2024-09-13T18:30:23.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e86a44640 1 -- start start 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e86a44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2e800d19c0 0x7f2e800cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e86a44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e800cf600 0x7f2e800b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e86a44640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e800d2400 con 0x7f2e8015cab0 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e86a44640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800cfa90 con 0x7f2e800cf600 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e86a44640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800d1530 con 0x7f2e800d19c0 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e84fe1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e800cf600 0x7f2e800b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e7ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2e8015cab0 0x7f2e800cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60390/0 (socket says 172.21.15.53:60390) 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e84fe1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e800cf600 0x7f2e800b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58912/0 (socket says 172.21.15.53:58912) 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e7ffff640 1 -- 172.21.15.53:0/3440961387 learned_addr learned my addr 172.21.15.53:0/3440961387 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e7f7fe640 1 --2- 172.21.15.53:0/3440961387 >> v2:172.21.15.87:3300/0 conn(0x7f2e800d19c0 0x7f2e800cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e84fe1640 1 -- 172.21.15.53:0/3440961387 >> v2:172.21.15.87:3300/0 conn(0x7f2e800d19c0 msgr2=0x7f2e800cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:23.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e84fe1640 1 --2- 172.21.15.53:0/3440961387 >> v2:172.21.15.87:3300/0 conn(0x7f2e800d19c0 0x7f2e800cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e84fe1640 1 -- 172.21.15.53:0/3440961387 >> v1:172.21.15.53:6789/0 conn(0x7f2e8015cab0 legacy=0x7f2e800cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:23.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e84fe1640 1 -- 172.21.15.53:0/3440961387 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800cddd0 con 0x7f2e800cf600 2024-09-13T18:30:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.082+0000 7f2e84fe1640 1 --2- 172.21.15.53:0/3440961387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800cf600 0x7f2e800b5870 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2e800b20e0 tx=0x7f2e7801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f783b099ef8976b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7effd640 1 -- 172.21.15.53:0/3440961387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e780a58e0 con 0x7f2e800cf600 2024-09-13T18:30:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7effd640 1 -- 172.21.15.53:0/3440961387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e780a5a40 con 0x7f2e800cf600 2024-09-13T18:30:23.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7effd640 1 -- 172.21.15.53:0/3440961387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e780a5dd0 con 0x7f2e800cf600 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- 172.21.15.53:0/3440961387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800cf600 msgr2=0x7f2e800b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3440961387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800cf600 0x7f2e800b5870 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2e800b20e0 tx=0x7f2e7801c930 comp rx=0 tx=0).stop 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- 172.21.15.53:0/3440961387 shutdown_connections 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3440961387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800cf600 0x7f2e800b5870 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3440961387 >> v2:172.21.15.87:3300/0 conn(0x7f2e800d19c0 0x7f2e800cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- 172.21.15.53:0/3440961387 >> 172.21.15.53:0/3440961387 conn(0x7f2e80065c80 msgr2=0x7f2e80066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- 172.21.15.53:0/3440961387 shutdown_connections 2024-09-13T18:30:23.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- 172.21.15.53:0/3440961387 wait complete. 2024-09-13T18:30:23.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 Processor -- start 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- start start 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e800cf600 0x7f2e800c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800d19c0 0x7f2e8014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8015cab0 0x7f2e801520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e80158e70 con 0x7f2e800d19c0 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e80150130 con 0x7f2e8015cab0 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e80156110 con 0x7f2e800cf600 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800d19c0 0x7f2e8014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800d19c0 0x7f2e8014fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58924/0 (socket says 172.21.15.53:58924) 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 -- 172.21.15.53:0/3092292359 learned_addr learned my addr 172.21.15.53:0/3092292359 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e84fe1640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8015cab0 0x7f2e801520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:23.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 -- 172.21.15.53:0/3092292359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e800cf600 msgr2=0x7f2e800c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e800cf600 0x7f2e800c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 -- 172.21.15.53:0/3092292359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8015cab0 msgr2=0x7f2e801520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8015cab0 0x7f2e801520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 -- 172.21.15.53:0/3092292359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e78009a70 con 0x7f2e800d19c0 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7f7fe640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800d19c0 0x7f2e8014fbf0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c7f0 tx=0x7f2e7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7cff9640 1 -- 172.21.15.53:0/3092292359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74007820 con 0x7f2e800d19c0 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7cff9640 1 -- 172.21.15.53:0/3092292359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e74007980 con 0x7f2e800d19c0 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e801563f0 con 0x7f2e800d19c0 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e7cff9640 1 -- 172.21.15.53:0/3092292359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74007d30 con 0x7f2e800d19c0 2024-09-13T18:30:23.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.086+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e801569b0 con 0x7f2e800d19c0 2024-09-13T18:30:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.090+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8015c2d0 con 0x7f2e800d19c0 2024-09-13T18:30:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.090+0000 7f2e7cff9640 1 -- 172.21.15.53:0/3092292359 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f2e740113f0 con 0x7f2e800d19c0 2024-09-13T18:30:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.090+0000 7f2e7cff9640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e6c0667e0 0x7f2e6c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.090+0000 7f2e7cff9640 1 -- 172.21.15.53:0/3092292359 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e740843f0 con 0x7f2e800d19c0 2024-09-13T18:30:23.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.090+0000 7f2e7ffff640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e6c0667e0 0x7f2e6c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:23.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.090+0000 7f2e7ffff640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e6c0667e0 0x7f2e6c068ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e70000f70 tx=0x7f2e70007a90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:23.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.094+0000 7f2e7cff9640 1 -- 172.21.15.53:0/3092292359 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e740515d0 con 0x7f2e800d19c0 2024-09-13T18:30:23.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.242+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e800d05b0 con 0x7f2e6c0667e0 2024-09-13T18:30:23.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.250+0000 7f2e7cff9640 1 -- 172.21.15.53:0/3092292359 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285166 (secure 0 0 0) 0x7f2e70001260 con 0x7f2e6c0667e0 2024-09-13T18:30:23.257 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:23.258 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e6c0667e0 msgr2=0x7f2e6c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e6c0667e0 0x7f2e6c068ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e70000f70 tx=0x7f2e70007a90 comp rx=0 tx=0).stop 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800d19c0 msgr2=0x7f2e8014fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800d19c0 0x7f2e8014fbf0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c7f0 tx=0x7f2e7400ccb0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 shutdown_connections 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e6c0667e0 0x7f2e6c068ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8015cab0 0x7f2e801520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e800d19c0 0x7f2e8014fbf0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 --2- 172.21.15.53:0/3092292359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e800cf600 0x7f2e800c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 >> 172.21.15.53:0/3092292359 conn(0x7f2e80065c80 msgr2=0x7f2e800b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:23.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 shutdown_connections 2024-09-13T18:30:23.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:23.254+0000 7f2e86a44640 1 -- 172.21.15.53:0/3092292359 wait complete. 2024-09-13T18:30:23.273 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T18:30:21.825472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":274624,"kb_used_data":9296,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754700096,"statfs":{"total":773094113280,"available":772812898304,"internally_reserved":0,"allocated":9519104,"data_stored":4757058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.400530"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.461818+0000","last_change":"2024-09-13T18:30:17.461818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.461818+0000","last_undegraded":"2024-09-13T18:30:17.461818+0000","last_fullsized":"2024-09-13T18:30:17.461818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:36.892959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449518+0000","last_change":"2024-09-13T18:30:17.449518+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449518+0000","last_undegraded":"2024-09-13T18:30:17.449518+0000","last_fullsized":"2024-09-13T18:30:17.449518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:42.841502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448555+0000","last_change":"2024-09-13T18:30:17.448555+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448555+0000","last_undegraded":"2024-09-13T18:30:17.448555+0000","last_fullsized":"2024-09-13T18:30:17.448555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440969+0000","last_change":"2024-09-13T18:30:17.440969+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440969+0000","last_undegraded":"2024-09-13T18:30:17.440969+0000","last_fullsized":"2024-09-13T18:30:17.440969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:14.566181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438188+0000","last_change":"2024-09-13T18:30:17.438188+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438188+0000","last_undegraded":"2024-09-13T18:30:17.438188+0000","last_fullsized":"2024-09-13T18:30:17.438188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444899+0000","last_change":"2024-09-13T18:30:17.444899+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444899+0000","last_undegraded":"2024-09-13T18:30:17.444899+0000","last_fullsized":"2024-09-13T18:30:17.444899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:47.133367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442413+0000","last_change":"2024-09-13T18:30:17.442413+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442413+0000","last_undegraded":"2024-09-13T18:30:17.442413+0000","last_fullsized":"2024-09-13T18:30:17.442413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442303+0000","last_change":"2024-09-13T18:30:17.442303+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442303+0000","last_undegraded":"2024-09-13T18:30:17.442303+0000","last_fullsized":"2024-09-13T18:30:17.442303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.412169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445210+0000","last_change":"2024-09-13T18:30:17.445210+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445210+0000","last_undegraded":"2024-09-13T18:30:17.445210+0000","last_fullsized":"2024-09-13T18:30:17.445210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446689+0000","last_change":"2024-09-13T18:30:17.446689+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446689+0000","last_undegraded":"2024-09-13T18:30:17.446689+0000","last_fullsized":"2024-09-13T18:30:17.446689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:25.340119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449397+0000","last_change":"2024-09-13T18:30:17.449397+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449397+0000","last_undegraded":"2024-09-13T18:30:17.449397+0000","last_fullsized":"2024-09-13T18:30:17.449397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:33.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.457353+0000","last_change":"2024-09-13T18:30:17.457353+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.457353+0000","last_undegraded":"2024-09-13T18:30:17.457353+0000","last_fullsized":"2024-09-13T18:30:17.457353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:17.869422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454691+0000","last_change":"2024-09-13T18:30:17.454691+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454691+0000","last_undegraded":"2024-09-13T18:30:17.454691+0000","last_fullsized":"2024-09-13T18:30:17.454691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440482+0000","last_change":"2024-09-13T18:30:17.440482+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440482+0000","last_undegraded":"2024-09-13T18:30:17.440482+0000","last_fullsized":"2024-09-13T18:30:17.440482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448148+0000","last_change":"2024-09-13T18:30:17.448148+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448148+0000","last_undegraded":"2024-09-13T18:30:17.448148+0000","last_fullsized":"2024-09-13T18:30:17.448148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:56.712509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439514+0000","last_change":"2024-09-13T18:30:17.439514+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439514+0000","last_undegraded":"2024-09-13T18:30:17.439514+0000","last_fullsized":"2024-09-13T18:30:17.439514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:19.248527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436190+0000","last_change":"2024-09-13T18:30:17.436190+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436190+0000","last_undegraded":"2024-09-13T18:30:17.436190+0000","last_fullsized":"2024-09-13T18:30:17.436190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441571+0000","last_change":"2024-09-13T18:30:17.441571+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441571+0000","last_undegraded":"2024-09-13T18:30:17.441571+0000","last_fullsized":"2024-09-13T18:30:17.441571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.441812+0000","last_change":"2024-09-13T18:30:17.441812+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.441812+0000","last_undegraded":"2024-09-13T18:30:17.441812+0000","last_fullsized":"2024-09-13T18:30:17.441812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440351+0000","last_change":"2024-09-13T18:30:17.440351+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440351+0000","last_undegraded":"2024-09-13T18:30:17.440351+0000","last_fullsized":"2024-09-13T18:30:17.440351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:25.520535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440746+0000","last_change":"2024-09-13T18:30:17.440746+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440746+0000","last_undegraded":"2024-09-13T18:30:17.440746+0000","last_fullsized":"2024-09-13T18:30:17.440746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.182666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450183+0000","last_change":"2024-09-13T18:30:17.450183+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450183+0000","last_undegraded":"2024-09-13T18:30:17.450183+0000","last_fullsized":"2024-09-13T18:30:17.450183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:07.120328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440569+0000","last_change":"2024-09-13T18:30:17.440569+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440569+0000","last_undegraded":"2024-09-13T18:30:17.440569+0000","last_fullsized":"2024-09-13T18:30:17.440569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.423940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448827+0000","last_change":"2024-09-13T18:30:17.448827+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448827+0000","last_undegraded":"2024-09-13T18:30:17.448827+0000","last_fullsized":"2024-09-13T18:30:17.448827+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.084744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.453058+0000","last_change":"2024-09-13T18:30:17.453058+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.453058+0000","last_undegraded":"2024-09-13T18:30:17.453058+0000","last_fullsized":"2024-09-13T18:30:17.453058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439982+0000","last_change":"2024-09-13T18:30:17.439982+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439982+0000","last_undegraded":"2024-09-13T18:30:17.439982+0000","last_fullsized":"2024-09-13T18:30:17.439982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.456285+0000","last_change":"2024-09-13T18:30:17.456285+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.456285+0000","last_undegraded":"2024-09-13T18:30:17.456285+0000","last_fullsized":"2024-09-13T18:30:17.456285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:23.365461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.450329+0000","last_change":"2024-09-13T18:30:17.450329+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.450329+0000","last_undegraded":"2024-09-13T18:30:17.450329+0000","last_fullsized":"2024-09-13T18:30:17.450329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:34.937843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449400+0000","last_change":"2024-09-13T18:30:17.449400+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449400+0000","last_undegraded":"2024-09-13T18:30:17.449400+0000","last_fullsized":"2024-09-13T18:30:17.449400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:46.395539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435185+0000","last_change":"2024-09-13T18:30:17.435185+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435185+0000","last_undegraded":"2024-09-13T18:30:17.435185+0000","last_fullsized":"2024-09-13T18:30:17.435185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.458552+0000","last_change":"2024-09-13T18:30:17.458552+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.458552+0000","last_undegraded":"2024-09-13T18:30:17.458552+0000","last_fullsized":"2024-09-13T18:30:17.458552+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:37.191193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438520+0000","last_change":"2024-09-13T18:30:17.438520+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438520+0000","last_undegraded":"2024-09-13T18:30:17.438520+0000","last_fullsized":"2024-09-13T18:30:17.438520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475101+0000","last_change":"2024-09-13T18:30:17.465337+0000","last_active":"2024-09-13T18:30:17.475101+0000","last_peered":"2024-09-13T18:30:17.475101+0000","last_clean":"2024-09-13T18:30:17.475101+0000","last_became_active":"2024-09-13T18:30:17.463016+0000","last_became_peered":"2024-09-13T18:30:17.463016+0000","last_unstale":"2024-09-13T18:30:17.475101+0000","last_undegraded":"2024-09-13T18:30:17.475101+0000","last_fullsized":"2024-09-13T18:30:17.475101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:46.075323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.460796+0000","last_change":"2024-09-13T18:30:17.460796+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.460796+0000","last_undegraded":"2024-09-13T18:30:17.460796+0000","last_fullsized":"2024-09-13T18:30:17.460796+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:29.618508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469556+0000","last_change":"2024-09-13T18:30:17.461838+0000","last_active":"2024-09-13T18:30:17.469556+0000","last_peered":"2024-09-13T18:30:17.469556+0000","last_clean":"2024-09-13T18:30:17.469556+0000","last_became_active":"2024-09-13T18:30:17.459072+0000","last_became_peered":"2024-09-13T18:30:17.459072+0000","last_unstale":"2024-09-13T18:30:17.469556+0000","last_undegraded":"2024-09-13T18:30:17.469556+0000","last_fullsized":"2024-09-13T18:30:17.469556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:52.437657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.455122+0000","last_change":"2024-09-13T18:30:17.455122+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.455122+0000","last_undegraded":"2024-09-13T18:30:17.455122+0000","last_fullsized":"2024-09-13T18:30:17.455122+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:48.577132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.455815+0000","last_change":"2024-09-13T18:30:17.451931+0000","last_active":"2024-09-13T18:30:17.455815+0000","last_peered":"2024-09-13T18:30:17.455815+0000","last_clean":"2024-09-13T18:30:17.455815+0000","last_became_active":"2024-09-13T18:30:17.451250+0000","last_became_peered":"2024-09-13T18:30:17.451250+0000","last_unstale":"2024-09-13T18:30:17.455815+0000","last_undegraded":"2024-09-13T18:30:17.455815+0000","last_fullsized":"2024-09-13T18:30:17.455815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:51.328595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447412+0000","last_change":"2024-09-13T18:30:17.447412+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447412+0000","last_undegraded":"2024-09-13T18:30:17.447412+0000","last_fullsized":"2024-09-13T18:30:17.447412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.456592+0000","last_change":"2024-09-13T18:30:17.453282+0000","last_active":"2024-09-13T18:30:17.456592+0000","last_peered":"2024-09-13T18:30:17.456592+0000","last_clean":"2024-09-13T18:30:17.456592+0000","last_became_active":"2024-09-13T18:30:17.452864+0000","last_became_peered":"2024-09-13T18:30:17.452864+0000","last_unstale":"2024-09-13T18:30:17.456592+0000","last_undegraded":"2024-09-13T18:30:17.456592+0000","last_fullsized":"2024-09-13T18:30:17.456592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:35.883538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443205+0000","last_change":"2024-09-13T18:30:17.443205+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443205+0000","last_undegraded":"2024-09-13T18:30:17.443205+0000","last_fullsized":"2024-09-13T18:30:17.443205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.468491+0000","last_change":"2024-09-13T18:30:17.449969+0000","last_active":"2024-09-13T18:30:17.468491+0000","last_peered":"2024-09-13T18:30:17.468491+0000","last_clean":"2024-09-13T18:30:17.468491+0000","last_became_active":"2024-09-13T18:30:17.449279+0000","last_became_peered":"2024-09-13T18:30:17.449279+0000","last_unstale":"2024-09-13T18:30:17.468491+0000","last_undegraded":"2024-09-13T18:30:17.468491+0000","last_fullsized":"2024-09-13T18:30:17.468491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:36.181772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.435798+0000","last_change":"2024-09-13T18:30:17.435798+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.435798+0000","last_undegraded":"2024-09-13T18:30:17.435798+0000","last_fullsized":"2024-09-13T18:30:17.435798+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469427+0000","last_change":"2024-09-13T18:30:17.461206+0000","last_active":"2024-09-13T18:30:17.469427+0000","last_peered":"2024-09-13T18:30:17.469427+0000","last_clean":"2024-09-13T18:30:17.469427+0000","last_became_active":"2024-09-13T18:30:17.460470+0000","last_became_peered":"2024-09-13T18:30:17.460470+0000","last_unstale":"2024-09-13T18:30:17.469427+0000","last_undegraded":"2024-09-13T18:30:17.469427+0000","last_fullsized":"2024-09-13T18:30:17.469427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447671+0000","last_change":"2024-09-13T18:30:17.447671+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447671+0000","last_undegraded":"2024-09-13T18:30:17.447671+0000","last_fullsized":"2024-09-13T18:30:17.447671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474559+0000","last_change":"2024-09-13T18:30:17.474092+0000","last_active":"2024-09-13T18:30:17.474559+0000","last_peered":"2024-09-13T18:30:17.474559+0000","last_clean":"2024-09-13T18:30:17.474559+0000","last_became_active":"2024-09-13T18:30:17.473815+0000","last_became_peered":"2024-09-13T18:30:17.473815+0000","last_unstale":"2024-09-13T18:30:17.474559+0000","last_undegraded":"2024-09-13T18:30:17.474559+0000","last_fullsized":"2024-09-13T18:30:17.474559+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:28.609087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.447486+0000","last_change":"2024-09-13T18:30:17.447486+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.447486+0000","last_undegraded":"2024-09-13T18:30:17.447486+0000","last_fullsized":"2024-09-13T18:30:17.447486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:37.194826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458389+0000","last_change":"2024-09-13T18:30:17.455292+0000","last_active":"2024-09-13T18:30:17.458389+0000","last_peered":"2024-09-13T18:30:17.458389+0000","last_clean":"2024-09-13T18:30:17.458389+0000","last_became_active":"2024-09-13T18:30:17.454937+0000","last_became_peered":"2024-09-13T18:30:17.454937+0000","last_unstale":"2024-09-13T18:30:17.458389+0000","last_undegraded":"2024-09-13T18:30:17.458389+0000","last_fullsized":"2024-09-13T18:30:17.458389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:22.782961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443246+0000","last_change":"2024-09-13T18:30:17.443246+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443246+0000","last_undegraded":"2024-09-13T18:30:17.443246+0000","last_fullsized":"2024-09-13T18:30:17.443246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:45.041871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478396+0000","last_change":"2024-09-13T18:30:17.474124+0000","last_active":"2024-09-13T18:30:17.478396+0000","last_peered":"2024-09-13T18:30:17.478396+0000","last_clean":"2024-09-13T18:30:17.478396+0000","last_became_active":"2024-09-13T18:30:17.469795+0000","last_became_peered":"2024-09-13T18:30:17.469795+0000","last_unstale":"2024-09-13T18:30:17.478396+0000","last_undegraded":"2024-09-13T18:30:17.478396+0000","last_fullsized":"2024-09-13T18:30:17.478396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:32.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443848+0000","last_change":"2024-09-13T18:30:17.443848+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443848+0000","last_undegraded":"2024-09-13T18:30:17.443848+0000","last_fullsized":"2024-09-13T18:30:17.443848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:52.338016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476975+0000","last_change":"2024-09-13T18:30:17.472015+0000","last_active":"2024-09-13T18:30:17.476975+0000","last_peered":"2024-09-13T18:30:17.476975+0000","last_clean":"2024-09-13T18:30:17.476975+0000","last_became_active":"2024-09-13T18:30:17.471329+0000","last_became_peered":"2024-09-13T18:30:17.471329+0000","last_unstale":"2024-09-13T18:30:17.476975+0000","last_undegraded":"2024-09-13T18:30:17.476975+0000","last_fullsized":"2024-09-13T18:30:17.476975+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:05.307653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444732+0000","last_change":"2024-09-13T18:30:17.444732+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444732+0000","last_undegraded":"2024-09-13T18:30:17.444732+0000","last_fullsized":"2024-09-13T18:30:17.444732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.476847+0000","last_change":"2024-09-13T18:30:17.470926+0000","last_active":"2024-09-13T18:30:17.476847+0000","last_peered":"2024-09-13T18:30:17.476847+0000","last_clean":"2024-09-13T18:30:17.476847+0000","last_became_active":"2024-09-13T18:30:17.470211+0000","last_became_peered":"2024-09-13T18:30:17.470211+0000","last_unstale":"2024-09-13T18:30:17.476847+0000","last_undegraded":"2024-09-13T18:30:17.476847+0000","last_fullsized":"2024-09-13T18:30:17.476847+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.832081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.438897+0000","last_change":"2024-09-13T18:30:17.438897+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.438897+0000","last_undegraded":"2024-09-13T18:30:17.438897+0000","last_fullsized":"2024-09-13T18:30:17.438897+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.470724+0000","last_change":"2024-09-13T18:30:17.461445+0000","last_active":"2024-09-13T18:30:17.470724+0000","last_peered":"2024-09-13T18:30:17.470724+0000","last_clean":"2024-09-13T18:30:17.470724+0000","last_became_active":"2024-09-13T18:30:17.460719+0000","last_became_peered":"2024-09-13T18:30:17.460719+0000","last_unstale":"2024-09-13T18:30:17.470724+0000","last_undegraded":"2024-09-13T18:30:17.470724+0000","last_fullsized":"2024-09-13T18:30:17.470724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442120+0000","last_change":"2024-09-13T18:30:17.442120+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442120+0000","last_undegraded":"2024-09-13T18:30:17.442120+0000","last_fullsized":"2024-09-13T18:30:17.442120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.458009+0000","last_change":"2024-09-13T18:30:17.452963+0000","last_active":"2024-09-13T18:30:17.458009+0000","last_peered":"2024-09-13T18:30:17.458009+0000","last_clean":"2024-09-13T18:30:17.458009+0000","last_became_active":"2024-09-13T18:30:17.452659+0000","last_became_peered":"2024-09-13T18:30:17.452659+0000","last_unstale":"2024-09-13T18:30:17.458009+0000","last_undegraded":"2024-09-13T18:30:17.458009+0000","last_fullsized":"2024-09-13T18:30:17.458009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:30.685201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448927+0000","last_change":"2024-09-13T18:30:17.448927+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448927+0000","last_undegraded":"2024-09-13T18:30:17.448927+0000","last_fullsized":"2024-09-13T18:30:17.448927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461506+0000","last_change":"2024-09-13T18:30:17.459076+0000","last_active":"2024-09-13T18:30:17.461506+0000","last_peered":"2024-09-13T18:30:17.461506+0000","last_clean":"2024-09-13T18:30:17.461506+0000","last_became_active":"2024-09-13T18:30:17.458664+0000","last_became_peered":"2024-09-13T18:30:17.458664+0000","last_unstale":"2024-09-13T18:30:17.461506+0000","last_undegraded":"2024-09-13T18:30:17.461506+0000","last_fullsized":"2024-09-13T18:30:17.461506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:57.981653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442723+0000","last_change":"2024-09-13T18:30:17.442723+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442723+0000","last_undegraded":"2024-09-13T18:30:17.442723+0000","last_fullsized":"2024-09-13T18:30:17.442723+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.474249+0000","last_change":"2024-09-13T18:30:17.470482+0000","last_active":"2024-09-13T18:30:17.474249+0000","last_peered":"2024-09-13T18:30:17.474249+0000","last_clean":"2024-09-13T18:30:17.474249+0000","last_became_active":"2024-09-13T18:30:17.469740+0000","last_became_peered":"2024-09-13T18:30:17.469740+0000","last_unstale":"2024-09-13T18:30:17.474249+0000","last_undegraded":"2024-09-13T18:30:17.474249+0000","last_fullsized":"2024-09-13T18:30:17.474249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.444435+0000","last_change":"2024-09-13T18:30:17.444435+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.444435+0000","last_undegraded":"2024-09-13T18:30:17.444435+0000","last_fullsized":"2024-09-13T18:30:17.444435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:48.836972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466100+0000","last_change":"2024-09-13T18:30:17.464881+0000","last_active":"2024-09-13T18:30:17.466100+0000","last_peered":"2024-09-13T18:30:17.466100+0000","last_clean":"2024-09-13T18:30:17.466100+0000","last_became_active":"2024-09-13T18:30:17.464384+0000","last_became_peered":"2024-09-13T18:30:17.464384+0000","last_unstale":"2024-09-13T18:30:17.466100+0000","last_undegraded":"2024-09-13T18:30:17.466100+0000","last_fullsized":"2024-09-13T18:30:17.466100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:22.742563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.449896+0000","last_change":"2024-09-13T18:30:17.449896+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.449896+0000","last_undegraded":"2024-09-13T18:30:17.449896+0000","last_fullsized":"2024-09-13T18:30:17.449896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.478426+0000","last_change":"2024-09-13T18:30:17.474878+0000","last_active":"2024-09-13T18:30:17.478426+0000","last_peered":"2024-09-13T18:30:17.478426+0000","last_clean":"2024-09-13T18:30:17.478426+0000","last_became_active":"2024-09-13T18:30:17.472672+0000","last_became_peered":"2024-09-13T18:30:17.472672+0000","last_unstale":"2024-09-13T18:30:17.478426+0000","last_undegraded":"2024-09-13T18:30:17.478426+0000","last_fullsized":"2024-09-13T18:30:17.478426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:47.827551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448734+0000","last_change":"2024-09-13T18:30:17.448734+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448734+0000","last_undegraded":"2024-09-13T18:30:17.448734+0000","last_fullsized":"2024-09-13T18:30:17.448734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:13.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.471412+0000","last_change":"2024-09-13T18:30:17.470804+0000","last_active":"2024-09-13T18:30:17.471412+0000","last_peered":"2024-09-13T18:30:17.471412+0000","last_clean":"2024-09-13T18:30:17.471412+0000","last_became_active":"2024-09-13T18:30:17.470398+0000","last_became_peered":"2024-09-13T18:30:17.470398+0000","last_unstale":"2024-09-13T18:30:17.471412+0000","last_undegraded":"2024-09-13T18:30:17.471412+0000","last_fullsized":"2024-09-13T18:30:17.471412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:52.402748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437738+0000","last_change":"2024-09-13T18:30:17.437738+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437738+0000","last_undegraded":"2024-09-13T18:30:17.437738+0000","last_fullsized":"2024-09-13T18:30:17.437738+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466115+0000","last_change":"2024-09-13T18:30:17.464795+0000","last_active":"2024-09-13T18:30:17.466115+0000","last_peered":"2024-09-13T18:30:17.466115+0000","last_clean":"2024-09-13T18:30:17.466115+0000","last_became_active":"2024-09-13T18:30:17.464223+0000","last_became_peered":"2024-09-13T18:30:17.464223+0000","last_unstale":"2024-09-13T18:30:17.466115+0000","last_undegraded":"2024-09-13T18:30:17.466115+0000","last_fullsized":"2024-09-13T18:30:17.466115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:46.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.440049+0000","last_change":"2024-09-13T18:30:17.440049+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.440049+0000","last_undegraded":"2024-09-13T18:30:17.440049+0000","last_fullsized":"2024-09-13T18:30:17.440049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.461517+0000","last_change":"2024-09-13T18:30:17.459067+0000","last_active":"2024-09-13T18:30:17.461517+0000","last_peered":"2024-09-13T18:30:17.461517+0000","last_clean":"2024-09-13T18:30:17.461517+0000","last_became_active":"2024-09-13T18:30:17.458693+0000","last_became_peered":"2024-09-13T18:30:17.458693+0000","last_unstale":"2024-09-13T18:30:17.461517+0000","last_undegraded":"2024-09-13T18:30:17.461517+0000","last_fullsized":"2024-09-13T18:30:17.461517+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442547+0000","last_change":"2024-09-13T18:30:17.442547+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442547+0000","last_undegraded":"2024-09-13T18:30:17.442547+0000","last_fullsized":"2024-09-13T18:30:17.442547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:23.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.450723+0000","last_change":"2024-09-13T18:30:17.449547+0000","last_active":"2024-09-13T18:30:17.450723+0000","last_peered":"2024-09-13T18:30:17.450723+0000","last_clean":"2024-09-13T18:30:17.450723+0000","last_became_active":"2024-09-13T18:30:17.449159+0000","last_became_peered":"2024-09-13T18:30:17.449159+0000","last_unstale":"2024-09-13T18:30:17.450723+0000","last_undegraded":"2024-09-13T18:30:17.450723+0000","last_fullsized":"2024-09-13T18:30:17.450723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:23.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.439476+0000","last_change":"2024-09-13T18:30:17.439476+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.439476+0000","last_undegraded":"2024-09-13T18:30:17.439476+0000","last_fullsized":"2024-09-13T18:30:17.439476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:41.845328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465034+0000","last_change":"2024-09-13T18:30:17.463039+0000","last_active":"2024-09-13T18:30:17.465034+0000","last_peered":"2024-09-13T18:30:17.465034+0000","last_clean":"2024-09-13T18:30:17.465034+0000","last_became_active":"2024-09-13T18:30:17.462645+0000","last_became_peered":"2024-09-13T18:30:17.462645+0000","last_unstale":"2024-09-13T18:30:17.465034+0000","last_undegraded":"2024-09-13T18:30:17.465034+0000","last_fullsized":"2024-09-13T18:30:17.465034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:33.468494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442507+0000","last_change":"2024-09-13T18:30:17.442507+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442507+0000","last_undegraded":"2024-09-13T18:30:17.442507+0000","last_fullsized":"2024-09-13T18:30:17.442507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:23.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.460967+0000","last_change":"2024-09-13T18:30:17.456332+0000","last_active":"2024-09-13T18:30:17.460967+0000","last_peered":"2024-09-13T18:30:17.460967+0000","last_clean":"2024-09-13T18:30:17.460967+0000","last_became_active":"2024-09-13T18:30:17.455964+0000","last_became_peered":"2024-09-13T18:30:17.455964+0000","last_unstale":"2024-09-13T18:30:17.460967+0000","last_undegraded":"2024-09-13T18:30:17.460967+0000","last_fullsized":"2024-09-13T18:30:17.460967+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.827618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.437372+0000","last_change":"2024-09-13T18:30:17.437372+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.437372+0000","last_undegraded":"2024-09-13T18:30:17.437372+0000","last_fullsized":"2024-09-13T18:30:17.437372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.463757+0000","last_change":"2024-09-13T18:30:17.462879+0000","last_active":"2024-09-13T18:30:17.463757+0000","last_peered":"2024-09-13T18:30:17.463757+0000","last_clean":"2024-09-13T18:30:17.463757+0000","last_became_active":"2024-09-13T18:30:17.462602+0000","last_became_peered":"2024-09-13T18:30:17.462602+0000","last_unstale":"2024-09-13T18:30:17.463757+0000","last_undegraded":"2024-09-13T18:30:17.463757+0000","last_fullsized":"2024-09-13T18:30:17.463757+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:36.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.454211+0000","last_change":"2024-09-13T18:30:17.454211+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.454211+0000","last_undegraded":"2024-09-13T18:30:17.454211+0000","last_fullsized":"2024-09-13T18:30:17.454211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.457978+0000","last_change":"2024-09-13T18:30:17.451616+0000","last_active":"2024-09-13T18:30:17.457978+0000","last_peered":"2024-09-13T18:30:17.457978+0000","last_clean":"2024-09-13T18:30:17.457978+0000","last_became_active":"2024-09-13T18:30:17.451294+0000","last_became_peered":"2024-09-13T18:30:17.451294+0000","last_unstale":"2024-09-13T18:30:17.457978+0000","last_undegraded":"2024-09-13T18:30:17.457978+0000","last_fullsized":"2024-09-13T18:30:17.457978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:05.389105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.448384+0000","last_change":"2024-09-13T18:30:17.448384+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.448384+0000","last_undegraded":"2024-09-13T18:30:17.448384+0000","last_fullsized":"2024-09-13T18:30:17.448384+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.093622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466414+0000","last_change":"2024-09-13T18:30:17.461240+0000","last_active":"2024-09-13T18:30:17.466414+0000","last_peered":"2024-09-13T18:30:17.466414+0000","last_clean":"2024-09-13T18:30:17.466414+0000","last_became_active":"2024-09-13T18:30:17.460378+0000","last_became_peered":"2024-09-13T18:30:17.460378+0000","last_unstale":"2024-09-13T18:30:17.466414+0000","last_undegraded":"2024-09-13T18:30:17.466414+0000","last_fullsized":"2024-09-13T18:30:17.466414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:11.697682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.436106+0000","last_change":"2024-09-13T18:30:17.436106+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.436106+0000","last_undegraded":"2024-09-13T18:30:17.436106+0000","last_fullsized":"2024-09-13T18:30:17.436106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475139+0000","last_change":"2024-09-13T18:30:17.465881+0000","last_active":"2024-09-13T18:30:17.475139+0000","last_peered":"2024-09-13T18:30:17.475139+0000","last_clean":"2024-09-13T18:30:17.475139+0000","last_became_active":"2024-09-13T18:30:17.465092+0000","last_became_peered":"2024-09-13T18:30:17.465092+0000","last_unstale":"2024-09-13T18:30:17.475139+0000","last_undegraded":"2024-09-13T18:30:17.475139+0000","last_fullsized":"2024-09-13T18:30:17.475139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:33.928423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.443818+0000","last_change":"2024-09-13T18:30:17.443818+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.443818+0000","last_undegraded":"2024-09-13T18:30:17.443818+0000","last_fullsized":"2024-09-13T18:30:17.443818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.466114+0000","last_change":"2024-09-13T18:30:17.464900+0000","last_active":"2024-09-13T18:30:17.466114+0000","last_peered":"2024-09-13T18:30:17.466114+0000","last_clean":"2024-09-13T18:30:17.466114+0000","last_became_active":"2024-09-13T18:30:17.464577+0000","last_became_peered":"2024-09-13T18:30:17.464577+0000","last_unstale":"2024-09-13T18:30:17.466114+0000","last_undegraded":"2024-09-13T18:30:17.466114+0000","last_fullsized":"2024-09-13T18:30:17.466114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:11.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.442776+0000","last_change":"2024-09-13T18:30:17.442776+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.442776+0000","last_undegraded":"2024-09-13T18:30:17.442776+0000","last_fullsized":"2024-09-13T18:30:17.442776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.469378+0000","last_change":"2024-09-13T18:30:17.458897+0000","last_active":"2024-09-13T18:30:17.469378+0000","last_peered":"2024-09-13T18:30:17.469378+0000","last_clean":"2024-09-13T18:30:17.469378+0000","last_became_active":"2024-09-13T18:30:17.458107+0000","last_became_peered":"2024-09-13T18:30:17.458107+0000","last_unstale":"2024-09-13T18:30:17.469378+0000","last_undegraded":"2024-09-13T18:30:17.469378+0000","last_fullsized":"2024-09-13T18:30:17.469378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446454+0000","last_change":"2024-09-13T18:30:17.446454+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446454+0000","last_undegraded":"2024-09-13T18:30:17.446454+0000","last_fullsized":"2024-09-13T18:30:17.446454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.475165+0000","last_change":"2024-09-13T18:30:17.466750+0000","last_active":"2024-09-13T18:30:17.475165+0000","last_peered":"2024-09-13T18:30:17.475165+0000","last_clean":"2024-09-13T18:30:17.475165+0000","last_became_active":"2024-09-13T18:30:17.465572+0000","last_became_peered":"2024-09-13T18:30:17.465572+0000","last_unstale":"2024-09-13T18:30:17.475165+0000","last_undegraded":"2024-09-13T18:30:17.475165+0000","last_fullsized":"2024-09-13T18:30:17.475165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:45.386119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.446420+0000","last_change":"2024-09-13T18:30:17.446420+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.446420+0000","last_undegraded":"2024-09-13T18:30:17.446420+0000","last_fullsized":"2024-09-13T18:30:17.446420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:37.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.472200+0000","last_change":"2024-09-13T18:30:17.469644+0000","last_active":"2024-09-13T18:30:17.472200+0000","last_peered":"2024-09-13T18:30:17.472200+0000","last_clean":"2024-09-13T18:30:17.472200+0000","last_became_active":"2024-09-13T18:30:17.468475+0000","last_became_peered":"2024-09-13T18:30:17.468475+0000","last_unstale":"2024-09-13T18:30:17.472200+0000","last_undegraded":"2024-09-13T18:30:17.472200+0000","last_fullsized":"2024-09-13T18:30:17.472200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:28.084201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-13T18:30:17.445440+0000","last_change":"2024-09-13T18:30:17.445440+0000","last_active":"2024-09-13T18:30:17.422984+0000","last_peered":"2024-09-13T18:30:17.422984+0000","last_clean":"2024-09-13T18:30:17.422984+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:30:17.445440+0000","last_undegraded":"2024-09-13T18:30:17.445440+0000","last_fullsized":"2024-09-13T18:30:17.445440+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.465858+0000","last_change":"2024-09-13T18:30:17.463051+0000","last_active":"2024-09-13T18:30:17.465858+0000","last_peered":"2024-09-13T18:30:17.465858+0000","last_clean":"2024-09-13T18:30:17.465858+0000","last_became_active":"2024-09-13T18:30:17.462356+0000","last_became_peered":"2024-09-13T18:30:17.462356+0000","last_unstale":"2024-09-13T18:30:17.465858+0000","last_undegraded":"2024-09-13T18:30:17.465858+0000","last_fullsized":"2024-09-13T18:30:17.465858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:33.324949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-13T18:30:16.440164+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:30:16.440164+0000","last_peered":"2024-09-13T18:30:16.440164+0000","last_clean":"2024-09-13T18:30:16.440164+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:30:16.440164+0000","last_undegraded":"2024-09-13T18:30:16.440164+0000","last_fullsized":"2024-09-13T18:30:16.440164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1638400,"data_stored":1038977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.026},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94999999999999996,"15min":0.89000000000000001},"min":{"1min":0.67400000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1870000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.58899999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.278,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2849999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84199999999999997,"15min":0.80400000000000005},"min":{"1min":0.55500000000000005,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.133,"5min":1.276,"15min":1.276},"last":0.995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89800000000000002,"15min":0.88100000000000001},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.296,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1679999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.1519999999999999,"5min":1.448,"15min":1.448},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95999999999999996,"15min":0.91400000000000003},"min":{"1min":0.68400000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.256,"5min":1.397,"15min":1.397},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2210000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.01,"15min":1.04},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.877,"15min":1.877},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0069999999999999,"15min":0.98199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3180000000000001,"5min":1.321,"15min":1.321},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.68500000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.274,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.044,"15min":1},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2969999999999999,"5min":1.506,"15min":1.506},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.78700000000000003},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.56100000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.24,"5min":1.577,"15min":1.577},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.998,"5min":0.95999999999999996,"15min":0.90100000000000002},"min":{"1min":0.68899999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.218,"5min":1.464,"15min":1.464},"last":0.98099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1080000000000001,"5min":1.268,"15min":1.268},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.92800000000000005,"15min":0.97099999999999997},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88600000000000001,"15min":0.876},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.131,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.024},{"interface":"front","average":{"1min":0.875,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1040000000000001,"5min":1.306,"15min":1.306},"last":0.80900000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.67000000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.157,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.02,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":1.526},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.57699999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1950000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.627},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.036,"15min":1.0960000000000001},"min":{"1min":0.60499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.228,"5min":2.762,"15min":2.762},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.002,"15min":1.0349999999999999},"min":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.01,"15min":1.038},"min":{"1min":0.63100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":1.72,"15min":1.72},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0580000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.876,"15min":0.90600000000000003},"min":{"1min":0.46800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.165,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.105}]},{"osd":1,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.875,"15min":0.83299999999999996},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1870000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.82899999999999996},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.157,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.88100000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.27,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.149},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93000000000000005,"15min":0.96999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.383,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.72099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.349,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6719999999999999,"5min":1.871,"15min":1.871},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.92400000000000004,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98699999999999999,"15min":1.0489999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4059999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98299999999999998,"15min":1.0289999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":1.026},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0389999999999999,"15min":1.117},"min":{"1min":0.84699999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.268,"5min":2.246,"15min":2.246},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.077,"15min":1.139},"min":{"1min":0.81299999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5980000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.0209999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84099999999999997,"15min":0.80600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.357,"15min":1.357},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88,"15min":0.876},"min":{"1min":0.59899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.96699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":1.536,"15min":1.536},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.88},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1859999999999999,"5min":1.323,"15min":1.323},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1379999999999999,"5min":1.476,"15min":1.476},"last":1.071},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92600000000000005,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.997}]},{"osd":5,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.94599999999999995},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.72099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3240000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93100000000000005,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.234,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.095},{"interface":"front","average":{"1min":1.054,"5min":1.004,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.145}]},{"osd":7,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3640000000000001,"5min":1.482,"15min":1.482},"last":1.125},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.073},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.179}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68899999999999995,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0700000000000001,"5min":2.113,"15min":2.113},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79100000000000004,"15min":0.71899999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1619999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.97699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.095,"5min":1.704,"15min":1.704},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.61899999999999999},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0620000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.70599999999999996},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1479999999999999,"5min":1.742,"15min":1.742},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80500000000000005,"15min":0.745},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.2010000000000001,"5min":1.399,"15min":1.399},"last":1.1339999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.70699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3089999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.113},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.264,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.94499999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3260000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.04,"15min":1.069},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.272,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.0640000000000001,"15min":1.054},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.6890000000000001,"5min":1.96,"15min":1.96},"last":1.256}]},{"osd":7,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0680000000000001,"15min":1.1000000000000001},"min":{"1min":0.67600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.359,"5min":3,"15min":3},"last":1.087},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0429999999999999,"15min":1.006},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1032192,"data_stored":442334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.97999999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.34000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.92900000000000005,"5min":1.335,"15min":1.335},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.41099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.423,"15min":1.423},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.101,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.77700000000000002},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2669999999999999,"5min":1.274,"15min":1.274},"last":0.314}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92200000000000004,"15min":0.90900000000000003},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1950000000000001,"5min":1.611,"15min":1.611},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.90800000000000003,"15min":0.91700000000000004},"min":{"1min":0.66200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.321,"5min":1.492,"15min":1.492},"last":0.623}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97699999999999998,"15min":1.0029999999999999},"min":{"1min":0.65600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2989999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.702,"15min":1.702},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.55400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.171,"5min":1.54,"15min":1.54},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0229999999999999,"15min":1.046},"min":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":1.452,"15min":1.452},"last":0.93200000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.109,"5min":1.657,"15min":1.657},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.071,"15min":1.0820000000000001},"min":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.375,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.81599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36232,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335608,"statfs":{"total":96636764160,"available":96599662592,"internally_reserved":0,"allocated":1044480,"data_stored":448609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.876},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.60899999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0149999999999999,"5min":1.177,"15min":1.177},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.69999999999999996},"min":{"1min":0.39400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.82099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.216,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93300000000000005,"15min":0.91800000000000004},"min":{"1min":0.747,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0209999999999999,"15min":1},"min":{"1min":0.64000000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5900000000000001,"5min":1.653,"15min":1.653},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.78900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2669999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0669999999999999,"15min":1.048},"min":{"1min":0.61899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0620000000000001,"15min":1.0189999999999999},"min":{"1min":0.71299999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.323,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":1626112,"data_stored":1032702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86199999999999999,"5min":1.147,"15min":1.147},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.056,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2310000000000001,"5min":1.333,"15min":1.333},"last":1.085},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70699999999999996,"15min":0.69899999999999995},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92800000000000005,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.73799999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0209999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.94799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4710000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98999999999999999,"15min":0.996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.986,"15min":1.986},"last":1.1830000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2030000000000001,"5min":2.641,"15min":2.641},"last":1.3},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.044},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2370000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.272}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0760000000000001,"15min":1.077},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.296,"5min":1.891,"15min":1.891},"last":1.323},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0289999999999999},"min":{"1min":0.61899999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5549999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":1.042}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.018,"15min":1.03},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.109,"15min":1.1040000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.25}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:30:25.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:25.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:26.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:30:26.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.410+0000 7f6dfbbca640 1 Processor -- start 2024-09-13T18:30:26.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.410+0000 7f6dfbbca640 1 -- start start 2024-09-13T18:30:26.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6dfbbca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6df40cd630 0x7f6df40b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6dfbbca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6df40b1af0 0x7f6df4069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6dfbbca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40cfe80 con 0x7f6df406a490 2024-09-13T18:30:26.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6dfbbca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40d0120 con 0x7f6df40b1af0 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6dfbbca640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df406ac20 con 0x7f6df40cd630 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9165640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6df40b1af0 0x7f6df4069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6dfa167640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6df406a490 0x7f6df40ad3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60400/0 (socket says 172.21.15.53:60400) 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6dfa167640 1 -- 172.21.15.53:0/4025010846 learned_addr learned my addr 172.21.15.53:0/4025010846 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9165640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6df40b1af0 0x7f6df4069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58930/0 (socket says 172.21.15.53:58930) 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9966640 1 --2- 172.21.15.53:0/4025010846 >> v2:172.21.15.87:3300/0 conn(0x7f6df40cd630 0x7f6df40b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9165640 1 -- 172.21.15.53:0/4025010846 >> v2:172.21.15.87:3300/0 conn(0x7f6df40cd630 msgr2=0x7f6df40b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9165640 1 --2- 172.21.15.53:0/4025010846 >> v2:172.21.15.87:3300/0 conn(0x7f6df40cd630 0x7f6df40b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9165640 1 -- 172.21.15.53:0/4025010846 >> v1:172.21.15.53:6789/0 conn(0x7f6df406a490 legacy=0x7f6df40ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9165640 1 -- 172.21.15.53:0/4025010846 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df406af00 con 0x7f6df40b1af0 2024-09-13T18:30:26.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df9165640 1 --2- 172.21.15.53:0/4025010846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df40b1af0 0x7f6df4069f50 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6df4070a70 tx=0x7f6de401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff2c2e755ec3336 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df8964640 1 -- 172.21.15.53:0/4025010846 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40aa640 con 0x7f6df40b1af0 2024-09-13T18:30:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df8964640 1 -- 172.21.15.53:0/4025010846 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de40a6070 con 0x7f6df40b1af0 2024-09-13T18:30:26.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.414+0000 7f6df8964640 1 -- 172.21.15.53:0/4025010846 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40aa9c0 con 0x7f6df40b1af0 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- 172.21.15.53:0/4025010846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df40b1af0 msgr2=0x7f6df4069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/4025010846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df40b1af0 0x7f6df4069f50 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6df4070a70 tx=0x7f6de401bf60 comp rx=0 tx=0).stop 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- 172.21.15.53:0/4025010846 shutdown_connections 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/4025010846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df40b1af0 0x7f6df4069f50 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/4025010846 >> v2:172.21.15.87:3300/0 conn(0x7f6df40cd630 0x7f6df40b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- 172.21.15.53:0/4025010846 >> 172.21.15.53:0/4025010846 conn(0x7f6df40b20d0 msgr2=0x7f6df40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- 172.21.15.53:0/4025010846 shutdown_connections 2024-09-13T18:30:26.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- 172.21.15.53:0/4025010846 wait complete. 2024-09-13T18:30:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 Processor -- start 2024-09-13T18:30:26.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- start start 2024-09-13T18:30:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df406a490 0x7f6df415edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6df40b1af0 0x7f6df40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6df40cd630 0x7f6df40c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df415fd20 con 0x7f6df406a490 2024-09-13T18:30:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df415f760 con 0x7f6df40cd630 2024-09-13T18:30:26.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dfbbca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df415fa40 con 0x7f6df40b1af0 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df406a490 0x7f6df415edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df406a490 0x7f6df415edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58934/0 (socket says 172.21.15.53:58934) 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 -- 172.21.15.53:0/251252324 learned_addr learned my addr 172.21.15.53:0/251252324 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 -- 172.21.15.53:0/251252324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6df40b1af0 msgr2=0x7f6df40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6df40b1af0 0x7f6df40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 -- 172.21.15.53:0/251252324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6df40cd630 msgr2=0x7f6df40c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6df40cd630 0x7f6df40c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 -- 172.21.15.53:0/251252324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4009420 con 0x7f6df406a490 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6df9966640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df406a490 0x7f6df415edf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6df0007ef0 tx=0x7f6df000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dea7fc640 1 -- 172.21.15.53:0/251252324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0014620 con 0x7f6df406a490 2024-09-13T18:30:26.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dea7fc640 1 -- 172.21.15.53:0/251252324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df0014780 con 0x7f6df406a490 2024-09-13T18:30:26.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.418+0000 7f6dea7fc640 1 -- 172.21.15.53:0/251252324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0014b30 con 0x7f6df406a490 2024-09-13T18:30:26.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df40c4140 con 0x7f6df406a490 2024-09-13T18:30:26.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df415f330 con 0x7f6df406a490 2024-09-13T18:30:26.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df415f520 con 0x7f6df406a490 2024-09-13T18:30:26.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6dea7fc640 1 -- 172.21.15.53:0/251252324 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f6df0014c90 con 0x7f6df406a490 2024-09-13T18:30:26.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6dea7fc640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6dd80667b0 0x7f6dd8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6dea7fc640 1 -- 172.21.15.53:0/251252324 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6df0084d80 con 0x7f6df406a490 2024-09-13T18:30:26.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6df9165640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6dd80667b0 0x7f6dd8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.422+0000 7f6df9165640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6dd80667b0 0x7f6dd8068c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6de40ae000 tx=0x7f6de4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:26.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.426+0000 7f6dea7fc640 1 -- 172.21.15.53:0/251252324 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6df415f520 con 0x7f6df406a490 2024-09-13T18:30:26.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.586+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6df40b2e90 con 0x7f6dd80667b0 2024-09-13T18:30:26.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.610+0000 7f6dea7fc640 1 -- 172.21.15.53:0/251252324 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288197 (secure 0 0 0) 0x7f6de40aa4c0 con 0x7f6dd80667b0 2024-09-13T18:30:26.612 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:26.616 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:30:26.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6dd80667b0 msgr2=0x7f6dd8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6dd80667b0 0x7f6dd8068c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6de40ae000 tx=0x7f6de4008040 comp rx=0 tx=0).stop 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df406a490 msgr2=0x7f6df415edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df406a490 0x7f6df415edf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6df0007ef0 tx=0x7f6df000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 shutdown_connections 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6dd80667b0 0x7f6dd8068c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6df40b1af0 0x7f6df40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6df40cd630 0x7f6df40c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 --2- 172.21.15.53:0/251252324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df406a490 0x7f6df415edf0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 >> 172.21.15.53:0/251252324 conn(0x7f6df40b20d0 msgr2=0x7f6df415d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 shutdown_connections 2024-09-13T18:30:26.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.614+0000 7f6dfbbca640 1 -- 172.21.15.53:0/251252324 wait complete. 2024-09-13T18:30:26.633 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-13T18:30:25.827118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":274920,"kb_used_data":9576,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754699800,"statfs":{"total":773094113280,"available":772812595200,"internally_reserved":0,"allocated":9805824,"data_stored":4878932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003252"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.884960+0000","last_change":"2024-09-13T18:30:17.875319+0000","last_active":"2024-09-13T18:30:17.884960+0000","last_peered":"2024-09-13T18:30:17.884960+0000","last_clean":"2024-09-13T18:30:17.884960+0000","last_became_active":"2024-09-13T18:30:17.873543+0000","last_became_peered":"2024-09-13T18:30:17.873543+0000","last_unstale":"2024-09-13T18:30:17.884960+0000","last_undegraded":"2024-09-13T18:30:17.884960+0000","last_fullsized":"2024-09-13T18:30:17.884960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:36.892959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.875744+0000","last_change":"2024-09-13T18:30:17.875181+0000","last_active":"2024-09-13T18:30:17.875744+0000","last_peered":"2024-09-13T18:30:17.875744+0000","last_clean":"2024-09-13T18:30:17.875744+0000","last_became_active":"2024-09-13T18:30:17.874830+0000","last_became_peered":"2024-09-13T18:30:17.874830+0000","last_unstale":"2024-09-13T18:30:17.875744+0000","last_undegraded":"2024-09-13T18:30:17.875744+0000","last_fullsized":"2024-09-13T18:30:17.875744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:42.841502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.884026+0000","last_change":"2024-09-13T18:30:17.882042+0000","last_active":"2024-09-13T18:30:17.884026+0000","last_peered":"2024-09-13T18:30:17.884026+0000","last_clean":"2024-09-13T18:30:17.884026+0000","last_became_active":"2024-09-13T18:30:17.881349+0000","last_became_peered":"2024-09-13T18:30:17.881349+0000","last_unstale":"2024-09-13T18:30:17.884026+0000","last_undegraded":"2024-09-13T18:30:17.884026+0000","last_fullsized":"2024-09-13T18:30:17.884026+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.845761+0000","last_change":"2024-09-13T18:30:17.842595+0000","last_active":"2024-09-13T18:30:17.845761+0000","last_peered":"2024-09-13T18:30:17.845761+0000","last_clean":"2024-09-13T18:30:17.845761+0000","last_became_active":"2024-09-13T18:30:17.842303+0000","last_became_peered":"2024-09-13T18:30:17.842303+0000","last_unstale":"2024-09-13T18:30:17.845761+0000","last_undegraded":"2024-09-13T18:30:17.845761+0000","last_fullsized":"2024-09-13T18:30:17.845761+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:14.566181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878875+0000","last_change":"2024-09-13T18:30:17.875102+0000","last_active":"2024-09-13T18:30:17.878875+0000","last_peered":"2024-09-13T18:30:17.878875+0000","last_clean":"2024-09-13T18:30:17.878875+0000","last_became_active":"2024-09-13T18:30:17.871308+0000","last_became_peered":"2024-09-13T18:30:17.871308+0000","last_unstale":"2024-09-13T18:30:17.878875+0000","last_undegraded":"2024-09-13T18:30:17.878875+0000","last_fullsized":"2024-09-13T18:30:17.878875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868596+0000","last_change":"2024-09-13T18:30:17.857456+0000","last_active":"2024-09-13T18:30:17.868596+0000","last_peered":"2024-09-13T18:30:17.868596+0000","last_clean":"2024-09-13T18:30:17.868596+0000","last_became_active":"2024-09-13T18:30:17.856060+0000","last_became_peered":"2024-09-13T18:30:17.856060+0000","last_unstale":"2024-09-13T18:30:17.868596+0000","last_undegraded":"2024-09-13T18:30:17.868596+0000","last_fullsized":"2024-09-13T18:30:17.868596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:47.133367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.855597+0000","last_change":"2024-09-13T18:30:17.855275+0000","last_active":"2024-09-13T18:30:17.855597+0000","last_peered":"2024-09-13T18:30:17.855597+0000","last_clean":"2024-09-13T18:30:17.855597+0000","last_became_active":"2024-09-13T18:30:17.855043+0000","last_became_peered":"2024-09-13T18:30:17.855043+0000","last_unstale":"2024-09-13T18:30:17.855597+0000","last_undegraded":"2024-09-13T18:30:17.855597+0000","last_fullsized":"2024-09-13T18:30:17.855597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.869742+0000","last_change":"2024-09-13T18:30:17.863281+0000","last_active":"2024-09-13T18:30:17.869742+0000","last_peered":"2024-09-13T18:30:17.869742+0000","last_clean":"2024-09-13T18:30:17.869742+0000","last_became_active":"2024-09-13T18:30:17.860336+0000","last_became_peered":"2024-09-13T18:30:17.860336+0000","last_unstale":"2024-09-13T18:30:17.869742+0000","last_undegraded":"2024-09-13T18:30:17.869742+0000","last_fullsized":"2024-09-13T18:30:17.869742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:53.412169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868454+0000","last_change":"2024-09-13T18:30:17.857235+0000","last_active":"2024-09-13T18:30:17.868454+0000","last_peered":"2024-09-13T18:30:17.868454+0000","last_clean":"2024-09-13T18:30:17.868454+0000","last_became_active":"2024-09-13T18:30:17.856596+0000","last_became_peered":"2024-09-13T18:30:17.856596+0000","last_unstale":"2024-09-13T18:30:17.868454+0000","last_undegraded":"2024-09-13T18:30:17.868454+0000","last_fullsized":"2024-09-13T18:30:17.868454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.879261+0000","last_change":"2024-09-13T18:30:17.860520+0000","last_active":"2024-09-13T18:30:17.879261+0000","last_peered":"2024-09-13T18:30:17.879261+0000","last_clean":"2024-09-13T18:30:17.879261+0000","last_became_active":"2024-09-13T18:30:17.843446+0000","last_became_peered":"2024-09-13T18:30:17.843446+0000","last_unstale":"2024-09-13T18:30:17.879261+0000","last_undegraded":"2024-09-13T18:30:17.879261+0000","last_fullsized":"2024-09-13T18:30:17.879261+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:25.340119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.870200+0000","last_change":"2024-09-13T18:30:17.869483+0000","last_active":"2024-09-13T18:30:17.870200+0000","last_peered":"2024-09-13T18:30:17.870200+0000","last_clean":"2024-09-13T18:30:17.870200+0000","last_became_active":"2024-09-13T18:30:17.869171+0000","last_became_peered":"2024-09-13T18:30:17.869171+0000","last_unstale":"2024-09-13T18:30:17.870200+0000","last_undegraded":"2024-09-13T18:30:17.870200+0000","last_fullsized":"2024-09-13T18:30:17.870200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:33.942214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.880902+0000","last_change":"2024-09-13T18:30:17.862547+0000","last_active":"2024-09-13T18:30:17.880902+0000","last_peered":"2024-09-13T18:30:17.880902+0000","last_clean":"2024-09-13T18:30:17.880902+0000","last_became_active":"2024-09-13T18:30:17.861875+0000","last_became_peered":"2024-09-13T18:30:17.861875+0000","last_unstale":"2024-09-13T18:30:17.880902+0000","last_undegraded":"2024-09-13T18:30:17.880902+0000","last_fullsized":"2024-09-13T18:30:17.880902+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:17.869422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.884015+0000","last_change":"2024-09-13T18:30:17.880337+0000","last_active":"2024-09-13T18:30:17.884015+0000","last_peered":"2024-09-13T18:30:17.884015+0000","last_clean":"2024-09-13T18:30:17.884015+0000","last_became_active":"2024-09-13T18:30:17.879697+0000","last_became_peered":"2024-09-13T18:30:17.879697+0000","last_unstale":"2024-09-13T18:30:17.884015+0000","last_undegraded":"2024-09-13T18:30:17.884015+0000","last_fullsized":"2024-09-13T18:30:17.884015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.853125+0000","last_change":"2024-09-13T18:30:17.852464+0000","last_active":"2024-09-13T18:30:17.853125+0000","last_peered":"2024-09-13T18:30:17.853125+0000","last_clean":"2024-09-13T18:30:17.853125+0000","last_became_active":"2024-09-13T18:30:17.851867+0000","last_became_peered":"2024-09-13T18:30:17.851867+0000","last_unstale":"2024-09-13T18:30:17.853125+0000","last_undegraded":"2024-09-13T18:30:17.853125+0000","last_fullsized":"2024-09-13T18:30:17.853125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.869082+0000","last_change":"2024-09-13T18:30:17.868260+0000","last_active":"2024-09-13T18:30:17.869082+0000","last_peered":"2024-09-13T18:30:17.869082+0000","last_clean":"2024-09-13T18:30:17.869082+0000","last_became_active":"2024-09-13T18:30:17.867873+0000","last_became_peered":"2024-09-13T18:30:17.867873+0000","last_unstale":"2024-09-13T18:30:17.869082+0000","last_undegraded":"2024-09-13T18:30:17.869082+0000","last_fullsized":"2024-09-13T18:30:17.869082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:56.712509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.884424+0000","last_change":"2024-09-13T18:30:17.882807+0000","last_active":"2024-09-13T18:30:17.884424+0000","last_peered":"2024-09-13T18:30:17.884424+0000","last_clean":"2024-09-13T18:30:17.884424+0000","last_became_active":"2024-09-13T18:30:17.882151+0000","last_became_peered":"2024-09-13T18:30:17.882151+0000","last_unstale":"2024-09-13T18:30:17.884424+0000","last_undegraded":"2024-09-13T18:30:17.884424+0000","last_fullsized":"2024-09-13T18:30:17.884424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:19.248527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.876441+0000","last_change":"2024-09-13T18:30:17.855247+0000","last_active":"2024-09-13T18:30:17.876441+0000","last_peered":"2024-09-13T18:30:17.876441+0000","last_clean":"2024-09-13T18:30:17.876441+0000","last_became_active":"2024-09-13T18:30:17.854400+0000","last_became_peered":"2024-09-13T18:30:17.854400+0000","last_unstale":"2024-09-13T18:30:17.876441+0000","last_undegraded":"2024-09-13T18:30:17.876441+0000","last_fullsized":"2024-09-13T18:30:17.876441+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.861507+0000","last_change":"2024-09-13T18:30:17.861058+0000","last_active":"2024-09-13T18:30:17.861507+0000","last_peered":"2024-09-13T18:30:17.861507+0000","last_clean":"2024-09-13T18:30:17.861507+0000","last_became_active":"2024-09-13T18:30:17.860804+0000","last_became_peered":"2024-09-13T18:30:17.860804+0000","last_unstale":"2024-09-13T18:30:17.861507+0000","last_undegraded":"2024-09-13T18:30:17.861507+0000","last_fullsized":"2024-09-13T18:30:17.861507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.849725+0000","last_change":"2024-09-13T18:30:17.845217+0000","last_active":"2024-09-13T18:30:17.849725+0000","last_peered":"2024-09-13T18:30:17.849725+0000","last_clean":"2024-09-13T18:30:17.849725+0000","last_became_active":"2024-09-13T18:30:17.844957+0000","last_became_peered":"2024-09-13T18:30:17.844957+0000","last_unstale":"2024-09-13T18:30:17.849725+0000","last_undegraded":"2024-09-13T18:30:17.849725+0000","last_fullsized":"2024-09-13T18:30:17.849725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.850157+0000","last_change":"2024-09-13T18:30:17.848559+0000","last_active":"2024-09-13T18:30:17.850157+0000","last_peered":"2024-09-13T18:30:17.850157+0000","last_clean":"2024-09-13T18:30:17.850157+0000","last_became_active":"2024-09-13T18:30:17.848302+0000","last_became_peered":"2024-09-13T18:30:17.848302+0000","last_unstale":"2024-09-13T18:30:17.850157+0000","last_undegraded":"2024-09-13T18:30:17.850157+0000","last_fullsized":"2024-09-13T18:30:17.850157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:25.520535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.846947+0000","last_change":"2024-09-13T18:30:17.846363+0000","last_active":"2024-09-13T18:30:17.846947+0000","last_peered":"2024-09-13T18:30:17.846947+0000","last_clean":"2024-09-13T18:30:17.846947+0000","last_became_active":"2024-09-13T18:30:17.843123+0000","last_became_peered":"2024-09-13T18:30:17.843123+0000","last_unstale":"2024-09-13T18:30:17.846947+0000","last_undegraded":"2024-09-13T18:30:17.846947+0000","last_fullsized":"2024-09-13T18:30:17.846947+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.182666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.854224+0000","last_change":"2024-09-13T18:30:17.851252+0000","last_active":"2024-09-13T18:30:17.854224+0000","last_peered":"2024-09-13T18:30:17.854224+0000","last_clean":"2024-09-13T18:30:17.854224+0000","last_became_active":"2024-09-13T18:30:17.850693+0000","last_became_peered":"2024-09-13T18:30:17.850693+0000","last_unstale":"2024-09-13T18:30:17.854224+0000","last_undegraded":"2024-09-13T18:30:17.854224+0000","last_fullsized":"2024-09-13T18:30:17.854224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:47.195635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878959+0000","last_change":"2024-09-13T18:30:17.848365+0000","last_active":"2024-09-13T18:30:17.878959+0000","last_peered":"2024-09-13T18:30:17.878959+0000","last_clean":"2024-09-13T18:30:17.878959+0000","last_became_active":"2024-09-13T18:30:17.847633+0000","last_became_peered":"2024-09-13T18:30:17.847633+0000","last_unstale":"2024-09-13T18:30:17.878959+0000","last_undegraded":"2024-09-13T18:30:17.878959+0000","last_fullsized":"2024-09-13T18:30:17.878959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:07.120328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.850140+0000","last_change":"2024-09-13T18:30:17.848170+0000","last_active":"2024-09-13T18:30:17.850140+0000","last_peered":"2024-09-13T18:30:17.850140+0000","last_clean":"2024-09-13T18:30:17.850140+0000","last_became_active":"2024-09-13T18:30:17.847896+0000","last_became_peered":"2024-09-13T18:30:17.847896+0000","last_unstale":"2024-09-13T18:30:17.850140+0000","last_undegraded":"2024-09-13T18:30:17.850140+0000","last_fullsized":"2024-09-13T18:30:17.850140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.423940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.882049+0000","last_change":"2024-09-13T18:30:17.881542+0000","last_active":"2024-09-13T18:30:17.882049+0000","last_peered":"2024-09-13T18:30:17.882049+0000","last_clean":"2024-09-13T18:30:17.882049+0000","last_became_active":"2024-09-13T18:30:17.881299+0000","last_became_peered":"2024-09-13T18:30:17.881299+0000","last_unstale":"2024-09-13T18:30:17.882049+0000","last_undegraded":"2024-09-13T18:30:17.882049+0000","last_fullsized":"2024-09-13T18:30:17.882049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:47.084744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.875744+0000","last_change":"2024-09-13T18:30:17.867951+0000","last_active":"2024-09-13T18:30:17.875744+0000","last_peered":"2024-09-13T18:30:17.875744+0000","last_clean":"2024-09-13T18:30:17.875744+0000","last_became_active":"2024-09-13T18:30:17.867247+0000","last_became_peered":"2024-09-13T18:30:17.867247+0000","last_unstale":"2024-09-13T18:30:17.875744+0000","last_undegraded":"2024-09-13T18:30:17.875744+0000","last_fullsized":"2024-09-13T18:30:17.875744+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878819+0000","last_change":"2024-09-13T18:30:17.872818+0000","last_active":"2024-09-13T18:30:17.878819+0000","last_peered":"2024-09-13T18:30:17.878819+0000","last_clean":"2024-09-13T18:30:17.878819+0000","last_became_active":"2024-09-13T18:30:17.865125+0000","last_became_peered":"2024-09-13T18:30:17.865125+0000","last_unstale":"2024-09-13T18:30:17.878819+0000","last_undegraded":"2024-09-13T18:30:17.878819+0000","last_fullsized":"2024-09-13T18:30:17.878819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:17.749156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.886219+0000","last_change":"2024-09-13T18:30:17.880377+0000","last_active":"2024-09-13T18:30:17.886219+0000","last_peered":"2024-09-13T18:30:17.886219+0000","last_clean":"2024-09-13T18:30:17.886219+0000","last_became_active":"2024-09-13T18:30:17.879767+0000","last_became_peered":"2024-09-13T18:30:17.879767+0000","last_unstale":"2024-09-13T18:30:17.886219+0000","last_undegraded":"2024-09-13T18:30:17.886219+0000","last_fullsized":"2024-09-13T18:30:17.886219+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:23.365461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.846839+0000","last_change":"2024-09-13T18:30:17.843817+0000","last_active":"2024-09-13T18:30:17.846839+0000","last_peered":"2024-09-13T18:30:17.846839+0000","last_clean":"2024-09-13T18:30:17.846839+0000","last_became_active":"2024-09-13T18:30:17.840697+0000","last_became_peered":"2024-09-13T18:30:17.840697+0000","last_unstale":"2024-09-13T18:30:17.846839+0000","last_undegraded":"2024-09-13T18:30:17.846839+0000","last_fullsized":"2024-09-13T18:30:17.846839+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:34.937843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.854192+0000","last_change":"2024-09-13T18:30:17.851056+0000","last_active":"2024-09-13T18:30:17.854192+0000","last_peered":"2024-09-13T18:30:17.854192+0000","last_clean":"2024-09-13T18:30:17.854192+0000","last_became_active":"2024-09-13T18:30:17.850715+0000","last_became_peered":"2024-09-13T18:30:17.850715+0000","last_unstale":"2024-09-13T18:30:17.854192+0000","last_undegraded":"2024-09-13T18:30:17.854192+0000","last_fullsized":"2024-09-13T18:30:17.854192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:46.395539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878467+0000","last_change":"2024-09-13T18:30:17.865187+0000","last_active":"2024-09-13T18:30:17.878467+0000","last_peered":"2024-09-13T18:30:17.878467+0000","last_clean":"2024-09-13T18:30:17.878467+0000","last_became_active":"2024-09-13T18:30:17.864487+0000","last_became_peered":"2024-09-13T18:30:17.864487+0000","last_unstale":"2024-09-13T18:30:17.878467+0000","last_undegraded":"2024-09-13T18:30:17.878467+0000","last_fullsized":"2024-09-13T18:30:17.878467+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878725+0000","last_change":"2024-09-13T18:30:17.846446+0000","last_active":"2024-09-13T18:30:17.878725+0000","last_peered":"2024-09-13T18:30:17.878725+0000","last_clean":"2024-09-13T18:30:17.878725+0000","last_became_active":"2024-09-13T18:30:17.845814+0000","last_became_peered":"2024-09-13T18:30:17.845814+0000","last_unstale":"2024-09-13T18:30:17.878725+0000","last_undegraded":"2024-09-13T18:30:17.878725+0000","last_fullsized":"2024-09-13T18:30:17.878725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:37.191193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.884417+0000","last_change":"2024-09-13T18:30:17.882735+0000","last_active":"2024-09-13T18:30:17.884417+0000","last_peered":"2024-09-13T18:30:17.884417+0000","last_clean":"2024-09-13T18:30:17.884417+0000","last_became_active":"2024-09-13T18:30:17.882184+0000","last_became_peered":"2024-09-13T18:30:17.882184+0000","last_unstale":"2024-09-13T18:30:17.884417+0000","last_undegraded":"2024-09-13T18:30:17.884417+0000","last_fullsized":"2024-09-13T18:30:17.884417+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.881539+0000","last_change":"2024-09-13T18:30:17.465337+0000","last_active":"2024-09-13T18:30:17.881539+0000","last_peered":"2024-09-13T18:30:17.881539+0000","last_clean":"2024-09-13T18:30:17.881539+0000","last_became_active":"2024-09-13T18:30:17.463016+0000","last_became_peered":"2024-09-13T18:30:17.463016+0000","last_unstale":"2024-09-13T18:30:17.881539+0000","last_undegraded":"2024-09-13T18:30:17.881539+0000","last_fullsized":"2024-09-13T18:30:17.881539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:46.075323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.881484+0000","last_change":"2024-09-13T18:30:17.864305+0000","last_active":"2024-09-13T18:30:17.881484+0000","last_peered":"2024-09-13T18:30:17.881484+0000","last_clean":"2024-09-13T18:30:17.881484+0000","last_became_active":"2024-09-13T18:30:17.863698+0000","last_became_peered":"2024-09-13T18:30:17.863698+0000","last_unstale":"2024-09-13T18:30:17.881484+0000","last_undegraded":"2024-09-13T18:30:17.881484+0000","last_fullsized":"2024-09-13T18:30:17.881484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:29.618508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.876166+0000","last_change":"2024-09-13T18:30:17.461838+0000","last_active":"2024-09-13T18:30:17.876166+0000","last_peered":"2024-09-13T18:30:17.876166+0000","last_clean":"2024-09-13T18:30:17.876166+0000","last_became_active":"2024-09-13T18:30:17.459072+0000","last_became_peered":"2024-09-13T18:30:17.459072+0000","last_unstale":"2024-09-13T18:30:17.876166+0000","last_undegraded":"2024-09-13T18:30:17.876166+0000","last_fullsized":"2024-09-13T18:30:17.876166+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:52.437657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.880856+0000","last_change":"2024-09-13T18:30:17.860926+0000","last_active":"2024-09-13T18:30:17.880856+0000","last_peered":"2024-09-13T18:30:17.880856+0000","last_clean":"2024-09-13T18:30:17.880856+0000","last_became_active":"2024-09-13T18:30:17.847785+0000","last_became_peered":"2024-09-13T18:30:17.847785+0000","last_unstale":"2024-09-13T18:30:17.880856+0000","last_undegraded":"2024-09-13T18:30:17.880856+0000","last_fullsized":"2024-09-13T18:30:17.880856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:48.577132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.850750+0000","last_change":"2024-09-13T18:30:17.451931+0000","last_active":"2024-09-13T18:30:17.850750+0000","last_peered":"2024-09-13T18:30:17.850750+0000","last_clean":"2024-09-13T18:30:17.850750+0000","last_became_active":"2024-09-13T18:30:17.451250+0000","last_became_peered":"2024-09-13T18:30:17.451250+0000","last_unstale":"2024-09-13T18:30:17.850750+0000","last_undegraded":"2024-09-13T18:30:17.850750+0000","last_fullsized":"2024-09-13T18:30:17.850750+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:51.328595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.877436+0000","last_change":"2024-09-13T18:30:17.872770+0000","last_active":"2024-09-13T18:30:17.877436+0000","last_peered":"2024-09-13T18:30:17.877436+0000","last_clean":"2024-09-13T18:30:17.877436+0000","last_became_active":"2024-09-13T18:30:17.868926+0000","last_became_peered":"2024-09-13T18:30:17.868926+0000","last_unstale":"2024-09-13T18:30:17.877436+0000","last_undegraded":"2024-09-13T18:30:17.877436+0000","last_fullsized":"2024-09-13T18:30:17.877436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.850965+0000","last_change":"2024-09-13T18:30:17.453282+0000","last_active":"2024-09-13T18:30:17.850965+0000","last_peered":"2024-09-13T18:30:17.850965+0000","last_clean":"2024-09-13T18:30:17.850965+0000","last_became_active":"2024-09-13T18:30:17.452864+0000","last_became_peered":"2024-09-13T18:30:17.452864+0000","last_unstale":"2024-09-13T18:30:17.850965+0000","last_undegraded":"2024-09-13T18:30:17.850965+0000","last_fullsized":"2024-09-13T18:30:17.850965+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:35.883538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.854211+0000","last_change":"2024-09-13T18:30:17.851214+0000","last_active":"2024-09-13T18:30:17.854211+0000","last_peered":"2024-09-13T18:30:17.854211+0000","last_clean":"2024-09-13T18:30:17.854211+0000","last_became_active":"2024-09-13T18:30:17.851002+0000","last_became_peered":"2024-09-13T18:30:17.851002+0000","last_unstale":"2024-09-13T18:30:17.854211+0000","last_undegraded":"2024-09-13T18:30:17.854211+0000","last_fullsized":"2024-09-13T18:30:17.854211+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:12.707102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.876103+0000","last_change":"2024-09-13T18:30:17.449969+0000","last_active":"2024-09-13T18:30:17.876103+0000","last_peered":"2024-09-13T18:30:17.876103+0000","last_clean":"2024-09-13T18:30:17.876103+0000","last_became_active":"2024-09-13T18:30:17.449279+0000","last_became_peered":"2024-09-13T18:30:17.449279+0000","last_unstale":"2024-09-13T18:30:17.876103+0000","last_undegraded":"2024-09-13T18:30:17.876103+0000","last_fullsized":"2024-09-13T18:30:17.876103+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:36.181772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878635+0000","last_change":"2024-09-13T18:30:17.871899+0000","last_active":"2024-09-13T18:30:17.878635+0000","last_peered":"2024-09-13T18:30:17.878635+0000","last_clean":"2024-09-13T18:30:17.878635+0000","last_became_active":"2024-09-13T18:30:17.871183+0000","last_became_peered":"2024-09-13T18:30:17.871183+0000","last_unstale":"2024-09-13T18:30:17.878635+0000","last_undegraded":"2024-09-13T18:30:17.878635+0000","last_fullsized":"2024-09-13T18:30:17.878635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:12.551885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.876208+0000","last_change":"2024-09-13T18:30:17.461206+0000","last_active":"2024-09-13T18:30:17.876208+0000","last_peered":"2024-09-13T18:30:17.876208+0000","last_clean":"2024-09-13T18:30:17.876208+0000","last_became_active":"2024-09-13T18:30:17.460470+0000","last_became_peered":"2024-09-13T18:30:17.460470+0000","last_unstale":"2024-09-13T18:30:17.876208+0000","last_undegraded":"2024-09-13T18:30:17.876208+0000","last_fullsized":"2024-09-13T18:30:17.876208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.877777+0000","last_change":"2024-09-13T18:30:17.874490+0000","last_active":"2024-09-13T18:30:17.877777+0000","last_peered":"2024-09-13T18:30:17.877777+0000","last_clean":"2024-09-13T18:30:17.877777+0000","last_became_active":"2024-09-13T18:30:17.873667+0000","last_became_peered":"2024-09-13T18:30:17.873667+0000","last_unstale":"2024-09-13T18:30:17.877777+0000","last_undegraded":"2024-09-13T18:30:17.877777+0000","last_fullsized":"2024-09-13T18:30:17.877777+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:26.589175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.833740+0000","last_change":"2024-09-13T18:30:17.474092+0000","last_active":"2024-09-13T18:30:17.833740+0000","last_peered":"2024-09-13T18:30:17.833740+0000","last_clean":"2024-09-13T18:30:17.833740+0000","last_became_active":"2024-09-13T18:30:17.473815+0000","last_became_peered":"2024-09-13T18:30:17.473815+0000","last_unstale":"2024-09-13T18:30:17.833740+0000","last_undegraded":"2024-09-13T18:30:17.833740+0000","last_fullsized":"2024-09-13T18:30:17.833740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:28.609087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.869103+0000","last_change":"2024-09-13T18:30:17.868252+0000","last_active":"2024-09-13T18:30:17.869103+0000","last_peered":"2024-09-13T18:30:17.869103+0000","last_clean":"2024-09-13T18:30:17.869103+0000","last_became_active":"2024-09-13T18:30:17.867857+0000","last_became_peered":"2024-09-13T18:30:17.867857+0000","last_unstale":"2024-09-13T18:30:17.869103+0000","last_undegraded":"2024-09-13T18:30:17.869103+0000","last_fullsized":"2024-09-13T18:30:17.869103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:37.194826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.834070+0000","last_change":"2024-09-13T18:30:17.455292+0000","last_active":"2024-09-13T18:30:17.834070+0000","last_peered":"2024-09-13T18:30:17.834070+0000","last_clean":"2024-09-13T18:30:17.834070+0000","last_became_active":"2024-09-13T18:30:17.454937+0000","last_became_peered":"2024-09-13T18:30:17.454937+0000","last_unstale":"2024-09-13T18:30:17.834070+0000","last_undegraded":"2024-09-13T18:30:17.834070+0000","last_fullsized":"2024-09-13T18:30:17.834070+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:22.782961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.843230+0000","last_change":"2024-09-13T18:30:17.841104+0000","last_active":"2024-09-13T18:30:17.843230+0000","last_peered":"2024-09-13T18:30:17.843230+0000","last_clean":"2024-09-13T18:30:17.843230+0000","last_became_active":"2024-09-13T18:30:17.840779+0000","last_became_peered":"2024-09-13T18:30:17.840779+0000","last_unstale":"2024-09-13T18:30:17.843230+0000","last_undegraded":"2024-09-13T18:30:17.843230+0000","last_fullsized":"2024-09-13T18:30:17.843230+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:45.041871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.839083+0000","last_change":"2024-09-13T18:30:17.474124+0000","last_active":"2024-09-13T18:30:17.839083+0000","last_peered":"2024-09-13T18:30:17.839083+0000","last_clean":"2024-09-13T18:30:17.839083+0000","last_became_active":"2024-09-13T18:30:17.469795+0000","last_became_peered":"2024-09-13T18:30:17.469795+0000","last_unstale":"2024-09-13T18:30:17.839083+0000","last_undegraded":"2024-09-13T18:30:17.839083+0000","last_fullsized":"2024-09-13T18:30:17.839083+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:32.932794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868784+0000","last_change":"2024-09-13T18:30:17.859742+0000","last_active":"2024-09-13T18:30:17.868784+0000","last_peered":"2024-09-13T18:30:17.868784+0000","last_clean":"2024-09-13T18:30:17.868784+0000","last_became_active":"2024-09-13T18:30:17.858999+0000","last_became_peered":"2024-09-13T18:30:17.858999+0000","last_unstale":"2024-09-13T18:30:17.868784+0000","last_undegraded":"2024-09-13T18:30:17.868784+0000","last_fullsized":"2024-09-13T18:30:17.868784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:52.338016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.838630+0000","last_change":"2024-09-13T18:30:17.472015+0000","last_active":"2024-09-13T18:30:17.838630+0000","last_peered":"2024-09-13T18:30:17.838630+0000","last_clean":"2024-09-13T18:30:17.838630+0000","last_became_active":"2024-09-13T18:30:17.471329+0000","last_became_peered":"2024-09-13T18:30:17.471329+0000","last_unstale":"2024-09-13T18:30:17.838630+0000","last_undegraded":"2024-09-13T18:30:17.838630+0000","last_fullsized":"2024-09-13T18:30:17.838630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:05.307653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.882589+0000","last_change":"2024-09-13T18:30:17.882211+0000","last_active":"2024-09-13T18:30:17.882589+0000","last_peered":"2024-09-13T18:30:17.882589+0000","last_clean":"2024-09-13T18:30:17.882589+0000","last_became_active":"2024-09-13T18:30:17.881938+0000","last_became_peered":"2024-09-13T18:30:17.881938+0000","last_unstale":"2024-09-13T18:30:17.882589+0000","last_undegraded":"2024-09-13T18:30:17.882589+0000","last_fullsized":"2024-09-13T18:30:17.882589+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.879236+0000","last_change":"2024-09-13T18:30:17.470926+0000","last_active":"2024-09-13T18:30:17.879236+0000","last_peered":"2024-09-13T18:30:17.879236+0000","last_clean":"2024-09-13T18:30:17.879236+0000","last_became_active":"2024-09-13T18:30:17.470211+0000","last_became_peered":"2024-09-13T18:30:17.470211+0000","last_unstale":"2024-09-13T18:30:17.879236+0000","last_undegraded":"2024-09-13T18:30:17.879236+0000","last_fullsized":"2024-09-13T18:30:17.879236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:41.832081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878489+0000","last_change":"2024-09-13T18:30:17.870964+0000","last_active":"2024-09-13T18:30:17.878489+0000","last_peered":"2024-09-13T18:30:17.878489+0000","last_clean":"2024-09-13T18:30:17.878489+0000","last_became_active":"2024-09-13T18:30:17.864391+0000","last_became_peered":"2024-09-13T18:30:17.864391+0000","last_unstale":"2024-09-13T18:30:17.878489+0000","last_undegraded":"2024-09-13T18:30:17.878489+0000","last_fullsized":"2024-09-13T18:30:17.878489+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.881900+0000","last_change":"2024-09-13T18:30:17.461445+0000","last_active":"2024-09-13T18:30:17.881900+0000","last_peered":"2024-09-13T18:30:17.881900+0000","last_clean":"2024-09-13T18:30:17.881900+0000","last_became_active":"2024-09-13T18:30:17.460719+0000","last_became_peered":"2024-09-13T18:30:17.460719+0000","last_unstale":"2024-09-13T18:30:17.881900+0000","last_undegraded":"2024-09-13T18:30:17.881900+0000","last_fullsized":"2024-09-13T18:30:17.881900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.866469+0000","last_change":"2024-09-13T18:30:17.866061+0000","last_active":"2024-09-13T18:30:17.866469+0000","last_peered":"2024-09-13T18:30:17.866469+0000","last_clean":"2024-09-13T18:30:17.866469+0000","last_became_active":"2024-09-13T18:30:17.865804+0000","last_became_peered":"2024-09-13T18:30:17.865804+0000","last_unstale":"2024-09-13T18:30:17.866469+0000","last_undegraded":"2024-09-13T18:30:17.866469+0000","last_fullsized":"2024-09-13T18:30:17.866469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.853715+0000","last_change":"2024-09-13T18:30:17.452963+0000","last_active":"2024-09-13T18:30:17.853715+0000","last_peered":"2024-09-13T18:30:17.853715+0000","last_clean":"2024-09-13T18:30:17.853715+0000","last_became_active":"2024-09-13T18:30:17.452659+0000","last_became_peered":"2024-09-13T18:30:17.452659+0000","last_unstale":"2024-09-13T18:30:17.853715+0000","last_undegraded":"2024-09-13T18:30:17.853715+0000","last_fullsized":"2024-09-13T18:30:17.853715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:30.685201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.875837+0000","last_change":"2024-09-13T18:30:17.868041+0000","last_active":"2024-09-13T18:30:17.875837+0000","last_peered":"2024-09-13T18:30:17.875837+0000","last_clean":"2024-09-13T18:30:17.875837+0000","last_became_active":"2024-09-13T18:30:17.867294+0000","last_became_peered":"2024-09-13T18:30:17.867294+0000","last_unstale":"2024-09-13T18:30:17.875837+0000","last_undegraded":"2024-09-13T18:30:17.875837+0000","last_fullsized":"2024-09-13T18:30:17.875837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.834316+0000","last_change":"2024-09-13T18:30:17.459076+0000","last_active":"2024-09-13T18:30:17.834316+0000","last_peered":"2024-09-13T18:30:17.834316+0000","last_clean":"2024-09-13T18:30:17.834316+0000","last_became_active":"2024-09-13T18:30:17.458664+0000","last_became_peered":"2024-09-13T18:30:17.458664+0000","last_unstale":"2024-09-13T18:30:17.834316+0000","last_undegraded":"2024-09-13T18:30:17.834316+0000","last_fullsized":"2024-09-13T18:30:17.834316+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:57.981653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.849794+0000","last_change":"2024-09-13T18:30:17.845351+0000","last_active":"2024-09-13T18:30:17.849794+0000","last_peered":"2024-09-13T18:30:17.849794+0000","last_clean":"2024-09-13T18:30:17.849794+0000","last_became_active":"2024-09-13T18:30:17.845032+0000","last_became_peered":"2024-09-13T18:30:17.845032+0000","last_unstale":"2024-09-13T18:30:17.849794+0000","last_undegraded":"2024-09-13T18:30:17.849794+0000","last_fullsized":"2024-09-13T18:30:17.849794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.845500+0000","last_change":"2024-09-13T18:30:17.470482+0000","last_active":"2024-09-13T18:30:17.845500+0000","last_peered":"2024-09-13T18:30:17.845500+0000","last_clean":"2024-09-13T18:30:17.845500+0000","last_became_active":"2024-09-13T18:30:17.469740+0000","last_became_peered":"2024-09-13T18:30:17.469740+0000","last_unstale":"2024-09-13T18:30:17.845500+0000","last_undegraded":"2024-09-13T18:30:17.845500+0000","last_fullsized":"2024-09-13T18:30:17.845500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:16.860001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.875748+0000","last_change":"2024-09-13T18:30:17.875178+0000","last_active":"2024-09-13T18:30:17.875748+0000","last_peered":"2024-09-13T18:30:17.875748+0000","last_clean":"2024-09-13T18:30:17.875748+0000","last_became_active":"2024-09-13T18:30:17.874835+0000","last_became_peered":"2024-09-13T18:30:17.874835+0000","last_unstale":"2024-09-13T18:30:17.875748+0000","last_undegraded":"2024-09-13T18:30:17.875748+0000","last_fullsized":"2024-09-13T18:30:17.875748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:48.836972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868917+0000","last_change":"2024-09-13T18:30:17.464881+0000","last_active":"2024-09-13T18:30:17.868917+0000","last_peered":"2024-09-13T18:30:17.868917+0000","last_clean":"2024-09-13T18:30:17.868917+0000","last_became_active":"2024-09-13T18:30:17.464384+0000","last_became_peered":"2024-09-13T18:30:17.464384+0000","last_unstale":"2024-09-13T18:30:17.868917+0000","last_undegraded":"2024-09-13T18:30:17.868917+0000","last_fullsized":"2024-09-13T18:30:17.868917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:22.742563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.877837+0000","last_change":"2024-09-13T18:30:17.873428+0000","last_active":"2024-09-13T18:30:17.877837+0000","last_peered":"2024-09-13T18:30:17.877837+0000","last_clean":"2024-09-13T18:30:17.877837+0000","last_became_active":"2024-09-13T18:30:17.872700+0000","last_became_peered":"2024-09-13T18:30:17.872700+0000","last_unstale":"2024-09-13T18:30:17.877837+0000","last_undegraded":"2024-09-13T18:30:17.877837+0000","last_fullsized":"2024-09-13T18:30:17.877837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:16.837039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.880781+0000","last_change":"2024-09-13T18:30:17.474878+0000","last_active":"2024-09-13T18:30:17.880781+0000","last_peered":"2024-09-13T18:30:17.880781+0000","last_clean":"2024-09-13T18:30:17.880781+0000","last_became_active":"2024-09-13T18:30:17.472672+0000","last_became_peered":"2024-09-13T18:30:17.472672+0000","last_unstale":"2024-09-13T18:30:17.880781+0000","last_undegraded":"2024-09-13T18:30:17.880781+0000","last_fullsized":"2024-09-13T18:30:17.880781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:47.827551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.885228+0000","last_change":"2024-09-13T18:30:17.879838+0000","last_active":"2024-09-13T18:30:17.885228+0000","last_peered":"2024-09-13T18:30:17.885228+0000","last_clean":"2024-09-13T18:30:17.885228+0000","last_became_active":"2024-09-13T18:30:17.874333+0000","last_became_peered":"2024-09-13T18:30:17.874333+0000","last_unstale":"2024-09-13T18:30:17.885228+0000","last_undegraded":"2024-09-13T18:30:17.885228+0000","last_fullsized":"2024-09-13T18:30:17.885228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:13.870358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.877022+0000","last_change":"2024-09-13T18:30:17.470804+0000","last_active":"2024-09-13T18:30:17.877022+0000","last_peered":"2024-09-13T18:30:17.877022+0000","last_clean":"2024-09-13T18:30:17.877022+0000","last_became_active":"2024-09-13T18:30:17.470398+0000","last_became_peered":"2024-09-13T18:30:17.470398+0000","last_unstale":"2024-09-13T18:30:17.877022+0000","last_undegraded":"2024-09-13T18:30:17.877022+0000","last_fullsized":"2024-09-13T18:30:17.877022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:52.402748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.876667+0000","last_change":"2024-09-13T18:30:17.862799+0000","last_active":"2024-09-13T18:30:17.876667+0000","last_peered":"2024-09-13T18:30:17.876667+0000","last_clean":"2024-09-13T18:30:17.876667+0000","last_became_active":"2024-09-13T18:30:17.861556+0000","last_became_peered":"2024-09-13T18:30:17.861556+0000","last_unstale":"2024-09-13T18:30:17.876667+0000","last_undegraded":"2024-09-13T18:30:17.876667+0000","last_fullsized":"2024-09-13T18:30:17.876667+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:16.475009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.838749+0000","last_change":"2024-09-13T18:30:17.464795+0000","last_active":"2024-09-13T18:30:17.838749+0000","last_peered":"2024-09-13T18:30:17.838749+0000","last_clean":"2024-09-13T18:30:17.838749+0000","last_became_active":"2024-09-13T18:30:17.464223+0000","last_became_peered":"2024-09-13T18:30:17.464223+0000","last_unstale":"2024-09-13T18:30:17.838749+0000","last_undegraded":"2024-09-13T18:30:17.838749+0000","last_fullsized":"2024-09-13T18:30:17.838749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:46.123946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.845786+0000","last_change":"2024-09-13T18:30:17.842721+0000","last_active":"2024-09-13T18:30:17.845786+0000","last_peered":"2024-09-13T18:30:17.845786+0000","last_clean":"2024-09-13T18:30:17.845786+0000","last_became_active":"2024-09-13T18:30:17.842454+0000","last_became_peered":"2024-09-13T18:30:17.842454+0000","last_unstale":"2024-09-13T18:30:17.845786+0000","last_undegraded":"2024-09-13T18:30:17.845786+0000","last_fullsized":"2024-09-13T18:30:17.845786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:35.966160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.846448+0000","last_change":"2024-09-13T18:30:17.459067+0000","last_active":"2024-09-13T18:30:17.846448+0000","last_peered":"2024-09-13T18:30:17.846448+0000","last_clean":"2024-09-13T18:30:17.846448+0000","last_became_active":"2024-09-13T18:30:17.458693+0000","last_became_peered":"2024-09-13T18:30:17.458693+0000","last_unstale":"2024-09-13T18:30:17.846448+0000","last_undegraded":"2024-09-13T18:30:17.846448+0000","last_fullsized":"2024-09-13T18:30:17.846448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.869245+0000","last_change":"2024-09-13T18:30:17.860317+0000","last_active":"2024-09-13T18:30:17.869245+0000","last_peered":"2024-09-13T18:30:17.869245+0000","last_clean":"2024-09-13T18:30:17.869245+0000","last_became_active":"2024-09-13T18:30:17.859465+0000","last_became_peered":"2024-09-13T18:30:17.859465+0000","last_unstale":"2024-09-13T18:30:17.869245+0000","last_undegraded":"2024-09-13T18:30:17.869245+0000","last_fullsized":"2024-09-13T18:30:17.869245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:23.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.830918+0000","last_change":"2024-09-13T18:30:17.449547+0000","last_active":"2024-09-13T18:30:17.830918+0000","last_peered":"2024-09-13T18:30:17.830918+0000","last_clean":"2024-09-13T18:30:17.830918+0000","last_became_active":"2024-09-13T18:30:17.449159+0000","last_became_peered":"2024-09-13T18:30:17.449159+0000","last_unstale":"2024-09-13T18:30:17.830918+0000","last_undegraded":"2024-09-13T18:30:17.830918+0000","last_fullsized":"2024-09-13T18:30:17.830918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:23.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.858457+0000","last_change":"2024-09-13T18:30:17.857844+0000","last_active":"2024-09-13T18:30:17.858457+0000","last_peered":"2024-09-13T18:30:17.858457+0000","last_clean":"2024-09-13T18:30:17.858457+0000","last_became_active":"2024-09-13T18:30:17.857485+0000","last_became_peered":"2024-09-13T18:30:17.857485+0000","last_unstale":"2024-09-13T18:30:17.858457+0000","last_undegraded":"2024-09-13T18:30:17.858457+0000","last_fullsized":"2024-09-13T18:30:17.858457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:41.845328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.832241+0000","last_change":"2024-09-13T18:30:17.463039+0000","last_active":"2024-09-13T18:30:17.832241+0000","last_peered":"2024-09-13T18:30:17.832241+0000","last_clean":"2024-09-13T18:30:17.832241+0000","last_became_active":"2024-09-13T18:30:17.462645+0000","last_became_peered":"2024-09-13T18:30:17.462645+0000","last_unstale":"2024-09-13T18:30:17.832241+0000","last_undegraded":"2024-09-13T18:30:17.832241+0000","last_fullsized":"2024-09-13T18:30:17.832241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:33.468494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868475+0000","last_change":"2024-09-13T18:30:17.855948+0000","last_active":"2024-09-13T18:30:17.868475+0000","last_peered":"2024-09-13T18:30:17.868475+0000","last_clean":"2024-09-13T18:30:17.868475+0000","last_became_active":"2024-09-13T18:30:17.855196+0000","last_became_peered":"2024-09-13T18:30:17.855196+0000","last_unstale":"2024-09-13T18:30:17.868475+0000","last_undegraded":"2024-09-13T18:30:17.868475+0000","last_fullsized":"2024-09-13T18:30:17.868475+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:23.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.833898+0000","last_change":"2024-09-13T18:30:17.456332+0000","last_active":"2024-09-13T18:30:17.833898+0000","last_peered":"2024-09-13T18:30:17.833898+0000","last_clean":"2024-09-13T18:30:17.833898+0000","last_became_active":"2024-09-13T18:30:17.455964+0000","last_became_peered":"2024-09-13T18:30:17.455964+0000","last_unstale":"2024-09-13T18:30:17.833898+0000","last_undegraded":"2024-09-13T18:30:17.833898+0000","last_fullsized":"2024-09-13T18:30:17.833898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.827618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878506+0000","last_change":"2024-09-13T18:30:17.864888+0000","last_active":"2024-09-13T18:30:17.878506+0000","last_peered":"2024-09-13T18:30:17.878506+0000","last_clean":"2024-09-13T18:30:17.878506+0000","last_became_active":"2024-09-13T18:30:17.864249+0000","last_became_peered":"2024-09-13T18:30:17.864249+0000","last_unstale":"2024-09-13T18:30:17.878506+0000","last_undegraded":"2024-09-13T18:30:17.878506+0000","last_fullsized":"2024-09-13T18:30:17.878506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:58.682745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868903+0000","last_change":"2024-09-13T18:30:17.462879+0000","last_active":"2024-09-13T18:30:17.868903+0000","last_peered":"2024-09-13T18:30:17.868903+0000","last_clean":"2024-09-13T18:30:17.868903+0000","last_became_active":"2024-09-13T18:30:17.462602+0000","last_became_peered":"2024-09-13T18:30:17.462602+0000","last_unstale":"2024-09-13T18:30:17.868903+0000","last_undegraded":"2024-09-13T18:30:17.868903+0000","last_fullsized":"2024-09-13T18:30:17.868903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:36.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.887126+0000","last_change":"2024-09-13T18:30:17.886269+0000","last_active":"2024-09-13T18:30:17.887126+0000","last_peered":"2024-09-13T18:30:17.887126+0000","last_clean":"2024-09-13T18:30:17.887126+0000","last_became_active":"2024-09-13T18:30:17.885908+0000","last_became_peered":"2024-09-13T18:30:17.885908+0000","last_unstale":"2024-09-13T18:30:17.887126+0000","last_undegraded":"2024-09-13T18:30:17.887126+0000","last_fullsized":"2024-09-13T18:30:17.887126+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:23.568447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.834584+0000","last_change":"2024-09-13T18:30:17.451616+0000","last_active":"2024-09-13T18:30:17.834584+0000","last_peered":"2024-09-13T18:30:17.834584+0000","last_clean":"2024-09-13T18:30:17.834584+0000","last_became_active":"2024-09-13T18:30:17.451294+0000","last_became_peered":"2024-09-13T18:30:17.451294+0000","last_unstale":"2024-09-13T18:30:17.834584+0000","last_undegraded":"2024-09-13T18:30:17.834584+0000","last_fullsized":"2024-09-13T18:30:17.834584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:05.389105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.880940+0000","last_change":"2024-09-13T18:30:17.862836+0000","last_active":"2024-09-13T18:30:17.880940+0000","last_peered":"2024-09-13T18:30:17.880940+0000","last_clean":"2024-09-13T18:30:17.880940+0000","last_became_active":"2024-09-13T18:30:17.847729+0000","last_became_peered":"2024-09-13T18:30:17.847729+0000","last_unstale":"2024-09-13T18:30:17.880940+0000","last_undegraded":"2024-09-13T18:30:17.880940+0000","last_fullsized":"2024-09-13T18:30:17.880940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:29.093622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.835242+0000","last_change":"2024-09-13T18:30:17.461240+0000","last_active":"2024-09-13T18:30:17.835242+0000","last_peered":"2024-09-13T18:30:17.835242+0000","last_clean":"2024-09-13T18:30:17.835242+0000","last_became_active":"2024-09-13T18:30:17.460378+0000","last_became_peered":"2024-09-13T18:30:17.460378+0000","last_unstale":"2024-09-13T18:30:17.835242+0000","last_undegraded":"2024-09-13T18:30:17.835242+0000","last_fullsized":"2024-09-13T18:30:17.835242+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:11.697682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.876612+0000","last_change":"2024-09-13T18:30:17.862303+0000","last_active":"2024-09-13T18:30:17.876612+0000","last_peered":"2024-09-13T18:30:17.876612+0000","last_clean":"2024-09-13T18:30:17.876612+0000","last_became_active":"2024-09-13T18:30:17.856472+0000","last_became_peered":"2024-09-13T18:30:17.856472+0000","last_unstale":"2024-09-13T18:30:17.876612+0000","last_undegraded":"2024-09-13T18:30:17.876612+0000","last_fullsized":"2024-09-13T18:30:17.876612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:57.681395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.836265+0000","last_change":"2024-09-13T18:30:17.465881+0000","last_active":"2024-09-13T18:30:17.836265+0000","last_peered":"2024-09-13T18:30:17.836265+0000","last_clean":"2024-09-13T18:30:17.836265+0000","last_became_active":"2024-09-13T18:30:17.465092+0000","last_became_peered":"2024-09-13T18:30:17.465092+0000","last_unstale":"2024-09-13T18:30:17.836265+0000","last_undegraded":"2024-09-13T18:30:17.836265+0000","last_fullsized":"2024-09-13T18:30:17.836265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:33.928423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868550+0000","last_change":"2024-09-13T18:30:17.856238+0000","last_active":"2024-09-13T18:30:17.868550+0000","last_peered":"2024-09-13T18:30:17.868550+0000","last_clean":"2024-09-13T18:30:17.868550+0000","last_became_active":"2024-09-13T18:30:17.855485+0000","last_became_peered":"2024-09-13T18:30:17.855485+0000","last_unstale":"2024-09-13T18:30:17.868550+0000","last_undegraded":"2024-09-13T18:30:17.868550+0000","last_fullsized":"2024-09-13T18:30:17.868550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.838610+0000","last_change":"2024-09-13T18:30:17.464900+0000","last_active":"2024-09-13T18:30:17.838610+0000","last_peered":"2024-09-13T18:30:17.838610+0000","last_clean":"2024-09-13T18:30:17.838610+0000","last_became_active":"2024-09-13T18:30:17.464577+0000","last_became_peered":"2024-09-13T18:30:17.464577+0000","last_unstale":"2024-09-13T18:30:17.838610+0000","last_undegraded":"2024-09-13T18:30:17.838610+0000","last_fullsized":"2024-09-13T18:30:17.838610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:11.542464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878269+0000","last_change":"2024-09-13T18:30:17.877767+0000","last_active":"2024-09-13T18:30:17.878269+0000","last_peered":"2024-09-13T18:30:17.878269+0000","last_clean":"2024-09-13T18:30:17.878269+0000","last_became_active":"2024-09-13T18:30:17.877396+0000","last_became_peered":"2024-09-13T18:30:17.877396+0000","last_unstale":"2024-09-13T18:30:17.878269+0000","last_undegraded":"2024-09-13T18:30:17.878269+0000","last_fullsized":"2024-09-13T18:30:17.878269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:58.991074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.849808+0000","last_change":"2024-09-13T18:30:17.458897+0000","last_active":"2024-09-13T18:30:17.849808+0000","last_peered":"2024-09-13T18:30:17.849808+0000","last_clean":"2024-09-13T18:30:17.849808+0000","last_became_active":"2024-09-13T18:30:17.458107+0000","last_became_peered":"2024-09-13T18:30:17.458107+0000","last_unstale":"2024-09-13T18:30:17.849808+0000","last_undegraded":"2024-09-13T18:30:17.849808+0000","last_fullsized":"2024-09-13T18:30:17.849808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:48.808049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.876178+0000","last_change":"2024-09-13T18:30:17.868304+0000","last_active":"2024-09-13T18:30:17.876178+0000","last_peered":"2024-09-13T18:30:17.876178+0000","last_clean":"2024-09-13T18:30:17.876178+0000","last_became_active":"2024-09-13T18:30:17.867588+0000","last_became_peered":"2024-09-13T18:30:17.867588+0000","last_unstale":"2024-09-13T18:30:17.876178+0000","last_undegraded":"2024-09-13T18:30:17.876178+0000","last_fullsized":"2024-09-13T18:30:17.876178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:12.646053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.836864+0000","last_change":"2024-09-13T18:30:17.466750+0000","last_active":"2024-09-13T18:30:17.836864+0000","last_peered":"2024-09-13T18:30:17.836864+0000","last_clean":"2024-09-13T18:30:17.836864+0000","last_became_active":"2024-09-13T18:30:17.465572+0000","last_became_peered":"2024-09-13T18:30:17.465572+0000","last_unstale":"2024-09-13T18:30:17.836864+0000","last_undegraded":"2024-09-13T18:30:17.836864+0000","last_fullsized":"2024-09-13T18:30:17.836864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:45.386119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.878911+0000","last_change":"2024-09-13T18:30:17.843975+0000","last_active":"2024-09-13T18:30:17.878911+0000","last_peered":"2024-09-13T18:30:17.878911+0000","last_clean":"2024-09-13T18:30:17.878911+0000","last_became_active":"2024-09-13T18:30:17.843183+0000","last_became_peered":"2024-09-13T18:30:17.843183+0000","last_unstale":"2024-09-13T18:30:17.878911+0000","last_undegraded":"2024-09-13T18:30:17.878911+0000","last_fullsized":"2024-09-13T18:30:17.878911+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:37.490746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.846129+0000","last_change":"2024-09-13T18:30:17.469644+0000","last_active":"2024-09-13T18:30:17.846129+0000","last_peered":"2024-09-13T18:30:17.846129+0000","last_clean":"2024-09-13T18:30:17.846129+0000","last_became_active":"2024-09-13T18:30:17.468475+0000","last_became_peered":"2024-09-13T18:30:17.468475+0000","last_unstale":"2024-09-13T18:30:17.846129+0000","last_undegraded":"2024-09-13T18:30:17.846129+0000","last_fullsized":"2024-09-13T18:30:17.846129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:28.084201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.868009+0000","last_change":"2024-09-13T18:30:17.867487+0000","last_active":"2024-09-13T18:30:17.868009+0000","last_peered":"2024-09-13T18:30:17.868009+0000","last_clean":"2024-09-13T18:30:17.868009+0000","last_became_active":"2024-09-13T18:30:17.867213+0000","last_became_peered":"2024-09-13T18:30:17.867213+0000","last_unstale":"2024-09-13T18:30:17.868009+0000","last_undegraded":"2024-09-13T18:30:17.868009+0000","last_fullsized":"2024-09-13T18:30:17.868009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:17.422984+0000","last_clean_scrub_stamp":"2024-09-13T18:30:17.422984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:26.918087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.871926+0000","last_change":"2024-09-13T18:30:17.463051+0000","last_active":"2024-09-13T18:30:17.871926+0000","last_peered":"2024-09-13T18:30:17.871926+0000","last_clean":"2024-09-13T18:30:17.871926+0000","last_became_active":"2024-09-13T18:30:17.462356+0000","last_became_peered":"2024-09-13T18:30:17.462356+0000","last_unstale":"2024-09-13T18:30:17.871926+0000","last_undegraded":"2024-09-13T18:30:17.871926+0000","last_fullsized":"2024-09-13T18:30:17.871926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:16.413563+0000","last_clean_scrub_stamp":"2024-09-13T18:30:16.413563+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:33.324949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":256,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:30:17.857485+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:30:17.857485+0000","last_peered":"2024-09-13T18:30:17.857485+0000","last_clean":"2024-09-13T18:30:17.857485+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:30:17.857485+0000","last_undegraded":"2024-09-13T18:30:17.857485+0000","last_fullsized":"2024-09-13T18:30:17.857485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1667072,"data_stored":1052122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.90700000000000003,"15min":0.88},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1220000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.94999999999999996,"15min":0.89000000000000001},"min":{"1min":0.67400000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1870000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.99199999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.58899999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.278,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94799999999999995,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.2849999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84199999999999997,"15min":0.80400000000000005},"min":{"1min":0.55500000000000005,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.133,"5min":1.276,"15min":1.276},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.89800000000000002,"15min":0.88100000000000001},"min":{"1min":0.68700000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.296,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.141}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.64500000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.1519999999999999,"5min":1.448,"15min":1.448},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.95999999999999996,"15min":0.91400000000000003},"min":{"1min":0.68400000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.256,"5min":1.397,"15min":1.397},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.89000000000000001,"15min":0.88900000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2210000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.87},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.93999999999999995},"min":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.083}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.01,"15min":1.04},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.877,"15min":1.877},"last":1.196},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0069999999999999,"15min":0.98199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3180000000000001,"5min":1.321,"15min":1.321},"last":1.117}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0649999999999999,"15min":1.0609999999999999},"min":{"1min":0.68500000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.274,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.044,"15min":1},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2969999999999999,"5min":1.506,"15min":1.506},"last":0.96499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1081344,"data_stored":462378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.78700000000000003},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.56100000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.24,"5min":1.577,"15min":1.577},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.95999999999999996,"15min":0.90100000000000002},"min":{"1min":0.68899999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.218,"5min":1.464,"15min":1.464},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1080000000000001,"5min":1.268,"15min":1.268},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.92800000000000005,"15min":0.97099999999999997},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88600000000000001,"15min":0.876},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.131,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1040000000000001,"5min":1.306,"15min":1.306},"last":1.0109999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.67000000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.157,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.02,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":1.526},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.57699999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1950000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.036,"15min":1.0960000000000001},"min":{"1min":0.60499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.228,"5min":2.762,"15min":2.762},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.002,"15min":1.0349999999999999},"min":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.01,"15min":1.038},"min":{"1min":0.63100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":1.72,"15min":1.72},"last":1.1519999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1085440,"data_stored":463270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84299999999999997,"15min":0.85499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0580000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.876,"15min":0.90600000000000003},"min":{"1min":0.46800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.165,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.875,"15min":0.83299999999999996},"min":{"1min":0.53100000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1870000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.82899999999999996},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.157,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90100000000000002,"15min":0.88100000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.27,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93000000000000005,"15min":0.96999999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.383,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.94099999999999995,"15min":0.96199999999999997},"min":{"1min":0.72099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.349,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.95999999999999996,"15min":0.97599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.6719999999999999,"5min":1.871,"15min":1.871},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.92400000000000004,"15min":0.94399999999999995},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.997},{"interface":"front","average":{"1min":1.016,"5min":0.98699999999999999,"15min":1.0489999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4059999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.83899999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.98299999999999998,"15min":1.0289999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":1.026},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3260000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.97599999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:29:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0389999999999999,"15min":1.117},"min":{"1min":0.84699999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.268,"5min":2.246,"15min":2.246},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.077,"15min":1.139},"min":{"1min":0.81299999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5980000000000001,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1069056,"data_stored":461684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84099999999999997,"15min":0.80600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.357,"15min":1.357},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.88,"15min":0.876},"min":{"1min":0.59899999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.99399999999999999,"5min":1.536,"15min":1.536},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.88},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.89400000000000002,"15min":0.89100000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1859999999999999,"5min":1.323,"15min":1.323},"last":0.625}]},{"osd":3,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1379999999999999,"5min":1.476,"15min":1.476},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.92600000000000005,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1850000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.92200000000000004,"15min":0.94599999999999995},"min":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2330000000000001,"5min":1.298,"15min":1.298},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.72099999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3240000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.82399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93100000000000005,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.234,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.054,"5min":1.004,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.90200000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:30:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.032,"15min":1.04},"min":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3640000000000001,"5min":1.482,"15min":1.482},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.034,"15min":1.073},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.006}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":1081344,"data_stored":463248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68899999999999995,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0700000000000001,"5min":2.113,"15min":2.113},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79100000000000004,"15min":0.71899999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1619999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69699999999999995,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.095,"5min":1.704,"15min":1.704},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.61899999999999999},"min":{"1min":0.34300000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0620000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.70599999999999996},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.1479999999999999,"5min":1.742,"15min":1.742},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80500000000000005,"15min":0.745},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.2010000000000001,"5min":1.399,"15min":1.399},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.70699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3089999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.113},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.264,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.94499999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.3260000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.0629999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.04,"15min":1.069},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.272,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.052,"5min":1.0640000000000001,"15min":1.054},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.6890000000000001,"5min":1.96,"15min":1.96},"last":0.92400000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0680000000000001,"15min":1.1000000000000001},"min":{"1min":0.67600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.359,"5min":3,"15min":3},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0429999999999999,"15min":1.006},"min":{"1min":0.625,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.385,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.84599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":1073152,"data_stored":462266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.34200000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.97999999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.64800000000000002},"min":{"1min":0.34000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.92900000000000005,"5min":1.335,"15min":1.335},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.41099999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.143,"5min":1.423,"15min":1.423},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.101,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.77700000000000002},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2669999999999999,"5min":1.274,"15min":1.274},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92200000000000004,"15min":0.90900000000000003},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1950000000000001,"5min":1.611,"15min":1.611},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.90800000000000003,"15min":0.91700000000000004},"min":{"1min":0.66200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.321,"5min":1.492,"15min":1.492},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97699999999999998,"15min":1.0029999999999999},"min":{"1min":0.65600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2989999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1839999999999999,"5min":1.702,"15min":1.702},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95299999999999996,"15min":0.95399999999999996},"min":{"1min":0.55400000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.171,"5min":1.54,"15min":1.54},"last":0.62},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0229999999999999,"15min":1.046},"min":{"1min":0.62,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":1.452,"15min":1.452},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.57299999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.109,"5min":1.657,"15min":1.657},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.071,"15min":1.0820000000000001},"min":{"1min":0.67100000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.375,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.68999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":1081344,"data_stored":461878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.308,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65200000000000002,"15min":0.60899999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0149999999999999,"5min":1.177,"15min":1.177},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.749},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.69999999999999996},"min":{"1min":0.39400000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72899999999999998},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.63700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.216,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.119}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93300000000000005,"15min":0.91800000000000004},"min":{"1min":0.747,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0169999999999999,"15min":1.0289999999999999},"min":{"1min":0.59699999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.98299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0209999999999999,"15min":1},"min":{"1min":0.64000000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5900000000000001,"5min":1.653,"15min":1.653},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.78900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2669999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0669999999999999,"15min":1.048},"min":{"1min":0.61899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.141},{"interface":"front","average":{"1min":1.093,"5min":1.0620000000000001,"15min":1.0189999999999999},"min":{"1min":0.71299999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.323,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1739999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1667072,"data_stored":1052086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.86199999999999999,"5min":1.147,"15min":1.147},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.056,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.90500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2310000000000001,"5min":1.333,"15min":1.333},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.018}]},{"osd":3,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70699999999999996,"15min":0.69899999999999995},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92800000000000005,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.73799999999999999},"min":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0209999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.94799999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.4710000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98999999999999999,"15min":0.996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5069999999999999,"5min":1.986,"15min":1.986},"last":1.1830000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.006,"15min":1.0129999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2030000000000001,"5min":2.641,"15min":2.641},"last":1.286},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.044},"min":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2370000000000001,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.0489999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.0760000000000001,"15min":1.077},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.296,"5min":1.891,"15min":1.891},"last":1.103},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.0289999999999999},"min":{"1min":0.61899999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5549999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":1.133}]},{"osd":7,"last update":"Fri Sep 13 18:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.018,"15min":1.03},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.22},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.109,"15min":1.1040000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.421,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.242}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:30:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:30:26.638 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:30:26.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.810+0000 7f9cb62b8640 1 Processor -- start 2024-09-13T18:30:26.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb62b8640 1 -- start start 2024-09-13T18:30:26.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb62b8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9cb00caee0 0x7f9cb00cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb62b8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 0x7f9cb00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb62b8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb006f7a0 con 0x7f9cb0143e80 2024-09-13T18:30:26.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb62b8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb006baa0 con 0x7f9cb00caee0 2024-09-13T18:30:26.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb62b8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb006fd60 con 0x7f9cb00cd320 2024-09-13T18:30:26.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9cb0143e80 0x7f9cb006b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46158/0 (socket says 172.21.15.53:46158) 2024-09-13T18:30:26.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caffff640 1 -- 172.21.15.53:0/1798869415 learned_addr learned my addr 172.21.15.53:0/1798869415 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:26.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb4855640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 0x7f9cb00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caf7fe640 1 --2- 172.21.15.53:0/1798869415 >> v2:172.21.15.87:3300/0 conn(0x7f9cb00caee0 0x7f9cb00cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276035073 0 0) 0x7f9cb006f7a0 con 0x7f9cb0143e80 2024-09-13T18:30:26.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c98003530 con 0x7f9cb0143e80 2024-09-13T18:30:26.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 361740949 0 0) 0x7f9c98003530 con 0x7f9cb0143e80 2024-09-13T18:30:26.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 msgr2=0x7f9cb00cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:26.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 0x7f9cb00cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 >> v2:172.21.15.87:3300/0 conn(0x7f9cb00caee0 msgr2=0x7f9cb00cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 --2- 172.21.15.53:0/1798869415 >> v2:172.21.15.87:3300/0 conn(0x7f9cb00caee0 0x7f9cb00cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb00cdd10 con 0x7f9cb0143e80 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9ca0001a00 con 0x7f9cb0143e80 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 >> v1:172.21.15.53:6789/0 conn(0x7f9cb0143e80 legacy=0x7f9cb006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c98003980 0x7f9c98003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 0x7f9c980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c98004d10 0x7f9c98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb006baa0 con 0x7f9c98004d10 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb006fd60 con 0x7f9c98003980 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9800b990 con 0x7f9cb00cd320 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb4855640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c98004d10 0x7f9c98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caffff640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c98003980 0x7f9c98003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9caf7fe640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 0x7f9c980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb4855640 1 -- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 msgr2=0x7f9c980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:26.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb4855640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb00cd320 0x7f9c980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb4855640 1 -- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c98003980 msgr2=0x7f9c98003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:26.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb4855640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c98003980 0x7f9c98003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.814+0000 7f9cb4855640 1 -- 172.21.15.53:0/1798869415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98003530 con 0x7f9c98004d10 2024-09-13T18:30:26.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb4855640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c98004d10 0x7f9c98005190 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009ae0 tx=0x7f9ca801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04a4203f542e9c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:26.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80a5550 con 0x7f9c98004d10 2024-09-13T18:30:26.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca80a56b0 con 0x7f9c98004d10 2024-09-13T18:30:26.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9caeffd640 1 -- 172.21.15.53:0/1798869415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80a5a60 con 0x7f9c98004d10 2024-09-13T18:30:26.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- 172.21.15.53:0/1798869415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c98004d10 msgr2=0x7f9c98005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 --2- 172.21.15.53:0/1798869415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c98004d10 0x7f9c98005190 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009ae0 tx=0x7f9ca801ca70 comp rx=0 tx=0).stop 2024-09-13T18:30:26.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb4855640 1 -- 172.21.15.53:0/1798869415 reap_dead start 2024-09-13T18:30:26.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- 172.21.15.53:0/1798869415 shutdown_connections 2024-09-13T18:30:26.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- 172.21.15.53:0/1798869415 >> 172.21.15.53:0/1798869415 conn(0x7f9cb0065c80 msgr2=0x7f9cb0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:26.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- 172.21.15.53:0/1798869415 shutdown_connections 2024-09-13T18:30:26.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- 172.21.15.53:0/1798869415 wait complete. 2024-09-13T18:30:26.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 Processor -- start 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- start start 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb0135760 0x7f9cb0136be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cb00ac5a0 0x7f9cb00aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cb0135b40 0x7f9cb0135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0134580 con 0x7f9cb0135b40 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb01336d0 con 0x7f9cb00ac5a0 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb62b8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb01efb00 con 0x7f9cb0135760 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb4855640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cb0135b40 0x7f9cb0135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb4855640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cb0135b40 0x7f9cb0135fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37806/0 (socket says 172.21.15.53:37806) 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.818+0000 7f9cb4855640 1 -- 172.21.15.53:0/707362709 learned_addr learned my addr 172.21.15.53:0/707362709 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9caffff640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb0135760 0x7f9cb0136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9caf7fe640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cb00ac5a0 0x7f9cb00aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb4855640 1 -- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb0135760 msgr2=0x7f9cb0136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb4855640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb0135760 0x7f9cb0136be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb4855640 1 -- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cb00ac5a0 msgr2=0x7f9cb00aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb4855640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cb00ac5a0 0x7f9cb00aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb4855640 1 -- 172.21.15.53:0/707362709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0133970 con 0x7f9cb0135b40 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9caffff640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb0135760 0x7f9cb0136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb4855640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cb0135b40 0x7f9cb0135fc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80b0040 tx=0x7f9c98005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cacff9640 1 -- 172.21.15.53:0/707362709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80bb070 con 0x7f9cb0135b40 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cacff9640 1 -- 172.21.15.53:0/707362709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca8004020 con 0x7f9cb0135b40 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb0133c50 con 0x7f9cb0135b40 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cacff9640 1 -- 172.21.15.53:0/707362709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80a5550 con 0x7f9cb0135b40 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb0134210 con 0x7f9cb0135b40 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb01346f0 con 0x7f9cb0135b40 2024-09-13T18:30:26.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cacff9640 1 -- 172.21.15.53:0/707362709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f9ca80b4040 con 0x7f9cb0135b40 2024-09-13T18:30:26.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cacff9640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9c9c0667e0 0x7f9c9c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:26.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9cacff9640 1 -- 172.21.15.53:0/707362709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ca811d620 con 0x7f9cb0135b40 2024-09-13T18:30:26.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9caffff640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9c9c0667e0 0x7f9c9c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:26.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.822+0000 7f9caffff640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9c9c0667e0 0x7f9c9c068ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000f90 tx=0x7f9ca0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:26.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:26.826+0000 7f9cacff9640 1 -- 172.21.15.53:0/707362709 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ca80ea880 con 0x7f9cb0135b40 2024-09-13T18:30:27.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.046+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9cb00ce160 con 0x7f9cb0135b40 2024-09-13T18:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.054+0000 7f9cacff9640 1 -- 172.21.15.53:0/707362709 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9ca80edea0 con 0x7f9cb0135b40 2024-09-13T18:30:27.057 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9c9c0667e0 msgr2=0x7f9c9c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9c9c0667e0 0x7f9c9c068ca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000f90 tx=0x7f9ca0009040 comp rx=0 tx=0).stop 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cb0135b40 msgr2=0x7f9cb0135fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cb0135b40 0x7f9cb0135fc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80b0040 tx=0x7f9c98005800 comp rx=0 tx=0).stop 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 shutdown_connections 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9c9c0667e0 0x7f9c9c068ca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cb0135b40 0x7f9cb0135fc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cb00ac5a0 0x7f9cb00aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 --2- 172.21.15.53:0/707362709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9cb0135760 0x7f9cb0136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 >> 172.21.15.53:0/707362709 conn(0x7f9cb0065c80 msgr2=0x7f9cb0157740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 shutdown_connections 2024-09-13T18:30:27.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.058+0000 7f9cb62b8640 1 -- 172.21.15.53:0/707362709 wait complete. 2024-09-13T18:30:27.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:27.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.198+0000 7f15e8d43640 1 Processor -- start 2024-09-13T18:30:27.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.198+0000 7f15e8d43640 1 -- start start 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e8d43640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15e41582a0 0x7f15e406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e8d43640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f15e40713a0 0x7f15e406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e8d43640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e406d480 con 0x7f15e415b7c0 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e8d43640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e415aaf0 con 0x7f15e41582a0 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e8d43640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e406d760 con 0x7f15e40713a0 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15e41582a0 0x7f15e406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15dbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f15e415b7c0 0x7f15e4070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46172/0 (socket says 172.21.15.53:46172) 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15dbfff640 1 -- 172.21.15.53:0/1864921065 learned_addr learned my addr 172.21.15.53:0/1864921065 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e2d9d640 1 --2- 172.21.15.53:0/1864921065 >> v2:172.21.15.87:3300/0 conn(0x7f15e40713a0 0x7f15e406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e259c640 1 -- 172.21.15.53:0/1864921065 >> v2:172.21.15.87:3300/0 conn(0x7f15e40713a0 msgr2=0x7f15e406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e259c640 1 --2- 172.21.15.53:0/1864921065 >> v2:172.21.15.87:3300/0 conn(0x7f15e40713a0 0x7f15e406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e259c640 1 -- 172.21.15.53:0/1864921065 >> v1:172.21.15.53:6789/0 conn(0x7f15e415b7c0 legacy=0x7f15e4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e259c640 1 -- 172.21.15.53:0/1864921065 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e415ace0 con 0x7f15e41582a0 2024-09-13T18:30:27.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e259c640 1 --2- 172.21.15.53:0/1864921065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e41582a0 0x7f15e406c900 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f15e4158680 tx=0x7f15d401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5584c163a7572f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e1d9b640 1 -- 172.21.15.53:0/1864921065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40a7070 con 0x7f15e41582a0 2024-09-13T18:30:27.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e1d9b640 1 -- 172.21.15.53:0/1864921065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d40ab430 con 0x7f15e41582a0 2024-09-13T18:30:27.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.202+0000 7f15e1d9b640 1 -- 172.21.15.53:0/1864921065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40ab7c0 con 0x7f15e41582a0 2024-09-13T18:30:27.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- 172.21.15.53:0/1864921065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e41582a0 msgr2=0x7f15e406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 --2- 172.21.15.53:0/1864921065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e41582a0 0x7f15e406c900 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f15e4158680 tx=0x7f15d401c430 comp rx=0 tx=0).stop 2024-09-13T18:30:27.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- 172.21.15.53:0/1864921065 shutdown_connections 2024-09-13T18:30:27.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 --2- 172.21.15.53:0/1864921065 >> v2:172.21.15.87:3300/0 conn(0x7f15e40713a0 0x7f15e406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 --2- 172.21.15.53:0/1864921065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e41582a0 0x7f15e406c900 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- 172.21.15.53:0/1864921065 >> 172.21.15.53:0/1864921065 conn(0x7f15e4065c80 msgr2=0x7f15e4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:27.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- 172.21.15.53:0/1864921065 shutdown_connections 2024-09-13T18:30:27.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- 172.21.15.53:0/1864921065 wait complete. 2024-09-13T18:30:27.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 Processor -- start 2024-09-13T18:30:27.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- start start 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e40713a0 0x7f15e414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e41582a0 0x7f15e4159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e415b7c0 0x7f15e415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4147b40 con 0x7f15e40713a0 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4147e20 con 0x7f15e415b7c0 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4148100 con 0x7f15e41582a0 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e40713a0 0x7f15e414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e40713a0 0x7f15e414ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37822/0 (socket says 172.21.15.53:37822) 2024-09-13T18:30:27.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 -- 172.21.15.53:0/3866118917 learned_addr learned my addr 172.21.15.53:0/3866118917 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e2d9d640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e415b7c0 0x7f15e415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15dbfff640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e41582a0 0x7f15e4159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 -- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e41582a0 msgr2=0x7f15e4159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e41582a0 0x7f15e4159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 -- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e415b7c0 msgr2=0x7f15e415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e415b7c0 0x7f15e415a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 -- 172.21.15.53:0/3866118917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4009420 con 0x7f15e40713a0 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e2d9d640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e415b7c0 0x7f15e415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15dbfff640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e41582a0 0x7f15e4159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e259c640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e40713a0 0x7f15e414ffd0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ad040 tx=0x7f15d401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15daffd640 1 -- 172.21.15.53:0/3866118917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40b5810 con 0x7f15e40713a0 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15daffd640 1 -- 172.21.15.53:0/3866118917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d40b59b0 con 0x7f15e40713a0 2024-09-13T18:30:27.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15daffd640 1 -- 172.21.15.53:0/3866118917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40b5d60 con 0x7f15e40713a0 2024-09-13T18:30:27.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.206+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e41483e0 con 0x7f15e40713a0 2024-09-13T18:30:27.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.210+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e4147880 con 0x7f15e40713a0 2024-09-13T18:30:27.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.210+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e4067400 con 0x7f15e40713a0 2024-09-13T18:30:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.210+0000 7f15daffd640 1 -- 172.21.15.53:0/3866118917 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f15d40b4390 con 0x7f15e40713a0 2024-09-13T18:30:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.210+0000 7f15daffd640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15c40667b0 0x7f15c4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.210+0000 7f15daffd640 1 -- 172.21.15.53:0/3866118917 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15d411ebc0 con 0x7f15e40713a0 2024-09-13T18:30:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.210+0000 7f15dbfff640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15c40667b0 0x7f15c4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.210+0000 7f15dbfff640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15c40667b0 0x7f15c4068c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15e4071370 tx=0x7f15cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.214+0000 7f15daffd640 1 -- 172.21.15.53:0/3866118917 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15d40ebdc0 con 0x7f15e40713a0 2024-09-13T18:30:27.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.406+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15e406fe60 con 0x7f15e40713a0 2024-09-13T18:30:27.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15daffd640 1 -- 172.21.15.53:0/3866118917 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f15d40c4020 con 0x7f15e40713a0 2024-09-13T18:30:27.411 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:27.411 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2807450918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2807450918},{"type":"v1","addr":"172.21.15.87:6833","nonce":2807450918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3225281050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3225281050},{"type":"v1","addr":"172.21.15.87:6835","nonce":3225281050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3795700837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3795700837},{"type":"v1","addr":"172.21.15.53:6833","nonce":3795700837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:30:17.824687+0000","modified":"2024-09-13T18:30:20.838202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2118447408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2118447408},{"type":"v1","addr":"172.21.15.53:6835","nonce":2118447408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:30:27.411 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 48 2024-09-13T18:30:27.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15c40667b0 msgr2=0x7f15c4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15c40667b0 0x7f15c4068c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15e4071370 tx=0x7f15cc009040 comp rx=0 tx=0).stop 2024-09-13T18:30:27.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e40713a0 msgr2=0x7f15e414ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e40713a0 0x7f15e414ffd0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ad040 tx=0x7f15d401ac70 comp rx=0 tx=0).stop 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 shutdown_connections 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15c40667b0 0x7f15c4068c70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e41582a0 0x7f15e4159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e415b7c0 0x7f15e415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 --2- 172.21.15.53:0/3866118917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e40713a0 0x7f15e414ffd0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 >> 172.21.15.53:0/3866118917 conn(0x7f15e4065c80 msgr2=0x7f15e414ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 shutdown_connections 2024-09-13T18:30:27.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.410+0000 7f15e8d43640 1 -- 172.21.15.53:0/3866118917 wait complete. 2024-09-13T18:30:27.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:30:17.824687+0000', 'modified': '2024-09-13T18:30:20.838202+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7431': {'gid': 7431, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/2118447408', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 2118447408}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 2118447408}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:30:27.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:30:27.833 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:30:27.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff77328a640 1 Processor -- start 2024-09-13T18:30:27.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff77328a640 1 -- start start 2024-09-13T18:30:27.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff77328a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 0x7ff76c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff77328a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76c0b1ac0 con 0x7ff76c06b850 2024-09-13T18:30:27.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff77328a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76c159ac0 con 0x7ff76c0cbd60 2024-09-13T18:30:27.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff77328a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c159da0 con 0x7ff76c0cb980 2024-09-13T18:30:27.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff770825640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff76c06b850 0x7ff76c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46178/0 (socket says 172.21.15.53:46178) 2024-09-13T18:30:27.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff770825640 1 -- 172.21.15.53:0/3766209511 learned_addr learned my addr 172.21.15.53:0/3766209511 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:27.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff771026640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 0x7ff76c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447377428 0 0) 0x7ff76c0b1ac0 con 0x7ff76c06b850 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff758003530 con 0x7ff76c06b850 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956812929 0 0) 0x7ff758003530 con 0x7ff76c06b850 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 msgr2=0x7ff76c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 0x7ff76c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 >> v1:172.21.15.87:6789/0 conn(0x7ff76c0cbd60 legacy=0x7ff76c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c15a080 con 0x7ff76c06b850 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ff75c001680 con 0x7ff76c06b850 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 >> v1:172.21.15.53:6789/0 conn(0x7ff76c06b850 legacy=0x7ff76c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff758003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 0x7ff7580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff758004d10 0x7ff758005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c159da0 con 0x7ff7580039b0 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75800bac0 con 0x7ff758004d10 2024-09-13T18:30:27.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.966+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75800bc80 con 0x7ff76c0cb980 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771026640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff758003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff770825640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 0x7ff7580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771827640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff758004d10 0x7ff758005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771026640 1 -- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 msgr2=0x7ff7580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771026640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 0x7ff7580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771026640 1 -- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff758004d10 msgr2=0x7ff758005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771026640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff758004d10 0x7ff758005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771026640 1 -- 172.21.15.53:0/3766209511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758003530 con 0x7ff7580039b0 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff770825640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c0cb980 0x7ff7580047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:27.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771827640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff758004d10 0x7ff758005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771026640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff758003dd0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff768009ae0 tx=0x7ff76801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2f730fa398d02a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680a5550 con 0x7ff7580039b0 2024-09-13T18:30:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7680a56b0 con 0x7ff7580039b0 2024-09-13T18:30:27.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff763fff640 1 -- 172.21.15.53:0/3766209511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680a5a60 con 0x7ff7580039b0 2024-09-13T18:30:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff77328a640 1 -- 172.21.15.53:0/3766209511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 msgr2=0x7ff758003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff77328a640 1 --2- 172.21.15.53:0/3766209511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff758003dd0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff768009ae0 tx=0x7ff76801c980 comp rx=0 tx=0).stop 2024-09-13T18:30:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.970+0000 7ff771827640 1 -- 172.21.15.53:0/3766209511 reap_dead start 2024-09-13T18:30:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- 172.21.15.53:0/3766209511 shutdown_connections 2024-09-13T18:30:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- 172.21.15.53:0/3766209511 >> 172.21.15.53:0/3766209511 conn(0x7ff76c065c80 msgr2=0x7ff76c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- 172.21.15.53:0/3766209511 shutdown_connections 2024-09-13T18:30:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- 172.21.15.53:0/3766209511 wait complete. 2024-09-13T18:30:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 Processor -- start 2024-09-13T18:30:27.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- start start 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff76c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c06fe20 0x7ff76c14a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff76c158cf0 0x7ff76c159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c147a70 con 0x7ff7580039b0 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c14e350 con 0x7ff76c158cf0 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c14d050 con 0x7ff76c06fe20 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff76c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff76c14de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37842/0 (socket says 172.21.15.53:37842) 2024-09-13T18:30:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 -- 172.21.15.53:0/981615461 learned_addr learned my addr 172.21.15.53:0/981615461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771827640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff76c158cf0 0x7ff76c159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff770825640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c06fe20 0x7ff76c14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 -- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c06fe20 msgr2=0x7ff76c14a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c06fe20 0x7ff76c14a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 -- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff76c158cf0 msgr2=0x7ff76c159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff76c158cf0 0x7ff76c159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 -- 172.21.15.53:0/981615461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c14d2f0 con 0x7ff7580039b0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff771026640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff76c14de10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff768009ae0 tx=0x7ff758005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff761ffb640 1 -- 172.21.15.53:0/981615461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680a5ea0 con 0x7ff7580039b0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff761ffb640 1 -- 172.21.15.53:0/981615461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff768004020 con 0x7ff7580039b0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76c14d5d0 con 0x7ff7580039b0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff761ffb640 1 -- 172.21.15.53:0/981615461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768004390 con 0x7ff7580039b0 2024-09-13T18:30:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.974+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c1596b0 con 0x7ff7580039b0 2024-09-13T18:30:27.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff761ffb640 1 -- 172.21.15.53:0/981615461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7ff7680b4040 con 0x7ff7580039b0 2024-09-13T18:30:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff761ffb640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7500667e0 0x7ff750068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff761ffb640 1 -- 172.21.15.53:0/981615461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff76811e3d0 con 0x7ff7580039b0 2024-09-13T18:30:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff770825640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7500667e0 0x7ff750068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff770825640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7500667e0 0x7ff750068ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000c10 tx=0x7ff75c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 Processor -- start 2024-09-13T18:30:27.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 -- start start 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4f01f0 0x55f9ca4f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4a6740 0x55f9ca4a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca36ee80 con 0x55f9ca4a6740 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca2fcaf0 con 0x55f9ca4f0b10 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca2fa0c0 con 0x55f9ca4f01f0 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4a6740 0x55f9ca4a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4a6740 0x55f9ca4a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37852/0 (socket says 172.21.15.53:37852) 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 -- 172.21.15.53:0/2822204385 learned_addr learned my addr 172.21.15.53:0/2822204385 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff770825640 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771026640 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4f01f0 0x55f9ca4f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 -- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4f01f0 msgr2=0x55f9ca4f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4f01f0 0x55f9ca4f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 -- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 msgr2=0x55f9ca4a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 -- 172.21.15.53:0/2822204385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9c9ff1890 con 0x55f9ca4a6740 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff771827640 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4a6740 0x55f9ca4a6b20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff76c071550 tx=0x7ff764001ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f9a0bd036b90f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff756ffd640 1 -- 172.21.15.53:0/2822204385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764003b90 con 0x55f9ca4a6740 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff756ffd640 1 -- 172.21.15.53:0/2822204385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400d070 con 0x55f9ca4a6740 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.978+0000 7ff756ffd640 1 -- 172.21.15.53:0/2822204385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400f780 con 0x55f9ca4a6740 2024-09-13T18:30:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/2822204385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4a6740 msgr2=0x55f9ca4a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4a6740 0x55f9ca4a6b20 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff76c071550 tx=0x7ff764001ee0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/2822204385 shutdown_connections 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4a6740 0x55f9ca4a6b20 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- 172.21.15.53:0/2822204385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4f01f0 0x55f9ca4f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/2822204385 >> 172.21.15.53:0/2822204385 conn(0x55f9ca4acfb0 msgr2=0x55f9ca4ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/2822204385 shutdown_connections 2024-09-13T18:30:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/2822204385 wait complete. 2024-09-13T18:30:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- start start 2024-09-13T18:30:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 Processor -- start 2024-09-13T18:30:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca2f59b0 con 0x55f9ca4f0b10 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca294c00 con 0x55f9ca4f01f0 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca2b3070 con 0x55f9ca4a6740 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 10 client.0 _ll_register_callbacks cb 0x55f9ca492ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37862/0 (socket says 172.21.15.53:37862) 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 -- 172.21.15.53:0/775981698 learned_addr learned my addr 172.21.15.53:0/775981698 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff770825640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771026640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 -- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 msgr2=0x55f9ca4b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 -- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f01f0 msgr2=0x55f9ca4b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 -- 172.21.15.53:0/775981698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c159ac0 con 0x55f9ca4f0b10 2024-09-13T18:30:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771026640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff770825640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771827640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4b2a30 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x55f9ca2f2ec0 tx=0x7ff764001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d30b2d7bb9e6f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff74bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff74bfff640 1 -- 172.21.15.53:0/775981698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640050d0 con 0x55f9ca4f0b10 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff74bfff640 1 -- 172.21.15.53:0/775981698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff764023070 con 0x55f9ca4f0b10 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9ca2b25f0 con 0x55f9ca4f0b10 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff74bfff640 1 -- 172.21.15.53:0/775981698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff764005230 con 0x55f9ca4f0b10 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 10 client.7608 fetch_fsmap learned FSMap version 48 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55f9ca2baab0 con 0x55f9ca4f0b10 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff74bfff640 1 -- 172.21.15.53:0/775981698 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9ca2b25f0 con 0x55f9ca4f0b10 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff74bfff640 1 -- 172.21.15.53:0/775981698 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff764012070 con 0x55f9ca4f0b10 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 10 client.7608 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T18:30:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 10 client.7608 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 20 client.7608 populate_metadata read hostname 'smithi053' 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca4b3440 0x55f9ca5022a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 4 client.7608 mds_command: new command op to 7431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 --> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9ca2f2790 con 0x55f9ca4b3440 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771026640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca4b3440 0x55f9ca5022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff771026640 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca4b3440 0x55f9ca5022a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb64c7b91d592a11 server_cookie=98406ca4fa39fcd in_seq=0 out_seq=0 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.982+0000 7ff74bfff640 10 client.7608 ms_handle_connect on v2:172.21.15.53:6834/2118447408 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff74bfff640 1 -- 172.21.15.53:0/775981698 <== mds.0 v2:172.21.15.53:6834/2118447408 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f9ca2f2790 con 0x55f9ca4b3440 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff74bfff640 10 client.7608 handle_command_reply: tid=0 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 client.7608 shutdown 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f0b10 msgr2=0x55f9ca4b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4b2a30 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x55f9ca2f2ec0 tx=0x7ff764001520 comp rx=0 tx=0).stop 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 shutdown_connections 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca4b3440 0x55f9ca5022a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4b2a30 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 --2- 172.21.15.53:0/775981698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff74bfff640 0 client.7608 ms_handle_reset on v2:172.21.15.53:6834/2118447408 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 >> 172.21.15.53:0/775981698 conn(0x55f9ca4acfb0 msgr2=0x55f9ca4a51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 shutdown_connections 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 1 -- 172.21.15.53:0/775981698 wait complete. 2024-09-13T18:30:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:27.986+0000 7ff7763d3000 20 client.7608 trim_cache size 0 max 16384 2024-09-13T18:30:28.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 Processor -- start 2024-09-13T18:30:28.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- start start 2024-09-13T18:30:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4ab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c9fb2940 con 0x55f9ca4f01f0 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca506f90 con 0x55f9ca4f0b10 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca2f99b0 con 0x55f9ca4a6740 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37876/0 (socket says 172.21.15.53:37876) 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 -- 172.21.15.53:0/3717206292 learned_addr learned my addr 172.21.15.53:0/3717206292 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff771026640 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 -- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 msgr2=0x55f9ca4ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff771827640 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 -- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 msgr2=0x55f9ca4ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 -- 172.21.15.53:0/3717206292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9ca2a0c00 con 0x55f9ca4f01f0 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff771827640 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:28.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff770825640 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4ab7a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff76c06bc30 tx=0x7ff75c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acea8f500339990 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7577fe640 1 -- 172.21.15.53:0/3717206292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00c070 con 0x55f9ca4f01f0 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7577fe640 1 -- 172.21.15.53:0/3717206292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c00d040 con 0x55f9ca4f01f0 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7577fe640 1 -- 172.21.15.53:0/3717206292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c007250 con 0x55f9ca4f01f0 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- 172.21.15.53:0/3717206292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 msgr2=0x55f9ca4ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4ab7a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff76c06bc30 tx=0x7ff75c00c000 comp rx=0 tx=0).stop 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- 172.21.15.53:0/3717206292 shutdown_connections 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca4ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca4ab7a0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 --2- 172.21.15.53:0/3717206292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca4ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- 172.21.15.53:0/3717206292 >> 172.21.15.53:0/3717206292 conn(0x55f9ca4acfb0 msgr2=0x55f9ca4a49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- 172.21.15.53:0/3717206292 shutdown_connections 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- 172.21.15.53:0/3717206292 wait complete. 2024-09-13T18:30:28.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 -- start start 2024-09-13T18:30:28.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.002+0000 7ff7763d3000 1 Processor -- start 2024-09-13T18:30:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca535090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca535cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca536230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca4b21e0 con 0x55f9ca4f01f0 2024-09-13T18:30:28.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca3385f0 con 0x55f9ca4f0b10 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9ca2bcc60 con 0x55f9ca4a6740 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 10 client.0 _ll_register_callbacks cb 0x55f9ca36edd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca535cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca535cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37886/0 (socket says 172.21.15.53:37886) 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 -- 172.21.15.53:0/189976431 learned_addr learned my addr 172.21.15.53:0/189976431 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff771026640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca535090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff771827640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca536230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 -- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 msgr2=0x55f9ca535090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca535090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 -- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 msgr2=0x55f9ca536230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca536230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 -- 172.21.15.53:0/189976431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c01d040 con 0x55f9ca4f01f0 2024-09-13T18:30:28.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff771827640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca536230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff770825640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca535cf0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00f010 tx=0x7ff75c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b994aa63b82d3875 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 1 -- 172.21.15.53:0/189976431 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00c030 con 0x55f9ca4f01f0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 1 -- 172.21.15.53:0/189976431 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff75c007680 con 0x55f9ca4f01f0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9ca2c5460 con 0x55f9ca4f01f0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 1 -- 172.21.15.53:0/189976431 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff75c013480 con 0x55f9ca4f01f0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 10 client.7614 fetch_fsmap learned FSMap version 48 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55f9c9ff1cc0 con 0x55f9ca4f01f0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 1 -- 172.21.15.53:0/189976431 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9ca2c5460 con 0x55f9ca4f01f0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 1 -- 172.21.15.53:0/189976431 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff75c0135e0 con 0x55f9ca4f01f0 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 10 client.7614 fetch_fsmap finished waiting for FSMap version 48 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 10 client.7614 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:30:28.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 20 client.7614 populate_metadata read hostname 'smithi053' 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca5355d0 0x55f9ca536770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 4 client.7614 mds_command: new command op to 7431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 --> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f9ca2be9c0 con 0x55f9ca5355d0 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff771026640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca5355d0 0x55f9ca536770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff771026640 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca5355d0 0x55f9ca536770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ac2c37a668f05e server_cookie=d1ba8a19149a1dd8 in_seq=0 out_seq=0 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 10 client.7614 ms_handle_connect on v2:172.21.15.53:6834/2118447408 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 1 -- 172.21.15.53:0/189976431 <== mds.0 v2:172.21.15.53:6834/2118447408 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f9ca2be9c0 con 0x55f9ca5355d0 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 10 client.7614 handle_command_reply: tid=0 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 client.7614 shutdown 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 msgr2=0x55f9ca535cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca535cf0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00f010 tx=0x7ff75c001a10 comp rx=0 tx=0).stop 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 shutdown_connections 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:6834/2118447408,v1:172.21.15.53:6835/2118447408] conn(0x55f9ca5355d0 0x55f9ca536770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f9ca4f0b10 0x55f9ca536230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f9ca4f01f0 0x55f9ca535cf0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff74bfff640 0 client.7614 ms_handle_reset on v2:172.21.15.53:6834/2118447408 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 --2- 172.21.15.53:0/189976431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f9ca4a6740 0x55f9ca535090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 >> 172.21.15.53:0/189976431 conn(0x55f9ca4acfb0 msgr2=0x55f9ca4a51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 shutdown_connections 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 1 -- 172.21.15.53:0/189976431 wait complete. 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff7763d3000 20 client.7614 trim_cache size 0 max 16384 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:30:28.016 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 7431, 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.181721559, 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 48, 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 87, 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 87, 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 14.503010828000001 2024-09-13T18:30:28.017 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7500667e0 msgr2=0x7ff750068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7500667e0 0x7ff750068ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000c10 tx=0x7ff75c009040 comp rx=0 tx=0).stop 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 msgr2=0x7ff76c14de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff76c14de10 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff768009ae0 tx=0x7ff758005800 comp rx=0 tx=0).stop 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 shutdown_connections 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff7500667e0 0x7ff750068ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff76c06fe20 0x7ff76c14a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff76c158cf0 0x7ff76c159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 --2- 172.21.15.53:0/981615461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7580039b0 0x7ff76c14de10 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.006+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 >> 172.21.15.53:0/981615461 conn(0x7ff76c065c80 msgr2=0x7ff76c0af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:28.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.010+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 shutdown_connections 2024-09-13T18:30:28.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.010+0000 7ff77328a640 1 -- 172.21.15.53:0/981615461 wait complete. 2024-09-13T18:30:28.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:30:28.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.138+0000 7f1285959640 1 Processor -- start 2024-09-13T18:30:28.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.138+0000 7f1285959640 1 -- start start 2024-09-13T18:30:28.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f1285959640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f128015b7c0 0x7f1280070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f1285959640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12800711d0 0x7f12801640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f1285959640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128006d480 con 0x7f12801582a0 2024-09-13T18:30:28.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f1285959640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128015aaf0 con 0x7f12800711d0 2024-09-13T18:30:28.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f1285959640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128006d760 con 0x7f128015b7c0 2024-09-13T18:30:28.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12800711d0 0x7f12801640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127e7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f128015b7c0 0x7f1280070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12800711d0 0x7f12801640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33122/0 (socket says 172.21.15.53:33122) 2024-09-13T18:30:28.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127e7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f128015b7c0 0x7f1280070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:50180/0 (socket says 172.21.15.53:50180) 2024-09-13T18:30:28.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127f7fe640 1 -- 172.21.15.53:0/987790926 learned_addr learned my addr 172.21.15.53:0/987790926 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:28.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127e7fc640 1 -- 172.21.15.53:0/987790926 >> v2:172.21.15.87:3300/0 conn(0x7f12800711d0 msgr2=0x7f12801640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:28.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127e7fc640 1 --2- 172.21.15.53:0/987790926 >> v2:172.21.15.87:3300/0 conn(0x7f12800711d0 0x7f12801640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127e7fc640 1 -- 172.21.15.53:0/987790926 >> v1:172.21.15.87:6789/0 conn(0x7f12801582a0 legacy=0x7f128006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127e7fc640 1 -- 172.21.15.53:0/987790926 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128015ace0 con 0x7f128015b7c0 2024-09-13T18:30:28.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.142+0000 7f127f7fe640 1 --2- 172.21.15.53:0/987790926 >> v2:172.21.15.87:3300/0 conn(0x7f12800711d0 0x7f12801640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:28.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f127e7fc640 1 --2- 172.21.15.53:0/987790926 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f128015b7c0 0x7f1280070c90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f12740097c0 tx=0x7f127401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f66c32bc995a93c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:28.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f127dffb640 1 -- 172.21.15.53:0/987790926 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740ad640 con 0x7f128015b7c0 2024-09-13T18:30:28.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f127dffb640 1 -- 172.21.15.53:0/987790926 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12740ad7a0 con 0x7f128015b7c0 2024-09-13T18:30:28.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f127dffb640 1 -- 172.21.15.53:0/987790926 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740adb30 con 0x7f128015b7c0 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 -- 172.21.15.53:0/987790926 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f128015b7c0 msgr2=0x7f1280070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 --2- 172.21.15.53:0/987790926 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f128015b7c0 0x7f1280070c90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f12740097c0 tx=0x7f127401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 -- 172.21.15.53:0/987790926 shutdown_connections 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 --2- 172.21.15.53:0/987790926 >> v2:172.21.15.87:3300/0 conn(0x7f12800711d0 0x7f12801640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 --2- 172.21.15.53:0/987790926 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f128015b7c0 0x7f1280070c90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 -- 172.21.15.53:0/987790926 >> 172.21.15.53:0/987790926 conn(0x7f1280065c80 msgr2=0x7f1280066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 -- 172.21.15.53:0/987790926 shutdown_connections 2024-09-13T18:30:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.146+0000 7f1285959640 1 -- 172.21.15.53:0/987790926 wait complete. 2024-09-13T18:30:28.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 Processor -- start 2024-09-13T18:30:28.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 -- start start 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12800711d0 0x7f128014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12801582a0 0x7f12801461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f128015b7c0 0x7f1280151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280146900 con 0x7f128015b7c0 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801466e0 con 0x7f12801582a0 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128014ad10 con 0x7f12800711d0 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f128015b7c0 0x7f1280151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f128015b7c0 0x7f1280151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37900/0 (socket says 172.21.15.53:37900) 2024-09-13T18:30:28.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 -- 172.21.15.53:0/2409460105 learned_addr learned my addr 172.21.15.53:0/2409460105 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127e7fc640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12801582a0 0x7f12801461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127effd640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12800711d0 0x7f128014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 -- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12800711d0 msgr2=0x7f128014a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12800711d0 0x7f128014a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 -- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12801582a0 msgr2=0x7f12801461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12801582a0 0x7f12801461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 -- 172.21.15.53:0/2409460105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009b30 con 0x7f128015b7c0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f127f7fe640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f128015b7c0 0x7f1280151660 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f127800efc0 tx=0x7f127800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1267fff640 1 -- 172.21.15.53:0/2409460105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278018070 con 0x7f128015b7c0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1267fff640 1 -- 172.21.15.53:0/2409460105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127800f040 con 0x7f128015b7c0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1274009420 con 0x7f128015b7c0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1267fff640 1 -- 172.21.15.53:0/2409460105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800ce00 con 0x7f128015b7c0 2024-09-13T18:30:28.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128014b2d0 con 0x7f128015b7c0 2024-09-13T18:30:28.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280067400 con 0x7f128015b7c0 2024-09-13T18:30:28.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.150+0000 7f1267fff640 1 -- 172.21.15.53:0/2409460105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f1278014480 con 0x7f128015b7c0 2024-09-13T18:30:28.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.154+0000 7f1267fff640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f126c0667b0 0x7f126c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:28.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.154+0000 7f127effd640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f126c0667b0 0x7f126c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:28.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.154+0000 7f1267fff640 1 -- 172.21.15.53:0/2409460105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1278084530 con 0x7f128015b7c0 2024-09-13T18:30:28.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.154+0000 7f127effd640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f126c0667b0 0x7f126c068c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1270007fd0 tx=0x7f1270009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:28.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.158+0000 7f1267fff640 1 -- 172.21.15.53:0/2409460105 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12780517c0 con 0x7f128015b7c0 2024-09-13T18:30:28.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.346+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1280146a40 con 0x7f128015b7c0 2024-09-13T18:30:28.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.346+0000 7f1267fff640 1 -- 172.21.15.53:0/2409460105 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1278054de0 con 0x7f128015b7c0 2024-09-13T18:30:28.350 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:30:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f126c0667b0 msgr2=0x7f126c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f126c0667b0 0x7f126c068c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1270007fd0 tx=0x7f1270009040 comp rx=0 tx=0).stop 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f128015b7c0 msgr2=0x7f1280151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f128015b7c0 0x7f1280151660 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f127800efc0 tx=0x7f127800c490 comp rx=0 tx=0).stop 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 shutdown_connections 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f126c0667b0 0x7f126c068c70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f128015b7c0 0x7f1280151660 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12801582a0 0x7f12801461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 --2- 172.21.15.53:0/2409460105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12800711d0 0x7f128014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:28.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 >> 172.21.15.53:0/2409460105 conn(0x7f1280065c80 msgr2=0x7f1280154750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:28.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 shutdown_connections 2024-09-13T18:30:28.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:28.350+0000 7f1285959640 1 -- 172.21.15.53:0/2409460105 wait complete. 2024-09-13T18:30:28.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:30:28.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:30:28.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:30:28.368 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:30:28.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:28.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:30:28.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:30:28.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:30:28.369 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:30:28.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:28.369 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:30:28.374 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42168sec preferred_lft 42168sec 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:30:28.375 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.376 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:30:28.377 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:30:28.377 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:30:28.377 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:28.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:28.377 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:30:28.425 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:30:28.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:28.426 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:30:28.477 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:30:28.477 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:30:28.477 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:30:28.477 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:30:28.477 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:30:28.477 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:30:28.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:28.478 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:30:28.478 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:30:28.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:30:28.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:30:28.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:30:28.478 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:30:28.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:28.551 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:30:28.599 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:30:28.599 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:30:28.600 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:30:28.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:28.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:30:28.657 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:30:28.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:30:28.657 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:28.707 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:30:28.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:30:28.708 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:28.759 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:30:28.821 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:30:28.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:30:28.874 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:30:28.876 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:30:28.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:28.876 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:30:28.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:30:28.928 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:30:28.976 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:30:28.991 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:30:28.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:30:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:30:29.045 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:30:29.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:29.046 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:30:29.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:30:29.062+0000 7f3ca0ba6580 -1 init, newargv = 0x55bb7b80e720 newargc=15 2024-09-13T18:30:29.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[47380]: starting ceph client 2024-09-13T18:30:29.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[47380]: starting fuse 2024-09-13T18:30:30.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:30:30.188 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:30:30.188 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:30:30.244 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:30:30.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:30:30.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:30.245 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:30:30.291 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:30:30.292 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:30:30.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:30:30.292 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:30:30.292 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:30:30.292 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:30:30.292 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:30:30.293 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:30:30.294 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:30:30.417 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.47380.asok 2024-09-13T18:30:30.598 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47380.asok 2024-09-13T18:30:30.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:30.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47380.asok status 2024-09-13T18:30:30.757 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:30:30.757 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:30:30.757 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:30:30.757 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "47380", 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 7620, 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:30:30.758 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 7620 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1857679242 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1857679242 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:30.759 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.7620 192.168.0.1:0/1857679242", 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1857679242", 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 48, 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 87, 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:30:30.760 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:30:30.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:30.772 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:30:30.772 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:30.778 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:30:30.778 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:30.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:30.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:30.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:30:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec7503c640 1 Processor -- start 2024-09-13T18:30:30.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec7503c640 1 -- start start 2024-09-13T18:30:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec7503c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec7006b850 0x7fec700b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec7503c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec700b1ac0 con 0x7fec700cb980 2024-09-13T18:30:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec7503c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec70159ac0 con 0x7fec700cbd60 2024-09-13T18:30:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec7503c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec70159da0 con 0x7fec7006b850 2024-09-13T18:30:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec7006b850 0x7fec700b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fec700cb980 0x7fec7006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46190/0 (socket says 172.21.15.53:46190) 2024-09-13T18:30:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6ed9d640 1 -- 172.21.15.53:0/1905322734 learned_addr learned my addr 172.21.15.53:0/1905322734 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6dd9b640 1 -- 172.21.15.53:0/1905322734 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741650227 0 0) 0x7fec700b1ac0 con 0x7fec700cb980 2024-09-13T18:30:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6dd9b640 1 -- 172.21.15.53:0/1905322734 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec58003530 con 0x7fec700cb980 2024-09-13T18:30:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6e59c640 1 -- 172.21.15.53:0/1905322734 >> v1:172.21.15.87:6789/0 conn(0x7fec700cbd60 legacy=0x7fec700b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6e59c640 1 -- 172.21.15.53:0/1905322734 >> v1:172.21.15.53:6789/0 conn(0x7fec700cb980 legacy=0x7fec7006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:30.998+0000 7fec6e59c640 1 -- 172.21.15.53:0/1905322734 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7015a080 con 0x7fec7006b850 2024-09-13T18:30:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec6e59c640 1 --2- 172.21.15.53:0/1905322734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec7006b850 0x7fec700b33b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fec640097c0 tx=0x7fec6401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727c381aa89f84d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec6dd9b640 1 -- 172.21.15.53:0/1905322734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec640ac640 con 0x7fec7006b850 2024-09-13T18:30:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec6dd9b640 1 -- 172.21.15.53:0/1905322734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec640ac7a0 con 0x7fec7006b850 2024-09-13T18:30:31.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec6dd9b640 1 -- 172.21.15.53:0/1905322734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec640acb10 con 0x7fec7006b850 2024-09-13T18:30:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- 172.21.15.53:0/1905322734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec7006b850 msgr2=0x7fec700b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 --2- 172.21.15.53:0/1905322734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec7006b850 0x7fec700b33b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fec640097c0 tx=0x7fec6401c310 comp rx=0 tx=0).stop 2024-09-13T18:30:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- 172.21.15.53:0/1905322734 shutdown_connections 2024-09-13T18:30:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 --2- 172.21.15.53:0/1905322734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec7006b850 0x7fec700b33b0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- 172.21.15.53:0/1905322734 >> 172.21.15.53:0/1905322734 conn(0x7fec70065c80 msgr2=0x7fec70066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- 172.21.15.53:0/1905322734 shutdown_connections 2024-09-13T18:30:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- 172.21.15.53:0/1905322734 wait complete. 2024-09-13T18:30:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 Processor -- start 2024-09-13T18:30:31.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- start start 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec7006b850 0x7fec701482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec700cb980 0x7fec701452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec700cbd60 0x7fec700cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7014d0a0 con 0x7fec700cbd60 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7014d2f0 con 0x7fec7006b850 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec7503c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7014d5d0 con 0x7fec700cb980 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec6f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec700cbd60 0x7fec700cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec6f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec700cbd60 0x7fec700cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37910/0 (socket says 172.21.15.53:37910) 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.002+0000 7fec6f59e640 1 -- 172.21.15.53:0/43710606 learned_addr learned my addr 172.21.15.53:0/43710606 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6ed9d640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec7006b850 0x7fec701482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6e59c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec700cb980 0x7fec701452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6f59e640 1 -- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec700cb980 msgr2=0x7fec701452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6f59e640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec700cb980 0x7fec701452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6f59e640 1 -- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec7006b850 msgr2=0x7fec701482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6f59e640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec7006b850 0x7fec701482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6f59e640 1 -- 172.21.15.53:0/43710606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009420 con 0x7fec700cbd60 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6e59c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec700cb980 0x7fec701452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6f59e640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec700cbd60 0x7fec700cc810 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c780 tx=0x7fec6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec577fe640 1 -- 172.21.15.53:0/43710606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68004b70 con 0x7fec700cbd60 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec577fe640 1 -- 172.21.15.53:0/43710606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800ce90 con 0x7fec700cbd60 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7014d8b0 con 0x7fec700cbd60 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec577fe640 1 -- 172.21.15.53:0/43710606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800a850 con 0x7fec700cbd60 2024-09-13T18:30:31.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70145dc0 con 0x7fec700cbd60 2024-09-13T18:30:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70067400 con 0x7fec700cbd60 2024-09-13T18:30:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec577fe640 1 -- 172.21.15.53:0/43710606 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fec6800a9b0 con 0x7fec700cbd60 2024-09-13T18:30:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec577fe640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec5c0667b0 0x7fec5c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec577fe640 1 -- 172.21.15.53:0/43710606 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec68084430 con 0x7fec700cbd60 2024-09-13T18:30:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6ed9d640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec5c0667b0 0x7fec5c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:31.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.006+0000 7fec6ed9d640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec5c0667b0 0x7fec5c068c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec700add70 tx=0x7fec60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:31.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.010+0000 7fec577fe640 1 -- 172.21.15.53:0/43710606 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec68051720 con 0x7fec700cbd60 2024-09-13T18:30:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.210+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fec700ce0d0 con 0x7fec700cbd60 2024-09-13T18:30:31.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec577fe640 1 -- 172.21.15.53:0/43710606 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fec68054d40 con 0x7fec700cbd60 2024-09-13T18:30:31.215 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:30:31.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec5c0667b0 msgr2=0x7fec5c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec5c0667b0 0x7fec5c068c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec700add70 tx=0x7fec60009040 comp rx=0 tx=0).stop 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec700cbd60 msgr2=0x7fec700cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec700cbd60 0x7fec700cc810 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c780 tx=0x7fec6800cc40 comp rx=0 tx=0).stop 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 shutdown_connections 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec5c0667b0 0x7fec5c068c70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec700cb980 0x7fec701452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec700cbd60 0x7fec700cc810 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 --2- 172.21.15.53:0/43710606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec7006b850 0x7fec701482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 >> 172.21.15.53:0/43710606 conn(0x7fec70065c80 msgr2=0x7fec700aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 shutdown_connections 2024-09-13T18:30:31.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:31.214+0000 7fec7503c640 1 -- 172.21.15.53:0/43710606 wait complete. 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:30:31.233 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:30:31.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.234 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:30:31.241 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:30:31.241 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:30:31.241 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:30:31.242 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42171sec preferred_lft 42171sec 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:30:31.243 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:30:31.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.245 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:30:31.295 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:30:31.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.297 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:30:31.348 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:30:31.348 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:30:31.348 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:30:31.348 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:30:31.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.349 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:30:31.349 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:30:31.350 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:30:31.350 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:30:31.350 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:30:31.350 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:30:31.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.428 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:30:31.476 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:30:31.476 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:30:31.477 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:30:31.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:30:31.532 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:30:31.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:30:31.533 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:31.580 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:30:31.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:30:31.580 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:31.628 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:30:31.685 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:30:31.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:30:31.739 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:30:31.741 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:30:31.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.741 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:30:31.788 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:30:31.788 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:30:31.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:30:31.852 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:30:31.852 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:30:31.904 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:30:31.905 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:30:31.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:31.906 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:30:31.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:30:31.913+0000 7f548d638580 -1 init, newargv = 0x555f91e715b0 newargc=15 2024-09-13T18:30:31.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35927]: starting ceph client 2024-09-13T18:30:31.924 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35927]: starting fuse 2024-09-13T18:30:33.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:30:33.038 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:30:33.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:30:33.092 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:30:33.093 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:30:33.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:33.094 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:30:33.144 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:30:33.144 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:30:33.145 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:30:33.146 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:30:33.147 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:30:33.147 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:30:33.265 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.35927.asok 2024-09-13T18:30:33.447 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35927.asok 2024-09-13T18:30:33.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:33.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35927.asok status 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "35927", 2024-09-13T18:30:33.608 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 6790, 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 6790 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 769972374 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:30:33.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 769972374 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.6790 192.168.0.1:0/769972374", 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/769972374", 2024-09-13T18:30:33.610 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:30:33.611 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 48, 2024-09-13T18:30:33.612 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 87, 2024-09-13T18:30:33.612 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:30:33.612 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:30:33.612 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:30:33.612 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:30:33.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:33.622 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:30:33.622 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:33.628 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:30:33.629 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:33.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:33.629 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:33.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:30:33.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9fe3de640 1 Processor -- start 2024-09-13T18:30:33.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9fe3de640 1 -- start start 2024-09-13T18:30:33.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9fe3de640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 0x7fd9f815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9fe3de640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f815af10 con 0x7fd9f806cec0 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9fe3de640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f80ae090 con 0x7fd9f80b3c70 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9fe3de640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f815ef40 con 0x7fd9f80ac4b0 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9f7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd9f806cec0 0x7fd9f815b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46198/0 (socket says 172.21.15.53:46198) 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.818+0000 7fd9f7fff640 1 -- 172.21.15.53:0/1503064143 learned_addr learned my addr 172.21.15.53:0/1503064143 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9fc97b640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 0x7fd9f815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193662009 0 0) 0x7fd9f815af10 con 0x7fd9f806cec0 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e4003530 con 0x7fd9f806cec0 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917157100 0 0) 0x7fd9e4003530 con 0x7fd9f806cec0 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 msgr2=0x7fd9f815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 0x7fd9f815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 >> v1:172.21.15.87:6789/0 conn(0x7fd9f80b3c70 legacy=0x7fd9f80abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f80ae870 con 0x7fd9f806cec0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd9e8001a00 con 0x7fd9f806cec0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 >> v1:172.21.15.53:6789/0 conn(0x7fd9f806cec0 legacy=0x7fd9f815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9e40039b0 0x7fd9e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e40047d0 0x7fd9e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 0x7fd9e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f815ef40 con 0x7fd9e40047d0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e400bb20 con 0x7fd9e40039b0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e400bce0 con 0x7fd9f80ac4b0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f77fe640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e40047d0 0x7fd9e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f7fff640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9e40039b0 0x7fd9e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9fc97b640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 0x7fd9e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f77fe640 1 -- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 msgr2=0x7fd9e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f77fe640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 0x7fd9e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f77fe640 1 -- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9e40039b0 msgr2=0x7fd9e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f77fe640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9e40039b0 0x7fd9e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f77fe640 1 -- 172.21.15.53:0/1503064143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4003530 con 0x7fd9e40047d0 2024-09-13T18:30:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9fc97b640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9f80ac4b0 0x7fd9e40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f77fe640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e40047d0 0x7fd9e4004c50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0001750 tx=0x7fd9e001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b337e86fea1d4566 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00052d0 con 0x7fd9e40047d0 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e00a7050 con 0x7fd9e40047d0 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.822+0000 7fd9f6ffd640 1 -- 172.21.15.53:0/1503064143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0003600 con 0x7fd9e40047d0 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- 172.21.15.53:0/1503064143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e40047d0 msgr2=0x7fd9e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 --2- 172.21.15.53:0/1503064143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9e40047d0 0x7fd9e4004c50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0001750 tx=0x7fd9e001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fc97b640 1 -- 172.21.15.53:0/1503064143 reap_dead start 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- 172.21.15.53:0/1503064143 shutdown_connections 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- 172.21.15.53:0/1503064143 >> 172.21.15.53:0/1503064143 conn(0x7fd9f8069f50 msgr2=0x7fd9f806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- 172.21.15.53:0/1503064143 shutdown_connections 2024-09-13T18:30:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- 172.21.15.53:0/1503064143 wait complete. 2024-09-13T18:30:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 Processor -- start 2024-09-13T18:30:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- start start 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9e40047d0 0x7fd9f8152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9f81532d0 0x7fd9f81f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9f81f55c0 0x7fd9f8163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f80cdc10 con 0x7fd9f81532d0 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f80cd930 con 0x7fd9f81f55c0 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f8070700 con 0x7fd9e40047d0 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9f81532d0 0x7fd9f81f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9f81532d0 0x7fd9f81f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37934/0 (socket says 172.21.15.53:37934) 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 -- 172.21.15.53:0/3162904081 learned_addr learned my addr 172.21.15.53:0/3162904081 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f7fff640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9e40047d0 0x7fd9f8152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fc97b640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9f81f55c0 0x7fd9f8163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 -- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9e40047d0 msgr2=0x7fd9f8152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9e40047d0 0x7fd9f8152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 -- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9f81f55c0 msgr2=0x7fd9f8163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9f81f55c0 0x7fd9f8163510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 -- 172.21.15.53:0/3162904081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f80709e0 con 0x7fd9f81532d0 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f77fe640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9f81532d0 0x7fd9f81f5080 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0005040 tx=0x7fd9e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f4ff9640 1 -- 172.21.15.53:0/3162904081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00069e0 con 0x7fd9f81532d0 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f4ff9640 1 -- 172.21.15.53:0/3162904081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e0006b40 con 0x7fd9f81532d0 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9f4ff9640 1 -- 172.21.15.53:0/3162904081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0007030 con 0x7fd9f81532d0 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f8070cc0 con 0x7fd9f81532d0 2024-09-13T18:30:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.826+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f8153820 con 0x7fd9f81532d0 2024-09-13T18:30:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.830+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f815b3a0 con 0x7fd9f81532d0 2024-09-13T18:30:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.830+0000 7fd9f4ff9640 1 -- 172.21.15.53:0/3162904081 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd9e0007190 con 0x7fd9f81532d0 2024-09-13T18:30:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.830+0000 7fd9f4ff9640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd9d80667e0 0x7fd9d8068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.830+0000 7fd9f4ff9640 1 -- 172.21.15.53:0/3162904081 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9e011e370 con 0x7fd9f81532d0 2024-09-13T18:30:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.830+0000 7fd9f7fff640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd9d80667e0 0x7fd9d8068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.830+0000 7fd9f7fff640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd9d80667e0 0x7fd9d8068ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8001ed0 tx=0x7fd9e8006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:33.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:33.834+0000 7fd9f4ff9640 1 -- 172.21.15.53:0/3162904081 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9e00eb550 con 0x7fd9f81532d0 2024-09-13T18:30:34.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.038+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd9f80cdc10 con 0x7fd9f81532d0 2024-09-13T18:30:34.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.086+0000 7fd9f4ff9640 1 -- 172.21.15.53:0/3162904081 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 136+0+0 (secure 0 0 0) 0x7fd9e00eeb70 con 0x7fd9f81532d0 2024-09-13T18:30:34.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd9d80667e0 msgr2=0x7fd9d8068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd9d80667e0 0x7fd9d8068ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8001ed0 tx=0x7fd9e8006040 comp rx=0 tx=0).stop 2024-09-13T18:30:34.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9f81532d0 msgr2=0x7fd9f81f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9f81532d0 0x7fd9f81f5080 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0005040 tx=0x7fd9e4005800 comp rx=0 tx=0).stop 2024-09-13T18:30:34.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 shutdown_connections 2024-09-13T18:30:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd9d80667e0 0x7fd9d8068ca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9f81f55c0 0x7fd9f8163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9f81532d0 0x7fd9f81f5080 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 --2- 172.21.15.53:0/3162904081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9e40047d0 0x7fd9f8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 >> 172.21.15.53:0/3162904081 conn(0x7fd9f8069f50 msgr2=0x7fd9f806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 shutdown_connections 2024-09-13T18:30:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.090+0000 7fd9fe3de640 1 -- 172.21.15.53:0/3162904081 wait complete. 2024-09-13T18:30:34.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:30:34.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5b027a640 1 Processor -- start 2024-09-13T18:30:34.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5b027a640 1 -- start start 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5b027a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5a80d19c0 0x7fb5a80cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5b027a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb5a80cf600 0x7fb5a80b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5b027a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a80d2400 con 0x7fb5a815cab0 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5b027a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a80cfa90 con 0x7fb5a80d19c0 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5b027a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a80d1530 con 0x7fb5a80cf600 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5ae016640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb5a815cab0 0x7fb5a80cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46204/0 (socket says 172.21.15.53:46204) 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.234+0000 7fb5ae016640 1 -- 172.21.15.53:0/3953424816 learned_addr learned my addr 172.21.15.53:0/3953424816 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:34.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad815640 1 --2- 172.21.15.53:0/3953424816 >> v2:172.21.15.53:3300/0 conn(0x7fb5a80d19c0 0x7fb5a80cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ae817640 1 --2- 172.21.15.53:0/3953424816 >> v2:172.21.15.87:3300/0 conn(0x7fb5a80cf600 0x7fb5a80b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad014640 1 -- 172.21.15.53:0/3953424816 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535904707 0 0) 0x7fb5a80d2400 con 0x7fb5a815cab0 2024-09-13T18:30:34.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad014640 1 -- 172.21.15.53:0/3953424816 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb594003530 con 0x7fb5a815cab0 2024-09-13T18:30:34.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad815640 1 -- 172.21.15.53:0/3953424816 >> v2:172.21.15.87:3300/0 conn(0x7fb5a80cf600 msgr2=0x7fb5a80b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad815640 1 --2- 172.21.15.53:0/3953424816 >> v2:172.21.15.87:3300/0 conn(0x7fb5a80cf600 0x7fb5a80b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad815640 1 -- 172.21.15.53:0/3953424816 >> v1:172.21.15.53:6789/0 conn(0x7fb5a815cab0 legacy=0x7fb5a80cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad815640 1 -- 172.21.15.53:0/3953424816 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a80cddd0 con 0x7fb5a80d19c0 2024-09-13T18:30:34.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad815640 1 --2- 172.21.15.53:0/3953424816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a80cf0c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80b7fe0 tx=0x7fb59801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905cae2ea7ee8490 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad014640 1 -- 172.21.15.53:0/3953424816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980ab600 con 0x7fb5a80d19c0 2024-09-13T18:30:34.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad014640 1 -- 172.21.15.53:0/3953424816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980a7050 con 0x7fb5a80d19c0 2024-09-13T18:30:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5ad014640 1 -- 172.21.15.53:0/3953424816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980ab980 con 0x7fb5a80d19c0 2024-09-13T18:30:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 -- 172.21.15.53:0/3953424816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 msgr2=0x7fb5a80cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 --2- 172.21.15.53:0/3953424816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a80cf0c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb5a80b7fe0 tx=0x7fb59801c480 comp rx=0 tx=0).stop 2024-09-13T18:30:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 -- 172.21.15.53:0/3953424816 shutdown_connections 2024-09-13T18:30:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 --2- 172.21.15.53:0/3953424816 >> v2:172.21.15.87:3300/0 conn(0x7fb5a80cf600 0x7fb5a80b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 --2- 172.21.15.53:0/3953424816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a80cf0c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 -- 172.21.15.53:0/3953424816 >> 172.21.15.53:0/3953424816 conn(0x7fb5a8065c80 msgr2=0x7fb5a8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 -- 172.21.15.53:0/3953424816 shutdown_connections 2024-09-13T18:30:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.238+0000 7fb5b027a640 1 -- 172.21.15.53:0/3953424816 wait complete. 2024-09-13T18:30:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 Processor -- start 2024-09-13T18:30:34.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 -- start start 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80cf600 0x7fb5a81555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a815cab0 0x7fb5a80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a81568d0 con 0x7fb5a80d19c0 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8155c50 con 0x7fb5a815cab0 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a8155f30 con 0x7fb5a80cf600 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a81526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a81526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37954/0 (socket says 172.21.15.53:37954) 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 -- 172.21.15.53:0/2174880439 learned_addr learned my addr 172.21.15.53:0/2174880439 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ae016640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80cf600 0x7fb5a81555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ae817640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a815cab0 0x7fb5a80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 -- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80cf600 msgr2=0x7fb5a81555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80cf600 0x7fb5a81555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 -- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a815cab0 msgr2=0x7fb5a80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a815cab0 0x7fb5a80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 -- 172.21.15.53:0/2174880439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598009420 con 0x7fb5a80d19c0 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ae016640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80cf600 0x7fb5a81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ae817640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a815cab0 0x7fb5a80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5ad815640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a81526f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb5980ae040 tx=0x7fb598019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb59effd640 1 -- 172.21.15.53:0/2174880439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980b4430 con 0x7fb5a80d19c0 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb59effd640 1 -- 172.21.15.53:0/2174880439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980b45b0 con 0x7fb5a80d19c0 2024-09-13T18:30:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a8156210 con 0x7fb5a80d19c0 2024-09-13T18:30:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb59effd640 1 -- 172.21.15.53:0/2174880439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980b4960 con 0x7fb5a80d19c0 2024-09-13T18:30:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a80cdab0 con 0x7fb5a80d19c0 2024-09-13T18:30:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.242+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590005260 con 0x7fb5a80d19c0 2024-09-13T18:30:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.246+0000 7fb59effd640 1 -- 172.21.15.53:0/2174880439 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fb5980b2040 con 0x7fb5a80d19c0 2024-09-13T18:30:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.246+0000 7fb59effd640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb58c0667b0 0x7fb58c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.246+0000 7fb59effd640 1 -- 172.21.15.53:0/2174880439 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5a80b65c0 con 0x7fb5a80d19c0 2024-09-13T18:30:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.246+0000 7fb5ae016640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb58c0667b0 0x7fb58c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.246+0000 7fb5ae016640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb58c0667b0 0x7fb58c068c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40011f0 tx=0x7fb5a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.250+0000 7fb59effd640 1 -- 172.21.15.53:0/2174880439 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5980ec050 con 0x7fb5a80d19c0 2024-09-13T18:30:34.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.430+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb590000bd0 con 0x7fb58c0667b0 2024-09-13T18:30:34.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.434+0000 7fb59effd640 1 -- 172.21.15.53:0/2174880439 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb590000bd0 con 0x7fb58c0667b0 2024-09-13T18:30:34.437 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:30:34.437 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:34.437 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:30:34.437 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:34.438 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:30:34.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb58c0667b0 msgr2=0x7fb58c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb58c0667b0 0x7fb58c068c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40011f0 tx=0x7fb5a4009040 comp rx=0 tx=0).stop 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 msgr2=0x7fb5a81526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a81526f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb5980ae040 tx=0x7fb598019220 comp rx=0 tx=0).stop 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 shutdown_connections 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb58c0667b0 0x7fb58c068c70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5a815cab0 0x7fb5a80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a80d19c0 0x7fb5a81526f0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 --2- 172.21.15.53:0/2174880439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5a80cf600 0x7fb5a81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 >> 172.21.15.53:0/2174880439 conn(0x7fb5a8065c80 msgr2=0x7fb5a8158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 shutdown_connections 2024-09-13T18:30:34.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.438+0000 7fb5b027a640 1 -- 172.21.15.53:0/2174880439 wait complete. 2024-09-13T18:30:34.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:30:34.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd8cc1640 1 Processor -- start 2024-09-13T18:30:34.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd8cc1640 1 -- start start 2024-09-13T18:30:34.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd8cc1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd40d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd8cc1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd40b7db0 con 0x7f7dd40d3390 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd8cc1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd40d0650 con 0x7f7dd40ccd10 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd8cc1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40d0c10 con 0x7f7dd415c830 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd2d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7dd40d3390 0x7f7dd40b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46212/0 (socket says 172.21.15.53:46212) 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd2d9d640 1 -- 172.21.15.53:0/2265734333 learned_addr learned my addr 172.21.15.53:0/2265734333 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd259c640 1 --2- 172.21.15.53:0/2265734333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd40d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd1d9b640 1 -- 172.21.15.53:0/2265734333 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426587870 0 0) 0x7f7dd40b7db0 con 0x7f7dd40d3390 2024-09-13T18:30:34.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd1d9b640 1 -- 172.21.15.53:0/2265734333 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc0003530 con 0x7f7dd40d3390 2024-09-13T18:30:34.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd259c640 1 -- 172.21.15.53:0/2265734333 >> v1:172.21.15.87:6789/0 conn(0x7f7dd40ccd10 legacy=0x7f7dd40d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd259c640 1 -- 172.21.15.53:0/2265734333 >> v1:172.21.15.53:6789/0 conn(0x7f7dd40d3390 legacy=0x7f7dd40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.578+0000 7f7dd259c640 1 -- 172.21.15.53:0/2265734333 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40cd7d0 con 0x7f7dd415c830 2024-09-13T18:30:34.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd259c640 1 --2- 172.21.15.53:0/2265734333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd40d10a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40097f0 tx=0x7f7dc401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f113716b22ac5359 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd1d9b640 1 -- 172.21.15.53:0/2265734333 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40ab600 con 0x7f7dd415c830 2024-09-13T18:30:34.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd1d9b640 1 -- 172.21.15.53:0/2265734333 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40a7050 con 0x7f7dd415c830 2024-09-13T18:30:34.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd1d9b640 1 -- 172.21.15.53:0/2265734333 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40ab960 con 0x7f7dd415c830 2024-09-13T18:30:34.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/2265734333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 msgr2=0x7f7dd40d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/2265734333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd40d10a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40097f0 tx=0x7f7dc401c4e0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/2265734333 shutdown_connections 2024-09-13T18:30:34.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/2265734333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd40d10a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/2265734333 >> 172.21.15.53:0/2265734333 conn(0x7f7dd4070970 msgr2=0x7f7dd4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/2265734333 shutdown_connections 2024-09-13T18:30:34.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/2265734333 wait complete. 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 Processor -- start 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- start start 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dd40ccd10 0x7f7dd415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd40d3390 0x7f7dd414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c9840 con 0x7f7dd40ccd10 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c61f0 con 0x7f7dd40d3390 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.582+0000 7f7dd8cc1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40cc380 con 0x7f7dd415c830 2024-09-13T18:30:34.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dd40ccd10 0x7f7dd415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dd40ccd10 0x7f7dd415aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37960/0 (socket says 172.21.15.53:37960) 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 -- 172.21.15.53:0/822819456 learned_addr learned my addr 172.21.15.53:0/822819456 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd2d9d640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcbfff640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd40d3390 0x7f7dd414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 -- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 msgr2=0x7f7dd415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 -- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd40d3390 msgr2=0x7f7dd414acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd40d3390 0x7f7dd414acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 -- 172.21.15.53:0/822819456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4009420 con 0x7f7dd40ccd10 2024-09-13T18:30:34.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd259c640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dd40ccd10 0x7f7dd415aee0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f7dc401a110 tx=0x7f7dc4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcaffd640 1 -- 172.21.15.53:0/822819456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40bb070 con 0x7f7dd40ccd10 2024-09-13T18:30:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcaffd640 1 -- 172.21.15.53:0/822819456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40038f0 con 0x7f7dd40ccd10 2024-09-13T18:30:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40cc660 con 0x7f7dd40ccd10 2024-09-13T18:30:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcaffd640 1 -- 172.21.15.53:0/822819456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4003c60 con 0x7f7dd40ccd10 2024-09-13T18:30:34.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd40c66e0 con 0x7f7dd40ccd10 2024-09-13T18:30:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd40c68d0 con 0x7f7dd40ccd10 2024-09-13T18:30:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcaffd640 1 -- 172.21.15.53:0/822819456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f7dc40b2070 con 0x7f7dd40ccd10 2024-09-13T18:30:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcaffd640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7db40667e0 0x7f7db4068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcaffd640 1 -- 172.21.15.53:0/822819456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc411ea00 con 0x7f7dd40ccd10 2024-09-13T18:30:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcbfff640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7db40667e0 0x7f7db4068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.586+0000 7f7dcbfff640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7db40667e0 0x7f7db4068ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4153df0 tx=0x7f7dbc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.590+0000 7f7dcaffd640 1 -- 172.21.15.53:0/822819456 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7dc40ebba0 con 0x7f7dd40ccd10 2024-09-13T18:30:34.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7dd40d10a0 con 0x7f7dd40ccd10 2024-09-13T18:30:34.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dcaffd640 1 -- 172.21.15.53:0/822819456 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7dc40b0070 con 0x7f7dd40ccd10 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7db40667e0 msgr2=0x7f7db4068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7db40667e0 0x7f7db4068ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4153df0 tx=0x7f7dbc009040 comp rx=0 tx=0).stop 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dd40ccd10 msgr2=0x7f7dd415aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dd40ccd10 0x7f7dd415aee0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f7dc401a110 tx=0x7f7dc4019280 comp rx=0 tx=0).stop 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 shutdown_connections 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7db40667e0 0x7f7db4068ca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.754+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7dd415c830 0x7f7dd415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.758+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dd40d3390 0x7f7dd414acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.758+0000 7f7dd8cc1640 1 --2- 172.21.15.53:0/822819456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dd40ccd10 0x7f7dd415aee0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.758+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 >> 172.21.15.53:0/822819456 conn(0x7f7dd4070970 msgr2=0x7f7dd40d2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.758+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 shutdown_connections 2024-09-13T18:30:34.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.758+0000 7f7dd8cc1640 1 -- 172.21.15.53:0/822819456 wait complete. 2024-09-13T18:30:34.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create 'abcd@#' 2024-09-13T18:30:34.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677e371640 1 Processor -- start 2024-09-13T18:30:34.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677e371640 1 -- start start 2024-09-13T18:30:34.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677e371640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f67780cda30 0x7f67780cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677e371640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677806f7a0 con 0x7f6778143e80 2024-09-13T18:30:34.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677e371640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677806fd60 con 0x7f67780caee0 2024-09-13T18:30:34.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677e371640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677806baa0 con 0x7f67780cda30 2024-09-13T18:30:34.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6778143e80 0x7f677806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46228/0 (socket says 172.21.15.53:46228) 2024-09-13T18:30:34.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 -- 172.21.15.53:0/4141932292 learned_addr learned my addr 172.21.15.53:0/4141932292 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:34.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677c90e640 1 --2- 172.21.15.53:0/4141932292 >> v2:172.21.15.87:3300/0 conn(0x7f67780cda30 0x7f67780cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209026236 0 0) 0x7f677806f7a0 con 0x7f6778143e80 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6760003530 con 0x7f6778143e80 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662785725 0 0) 0x7f6760003530 con 0x7f6778143e80 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 >> v2:172.21.15.87:3300/0 conn(0x7f67780cda30 msgr2=0x7f67780cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 --2- 172.21.15.53:0/4141932292 >> v2:172.21.15.87:3300/0 conn(0x7f67780cda30 0x7f67780cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 >> v1:172.21.15.87:6789/0 conn(0x7f67780caee0 legacy=0x7f67780cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780cb960 con 0x7f6778143e80 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6768001680 con 0x7f6778143e80 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 >> v1:172.21.15.53:6789/0 conn(0x7f6778143e80 legacy=0x7f677806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6760003980 0x7f6760003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67600047d0 0x7f6760004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67600052b0 0x7f676000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677806baa0 con 0x7f6760003980 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676000c180 con 0x7f67600047d0 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676000c340 con 0x7f67600052b0 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6760003980 0x7f6760003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677c90e640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67600052b0 0x7f676000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 -- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67600052b0 msgr2=0x7f676000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f67777fe640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67600047d0 0x7f6760004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67600052b0 0x7f676000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 -- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67600047d0 msgr2=0x7f6760004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67600047d0 0x7f6760004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f677c90e640 1 -- 172.21.15.53:0/4141932292 reap_dead start 2024-09-13T18:30:34.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.890+0000 7f6777fff640 1 -- 172.21.15.53:0/4141932292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760003530 con 0x7f6760003980 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f6777fff640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6760003980 0x7f6760003da0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f676800c190 tx=0x7f676801cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2982ecc00294e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768005ae0 con 0x7f6760003980 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6768005c40 con 0x7f6760003980 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f6776ffd640 1 -- 172.21.15.53:0/4141932292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680072b0 con 0x7f6760003980 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- 172.21.15.53:0/4141932292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6760003980 msgr2=0x7f6760003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6760003980 0x7f6760003da0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f676800c190 tx=0x7f676801cb10 comp rx=0 tx=0).stop 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- 172.21.15.53:0/4141932292 shutdown_connections 2024-09-13T18:30:34.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 --2- 172.21.15.53:0/4141932292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6760003980 0x7f6760003da0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- 172.21.15.53:0/4141932292 >> 172.21.15.53:0/4141932292 conn(0x7f6778065c80 msgr2=0x7f6778066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:34.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- 172.21.15.53:0/4141932292 shutdown_connections 2024-09-13T18:30:34.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- 172.21.15.53:0/4141932292 wait complete. 2024-09-13T18:30:34.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 Processor -- start 2024-09-13T18:30:34.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- start start 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6760003980 0x7f67781357d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677815b5e0 0x7f6778135d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677815cc20 0x7f67781f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677815bb80 con 0x7f677815b5e0 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677815be60 con 0x7f677815cc20 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.894+0000 7f677e371640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677815c140 con 0x7f6760003980 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677815b5e0 0x7f6778135d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677815b5e0 0x7f6778135d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37980/0 (socket says 172.21.15.53:37980) 2024-09-13T18:30:34.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 -- 172.21.15.53:0/2017364573 learned_addr learned my addr 172.21.15.53:0/2017364573 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f677c90e640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677815cc20 0x7f67781f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 -- 172.21.15.53:0/2017364573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6760003980 msgr2=0x7f67781357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6760003980 0x7f67781357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 -- 172.21.15.53:0/2017364573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677815cc20 msgr2=0x7f67781f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677815cc20 0x7f67781f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 -- 172.21.15.53:0/2017364573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677815c420 con 0x7f677815b5e0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f677c90e640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f677815cc20 0x7f67781f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f67777fe640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677815b5e0 0x7f6778135d10 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f676c00d4a0 tx=0x7f676c00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6774ff9640 1 -- 172.21.15.53:0/2017364573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c005480 con 0x7f677815b5e0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6774ff9640 1 -- 172.21.15.53:0/2017364573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c003620 con 0x7f677815b5e0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f677e371640 1 -- 172.21.15.53:0/2017364573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677815c700 con 0x7f677815b5e0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6774ff9640 1 -- 172.21.15.53:0/2017364573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c003990 con 0x7f677815b5e0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f677e371640 1 -- 172.21.15.53:0/2017364573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67781f3970 con 0x7f677815b5e0 2024-09-13T18:30:34.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f677e371640 1 -- 172.21.15.53:0/2017364573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67780709e0 con 0x7f677815b5e0 2024-09-13T18:30:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6774ff9640 1 -- 172.21.15.53:0/2017364573 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f676c003af0 con 0x7f677815b5e0 2024-09-13T18:30:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6774ff9640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67640667e0 0x7f6764068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6777fff640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67640667e0 0x7f6764068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6774ff9640 1 -- 172.21.15.53:0/2017364573 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f676c0842c0 con 0x7f677815b5e0 2024-09-13T18:30:34.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.898+0000 7f6777fff640 1 --2- 172.21.15.53:0/2017364573 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67640667e0 0x7f6764068ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f67680ab000 tx=0x7f677806fcd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:34.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:34.902+0000 7f6774ff9640 1 -- 172.21.15.53:0/2017364573 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f676c051370 con 0x7f677815b5e0 2024-09-13T18:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-13T18:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:fs volume create [] : Create a CephFS volume 2024-09-13T18:30:35.088 INFO:teuthology.orchestra.run.smithi053.stderr:Error EINVAL: invalid command 2024-09-13T18:30:35.092 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T18:30:35.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create testvol 2024-09-13T18:30:35.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113c4f7640 1 Processor -- start 2024-09-13T18:30:35.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113c4f7640 1 -- start start 2024-09-13T18:30:35.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113c4f7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 0x7f11340cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113c4f7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11340b1dd0 0x7f11340b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113c4f7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113406bc20 con 0x7f113406ff40 2024-09-13T18:30:35.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113c4f7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113406c530 con 0x7f11340b1dd0 2024-09-13T18:30:35.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113c4f7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1134158f80 con 0x7f1134158ba0 2024-09-13T18:30:35.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f113406ff40 0x7f1134070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46234/0 (socket says 172.21.15.53:46234) 2024-09-13T18:30:35.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 -- 172.21.15.53:0/3755310591 learned_addr learned my addr 172.21.15.53:0/3755310591 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:35.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808588470 0 0) 0x7f113406bc20 con 0x7f113406ff40 2024-09-13T18:30:35.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1120003530 con 0x7f113406ff40 2024-09-13T18:30:35.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139a92640 1 --2- 172.21.15.53:0/3755310591 >> v2:172.21.15.87:3300/0 conn(0x7f11340b1dd0 0x7f11340b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113a293640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 0x7f11340cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629901743 0 0) 0x7f1120003530 con 0x7f113406ff40 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 msgr2=0x7f11340cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 0x7f11340cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 >> v2:172.21.15.87:3300/0 conn(0x7f11340b1dd0 msgr2=0x7f11340b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 --2- 172.21.15.53:0/3755310591 >> v2:172.21.15.87:3300/0 conn(0x7f11340b1dd0 0x7f11340b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11340b2340 con 0x7f113406ff40 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f112c001a00 con 0x7f113406ff40 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 >> v1:172.21.15.53:6789/0 conn(0x7f113406ff40 legacy=0x7f1134070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1120003980 0x7f1120003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 0x7f11200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1120005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113406c530 con 0x7f1120004d10 2024-09-13T18:30:35.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1134158f80 con 0x7f1120003980 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112000ba10 con 0x7f1134158ba0 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1120005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113a293640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1120003980 0x7f1120003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f1139a92640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 0x7f11200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 -- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 msgr2=0x7f11200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134158ba0 0x7f11200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 -- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1120003980 msgr2=0x7f1120003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1120003980 0x7f1120003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.222+0000 7f113aa94640 1 -- 172.21.15.53:0/3755310591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1120003530 con 0x7f1120004d10 2024-09-13T18:30:35.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113aa94640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1120005190 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f112c00a440 tx=0x7f112c01f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cfe15bec6a89e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0ad600 con 0x7f1120004d10 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c0ad760 con 0x7f1120004d10 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f1139291640 1 -- 172.21.15.53:0/3755310591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0adb30 con 0x7f1120004d10 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 -- 172.21.15.53:0/3755310591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 msgr2=0x7f1120005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 --2- 172.21.15.53:0/3755310591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1120005190 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f112c00a440 tx=0x7f112c01f580 comp rx=0 tx=0).stop 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113aa94640 1 -- 172.21.15.53:0/3755310591 reap_dead start 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 -- 172.21.15.53:0/3755310591 shutdown_connections 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 -- 172.21.15.53:0/3755310591 >> 172.21.15.53:0/3755310591 conn(0x7f1134065c80 msgr2=0x7f1134066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 -- 172.21.15.53:0/3755310591 shutdown_connections 2024-09-13T18:30:35.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 -- 172.21.15.53:0/3755310591 wait complete. 2024-09-13T18:30:35.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 Processor -- start 2024-09-13T18:30:35.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.226+0000 7f113c4f7640 1 -- start start 2024-09-13T18:30:35.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1134154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134151fa0 0x7f113414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1134152770 0x7f1134154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11341546c0 con 0x7f1120004d10 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11341530e0 con 0x7f1134152770 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11341533c0 con 0x7f1134151fa0 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1134154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1134154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37998/0 (socket says 172.21.15.53:37998) 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 -- 172.21.15.53:0/1023278397 learned_addr learned my addr 172.21.15.53:0/1023278397 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113aa94640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1134152770 0x7f1134154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f1139a92640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134151fa0 0x7f113414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 -- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134151fa0 msgr2=0x7f113414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134151fa0 0x7f113414bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 -- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1134152770 msgr2=0x7f1134154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:35.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1134152770 0x7f1134154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:35.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 -- 172.21.15.53:0/1023278397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11341536a0 con 0x7f1120004d10 2024-09-13T18:30:35.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113a293640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1134154180 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1130011560 tx=0x7f1130011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:35.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f112affd640 1 -- 172.21.15.53:0/1023278397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130015930 con 0x7f1120004d10 2024-09-13T18:30:35.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f112affd640 1 -- 172.21.15.53:0/1023278397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130015a90 con 0x7f1120004d10 2024-09-13T18:30:35.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1134153980 con 0x7f1120004d10 2024-09-13T18:30:35.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f112affd640 1 -- 172.21.15.53:0/1023278397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130015e20 con 0x7f1120004d10 2024-09-13T18:30:35.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113414c200 con 0x7f1120004d10 2024-09-13T18:30:35.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113406ba50 con 0x7f1120004d10 2024-09-13T18:30:35.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f112affd640 1 -- 172.21.15.53:0/1023278397 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f113000f460 con 0x7f1120004d10 2024-09-13T18:30:35.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f112affd640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f11180667b0 0x7f1118068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:35.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f112affd640 1 -- 172.21.15.53:0/1023278397 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1130084dd0 con 0x7f1120004d10 2024-09-13T18:30:35.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.230+0000 7f1139a92640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f11180667b0 0x7f1118068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:35.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.234+0000 7f1139a92640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f11180667b0 0x7f1118068c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f11340aff10 tx=0x7f1124008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:35.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.234+0000 7f112affd640 1 -- 172.21.15.53:0/1023278397 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f11300521a0 con 0x7f1120004d10 2024-09-13T18:30:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:35.418+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "testvol", "target": ["mon-mgr", ""]}) v1 -- 0x7f11340ade50 con 0x7f11180667b0 2024-09-13T18:30:37.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.174+0000 7f112affd640 1 -- 172.21.15.53:0/1023278397 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f11340ade50 con 0x7f11180667b0 2024-09-13T18:30:37.177 INFO:teuthology.orchestra.run.smithi053.stderr:Volume created successfully (no MDS daemons created) 2024-09-13T18:30:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f11180667b0 msgr2=0x7f1118068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f11180667b0 0x7f1118068c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f11340aff10 tx=0x7f1124008040 comp rx=0 tx=0).stop 2024-09-13T18:30:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 msgr2=0x7f1134154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1134154180 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1130011560 tx=0x7f1130011a20 comp rx=0 tx=0).stop 2024-09-13T18:30:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 shutdown_connections 2024-09-13T18:30:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f11180667b0 0x7f1118068c70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1134151fa0 0x7f113414bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1134152770 0x7f1134154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 --2- 172.21.15.53:0/1023278397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1120004d10 0x7f1134154180 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 >> 172.21.15.53:0/1023278397 conn(0x7f1134065c80 msgr2=0x7f1134067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 shutdown_connections 2024-09-13T18:30:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.178+0000 7f113c4f7640 1 -- 172.21.15.53:0/1023278397 wait complete. 2024-09-13T18:30:37.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create testvol 'abcd@#' 2024-09-13T18:30:37.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd741477640 1 Processor -- start 2024-09-13T18:30:37.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd741477640 1 -- start start 2024-09-13T18:30:37.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd741477640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd73c15c830 0x7fd73c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd741477640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd73c0d3390 0x7fd73c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd741477640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c0b7db0 con 0x7fd73c0ccd10 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd741477640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0d0650 con 0x7fd73c15c830 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd741477640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0d0c10 con 0x7fd73c0d3390 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd73c15c830 0x7fd73c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73a7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd73c0ccd10 0x7fd73c0d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59630/0 (socket says 172.21.15.53:59630) 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd73c15c830 0x7fd73c0d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43390/0 (socket says 172.21.15.53:43390) 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73a7fc640 1 -- 172.21.15.53:0/3541609337 learned_addr learned my addr 172.21.15.53:0/3541609337 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73b7fe640 1 --2- 172.21.15.53:0/3541609337 >> v2:172.21.15.87:3300/0 conn(0x7fd73c0d3390 0x7fd73c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73affd640 1 -- 172.21.15.53:0/3541609337 >> v2:172.21.15.87:3300/0 conn(0x7fd73c0d3390 msgr2=0x7fd73c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73affd640 1 --2- 172.21.15.53:0/3541609337 >> v2:172.21.15.87:3300/0 conn(0x7fd73c0d3390 0x7fd73c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73affd640 1 -- 172.21.15.53:0/3541609337 >> v1:172.21.15.53:6789/0 conn(0x7fd73c0ccd10 legacy=0x7fd73c0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd739ffb640 1 -- 172.21.15.53:0/3541609337 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103249968 0 0) 0x7fd73c0b7db0 con 0x7fd73c0ccd10 2024-09-13T18:30:37.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.326+0000 7fd73affd640 1 -- 172.21.15.53:0/3541609337 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0cd7d0 con 0x7fd73c15c830 2024-09-13T18:30:37.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73affd640 1 --2- 172.21.15.53:0/3541609337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c15c830 0x7fd73c0d10a0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0b80d0 tx=0x7fd72c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0845068bb7ab5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:37.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd739ffb640 1 -- 172.21.15.53:0/3541609337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0ab600 con 0x7fd73c15c830 2024-09-13T18:30:37.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd739ffb640 1 -- 172.21.15.53:0/3541609337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c0a7050 con 0x7fd73c15c830 2024-09-13T18:30:37.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd739ffb640 1 -- 172.21.15.53:0/3541609337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0ab980 con 0x7fd73c15c830 2024-09-13T18:30:37.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- 172.21.15.53:0/3541609337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c15c830 msgr2=0x7fd73c0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 --2- 172.21.15.53:0/3541609337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c15c830 0x7fd73c0d10a0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0b80d0 tx=0x7fd72c01c480 comp rx=0 tx=0).stop 2024-09-13T18:30:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- 172.21.15.53:0/3541609337 shutdown_connections 2024-09-13T18:30:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 --2- 172.21.15.53:0/3541609337 >> v2:172.21.15.87:3300/0 conn(0x7fd73c0d3390 0x7fd73c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 --2- 172.21.15.53:0/3541609337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c15c830 0x7fd73c0d10a0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- 172.21.15.53:0/3541609337 >> 172.21.15.53:0/3541609337 conn(0x7fd73c070970 msgr2=0x7fd73c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- 172.21.15.53:0/3541609337 shutdown_connections 2024-09-13T18:30:37.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- 172.21.15.53:0/3541609337 wait complete. 2024-09-13T18:30:37.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 Processor -- start 2024-09-13T18:30:37.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- start start 2024-09-13T18:30:37.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd73c0ccd10 0x7fd73c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c0d3390 0x7fd73c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c15c830 0x7fd73c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0cb320 con 0x7fd73c0d3390 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c15a0a0 con 0x7fd73c15c830 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0cb550 con 0x7fd73c0ccd10 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c0d3390 0x7fd73c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c0d3390 0x7fd73c0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43396/0 (socket says 172.21.15.53:43396) 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 -- 172.21.15.53:0/3423837347 learned_addr learned my addr 172.21.15.53:0/3423837347 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73b7fe640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c15c830 0x7fd73c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73affd640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd73c0ccd10 0x7fd73c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 -- 172.21.15.53:0/3423837347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd73c0ccd10 msgr2=0x7fd73c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd73c0ccd10 0x7fd73c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 -- 172.21.15.53:0/3423837347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c15c830 msgr2=0x7fd73c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd73c15c830 0x7fd73c154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 -- 172.21.15.53:0/3423837347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c009420 con 0x7fd73c0d3390 2024-09-13T18:30:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd73a7fc640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd73c0d3390 0x7fd73c0cade0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fd7300011f0 tx=0x7fd73000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd7237fe640 1 -- 172.21.15.53:0/3423837347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300074e0 con 0x7fd73c0d3390 2024-09-13T18:30:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd7237fe640 1 -- 172.21.15.53:0/3423837347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730007640 con 0x7fd73c0d3390 2024-09-13T18:30:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- 172.21.15.53:0/3423837347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c0cb830 con 0x7fd73c0d3390 2024-09-13T18:30:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd7237fe640 1 -- 172.21.15.53:0/3423837347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730004a10 con 0x7fd73c0d3390 2024-09-13T18:30:37.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.330+0000 7fd741477640 1 -- 172.21.15.53:0/3423837347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c15a340 con 0x7fd73c0d3390 2024-09-13T18:30:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.334+0000 7fd741477640 1 -- 172.21.15.53:0/3423837347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c0d1080 con 0x7fd73c0d3390 2024-09-13T18:30:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.334+0000 7fd7237fe640 1 -- 172.21.15.53:0/3423837347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd730004b70 con 0x7fd73c0d3390 2024-09-13T18:30:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.334+0000 7fd7237fe640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7280667b0 0x7fd728068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.334+0000 7fd7237fe640 1 -- 172.21.15.53:0/3423837347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6543+0+0 (secure 0 0 0) 0x7fd730083ea0 con 0x7fd73c0d3390 2024-09-13T18:30:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.334+0000 7fd73affd640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7280667b0 0x7fd728068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.334+0000 7fd73affd640 1 --2- 172.21.15.53:0/3423837347 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7280667b0 0x7fd728068c70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0ad000 tx=0x7fd72c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:37.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.338+0000 7fd7237fe640 1 -- 172.21.15.53:0/3423837347 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd730050ea0 con 0x7fd73c0d3390 2024-09-13T18:30:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-13T18:30:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:fs subvolumegroup create [] [] [] [] [] : Create a CephFS subvolume group in a volume, and optionally, with a specific data pool layout, and a specific numeric mode 2024-09-13T18:30:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:Error EINVAL: invalid command 2024-09-13T18:30:37.528 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T18:30:37.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create testvol 'abcd@#' 2024-09-13T18:30:37.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd264ce2640 1 Processor -- start 2024-09-13T18:30:37.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd264ce2640 1 -- start start 2024-09-13T18:30:37.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd264ce2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd26015c830 0x7fd2600d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd264ce2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 0x7fd2600cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd264ce2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600b7db0 con 0x7fd2600d2c80 2024-09-13T18:30:37.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd264ce2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600d0650 con 0x7fd26015c830 2024-09-13T18:30:37.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd264ce2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600d0c10 con 0x7fd2600ccd10 2024-09-13T18:30:37.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd25e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd26015c830 0x7fd2600d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd25ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd2600d2c80 0x7fd2600b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59632/0 (socket says 172.21.15.53:59632) 2024-09-13T18:30:37.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.658+0000 7fd25ed9d640 1 -- 172.21.15.53:0/208473671 learned_addr learned my addr 172.21.15.53:0/208473671 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:37.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25dd9b640 1 --2- 172.21.15.53:0/208473671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 0x7fd2600cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25e59c640 1 -- 172.21.15.53:0/208473671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 msgr2=0x7fd2600cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:37.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25e59c640 1 --2- 172.21.15.53:0/208473671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 0x7fd2600cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25e59c640 1 -- 172.21.15.53:0/208473671 >> v1:172.21.15.53:6789/0 conn(0x7fd2600d2c80 legacy=0x7fd2600b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25d59a640 1 -- 172.21.15.53:0/208473671 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011322432 0 0) 0x7fd2600b7db0 con 0x7fd2600d2c80 2024-09-13T18:30:37.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25e59c640 1 -- 172.21.15.53:0/208473671 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600cd7d0 con 0x7fd26015c830 2024-09-13T18:30:37.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25e59c640 1 --2- 172.21.15.53:0/208473671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd26015c830 0x7fd2600d10a0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd258009d90 tx=0x7fd25801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98093ba4ac6a36a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:37.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25d59a640 1 -- 172.21.15.53:0/208473671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580a5830 con 0x7fd26015c830 2024-09-13T18:30:37.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25d59a640 1 -- 172.21.15.53:0/208473671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2580a5990 con 0x7fd26015c830 2024-09-13T18:30:37.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd25d59a640 1 -- 172.21.15.53:0/208473671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580a5d20 con 0x7fd26015c830 2024-09-13T18:30:37.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 -- 172.21.15.53:0/208473671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd26015c830 msgr2=0x7fd2600d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 --2- 172.21.15.53:0/208473671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd26015c830 0x7fd2600d10a0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd258009d90 tx=0x7fd25801c970 comp rx=0 tx=0).stop 2024-09-13T18:30:37.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 -- 172.21.15.53:0/208473671 shutdown_connections 2024-09-13T18:30:37.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 --2- 172.21.15.53:0/208473671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 0x7fd2600cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 --2- 172.21.15.53:0/208473671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd26015c830 0x7fd2600d10a0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 -- 172.21.15.53:0/208473671 >> 172.21.15.53:0/208473671 conn(0x7fd260070970 msgr2=0x7fd260070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:37.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 -- 172.21.15.53:0/208473671 shutdown_connections 2024-09-13T18:30:37.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.662+0000 7fd264ce2640 1 -- 172.21.15.53:0/208473671 wait complete. 2024-09-13T18:30:37.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 Processor -- start 2024-09-13T18:30:37.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 -- start start 2024-09-13T18:30:37.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 0x7fd2600c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2600d2c80 0x7fd2601547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd26015c830 0x7fd260154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26015b040 con 0x7fd2600d2c80 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26015cdc0 con 0x7fd26015c830 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26015d0a0 con 0x7fd2600ccd10 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2600d2c80 0x7fd2601547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2600d2c80 0x7fd2601547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43412/0 (socket says 172.21.15.53:43412) 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 -- 172.21.15.53:0/1169709552 learned_addr learned my addr 172.21.15.53:0/1169709552 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25ed9d640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd26015c830 0x7fd260154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25e59c640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 0x7fd2600c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 -- 172.21.15.53:0/1169709552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 msgr2=0x7fd2600c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2600ccd10 0x7fd2600c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 -- 172.21.15.53:0/1169709552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd26015c830 msgr2=0x7fd260154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd26015c830 0x7fd260154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:37.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 -- 172.21.15.53:0/1169709552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258009a70 con 0x7fd2600d2c80 2024-09-13T18:30:37.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd25dd9b640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2600d2c80 0x7fd2601547b0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd24800d5d0 tx=0x7fd24800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:37.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd256ffd640 1 -- 172.21.15.53:0/1169709552 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248004240 con 0x7fd2600d2c80 2024-09-13T18:30:37.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd256ffd640 1 -- 172.21.15.53:0/1169709552 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480043a0 con 0x7fd2600d2c80 2024-09-13T18:30:37.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd256ffd640 1 -- 172.21.15.53:0/1169709552 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248003840 con 0x7fd2600d2c80 2024-09-13T18:30:37.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 -- 172.21.15.53:0/1169709552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26015d380 con 0x7fd2600d2c80 2024-09-13T18:30:37.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 -- 172.21.15.53:0/1169709552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2600c8d30 con 0x7fd2600d2c80 2024-09-13T18:30:37.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.666+0000 7fd264ce2640 1 -- 172.21.15.53:0/1169709552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2600d1080 con 0x7fd2600d2c80 2024-09-13T18:30:37.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.670+0000 7fd256ffd640 1 -- 172.21.15.53:0/1169709552 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd2480039a0 con 0x7fd2600d2c80 2024-09-13T18:30:37.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.670+0000 7fd256ffd640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd2400667b0 0x7fd240068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:37.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.670+0000 7fd256ffd640 1 -- 172.21.15.53:0/1169709552 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6543+0+0 (secure 0 0 0) 0x7fd248085260 con 0x7fd2600d2c80 2024-09-13T18:30:37.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.670+0000 7fd25e59c640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd2400667b0 0x7fd240068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:37.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.670+0000 7fd25e59c640 1 --2- 172.21.15.53:0/1169709552 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd2400667b0 0x7fd240068c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2580af000 tx=0x7fd2580a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:37.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.674+0000 7fd256ffd640 1 -- 172.21.15.53:0/1169709552 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd248052260 con 0x7fd2600d2c80 2024-09-13T18:30:37.861 INFO:teuthology.orchestra.run.smithi053.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-13T18:30:37.861 INFO:teuthology.orchestra.run.smithi053.stderr:fs subvolume create [] [] [] [] [] [] [--namespace-isolated] : Create a CephFS subvolume in a volume, and optionally, with a specific size (in bytes), a specific data pool layout, a specific mode, in a specific subvolume group and in separate RADOS namespace 2024-09-13T18:30:37.862 INFO:teuthology.orchestra.run.smithi053.stderr:Error EINVAL: invalid command 2024-09-13T18:30:37.866 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T18:30:37.866 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm testvol --yes-i-really-mean-it 2024-09-13T18:30:37.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.994+0000 7f0737db2640 1 Processor -- start 2024-09-13T18:30:37.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0737db2640 1 -- start start 2024-09-13T18:30:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0737db2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0730143e80 0x7f073006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0737db2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300cda30 0x7f07300cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0737db2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073006f7a0 con 0x7f07300caee0 2024-09-13T18:30:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0737db2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073006fd60 con 0x7f0730143e80 2024-09-13T18:30:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0737db2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07300cb960 con 0x7f07300cda30 2024-09-13T18:30:38.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0735b4e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0730143e80 0x7f073006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:38.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f073534d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f07300caee0 0x7f07300cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:37710/0 (socket says 172.21.15.53:37710) 2024-09-13T18:30:38.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f073634f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300cda30 0x7f07300cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:38.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f073534d640 1 -- 172.21.15.53:0/3848427183 learned_addr learned my addr 172.21.15.53:0/3848427183 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:38.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0735b4e640 1 -- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300cda30 msgr2=0x7f07300cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:38.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0735b4e640 1 --2- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300cda30 0x7f07300cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:38.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0735b4e640 1 -- 172.21.15.53:0/3848427183 >> v1:172.21.15.87:6789/0 conn(0x7f07300caee0 legacy=0x7f07300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:38.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f0735b4e640 1 -- 172.21.15.53:0/3848427183 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300cbc40 con 0x7f0730143e80 2024-09-13T18:30:38.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:37.998+0000 7f073634f640 1 --2- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300cda30 0x7f07300cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:38.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0735b4e640 1 --2- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0730143e80 0x7f073006b390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f07200097c0 tx=0x7f072001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=598f51fbba63094f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:38.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0734b4c640 1 -- 172.21.15.53:0/3848427183 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200ab600 con 0x7f0730143e80 2024-09-13T18:30:38.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0734b4c640 1 -- 172.21.15.53:0/3848427183 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07200a7050 con 0x7f0730143e80 2024-09-13T18:30:38.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0734b4c640 1 -- 172.21.15.53:0/3848427183 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200ab980 con 0x7f0730143e80 2024-09-13T18:30:38.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0730143e80 msgr2=0x7f073006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:38.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 --2- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0730143e80 0x7f073006b390 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f07200097c0 tx=0x7f072001c350 comp rx=0 tx=0).stop 2024-09-13T18:30:38.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- 172.21.15.53:0/3848427183 shutdown_connections 2024-09-13T18:30:38.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 --2- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300cda30 0x7f07300cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:38.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 --2- 172.21.15.53:0/3848427183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0730143e80 0x7f073006b390 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:38.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- 172.21.15.53:0/3848427183 >> 172.21.15.53:0/3848427183 conn(0x7f0730065c80 msgr2=0x7f0730066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:38.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- 172.21.15.53:0/3848427183 shutdown_connections 2024-09-13T18:30:38.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- 172.21.15.53:0/3848427183 wait complete. 2024-09-13T18:30:38.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 Processor -- start 2024-09-13T18:30:38.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- start start 2024-09-13T18:30:38.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300caee0 0x7f07301415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:38.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07300cda30 0x7f07301625b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0730143e80 0x7f0730162af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0730141b00 con 0x7f0730143e80 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07300ae980 con 0x7f07300cda30 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.002+0000 7f0737db2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073015f480 con 0x7f07300caee0 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0730143e80 0x7f0730162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073534d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07300cda30 0x7f07301625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f0735b4e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300caee0 0x7f07301415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0730143e80 0x7f0730162af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43428/0 (socket says 172.21.15.53:43428) 2024-09-13T18:30:38.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 -- 172.21.15.53:0/998910503 learned_addr learned my addr 172.21.15.53:0/998910503 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 -- 172.21.15.53:0/998910503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300caee0 msgr2=0x7f07301415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300caee0 0x7f07301415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 -- 172.21.15.53:0/998910503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07300cda30 msgr2=0x7f07301625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07300cda30 0x7f07301625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 -- 172.21.15.53:0/998910503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728009a70 con 0x7f0730143e80 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f073634f640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0730143e80 0x7f0730162af0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f072800ef90 tx=0x7f072800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f07267fc640 1 -- 172.21.15.53:0/998910503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728009cd0 con 0x7f0730143e80 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f07267fc640 1 -- 172.21.15.53:0/998910503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800f040 con 0x7f0730143e80 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720009420 con 0x7f0730143e80 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f07267fc640 1 -- 172.21.15.53:0/998910503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280146a0 con 0x7f0730143e80 2024-09-13T18:30:38.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07300aeee0 con 0x7f0730143e80 2024-09-13T18:30:38.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07300cb350 con 0x7f0730143e80 2024-09-13T18:30:38.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f07267fc640 1 -- 172.21.15.53:0/998910503 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f0728014800 con 0x7f0730143e80 2024-09-13T18:30:38.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f07267fc640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07140667b0 0x7f0714068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:38.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f07267fc640 1 -- 172.21.15.53:0/998910503 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6543+0+0 (secure 0 0 0) 0x7f07280859b0 con 0x7f0730143e80 2024-09-13T18:30:38.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.006+0000 7f0735b4e640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07140667b0 0x7f0714068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:38.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.010+0000 7f0735b4e640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07140667b0 0x7f0714068c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07200ad000 tx=0x7f0720008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:38.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.010+0000 7f07267fc640 1 -- 172.21.15.53:0/998910503 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07280529e0 con 0x7f0730143e80 2024-09-13T18:30:38.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:38.198+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "testvol", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f0730070a00 con 0x7f07140667b0 2024-09-13T18:30:38.209 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:30:38.206+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:30:38.261 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:30:41.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.250+0000 7f07267fc640 1 -- 172.21.15.53:0/998910503 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+78 (secure 0 0 0) 0x7f07200ab7f0 con 0x7f07140667b0 2024-09-13T18:30:41.253 INFO:teuthology.orchestra.run.smithi053.stdout:metadata pool: cephfs.testvol.meta data pool: ['cephfs.testvol.data'] removed 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07140667b0 msgr2=0x7f0714068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07140667b0 0x7f0714068c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07200ad000 tx=0x7f0720008040 comp rx=0 tx=0).stop 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0730143e80 msgr2=0x7f0730162af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0730143e80 0x7f0730162af0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f072800ef90 tx=0x7f072800c490 comp rx=0 tx=0).stop 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 shutdown_connections 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07140667b0 0x7f0714068c70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0730143e80 0x7f0730162af0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07300cda30 0x7f07301625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 --2- 172.21.15.53:0/998910503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07300caee0 0x7f07301415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 >> 172.21.15.53:0/998910503 conn(0x7f0730065c80 msgr2=0x7f07300b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 shutdown_connections 2024-09-13T18:30:41.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.254+0000 7f0737db2640 1 -- 172.21.15.53:0/998910503 wait complete. 2024-09-13T18:30:41.278 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:30:41.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:41.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:41.429 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:30:41.429 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:41.429 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:41.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09b00b5640 1 Processor -- start 2024-09-13T18:30:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09b00b5640 1 -- start start 2024-09-13T18:30:41.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09b00b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09a815c810 0x7f09a806a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09b00b5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a815dff0 con 0x7f09a815cbf0 2024-09-13T18:30:41.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09b00b5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a815e2d0 con 0x7f09a815d9d0 2024-09-13T18:30:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09b00b5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a815dde0 con 0x7f09a815c810 2024-09-13T18:30:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09ade51640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09a815c810 0x7f09a806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09ad650640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f09a815cbf0 0x7f09a815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59636/0 (socket says 172.21.15.53:59636) 2024-09-13T18:30:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09ad650640 1 -- 172.21.15.53:0/3519681409 learned_addr learned my addr 172.21.15.53:0/3519681409 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09ade51640 1 -- 172.21.15.53:0/3519681409 >> v1:172.21.15.87:6789/0 conn(0x7f09a815d9d0 legacy=0x7f09a815f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09ade51640 1 -- 172.21.15.53:0/3519681409 >> v1:172.21.15.53:6789/0 conn(0x7f09a815cbf0 legacy=0x7f09a815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09ade51640 1 -- 172.21.15.53:0/3519681409 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a815e5b0 con 0x7f09a815c810 2024-09-13T18:30:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.614+0000 7f09ace4f640 1 -- 172.21.15.53:0/3519681409 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999453625 0 0) 0x7f09a815dff0 con 0x7f09a815cbf0 2024-09-13T18:30:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09ade51640 1 --2- 172.21.15.53:0/3519681409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815c810 0x7f09a806a740 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f09a40097c0 tx=0x7f09a401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f60dddc23c0822 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09ace4f640 1 -- 172.21.15.53:0/3519681409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a40ab600 con 0x7f09a815c810 2024-09-13T18:30:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09ace4f640 1 -- 172.21.15.53:0/3519681409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a40a7050 con 0x7f09a815c810 2024-09-13T18:30:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09ace4f640 1 -- 172.21.15.53:0/3519681409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a40ab980 con 0x7f09a815c810 2024-09-13T18:30:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- 172.21.15.53:0/3519681409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815c810 msgr2=0x7f09a806a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 --2- 172.21.15.53:0/3519681409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815c810 0x7f09a806a740 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f09a40097c0 tx=0x7f09a401c3a0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- 172.21.15.53:0/3519681409 shutdown_connections 2024-09-13T18:30:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 --2- 172.21.15.53:0/3519681409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815c810 0x7f09a806a740 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- 172.21.15.53:0/3519681409 >> 172.21.15.53:0/3519681409 conn(0x7f09a8071a50 msgr2=0x7f09a8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- 172.21.15.53:0/3519681409 shutdown_connections 2024-09-13T18:30:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- 172.21.15.53:0/3519681409 wait complete. 2024-09-13T18:30:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 Processor -- start 2024-09-13T18:30:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- start start 2024-09-13T18:30:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09a815c810 0x7f09a809e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a815cbf0 0x7f09a80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815d9d0 0x7f09a80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a809e670 con 0x7f09a815d9d0 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8153e10 con 0x7f09a815cbf0 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09b00b5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80cfbc0 con 0x7f09a815c810 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09ae652640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815d9d0 0x7f09a80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09ae652640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815d9d0 0x7f09a80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43470/0 (socket says 172.21.15.53:43470) 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.618+0000 7f09ae652640 1 -- 172.21.15.53:0/2108030880 learned_addr learned my addr 172.21.15.53:0/2108030880 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ade51640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09a815c810 0x7f09a809e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ad650640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a815cbf0 0x7f09a80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ae652640 1 -- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09a815c810 msgr2=0x7f09a809e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ae652640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09a815c810 0x7f09a809e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ae652640 1 -- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a815cbf0 msgr2=0x7f09a80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ae652640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a815cbf0 0x7f09a80cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ae652640 1 -- 172.21.15.53:0/2108030880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a4009420 con 0x7f09a815d9d0 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ade51640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09a815c810 0x7f09a809e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ad650640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a815cbf0 0x7f09a80cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ae652640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815d9d0 0x7f09a80cd230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f09a000b970 tx=0x7f09a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f099e7fc640 1 -- 172.21.15.53:0/2108030880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000cb40 con 0x7f09a815d9d0 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f099e7fc640 1 -- 172.21.15.53:0/2108030880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000cca0 con 0x7f09a815d9d0 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f099e7fc640 1 -- 172.21.15.53:0/2108030880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0014680 con 0x7f09a815d9d0 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a80cfea0 con 0x7f09a815d9d0 2024-09-13T18:30:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a80d0180 con 0x7f09a815d9d0 2024-09-13T18:30:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a81542f0 con 0x7f09a815d9d0 2024-09-13T18:30:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f099e7fc640 1 -- 172.21.15.53:0/2108030880 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f09a001d3b0 con 0x7f09a815d9d0 2024-09-13T18:30:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f099e7fc640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f098c0667b0 0x7f098c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f099e7fc640 1 -- 172.21.15.53:0/2108030880 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f09a0084230 con 0x7f09a815d9d0 2024-09-13T18:30:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ade51640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f098c0667b0 0x7f098c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.622+0000 7f09ade51640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f098c0667b0 0x7f098c068c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09a40ad000 tx=0x7f09a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.626+0000 7f099e7fc640 1 -- 172.21.15.53:0/2108030880 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09a81542f0 con 0x7f09a815d9d0 2024-09-13T18:30:41.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.790+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09a81542f0 con 0x7f09a815d9d0 2024-09-13T18:30:41.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.790+0000 7f099e7fc640 1 -- 172.21.15.53:0/2108030880 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f09a81542f0 con 0x7f09a815d9d0 2024-09-13T18:30:41.794 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:41.795 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:41.229329+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6833/3795700837":"2024-09-14T18:30:38.209515+0000","172.21.15.53:6832/3795700837":"2024-09-14T18:30:38.209515+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f098c0667b0 msgr2=0x7f098c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f098c0667b0 0x7f098c068c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09a40ad000 tx=0x7f09a4008040 comp rx=0 tx=0).stop 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815d9d0 msgr2=0x7f09a80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815d9d0 0x7f09a80cd230 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f09a000b970 tx=0x7f09a000be30 comp rx=0 tx=0).stop 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 shutdown_connections 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f098c0667b0 0x7f098c068c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09a815d9d0 0x7f09a80cd230 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09a815cbf0 0x7f09a80cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 --2- 172.21.15.53:0/2108030880 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09a815c810 0x7f09a809e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 >> 172.21.15.53:0/2108030880 conn(0x7f09a8071a50 msgr2=0x7f09a815a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:41.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 shutdown_connections 2024-09-13T18:30:41.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.794+0000 7f09b00b5640 1 -- 172.21.15.53:0/2108030880 wait complete. 2024-09-13T18:30:41.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:30:16.211649+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:30:16.801150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:41.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.946+0000 7fc99e8ea640 1 Processor -- start 2024-09-13T18:30:41.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.946+0000 7fc99e8ea640 1 -- start start 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99e8ea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc998143e80 0x7fc99806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99e8ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9980cda30 0x7fc9980cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99e8ea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99806f7a0 con 0x7fc9980caee0 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99e8ea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99806fd60 con 0x7fc9980cda30 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99e8ea640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9980cb960 con 0x7fc998143e80 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99ce87640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9980cda30 0x7fc9980cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc9977fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc9980caee0 0x7fc9980cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59652/0 (socket says 172.21.15.53:59652) 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc9977fe640 1 -- 172.21.15.53:0/1190212219 learned_addr learned my addr 172.21.15.53:0/1190212219 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc997fff640 1 --2- 172.21.15.53:0/1190212219 >> v2:172.21.15.87:3300/0 conn(0x7fc998143e80 0x7fc99806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99ce87640 1 -- 172.21.15.53:0/1190212219 >> v2:172.21.15.87:3300/0 conn(0x7fc998143e80 msgr2=0x7fc99806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:41.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99ce87640 1 --2- 172.21.15.53:0/1190212219 >> v2:172.21.15.87:3300/0 conn(0x7fc998143e80 0x7fc99806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99ce87640 1 -- 172.21.15.53:0/1190212219 >> v1:172.21.15.53:6789/0 conn(0x7fc9980caee0 legacy=0x7fc9980cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc996ffd640 1 -- 172.21.15.53:0/1190212219 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373698169 0 0) 0x7fc99806f7a0 con 0x7fc9980caee0 2024-09-13T18:30:41.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99ce87640 1 -- 172.21.15.53:0/1190212219 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9980cbc40 con 0x7fc9980cda30 2024-09-13T18:30:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc99ce87640 1 --2- 172.21.15.53:0/1190212219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9980cda30 0x7fc9980cb350 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc9980676d0 tx=0x7fc99001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4c13d1e82590b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc996ffd640 1 -- 172.21.15.53:0/1190212219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900ac640 con 0x7fc9980cda30 2024-09-13T18:30:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc996ffd640 1 -- 172.21.15.53:0/1190212219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9900ac7a0 con 0x7fc9980cda30 2024-09-13T18:30:41.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.950+0000 7fc996ffd640 1 -- 172.21.15.53:0/1190212219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900acb30 con 0x7fc9980cda30 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1190212219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9980cda30 msgr2=0x7fc9980cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1190212219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9980cda30 0x7fc9980cb350 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fc9980676d0 tx=0x7fc99001c330 comp rx=0 tx=0).stop 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1190212219 shutdown_connections 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1190212219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9980cda30 0x7fc9980cb350 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1190212219 >> v2:172.21.15.87:3300/0 conn(0x7fc998143e80 0x7fc99806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1190212219 >> 172.21.15.53:0/1190212219 conn(0x7fc998065c80 msgr2=0x7fc998066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1190212219 shutdown_connections 2024-09-13T18:30:41.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1190212219 wait complete. 2024-09-13T18:30:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 Processor -- start 2024-09-13T18:30:41.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- start start 2024-09-13T18:30:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9980caee0 0x7fc9981335e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9980cda30 0x7fc998142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc998143e80 0x7fc998159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998133b20 con 0x7fc998143e80 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99812f120 con 0x7fc9980cda30 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99e8ea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99812e510 con 0x7fc9980caee0 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc998143e80 0x7fc998159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc998143e80 0x7fc998159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43476/0 (socket says 172.21.15.53:43476) 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 -- 172.21.15.53:0/1686425934 learned_addr learned my addr 172.21.15.53:0/1686425934 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc9977fe640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9980cda30 0x7fc998142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc997fff640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9980caee0 0x7fc9981335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 -- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9980caee0 msgr2=0x7fc9981335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9980caee0 0x7fc9981335e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 -- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9980cda30 msgr2=0x7fc998142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9980cda30 0x7fc998142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.954+0000 7fc99ce87640 1 -- 172.21.15.53:0/1686425934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990009420 con 0x7fc998143e80 2024-09-13T18:30:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc99ce87640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc998143e80 0x7fc998159a30 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc9900af040 tx=0x7fc9900190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc994ff9640 1 -- 172.21.15.53:0/1686425934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900b5610 con 0x7fc998143e80 2024-09-13T18:30:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc994ff9640 1 -- 172.21.15.53:0/1686425934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9900b5790 con 0x7fc998143e80 2024-09-13T18:30:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99812e7f0 con 0x7fc998143e80 2024-09-13T18:30:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc994ff9640 1 -- 172.21.15.53:0/1686425934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900b5b40 con 0x7fc998143e80 2024-09-13T18:30:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99812edb0 con 0x7fc998143e80 2024-09-13T18:30:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9980cb350 con 0x7fc998143e80 2024-09-13T18:30:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc994ff9640 1 -- 172.21.15.53:0/1686425934 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc9900b3040 con 0x7fc998143e80 2024-09-13T18:30:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc994ff9640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc9780667e0 0x7fc978068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc994ff9640 1 -- 172.21.15.53:0/1686425934 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc99011e7a0 con 0x7fc998143e80 2024-09-13T18:30:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc997fff640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc9780667e0 0x7fc978068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.958+0000 7fc997fff640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc9780667e0 0x7fc978068ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc980003fd0 tx=0x7fc9800039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:41.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:41.962+0000 7fc994ff9640 1 -- 172.21.15.53:0/1686425934 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9900eb910 con 0x7fc998143e80 2024-09-13T18:30:42.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.122+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc99815d820 con 0x7fc998143e80 2024-09-13T18:30:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.122+0000 7fc994ff9640 1 -- 172.21.15.53:0/1686425934 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9900eef30 con 0x7fc998143e80 2024-09-13T18:30:42.125 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:42.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc9780667e0 msgr2=0x7fc978068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc9780667e0 0x7fc978068ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc980003fd0 tx=0x7fc9800039a0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc998143e80 msgr2=0x7fc998159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc998143e80 0x7fc998159a30 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fc9900af040 tx=0x7fc9900190d0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 shutdown_connections 2024-09-13T18:30:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc9780667e0 0x7fc978068ca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc998143e80 0x7fc998159a30 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9980cda30 0x7fc998142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 --2- 172.21.15.53:0/1686425934 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9980caee0 0x7fc9981335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 >> 172.21.15.53:0/1686425934 conn(0x7fc998065c80 msgr2=0x7fc9980afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 shutdown_connections 2024-09-13T18:30:42.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.126+0000 7fc99e8ea640 1 -- 172.21.15.53:0/1686425934 wait complete. 2024-09-13T18:30:42.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:30:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08d0758640 1 Processor -- start 2024-09-13T18:30:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08d0758640 1 -- start start 2024-09-13T18:30:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08d0758640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f08c80ccd10 0x7f08c80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08d0758640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80b7db0 con 0x7f08c80d2c80 2024-09-13T18:30:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08d0758640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80d0650 con 0x7f08c815c830 2024-09-13T18:30:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08d0758640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80d0c10 con 0x7f08c80ccd10 2024-09-13T18:30:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cecf5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f08c80d2c80 0x7f08c80b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59660/0 (socket says 172.21.15.53:59660) 2024-09-13T18:30:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cecf5640 1 -- 172.21.15.53:0/3077304550 learned_addr learned my addr 172.21.15.53:0/3077304550 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3077304550 >> v2:172.21.15.87:3300/0 conn(0x7f08c80ccd10 0x7f08c80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797213696 0 0) 0x7f08c80b7db0 con 0x7f08c80d2c80 2024-09-13T18:30:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b4003530 con 0x7f08c80d2c80 2024-09-13T18:30:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1299124309 0 0) 0x7f08b4003530 con 0x7f08c80d2c80 2024-09-13T18:30:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 >> v2:172.21.15.87:3300/0 conn(0x7f08c80ccd10 msgr2=0x7f08c80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 --2- 172.21.15.53:0/3077304550 >> v2:172.21.15.87:3300/0 conn(0x7f08c80ccd10 0x7f08c80cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 >> v1:172.21.15.87:6789/0 conn(0x7f08c815c830 legacy=0x7f08c80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80d17b0 con 0x7f08c80d2c80 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f08c4001a00 con 0x7f08c80d2c80 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 >> v1:172.21.15.53:6789/0 conn(0x7f08c80d2c80 legacy=0x7f08c80b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08b4003980 0x7f08b4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4005190 0x7f08b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80d0c10 con 0x7f08b40047d0 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b400c030 con 0x7f08b4005190 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b400c1f0 con 0x7f08b4003980 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cecf5640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4005190 0x7f08b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08ce4f4640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08b4003980 0x7f08b4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cdcf3640 1 -- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08b4003980 msgr2=0x7f08b4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08b4003980 0x7f08b4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cdcf3640 1 -- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4005190 msgr2=0x7f08b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08b4005190 0x7f08b400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cdcf3640 1 -- 172.21.15.53:0/3077304550 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4003530 con 0x7f08b40047d0 2024-09-13T18:30:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08cecf5640 1 -- 172.21.15.53:0/3077304550 reap_dead start 2024-09-13T18:30:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.274+0000 7f08ce4f4640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08b4003980 0x7f08b4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08b4004c50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009ae0 tx=0x7f08b801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d422eee0b2599a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80a5550 con 0x7f08b40047d0 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b80a56b0 con 0x7f08b40047d0 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08cd4f2640 1 -- 172.21.15.53:0/3077304550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80a5a60 con 0x7f08b40047d0 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08d0758640 1 -- 172.21.15.53:0/3077304550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 msgr2=0x7f08b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08d0758640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08b4004c50 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009ae0 tx=0x7f08b801ca70 comp rx=0 tx=0).stop 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08d0758640 1 -- 172.21.15.53:0/3077304550 shutdown_connections 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08d0758640 1 --2- 172.21.15.53:0/3077304550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08b4004c50 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08d0758640 1 -- 172.21.15.53:0/3077304550 >> 172.21.15.53:0/3077304550 conn(0x7f08c8070970 msgr2=0x7f08c8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08d0758640 1 -- 172.21.15.53:0/3077304550 shutdown_connections 2024-09-13T18:30:42.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.278+0000 7f08d0758640 1 -- 172.21.15.53:0/3077304550 wait complete. 2024-09-13T18:30:42.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 Processor -- start 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 -- start start 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08c8151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c815ede0 0x7f08c815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c8144980 0x7f08c8144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c815f7a0 con 0x7f08b40047d0 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8145340 con 0x7f08c8144980 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8158b00 con 0x7f08c815ede0 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08c8151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08c8151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43492/0 (socket says 172.21.15.53:43492) 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 -- 172.21.15.53:0/3614930508 learned_addr learned my addr 172.21.15.53:0/3614930508 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c815ede0 0x7f08c815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08cecf5640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c8144980 0x7f08c8144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 -- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c815ede0 msgr2=0x7f08c815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c815ede0 0x7f08c815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 -- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c8144980 msgr2=0x7f08c8144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c8144980 0x7f08c8144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 -- 172.21.15.53:0/3614930508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c81455a0 con 0x7f08b40047d0 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08ce4f4640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08c8151790 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f08c000d4d0 tx=0x7f08c000d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08beffd640 1 -- 172.21.15.53:0/3614930508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0005480 con 0x7f08b40047d0 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08beffd640 1 -- 172.21.15.53:0/3614930508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0003620 con 0x7f08b40047d0 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c81429d0 con 0x7f08b40047d0 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08beffd640 1 -- 172.21.15.53:0/3614930508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c00039d0 con 0x7f08b40047d0 2024-09-13T18:30:42.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c8142f90 con 0x7f08b40047d0 2024-09-13T18:30:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c8143120 con 0x7f08b40047d0 2024-09-13T18:30:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.282+0000 7f08beffd640 1 -- 172.21.15.53:0/3614930508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f08c0003b30 con 0x7f08b40047d0 2024-09-13T18:30:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.286+0000 7f08beffd640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f08ac0667b0 0x7f08ac068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.286+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f08ac0667b0 0x7f08ac068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.286+0000 7f08beffd640 1 -- 172.21.15.53:0/3614930508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f08c0084370 con 0x7f08b40047d0 2024-09-13T18:30:42.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.286+0000 7f08cdcf3640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f08ac0667b0 0x7f08ac068c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08b80af000 tx=0x7f08b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.290+0000 7f08beffd640 1 -- 172.21.15.53:0/3614930508 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f08c00513d0 con 0x7f08b40047d0 2024-09-13T18:30:42.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.450+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08c80cd180 con 0x7f08b40047d0 2024-09-13T18:30:42.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08beffd640 1 -- 172.21.15.53:0/3614930508 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08c00549f0 con 0x7f08b40047d0 2024-09-13T18:30:42.455 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:30:42.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f08ac0667b0 msgr2=0x7f08ac068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f08ac0667b0 0x7f08ac068c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08b80af000 tx=0x7f08b8008040 comp rx=0 tx=0).stop 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 msgr2=0x7f08c8151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08c8151790 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f08c000d4d0 tx=0x7f08c000d990 comp rx=0 tx=0).stop 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 shutdown_connections 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f08ac0667b0 0x7f08ac068c70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f08c815ede0 0x7f08c815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08c8144980 0x7f08c8144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 --2- 172.21.15.53:0/3614930508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08b40047d0 0x7f08c8151790 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 >> 172.21.15.53:0/3614930508 conn(0x7f08c8070970 msgr2=0x7f08c80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 shutdown_connections 2024-09-13T18:30:42.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.454+0000 7f08d0758640 1 -- 172.21.15.53:0/3614930508 wait complete. 2024-09-13T18:30:42.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:30:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5b4f2640 1 Processor -- start 2024-09-13T18:30:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5b4f2640 1 -- start start 2024-09-13T18:30:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5b4f2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d5415c830 0x7f9d540d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5b4f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d540cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5b4f2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d540b7db0 con 0x7f9d540d2c80 2024-09-13T18:30:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5b4f2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d540d0650 con 0x7f9d5415c830 2024-09-13T18:30:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5b4f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540d0c10 con 0x7f9d540ccd10 2024-09-13T18:30:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d58a8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d540cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d58a8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d540cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:42216/0 (socket says 172.21.15.53:42216) 2024-09-13T18:30:42.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d58a8d640 1 -- 172.21.15.53:0/518842348 learned_addr learned my addr 172.21.15.53:0/518842348 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5928e640 1 --2- 172.21.15.53:0/518842348 >> v2:172.21.15.87:3300/0 conn(0x7f9d5415c830 0x7f9d540d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5928e640 1 -- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 msgr2=0x7f9d540cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5928e640 1 --2- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d540cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5928e640 1 -- 172.21.15.53:0/518842348 >> v1:172.21.15.87:6789/0 conn(0x7f9d540d2c80 legacy=0x7f9d540b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d5928e640 1 -- 172.21.15.53:0/518842348 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540cd7d0 con 0x7f9d5415c830 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.606+0000 7f9d58a8d640 1 --2- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d540cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5928e640 1 --2- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 0x7f9d540d10a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9d500097c0 tx=0x7f9d5001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df6f25247630635 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d4bfff640 1 -- 172.21.15.53:0/518842348 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500ab600 con 0x7f9d5415c830 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d4bfff640 1 -- 172.21.15.53:0/518842348 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d500a7050 con 0x7f9d5415c830 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d4bfff640 1 -- 172.21.15.53:0/518842348 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500ab980 con 0x7f9d5415c830 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 msgr2=0x7f9d540d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 0x7f9d540d10a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9d500097c0 tx=0x7f9d5001c4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/518842348 shutdown_connections 2024-09-13T18:30:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d540cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/518842348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 0x7f9d540d10a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/518842348 >> 172.21.15.53:0/518842348 conn(0x7f9d54070970 msgr2=0x7f9d54070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/518842348 shutdown_connections 2024-09-13T18:30:42.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.610+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/518842348 wait complete. 2024-09-13T18:30:42.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 Processor -- start 2024-09-13T18:30:42.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 -- start start 2024-09-13T18:30:42.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d54150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d540d2c80 0x7f9d5414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 0x7f9d54152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54152300 con 0x7f9d540d2c80 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541528c0 con 0x7f9d5415c830 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540ca8c0 con 0x7f9d540ccd10 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d540d2c80 0x7f9d5414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d540d2c80 0x7f9d5414f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43496/0 (socket says 172.21.15.53:43496) 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 -- 172.21.15.53:0/3711967694 learned_addr learned my addr 172.21.15.53:0/3711967694 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5928e640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d54150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d59a8f640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 0x7f9d54152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 -- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 msgr2=0x7f9d54150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d54150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 -- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 msgr2=0x7f9d54152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 0x7f9d54152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 -- 172.21.15.53:0/3711967694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440094d0 con 0x7f9d540d2c80 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d58a8d640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d540d2c80 0x7f9d5414f060 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400e9b0 tx=0x7f9d4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d49ffb640 1 -- 172.21.15.53:0/3711967694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400c9a0 con 0x7f9d540d2c80 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d49ffb640 1 -- 172.21.15.53:0/3711967694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400cb00 con 0x7f9d540d2c80 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d50009420 con 0x7f9d540d2c80 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d49ffb640 1 -- 172.21.15.53:0/3711967694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44013470 con 0x7f9d540d2c80 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d540ccaf0 con 0x7f9d540d2c80 2024-09-13T18:30:42.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d540d1080 con 0x7f9d540d2c80 2024-09-13T18:30:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.614+0000 7f9d49ffb640 1 -- 172.21.15.53:0/3711967694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f9d440135d0 con 0x7f9d540d2c80 2024-09-13T18:30:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.618+0000 7f9d49ffb640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d380667b0 0x7f9d38068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.618+0000 7f9d5928e640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d380667b0 0x7f9d38068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.618+0000 7f9d49ffb640 1 -- 172.21.15.53:0/3711967694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9d440845d0 con 0x7f9d540d2c80 2024-09-13T18:30:42.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.618+0000 7f9d5928e640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d380667b0 0x7f9d38068c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d500ad000 tx=0x7f9d500a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.622+0000 7f9d49ffb640 1 -- 172.21.15.53:0/3711967694 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d440517c0 con 0x7f9d540d2c80 2024-09-13T18:30:42.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.782+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d54159e30 con 0x7f9d540d2c80 2024-09-13T18:30:42.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.782+0000 7f9d49ffb640 1 -- 172.21.15.53:0/3711967694 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d44054de0 con 0x7f9d540d2c80 2024-09-13T18:30:42.786 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d380667b0 msgr2=0x7f9d38068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d380667b0 0x7f9d38068c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d500ad000 tx=0x7f9d500a6000 comp rx=0 tx=0).stop 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d540d2c80 msgr2=0x7f9d5414f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d540d2c80 0x7f9d5414f060 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400e9b0 tx=0x7f9d4400ee70 comp rx=0 tx=0).stop 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 shutdown_connections 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d380667b0 0x7f9d38068c70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d5415c830 0x7f9d54152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d540d2c80 0x7f9d5414f060 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 --2- 172.21.15.53:0/3711967694 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d540ccd10 0x7f9d54150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 >> 172.21.15.53:0/3711967694 conn(0x7f9d54070970 msgr2=0x7f9d540b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:42.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 shutdown_connections 2024-09-13T18:30:42.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.786+0000 7f9d5b4f2640 1 -- 172.21.15.53:0/3711967694 wait complete. 2024-09-13T18:30:42.806 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:30:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd3627bc640 1 Processor -- start 2024-09-13T18:30:42.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd3627bc640 1 -- start start 2024-09-13T18:30:42.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd3627bc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd35c0b48e0 0x7fd35c0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd3627bc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c0aeb40 con 0x7fd35c15a440 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd3627bc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c0aee20 con 0x7fd35c15a820 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd3627bc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c0af100 con 0x7fd35c0b48e0 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd35c15a440 0x7fd35c0b41d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59670/0 (socket says 172.21.15.53:59670) 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35bfff640 1 -- 172.21.15.53:0/1453447617 learned_addr learned my addr 172.21.15.53:0/1453447617 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 --2- 172.21.15.53:0/1453447617 >> v2:172.21.15.87:3300/0 conn(0x7fd35c0b48e0 0x7fd35c0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049780930 0 0) 0x7fd35c0aeb40 con 0x7fd35c15a440 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd348003530 con 0x7fd35c15a440 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152525924 0 0) 0x7fd35c0aee20 con 0x7fd35c15a820 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd35c0aeb40 con 0x7fd35c15a820 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185545906 0 0) 0x7fd348003530 con 0x7fd35c15a440 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 >> v2:172.21.15.87:3300/0 conn(0x7fd35c0b48e0 msgr2=0x7fd35c0afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 --2- 172.21.15.53:0/1453447617 >> v2:172.21.15.87:3300/0 conn(0x7fd35c0b48e0 0x7fd35c0afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 >> v1:172.21.15.87:6789/0 conn(0x7fd35c15a820 legacy=0x7fd35c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c0af3e0 con 0x7fd35c15a440 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 --2- 172.21.15.53:0/1453447617 >> v2:172.21.15.87:3300/0 conn(0x7fd35c0b48e0 0x7fd35c0afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd34c001680 con 0x7fd35c15a440 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 >> v1:172.21.15.53:6789/0 conn(0x7fd35c15a440 legacy=0x7fd35c0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd348003b10 0x7fd348003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3480047d0 0x7fd348004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd34800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0af100 con 0x7fd348005190 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34800c0c0 con 0x7fd348003b10 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34800c280 con 0x7fd3480047d0 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd34800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35bfff640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd348003b10 0x7fd348003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd35b7fe640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3480047d0 0x7fd348004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 -- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3480047d0 msgr2=0x7fd348004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:42.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3480047d0 0x7fd348004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 -- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd348003b10 msgr2=0x7fd348003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:42.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd348003b10 0x7fd348003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.922+0000 7fd360d59640 1 -- 172.21.15.53:0/1453447617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348003530 con 0x7fd348005190 2024-09-13T18:30:42.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd360d59640 1 -- 172.21.15.53:0/1453447617 reap_dead start 2024-09-13T18:30:42.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd360d59640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd34800b990 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd35400e350 tx=0x7fd35401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a6bcfcc0e8d06a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3540a5e90 con 0x7fd348005190 2024-09-13T18:30:42.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35400f040 con 0x7fd348005190 2024-09-13T18:30:42.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd35affd640 1 -- 172.21.15.53:0/1453447617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354003be0 con 0x7fd348005190 2024-09-13T18:30:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd3627bc640 1 -- 172.21.15.53:0/1453447617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 msgr2=0x7fd34800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd3627bc640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd34800b990 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd35400e350 tx=0x7fd35401ce80 comp rx=0 tx=0).stop 2024-09-13T18:30:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd3627bc640 1 -- 172.21.15.53:0/1453447617 shutdown_connections 2024-09-13T18:30:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd3627bc640 1 --2- 172.21.15.53:0/1453447617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd34800b990 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd3627bc640 1 -- 172.21.15.53:0/1453447617 >> 172.21.15.53:0/1453447617 conn(0x7fd35c071a50 msgr2=0x7fd35c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd3627bc640 1 -- 172.21.15.53:0/1453447617 shutdown_connections 2024-09-13T18:30:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.926+0000 7fd3627bc640 1 -- 172.21.15.53:0/1453447617 wait complete. 2024-09-13T18:30:42.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 Processor -- start 2024-09-13T18:30:42.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 -- start start 2024-09-13T18:30:42.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd35c09ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35c144760 0x7fd35c1f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35c144be0 0x7fd35c1f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c1557d0 con 0x7fd348005190 2024-09-13T18:30:42.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c09e660 con 0x7fd35c144be0 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c154e30 con 0x7fd35c144760 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd35c09ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd35c09ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43522/0 (socket says 172.21.15.53:43522) 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 -- 172.21.15.53:0/914135711 learned_addr learned my addr 172.21.15.53:0/914135711 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd360d59640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35c144be0 0x7fd35c1f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35b7fe640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35c144760 0x7fd35c1f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 -- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35c144760 msgr2=0x7fd35c1f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35c144760 0x7fd35c1f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 -- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35c144be0 msgr2=0x7fd35c1f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35c144be0 0x7fd35c1f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 -- 172.21.15.53:0/914135711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c155110 con 0x7fd348005190 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35b7fe640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35c144760 0x7fd35c1f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:42.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd360d59640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35c144be0 0x7fd35c1f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd35bfff640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd35c09ddd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e550 tx=0x7fd34c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd358ff9640 1 -- 172.21.15.53:0/914135711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c012590 con 0x7fd348005190 2024-09-13T18:30:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd358ff9640 1 -- 172.21.15.53:0/914135711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0126f0 con 0x7fd348005190 2024-09-13T18:30:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c1553f0 con 0x7fd348005190 2024-09-13T18:30:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd358ff9640 1 -- 172.21.15.53:0/914135711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c012aa0 con 0x7fd348005190 2024-09-13T18:30:42.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c155bf0 con 0x7fd348005190 2024-09-13T18:30:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35c155910 con 0x7fd348005190 2024-09-13T18:30:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.930+0000 7fd358ff9640 1 -- 172.21.15.53:0/914135711 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd34c012c00 con 0x7fd348005190 2024-09-13T18:30:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.934+0000 7fd358ff9640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd33c0667b0 0x7fd33c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.934+0000 7fd358ff9640 1 -- 172.21.15.53:0/914135711 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd34c0840d0 con 0x7fd348005190 2024-09-13T18:30:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.934+0000 7fd35b7fe640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd33c0667b0 0x7fd33c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:42.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.934+0000 7fd35b7fe640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd33c0667b0 0x7fd33c068c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd344005630 tx=0x7fd344009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:42.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:42.938+0000 7fd358ff9640 1 -- 172.21.15.53:0/914135711 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd34c051360 con 0x7fd348005190 2024-09-13T18:30:43.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.106+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd35c0afc10 con 0x7fd348005190 2024-09-13T18:30:43.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.106+0000 7fd358ff9640 1 -- 172.21.15.53:0/914135711 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v94) v1 ==== 80+0+122 (secure 0 0 0) 0x7fd34c054980 con 0x7fd348005190 2024-09-13T18:30:43.110 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6833/3795700837 2024-09-14T18:30:38.209515+0000 2024-09-13T18:30:43.110 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6832/3795700837 2024-09-14T18:30:38.209515+0000 2024-09-13T18:30:43.110 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2024-09-13T18:30:43.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd33c0667b0 msgr2=0x7fd33c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd33c0667b0 0x7fd33c068c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd344005630 tx=0x7fd344009040 comp rx=0 tx=0).stop 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 msgr2=0x7fd35c09ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd35c09ddd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e550 tx=0x7fd34c00ea10 comp rx=0 tx=0).stop 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 shutdown_connections 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd33c0667b0 0x7fd33c068c70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd35c144760 0x7fd35c1f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd35c144be0 0x7fd35c1f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 --2- 172.21.15.53:0/914135711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd348005190 0x7fd35c09ddd0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 >> 172.21.15.53:0/914135711 conn(0x7fd35c071a50 msgr2=0x7fd35c0b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 shutdown_connections 2024-09-13T18:30:43.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.110+0000 7fd3627bc640 1 -- 172.21.15.53:0/914135711 wait complete. 2024-09-13T18:30:43.128 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:30:43.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:43.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:30:43.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[47380]: fuse finished with error 0 and tester_r 0 2024-09-13T18:30:43.141 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:30:43.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:43.142 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:30:43.272 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:43.272 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:43.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:43.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.398+0000 7f171bd12640 1 Processor -- start 2024-09-13T18:30:43.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.398+0000 7f171bd12640 1 -- start start 2024-09-13T18:30:43.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f171bd12640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17141582a0 0x7f171406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f171bd12640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f171415b7c0 0x7f171406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f171bd12640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171406d480 con 0x7f1714070c90 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f171bd12640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171415aaf0 con 0x7f17141582a0 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f171bd12640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171406d760 con 0x7f171415b7c0 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f1719aae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17141582a0 0x7f171406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f1719aae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17141582a0 0x7f171406c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43538/0 (socket says 172.21.15.53:43538) 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f1719aae640 1 -- 172.21.15.53:0/1700376156 learned_addr learned my addr 172.21.15.53:0/1700376156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f17192ad640 1 --2- 172.21.15.53:0/1700376156 >> v2:172.21.15.87:3300/0 conn(0x7f171415b7c0 0x7f171406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f1719aae640 1 -- 172.21.15.53:0/1700376156 >> v2:172.21.15.87:3300/0 conn(0x7f171415b7c0 msgr2=0x7f171406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f1719aae640 1 --2- 172.21.15.53:0/1700376156 >> v2:172.21.15.87:3300/0 conn(0x7f171415b7c0 0x7f171406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f1719aae640 1 -- 172.21.15.53:0/1700376156 >> v1:172.21.15.87:6789/0 conn(0x7f1714070c90 legacy=0x7f171406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.402+0000 7f1719aae640 1 -- 172.21.15.53:0/1700376156 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171415ace0 con 0x7f17141582a0 2024-09-13T18:30:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f1719aae640 1 --2- 172.21.15.53:0/1700376156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17141582a0 0x7f171406c900 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f17140ce220 tx=0x7f171001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbb88754f0c6246 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f1718aac640 1 -- 172.21.15.53:0/1700376156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100ab5f0 con 0x7f17141582a0 2024-09-13T18:30:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f1718aac640 1 -- 172.21.15.53:0/1700376156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17100ab750 con 0x7f17141582a0 2024-09-13T18:30:43.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f1718aac640 1 -- 172.21.15.53:0/1700376156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100abae0 con 0x7f17141582a0 2024-09-13T18:30:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- 172.21.15.53:0/1700376156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17141582a0 msgr2=0x7f171406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 --2- 172.21.15.53:0/1700376156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17141582a0 0x7f171406c900 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f17140ce220 tx=0x7f171001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- 172.21.15.53:0/1700376156 shutdown_connections 2024-09-13T18:30:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 --2- 172.21.15.53:0/1700376156 >> v2:172.21.15.87:3300/0 conn(0x7f171415b7c0 0x7f171406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 --2- 172.21.15.53:0/1700376156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17141582a0 0x7f171406c900 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- 172.21.15.53:0/1700376156 >> 172.21.15.53:0/1700376156 conn(0x7f1714065c80 msgr2=0x7f1714066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- 172.21.15.53:0/1700376156 shutdown_connections 2024-09-13T18:30:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- 172.21.15.53:0/1700376156 wait complete. 2024-09-13T18:30:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 Processor -- start 2024-09-13T18:30:43.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- start start 2024-09-13T18:30:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1714070c90 0x7f17140b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17141582a0 0x7f171414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f171415b7c0 0x7f1714154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17140b1d90 con 0x7f171415b7c0 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17140b2070 con 0x7f1714070c90 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171bd12640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17140b2350 con 0x7f17141582a0 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171a2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f171415b7c0 0x7f1714154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171a2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f171415b7c0 0x7f1714154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43544/0 (socket says 172.21.15.53:43544) 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171a2af640 1 -- 172.21.15.53:0/3593814216 learned_addr learned my addr 172.21.15.53:0/3593814216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f1719aae640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1714070c90 0x7f17140b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f17192ad640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17141582a0 0x7f171414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171a2af640 1 -- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17141582a0 msgr2=0x7f171414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171a2af640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17141582a0 0x7f171414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171a2af640 1 -- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1714070c90 msgr2=0x7f17140b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.406+0000 7f171a2af640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1714070c90 0x7f17140b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f171a2af640 1 -- 172.21.15.53:0/3593814216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100094d0 con 0x7f171415b7c0 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f171a2af640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f171415b7c0 0x7f1714154f30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c770 tx=0x7f170c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f170a7fc640 1 -- 172.21.15.53:0/3593814216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c003b80 con 0x7f171415b7c0 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f170a7fc640 1 -- 172.21.15.53:0/3593814216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c003ce0 con 0x7f171415b7c0 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f170a7fc640 1 -- 172.21.15.53:0/3593814216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00aa90 con 0x7f171415b7c0 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17140b2630 con 0x7f171415b7c0 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171414b1c0 con 0x7f171415b7c0 2024-09-13T18:30:43.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1714067400 con 0x7f171415b7c0 2024-09-13T18:30:43.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f170a7fc640 1 -- 172.21.15.53:0/3593814216 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f170c00abf0 con 0x7f171415b7c0 2024-09-13T18:30:43.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f170a7fc640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f16f80667b0 0x7f16f8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f1719aae640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f16f80667b0 0x7f16f8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f170a7fc640 1 -- 172.21.15.53:0/3593814216 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f170c0842d0 con 0x7f171415b7c0 2024-09-13T18:30:43.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.410+0000 7f1719aae640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f16f80667b0 0x7f16f8068c70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f17100af000 tx=0x7f17100a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:43.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.414+0000 7f170a7fc640 1 -- 172.21.15.53:0/3593814216 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f170c051430 con 0x7f171415b7c0 2024-09-13T18:30:43.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.574+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17140b2b50 con 0x7f171415b7c0 2024-09-13T18:30:43.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f170a7fc640 1 -- 172.21.15.53:0/3593814216 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f17140b2b50 con 0x7f171415b7c0 2024-09-13T18:30:43.579 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:43.579 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:41.229329+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6833/3795700837":"2024-09-14T18:30:38.209515+0000","172.21.15.53:6832/3795700837":"2024-09-14T18:30:38.209515+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:43.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f16f80667b0 msgr2=0x7f16f8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f16f80667b0 0x7f16f8068c70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f17100af000 tx=0x7f17100a7000 comp rx=0 tx=0).stop 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f171415b7c0 msgr2=0x7f1714154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f171415b7c0 0x7f1714154f30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c770 tx=0x7f170c00cc30 comp rx=0 tx=0).stop 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 shutdown_connections 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f16f80667b0 0x7f16f8068c70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17141582a0 0x7f171414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f171415b7c0 0x7f1714154f30 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 --2- 172.21.15.53:0/3593814216 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1714070c90 0x7f17140b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 >> 172.21.15.53:0/3593814216 conn(0x7f1714065c80 msgr2=0x7f17140af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 shutdown_connections 2024-09-13T18:30:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.578+0000 7f171bd12640 1 -- 172.21.15.53:0/3593814216 wait complete. 2024-09-13T18:30:43.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:30:16.211649+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:30:16.801150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:43.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:43.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 Processor -- start 2024-09-13T18:30:43.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 -- start start 2024-09-13T18:30:43.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6acc06bdd0 0x7f6acc0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6acc0cb670 0x7f6acc0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0b2d30 0x7f6acc06c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6acc0b23d0 con 0x7f6acc06bdd0 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6acc0b31c0 con 0x7f6acc0cb670 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad26af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc160ed0 con 0x7f6acc0b2d30 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6acc06bdd0 0x7f6acc0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6acc06bdd0 0x7f6acc0cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43558/0 (socket says 172.21.15.53:43558) 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 -- 172.21.15.53:0/2349357364 learned_addr learned my addr 172.21.15.53:0/2349357364 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acb7fe640 1 --2- 172.21.15.53:0/2349357364 >> v2:172.21.15.87:3300/0 conn(0x7f6acc0cb670 0x7f6acc0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad0c4c640 1 --2- 172.21.15.53:0/2349357364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0b2d30 0x7f6acc06c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 -- 172.21.15.53:0/2349357364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0b2d30 msgr2=0x7f6acc06c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 --2- 172.21.15.53:0/2349357364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0b2d30 0x7f6acc06c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 -- 172.21.15.53:0/2349357364 >> v2:172.21.15.87:3300/0 conn(0x7f6acc0cb670 msgr2=0x7f6acc0b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 --2- 172.21.15.53:0/2349357364 >> v2:172.21.15.87:3300/0 conn(0x7f6acc0cb670 0x7f6acc0b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6acbfff640 1 -- 172.21.15.53:0/2349357364 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0b1500 con 0x7f6acc06bdd0 2024-09-13T18:30:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.726+0000 7f6ad0c4c640 1 --2- 172.21.15.53:0/2349357364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0b2d30 0x7f6acc06c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acbfff640 1 --2- 172.21.15.53:0/2349357364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc06bdd0 0x7f6acc0cb130 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0ce310 tx=0x7f6ac401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8434c1e936a561a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acaffd640 1 -- 172.21.15.53:0/2349357364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40a5780 con 0x7f6acc06bdd0 2024-09-13T18:30:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acaffd640 1 -- 172.21.15.53:0/2349357364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc06d700 con 0x7f6acc06bdd0 2024-09-13T18:30:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acaffd640 1 -- 172.21.15.53:0/2349357364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40a5b00 con 0x7f6acc06bdd0 2024-09-13T18:30:43.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- 172.21.15.53:0/2349357364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc06bdd0 msgr2=0x7f6acc0cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 --2- 172.21.15.53:0/2349357364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc06bdd0 0x7f6acc0cb130 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0ce310 tx=0x7f6ac401c9f0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- 172.21.15.53:0/2349357364 shutdown_connections 2024-09-13T18:30:43.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 --2- 172.21.15.53:0/2349357364 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0b2d30 0x7f6acc06c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 --2- 172.21.15.53:0/2349357364 >> v2:172.21.15.87:3300/0 conn(0x7f6acc0cb670 0x7f6acc0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 --2- 172.21.15.53:0/2349357364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc06bdd0 0x7f6acc0cb130 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- 172.21.15.53:0/2349357364 >> 172.21.15.53:0/2349357364 conn(0x7f6acc065c80 msgr2=0x7f6acc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:43.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- 172.21.15.53:0/2349357364 shutdown_connections 2024-09-13T18:30:43.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- 172.21.15.53:0/2349357364 wait complete. 2024-09-13T18:30:43.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 Processor -- start 2024-09-13T18:30:43.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- start start 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc06bdd0 0x7f6acc14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc0b2d30 0x7f6acc0a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0cb670 0x7f6acc0aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0a8c80 con 0x7f6acc0b2d30 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0a8f60 con 0x7f6acc06bdd0 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad26af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0a9240 con 0x7f6acc0cb670 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc0b2d30 0x7f6acc0a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc0b2d30 0x7f6acc0a9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43566/0 (socket says 172.21.15.53:43566) 2024-09-13T18:30:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 -- 172.21.15.53:0/1475872537 learned_addr learned my addr 172.21.15.53:0/1475872537 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acbfff640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc06bdd0 0x7f6acc14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6ad0c4c640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0cb670 0x7f6acc0aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 -- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0cb670 msgr2=0x7f6acc0aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0cb670 0x7f6acc0aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 -- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc06bdd0 msgr2=0x7f6acc14c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc06bdd0 0x7f6acc14c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.730+0000 7f6acb7fe640 1 -- 172.21.15.53:0/1475872537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4009b30 con 0x7f6acc0b2d30 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6acb7fe640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc0b2d30 0x7f6acc0a9d20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d5f0 tx=0x7f6ac000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ac8ff9640 1 -- 172.21.15.53:0/1475872537 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00125f0 con 0x7f6acc0b2d30 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ac8ff9640 1 -- 172.21.15.53:0/1475872537 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac0012750 con 0x7f6acc0b2d30 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc0a9520 con 0x7f6acc0b2d30 2024-09-13T18:30:43.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ac8ff9640 1 -- 172.21.15.53:0/1475872537 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0012ae0 con 0x7f6acc0b2d30 2024-09-13T18:30:43.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc0ad3d0 con 0x7f6acc0b2d30 2024-09-13T18:30:43.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc06d410 con 0x7f6acc0b2d30 2024-09-13T18:30:43.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ac8ff9640 1 -- 172.21.15.53:0/1475872537 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f6ac0012c40 con 0x7f6acc0b2d30 2024-09-13T18:30:43.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ac8ff9640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6ab80667e0 0x7f6ab8068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:43.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6ac8ff9640 1 -- 172.21.15.53:0/1475872537 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6ac00847a0 con 0x7f6acc0b2d30 2024-09-13T18:30:43.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6acbfff640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6ab80667e0 0x7f6ab8068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:43.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.734+0000 7f6acbfff640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6ab80667e0 0x7f6ab8068ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40ae000 tx=0x7f6ac40a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:43.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.738+0000 7f6ac8ff9640 1 -- 172.21.15.53:0/1475872537 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ac0051a30 con 0x7f6acc0b2d30 2024-09-13T18:30:43.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.894+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6acc070760 con 0x7f6acc0b2d30 2024-09-13T18:30:43.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.894+0000 7f6ac8ff9640 1 -- 172.21.15.53:0/1475872537 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ac0055050 con 0x7f6acc0b2d30 2024-09-13T18:30:43.899 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6ab80667e0 msgr2=0x7f6ab8068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6ab80667e0 0x7f6ab8068ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40ae000 tx=0x7f6ac40a7070 comp rx=0 tx=0).stop 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc0b2d30 msgr2=0x7f6acc0a9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc0b2d30 0x7f6acc0a9d20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000d5f0 tx=0x7f6ac000dab0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 shutdown_connections 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6ab80667e0 0x7f6ab8068ca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6acc0cb670 0x7f6acc0aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6acc0b2d30 0x7f6acc0a9d20 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 --2- 172.21.15.53:0/1475872537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc06bdd0 0x7f6acc14c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:43.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 >> 172.21.15.53:0/1475872537 conn(0x7f6acc065c80 msgr2=0x7f6acc0cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:43.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 shutdown_connections 2024-09-13T18:30:43.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:43.898+0000 7f6ad26af640 1 -- 172.21.15.53:0/1475872537 wait complete. 2024-09-13T18:30:43.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:30:44.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff74a3c640 1 Processor -- start 2024-09-13T18:30:44.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff74a3c640 1 -- start start 2024-09-13T18:30:44.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff74a3c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff70143e80 0x7eff7006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff74a3c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff700cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff74a3c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7006f7a0 con 0x7eff700caee0 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff74a3c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7006fd60 con 0x7eff70143e80 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff74a3c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff700cb960 con 0x7eff700cda30 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6ed9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff700cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6dd9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7eff700caee0 0x7eff700cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:37782/0 (socket says 172.21.15.53:37782) 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6e59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff70143e80 0x7eff7006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6dd9b640 1 -- 172.21.15.53:0/1998200370 learned_addr learned my addr 172.21.15.53:0/1998200370 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6ed9d640 1 -- 172.21.15.53:0/1998200370 >> v2:172.21.15.87:3300/0 conn(0x7eff70143e80 msgr2=0x7eff7006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6ed9d640 1 --2- 172.21.15.53:0/1998200370 >> v2:172.21.15.87:3300/0 conn(0x7eff70143e80 0x7eff7006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6ed9d640 1 -- 172.21.15.53:0/1998200370 >> v1:172.21.15.87:6789/0 conn(0x7eff700caee0 legacy=0x7eff700cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.038+0000 7eff6ed9d640 1 -- 172.21.15.53:0/1998200370 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700cbc40 con 0x7eff700cda30 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff6ed9d640 1 --2- 172.21.15.53:0/1998200370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff700cb350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff68009d90 tx=0x7eff6801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ded9a24fc904084 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff6d59a640 1 -- 172.21.15.53:0/1998200370 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680a58c0 con 0x7eff700cda30 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff6d59a640 1 -- 172.21.15.53:0/1998200370 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff680a5a20 con 0x7eff700cda30 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff6d59a640 1 -- 172.21.15.53:0/1998200370 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680a5db0 con 0x7eff700cda30 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- 172.21.15.53:0/1998200370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 msgr2=0x7eff700cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 --2- 172.21.15.53:0/1998200370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff700cb350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff68009d90 tx=0x7eff6801c820 comp rx=0 tx=0).stop 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- 172.21.15.53:0/1998200370 shutdown_connections 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 --2- 172.21.15.53:0/1998200370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff700cb350 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 --2- 172.21.15.53:0/1998200370 >> v2:172.21.15.87:3300/0 conn(0x7eff70143e80 0x7eff7006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- 172.21.15.53:0/1998200370 >> 172.21.15.53:0/1998200370 conn(0x7eff70065c80 msgr2=0x7eff70066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- 172.21.15.53:0/1998200370 shutdown_connections 2024-09-13T18:30:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- 172.21.15.53:0/1998200370 wait complete. 2024-09-13T18:30:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 Processor -- start 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- start start 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff700caee0 0x7eff700aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff701f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff70143e80 0x7eff701416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff70141c20 con 0x7eff700caee0 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700af1a0 con 0x7eff70143e80 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.042+0000 7eff74a3c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff700af480 con 0x7eff700cda30 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff700caee0 0x7eff700aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff700caee0 0x7eff700aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43568/0 (socket says 172.21.15.53:43568) 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 -- 172.21.15.53:0/3877518157 learned_addr learned my addr 172.21.15.53:0/3877518157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6ed9d640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff70143e80 0x7eff701416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6dd9b640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff701f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 -- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 msgr2=0x7eff701f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff701f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 -- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff70143e80 msgr2=0x7eff701416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff70143e80 0x7eff701416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 -- 172.21.15.53:0/3877518157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68009a70 con 0x7eff700caee0 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6e59c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff700caee0 0x7eff700aebc0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7eff6000e870 tx=0x7eff6000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff5effd640 1 -- 172.21.15.53:0/3877518157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60009510 con 0x7eff700caee0 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff700af760 con 0x7eff700caee0 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff5effd640 1 -- 172.21.15.53:0/3877518157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6000eec0 con 0x7eff700caee0 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff5effd640 1 -- 172.21.15.53:0/3877518157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6000cb40 con 0x7eff700caee0 2024-09-13T18:30:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff700afd20 con 0x7eff700caee0 2024-09-13T18:30:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff700cb350 con 0x7eff700caee0 2024-09-13T18:30:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff5effd640 1 -- 172.21.15.53:0/3877518157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7eff6000ccc0 con 0x7eff700caee0 2024-09-13T18:30:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff5effd640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff500667b0 0x7eff50068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff5effd640 1 -- 172.21.15.53:0/3877518157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7eff60084410 con 0x7eff700caee0 2024-09-13T18:30:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6dd9b640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff500667b0 0x7eff50068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.046+0000 7eff6dd9b640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff500667b0 0x7eff50068c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff700684b0 tx=0x7eff64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.050+0000 7eff5effd640 1 -- 172.21.15.53:0/3877518157 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff60051630 con 0x7eff700caee0 2024-09-13T18:30:44.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.206+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff700b34a0 con 0x7eff700caee0 2024-09-13T18:30:44.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.206+0000 7eff5effd640 1 -- 172.21.15.53:0/3877518157 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff60054c50 con 0x7eff700caee0 2024-09-13T18:30:44.210 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff500667b0 msgr2=0x7eff50068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff500667b0 0x7eff50068c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff700684b0 tx=0x7eff64009040 comp rx=0 tx=0).stop 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff700caee0 msgr2=0x7eff700aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff700caee0 0x7eff700aebc0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7eff6000e870 tx=0x7eff6000ec70 comp rx=0 tx=0).stop 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 shutdown_connections 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff500667b0 0x7eff50068c70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff700cda30 0x7eff701f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff70143e80 0x7eff701416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 --2- 172.21.15.53:0/3877518157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff700caee0 0x7eff700aebc0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 >> 172.21.15.53:0/3877518157 conn(0x7eff70065c80 msgr2=0x7eff7015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:44.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 shutdown_connections 2024-09-13T18:30:44.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.210+0000 7eff74a3c640 1 -- 172.21.15.53:0/3877518157 wait complete. 2024-09-13T18:30:44.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:30:44.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b30b2a640 1 Processor -- start 2024-09-13T18:30:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b30b2a640 1 -- start start 2024-09-13T18:30:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b30b2a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5b2c143f80 0x7f5b2c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b30b2a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b2c06c990 0x7f5b2c065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b30b2a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c066600 con 0x7f5b2c0661c0 2024-09-13T18:30:44.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b30b2a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c144360 con 0x7f5b2c143f80 2024-09-13T18:30:44.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b30b2a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c15baa0 con 0x7f5b2c06c990 2024-09-13T18:30:44.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5b2c0661c0 0x7f5b2c070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59682/0 (socket says 172.21.15.53:59682) 2024-09-13T18:30:44.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 -- 172.21.15.53:0/521999769 learned_addr learned my addr 172.21.15.53:0/521999769 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b29d9b640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b2c06c990 0x7f5b2c065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2a59c640 1 --2- 172.21.15.53:0/521999769 >> v2:172.21.15.87:3300/0 conn(0x7f5b2c143f80 0x7f5b2c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925593012 0 0) 0x7f5b2c066600 con 0x7f5b2c0661c0 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b14003530 con 0x7f5b2c0661c0 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2103109746 0 0) 0x7f5b14003530 con 0x7f5b2c0661c0 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b2c06c990 msgr2=0x7f5b2c065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b2c06c990 0x7f5b2c065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 >> v2:172.21.15.87:3300/0 conn(0x7f5b2c143f80 msgr2=0x7f5b2c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 --2- 172.21.15.53:0/521999769 >> v2:172.21.15.87:3300/0 conn(0x7f5b2c143f80 0x7f5b2c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c06d170 con 0x7f5b2c0661c0 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5b24001a00 con 0x7f5b2c0661c0 2024-09-13T18:30:44.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 >> v1:172.21.15.53:6789/0 conn(0x7f5b2c0661c0 legacy=0x7f5b2c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b14003980 0x7f5b14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b2c06c990 0x7f5b140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b14004d10 0x7f5b14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c144360 con 0x7f5b14004d10 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c15baa0 con 0x7f5b14003980 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1400b990 con 0x7f5b2c06c990 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b14004d10 0x7f5b14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2a59c640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b14003980 0x7f5b14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 -- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b2c06c990 msgr2=0x7f5b140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b2c06c990 0x7f5b140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 -- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b14003980 msgr2=0x7f5b14003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b14003980 0x7f5b14003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.342+0000 7f5b2ad9d640 1 -- 172.21.15.53:0/521999769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14003530 con 0x7f5b14004d10 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b2ad9d640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b14004d10 0x7f5b14005190 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400a850 tx=0x7f5b2401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda430b6d6679035 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240ad630 con 0x7f5b14004d10 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b240a8070 con 0x7f5b14004d10 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b2959a640 1 -- 172.21.15.53:0/521999769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240ad9d0 con 0x7f5b14004d10 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- 172.21.15.53:0/521999769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b14004d10 msgr2=0x7f5b14005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 --2- 172.21.15.53:0/521999769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b14004d10 0x7f5b14005190 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400a850 tx=0x7f5b2401d3a0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b2ad9d640 1 -- 172.21.15.53:0/521999769 reap_dead start 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- 172.21.15.53:0/521999769 shutdown_connections 2024-09-13T18:30:44.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- 172.21.15.53:0/521999769 >> 172.21.15.53:0/521999769 conn(0x7f5b2c0b1310 msgr2=0x7f5b2c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:44.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- 172.21.15.53:0/521999769 shutdown_connections 2024-09-13T18:30:44.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- 172.21.15.53:0/521999769 wait complete. 2024-09-13T18:30:44.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 Processor -- start 2024-09-13T18:30:44.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- start start 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b14004d10 0x7f5b2c0ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c1404c0 0x7f5b2c140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2c0abec0 0x7f5b2c0ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c12edd0 con 0x7f5b2c1404c0 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c140fb0 con 0x7f5b2c0abec0 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b30b2a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c141290 con 0x7f5b14004d10 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.346+0000 7f5b29d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c1404c0 0x7f5b2c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c1404c0 0x7f5b2c140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43586/0 (socket says 172.21.15.53:43586) 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 -- 172.21.15.53:0/2378007403 learned_addr learned my addr 172.21.15.53:0/2378007403 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:44.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b2a59c640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b14004d10 0x7f5b2c0ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 -- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b14004d10 msgr2=0x7f5b2c0ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b14004d10 0x7f5b2c0ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 -- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2c0abec0 msgr2=0x7f5b2c0ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b2ad9d640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2c0abec0 0x7f5b2c0ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2c0abec0 0x7f5b2c0ac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 -- 172.21.15.53:0/2378007403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c141570 con 0x7f5b2c1404c0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b29d9b640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c1404c0 0x7f5b2c140940 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000e7c0 tx=0x7f5b2000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b1affd640 1 -- 172.21.15.53:0/2378007403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000eed0 con 0x7f5b2c1404c0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b1affd640 1 -- 172.21.15.53:0/2378007403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000c860 con 0x7f5b2c1404c0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c141850 con 0x7f5b2c1404c0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b1affd640 1 -- 172.21.15.53:0/2378007403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2000cbf0 con 0x7f5b2c1404c0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c0ac880 con 0x7f5b2c1404c0 2024-09-13T18:30:44.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c12ef10 con 0x7f5b2c1404c0 2024-09-13T18:30:44.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b1affd640 1 -- 172.21.15.53:0/2378007403 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f5b2000cd50 con 0x7f5b2c1404c0 2024-09-13T18:30:44.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b1affd640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b0c0667b0 0x7f5b0c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b1affd640 1 -- 172.21.15.53:0/2378007403 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5b200848f0 con 0x7f5b2c1404c0 2024-09-13T18:30:44.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b2a59c640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b0c0667b0 0x7f5b0c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.350+0000 7f5b2a59c640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b0c0667b0 0x7f5b0c068c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009ab0 tx=0x7f5b1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.354+0000 7f5b1affd640 1 -- 172.21.15.53:0/2378007403 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b20051c60 con 0x7f5b2c1404c0 2024-09-13T18:30:44.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.506+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b2c12ef10 con 0x7f5b2c1404c0 2024-09-13T18:30:44.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.506+0000 7f5b1affd640 1 -- 172.21.15.53:0/2378007403 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b2c12ef10 con 0x7f5b2c1404c0 2024-09-13T18:30:44.509 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:30:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b0c0667b0 msgr2=0x7f5b0c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b0c0667b0 0x7f5b0c068c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009ab0 tx=0x7f5b1c008040 comp rx=0 tx=0).stop 2024-09-13T18:30:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c1404c0 msgr2=0x7f5b2c140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c1404c0 0x7f5b2c140940 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000e7c0 tx=0x7f5b2000ec80 comp rx=0 tx=0).stop 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 shutdown_connections 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5b0c0667b0 0x7f5b0c068c70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b2c0abec0 0x7f5b2c0ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b2c1404c0 0x7f5b2c140940 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 --2- 172.21.15.53:0/2378007403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b14004d10 0x7f5b2c0ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 >> 172.21.15.53:0/2378007403 conn(0x7f5b2c0b1310 msgr2=0x7f5b2c069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 shutdown_connections 2024-09-13T18:30:44.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.510+0000 7f5b30b2a640 1 -- 172.21.15.53:0/2378007403 wait complete. 2024-09-13T18:30:44.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:30:44.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4367734640 1 Processor -- start 2024-09-13T18:30:44.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4367734640 1 -- start start 2024-09-13T18:30:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4367734640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f436015b7c0 0x7f4360070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4367734640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f43601640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4367734640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436006d480 con 0x7f43601582a0 2024-09-13T18:30:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4367734640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436015aaf0 con 0x7f436015b7c0 2024-09-13T18:30:44.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4367734640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436006d760 con 0x7f43600711d0 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4365cd1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f43601640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f4364ccf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f436015b7c0 0x7f4360070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f43654d0640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f43601582a0 0x7f436006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:37798/0 (socket says 172.21.15.53:37798) 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.638+0000 7f43654d0640 1 -- 172.21.15.53:0/2561698552 learned_addr learned my addr 172.21.15.53:0/2561698552 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4365cd1640 1 -- 172.21.15.53:0/2561698552 >> v2:172.21.15.87:3300/0 conn(0x7f436015b7c0 msgr2=0x7f4360070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4365cd1640 1 --2- 172.21.15.53:0/2561698552 >> v2:172.21.15.87:3300/0 conn(0x7f436015b7c0 0x7f4360070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4365cd1640 1 -- 172.21.15.53:0/2561698552 >> v1:172.21.15.87:6789/0 conn(0x7f43601582a0 legacy=0x7f436006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4365cd1640 1 -- 172.21.15.53:0/2561698552 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436015ace0 con 0x7f43600711d0 2024-09-13T18:30:44.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4364ccf640 1 --2- 172.21.15.53:0/2561698552 >> v2:172.21.15.87:3300/0 conn(0x7f436015b7c0 0x7f4360070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:44.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4365cd1640 1 --2- 172.21.15.53:0/2561698552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f43601640f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4358009d90 tx=0x7f435801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c5da2ec7da3b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4357fff640 1 -- 172.21.15.53:0/2561698552 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580a5920 con 0x7f43600711d0 2024-09-13T18:30:44.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4357fff640 1 -- 172.21.15.53:0/2561698552 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43580a5a80 con 0x7f43600711d0 2024-09-13T18:30:44.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4357fff640 1 -- 172.21.15.53:0/2561698552 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580a5e10 con 0x7f43600711d0 2024-09-13T18:30:44.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 -- 172.21.15.53:0/2561698552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 msgr2=0x7f43601640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 --2- 172.21.15.53:0/2561698552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f43601640f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4358009d90 tx=0x7f435801c970 comp rx=0 tx=0).stop 2024-09-13T18:30:44.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 -- 172.21.15.53:0/2561698552 shutdown_connections 2024-09-13T18:30:44.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 --2- 172.21.15.53:0/2561698552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f43601640f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 --2- 172.21.15.53:0/2561698552 >> v2:172.21.15.87:3300/0 conn(0x7f436015b7c0 0x7f4360070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 -- 172.21.15.53:0/2561698552 >> 172.21.15.53:0/2561698552 conn(0x7f4360065c80 msgr2=0x7f4360066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:44.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 -- 172.21.15.53:0/2561698552 shutdown_connections 2024-09-13T18:30:44.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.642+0000 7f4367734640 1 -- 172.21.15.53:0/2561698552 wait complete. 2024-09-13T18:30:44.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 Processor -- start 2024-09-13T18:30:44.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 -- start start 2024-09-13T18:30:44.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f436014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43601582a0 0x7f4360138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f436015b7c0 0x7f43600a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601394c0 con 0x7f436015b7c0 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601397a0 con 0x7f43601582a0 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4360139a80 con 0x7f43600711d0 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f436015b7c0 0x7f43600a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f436015b7c0 0x7f43600a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43598/0 (socket says 172.21.15.53:43598) 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 -- 172.21.15.53:0/3138059500 learned_addr learned my addr 172.21.15.53:0/3138059500 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4364ccf640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43601582a0 0x7f4360138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f43654d0640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f436014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 -- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 msgr2=0x7f436014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f436014fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 -- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43601582a0 msgr2=0x7f4360138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43601582a0 0x7f4360138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 -- 172.21.15.53:0/3138059500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350009420 con 0x7f436015b7c0 2024-09-13T18:30:44.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4365cd1640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f436015b7c0 0x7f43600a84d0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f435801b020 tx=0x7f4358019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4355ffb640 1 -- 172.21.15.53:0/3138059500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580aede0 con 0x7f436015b7c0 2024-09-13T18:30:44.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4355ffb640 1 -- 172.21.15.53:0/3138059500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358009450 con 0x7f436015b7c0 2024-09-13T18:30:44.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4355ffb640 1 -- 172.21.15.53:0/3138059500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580b7650 con 0x7f436015b7c0 2024-09-13T18:30:44.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4358009a70 con 0x7f436015b7c0 2024-09-13T18:30:44.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436013a040 con 0x7f436015b7c0 2024-09-13T18:30:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.646+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4360067400 con 0x7f436015b7c0 2024-09-13T18:30:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.650+0000 7f4355ffb640 1 -- 172.21.15.53:0/3138059500 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f43580b4050 con 0x7f436015b7c0 2024-09-13T18:30:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.650+0000 7f4355ffb640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43440667b0 0x7f4344068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.650+0000 7f4355ffb640 1 -- 172.21.15.53:0/3138059500 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f435811f690 con 0x7f436015b7c0 2024-09-13T18:30:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.650+0000 7f43654d0640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43440667b0 0x7f4344068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:44.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.650+0000 7f43654d0640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43440667b0 0x7f4344068c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f435c000f70 tx=0x7f435c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.654+0000 7f4355ffb640 1 -- 172.21.15.53:0/3138059500 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43580ec9b0 con 0x7f436015b7c0 2024-09-13T18:30:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f436013a230 con 0x7f436015b7c0 2024-09-13T18:30:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4355ffb640 1 -- 172.21.15.53:0/3138059500 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v94) v1 ==== 80+0+122 (secure 0 0 0) 0x7f43580effd0 con 0x7f436015b7c0 2024-09-13T18:30:44.820 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6833/3795700837 2024-09-14T18:30:38.209515+0000 2024-09-13T18:30:44.821 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6832/3795700837 2024-09-14T18:30:38.209515+0000 2024-09-13T18:30:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2024-09-13T18:30:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43440667b0 msgr2=0x7f4344068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43440667b0 0x7f4344068c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f435c000f70 tx=0x7f435c009040 comp rx=0 tx=0).stop 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f436015b7c0 msgr2=0x7f43600a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f436015b7c0 0x7f43600a84d0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f435801b020 tx=0x7f4358019710 comp rx=0 tx=0).stop 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 shutdown_connections 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43440667b0 0x7f4344068c70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f436015b7c0 0x7f43600a84d0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43601582a0 0x7f4360138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 --2- 172.21.15.53:0/3138059500 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43600711d0 0x7f436014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.818+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 >> 172.21.15.53:0/3138059500 conn(0x7f4360065c80 msgr2=0x7f4360070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.822+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 shutdown_connections 2024-09-13T18:30:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:44.822+0000 7f4367734640 1 -- 172.21.15.53:0/3138059500 wait complete. 2024-09-13T18:30:44.838 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:30:44.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:44.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:30:44.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[35927]: fuse finished with error 0 and tester_r 0 2024-09-13T18:30:44.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:30:44.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:44.854 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:30:44.922 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:44.922 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:44.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:44.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:30:44.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:44.928 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:30:44.979 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:30:44.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:44.980 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:44.980 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:44.986 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:44.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:30:44.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:30:44.986 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:30:45.032 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:30:45.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:30:45.033 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:45.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff611c3e640 1 Processor -- start 2024-09-13T18:30:45.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff611c3e640 1 -- start start 2024-09-13T18:30:45.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff611c3e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff60c06b850 0x7ff60c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff611c3e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0b1ac0 con 0x7ff60c0cbd60 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff611c3e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c159ac0 con 0x7ff60c0cb980 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff611c3e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c159da0 con 0x7ff60c06b850 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff60c0cbd60 0x7ff60c0b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59698/0 (socket says 172.21.15.53:59698) 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 -- 172.21.15.53:0/3535296343 learned_addr learned my addr 172.21.15.53:0/3535296343 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60affd640 1 --2- 172.21.15.53:0/3535296343 >> v2:172.21.15.87:3300/0 conn(0x7ff60c06b850 0x7ff60c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739142909 0 0) 0x7ff60c0b1ac0 con 0x7ff60c0cbd60 2024-09-13T18:30:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f8003530 con 0x7ff60c0cbd60 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1508819635 0 0) 0x7ff5f8003530 con 0x7ff60c0cbd60 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 >> v2:172.21.15.87:3300/0 conn(0x7ff60c06b850 msgr2=0x7ff60c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 --2- 172.21.15.53:0/3535296343 >> v2:172.21.15.87:3300/0 conn(0x7ff60c06b850 0x7ff60c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 >> v1:172.21.15.87:6789/0 conn(0x7ff60c0cb980 legacy=0x7ff60c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c15a080 con 0x7ff60c0cbd60 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ff5fc0016a0 con 0x7ff60c0cbd60 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 >> v1:172.21.15.53:6789/0 conn(0x7ff60c0cbd60 legacy=0x7ff60c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5f8003980 0x7ff5f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80047d0 0x7ff5f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f80052b0 0x7ff5f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c159da0 con 0x7ff5f80052b0 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f800bf70 con 0x7ff5f80047d0 2024-09-13T18:30:45.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f800c130 con 0x7ff5f8003980 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f80052b0 0x7ff5f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60affd640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80047d0 0x7ff5f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60b7fe640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5f8003980 0x7ff5f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 -- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5f8003980 msgr2=0x7ff5f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5f8003980 0x7ff5f8003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 -- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80047d0 msgr2=0x7ff5f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80047d0 0x7ff5f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60bfff640 1 -- 172.21.15.53:0/3535296343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8003530 con 0x7ff5f80052b0 2024-09-13T18:30:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.158+0000 7ff60affd640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80047d0 0x7ff5f8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff60bfff640 1 -- 172.21.15.53:0/3535296343 reap_dead start 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff60bfff640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f80052b0 0x7ff5f800b990 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff60c15aab0 tx=0x7ff5fc01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a8e36f39358eb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc005ae0 con 0x7ff5f80052b0 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc005c40 con 0x7ff5f80052b0 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff60a7fc640 1 -- 172.21.15.53:0/3535296343 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0a58b0 con 0x7ff5f80052b0 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 -- 172.21.15.53:0/3535296343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f80052b0 msgr2=0x7ff5f800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f80052b0 0x7ff5f800b990 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff60c15aab0 tx=0x7ff5fc01cbd0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 -- 172.21.15.53:0/3535296343 shutdown_connections 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 --2- 172.21.15.53:0/3535296343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5f80052b0 0x7ff5f800b990 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 -- 172.21.15.53:0/3535296343 >> 172.21.15.53:0/3535296343 conn(0x7ff60c065c80 msgr2=0x7ff60c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 -- 172.21.15.53:0/3535296343 shutdown_connections 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 -- 172.21.15.53:0/3535296343 wait complete. 2024-09-13T18:30:45.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 Processor -- start 2024-09-13T18:30:45.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.162+0000 7ff611c3e640 1 -- start start 2024-09-13T18:30:45.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80052b0 0x7ff60c14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff60c1f9b90 0x7ff60c147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff60c0ad9c0 0x7ff60c0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1f8ec0 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c14f4d0 con 0x7ff5f80052b0 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c14f1f0 con 0x7ff60c1f9b90 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff60c0ad9c0 0x7ff60c0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff60c0ad9c0 0x7ff60c0aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43614/0 (socket says 172.21.15.53:43614) 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 -- 172.21.15.53:0/2663253033 learned_addr learned my addr 172.21.15.53:0/2663253033 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60b7fe640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80052b0 0x7ff60c14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 -- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff60c1f9b90 msgr2=0x7ff60c147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60affd640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff60c1f9b90 0x7ff60c147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff60c1f9b90 0x7ff60c147dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 -- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80052b0 msgr2=0x7ff60c14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80052b0 0x7ff60c14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 -- 172.21.15.53:0/2663253033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c1f90b0 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60bfff640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff60c0ad9c0 0x7ff60c0aeaa0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc01ca00 tx=0x7ff5f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff603fff640 1 -- 172.21.15.53:0/2663253033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0b2030 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff603fff640 1 -- 172.21.15.53:0/2663253033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc0a5ab0 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c1f9390 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff603fff640 1 -- 172.21.15.53:0/2663253033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0a5e20 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c14ee50 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c067400 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff603fff640 1 -- 172.21.15.53:0/2663253033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7ff5fc0b5070 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff603fff640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5ec0667e0 0x7ff5ec068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff603fff640 1 -- 172.21.15.53:0/2663253033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff5fc0b3070 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60b7fe640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5ec0667e0 0x7ff5ec068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.166+0000 7ff60b7fe640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5ec0667e0 0x7ff5ec068ca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff60c14e440 tx=0x7ff604009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.170+0000 7ff603fff640 1 -- 172.21.15.53:0/2663253033 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5fc0ea930 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.362+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff60c0cdd40 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.366+0000 7ff603fff640 1 -- 172.21.15.53:0/2663253033 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4736 (secure 0 0 0) 0x7ff5fc0edf50 con 0x7ff60c0ad9c0 2024-09-13T18:30:45.367 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:45.367 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2807450918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2807450918},{"type":"v1","addr":"172.21.15.87:6833","nonce":2807450918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3225281050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3225281050},{"type":"v1","addr":"172.21.15.87:6835","nonce":3225281050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1870582127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1870582127},{"type":"v1","addr":"172.21.15.53:6833","nonce":1870582127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:30:17.824687+0000","modified":"2024-09-13T18:30:20.838202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2118447408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2118447408},{"type":"v1","addr":"172.21.15.53:6835","nonce":2118447408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:30:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 54 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.366+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5ec0667e0 msgr2=0x7ff5ec068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.366+0000 7ff611c3e640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5ec0667e0 0x7ff5ec068ca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff60c14e440 tx=0x7ff604009040 comp rx=0 tx=0).stop 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.366+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff60c0ad9c0 msgr2=0x7ff60c0aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.366+0000 7ff611c3e640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff60c0ad9c0 0x7ff60c0aeaa0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc01ca00 tx=0x7ff5f8005800 comp rx=0 tx=0).stop 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 shutdown_connections 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5ec0667e0 0x7ff5ec068ca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff60c1f9b90 0x7ff60c147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff60c0ad9c0 0x7ff60c0aeaa0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 --2- 172.21.15.53:0/2663253033 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5f80052b0 0x7ff60c14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 >> 172.21.15.53:0/2663253033 conn(0x7ff60c065c80 msgr2=0x7ff60c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:45.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 shutdown_connections 2024-09-13T18:30:45.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.370+0000 7ff611c3e640 1 -- 172.21.15.53:0/2663253033 wait complete. 2024-09-13T18:30:45.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:45.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9c702640 1 Processor -- start 2024-09-13T18:30:45.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9c702640 1 -- start start 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9c702640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fde9415b300 0x7fde940cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9c702640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde94161170 0x7fde94162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9c702640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940cc3f0 con 0x7fde94162850 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9c702640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde94161930 con 0x7fde94161170 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9c702640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde94161c10 con 0x7fde9415b300 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde99c9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde94161170 0x7fde94162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde99c9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde94161170 0x7fde94162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43618/0 (socket says 172.21.15.53:43618) 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde99c9d640 1 -- 172.21.15.53:0/2786972770 learned_addr learned my addr 172.21.15.53:0/2786972770 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde9a49e640 1 --2- 172.21.15.53:0/2786972770 >> v2:172.21.15.87:3300/0 conn(0x7fde9415b300 0x7fde940cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde99c9d640 1 -- 172.21.15.53:0/2786972770 >> v2:172.21.15.87:3300/0 conn(0x7fde9415b300 msgr2=0x7fde940cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde99c9d640 1 --2- 172.21.15.53:0/2786972770 >> v2:172.21.15.87:3300/0 conn(0x7fde9415b300 0x7fde940cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde99c9d640 1 -- 172.21.15.53:0/2786972770 >> v1:172.21.15.87:6789/0 conn(0x7fde94162850 legacy=0x7fde940cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.494+0000 7fde99c9d640 1 -- 172.21.15.53:0/2786972770 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94161ef0 con 0x7fde94161170 2024-09-13T18:30:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 --2- 172.21.15.53:0/2786972770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde94162310 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fde940b38f0 tx=0x7fde8801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95799a2a6f0cb4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9949c640 1 -- 172.21.15.53:0/2786972770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880ab5f0 con 0x7fde94161170 2024-09-13T18:30:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9949c640 1 -- 172.21.15.53:0/2786972770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880ab750 con 0x7fde94161170 2024-09-13T18:30:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9949c640 1 -- 172.21.15.53:0/2786972770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880abae0 con 0x7fde94161170 2024-09-13T18:30:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- 172.21.15.53:0/2786972770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 msgr2=0x7fde94162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 --2- 172.21.15.53:0/2786972770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde94162310 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fde940b38f0 tx=0x7fde8801c4e0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- 172.21.15.53:0/2786972770 shutdown_connections 2024-09-13T18:30:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 --2- 172.21.15.53:0/2786972770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde94162310 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 --2- 172.21.15.53:0/2786972770 >> v2:172.21.15.87:3300/0 conn(0x7fde9415b300 0x7fde940cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- 172.21.15.53:0/2786972770 >> 172.21.15.53:0/2786972770 conn(0x7fde94065c80 msgr2=0x7fde94066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- 172.21.15.53:0/2786972770 shutdown_connections 2024-09-13T18:30:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- 172.21.15.53:0/2786972770 wait complete. 2024-09-13T18:30:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 Processor -- start 2024-09-13T18:30:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- start start 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde9415b300 0x7fde941565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde9415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde94162850 0x7fde940aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940aa4e0 con 0x7fde94161170 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94156410 con 0x7fde94162850 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940ae0e0 con 0x7fde9415b300 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde9415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde9415b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43632/0 (socket says 172.21.15.53:43632) 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 -- 172.21.15.53:0/2772406338 learned_addr learned my addr 172.21.15.53:0/2772406338 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 -- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde9415b300 msgr2=0x7fde941565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9a49e640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde9415b300 0x7fde941565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9ac9f640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde94162850 0x7fde940aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde9415b300 0x7fde941565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 -- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde94162850 msgr2=0x7fde940aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde94162850 0x7fde940aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 -- 172.21.15.53:0/2772406338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880094d0 con 0x7fde94161170 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde99c9d640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde9415b6e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fde8801a110 tx=0x7fde8801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde92ffd640 1 -- 172.21.15.53:0/2772406338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880be5f0 con 0x7fde94161170 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde92ffd640 1 -- 172.21.15.53:0/2772406338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880be770 con 0x7fde94161170 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde940cd210 con 0x7fde94161170 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde92ffd640 1 -- 172.21.15.53:0/2772406338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880beb20 con 0x7fde94161170 2024-09-13T18:30:45.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.498+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde940ae6a0 con 0x7fde94161170 2024-09-13T18:30:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.502+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde94067400 con 0x7fde94161170 2024-09-13T18:30:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.502+0000 7fde92ffd640 1 -- 172.21.15.53:0/2772406338 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fde880b43f0 con 0x7fde94161170 2024-09-13T18:30:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.502+0000 7fde92ffd640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde800667b0 0x7fde80068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.502+0000 7fde92ffd640 1 -- 172.21.15.53:0/2772406338 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fde880a8050 con 0x7fde94161170 2024-09-13T18:30:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.502+0000 7fde9a49e640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde800667b0 0x7fde80068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.502+0000 7fde9a49e640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde800667b0 0x7fde80068c70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e90 tx=0x7fde8c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.506+0000 7fde92ffd640 1 -- 172.21.15.53:0/2772406338 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde880ec060 con 0x7fde94161170 2024-09-13T18:30:45.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.678+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde940aa620 con 0x7fde94161170 2024-09-13T18:30:45.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.678+0000 7fde92ffd640 1 -- 172.21.15.53:0/2772406338 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fde880c4020 con 0x7fde94161170 2024-09-13T18:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:45.683 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:41.229329+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6833/3795700837":"2024-09-14T18:30:38.209515+0000","172.21.15.53:6832/3795700837":"2024-09-14T18:30:38.209515+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde800667b0 msgr2=0x7fde80068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde800667b0 0x7fde80068c70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e90 tx=0x7fde8c00b040 comp rx=0 tx=0).stop 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 msgr2=0x7fde9415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde9415b6e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fde8801a110 tx=0x7fde8801ad20 comp rx=0 tx=0).stop 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 shutdown_connections 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde800667b0 0x7fde80068c70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde94162850 0x7fde940aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde94161170 0x7fde9415b6e0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 --2- 172.21.15.53:0/2772406338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fde9415b300 0x7fde941565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 >> 172.21.15.53:0/2772406338 conn(0x7fde94065c80 msgr2=0x7fde94157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 shutdown_connections 2024-09-13T18:30:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.682+0000 7fde9c702640 1 -- 172.21.15.53:0/2772406338 wait complete. 2024-09-13T18:30:45.702 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:30:16.211649+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:30:16.801150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:45.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:45.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7fa12640 1 Processor -- start 2024-09-13T18:30:45.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7fa12640 1 -- start start 2024-09-13T18:30:45.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7fa12640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d78143e80 0x7f7d7806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7fa12640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 0x7f7d780cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7fa12640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7806f7a0 con 0x7f7d780caee0 2024-09-13T18:30:45.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7fa12640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7806fd60 con 0x7f7d78143e80 2024-09-13T18:30:45.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7fa12640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780cb960 con 0x7f7d780cda30 2024-09-13T18:30:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7cfad640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7d780caee0 0x7f7d780cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59708/0 (socket says 172.21.15.53:59708) 2024-09-13T18:30:45.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7cfad640 1 -- 172.21.15.53:0/4185827295 learned_addr learned my addr 172.21.15.53:0/4185827295 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:45.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7dfaf640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 0x7f7d780cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/4185827295 >> v2:172.21.15.87:3300/0 conn(0x7f7d78143e80 0x7f7d7806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711113998 0 0) 0x7f7d7806f7a0 con 0x7f7d780caee0 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d64003530 con 0x7f7d780caee0 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853444896 0 0) 0x7f7d64003530 con 0x7f7d780caee0 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 msgr2=0x7f7d780cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 0x7f7d780cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 >> v2:172.21.15.87:3300/0 conn(0x7f7d78143e80 msgr2=0x7f7d7806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/4185827295 >> v2:172.21.15.87:3300/0 conn(0x7f7d78143e80 0x7f7d7806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780cbc40 con 0x7f7d780caee0 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7d68001680 con 0x7f7d780caee0 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 >> v1:172.21.15.53:6789/0 conn(0x7f7d780caee0 legacy=0x7f7d780cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 0x7f7d640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d64004d10 0x7f7d64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7806fd60 con 0x7f7d64003980 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780cb960 con 0x7f7d64004d10 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6400ba10 con 0x7f7d780cda30 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7cfad640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 0x7f7d640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7dfaf640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d64004d10 0x7f7d64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7d7ae640 1 -- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 msgr2=0x7f7d640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d780cda30 0x7f7d640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7d7ae640 1 -- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d64004d10 msgr2=0x7f7d64005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d64004d10 0x7f7d64005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.826+0000 7f7d7d7ae640 1 -- 172.21.15.53:0/4185827295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64003530 con 0x7f7d64003980 2024-09-13T18:30:45.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009ae0 tx=0x7f7d7401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0a525761204df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d740a5560 con 0x7f7d64003980 2024-09-13T18:30:45.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d740a56c0 con 0x7f7d64003980 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d6ffff640 1 -- 172.21.15.53:0/4185827295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d740a5a70 con 0x7f7d64003980 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 -- 172.21.15.53:0/4185827295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 msgr2=0x7f7d64003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 --2- 172.21.15.53:0/4185827295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d64003da0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009ae0 tx=0x7f7d7401ca80 comp rx=0 tx=0).stop 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7dfaf640 1 -- 172.21.15.53:0/4185827295 reap_dead start 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 -- 172.21.15.53:0/4185827295 shutdown_connections 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 -- 172.21.15.53:0/4185827295 >> 172.21.15.53:0/4185827295 conn(0x7f7d78065c80 msgr2=0x7f7d78066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 -- 172.21.15.53:0/4185827295 shutdown_connections 2024-09-13T18:30:45.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 -- 172.21.15.53:0/4185827295 wait complete. 2024-09-13T18:30:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 Processor -- start 2024-09-13T18:30:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.830+0000 7f7d7fa12640 1 -- start start 2024-09-13T18:30:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d7813e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7813c020 0x7f7d7813a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d7813c4a0 0x7f7d78138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7813cbf0 con 0x7f7d64003980 2024-09-13T18:30:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7813d190 con 0x7f7d7813c020 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7813d470 con 0x7f7d7813c4a0 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d7813e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d7813e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43644/0 (socket says 172.21.15.53:43644) 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 -- 172.21.15.53:0/1721324638 learned_addr learned my addr 172.21.15.53:0/1721324638 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7dfaf640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d7813c4a0 0x7f7d78138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7cfad640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7813c020 0x7f7d7813a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 -- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d7813c4a0 msgr2=0x7f7d78138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d7813c4a0 0x7f7d78138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 -- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7813c020 msgr2=0x7f7d7813a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7813c020 0x7f7d7813a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 -- 172.21.15.53:0/1721324638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7813d750 con 0x7f7d64003980 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7cfad640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7813c020 0x7f7d7813a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7d7ae640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d7813e210 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009ae0 tx=0x7f7d64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d6dffb640 1 -- 172.21.15.53:0/1721324638 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d740a5560 con 0x7f7d64003980 2024-09-13T18:30:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d6dffb640 1 -- 172.21.15.53:0/1721324638 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d74004020 con 0x7f7d64003980 2024-09-13T18:30:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7813da30 con 0x7f7d64003980 2024-09-13T18:30:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d6dffb640 1 -- 172.21.15.53:0/1721324638 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74004390 con 0x7f7d64003980 2024-09-13T18:30:45.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7813ce60 con 0x7f7d64003980 2024-09-13T18:30:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7815be00 con 0x7f7d64003980 2024-09-13T18:30:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d6dffb640 1 -- 172.21.15.53:0/1721324638 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f7d740b4040 con 0x7f7d64003980 2024-09-13T18:30:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d6dffb640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7d5c0667b0 0x7f7d5c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d6dffb640 1 -- 172.21.15.53:0/1721324638 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7d7411e370 con 0x7f7d64003980 2024-09-13T18:30:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7cfad640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7d5c0667b0 0x7f7d5c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:45.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.834+0000 7f7d7cfad640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7d5c0667b0 0x7f7d5c068c70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d68000c10 tx=0x7f7d68000ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:45.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.838+0000 7f7d6dffb640 1 -- 172.21.15.53:0/1721324638 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d740eb6b0 con 0x7f7d64003980 2024-09-13T18:30:45.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.994+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d7815bb20 con 0x7f7d64003980 2024-09-13T18:30:45.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d6dffb640 1 -- 172.21.15.53:0/1721324638 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d740eecd0 con 0x7f7d64003980 2024-09-13T18:30:45.999 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7d5c0667b0 msgr2=0x7f7d5c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7d5c0667b0 0x7f7d5c068c70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d68000c10 tx=0x7f7d68000ee0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 msgr2=0x7f7d7813e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d7813e210 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009ae0 tx=0x7f7d64005800 comp rx=0 tx=0).stop 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 shutdown_connections 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7d5c0667b0 0x7f7d5c068c70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d7813c4a0 0x7f7d78138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d7813c020 0x7f7d7813a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 --2- 172.21.15.53:0/1721324638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d64003980 0x7f7d7813e210 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 >> 172.21.15.53:0/1721324638 conn(0x7f7d78065c80 msgr2=0x7f7d780b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:46.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 shutdown_connections 2024-09-13T18:30:46.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:45.998+0000 7f7d7fa12640 1 -- 172.21.15.53:0/1721324638 wait complete. 2024-09-13T18:30:46.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:30:46.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 Processor -- start 2024-09-13T18:30:46.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 -- start start 2024-09-13T18:30:46.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82bc143e80 0x7f82bc06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82bc0caee0 0x7f82bc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc06f7a0 con 0x7f82bc143e80 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc06fd60 con 0x7f82bc0caee0 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82c1126640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0cdd10 con 0x7f82bc0cd320 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82bc143e80 0x7f82bc06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82bc143e80 0x7f82bc06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43656/0 (socket says 172.21.15.53:43656) 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 -- 172.21.15.53:0/4249629785 learned_addr learned my addr 172.21.15.53:0/4249629785 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bb59e640 1 --2- 172.21.15.53:0/4249629785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82b3fff640 1 --2- 172.21.15.53:0/4249629785 >> v2:172.21.15.87:3300/0 conn(0x7f82bc0caee0 0x7f82bc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 -- 172.21.15.53:0/4249629785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 msgr2=0x7f82bc0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 --2- 172.21.15.53:0/4249629785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 -- 172.21.15.53:0/4249629785 >> v2:172.21.15.87:3300/0 conn(0x7f82bc0caee0 msgr2=0x7f82bc0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:46.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 --2- 172.21.15.53:0/4249629785 >> v2:172.21.15.87:3300/0 conn(0x7f82bc0caee0 0x7f82bc0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.138+0000 7f82bad9d640 1 -- 172.21.15.53:0/4249629785 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0cb960 con 0x7f82bc143e80 2024-09-13T18:30:46.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82bad9d640 1 --2- 172.21.15.53:0/4249629785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc143e80 0x7f82bc06b390 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009870 tx=0x7f82ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2ffb96879fceed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82ba59c640 1 -- 172.21.15.53:0/4249629785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0ab620 con 0x7f82bc143e80 2024-09-13T18:30:46.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82ba59c640 1 -- 172.21.15.53:0/4249629785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac0ab780 con 0x7f82bc143e80 2024-09-13T18:30:46.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82ba59c640 1 -- 172.21.15.53:0/4249629785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0abb10 con 0x7f82bc143e80 2024-09-13T18:30:46.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- 172.21.15.53:0/4249629785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc143e80 msgr2=0x7f82bc06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 --2- 172.21.15.53:0/4249629785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc143e80 0x7f82bc06b390 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009870 tx=0x7f82ac01c460 comp rx=0 tx=0).stop 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- 172.21.15.53:0/4249629785 shutdown_connections 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 --2- 172.21.15.53:0/4249629785 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 --2- 172.21.15.53:0/4249629785 >> v2:172.21.15.87:3300/0 conn(0x7f82bc0caee0 0x7f82bc0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 --2- 172.21.15.53:0/4249629785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc143e80 0x7f82bc06b390 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- 172.21.15.53:0/4249629785 >> 172.21.15.53:0/4249629785 conn(0x7f82bc065c80 msgr2=0x7f82bc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- 172.21.15.53:0/4249629785 shutdown_connections 2024-09-13T18:30:46.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- 172.21.15.53:0/4249629785 wait complete. 2024-09-13T18:30:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 Processor -- start 2024-09-13T18:30:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- start start 2024-09-13T18:30:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc0caee0 0x7f82bc1360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc143e80 0x7f82bc153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc1365e0 con 0x7f82bc0caee0 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc136810 con 0x7f82bc143e80 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82c1126640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc1376a0 con 0x7f82bc0cd320 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82bad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc0caee0 0x7f82bc1360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82bad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc0caee0 0x7f82bc1360a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43672/0 (socket says 172.21.15.53:43672) 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82bad9d640 1 -- 172.21.15.53:0/398817345 learned_addr learned my addr 172.21.15.53:0/398817345 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.142+0000 7f82b3fff640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82bad9d640 1 -- 172.21.15.53:0/398817345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 msgr2=0x7f82bc153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82bad9d640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82bad9d640 1 -- 172.21.15.53:0/398817345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc143e80 msgr2=0x7f82bc153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82bad9d640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc143e80 0x7f82bc153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82bad9d640 1 -- 172.21.15.53:0/398817345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0094d0 con 0x7f82bc0caee0 2024-09-13T18:30:46.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82bad9d640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc0caee0 0x7f82bc1360a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0ad040 tx=0x7f82ac01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b37fe640 1 -- 172.21.15.53:0/398817345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0be3f0 con 0x7f82bc0caee0 2024-09-13T18:30:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b37fe640 1 -- 172.21.15.53:0/398817345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac0be570 con 0x7f82bc0caee0 2024-09-13T18:30:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc137980 con 0x7f82bc0caee0 2024-09-13T18:30:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b37fe640 1 -- 172.21.15.53:0/398817345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0be920 con 0x7f82bc0caee0 2024-09-13T18:30:46.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc1538d0 con 0x7f82bc0caee0 2024-09-13T18:30:46.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc070a00 con 0x7f82bc0caee0 2024-09-13T18:30:46.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b37fe640 1 -- 172.21.15.53:0/398817345 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f82ac0b43f0 con 0x7f82bc0caee0 2024-09-13T18:30:46.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b37fe640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f829c0667b0 0x7f829c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b37fe640 1 -- 172.21.15.53:0/398817345 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f82ac11e210 con 0x7f82bc0caee0 2024-09-13T18:30:46.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b3fff640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f829c0667b0 0x7f829c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.146+0000 7f82b3fff640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f829c0667b0 0x7f829c068c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0b1190 tx=0x7f82a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.150+0000 7f82b37fe640 1 -- 172.21.15.53:0/398817345 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82ac0eb300 con 0x7f82bc0caee0 2024-09-13T18:30:46.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.306+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82bc136c80 con 0x7f82bc0caee0 2024-09-13T18:30:46.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.306+0000 7f82b37fe640 1 -- 172.21.15.53:0/398817345 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f82ac0ee920 con 0x7f82bc0caee0 2024-09-13T18:30:46.309 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f829c0667b0 msgr2=0x7f829c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f829c0667b0 0x7f829c068c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0b1190 tx=0x7f82a4008040 comp rx=0 tx=0).stop 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc0caee0 msgr2=0x7f82bc1360a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc0caee0 0x7f82bc1360a0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0ad040 tx=0x7f82ac01aca0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 shutdown_connections 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f829c0667b0 0x7f829c068c70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82bc0cd320 0x7f82bc153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82bc143e80 0x7f82bc153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 --2- 172.21.15.53:0/398817345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82bc0caee0 0x7f82bc1360a0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 >> 172.21.15.53:0/398817345 conn(0x7f82bc065c80 msgr2=0x7f82bc0ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:46.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 shutdown_connections 2024-09-13T18:30:46.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.310+0000 7f82c1126640 1 -- 172.21.15.53:0/398817345 wait complete. 2024-09-13T18:30:46.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:30:46.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.446+0000 7f40ca49b640 1 Processor -- start 2024-09-13T18:30:46.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.446+0000 7f40ca49b640 1 -- start start 2024-09-13T18:30:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.446+0000 7f40ca49b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c41593a0 0x7f40c40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.446+0000 7f40ca49b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40c406cb70 0x7f40c406cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c406d4d0 con 0x7f40c4159780 2024-09-13T18:30:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4159c30 con 0x7f40c406cb70 2024-09-13T18:30:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4159f10 con 0x7f40c41593a0 2024-09-13T18:30:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40bb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f40c4159780 0x7f40c4071010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59724/0 (socket says 172.21.15.53:59724) 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2299646756 learned_addr learned my addr 172.21.15.53:0/2299646756 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c8a38640 1 --2- 172.21.15.53:0/2299646756 >> v2:172.21.15.53:3300/0 conn(0x7f40c406cb70 0x7f40c406cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c37fe640 1 -- 172.21.15.53:0/2299646756 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313005707 0 0) 0x7f40c406d4d0 con 0x7f40c4159780 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c3fff640 1 --2- 172.21.15.53:0/2299646756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c41593a0 0x7f40c40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c37fe640 1 -- 172.21.15.53:0/2299646756 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b0003530 con 0x7f40c4159780 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c8a38640 1 -- 172.21.15.53:0/2299646756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c41593a0 msgr2=0x7f40c40b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c8a38640 1 --2- 172.21.15.53:0/2299646756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c41593a0 0x7f40c40b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c8a38640 1 -- 172.21.15.53:0/2299646756 >> v1:172.21.15.53:6789/0 conn(0x7f40c4159780 legacy=0x7f40c4071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c8a38640 1 -- 172.21.15.53:0/2299646756 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c415a1f0 con 0x7f40c406cb70 2024-09-13T18:30:46.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c8a38640 1 --2- 172.21.15.53:0/2299646756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c406cb70 0x7f40c406cf90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f40bc009d90 tx=0x7f40bc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2714e6c6fe4a308 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c37fe640 1 -- 172.21.15.53:0/2299646756 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0a59c0 con 0x7f40c406cb70 2024-09-13T18:30:46.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c37fe640 1 -- 172.21.15.53:0/2299646756 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc0a5b20 con 0x7f40c406cb70 2024-09-13T18:30:46.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40c37fe640 1 -- 172.21.15.53:0/2299646756 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0ad440 con 0x7f40c406cb70 2024-09-13T18:30:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- 172.21.15.53:0/2299646756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c406cb70 msgr2=0x7f40c406cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 --2- 172.21.15.53:0/2299646756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c406cb70 0x7f40c406cf90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f40bc009d90 tx=0x7f40bc01c970 comp rx=0 tx=0).stop 2024-09-13T18:30:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- 172.21.15.53:0/2299646756 shutdown_connections 2024-09-13T18:30:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 --2- 172.21.15.53:0/2299646756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c406cb70 0x7f40c406cf90 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 --2- 172.21.15.53:0/2299646756 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c41593a0 0x7f40c40b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- 172.21.15.53:0/2299646756 >> 172.21.15.53:0/2299646756 conn(0x7f40c4069f50 msgr2=0x7f40c406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- 172.21.15.53:0/2299646756 shutdown_connections 2024-09-13T18:30:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.450+0000 7f40ca49b640 1 -- 172.21.15.53:0/2299646756 wait complete. 2024-09-13T18:30:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 Processor -- start 2024-09-13T18:30:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 -- start start 2024-09-13T18:30:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c406cb70 0x7f40c4155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c41593a0 0x7f40c4147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c4159780 0x7f40c414f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c414fcf0 con 0x7f40c4159780 2024-09-13T18:30:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40cd790 con 0x7f40c41593a0 2024-09-13T18:30:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c414fa20 con 0x7f40c406cb70 2024-09-13T18:30:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c4159780 0x7f40c414f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c4159780 0x7f40c414f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43688/0 (socket says 172.21.15.53:43688) 2024-09-13T18:30:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 -- 172.21.15.53:0/3630287655 learned_addr learned my addr 172.21.15.53:0/3630287655 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c3fff640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c406cb70 0x7f40c4155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40bb7fe640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c41593a0 0x7f40c4147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 -- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c406cb70 msgr2=0x7f40c4155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c406cb70 0x7f40c4155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 -- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c41593a0 msgr2=0x7f40c4147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c41593a0 0x7f40c4147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 -- 172.21.15.53:0/3630287655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009a70 con 0x7f40c4159780 2024-09-13T18:30:46.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40bb7fe640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c41593a0 0x7f40c4147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:46.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c3fff640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c406cb70 0x7f40c4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:46.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c8a38640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c4159780 0x7f40c414f4e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f40bc01b020 tx=0x7f40bc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c17fa640 1 -- 172.21.15.53:0/3630287655 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0add90 con 0x7f40c4159780 2024-09-13T18:30:46.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c17fa640 1 -- 172.21.15.53:0/3630287655 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc009450 con 0x7f40c4159780 2024-09-13T18:30:46.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c40cda30 con 0x7f40c4159780 2024-09-13T18:30:46.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c17fa640 1 -- 172.21.15.53:0/3630287655 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0b9670 con 0x7f40c4159780 2024-09-13T18:30:46.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c40cdff0 con 0x7f40c4159780 2024-09-13T18:30:46.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c40cb610 con 0x7f40c4159780 2024-09-13T18:30:46.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.454+0000 7f40c17fa640 1 -- 172.21.15.53:0/3630287655 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f40bc0b97d0 con 0x7f40c4159780 2024-09-13T18:30:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.458+0000 7f40c17fa640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a40667b0 0x7f40a4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.458+0000 7f40c17fa640 1 -- 172.21.15.53:0/3630287655 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f40bc11fa50 con 0x7f40c4159780 2024-09-13T18:30:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.458+0000 7f40c3fff640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a40667b0 0x7f40a4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.458+0000 7f40c3fff640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a40667b0 0x7f40a4068c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009840 tx=0x7f40b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.462+0000 7f40c17fa640 1 -- 172.21.15.53:0/3630287655 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40bc0ecc50 con 0x7f40c4159780 2024-09-13T18:30:46.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.618+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40c40cb610 con 0x7f40c4159780 2024-09-13T18:30:46.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40c17fa640 1 -- 172.21.15.53:0/3630287655 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40bc0b20a0 con 0x7f40c4159780 2024-09-13T18:30:46.623 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:30:46.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a40667b0 msgr2=0x7f40a4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a40667b0 0x7f40a4068c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009840 tx=0x7f40b4008040 comp rx=0 tx=0).stop 2024-09-13T18:30:46.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c4159780 msgr2=0x7f40c414f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c4159780 0x7f40c414f4e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f40bc01b020 tx=0x7f40bc019710 comp rx=0 tx=0).stop 2024-09-13T18:30:46.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 shutdown_connections 2024-09-13T18:30:46.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a40667b0 0x7f40a4068c70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40c4159780 0x7f40c414f4e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40c41593a0 0x7f40c4147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 --2- 172.21.15.53:0/3630287655 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40c406cb70 0x7f40c4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 >> 172.21.15.53:0/3630287655 conn(0x7f40c4069f50 msgr2=0x7f40c406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:46.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 shutdown_connections 2024-09-13T18:30:46.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.622+0000 7f40ca49b640 1 -- 172.21.15.53:0/3630287655 wait complete. 2024-09-13T18:30:46.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.758+0000 7f8c23ae6640 1 Processor -- start 2024-09-13T18:30:46.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.758+0000 7f8c23ae6640 1 -- start start 2024-09-13T18:30:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c23ae6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c1c15cab0 0x7f8c1c0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c23ae6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cd6c0 0x7f8c1c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c23ae6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0cdb00 0x7f8c1c0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c23ae6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0d2400 con 0x7f8c1c15cab0 2024-09-13T18:30:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c23ae6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0d1530 con 0x7f8c1c0cdb00 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c23ae6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0d0920 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c1c15cab0 0x7f8c1c0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c1c15cab0 0x7f8c1c0d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52218/0 (socket says 172.21.15.53:52218) 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 -- 172.21.15.53:0/456100546 learned_addr learned my addr 172.21.15.53:0/456100546 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21081640 1 --2- 172.21.15.53:0/456100546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cd6c0 0x7f8c1c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c22083640 1 --2- 172.21.15.53:0/456100546 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0cdb00 0x7f8c1c0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 -- 172.21.15.53:0/456100546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cd6c0 msgr2=0x7f8c1c0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 --2- 172.21.15.53:0/456100546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cd6c0 0x7f8c1c0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 -- 172.21.15.53:0/456100546 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0cdb00 msgr2=0x7f8c1c0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 --2- 172.21.15.53:0/456100546 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0cdb00 0x7f8c1c0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 -- 172.21.15.53:0/456100546 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0d0c00 con 0x7f8c1c15cab0 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c22083640 1 --2- 172.21.15.53:0/456100546 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0cdb00 0x7f8c1c0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:46.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21081640 1 --2- 172.21.15.53:0/456100546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cd6c0 0x7f8c1c0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c21882640 1 --2- 172.21.15.53:0/456100546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0d19c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0b7fe0 tx=0x7f8c0c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7ac72df96cdc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c20880640 1 -- 172.21.15.53:0/456100546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0aa610 con 0x7f8c1c15cab0 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c20880640 1 -- 172.21.15.53:0/456100546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c0a6040 con 0x7f8c1c15cab0 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.762+0000 7f8c20880640 1 -- 172.21.15.53:0/456100546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0aa990 con 0x7f8c1c15cab0 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- 172.21.15.53:0/456100546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c15cab0 msgr2=0x7f8c1c0d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/456100546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0d19c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0b7fe0 tx=0x7f8c0c01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- 172.21.15.53:0/456100546 shutdown_connections 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/456100546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cd6c0 0x7f8c1c0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/456100546 >> v2:172.21.15.87:3300/0 conn(0x7f8c1c0cdb00 0x7f8c1c0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/456100546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0d19c0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- 172.21.15.53:0/456100546 >> 172.21.15.53:0/456100546 conn(0x7f8c1c065c80 msgr2=0x7f8c1c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- 172.21.15.53:0/456100546 shutdown_connections 2024-09-13T18:30:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- 172.21.15.53:0/456100546 wait complete. 2024-09-13T18:30:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 Processor -- start 2024-09-13T18:30:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- start start 2024-09-13T18:30:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c0cd6c0 0x7f8c1c152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cdb00 0x7f8c1c0c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c153520 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c153c10 con 0x7f8c1c15cab0 2024-09-13T18:30:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c153ef0 con 0x7f8c1c0cdb00 2024-09-13T18:30:46.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c0cd6c0 0x7f8c1c152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c0cd6c0 0x7f8c1c152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52222/0 (socket says 172.21.15.53:52222) 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 -- 172.21.15.53:0/2177897174 learned_addr learned my addr 172.21.15.53:0/2177897174 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21081640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cdb00 0x7f8c1c0c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c22083640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 -- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cdb00 msgr2=0x7f8c1c0c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cdb00 0x7f8c1c0c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 -- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c15cab0 msgr2=0x7f8c1c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 -- 172.21.15.53:0/2177897174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c0094d0 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c22083640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c21882640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c0cd6c0 0x7f8c1c152fe0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c01aba0 tx=0x7f8c0c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c127fc640 1 -- 172.21.15.53:0/2177897174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0b3800 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c127fc640 1 -- 172.21.15.53:0/2177897174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c0b3960 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c1541d0 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c127fc640 1 -- 172.21.15.53:0/2177897174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0b3d10 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.766+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c154790 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.770+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c156a90 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.770+0000 7f8c127fc640 1 -- 172.21.15.53:0/2177897174 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8c0c0c6390 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.770+0000 7f8c127fc640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8c000667b0 0x7f8c00068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.770+0000 7f8c127fc640 1 -- 172.21.15.53:0/2177897174 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8c0c11ee90 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.770+0000 7f8c21081640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8c000667b0 0x7f8c00068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:46.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.770+0000 7f8c21081640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8c000667b0 0x7f8c00068c70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0cd450 tx=0x7f8c18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.774+0000 7f8c127fc640 1 -- 172.21.15.53:0/2177897174 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c0c0ec0c0 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c1c154030 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c127fc640 1 -- 172.21.15.53:0/2177897174 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f8c1c154030 con 0x7f8c1c0cd6c0 2024-09-13T18:30:46.972 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:46.972 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2807450918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2807450918},{"type":"v1","addr":"172.21.15.87:6833","nonce":2807450918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3225281050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3225281050},{"type":"v1","addr":"172.21.15.87:6835","nonce":3225281050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1870582127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1870582127},{"type":"v1","addr":"172.21.15.53:6833","nonce":1870582127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:30:17.824687+0000","modified":"2024-09-13T18:30:20.838202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2118447408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2118447408},{"type":"v1","addr":"172.21.15.53:6835","nonce":2118447408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:30:46.972 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 54 2024-09-13T18:30:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8c000667b0 msgr2=0x7f8c00068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8c000667b0 0x7f8c00068c70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0cd450 tx=0x7f8c18008040 comp rx=0 tx=0).stop 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c0cd6c0 msgr2=0x7f8c1c152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c0cd6c0 0x7f8c1c152fe0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c01aba0 tx=0x7f8c0c01ad30 comp rx=0 tx=0).stop 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 shutdown_connections 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8c000667b0 0x7f8c00068c70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8c1c0cdb00 0x7f8c1c0c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c1c15cab0 0x7f8c1c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 --2- 172.21.15.53:0/2177897174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c1c0cd6c0 0x7f8c1c152fe0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.970+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 >> 172.21.15.53:0/2177897174 conn(0x7f8c1c065c80 msgr2=0x7f8c1c0b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.974+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 shutdown_connections 2024-09-13T18:30:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:46.974+0000 7f8c23ae6640 1 -- 172.21.15.53:0/2177897174 wait complete. 2024-09-13T18:30:46.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7d05535640 1 Processor -- start 2024-09-13T18:30:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7d05535640 1 -- start start 2024-09-13T18:30:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7d05535640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d0015b7c0 0x7f7d00070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7d05535640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0006d480 con 0x7f7d000711d0 2024-09-13T18:30:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7d05535640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0015ace0 con 0x7f7d001582a0 2024-09-13T18:30:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7d05535640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d00071680 con 0x7f7d0015b7c0 2024-09-13T18:30:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7cff7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7d000711d0 0x7f7d001640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41814/0 (socket says 172.21.15.53:41814) 2024-09-13T18:30:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7cff7fe640 1 -- 172.21.15.53:0/1700441911 learned_addr learned my addr 172.21.15.53:0/1700441911 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/1700441911 >> v2:172.21.15.87:3300/0 conn(0x7f7d0015b7c0 0x7f7d00070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104249153 0 0) 0x7f7d0006d480 con 0x7f7d000711d0 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.106+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cec003530 con 0x7f7d000711d0 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1628682991 0 0) 0x7f7cec003530 con 0x7f7d000711d0 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 >> v2:172.21.15.87:3300/0 conn(0x7f7d0015b7c0 msgr2=0x7f7d00070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 --2- 172.21.15.53:0/1700441911 >> v2:172.21.15.87:3300/0 conn(0x7f7d0015b7c0 0x7f7d00070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 >> v1:172.21.15.87:6789/0 conn(0x7f7d001582a0 legacy=0x7f7d0006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0015afc0 con 0x7f7d000711d0 2024-09-13T18:30:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7cf8001a00 con 0x7f7d000711d0 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 >> v1:172.21.15.53:6789/0 conn(0x7f7d000711d0 legacy=0x7f7d001640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec003980 0x7f7cec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7cec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec005190 0x7f7cec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00071680 con 0x7f7cec0047d0 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec00c030 con 0x7f7cec005190 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec00c1f0 con 0x7f7cec003980 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7cec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfeffd640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec003980 0x7f7cec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cff7fe640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec005190 0x7f7cec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfe7fc640 1 -- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec003980 msgr2=0x7f7cec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec003980 0x7f7cec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfe7fc640 1 -- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec005190 msgr2=0x7f7cec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec005190 0x7f7cec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfe7fc640 1 -- 172.21.15.53:0/1700441911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec003530 con 0x7f7cec0047d0 2024-09-13T18:30:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfeffd640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cec003980 0x7f7cec003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cff7fe640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cec005190 0x7f7cec00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cff7fe640 1 -- 172.21.15.53:0/1700441911 reap_dead start 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7cec004c50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009ae0 tx=0x7f7ce801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48257c0c895191b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80a5660 con 0x7f7cec0047d0 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf8002100 con 0x7f7cec0047d0 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7cfdffb640 1 -- 172.21.15.53:0/1700441911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80a5a00 con 0x7f7cec0047d0 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7d05535640 1 -- 172.21.15.53:0/1700441911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 msgr2=0x7f7cec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7d05535640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7cec004c50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009ae0 tx=0x7f7ce801ca70 comp rx=0 tx=0).stop 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7d05535640 1 -- 172.21.15.53:0/1700441911 shutdown_connections 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7d05535640 1 --2- 172.21.15.53:0/1700441911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7cec004c50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7d05535640 1 -- 172.21.15.53:0/1700441911 >> 172.21.15.53:0/1700441911 conn(0x7f7d00065c80 msgr2=0x7f7d00066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:47.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7d05535640 1 -- 172.21.15.53:0/1700441911 shutdown_connections 2024-09-13T18:30:47.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.110+0000 7f7d05535640 1 -- 172.21.15.53:0/1700441911 wait complete. 2024-09-13T18:30:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 Processor -- start 2024-09-13T18:30:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 -- start start 2024-09-13T18:30:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7d00152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d001e0e60 0x7f7d00150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0013fb30 0x7f7d00158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00152200 con 0x7f7cec0047d0 2024-09-13T18:30:47.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00152b60 con 0x7f7d0013fb30 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d001512e0 con 0x7f7d001e0e60 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7d00152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7d00152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52248/0 (socket says 172.21.15.53:52248) 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 -- 172.21.15.53:0/4242713337 learned_addr learned my addr 172.21.15.53:0/4242713337 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cff7fe640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0013fb30 0x7f7d00158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d001e0e60 0x7f7d00150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 -- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d001e0e60 msgr2=0x7f7d00150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d001e0e60 0x7f7d00150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 -- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0013fb30 msgr2=0x7f7d00158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0013fb30 0x7f7d00158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 -- 172.21.15.53:0/4242713337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d00151580 con 0x7f7cec0047d0 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cfeffd640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7d00152620 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000d4a0 tx=0x7f7cf000d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cf77fe640 1 -- 172.21.15.53:0/4242713337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0005480 con 0x7f7cec0047d0 2024-09-13T18:30:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cf77fe640 1 -- 172.21.15.53:0/4242713337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0007030 con 0x7f7cec0047d0 2024-09-13T18:30:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d00151860 con 0x7f7cec0047d0 2024-09-13T18:30:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7cf77fe640 1 -- 172.21.15.53:0/4242713337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00073e0 con 0x7f7cec0047d0 2024-09-13T18:30:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d00151e20 con 0x7f7cec0047d0 2024-09-13T18:30:47.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.114+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d00067400 con 0x7f7cec0047d0 2024-09-13T18:30:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.118+0000 7f7cf77fe640 1 -- 172.21.15.53:0/4242713337 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f7cf0007540 con 0x7f7cec0047d0 2024-09-13T18:30:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.118+0000 7f7cf77fe640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce00667e0 0x7f7ce0068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.118+0000 7f7cf77fe640 1 -- 172.21.15.53:0/4242713337 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7cf0083c70 con 0x7f7cec0047d0 2024-09-13T18:30:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.118+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce00667e0 0x7f7ce0068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.118+0000 7f7cfe7fc640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce00667e0 0x7f7ce0068ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80af000 tx=0x7f7ce8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.122+0000 7f7cf77fe640 1 -- 172.21.15.53:0/4242713337 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7cf0050eb0 con 0x7f7cec0047d0 2024-09-13T18:30:47.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.278+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d0006d480 con 0x7f7cec0047d0 2024-09-13T18:30:47.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7cf77fe640 1 -- 172.21.15.53:0/4242713337 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f7cf00544d0 con 0x7f7cec0047d0 2024-09-13T18:30:47.284 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:47.284 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:41.229329+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6833/3795700837":"2024-09-14T18:30:38.209515+0000","172.21.15.53:6832/3795700837":"2024-09-14T18:30:38.209515+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce00667e0 msgr2=0x7f7ce0068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce00667e0 0x7f7ce0068ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80af000 tx=0x7f7ce8008040 comp rx=0 tx=0).stop 2024-09-13T18:30:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 msgr2=0x7f7d00152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7d00152620 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000d4a0 tx=0x7f7cf000d960 comp rx=0 tx=0).stop 2024-09-13T18:30:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 shutdown_connections 2024-09-13T18:30:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce00667e0 0x7f7ce0068ca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d001e0e60 0x7f7d00150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0013fb30 0x7f7d00158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 --2- 172.21.15.53:0/4242713337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cec0047d0 0x7f7d00152620 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 >> 172.21.15.53:0/4242713337 conn(0x7f7d00065c80 msgr2=0x7f7d000af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:47.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 shutdown_connections 2024-09-13T18:30:47.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.282+0000 7f7d05535640 1 -- 172.21.15.53:0/4242713337 wait complete. 2024-09-13T18:30:47.302 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:30:47.302 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:47.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda2ba2e640 1 Processor -- start 2024-09-13T18:30:47.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda2ba2e640 1 -- start start 2024-09-13T18:30:47.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda2ba2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda2406b850 0x7fda240b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda2ba2e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cbd60 0x7fda240cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda2ba2e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240b1ac0 con 0x7fda240cb980 2024-09-13T18:30:47.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda2ba2e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240b3010 con 0x7fda2406b850 2024-09-13T18:30:47.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda2ba2e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda24159ac0 con 0x7fda240cbd60 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda28fc9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda2406b850 0x7fda240b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda297ca640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fda240cb980 0x7fda2406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41824/0 (socket says 172.21.15.53:41824) 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda28fc9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda2406b850 0x7fda240b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52252/0 (socket says 172.21.15.53:52252) 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda297ca640 1 -- 172.21.15.53:0/1696069472 learned_addr learned my addr 172.21.15.53:0/1696069472 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda29fcb640 1 --2- 172.21.15.53:0/1696069472 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cbd60 0x7fda240cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda28fc9640 1 -- 172.21.15.53:0/1696069472 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cbd60 msgr2=0x7fda240cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda28fc9640 1 --2- 172.21.15.53:0/1696069472 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cbd60 0x7fda240cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda28fc9640 1 -- 172.21.15.53:0/1696069472 >> v1:172.21.15.53:6789/0 conn(0x7fda240cb980 legacy=0x7fda2406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda28fc9640 1 -- 172.21.15.53:0/1696069472 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24159da0 con 0x7fda2406b850 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda23fff640 1 -- 172.21.15.53:0/1696069472 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509321515 0 0) 0x7fda240b1ac0 con 0x7fda240cb980 2024-09-13T18:30:47.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda29fcb640 1 --2- 172.21.15.53:0/1696069472 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cbd60 0x7fda240cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:47.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda28fc9640 1 --2- 172.21.15.53:0/1696069472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda2406b850 0x7fda240b33b0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fda180097c0 tx=0x7fda1801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a000a17692d10111 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda23fff640 1 -- 172.21.15.53:0/1696069472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180ac640 con 0x7fda2406b850 2024-09-13T18:30:47.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda23fff640 1 -- 172.21.15.53:0/1696069472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda180ac7a0 con 0x7fda2406b850 2024-09-13T18:30:47.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.414+0000 7fda23fff640 1 -- 172.21.15.53:0/1696069472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180acb30 con 0x7fda2406b850 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- 172.21.15.53:0/1696069472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda2406b850 msgr2=0x7fda240b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/1696069472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda2406b850 0x7fda240b33b0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fda180097c0 tx=0x7fda1801c3e0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- 172.21.15.53:0/1696069472 shutdown_connections 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/1696069472 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cbd60 0x7fda240cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/1696069472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda2406b850 0x7fda240b33b0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- 172.21.15.53:0/1696069472 >> 172.21.15.53:0/1696069472 conn(0x7fda24065c80 msgr2=0x7fda24066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- 172.21.15.53:0/1696069472 shutdown_connections 2024-09-13T18:30:47.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- 172.21.15.53:0/1696069472 wait complete. 2024-09-13T18:30:47.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 Processor -- start 2024-09-13T18:30:47.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- start start 2024-09-13T18:30:47.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2406b850 0x7fda2415f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cb980 0x7fda24148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda240cbd60 0x7fda2414ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240aead0 con 0x7fda240cbd60 2024-09-13T18:30:47.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241497f0 con 0x7fda2406b850 2024-09-13T18:30:47.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda24149ad0 con 0x7fda240cb980 2024-09-13T18:30:47.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda240cbd60 0x7fda2414ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda240cbd60 0x7fda2414ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52256/0 (socket says 172.21.15.53:52256) 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 -- 172.21.15.53:0/739827969 learned_addr learned my addr 172.21.15.53:0/739827969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda28fc9640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cb980 0x7fda24148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda297ca640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2406b850 0x7fda2415f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 -- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cb980 msgr2=0x7fda24148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cb980 0x7fda24148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 -- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2406b850 msgr2=0x7fda2415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2406b850 0x7fda2415f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 -- 172.21.15.53:0/739827969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda18009420 con 0x7fda240cbd60 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda29fcb640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda240cbd60 0x7fda2414ef10 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00ce80 tx=0x7fda1c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda21ffb640 1 -- 172.21.15.53:0/739827969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00d840 con 0x7fda240cbd60 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda21ffb640 1 -- 172.21.15.53:0/739827969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00d9e0 con 0x7fda240cbd60 2024-09-13T18:30:47.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda241494c0 con 0x7fda240cbd60 2024-09-13T18:30:47.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda21ffb640 1 -- 172.21.15.53:0/739827969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00dd90 con 0x7fda240cbd60 2024-09-13T18:30:47.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.418+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2415e1b0 con 0x7fda240cbd60 2024-09-13T18:30:47.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.422+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda24067400 con 0x7fda240cbd60 2024-09-13T18:30:47.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.422+0000 7fda21ffb640 1 -- 172.21.15.53:0/739827969 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fda1c015440 con 0x7fda240cbd60 2024-09-13T18:30:47.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.422+0000 7fda21ffb640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda100667b0 0x7fda10068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.422+0000 7fda21ffb640 1 -- 172.21.15.53:0/739827969 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fda1c084ca0 con 0x7fda240cbd60 2024-09-13T18:30:47.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.422+0000 7fda297ca640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda100667b0 0x7fda10068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.422+0000 7fda297ca640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda100667b0 0x7fda10068c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda14000f70 tx=0x7fda14007b60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.426+0000 7fda21ffb640 1 -- 172.21.15.53:0/739827969 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda1c051f50 con 0x7fda240cbd60 2024-09-13T18:30:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda240aec10 con 0x7fda240cbd60 2024-09-13T18:30:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda21ffb640 1 -- 172.21.15.53:0/739827969 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fda240aec10 con 0x7fda240cbd60 2024-09-13T18:30:47.620 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:47.621 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2807450918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2807450918},{"type":"v1","addr":"172.21.15.87:6833","nonce":2807450918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3225281050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3225281050},{"type":"v1","addr":"172.21.15.87:6835","nonce":3225281050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1870582127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1870582127},{"type":"v1","addr":"172.21.15.53:6833","nonce":1870582127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:30:17.824687+0000","modified":"2024-09-13T18:30:20.838202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2118447408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2118447408},{"type":"v1","addr":"172.21.15.53:6835","nonce":2118447408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:30:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 54 2024-09-13T18:30:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda100667b0 msgr2=0x7fda10068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda100667b0 0x7fda10068c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda14000f70 tx=0x7fda14007b60 comp rx=0 tx=0).stop 2024-09-13T18:30:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda240cbd60 msgr2=0x7fda2414ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda240cbd60 0x7fda2414ef10 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00ce80 tx=0x7fda1c00a710 comp rx=0 tx=0).stop 2024-09-13T18:30:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 shutdown_connections 2024-09-13T18:30:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda100667b0 0x7fda10068c70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda240cb980 0x7fda24148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda240cbd60 0x7fda2414ef10 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 --2- 172.21.15.53:0/739827969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda2406b850 0x7fda2415f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 >> 172.21.15.53:0/739827969 conn(0x7fda24065c80 msgr2=0x7fda2406f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:47.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.618+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 shutdown_connections 2024-09-13T18:30:47.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.622+0000 7fda2ba2e640 1 -- 172.21.15.53:0/739827969 wait complete. 2024-09-13T18:30:47.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f4d88e640 1 Processor -- start 2024-09-13T18:30:47.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f4d88e640 1 -- start start 2024-09-13T18:30:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f4d88e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 0x7f8f480b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f4d88e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f480cbd60 0x7f8f480cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f4d88e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f480b1ac0 con 0x7f8f4806b850 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f4d88e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f480b3010 con 0x7f8f480cbd60 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f4d88e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48159ac0 con 0x7f8f480cb980 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8f4806b850 0x7f8f4806fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41828/0 (socket says 172.21.15.53:41828) 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 -- 172.21.15.53:0/1220970118 learned_addr learned my addr 172.21.15.53:0/1220970118 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049028823 0 0) 0x7f8f480b1ac0 con 0x7f8f4806b850 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f477fe640 1 --2- 172.21.15.53:0/1220970118 >> v2:172.21.15.87:3300/0 conn(0x7f8f480cbd60 0x7f8f480cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003530 con 0x7f8f4806b850 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 0x7f8f480b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887233551 0 0) 0x7f8f30003530 con 0x7f8f4806b850 2024-09-13T18:30:47.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 msgr2=0x7f8f480b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 0x7f8f480b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 >> v2:172.21.15.87:3300/0 conn(0x7f8f480cbd60 msgr2=0x7f8f480cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 --2- 172.21.15.53:0/1220970118 >> v2:172.21.15.87:3300/0 conn(0x7f8f480cbd60 0x7f8f480cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f48159da0 con 0x7f8f4806b850 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8f3c001680 con 0x7f8f4806b850 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 >> v1:172.21.15.53:6789/0 conn(0x7f8f4806b850 legacy=0x7f8f4806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 0x7f8f30003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004d10 0x7f8f30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480b3010 con 0x7f8f30003f00 2024-09-13T18:30:47.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48159ac0 con 0x7f8f30004d10 2024-09-13T18:30:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3000b9e0 con 0x7f8f480cb980 2024-09-13T18:30:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 0x7f8f30003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 -- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 msgr2=0x7f8f30003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 0x7f8f30003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 -- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004d10 msgr2=0x7f8f30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:47.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f477fe640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004d10 0x7f8f30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f30004d10 0x7f8f30005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f467fc640 1 -- 172.21.15.53:0/1220970118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30003530 con 0x7f8f30003f00 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.762+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480cb980 0x7f8f30003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f467fc640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f300047d0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c210 tx=0x7f8f3c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ed0188944c048b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c005ae0 con 0x7f8f30003f00 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c005c40 con 0x7f8f30003f00 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f45ffb640 1 -- 172.21.15.53:0/1220970118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0a5af0 con 0x7f8f30003f00 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- 172.21.15.53:0/1220970118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 msgr2=0x7f8f300047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 --2- 172.21.15.53:0/1220970118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f300047d0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c210 tx=0x7f8f3c01cbd0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f477fe640 1 -- 172.21.15.53:0/1220970118 reap_dead start 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- 172.21.15.53:0/1220970118 shutdown_connections 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- 172.21.15.53:0/1220970118 >> 172.21.15.53:0/1220970118 conn(0x7f8f48065c80 msgr2=0x7f8f48066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- 172.21.15.53:0/1220970118 shutdown_connections 2024-09-13T18:30:47.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- 172.21.15.53:0/1220970118 wait complete. 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 Processor -- start 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- start start 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f48164100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f48162ab0 0x7f8f481f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4806f600 0x7f8f4806fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48144820 con 0x7f8f30003f00 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4806ffc0 con 0x7f8f4806f600 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f4d88e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f481f9390 con 0x7f8f48162ab0 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f48164100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f48164100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52280/0 (socket says 172.21.15.53:52280) 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.766+0000 7f8f46ffd640 1 -- 172.21.15.53:0/141377622 learned_addr learned my addr 172.21.15.53:0/141377622 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f467fc640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f48162ab0 0x7f8f481f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f477fe640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4806f600 0x7f8f4806fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f46ffd640 1 -- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f48162ab0 msgr2=0x7f8f481f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f48162ab0 0x7f8f481f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f46ffd640 1 -- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4806f600 msgr2=0x7f8f4806fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4806f600 0x7f8f4806fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f46ffd640 1 -- 172.21.15.53:0/141377622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f48164930 con 0x7f8f30003f00 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f477fe640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4806f600 0x7f8f4806fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f48164100 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f8f38010900 tx=0x7f8f38010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f2ffff640 1 -- 172.21.15.53:0/141377622 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38004220 con 0x7f8f30003f00 2024-09-13T18:30:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f2ffff640 1 -- 172.21.15.53:0/141377622 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38004380 con 0x7f8f30003f00 2024-09-13T18:30:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f481f8f00 con 0x7f8f30003f00 2024-09-13T18:30:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f2ffff640 1 -- 172.21.15.53:0/141377622 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800eb40 con 0x7f8f30003f00 2024-09-13T18:30:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f481f88b0 con 0x7f8f30003f00 2024-09-13T18:30:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f48067400 con 0x7f8f30003f00 2024-09-13T18:30:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f2ffff640 1 -- 172.21.15.53:0/141377622 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8f3800eca0 con 0x7f8f30003f00 2024-09-13T18:30:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f2ffff640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f340667e0 0x7f8f34068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f2ffff640 1 -- 172.21.15.53:0/141377622 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8f38084780 con 0x7f8f30003f00 2024-09-13T18:30:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f467fc640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f340667e0 0x7f8f34068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.770+0000 7f8f467fc640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f340667e0 0x7f8f34068ca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0ab000 tx=0x7f8f3c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.774+0000 7f8f2ffff640 1 -- 172.21.15.53:0/141377622 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f38051a60 con 0x7f8f30003f00 2024-09-13T18:30:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.962+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f48164930 con 0x7f8f30003f00 2024-09-13T18:30:47.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f2ffff640 1 -- 172.21.15.53:0/141377622 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f8f48164930 con 0x7f8f30003f00 2024-09-13T18:30:47.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:47.967 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2807450918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2807450918},{"type":"v1","addr":"172.21.15.87:6833","nonce":2807450918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3225281050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3225281050},{"type":"v1","addr":"172.21.15.87:6835","nonce":3225281050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1870582127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1870582127},{"type":"v1","addr":"172.21.15.53:6833","nonce":1870582127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:30:17.824687+0000","modified":"2024-09-13T18:30:20.838202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7431":{"gid":7431,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2118447408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2118447408},{"type":"v1","addr":"172.21.15.53:6835","nonce":2118447408}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:30:47.967 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 54 2024-09-13T18:30:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f340667e0 msgr2=0x7f8f34068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f340667e0 0x7f8f34068ca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0ab000 tx=0x7f8f3c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 msgr2=0x7f8f48164100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f48164100 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f8f38010900 tx=0x7f8f38010dc0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 shutdown_connections 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f340667e0 0x7f8f34068ca0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f48162ab0 0x7f8f481f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4806f600 0x7f8f4806fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 --2- 172.21.15.53:0/141377622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f30003f00 0x7f8f48164100 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 >> 172.21.15.53:0/141377622 conn(0x7f8f48065c80 msgr2=0x7f8f4814e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 shutdown_connections 2024-09-13T18:30:47.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:47.966+0000 7f8f4d88e640 1 -- 172.21.15.53:0/141377622 wait complete. 2024-09-13T18:30:47.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.090+0000 7ffb263ea640 1 Processor -- start 2024-09-13T18:30:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.090+0000 7ffb263ea640 1 -- start start 2024-09-13T18:30:48.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb263ea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 0x7ffb200ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb263ea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb200cc270 con 0x7ffb2006d080 2024-09-13T18:30:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb263ea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2006d510 con 0x7ffb20143ec0 2024-09-13T18:30:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb263ea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb200cd530 con 0x7ffb200713f0 2024-09-13T18:30:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb2006d080 0x7ffb20070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41838/0 (socket says 172.21.15.53:41838) 2024-09-13T18:30:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1f7fe640 1 -- 172.21.15.53:0/3828496613 learned_addr learned my addr 172.21.15.53:0/3828496613 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb24987640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 0x7ffb200ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807125788 0 0) 0x7ffb200cc270 con 0x7ffb2006d080 2024-09-13T18:30:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb08003530 con 0x7ffb2006d080 2024-09-13T18:30:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863926277 0 0) 0x7ffb08003530 con 0x7ffb2006d080 2024-09-13T18:30:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 msgr2=0x7ffb200ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 0x7ffb200ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 >> v1:172.21.15.87:6789/0 conn(0x7ffb20143ec0 legacy=0x7ffb2006c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb200cc510 con 0x7ffb2006d080 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ffb10001a00 con 0x7ffb2006d080 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 >> v1:172.21.15.53:6789/0 conn(0x7ffb2006d080 legacy=0x7ffb20070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 0x7ffb080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08004d10 0x7ffb08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb200cd530 con 0x7ffb080039b0 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0800ba70 con 0x7ffb08004d10 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0800bc30 con 0x7ffb200713f0 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1ffff640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1f7fe640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 0x7ffb080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb24987640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08004d10 0x7ffb08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1ffff640 1 -- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 msgr2=0x7ffb080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1ffff640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb200713f0 0x7ffb080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1ffff640 1 -- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08004d10 msgr2=0x7ffb08005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1ffff640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08004d10 0x7ffb08005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb1ffff640 1 -- 172.21.15.53:0/3828496613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08003530 con 0x7ffb080039b0 2024-09-13T18:30:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.094+0000 7ffb24987640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb08004d10 0x7ffb08005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb08003dd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7ffb14001750 tx=0x7ffb1401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d1ef681a32cdc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140052d0 con 0x7ffb080039b0 2024-09-13T18:30:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb140a7050 con 0x7ffb080039b0 2024-09-13T18:30:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1effd640 1 -- 172.21.15.53:0/3828496613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14003600 con 0x7ffb080039b0 2024-09-13T18:30:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- 172.21.15.53:0/3828496613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 msgr2=0x7ffb08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 --2- 172.21.15.53:0/3828496613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb08003dd0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7ffb14001750 tx=0x7ffb1401c3e0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb24987640 1 -- 172.21.15.53:0/3828496613 reap_dead start 2024-09-13T18:30:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- 172.21.15.53:0/3828496613 shutdown_connections 2024-09-13T18:30:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- 172.21.15.53:0/3828496613 >> 172.21.15.53:0/3828496613 conn(0x7ffb20065c80 msgr2=0x7ffb20066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- 172.21.15.53:0/3828496613 shutdown_connections 2024-09-13T18:30:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- 172.21.15.53:0/3828496613 wait complete. 2024-09-13T18:30:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 Processor -- start 2024-09-13T18:30:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- start start 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb20158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb2015d4f0 0x7ffb200b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb200ac8e0 0x7ffb200acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb200b31d0 con 0x7ffb080039b0 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb200ad2a0 con 0x7ffb200ac8e0 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20159150 con 0x7ffb2015d4f0 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb20158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb20158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52292/0 (socket says 172.21.15.53:52292) 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 -- 172.21.15.53:0/2620973910 learned_addr learned my addr 172.21.15.53:0/2620973910 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb24987640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb200ac8e0 0x7ffb200acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1f7fe640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb2015d4f0 0x7ffb200b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 -- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb2015d4f0 msgr2=0x7ffb200b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb2015d4f0 0x7ffb200b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 -- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb200ac8e0 msgr2=0x7ffb200acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb200ac8e0 0x7ffb200acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 -- 172.21.15.53:0/2620973910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2015c310 con 0x7ffb080039b0 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1f7fe640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb2015d4f0 0x7ffb200b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb24987640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb200ac8e0 0x7ffb200acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1ffff640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb20158c10 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7ffb14001750 tx=0x7ffb08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1cff9640 1 -- 172.21.15.53:0/2620973910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007040 con 0x7ffb080039b0 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1cff9640 1 -- 172.21.15.53:0/2620973910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb140071a0 con 0x7ffb080039b0 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2015c5f0 con 0x7ffb080039b0 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb1cff9640 1 -- 172.21.15.53:0/2620973910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14007510 con 0x7ffb080039b0 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.098+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2015cbb0 con 0x7ffb080039b0 2024-09-13T18:30:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.102+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb20067400 con 0x7ffb080039b0 2024-09-13T18:30:48.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.102+0000 7ffb1cff9640 1 -- 172.21.15.53:0/2620973910 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7ffb140067e0 con 0x7ffb080039b0 2024-09-13T18:30:48.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.102+0000 7ffb1cff9640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb0c0667e0 0x7ffb0c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.102+0000 7ffb1cff9640 1 -- 172.21.15.53:0/2620973910 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ffb1411f3b0 con 0x7ffb080039b0 2024-09-13T18:30:48.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.102+0000 7ffb1f7fe640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb0c0667e0 0x7ffb0c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.102+0000 7ffb1f7fe640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb0c0667e0 0x7ffb0c068ca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb10001590 tx=0x7ffb10001520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.106+0000 7ffb1cff9640 1 -- 172.21.15.53:0/2620973910 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb140eff10 con 0x7ffb080039b0 2024-09-13T18:30:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.258+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb20070ce0 con 0x7ffb080039b0 2024-09-13T18:30:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb1cff9640 1 -- 172.21.15.53:0/2620973910 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16629 (secure 0 0 0) 0x7ffb140efaa0 con 0x7ffb080039b0 2024-09-13T18:30:48.264 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:48.264 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:41.229329+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:16.211649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:16.801150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6833/3795700837":"2024-09-14T18:30:38.209515+0000","172.21.15.53:6832/3795700837":"2024-09-14T18:30:38.209515+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb0c0667e0 msgr2=0x7ffb0c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb0c0667e0 0x7ffb0c068ca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb10001590 tx=0x7ffb10001520 comp rx=0 tx=0).stop 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 msgr2=0x7ffb20158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb20158c10 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7ffb14001750 tx=0x7ffb08005800 comp rx=0 tx=0).stop 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 shutdown_connections 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb0c0667e0 0x7ffb0c068ca0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb2015d4f0 0x7ffb200b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb200ac8e0 0x7ffb200acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 --2- 172.21.15.53:0/2620973910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb080039b0 0x7ffb20158c10 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 >> 172.21.15.53:0/2620973910 conn(0x7ffb20065c80 msgr2=0x7ffb200add20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 shutdown_connections 2024-09-13T18:30:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.262+0000 7ffb263ea640 1 -- 172.21.15.53:0/2620973910 wait complete. 2024-09-13T18:30:48.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:30:48.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f5784cd0640 1 Processor -- start 2024-09-13T18:30:48.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f5784cd0640 1 -- start start 2024-09-13T18:30:48.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f5784cd0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57800b0fb0 0x7f578015b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f5784cd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578006f710 0x7f57800ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f5784cd0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5780158410 con 0x7f5780158030 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f5784cd0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5780070720 con 0x7f57800b0fb0 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f5784cd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578006fe80 con 0x7f578006f710 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f577dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57800b0fb0 0x7f578015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f577dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57800b0fb0 0x7f578015b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52300/0 (socket says 172.21.15.53:52300) 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f577dd9b640 1 -- 172.21.15.53:0/3651750390 learned_addr learned my addr 172.21.15.53:0/3651750390 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f577dd9b640 1 -- 172.21.15.53:0/3651750390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578006f710 msgr2=0x7f57800ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f577dd9b640 1 --2- 172.21.15.53:0/3651750390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578006f710 0x7f57800ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f577dd9b640 1 -- 172.21.15.53:0/3651750390 >> v1:172.21.15.87:6789/0 conn(0x7f5780158030 legacy=0x7f57800b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:48.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.398+0000 7f577dd9b640 1 -- 172.21.15.53:0/3651750390 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780070160 con 0x7f57800b0fb0 2024-09-13T18:30:48.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f577dd9b640 1 --2- 172.21.15.53:0/3651750390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800b0fb0 0x7f578015b560 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f5768009870 tx=0x7f576801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca190cf8bce4491f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f577d59a640 1 -- 172.21.15.53:0/3651750390 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680aa610 con 0x7f57800b0fb0 2024-09-13T18:30:48.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f577d59a640 1 -- 172.21.15.53:0/3651750390 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57680a6040 con 0x7f57800b0fb0 2024-09-13T18:30:48.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f577d59a640 1 -- 172.21.15.53:0/3651750390 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680aa990 con 0x7f57800b0fb0 2024-09-13T18:30:48.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651750390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800b0fb0 msgr2=0x7f578015b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651750390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800b0fb0 0x7f578015b560 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f5768009870 tx=0x7f576801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651750390 shutdown_connections 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651750390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f578006f710 0x7f57800ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651750390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800b0fb0 0x7f578015b560 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651750390 >> 172.21.15.53:0/3651750390 conn(0x7f5780066080 msgr2=0x7f5780066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651750390 shutdown_connections 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651750390 wait complete. 2024-09-13T18:30:48.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 Processor -- start 2024-09-13T18:30:48.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- start start 2024-09-13T18:30:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578006f710 0x7f5780155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57800b0fb0 0x7f57800a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5780158030 0x7f57800a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5780155970 con 0x7f5780158030 2024-09-13T18:30:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57800aaf20 con 0x7f578006f710 2024-09-13T18:30:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.402+0000 7f5784cd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5780163c10 con 0x7f57800b0fb0 2024-09-13T18:30:48.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5780158030 0x7f57800a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5780158030 0x7f57800a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52314/0 (socket says 172.21.15.53:52314) 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 -- 172.21.15.53:0/3651000734 learned_addr learned my addr 172.21.15.53:0/3651000734 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577e59c640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578006f710 0x7f5780155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577dd9b640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57800b0fb0 0x7f57800a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 -- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57800b0fb0 msgr2=0x7f57800a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57800b0fb0 0x7f57800a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 -- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578006f710 msgr2=0x7f5780155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578006f710 0x7f5780155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 -- 172.21.15.53:0/3651000734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680094d0 con 0x7f5780158030 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577e59c640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578006f710 0x7f5780155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577ed9d640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5780158030 0x7f57800a8a10 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f577000b970 tx=0x7f577000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5776ffd640 1 -- 172.21.15.53:0/3651000734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577000cb40 con 0x7f5780158030 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5776ffd640 1 -- 172.21.15.53:0/3651000734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577000ccc0 con 0x7f5780158030 2024-09-13T18:30:48.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5780163ef0 con 0x7f5780158030 2024-09-13T18:30:48.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5776ffd640 1 -- 172.21.15.53:0/3651000734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770014680 con 0x7f5780158030 2024-09-13T18:30:48.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57800ab4a0 con 0x7f5780158030 2024-09-13T18:30:48.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57800ab690 con 0x7f5780158030 2024-09-13T18:30:48.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5776ffd640 1 -- 172.21.15.53:0/3651000734 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f577001d3b0 con 0x7f5780158030 2024-09-13T18:30:48.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5776ffd640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57600667b0 0x7f5760068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f5776ffd640 1 -- 172.21.15.53:0/3651000734 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5770084320 con 0x7f5780158030 2024-09-13T18:30:48.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577e59c640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57600667b0 0x7f5760068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.406+0000 7f577e59c640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57600667b0 0x7f5760068c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f57800adb60 tx=0x7f5778008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.410+0000 7f5776ffd640 1 -- 172.21.15.53:0/3651000734 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5770051520 con 0x7f5780158030 2024-09-13T18:30:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.606+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f57800ccc40 con 0x7f5780158030 2024-09-13T18:30:48.611 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:30:48.610+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:30:48.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.622+0000 7f5776ffd640 1 -- 172.21.15.53:0/3651000734 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5770054b40 con 0x7f5780158030 2024-09-13T18:30:48.625 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57600667b0 msgr2=0x7f5760068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57600667b0 0x7f5760068c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f57800adb60 tx=0x7f5778008040 comp rx=0 tx=0).stop 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5780158030 msgr2=0x7f57800a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5780158030 0x7f57800a8a10 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f577000b970 tx=0x7f577000be30 comp rx=0 tx=0).stop 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 shutdown_connections 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57600667b0 0x7f5760068c70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57800b0fb0 0x7f57800a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5780158030 0x7f57800a8a10 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 --2- 172.21.15.53:0/3651000734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f578006f710 0x7f5780155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 >> 172.21.15.53:0/3651000734 conn(0x7f5780066080 msgr2=0x7f57800ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 shutdown_connections 2024-09-13T18:30:48.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.626+0000 7f5784cd0640 1 -- 172.21.15.53:0/3651000734 wait complete. 2024-09-13T18:30:48.630 INFO:tasks.ceph.mds.a.smithi053.stderr: -1585> 2024-09-13T18:30:19.415+0000 7f0f98c9e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:30:48.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:30:48.687 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:30:48.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.774+0000 7f972b927640 1 Processor -- start 2024-09-13T18:30:48.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.774+0000 7f972b927640 1 -- start start 2024-09-13T18:30:48.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f972b927640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f97240b22c0 0x7f972415b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f972b927640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f97240cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f972b927640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972415b0d0 con 0x7f97240b26a0 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f972b927640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972415ab70 con 0x7f97240b22c0 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f972b927640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97240b31e0 con 0x7f972406e060 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f97240b22c0 0x7f972415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f97240b22c0 0x7f972415b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52336/0 (socket says 172.21.15.53:52336) 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 -- 172.21.15.53:0/1686183827 learned_addr learned my addr 172.21.15.53:0/1686183827 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f9729ec4640 1 --2- 172.21.15.53:0/1686183827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f97240cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 -- 172.21.15.53:0/1686183827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 msgr2=0x7f97240cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 --2- 172.21.15.53:0/1686183827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f97240cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 -- 172.21.15.53:0/1686183827 >> v1:172.21.15.87:6789/0 conn(0x7f97240b26a0 legacy=0x7f97240b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 -- 172.21.15.53:0/1686183827 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972415baa0 con 0x7f97240b22c0 2024-09-13T18:30:48.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f9729ec4640 1 --2- 172.21.15.53:0/1686183827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f97240cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f97296c3640 1 --2- 172.21.15.53:0/1686183827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b22c0 0x7f972415b560 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f9720009870 tx=0x7f972001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4333057d88901a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f971bfff640 1 -- 172.21.15.53:0/1686183827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200ac620 con 0x7f97240b22c0 2024-09-13T18:30:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f971bfff640 1 -- 172.21.15.53:0/1686183827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200ac780 con 0x7f97240b22c0 2024-09-13T18:30:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.778+0000 7f971bfff640 1 -- 172.21.15.53:0/1686183827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200acb10 con 0x7f97240b22c0 2024-09-13T18:30:48.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/1686183827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b22c0 msgr2=0x7f972415b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 --2- 172.21.15.53:0/1686183827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b22c0 0x7f972415b560 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f9720009870 tx=0x7f972001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/1686183827 shutdown_connections 2024-09-13T18:30:48.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 --2- 172.21.15.53:0/1686183827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f97240cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 --2- 172.21.15.53:0/1686183827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b22c0 0x7f972415b560 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/1686183827 >> 172.21.15.53:0/1686183827 conn(0x7f97240ceb80 msgr2=0x7f97240cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/1686183827 shutdown_connections 2024-09-13T18:30:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/1686183827 wait complete. 2024-09-13T18:30:48.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 Processor -- start 2024-09-13T18:30:48.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- start start 2024-09-13T18:30:48.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f972414e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97240b22c0 0x7f972414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b26a0 0x7f9724154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972414fba0 con 0x7f97240b26a0 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972414fe80 con 0x7f97240b22c0 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9724150160 con 0x7f972406e060 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b26a0 0x7f9724154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b26a0 0x7f9724154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52342/0 (socket says 172.21.15.53:52342) 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 -- 172.21.15.53:0/2766733136 learned_addr learned my addr 172.21.15.53:0/2766733136 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f97296c3640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f972414e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9728ec2640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97240b22c0 0x7f972414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 -- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 msgr2=0x7f972414e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f972414e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 -- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97240b22c0 msgr2=0x7f972414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97240b22c0 0x7f972414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 -- 172.21.15.53:0/2766733136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97200094d0 con 0x7f97240b26a0 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9728ec2640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97240b22c0 0x7f972414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9729ec4640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b26a0 0x7f9724154060 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f971c00cd50 tx=0x7f971c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9719ffb640 1 -- 172.21.15.53:0/2766733136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c00f680 con 0x7f97240b26a0 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9719ffb640 1 -- 172.21.15.53:0/2766733136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c00f800 con 0x7f97240b26a0 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9724150440 con 0x7f97240b26a0 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f9719ffb640 1 -- 172.21.15.53:0/2766733136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c00fbb0 con 0x7f97240b26a0 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972414eef0 con 0x7f97240b26a0 2024-09-13T18:30:48.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.782+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9724160bf0 con 0x7f97240b26a0 2024-09-13T18:30:48.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.786+0000 7f9719ffb640 1 -- 172.21.15.53:0/2766733136 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f971c00b040 con 0x7f97240b26a0 2024-09-13T18:30:48.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.786+0000 7f9719ffb640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f97080667b0 0x7f9708068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:48.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.786+0000 7f9719ffb640 1 -- 172.21.15.53:0/2766733136 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f971c084db0 con 0x7f97240b26a0 2024-09-13T18:30:48.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.786+0000 7f97296c3640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f97080667b0 0x7f9708068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:48.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.786+0000 7f97296c3640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f97080667b0 0x7f9708068c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f97200ae000 tx=0x7f97200a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:48.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.790+0000 7f9719ffb640 1 -- 172.21.15.53:0/2766733136 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9724160bf0 con 0x7f97240b26a0 2024-09-13T18:30:48.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:48.986+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9724160bf0 con 0x7f97240b26a0 2024-09-13T18:30:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.622+0000 7f9719ffb640 1 -- 172.21.15.53:0/2766733136 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9724160bf0 con 0x7f97240b26a0 2024-09-13T18:30:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f97080667b0 msgr2=0x7f9708068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f97080667b0 0x7f9708068c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f97200ae000 tx=0x7f97200a7000 comp rx=0 tx=0).stop 2024-09-13T18:30:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b26a0 msgr2=0x7f9724154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b26a0 0x7f9724154060 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f971c00cd50 tx=0x7f971c00a650 comp rx=0 tx=0).stop 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 shutdown_connections 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f97080667b0 0x7f9708068c70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97240b26a0 0x7f9724154060 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97240b22c0 0x7f972414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 --2- 172.21.15.53:0/2766733136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f972406e060 0x7f972414e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 >> 172.21.15.53:0/2766733136 conn(0x7f97240ceb80 msgr2=0x7f97240cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 shutdown_connections 2024-09-13T18:30:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.626+0000 7f972b927640 1 -- 172.21.15.53:0/2766733136 wait complete. 2024-09-13T18:30:49.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.830+0000 7fd4ab4f2640 1 Processor -- start 2024-09-13T18:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.830+0000 7fd4ab4f2640 1 -- start start 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.830+0000 7fd4ab4f2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4a40cdb70 0x7fd4a40cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.830+0000 7fd4ab4f2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4a40cf620 0x7fd4a40b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.830+0000 7fd4ab4f2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a40cfa50 con 0x7fd4a415c860 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.830+0000 7fd4ab4f2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40d1b20 con 0x7fd4a40cdb70 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.830+0000 7fd4ab4f2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a40d1d10 con 0x7fd4a40cf620 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a928e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd4a415c860 0x7fd4a40d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41848/0 (socket says 172.21.15.53:41848) 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a928e640 1 -- 172.21.15.53:0/3258677928 learned_addr learned my addr 172.21.15.53:0/3258677928 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a8a8d640 1 --2- 172.21.15.53:0/3258677928 >> v2:172.21.15.53:3300/0 conn(0x7fd4a40cdb70 0x7fd4a40cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:49.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a9a8f640 1 --2- 172.21.15.53:0/3258677928 >> v2:172.21.15.87:3300/0 conn(0x7fd4a40cf620 0x7fd4a40b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a8a8d640 1 -- 172.21.15.53:0/3258677928 >> v2:172.21.15.87:3300/0 conn(0x7fd4a40cf620 msgr2=0x7fd4a40b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a8a8d640 1 --2- 172.21.15.53:0/3258677928 >> v2:172.21.15.87:3300/0 conn(0x7fd4a40cf620 0x7fd4a40b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a8a8d640 1 -- 172.21.15.53:0/3258677928 >> v1:172.21.15.53:6789/0 conn(0x7fd4a415c860 legacy=0x7fd4a40d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a8a8d640 1 -- 172.21.15.53:0/3258677928 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a40d1ff0 con 0x7fd4a40cdb70 2024-09-13T18:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd4a8a8d640 1 --2- 172.21.15.53:0/3258677928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a40cf0e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40b20e0 tx=0x7fd49401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb7d72fd4431b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd49bfff640 1 -- 172.21.15.53:0/3258677928 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940a8970 con 0x7fd4a40cdb70 2024-09-13T18:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd49bfff640 1 -- 172.21.15.53:0/3258677928 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940a8ad0 con 0x7fd4a40cdb70 2024-09-13T18:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.834+0000 7fd49bfff640 1 -- 172.21.15.53:0/3258677928 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940a8e60 con 0x7fd4a40cdb70 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/3258677928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 msgr2=0x7fd4a40cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/3258677928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a40cf0e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40b20e0 tx=0x7fd49401ec70 comp rx=0 tx=0).stop 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/3258677928 shutdown_connections 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/3258677928 >> v2:172.21.15.87:3300/0 conn(0x7fd4a40cf620 0x7fd4a40b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/3258677928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a40cf0e0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/3258677928 >> 172.21.15.53:0/3258677928 conn(0x7fd4a4065c80 msgr2=0x7fd4a4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/3258677928 shutdown_connections 2024-09-13T18:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/3258677928 wait complete. 2024-09-13T18:30:49.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 Processor -- start 2024-09-13T18:30:49.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- start start 2024-09-13T18:30:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a41e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4a40cf620 0x7fd4a415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4a415c860 0x7fd4a40b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a415e980 con 0x7fd4a40cdb70 2024-09-13T18:30:49.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a41e5200 con 0x7fd4a40cf620 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a41e54a0 con 0x7fd4a415c860 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a41e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a41e5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52366/0 (socket says 172.21.15.53:52366) 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 -- 172.21.15.53:0/116895659 learned_addr learned my addr 172.21.15.53:0/116895659 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a8a8d640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4a40cf620 0x7fd4a415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a9a8f640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4a415c860 0x7fd4a40b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 -- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4a415c860 msgr2=0x7fd4a40b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4a415c860 0x7fd4a40b7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 -- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4a40cf620 msgr2=0x7fd4a415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4a40cf620 0x7fd4a415e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 -- 172.21.15.53:0/116895659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494009420 con 0x7fd4a40cdb70 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a8a8d640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4a40cf620 0x7fd4a415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4a928e640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a41e5f60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c400 tx=0x7fd4a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd499ffb640 1 -- 172.21.15.53:0/116895659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0005cf0 con 0x7fd4a40cdb70 2024-09-13T18:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd499ffb640 1 -- 172.21.15.53:0/116895659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0005e50 con 0x7fd4a40cdb70 2024-09-13T18:30:49.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a41e5780 con 0x7fd4a40cdb70 2024-09-13T18:30:49.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.838+0000 7fd499ffb640 1 -- 172.21.15.53:0/116895659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00072d0 con 0x7fd4a40cdb70 2024-09-13T18:30:49.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.842+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a415e670 con 0x7fd4a40cdb70 2024-09-13T18:30:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.842+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a41e64a0 con 0x7fd4a40cdb70 2024-09-13T18:30:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.842+0000 7fd499ffb640 1 -- 172.21.15.53:0/116895659 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd4a0007430 con 0x7fd4a40cdb70 2024-09-13T18:30:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.842+0000 7fd499ffb640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4880667b0 0x7fd488068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.842+0000 7fd499ffb640 1 -- 172.21.15.53:0/116895659 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd4a00837f0 con 0x7fd4a40cdb70 2024-09-13T18:30:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.842+0000 7fd4a8a8d640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4880667b0 0x7fd488068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:49.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.842+0000 7fd4a8a8d640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4880667b0 0x7fd488068c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4940b2000 tx=0x7fd4940aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:49.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:49.846+0000 7fd499ffb640 1 -- 172.21.15.53:0/116895659 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4a0050a50 con 0x7fd4a40cdb70 2024-09-13T18:30:50.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.010+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4a40cf0e0 con 0x7fd4a40cdb70 2024-09-13T18:30:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:30:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.630+0000 7fd499ffb640 1 -- 172.21.15.53:0/116895659 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd4a00170d0 con 0x7fd4a40cdb70 2024-09-13T18:30:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.634+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4880667b0 msgr2=0x7fd488068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.634+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4880667b0 0x7fd488068c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4940b2000 tx=0x7fd4940aa070 comp rx=0 tx=0).stop 2024-09-13T18:30:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.634+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 msgr2=0x7fd4a41e5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.634+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a41e5f60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c400 tx=0x7fd4a000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 shutdown_connections 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4880667b0 0x7fd488068c70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4a415c860 0x7fd4a40b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4a40cf620 0x7fd4a415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 --2- 172.21.15.53:0/116895659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4a40cdb70 0x7fd4a41e5f60 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 >> 172.21.15.53:0/116895659 conn(0x7fd4a4065c80 msgr2=0x7fd4a40d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 shutdown_connections 2024-09-13T18:30:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.638+0000 7fd4ab4f2640 1 -- 172.21.15.53:0/116895659 wait complete. 2024-09-13T18:30:50.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:30:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1cdb94640 1 Processor -- start 2024-09-13T18:30:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1cdb94640 1 -- start start 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1cdb94640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1c806ccc0 0x7fc1c806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1cdb94640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c8070fb0 con 0x7fc1c80cc800 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1cdb94640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c806d620 con 0x7fc1c815c5e0 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1cdb94640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c8070a10 con 0x7fc1c806ccc0 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1c7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc1c80cc800 0x7fc1c80ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41862/0 (socket says 172.21.15.53:41862) 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1c7fff640 1 -- 172.21.15.53:0/1658100847 learned_addr learned my addr 172.21.15.53:0/1658100847 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1658100847 >> v2:172.21.15.87:3300/0 conn(0x7fc1c806ccc0 0x7fc1c806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315877555 0 0) 0x7fc1c8070fb0 con 0x7fc1c80cc800 2024-09-13T18:30:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.790+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b0005740 con 0x7fc1c80cc800 2024-09-13T18:30:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1648105331 0 0) 0x7fc1b0005740 con 0x7fc1c80cc800 2024-09-13T18:30:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 >> v2:172.21.15.87:3300/0 conn(0x7fc1c806ccc0 msgr2=0x7fc1c806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 --2- 172.21.15.53:0/1658100847 >> v2:172.21.15.87:3300/0 conn(0x7fc1c806ccc0 0x7fc1c806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 >> v1:172.21.15.87:6789/0 conn(0x7fc1c815c5e0 legacy=0x7fc1c815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80711e0 con 0x7fc1c80cc800 2024-09-13T18:30:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc1c0001680 con 0x7fc1c80cc800 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 >> v1:172.21.15.53:6789/0 conn(0x7fc1c80cc800 legacy=0x7fc1c80ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b0005b90 0x7fc1b0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1b0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b00073a0 0x7fc1b000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8070a10 con 0x7fc1b00069e0 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000e240 con 0x7fc1b00073a0 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000e400 con 0x7fc1b0005b90 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1b0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c77fe640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b0005b90 0x7fc1b0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c7fff640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b00073a0 0x7fc1b000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c6ffd640 1 -- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b0005b90 msgr2=0x7fc1b0005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b0005b90 0x7fc1b0005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c6ffd640 1 -- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b00073a0 msgr2=0x7fc1b000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b00073a0 0x7fc1b000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c6ffd640 1 -- 172.21.15.53:0/1658100847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0005740 con 0x7fc1b00069e0 2024-09-13T18:30:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c77fe640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b0005b90 0x7fc1b0005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c7fff640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b00073a0 0x7fc1b000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c7fff640 1 -- 172.21.15.53:0/1658100847 reap_dead start 2024-09-13T18:30:50.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1b0006e60 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009ae0 tx=0x7fc1bc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ef5b0ca6c9bc07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:50.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0a5660 con 0x7fc1b00069e0 2024-09-13T18:30:50.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0a57c0 con 0x7fc1b00069e0 2024-09-13T18:30:50.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1c67fc640 1 -- 172.21.15.53:0/1658100847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0a5b70 con 0x7fc1b00069e0 2024-09-13T18:30:50.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1658100847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 msgr2=0x7fc1b0006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:50.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1b0006e60 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009ae0 tx=0x7fc1bc01ca70 comp rx=0 tx=0).stop 2024-09-13T18:30:50.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1658100847 shutdown_connections 2024-09-13T18:30:50.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1658100847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1b0006e60 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1658100847 >> 172.21.15.53:0/1658100847 conn(0x7fc1c8073330 msgr2=0x7fc1c8065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:50.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.794+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1658100847 shutdown_connections 2024-09-13T18:30:50.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1658100847 wait complete. 2024-09-13T18:30:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 Processor -- start 2024-09-13T18:30:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 -- start start 2024-09-13T18:30:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1c813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1c8152a80 0x7fc1c8140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1c8154c30 0x7fc1c80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c81402a0 con 0x7fc1b00069e0 2024-09-13T18:30:50.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8150df0 con 0x7fc1c8154c30 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8150ac0 con 0x7fc1c8152a80 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1c813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1c813fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52376/0 (socket says 172.21.15.53:52376) 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 -- 172.21.15.53:0/1884625670 learned_addr learned my addr 172.21.15.53:0/1884625670 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1c8152a80 0x7fc1c8140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c7fff640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1c8154c30 0x7fc1c80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 -- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1c8152a80 msgr2=0x7fc1c8140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1c8152a80 0x7fc1c8140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 -- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1c8154c30 msgr2=0x7fc1c80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1c8154c30 0x7fc1c80ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 -- 172.21.15.53:0/1884625670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8152f60 con 0x7fc1b00069e0 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1c77fe640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1c813fd60 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800e780 tx=0x7fc1b800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1affff640 1 -- 172.21.15.53:0/1884625670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8017070 con 0x7fc1b00069e0 2024-09-13T18:30:50.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1affff640 1 -- 172.21.15.53:0/1884625670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b800ee90 con 0x7fc1b00069e0 2024-09-13T18:30:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1affff640 1 -- 172.21.15.53:0/1884625670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8003b90 con 0x7fc1b00069e0 2024-09-13T18:30:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c8153240 con 0x7fc1b00069e0 2024-09-13T18:30:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.798+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c8153520 con 0x7fc1b00069e0 2024-09-13T18:30:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.802+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c8150910 con 0x7fc1b00069e0 2024-09-13T18:30:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.802+0000 7fc1affff640 1 -- 172.21.15.53:0/1884625670 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc1b8003cf0 con 0x7fc1b00069e0 2024-09-13T18:30:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.802+0000 7fc1affff640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc1b40667e0 0x7fc1b4068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.802+0000 7fc1affff640 1 -- 172.21.15.53:0/1884625670 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5443+0+0 (secure 0 0 0) 0x7fc1b8083a90 con 0x7fc1b00069e0 2024-09-13T18:30:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.802+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc1b40667e0 0x7fc1b4068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:50.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.802+0000 7fc1c6ffd640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc1b40667e0 0x7fc1b4068ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0af000 tx=0x7fc1bc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:50.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.806+0000 7fc1affff640 1 -- 172.21.15.53:0/1884625670 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1b8050de0 con 0x7fc1b00069e0 2024-09-13T18:30:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:50.978+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1c80cc250 con 0x7fc1b00069e0 2024-09-13T18:30:51.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.638+0000 7fc1affff640 1 -- 172.21.15.53:0/1884625670 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc1b8054400 con 0x7fc1b00069e0 2024-09-13T18:30:51.641 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc1b40667e0 msgr2=0x7fc1b4068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc1b40667e0 0x7fc1b4068ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0af000 tx=0x7fc1bc008040 comp rx=0 tx=0).stop 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 msgr2=0x7fc1c813fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1c813fd60 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800e780 tx=0x7fc1b800ec40 comp rx=0 tx=0).stop 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 shutdown_connections 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc1b40667e0 0x7fc1b4068ca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1c8152a80 0x7fc1c8140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1c8154c30 0x7fc1c80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 --2- 172.21.15.53:0/1884625670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00069e0 0x7fc1c813fd60 secure :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800e780 tx=0x7fc1b800ec40 comp rx=0 tx=0).stop 2024-09-13T18:30:51.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 >> 172.21.15.53:0/1884625670 conn(0x7fc1c8073330 msgr2=0x7fc1c8159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:51.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 shutdown_connections 2024-09-13T18:30:51.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.642+0000 7fc1cdb94640 1 -- 172.21.15.53:0/1884625670 wait complete. 2024-09-13T18:30:51.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:30:51.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.790+0000 7f5a06740640 1 Processor -- start 2024-09-13T18:30:51.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.790+0000 7f5a06740640 1 -- start start 2024-09-13T18:30:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a06740640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a000d3390 0x7f5a000cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a06740640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000b7db0 con 0x7f5a000ccd10 2024-09-13T18:30:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a06740640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000d0650 con 0x7f5a0015c830 2024-09-13T18:30:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a06740640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a000d0c10 con 0x7f5a000d3390 2024-09-13T18:30:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5a000ccd10 0x7f5a000d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41874/0 (socket says 172.21.15.53:41874) 2024-09-13T18:30:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 -- 172.21.15.53:0/2076551354 learned_addr learned my addr 172.21.15.53:0/2076551354 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:51.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a04cdd640 1 --2- 172.21.15.53:0/2076551354 >> v2:172.21.15.87:3300/0 conn(0x7f5a000d3390 0x7f5a000cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34856208 0 0) 0x7f5a000b7db0 con 0x7f5a000ccd10 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e8003530 con 0x7f5a000ccd10 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3731899874 0 0) 0x7f59e8003530 con 0x7f5a000ccd10 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 >> v2:172.21.15.87:3300/0 conn(0x7f5a000d3390 msgr2=0x7f5a000cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 --2- 172.21.15.53:0/2076551354 >> v2:172.21.15.87:3300/0 conn(0x7f5a000d3390 0x7f5a000cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 >> v1:172.21.15.87:6789/0 conn(0x7f5a0015c830 legacy=0x7f5a000d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000d17b0 con 0x7f5a000ccd10 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f59f4001680 con 0x7f5a000ccd10 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a04cdd640 1 --2- 172.21.15.53:0/2076551354 >> v2:172.21.15.87:3300/0 conn(0x7f5a000d3390 0x7f5a000cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:51.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 >> v1:172.21.15.53:6789/0 conn(0x7f5a000ccd10 legacy=0x7f5a000d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59e8003980 0x7f59e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f59e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59e8005190 0x7f59e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000d0c10 con 0x7f59e80047d0 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e800c030 con 0x7f59e8005190 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e800c1f0 con 0x7f59e8003980 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f59e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a04cdd640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59e8005190 0x7f59e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59fffff640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59e8003980 0x7f59e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 -- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59e8003980 msgr2=0x7f59e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59e8003980 0x7f59e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 -- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59e8005190 msgr2=0x7f59e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59e8005190 0x7f59e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59ff7fe640 1 -- 172.21.15.53:0/2076551354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8003530 con 0x7f59e80047d0 2024-09-13T18:30:51.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f5a04cdd640 1 -- 172.21.15.53:0/2076551354 reap_dead start 2024-09-13T18:30:51.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.794+0000 7f59fffff640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59e8003980 0x7f59e8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f59e8004c50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c210 tx=0x7f59f401f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2233ad7f54b8ca17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4005ae0 con 0x7f59e80047d0 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f40ab070 con 0x7f59e80047d0 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f59feffd640 1 -- 172.21.15.53:0/2076551354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4007070 con 0x7f59e80047d0 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- 172.21.15.53:0/2076551354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 msgr2=0x7f59e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f59e8004c50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c210 tx=0x7f59f401f350 comp rx=0 tx=0).stop 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- 172.21.15.53:0/2076551354 shutdown_connections 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 --2- 172.21.15.53:0/2076551354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f59e8004c50 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- 172.21.15.53:0/2076551354 >> 172.21.15.53:0/2076551354 conn(0x7f5a00070970 msgr2=0x7f5a00070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- 172.21.15.53:0/2076551354 shutdown_connections 2024-09-13T18:30:51.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- 172.21.15.53:0/2076551354 wait complete. 2024-09-13T18:30:51.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 Processor -- start 2024-09-13T18:30:51.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- start start 2024-09-13T18:30:51.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f5a000c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a001f1e80 0x7f5a00158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a0015aa40 0x7f5a0015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0015b400 con 0x7f59e80047d0 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000c6300 con 0x7f5a0015aa40 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a06740640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a001f2e70 con 0x7f5a001f1e80 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f59fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f5a000c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f59fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f5a000c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52394/0 (socket says 172.21.15.53:52394) 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f59fffff640 1 -- 172.21.15.53:0/821395011 learned_addr learned my addr 172.21.15.53:0/821395011 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.798+0000 7f5a04cdd640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a0015aa40 0x7f5a0015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a001f1e80 0x7f5a00158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fffff640 1 -- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a001f1e80 msgr2=0x7f5a00158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fffff640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a001f1e80 0x7f5a00158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fffff640 1 -- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a0015aa40 msgr2=0x7f5a0015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fffff640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a0015aa40 0x7f5a0015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fffff640 1 -- 172.21.15.53:0/821395011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a001f25d0 con 0x7f59e80047d0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a001f1e80 0x7f5a00158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f5a04cdd640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a0015aa40 0x7f5a0015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fffff640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f5a000c8f40 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d4a0 tx=0x7f59f000d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fcff9640 1 -- 172.21.15.53:0/821395011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0005480 con 0x7f59e80047d0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fcff9640 1 -- 172.21.15.53:0/821395011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f0007030 con 0x7f59e80047d0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a001f28b0 con 0x7f59e80047d0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fcff9640 1 -- 172.21.15.53:0/821395011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f00073e0 con 0x7f59e80047d0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a000cae80 con 0x7f59e80047d0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a000cb040 con 0x7f59e80047d0 2024-09-13T18:30:51.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fcff9640 1 -- 172.21.15.53:0/821395011 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f59f0007540 con 0x7f59e80047d0 2024-09-13T18:30:51.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fcff9640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f59ec0667b0 0x7f59ec068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59fcff9640 1 -- 172.21.15.53:0/821395011 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f59f00839d0 con 0x7f59e80047d0 2024-09-13T18:30:51.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f59ec0667b0 0x7f59ec068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.802+0000 7f59ff7fe640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f59ec0667b0 0x7f59ec068c70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ae000 tx=0x7f59f4007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:51.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.806+0000 7f59fcff9640 1 -- 172.21.15.53:0/821395011 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59f0050f10 con 0x7f59e80047d0 2024-09-13T18:30:51.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.970+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5a000cace0 con 0x7f59e80047d0 2024-09-13T18:30:51.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.974+0000 7f59fcff9640 1 -- 172.21.15.53:0/821395011 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5a000cace0 con 0x7f59e80047d0 2024-09-13T18:30:51.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f59ec0667b0 msgr2=0x7f59ec068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f59ec0667b0 0x7f59ec068c70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59f40ae000 tx=0x7f59f4007040 comp rx=0 tx=0).stop 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 msgr2=0x7f5a000c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f5a000c8f40 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d4a0 tx=0x7f59f000d960 comp rx=0 tx=0).stop 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 shutdown_connections 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f59ec0667b0 0x7f59ec068c70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5a001f1e80 0x7f5a00158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a0015aa40 0x7f5a0015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 --2- 172.21.15.53:0/821395011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59e80047d0 0x7f5a000c8f40 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 >> 172.21.15.53:0/821395011 conn(0x7f5a00070970 msgr2=0x7f5a000b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 shutdown_connections 2024-09-13T18:30:51.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:51.978+0000 7f5a06740640 1 -- 172.21.15.53:0/821395011 wait complete. 2024-09-13T18:30:51.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-13T18:30:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7c60e5640 1 Processor -- start 2024-09-13T18:30:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7c60e5640 1 -- start start 2024-09-13T18:30:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7c60e5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7c01582a0 0x7fc7c006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7c60e5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c015b7c0 0x7fc7c006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7c60e5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c006d480 con 0x7fc7c0070c90 2024-09-13T18:30:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7c60e5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c015aaf0 con 0x7fc7c01582a0 2024-09-13T18:30:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7c60e5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c006d760 con 0x7fc7c015b7c0 2024-09-13T18:30:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7beffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c015b7c0 0x7fc7c006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7bf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7c01582a0 0x7fc7c006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7beffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c015b7c0 0x7fc7c006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:34526/0 (socket says 172.21.15.53:34526) 2024-09-13T18:30:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7beffd640 1 -- 172.21.15.53:0/3475219090 learned_addr learned my addr 172.21.15.53:0/3475219090 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7beffd640 1 -- 172.21.15.53:0/3475219090 >> v2:172.21.15.87:3300/0 conn(0x7fc7c01582a0 msgr2=0x7fc7c006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7beffd640 1 --2- 172.21.15.53:0/3475219090 >> v2:172.21.15.87:3300/0 conn(0x7fc7c01582a0 0x7fc7c006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7beffd640 1 -- 172.21.15.53:0/3475219090 >> v1:172.21.15.87:6789/0 conn(0x7fc7c0070c90 legacy=0x7fc7c006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.118+0000 7fc7beffd640 1 -- 172.21.15.53:0/3475219090 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c015ace0 con 0x7fc7c015b7c0 2024-09-13T18:30:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7beffd640 1 --2- 172.21.15.53:0/3475219090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c015b7c0 0x7fc7c006ce40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009870 tx=0x7fc7b401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d561336a6b6bc7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7be7fc640 1 -- 172.21.15.53:0/3475219090 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40a7070 con 0x7fc7c015b7c0 2024-09-13T18:30:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7be7fc640 1 -- 172.21.15.53:0/3475219090 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b40ab430 con 0x7fc7c015b7c0 2024-09-13T18:30:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7be7fc640 1 -- 172.21.15.53:0/3475219090 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40ab7c0 con 0x7fc7c015b7c0 2024-09-13T18:30:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 -- 172.21.15.53:0/3475219090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c015b7c0 msgr2=0x7fc7c006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/3475219090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c015b7c0 0x7fc7c006ce40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009870 tx=0x7fc7b401c530 comp rx=0 tx=0).stop 2024-09-13T18:30:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 -- 172.21.15.53:0/3475219090 shutdown_connections 2024-09-13T18:30:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/3475219090 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c015b7c0 0x7fc7c006ce40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/3475219090 >> v2:172.21.15.87:3300/0 conn(0x7fc7c01582a0 0x7fc7c006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 -- 172.21.15.53:0/3475219090 >> 172.21.15.53:0/3475219090 conn(0x7fc7c0065c80 msgr2=0x7fc7c0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 -- 172.21.15.53:0/3475219090 shutdown_connections 2024-09-13T18:30:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 -- 172.21.15.53:0/3475219090 wait complete. 2024-09-13T18:30:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 Processor -- start 2024-09-13T18:30:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.122+0000 7fc7c60e5640 1 -- start start 2024-09-13T18:30:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7c0070c90 0x7fc7c014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7c01582a0 0x7fc7c00b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c00b1a60 0x7fc7c00b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01486d0 con 0x7fc7c01582a0 2024-09-13T18:30:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b2b80 con 0x7fc7c0070c90 2024-09-13T18:30:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b1f70 con 0x7fc7c00b1a60 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7c01582a0 0x7fc7c00b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7c01582a0 0x7fc7c00b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52406/0 (socket says 172.21.15.53:52406) 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 -- 172.21.15.53:0/1951081076 learned_addr learned my addr 172.21.15.53:0/1951081076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7bf7fe640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7c0070c90 0x7fc7c014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7bffff640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c00b1a60 0x7fc7c00b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 -- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c00b1a60 msgr2=0x7fc7c00b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c00b1a60 0x7fc7c00b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 -- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7c0070c90 msgr2=0x7fc7c014b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7c0070c90 0x7fc7c014b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 -- 172.21.15.53:0/1951081076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b40094d0 con 0x7fc7c01582a0 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7bffff640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c00b1a60 0x7fc7c00b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7beffd640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7c01582a0 0x7fc7c00b1520 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc7b401abe0 tx=0x7fc7b40192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7a7fff640 1 -- 172.21.15.53:0/1951081076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4004220 con 0x7fc7c01582a0 2024-09-13T18:30:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7a7fff640 1 -- 172.21.15.53:0/1951081076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b40abe90 con 0x7fc7c01582a0 2024-09-13T18:30:52.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c00b2250 con 0x7fc7c01582a0 2024-09-13T18:30:52.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7a7fff640 1 -- 172.21.15.53:0/1951081076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4003620 con 0x7fc7c01582a0 2024-09-13T18:30:52.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c00b2810 con 0x7fc7c01582a0 2024-09-13T18:30:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c0067400 con 0x7fc7c01582a0 2024-09-13T18:30:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7a7fff640 1 -- 172.21.15.53:0/1951081076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc7b4003780 con 0x7fc7c01582a0 2024-09-13T18:30:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7a7fff640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc7ac0667e0 0x7fc7ac068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7a7fff640 1 -- 172.21.15.53:0/1951081076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc7b411d890 con 0x7fc7c01582a0 2024-09-13T18:30:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.126+0000 7fc7bf7fe640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc7ac0667e0 0x7fc7ac068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.130+0000 7fc7bf7fe640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc7ac0667e0 0x7fc7ac068ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009ac0 tx=0x7fc7b0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.134+0000 7fc7a7fff640 1 -- 172.21.15.53:0/1951081076 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7b40eab70 con 0x7fc7c01582a0 2024-09-13T18:30:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.358+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) v1 -- 0x7fc7c006f370 con 0x7fc7c01582a0 2024-09-13T18:30:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.642+0000 7fc7a7fff640 1 -- 172.21.15.53:0/1951081076 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v321) v1 ==== 146+0+0 (secure 0 0 0) 0x7fc7b40ee190 con 0x7fc7c01582a0 2024-09-13T18:30:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc7ac0667e0 msgr2=0x7fc7ac068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc7ac0667e0 0x7fc7ac068ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009ac0 tx=0x7fc7b0009190 comp rx=0 tx=0).stop 2024-09-13T18:30:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7c01582a0 msgr2=0x7fc7c00b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7c01582a0 0x7fc7c00b1520 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fc7b401abe0 tx=0x7fc7b40192d0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 shutdown_connections 2024-09-13T18:30:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc7ac0667e0 0x7fc7ac068ca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7c00b1a60 0x7fc7c00b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7c01582a0 0x7fc7c00b1520 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 --2- 172.21.15.53:0/1951081076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7c0070c90 0x7fc7c014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 >> 172.21.15.53:0/1951081076 conn(0x7fc7c0065c80 msgr2=0x7fc7c00aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 shutdown_connections 2024-09-13T18:30:52.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.646+0000 7fc7c60e5640 1 -- 172.21.15.53:0/1951081076 wait complete. 2024-09-13T18:30:52.671 INFO:tasks.cephfs_test_runner:Test the creating vols, subvols subvolgroups fails when their names uses ... ok 2024-09-13T18:30:52.671 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-13T18:30:52.671 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:30:52.671 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:52.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc60b609640 1 Processor -- start 2024-09-13T18:30:52.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc60b609640 1 -- start start 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc60b609640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc60b609640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc60415cb60 0x7fc60406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc60b609640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60415db50 con 0x7fc6040b46b0 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc60b609640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60406c5b0 con 0x7fc60415cb60 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc60b609640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60415d2b0 con 0x7fc604066390 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc609ba6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc60415cb60 0x7fc60406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc609ba6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc60415cb60 0x7fc60406ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52410/0 (socket says 172.21.15.53:52410) 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc609ba6640 1 -- 172.21.15.53:0/159841084 learned_addr learned my addr 172.21.15.53:0/159841084 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc608ba4640 1 --2- 172.21.15.53:0/159841084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc609ba6640 1 -- 172.21.15.53:0/159841084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 msgr2=0x7fc6040708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:52.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc609ba6640 1 --2- 172.21.15.53:0/159841084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc609ba6640 1 -- 172.21.15.53:0/159841084 >> v1:172.21.15.87:6789/0 conn(0x7fc6040b46b0 legacy=0x7fc604065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:52.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.798+0000 7fc609ba6640 1 -- 172.21.15.53:0/159841084 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60415d590 con 0x7fc60415cb60 2024-09-13T18:30:52.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc609ba6640 1 --2- 172.21.15.53:0/159841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc60415cb60 0x7fc60406ca40 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009e50 tx=0x7fc5fc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedf01666a313fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc5fbfff640 1 -- 172.21.15.53:0/159841084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0a56f0 con 0x7fc60415cb60 2024-09-13T18:30:52.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc5fbfff640 1 -- 172.21.15.53:0/159841084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0a5850 con 0x7fc60415cb60 2024-09-13T18:30:52.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc5fbfff640 1 -- 172.21.15.53:0/159841084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0a5be0 con 0x7fc60415cb60 2024-09-13T18:30:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- 172.21.15.53:0/159841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc60415cb60 msgr2=0x7fc60406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 --2- 172.21.15.53:0/159841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc60415cb60 0x7fc60406ca40 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009e50 tx=0x7fc5fc01c960 comp rx=0 tx=0).stop 2024-09-13T18:30:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- 172.21.15.53:0/159841084 shutdown_connections 2024-09-13T18:30:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 --2- 172.21.15.53:0/159841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc60415cb60 0x7fc60406ca40 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 --2- 172.21.15.53:0/159841084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- 172.21.15.53:0/159841084 >> 172.21.15.53:0/159841084 conn(0x7fc604073130 msgr2=0x7fc604069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- 172.21.15.53:0/159841084 shutdown_connections 2024-09-13T18:30:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- 172.21.15.53:0/159841084 wait complete. 2024-09-13T18:30:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 Processor -- start 2024-09-13T18:30:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- start start 2024-09-13T18:30:52.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6040b46b0 0x7fc6041575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60415cb60 0x7fc604157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60415eff0 con 0x7fc6040b46b0 2024-09-13T18:30:52.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040ce750 con 0x7fc60415cb60 2024-09-13T18:30:52.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.802+0000 7fc60b609640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cec80 con 0x7fc604066390 2024-09-13T18:30:52.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6040b46b0 0x7fc6041575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6040b46b0 0x7fc6041575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52420/0 (socket says 172.21.15.53:52420) 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 -- 172.21.15.53:0/3240568726 learned_addr learned my addr 172.21.15.53:0/3240568726 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc6093a5640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc609ba6640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60415cb60 0x7fc604157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 -- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 msgr2=0x7fc6040b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 -- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60415cb60 msgr2=0x7fc604157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60415cb60 0x7fc604157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 -- 172.21.15.53:0/3240568726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc009b30 con 0x7fc6040b46b0 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc609ba6640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60415cb60 0x7fc604157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc608ba4640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6040b46b0 0x7fc6041575c0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400d600 tx=0x7fc5f400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc5f9ffb640 1 -- 172.21.15.53:0/3240568726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40125f0 con 0x7fc6040b46b0 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc5f9ffb640 1 -- 172.21.15.53:0/3240568726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f4012750 con 0x7fc6040b46b0 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6040ce9a0 con 0x7fc6040b46b0 2024-09-13T18:30:52.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc5f9ffb640 1 -- 172.21.15.53:0/3240568726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4012ae0 con 0x7fc6040b46b0 2024-09-13T18:30:52.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc604156240 con 0x7fc6040b46b0 2024-09-13T18:30:52.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6040708d0 con 0x7fc6040b46b0 2024-09-13T18:30:52.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc5f9ffb640 1 -- 172.21.15.53:0/3240568726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc5f4012c40 con 0x7fc6040b46b0 2024-09-13T18:30:52.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc5f9ffb640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5e80667b0 0x7fc5e8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc5f9ffb640 1 -- 172.21.15.53:0/3240568726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc5f4084380 con 0x7fc6040b46b0 2024-09-13T18:30:52.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc6093a5640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5e80667b0 0x7fc5e8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.806+0000 7fc6093a5640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5e80667b0 0x7fc5e8068c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc60415e8a0 tx=0x7fc600009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.810+0000 7fc5f9ffb640 1 -- 172.21.15.53:0/3240568726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5f4051910 con 0x7fc6040b46b0 2024-09-13T18:30:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.970+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc60406b3d0 con 0x7fc6040b46b0 2024-09-13T18:30:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.970+0000 7fc5f9ffb640 1 -- 172.21.15.53:0/3240568726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13057 (secure 0 0 0) 0x7fc5f4054f30 con 0x7fc6040b46b0 2024-09-13T18:30:52.974 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:52.975 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":97,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:51.630755+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/2118447408":"2024-09-14T18:30:48.610947+0000","172.21.15.53:6834/2118447408":"2024-09-14T18:30:48.610947+0000","172.21.15.53:6833/3795700837":"2024-09-14T18:30:38.209515+0000","172.21.15.53:6832/3795700837":"2024-09-14T18:30:38.209515+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5e80667b0 msgr2=0x7fc5e8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5e80667b0 0x7fc5e8068c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc60415e8a0 tx=0x7fc600009060 comp rx=0 tx=0).stop 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6040b46b0 msgr2=0x7fc6041575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6040b46b0 0x7fc6041575c0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400d600 tx=0x7fc5f400dac0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 shutdown_connections 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5e80667b0 0x7fc5e8068c70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60415cb60 0x7fc604157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6040b46b0 0x7fc6041575c0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 --2- 172.21.15.53:0/3240568726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc604066390 0x7fc6040b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 >> 172.21.15.53:0/3240568726 conn(0x7fc604073130 msgr2=0x7fc604065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 shutdown_connections 2024-09-13T18:30:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:52.978+0000 7fc60b609640 1 -- 172.21.15.53:0/3240568726 wait complete. 2024-09-13T18:30:52.995 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:52.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:53.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 Processor -- start 2024-09-13T18:30:53.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 -- start start 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e6415fd60 0x7f6e640cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e640cd580 0x7f6e640cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e640cf5e0 0x7f6e640b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e640cd9a0 con 0x7f6e640cd580 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e64160ca0 con 0x7f6e640cf5e0 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e6b64c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640cfa90 con 0x7f6e6415fd60 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e640cd580 0x7f6e640cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6e640cd580 0x7f6e640cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52430/0 (socket says 172.21.15.53:52430) 2024-09-13T18:30:53.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 -- 172.21.15.53:0/1668645388 learned_addr learned my addr 172.21.15.53:0/1668645388 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:53.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e693e8640 1 --2- 172.21.15.53:0/1668645388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e6415fd60 0x7f6e640cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e69be9640 1 --2- 172.21.15.53:0/1668645388 >> v2:172.21.15.87:3300/0 conn(0x7f6e640cf5e0 0x7f6e640b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 -- 172.21.15.53:0/1668645388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e6415fd60 msgr2=0x7f6e640cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:53.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 --2- 172.21.15.53:0/1668645388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e6415fd60 0x7f6e640cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 -- 172.21.15.53:0/1668645388 >> v2:172.21.15.87:3300/0 conn(0x7f6e640cf5e0 msgr2=0x7f6e640b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:53.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 --2- 172.21.15.53:0/1668645388 >> v2:172.21.15.87:3300/0 conn(0x7f6e640cf5e0 0x7f6e640b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.122+0000 7f6e68be7640 1 -- 172.21.15.53:0/1668645388 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e64161130 con 0x7f6e640cd580 2024-09-13T18:30:53.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e68be7640 1 --2- 172.21.15.53:0/1668645388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e640cd580 0x7f6e640cf0a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6e640ccf70 tx=0x7f6e5401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda88bc75242f206 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e5bfff640 1 -- 172.21.15.53:0/1668645388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540a89d0 con 0x7f6e640cd580 2024-09-13T18:30:53.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e5bfff640 1 -- 172.21.15.53:0/1668645388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e540a8b30 con 0x7f6e640cd580 2024-09-13T18:30:53.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e5bfff640 1 -- 172.21.15.53:0/1668645388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540b0440 con 0x7f6e640cd580 2024-09-13T18:30:53.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1668645388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e640cd580 msgr2=0x7f6e640cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1668645388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e640cd580 0x7f6e640cf0a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6e640ccf70 tx=0x7f6e5401ed10 comp rx=0 tx=0).stop 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1668645388 shutdown_connections 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1668645388 >> v2:172.21.15.87:3300/0 conn(0x7f6e640cf5e0 0x7f6e640b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1668645388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e640cd580 0x7f6e640cf0a0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1668645388 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e6415fd60 0x7f6e640cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1668645388 >> 172.21.15.53:0/1668645388 conn(0x7f6e64070970 msgr2=0x7f6e64070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1668645388 shutdown_connections 2024-09-13T18:30:53.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.126+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1668645388 wait complete. 2024-09-13T18:30:53.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 Processor -- start 2024-09-13T18:30:53.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 -- start start 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e640cd580 0x7f6e641f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e640cf5e0 0x7f6e640c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e6415fd60 0x7f6e640b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e641f3220 con 0x7f6e6415fd60 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640c9fe0 con 0x7f6e640cf5e0 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640ca2c0 con 0x7f6e640cd580 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e6415fd60 0x7f6e640b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e6415fd60 0x7f6e640b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52438/0 (socket says 172.21.15.53:52438) 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 -- 172.21.15.53:0/1636769656 learned_addr learned my addr 172.21.15.53:0/1636769656 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:53.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e693e8640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e640cd580 0x7f6e641f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e68be7640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e640cf5e0 0x7f6e640c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 -- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e640cd580 msgr2=0x7f6e641f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e640cd580 0x7f6e641f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 -- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e640cf5e0 msgr2=0x7f6e640c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e640cf5e0 0x7f6e640c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 -- 172.21.15.53:0/1636769656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540094d0 con 0x7f6e6415fd60 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e68be7640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e640cf5e0 0x7f6e640c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e69be9640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e6415fd60 0x7f6e640b0c60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c007e60 tx=0x7f6e5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e59ffb640 1 -- 172.21.15.53:0/1636769656 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c014620 con 0x7f6e6415fd60 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e59ffb640 1 -- 172.21.15.53:0/1636769656 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c00ee90 con 0x7f6e6415fd60 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e640ca5a0 con 0x7f6e6415fd60 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e59ffb640 1 -- 172.21.15.53:0/1636769656 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0149e0 con 0x7f6e6415fd60 2024-09-13T18:30:53.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e640c9cf0 con 0x7f6e6415fd60 2024-09-13T18:30:53.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6415d5e0 con 0x7f6e6415fd60 2024-09-13T18:30:53.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e59ffb640 1 -- 172.21.15.53:0/1636769656 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f6e5c014b40 con 0x7f6e6415fd60 2024-09-13T18:30:53.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.130+0000 7f6e59ffb640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e480667b0 0x7f6e48068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.134+0000 7f6e59ffb640 1 -- 172.21.15.53:0/1636769656 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6e5c085820 con 0x7f6e6415fd60 2024-09-13T18:30:53.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.134+0000 7f6e693e8640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e480667b0 0x7f6e48068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.134+0000 7f6e693e8640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e480667b0 0x7f6e48068c70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000b930 tx=0x7f6e60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.134+0000 7f6e59ffb640 1 -- 172.21.15.53:0/1636769656 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e5c052e00 con 0x7f6e6415fd60 2024-09-13T18:30:53.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e641f3360 con 0x7f6e6415fd60 2024-09-13T18:30:53.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e59ffb640 1 -- 172.21.15.53:0/1636769656 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e5c056420 con 0x7f6e6415fd60 2024-09-13T18:30:53.292 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:53.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e480667b0 msgr2=0x7f6e48068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e480667b0 0x7f6e48068c70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000b930 tx=0x7f6e60008040 comp rx=0 tx=0).stop 2024-09-13T18:30:53.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e6415fd60 msgr2=0x7f6e640b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e6415fd60 0x7f6e640b0c60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c007e60 tx=0x7f6e5c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 shutdown_connections 2024-09-13T18:30:53.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e480667b0 0x7f6e48068c70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e6415fd60 0x7f6e640b0c60 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e640cf5e0 0x7f6e640c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 --2- 172.21.15.53:0/1636769656 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e640cd580 0x7f6e641f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.290+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 >> 172.21.15.53:0/1636769656 conn(0x7f6e64070970 msgr2=0x7f6e640d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.294+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 shutdown_connections 2024-09-13T18:30:53.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.294+0000 7f6e6b64c640 1 -- 172.21.15.53:0/1636769656 wait complete. 2024-09-13T18:30:53.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-13T18:30:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 Processor -- start 2024-09-13T18:30:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 -- start start 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8eac1582a0 0x7f8eac06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac15b7c0 0x7f8eac06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8eac070c90 0x7f8eac071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac15aaf0 con 0x7f8eac1582a0 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac06d760 con 0x7f8eac070c90 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb3a72640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac071650 con 0x7f8eac15b7c0 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8eac1582a0 0x7f8eac06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8eac1582a0 0x7f8eac06c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52444/0 (socket says 172.21.15.53:52444) 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 -- 172.21.15.53:0/1014799380 learned_addr learned my addr 172.21.15.53:0/1014799380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb100d640 1 --2- 172.21.15.53:0/1014799380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac15b7c0 0x7f8eac06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 -- 172.21.15.53:0/1014799380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac15b7c0 msgr2=0x7f8eac06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 --2- 172.21.15.53:0/1014799380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac15b7c0 0x7f8eac06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb200f640 1 --2- 172.21.15.53:0/1014799380 >> v2:172.21.15.87:3300/0 conn(0x7f8eac070c90 0x7f8eac071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 -- 172.21.15.53:0/1014799380 >> v2:172.21.15.87:3300/0 conn(0x7f8eac070c90 msgr2=0x7f8eac071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 --2- 172.21.15.53:0/1014799380 >> v2:172.21.15.87:3300/0 conn(0x7f8eac070c90 0x7f8eac071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb180e640 1 -- 172.21.15.53:0/1014799380 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac06d480 con 0x7f8eac1582a0 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb100d640 1 --2- 172.21.15.53:0/1014799380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac15b7c0 0x7f8eac06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.426+0000 7f8eb200f640 1 --2- 172.21.15.53:0/1014799380 >> v2:172.21.15.87:3300/0 conn(0x7f8eac070c90 0x7f8eac071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb180e640 1 --2- 172.21.15.53:0/1014799380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac1582a0 0x7f8eac06c900 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f8eac066c00 tx=0x7f8e9c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0240714ba1220d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb080c640 1 -- 172.21.15.53:0/1014799380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0aa610 con 0x7f8eac1582a0 2024-09-13T18:30:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb080c640 1 -- 172.21.15.53:0/1014799380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0a6040 con 0x7f8eac1582a0 2024-09-13T18:30:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb080c640 1 -- 172.21.15.53:0/1014799380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0aa990 con 0x7f8eac1582a0 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1014799380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac1582a0 msgr2=0x7f8eac06c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1014799380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac1582a0 0x7f8eac06c900 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f8eac066c00 tx=0x7f8e9c01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1014799380 shutdown_connections 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1014799380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac15b7c0 0x7f8eac06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1014799380 >> v2:172.21.15.87:3300/0 conn(0x7f8eac070c90 0x7f8eac071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1014799380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac1582a0 0x7f8eac06c900 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1014799380 >> 172.21.15.53:0/1014799380 conn(0x7f8eac065c80 msgr2=0x7f8eac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1014799380 shutdown_connections 2024-09-13T18:30:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1014799380 wait complete. 2024-09-13T18:30:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 Processor -- start 2024-09-13T18:30:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 -- start start 2024-09-13T18:30:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac070c90 0x7f8eac14bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.430+0000 7f8eb3a72640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac1582a0 0x7f8eac154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb3a72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac15b7c0 0x7f8eac14ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb3a72640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac14c510 con 0x7f8eac15b7c0 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb3a72640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac14f7e0 con 0x7f8eac1582a0 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb3a72640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac154390 con 0x7f8eac070c90 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac15b7c0 0x7f8eac14ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac15b7c0 0x7f8eac14ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52446/0 (socket says 172.21.15.53:52446) 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 -- 172.21.15.53:0/1953663480 learned_addr learned my addr 172.21.15.53:0/1953663480 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb100d640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac1582a0 0x7f8eac154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb180e640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac070c90 0x7f8eac14bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 -- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac070c90 msgr2=0x7f8eac14bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac070c90 0x7f8eac14bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 -- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac1582a0 msgr2=0x7f8eac154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac1582a0 0x7f8eac154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 -- 172.21.15.53:0/1953663480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0094d0 con 0x7f8eac15b7c0 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb100d640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac1582a0 0x7f8eac154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb200f640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac15b7c0 0x7f8eac14ab90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400cef0 tx=0x7f8ea400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8ea27fc640 1 -- 172.21.15.53:0/1953663480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400d840 con 0x7f8eac15b7c0 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8ea27fc640 1 -- 172.21.15.53:0/1953663480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea400d9a0 con 0x7f8eac15b7c0 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8ea27fc640 1 -- 172.21.15.53:0/1953663480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400dd50 con 0x7f8eac15b7c0 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac154670 con 0x7f8eac15b7c0 2024-09-13T18:30:53.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac155500 con 0x7f8eac15b7c0 2024-09-13T18:30:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac067400 con 0x7f8eac15b7c0 2024-09-13T18:30:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8ea27fc640 1 -- 172.21.15.53:0/1953663480 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8ea401e3b0 con 0x7f8eac15b7c0 2024-09-13T18:30:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8ea27fc640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8e900667b0 0x7f8e90068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8ea27fc640 1 -- 172.21.15.53:0/1953663480 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8ea4084a30 con 0x7f8eac15b7c0 2024-09-13T18:30:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb180e640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8e900667b0 0x7f8e90068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.434+0000 7f8eb180e640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8e900667b0 0x7f8e90068c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0ae000 tx=0x7f8e9c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.438+0000 7f8ea27fc640 1 -- 172.21.15.53:0/1953663480 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ea4051fc0 con 0x7f8eac15b7c0 2024-09-13T18:30:53.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:53.654+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) v1 -- 0x7f8eac0700e0 con 0x7f8eac15b7c0 2024-09-13T18:30:54.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.654+0000 7f8ea27fc640 1 -- 172.21.15.53:0/1953663480 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v323) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8ea401a0d0 con 0x7f8eac15b7c0 2024-09-13T18:30:54.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8e900667b0 msgr2=0x7f8e90068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8e900667b0 0x7f8e90068c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0ae000 tx=0x7f8e9c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:30:54.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac15b7c0 msgr2=0x7f8eac14ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac15b7c0 0x7f8eac14ab90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400cef0 tx=0x7f8ea400a710 comp rx=0 tx=0).stop 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 shutdown_connections 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8e900667b0 0x7f8e90068c70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8eac15b7c0 0x7f8eac14ab90 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8eac1582a0 0x7f8eac154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 --2- 172.21.15.53:0/1953663480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8eac070c90 0x7f8eac14bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 >> 172.21.15.53:0/1953663480 conn(0x7f8eac065c80 msgr2=0x7f8eac0aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 shutdown_connections 2024-09-13T18:30:54.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.658+0000 7f8eb3a72640 1 -- 172.21.15.53:0/1953663480 wait complete. 2024-09-13T18:30:54.684 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:30:54.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93a3be640 1 Processor -- start 2024-09-13T18:30:54.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93a3be640 1 -- start start 2024-09-13T18:30:54.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93a3be640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff93415c830 0x7ff9340d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93a3be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9340d3390 0x7ff9340cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93a3be640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340b7db0 con 0x7ff9340ccd10 2024-09-13T18:30:54.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93a3be640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9340d0650 con 0x7ff9340d3390 2024-09-13T18:30:54.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93a3be640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9340d0c10 con 0x7ff93415c830 2024-09-13T18:30:54.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93895b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9340d3390 0x7ff9340cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93895b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9340d3390 0x7ff9340cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52462/0 (socket says 172.21.15.53:52462) 2024-09-13T18:30:54.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93895b640 1 -- 172.21.15.53:0/1118278829 learned_addr learned my addr 172.21.15.53:0/1118278829 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:54.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff933fff640 1 --2- 172.21.15.53:0/1118278829 >> v2:172.21.15.87:3300/0 conn(0x7ff93415c830 0x7ff9340d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93895b640 1 -- 172.21.15.53:0/1118278829 >> v2:172.21.15.87:3300/0 conn(0x7ff93415c830 msgr2=0x7ff9340d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:54.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93895b640 1 --2- 172.21.15.53:0/1118278829 >> v2:172.21.15.87:3300/0 conn(0x7ff93415c830 0x7ff9340d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93895b640 1 -- 172.21.15.53:0/1118278829 >> v1:172.21.15.87:6789/0 conn(0x7ff9340ccd10 legacy=0x7ff9340d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:54.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.818+0000 7ff93895b640 1 -- 172.21.15.53:0/1118278829 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340cd7d0 con 0x7ff9340d3390 2024-09-13T18:30:54.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93895b640 1 --2- 172.21.15.53:0/1118278829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff9340cd180 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff9340d0240 tx=0x7ff92c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321d71f30dd2fff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:54.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff932ffd640 1 -- 172.21.15.53:0/1118278829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0a5760 con 0x7ff9340d3390 2024-09-13T18:30:54.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff932ffd640 1 -- 172.21.15.53:0/1118278829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c0a58c0 con 0x7ff9340d3390 2024-09-13T18:30:54.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff932ffd640 1 -- 172.21.15.53:0/1118278829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0a5c50 con 0x7ff9340d3390 2024-09-13T18:30:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- 172.21.15.53:0/1118278829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 msgr2=0x7ff9340cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 --2- 172.21.15.53:0/1118278829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff9340cd180 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff9340d0240 tx=0x7ff92c01c9b0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- 172.21.15.53:0/1118278829 shutdown_connections 2024-09-13T18:30:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 --2- 172.21.15.53:0/1118278829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff9340cd180 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 --2- 172.21.15.53:0/1118278829 >> v2:172.21.15.87:3300/0 conn(0x7ff93415c830 0x7ff9340d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- 172.21.15.53:0/1118278829 >> 172.21.15.53:0/1118278829 conn(0x7ff934070970 msgr2=0x7ff934070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:54.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- 172.21.15.53:0/1118278829 shutdown_connections 2024-09-13T18:30:54.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- 172.21.15.53:0/1118278829 wait complete. 2024-09-13T18:30:54.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 Processor -- start 2024-09-13T18:30:54.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- start start 2024-09-13T18:30:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9340ccd10 0x7ff9340cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff934155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff93415c830 0x7ff9341561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff934157f30 con 0x7ff9340d3390 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93415f040 con 0x7ff9340ccd10 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff93a3be640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93415f320 con 0x7ff93415c830 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff9337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff934155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.822+0000 7ff933fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9340ccd10 0x7ff9340cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff93895b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff93415c830 0x7ff9341561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff933fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9340ccd10 0x7ff9340cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:40602/0 (socket says 172.21.15.53:40602) 2024-09-13T18:30:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff933fff640 1 -- 172.21.15.53:0/766216879 learned_addr learned my addr 172.21.15.53:0/766216879 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff9337fe640 1 -- 172.21.15.53:0/766216879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff93415c830 msgr2=0x7ff9341561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff9337fe640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff93415c830 0x7ff9341561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff9337fe640 1 -- 172.21.15.53:0/766216879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9340ccd10 msgr2=0x7ff9340cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff9337fe640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9340ccd10 0x7ff9340cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff9337fe640 1 -- 172.21.15.53:0/766216879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c009b30 con 0x7ff9340d3390 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff9337fe640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff934155c90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c360 tx=0x7ff92800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff930ff9640 1 -- 172.21.15.53:0/766216879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928003600 con 0x7ff9340d3390 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff930ff9640 1 -- 172.21.15.53:0/766216879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928003760 con 0x7ff9340d3390 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93415f600 con 0x7ff9340d3390 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff930ff9640 1 -- 172.21.15.53:0/766216879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928003b50 con 0x7ff9340d3390 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9340cc780 con 0x7ff9340d3390 2024-09-13T18:30:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff934157a20 con 0x7ff9340d3390 2024-09-13T18:30:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff930ff9640 1 -- 172.21.15.53:0/766216879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7ff928003cb0 con 0x7ff9340d3390 2024-09-13T18:30:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff930ff9640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9200667b0 0x7ff920068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff930ff9640 1 -- 172.21.15.53:0/766216879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff928083570 con 0x7ff9340d3390 2024-09-13T18:30:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff933fff640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9200667b0 0x7ff920068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.826+0000 7ff933fff640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9200667b0 0x7ff920068c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff92400aaf0 tx=0x7ff924008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.830+0000 7ff930ff9640 1 -- 172.21.15.53:0/766216879 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff934157a20 con 0x7ff9340d3390 2024-09-13T18:30:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.994+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff934157a20 con 0x7ff9340d3390 2024-09-13T18:30:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:54.998+0000 7ff930ff9640 1 -- 172.21.15.53:0/766216879 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff934157a20 con 0x7ff9340d3390 2024-09-13T18:30:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9200667b0 msgr2=0x7ff920068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9200667b0 0x7ff920068c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff92400aaf0 tx=0x7ff924008040 comp rx=0 tx=0).stop 2024-09-13T18:30:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 msgr2=0x7ff934155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff934155c90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c360 tx=0x7ff92800c820 comp rx=0 tx=0).stop 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 shutdown_connections 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9200667b0 0x7ff920068c70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff93415c830 0x7ff9341561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9340d3390 0x7ff934155c90 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 --2- 172.21.15.53:0/766216879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9340ccd10 0x7ff9340cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 >> 172.21.15.53:0/766216879 conn(0x7ff934070970 msgr2=0x7ff9340b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 shutdown_connections 2024-09-13T18:30:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.002+0000 7ff93a3be640 1 -- 172.21.15.53:0/766216879 wait complete. 2024-09-13T18:30:55.022 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:30:55.023 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:55.100 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:30:55.181 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:30:55.181 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:55.181 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:55.188 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:55.188 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:55.188 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:55.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:55.195 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:30:55.195 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:55.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:30:55.236 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:30:55.236 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:30:55.244 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:30:55.244 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:30:55.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:30:55.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:55.324 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:30:55.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.406+0000 7f88c6f32640 1 Processor -- start 2024-09-13T18:30:55.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.406+0000 7f88c6f32640 1 -- start start 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c6f32640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c015b7c0 0x7f88c0070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c6f32640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88c00711d0 0x7f88c01640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c6f32640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c006d480 con 0x7f88c01582a0 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c6f32640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c015aaf0 con 0x7f88c00711d0 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c6f32640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c006d760 con 0x7f88c015b7c0 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88c00711d0 0x7f88c01640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88c00711d0 0x7f88c01640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52494/0 (socket says 172.21.15.53:52494) 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 -- 172.21.15.53:0/2326247285 learned_addr learned my addr 172.21.15.53:0/2326247285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c4cce640 1 --1- 172.21.15.53:0/2326247285 >> v1:172.21.15.87:6789/0 conn(0x7f88c01582a0 0x7f88c006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:51600/0 (socket says 172.21.15.53:51600) 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88bffff640 1 --2- 172.21.15.53:0/2326247285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c015b7c0 0x7f88c0070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 -- 172.21.15.53:0/2326247285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c015b7c0 msgr2=0x7f88c0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 --2- 172.21.15.53:0/2326247285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c015b7c0 0x7f88c0070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 -- 172.21.15.53:0/2326247285 >> v1:172.21.15.87:6789/0 conn(0x7f88c01582a0 legacy=0x7f88c006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 -- 172.21.15.53:0/2326247285 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c015ace0 con 0x7f88c00711d0 2024-09-13T18:30:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88c54cf640 1 --2- 172.21.15.53:0/2326247285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c01640f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b7b9745f04a058 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88bf7fe640 1 -- 172.21.15.53:0/2326247285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80a57f0 con 0x7f88c00711d0 2024-09-13T18:30:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88bf7fe640 1 -- 172.21.15.53:0/2326247285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b80a5950 con 0x7f88c00711d0 2024-09-13T18:30:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.410+0000 7f88bf7fe640 1 -- 172.21.15.53:0/2326247285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80a5ce0 con 0x7f88c00711d0 2024-09-13T18:30:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- 172.21.15.53:0/2326247285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 msgr2=0x7f88c01640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 --2- 172.21.15.53:0/2326247285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c01640f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b801ca30 comp rx=0 tx=0).stop 2024-09-13T18:30:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- 172.21.15.53:0/2326247285 shutdown_connections 2024-09-13T18:30:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 --2- 172.21.15.53:0/2326247285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c01640f0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 --2- 172.21.15.53:0/2326247285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c015b7c0 0x7f88c0070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- 172.21.15.53:0/2326247285 >> 172.21.15.53:0/2326247285 conn(0x7f88c0065c80 msgr2=0x7f88c0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- 172.21.15.53:0/2326247285 shutdown_connections 2024-09-13T18:30:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- 172.21.15.53:0/2326247285 wait complete. 2024-09-13T18:30:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 Processor -- start 2024-09-13T18:30:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- start start 2024-09-13T18:30:55.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c0133520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c01582a0 0x7f88c0148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88c015b7c0 0x7f88c0133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0148430 con 0x7f88c00711d0 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0136860 con 0x7f88c015b7c0 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0136b40 con 0x7f88c01582a0 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c0133520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c0133520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52500/0 (socket says 172.21.15.53:52500) 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 -- 172.21.15.53:0/1667597604 learned_addr learned my addr 172.21.15.53:0/1667597604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88bffff640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c01582a0 0x7f88c0148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c54cf640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88c015b7c0 0x7f88c0133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 -- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c01582a0 msgr2=0x7f88c0148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c01582a0 0x7f88c0148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 -- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88c015b7c0 msgr2=0x7f88c0133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88c015b7c0 0x7f88c0133c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 -- 172.21.15.53:0/1667597604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009b30 con 0x7f88c00711d0 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c4cce640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c0133520 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f88b000c490 tx=0x7f88b000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88bd7fa640 1 -- 172.21.15.53:0/1667597604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0007480 con 0x7f88c00711d0 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88bd7fa640 1 -- 172.21.15.53:0/1667597604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b00075e0 con 0x7f88c00711d0 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88bd7fa640 1 -- 172.21.15.53:0/1667597604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b0004a10 con 0x7f88c00711d0 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c0147d70 con 0x7f88c00711d0 2024-09-13T18:30:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.414+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c0149580 con 0x7f88c00711d0 2024-09-13T18:30:55.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.418+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c0067400 con 0x7f88c00711d0 2024-09-13T18:30:55.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.418+0000 7f88bd7fa640 1 -- 172.21.15.53:0/1667597604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f88b0004b70 con 0x7f88c00711d0 2024-09-13T18:30:55.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.418+0000 7f88bd7fa640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88ac0667b0 0x7f88ac068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.418+0000 7f88bd7fa640 1 -- 172.21.15.53:0/1667597604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f88b00831c0 con 0x7f88c00711d0 2024-09-13T18:30:55.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.418+0000 7f88bffff640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88ac0667b0 0x7f88ac068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.418+0000 7f88bffff640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88ac0667b0 0x7f88ac068c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88c0149890 tx=0x7f88b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:55.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.422+0000 7f88bd7fa640 1 -- 172.21.15.53:0/1667597604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88b0050760 con 0x7f88c00711d0 2024-09-13T18:30:55.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.618+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c0148570 con 0x7f88c00711d0 2024-09-13T18:30:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88bd7fa640 1 -- 172.21.15.53:0/1667597604 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f88b0018de0 con 0x7f88c00711d0 2024-09-13T18:30:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:55.623 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2807450918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2807450918},{"type":"v1","addr":"172.21.15.87:6833","nonce":2807450918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3225281050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3225281050},{"type":"v1","addr":"172.21.15.87:6835","nonce":3225281050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1870582127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1870582127},{"type":"v1","addr":"172.21.15.53:6833","nonce":1870582127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7833,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1810070464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1810070464},{"type":"v1","addr":"172.21.15.53:6835","nonce":1810070464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[]} 2024-09-13T18:30:55.624 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 56 2024-09-13T18:30:55.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88ac0667b0 msgr2=0x7f88ac068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88ac0667b0 0x7f88ac068c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88c0149890 tx=0x7f88b4008040 comp rx=0 tx=0).stop 2024-09-13T18:30:55.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 msgr2=0x7f88c0133520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c0133520 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f88b000c490 tx=0x7f88b000c950 comp rx=0 tx=0).stop 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 shutdown_connections 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88ac0667b0 0x7f88ac068c70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88c01582a0 0x7f88c0148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88c015b7c0 0x7f88c0133c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 --2- 172.21.15.53:0/1667597604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c00711d0 0x7f88c0133520 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 >> 172.21.15.53:0/1667597604 conn(0x7f88c0065c80 msgr2=0x7f88c0155190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 shutdown_connections 2024-09-13T18:30:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.622+0000 7f88c6f32640 1 -- 172.21.15.53:0/1667597604 wait complete. 2024-09-13T18:30:55.643 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:30:55.643 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:30:55.644 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:30:55.644 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:55.644 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:30:55.644 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:30:55.644 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:30:55.644 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:55.645 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:30:55.645 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:30:55.645 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:30:55.645 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:55.645 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:30:55.645 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:30:55.645 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:30:55.645 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:30:55.658 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:30:55.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:30:55.661 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:30:55.661 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:30:55.696 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:30:55.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:30:55.698 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:30:55.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:30:55.704 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:30:55.704 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:55.705 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:30:55.705 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:55.743 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:30:55.743 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:55.744 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:30:55.744 DEBUG:teuthology.parallel:result is None 2024-09-13T18:30:55.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:30:55.773 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:30:55.773 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:30:55.813 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:30:55.815 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:30:55.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.866+0000 7f03ce2e5640 1 Processor -- start 2024-09-13T18:30:55.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.866+0000 7f03ce2e5640 1 -- start start 2024-09-13T18:30:55.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03c815b990 0x7f03c815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c8069f50 0x7f03c806a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c80cd570 con 0x7f03c815a630 2024-09-13T18:30:55.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c806a940 con 0x7f03c815b990 2024-09-13T18:30:55.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c80cd7b0 con 0x7f03c8069f50 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03c815b990 0x7f03c815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f03c815a630 0x7f03c80cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41878/0 (socket says 172.21.15.53:41878) 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c7fff640 1 -- 172.21.15.53:0/3632851042 learned_addr learned my addr 172.21.15.53:0/3632851042 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03cc882640 1 --2- 172.21.15.53:0/3632851042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c8069f50 0x7f03c806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c77fe640 1 -- 172.21.15.53:0/3632851042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c8069f50 msgr2=0x7f03c806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c77fe640 1 --2- 172.21.15.53:0/3632851042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c8069f50 0x7f03c806a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c77fe640 1 -- 172.21.15.53:0/3632851042 >> v1:172.21.15.53:6789/0 conn(0x7f03c815a630 legacy=0x7f03c80cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c6ffd640 1 -- 172.21.15.53:0/3632851042 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501899234 0 0) 0x7f03b8001120 con 0x7f03c815a630 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c77fe640 1 -- 172.21.15.53:0/3632851042 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c80cda90 con 0x7f03c815b990 2024-09-13T18:30:55.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03cc882640 1 --2- 172.21.15.53:0/3632851042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c8069f50 0x7f03c806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:55.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c77fe640 1 --2- 172.21.15.53:0/3632851042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c815eda0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0097a0 tx=0x7f03bc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d589447cf7e21c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:55.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c6ffd640 1 -- 172.21.15.53:0/3632851042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0ac620 con 0x7f03c815b990 2024-09-13T18:30:55.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c6ffd640 1 -- 172.21.15.53:0/3632851042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc0ac780 con 0x7f03c815b990 2024-09-13T18:30:55.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03c6ffd640 1 -- 172.21.15.53:0/3632851042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0acb10 con 0x7f03c815b990 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3632851042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 msgr2=0x7f03c815eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3632851042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c815eda0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0097a0 tx=0x7f03bc01c3c0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3632851042 shutdown_connections 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3632851042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c8069f50 0x7f03c806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3632851042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c815eda0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3632851042 >> 172.21.15.53:0/3632851042 conn(0x7f03c80b0a30 msgr2=0x7f03c80b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3632851042 shutdown_connections 2024-09-13T18:30:55.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.870+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3632851042 wait complete. 2024-09-13T18:30:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 Processor -- start 2024-09-13T18:30:55.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 -- start start 2024-09-13T18:30:55.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c8069f50 0x7f03c81587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c815a630 0x7f03c80cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c81599b0 con 0x7f03c815b990 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8159e40 con 0x7f03c8069f50 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8158da0 con 0x7f03c815a630 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c814df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52570/0 (socket says 172.21.15.53:52570) 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 -- 172.21.15.53:0/3742832830 learned_addr learned my addr 172.21.15.53:0/3742832830 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03c7fff640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c8069f50 0x7f03c81587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03c77fe640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c815a630 0x7f03c80cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 -- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c815a630 msgr2=0x7f03c80cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c815a630 0x7f03c80cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 -- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c8069f50 msgr2=0x7f03c81587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:55.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c8069f50 0x7f03c81587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 -- 172.21.15.53:0/3742832830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc0093b0 con 0x7f03c815b990 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03c7fff640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c8069f50 0x7f03c81587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03cc882640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c814df40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f03c000cef0 tx=0x7f03c000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03c4ff9640 1 -- 172.21.15.53:0/3742832830 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000d840 con 0x7f03c815b990 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03c4ff9640 1 -- 172.21.15.53:0/3742832830 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c000d9c0 con 0x7f03c815b990 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c8159080 con 0x7f03c815b990 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03c4ff9640 1 -- 172.21.15.53:0/3742832830 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000dd70 con 0x7f03c815b990 2024-09-13T18:30:55.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c8159640 con 0x7f03c815b990 2024-09-13T18:30:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.874+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c8159b20 con 0x7f03c815b990 2024-09-13T18:30:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.878+0000 7f03c4ff9640 1 -- 172.21.15.53:0/3742832830 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f03c001e3b0 con 0x7f03c815b990 2024-09-13T18:30:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.878+0000 7f03c4ff9640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f03b40667b0 0x7f03b4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.878+0000 7f03c4ff9640 1 -- 172.21.15.53:0/3742832830 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f03c0084b40 con 0x7f03c815b990 2024-09-13T18:30:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.878+0000 7f03c7fff640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f03b40667b0 0x7f03b4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:55.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.878+0000 7f03c7fff640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f03b40667b0 0x7f03b4068c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f03b8007fd0 tx=0x7f03b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:55.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:55.882+0000 7f03c4ff9640 1 -- 172.21.15.53:0/3742832830 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03c00520f0 con 0x7f03c815b990 2024-09-13T18:30:56.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.054+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f03c8073210 con 0x7f03c815b990 2024-09-13T18:30:56.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.854+0000 7f03c4ff9640 1 -- 172.21.15.53:0/3742832830 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v102) v1 ==== 97+0+0 (secure 0 0 0) 0x7f03c001a020 con 0x7f03c815b990 2024-09-13T18:30:56.858 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f03b40667b0 msgr2=0x7f03b4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f03b40667b0 0x7f03b4068c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f03b8007fd0 tx=0x7f03b8009040 comp rx=0 tx=0).stop 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 msgr2=0x7f03c814df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c814df40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f03c000cef0 tx=0x7f03c000a710 comp rx=0 tx=0).stop 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 shutdown_connections 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f03b40667b0 0x7f03b4068c70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03c815a630 0x7f03c80cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03c815b990 0x7f03c814df40 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 --2- 172.21.15.53:0/3742832830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03c8069f50 0x7f03c81587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 >> 172.21.15.53:0/3742832830 conn(0x7f03c80b0a30 msgr2=0x7f03c80ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 shutdown_connections 2024-09-13T18:30:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:56.858+0000 7f03ce2e5640 1 -- 172.21.15.53:0/3742832830 wait complete. 2024-09-13T18:30:56.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:30:57.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.014+0000 7fa03d22d640 1 Processor -- start 2024-09-13T18:30:57.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.014+0000 7fa03d22d640 1 -- start start 2024-09-13T18:30:57.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.014+0000 7fa03d22d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa0380cdae0 0x7fa0380cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.014+0000 7fa03d22d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 0x7fa0380b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.014+0000 7fa03d22d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03815cc30 con 0x7fa03815c850 2024-09-13T18:30:57.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.014+0000 7fa03d22d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0380d0050 con 0x7fa0380cdae0 2024-09-13T18:30:57.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.014+0000 7fa03d22d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380d2450 con 0x7fa0380cfbe0 2024-09-13T18:30:57.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa036d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa03815c850 0x7fa0380d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40998/0 (socket says 172.21.15.53:40998) 2024-09-13T18:30:57.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa036d9d640 1 -- 172.21.15.53:0/1884646295 learned_addr learned my addr 172.21.15.53:0/1884646295 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03759e640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 0x7fa0380b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 --2- 172.21.15.53:0/1884646295 >> v2:172.21.15.87:3300/0 conn(0x7fa0380cdae0 0x7fa0380cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265262371 0 0) 0x7fa028001120 con 0x7fa03815c850 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa020003530 con 0x7fa03815c850 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183733599 0 0) 0x7fa020003530 con 0x7fa03815c850 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 msgr2=0x7fa0380b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 0x7fa0380b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 >> v2:172.21.15.87:3300/0 conn(0x7fa0380cdae0 msgr2=0x7fa0380cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 --2- 172.21.15.53:0/1884646295 >> v2:172.21.15.87:3300/0 conn(0x7fa0380cdae0 0x7fa0380cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380d27a0 con 0x7fa03815c850 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa028001810 con 0x7fa03815c850 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 >> v1:172.21.15.53:6789/0 conn(0x7fa03815c850 legacy=0x7fa0380d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 0x7fa020003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa020003f00 0x7fa0200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020004d10 0x7fa020005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380d0050 con 0x7fa020003f00 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380d2450 con 0x7fa020004d10 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02000b9c0 con 0x7fa0380cfbe0 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa020003f00 0x7fa0200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa036d9d640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 0x7fa020003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03759e640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020004d10 0x7fa020005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 -- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 msgr2=0x7fa020003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cfbe0 0x7fa020003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 -- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020004d10 msgr2=0x7fa020005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020004d10 0x7fa020005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 -- 172.21.15.53:0/1884646295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020003530 con 0x7fa020003f00 2024-09-13T18:30:57.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03759e640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020004d10 0x7fa020005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:57.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.018+0000 7fa03659c640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa020003f00 0x7fa0200047d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009ae0 tx=0x7fa02c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4710ed753468d250 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0a56a0 con 0x7fa020003f00 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c0a5800 con 0x7fa020003f00 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa035d9b640 1 -- 172.21.15.53:0/1884646295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0a5bb0 con 0x7fa020003f00 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- 172.21.15.53:0/1884646295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa020003f00 msgr2=0x7fa0200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 --2- 172.21.15.53:0/1884646295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa020003f00 0x7fa0200047d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009ae0 tx=0x7fa02c01cab0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 -- 172.21.15.53:0/1884646295 reap_dead start 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- 172.21.15.53:0/1884646295 shutdown_connections 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- 172.21.15.53:0/1884646295 >> 172.21.15.53:0/1884646295 conn(0x7fa038070970 msgr2=0x7fa038070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- 172.21.15.53:0/1884646295 shutdown_connections 2024-09-13T18:30:57.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- 172.21.15.53:0/1884646295 wait complete. 2024-09-13T18:30:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 Processor -- start 2024-09-13T18:30:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- start start 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020003f00 0x7fa0380cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cae50 0x7fa0380cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa03815e2d0 0x7fa03815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03815d230 con 0x7fa03815e2d0 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03815d510 con 0x7fa020003f00 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03815d7f0 con 0x7fa0380cae50 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa03815e2d0 0x7fa03815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa03815e2d0 0x7fa03815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43798/0 (socket says 172.21.15.53:43798) 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 -- 172.21.15.53:0/861350145 learned_addr learned my addr 172.21.15.53:0/861350145 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03659c640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cae50 0x7fa0380cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa036d9d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020003f00 0x7fa0380cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 -- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cae50 msgr2=0x7fa0380cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cae50 0x7fa0380cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 -- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020003f00 msgr2=0x7fa0380cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020003f00 0x7fa0380cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 -- 172.21.15.53:0/861350145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03815dad0 con 0x7fa03815e2d0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03659c640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cae50 0x7fa0380cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03759e640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa03815e2d0 0x7fa03815e750 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa0380b88e0 tx=0x7fa03000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa01f7fe640 1 -- 172.21.15.53:0/861350145 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000fe90 con 0x7fa03815e2d0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa01f7fe640 1 -- 172.21.15.53:0/861350145 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa030011040 con 0x7fa03815e2d0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa01f7fe640 1 -- 172.21.15.53:0/861350145 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030017640 con 0x7fa03815e2d0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03815ddb0 con 0x7fa03815e2d0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.022+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0380cc450 con 0x7fa03815e2d0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.026+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa038067400 con 0x7fa03815e2d0 2024-09-13T18:30:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.026+0000 7fa01f7fe640 1 -- 172.21.15.53:0/861350145 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fa0300203b0 con 0x7fa03815e2d0 2024-09-13T18:30:57.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.026+0000 7fa01f7fe640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0240667b0 0x7fa024068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.026+0000 7fa01f7fe640 1 -- 172.21.15.53:0/861350145 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa030084210 con 0x7fa03815e2d0 2024-09-13T18:30:57.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.026+0000 7fa036d9d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0240667b0 0x7fa024068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.026+0000 7fa036d9d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0240667b0 0x7fa024068c70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa028007b60 tx=0x7fa028009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.030+0000 7fa01f7fe640 1 -- 172.21.15.53:0/861350145 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa030051740 con 0x7fa03815e2d0 2024-09-13T18:30:57.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.246+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa0380d3540 con 0x7fa03815e2d0 2024-09-13T18:30:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa01f7fe640 1 -- 172.21.15.53:0/861350145 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa0380d3540 con 0x7fa03815e2d0 2024-09-13T18:30:57.251 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:57.251 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:30:57.251 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:30:57.251 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.251 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.252 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:57.253 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.254 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.255 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.256 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:30:57.258 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.259 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:30:57.260 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:30:57.261 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.262 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:30:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:30:57.264 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.265 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:57.265 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:30:57.265 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0240667b0 msgr2=0x7fa024068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0240667b0 0x7fa024068c70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa028007b60 tx=0x7fa028009040 comp rx=0 tx=0).stop 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa03815e2d0 msgr2=0x7fa03815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa03815e2d0 0x7fa03815e750 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa0380b88e0 tx=0x7fa03000f4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 shutdown_connections 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0240667b0 0x7fa024068c70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0380cae50 0x7fa0380cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa03815e2d0 0x7fa03815e750 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 --2- 172.21.15.53:0/861350145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa020003f00 0x7fa0380cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 >> 172.21.15.53:0/861350145 conn(0x7fa038070970 msgr2=0x7fa0380d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 shutdown_connections 2024-09-13T18:30:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.250+0000 7fa03d22d640 1 -- 172.21.15.53:0/861350145 wait complete. 2024-09-13T18:30:57.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:30:57.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.398+0000 7f75ab03f640 1 Processor -- start 2024-09-13T18:30:57.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.398+0000 7f75ab03f640 1 -- start start 2024-09-13T18:30:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75ab03f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 0x7f75a40d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75ab03f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f75a40cf7d0 0x7f75a40b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75ab03f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a40d2400 con 0x7f75a40cd6c0 2024-09-13T18:30:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75ab03f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a40d1530 con 0x7f75a40cf7d0 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75ab03f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40d0920 con 0x7f75a415cab0 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f75a40cd6c0 0x7f75a40cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41002/0 (socket says 172.21.15.53:41002) 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 -- 172.21.15.53:0/1503406803 learned_addr learned my addr 172.21.15.53:0/1503406803 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a95dc640 1 --2- 172.21.15.53:0/1503406803 >> v2:172.21.15.87:3300/0 conn(0x7f75a40cf7d0 0x7f75a40b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a8ddb640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 0x7f75a40d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254452066 0 0) 0x7f75a40d2400 con 0x7f75a40cd6c0 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7594003530 con 0x7f75a40cd6c0 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037414060 0 0) 0x7f7594003530 con 0x7f75a40cd6c0 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 msgr2=0x7f75a40d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 0x7f75a40d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 >> v2:172.21.15.87:3300/0 conn(0x7f75a40cf7d0 msgr2=0x7f75a40b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 --2- 172.21.15.53:0/1503406803 >> v2:172.21.15.87:3300/0 conn(0x7f75a40cf7d0 0x7f75a40b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40d0c00 con 0x7f75a40cd6c0 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7590001680 con 0x7f75a40cd6c0 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 >> v1:172.21.15.53:6789/0 conn(0x7f75a40cd6c0 legacy=0x7f75a40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7594003980 0x7f7594003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940047d0 0x7f7594004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 0x7f7594005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40d1530 con 0x7f75940047d0 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40d0920 con 0x7f7594003980 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759400b990 con 0x7f75a415cab0 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940047d0 0x7f7594004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a95dc640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 0x7f7594005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a8ddb640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7594003980 0x7f7594003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 -- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 msgr2=0x7f7594005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75a415cab0 0x7f7594005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 -- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7594003980 msgr2=0x7f7594003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7594003980 0x7f7594003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.402+0000 7f75a3fff640 1 -- 172.21.15.53:0/1503406803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594003530 con 0x7f75940047d0 2024-09-13T18:30:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940047d0 0x7f7594004c50 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f75a40b20e0 tx=0x7f759001f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182a5437a5555aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900a8cd0 con 0x7f75940047d0 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75900a8e30 con 0x7f75940047d0 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a37fe640 1 -- 172.21.15.53:0/1503406803 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590005b20 con 0x7f75940047d0 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- 172.21.15.53:0/1503406803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940047d0 msgr2=0x7f7594004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 --2- 172.21.15.53:0/1503406803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940047d0 0x7f7594004c50 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f75a40b20e0 tx=0x7f759001f430 comp rx=0 tx=0).stop 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a95dc640 1 -- 172.21.15.53:0/1503406803 reap_dead start 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- 172.21.15.53:0/1503406803 shutdown_connections 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- 172.21.15.53:0/1503406803 >> 172.21.15.53:0/1503406803 conn(0x7f75a4065c80 msgr2=0x7f75a4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- 172.21.15.53:0/1503406803 shutdown_connections 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- 172.21.15.53:0/1503406803 wait complete. 2024-09-13T18:30:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 Processor -- start 2024-09-13T18:30:57.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- start start 2024-09-13T18:30:57.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75940047d0 0x7f75a40c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75a4157750 0x7f75a4155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75a40b39c0 0x7f75a40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4158b50 con 0x7f75a4157750 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40cb020 con 0x7f75a40b39c0 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75ab03f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40b4360 con 0x7f75940047d0 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75a4157750 0x7f75a4155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75a4157750 0x7f75a4155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43818/0 (socket says 172.21.15.53:43818) 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 -- 172.21.15.53:0/2084287399 learned_addr learned my addr 172.21.15.53:0/2084287399 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a95dc640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75a40b39c0 0x7f75a40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a8ddb640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75940047d0 0x7f75a40c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 -- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75940047d0 msgr2=0x7f75a40c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75940047d0 0x7f75a40c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 -- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75a40b39c0 msgr2=0x7f75a40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75a40b39c0 0x7f75a40b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 -- 172.21.15.53:0/2084287399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40ca720 con 0x7f75a4157750 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a3fff640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75a4157750 0x7f75a4155920 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f7590007040 tx=0x7f7594005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.406+0000 7f75a17fa640 1 -- 172.21.15.53:0/2084287399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900049f0 con 0x7f75a4157750 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75a17fa640 1 -- 172.21.15.53:0/2084287399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590004b70 con 0x7f75a4157750 2024-09-13T18:30:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a4157bd0 con 0x7f75a4157750 2024-09-13T18:30:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75a17fa640 1 -- 172.21.15.53:0/2084287399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900070d0 con 0x7f75a4157750 2024-09-13T18:30:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a40ca160 con 0x7f75a4157750 2024-09-13T18:30:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a40cb160 con 0x7f75a4157750 2024-09-13T18:30:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75a17fa640 1 -- 172.21.15.53:0/2084287399 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f75900b8070 con 0x7f75a4157750 2024-09-13T18:30:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75a17fa640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f75880667b0 0x7f7588068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75a17fa640 1 -- 172.21.15.53:0/2084287399 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7590120f70 con 0x7f75a4157750 2024-09-13T18:30:57.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75a8ddb640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f75880667b0 0x7f7588068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.410+0000 7f75a8ddb640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f75880667b0 0x7f7588068c70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7598009950 tx=0x7f7598008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.414+0000 7f75a17fa640 1 -- 172.21.15.53:0/2084287399 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7590152db0 con 0x7f75a4157750 2024-09-13T18:30:57.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.574+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75a40d19c0 con 0x7f75a4157750 2024-09-13T18:30:57.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.574+0000 7f75a17fa640 1 -- 172.21.15.53:0/2084287399 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+12799 (secure 0 0 0) 0x7f75900c0090 con 0x7f75a4157750 2024-09-13T18:30:57.579 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:57.579 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":102,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:30:56.851250+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:30:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f75880667b0 msgr2=0x7f7588068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f75880667b0 0x7f7588068c70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7598009950 tx=0x7f7598008040 comp rx=0 tx=0).stop 2024-09-13T18:30:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75a4157750 msgr2=0x7f75a4155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75a4157750 0x7f75a4155920 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f7590007040 tx=0x7f7594005800 comp rx=0 tx=0).stop 2024-09-13T18:30:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 shutdown_connections 2024-09-13T18:30:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f75880667b0 0x7f7588068c70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75a40b39c0 0x7f75a40b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75a4157750 0x7f75a4155920 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 --2- 172.21.15.53:0/2084287399 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75940047d0 0x7f75a40c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 >> 172.21.15.53:0/2084287399 conn(0x7f75a4065c80 msgr2=0x7f75a415ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 shutdown_connections 2024-09-13T18:30:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.578+0000 7f75ab03f640 1 -- 172.21.15.53:0/2084287399 wait complete. 2024-09-13T18:30:57.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:30:57.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:30:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07f57e8640 1 Processor -- start 2024-09-13T18:30:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07f57e8640 1 -- start start 2024-09-13T18:30:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07f57e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07f006d440 0x7f07f0163e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07f57e8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f00715f0 con 0x7f07f0156c40 2024-09-13T18:30:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07f57e8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f00b15a0 con 0x7f07f0157020 2024-09-13T18:30:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07f57e8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f0070340 con 0x7f07f006d440 2024-09-13T18:30:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07ef7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07f006d440 0x7f07f0163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07eeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f07f0156c40 0x7f07f0070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41008/0 (socket says 172.21.15.53:41008) 2024-09-13T18:30:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07eeffd640 1 -- 172.21.15.53:0/2380709912 learned_addr learned my addr 172.21.15.53:0/2380709912 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07ef7fe640 1 -- 172.21.15.53:0/2380709912 >> v1:172.21.15.87:6789/0 conn(0x7f07f0157020 legacy=0x7f07f006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07ef7fe640 1 -- 172.21.15.53:0/2380709912 >> v1:172.21.15.53:6789/0 conn(0x7f07f0156c40 legacy=0x7f07f0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.726+0000 7f07ef7fe640 1 -- 172.21.15.53:0/2380709912 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00b1880 con 0x7f07f006d440 2024-09-13T18:30:57.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07ef7fe640 1 --2- 172.21.15.53:0/2380709912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0163e90 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009dc0 tx=0x7f07e801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841238037ff0d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07edffb640 1 -- 172.21.15.53:0/2380709912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80a59a0 con 0x7f07f006d440 2024-09-13T18:30:57.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07edffb640 1 -- 172.21.15.53:0/2380709912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e80a5b00 con 0x7f07f006d440 2024-09-13T18:30:57.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07edffb640 1 -- 172.21.15.53:0/2380709912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80a5e90 con 0x7f07f006d440 2024-09-13T18:30:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- 172.21.15.53:0/2380709912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 msgr2=0x7f07f0163e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 --2- 172.21.15.53:0/2380709912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0163e90 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009dc0 tx=0x7f07e801c8e0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- 172.21.15.53:0/2380709912 shutdown_connections 2024-09-13T18:30:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 --2- 172.21.15.53:0/2380709912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0163e90 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- 172.21.15.53:0/2380709912 >> 172.21.15.53:0/2380709912 conn(0x7f07f0065c80 msgr2=0x7f07f0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- 172.21.15.53:0/2380709912 shutdown_connections 2024-09-13T18:30:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- 172.21.15.53:0/2380709912 wait complete. 2024-09-13T18:30:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 Processor -- start 2024-09-13T18:30:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- start start 2024-09-13T18:30:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07f0156c40 0x7f07f0150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07f0151200 0x7f07f0151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f014c140 con 0x7f07f006d440 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f014b270 con 0x7f07f0156c40 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07f57e8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0151f90 con 0x7f07f0151200 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43828/0 (socket says 172.21.15.53:43828) 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 -- 172.21.15.53:0/1140731913 learned_addr learned my addr 172.21.15.53:0/1140731913 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07ef7fe640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07f0151200 0x7f07f0151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07ee7fc640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07f0156c40 0x7f07f0150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 -- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07f0151200 msgr2=0x7f07f0151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07f0151200 0x7f07f0151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 -- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07f0156c40 msgr2=0x7f07f0150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07f0156c40 0x7f07f0150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 -- 172.21.15.53:0/1140731913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009a70 con 0x7f07f006d440 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07ee7fc640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07f0156c40 0x7f07f0150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07eeffd640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0149f70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c500 tx=0x7f07e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07d77fe640 1 -- 172.21.15.53:0/1140731913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4005cf0 con 0x7f07f006d440 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.730+0000 7f07d77fe640 1 -- 172.21.15.53:0/1140731913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4005e50 con 0x7f07f006d440 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07d77fe640 1 -- 172.21.15.53:0/1140731913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40072f0 con 0x7f07f006d440 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f014b4c0 con 0x7f07f006d440 2024-09-13T18:30:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f014ba80 con 0x7f07f006d440 2024-09-13T18:30:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f0070ee0 con 0x7f07f006d440 2024-09-13T18:30:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07d77fe640 1 -- 172.21.15.53:0/1140731913 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f07e4007450 con 0x7f07f006d440 2024-09-13T18:30:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07d77fe640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07dc0667b0 0x7f07dc068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07d77fe640 1 -- 172.21.15.53:0/1140731913 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07e4083500 con 0x7f07f006d440 2024-09-13T18:30:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07ee7fc640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07dc0667b0 0x7f07dc068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.734+0000 7f07ee7fc640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07dc0667b0 0x7f07dc068c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07f015ac60 tx=0x7f07e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.738+0000 7f07d77fe640 1 -- 172.21.15.53:0/1140731913 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07e4050b60 con 0x7f07f006d440 2024-09-13T18:30:57.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07f0156450 con 0x7f07f006d440 2024-09-13T18:30:57.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07d77fe640 1 -- 172.21.15.53:0/1140731913 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07e40170a0 con 0x7f07f006d440 2024-09-13T18:30:57.903 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:30:57.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07dc0667b0 msgr2=0x7f07dc068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07dc0667b0 0x7f07dc068c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07f015ac60 tx=0x7f07e0008040 comp rx=0 tx=0).stop 2024-09-13T18:30:57.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 msgr2=0x7f07f0149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:57.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0149f70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c500 tx=0x7f07e400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 shutdown_connections 2024-09-13T18:30:57.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f07dc0667b0 0x7f07dc068c70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07f0151200 0x7f07f0151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07f0156c40 0x7f07f0150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 --2- 172.21.15.53:0/1140731913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07f006d440 0x7f07f0149f70 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:57.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 >> 172.21.15.53:0/1140731913 conn(0x7f07f0065c80 msgr2=0x7f07f00b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:57.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 shutdown_connections 2024-09-13T18:30:57.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:57.902+0000 7f07f57e8640 1 -- 172.21.15.53:0/1140731913 wait complete. 2024-09-13T18:30:57.923 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:30:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b3686640 1 Processor -- start 2024-09-13T18:30:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b3686640 1 -- start start 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b3686640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 0x7f91ac06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b3686640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91ac15b7c0 0x7f91ac06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b3686640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac06d480 con 0x7f91ac070c90 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b3686640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac15aaf0 con 0x7f91ac15b7c0 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b3686640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac06d760 con 0x7f91ac1582a0 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1c23640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f91ac070c90 0x7f91ac06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41012/0 (socket says 172.21.15.53:41012) 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1c23640 1 -- 172.21.15.53:0/240909524 learned_addr learned my addr 172.21.15.53:0/240909524 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1422640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 0x7f91ac06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b0c21640 1 --2- 172.21.15.53:0/240909524 >> v2:172.21.15.87:3300/0 conn(0x7f91ac15b7c0 0x7f91ac06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970115473 0 0) 0x7f91ac06d480 con 0x7f91ac070c90 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9198003530 con 0x7f91ac070c90 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1844927152 0 0) 0x7f9198003530 con 0x7f91ac070c90 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 msgr2=0x7f91ac06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 0x7f91ac06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 >> v2:172.21.15.87:3300/0 conn(0x7f91ac15b7c0 msgr2=0x7f91ac06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 --2- 172.21.15.53:0/240909524 >> v2:172.21.15.87:3300/0 conn(0x7f91ac15b7c0 0x7f91ac06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac15ace0 con 0x7f91ac070c90 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f91a4001a00 con 0x7f91ac070c90 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 >> v1:172.21.15.53:6789/0 conn(0x7f91ac070c90 legacy=0x7f91ac06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198003980 0x7f9198003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 0x7f91980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198004d10 0x7f9198005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919800b990 con 0x7f9198003980 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919800bad0 con 0x7f9198004d10 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9198010020 con 0x7f91ac1582a0 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1422640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198003980 0x7f9198003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1c23640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198004d10 0x7f9198005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b0c21640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 0x7f91980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1422640 1 -- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 msgr2=0x7f91980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1422640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac1582a0 0x7f91980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1422640 1 -- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198004d10 msgr2=0x7f9198005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1422640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198004d10 0x7f9198005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.038+0000 7f91b1422640 1 -- 172.21.15.53:0/240909524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198003530 con 0x7f9198003980 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b1422640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198003980 0x7f9198003da0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009ae0 tx=0x7f91a801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386948fd2ec98ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80a5520 con 0x7f9198003980 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a80a5680 con 0x7f9198003980 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91a3fff640 1 -- 172.21.15.53:0/240909524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80a5a30 con 0x7f9198003980 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 -- 172.21.15.53:0/240909524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198003980 msgr2=0x7f9198003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 --2- 172.21.15.53:0/240909524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9198003980 0x7f9198003da0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009ae0 tx=0x7f91a801ca40 comp rx=0 tx=0).stop 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b1c23640 1 -- 172.21.15.53:0/240909524 reap_dead start 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 -- 172.21.15.53:0/240909524 shutdown_connections 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 -- 172.21.15.53:0/240909524 >> 172.21.15.53:0/240909524 conn(0x7f91ac065c80 msgr2=0x7f91ac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 -- 172.21.15.53:0/240909524 shutdown_connections 2024-09-13T18:30:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 -- 172.21.15.53:0/240909524 wait complete. 2024-09-13T18:30:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 Processor -- start 2024-09-13T18:30:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.042+0000 7f91b3686640 1 -- start start 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198003980 0x7f91ac14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91ac1509e0 0x7f91ac15d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac152f20 0x7f91ac153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1560c0 con 0x7f91ac1509e0 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac15d6c0 con 0x7f9198003980 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1521a0 con 0x7f91ac152f20 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91ac1509e0 0x7f91ac15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91ac1509e0 0x7f91ac15d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43852/0 (socket says 172.21.15.53:43852) 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 -- 172.21.15.53:0/3750079330 learned_addr learned my addr 172.21.15.53:0/3750079330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b1422640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198003980 0x7f91ac14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b1c23640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac152f20 0x7f91ac153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 -- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac152f20 msgr2=0x7f91ac153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac152f20 0x7f91ac153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 -- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198003980 msgr2=0x7f91ac14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198003980 0x7f91ac14e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 -- 172.21.15.53:0/3750079330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac071630 con 0x7f91ac1509e0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b0c21640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91ac1509e0 0x7f91ac15d180 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f919c011660 tx=0x7f919c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91a1ffb640 1 -- 172.21.15.53:0/3750079330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00f9c0 con 0x7f91ac1509e0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91a1ffb640 1 -- 172.21.15.53:0/3750079330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c00fb20 con 0x7f91ac1509e0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac155de0 con 0x7f91ac1509e0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91a1ffb640 1 -- 172.21.15.53:0/3750079330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00fe90 con 0x7f91ac1509e0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac152720 con 0x7f91ac1509e0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac067400 con 0x7f91ac1509e0 2024-09-13T18:30:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91a1ffb640 1 -- 172.21.15.53:0/3750079330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f919c015460 con 0x7f91ac1509e0 2024-09-13T18:30:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91a1ffb640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f91900667b0 0x7f9190068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91a1ffb640 1 -- 172.21.15.53:0/3750079330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f919c084470 con 0x7f91ac1509e0 2024-09-13T18:30:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b1422640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f91900667b0 0x7f9190068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.046+0000 7f91b1422640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f91900667b0 0x7f9190068c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91a80af000 tx=0x7f91a80046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.050+0000 7f91a1ffb640 1 -- 172.21.15.53:0/3750079330 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f919c051a20 con 0x7f91ac1509e0 2024-09-13T18:30:58.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.206+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f91ac06d480 con 0x7f91ac1509e0 2024-09-13T18:30:58.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.206+0000 7f91a1ffb640 1 -- 172.21.15.53:0/3750079330 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v102) v1 ==== 84+0+65 (secure 0 0 0) 0x7f919c022060 con 0x7f91ac1509e0 2024-09-13T18:30:58.210 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:30:58.210 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:30:58.210 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:30:58.210 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:30:58.210 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:30:58.210 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:30:58.210 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:30:58.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f91900667b0 msgr2=0x7f9190068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f91900667b0 0x7f9190068c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91a80af000 tx=0x7f91a80046d0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91ac1509e0 msgr2=0x7f91ac15d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91ac1509e0 0x7f91ac15d180 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f919c011660 tx=0x7f919c011b20 comp rx=0 tx=0).stop 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 shutdown_connections 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f91900667b0 0x7f9190068c70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac152f20 0x7f91ac153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91ac1509e0 0x7f91ac15d180 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 --2- 172.21.15.53:0/3750079330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9198003980 0x7f91ac14e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 >> 172.21.15.53:0/3750079330 conn(0x7f91ac065c80 msgr2=0x7f91ac06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 shutdown_connections 2024-09-13T18:30:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.210+0000 7f91b3686640 1 -- 172.21.15.53:0/3750079330 wait complete. 2024-09-13T18:30:58.227 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:30:58.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:30:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.342+0000 7fd35a43e640 1 Processor -- start 2024-09-13T18:30:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.342+0000 7fd35a43e640 1 -- start start 2024-09-13T18:30:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3540b4080 0x7fd35415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3540717b0 0x7fd35406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35415d630 con 0x7fd3540b3ca0 2024-09-13T18:30:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35415d910 con 0x7fd3540717b0 2024-09-13T18:30:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35415dbf0 con 0x7fd3540b4080 2024-09-13T18:30:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3589db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3540717b0 0x7fd35406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd353fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd3540b3ca0 0x7fd35415ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41024/0 (socket says 172.21.15.53:41024) 2024-09-13T18:30:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd353fff640 1 -- 172.21.15.53:0/2371445613 learned_addr learned my addr 172.21.15.53:0/2371445613 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd34bfff640 1 --2- 172.21.15.53:0/2371445613 >> v2:172.21.15.87:3300/0 conn(0x7fd3540b4080 0x7fd35415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3589db640 1 -- 172.21.15.53:0/2371445613 >> v2:172.21.15.87:3300/0 conn(0x7fd3540b4080 msgr2=0x7fd35415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3589db640 1 --2- 172.21.15.53:0/2371445613 >> v2:172.21.15.87:3300/0 conn(0x7fd3540b4080 0x7fd35415a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3589db640 1 -- 172.21.15.53:0/2371445613 >> v1:172.21.15.53:6789/0 conn(0x7fd3540b3ca0 legacy=0x7fd35415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3589db640 1 -- 172.21.15.53:0/2371445613 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354159b90 con 0x7fd3540717b0 2024-09-13T18:30:58.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3589db640 1 --2- 172.21.15.53:0/2371445613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540717b0 0x7fd35406cb70 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd3540730e0 tx=0x7fd34c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad39c071a02e742f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3537fe640 1 -- 172.21.15.53:0/2371445613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0a5900 con 0x7fd3540717b0 2024-09-13T18:30:58.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3537fe640 1 -- 172.21.15.53:0/2371445613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0a5a60 con 0x7fd3540717b0 2024-09-13T18:30:58.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd3537fe640 1 -- 172.21.15.53:0/2371445613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0a5df0 con 0x7fd3540717b0 2024-09-13T18:30:58.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- 172.21.15.53:0/2371445613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540717b0 msgr2=0x7fd35406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 --2- 172.21.15.53:0/2371445613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540717b0 0x7fd35406cb70 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd3540730e0 tx=0x7fd34c01c930 comp rx=0 tx=0).stop 2024-09-13T18:30:58.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- 172.21.15.53:0/2371445613 shutdown_connections 2024-09-13T18:30:58.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 --2- 172.21.15.53:0/2371445613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540717b0 0x7fd35406cb70 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 --2- 172.21.15.53:0/2371445613 >> v2:172.21.15.87:3300/0 conn(0x7fd3540b4080 0x7fd35415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- 172.21.15.53:0/2371445613 >> 172.21.15.53:0/2371445613 conn(0x7fd354069f50 msgr2=0x7fd35406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:58.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- 172.21.15.53:0/2371445613 shutdown_connections 2024-09-13T18:30:58.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.346+0000 7fd35a43e640 1 -- 172.21.15.53:0/2371445613 wait complete. 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 Processor -- start 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 -- start start 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3540717b0 0x7fd354154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3540b3ca0 0x7fd3541516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540b4080 0x7fd354153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd354155180 con 0x7fd3540b4080 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540cdf60 con 0x7fd3540b3ca0 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd354153e80 con 0x7fd3540717b0 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540b4080 0x7fd354153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540b4080 0x7fd354153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43876/0 (socket says 172.21.15.53:43876) 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 -- 172.21.15.53:0/4081053384 learned_addr learned my addr 172.21.15.53:0/4081053384 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd34bfff640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3540b3ca0 0x7fd3541516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 -- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3540717b0 msgr2=0x7fd354154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd353fff640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3540717b0 0x7fd354154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3540717b0 0x7fd354154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 -- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3540b3ca0 msgr2=0x7fd3541516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3540b3ca0 0x7fd3541516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 -- 172.21.15.53:0/4081053384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c009a70 con 0x7fd3540b4080 2024-09-13T18:30:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3589db640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540b4080 0x7fd354153100 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd34c019540 tx=0x7fd34c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3517fa640 1 -- 172.21.15.53:0/4081053384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0b9860 con 0x7fd3540b4080 2024-09-13T18:30:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3517fa640 1 -- 172.21.15.53:0/4081053384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0b99e0 con 0x7fd3540b4080 2024-09-13T18:30:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd354154160 con 0x7fd3540b4080 2024-09-13T18:30:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3517fa640 1 -- 172.21.15.53:0/4081053384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0b9d90 con 0x7fd3540b4080 2024-09-13T18:30:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd354154720 con 0x7fd3540b4080 2024-09-13T18:30:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd354153fc0 con 0x7fd3540b4080 2024-09-13T18:30:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.350+0000 7fd3517fa640 1 -- 172.21.15.53:0/4081053384 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd34c0c4460 con 0x7fd3540b4080 2024-09-13T18:30:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.354+0000 7fd3517fa640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3340667b0 0x7fd334068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.354+0000 7fd3517fa640 1 -- 172.21.15.53:0/4081053384 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd34c11f640 con 0x7fd3540b4080 2024-09-13T18:30:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.354+0000 7fd353fff640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3340667b0 0x7fd334068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.354+0000 7fd353fff640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3340667b0 0x7fd334068c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd344005890 tx=0x7fd344009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.358+0000 7fd3517fa640 1 -- 172.21.15.53:0/4081053384 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd354153fc0 con 0x7fd3540b4080 2024-09-13T18:30:58.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.514+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd354153fc0 con 0x7fd3540b4080 2024-09-13T18:30:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.678+0000 7fd3517fa640 1 -- 172.21.15.53:0/4081053384 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v103) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd354153fc0 con 0x7fd3540b4080 2024-09-13T18:30:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:30:58.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3340667b0 msgr2=0x7fd334068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3340667b0 0x7fd334068c70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd344005890 tx=0x7fd344009040 comp rx=0 tx=0).stop 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540b4080 msgr2=0x7fd354153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540b4080 0x7fd354153100 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fd34c019540 tx=0x7fd34c0196d0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 shutdown_connections 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3340667b0 0x7fd334068c70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3540b4080 0x7fd354153100 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3540b3ca0 0x7fd3541516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 --2- 172.21.15.53:0/4081053384 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3540717b0 0x7fd354154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 >> 172.21.15.53:0/4081053384 conn(0x7fd354069f50 msgr2=0x7fd35415b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:58.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 shutdown_connections 2024-09-13T18:30:58.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.686+0000 7fd35a43e640 1 -- 172.21.15.53:0/4081053384 wait complete. 2024-09-13T18:30:58.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:30:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e2ab8b640 1 Processor -- start 2024-09-13T18:30:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e2ab8b640 1 -- start start 2024-09-13T18:30:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e2ab8b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1e24143e80 0x7f1e2406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e2ab8b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240caee0 0x7f1e240cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e2ab8b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2406f7a0 con 0x7f1e240cd320 2024-09-13T18:30:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e2ab8b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2406fd60 con 0x7f1e24143e80 2024-09-13T18:30:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e2ab8b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240cb960 con 0x7f1e240caee0 2024-09-13T18:30:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e28927640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1e24143e80 0x7f1e2406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e23fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240caee0 0x7f1e240cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e28927640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1e24143e80 0x7f1e2406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:37470/0 (socket says 172.21.15.53:37470) 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e28927640 1 -- 172.21.15.53:0/2819662005 learned_addr learned my addr 172.21.15.53:0/2819662005 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.846+0000 7f1e29128640 1 --1- 172.21.15.53:0/2819662005 >> v1:172.21.15.87:6789/0 conn(0x7f1e240cd320 0x7f1e240cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:56682/0 (socket says 172.21.15.53:56682) 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e28927640 1 -- 172.21.15.53:0/2819662005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240caee0 msgr2=0x7f1e240cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e28927640 1 --2- 172.21.15.53:0/2819662005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240caee0 0x7f1e240cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e28927640 1 -- 172.21.15.53:0/2819662005 >> v1:172.21.15.87:6789/0 conn(0x7f1e240cd320 legacy=0x7f1e240cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e28927640 1 -- 172.21.15.53:0/2819662005 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240cbc40 con 0x7f1e24143e80 2024-09-13T18:30:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e28927640 1 --2- 172.21.15.53:0/2819662005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e24143e80 0x7f1e2406b390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009870 tx=0x7f1e1801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb161c15c4c6e1fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e237fe640 1 -- 172.21.15.53:0/2819662005 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180ab680 con 0x7f1e24143e80 2024-09-13T18:30:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e237fe640 1 -- 172.21.15.53:0/2819662005 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e180ab7e0 con 0x7f1e24143e80 2024-09-13T18:30:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e237fe640 1 -- 172.21.15.53:0/2819662005 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180abb70 con 0x7f1e24143e80 2024-09-13T18:30:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/2819662005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e24143e80 msgr2=0x7f1e2406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/2819662005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e24143e80 0x7f1e2406b390 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009870 tx=0x7f1e1801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/2819662005 shutdown_connections 2024-09-13T18:30:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/2819662005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240caee0 0x7f1e240cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/2819662005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e24143e80 0x7f1e2406b390 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/2819662005 >> 172.21.15.53:0/2819662005 conn(0x7f1e24065c80 msgr2=0x7f1e24066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/2819662005 shutdown_connections 2024-09-13T18:30:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.850+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/2819662005 wait complete. 2024-09-13T18:30:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 Processor -- start 2024-09-13T18:30:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 -- start start 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e240caee0 0x7f1e24139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240cd320 0x7f1e24157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e24143e80 0x7f1e2413b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24138940 con 0x7f1e24143e80 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2415da70 con 0x7f1e240caee0 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2413a170 con 0x7f1e240cd320 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e24143e80 0x7f1e2413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e24143e80 0x7f1e2413b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43880/0 (socket says 172.21.15.53:43880) 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 -- 172.21.15.53:0/1030536892 learned_addr learned my addr 172.21.15.53:0/1030536892 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e28927640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e240caee0 0x7f1e24139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e23fff640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240cd320 0x7f1e24157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 -- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240cd320 msgr2=0x7f1e24157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240cd320 0x7f1e24157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 -- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e240caee0 msgr2=0x7f1e24139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e240caee0 0x7f1e24139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 -- 172.21.15.53:0/1030536892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180094d0 con 0x7f1e24143e80 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e29128640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e24143e80 0x7f1e2413b860 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c790 tx=0x7f1e1c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e217fa640 1 -- 172.21.15.53:0/1030536892 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c004d70 con 0x7f1e24143e80 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e217fa640 1 -- 172.21.15.53:0/1030536892 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00a640 con 0x7f1e24143e80 2024-09-13T18:30:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24138b90 con 0x7f1e24143e80 2024-09-13T18:30:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e217fa640 1 -- 172.21.15.53:0/1030536892 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00a9f0 con 0x7f1e24143e80 2024-09-13T18:30:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.854+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e24139150 con 0x7f1e24143e80 2024-09-13T18:30:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.858+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e240cb320 con 0x7f1e24143e80 2024-09-13T18:30:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.858+0000 7f1e217fa640 1 -- 172.21.15.53:0/1030536892 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f1e1c007070 con 0x7f1e24143e80 2024-09-13T18:30:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.858+0000 7f1e217fa640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e080667b0 0x7f1e08068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.858+0000 7f1e217fa640 1 -- 172.21.15.53:0/1030536892 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1e1c083c20 con 0x7f1e24143e80 2024-09-13T18:30:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.858+0000 7f1e28927640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e080667b0 0x7f1e08068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.858+0000 7f1e28927640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e080667b0 0x7f1e08068c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1e180af000 tx=0x7f1e180b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:58.862+0000 7f1e217fa640 1 -- 172.21.15.53:0/1030536892 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e1c0511f0 con 0x7f1e24143e80 2024-09-13T18:30:59.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.022+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1e2413eb90 con 0x7f1e24143e80 2024-09-13T18:30:59.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.694+0000 7f1e217fa640 1 -- 172.21.15.53:0/1030536892 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v104) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1e1c0180d0 con 0x7f1e24143e80 2024-09-13T18:30:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:30:59.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e080667b0 msgr2=0x7f1e08068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:59.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e080667b0 0x7f1e08068c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1e180af000 tx=0x7f1e180b6040 comp rx=0 tx=0).stop 2024-09-13T18:30:59.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e24143e80 msgr2=0x7f1e2413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:59.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e24143e80 0x7f1e2413b860 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c790 tx=0x7f1e1c00cb90 comp rx=0 tx=0).stop 2024-09-13T18:30:59.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 shutdown_connections 2024-09-13T18:30:59.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e080667b0 0x7f1e08068c70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e240cd320 0x7f1e24157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e24143e80 0x7f1e2413b860 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 --2- 172.21.15.53:0/1030536892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e240caee0 0x7f1e24139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 >> 172.21.15.53:0/1030536892 conn(0x7f1e24065c80 msgr2=0x7f1e24158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:59.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 shutdown_connections 2024-09-13T18:30:59.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.722+0000 7f1e2ab8b640 1 -- 172.21.15.53:0/1030536892 wait complete. 2024-09-13T18:30:59.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:30:59.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.870+0000 7f7b98e76640 1 Processor -- start 2024-09-13T18:30:59.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.870+0000 7f7b98e76640 1 -- start start 2024-09-13T18:30:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b98e76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b9406bdd0 0x7f7b940cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b98e76640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b940cb670 0x7f7b940b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b98e76640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b94160ed0 con 0x7f7b940b2d30 2024-09-13T18:30:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b98e76640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b940b23d0 con 0x7f7b9406bdd0 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b98e76640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940b1500 con 0x7f7b940cb670 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b9259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b9406bdd0 0x7f7b940cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b92d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7b940b2d30 0x7f7b9406c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41038/0 (socket says 172.21.15.53:41038) 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b92d9d640 1 -- 172.21.15.53:0/1720649325 learned_addr learned my addr 172.21.15.53:0/1720649325 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b91d9b640 1 --2- 172.21.15.53:0/1720649325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b940cb670 0x7f7b940b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b9259c640 1 -- 172.21.15.53:0/1720649325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b940cb670 msgr2=0x7f7b940b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b9259c640 1 --2- 172.21.15.53:0/1720649325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b940cb670 0x7f7b940b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b9259c640 1 -- 172.21.15.53:0/1720649325 >> v1:172.21.15.53:6789/0 conn(0x7f7b940b2d30 legacy=0x7f7b9406c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b9159a640 1 -- 172.21.15.53:0/1720649325 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166129662 0 0) 0x7f7b94160ed0 con 0x7f7b940b2d30 2024-09-13T18:30:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.874+0000 7f7b9259c640 1 -- 172.21.15.53:0/1720649325 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940b1750 con 0x7f7b9406bdd0 2024-09-13T18:30:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b9259c640 1 --2- 172.21.15.53:0/1720649325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b9406bdd0 0x7f7b940cb130 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f7b840097c0 tx=0x7f7b8401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3069509d62b29afc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b9159a640 1 -- 172.21.15.53:0/1720649325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840ab600 con 0x7f7b9406bdd0 2024-09-13T18:30:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b9159a640 1 -- 172.21.15.53:0/1720649325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b840a7050 con 0x7f7b9406bdd0 2024-09-13T18:30:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b9159a640 1 -- 172.21.15.53:0/1720649325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840ab980 con 0x7f7b9406bdd0 2024-09-13T18:30:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- 172.21.15.53:0/1720649325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b9406bdd0 msgr2=0x7f7b940cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1720649325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b9406bdd0 0x7f7b940cb130 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f7b840097c0 tx=0x7f7b8401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- 172.21.15.53:0/1720649325 shutdown_connections 2024-09-13T18:30:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1720649325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b940cb670 0x7f7b940b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1720649325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b9406bdd0 0x7f7b940cb130 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- 172.21.15.53:0/1720649325 >> 172.21.15.53:0/1720649325 conn(0x7f7b94065c80 msgr2=0x7f7b94066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- 172.21.15.53:0/1720649325 shutdown_connections 2024-09-13T18:30:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- 172.21.15.53:0/1720649325 wait complete. 2024-09-13T18:30:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 Processor -- start 2024-09-13T18:30:59.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- start start 2024-09-13T18:30:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b9406bdd0 0x7f7b94159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940b2d30 0x7f7b940ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b940cb670 0x7f7b9415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940ac8d0 con 0x7f7b940b2d30 2024-09-13T18:30:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940a84d0 con 0x7f7b940cb670 2024-09-13T18:30:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.878+0000 7f7b98e76640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94161160 con 0x7f7b9406bdd0 2024-09-13T18:30:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940b2d30 0x7f7b940ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940b2d30 0x7f7b940ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43898/0 (socket says 172.21.15.53:43898) 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 -- 172.21.15.53:0/1767947769 learned_addr learned my addr 172.21.15.53:0/1767947769 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b92d9d640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b940cb670 0x7f7b9415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b9259c640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b9406bdd0 0x7f7b94159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 -- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b9406bdd0 msgr2=0x7f7b94159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b9406bdd0 0x7f7b94159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 -- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b940cb670 msgr2=0x7f7b9415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b940cb670 0x7f7b9415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 -- 172.21.15.53:0/1767947769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84009420 con 0x7f7b940b2d30 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b91d9b640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940b2d30 0x7f7b940ac390 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00d5d0 tx=0x7f7b7c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b8affd640 1 -- 172.21.15.53:0/1767947769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c004240 con 0x7f7b940b2d30 2024-09-13T18:30:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b8affd640 1 -- 172.21.15.53:0/1767947769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0043a0 con 0x7f7b940b2d30 2024-09-13T18:30:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b940acae0 con 0x7f7b940b2d30 2024-09-13T18:30:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b8affd640 1 -- 172.21.15.53:0/1767947769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c003840 con 0x7f7b940b2d30 2024-09-13T18:30:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b940ad0a0 con 0x7f7b940b2d30 2024-09-13T18:30:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b940cb130 con 0x7f7b940b2d30 2024-09-13T18:30:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b8affd640 1 -- 172.21.15.53:0/1767947769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f7b7c0039a0 con 0x7f7b940b2d30 2024-09-13T18:30:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b8affd640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b740667b0 0x7f7b74068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b8affd640 1 -- 172.21.15.53:0/1767947769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7b7c084f10 con 0x7f7b940b2d30 2024-09-13T18:30:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b9259c640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b740667b0 0x7f7b74068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.882+0000 7f7b9259c640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b740667b0 0x7f7b74068c70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b840ad000 tx=0x7f7b840a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:30:59.886+0000 7f7b8affd640 1 -- 172.21.15.53:0/1767947769 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b7c0522b0 con 0x7f7b940b2d30 2024-09-13T18:31:00.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.082+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7b9415abb0 con 0x7f7b940b2d30 2024-09-13T18:31:00.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.094+0000 7f7b8affd640 1 -- 172.21.15.53:0/1767947769 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v58) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7b7c0558d0 con 0x7f7b940b2d30 2024-09-13T18:31:00.095 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 16 and data pool 17 2024-09-13T18:31:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b740667b0 msgr2=0x7f7b74068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b740667b0 0x7f7b74068c70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b840ad000 tx=0x7f7b840a6000 comp rx=0 tx=0).stop 2024-09-13T18:31:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940b2d30 msgr2=0x7f7b940ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940b2d30 0x7f7b940ac390 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00d5d0 tx=0x7f7b7c00da90 comp rx=0 tx=0).stop 2024-09-13T18:31:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 shutdown_connections 2024-09-13T18:31:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b740667b0 0x7f7b74068c70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b940cb670 0x7f7b9415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b940b2d30 0x7f7b940ac390 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 --2- 172.21.15.53:0/1767947769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b9406bdd0 0x7f7b94159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.098+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 >> 172.21.15.53:0/1767947769 conn(0x7f7b94065c80 msgr2=0x7f7b940cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.102+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 shutdown_connections 2024-09-13T18:31:00.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.102+0000 7f7b98e76640 1 -- 172.21.15.53:0/1767947769 wait complete. 2024-09-13T18:31:00.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:00.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.242+0000 7f21edc97640 1 Processor -- start 2024-09-13T18:31:00.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.242+0000 7f21edc97640 1 -- start start 2024-09-13T18:31:00.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21e80cbd60 0x7f21e80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e80b1ac0 con 0x7f21e806b850 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e80b3010 con 0x7f21e80cbd60 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8159ac0 con 0x7f21e80cb980 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21e80cbd60 0x7f21e80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21e80cbd60 0x7f21e80cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43902/0 (socket says 172.21.15.53:43902) 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 -- 172.21.15.53:0/3784556678 learned_addr learned my addr 172.21.15.53:0/3784556678 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 -- 172.21.15.53:0/3784556678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 msgr2=0x7f21e80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 --2- 172.21.15.53:0/3784556678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 -- 172.21.15.53:0/3784556678 >> v1:172.21.15.87:6789/0 conn(0x7f21e806b850 legacy=0x7f21e806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:00.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 -- 172.21.15.53:0/3784556678 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8159da0 con 0x7f21e80cbd60 2024-09-13T18:31:00.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e7fff640 1 --2- 172.21.15.53:0/3784556678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e80cdd40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f21e000d180 tx=0x7f21e001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9b262d1d63673c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e6ffd640 1 -- 172.21.15.53:0/3784556678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000b2d0 con 0x7f21e80cbd60 2024-09-13T18:31:00.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e6ffd640 1 -- 172.21.15.53:0/3784556678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e000b430 con 0x7f21e80cbd60 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21e6ffd640 1 -- 172.21.15.53:0/3784556678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00a7bc0 con 0x7f21e80cbd60 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 -- 172.21.15.53:0/3784556678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 msgr2=0x7f21e80cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 --2- 172.21.15.53:0/3784556678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e80cdd40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f21e000d180 tx=0x7f21e001eb10 comp rx=0 tx=0).stop 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 -- 172.21.15.53:0/3784556678 shutdown_connections 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 --2- 172.21.15.53:0/3784556678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e80cdd40 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 --2- 172.21.15.53:0/3784556678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.246+0000 7f21edc97640 1 -- 172.21.15.53:0/3784556678 >> 172.21.15.53:0/3784556678 conn(0x7f21e8065c80 msgr2=0x7f21e8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- 172.21.15.53:0/3784556678 shutdown_connections 2024-09-13T18:31:00.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- 172.21.15.53:0/3784556678 wait complete. 2024-09-13T18:31:00.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 Processor -- start 2024-09-13T18:31:00.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- start start 2024-09-13T18:31:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21e806b850 0x7f21e81f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e81624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e8162a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8152ae0 con 0x7f21e80cbd60 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e81f5cd0 con 0x7f21e806b850 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8151e60 con 0x7f21e80cb980 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e8162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e8162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43906/0 (socket says 172.21.15.53:43906) 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 -- 172.21.15.53:0/4200197696 learned_addr learned my addr 172.21.15.53:0/4200197696 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21dffff640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e81624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e77fe640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21e806b850 0x7f21e81f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 -- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 msgr2=0x7f21e81624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e81624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 -- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21e806b850 msgr2=0x7f21e81f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21e806b850 0x7f21e81f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 -- 172.21.15.53:0/4200197696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e000bd40 con 0x7f21e80cbd60 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21dffff640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e81624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e77fe640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21e806b850 0x7f21e81f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e7fff640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e8162a00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f21e001f3b0 tx=0x7f21e001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e4ff9640 1 -- 172.21.15.53:0/4200197696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0009800 con 0x7f21e80cbd60 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e4ff9640 1 -- 172.21.15.53:0/4200197696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0009960 con 0x7f21e80cbd60 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e8152140 con 0x7f21e80cbd60 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21e4ff9640 1 -- 172.21.15.53:0/4200197696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0009cf0 con 0x7f21e80cbd60 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.250+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e8152700 con 0x7f21e80cbd60 2024-09-13T18:31:00.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.254+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e8067400 con 0x7f21e80cbd60 2024-09-13T18:31:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.254+0000 7f21e4ff9640 1 -- 172.21.15.53:0/4200197696 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f21e00c3460 con 0x7f21e80cbd60 2024-09-13T18:31:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.254+0000 7f21e4ff9640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21c80667b0 0x7f21c8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.254+0000 7f21e4ff9640 1 -- 172.21.15.53:0/4200197696 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21e011fc30 con 0x7f21e80cbd60 2024-09-13T18:31:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.254+0000 7f21e77fe640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21c80667b0 0x7f21c8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.254+0000 7f21e77fe640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21c80667b0 0x7f21c8068c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21e814bc20 tx=0x7f21d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.258+0000 7f21e4ff9640 1 -- 172.21.15.53:0/4200197696 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21e00ecdf0 con 0x7f21e80cbd60 2024-09-13T18:31:00.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21e8067400 con 0x7f21e80cbd60 2024-09-13T18:31:00.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21e4ff9640 1 -- 172.21.15.53:0/4200197696 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16480 (secure 0 0 0) 0x7f21e00f0410 con 0x7f21e80cbd60 2024-09-13T18:31:00.420 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:00.420 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":105,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:00.085343+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:00.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21c80667b0 msgr2=0x7f21c8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21c80667b0 0x7f21c8068c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21e814bc20 tx=0x7f21d8008040 comp rx=0 tx=0).stop 2024-09-13T18:31:00.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 msgr2=0x7f21e8162a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e8162a00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f21e001f3b0 tx=0x7f21e001b8b0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 shutdown_connections 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21c80667b0 0x7f21c8068c70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21e80cb980 0x7f21e81624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21e80cbd60 0x7f21e8162a00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 --2- 172.21.15.53:0/4200197696 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21e806b850 0x7f21e81f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 >> 172.21.15.53:0/4200197696 conn(0x7f21e8065c80 msgr2=0x7f21e80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 shutdown_connections 2024-09-13T18:31:00.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.418+0000 7f21edc97640 1 -- 172.21.15.53:0/4200197696 wait complete. 2024-09-13T18:31:00.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:00.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.558+0000 7fdda7312640 1 Processor -- start 2024-09-13T18:31:00.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.558+0000 7fdda7312640 1 -- start start 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdda0158030 0x7fdda015b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdda00b0fb0 0x7fdda00ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda0158410 con 0x7fdda006f710 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda0070720 con 0x7fdda0158030 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda006fe80 con 0x7fdda00b0fb0 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdda0158030 0x7fdda015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdda0158030 0x7fdda015b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43922/0 (socket says 172.21.15.53:43922) 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 -- 172.21.15.53:0/848186813 learned_addr learned my addr 172.21.15.53:0/848186813 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:00.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda58af640 1 --2- 172.21.15.53:0/848186813 >> v2:172.21.15.87:3300/0 conn(0x7fdda00b0fb0 0x7fdda00ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 -- 172.21.15.53:0/848186813 >> v2:172.21.15.87:3300/0 conn(0x7fdda00b0fb0 msgr2=0x7fdda00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:00.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 --2- 172.21.15.53:0/848186813 >> v2:172.21.15.87:3300/0 conn(0x7fdda00b0fb0 0x7fdda00ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 -- 172.21.15.53:0/848186813 >> v1:172.21.15.87:6789/0 conn(0x7fdda006f710 legacy=0x7fdda00b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:00.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 -- 172.21.15.53:0/848186813 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0070160 con 0x7fdda0158030 2024-09-13T18:31:00.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda50ae640 1 --2- 172.21.15.53:0/848186813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda0158030 0x7fdda015b560 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fdda015def0 tx=0x7fdd9401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67e0ae9e0080016 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdd93fff640 1 -- 172.21.15.53:0/848186813 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940aa610 con 0x7fdda0158030 2024-09-13T18:31:00.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdd93fff640 1 -- 172.21.15.53:0/848186813 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd940a6040 con 0x7fdda0158030 2024-09-13T18:31:00.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdd93fff640 1 -- 172.21.15.53:0/848186813 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940aa990 con 0x7fdda0158030 2024-09-13T18:31:00.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- 172.21.15.53:0/848186813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda0158030 msgr2=0x7fdda015b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 --2- 172.21.15.53:0/848186813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda0158030 0x7fdda015b560 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fdda015def0 tx=0x7fdd9401c4b0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- 172.21.15.53:0/848186813 shutdown_connections 2024-09-13T18:31:00.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 --2- 172.21.15.53:0/848186813 >> v2:172.21.15.87:3300/0 conn(0x7fdda00b0fb0 0x7fdda00ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 --2- 172.21.15.53:0/848186813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda0158030 0x7fdda015b560 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- 172.21.15.53:0/848186813 >> 172.21.15.53:0/848186813 conn(0x7fdda0066080 msgr2=0x7fdda0066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- 172.21.15.53:0/848186813 shutdown_connections 2024-09-13T18:31:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.562+0000 7fdda7312640 1 -- 172.21.15.53:0/848186813 wait complete. 2024-09-13T18:31:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 Processor -- start 2024-09-13T18:31:00.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 -- start start 2024-09-13T18:31:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda006f710 0x7fdda0161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda00b0fb0 0x7fdda0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda0158030 0x7fdda00ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda015ffb0 con 0x7fdda00b0fb0 2024-09-13T18:31:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda015f0c0 con 0x7fdda0158030 2024-09-13T18:31:00.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda015f3a0 con 0x7fdda006f710 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda00b0fb0 0x7fdda0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda00b0fb0 0x7fdda0156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43928/0 (socket says 172.21.15.53:43928) 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 -- 172.21.15.53:0/3831891591 learned_addr learned my addr 172.21.15.53:0/3831891591 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda50ae640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda006f710 0x7fdda0161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda58af640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda0158030 0x7fdda00ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 -- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda006f710 msgr2=0x7fdda0161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda006f710 0x7fdda0161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 -- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda0158030 msgr2=0x7fdda00ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda0158030 0x7fdda00ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 -- 172.21.15.53:0/3831891591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940094d0 con 0x7fdda00b0fb0 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda48ad640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda00b0fb0 0x7fdda0156a40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c450 tx=0x7fdd9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdd91ffb640 1 -- 172.21.15.53:0/3831891591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c012830 con 0x7fdda00b0fb0 2024-09-13T18:31:00.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdd91ffb640 1 -- 172.21.15.53:0/3831891591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0129b0 con 0x7fdda00b0fb0 2024-09-13T18:31:00.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdd91ffb640 1 -- 172.21.15.53:0/3831891591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c012d60 con 0x7fdda00b0fb0 2024-09-13T18:31:00.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda015f680 con 0x7fdda00b0fb0 2024-09-13T18:31:00.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda015fc40 con 0x7fdda00b0fb0 2024-09-13T18:31:00.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.566+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda0160120 con 0x7fdda00b0fb0 2024-09-13T18:31:00.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.570+0000 7fdd91ffb640 1 -- 172.21.15.53:0/3831891591 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fdd9c01c460 con 0x7fdda00b0fb0 2024-09-13T18:31:00.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.570+0000 7fdd91ffb640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdd840667b0 0x7fdd84068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.570+0000 7fdd91ffb640 1 -- 172.21.15.53:0/3831891591 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd9c084080 con 0x7fdda00b0fb0 2024-09-13T18:31:00.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.570+0000 7fdda50ae640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdd840667b0 0x7fdd84068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.570+0000 7fdda50ae640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdd840667b0 0x7fdd84068c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd940ae000 tx=0x7fdd940a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.574+0000 7fdd91ffb640 1 -- 172.21.15.53:0/3831891591 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdd9c051370 con 0x7fdda00b0fb0 2024-09-13T18:31:00.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.734+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdda00ccc40 con 0x7fdda00b0fb0 2024-09-13T18:31:00.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.734+0000 7fdd91ffb640 1 -- 172.21.15.53:0/3831891591 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16480 (secure 0 0 0) 0x7fdd9c054990 con 0x7fdda00b0fb0 2024-09-13T18:31:00.737 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:00.737 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":105,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:00.085343+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdd840667b0 msgr2=0x7fdd84068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdd840667b0 0x7fdd84068c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd940ae000 tx=0x7fdd940a7000 comp rx=0 tx=0).stop 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda00b0fb0 msgr2=0x7fdda0156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda00b0fb0 0x7fdda0156a40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c450 tx=0x7fdd9c00c910 comp rx=0 tx=0).stop 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 shutdown_connections 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdd840667b0 0x7fdd84068c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdda0158030 0x7fdda00ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdda00b0fb0 0x7fdda0156a40 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 --2- 172.21.15.53:0/3831891591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdda006f710 0x7fdda0161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 >> 172.21.15.53:0/3831891591 conn(0x7fdda0066080 msgr2=0x7fdda0159640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 shutdown_connections 2024-09-13T18:31:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.738+0000 7fdda7312640 1 -- 172.21.15.53:0/3831891591 wait complete. 2024-09-13T18:31:00.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:31:00.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.878+0000 7f3f54caf640 1 Processor -- start 2024-09-13T18:31:00.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f54caf640 1 -- start start 2024-09-13T18:31:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f54caf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f50156c40 0x7f3f50070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f54caf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f50157020 0x7f3f5006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f54caf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3f5006d270 0x7f3f5015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f54caf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5006d6e0 con 0x7f3f50156c40 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f54caf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500b15a0 con 0x7f3f5006d270 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f54caf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500b1880 con 0x7f3f50157020 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f50156c40 0x7f3f50070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f50156c40 0x7f3f50070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43944/0 (socket says 172.21.15.53:43944) 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 -- 172.21.15.53:0/1876052507 learned_addr learned my addr 172.21.15.53:0/1876052507 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 -- 172.21.15.53:0/1876052507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f50157020 msgr2=0x7f3f5006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4ed9d640 1 --2- 172.21.15.53:0/1876052507 >> v2:172.21.15.87:3300/0 conn(0x7f3f5006d270 0x7f3f5015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4dd9b640 1 --2- 172.21.15.53:0/1876052507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f50157020 0x7f3f5006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 --2- 172.21.15.53:0/1876052507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f50157020 0x7f3f5006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 -- 172.21.15.53:0/1876052507 >> v2:172.21.15.87:3300/0 conn(0x7f3f5006d270 msgr2=0x7f3f5015cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 --2- 172.21.15.53:0/1876052507 >> v2:172.21.15.87:3300/0 conn(0x7f3f5006d270 0x7f3f5015cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 -- 172.21.15.53:0/1876052507 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500b1b60 con 0x7f3f50156c40 2024-09-13T18:31:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4ed9d640 1 --2- 172.21.15.53:0/1876052507 >> v2:172.21.15.87:3300/0 conn(0x7f3f5006d270 0x7f3f5015cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:00.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4dd9b640 1 --2- 172.21.15.53:0/1876052507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f50157020 0x7f3f5006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:00.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.882+0000 7f3f4e59c640 1 --2- 172.21.15.53:0/1876052507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50070ee0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f3f500ce400 tx=0x7f3f4001e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7412bb2ba3331c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4d59a640 1 -- 172.21.15.53:0/1876052507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400a7990 con 0x7f3f50156c40 2024-09-13T18:31:00.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4d59a640 1 -- 172.21.15.53:0/1876052507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f400a7af0 con 0x7f3f50156c40 2024-09-13T18:31:00.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4d59a640 1 -- 172.21.15.53:0/1876052507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400a7e80 con 0x7f3f50156c40 2024-09-13T18:31:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- 172.21.15.53:0/1876052507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 msgr2=0x7f3f50070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 --2- 172.21.15.53:0/1876052507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50070ee0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f3f500ce400 tx=0x7f3f4001e900 comp rx=0 tx=0).stop 2024-09-13T18:31:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- 172.21.15.53:0/1876052507 shutdown_connections 2024-09-13T18:31:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 --2- 172.21.15.53:0/1876052507 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f50157020 0x7f3f5006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 --2- 172.21.15.53:0/1876052507 >> v2:172.21.15.87:3300/0 conn(0x7f3f5006d270 0x7f3f5015cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 --2- 172.21.15.53:0/1876052507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50070ee0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- 172.21.15.53:0/1876052507 >> 172.21.15.53:0/1876052507 conn(0x7f3f50065c80 msgr2=0x7f3f50066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- 172.21.15.53:0/1876052507 shutdown_connections 2024-09-13T18:31:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- 172.21.15.53:0/1876052507 wait complete. 2024-09-13T18:31:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 Processor -- start 2024-09-13T18:31:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- start start 2024-09-13T18:31:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f5006d270 0x7f3f5014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5013a3c0 0x7f3f500ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50156350 con 0x7f3f50156c40 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50153420 con 0x7f3f5013a3c0 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5013d4c0 con 0x7f3f5006d270 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43954/0 (socket says 172.21.15.53:43954) 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 -- 172.21.15.53:0/394418969 learned_addr learned my addr 172.21.15.53:0/394418969 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4e59c640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f5006d270 0x7f3f5014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4ed9d640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5013a3c0 0x7f3f500ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 -- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f5006d270 msgr2=0x7f3f5014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f5006d270 0x7f3f5014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 -- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5013a3c0 msgr2=0x7f3f500ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5013a3c0 0x7f3f500ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 -- 172.21.15.53:0/394418969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4000b770 con 0x7f3f50156c40 2024-09-13T18:31:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4e59c640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f5006d270 0x7f3f5014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f4dd9b640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50155e10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7f0 tx=0x7f3f4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f3effd640 1 -- 172.21.15.53:0/394418969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44007820 con 0x7f3f50156c40 2024-09-13T18:31:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f3effd640 1 -- 172.21.15.53:0/394418969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f44007980 con 0x7f3f50156c40 2024-09-13T18:31:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5013d7a0 con 0x7f3f50156c40 2024-09-13T18:31:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f3effd640 1 -- 172.21.15.53:0/394418969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44007d30 con 0x7f3f50156c40 2024-09-13T18:31:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.886+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f50153950 con 0x7f3f50156c40 2024-09-13T18:31:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.890+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5015cde0 con 0x7f3f50156c40 2024-09-13T18:31:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.890+0000 7f3f3effd640 1 -- 172.21.15.53:0/394418969 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f3f440113f0 con 0x7f3f50156c40 2024-09-13T18:31:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.890+0000 7f3f3effd640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f300667b0 0x7f3f30068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.890+0000 7f3f3effd640 1 -- 172.21.15.53:0/394418969 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f440846e0 con 0x7f3f50156c40 2024-09-13T18:31:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.890+0000 7f3f4e59c640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f300667b0 0x7f3f30068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.890+0000 7f3f4e59c640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f300667b0 0x7f3f30068c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f400b1000 tx=0x7f3f40008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:00.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:00.894+0000 7f3f3effd640 1 -- 172.21.15.53:0/394418969 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f440518c0 con 0x7f3f50156c40 2024-09-13T18:31:01.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:01.090+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3f50153b70 con 0x7f3f50156c40 2024-09-13T18:31:01.677 INFO:tasks.ceph.mds.c.smithi053.stderr:2024-09-13T18:31:01.674+0000 7f07e76a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:31:02.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.102+0000 7f3f3effd640 1 -- 172.21.15.53:0/394418969 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3f4401f0b0 con 0x7f3f50156c40 2024-09-13T18:31:02.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f300667b0 msgr2=0x7f3f30068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:02.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f300667b0 0x7f3f30068c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f400b1000 tx=0x7f3f40008040 comp rx=0 tx=0).stop 2024-09-13T18:31:02.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 msgr2=0x7f3f50155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:02.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50155e10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c7f0 tx=0x7f3f4400ccb0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 shutdown_connections 2024-09-13T18:31:02.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f300667b0 0x7f3f30068c70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f5013a3c0 0x7f3f500ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f50156c40 0x7f3f50155e10 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 --2- 172.21.15.53:0/394418969 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f5006d270 0x7f3f5014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 >> 172.21.15.53:0/394418969 conn(0x7f3f50065c80 msgr2=0x7f3f5006b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:02.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 shutdown_connections 2024-09-13T18:31:02.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.106+0000 7f3f54caf640 1 -- 172.21.15.53:0/394418969 wait complete. 2024-09-13T18:31:02.129 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:31:02.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:31:02.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadf1b68640 1 Processor -- start 2024-09-13T18:31:02.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadf1b68640 1 -- start start 2024-09-13T18:31:02.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadf1b68640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec070ce0 0x7fadec071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:02.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadf1b68640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fadec06b390 0x7fadec06b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:02.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadf1b68640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec146180 con 0x7fadec1457c0 2024-09-13T18:31:02.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadf1b68640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0702d0 con 0x7fadec06b390 2024-09-13T18:31:02.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadf1b68640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec06c4c0 con 0x7fadec070ce0 2024-09-13T18:31:02.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadebfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fadec06b390 0x7fadec06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:02.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadeaffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec070ce0 0x7fadec071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:02.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadebfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fadec06b390 0x7fadec06b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:37532/0 (socket says 172.21.15.53:37532) 2024-09-13T18:31:02.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadebfff640 1 -- 172.21.15.53:0/4177852293 learned_addr learned my addr 172.21.15.53:0/4177852293 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:02.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadebfff640 1 -- 172.21.15.53:0/4177852293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec070ce0 msgr2=0x7fadec071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:02.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadebfff640 1 --2- 172.21.15.53:0/4177852293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec070ce0 0x7fadec071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadebfff640 1 -- 172.21.15.53:0/4177852293 >> v1:172.21.15.87:6789/0 conn(0x7fadec1457c0 legacy=0x7fadec0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:02.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.262+0000 7fadebfff640 1 -- 172.21.15.53:0/4177852293 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec06bf00 con 0x7fadec06b390 2024-09-13T18:31:02.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadebfff640 1 --2- 172.21.15.53:0/4177852293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec06b390 0x7fadec06b800 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fade4009e50 tx=0x7fade401ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=307d8e8d443e5271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:02.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadea7fc640 1 -- 172.21.15.53:0/4177852293 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40a5810 con 0x7fadec06b390 2024-09-13T18:31:02.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadea7fc640 1 -- 172.21.15.53:0/4177852293 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40a5970 con 0x7fadec06b390 2024-09-13T18:31:02.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadea7fc640 1 -- 172.21.15.53:0/4177852293 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40a5d00 con 0x7fadec06b390 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 -- 172.21.15.53:0/4177852293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec06b390 msgr2=0x7fadec06b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 --2- 172.21.15.53:0/4177852293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec06b390 0x7fadec06b800 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fade4009e50 tx=0x7fade401ca30 comp rx=0 tx=0).stop 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 -- 172.21.15.53:0/4177852293 shutdown_connections 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 --2- 172.21.15.53:0/4177852293 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec06b390 0x7fadec06b800 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 --2- 172.21.15.53:0/4177852293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec070ce0 0x7fadec071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 -- 172.21.15.53:0/4177852293 >> 172.21.15.53:0/4177852293 conn(0x7fadec065c80 msgr2=0x7fadec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 -- 172.21.15.53:0/4177852293 shutdown_connections 2024-09-13T18:31:02.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.266+0000 7fadf1b68640 1 -- 172.21.15.53:0/4177852293 wait complete. 2024-09-13T18:31:02.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 Processor -- start 2024-09-13T18:31:02.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 -- start start 2024-09-13T18:31:02.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec06b390 0x7fadec143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:02.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec070ce0 0x7fadec15f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec1457c0 0x7fadec15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec15bfc0 con 0x7fadec1457c0 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec15c260 con 0x7fadec070ce0 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec15ed90 con 0x7fadec06b390 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec1457c0 0x7fadec15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec1457c0 0x7fadec15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43960/0 (socket says 172.21.15.53:43960) 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 -- 172.21.15.53:0/1436038205 learned_addr learned my addr 172.21.15.53:0/1436038205 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadeb7fe640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec06b390 0x7fadec143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadeaffd640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec070ce0 0x7fadec15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 -- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec06b390 msgr2=0x7fadec143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec06b390 0x7fadec143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 -- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec070ce0 msgr2=0x7fadec15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec070ce0 0x7fadec15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 -- 172.21.15.53:0/1436038205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4009b30 con 0x7fadec1457c0 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadeaffd640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec070ce0 0x7fadec15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadebfff640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec1457c0 0x7fadec15a1e0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fade401a660 tx=0x7fade40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadd3fff640 1 -- 172.21.15.53:0/1436038205 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40b8470 con 0x7fadec1457c0 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadd3fff640 1 -- 172.21.15.53:0/1436038205 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40b85f0 con 0x7fadec1457c0 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec15f070 con 0x7fadec1457c0 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadd3fff640 1 -- 172.21.15.53:0/1436038205 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40b89a0 con 0x7fadec1457c0 2024-09-13T18:31:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec15fad0 con 0x7fadec1457c0 2024-09-13T18:31:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.270+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec15f2b0 con 0x7fadec1457c0 2024-09-13T18:31:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.274+0000 7fadd3fff640 1 -- 172.21.15.53:0/1436038205 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fade40b8b00 con 0x7fadec1457c0 2024-09-13T18:31:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.274+0000 7fadd3fff640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fadd80667b0 0x7fadd8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.274+0000 7fadd3fff640 1 -- 172.21.15.53:0/1436038205 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fade411efe0 con 0x7fadec1457c0 2024-09-13T18:31:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.274+0000 7fadeb7fe640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fadd80667b0 0x7fadd8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.274+0000 7fadeb7fe640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fadd80667b0 0x7fadd8068c70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faddc001810 tx=0x7faddc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:02.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.278+0000 7fadd3fff640 1 -- 172.21.15.53:0/1436038205 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fade40ec2d0 con 0x7fadec1457c0 2024-09-13T18:31:02.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:02.482+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fadec15eed0 con 0x7fadec1457c0 2024-09-13T18:31:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.102+0000 7fadd3fff640 1 -- 172.21.15.53:0/1436038205 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7fadec15eed0 con 0x7fadec1457c0 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fadd80667b0 msgr2=0x7fadd8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fadd80667b0 0x7fadd8068c70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faddc001810 tx=0x7faddc009040 comp rx=0 tx=0).stop 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec1457c0 msgr2=0x7fadec15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec1457c0 0x7fadec15a1e0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fade401a660 tx=0x7fade40197d0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 shutdown_connections 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fadd80667b0 0x7fadd8068c70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec1457c0 0x7fadec15a1e0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fadec070ce0 0x7fadec15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 --2- 172.21.15.53:0/1436038205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fadec06b390 0x7fadec143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 >> 172.21.15.53:0/1436038205 conn(0x7fadec065c80 msgr2=0x7fadec140e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 shutdown_connections 2024-09-13T18:31:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.106+0000 7fadf1b68640 1 -- 172.21.15.53:0/1436038205 wait complete. 2024-09-13T18:31:03.131 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:31:03.131 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efef486c640 1 Processor -- start 2024-09-13T18:31:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efef486c640 1 -- start start 2024-09-13T18:31:03.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efef486c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efef015b7c0 0x7efef0070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efef486c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efef00711d0 0x7efef01640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efef486c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef006d480 con 0x7efef01582a0 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efef486c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef0071680 con 0x7efef015b7c0 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efef486c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef015aaf0 con 0x7efef00711d0 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeedd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efef015b7c0 0x7efef0070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeedd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efef015b7c0 0x7efef0070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43972/0 (socket says 172.21.15.53:43972) 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeedd9b640 1 -- 172.21.15.53:0/2775867961 learned_addr learned my addr 172.21.15.53:0/2775867961 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeeed9d640 1 --2- 172.21.15.53:0/2775867961 >> v2:172.21.15.87:3300/0 conn(0x7efef00711d0 0x7efef01640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeedd9b640 1 -- 172.21.15.53:0/2775867961 >> v2:172.21.15.87:3300/0 conn(0x7efef00711d0 msgr2=0x7efef01640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeedd9b640 1 --2- 172.21.15.53:0/2775867961 >> v2:172.21.15.87:3300/0 conn(0x7efef00711d0 0x7efef01640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeedd9b640 1 -- 172.21.15.53:0/2775867961 >> v1:172.21.15.87:6789/0 conn(0x7efef01582a0 legacy=0x7efef006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.258+0000 7efeedd9b640 1 -- 172.21.15.53:0/2775867961 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef015ace0 con 0x7efef015b7c0 2024-09-13T18:31:03.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efeedd9b640 1 --2- 172.21.15.53:0/2775867961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef015b7c0 0x7efef0070c90 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7efef0158680 tx=0x7efee401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88967946fb90bb2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efeed59a640 1 -- 172.21.15.53:0/2775867961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee40ac630 con 0x7efef015b7c0 2024-09-13T18:31:03.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efeed59a640 1 -- 172.21.15.53:0/2775867961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee40ac790 con 0x7efef015b7c0 2024-09-13T18:31:03.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efeed59a640 1 -- 172.21.15.53:0/2775867961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee40acb20 con 0x7efef015b7c0 2024-09-13T18:31:03.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 -- 172.21.15.53:0/2775867961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef015b7c0 msgr2=0x7efef0070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 --2- 172.21.15.53:0/2775867961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef015b7c0 0x7efef0070c90 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7efef0158680 tx=0x7efee401c4e0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 -- 172.21.15.53:0/2775867961 shutdown_connections 2024-09-13T18:31:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 --2- 172.21.15.53:0/2775867961 >> v2:172.21.15.87:3300/0 conn(0x7efef00711d0 0x7efef01640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 --2- 172.21.15.53:0/2775867961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef015b7c0 0x7efef0070c90 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 -- 172.21.15.53:0/2775867961 >> 172.21.15.53:0/2775867961 conn(0x7efef0065c80 msgr2=0x7efef0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 -- 172.21.15.53:0/2775867961 shutdown_connections 2024-09-13T18:31:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 -- 172.21.15.53:0/2775867961 wait complete. 2024-09-13T18:31:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 Processor -- start 2024-09-13T18:31:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.262+0000 7efef486c640 1 -- start start 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efef00711d0 0x7efef01f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef01582a0 0x7efef00b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efef015b7c0 0x7efef0149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef01f5ea0 con 0x7efef01582a0 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef00b1a60 con 0x7efef015b7c0 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef0153f70 con 0x7efef00711d0 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef01582a0 0x7efef00b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef01582a0 0x7efef00b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43976/0 (socket says 172.21.15.53:43976) 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 -- 172.21.15.53:0/1568986740 learned_addr learned my addr 172.21.15.53:0/1568986740 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeee59c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efef00711d0 0x7efef01f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeeed9d640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efef015b7c0 0x7efef0149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 -- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efef00711d0 msgr2=0x7efef01f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efef00711d0 0x7efef01f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 -- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efef015b7c0 msgr2=0x7efef0149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efef015b7c0 0x7efef0149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 -- 172.21.15.53:0/1568986740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee40094d0 con 0x7efef01582a0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeedd9b640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef01582a0 0x7efef00b1520 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7efee401ab90 tx=0x7efee401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efedeffd640 1 -- 172.21.15.53:0/1568986740 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee40b7620 con 0x7efef01582a0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efedeffd640 1 -- 172.21.15.53:0/1568986740 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee40b77a0 con 0x7efef01582a0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efedeffd640 1 -- 172.21.15.53:0/1568986740 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee40b7b50 con 0x7efef01582a0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef006fe20 con 0x7efef01582a0 2024-09-13T18:31:03.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef0070100 con 0x7efef01582a0 2024-09-13T18:31:03.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef0067400 con 0x7efef01582a0 2024-09-13T18:31:03.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efedeffd640 1 -- 172.21.15.53:0/1568986740 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7efee40b3040 con 0x7efef01582a0 2024-09-13T18:31:03.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efedeffd640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efed00667b0 0x7efed0068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efedeffd640 1 -- 172.21.15.53:0/1568986740 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efee411e8f0 con 0x7efef01582a0 2024-09-13T18:31:03.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeee59c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efed00667b0 0x7efed0068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.266+0000 7efeee59c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efed00667b0 0x7efed0068c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efee0004e30 tx=0x7efee0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.270+0000 7efedeffd640 1 -- 172.21.15.53:0/1568986740 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efee40ebad0 con 0x7efef01582a0 2024-09-13T18:31:03.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.462+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efef01f84d0 con 0x7efef01582a0 2024-09-13T18:31:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.462+0000 7efedeffd640 1 -- 172.21.15.53:0/1568986740 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4733 (secure 0 0 0) 0x7efee40ef0f0 con 0x7efef01582a0 2024-09-13T18:31:03.466 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:03.466 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/1892947074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1892947074},{"type":"v1","addr":"172.21.15.87:6834","nonce":1892947074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3784505733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3784505733},{"type":"v1","addr":"172.21.15.87:6835","nonce":3784505733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/945674829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":945674829},{"type":"v1","addr":"172.21.15.53:6833","nonce":945674829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:00.085788+0000","modified":"2024-09-13T18:31:03.099836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2605273551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2605273551},{"type":"v1","addr":"172.21.15.53:6835","nonce":2605273551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:31:03.466 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 62 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efed00667b0 msgr2=0x7efed0068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efed00667b0 0x7efed0068c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efee0004e30 tx=0x7efee0009040 comp rx=0 tx=0).stop 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef01582a0 msgr2=0x7efef00b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef01582a0 0x7efef00b1520 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7efee401ab90 tx=0x7efee401ad20 comp rx=0 tx=0).stop 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 shutdown_connections 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efed00667b0 0x7efed0068c70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efef015b7c0 0x7efef0149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efef01582a0 0x7efef00b1520 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 --2- 172.21.15.53:0/1568986740 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efef00711d0 0x7efef01f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 >> 172.21.15.53:0/1568986740 conn(0x7efef0065c80 msgr2=0x7efef00aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 shutdown_connections 2024-09-13T18:31:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.466+0000 7efef486c640 1 -- 172.21.15.53:0/1568986740 wait complete. 2024-09-13T18:31:03.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:03.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.602+0000 7f2d03db9640 1 Processor -- start 2024-09-13T18:31:03.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.602+0000 7f2d03db9640 1 -- start start 2024-09-13T18:31:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d03db9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 0x7f2cfc0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d03db9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cfc06f550 con 0x7f2cfc15cc60 2024-09-13T18:31:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d03db9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cfc15dc40 con 0x7f2cfc0b1c10 2024-09-13T18:31:03.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d03db9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc06f880 con 0x7f2cfc15a470 2024-09-13T18:31:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d01354640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2cfc15cc60 0x7f2cfc071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41052/0 (socket says 172.21.15.53:41052) 2024-09-13T18:31:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d01354640 1 -- 172.21.15.53:0/600748605 learned_addr learned my addr 172.21.15.53:0/600748605 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d01b55640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 0x7f2cfc0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216827883 0 0) 0x7f2cfc06f550 con 0x7f2cfc15cc60 2024-09-13T18:31:03.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ce8003530 con 0x7f2cfc15cc60 2024-09-13T18:31:03.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418919852 0 0) 0x7f2ce8003530 con 0x7f2cfc15cc60 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 msgr2=0x7f2cfc0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 0x7f2cfc0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 >> v1:172.21.15.87:6789/0 conn(0x7f2cfc0b1c10 legacy=0x7f2cfc06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc15d3a0 con 0x7f2cfc15cc60 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f2cec001680 con 0x7f2cfc15cc60 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 >> v1:172.21.15.53:6789/0 conn(0x7f2cfc15cc60 legacy=0x7f2cfc071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 0x7f2ce80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce8003f30 0x7f2ce80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8004d10 0x7f2ce8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc06f880 con 0x7f2ce8004d10 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce800ba70 con 0x7f2ce8003f30 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce800bc30 con 0x7f2cfc15a470 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d02356640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8004d10 0x7f2ce8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d01354640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce8003f30 0x7f2ce80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d01b55640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 0x7f2ce80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d02356640 1 -- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 msgr2=0x7f2ce80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d02356640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc15a470 0x7f2ce80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d02356640 1 -- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce8003f30 msgr2=0x7f2ce80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d02356640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce8003f30 0x7f2ce80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d02356640 1 -- 172.21.15.53:0/600748605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8003530 con 0x7f2ce8004d10 2024-09-13T18:31:03.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.606+0000 7f2d01354640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce8003f30 0x7f2ce80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:03.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d02356640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8004d10 0x7f2ce8005190 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4001e70 tx=0x7f2cf401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916bf7fc491e4533 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4003b80 con 0x7f2ce8004d10 2024-09-13T18:31:03.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf4003ce0 con 0x7f2ce8004d10 2024-09-13T18:31:03.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d00b53640 1 -- 172.21.15.53:0/600748605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40052c0 con 0x7f2ce8004d10 2024-09-13T18:31:03.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- 172.21.15.53:0/600748605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8004d10 msgr2=0x7f2ce8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 --2- 172.21.15.53:0/600748605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce8004d10 0x7f2ce8005190 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4001e70 tx=0x7f2cf401c780 comp rx=0 tx=0).stop 2024-09-13T18:31:03.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d02356640 1 -- 172.21.15.53:0/600748605 reap_dead start 2024-09-13T18:31:03.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- 172.21.15.53:0/600748605 shutdown_connections 2024-09-13T18:31:03.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- 172.21.15.53:0/600748605 >> 172.21.15.53:0/600748605 conn(0x7f2cfc065c80 msgr2=0x7f2cfc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:03.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- 172.21.15.53:0/600748605 shutdown_connections 2024-09-13T18:31:03.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- 172.21.15.53:0/600748605 wait complete. 2024-09-13T18:31:03.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 Processor -- start 2024-09-13T18:31:03.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- start start 2024-09-13T18:31:03.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cfc06fe00 0x7f2cfc155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc0701e0 0x7f2cfc1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cfc158c30 0x7f2cfc1f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc155e40 con 0x7f2cfc06fe00 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c3770 con 0x7f2cfc158c30 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d03db9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc152dc0 con 0x7f2cfc0701e0 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cfc06fe00 0x7f2cfc155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cfc06fe00 0x7f2cfc155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43984/0 (socket says 172.21.15.53:43984) 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 -- 172.21.15.53:0/3710918555 learned_addr learned my addr 172.21.15.53:0/3710918555 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d02356640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cfc158c30 0x7f2cfc1f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01354640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc0701e0 0x7f2cfc1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 -- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc0701e0 msgr2=0x7f2cfc1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc0701e0 0x7f2cfc1586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 -- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cfc158c30 msgr2=0x7f2cfc1f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cfc158c30 0x7f2cfc1f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 -- 172.21.15.53:0/3710918555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc1530a0 con 0x7f2cfc06fe00 2024-09-13T18:31:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2d01b55640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cfc06fe00 0x7f2cfc155900 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80115e0 tx=0x7f2cf8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.610+0000 7f2cf27fc640 1 -- 172.21.15.53:0/3710918555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f8f0 con 0x7f2cfc06fe00 2024-09-13T18:31:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2cf27fc640 1 -- 172.21.15.53:0/3710918555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800fa50 con 0x7f2cfc06fe00 2024-09-13T18:31:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc153380 con 0x7f2cfc06fe00 2024-09-13T18:31:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2cf27fc640 1 -- 172.21.15.53:0/3710918555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800fdc0 con 0x7f2cfc06fe00 2024-09-13T18:31:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc14b4b0 con 0x7f2cfc06fe00 2024-09-13T18:31:03.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc067400 con 0x7f2cfc06fe00 2024-09-13T18:31:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2cf27fc640 1 -- 172.21.15.53:0/3710918555 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f2cf8015460 con 0x7f2cfc06fe00 2024-09-13T18:31:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2cf27fc640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ce00667b0 0x7f2ce0068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2cf27fc640 1 -- 172.21.15.53:0/3710918555 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cf80848a0 con 0x7f2cfc06fe00 2024-09-13T18:31:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2d01354640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ce00667b0 0x7f2ce0068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.614+0000 7f2d01354640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ce00667b0 0x7f2ce0068c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2cec001210 tx=0x7f2cec001160 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.618+0000 7f2cf27fc640 1 -- 172.21.15.53:0/3710918555 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2cf8051a60 con 0x7f2cfc06fe00 2024-09-13T18:31:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.778+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cfc0cc640 con 0x7f2cfc06fe00 2024-09-13T18:31:03.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.782+0000 7f2cf27fc640 1 -- 172.21.15.53:0/3710918555 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16467 (secure 0 0 0) 0x7f2cf8055080 con 0x7f2cfc06fe00 2024-09-13T18:31:03.784 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:03.785 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":106,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:01.088415+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:03.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.782+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ce00667b0 msgr2=0x7f2ce0068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.782+0000 7f2d03db9640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ce00667b0 0x7f2ce0068c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2cec001210 tx=0x7f2cec001160 comp rx=0 tx=0).stop 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.782+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cfc06fe00 msgr2=0x7f2cfc155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.782+0000 7f2d03db9640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cfc06fe00 0x7f2cfc155900 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80115e0 tx=0x7f2cf8011aa0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 shutdown_connections 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ce00667b0 0x7f2ce0068c70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cfc0701e0 0x7f2cfc1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cfc158c30 0x7f2cfc1f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 --2- 172.21.15.53:0/3710918555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cfc06fe00 0x7f2cfc155900 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 >> 172.21.15.53:0/3710918555 conn(0x7f2cfc065c80 msgr2=0x7f2cfc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 shutdown_connections 2024-09-13T18:31:03.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.786+0000 7f2d03db9640 1 -- 172.21.15.53:0/3710918555 wait complete. 2024-09-13T18:31:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:31:03.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:31:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.926+0000 7f1605239640 1 Processor -- start 2024-09-13T18:31:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.926+0000 7f1605239640 1 -- start start 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f1605239640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16000cf7d0 0x7f16000b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f1605239640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16000d2400 con 0x7f160015cab0 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f1605239640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16000d1530 con 0x7f16000d19c0 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f1605239640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16000cddd0 con 0x7f16000cf7d0 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f160015cab0 0x7f16000cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41062/0 (socket says 172.21.15.53:41062) 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fed9d640 1 -- 172.21.15.53:0/3447565319 learned_addr learned my addr 172.21.15.53:0/3447565319 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15ff59e640 1 --2- 172.21.15.53:0/3447565319 >> v2:172.21.15.87:3300/0 conn(0x7f16000cf7d0 0x7f16000b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288706534 0 0) 0x7f16000d2400 con 0x7f160015cab0 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e8003530 con 0x7f160015cab0 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1096208547 0 0) 0x7f15e8003530 con 0x7f160015cab0 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 >> v2:172.21.15.87:3300/0 conn(0x7f16000cf7d0 msgr2=0x7f16000b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 --2- 172.21.15.53:0/3447565319 >> v2:172.21.15.87:3300/0 conn(0x7f16000cf7d0 0x7f16000b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 >> v1:172.21.15.87:6789/0 conn(0x7f16000d19c0 legacy=0x7f16000cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000d1e30 con 0x7f160015cab0 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f15f0001680 con 0x7f160015cab0 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 >> v1:172.21.15.53:6789/0 conn(0x7f160015cab0 legacy=0x7f16000cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e8003980 0x7f15e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e80047d0 0x7f15e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e8005190 0x7f15e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16000cddd0 con 0x7f15e80047d0 2024-09-13T18:31:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e800c030 con 0x7f15e8005190 2024-09-13T18:31:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e800c1f0 con 0x7f15e8003980 2024-09-13T18:31:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fe59c640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e80047d0 0x7f15e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fed9d640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e8003980 0x7f15e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15ff59e640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e8005190 0x7f15e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fe59c640 1 -- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e8003980 msgr2=0x7f15e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fe59c640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e8003980 0x7f15e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fe59c640 1 -- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e8005190 msgr2=0x7f15e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fe59c640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15e8005190 0x7f15e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15ff59e640 1 -- 172.21.15.53:0/3447565319 reap_dead start 2024-09-13T18:31:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.930+0000 7f15fe59c640 1 -- 172.21.15.53:0/3447565319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8003530 con 0x7f15e80047d0 2024-09-13T18:31:03.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e80047d0 0x7f15e8004c50 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f15f4001780 tx=0x7f15f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d35d66d7e4b6a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40052d0 con 0x7f15e80047d0 2024-09-13T18:31:03.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f40a7050 con 0x7f15e80047d0 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fdd9b640 1 -- 172.21.15.53:0/3447565319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4003600 con 0x7f15e80047d0 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- 172.21.15.53:0/3447565319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e80047d0 msgr2=0x7f15e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e80047d0 0x7f15e8004c50 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f15f4001780 tx=0x7f15f401c400 comp rx=0 tx=0).stop 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- 172.21.15.53:0/3447565319 shutdown_connections 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 --2- 172.21.15.53:0/3447565319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e80047d0 0x7f15e8004c50 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- 172.21.15.53:0/3447565319 >> 172.21.15.53:0/3447565319 conn(0x7f1600065c80 msgr2=0x7f1600066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- 172.21.15.53:0/3447565319 shutdown_connections 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- 172.21.15.53:0/3447565319 wait complete. 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 Processor -- start 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- start start 2024-09-13T18:31:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e80047d0 0x7f160014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160014bd40 0x7f16000abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16000ac0b0 0x7f160014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160014ed70 con 0x7f160014bd40 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16000ac540 con 0x7f16000ac0b0 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f1605239640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160014ea90 con 0x7f15e80047d0 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160014bd40 0x7f16000abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160014bd40 0x7f16000abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44012/0 (socket says 172.21.15.53:44012) 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 -- 172.21.15.53:0/2877110476 learned_addr learned my addr 172.21.15.53:0/2877110476 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fed9d640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e80047d0 0x7f160014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15ff59e640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16000ac0b0 0x7f160014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 -- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e80047d0 msgr2=0x7f160014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e80047d0 0x7f160014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 -- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16000ac0b0 msgr2=0x7f160014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16000ac0b0 0x7f160014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 -- 172.21.15.53:0/2877110476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000cadb0 con 0x7f160014bd40 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.934+0000 7f15fe59c640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160014bd40 0x7f16000abb70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f15f401c230 tx=0x7f15e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15e77fe640 1 -- 172.21.15.53:0/2877110476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4003e40 con 0x7f160014bd40 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15e77fe640 1 -- 172.21.15.53:0/2877110476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4007030 con 0x7f160014bd40 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16000cb090 con 0x7f160014bd40 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15e77fe640 1 -- 172.21.15.53:0/2877110476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40073e0 con 0x7f160014bd40 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160014b990 con 0x7f160014bd40 2024-09-13T18:31:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16000cac10 con 0x7f160014bd40 2024-09-13T18:31:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15e77fe640 1 -- 172.21.15.53:0/2877110476 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f15f4007540 con 0x7f160014bd40 2024-09-13T18:31:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15e77fe640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15ec0667b0 0x7f15ec068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15fed9d640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15ec0667b0 0x7f15ec068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:03.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15e77fe640 1 -- 172.21.15.53:0/2877110476 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15f411e780 con 0x7f160014bd40 2024-09-13T18:31:03.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.938+0000 7f15fed9d640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15ec0667b0 0x7f15ec068c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15f0000c10 tx=0x7f15f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:03.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:03.942+0000 7f15e77fe640 1 -- 172.21.15.53:0/2877110476 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16000cac10 con 0x7f160014bd40 2024-09-13T18:31:04.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.098+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16000d0ee0 con 0x7f15ec0667b0 2024-09-13T18:31:04.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.122+0000 7f15e77fe640 1 -- 172.21.15.53:0/2877110476 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288495 (secure 0 0 0) 0x7f15f00139b0 con 0x7f15ec0667b0 2024-09-13T18:31:04.127 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:04.129 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15ec0667b0 msgr2=0x7f15ec068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15ec0667b0 0x7f15ec068c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15f0000c10 tx=0x7f15f0009040 comp rx=0 tx=0).stop 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160014bd40 msgr2=0x7f16000abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160014bd40 0x7f16000abb70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f15f401c230 tx=0x7f15e8005800 comp rx=0 tx=0).stop 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 shutdown_connections 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f15ec0667b0 0x7f15ec068c70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16000ac0b0 0x7f160014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f160014bd40 0x7f16000abb70 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 --2- 172.21.15.53:0/2877110476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f15e80047d0 0x7f160014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 >> 172.21.15.53:0/2877110476 conn(0x7f1600065c80 msgr2=0x7f16000cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 shutdown_connections 2024-09-13T18:31:04.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.126+0000 7f1605239640 1 -- 172.21.15.53:0/2877110476 wait complete. 2024-09-13T18:31:04.146 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-13T18:31:03.838222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276904,"kb_used_data":11528,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754697816,"statfs":{"total":773094113280,"available":772810563584,"internally_reserved":0,"allocated":11804672,"data_stored":5824044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.158598"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139082+0000","last_change":"2024-09-13T18:31:00.122945+0000","last_active":"2024-09-13T18:31:01.139082+0000","last_peered":"2024-09-13T18:31:01.139082+0000","last_clean":"2024-09-13T18:31:01.139082+0000","last_became_active":"2024-09-13T18:31:00.120239+0000","last_became_peered":"2024-09-13T18:31:00.120239+0000","last_unstale":"2024-09-13T18:31:01.139082+0000","last_undegraded":"2024-09-13T18:31:01.139082+0000","last_fullsized":"2024-09-13T18:31:01.139082+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:54.424886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102961+0000","last_change":"2024-09-13T18:31:00.114311+0000","last_active":"2024-09-13T18:31:01.102961+0000","last_peered":"2024-09-13T18:31:01.102961+0000","last_clean":"2024-09-13T18:31:01.102961+0000","last_became_active":"2024-09-13T18:31:00.113333+0000","last_became_peered":"2024-09-13T18:31:00.113333+0000","last_unstale":"2024-09-13T18:31:01.102961+0000","last_undegraded":"2024-09-13T18:31:01.102961+0000","last_fullsized":"2024-09-13T18:31:01.102961+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:48.417541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139643+0000","last_change":"2024-09-13T18:31:00.140700+0000","last_active":"2024-09-13T18:31:01.139643+0000","last_peered":"2024-09-13T18:31:01.139643+0000","last_clean":"2024-09-13T18:31:01.139643+0000","last_became_active":"2024-09-13T18:31:00.140088+0000","last_became_peered":"2024-09-13T18:31:00.140088+0000","last_unstale":"2024-09-13T18:31:01.139643+0000","last_undegraded":"2024-09-13T18:31:01.139643+0000","last_fullsized":"2024-09-13T18:31:01.139643+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:16.567223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137706+0000","last_change":"2024-09-13T18:31:00.106136+0000","last_active":"2024-09-13T18:31:01.137706+0000","last_peered":"2024-09-13T18:31:01.137706+0000","last_clean":"2024-09-13T18:31:01.137706+0000","last_became_active":"2024-09-13T18:31:00.105899+0000","last_became_peered":"2024-09-13T18:31:00.105899+0000","last_unstale":"2024-09-13T18:31:01.137706+0000","last_undegraded":"2024-09-13T18:31:01.137706+0000","last_fullsized":"2024-09-13T18:31:01.137706+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:27.992769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140703+0000","last_change":"2024-09-13T18:31:00.111612+0000","last_active":"2024-09-13T18:31:01.140703+0000","last_peered":"2024-09-13T18:31:01.140703+0000","last_clean":"2024-09-13T18:31:01.140703+0000","last_became_active":"2024-09-13T18:31:00.111271+0000","last_became_peered":"2024-09-13T18:31:00.111271+0000","last_unstale":"2024-09-13T18:31:01.140703+0000","last_undegraded":"2024-09-13T18:31:01.140703+0000","last_fullsized":"2024-09-13T18:31:01.140703+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:52.473245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137553+0000","last_change":"2024-09-13T18:31:00.110188+0000","last_active":"2024-09-13T18:31:01.137553+0000","last_peered":"2024-09-13T18:31:01.137553+0000","last_clean":"2024-09-13T18:31:01.137553+0000","last_became_active":"2024-09-13T18:31:00.109921+0000","last_became_peered":"2024-09-13T18:31:00.109921+0000","last_unstale":"2024-09-13T18:31:01.137553+0000","last_undegraded":"2024-09-13T18:31:01.137553+0000","last_fullsized":"2024-09-13T18:31:01.137553+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:46.819882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138174+0000","last_change":"2024-09-13T18:31:00.124913+0000","last_active":"2024-09-13T18:31:01.138174+0000","last_peered":"2024-09-13T18:31:01.138174+0000","last_clean":"2024-09-13T18:31:01.138174+0000","last_became_active":"2024-09-13T18:31:00.123575+0000","last_became_peered":"2024-09-13T18:31:00.123575+0000","last_unstale":"2024-09-13T18:31:01.138174+0000","last_undegraded":"2024-09-13T18:31:01.138174+0000","last_fullsized":"2024-09-13T18:31:01.138174+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:28.203472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138608+0000","last_change":"2024-09-13T18:31:00.130698+0000","last_active":"2024-09-13T18:31:01.138608+0000","last_peered":"2024-09-13T18:31:01.138608+0000","last_clean":"2024-09-13T18:31:01.138608+0000","last_became_active":"2024-09-13T18:31:00.130138+0000","last_became_peered":"2024-09-13T18:31:00.130138+0000","last_unstale":"2024-09-13T18:31:01.138608+0000","last_undegraded":"2024-09-13T18:31:01.138608+0000","last_fullsized":"2024-09-13T18:31:01.138608+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:59.736807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139259+0000","last_change":"2024-09-13T18:31:00.122620+0000","last_active":"2024-09-13T18:31:01.139259+0000","last_peered":"2024-09-13T18:31:01.139259+0000","last_clean":"2024-09-13T18:31:01.139259+0000","last_became_active":"2024-09-13T18:31:00.122346+0000","last_became_peered":"2024-09-13T18:31:00.122346+0000","last_unstale":"2024-09-13T18:31:01.139259+0000","last_undegraded":"2024-09-13T18:31:01.139259+0000","last_fullsized":"2024-09-13T18:31:01.139259+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:33.470009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138385+0000","last_change":"2024-09-13T18:31:00.103320+0000","last_active":"2024-09-13T18:31:01.138385+0000","last_peered":"2024-09-13T18:31:01.138385+0000","last_clean":"2024-09-13T18:31:01.138385+0000","last_became_active":"2024-09-13T18:31:00.103084+0000","last_became_peered":"2024-09-13T18:31:00.103084+0000","last_unstale":"2024-09-13T18:31:01.138385+0000","last_undegraded":"2024-09-13T18:31:01.138385+0000","last_fullsized":"2024-09-13T18:31:01.138385+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:44.277646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102650+0000","last_change":"2024-09-13T18:31:00.137287+0000","last_active":"2024-09-13T18:31:01.102650+0000","last_peered":"2024-09-13T18:31:01.102650+0000","last_clean":"2024-09-13T18:31:01.102650+0000","last_became_active":"2024-09-13T18:31:00.137029+0000","last_became_peered":"2024-09-13T18:31:00.137029+0000","last_unstale":"2024-09-13T18:31:01.102650+0000","last_undegraded":"2024-09-13T18:31:01.102650+0000","last_fullsized":"2024-09-13T18:31:01.102650+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:50.652223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137893+0000","last_change":"2024-09-13T18:31:00.106671+0000","last_active":"2024-09-13T18:31:01.137893+0000","last_peered":"2024-09-13T18:31:01.137893+0000","last_clean":"2024-09-13T18:31:01.137893+0000","last_became_active":"2024-09-13T18:31:00.106409+0000","last_became_peered":"2024-09-13T18:31:00.106409+0000","last_unstale":"2024-09-13T18:31:01.137893+0000","last_undegraded":"2024-09-13T18:31:01.137893+0000","last_fullsized":"2024-09-13T18:31:01.137893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:19.555820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139452+0000","last_change":"2024-09-13T18:31:00.142937+0000","last_active":"2024-09-13T18:31:01.139452+0000","last_peered":"2024-09-13T18:31:01.139452+0000","last_clean":"2024-09-13T18:31:01.139452+0000","last_became_active":"2024-09-13T18:31:00.142384+0000","last_became_peered":"2024-09-13T18:31:00.142384+0000","last_unstale":"2024-09-13T18:31:01.139452+0000","last_undegraded":"2024-09-13T18:31:01.139452+0000","last_fullsized":"2024-09-13T18:31:01.139452+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:45.764306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139442+0000","last_change":"2024-09-13T18:31:00.145554+0000","last_active":"2024-09-13T18:31:01.139442+0000","last_peered":"2024-09-13T18:31:01.139442+0000","last_clean":"2024-09-13T18:31:01.139442+0000","last_became_active":"2024-09-13T18:31:00.145093+0000","last_became_peered":"2024-09-13T18:31:00.145093+0000","last_unstale":"2024-09-13T18:31:01.139442+0000","last_undegraded":"2024-09-13T18:31:01.139442+0000","last_fullsized":"2024-09-13T18:31:01.139442+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:00.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138749+0000","last_change":"2024-09-13T18:31:00.113219+0000","last_active":"2024-09-13T18:31:01.138749+0000","last_peered":"2024-09-13T18:31:01.138749+0000","last_clean":"2024-09-13T18:31:01.138749+0000","last_became_active":"2024-09-13T18:31:00.112829+0000","last_became_peered":"2024-09-13T18:31:00.112829+0000","last_unstale":"2024-09-13T18:31:01.138749+0000","last_undegraded":"2024-09-13T18:31:01.138749+0000","last_fullsized":"2024-09-13T18:31:01.138749+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:52.473245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136615+0000","last_change":"2024-09-13T18:31:00.129631+0000","last_active":"2024-09-13T18:31:01.136615+0000","last_peered":"2024-09-13T18:31:01.136615+0000","last_clean":"2024-09-13T18:31:01.136615+0000","last_became_active":"2024-09-13T18:31:00.129328+0000","last_became_peered":"2024-09-13T18:31:00.129328+0000","last_unstale":"2024-09-13T18:31:01.136615+0000","last_undegraded":"2024-09-13T18:31:01.136615+0000","last_fullsized":"2024-09-13T18:31:01.136615+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:22.417724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.103090+0000","last_change":"2024-09-13T18:31:00.121006+0000","last_active":"2024-09-13T18:31:01.103090+0000","last_peered":"2024-09-13T18:31:01.103090+0000","last_clean":"2024-09-13T18:31:01.103090+0000","last_became_active":"2024-09-13T18:31:00.119862+0000","last_became_peered":"2024-09-13T18:31:00.119862+0000","last_unstale":"2024-09-13T18:31:01.103090+0000","last_undegraded":"2024-09-13T18:31:01.103090+0000","last_fullsized":"2024-09-13T18:31:01.103090+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:30.004060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140822+0000","last_change":"2024-09-13T18:31:00.127582+0000","last_active":"2024-09-13T18:31:01.140822+0000","last_peered":"2024-09-13T18:31:01.140822+0000","last_clean":"2024-09-13T18:31:01.140822+0000","last_became_active":"2024-09-13T18:31:00.127335+0000","last_became_peered":"2024-09-13T18:31:00.127335+0000","last_unstale":"2024-09-13T18:31:01.140822+0000","last_undegraded":"2024-09-13T18:31:01.140822+0000","last_fullsized":"2024-09-13T18:31:01.140822+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:44.914165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139893+0000","last_change":"2024-09-13T18:31:00.142714+0000","last_active":"2024-09-13T18:31:01.139893+0000","last_peered":"2024-09-13T18:31:01.139893+0000","last_clean":"2024-09-13T18:31:01.139893+0000","last_became_active":"2024-09-13T18:31:00.141993+0000","last_became_peered":"2024-09-13T18:31:00.141993+0000","last_unstale":"2024-09-13T18:31:01.139893+0000","last_undegraded":"2024-09-13T18:31:01.139893+0000","last_fullsized":"2024-09-13T18:31:01.139893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:48.417541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102580+0000","last_change":"2024-09-13T18:31:00.131366+0000","last_active":"2024-09-13T18:31:01.102580+0000","last_peered":"2024-09-13T18:31:01.102580+0000","last_clean":"2024-09-13T18:31:01.102580+0000","last_became_active":"2024-09-13T18:31:00.129363+0000","last_became_peered":"2024-09-13T18:31:00.129363+0000","last_unstale":"2024-09-13T18:31:01.102580+0000","last_undegraded":"2024-09-13T18:31:01.102580+0000","last_fullsized":"2024-09-13T18:31:01.102580+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:47.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102902+0000","last_change":"2024-09-13T18:31:00.104344+0000","last_active":"2024-09-13T18:31:01.102902+0000","last_peered":"2024-09-13T18:31:01.102902+0000","last_clean":"2024-09-13T18:31:01.102902+0000","last_became_active":"2024-09-13T18:31:00.103642+0000","last_became_peered":"2024-09-13T18:31:00.103642+0000","last_unstale":"2024-09-13T18:31:01.102902+0000","last_undegraded":"2024-09-13T18:31:01.102902+0000","last_fullsized":"2024-09-13T18:31:01.102902+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:16.567223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099726+0000","last_change":"2024-09-13T18:31:00.125745+0000","last_active":"2024-09-13T18:31:01.099726+0000","last_peered":"2024-09-13T18:31:01.099726+0000","last_clean":"2024-09-13T18:31:01.099726+0000","last_became_active":"2024-09-13T18:31:00.125434+0000","last_became_peered":"2024-09-13T18:31:00.125434+0000","last_unstale":"2024-09-13T18:31:01.099726+0000","last_undegraded":"2024-09-13T18:31:01.099726+0000","last_fullsized":"2024-09-13T18:31:01.099726+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:50.652223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102119+0000","last_change":"2024-09-13T18:31:00.118272+0000","last_active":"2024-09-13T18:31:01.102119+0000","last_peered":"2024-09-13T18:31:01.102119+0000","last_clean":"2024-09-13T18:31:01.102119+0000","last_became_active":"2024-09-13T18:31:00.117596+0000","last_became_peered":"2024-09-13T18:31:00.117596+0000","last_unstale":"2024-09-13T18:31:01.102119+0000","last_undegraded":"2024-09-13T18:31:01.102119+0000","last_fullsized":"2024-09-13T18:31:01.102119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:28.750230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099692+0000","last_change":"2024-09-13T18:31:00.121780+0000","last_active":"2024-09-13T18:31:01.099692+0000","last_peered":"2024-09-13T18:31:01.099692+0000","last_clean":"2024-09-13T18:31:01.099692+0000","last_became_active":"2024-09-13T18:31:00.121533+0000","last_became_peered":"2024-09-13T18:31:00.121533+0000","last_unstale":"2024-09-13T18:31:01.099692+0000","last_undegraded":"2024-09-13T18:31:01.099692+0000","last_fullsized":"2024-09-13T18:31:01.099692+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:14.404438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.103210+0000","last_change":"2024-09-13T18:31:00.120522+0000","last_active":"2024-09-13T18:31:01.103210+0000","last_peered":"2024-09-13T18:31:01.103210+0000","last_clean":"2024-09-13T18:31:01.103210+0000","last_became_active":"2024-09-13T18:31:00.118978+0000","last_became_peered":"2024-09-13T18:31:00.118978+0000","last_unstale":"2024-09-13T18:31:01.103210+0000","last_undegraded":"2024-09-13T18:31:01.103210+0000","last_fullsized":"2024-09-13T18:31:01.103210+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:14.404438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138491+0000","last_change":"2024-09-13T18:31:00.133005+0000","last_active":"2024-09-13T18:31:01.138491+0000","last_peered":"2024-09-13T18:31:01.138491+0000","last_clean":"2024-09-13T18:31:01.138491+0000","last_became_active":"2024-09-13T18:31:00.132678+0000","last_became_peered":"2024-09-13T18:31:00.132678+0000","last_unstale":"2024-09-13T18:31:01.138491+0000","last_undegraded":"2024-09-13T18:31:01.138491+0000","last_fullsized":"2024-09-13T18:31:01.138491+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138172+0000","last_change":"2024-09-13T18:31:00.104271+0000","last_active":"2024-09-13T18:31:01.138172+0000","last_peered":"2024-09-13T18:31:01.138172+0000","last_clean":"2024-09-13T18:31:01.138172+0000","last_became_active":"2024-09-13T18:31:00.103457+0000","last_became_peered":"2024-09-13T18:31:00.103457+0000","last_unstale":"2024-09-13T18:31:01.138172+0000","last_undegraded":"2024-09-13T18:31:01.138172+0000","last_fullsized":"2024-09-13T18:31:01.138172+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:54.025453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099987+0000","last_change":"2024-09-13T18:31:00.126688+0000","last_active":"2024-09-13T18:31:01.099987+0000","last_peered":"2024-09-13T18:31:01.099987+0000","last_clean":"2024-09-13T18:31:01.099987+0000","last_became_active":"2024-09-13T18:31:00.126411+0000","last_became_peered":"2024-09-13T18:31:00.126411+0000","last_unstale":"2024-09-13T18:31:01.099987+0000","last_undegraded":"2024-09-13T18:31:01.099987+0000","last_fullsized":"2024-09-13T18:31:01.099987+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:15.667070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102383+0000","last_change":"2024-09-13T18:31:00.119533+0000","last_active":"2024-09-13T18:31:01.102383+0000","last_peered":"2024-09-13T18:31:01.102383+0000","last_clean":"2024-09-13T18:31:01.102383+0000","last_became_active":"2024-09-13T18:31:00.117117+0000","last_became_peered":"2024-09-13T18:31:00.117117+0000","last_unstale":"2024-09-13T18:31:01.102383+0000","last_undegraded":"2024-09-13T18:31:01.102383+0000","last_fullsized":"2024-09-13T18:31:01.102383+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:00.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138534+0000","last_change":"2024-09-13T18:31:00.108375+0000","last_active":"2024-09-13T18:31:01.138534+0000","last_peered":"2024-09-13T18:31:01.138534+0000","last_clean":"2024-09-13T18:31:01.138534+0000","last_became_active":"2024-09-13T18:31:00.107911+0000","last_became_peered":"2024-09-13T18:31:00.107911+0000","last_unstale":"2024-09-13T18:31:01.138534+0000","last_undegraded":"2024-09-13T18:31:01.138534+0000","last_fullsized":"2024-09-13T18:31:01.138534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:56.076108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137023+0000","last_change":"2024-09-13T18:31:00.123180+0000","last_active":"2024-09-13T18:31:01.137023+0000","last_peered":"2024-09-13T18:31:01.137023+0000","last_clean":"2024-09-13T18:31:01.137023+0000","last_became_active":"2024-09-13T18:31:00.122806+0000","last_became_peered":"2024-09-13T18:31:00.122806+0000","last_unstale":"2024-09-13T18:31:01.137023+0000","last_undegraded":"2024-09-13T18:31:01.137023+0000","last_fullsized":"2024-09-13T18:31:01.137023+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:05.685840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137552+0000","last_change":"2024-09-13T18:31:00.112467+0000","last_active":"2024-09-13T18:31:01.137552+0000","last_peered":"2024-09-13T18:31:01.137552+0000","last_clean":"2024-09-13T18:31:01.137552+0000","last_became_active":"2024-09-13T18:31:00.110214+0000","last_became_peered":"2024-09-13T18:31:00.110214+0000","last_unstale":"2024-09-13T18:31:01.137552+0000","last_undegraded":"2024-09-13T18:31:01.137552+0000","last_fullsized":"2024-09-13T18:31:01.137552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:58.488601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138099+0000","last_change":"2024-09-13T18:31:00.112540+0000","last_active":"2024-09-13T18:31:01.138099+0000","last_peered":"2024-09-13T18:31:01.138099+0000","last_clean":"2024-09-13T18:31:01.138099+0000","last_became_active":"2024-09-13T18:31:00.109827+0000","last_became_peered":"2024-09-13T18:31:00.109827+0000","last_unstale":"2024-09-13T18:31:01.138099+0000","last_undegraded":"2024-09-13T18:31:01.138099+0000","last_fullsized":"2024-09-13T18:31:01.138099+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:42.967782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"105'4","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139528+0000","last_change":"2024-09-13T18:30:59.718096+0000","last_active":"2024-09-13T18:31:01.139528+0000","last_peered":"2024-09-13T18:31:01.139528+0000","last_clean":"2024-09-13T18:31:01.139528+0000","last_became_active":"2024-09-13T18:30:59.717097+0000","last_became_peered":"2024-09-13T18:30:59.717097+0000","last_unstale":"2024-09-13T18:31:01.139528+0000","last_undegraded":"2024-09-13T18:31:01.139528+0000","last_fullsized":"2024-09-13T18:31:01.139528+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:28.487233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141053+0000","last_change":"2024-09-13T18:31:00.136558+0000","last_active":"2024-09-13T18:31:01.141053+0000","last_peered":"2024-09-13T18:31:01.141053+0000","last_clean":"2024-09-13T18:31:01.141053+0000","last_became_active":"2024-09-13T18:31:00.136028+0000","last_became_peered":"2024-09-13T18:31:00.136028+0000","last_unstale":"2024-09-13T18:31:01.141053+0000","last_undegraded":"2024-09-13T18:31:01.141053+0000","last_fullsized":"2024-09-13T18:31:01.141053+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:47.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138817+0000","last_change":"2024-09-13T18:30:59.726968+0000","last_active":"2024-09-13T18:31:01.138817+0000","last_peered":"2024-09-13T18:31:01.138817+0000","last_clean":"2024-09-13T18:31:01.138817+0000","last_became_active":"2024-09-13T18:30:59.726288+0000","last_became_peered":"2024-09-13T18:30:59.726288+0000","last_unstale":"2024-09-13T18:31:01.138817+0000","last_undegraded":"2024-09-13T18:31:01.138817+0000","last_fullsized":"2024-09-13T18:31:01.138817+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:28.830684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137936+0000","last_change":"2024-09-13T18:31:00.119554+0000","last_active":"2024-09-13T18:31:01.137936+0000","last_peered":"2024-09-13T18:31:01.137936+0000","last_clean":"2024-09-13T18:31:01.137936+0000","last_became_active":"2024-09-13T18:31:00.119346+0000","last_became_peered":"2024-09-13T18:31:00.119346+0000","last_unstale":"2024-09-13T18:31:01.137936+0000","last_undegraded":"2024-09-13T18:31:01.137936+0000","last_fullsized":"2024-09-13T18:31:01.137936+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:56.363626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140675+0000","last_change":"2024-09-13T18:30:59.722962+0000","last_active":"2024-09-13T18:31:01.140675+0000","last_peered":"2024-09-13T18:31:01.140675+0000","last_clean":"2024-09-13T18:31:01.140675+0000","last_became_active":"2024-09-13T18:30:59.722375+0000","last_became_peered":"2024-09-13T18:30:59.722375+0000","last_unstale":"2024-09-13T18:31:01.140675+0000","last_undegraded":"2024-09-13T18:31:01.140675+0000","last_fullsized":"2024-09-13T18:31:01.140675+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139884+0000","last_change":"2024-09-13T18:31:00.142123+0000","last_active":"2024-09-13T18:31:01.139884+0000","last_peered":"2024-09-13T18:31:01.139884+0000","last_clean":"2024-09-13T18:31:01.139884+0000","last_became_active":"2024-09-13T18:31:00.141501+0000","last_became_peered":"2024-09-13T18:31:00.141501+0000","last_unstale":"2024-09-13T18:31:01.139884+0000","last_undegraded":"2024-09-13T18:31:01.139884+0000","last_fullsized":"2024-09-13T18:31:01.139884+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.598316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140841+0000","last_change":"2024-09-13T18:30:59.723309+0000","last_active":"2024-09-13T18:31:01.140841+0000","last_peered":"2024-09-13T18:31:01.140841+0000","last_clean":"2024-09-13T18:31:01.140841+0000","last_became_active":"2024-09-13T18:30:59.722812+0000","last_became_peered":"2024-09-13T18:30:59.722812+0000","last_unstale":"2024-09-13T18:31:01.140841+0000","last_undegraded":"2024-09-13T18:31:01.140841+0000","last_fullsized":"2024-09-13T18:31:01.140841+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:21.826476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137094+0000","last_change":"2024-09-13T18:31:00.110542+0000","last_active":"2024-09-13T18:31:01.137094+0000","last_peered":"2024-09-13T18:31:01.137094+0000","last_clean":"2024-09-13T18:31:01.137094+0000","last_became_active":"2024-09-13T18:31:00.110274+0000","last_became_peered":"2024-09-13T18:31:00.110274+0000","last_unstale":"2024-09-13T18:31:01.137094+0000","last_undegraded":"2024-09-13T18:31:01.137094+0000","last_fullsized":"2024-09-13T18:31:01.137094+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:35.211875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138624+0000","last_change":"2024-09-13T18:30:59.719669+0000","last_active":"2024-09-13T18:31:01.138624+0000","last_peered":"2024-09-13T18:31:01.138624+0000","last_clean":"2024-09-13T18:31:01.138624+0000","last_became_active":"2024-09-13T18:30:59.718986+0000","last_became_peered":"2024-09-13T18:30:59.718986+0000","last_unstale":"2024-09-13T18:31:01.138624+0000","last_undegraded":"2024-09-13T18:31:01.138624+0000","last_fullsized":"2024-09-13T18:31:01.138624+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:44.322585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102615+0000","last_change":"2024-09-13T18:31:00.114499+0000","last_active":"2024-09-13T18:31:01.102615+0000","last_peered":"2024-09-13T18:31:01.102615+0000","last_clean":"2024-09-13T18:31:01.102615+0000","last_became_active":"2024-09-13T18:31:00.114141+0000","last_became_peered":"2024-09-13T18:31:00.114141+0000","last_unstale":"2024-09-13T18:31:01.102615+0000","last_undegraded":"2024-09-13T18:31:01.102615+0000","last_fullsized":"2024-09-13T18:31:01.102615+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:16.640557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099962+0000","last_change":"2024-09-13T18:30:59.726139+0000","last_active":"2024-09-13T18:31:01.099962+0000","last_peered":"2024-09-13T18:31:01.099962+0000","last_clean":"2024-09-13T18:31:01.099962+0000","last_became_active":"2024-09-13T18:30:59.725715+0000","last_became_peered":"2024-09-13T18:30:59.725715+0000","last_unstale":"2024-09-13T18:31:01.099962+0000","last_undegraded":"2024-09-13T18:31:01.099962+0000","last_fullsized":"2024-09-13T18:31:01.099962+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:47.860700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136638+0000","last_change":"2024-09-13T18:31:00.114727+0000","last_active":"2024-09-13T18:31:01.136638+0000","last_peered":"2024-09-13T18:31:01.136638+0000","last_clean":"2024-09-13T18:31:01.136638+0000","last_became_active":"2024-09-13T18:31:00.113567+0000","last_became_peered":"2024-09-13T18:31:00.113567+0000","last_unstale":"2024-09-13T18:31:01.136638+0000","last_undegraded":"2024-09-13T18:31:01.136638+0000","last_fullsized":"2024-09-13T18:31:01.136638+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:02.440710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102786+0000","last_change":"2024-09-13T18:30:59.705185+0000","last_active":"2024-09-13T18:31:01.102786+0000","last_peered":"2024-09-13T18:31:01.102786+0000","last_clean":"2024-09-13T18:31:01.102786+0000","last_became_active":"2024-09-13T18:30:59.704388+0000","last_became_peered":"2024-09-13T18:30:59.704388+0000","last_unstale":"2024-09-13T18:31:01.102786+0000","last_undegraded":"2024-09-13T18:31:01.102786+0000","last_fullsized":"2024-09-13T18:31:01.102786+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:47.257248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137976+0000","last_change":"2024-09-13T18:31:00.125683+0000","last_active":"2024-09-13T18:31:01.137976+0000","last_peered":"2024-09-13T18:31:01.137976+0000","last_clean":"2024-09-13T18:31:01.137976+0000","last_became_active":"2024-09-13T18:31:00.124917+0000","last_became_peered":"2024-09-13T18:31:00.124917+0000","last_unstale":"2024-09-13T18:31:01.137976+0000","last_undegraded":"2024-09-13T18:31:01.137976+0000","last_fullsized":"2024-09-13T18:31:01.137976+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:43.762603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136781+0000","last_change":"2024-09-13T18:30:59.720119+0000","last_active":"2024-09-13T18:31:01.136781+0000","last_peered":"2024-09-13T18:31:01.136781+0000","last_clean":"2024-09-13T18:31:01.136781+0000","last_became_active":"2024-09-13T18:30:59.712303+0000","last_became_peered":"2024-09-13T18:30:59.712303+0000","last_unstale":"2024-09-13T18:31:01.136781+0000","last_undegraded":"2024-09-13T18:31:01.136781+0000","last_fullsized":"2024-09-13T18:31:01.136781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:15.630418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139824+0000","last_change":"2024-09-13T18:31:00.122470+0000","last_active":"2024-09-13T18:31:01.139824+0000","last_peered":"2024-09-13T18:31:01.139824+0000","last_clean":"2024-09-13T18:31:01.139824+0000","last_became_active":"2024-09-13T18:31:00.121757+0000","last_became_peered":"2024-09-13T18:31:00.121757+0000","last_unstale":"2024-09-13T18:31:01.139824+0000","last_undegraded":"2024-09-13T18:31:01.139824+0000","last_fullsized":"2024-09-13T18:31:01.139824+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:47.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140840+0000","last_change":"2024-09-13T18:30:59.717009+0000","last_active":"2024-09-13T18:31:01.140840+0000","last_peered":"2024-09-13T18:31:01.140840+0000","last_clean":"2024-09-13T18:31:01.140840+0000","last_became_active":"2024-09-13T18:30:59.716473+0000","last_became_peered":"2024-09-13T18:30:59.716473+0000","last_unstale":"2024-09-13T18:31:01.140840+0000","last_undegraded":"2024-09-13T18:31:01.140840+0000","last_fullsized":"2024-09-13T18:31:01.140840+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:29.313840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141146+0000","last_change":"2024-09-13T18:31:00.118279+0000","last_active":"2024-09-13T18:31:01.141146+0000","last_peered":"2024-09-13T18:31:01.141146+0000","last_clean":"2024-09-13T18:31:01.141146+0000","last_became_active":"2024-09-13T18:31:00.117600+0000","last_became_peered":"2024-09-13T18:31:00.117600+0000","last_unstale":"2024-09-13T18:31:01.141146+0000","last_undegraded":"2024-09-13T18:31:01.141146+0000","last_fullsized":"2024-09-13T18:31:01.141146+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:43.762603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099701+0000","last_change":"2024-09-13T18:30:59.727272+0000","last_active":"2024-09-13T18:31:01.099701+0000","last_peered":"2024-09-13T18:31:01.099701+0000","last_clean":"2024-09-13T18:31:01.099701+0000","last_became_active":"2024-09-13T18:30:59.726989+0000","last_became_peered":"2024-09-13T18:30:59.726989+0000","last_unstale":"2024-09-13T18:31:01.099701+0000","last_undegraded":"2024-09-13T18:31:01.099701+0000","last_fullsized":"2024-09-13T18:31:01.099701+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:55.065970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.100009+0000","last_change":"2024-09-13T18:31:00.118258+0000","last_active":"2024-09-13T18:31:01.100009+0000","last_peered":"2024-09-13T18:31:01.100009+0000","last_clean":"2024-09-13T18:31:01.100009+0000","last_became_active":"2024-09-13T18:31:00.114762+0000","last_became_peered":"2024-09-13T18:31:00.114762+0000","last_unstale":"2024-09-13T18:31:01.100009+0000","last_undegraded":"2024-09-13T18:31:01.100009+0000","last_fullsized":"2024-09-13T18:31:01.100009+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:59.736807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"105'3","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137764+0000","last_change":"2024-09-13T18:30:59.712265+0000","last_active":"2024-09-13T18:31:01.137764+0000","last_peered":"2024-09-13T18:31:01.137764+0000","last_clean":"2024-09-13T18:31:01.137764+0000","last_became_active":"2024-09-13T18:30:59.711849+0000","last_became_peered":"2024-09-13T18:30:59.711849+0000","last_unstale":"2024-09-13T18:31:01.137764+0000","last_undegraded":"2024-09-13T18:31:01.137764+0000","last_fullsized":"2024-09-13T18:31:01.137764+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:44.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139315+0000","last_change":"2024-09-13T18:31:00.145325+0000","last_active":"2024-09-13T18:31:01.139315+0000","last_peered":"2024-09-13T18:31:01.139315+0000","last_clean":"2024-09-13T18:31:01.139315+0000","last_became_active":"2024-09-13T18:31:00.144793+0000","last_became_peered":"2024-09-13T18:31:00.144793+0000","last_unstale":"2024-09-13T18:31:01.139315+0000","last_undegraded":"2024-09-13T18:31:01.139315+0000","last_fullsized":"2024-09-13T18:31:01.139315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:44.914165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"105'6","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138263+0000","last_change":"2024-09-13T18:30:59.716640+0000","last_active":"2024-09-13T18:31:01.138263+0000","last_peered":"2024-09-13T18:31:01.138263+0000","last_clean":"2024-09-13T18:31:01.138263+0000","last_became_active":"2024-09-13T18:30:59.716304+0000","last_became_peered":"2024-09-13T18:30:59.716304+0000","last_unstale":"2024-09-13T18:31:01.138263+0000","last_undegraded":"2024-09-13T18:31:01.138263+0000","last_fullsized":"2024-09-13T18:31:01.138263+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:15.557084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099875+0000","last_change":"2024-09-13T18:31:00.111542+0000","last_active":"2024-09-13T18:31:01.099875+0000","last_peered":"2024-09-13T18:31:01.099875+0000","last_clean":"2024-09-13T18:31:01.099875+0000","last_became_active":"2024-09-13T18:31:00.111283+0000","last_became_peered":"2024-09-13T18:31:00.111283+0000","last_unstale":"2024-09-13T18:31:01.099875+0000","last_undegraded":"2024-09-13T18:31:01.099875+0000","last_fullsized":"2024-09-13T18:31:01.099875+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:28.750230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137741+0000","last_change":"2024-09-13T18:30:59.718477+0000","last_active":"2024-09-13T18:31:01.137741+0000","last_peered":"2024-09-13T18:31:01.137741+0000","last_clean":"2024-09-13T18:31:01.137741+0000","last_became_active":"2024-09-13T18:30:59.718088+0000","last_became_peered":"2024-09-13T18:30:59.718088+0000","last_unstale":"2024-09-13T18:31:01.137741+0000","last_undegraded":"2024-09-13T18:31:01.137741+0000","last_fullsized":"2024-09-13T18:31:01.137741+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:44.942585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.100210+0000","last_change":"2024-09-13T18:31:00.140856+0000","last_active":"2024-09-13T18:31:01.100210+0000","last_peered":"2024-09-13T18:31:01.100210+0000","last_clean":"2024-09-13T18:31:01.100210+0000","last_became_active":"2024-09-13T18:31:00.140638+0000","last_became_peered":"2024-09-13T18:31:00.140638+0000","last_unstale":"2024-09-13T18:31:01.100210+0000","last_undegraded":"2024-09-13T18:31:01.100210+0000","last_fullsized":"2024-09-13T18:31:01.100210+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:47.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140400+0000","last_change":"2024-09-13T18:30:59.728800+0000","last_active":"2024-09-13T18:31:01.140400+0000","last_peered":"2024-09-13T18:31:01.140400+0000","last_clean":"2024-09-13T18:31:01.140400+0000","last_became_active":"2024-09-13T18:30:59.728162+0000","last_became_peered":"2024-09-13T18:30:59.728162+0000","last_unstale":"2024-09-13T18:31:01.140400+0000","last_undegraded":"2024-09-13T18:31:01.140400+0000","last_fullsized":"2024-09-13T18:31:01.140400+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:59.930969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099682+0000","last_change":"2024-09-13T18:31:00.111159+0000","last_active":"2024-09-13T18:31:01.099682+0000","last_peered":"2024-09-13T18:31:01.099682+0000","last_clean":"2024-09-13T18:31:01.099682+0000","last_became_active":"2024-09-13T18:31:00.110914+0000","last_became_peered":"2024-09-13T18:31:00.110914+0000","last_unstale":"2024-09-13T18:31:01.099682+0000","last_undegraded":"2024-09-13T18:31:01.099682+0000","last_fullsized":"2024-09-13T18:31:01.099682+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:16.640557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"105'8","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140492+0000","last_change":"2024-09-13T18:30:59.713502+0000","last_active":"2024-09-13T18:31:01.140492+0000","last_peered":"2024-09-13T18:31:01.140492+0000","last_clean":"2024-09-13T18:31:01.140492+0000","last_became_active":"2024-09-13T18:30:59.713166+0000","last_became_peered":"2024-09-13T18:30:59.713166+0000","last_unstale":"2024-09-13T18:31:01.140492+0000","last_undegraded":"2024-09-13T18:31:01.140492+0000","last_fullsized":"2024-09-13T18:31:01.140492+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:44.434564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141022+0000","last_change":"2024-09-13T18:31:00.104829+0000","last_active":"2024-09-13T18:31:01.141022+0000","last_peered":"2024-09-13T18:31:01.141022+0000","last_clean":"2024-09-13T18:31:01.141022+0000","last_became_active":"2024-09-13T18:31:00.104561+0000","last_became_peered":"2024-09-13T18:31:00.104561+0000","last_unstale":"2024-09-13T18:31:01.141022+0000","last_undegraded":"2024-09-13T18:31:01.141022+0000","last_fullsized":"2024-09-13T18:31:01.141022+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:46.819882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139603+0000","last_change":"2024-09-13T18:30:59.724932+0000","last_active":"2024-09-13T18:31:01.139603+0000","last_peered":"2024-09-13T18:31:01.139603+0000","last_clean":"2024-09-13T18:31:01.139603+0000","last_became_active":"2024-09-13T18:30:59.724630+0000","last_became_peered":"2024-09-13T18:30:59.724630+0000","last_unstale":"2024-09-13T18:31:01.139603+0000","last_undegraded":"2024-09-13T18:31:01.139603+0000","last_fullsized":"2024-09-13T18:31:01.139603+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:27.102660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139949+0000","last_change":"2024-09-13T18:31:00.110058+0000","last_active":"2024-09-13T18:31:01.139949+0000","last_peered":"2024-09-13T18:31:01.139949+0000","last_clean":"2024-09-13T18:31:01.139949+0000","last_became_active":"2024-09-13T18:31:00.109771+0000","last_became_peered":"2024-09-13T18:31:00.109771+0000","last_unstale":"2024-09-13T18:31:01.139949+0000","last_undegraded":"2024-09-13T18:31:01.139949+0000","last_fullsized":"2024-09-13T18:31:01.139949+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:49.367533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141111+0000","last_change":"2024-09-13T18:30:59.709979+0000","last_active":"2024-09-13T18:31:01.141111+0000","last_peered":"2024-09-13T18:31:01.141111+0000","last_clean":"2024-09-13T18:31:01.141111+0000","last_became_active":"2024-09-13T18:30:59.709537+0000","last_became_peered":"2024-09-13T18:30:59.709537+0000","last_unstale":"2024-09-13T18:31:01.141111+0000","last_undegraded":"2024-09-13T18:31:01.141111+0000","last_fullsized":"2024-09-13T18:31:01.141111+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:30.556706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139044+0000","last_change":"2024-09-13T18:31:00.141421+0000","last_active":"2024-09-13T18:31:01.139044+0000","last_peered":"2024-09-13T18:31:01.139044+0000","last_clean":"2024-09-13T18:31:01.139044+0000","last_became_active":"2024-09-13T18:31:00.141134+0000","last_became_peered":"2024-09-13T18:31:00.141134+0000","last_unstale":"2024-09-13T18:31:01.139044+0000","last_undegraded":"2024-09-13T18:31:01.139044+0000","last_fullsized":"2024-09-13T18:31:01.139044+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:45.808535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140676+0000","last_change":"2024-09-13T18:30:59.730855+0000","last_active":"2024-09-13T18:31:01.140676+0000","last_peered":"2024-09-13T18:31:01.140676+0000","last_clean":"2024-09-13T18:31:01.140676+0000","last_became_active":"2024-09-13T18:30:59.727171+0000","last_became_peered":"2024-09-13T18:30:59.727171+0000","last_unstale":"2024-09-13T18:31:01.140676+0000","last_undegraded":"2024-09-13T18:31:01.140676+0000","last_fullsized":"2024-09-13T18:31:01.140676+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:01.935400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140151+0000","last_change":"2024-09-13T18:31:00.144541+0000","last_active":"2024-09-13T18:31:01.140151+0000","last_peered":"2024-09-13T18:31:01.140151+0000","last_clean":"2024-09-13T18:31:01.140151+0000","last_became_active":"2024-09-13T18:31:00.143949+0000","last_became_peered":"2024-09-13T18:31:00.143949+0000","last_unstale":"2024-09-13T18:31:01.140151+0000","last_undegraded":"2024-09-13T18:31:01.140151+0000","last_fullsized":"2024-09-13T18:31:01.140151+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:01.561354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138529+0000","last_change":"2024-09-13T18:30:59.726038+0000","last_active":"2024-09-13T18:31:01.138529+0000","last_peered":"2024-09-13T18:31:01.138529+0000","last_clean":"2024-09-13T18:31:01.138529+0000","last_became_active":"2024-09-13T18:30:59.725334+0000","last_became_peered":"2024-09-13T18:30:59.725334+0000","last_unstale":"2024-09-13T18:31:01.138529+0000","last_undegraded":"2024-09-13T18:31:01.138529+0000","last_fullsized":"2024-09-13T18:31:01.138529+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:46.316749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138418+0000","last_change":"2024-09-13T18:31:00.140249+0000","last_active":"2024-09-13T18:31:01.138418+0000","last_peered":"2024-09-13T18:31:01.138418+0000","last_clean":"2024-09-13T18:31:01.138418+0000","last_became_active":"2024-09-13T18:31:00.139827+0000","last_became_peered":"2024-09-13T18:31:00.139827+0000","last_unstale":"2024-09-13T18:31:01.138418+0000","last_undegraded":"2024-09-13T18:31:01.138418+0000","last_fullsized":"2024-09-13T18:31:01.138418+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:16.640557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137808+0000","last_change":"2024-09-13T18:30:59.717265+0000","last_active":"2024-09-13T18:31:01.137808+0000","last_peered":"2024-09-13T18:31:01.137808+0000","last_clean":"2024-09-13T18:31:01.137808+0000","last_became_active":"2024-09-13T18:30:59.715468+0000","last_became_peered":"2024-09-13T18:30:59.715468+0000","last_unstale":"2024-09-13T18:31:01.137808+0000","last_undegraded":"2024-09-13T18:31:01.137808+0000","last_fullsized":"2024-09-13T18:31:01.137808+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:34.997483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137245+0000","last_change":"2024-09-13T18:31:00.116886+0000","last_active":"2024-09-13T18:31:01.137245+0000","last_peered":"2024-09-13T18:31:01.137245+0000","last_clean":"2024-09-13T18:31:01.137245+0000","last_became_active":"2024-09-13T18:31:00.116659+0000","last_became_peered":"2024-09-13T18:31:00.116659+0000","last_unstale":"2024-09-13T18:31:01.137245+0000","last_undegraded":"2024-09-13T18:31:01.137245+0000","last_fullsized":"2024-09-13T18:31:01.137245+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.529016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140358+0000","last_change":"2024-09-13T18:30:59.719226+0000","last_active":"2024-09-13T18:31:01.140358+0000","last_peered":"2024-09-13T18:31:01.140358+0000","last_clean":"2024-09-13T18:31:01.140358+0000","last_became_active":"2024-09-13T18:30:59.718956+0000","last_became_peered":"2024-09-13T18:30:59.718956+0000","last_unstale":"2024-09-13T18:31:01.140358+0000","last_undegraded":"2024-09-13T18:31:01.140358+0000","last_fullsized":"2024-09-13T18:31:01.140358+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:05.160864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138899+0000","last_change":"2024-09-13T18:31:00.138266+0000","last_active":"2024-09-13T18:31:01.138899+0000","last_peered":"2024-09-13T18:31:01.138899+0000","last_clean":"2024-09-13T18:31:01.138899+0000","last_became_active":"2024-09-13T18:31:00.137534+0000","last_became_peered":"2024-09-13T18:31:00.137534+0000","last_unstale":"2024-09-13T18:31:01.138899+0000","last_undegraded":"2024-09-13T18:31:01.138899+0000","last_fullsized":"2024-09-13T18:31:01.138899+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:25.310734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138939+0000","last_change":"2024-09-13T18:30:59.715811+0000","last_active":"2024-09-13T18:31:01.138939+0000","last_peered":"2024-09-13T18:31:01.138939+0000","last_clean":"2024-09-13T18:31:01.138939+0000","last_became_active":"2024-09-13T18:30:59.715513+0000","last_became_peered":"2024-09-13T18:30:59.715513+0000","last_unstale":"2024-09-13T18:31:01.138939+0000","last_undegraded":"2024-09-13T18:31:01.138939+0000","last_fullsized":"2024-09-13T18:31:01.138939+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:32.139598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099784+0000","last_change":"2024-09-13T18:31:00.118612+0000","last_active":"2024-09-13T18:31:01.099784+0000","last_peered":"2024-09-13T18:31:01.099784+0000","last_clean":"2024-09-13T18:31:01.099784+0000","last_became_active":"2024-09-13T18:31:00.118318+0000","last_became_peered":"2024-09-13T18:31:00.118318+0000","last_unstale":"2024-09-13T18:31:01.099784+0000","last_undegraded":"2024-09-13T18:31:01.099784+0000","last_fullsized":"2024-09-13T18:31:01.099784+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:30.004060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136955+0000","last_change":"2024-09-13T18:30:59.726632+0000","last_active":"2024-09-13T18:31:01.136955+0000","last_peered":"2024-09-13T18:31:01.136955+0000","last_clean":"2024-09-13T18:31:01.136955+0000","last_became_active":"2024-09-13T18:30:59.726083+0000","last_became_peered":"2024-09-13T18:30:59.726083+0000","last_unstale":"2024-09-13T18:31:01.136955+0000","last_undegraded":"2024-09-13T18:31:01.136955+0000","last_fullsized":"2024-09-13T18:31:01.136955+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:58.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140886+0000","last_change":"2024-09-13T18:31:00.127050+0000","last_active":"2024-09-13T18:31:01.140886+0000","last_peered":"2024-09-13T18:31:01.140886+0000","last_clean":"2024-09-13T18:31:01.140886+0000","last_became_active":"2024-09-13T18:31:00.126511+0000","last_became_peered":"2024-09-13T18:31:00.126511+0000","last_unstale":"2024-09-13T18:31:01.140886+0000","last_undegraded":"2024-09-13T18:31:01.140886+0000","last_fullsized":"2024-09-13T18:31:01.140886+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:56.076108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099910+0000","last_change":"2024-09-13T18:30:59.727290+0000","last_active":"2024-09-13T18:31:01.099910+0000","last_peered":"2024-09-13T18:31:01.099910+0000","last_clean":"2024-09-13T18:31:01.099910+0000","last_became_active":"2024-09-13T18:30:59.726318+0000","last_became_peered":"2024-09-13T18:30:59.726318+0000","last_unstale":"2024-09-13T18:31:01.099910+0000","last_undegraded":"2024-09-13T18:31:01.099910+0000","last_fullsized":"2024-09-13T18:31:01.099910+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:27.193334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139435+0000","last_change":"2024-09-13T18:31:00.105195+0000","last_active":"2024-09-13T18:31:01.139435+0000","last_peered":"2024-09-13T18:31:01.139435+0000","last_clean":"2024-09-13T18:31:01.139435+0000","last_became_active":"2024-09-13T18:31:00.104953+0000","last_became_peered":"2024-09-13T18:31:00.104953+0000","last_unstale":"2024-09-13T18:31:01.139435+0000","last_undegraded":"2024-09-13T18:31:01.139435+0000","last_fullsized":"2024-09-13T18:31:01.139435+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:37.094733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141004+0000","last_change":"2024-09-13T18:30:59.730227+0000","last_active":"2024-09-13T18:31:01.141004+0000","last_peered":"2024-09-13T18:31:01.141004+0000","last_clean":"2024-09-13T18:31:01.141004+0000","last_became_active":"2024-09-13T18:30:59.729571+0000","last_became_peered":"2024-09-13T18:30:59.729571+0000","last_unstale":"2024-09-13T18:31:01.141004+0000","last_undegraded":"2024-09-13T18:31:01.141004+0000","last_fullsized":"2024-09-13T18:31:01.141004+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:28.487233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138076+0000","last_change":"2024-09-13T18:31:00.116029+0000","last_active":"2024-09-13T18:31:01.138076+0000","last_peered":"2024-09-13T18:31:01.138076+0000","last_clean":"2024-09-13T18:31:01.138076+0000","last_became_active":"2024-09-13T18:31:00.115880+0000","last_became_peered":"2024-09-13T18:31:00.115880+0000","last_unstale":"2024-09-13T18:31:01.138076+0000","last_undegraded":"2024-09-13T18:31:01.138076+0000","last_fullsized":"2024-09-13T18:31:01.138076+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:19.545531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137998+0000","last_change":"2024-09-13T18:30:59.724734+0000","last_active":"2024-09-13T18:31:01.137998+0000","last_peered":"2024-09-13T18:31:01.137998+0000","last_clean":"2024-09-13T18:31:01.137998+0000","last_became_active":"2024-09-13T18:30:59.723977+0000","last_became_peered":"2024-09-13T18:30:59.723977+0000","last_unstale":"2024-09-13T18:31:01.137998+0000","last_undegraded":"2024-09-13T18:31:01.137998+0000","last_fullsized":"2024-09-13T18:31:01.137998+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:47.407403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140509+0000","last_change":"2024-09-13T18:31:00.135214+0000","last_active":"2024-09-13T18:31:01.140509+0000","last_peered":"2024-09-13T18:31:01.140509+0000","last_clean":"2024-09-13T18:31:01.140509+0000","last_became_active":"2024-09-13T18:31:00.134521+0000","last_became_peered":"2024-09-13T18:31:00.134521+0000","last_unstale":"2024-09-13T18:31:01.140509+0000","last_undegraded":"2024-09-13T18:31:01.140509+0000","last_fullsized":"2024-09-13T18:31:01.140509+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:28.203472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.100209+0000","last_change":"2024-09-13T18:30:59.719711+0000","last_active":"2024-09-13T18:31:01.100209+0000","last_peered":"2024-09-13T18:31:01.100209+0000","last_clean":"2024-09-13T18:31:01.100209+0000","last_became_active":"2024-09-13T18:30:59.719029+0000","last_became_peered":"2024-09-13T18:30:59.719029+0000","last_unstale":"2024-09-13T18:31:01.100209+0000","last_undegraded":"2024-09-13T18:31:01.100209+0000","last_fullsized":"2024-09-13T18:31:01.100209+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:42.752464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102167+0000","last_change":"2024-09-13T18:31:00.125453+0000","last_active":"2024-09-13T18:31:01.102167+0000","last_peered":"2024-09-13T18:31:01.102167+0000","last_clean":"2024-09-13T18:31:01.102167+0000","last_became_active":"2024-09-13T18:31:00.122510+0000","last_became_peered":"2024-09-13T18:31:00.122510+0000","last_unstale":"2024-09-13T18:31:01.102167+0000","last_undegraded":"2024-09-13T18:31:01.102167+0000","last_fullsized":"2024-09-13T18:31:01.102167+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:59.736807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138848+0000","last_change":"2024-09-13T18:30:59.712868+0000","last_active":"2024-09-13T18:31:01.138848+0000","last_peered":"2024-09-13T18:31:01.138848+0000","last_clean":"2024-09-13T18:31:01.138848+0000","last_became_active":"2024-09-13T18:30:59.712095+0000","last_became_peered":"2024-09-13T18:30:59.712095+0000","last_unstale":"2024-09-13T18:31:01.138848+0000","last_undegraded":"2024-09-13T18:31:01.138848+0000","last_fullsized":"2024-09-13T18:31:01.138848+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:10.851364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102617+0000","last_change":"2024-09-13T18:31:00.110335+0000","last_active":"2024-09-13T18:31:01.102617+0000","last_peered":"2024-09-13T18:31:01.102617+0000","last_clean":"2024-09-13T18:31:01.102617+0000","last_became_active":"2024-09-13T18:31:00.108076+0000","last_became_peered":"2024-09-13T18:31:00.108076+0000","last_unstale":"2024-09-13T18:31:01.102617+0000","last_undegraded":"2024-09-13T18:31:01.102617+0000","last_fullsized":"2024-09-13T18:31:01.102617+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.598316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102312+0000","last_change":"2024-09-13T18:30:59.716165+0000","last_active":"2024-09-13T18:31:01.102312+0000","last_peered":"2024-09-13T18:31:01.102312+0000","last_clean":"2024-09-13T18:31:01.102312+0000","last_became_active":"2024-09-13T18:30:59.715395+0000","last_became_peered":"2024-09-13T18:30:59.715395+0000","last_unstale":"2024-09-13T18:31:01.102312+0000","last_undegraded":"2024-09-13T18:31:01.102312+0000","last_fullsized":"2024-09-13T18:31:01.102312+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:00.719013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138965+0000","last_change":"2024-09-13T18:31:00.145681+0000","last_active":"2024-09-13T18:31:01.138965+0000","last_peered":"2024-09-13T18:31:01.138965+0000","last_clean":"2024-09-13T18:31:01.138965+0000","last_became_active":"2024-09-13T18:31:00.145120+0000","last_became_peered":"2024-09-13T18:31:00.145120+0000","last_unstale":"2024-09-13T18:31:01.138965+0000","last_undegraded":"2024-09-13T18:31:01.138965+0000","last_fullsized":"2024-09-13T18:31:01.138965+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:28.750230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140397+0000","last_change":"2024-09-13T18:30:59.719506+0000","last_active":"2024-09-13T18:31:01.140397+0000","last_peered":"2024-09-13T18:31:01.140397+0000","last_clean":"2024-09-13T18:31:01.140397+0000","last_became_active":"2024-09-13T18:30:59.719200+0000","last_became_peered":"2024-09-13T18:30:59.719200+0000","last_unstale":"2024-09-13T18:31:01.140397+0000","last_undegraded":"2024-09-13T18:31:01.140397+0000","last_fullsized":"2024-09-13T18:31:01.140397+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.344721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137236+0000","last_change":"2024-09-13T18:31:00.114905+0000","last_active":"2024-09-13T18:31:01.137236+0000","last_peered":"2024-09-13T18:31:01.137236+0000","last_clean":"2024-09-13T18:31:01.137236+0000","last_became_active":"2024-09-13T18:31:00.113528+0000","last_became_peered":"2024-09-13T18:31:00.113528+0000","last_unstale":"2024-09-13T18:31:01.137236+0000","last_undegraded":"2024-09-13T18:31:01.137236+0000","last_fullsized":"2024-09-13T18:31:01.137236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:28.667585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136902+0000","last_change":"2024-09-13T18:30:59.725952+0000","last_active":"2024-09-13T18:31:01.136902+0000","last_peered":"2024-09-13T18:31:01.136902+0000","last_clean":"2024-09-13T18:31:01.136902+0000","last_became_active":"2024-09-13T18:30:59.725251+0000","last_became_peered":"2024-09-13T18:30:59.725251+0000","last_unstale":"2024-09-13T18:31:01.136902+0000","last_undegraded":"2024-09-13T18:31:01.136902+0000","last_fullsized":"2024-09-13T18:31:01.136902+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:58.588177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099544+0000","last_change":"2024-09-13T18:31:00.121714+0000","last_active":"2024-09-13T18:31:01.099544+0000","last_peered":"2024-09-13T18:31:01.099544+0000","last_clean":"2024-09-13T18:31:01.099544+0000","last_became_active":"2024-09-13T18:31:00.121455+0000","last_became_peered":"2024-09-13T18:31:00.121455+0000","last_unstale":"2024-09-13T18:31:01.099544+0000","last_undegraded":"2024-09-13T18:31:01.099544+0000","last_fullsized":"2024-09-13T18:31:01.099544+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:00.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138215+0000","last_change":"2024-09-13T18:30:59.725825+0000","last_active":"2024-09-13T18:31:01.138215+0000","last_peered":"2024-09-13T18:31:01.138215+0000","last_clean":"2024-09-13T18:31:01.138215+0000","last_became_active":"2024-09-13T18:30:59.725266+0000","last_became_peered":"2024-09-13T18:30:59.725266+0000","last_unstale":"2024-09-13T18:31:01.138215+0000","last_undegraded":"2024-09-13T18:31:01.138215+0000","last_fullsized":"2024-09-13T18:31:01.138215+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:42.212984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":273,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T18:31:00.119620+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:31:00.119620+0000","last_peered":"2024-09-13T18:31:00.119620+0000","last_clean":"2024-09-13T18:31:00.119620+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:31:00.119620+0000","last_undegraded":"2024-09-13T18:31:00.119620+0000","last_fullsized":"2024-09-13T18:31:00.119620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1921024,"data_stored":1170807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.292,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96299999999999997,"15min":0.89500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.333,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.93100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.173,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95699999999999996,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.274,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.0389999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83699999999999997,"15min":0.80200000000000005},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.997,"5min":1.276,"15min":1.276},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.88200000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.2190000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88300000000000001,"15min":0.88100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":1.349,"15min":1.448},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.91600000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2230000000000001,"5min":1.397,"15min":1.397},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.879,"15min":0.88500000000000001},"min":{"1min":0.61699999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2569999999999999,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.93799999999999994},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.266},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98799999999999999,"15min":1.032},"min":{"1min":0.60799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.5609999999999999,"15min":1.877},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0089999999999999,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.69399999999999995,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.044,"15min":1},"min":{"1min":0.69199999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1779999999999999,"5min":1.506,"15min":1.506},"last":1.018}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1323008,"data_stored":579893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.78700000000000003},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.56100000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.24,"5min":1.577,"15min":1.577},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.95999999999999996,"15min":0.90100000000000002},"min":{"1min":0.68899999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.218,"5min":1.464,"15min":1.464},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1080000000000001,"5min":1.268,"15min":1.268},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.92800000000000005,"15min":0.97099999999999997},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.0549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88600000000000001,"15min":0.876},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.131,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.875,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1040000000000001,"5min":1.306,"15min":1.306},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.67000000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.157,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.02,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":1.526},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.57699999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1950000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.036,"15min":1.0960000000000001},"min":{"1min":0.60499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.228,"5min":2.762,"15min":2.762},"last":1.002}]},{"osd":7,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.002,"15min":1.0349999999999999},"min":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.877},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.01,"15min":1.038},"min":{"1min":0.63100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":1.72,"15min":1.72},"last":0.94799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1327104,"data_stored":580427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":0.84999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2390000000000001,"5min":1.5469999999999999,"15min":2.0209999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.86699999999999999,"15min":0.90300000000000002},"min":{"1min":0.59999999999999998,"5min":0.45300000000000001,"15min":0.437},"max":{"1min":1.105,"5min":1.2010000000000001,"15min":2.1840000000000002},"last":0.89600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.88400000000000001,"15min":0.83599999999999997},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.1559999999999999,"5min":1.22,"15min":1.4419999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85099999999999998,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.109,"5min":1.157,"15min":1.5029999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90000000000000002,"15min":0.88100000000000001},"min":{"1min":0.51700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1599999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91500000000000004,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3839999999999999,"5min":1.4730000000000001,"15min":2.2589999999999999},"last":1.0840000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2350000000000001,"5min":1.3740000000000001,"15min":2.0840000000000001},"last":1.3},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.97099999999999997},"min":{"1min":0.61099999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.339,"5min":1.6719999999999999,"15min":1.871},"last":1.111}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.163,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":1.042},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3180000000000001,"5min":1.4059999999999999,"15min":1.5049999999999999},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.96999999999999997,"15min":1.0249999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4239999999999999,"5min":1.5229999999999999,"15min":1.5680000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93899999999999995,"15min":1.018},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.6779999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.0029999999999999,"15min":1.105},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3779999999999999,"5min":1.4039999999999999,"15min":2.246},"last":1.232},{"interface":"front","average":{"1min":0.995,"5min":1.042,"15min":1.1279999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2969999999999999,"5min":1.5980000000000001,"15min":1.9379999999999999},"last":1.1830000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1318912,"data_stored":579823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.91200000000000003,"15min":0.82999999999999996},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.877},{"interface":"front","average":{"1min":1.034,"5min":0.91200000000000003,"15min":0.88600000000000001},"min":{"1min":0.52900000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.143,"5min":1.536,"15min":1.536},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.026,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.502,"5min":0.499,"15min":0.499},"max":{"1min":4.4509999999999996,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.0169999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88800000000000001,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1910000000000001,"5min":1.216,"15min":1.216},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.89900000000000002,"15min":0.89300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3149999999999999,"5min":1.323,"15min":1.323},"last":1.091}]},{"osd":3,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1679999999999999,"5min":1.476,"15min":1.476},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.01,"15min":0.95799999999999996},"min":{"1min":0.63100000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":10.44,"5min":10.44,"15min":10.44},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.3280000000000003,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.94899999999999995,"15min":0.96499999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.841,"5min":1.0980000000000001,"15min":1.0349999999999999},"min":{"1min":0.70799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":19.254000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1950000000000001,"15min":1.085},"min":{"1min":0.88400000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":19.434000000000001,"5min":19.434000000000001,"15min":19.434000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.181,"15min":1.0900000000000001},"min":{"1min":0.623,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":15.593,"5min":15.593,"15min":15.593},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.034,"15min":1.073},"min":{"1min":0.877,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.323,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36524,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335316,"statfs":{"total":96636764160,"available":96599363584,"internally_reserved":0,"allocated":1335296,"data_stored":581457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":0.63100000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.127,"5min":2.113,"15min":2.113},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80700000000000005,"15min":0.72499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1819999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.94799999999999995,"5min":1.4199999999999999,"15min":1.704},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.623},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98599999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.375,"5min":1.742,"15min":1.742},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.81299999999999994,"15min":0.747},"min":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.222,"5min":1.224,"15min":1.399},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94899999999999995,"15min":0.95499999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4470000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1,"15min":1.0980000000000001},"min":{"1min":0.71999999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.498,"5min":1.498,"15min":2.8740000000000001},"last":1.536}]},{"osd":5,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2949999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.27},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.94199999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.236,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0149999999999999,"15min":1.0609999999999999},"min":{"1min":0.64100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.302,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0640000000000001,"15min":1.054},"min":{"1min":0.64800000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.345,"5min":1.6890000000000001,"15min":1.96},"last":1.502}]},{"osd":7,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0509999999999999,"15min":1.095},"min":{"1min":0.67200000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.6060000000000001,"5min":1.665,"15min":3},"last":1.171},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.044,"15min":1.006},"min":{"1min":0.629,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.3500000000000001,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.1040000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1318912,"data_stored":579823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.92500000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.34100000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.335},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.65500000000000003},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.97699999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.44700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2190000000000001,"5min":1.288,"15min":1.423},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.161,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.141}]},{"osd":4,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91900000000000004,"15min":0.90800000000000003},"min":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.367,"5min":1.367,"15min":1.611},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.623,"5min":0.498,"15min":0.498},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.999},"min":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4950000000000001,"5min":1.5109999999999999,"15min":1.9179999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.702},"last":1.1930000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.62,"5min":0.5,"15min":0.5},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0249999999999999,"15min":1.0469999999999999},"min":{"1min":0.72199999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0620000000000001,"15min":1.079},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4850000000000001,"5min":1.6499999999999999,"15min":1.8089999999999999},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1327104,"data_stored":579947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.58399999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.876,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67300000000000004,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":1.042,"5min":1.177,"15min":1.177},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.754,"15min":0.70499999999999996},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1719999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.145,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77900000000000003,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0580000000000001,"5min":1.423,"15min":1.423},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93500000000000005,"15min":0.90900000000000003},"min":{"1min":0.65400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3600000000000001,"5min":1.4359999999999999,"15min":1.4610000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.93400000000000005,"15min":0.92700000000000005},"min":{"1min":0.58199999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1899999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.69599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1080000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.0149999999999999,"15min":1.0289999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3759999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.022}]},{"osd":6,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.032,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.60999999999999999,"15min":0.60299999999999998},"max":{"1min":1.2689999999999999,"5min":1.5900000000000001,"15min":1.653},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":0.99299999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3859999999999999,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":1.117}]},{"osd":7,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0840000000000001,"15min":1.054},"min":{"1min":0.72699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.403,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.147},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.075,"15min":1.0229999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.345,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.091}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37108,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334732,"statfs":{"total":96636764160,"available":96598765568,"internally_reserved":0,"allocated":1933312,"data_stored":1171867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.147},"last":0.313},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.76200000000000001,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":1.1060000000000001,"5min":1.244,"15min":1.4359999999999999},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":0.63300000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.379},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.35899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.018,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1200000000000001,"5min":1.3169999999999999,"15min":1.5129999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.88200000000000001,"15min":0.93999999999999995},"min":{"1min":0.44400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.248,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.56699999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4259999999999999,"5min":1.5069999999999999,"15min":1.986},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5669999999999999,"5min":1.8799999999999999,"15min":2.641},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.026,"15min":1.038},"min":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3580000000000001,"5min":1.4259999999999999,"15min":1.6699999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.59799999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3740000000000001,"5min":1.466,"15min":1.891},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.99099999999999999,"15min":1.0229999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.534,"5min":1.5549999999999999,"15min":2.5590000000000002},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.004,"15min":1.0249999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.617,"5min":1.617,"15min":2.2949999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.60999999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6930000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:31:04.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:31:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1b5de9640 1 Processor -- start 2024-09-13T18:31:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1b5de9640 1 -- start start 2024-09-13T18:31:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1b5de9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1b01582a0 0x7fc1b006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1b5de9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1b00713a0 0x7fc1b006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1b5de9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b006d480 con 0x7fc1b015b7c0 2024-09-13T18:31:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1b5de9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b015aaf0 con 0x7fc1b00713a0 2024-09-13T18:31:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1b5de9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b006d760 con 0x7fc1b01582a0 2024-09-13T18:31:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1affff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1b00713a0 0x7fc1b006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1aeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc1b015b7c0 0x7fc1b0070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41070/0 (socket says 172.21.15.53:41070) 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1aeffd640 1 -- 172.21.15.53:0/154333676 learned_addr learned my addr 172.21.15.53:0/154333676 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1af7fe640 1 --2- 172.21.15.53:0/154333676 >> v2:172.21.15.87:3300/0 conn(0x7fc1b01582a0 0x7fc1b006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1ae7fc640 1 -- 172.21.15.53:0/154333676 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310793855 0 0) 0x7fc1b006d480 con 0x7fc1b015b7c0 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1ae7fc640 1 -- 172.21.15.53:0/154333676 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc198003530 con 0x7fc1b015b7c0 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1affff640 1 -- 172.21.15.53:0/154333676 >> v2:172.21.15.87:3300/0 conn(0x7fc1b01582a0 msgr2=0x7fc1b006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1affff640 1 --2- 172.21.15.53:0/154333676 >> v2:172.21.15.87:3300/0 conn(0x7fc1b01582a0 0x7fc1b006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1affff640 1 -- 172.21.15.53:0/154333676 >> v1:172.21.15.53:6789/0 conn(0x7fc1b015b7c0 legacy=0x7fc1b0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1affff640 1 -- 172.21.15.53:0/154333676 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b015ace0 con 0x7fc1b00713a0 2024-09-13T18:31:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.318+0000 7fc1affff640 1 --2- 172.21.15.53:0/154333676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00713a0 0x7fc1b006ce40 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0069f50 tx=0x7fc1a801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaf7412a71eae37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1ae7fc640 1 -- 172.21.15.53:0/154333676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80a59c0 con 0x7fc1b00713a0 2024-09-13T18:31:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1ae7fc640 1 -- 172.21.15.53:0/154333676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80a5b20 con 0x7fc1b00713a0 2024-09-13T18:31:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1ae7fc640 1 -- 172.21.15.53:0/154333676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80ad440 con 0x7fc1b00713a0 2024-09-13T18:31:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- 172.21.15.53:0/154333676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00713a0 msgr2=0x7fc1b006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/154333676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00713a0 0x7fc1b006ce40 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0069f50 tx=0x7fc1a801c900 comp rx=0 tx=0).stop 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- 172.21.15.53:0/154333676 shutdown_connections 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/154333676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b00713a0 0x7fc1b006ce40 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/154333676 >> v2:172.21.15.87:3300/0 conn(0x7fc1b01582a0 0x7fc1b006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- 172.21.15.53:0/154333676 >> 172.21.15.53:0/154333676 conn(0x7fc1b0065c80 msgr2=0x7fc1b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- 172.21.15.53:0/154333676 shutdown_connections 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- 172.21.15.53:0/154333676 wait complete. 2024-09-13T18:31:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 Processor -- start 2024-09-13T18:31:04.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- start start 2024-09-13T18:31:04.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b00713a0 0x7fc1b013db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b01582a0 0x7fc1b0159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b015b7c0 0x7fc1b015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0158820 con 0x7fc1b01582a0 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0158ac0 con 0x7fc1b015b7c0 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1b5de9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0158da0 con 0x7fc1b00713a0 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b01582a0 0x7fc1b0159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b01582a0 0x7fc1b0159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44028/0 (socket says 172.21.15.53:44028) 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 -- 172.21.15.53:0/3153178649 learned_addr learned my addr 172.21.15.53:0/3153178649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1af7fe640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b00713a0 0x7fc1b013db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1affff640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b015b7c0 0x7fc1b015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 -- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b00713a0 msgr2=0x7fc1b013db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b00713a0 0x7fc1b013db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 -- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b015b7c0 msgr2=0x7fc1b015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b015b7c0 0x7fc1b015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 -- 172.21.15.53:0/3153178649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009a70 con 0x7fc1b01582a0 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1af7fe640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b00713a0 0x7fc1b013db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1affff640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b015b7c0 0x7fc1b015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc1aeffd640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b01582a0 0x7fc1b0159f10 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c420 tx=0x7fc1a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.322+0000 7fc197fff640 1 -- 172.21.15.53:0/3153178649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4005cf0 con 0x7fc1b01582a0 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc197fff640 1 -- 172.21.15.53:0/3153178649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4005e50 con 0x7fc1b01582a0 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b0159080 con 0x7fc1b01582a0 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc197fff640 1 -- 172.21.15.53:0/3153178649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40072d0 con 0x7fc1b01582a0 2024-09-13T18:31:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b013e050 con 0x7fc1b01582a0 2024-09-13T18:31:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b0067400 con 0x7fc1b01582a0 2024-09-13T18:31:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc197fff640 1 -- 172.21.15.53:0/3153178649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fc1a4007430 con 0x7fc1b01582a0 2024-09-13T18:31:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc197fff640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc19c0667b0 0x7fc19c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc197fff640 1 -- 172.21.15.53:0/3153178649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a4083880 con 0x7fc1b01582a0 2024-09-13T18:31:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc1af7fe640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc19c0667b0 0x7fc19c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.326+0000 7fc1af7fe640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc19c0667b0 0x7fc19c068c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0007a70 tx=0x7fc1a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:04.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.330+0000 7fc197fff640 1 -- 172.21.15.53:0/3153178649 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1a4050b90 con 0x7fc1b01582a0 2024-09-13T18:31:04.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.482+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1b00ae230 con 0x7fc19c0667b0 2024-09-13T18:31:04.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.494+0000 7fc197fff640 1 -- 172.21.15.53:0/3153178649 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288495 (secure 0 0 0) 0x7fc1b00ae230 con 0x7fc19c0667b0 2024-09-13T18:31:04.501 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:31:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc19c0667b0 msgr2=0x7fc19c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc19c0667b0 0x7fc19c068c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0007a70 tx=0x7fc1a0008040 comp rx=0 tx=0).stop 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b01582a0 msgr2=0x7fc1b0159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b01582a0 0x7fc1b0159f10 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c420 tx=0x7fc1a400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 shutdown_connections 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc19c0667b0 0x7fc19c068c70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1b015b7c0 0x7fc1b015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1b01582a0 0x7fc1b0159f10 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 --2- 172.21.15.53:0/3153178649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1b00713a0 0x7fc1b013db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 >> 172.21.15.53:0/3153178649 conn(0x7fc1b0065c80 msgr2=0x7fc1b00703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 shutdown_connections 2024-09-13T18:31:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.498+0000 7fc1b5de9640 1 -- 172.21.15.53:0/3153178649 wait complete. 2024-09-13T18:31:04.517 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-13T18:31:03.838222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276904,"kb_used_data":11528,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754697816,"statfs":{"total":773094113280,"available":772810563584,"internally_reserved":0,"allocated":11804672,"data_stored":5824044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.158598"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139082+0000","last_change":"2024-09-13T18:31:00.122945+0000","last_active":"2024-09-13T18:31:01.139082+0000","last_peered":"2024-09-13T18:31:01.139082+0000","last_clean":"2024-09-13T18:31:01.139082+0000","last_became_active":"2024-09-13T18:31:00.120239+0000","last_became_peered":"2024-09-13T18:31:00.120239+0000","last_unstale":"2024-09-13T18:31:01.139082+0000","last_undegraded":"2024-09-13T18:31:01.139082+0000","last_fullsized":"2024-09-13T18:31:01.139082+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:54.424886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102961+0000","last_change":"2024-09-13T18:31:00.114311+0000","last_active":"2024-09-13T18:31:01.102961+0000","last_peered":"2024-09-13T18:31:01.102961+0000","last_clean":"2024-09-13T18:31:01.102961+0000","last_became_active":"2024-09-13T18:31:00.113333+0000","last_became_peered":"2024-09-13T18:31:00.113333+0000","last_unstale":"2024-09-13T18:31:01.102961+0000","last_undegraded":"2024-09-13T18:31:01.102961+0000","last_fullsized":"2024-09-13T18:31:01.102961+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:48.417541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139643+0000","last_change":"2024-09-13T18:31:00.140700+0000","last_active":"2024-09-13T18:31:01.139643+0000","last_peered":"2024-09-13T18:31:01.139643+0000","last_clean":"2024-09-13T18:31:01.139643+0000","last_became_active":"2024-09-13T18:31:00.140088+0000","last_became_peered":"2024-09-13T18:31:00.140088+0000","last_unstale":"2024-09-13T18:31:01.139643+0000","last_undegraded":"2024-09-13T18:31:01.139643+0000","last_fullsized":"2024-09-13T18:31:01.139643+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:16.567223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137706+0000","last_change":"2024-09-13T18:31:00.106136+0000","last_active":"2024-09-13T18:31:01.137706+0000","last_peered":"2024-09-13T18:31:01.137706+0000","last_clean":"2024-09-13T18:31:01.137706+0000","last_became_active":"2024-09-13T18:31:00.105899+0000","last_became_peered":"2024-09-13T18:31:00.105899+0000","last_unstale":"2024-09-13T18:31:01.137706+0000","last_undegraded":"2024-09-13T18:31:01.137706+0000","last_fullsized":"2024-09-13T18:31:01.137706+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:27.992769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140703+0000","last_change":"2024-09-13T18:31:00.111612+0000","last_active":"2024-09-13T18:31:01.140703+0000","last_peered":"2024-09-13T18:31:01.140703+0000","last_clean":"2024-09-13T18:31:01.140703+0000","last_became_active":"2024-09-13T18:31:00.111271+0000","last_became_peered":"2024-09-13T18:31:00.111271+0000","last_unstale":"2024-09-13T18:31:01.140703+0000","last_undegraded":"2024-09-13T18:31:01.140703+0000","last_fullsized":"2024-09-13T18:31:01.140703+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:52.473245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137553+0000","last_change":"2024-09-13T18:31:00.110188+0000","last_active":"2024-09-13T18:31:01.137553+0000","last_peered":"2024-09-13T18:31:01.137553+0000","last_clean":"2024-09-13T18:31:01.137553+0000","last_became_active":"2024-09-13T18:31:00.109921+0000","last_became_peered":"2024-09-13T18:31:00.109921+0000","last_unstale":"2024-09-13T18:31:01.137553+0000","last_undegraded":"2024-09-13T18:31:01.137553+0000","last_fullsized":"2024-09-13T18:31:01.137553+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:46.819882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138174+0000","last_change":"2024-09-13T18:31:00.124913+0000","last_active":"2024-09-13T18:31:01.138174+0000","last_peered":"2024-09-13T18:31:01.138174+0000","last_clean":"2024-09-13T18:31:01.138174+0000","last_became_active":"2024-09-13T18:31:00.123575+0000","last_became_peered":"2024-09-13T18:31:00.123575+0000","last_unstale":"2024-09-13T18:31:01.138174+0000","last_undegraded":"2024-09-13T18:31:01.138174+0000","last_fullsized":"2024-09-13T18:31:01.138174+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:28.203472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138608+0000","last_change":"2024-09-13T18:31:00.130698+0000","last_active":"2024-09-13T18:31:01.138608+0000","last_peered":"2024-09-13T18:31:01.138608+0000","last_clean":"2024-09-13T18:31:01.138608+0000","last_became_active":"2024-09-13T18:31:00.130138+0000","last_became_peered":"2024-09-13T18:31:00.130138+0000","last_unstale":"2024-09-13T18:31:01.138608+0000","last_undegraded":"2024-09-13T18:31:01.138608+0000","last_fullsized":"2024-09-13T18:31:01.138608+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:59.736807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139259+0000","last_change":"2024-09-13T18:31:00.122620+0000","last_active":"2024-09-13T18:31:01.139259+0000","last_peered":"2024-09-13T18:31:01.139259+0000","last_clean":"2024-09-13T18:31:01.139259+0000","last_became_active":"2024-09-13T18:31:00.122346+0000","last_became_peered":"2024-09-13T18:31:00.122346+0000","last_unstale":"2024-09-13T18:31:01.139259+0000","last_undegraded":"2024-09-13T18:31:01.139259+0000","last_fullsized":"2024-09-13T18:31:01.139259+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:33.470009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138385+0000","last_change":"2024-09-13T18:31:00.103320+0000","last_active":"2024-09-13T18:31:01.138385+0000","last_peered":"2024-09-13T18:31:01.138385+0000","last_clean":"2024-09-13T18:31:01.138385+0000","last_became_active":"2024-09-13T18:31:00.103084+0000","last_became_peered":"2024-09-13T18:31:00.103084+0000","last_unstale":"2024-09-13T18:31:01.138385+0000","last_undegraded":"2024-09-13T18:31:01.138385+0000","last_fullsized":"2024-09-13T18:31:01.138385+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:44.277646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102650+0000","last_change":"2024-09-13T18:31:00.137287+0000","last_active":"2024-09-13T18:31:01.102650+0000","last_peered":"2024-09-13T18:31:01.102650+0000","last_clean":"2024-09-13T18:31:01.102650+0000","last_became_active":"2024-09-13T18:31:00.137029+0000","last_became_peered":"2024-09-13T18:31:00.137029+0000","last_unstale":"2024-09-13T18:31:01.102650+0000","last_undegraded":"2024-09-13T18:31:01.102650+0000","last_fullsized":"2024-09-13T18:31:01.102650+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:50.652223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137893+0000","last_change":"2024-09-13T18:31:00.106671+0000","last_active":"2024-09-13T18:31:01.137893+0000","last_peered":"2024-09-13T18:31:01.137893+0000","last_clean":"2024-09-13T18:31:01.137893+0000","last_became_active":"2024-09-13T18:31:00.106409+0000","last_became_peered":"2024-09-13T18:31:00.106409+0000","last_unstale":"2024-09-13T18:31:01.137893+0000","last_undegraded":"2024-09-13T18:31:01.137893+0000","last_fullsized":"2024-09-13T18:31:01.137893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:19.555820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139452+0000","last_change":"2024-09-13T18:31:00.142937+0000","last_active":"2024-09-13T18:31:01.139452+0000","last_peered":"2024-09-13T18:31:01.139452+0000","last_clean":"2024-09-13T18:31:01.139452+0000","last_became_active":"2024-09-13T18:31:00.142384+0000","last_became_peered":"2024-09-13T18:31:00.142384+0000","last_unstale":"2024-09-13T18:31:01.139452+0000","last_undegraded":"2024-09-13T18:31:01.139452+0000","last_fullsized":"2024-09-13T18:31:01.139452+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:45.764306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139442+0000","last_change":"2024-09-13T18:31:00.145554+0000","last_active":"2024-09-13T18:31:01.139442+0000","last_peered":"2024-09-13T18:31:01.139442+0000","last_clean":"2024-09-13T18:31:01.139442+0000","last_became_active":"2024-09-13T18:31:00.145093+0000","last_became_peered":"2024-09-13T18:31:00.145093+0000","last_unstale":"2024-09-13T18:31:01.139442+0000","last_undegraded":"2024-09-13T18:31:01.139442+0000","last_fullsized":"2024-09-13T18:31:01.139442+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:00.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138749+0000","last_change":"2024-09-13T18:31:00.113219+0000","last_active":"2024-09-13T18:31:01.138749+0000","last_peered":"2024-09-13T18:31:01.138749+0000","last_clean":"2024-09-13T18:31:01.138749+0000","last_became_active":"2024-09-13T18:31:00.112829+0000","last_became_peered":"2024-09-13T18:31:00.112829+0000","last_unstale":"2024-09-13T18:31:01.138749+0000","last_undegraded":"2024-09-13T18:31:01.138749+0000","last_fullsized":"2024-09-13T18:31:01.138749+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:52.473245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136615+0000","last_change":"2024-09-13T18:31:00.129631+0000","last_active":"2024-09-13T18:31:01.136615+0000","last_peered":"2024-09-13T18:31:01.136615+0000","last_clean":"2024-09-13T18:31:01.136615+0000","last_became_active":"2024-09-13T18:31:00.129328+0000","last_became_peered":"2024-09-13T18:31:00.129328+0000","last_unstale":"2024-09-13T18:31:01.136615+0000","last_undegraded":"2024-09-13T18:31:01.136615+0000","last_fullsized":"2024-09-13T18:31:01.136615+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:22.417724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.103090+0000","last_change":"2024-09-13T18:31:00.121006+0000","last_active":"2024-09-13T18:31:01.103090+0000","last_peered":"2024-09-13T18:31:01.103090+0000","last_clean":"2024-09-13T18:31:01.103090+0000","last_became_active":"2024-09-13T18:31:00.119862+0000","last_became_peered":"2024-09-13T18:31:00.119862+0000","last_unstale":"2024-09-13T18:31:01.103090+0000","last_undegraded":"2024-09-13T18:31:01.103090+0000","last_fullsized":"2024-09-13T18:31:01.103090+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:30.004060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140822+0000","last_change":"2024-09-13T18:31:00.127582+0000","last_active":"2024-09-13T18:31:01.140822+0000","last_peered":"2024-09-13T18:31:01.140822+0000","last_clean":"2024-09-13T18:31:01.140822+0000","last_became_active":"2024-09-13T18:31:00.127335+0000","last_became_peered":"2024-09-13T18:31:00.127335+0000","last_unstale":"2024-09-13T18:31:01.140822+0000","last_undegraded":"2024-09-13T18:31:01.140822+0000","last_fullsized":"2024-09-13T18:31:01.140822+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:44.914165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139893+0000","last_change":"2024-09-13T18:31:00.142714+0000","last_active":"2024-09-13T18:31:01.139893+0000","last_peered":"2024-09-13T18:31:01.139893+0000","last_clean":"2024-09-13T18:31:01.139893+0000","last_became_active":"2024-09-13T18:31:00.141993+0000","last_became_peered":"2024-09-13T18:31:00.141993+0000","last_unstale":"2024-09-13T18:31:01.139893+0000","last_undegraded":"2024-09-13T18:31:01.139893+0000","last_fullsized":"2024-09-13T18:31:01.139893+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:48.417541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102580+0000","last_change":"2024-09-13T18:31:00.131366+0000","last_active":"2024-09-13T18:31:01.102580+0000","last_peered":"2024-09-13T18:31:01.102580+0000","last_clean":"2024-09-13T18:31:01.102580+0000","last_became_active":"2024-09-13T18:31:00.129363+0000","last_became_peered":"2024-09-13T18:31:00.129363+0000","last_unstale":"2024-09-13T18:31:01.102580+0000","last_undegraded":"2024-09-13T18:31:01.102580+0000","last_fullsized":"2024-09-13T18:31:01.102580+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:47.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102902+0000","last_change":"2024-09-13T18:31:00.104344+0000","last_active":"2024-09-13T18:31:01.102902+0000","last_peered":"2024-09-13T18:31:01.102902+0000","last_clean":"2024-09-13T18:31:01.102902+0000","last_became_active":"2024-09-13T18:31:00.103642+0000","last_became_peered":"2024-09-13T18:31:00.103642+0000","last_unstale":"2024-09-13T18:31:01.102902+0000","last_undegraded":"2024-09-13T18:31:01.102902+0000","last_fullsized":"2024-09-13T18:31:01.102902+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:16.567223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099726+0000","last_change":"2024-09-13T18:31:00.125745+0000","last_active":"2024-09-13T18:31:01.099726+0000","last_peered":"2024-09-13T18:31:01.099726+0000","last_clean":"2024-09-13T18:31:01.099726+0000","last_became_active":"2024-09-13T18:31:00.125434+0000","last_became_peered":"2024-09-13T18:31:00.125434+0000","last_unstale":"2024-09-13T18:31:01.099726+0000","last_undegraded":"2024-09-13T18:31:01.099726+0000","last_fullsized":"2024-09-13T18:31:01.099726+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:50.652223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102119+0000","last_change":"2024-09-13T18:31:00.118272+0000","last_active":"2024-09-13T18:31:01.102119+0000","last_peered":"2024-09-13T18:31:01.102119+0000","last_clean":"2024-09-13T18:31:01.102119+0000","last_became_active":"2024-09-13T18:31:00.117596+0000","last_became_peered":"2024-09-13T18:31:00.117596+0000","last_unstale":"2024-09-13T18:31:01.102119+0000","last_undegraded":"2024-09-13T18:31:01.102119+0000","last_fullsized":"2024-09-13T18:31:01.102119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:28.750230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099692+0000","last_change":"2024-09-13T18:31:00.121780+0000","last_active":"2024-09-13T18:31:01.099692+0000","last_peered":"2024-09-13T18:31:01.099692+0000","last_clean":"2024-09-13T18:31:01.099692+0000","last_became_active":"2024-09-13T18:31:00.121533+0000","last_became_peered":"2024-09-13T18:31:00.121533+0000","last_unstale":"2024-09-13T18:31:01.099692+0000","last_undegraded":"2024-09-13T18:31:01.099692+0000","last_fullsized":"2024-09-13T18:31:01.099692+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:14.404438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.103210+0000","last_change":"2024-09-13T18:31:00.120522+0000","last_active":"2024-09-13T18:31:01.103210+0000","last_peered":"2024-09-13T18:31:01.103210+0000","last_clean":"2024-09-13T18:31:01.103210+0000","last_became_active":"2024-09-13T18:31:00.118978+0000","last_became_peered":"2024-09-13T18:31:00.118978+0000","last_unstale":"2024-09-13T18:31:01.103210+0000","last_undegraded":"2024-09-13T18:31:01.103210+0000","last_fullsized":"2024-09-13T18:31:01.103210+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:14.404438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138491+0000","last_change":"2024-09-13T18:31:00.133005+0000","last_active":"2024-09-13T18:31:01.138491+0000","last_peered":"2024-09-13T18:31:01.138491+0000","last_clean":"2024-09-13T18:31:01.138491+0000","last_became_active":"2024-09-13T18:31:00.132678+0000","last_became_peered":"2024-09-13T18:31:00.132678+0000","last_unstale":"2024-09-13T18:31:01.138491+0000","last_undegraded":"2024-09-13T18:31:01.138491+0000","last_fullsized":"2024-09-13T18:31:01.138491+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:28.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138172+0000","last_change":"2024-09-13T18:31:00.104271+0000","last_active":"2024-09-13T18:31:01.138172+0000","last_peered":"2024-09-13T18:31:01.138172+0000","last_clean":"2024-09-13T18:31:01.138172+0000","last_became_active":"2024-09-13T18:31:00.103457+0000","last_became_peered":"2024-09-13T18:31:00.103457+0000","last_unstale":"2024-09-13T18:31:01.138172+0000","last_undegraded":"2024-09-13T18:31:01.138172+0000","last_fullsized":"2024-09-13T18:31:01.138172+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:54.025453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099987+0000","last_change":"2024-09-13T18:31:00.126688+0000","last_active":"2024-09-13T18:31:01.099987+0000","last_peered":"2024-09-13T18:31:01.099987+0000","last_clean":"2024-09-13T18:31:01.099987+0000","last_became_active":"2024-09-13T18:31:00.126411+0000","last_became_peered":"2024-09-13T18:31:00.126411+0000","last_unstale":"2024-09-13T18:31:01.099987+0000","last_undegraded":"2024-09-13T18:31:01.099987+0000","last_fullsized":"2024-09-13T18:31:01.099987+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:15.667070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102383+0000","last_change":"2024-09-13T18:31:00.119533+0000","last_active":"2024-09-13T18:31:01.102383+0000","last_peered":"2024-09-13T18:31:01.102383+0000","last_clean":"2024-09-13T18:31:01.102383+0000","last_became_active":"2024-09-13T18:31:00.117117+0000","last_became_peered":"2024-09-13T18:31:00.117117+0000","last_unstale":"2024-09-13T18:31:01.102383+0000","last_undegraded":"2024-09-13T18:31:01.102383+0000","last_fullsized":"2024-09-13T18:31:01.102383+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:00.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138534+0000","last_change":"2024-09-13T18:31:00.108375+0000","last_active":"2024-09-13T18:31:01.138534+0000","last_peered":"2024-09-13T18:31:01.138534+0000","last_clean":"2024-09-13T18:31:01.138534+0000","last_became_active":"2024-09-13T18:31:00.107911+0000","last_became_peered":"2024-09-13T18:31:00.107911+0000","last_unstale":"2024-09-13T18:31:01.138534+0000","last_undegraded":"2024-09-13T18:31:01.138534+0000","last_fullsized":"2024-09-13T18:31:01.138534+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:56.076108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137023+0000","last_change":"2024-09-13T18:31:00.123180+0000","last_active":"2024-09-13T18:31:01.137023+0000","last_peered":"2024-09-13T18:31:01.137023+0000","last_clean":"2024-09-13T18:31:01.137023+0000","last_became_active":"2024-09-13T18:31:00.122806+0000","last_became_peered":"2024-09-13T18:31:00.122806+0000","last_unstale":"2024-09-13T18:31:01.137023+0000","last_undegraded":"2024-09-13T18:31:01.137023+0000","last_fullsized":"2024-09-13T18:31:01.137023+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:05.685840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137552+0000","last_change":"2024-09-13T18:31:00.112467+0000","last_active":"2024-09-13T18:31:01.137552+0000","last_peered":"2024-09-13T18:31:01.137552+0000","last_clean":"2024-09-13T18:31:01.137552+0000","last_became_active":"2024-09-13T18:31:00.110214+0000","last_became_peered":"2024-09-13T18:31:00.110214+0000","last_unstale":"2024-09-13T18:31:01.137552+0000","last_undegraded":"2024-09-13T18:31:01.137552+0000","last_fullsized":"2024-09-13T18:31:01.137552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:58.488601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138099+0000","last_change":"2024-09-13T18:31:00.112540+0000","last_active":"2024-09-13T18:31:01.138099+0000","last_peered":"2024-09-13T18:31:01.138099+0000","last_clean":"2024-09-13T18:31:01.138099+0000","last_became_active":"2024-09-13T18:31:00.109827+0000","last_became_peered":"2024-09-13T18:31:00.109827+0000","last_unstale":"2024-09-13T18:31:01.138099+0000","last_undegraded":"2024-09-13T18:31:01.138099+0000","last_fullsized":"2024-09-13T18:31:01.138099+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:42.967782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"105'4","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139528+0000","last_change":"2024-09-13T18:30:59.718096+0000","last_active":"2024-09-13T18:31:01.139528+0000","last_peered":"2024-09-13T18:31:01.139528+0000","last_clean":"2024-09-13T18:31:01.139528+0000","last_became_active":"2024-09-13T18:30:59.717097+0000","last_became_peered":"2024-09-13T18:30:59.717097+0000","last_unstale":"2024-09-13T18:31:01.139528+0000","last_undegraded":"2024-09-13T18:31:01.139528+0000","last_fullsized":"2024-09-13T18:31:01.139528+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:28.487233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141053+0000","last_change":"2024-09-13T18:31:00.136558+0000","last_active":"2024-09-13T18:31:01.141053+0000","last_peered":"2024-09-13T18:31:01.141053+0000","last_clean":"2024-09-13T18:31:01.141053+0000","last_became_active":"2024-09-13T18:31:00.136028+0000","last_became_peered":"2024-09-13T18:31:00.136028+0000","last_unstale":"2024-09-13T18:31:01.141053+0000","last_undegraded":"2024-09-13T18:31:01.141053+0000","last_fullsized":"2024-09-13T18:31:01.141053+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:47.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138817+0000","last_change":"2024-09-13T18:30:59.726968+0000","last_active":"2024-09-13T18:31:01.138817+0000","last_peered":"2024-09-13T18:31:01.138817+0000","last_clean":"2024-09-13T18:31:01.138817+0000","last_became_active":"2024-09-13T18:30:59.726288+0000","last_became_peered":"2024-09-13T18:30:59.726288+0000","last_unstale":"2024-09-13T18:31:01.138817+0000","last_undegraded":"2024-09-13T18:31:01.138817+0000","last_fullsized":"2024-09-13T18:31:01.138817+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:28.830684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137936+0000","last_change":"2024-09-13T18:31:00.119554+0000","last_active":"2024-09-13T18:31:01.137936+0000","last_peered":"2024-09-13T18:31:01.137936+0000","last_clean":"2024-09-13T18:31:01.137936+0000","last_became_active":"2024-09-13T18:31:00.119346+0000","last_became_peered":"2024-09-13T18:31:00.119346+0000","last_unstale":"2024-09-13T18:31:01.137936+0000","last_undegraded":"2024-09-13T18:31:01.137936+0000","last_fullsized":"2024-09-13T18:31:01.137936+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:56.363626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140675+0000","last_change":"2024-09-13T18:30:59.722962+0000","last_active":"2024-09-13T18:31:01.140675+0000","last_peered":"2024-09-13T18:31:01.140675+0000","last_clean":"2024-09-13T18:31:01.140675+0000","last_became_active":"2024-09-13T18:30:59.722375+0000","last_became_peered":"2024-09-13T18:30:59.722375+0000","last_unstale":"2024-09-13T18:31:01.140675+0000","last_undegraded":"2024-09-13T18:31:01.140675+0000","last_fullsized":"2024-09-13T18:31:01.140675+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:27.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139884+0000","last_change":"2024-09-13T18:31:00.142123+0000","last_active":"2024-09-13T18:31:01.139884+0000","last_peered":"2024-09-13T18:31:01.139884+0000","last_clean":"2024-09-13T18:31:01.139884+0000","last_became_active":"2024-09-13T18:31:00.141501+0000","last_became_peered":"2024-09-13T18:31:00.141501+0000","last_unstale":"2024-09-13T18:31:01.139884+0000","last_undegraded":"2024-09-13T18:31:01.139884+0000","last_fullsized":"2024-09-13T18:31:01.139884+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.598316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140841+0000","last_change":"2024-09-13T18:30:59.723309+0000","last_active":"2024-09-13T18:31:01.140841+0000","last_peered":"2024-09-13T18:31:01.140841+0000","last_clean":"2024-09-13T18:31:01.140841+0000","last_became_active":"2024-09-13T18:30:59.722812+0000","last_became_peered":"2024-09-13T18:30:59.722812+0000","last_unstale":"2024-09-13T18:31:01.140841+0000","last_undegraded":"2024-09-13T18:31:01.140841+0000","last_fullsized":"2024-09-13T18:31:01.140841+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:21.826476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137094+0000","last_change":"2024-09-13T18:31:00.110542+0000","last_active":"2024-09-13T18:31:01.137094+0000","last_peered":"2024-09-13T18:31:01.137094+0000","last_clean":"2024-09-13T18:31:01.137094+0000","last_became_active":"2024-09-13T18:31:00.110274+0000","last_became_peered":"2024-09-13T18:31:00.110274+0000","last_unstale":"2024-09-13T18:31:01.137094+0000","last_undegraded":"2024-09-13T18:31:01.137094+0000","last_fullsized":"2024-09-13T18:31:01.137094+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:35.211875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138624+0000","last_change":"2024-09-13T18:30:59.719669+0000","last_active":"2024-09-13T18:31:01.138624+0000","last_peered":"2024-09-13T18:31:01.138624+0000","last_clean":"2024-09-13T18:31:01.138624+0000","last_became_active":"2024-09-13T18:30:59.718986+0000","last_became_peered":"2024-09-13T18:30:59.718986+0000","last_unstale":"2024-09-13T18:31:01.138624+0000","last_undegraded":"2024-09-13T18:31:01.138624+0000","last_fullsized":"2024-09-13T18:31:01.138624+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:44.322585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102615+0000","last_change":"2024-09-13T18:31:00.114499+0000","last_active":"2024-09-13T18:31:01.102615+0000","last_peered":"2024-09-13T18:31:01.102615+0000","last_clean":"2024-09-13T18:31:01.102615+0000","last_became_active":"2024-09-13T18:31:00.114141+0000","last_became_peered":"2024-09-13T18:31:00.114141+0000","last_unstale":"2024-09-13T18:31:01.102615+0000","last_undegraded":"2024-09-13T18:31:01.102615+0000","last_fullsized":"2024-09-13T18:31:01.102615+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:16.640557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099962+0000","last_change":"2024-09-13T18:30:59.726139+0000","last_active":"2024-09-13T18:31:01.099962+0000","last_peered":"2024-09-13T18:31:01.099962+0000","last_clean":"2024-09-13T18:31:01.099962+0000","last_became_active":"2024-09-13T18:30:59.725715+0000","last_became_peered":"2024-09-13T18:30:59.725715+0000","last_unstale":"2024-09-13T18:31:01.099962+0000","last_undegraded":"2024-09-13T18:31:01.099962+0000","last_fullsized":"2024-09-13T18:31:01.099962+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:47.860700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136638+0000","last_change":"2024-09-13T18:31:00.114727+0000","last_active":"2024-09-13T18:31:01.136638+0000","last_peered":"2024-09-13T18:31:01.136638+0000","last_clean":"2024-09-13T18:31:01.136638+0000","last_became_active":"2024-09-13T18:31:00.113567+0000","last_became_peered":"2024-09-13T18:31:00.113567+0000","last_unstale":"2024-09-13T18:31:01.136638+0000","last_undegraded":"2024-09-13T18:31:01.136638+0000","last_fullsized":"2024-09-13T18:31:01.136638+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:02.440710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102786+0000","last_change":"2024-09-13T18:30:59.705185+0000","last_active":"2024-09-13T18:31:01.102786+0000","last_peered":"2024-09-13T18:31:01.102786+0000","last_clean":"2024-09-13T18:31:01.102786+0000","last_became_active":"2024-09-13T18:30:59.704388+0000","last_became_peered":"2024-09-13T18:30:59.704388+0000","last_unstale":"2024-09-13T18:31:01.102786+0000","last_undegraded":"2024-09-13T18:31:01.102786+0000","last_fullsized":"2024-09-13T18:31:01.102786+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:47.257248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137976+0000","last_change":"2024-09-13T18:31:00.125683+0000","last_active":"2024-09-13T18:31:01.137976+0000","last_peered":"2024-09-13T18:31:01.137976+0000","last_clean":"2024-09-13T18:31:01.137976+0000","last_became_active":"2024-09-13T18:31:00.124917+0000","last_became_peered":"2024-09-13T18:31:00.124917+0000","last_unstale":"2024-09-13T18:31:01.137976+0000","last_undegraded":"2024-09-13T18:31:01.137976+0000","last_fullsized":"2024-09-13T18:31:01.137976+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:43.762603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136781+0000","last_change":"2024-09-13T18:30:59.720119+0000","last_active":"2024-09-13T18:31:01.136781+0000","last_peered":"2024-09-13T18:31:01.136781+0000","last_clean":"2024-09-13T18:31:01.136781+0000","last_became_active":"2024-09-13T18:30:59.712303+0000","last_became_peered":"2024-09-13T18:30:59.712303+0000","last_unstale":"2024-09-13T18:31:01.136781+0000","last_undegraded":"2024-09-13T18:31:01.136781+0000","last_fullsized":"2024-09-13T18:31:01.136781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:15.630418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139824+0000","last_change":"2024-09-13T18:31:00.122470+0000","last_active":"2024-09-13T18:31:01.139824+0000","last_peered":"2024-09-13T18:31:01.139824+0000","last_clean":"2024-09-13T18:31:01.139824+0000","last_became_active":"2024-09-13T18:31:00.121757+0000","last_became_peered":"2024-09-13T18:31:00.121757+0000","last_unstale":"2024-09-13T18:31:01.139824+0000","last_undegraded":"2024-09-13T18:31:01.139824+0000","last_fullsized":"2024-09-13T18:31:01.139824+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:47.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140840+0000","last_change":"2024-09-13T18:30:59.717009+0000","last_active":"2024-09-13T18:31:01.140840+0000","last_peered":"2024-09-13T18:31:01.140840+0000","last_clean":"2024-09-13T18:31:01.140840+0000","last_became_active":"2024-09-13T18:30:59.716473+0000","last_became_peered":"2024-09-13T18:30:59.716473+0000","last_unstale":"2024-09-13T18:31:01.140840+0000","last_undegraded":"2024-09-13T18:31:01.140840+0000","last_fullsized":"2024-09-13T18:31:01.140840+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:29.313840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141146+0000","last_change":"2024-09-13T18:31:00.118279+0000","last_active":"2024-09-13T18:31:01.141146+0000","last_peered":"2024-09-13T18:31:01.141146+0000","last_clean":"2024-09-13T18:31:01.141146+0000","last_became_active":"2024-09-13T18:31:00.117600+0000","last_became_peered":"2024-09-13T18:31:00.117600+0000","last_unstale":"2024-09-13T18:31:01.141146+0000","last_undegraded":"2024-09-13T18:31:01.141146+0000","last_fullsized":"2024-09-13T18:31:01.141146+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:43.762603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099701+0000","last_change":"2024-09-13T18:30:59.727272+0000","last_active":"2024-09-13T18:31:01.099701+0000","last_peered":"2024-09-13T18:31:01.099701+0000","last_clean":"2024-09-13T18:31:01.099701+0000","last_became_active":"2024-09-13T18:30:59.726989+0000","last_became_peered":"2024-09-13T18:30:59.726989+0000","last_unstale":"2024-09-13T18:31:01.099701+0000","last_undegraded":"2024-09-13T18:31:01.099701+0000","last_fullsized":"2024-09-13T18:31:01.099701+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:55.065970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.100009+0000","last_change":"2024-09-13T18:31:00.118258+0000","last_active":"2024-09-13T18:31:01.100009+0000","last_peered":"2024-09-13T18:31:01.100009+0000","last_clean":"2024-09-13T18:31:01.100009+0000","last_became_active":"2024-09-13T18:31:00.114762+0000","last_became_peered":"2024-09-13T18:31:00.114762+0000","last_unstale":"2024-09-13T18:31:01.100009+0000","last_undegraded":"2024-09-13T18:31:01.100009+0000","last_fullsized":"2024-09-13T18:31:01.100009+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:59.736807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"105'3","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137764+0000","last_change":"2024-09-13T18:30:59.712265+0000","last_active":"2024-09-13T18:31:01.137764+0000","last_peered":"2024-09-13T18:31:01.137764+0000","last_clean":"2024-09-13T18:31:01.137764+0000","last_became_active":"2024-09-13T18:30:59.711849+0000","last_became_peered":"2024-09-13T18:30:59.711849+0000","last_unstale":"2024-09-13T18:31:01.137764+0000","last_undegraded":"2024-09-13T18:31:01.137764+0000","last_fullsized":"2024-09-13T18:31:01.137764+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:44.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139315+0000","last_change":"2024-09-13T18:31:00.145325+0000","last_active":"2024-09-13T18:31:01.139315+0000","last_peered":"2024-09-13T18:31:01.139315+0000","last_clean":"2024-09-13T18:31:01.139315+0000","last_became_active":"2024-09-13T18:31:00.144793+0000","last_became_peered":"2024-09-13T18:31:00.144793+0000","last_unstale":"2024-09-13T18:31:01.139315+0000","last_undegraded":"2024-09-13T18:31:01.139315+0000","last_fullsized":"2024-09-13T18:31:01.139315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:44.914165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"105'6","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138263+0000","last_change":"2024-09-13T18:30:59.716640+0000","last_active":"2024-09-13T18:31:01.138263+0000","last_peered":"2024-09-13T18:31:01.138263+0000","last_clean":"2024-09-13T18:31:01.138263+0000","last_became_active":"2024-09-13T18:30:59.716304+0000","last_became_peered":"2024-09-13T18:30:59.716304+0000","last_unstale":"2024-09-13T18:31:01.138263+0000","last_undegraded":"2024-09-13T18:31:01.138263+0000","last_fullsized":"2024-09-13T18:31:01.138263+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:15.557084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099875+0000","last_change":"2024-09-13T18:31:00.111542+0000","last_active":"2024-09-13T18:31:01.099875+0000","last_peered":"2024-09-13T18:31:01.099875+0000","last_clean":"2024-09-13T18:31:01.099875+0000","last_became_active":"2024-09-13T18:31:00.111283+0000","last_became_peered":"2024-09-13T18:31:00.111283+0000","last_unstale":"2024-09-13T18:31:01.099875+0000","last_undegraded":"2024-09-13T18:31:01.099875+0000","last_fullsized":"2024-09-13T18:31:01.099875+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:28.750230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137741+0000","last_change":"2024-09-13T18:30:59.718477+0000","last_active":"2024-09-13T18:31:01.137741+0000","last_peered":"2024-09-13T18:31:01.137741+0000","last_clean":"2024-09-13T18:31:01.137741+0000","last_became_active":"2024-09-13T18:30:59.718088+0000","last_became_peered":"2024-09-13T18:30:59.718088+0000","last_unstale":"2024-09-13T18:31:01.137741+0000","last_undegraded":"2024-09-13T18:31:01.137741+0000","last_fullsized":"2024-09-13T18:31:01.137741+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:44.942585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.100210+0000","last_change":"2024-09-13T18:31:00.140856+0000","last_active":"2024-09-13T18:31:01.100210+0000","last_peered":"2024-09-13T18:31:01.100210+0000","last_clean":"2024-09-13T18:31:01.100210+0000","last_became_active":"2024-09-13T18:31:00.140638+0000","last_became_peered":"2024-09-13T18:31:00.140638+0000","last_unstale":"2024-09-13T18:31:01.100210+0000","last_undegraded":"2024-09-13T18:31:01.100210+0000","last_fullsized":"2024-09-13T18:31:01.100210+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:51:47.385179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140400+0000","last_change":"2024-09-13T18:30:59.728800+0000","last_active":"2024-09-13T18:31:01.140400+0000","last_peered":"2024-09-13T18:31:01.140400+0000","last_clean":"2024-09-13T18:31:01.140400+0000","last_became_active":"2024-09-13T18:30:59.728162+0000","last_became_peered":"2024-09-13T18:30:59.728162+0000","last_unstale":"2024-09-13T18:31:01.140400+0000","last_undegraded":"2024-09-13T18:31:01.140400+0000","last_fullsized":"2024-09-13T18:31:01.140400+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:59.930969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099682+0000","last_change":"2024-09-13T18:31:00.111159+0000","last_active":"2024-09-13T18:31:01.099682+0000","last_peered":"2024-09-13T18:31:01.099682+0000","last_clean":"2024-09-13T18:31:01.099682+0000","last_became_active":"2024-09-13T18:31:00.110914+0000","last_became_peered":"2024-09-13T18:31:00.110914+0000","last_unstale":"2024-09-13T18:31:01.099682+0000","last_undegraded":"2024-09-13T18:31:01.099682+0000","last_fullsized":"2024-09-13T18:31:01.099682+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:16.640557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"105'8","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140492+0000","last_change":"2024-09-13T18:30:59.713502+0000","last_active":"2024-09-13T18:31:01.140492+0000","last_peered":"2024-09-13T18:31:01.140492+0000","last_clean":"2024-09-13T18:31:01.140492+0000","last_became_active":"2024-09-13T18:30:59.713166+0000","last_became_peered":"2024-09-13T18:30:59.713166+0000","last_unstale":"2024-09-13T18:31:01.140492+0000","last_undegraded":"2024-09-13T18:31:01.140492+0000","last_fullsized":"2024-09-13T18:31:01.140492+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:44.434564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141022+0000","last_change":"2024-09-13T18:31:00.104829+0000","last_active":"2024-09-13T18:31:01.141022+0000","last_peered":"2024-09-13T18:31:01.141022+0000","last_clean":"2024-09-13T18:31:01.141022+0000","last_became_active":"2024-09-13T18:31:00.104561+0000","last_became_peered":"2024-09-13T18:31:00.104561+0000","last_unstale":"2024-09-13T18:31:01.141022+0000","last_undegraded":"2024-09-13T18:31:01.141022+0000","last_fullsized":"2024-09-13T18:31:01.141022+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:46.819882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139603+0000","last_change":"2024-09-13T18:30:59.724932+0000","last_active":"2024-09-13T18:31:01.139603+0000","last_peered":"2024-09-13T18:31:01.139603+0000","last_clean":"2024-09-13T18:31:01.139603+0000","last_became_active":"2024-09-13T18:30:59.724630+0000","last_became_peered":"2024-09-13T18:30:59.724630+0000","last_unstale":"2024-09-13T18:31:01.139603+0000","last_undegraded":"2024-09-13T18:31:01.139603+0000","last_fullsized":"2024-09-13T18:31:01.139603+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:27.102660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139949+0000","last_change":"2024-09-13T18:31:00.110058+0000","last_active":"2024-09-13T18:31:01.139949+0000","last_peered":"2024-09-13T18:31:01.139949+0000","last_clean":"2024-09-13T18:31:01.139949+0000","last_became_active":"2024-09-13T18:31:00.109771+0000","last_became_peered":"2024-09-13T18:31:00.109771+0000","last_unstale":"2024-09-13T18:31:01.139949+0000","last_undegraded":"2024-09-13T18:31:01.139949+0000","last_fullsized":"2024-09-13T18:31:01.139949+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:49.367533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141111+0000","last_change":"2024-09-13T18:30:59.709979+0000","last_active":"2024-09-13T18:31:01.141111+0000","last_peered":"2024-09-13T18:31:01.141111+0000","last_clean":"2024-09-13T18:31:01.141111+0000","last_became_active":"2024-09-13T18:30:59.709537+0000","last_became_peered":"2024-09-13T18:30:59.709537+0000","last_unstale":"2024-09-13T18:31:01.141111+0000","last_undegraded":"2024-09-13T18:31:01.141111+0000","last_fullsized":"2024-09-13T18:31:01.141111+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:30.556706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139044+0000","last_change":"2024-09-13T18:31:00.141421+0000","last_active":"2024-09-13T18:31:01.139044+0000","last_peered":"2024-09-13T18:31:01.139044+0000","last_clean":"2024-09-13T18:31:01.139044+0000","last_became_active":"2024-09-13T18:31:00.141134+0000","last_became_peered":"2024-09-13T18:31:00.141134+0000","last_unstale":"2024-09-13T18:31:01.139044+0000","last_undegraded":"2024-09-13T18:31:01.139044+0000","last_fullsized":"2024-09-13T18:31:01.139044+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:45.808535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"105'1","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140676+0000","last_change":"2024-09-13T18:30:59.730855+0000","last_active":"2024-09-13T18:31:01.140676+0000","last_peered":"2024-09-13T18:31:01.140676+0000","last_clean":"2024-09-13T18:31:01.140676+0000","last_became_active":"2024-09-13T18:30:59.727171+0000","last_became_peered":"2024-09-13T18:30:59.727171+0000","last_unstale":"2024-09-13T18:31:01.140676+0000","last_undegraded":"2024-09-13T18:31:01.140676+0000","last_fullsized":"2024-09-13T18:31:01.140676+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:01.935400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140151+0000","last_change":"2024-09-13T18:31:00.144541+0000","last_active":"2024-09-13T18:31:01.140151+0000","last_peered":"2024-09-13T18:31:01.140151+0000","last_clean":"2024-09-13T18:31:01.140151+0000","last_became_active":"2024-09-13T18:31:00.143949+0000","last_became_peered":"2024-09-13T18:31:00.143949+0000","last_unstale":"2024-09-13T18:31:01.140151+0000","last_undegraded":"2024-09-13T18:31:01.140151+0000","last_fullsized":"2024-09-13T18:31:01.140151+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:01.561354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138529+0000","last_change":"2024-09-13T18:30:59.726038+0000","last_active":"2024-09-13T18:31:01.138529+0000","last_peered":"2024-09-13T18:31:01.138529+0000","last_clean":"2024-09-13T18:31:01.138529+0000","last_became_active":"2024-09-13T18:30:59.725334+0000","last_became_peered":"2024-09-13T18:30:59.725334+0000","last_unstale":"2024-09-13T18:31:01.138529+0000","last_undegraded":"2024-09-13T18:31:01.138529+0000","last_fullsized":"2024-09-13T18:31:01.138529+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:46.316749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138418+0000","last_change":"2024-09-13T18:31:00.140249+0000","last_active":"2024-09-13T18:31:01.138418+0000","last_peered":"2024-09-13T18:31:01.138418+0000","last_clean":"2024-09-13T18:31:01.138418+0000","last_became_active":"2024-09-13T18:31:00.139827+0000","last_became_peered":"2024-09-13T18:31:00.139827+0000","last_unstale":"2024-09-13T18:31:01.138418+0000","last_undegraded":"2024-09-13T18:31:01.138418+0000","last_fullsized":"2024-09-13T18:31:01.138418+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:16.640557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137808+0000","last_change":"2024-09-13T18:30:59.717265+0000","last_active":"2024-09-13T18:31:01.137808+0000","last_peered":"2024-09-13T18:31:01.137808+0000","last_clean":"2024-09-13T18:31:01.137808+0000","last_became_active":"2024-09-13T18:30:59.715468+0000","last_became_peered":"2024-09-13T18:30:59.715468+0000","last_unstale":"2024-09-13T18:31:01.137808+0000","last_undegraded":"2024-09-13T18:31:01.137808+0000","last_fullsized":"2024-09-13T18:31:01.137808+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:34.997483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137245+0000","last_change":"2024-09-13T18:31:00.116886+0000","last_active":"2024-09-13T18:31:01.137245+0000","last_peered":"2024-09-13T18:31:01.137245+0000","last_clean":"2024-09-13T18:31:01.137245+0000","last_became_active":"2024-09-13T18:31:00.116659+0000","last_became_peered":"2024-09-13T18:31:00.116659+0000","last_unstale":"2024-09-13T18:31:01.137245+0000","last_undegraded":"2024-09-13T18:31:01.137245+0000","last_fullsized":"2024-09-13T18:31:01.137245+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.529016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140358+0000","last_change":"2024-09-13T18:30:59.719226+0000","last_active":"2024-09-13T18:31:01.140358+0000","last_peered":"2024-09-13T18:31:01.140358+0000","last_clean":"2024-09-13T18:31:01.140358+0000","last_became_active":"2024-09-13T18:30:59.718956+0000","last_became_peered":"2024-09-13T18:30:59.718956+0000","last_unstale":"2024-09-13T18:31:01.140358+0000","last_undegraded":"2024-09-13T18:31:01.140358+0000","last_fullsized":"2024-09-13T18:31:01.140358+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:05.160864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138899+0000","last_change":"2024-09-13T18:31:00.138266+0000","last_active":"2024-09-13T18:31:01.138899+0000","last_peered":"2024-09-13T18:31:01.138899+0000","last_clean":"2024-09-13T18:31:01.138899+0000","last_became_active":"2024-09-13T18:31:00.137534+0000","last_became_peered":"2024-09-13T18:31:00.137534+0000","last_unstale":"2024-09-13T18:31:01.138899+0000","last_undegraded":"2024-09-13T18:31:01.138899+0000","last_fullsized":"2024-09-13T18:31:01.138899+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:25.310734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138939+0000","last_change":"2024-09-13T18:30:59.715811+0000","last_active":"2024-09-13T18:31:01.138939+0000","last_peered":"2024-09-13T18:31:01.138939+0000","last_clean":"2024-09-13T18:31:01.138939+0000","last_became_active":"2024-09-13T18:30:59.715513+0000","last_became_peered":"2024-09-13T18:30:59.715513+0000","last_unstale":"2024-09-13T18:31:01.138939+0000","last_undegraded":"2024-09-13T18:31:01.138939+0000","last_fullsized":"2024-09-13T18:31:01.138939+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:32.139598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099784+0000","last_change":"2024-09-13T18:31:00.118612+0000","last_active":"2024-09-13T18:31:01.099784+0000","last_peered":"2024-09-13T18:31:01.099784+0000","last_clean":"2024-09-13T18:31:01.099784+0000","last_became_active":"2024-09-13T18:31:00.118318+0000","last_became_peered":"2024-09-13T18:31:00.118318+0000","last_unstale":"2024-09-13T18:31:01.099784+0000","last_undegraded":"2024-09-13T18:31:01.099784+0000","last_fullsized":"2024-09-13T18:31:01.099784+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:30.004060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136955+0000","last_change":"2024-09-13T18:30:59.726632+0000","last_active":"2024-09-13T18:31:01.136955+0000","last_peered":"2024-09-13T18:31:01.136955+0000","last_clean":"2024-09-13T18:31:01.136955+0000","last_became_active":"2024-09-13T18:30:59.726083+0000","last_became_peered":"2024-09-13T18:30:59.726083+0000","last_unstale":"2024-09-13T18:31:01.136955+0000","last_undegraded":"2024-09-13T18:31:01.136955+0000","last_fullsized":"2024-09-13T18:31:01.136955+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:58.726669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140886+0000","last_change":"2024-09-13T18:31:00.127050+0000","last_active":"2024-09-13T18:31:01.140886+0000","last_peered":"2024-09-13T18:31:01.140886+0000","last_clean":"2024-09-13T18:31:01.140886+0000","last_became_active":"2024-09-13T18:31:00.126511+0000","last_became_peered":"2024-09-13T18:31:00.126511+0000","last_unstale":"2024-09-13T18:31:01.140886+0000","last_undegraded":"2024-09-13T18:31:01.140886+0000","last_fullsized":"2024-09-13T18:31:01.140886+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:56.076108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"105'2","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099910+0000","last_change":"2024-09-13T18:30:59.727290+0000","last_active":"2024-09-13T18:31:01.099910+0000","last_peered":"2024-09-13T18:31:01.099910+0000","last_clean":"2024-09-13T18:31:01.099910+0000","last_became_active":"2024-09-13T18:30:59.726318+0000","last_became_peered":"2024-09-13T18:30:59.726318+0000","last_unstale":"2024-09-13T18:31:01.099910+0000","last_undegraded":"2024-09-13T18:31:01.099910+0000","last_fullsized":"2024-09-13T18:31:01.099910+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:27.193334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.139435+0000","last_change":"2024-09-13T18:31:00.105195+0000","last_active":"2024-09-13T18:31:01.139435+0000","last_peered":"2024-09-13T18:31:01.139435+0000","last_clean":"2024-09-13T18:31:01.139435+0000","last_became_active":"2024-09-13T18:31:00.104953+0000","last_became_peered":"2024-09-13T18:31:00.104953+0000","last_unstale":"2024-09-13T18:31:01.139435+0000","last_undegraded":"2024-09-13T18:31:01.139435+0000","last_fullsized":"2024-09-13T18:31:01.139435+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:37.094733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.141004+0000","last_change":"2024-09-13T18:30:59.730227+0000","last_active":"2024-09-13T18:31:01.141004+0000","last_peered":"2024-09-13T18:31:01.141004+0000","last_clean":"2024-09-13T18:31:01.141004+0000","last_became_active":"2024-09-13T18:30:59.729571+0000","last_became_peered":"2024-09-13T18:30:59.729571+0000","last_unstale":"2024-09-13T18:31:01.141004+0000","last_undegraded":"2024-09-13T18:31:01.141004+0000","last_fullsized":"2024-09-13T18:31:01.141004+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:28.487233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138076+0000","last_change":"2024-09-13T18:31:00.116029+0000","last_active":"2024-09-13T18:31:01.138076+0000","last_peered":"2024-09-13T18:31:01.138076+0000","last_clean":"2024-09-13T18:31:01.138076+0000","last_became_active":"2024-09-13T18:31:00.115880+0000","last_became_peered":"2024-09-13T18:31:00.115880+0000","last_unstale":"2024-09-13T18:31:01.138076+0000","last_undegraded":"2024-09-13T18:31:01.138076+0000","last_fullsized":"2024-09-13T18:31:01.138076+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:19.545531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137998+0000","last_change":"2024-09-13T18:30:59.724734+0000","last_active":"2024-09-13T18:31:01.137998+0000","last_peered":"2024-09-13T18:31:01.137998+0000","last_clean":"2024-09-13T18:31:01.137998+0000","last_became_active":"2024-09-13T18:30:59.723977+0000","last_became_peered":"2024-09-13T18:30:59.723977+0000","last_unstale":"2024-09-13T18:31:01.137998+0000","last_undegraded":"2024-09-13T18:31:01.137998+0000","last_fullsized":"2024-09-13T18:31:01.137998+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:47.407403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140509+0000","last_change":"2024-09-13T18:31:00.135214+0000","last_active":"2024-09-13T18:31:01.140509+0000","last_peered":"2024-09-13T18:31:01.140509+0000","last_clean":"2024-09-13T18:31:01.140509+0000","last_became_active":"2024-09-13T18:31:00.134521+0000","last_became_peered":"2024-09-13T18:31:00.134521+0000","last_unstale":"2024-09-13T18:31:01.140509+0000","last_undegraded":"2024-09-13T18:31:01.140509+0000","last_fullsized":"2024-09-13T18:31:01.140509+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:28.203472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.100209+0000","last_change":"2024-09-13T18:30:59.719711+0000","last_active":"2024-09-13T18:31:01.100209+0000","last_peered":"2024-09-13T18:31:01.100209+0000","last_clean":"2024-09-13T18:31:01.100209+0000","last_became_active":"2024-09-13T18:30:59.719029+0000","last_became_peered":"2024-09-13T18:30:59.719029+0000","last_unstale":"2024-09-13T18:31:01.100209+0000","last_undegraded":"2024-09-13T18:31:01.100209+0000","last_fullsized":"2024-09-13T18:31:01.100209+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:42.752464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102167+0000","last_change":"2024-09-13T18:31:00.125453+0000","last_active":"2024-09-13T18:31:01.102167+0000","last_peered":"2024-09-13T18:31:01.102167+0000","last_clean":"2024-09-13T18:31:01.102167+0000","last_became_active":"2024-09-13T18:31:00.122510+0000","last_became_peered":"2024-09-13T18:31:00.122510+0000","last_unstale":"2024-09-13T18:31:01.102167+0000","last_undegraded":"2024-09-13T18:31:01.102167+0000","last_fullsized":"2024-09-13T18:31:01.102167+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:59.736807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138848+0000","last_change":"2024-09-13T18:30:59.712868+0000","last_active":"2024-09-13T18:31:01.138848+0000","last_peered":"2024-09-13T18:31:01.138848+0000","last_clean":"2024-09-13T18:31:01.138848+0000","last_became_active":"2024-09-13T18:30:59.712095+0000","last_became_peered":"2024-09-13T18:30:59.712095+0000","last_unstale":"2024-09-13T18:31:01.138848+0000","last_undegraded":"2024-09-13T18:31:01.138848+0000","last_fullsized":"2024-09-13T18:31:01.138848+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:10.851364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102617+0000","last_change":"2024-09-13T18:31:00.110335+0000","last_active":"2024-09-13T18:31:01.102617+0000","last_peered":"2024-09-13T18:31:01.102617+0000","last_clean":"2024-09-13T18:31:01.102617+0000","last_became_active":"2024-09-13T18:31:00.108076+0000","last_became_peered":"2024-09-13T18:31:00.108076+0000","last_unstale":"2024-09-13T18:31:01.102617+0000","last_undegraded":"2024-09-13T18:31:01.102617+0000","last_fullsized":"2024-09-13T18:31:01.102617+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:59.598316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.102312+0000","last_change":"2024-09-13T18:30:59.716165+0000","last_active":"2024-09-13T18:31:01.102312+0000","last_peered":"2024-09-13T18:31:01.102312+0000","last_clean":"2024-09-13T18:31:01.102312+0000","last_became_active":"2024-09-13T18:30:59.715395+0000","last_became_peered":"2024-09-13T18:30:59.715395+0000","last_unstale":"2024-09-13T18:31:01.102312+0000","last_undegraded":"2024-09-13T18:31:01.102312+0000","last_fullsized":"2024-09-13T18:31:01.102312+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:00.719013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138965+0000","last_change":"2024-09-13T18:31:00.145681+0000","last_active":"2024-09-13T18:31:01.138965+0000","last_peered":"2024-09-13T18:31:01.138965+0000","last_clean":"2024-09-13T18:31:01.138965+0000","last_became_active":"2024-09-13T18:31:00.145120+0000","last_became_peered":"2024-09-13T18:31:00.145120+0000","last_unstale":"2024-09-13T18:31:01.138965+0000","last_undegraded":"2024-09-13T18:31:01.138965+0000","last_fullsized":"2024-09-13T18:31:01.138965+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:28.750230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.140397+0000","last_change":"2024-09-13T18:30:59.719506+0000","last_active":"2024-09-13T18:31:01.140397+0000","last_peered":"2024-09-13T18:31:01.140397+0000","last_clean":"2024-09-13T18:31:01.140397+0000","last_became_active":"2024-09-13T18:30:59.719200+0000","last_became_peered":"2024-09-13T18:30:59.719200+0000","last_unstale":"2024-09-13T18:31:01.140397+0000","last_undegraded":"2024-09-13T18:31:01.140397+0000","last_fullsized":"2024-09-13T18:31:01.140397+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:13.344721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.137236+0000","last_change":"2024-09-13T18:31:00.114905+0000","last_active":"2024-09-13T18:31:01.137236+0000","last_peered":"2024-09-13T18:31:01.137236+0000","last_clean":"2024-09-13T18:31:01.137236+0000","last_became_active":"2024-09-13T18:31:00.113528+0000","last_became_peered":"2024-09-13T18:31:00.113528+0000","last_unstale":"2024-09-13T18:31:01.137236+0000","last_undegraded":"2024-09-13T18:31:01.137236+0000","last_fullsized":"2024-09-13T18:31:01.137236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:28.667585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.136902+0000","last_change":"2024-09-13T18:30:59.725952+0000","last_active":"2024-09-13T18:31:01.136902+0000","last_peered":"2024-09-13T18:31:01.136902+0000","last_clean":"2024-09-13T18:31:01.136902+0000","last_became_active":"2024-09-13T18:30:59.725251+0000","last_became_peered":"2024-09-13T18:30:59.725251+0000","last_unstale":"2024-09-13T18:31:01.136902+0000","last_undegraded":"2024-09-13T18:31:01.136902+0000","last_fullsized":"2024-09-13T18:31:01.136902+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:58.588177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.099544+0000","last_change":"2024-09-13T18:31:00.121714+0000","last_active":"2024-09-13T18:31:01.099544+0000","last_peered":"2024-09-13T18:31:01.099544+0000","last_clean":"2024-09-13T18:31:01.099544+0000","last_became_active":"2024-09-13T18:31:00.121455+0000","last_became_peered":"2024-09-13T18:31:00.121455+0000","last_unstale":"2024-09-13T18:31:01.099544+0000","last_undegraded":"2024-09-13T18:31:01.099544+0000","last_fullsized":"2024-09-13T18:31:01.099544+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:59.678495+0000","last_clean_scrub_stamp":"2024-09-13T18:30:59.678495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:00.185184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:31:01.138215+0000","last_change":"2024-09-13T18:30:59.725825+0000","last_active":"2024-09-13T18:31:01.138215+0000","last_peered":"2024-09-13T18:31:01.138215+0000","last_clean":"2024-09-13T18:31:01.138215+0000","last_became_active":"2024-09-13T18:30:59.725266+0000","last_became_peered":"2024-09-13T18:30:59.725266+0000","last_unstale":"2024-09-13T18:31:01.138215+0000","last_undegraded":"2024-09-13T18:31:01.138215+0000","last_fullsized":"2024-09-13T18:31:01.138215+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:30:58.668357+0000","last_clean_scrub_stamp":"2024-09-13T18:30:58.668357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:42.212984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":273,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-13T18:31:00.119620+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:31:00.119620+0000","last_peered":"2024-09-13T18:31:00.119620+0000","last_clean":"2024-09-13T18:31:00.119620+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:31:00.119620+0000","last_undegraded":"2024-09-13T18:31:00.119620+0000","last_fullsized":"2024-09-13T18:31:00.119620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1921024,"data_stored":1170807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.292,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96299999999999997,"15min":0.89500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.333,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.93100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.173,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95699999999999996,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.274,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.0389999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83699999999999997,"15min":0.80200000000000005},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.997,"5min":1.276,"15min":1.276},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.88200000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.2190000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88300000000000001,"15min":0.88100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":1.349,"15min":1.448},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.91600000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2230000000000001,"5min":1.397,"15min":1.397},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.879,"15min":0.88500000000000001},"min":{"1min":0.61699999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2569999999999999,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.93799999999999994},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.266},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98799999999999999,"15min":1.032},"min":{"1min":0.60799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.5609999999999999,"15min":1.877},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0089999999999999,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.69399999999999995,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.044,"15min":1},"min":{"1min":0.69199999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1779999999999999,"5min":1.506,"15min":1.506},"last":1.018}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1323008,"data_stored":579893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.81599999999999995,"15min":0.83199999999999996},"min":{"1min":0.51800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.169,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.78700000000000003},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.56100000000000005,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.24,"5min":1.577,"15min":1.577},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.95999999999999996,"15min":0.90100000000000002},"min":{"1min":0.68899999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.218,"5min":1.464,"15min":1.464},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.64500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1080000000000001,"5min":1.268,"15min":1.268},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.92800000000000005,"15min":0.97099999999999997},"min":{"1min":0.59599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4220000000000002,"15min":2.4220000000000002},"last":1.0549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88600000000000001,"15min":0.876},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.131,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.875,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.68300000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1040000000000001,"5min":1.306,"15min":1.306},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94799999999999995,"15min":0.97599999999999998},"min":{"1min":0.67000000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.157,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.02,"15min":0.998},"min":{"1min":0.69599999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":1.526},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.57699999999999996,"5min":0.439,"15min":0.439},"max":{"1min":1.1950000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.036,"15min":1.0960000000000001},"min":{"1min":0.60499999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.228,"5min":2.762,"15min":2.762},"last":1.002}]},{"osd":7,"last update":"Fri Sep 13 18:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.002,"15min":1.0349999999999999},"min":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.216,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.877},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.01,"15min":1.038},"min":{"1min":0.63100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":1.72,"15min":1.72},"last":0.94799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1327104,"data_stored":580427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":0.84999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2390000000000001,"5min":1.5469999999999999,"15min":2.0209999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.86699999999999999,"15min":0.90300000000000002},"min":{"1min":0.59999999999999998,"5min":0.45300000000000001,"15min":0.437},"max":{"1min":1.105,"5min":1.2010000000000001,"15min":2.1840000000000002},"last":0.89600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.88400000000000001,"15min":0.83599999999999997},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.1559999999999999,"5min":1.22,"15min":1.4419999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85099999999999998,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.109,"5min":1.157,"15min":1.5029999999999999},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90000000000000002,"15min":0.88100000000000001},"min":{"1min":0.51700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1599999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91500000000000004,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3839999999999999,"5min":1.4730000000000001,"15min":2.2589999999999999},"last":1.0840000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2350000000000001,"5min":1.3740000000000001,"15min":2.0840000000000001},"last":1.3},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.97099999999999997},"min":{"1min":0.61099999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.339,"5min":1.6719999999999999,"15min":1.871},"last":1.111}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.163,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":1.042},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3180000000000001,"5min":1.4059999999999999,"15min":1.5049999999999999},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.96999999999999997,"15min":1.0249999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4239999999999999,"5min":1.5229999999999999,"15min":1.5680000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93899999999999995,"15min":1.018},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.6779999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.0029999999999999,"15min":1.105},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3779999999999999,"5min":1.4039999999999999,"15min":2.246},"last":1.232},{"interface":"front","average":{"1min":0.995,"5min":1.042,"15min":1.1279999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2969999999999999,"5min":1.5980000000000001,"15min":1.9379999999999999},"last":1.1830000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1318912,"data_stored":579823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.91200000000000003,"15min":0.82999999999999996},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.877},{"interface":"front","average":{"1min":1.034,"5min":0.91200000000000003,"15min":0.88600000000000001},"min":{"1min":0.52900000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.143,"5min":1.536,"15min":1.536},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.026,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.502,"5min":0.499,"15min":0.499},"max":{"1min":4.4509999999999996,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.0169999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88800000000000001,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1910000000000001,"5min":1.216,"15min":1.216},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.89900000000000002,"15min":0.89300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3149999999999999,"5min":1.323,"15min":1.323},"last":1.091}]},{"osd":3,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1679999999999999,"5min":1.476,"15min":1.476},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.01,"15min":0.95799999999999996},"min":{"1min":0.63100000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":10.44,"5min":10.44,"15min":10.44},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.3280000000000003,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.94899999999999995,"15min":0.96499999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.841,"5min":1.0980000000000001,"15min":1.0349999999999999},"min":{"1min":0.70799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":19.254000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1950000000000001,"15min":1.085},"min":{"1min":0.88400000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":19.434000000000001,"5min":19.434000000000001,"15min":19.434000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.181,"15min":1.0900000000000001},"min":{"1min":0.623,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":15.593,"5min":15.593,"15min":15.593},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.034,"15min":1.073},"min":{"1min":0.877,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.323,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36524,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335316,"statfs":{"total":96636764160,"available":96599363584,"internally_reserved":0,"allocated":1335296,"data_stored":581457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":0.63100000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.127,"5min":2.113,"15min":2.113},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80700000000000005,"15min":0.72499999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1819999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.94799999999999995,"5min":1.4199999999999999,"15min":1.704},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.623},"min":{"1min":0.32900000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98599999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.375,"5min":1.742,"15min":1.742},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.81299999999999994,"15min":0.747},"min":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.222,"5min":1.224,"15min":1.399},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94899999999999995,"15min":0.95499999999999996},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4470000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1,"15min":1.0980000000000001},"min":{"1min":0.71999999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.498,"5min":1.498,"15min":2.8740000000000001},"last":1.536}]},{"osd":5,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0209999999999999,"15min":1.022},"min":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2949999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.27},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.95899999999999996,"15min":0.94199999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.236,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.0149999999999999,"15min":1.0609999999999999},"min":{"1min":0.64100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.302,"5min":2.6190000000000002,"15min":2.6190000000000002},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0640000000000001,"15min":1.054},"min":{"1min":0.64800000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.345,"5min":1.6890000000000001,"15min":1.96},"last":1.502}]},{"osd":7,"last update":"Fri Sep 13 18:30:52 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0509999999999999,"15min":1.095},"min":{"1min":0.67200000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.6060000000000001,"5min":1.665,"15min":3},"last":1.171},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.044,"15min":1.006},"min":{"1min":0.629,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.3500000000000001,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.1040000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1318912,"data_stored":579823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.92500000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.34100000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.335},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.65500000000000003},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.97699999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.44700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2190000000000001,"5min":1.288,"15min":1.423},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.161,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.141}]},{"osd":4,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91900000000000004,"15min":0.90800000000000003},"min":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.367,"5min":1.367,"15min":1.611},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.623,"5min":0.498,"15min":0.498},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.999},"min":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4950000000000001,"5min":1.5109999999999999,"15min":1.9179999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.702},"last":1.1930000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.62,"5min":0.5,"15min":0.5},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0249999999999999,"15min":1.0469999999999999},"min":{"1min":0.72199999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0620000000000001,"15min":1.079},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4850000000000001,"5min":1.6499999999999999,"15min":1.8089999999999999},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1327104,"data_stored":579947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.58399999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.876,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67300000000000004,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":1.042,"5min":1.177,"15min":1.177},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.32600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.754,"15min":0.70499999999999996},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1719999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.145,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77900000000000003,"15min":0.73499999999999999},"min":{"1min":0.49299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0580000000000001,"5min":1.423,"15min":1.423},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93500000000000005,"15min":0.90900000000000003},"min":{"1min":0.65400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3600000000000001,"5min":1.4359999999999999,"15min":1.4610000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.93400000000000005,"15min":0.92700000000000005},"min":{"1min":0.58199999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1899999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.69599999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1080000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.0149999999999999,"15min":1.0289999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3759999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.022}]},{"osd":6,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.032,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.60999999999999999,"15min":0.60299999999999998},"max":{"1min":1.2689999999999999,"5min":1.5900000000000001,"15min":1.653},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":0.99299999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3859999999999999,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":1.117}]},{"osd":7,"last update":"Fri Sep 13 18:30:53 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.0840000000000001,"15min":1.054},"min":{"1min":0.72699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.403,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.147},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.075,"15min":1.0229999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.345,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.091}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37108,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334732,"statfs":{"total":96636764160,"available":96598765568,"internally_reserved":0,"allocated":1933312,"data_stored":1171867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.147},"last":0.313},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.76200000000000001,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":1.1060000000000001,"5min":1.244,"15min":1.4359999999999999},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70299999999999996,"15min":0.63300000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.085,"5min":1.333,"15min":1.333},"last":0.379},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.35899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.018,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1200000000000001,"5min":1.3169999999999999,"15min":1.5129999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.88200000000000001,"15min":0.93999999999999995},"min":{"1min":0.44400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.248,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.56699999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.4259999999999999,"5min":1.5069999999999999,"15min":1.986},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.99299999999999999,"15min":1.0089999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5669999999999999,"5min":1.8799999999999999,"15min":2.641},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.026,"15min":1.038},"min":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3580000000000001,"5min":1.4259999999999999,"15min":1.6699999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.0569999999999999,"15min":1.071},"min":{"1min":0.59799999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3740000000000001,"5min":1.466,"15min":1.891},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.99099999999999999,"15min":1.0229999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.534,"5min":1.5549999999999999,"15min":2.5590000000000002},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 18:30:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.004,"15min":1.0249999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.617,"5min":1.617,"15min":2.2949999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.60999999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6930000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:31:04.522 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:31:04.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:31:04.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f878742f640 1 Processor -- start 2024-09-13T18:31:04.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f878742f640 1 -- start start 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f878742f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878015c830 0x7f87800d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f878742f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87800d3390 0x7f87800cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f878742f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87800b7db0 con 0x7f87800ccd10 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f878742f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87800d0650 con 0x7f87800d3390 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f878742f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800d0c10 con 0x7f878015c830 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87859cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87800d3390 0x7f87800cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87851cb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878015c830 0x7f87800d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87849ca640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f87800ccd10 0x7f87800d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:56766/0 (socket says 172.21.15.53:56766) 2024-09-13T18:31:04.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87859cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87800d3390 0x7f87800cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:37612/0 (socket says 172.21.15.53:37612) 2024-09-13T18:31:04.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87849ca640 1 -- 172.21.15.53:0/1277075405 learned_addr learned my addr 172.21.15.53:0/1277075405 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:04.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87851cb640 1 -- 172.21.15.53:0/1277075405 >> v2:172.21.15.87:3300/0 conn(0x7f87800d3390 msgr2=0x7f87800cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:04.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87851cb640 1 --2- 172.21.15.53:0/1277075405 >> v2:172.21.15.87:3300/0 conn(0x7f87800d3390 0x7f87800cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87851cb640 1 -- 172.21.15.53:0/1277075405 >> v1:172.21.15.87:6789/0 conn(0x7f87800ccd10 legacy=0x7f87800d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87851cb640 1 -- 172.21.15.53:0/1277075405 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87800cd7d0 con 0x7f878015c830 2024-09-13T18:31:04.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.694+0000 7f87859cc640 1 --2- 172.21.15.53:0/1277075405 >> v2:172.21.15.87:3300/0 conn(0x7f87800d3390 0x7f87800cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:04.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f87851cb640 1 --2- 172.21.15.53:0/1277075405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878015c830 0x7f87800d10a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f877c0097c0 tx=0x7f877c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b43ba14e9fa3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:04.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f8777fff640 1 -- 172.21.15.53:0/1277075405 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0ad640 con 0x7f878015c830 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f8777fff640 1 -- 172.21.15.53:0/1277075405 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c0ad7a0 con 0x7f878015c830 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f8777fff640 1 -- 172.21.15.53:0/1277075405 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c0adb30 con 0x7f878015c830 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 -- 172.21.15.53:0/1277075405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878015c830 msgr2=0x7f87800d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 --2- 172.21.15.53:0/1277075405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878015c830 0x7f87800d10a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f877c0097c0 tx=0x7f877c01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 -- 172.21.15.53:0/1277075405 shutdown_connections 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 --2- 172.21.15.53:0/1277075405 >> v2:172.21.15.87:3300/0 conn(0x7f87800d3390 0x7f87800cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 --2- 172.21.15.53:0/1277075405 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f878015c830 0x7f87800d10a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 -- 172.21.15.53:0/1277075405 >> 172.21.15.53:0/1277075405 conn(0x7f8780070970 msgr2=0x7f8780070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:04.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 -- 172.21.15.53:0/1277075405 shutdown_connections 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.698+0000 7f878742f640 1 -- 172.21.15.53:0/1277075405 wait complete. 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 Processor -- start 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 -- start start 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87800ccd10 0x7f8780155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87800d3390 0x7f87800cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015c830 0x7f8780150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87800cbd60 con 0x7f87800d3390 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8780152af0 con 0x7f878015c830 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878015a390 con 0x7f87800ccd10 2024-09-13T18:31:04.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87800d3390 0x7f87800cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87800d3390 0x7f87800cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44038/0 (socket says 172.21.15.53:44038) 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 -- 172.21.15.53:0/181142271 learned_addr learned my addr 172.21.15.53:0/181142271 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87859cc640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015c830 0x7f8780150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87851cb640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87800ccd10 0x7f8780155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 -- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87800ccd10 msgr2=0x7f8780155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87800ccd10 0x7f8780155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 -- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015c830 msgr2=0x7f8780150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015c830 0x7f8780150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 -- 172.21.15.53:0/181142271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009a70 con 0x7f87800d3390 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f87849ca640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87800d3390 0x7f87800cb160 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f877000c430 tx=0x7f877000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:04.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f8775ffb640 1 -- 172.21.15.53:0/181142271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770005cf0 con 0x7f87800d3390 2024-09-13T18:31:04.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f8775ffb640 1 -- 172.21.15.53:0/181142271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770005e50 con 0x7f87800d3390 2024-09-13T18:31:04.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c009420 con 0x7f87800d3390 2024-09-13T18:31:04.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f8775ffb640 1 -- 172.21.15.53:0/181142271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700072f0 con 0x7f87800d3390 2024-09-13T18:31:04.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8780152250 con 0x7f87800d3390 2024-09-13T18:31:04.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.702+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87800cc950 con 0x7f87800d3390 2024-09-13T18:31:04.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.706+0000 7f8775ffb640 1 -- 172.21.15.53:0/181142271 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f8770007510 con 0x7f87800d3390 2024-09-13T18:31:04.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.706+0000 7f8775ffb640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87640667b0 0x7f8764068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:04.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.706+0000 7f8775ffb640 1 -- 172.21.15.53:0/181142271 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87700838d0 con 0x7f87800d3390 2024-09-13T18:31:04.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.706+0000 7f87851cb640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87640667b0 0x7f8764068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:04.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.706+0000 7f87851cb640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87640667b0 0x7f8764068c70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f877c0af000 tx=0x7f877c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:04.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.710+0000 7f8775ffb640 1 -- 172.21.15.53:0/181142271 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8770050bc0 con 0x7f87800d3390 2024-09-13T18:31:04.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.926+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f87800d1080 con 0x7f87800d3390 2024-09-13T18:31:04.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.934+0000 7f8775ffb640 1 -- 172.21.15.53:0/181142271 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8770017020 con 0x7f87800d3390 2024-09-13T18:31:04.937 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:31:04.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87640667b0 msgr2=0x7f8764068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87640667b0 0x7f8764068c70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f877c0af000 tx=0x7f877c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87800d3390 msgr2=0x7f87800cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87800d3390 0x7f87800cb160 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f877000c430 tx=0x7f877000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 shutdown_connections 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87640667b0 0x7f8764068c70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f878015c830 0x7f8780150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87800d3390 0x7f87800cb160 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 --2- 172.21.15.53:0/181142271 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87800ccd10 0x7f8780155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 >> 172.21.15.53:0/181142271 conn(0x7f8780070970 msgr2=0x7f87800d2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 shutdown_connections 2024-09-13T18:31:04.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:04.938+0000 7f878742f640 1 -- 172.21.15.53:0/181142271 wait complete. 2024-09-13T18:31:04.958 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.082+0000 7f61d3afa640 1 Processor -- start 2024-09-13T18:31:05.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.082+0000 7f61d3afa640 1 -- start start 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d3afa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15a470 0x7f61cc0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d3afa640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f61cc15cc60 0x7f61cc071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d3afa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61cc0b1c10 0x7f61cc0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d3afa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc06f880 con 0x7f61cc0b1c10 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d3afa640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0b2600 con 0x7f61cc15cc60 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d3afa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc06f550 con 0x7f61cc15a470 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61cc0b1c10 0x7f61cc0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61cc0b1c10 0x7f61cc0b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44042/0 (socket says 172.21.15.53:44042) 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 -- 172.21.15.53:0/2440947206 learned_addr learned my addr 172.21.15.53:0/2440947206 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d1095640 1 --2- 172.21.15.53:0/2440947206 >> v2:172.21.15.87:3300/0 conn(0x7f61cc15cc60 0x7f61cc071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d1896640 1 --2- 172.21.15.53:0/2440947206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15a470 0x7f61cc0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 -- 172.21.15.53:0/2440947206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15a470 msgr2=0x7f61cc0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 --2- 172.21.15.53:0/2440947206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15a470 0x7f61cc0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 -- 172.21.15.53:0/2440947206 >> v2:172.21.15.87:3300/0 conn(0x7f61cc15cc60 msgr2=0x7f61cc071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 --2- 172.21.15.53:0/2440947206 >> v2:172.21.15.87:3300/0 conn(0x7f61cc15cc60 0x7f61cc071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.086+0000 7f61d2097640 1 -- 172.21.15.53:0/2440947206 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc15dc40 con 0x7f61cc0b1c10 2024-09-13T18:31:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d2097640 1 --2- 172.21.15.53:0/2440947206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc0b1c10 0x7f61cc0b20c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f61cc071ba0 tx=0x7f61c401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d70a34e464db0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d0894640 1 -- 172.21.15.53:0/2440947206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40a5870 con 0x7f61cc0b1c10 2024-09-13T18:31:05.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d0894640 1 -- 172.21.15.53:0/2440947206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40a59d0 con 0x7f61cc0b1c10 2024-09-13T18:31:05.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d0894640 1 -- 172.21.15.53:0/2440947206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40a5d60 con 0x7f61cc0b1c10 2024-09-13T18:31:05.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- 172.21.15.53:0/2440947206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc0b1c10 msgr2=0x7f61cc0b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 --2- 172.21.15.53:0/2440947206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc0b1c10 0x7f61cc0b20c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f61cc071ba0 tx=0x7f61c401c9f0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- 172.21.15.53:0/2440947206 shutdown_connections 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 --2- 172.21.15.53:0/2440947206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc0b1c10 0x7f61cc0b20c0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 --2- 172.21.15.53:0/2440947206 >> v2:172.21.15.87:3300/0 conn(0x7f61cc15cc60 0x7f61cc071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 --2- 172.21.15.53:0/2440947206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15a470 0x7f61cc0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- 172.21.15.53:0/2440947206 >> 172.21.15.53:0/2440947206 conn(0x7f61cc065c80 msgr2=0x7f61cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- 172.21.15.53:0/2440947206 shutdown_connections 2024-09-13T18:31:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- 172.21.15.53:0/2440947206 wait complete. 2024-09-13T18:31:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 Processor -- start 2024-09-13T18:31:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- start start 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61cc0b1c10 0x7f61cc1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc15a470 0x7f61cc0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15cc60 0x7f61cc152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc154220 con 0x7f61cc15a470 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0c3390 con 0x7f61cc0b1c10 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d3afa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0c35e0 con 0x7f61cc15cc60 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc15a470 0x7f61cc0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc15a470 0x7f61cc0b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44054/0 (socket says 172.21.15.53:44054) 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 -- 172.21.15.53:0/3034329338 learned_addr learned my addr 172.21.15.53:0/3034329338 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1896640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61cc0b1c10 0x7f61cc1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d2097640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15cc60 0x7f61cc152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 -- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15cc60 msgr2=0x7f61cc152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15cc60 0x7f61cc152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 -- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61cc0b1c10 msgr2=0x7f61cc1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61cc0b1c10 0x7f61cc1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 -- 172.21.15.53:0/3034329338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4009b30 con 0x7f61cc15a470 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.090+0000 7f61d1095640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc15a470 0x7f61cc0b0360 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00d5d0 tx=0x7f61bc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61c27fc640 1 -- 172.21.15.53:0/3034329338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc004240 con 0x7f61cc15a470 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61c27fc640 1 -- 172.21.15.53:0/3034329338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc0043a0 con 0x7f61cc15a470 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc0c38c0 con 0x7f61cc15a470 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61c27fc640 1 -- 172.21.15.53:0/3034329338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc003840 con 0x7f61cc15a470 2024-09-13T18:31:05.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc0c3e80 con 0x7f61cc15a470 2024-09-13T18:31:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc067400 con 0x7f61cc15a470 2024-09-13T18:31:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61c27fc640 1 -- 172.21.15.53:0/3034329338 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f61bc0039a0 con 0x7f61cc15a470 2024-09-13T18:31:05.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61c27fc640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61b00667b0 0x7f61b0068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61c27fc640 1 -- 172.21.15.53:0/3034329338 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61bc0843b0 con 0x7f61cc15a470 2024-09-13T18:31:05.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61d1896640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61b00667b0 0x7f61b0068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.094+0000 7f61d1896640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61b00667b0 0x7f61b0068c70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61c80045f0 tx=0x7f61c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.098+0000 7f61c27fc640 1 -- 172.21.15.53:0/3034329338 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61bc051610 con 0x7f61cc15a470 2024-09-13T18:31:05.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.294+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61cc070870 con 0x7f61cc15a470 2024-09-13T18:31:05.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.294+0000 7f61c27fc640 1 -- 172.21.15.53:0/3034329338 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f61bc054c30 con 0x7f61cc15a470 2024-09-13T18:31:05.297 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:05.297 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/1892947074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1892947074},{"type":"v1","addr":"172.21.15.87:6834","nonce":1892947074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3784505733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3784505733},{"type":"v1","addr":"172.21.15.87:6835","nonce":3784505733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/945674829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":945674829},{"type":"v1","addr":"172.21.15.53:6833","nonce":945674829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:00.085788+0000","modified":"2024-09-13T18:31:03.099836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2605273551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2605273551},{"type":"v1","addr":"172.21.15.53:6835","nonce":2605273551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:31:05.298 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 62 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61b00667b0 msgr2=0x7f61b0068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61b00667b0 0x7f61b0068c70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61c80045f0 tx=0x7f61c8008040 comp rx=0 tx=0).stop 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc15a470 msgr2=0x7f61cc0b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc15a470 0x7f61cc0b0360 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00d5d0 tx=0x7f61bc00da90 comp rx=0 tx=0).stop 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 shutdown_connections 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61b00667b0 0x7f61b0068c70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61cc15cc60 0x7f61cc152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc15a470 0x7f61cc0b0360 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 --2- 172.21.15.53:0/3034329338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61cc0b1c10 0x7f61cc1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 >> 172.21.15.53:0/3034329338 conn(0x7f61cc065c80 msgr2=0x7f61cc0aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 shutdown_connections 2024-09-13T18:31:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.298+0000 7f61d3afa640 1 -- 172.21.15.53:0/3034329338 wait complete. 2024-09-13T18:31:05.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:31:00.085788+0000', 'modified': '2024-09-13T18:31:03.099836+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7920': {'gid': 7920, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/2605273551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 2605273551}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 2605273551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:31:05.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:31:05.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.854+0000 7f57472da640 1 Processor -- start 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.854+0000 7f57472da640 1 -- start start 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.854+0000 7f57472da640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5740158ba0 0x7f574006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.854+0000 7f57472da640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f574006fa80 0x7f57400b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.854+0000 7f57472da640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57400b2340 con 0x7f57400cbb60 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.854+0000 7f57472da640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57400b2860 con 0x7f5740158ba0 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.854+0000 7f57472da640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5740158f80 con 0x7f574006fa80 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5744875640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f57400cbb60 0x7f574006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41074/0 (socket says 172.21.15.53:41074) 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5744875640 1 -- 172.21.15.53:0/616962352 learned_addr learned my addr 172.21.15.53:0/616962352 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:05.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5745076640 1 --2- 172.21.15.53:0/616962352 >> v2:172.21.15.53:3300/0 conn(0x7f5740158ba0 0x7f574006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5745877640 1 --2- 172.21.15.53:0/616962352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f574006fa80 0x7f57400b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5737fff640 1 -- 172.21.15.53:0/616962352 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431725377 0 0) 0x7f5730001120 con 0x7f57400cbb60 2024-09-13T18:31:05.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5737fff640 1 -- 172.21.15.53:0/616962352 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f572c003530 con 0x7f57400cbb60 2024-09-13T18:31:05.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5745076640 1 -- 172.21.15.53:0/616962352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f574006fa80 msgr2=0x7f57400b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5745076640 1 --2- 172.21.15.53:0/616962352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f574006fa80 0x7f57400b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5745076640 1 -- 172.21.15.53:0/616962352 >> v1:172.21.15.53:6789/0 conn(0x7f57400cbb60 legacy=0x7f574006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5745076640 1 -- 172.21.15.53:0/616962352 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400b2580 con 0x7f5740158ba0 2024-09-13T18:31:05.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5745076640 1 --2- 172.21.15.53:0/616962352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5740158ba0 0x7f574006b390 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f573c0097c0 tx=0x7f573c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7090bb9d99d98fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5737fff640 1 -- 172.21.15.53:0/616962352 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c004230 con 0x7f5740158ba0 2024-09-13T18:31:05.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5737fff640 1 -- 172.21.15.53:0/616962352 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c0a7050 con 0x7f5740158ba0 2024-09-13T18:31:05.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.858+0000 7f5737fff640 1 -- 172.21.15.53:0/616962352 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c003620 con 0x7f5740158ba0 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- 172.21.15.53:0/616962352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5740158ba0 msgr2=0x7f574006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 --2- 172.21.15.53:0/616962352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5740158ba0 0x7f574006b390 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f573c0097c0 tx=0x7f573c01c350 comp rx=0 tx=0).stop 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- 172.21.15.53:0/616962352 shutdown_connections 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 --2- 172.21.15.53:0/616962352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f574006fa80 0x7f57400b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 --2- 172.21.15.53:0/616962352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5740158ba0 0x7f574006b390 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- 172.21.15.53:0/616962352 >> 172.21.15.53:0/616962352 conn(0x7f5740065c80 msgr2=0x7f5740066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- 172.21.15.53:0/616962352 shutdown_connections 2024-09-13T18:31:05.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- 172.21.15.53:0/616962352 wait complete. 2024-09-13T18:31:05.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 Processor -- start 2024-09-13T18:31:05.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- start start 2024-09-13T18:31:05.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006fa80 0x7f57401554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57400cbb60 0x7f57400c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5740158ba0 0x7f57401529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740155010 con 0x7f574006fa80 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740152f10 con 0x7f5740158ba0 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400c5b00 con 0x7f57400cbb60 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006fa80 0x7f57401554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006fa80 0x7f57401554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44068/0 (socket says 172.21.15.53:44068) 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 -- 172.21.15.53:0/2119864633 learned_addr learned my addr 172.21.15.53:0/2119864633 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:05.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5744875640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57400cbb60 0x7f57400c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745877640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5740158ba0 0x7f57401529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 -- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57400cbb60 msgr2=0x7f57400c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57400cbb60 0x7f57400c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 -- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5740158ba0 msgr2=0x7f57401529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5740158ba0 0x7f57401529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 -- 172.21.15.53:0/2119864633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c009420 con 0x7f574006fa80 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5745076640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006fa80 0x7f57401554a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f573c019f80 tx=0x7f573c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5735ffb640 1 -- 172.21.15.53:0/2119864633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c003af0 con 0x7f574006fa80 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5735ffb640 1 -- 172.21.15.53:0/2119864633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c003c50 con 0x7f574006fa80 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57401549c0 con 0x7f574006fa80 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f5735ffb640 1 -- 172.21.15.53:0/2119864633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0ab440 con 0x7f574006fa80 2024-09-13T18:31:05.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.862+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400c5de0 con 0x7f574006fa80 2024-09-13T18:31:05.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5735ffb640 1 -- 172.21.15.53:0/2119864633 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f573c0b2040 con 0x7f574006fa80 2024-09-13T18:31:05.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5735ffb640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57240667b0 0x7f5724068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5735ffb640 1 -- 172.21.15.53:0/2119864633 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f573c11e170 con 0x7f574006fa80 2024-09-13T18:31:05.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5744875640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57240667b0 0x7f5724068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 Processor -- start 2024-09-13T18:31:05.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5744875640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57240667b0 0x7f5724068c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f57401f8440 tx=0x7f5730007bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 -- start start 2024-09-13T18:31:05.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec161f0 0x555a8ec165d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec16b10 0x555a8ebcc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ebcc740 0x555a8ebccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8ea94e80 con 0x555a8ec161f0 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8ea22af0 con 0x555a8ebcc740 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a8ea200c0 con 0x555a8ec16b10 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec161f0 0x555a8ec165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec161f0 0x555a8ec165d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44074/0 (socket says 172.21.15.53:44074) 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 -- 172.21.15.53:0/588049495 learned_addr learned my addr 172.21.15.53:0/588049495 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5744875640 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec16b10 0x555a8ebcc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 -- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec16b10 msgr2=0x555a8ebcc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec16b10 0x555a8ebcc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 -- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ebcc740 msgr2=0x555a8ebccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ebcc740 0x555a8ebccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 -- 172.21.15.53:0/588049495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a8e717890 con 0x555a8ec161f0 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5744875640 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec16b10 0x555a8ebcc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f5745076640 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec161f0 0x555a8ec165d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f573c0eb520 tx=0x7f573c0ef020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaa953cfdb1208e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.866+0000 7f572affd640 1 -- 172.21.15.53:0/588049495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0f7360 con 0x555a8ec161f0 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f572affd640 1 -- 172.21.15.53:0/588049495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c11c5f0 con 0x555a8ec161f0 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f572affd640 1 -- 172.21.15.53:0/588049495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c11c7a0 con 0x555a8ec161f0 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/588049495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec161f0 msgr2=0x555a8ec165d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec161f0 0x555a8ec165d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f573c0eb520 tx=0x7f573c0ef020 comp rx=0 tx=0).stop 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/588049495 shutdown_connections 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec16b10 0x555a8ebcc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ebcc740 0x555a8ebccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- 172.21.15.53:0/588049495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec161f0 0x555a8ec165d0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/588049495 >> 172.21.15.53:0/588049495 conn(0x555a8ebd2fb0 msgr2=0x555a8ebd3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/588049495 shutdown_connections 2024-09-13T18:31:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/588049495 wait complete. 2024-09-13T18:31:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- start start 2024-09-13T18:31:05.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 Processor -- start 2024-09-13T18:31:05.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ebd7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ebd84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ebd8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8ea1b9b0 con 0x555a8ec16b10 2024-09-13T18:31:05.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8e9bac00 con 0x555a8ec161f0 2024-09-13T18:31:05.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a8e9d9070 con 0x555a8ebcc740 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 10 client.0 _ll_register_callbacks cb 0x555a8ebb8ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ebd8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ebd8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44084/0 (socket says 172.21.15.53:44084) 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 -- 172.21.15.53:0/3393128018 learned_addr learned my addr 172.21.15.53:0/3393128018 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5744875640 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ebd84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745076640 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ebd7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 -- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 msgr2=0x555a8ebd7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ebd7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 -- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 msgr2=0x555a8ebd84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ebd84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 -- 172.21.15.53:0/3393128018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400c5de0 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745877640 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ebd8a30 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5738007e70 tx=0x7f57380115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a239cd3278b8dbb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f571ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f571ffff640 1 -- 172.21.15.53:0/3393128018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800e030 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f571ffff640 1 -- 172.21.15.53:0/3393128018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f573800f070 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a8e9d85f0 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f571ffff640 1 -- 172.21.15.53:0/3393128018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5738009ea0 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 10 client.8049 fetch_fsmap learned FSMap version 62 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x555a8e9e0ab0 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f571ffff640 1 -- 172.21.15.53:0/3393128018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a8e9d85f0 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f571ffff640 1 -- 172.21.15.53:0/3393128018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5738014070 con 0x555a8ec16b10 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 10 client.8049 fetch_fsmap finished waiting for FSMap version 62 2024-09-13T18:31:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 10 client.8049 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 20 client.8049 populate_metadata read hostname 'smithi053' 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ebd8f70 0x555a8ebd9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 4 client.8049 mds_command: new command op to 7920 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 --> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a8ea18790 con 0x555a8ebd8f70 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.870+0000 7f5745076640 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ebd8f70 0x555a8ebd9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f5745076640 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ebd8f70 0x555a8ebd9350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ffae1be6046834 server_cookie=6f19de78da53f42f in_seq=0 out_seq=0 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f571ffff640 10 client.8049 ms_handle_connect on v2:172.21.15.53:6834/2605273551 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f571ffff640 1 -- 172.21.15.53:0/3393128018 <== mds.0 v2:172.21.15.53:6834/2605273551 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555a8ea18790 con 0x555a8ebd8f70 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f571ffff640 10 client.8049 handle_command_reply: tid=0 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 client.8049 shutdown 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 msgr2=0x555a8ebd8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ebd8a30 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5738007e70 tx=0x7f57380115a0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 shutdown_connections 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ebd8f70 0x555a8ebd9350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ebd8a30 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ebd84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 --2- 172.21.15.53:0/3393128018 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ebd7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f571ffff640 0 client.8049 ms_handle_reset on v2:172.21.15.53:6834/2605273551 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 >> 172.21.15.53:0/3393128018 conn(0x555a8ebd2fb0 msgr2=0x555a8ebcb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 shutdown_connections 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 1 -- 172.21.15.53:0/3393128018 wait complete. 2024-09-13T18:31:05.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.874+0000 7f574a423000 20 client.8049 trim_cache size 0 max 16384 2024-09-13T18:31:05.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 Processor -- start 2024-09-13T18:31:05.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- start start 2024-09-13T18:31:05.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ebcc740 0x555a8ec72620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec161f0 0x555a8ec72b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec16b10 0x555a8ec730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8e6d8940 con 0x555a8ebcc740 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8e9d4f80 con 0x555a8ec16b10 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a8e9e2c60 con 0x555a8ec161f0 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ebcc740 0x555a8ec72620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ebcc740 0x555a8ec72620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44100/0 (socket says 172.21.15.53:44100) 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 -- 172.21.15.53:0/1624040034 learned_addr learned my addr 172.21.15.53:0/1624040034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 -- 172.21.15.53:0/1624040034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec161f0 msgr2=0x555a8ec72b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 --2- 172.21.15.53:0/1624040034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec161f0 0x555a8ec72b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 -- 172.21.15.53:0/1624040034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec16b10 msgr2=0x555a8ec730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 --2- 172.21.15.53:0/1624040034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec16b10 0x555a8ec730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 -- 172.21.15.53:0/1624040034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a8e9c6c00 con 0x555a8ebcc740 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f5745076640 1 --2- 172.21.15.53:0/1624040034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ebcc740 0x555a8ec72620 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f573c0f2f60 tx=0x7f573c0f5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9debc86b4e717f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f572b7fe640 1 -- 172.21.15.53:0/1624040034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0f5070 con 0x555a8ebcc740 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f572b7fe640 1 -- 172.21.15.53:0/1624040034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c0eb730 con 0x555a8ebcc740 2024-09-13T18:31:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f572b7fe640 1 -- 172.21.15.53:0/1624040034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c11c7f0 con 0x555a8ebcc740 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- 172.21.15.53:0/1624040034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ebcc740 msgr2=0x555a8ec72620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 --2- 172.21.15.53:0/1624040034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ebcc740 0x555a8ec72620 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f573c0f2f60 tx=0x7f573c0f5000 comp rx=0 tx=0).stop 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- 172.21.15.53:0/1624040034 shutdown_connections 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 --2- 172.21.15.53:0/1624040034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ec161f0 0x555a8ec72b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 --2- 172.21.15.53:0/1624040034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec16b10 0x555a8ec730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 --2- 172.21.15.53:0/1624040034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ebcc740 0x555a8ec72620 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- 172.21.15.53:0/1624040034 >> 172.21.15.53:0/1624040034 conn(0x555a8ebd2fb0 msgr2=0x555a8ebca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- 172.21.15.53:0/1624040034 shutdown_connections 2024-09-13T18:31:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- 172.21.15.53:0/1624040034 wait complete. 2024-09-13T18:31:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 -- start start 2024-09-13T18:31:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.890+0000 7f574a423000 1 Processor -- start 2024-09-13T18:31:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ec5b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ec2a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ec2ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8ea171a0 con 0x555a8ec16b10 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8ea1e510 con 0x555a8ec161f0 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a8ea104d0 con 0x555a8ebcc740 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 10 client.0 _ll_register_callbacks cb 0x7f573c0eb360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ec2ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ec2ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44108/0 (socket says 172.21.15.53:44108) 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 -- 172.21.15.53:0/3467264358 learned_addr learned my addr 172.21.15.53:0/3467264358 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745076640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ec5b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5744875640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ec2a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 -- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 msgr2=0x555a8ec5b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ec5b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 -- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 msgr2=0x555a8ec2a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ec2a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 -- 172.21.15.53:0/3467264358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a8e717890 con 0x555a8ec16b10 2024-09-13T18:31:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745076640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ec5b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5744875640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ec2a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745877640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ec2ab20 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f5738000f90 tx=0x7f5738004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb5107487c301f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 1 -- 172.21.15.53:0/3467264358 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738009ea0 con 0x555a8ec16b10 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a8e9eb460 con 0x555a8ec16b10 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 1 -- 172.21.15.53:0/3467264358 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5738009410 con 0x555a8ec16b10 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 1 -- 172.21.15.53:0/3467264358 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f573800e040 con 0x555a8ec16b10 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 10 client.8055 fetch_fsmap learned FSMap version 62 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x555a8e717cc0 con 0x555a8ec16b10 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 1 -- 172.21.15.53:0/3467264358 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a8e9eb460 con 0x555a8ec16b10 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 1 -- 172.21.15.53:0/3467264358 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5738005d20 con 0x555a8ec16b10 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 10 client.8055 fetch_fsmap finished waiting for FSMap version 62 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 10 client.8055 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:31:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 20 client.8055 populate_metadata read hostname 'smithi053' 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ec5b610 0x555a8ec2b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 4 client.8055 mds_command: new command op to 7920 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 --> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555a8e9e49c0 con 0x555a8ec5b610 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745076640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ec5b610 0x555a8ec2b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f5745076640 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ec5b610 0x555a8ec2b060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5147c74fb9bea573 server_cookie=c801a891a9c08c34 in_seq=0 out_seq=0 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 10 client.8055 ms_handle_connect on v2:172.21.15.53:6834/2605273551 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 1 -- 172.21.15.53:0/3467264358 <== mds.0 v2:172.21.15.53:6834/2605273551 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x555a8e9e49c0 con 0x555a8ec5b610 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 10 client.8055 handle_command_reply: tid=0 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 client.8055 shutdown 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 msgr2=0x555a8ec2ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ec2ab20 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f5738000f90 tx=0x7f5738004ac0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 shutdown_connections 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:6834/2605273551,v1:172.21.15.53:6835/2605273551] conn(0x555a8ec5b610 0x555a8ec2b060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555a8ec16b10 0x555a8ec2ab20 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x555a8ec161f0 0x555a8ec2a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f571ffff640 0 client.8055 ms_handle_reset on v2:172.21.15.53:6834/2605273551 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 --2- 172.21.15.53:0/3467264358 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x555a8ebcc740 0x555a8ec5b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 >> 172.21.15.53:0/3467264358 conn(0x555a8ebd2fb0 msgr2=0x555a8ebcb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 shutdown_connections 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 1 -- 172.21.15.53:0/3467264358 wait complete. 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f574a423000 20 client.8055 trim_cache size 0 max 16384 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:31:05.903 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 7920, 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 5.8093906459999998, 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 62, 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 106, 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 106, 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 10.07994068 2024-09-13T18:31:05.904 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57240667b0 msgr2=0x7f5724068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57240667b0 0x7f5724068c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f57401f8440 tx=0x7f5730007bc0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006fa80 msgr2=0x7f57401554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006fa80 0x7f57401554a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f573c019f80 tx=0x7f573c0190f0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 shutdown_connections 2024-09-13T18:31:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57240667b0 0x7f5724068c70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57400cbb60 0x7f57400c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5740158ba0 0x7f57401529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 --2- 172.21.15.53:0/2119864633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006fa80 0x7f57401554a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 >> 172.21.15.53:0/2119864633 conn(0x7f5740065c80 msgr2=0x7f57400ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 shutdown_connections 2024-09-13T18:31:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:05.894+0000 7f57472da640 1 -- 172.21.15.53:0/2119864633 wait complete. 2024-09-13T18:31:05.915 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:31:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.026+0000 7f771a3a8640 1 Processor -- start 2024-09-13T18:31:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.026+0000 7f771a3a8640 1 -- start start 2024-09-13T18:31:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f771a3a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f77140cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f771a3a8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f771406c470 0x7f77140cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:06.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f771a3a8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771415b6d0 con 0x7f7714157f50 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f771a3a8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771415a910 con 0x7f771406c470 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f771a3a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771415ab00 con 0x7f7714066390 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7718945640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f771406c470 0x7f77140cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7713fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7714157f50 0x7f7714065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41082/0 (socket says 172.21.15.53:41082) 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7713fff640 1 -- 172.21.15.53:0/1769189277 learned_addr learned my addr 172.21.15.53:0/1769189277 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f77137fe640 1 --2- 172.21.15.53:0/1769189277 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f77140cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7718945640 1 -- 172.21.15.53:0/1769189277 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 msgr2=0x7f77140cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7718945640 1 --2- 172.21.15.53:0/1769189277 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f77140cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7718945640 1 -- 172.21.15.53:0/1769189277 >> v1:172.21.15.53:6789/0 conn(0x7f7714157f50 legacy=0x7f7714065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7718945640 1 -- 172.21.15.53:0/1769189277 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771415ada0 con 0x7f771406c470 2024-09-13T18:31:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7718945640 1 --2- 172.21.15.53:0/1769189277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f771406c470 0x7f77140cc940 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f770c009dc0 tx=0x7f770c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5d93a7c19c65bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7712ffd640 1 -- 172.21.15.53:0/1769189277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0a5950 con 0x7f771406c470 2024-09-13T18:31:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7712ffd640 1 -- 172.21.15.53:0/1769189277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c0a5ab0 con 0x7f771406c470 2024-09-13T18:31:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.030+0000 7f7712ffd640 1 -- 172.21.15.53:0/1769189277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0a5e40 con 0x7f771406c470 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- 172.21.15.53:0/1769189277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f771406c470 msgr2=0x7f77140cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 --2- 172.21.15.53:0/1769189277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f771406c470 0x7f77140cc940 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f770c009dc0 tx=0x7f770c01c890 comp rx=0 tx=0).stop 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- 172.21.15.53:0/1769189277 shutdown_connections 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 --2- 172.21.15.53:0/1769189277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f771406c470 0x7f77140cc940 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 --2- 172.21.15.53:0/1769189277 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f77140cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- 172.21.15.53:0/1769189277 >> 172.21.15.53:0/1769189277 conn(0x7f7714073130 msgr2=0x7f7714069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- 172.21.15.53:0/1769189277 shutdown_connections 2024-09-13T18:31:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- 172.21.15.53:0/1769189277 wait complete. 2024-09-13T18:31:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 Processor -- start 2024-09-13T18:31:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- start start 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f771414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f771406c470 0x7f77141518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7714157f50 0x7f771414ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77140af800 con 0x7f7714157f50 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771414be40 con 0x7f771406c470 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714151e00 con 0x7f7714066390 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7714157f50 0x7f771414ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7714157f50 0x7f771414ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44120/0 (socket says 172.21.15.53:44120) 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 -- 172.21.15.53:0/3016713994 learned_addr learned my addr 172.21.15.53:0/3016713994 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:06.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7713fff640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f771414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f77137fe640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f771406c470 0x7f77141518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 -- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 msgr2=0x7f771414b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f771414b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 -- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f771406c470 msgr2=0x7f77141518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f771406c470 0x7f77141518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 -- 172.21.15.53:0/3016713994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009a70 con 0x7f7714157f50 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f77137fe640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f771406c470 0x7f77141518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7718945640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7714157f50 0x7f771414ed00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b0040 tx=0x7f770c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7710ff9640 1 -- 172.21.15.53:0/3016713994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0ade20 con 0x7f7714157f50 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7710ff9640 1 -- 172.21.15.53:0/3016713994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c009450 con 0x7f7714157f50 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771414bb60 con 0x7f7714157f50 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f7710ff9640 1 -- 172.21.15.53:0/3016713994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0b9690 con 0x7f7714157f50 2024-09-13T18:31:06.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.034+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77140af490 con 0x7f7714157f50 2024-09-13T18:31:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.038+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77140af9b0 con 0x7f7714157f50 2024-09-13T18:31:06.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.038+0000 7f7710ff9640 1 -- 172.21.15.53:0/3016713994 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f770c0b97f0 con 0x7f7714157f50 2024-09-13T18:31:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.038+0000 7f7710ff9640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f77000667b0 0x7f7700068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.038+0000 7f7710ff9640 1 -- 172.21.15.53:0/3016713994 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f770c11fae0 con 0x7f7714157f50 2024-09-13T18:31:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.038+0000 7f7713fff640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f77000667b0 0x7f7700068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:06.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.038+0000 7f7713fff640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f77000667b0 0x7f7700068c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7704005890 tx=0x7f7704009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:06.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.042+0000 7f7710ff9640 1 -- 172.21.15.53:0/3016713994 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f77140af9b0 con 0x7f7714157f50 2024-09-13T18:31:06.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77140af9b0 con 0x7f7714157f50 2024-09-13T18:31:06.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f7710ff9640 1 -- 172.21.15.53:0/3016713994 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f770c0bd060 con 0x7f7714157f50 2024-09-13T18:31:06.235 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f77000667b0 msgr2=0x7f7700068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f77000667b0 0x7f7700068c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7704005890 tx=0x7f7704009040 comp rx=0 tx=0).stop 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7714157f50 msgr2=0x7f771414ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7714157f50 0x7f771414ed00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b0040 tx=0x7f770c019630 comp rx=0 tx=0).stop 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 shutdown_connections 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f77000667b0 0x7f7700068c70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7714157f50 0x7f771414ed00 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f771406c470 0x7f77141518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 --2- 172.21.15.53:0/3016713994 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7714066390 0x7f771414b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 >> 172.21.15.53:0/3016713994 conn(0x7f7714073130 msgr2=0x7f771415c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 shutdown_connections 2024-09-13T18:31:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:06.234+0000 7f771a3a8640 1 -- 172.21.15.53:0/3016713994 wait complete. 2024-09-13T18:31:06.252 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:31:06.252 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:31:06.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:31:06.252 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:31:06.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:06.252 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:31:06.252 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:31:06.253 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:31:06.253 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:31:06.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.253 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:31:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:31:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:31:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:31:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42130sec preferred_lft 42130sec 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:31:06.261 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:06.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.262 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:31:06.315 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:31:06.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.317 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:31:06.365 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:31:06.365 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:31:06.365 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:31:06.365 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:31:06.365 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:31:06.365 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:31:06.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.366 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:31:06.366 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:31:06.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:31:06.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:31:06.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:31:06.366 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:31:06.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.440 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:31:06.487 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:31:06.488 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:31:06.488 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:31:06.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:31:06.548 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:31:06.548 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:31:06.548 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:06.596 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:31:06.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:31:06.597 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:06.643 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:31:06.701 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:06.702 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:06.755 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:06.756 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:06.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.756 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:31:06.803 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:31:06.803 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:31:06.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:31:06.868 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:06.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:06.921 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:06.922 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:06.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:06.923 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:31:06.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:31:06.938+0000 7fe1bdcb4580 -1 init, newargv = 0x563171816a80 newargc=15 2024-09-13T18:31:06.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[49177]: starting ceph client 2024-09-13T18:31:06.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[49177]: starting fuse 2024-09-13T18:31:08.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:31:08.063 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:08.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:08.121 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:08.123 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:08.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:08.123 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:31:08.176 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:31:08.176 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:31:08.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:31:08.176 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:31:08.176 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:31:08.176 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:31:08.176 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:31:08.177 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:31:08.178 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:31:08.299 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.49177.asok 2024-09-13T18:31:08.481 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49177.asok 2024-09-13T18:31:08.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:08.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49177.asok status 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "49177", 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:08.642 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8070, 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 8070 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3212704768 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:08.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3212704768 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.8070 192.168.0.1:0/3212704768", 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3212704768", 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 62, 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 106, 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:31:08.644 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:31:08.645 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:08.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:08.656 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:31:08.656 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:08.663 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:31:08.663 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:08.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:08.663 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:08.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:31:08.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f6c02640 1 Processor -- start 2024-09-13T18:31:08.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f6c02640 1 -- start start 2024-09-13T18:31:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f6c02640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8f0066390 0x7fd8f00b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f6c02640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 0x7fd8f00b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f6c02640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f00af0d0 con 0x7fd8f015c770 2024-09-13T18:31:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f6c02640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f00ad9e0 con 0x7fd8f0066390 2024-09-13T18:31:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f6c02640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015cb50 con 0x7fd8f00ade00 2024-09-13T18:31:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd8f015c770 0x7fd8f0065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45112/0 (socket says 172.21.15.53:45112) 2024-09-13T18:31:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 -- 172.21.15.53:0/315569132 learned_addr learned my addr 172.21.15.53:0/315569132 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8effff640 1 --2- 172.21.15.53:0/315569132 >> v2:172.21.15.87:3300/0 conn(0x7fd8f0066390 0x7fd8f00b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f519f640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 0x7fd8f00b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186178718 0 0) 0x7fd8f00af0d0 con 0x7fd8f015c770 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d8003530 con 0x7fd8f015c770 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1216515068 0 0) 0x7fd8d8003530 con 0x7fd8f015c770 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 msgr2=0x7fd8f00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 0x7fd8f00b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 >> v2:172.21.15.87:3300/0 conn(0x7fd8f0066390 msgr2=0x7fd8f00b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 --2- 172.21.15.53:0/315569132 >> v2:172.21.15.87:3300/0 conn(0x7fd8f0066390 0x7fd8f00b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00acd60 con 0x7fd8f015c770 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd8e8001680 con 0x7fd8f015c770 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 >> v1:172.21.15.53:6789/0 conn(0x7fd8f015c770 legacy=0x7fd8f0065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d8003980 0x7fd8d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80047d0 0x7fd8d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 0x7fd8d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00ad9e0 con 0x7fd8d8003980 2024-09-13T18:31:08.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015cb50 con 0x7fd8d80047d0 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d800b9c0 con 0x7fd8f00ade00 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d8003980 0x7fd8d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f519f640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 0x7fd8d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8effff640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80047d0 0x7fd8d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 -- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 msgr2=0x7fd8d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f00ade00 0x7fd8d8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 -- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80047d0 msgr2=0x7fd8d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80047d0 0x7fd8d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8f499e640 1 -- 172.21.15.53:0/315569132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8003530 con 0x7fd8d8003980 2024-09-13T18:31:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.894+0000 7fd8effff640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d80047d0 0x7fd8d8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f499e640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d8003980 0x7fd8d8003da0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c290 tx=0x7fd8e801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6945dfd9afc0b599 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80058e0 con 0x7fd8d8003980 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8005a40 con 0x7fd8d8003980 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8ef7fe640 1 -- 172.21.15.53:0/315569132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8005df0 con 0x7fd8d8003980 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 -- 172.21.15.53:0/315569132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d8003980 msgr2=0x7fd8d8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 --2- 172.21.15.53:0/315569132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8d8003980 0x7fd8d8003da0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c290 tx=0x7fd8e801cc70 comp rx=0 tx=0).stop 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f519f640 1 -- 172.21.15.53:0/315569132 reap_dead start 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 -- 172.21.15.53:0/315569132 shutdown_connections 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 -- 172.21.15.53:0/315569132 >> 172.21.15.53:0/315569132 conn(0x7fd8f00b1310 msgr2=0x7fd8f00b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 -- 172.21.15.53:0/315569132 shutdown_connections 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 -- 172.21.15.53:0/315569132 wait complete. 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 Processor -- start 2024-09-13T18:31:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.898+0000 7fd8f6c02640 1 -- start start 2024-09-13T18:31:08.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d8003980 0x7fd8f015e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f013ffb0 0x7fd8f015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f015b810 0x7fd8f015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015bc90 con 0x7fd8f015b810 2024-09-13T18:31:08.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015ef40 con 0x7fd8d8003980 2024-09-13T18:31:08.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015f1e0 con 0x7fd8f013ffb0 2024-09-13T18:31:08.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f015b810 0x7fd8f015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f015b810 0x7fd8f015cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48748/0 (socket says 172.21.15.53:48748) 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 -- 172.21.15.53:0/3992642566 learned_addr learned my addr 172.21.15.53:0/3992642566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8effff640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f013ffb0 0x7fd8f015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f499e640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d8003980 0x7fd8f015e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 -- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f013ffb0 msgr2=0x7fd8f015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f013ffb0 0x7fd8f015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 -- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d8003980 msgr2=0x7fd8f015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d8003980 0x7fd8f015e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 -- 172.21.15.53:0/3992642566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f015f4c0 con 0x7fd8f015b810 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f499e640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d8003980 0x7fd8f015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f519f640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f015b810 0x7fd8f015cd50 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00cf530 tx=0x7fd8e00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8ed7fa640 1 -- 172.21.15.53:0/3992642566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000e070 con 0x7fd8f015b810 2024-09-13T18:31:08.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8ed7fa640 1 -- 172.21.15.53:0/3992642566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0011e10 con 0x7fd8f015b810 2024-09-13T18:31:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f015f7a0 con 0x7fd8f015b810 2024-09-13T18:31:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8ed7fa640 1 -- 172.21.15.53:0/3992642566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00039a0 con 0x7fd8f015b810 2024-09-13T18:31:08.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f015e950 con 0x7fd8f015b810 2024-09-13T18:31:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f006d7d0 con 0x7fd8f015b810 2024-09-13T18:31:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8ed7fa640 1 -- 172.21.15.53:0/3992642566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fd8e0003b00 con 0x7fd8f015b810 2024-09-13T18:31:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8ed7fa640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8dc0667b0 0x7fd8dc068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8ed7fa640 1 -- 172.21.15.53:0/3992642566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8e0084b80 con 0x7fd8f015b810 2024-09-13T18:31:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f499e640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8dc0667b0 0x7fd8dc068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.902+0000 7fd8f499e640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8dc0667b0 0x7fd8dc068c70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80aa000 tx=0x7fd8e8001a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:08.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:08.906+0000 7fd8ed7fa640 1 -- 172.21.15.53:0/3992642566 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8e0051cd0 con 0x7fd8f015b810 2024-09-13T18:31:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.102+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8f0066090 con 0x7fd8f015b810 2024-09-13T18:31:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8ed7fa640 1 -- 172.21.15.53:0/3992642566 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd8e0003db0 con 0x7fd8f015b810 2024-09-13T18:31:09.107 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:31:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8dc0667b0 msgr2=0x7fd8dc068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8dc0667b0 0x7fd8dc068c70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80aa000 tx=0x7fd8e8001a10 comp rx=0 tx=0).stop 2024-09-13T18:31:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f015b810 msgr2=0x7fd8f015cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f015b810 0x7fd8f015cd50 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00cf530 tx=0x7fd8e00115a0 comp rx=0 tx=0).stop 2024-09-13T18:31:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 shutdown_connections 2024-09-13T18:31:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8dc0667b0 0x7fd8dc068c70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8f013ffb0 0x7fd8f015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8f015b810 0x7fd8f015cd50 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 --2- 172.21.15.53:0/3992642566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8d8003980 0x7fd8f015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 >> 172.21.15.53:0/3992642566 conn(0x7fd8f00b1310 msgr2=0x7fd8f0156720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 shutdown_connections 2024-09-13T18:31:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:09.106+0000 7fd8f6c02640 1 -- 172.21.15.53:0/3992642566 wait complete. 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:31:09.126 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:31:09.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.127 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:31:09.134 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:31:09.134 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:31:09.134 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:31:09.134 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.134 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:31:09.134 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.134 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42134sec preferred_lft 42134sec 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.135 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:31:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:31:09.137 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.137 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:31:09.137 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:31:09.137 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:31:09.137 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:31:09.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.137 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:31:09.189 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:31:09.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.191 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:31:09.244 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:31:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:31:09.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.246 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:31:09.246 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:31:09.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:31:09.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:31:09.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:31:09.246 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:31:09.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.323 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:31:09.372 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:31:09.372 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:31:09.372 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:31:09.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:31:09.429 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:31:09.429 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:31:09.429 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:31:09.476 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:31:09.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:31:09.476 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:31:09.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:31:09.581 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:09.581 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:09.633 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:09.635 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:09.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.635 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:31:09.684 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:31:09.684 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:31:09.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:31:09.748 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:09.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:09.805 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:09.806 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:09.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:09.806 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:31:09.813 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:31:09.809+0000 7f178f07b580 -1 init, newargv = 0x55b7fbedd4d0 newargc=15 2024-09-13T18:31:09.814 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36079]: starting ceph client 2024-09-13T18:31:09.822 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36079]: starting fuse 2024-09-13T18:31:10.919 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:31:10.936 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:31:10.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:31:10.991 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:31:10.992 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:31:10.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:10.993 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:31:11.039 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:31:11.040 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:31:11.040 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:31:11.041 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:31:11.042 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:31:11.162 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.36079.asok 2024-09-13T18:31:11.342 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.36079.asok 2024-09-13T18:31:11.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:11.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.36079.asok status 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "36079", 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:31:11.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 7132, 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 7132 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1375203409 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:31:11.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1375203409 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.7132 192.168.0.1:0/1375203409", 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1375203409", 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 62, 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 106, 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:31:11.503 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:31:11.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:11.516 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:31:11.516 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:31:11.522 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:31:11.522 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:31:11.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:11.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:31:11.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:31:11.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f150a87e640 1 Processor -- start 2024-09-13T18:31:11.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f150a87e640 1 -- start start 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f150a87e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15040cd6f0 0x7f15040b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f150a87e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f15040cdad0 0x7f1504143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f150a87e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15040b3020 con 0x7f1504143d50 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f150a87e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15040b1f80 con 0x7f15040cd6f0 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f150a87e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15040b2260 con 0x7f15040cdad0 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1503fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f15040cd6f0 0x7f15040b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1508e1b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1504143d50 0x7f150415dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45126/0 (socket says 172.21.15.53:45126) 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1508e1b640 1 -- 172.21.15.53:0/1450839865 learned_addr learned my addr 172.21.15.53:0/1450839865 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f15037fe640 1 --2- 172.21.15.53:0/1450839865 >> v2:172.21.15.87:3300/0 conn(0x7f15040cdad0 0x7f1504143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1503fff640 1 -- 172.21.15.53:0/1450839865 >> v2:172.21.15.87:3300/0 conn(0x7f15040cdad0 msgr2=0x7f1504143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:11.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1503fff640 1 --2- 172.21.15.53:0/1450839865 >> v2:172.21.15.87:3300/0 conn(0x7f15040cdad0 0x7f1504143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:11.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1503fff640 1 -- 172.21.15.53:0/1450839865 >> v1:172.21.15.53:6789/0 conn(0x7f1504143d50 legacy=0x7f150415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:11.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1503fff640 1 -- 172.21.15.53:0/1450839865 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15040b2540 con 0x7f15040cd6f0 2024-09-13T18:31:11.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.714+0000 7f1502ffd640 1 -- 172.21.15.53:0/1450839865 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380371866 0 0) 0x7f15040b3020 con 0x7f1504143d50 2024-09-13T18:31:11.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f1503fff640 1 --2- 172.21.15.53:0/1450839865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cd6f0 0x7f15040b1490 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f15040adae0 tx=0x7f14f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7de377b3cb9c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:11.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f1502ffd640 1 -- 172.21.15.53:0/1450839865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f40ab600 con 0x7f15040cd6f0 2024-09-13T18:31:11.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f1502ffd640 1 -- 172.21.15.53:0/1450839865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f40a7050 con 0x7f15040cd6f0 2024-09-13T18:31:11.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f1502ffd640 1 -- 172.21.15.53:0/1450839865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f40ab980 con 0x7f15040cd6f0 2024-09-13T18:31:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 -- 172.21.15.53:0/1450839865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cd6f0 msgr2=0x7f15040b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 --2- 172.21.15.53:0/1450839865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cd6f0 0x7f15040b1490 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f15040adae0 tx=0x7f14f401c450 comp rx=0 tx=0).stop 2024-09-13T18:31:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 -- 172.21.15.53:0/1450839865 shutdown_connections 2024-09-13T18:31:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 --2- 172.21.15.53:0/1450839865 >> v2:172.21.15.87:3300/0 conn(0x7f15040cdad0 0x7f1504143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 --2- 172.21.15.53:0/1450839865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cd6f0 0x7f15040b1490 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 -- 172.21.15.53:0/1450839865 >> 172.21.15.53:0/1450839865 conn(0x7f1504073330 msgr2=0x7f1504065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 -- 172.21.15.53:0/1450839865 shutdown_connections 2024-09-13T18:31:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 -- 172.21.15.53:0/1450839865 wait complete. 2024-09-13T18:31:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.718+0000 7f150a87e640 1 Processor -- start 2024-09-13T18:31:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 -- start start 2024-09-13T18:31:11.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15040cd6f0 0x7f1504159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:11.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cdad0 0x7f15041406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:11.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1504143d50 0x7f150415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:11.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150415c4c0 con 0x7f15040cdad0 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1504140c00 con 0x7f15040cd6f0 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150415b8b0 con 0x7f1504143d50 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cdad0 0x7f15041406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cdad0 0x7f15041406c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48776/0 (socket says 172.21.15.53:48776) 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 -- 172.21.15.53:0/2818880847 learned_addr learned my addr 172.21.15.53:0/2818880847 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f1503fff640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15040cd6f0 0x7f1504159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f1508e1b640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1504143d50 0x7f150415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 -- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1504143d50 msgr2=0x7f150415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1504143d50 0x7f150415c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 -- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15040cd6f0 msgr2=0x7f1504159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:11.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15040cd6f0 0x7f1504159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:11.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 -- 172.21.15.53:0/2818880847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f4009420 con 0x7f15040cdad0 2024-09-13T18:31:11.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f15037fe640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cdad0 0x7f15041406c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00ce10 tx=0x7f14ec00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:11.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f1500ff9640 1 -- 172.21.15.53:0/2818880847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec003ba0 con 0x7f15040cdad0 2024-09-13T18:31:11.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f1500ff9640 1 -- 172.21.15.53:0/2818880847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec003d00 con 0x7f15040cdad0 2024-09-13T18:31:11.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150415bb90 con 0x7f15040cdad0 2024-09-13T18:31:11.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f1500ff9640 1 -- 172.21.15.53:0/2818880847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec004240 con 0x7f15040cdad0 2024-09-13T18:31:11.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150415c150 con 0x7f15040cdad0 2024-09-13T18:31:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150415c630 con 0x7f15040cdad0 2024-09-13T18:31:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f1500ff9640 1 -- 172.21.15.53:0/2818880847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f14ec0043a0 con 0x7f15040cdad0 2024-09-13T18:31:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.722+0000 7f1500ff9640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f14e40667b0 0x7f14e4068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.726+0000 7f1503fff640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f14e40667b0 0x7f14e4068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.726+0000 7f1500ff9640 1 -- 172.21.15.53:0/2818880847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14ec012070 con 0x7f15040cdad0 2024-09-13T18:31:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.726+0000 7f1503fff640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f14e40667b0 0x7f14e4068c70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14f40ad000 tx=0x7f14f40a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.730+0000 7f1500ff9640 1 -- 172.21.15.53:0/2818880847 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f14ec08a020 con 0x7f15040cdad0 2024-09-13T18:31:11.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:11.926+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f15040b1490 con 0x7f15040cdad0 2024-09-13T18:31:12.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.150+0000 7f1500ff9640 1 -- 172.21.15.53:0/2818880847 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 136+0+0 (secure 0 0 0) 0x7f14ec051ff0 con 0x7f15040cdad0 2024-09-13T18:31:12.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f14e40667b0 msgr2=0x7f14e4068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f14e40667b0 0x7f14e4068c70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14f40ad000 tx=0x7f14f40a6000 comp rx=0 tx=0).stop 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cdad0 msgr2=0x7f15041406c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cdad0 0x7f15041406c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00ce10 tx=0x7f14ec00a660 comp rx=0 tx=0).stop 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 shutdown_connections 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f14e40667b0 0x7f14e4068c70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1504143d50 0x7f150415c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040cdad0 0x7f15041406c0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 --2- 172.21.15.53:0/2818880847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15040cd6f0 0x7f1504159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 >> 172.21.15.53:0/2818880847 conn(0x7f1504073330 msgr2=0x7f150413d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 shutdown_connections 2024-09-13T18:31:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.154+0000 7f150a87e640 1 -- 172.21.15.53:0/2818880847 wait complete. 2024-09-13T18:31:12.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:31:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.298+0000 7f9069296640 1 Processor -- start 2024-09-13T18:31:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.298+0000 7f9069296640 1 -- start start 2024-09-13T18:31:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9069296640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9064065c80 0x7f9064066060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9069296640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f906415c9b0 0x7f90640b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9069296640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90640b3420 con 0x7f906406cc40 2024-09-13T18:31:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9069296640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90640adb60 con 0x7f9064065c80 2024-09-13T18:31:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9069296640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90640665a0 con 0x7f906415c9b0 2024-09-13T18:31:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9064065c80 0x7f9064066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f90637fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f906415c9b0 0x7f90640b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9064065c80 0x7f9064066060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:53360/0 (socket says 172.21.15.53:53360) 2024-09-13T18:31:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 -- 172.21.15.53:0/3036656985 learned_addr learned my addr 172.21.15.53:0/3036656985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f90637fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f906415c9b0 0x7f90640b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:60942/0 (socket says 172.21.15.53:60942) 2024-09-13T18:31:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f905bfff640 1 --1- 172.21.15.53:0/3036656985 >> v1:172.21.15.87:6789/0 conn(0x7f906406cc40 0x7f90640ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:36154/0 (socket says 172.21.15.53:36154) 2024-09-13T18:31:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 -- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f906415c9b0 msgr2=0x7f90640b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 --2- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f906415c9b0 0x7f90640b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 -- 172.21.15.53:0/3036656985 >> v1:172.21.15.87:6789/0 conn(0x7f906406cc40 legacy=0x7f90640ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 -- 172.21.15.53:0/3036656985 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640acff0 con 0x7f9064065c80 2024-09-13T18:31:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f90637fe640 1 --2- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f906415c9b0 0x7f90640b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.302+0000 7f9062ffd640 1 --2- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9064065c80 0x7f9064066060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9054009870 tx=0x7f905401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c93fb753c8be7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f90627fc640 1 -- 172.21.15.53:0/3036656985 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90540a95f0 con 0x7f9064065c80 2024-09-13T18:31:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f90627fc640 1 -- 172.21.15.53:0/3036656985 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90540a9750 con 0x7f9064065c80 2024-09-13T18:31:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f90627fc640 1 -- 172.21.15.53:0/3036656985 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90540a9ae0 con 0x7f9064065c80 2024-09-13T18:31:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9064065c80 msgr2=0x7f9064066060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 --2- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9064065c80 0x7f9064066060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9054009870 tx=0x7f905401c530 comp rx=0 tx=0).stop 2024-09-13T18:31:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- 172.21.15.53:0/3036656985 shutdown_connections 2024-09-13T18:31:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 --2- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f906415c9b0 0x7f90640b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 --2- 172.21.15.53:0/3036656985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9064065c80 0x7f9064066060 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- 172.21.15.53:0/3036656985 >> 172.21.15.53:0/3036656985 conn(0x7f9064069f50 msgr2=0x7f906406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- 172.21.15.53:0/3036656985 shutdown_connections 2024-09-13T18:31:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- 172.21.15.53:0/3036656985 wait complete. 2024-09-13T18:31:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 Processor -- start 2024-09-13T18:31:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- start start 2024-09-13T18:31:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9064065c80 0x7f906415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f906406cc40 0x7f906414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9064150c60 0x7f9064152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906415d960 con 0x7f9064150c60 2024-09-13T18:31:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906415fbf0 con 0x7f906406cc40 2024-09-13T18:31:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f9069296640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906414b6b0 con 0x7f9064065c80 2024-09-13T18:31:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f90637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9064150c60 0x7f9064152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f90637fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9064150c60 0x7f9064152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48786/0 (socket says 172.21.15.53:48786) 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.306+0000 7f90637fe640 1 -- 172.21.15.53:0/552946821 learned_addr learned my addr 172.21.15.53:0/552946821 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f905bfff640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f906406cc40 0x7f906414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f9062ffd640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9064065c80 0x7f906415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f90637fe640 1 -- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9064065c80 msgr2=0x7f906415ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f90637fe640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9064065c80 0x7f906415ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f90637fe640 1 -- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f906406cc40 msgr2=0x7f906414ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f90637fe640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f906406cc40 0x7f906414ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f90637fe640 1 -- 172.21.15.53:0/552946821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c009a70 con 0x7f9064150c60 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f90637fe640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9064150c60 0x7f9064152480 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f905c009e60 tx=0x7f905c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f905b7fe640 1 -- 172.21.15.53:0/552946821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c009cd0 con 0x7f9064150c60 2024-09-13T18:31:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f905b7fe640 1 -- 172.21.15.53:0/552946821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00f040 con 0x7f9064150c60 2024-09-13T18:31:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90540094d0 con 0x7f9064150c60 2024-09-13T18:31:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f905b7fe640 1 -- 172.21.15.53:0/552946821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0039a0 con 0x7f9064150c60 2024-09-13T18:31:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906415f630 con 0x7f9064150c60 2024-09-13T18:31:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906406d340 con 0x7f9064150c60 2024-09-13T18:31:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f905b7fe640 1 -- 172.21.15.53:0/552946821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f905c014480 con 0x7f9064150c60 2024-09-13T18:31:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f905b7fe640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90440667e0 0x7f9044068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f905b7fe640 1 -- 172.21.15.53:0/552946821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f905c084ee0 con 0x7f9064150c60 2024-09-13T18:31:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f9062ffd640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90440667e0 0x7f9044068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.310+0000 7f9062ffd640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90440667e0 0x7f9044068ca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90540ae000 tx=0x7f90540b3040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:12.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.314+0000 7f905b7fe640 1 -- 172.21.15.53:0/552946821 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f905c0520f0 con 0x7f9064150c60 2024-09-13T18:31:12.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.494+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9064066060 con 0x7f90440667e0 2024-09-13T18:31:12.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f905b7fe640 1 -- 172.21.15.53:0/552946821 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9064066060 con 0x7f90440667e0 2024-09-13T18:31:12.499 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:31:12.499 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:12.499 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:31:12.499 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:12.500 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90440667e0 msgr2=0x7f9044068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90440667e0 0x7f9044068ca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90540ae000 tx=0x7f90540b3040 comp rx=0 tx=0).stop 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9064150c60 msgr2=0x7f9064152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9064150c60 0x7f9064152480 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f905c009e60 tx=0x7f905c00c490 comp rx=0 tx=0).stop 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 shutdown_connections 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90440667e0 0x7f9044068ca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9064150c60 0x7f9064152480 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f906406cc40 0x7f906414ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 --2- 172.21.15.53:0/552946821 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9064065c80 0x7f906415ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 >> 172.21.15.53:0/552946821 conn(0x7f9064069f50 msgr2=0x7f90640b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 shutdown_connections 2024-09-13T18:31:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.498+0000 7f9069296640 1 -- 172.21.15.53:0/552946821 wait complete. 2024-09-13T18:31:12.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:31:12.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f85716e1640 1 Processor -- start 2024-09-13T18:31:12.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f85716e1640 1 -- start start 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f85716e1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c157020 0x7f856c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f85716e1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c06d6e0 con 0x7f856c06d270 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f85716e1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0715f0 con 0x7f856c156c40 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f85716e1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0b15a0 con 0x7f856c157020 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f856c06d270 0x7f856c06f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45130/0 (socket says 172.21.15.53:45130) 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856b7fe640 1 -- 172.21.15.53:0/4038795692 learned_addr learned my addr 172.21.15.53:0/4038795692 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f8563fff640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c157020 0x7f856c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796537845 0 0) 0x7f856c06d6e0 con 0x7f856c06d270 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8558005740 con 0x7f856c06d270 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2451069976 0 0) 0x7f8558005740 con 0x7f856c06d270 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c157020 msgr2=0x7f856c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:12.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f856c157020 0x7f856c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 >> v1:172.21.15.87:6789/0 conn(0x7f856c156c40 legacy=0x7f856c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0b1880 con 0x7f856c06d270 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8564001a00 con 0x7f856c06d270 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 >> v1:172.21.15.53:6789/0 conn(0x7f856c06d270 legacy=0x7f856c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8558005bc0 0x7f8558005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8558006570 0x7f8558006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558007240 0x7f855800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0b15a0 con 0x7f8558005bc0 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580078b0 con 0x7f8558006570 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855800e160 con 0x7f8558007240 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856affd640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8558005bc0 0x7f8558005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856b7fe640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558007240 0x7f855800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f8563fff640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8558006570 0x7f8558006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856affd640 1 -- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558007240 msgr2=0x7f855800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856affd640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558007240 0x7f855800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856affd640 1 -- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8558006570 msgr2=0x7f8558006a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856affd640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8558006570 0x7f8558006a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f856affd640 1 -- 172.21.15.53:0/4038795692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558005740 con 0x7f8558005bc0 2024-09-13T18:31:12.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.630+0000 7f8563fff640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8558006570 0x7f8558006a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:12.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f856affd640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8558005bc0 0x7f8558005fa0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8554001860 tx=0x7f855401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3b86955515d27d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540ab610 con 0x7f8558005bc0 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85540ab770 con 0x7f8558005bc0 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f856a7fc640 1 -- 172.21.15.53:0/4038795692 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540abb20 con 0x7f8558005bc0 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 -- 172.21.15.53:0/4038795692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8558005bc0 msgr2=0x7f8558005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 --2- 172.21.15.53:0/4038795692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8558005bc0 0x7f8558005fa0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f8554001860 tx=0x7f855401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f856b7fe640 1 -- 172.21.15.53:0/4038795692 reap_dead start 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 -- 172.21.15.53:0/4038795692 shutdown_connections 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 -- 172.21.15.53:0/4038795692 >> 172.21.15.53:0/4038795692 conn(0x7f856c065c80 msgr2=0x7f856c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 -- 172.21.15.53:0/4038795692 shutdown_connections 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 -- 172.21.15.53:0/4038795692 wait complete. 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 Processor -- start 2024-09-13T18:31:12.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 -- start start 2024-09-13T18:31:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.634+0000 7f85716e1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558005bc0 0x7f856c13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c15f510 0x7f856c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c15cc20 0x7f856c151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c15b450 con 0x7f856c15cc20 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c15abb0 con 0x7f856c15f510 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c15ae90 con 0x7f8558005bc0 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c15cc20 0x7f856c151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c15cc20 0x7f856c151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48804/0 (socket says 172.21.15.53:48804) 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 -- 172.21.15.53:0/1716896752 learned_addr learned my addr 172.21.15.53:0/1716896752 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f8563fff640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c15f510 0x7f856c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 -- 172.21.15.53:0/1716896752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558005bc0 msgr2=0x7f856c13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558005bc0 0x7f856c13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 -- 172.21.15.53:0/1716896752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c15f510 msgr2=0x7f856c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c15f510 0x7f856c15a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 -- 172.21.15.53:0/1716896752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c15b170 con 0x7f856c15cc20 2024-09-13T18:31:12.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856b7fe640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c15cc20 0x7f856c151b50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f856c066930 tx=0x7f856400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85637fe640 1 -- 172.21.15.53:0/1716896752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400ec10 con 0x7f856c15cc20 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85637fe640 1 -- 172.21.15.53:0/1716896752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400ed70 con 0x7f856c15cc20 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c147ea0 con 0x7f856c15cc20 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85637fe640 1 -- 172.21.15.53:0/1716896752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564013660 con 0x7f856c15cc20 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c140350 con 0x7f856c15cc20 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c147d00 con 0x7f856c15cc20 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85637fe640 1 -- 172.21.15.53:0/1716896752 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f85640137c0 con 0x7f856c15cc20 2024-09-13T18:31:12.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85637fe640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f854c0667e0 0x7f854c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f85637fe640 1 -- 172.21.15.53:0/1716896752 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8564084660 con 0x7f856c15cc20 2024-09-13T18:31:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856affd640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f854c0667e0 0x7f854c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:12.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.638+0000 7f856affd640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f854c0667e0 0x7f854c068ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f85540af000 tx=0x7f8554001240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:12.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.642+0000 7f85637fe640 1 -- 172.21.15.53:0/1716896752 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f856c147d00 con 0x7f856c15cc20 2024-09-13T18:31:12.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f856c147d00 con 0x7f856c15cc20 2024-09-13T18:31:12.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85637fe640 1 -- 172.21.15.53:0/1716896752 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f856c147d00 con 0x7f856c15cc20 2024-09-13T18:31:12.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f854c0667e0 msgr2=0x7f854c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f854c0667e0 0x7f854c068ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f85540af000 tx=0x7f8554001240 comp rx=0 tx=0).stop 2024-09-13T18:31:12.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c15cc20 msgr2=0x7f856c151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:12.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c15cc20 0x7f856c151b50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f856c066930 tx=0x7f856400e530 comp rx=0 tx=0).stop 2024-09-13T18:31:12.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 shutdown_connections 2024-09-13T18:31:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f854c0667e0 0x7f854c068ca0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f856c15cc20 0x7f856c151b50 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f856c15f510 0x7f856c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 --2- 172.21.15.53:0/1716896752 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8558005bc0 0x7f856c13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 >> 172.21.15.53:0/1716896752 conn(0x7f856c065c80 msgr2=0x7f856c0aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 shutdown_connections 2024-09-13T18:31:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:12.798+0000 7f85716e1640 1 -- 172.21.15.53:0/1716896752 wait complete. 2024-09-13T18:31:12.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:12.819 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0) 2024-09-13T18:31:12.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:12.842 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/fake) 2024-09-13T18:31:12.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:12.904 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:31:12.956 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:31:12.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:12.957 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0) 2024-09-13T18:31:13.015 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:13.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol78490/.meta 2024-09-13T18:31:13.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol78490 2024-09-13T18:31:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.250+0000 7f7426d3f640 1 Processor -- start 2024-09-13T18:31:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.250+0000 7f7426d3f640 1 -- start start 2024-09-13T18:31:13.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f7426d3f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f7426d3f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74200cd320 0x7f74200cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f7426d3f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742006f7a0 con 0x7f7420143e80 2024-09-13T18:31:13.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f7426d3f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742006baa0 con 0x7f74200cd320 2024-09-13T18:31:13.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f7426d3f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742006fd60 con 0x7f74200caee0 2024-09-13T18:31:13.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f741ffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74200cd320 0x7f74200cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74200cd320 0x7f74200cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:53402/0 (socket says 172.21.15.53:53402) 2024-09-13T18:31:13.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 -- 172.21.15.53:0/2784706771 learned_addr learned my addr 172.21.15.53:0/2784706771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 -- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 msgr2=0x7f74200cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 --2- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 -- 172.21.15.53:0/2784706771 >> v1:172.21.15.87:6789/0 conn(0x7f7420143e80 legacy=0x7f742006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 -- 172.21.15.53:0/2784706771 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200cb960 con 0x7f74200cd320 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f741ffff640 1 --2- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.254+0000 7f74252dc640 1 --2- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f74200cd7b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7418009e50 tx=0x7f741801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0345b6c5a13779 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f741f7fe640 1 -- 172.21.15.53:0/2784706771 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180a5830 con 0x7f74200cd320 2024-09-13T18:31:13.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f741f7fe640 1 -- 172.21.15.53:0/2784706771 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74180a5990 con 0x7f74200cd320 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f741f7fe640 1 -- 172.21.15.53:0/2784706771 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180a5d20 con 0x7f74200cd320 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 msgr2=0x7f74200cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 --2- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f74200cd7b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7418009e50 tx=0x7f741801c970 comp rx=0 tx=0).stop 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- 172.21.15.53:0/2784706771 shutdown_connections 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 --2- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f74200cd7b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 --2- 172.21.15.53:0/2784706771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- 172.21.15.53:0/2784706771 >> 172.21.15.53:0/2784706771 conn(0x7f7420065c80 msgr2=0x7f7420066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- 172.21.15.53:0/2784706771 shutdown_connections 2024-09-13T18:31:13.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- 172.21.15.53:0/2784706771 wait complete. 2024-09-13T18:31:13.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 Processor -- start 2024-09-13T18:31:13.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- start start 2024-09-13T18:31:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f7420140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7420143e80 0x7f7420137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74200b34a0 con 0x7f7420143e80 2024-09-13T18:31:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742015cd30 con 0x7f74200cd320 2024-09-13T18:31:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7426d3f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742015d010 con 0x7f74200caee0 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f74252dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7420143e80 0x7f7420137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f74252dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7420143e80 0x7f7420137ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48820/0 (socket says 172.21.15.53:48820) 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f74252dc640 1 -- 172.21.15.53:0/1354865377 learned_addr learned my addr 172.21.15.53:0/1354865377 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f741ffff640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f7420140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f7424adb640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.258+0000 7f74252dc640 1 -- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 msgr2=0x7f74200b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f74252dc640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f74252dc640 1 -- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 msgr2=0x7f7420140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f74252dc640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f7420140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f74252dc640 1 -- 172.21.15.53:0/1354865377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009420 con 0x7f7420143e80 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f741ffff640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f7420140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f74252dc640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7420143e80 0x7f7420137ad0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f74180af040 tx=0x7f7418019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f741d7fa640 1 -- 172.21.15.53:0/1354865377 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180bd070 con 0x7f7420143e80 2024-09-13T18:31:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f741d7fa640 1 -- 172.21.15.53:0/1354865377 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74180b8470 con 0x7f7420143e80 2024-09-13T18:31:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7418009b30 con 0x7f7420143e80 2024-09-13T18:31:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f741d7fa640 1 -- 172.21.15.53:0/1354865377 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180b8800 con 0x7f7420143e80 2024-09-13T18:31:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742015d5d0 con 0x7f7420143e80 2024-09-13T18:31:13.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74200cb320 con 0x7f7420143e80 2024-09-13T18:31:13.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f741d7fa640 1 -- 172.21.15.53:0/1354865377 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f74180b8960 con 0x7f7420143e80 2024-09-13T18:31:13.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f741d7fa640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f740c0667b0 0x7f740c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f741d7fa640 1 -- 172.21.15.53:0/1354865377 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f741811fc40 con 0x7f7420143e80 2024-09-13T18:31:13.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.262+0000 7f7424adb640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f740c0667b0 0x7f740c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.266+0000 7f7424adb640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f740c0667b0 0x7f740c068c70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7410000f70 tx=0x7f7410009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:13.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.266+0000 7f741d7fa640 1 -- 172.21.15.53:0/1354865377 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74180ecef0 con 0x7f7420143e80 2024-09-13T18:31:13.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.454+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol78490", "target": ["mon-mgr", ""]}) v1 -- 0x7f74200ce160 con 0x7f740c0667b0 2024-09-13T18:31:13.463 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:13.462+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:13.463 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:13.462+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:13.464 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:13.462+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:13.464 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:13.462+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:13.464 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:13.462+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:13.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.578+0000 7f741d7fa640 1 -- 172.21.15.53:0/1354865377 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f74100012f0 con 0x7f740c0667b0 2024-09-13T18:31:13.580 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0 2024-09-13T18:31:13.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f740c0667b0 msgr2=0x7f740c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f740c0667b0 0x7f740c068c70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7410000f70 tx=0x7f7410009040 comp rx=0 tx=0).stop 2024-09-13T18:31:13.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7420143e80 msgr2=0x7f7420137ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7420143e80 0x7f7420137ad0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f74180af040 tx=0x7f7418019710 comp rx=0 tx=0).stop 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 shutdown_connections 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f740c0667b0 0x7f740c068c70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7420143e80 0x7f7420137ad0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74200cd320 0x7f7420140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 --2- 172.21.15.53:0/1354865377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74200caee0 0x7f74200b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 >> 172.21.15.53:0/1354865377 conn(0x7f7420065c80 msgr2=0x7f74200a8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 shutdown_connections 2024-09-13T18:31:13.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.582+0000 7f7426d3f640 1 -- 172.21.15.53:0/1354865377 wait complete. 2024-09-13T18:31:13.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-13T18:31:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.722+0000 7fba49146640 1 Processor -- start 2024-09-13T18:31:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.722+0000 7fba49146640 1 -- start start 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba44066390 0x7fba440b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fba4406d420 0x7fba440ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440acf30 con 0x7fba44146150 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4406db90 con 0x7fba44066390 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4406de70 con 0x7fba4406d420 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba3bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba44066390 0x7fba440b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba42d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fba44146150 0x7fba44065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45142/0 (socket says 172.21.15.53:45142) 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba42d9d640 1 -- 172.21.15.53:0/3165557019 learned_addr learned my addr 172.21.15.53:0/3165557019 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba4359e640 1 --2- 172.21.15.53:0/3165557019 >> v2:172.21.15.87:3300/0 conn(0x7fba4406d420 0x7fba440ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba3bfff640 1 -- 172.21.15.53:0/3165557019 >> v2:172.21.15.87:3300/0 conn(0x7fba4406d420 msgr2=0x7fba440ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba3bfff640 1 --2- 172.21.15.53:0/3165557019 >> v2:172.21.15.87:3300/0 conn(0x7fba4406d420 0x7fba440ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba3bfff640 1 -- 172.21.15.53:0/3165557019 >> v1:172.21.15.53:6789/0 conn(0x7fba44146150 legacy=0x7fba44065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba3bfff640 1 -- 172.21.15.53:0/3165557019 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4406e150 con 0x7fba44066390 2024-09-13T18:31:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba3bfff640 1 --2- 172.21.15.53:0/3165557019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44066390 0x7fba440b33d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fba4406fe40 tx=0x7fba2c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05f19bfa5ae388d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba4259c640 1 -- 172.21.15.53:0/3165557019 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0ab600 con 0x7fba44066390 2024-09-13T18:31:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba4259c640 1 -- 172.21.15.53:0/3165557019 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c0a7050 con 0x7fba44066390 2024-09-13T18:31:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba4259c640 1 -- 172.21.15.53:0/3165557019 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0ab980 con 0x7fba44066390 2024-09-13T18:31:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- 172.21.15.53:0/3165557019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44066390 msgr2=0x7fba440b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 --2- 172.21.15.53:0/3165557019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44066390 0x7fba440b33d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fba4406fe40 tx=0x7fba2c01c310 comp rx=0 tx=0).stop 2024-09-13T18:31:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- 172.21.15.53:0/3165557019 shutdown_connections 2024-09-13T18:31:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 --2- 172.21.15.53:0/3165557019 >> v2:172.21.15.87:3300/0 conn(0x7fba4406d420 0x7fba440ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 --2- 172.21.15.53:0/3165557019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44066390 0x7fba440b33d0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- 172.21.15.53:0/3165557019 >> 172.21.15.53:0/3165557019 conn(0x7fba440b1310 msgr2=0x7fba440b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- 172.21.15.53:0/3165557019 shutdown_connections 2024-09-13T18:31:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.726+0000 7fba49146640 1 -- 172.21.15.53:0/3165557019 wait complete. 2024-09-13T18:31:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 Processor -- start 2024-09-13T18:31:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 -- start start 2024-09-13T18:31:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba44066390 0x7fba44138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba4406d420 0x7fba44140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44146150 0x7fba44137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44140540 con 0x7fba44146150 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4413f290 con 0x7fba44066390 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44139560 con 0x7fba4406d420 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44146150 0x7fba44137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44146150 0x7fba44137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48856/0 (socket says 172.21.15.53:48856) 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 -- 172.21.15.53:0/4153585757 learned_addr learned my addr 172.21.15.53:0/4153585757 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba42d9d640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba44066390 0x7fba44138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba3bfff640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba4406d420 0x7fba44140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 -- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba4406d420 msgr2=0x7fba44140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba4406d420 0x7fba44140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 -- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba44066390 msgr2=0x7fba44138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba44066390 0x7fba44138ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 -- 172.21.15.53:0/4153585757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c009420 con 0x7fba44146150 2024-09-13T18:31:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba4359e640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44146150 0x7fba44137830 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007e40 tx=0x7fba3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba3b7fe640 1 -- 172.21.15.53:0/4153585757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c014620 con 0x7fba44146150 2024-09-13T18:31:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba3b7fe640 1 -- 172.21.15.53:0/4153585757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c00ee90 con 0x7fba44146150 2024-09-13T18:31:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba3b7fe640 1 -- 172.21.15.53:0/4153585757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0149e0 con 0x7fba44146150 2024-09-13T18:31:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4413f4e0 con 0x7fba44146150 2024-09-13T18:31:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4413faa0 con 0x7fba44146150 2024-09-13T18:31:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.730+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44144aa0 con 0x7fba44146150 2024-09-13T18:31:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.734+0000 7fba3b7fe640 1 -- 172.21.15.53:0/4153585757 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7fba3c014b40 con 0x7fba44146150 2024-09-13T18:31:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.734+0000 7fba3b7fe640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba240667b0 0x7fba24068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.734+0000 7fba3b7fe640 1 -- 172.21.15.53:0/4153585757 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba3c084d00 con 0x7fba44146150 2024-09-13T18:31:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.734+0000 7fba42d9d640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba240667b0 0x7fba24068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.734+0000 7fba42d9d640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba240667b0 0x7fba24068c70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba34000f70 tx=0x7fba34007c30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:13.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.738+0000 7fba3b7fe640 1 -- 172.21.15.53:0/4153585757 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba3c051f60 con 0x7fba44146150 2024-09-13T18:31:13.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.914+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fba441447c0 con 0x7fba240667b0 2024-09-13T18:31:13.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba3b7fe640 1 -- 172.21.15.53:0/4153585757 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fba441447c0 con 0x7fba240667b0 2024-09-13T18:31:13.922 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:31:13.923 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:13.923 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "subvol78490" 2024-09-13T18:31:13.923 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:13.923 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:31:13.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba240667b0 msgr2=0x7fba24068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba240667b0 0x7fba24068c70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba34000f70 tx=0x7fba34007c30 comp rx=0 tx=0).stop 2024-09-13T18:31:13.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44146150 msgr2=0x7fba44137830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:13.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44146150 0x7fba44137830 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007e40 tx=0x7fba3c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 shutdown_connections 2024-09-13T18:31:13.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba240667b0 0x7fba24068c70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba4406d420 0x7fba44140000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba44146150 0x7fba44137830 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 --2- 172.21.15.53:0/4153585757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba44066390 0x7fba44138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:13.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 >> 172.21.15.53:0/4153585757 conn(0x7fba440b1310 msgr2=0x7fba44143260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:13.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 shutdown_connections 2024-09-13T18:31:13.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:13.922+0000 7fba49146640 1 -- 172.21.15.53:0/4153585757 wait complete. 2024-09-13T18:31:13.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol78490 2024-09-13T18:31:14.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa993d640 1 Processor -- start 2024-09-13T18:31:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa993d640 1 -- start start 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa993d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4160300 0x7fafa41606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa993d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafa40cf6a0 0x7fafa4160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa993d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa4161160 con 0x7fafa415c9e0 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa993d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40aff30 con 0x7fafa40cf6a0 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa993d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa406ac90 con 0x7fafa4160300 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafa40cf6a0 0x7fafa4160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafa40cf6a0 0x7fafa4160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48858/0 (socket says 172.21.15.53:48858) 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa37fe640 1 -- 172.21.15.53:0/2816878346 learned_addr learned my addr 172.21.15.53:0/2816878346 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa2ffd640 1 --2- 172.21.15.53:0/2816878346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4160300 0x7fafa41606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa37fe640 1 -- 172.21.15.53:0/2816878346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4160300 msgr2=0x7fafa41606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:14.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa37fe640 1 --2- 172.21.15.53:0/2816878346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4160300 0x7fafa41606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa37fe640 1 -- 172.21.15.53:0/2816878346 >> v1:172.21.15.87:6789/0 conn(0x7fafa415c9e0 legacy=0x7fafa40b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:14.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.066+0000 7fafa37fe640 1 -- 172.21.15.53:0/2816878346 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa406af70 con 0x7fafa40cf6a0 2024-09-13T18:31:14.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa37fe640 1 --2- 172.21.15.53:0/2816878346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa40cf6a0 0x7fafa4160c20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009e50 tx=0x7faf9c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed598f93705fc0bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa27fc640 1 -- 172.21.15.53:0/2816878346 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0a5700 con 0x7fafa40cf6a0 2024-09-13T18:31:14.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa27fc640 1 -- 172.21.15.53:0/2816878346 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0a5860 con 0x7fafa40cf6a0 2024-09-13T18:31:14.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa27fc640 1 -- 172.21.15.53:0/2816878346 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0a5bf0 con 0x7fafa40cf6a0 2024-09-13T18:31:14.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- 172.21.15.53:0/2816878346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa40cf6a0 msgr2=0x7fafa4160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 --2- 172.21.15.53:0/2816878346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa40cf6a0 0x7fafa4160c20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009e50 tx=0x7faf9c01c9f0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- 172.21.15.53:0/2816878346 shutdown_connections 2024-09-13T18:31:14.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 --2- 172.21.15.53:0/2816878346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa40cf6a0 0x7fafa4160c20 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 --2- 172.21.15.53:0/2816878346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa4160300 0x7fafa41606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- 172.21.15.53:0/2816878346 >> 172.21.15.53:0/2816878346 conn(0x7fafa40b20d0 msgr2=0x7fafa40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- 172.21.15.53:0/2816878346 shutdown_connections 2024-09-13T18:31:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- 172.21.15.53:0/2816878346 wait complete. 2024-09-13T18:31:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 Processor -- start 2024-09-13T18:31:14.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- start start 2024-09-13T18:31:14.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa40cf6a0 0x7fafa41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa415c9e0 0x7fafa40b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa4160300 0x7fafa40c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40ca730 con 0x7fafa4160300 2024-09-13T18:31:14.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b4af0 con 0x7fafa415c9e0 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.070+0000 7fafa993d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b4dd0 con 0x7fafa40cf6a0 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa4160300 0x7fafa40c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa4160300 0x7fafa40c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48874/0 (socket says 172.21.15.53:48874) 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 -- 172.21.15.53:0/410429219 learned_addr learned my addr 172.21.15.53:0/410429219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa2ffd640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa40cf6a0 0x7fafa41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7faf9bfff640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa415c9e0 0x7fafa40b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 -- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa40cf6a0 msgr2=0x7fafa41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa40cf6a0 0x7fafa41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 -- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa415c9e0 msgr2=0x7fafa40b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa415c9e0 0x7fafa40b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 -- 172.21.15.53:0/410429219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009b30 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa37fe640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa4160300 0x7fafa40c7ee0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0af040 tx=0x7faf9c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa0ff9640 1 -- 172.21.15.53:0/410429219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0b8670 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa0ff9640 1 -- 172.21.15.53:0/410429219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0b87f0 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa0ff9640 1 -- 172.21.15.53:0/410429219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0b8ba0 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa40b50b0 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40b5670 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa40b06f0 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa0ff9640 1 -- 172.21.15.53:0/410429219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7faf9c0b8d00 con 0x7fafa4160300 2024-09-13T18:31:14.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa0ff9640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7faf840667b0 0x7faf84068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa0ff9640 1 -- 172.21.15.53:0/410429219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf9c11f940 con 0x7fafa4160300 2024-09-13T18:31:14.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa2ffd640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7faf840667b0 0x7faf84068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.074+0000 7fafa2ffd640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7faf840667b0 0x7faf84068c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf9400a8d0 tx=0x7faf94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.078+0000 7fafa0ff9640 1 -- 172.21.15.53:0/410429219 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf9c0ece00 con 0x7fafa4160300 2024-09-13T18:31:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.270+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol78490", "target": ["mon-mgr", ""]}) v1 -- 0x7fafa4073100 con 0x7faf840667b0 2024-09-13T18:31:14.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.290+0000 7fafa0ff9640 1 -- 172.21.15.53:0/410429219 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+684 (secure 0 0 0) 0x7fafa4073100 con 0x7faf840667b0 2024-09-13T18:31:14.293 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:14.293 INFO:teuthology.orchestra.run.smithi053.stdout: "atime": "2024-09-13 18:31:12", 2024-09-13T18:31:14.293 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_pcent": "undefined", 2024-09-13T18:31:14.293 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_quota": "infinite", 2024-09-13T18:31:14.293 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_used": 0, 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "created_at": "2024-09-13 18:31:12", 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "ctime": "2024-09-13 18:31:13", 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "data_pool": "cephfs_data", 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "features": [ 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot-clone", 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot-autoprotect" 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "flavor": 1, 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "gid": 0, 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": 16877, 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_addrs": [ 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.53:6789", 2024-09-13T18:31:14.294 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.87:6789", 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.87:6790" 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-13 18:31:12", 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0", 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_namespace": "", 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "complete", 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "subvolume", 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout: "uid": 0 2024-09-13T18:31:14.295 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7faf840667b0 msgr2=0x7faf84068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7faf840667b0 0x7faf84068c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf9400a8d0 tx=0x7faf94008040 comp rx=0 tx=0).stop 2024-09-13T18:31:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa4160300 msgr2=0x7fafa40c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa4160300 0x7fafa40c7ee0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0af040 tx=0x7faf9c019790 comp rx=0 tx=0).stop 2024-09-13T18:31:14.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 shutdown_connections 2024-09-13T18:31:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7faf840667b0 0x7faf84068c70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafa4160300 0x7fafa40c7ee0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafa415c9e0 0x7fafa40b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 --2- 172.21.15.53:0/410429219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafa40cf6a0 0x7fafa41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 >> 172.21.15.53:0/410429219 conn(0x7fafa40b20d0 msgr2=0x7fafa40ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 shutdown_connections 2024-09-13T18:31:14.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.294+0000 7fafa993d640 1 -- 172.21.15.53:0/410429219 wait complete. 2024-09-13T18:31:14.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvol78490 10485760 2024-09-13T18:31:14.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f26623f4640 1 Processor -- start 2024-09-13T18:31:14.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f26623f4640 1 -- start start 2024-09-13T18:31:14.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f26623f4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f265c0cdad0 0x7f265c143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f26623f4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f26623f4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265c0b1ba0 con 0x7f265c0cd6f0 2024-09-13T18:31:14.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f26623f4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c0b3020 con 0x7f265c0cdad0 2024-09-13T18:31:14.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f26623f4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0b1f80 con 0x7f265c143d50 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f2660991640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f265b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f265c0cdad0 0x7f265c143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f2660991640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c06b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:32818/0 (socket says 172.21.15.53:32818) 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f2660991640 1 -- 172.21.15.53:0/1176164905 learned_addr learned my addr 172.21.15.53:0/1176164905 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f265bfff640 1 --1- 172.21.15.53:0/1176164905 >> v1:172.21.15.87:6789/0 conn(0x7f265c0cd6f0 0x7f265c0b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:36206/0 (socket says 172.21.15.53:36206) 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f2660991640 1 -- 172.21.15.53:0/1176164905 >> v2:172.21.15.87:3300/0 conn(0x7f265c0cdad0 msgr2=0x7f265c143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f2660991640 1 --2- 172.21.15.53:0/1176164905 >> v2:172.21.15.87:3300/0 conn(0x7f265c0cdad0 0x7f265c143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f2660991640 1 -- 172.21.15.53:0/1176164905 >> v1:172.21.15.87:6789/0 conn(0x7f265c0cd6f0 legacy=0x7f265c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.442+0000 7f2660991640 1 -- 172.21.15.53:0/1176164905 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c0b2260 con 0x7f265c143d50 2024-09-13T18:31:14.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f2660991640 1 --2- 172.21.15.53:0/1176164905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c06b320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2654009e50 tx=0x7f265401ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d565bef2c048eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f265affd640 1 -- 172.21.15.53:0/1176164905 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540a58d0 con 0x7f265c143d50 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f265affd640 1 -- 172.21.15.53:0/1176164905 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26540a5a30 con 0x7f265c143d50 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f265affd640 1 -- 172.21.15.53:0/1176164905 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540a5dc0 con 0x7f265c143d50 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- 172.21.15.53:0/1176164905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 msgr2=0x7f265c06b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 --2- 172.21.15.53:0/1176164905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c06b320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2654009e50 tx=0x7f265401ca00 comp rx=0 tx=0).stop 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- 172.21.15.53:0/1176164905 shutdown_connections 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 --2- 172.21.15.53:0/1176164905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c06b320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 --2- 172.21.15.53:0/1176164905 >> v2:172.21.15.87:3300/0 conn(0x7f265c0cdad0 0x7f265c143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- 172.21.15.53:0/1176164905 >> 172.21.15.53:0/1176164905 conn(0x7f265c073330 msgr2=0x7f265c065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- 172.21.15.53:0/1176164905 shutdown_connections 2024-09-13T18:31:14.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- 172.21.15.53:0/1176164905 wait complete. 2024-09-13T18:31:14.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 Processor -- start 2024-09-13T18:31:14.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- start start 2024-09-13T18:31:14.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f265c0cd6f0 0x7f265c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f265c0cdad0 0x7f265c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c13f7a0 con 0x7f265c0cd6f0 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0acea0 con 0x7f265c0cdad0 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f26623f4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0abe00 con 0x7f265c143d50 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f265bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f265c0cd6f0 0x7f265c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f265bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f265c0cd6f0 0x7f265c15b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48888/0 (socket says 172.21.15.53:48888) 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f265bfff640 1 -- 172.21.15.53:0/373976681 learned_addr learned my addr 172.21.15.53:0/373976681 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f2660991640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.446+0000 7f265b7fe640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f265c0cdad0 0x7f265c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265bfff640 1 -- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 msgr2=0x7f265c15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265bfff640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265bfff640 1 -- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f265c0cdad0 msgr2=0x7f265c15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265bfff640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f265c0cdad0 0x7f265c15bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265bfff640 1 -- 172.21.15.53:0/373976681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2654009b30 con 0x7f265c0cd6f0 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265bfff640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f265c0cd6f0 0x7f265c15b960 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c460 tx=0x7f264c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f2658ff9640 1 -- 172.21.15.53:0/373976681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c007480 con 0x7f265c0cd6f0 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f2658ff9640 1 -- 172.21.15.53:0/373976681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c007600 con 0x7f265c0cd6f0 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c0ac0e0 con 0x7f265c0cd6f0 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f2658ff9640 1 -- 172.21.15.53:0/373976681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c004a30 con 0x7f265c0cd6f0 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c0ac6a0 con 0x7f265c0cd6f0 2024-09-13T18:31:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c143810 con 0x7f265c0cd6f0 2024-09-13T18:31:14.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f2658ff9640 1 -- 172.21.15.53:0/373976681 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f264c004b90 con 0x7f265c0cd6f0 2024-09-13T18:31:14.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f2658ff9640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f26480667b0 0x7f2648068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f2658ff9640 1 -- 172.21.15.53:0/373976681 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f264c083770 con 0x7f265c0cd6f0 2024-09-13T18:31:14.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265b7fe640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f26480667b0 0x7f2648068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.450+0000 7f265b7fe640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f26480667b0 0x7f2648068c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f265c1649c0 tx=0x7f2650008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.454+0000 7f2658ff9640 1 -- 172.21.15.53:0/373976681 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f264c0509d0 con 0x7f265c0cd6f0 2024-09-13T18:31:14.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.638+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "cephfs", "sub_name": "subvol78490", "new_size": "10485760", "target": ["mon-mgr", ""]}) v1 -- 0x7f265c0cbdd0 con 0x7f26480667b0 2024-09-13T18:31:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f2658ff9640 1 -- 172.21.15.53:0/373976681 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+128 (secure 0 0 0) 0x7f2650011950 con 0x7f26480667b0 2024-09-13T18:31:14.663 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:31:14.663 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_used": 0 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_quota": 10485760 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_pcent": "0.00" 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:14.664 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:31:14.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f26480667b0 msgr2=0x7f2648068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f26480667b0 0x7f2648068c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f265c1649c0 tx=0x7f2650008040 comp rx=0 tx=0).stop 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f265c0cd6f0 msgr2=0x7f265c15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f265c0cd6f0 0x7f265c15b960 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c460 tx=0x7f264c00c920 comp rx=0 tx=0).stop 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 shutdown_connections 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f26480667b0 0x7f2648068c70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f265c143d50 0x7f265c15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f265c0cdad0 0x7f265c15bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 --2- 172.21.15.53:0/373976681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f265c0cd6f0 0x7f265c15b960 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 >> 172.21.15.53:0/373976681 conn(0x7f265c073330 msgr2=0x7f265c140740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 shutdown_connections 2024-09-13T18:31:14.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.662+0000 7f26623f4640 1 -- 172.21.15.53:0/373976681 wait complete. 2024-09-13T18:31:14.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol78490 2024-09-13T18:31:14.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5653d46640 1 Processor -- start 2024-09-13T18:31:14.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5653d46640 1 -- start start 2024-09-13T18:31:14.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5653d46640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 0x7f564c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5653d46640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564c06f7a0 con 0x7f564c0caee0 2024-09-13T18:31:14.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5653d46640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564c06fd60 con 0x7f564c0cda30 2024-09-13T18:31:14.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5653d46640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0cb960 con 0x7f564c143e80 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f56512e1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f564c0caee0 0x7f564c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45158/0 (socket says 172.21.15.53:45158) 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f56512e1640 1 -- 172.21.15.53:0/4219783592 learned_addr learned my addr 172.21.15.53:0/4219783592 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5651ae2640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 0x7f564c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704724811 0 0) 0x7f564c06f7a0 con 0x7f564c0caee0 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5634003530 con 0x7f564c0caee0 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3122339111 0 0) 0x7f5634003530 con 0x7f564c0caee0 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 msgr2=0x7f564c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 0x7f564c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 >> v1:172.21.15.87:6789/0 conn(0x7f564c0cda30 legacy=0x7f564c0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0cbc40 con 0x7f564c0caee0 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5640001680 con 0x7f564c0caee0 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 >> v1:172.21.15.53:6789/0 conn(0x7f564c0caee0 legacy=0x7f564c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340039b0 0x7f5634003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 0x7f56340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5634004d10 0x7f5634005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0cb960 con 0x7f56340039b0 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563400ba40 con 0x7f5634004d10 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563400bc00 con 0x7f564c143e80 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5651ae2640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340039b0 0x7f5634003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f56512e1640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 0x7f56340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f56522e3640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5634004d10 0x7f5634005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5651ae2640 1 -- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 msgr2=0x7f56340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5651ae2640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c143e80 0x7f56340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5651ae2640 1 -- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5634004d10 msgr2=0x7f5634005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5651ae2640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5634004d10 0x7f5634005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.802+0000 7f5651ae2640 1 -- 172.21.15.53:0/4219783592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634003530 con 0x7f56340039b0 2024-09-13T18:31:14.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f56522e3640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5634004d10 0x7f5634005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:14.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5651ae2640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340039b0 0x7f5634003d90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5644009fc0 tx=0x7f564401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0723bcfb5a3dec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56440a5c60 con 0x7f56340039b0 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400f040 con 0x7f56340039b0 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5650ae0640 1 -- 172.21.15.53:0/4219783592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56440ad440 con 0x7f56340039b0 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5653d46640 1 -- 172.21.15.53:0/4219783592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340039b0 msgr2=0x7f5634003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5653d46640 1 --2- 172.21.15.53:0/4219783592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340039b0 0x7f5634003d90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5644009fc0 tx=0x7f564401cc50 comp rx=0 tx=0).stop 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f56522e3640 1 -- 172.21.15.53:0/4219783592 reap_dead start 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5653d46640 1 -- 172.21.15.53:0/4219783592 shutdown_connections 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5653d46640 1 -- 172.21.15.53:0/4219783592 >> 172.21.15.53:0/4219783592 conn(0x7f564c065c80 msgr2=0x7f564c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5653d46640 1 -- 172.21.15.53:0/4219783592 shutdown_connections 2024-09-13T18:31:14.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.806+0000 7f5653d46640 1 -- 172.21.15.53:0/4219783592 wait complete. 2024-09-13T18:31:14.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 Processor -- start 2024-09-13T18:31:14.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 -- start start 2024-09-13T18:31:14.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56340039b0 0x7f564c142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f564c142e70 0x7f564c1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c15a5a0 0x7f564c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c163bc0 con 0x7f564c142e70 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c15af60 con 0x7f56340039b0 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c158e00 con 0x7f564c15a5a0 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f564c142e70 0x7f564c1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f564c142e70 0x7f564c1585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48908/0 (socket says 172.21.15.53:48908) 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 -- 172.21.15.53:0/627913065 learned_addr learned my addr 172.21.15.53:0/627913065 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5651ae2640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56340039b0 0x7f564c142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56522e3640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c15a5a0 0x7f564c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 -- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c15a5a0 msgr2=0x7f564c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c15a5a0 0x7f564c15aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 -- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56340039b0 msgr2=0x7f564c142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56340039b0 0x7f564c142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 -- 172.21.15.53:0/627913065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c1590e0 con 0x7f564c142e70 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56522e3640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c15a5a0 0x7f564c15aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f56512e1640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f564c142e70 0x7f564c1585b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f56400010f0 tx=0x7f564000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f564a7fc640 1 -- 172.21.15.53:0/627913065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564000c870 con 0x7f564c142e70 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f564a7fc640 1 -- 172.21.15.53:0/627913065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564000c9d0 con 0x7f564c142e70 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c1593c0 con 0x7f564c142e70 2024-09-13T18:31:14.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c159980 con 0x7f564c142e70 2024-09-13T18:31:14.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f564a7fc640 1 -- 172.21.15.53:0/627913065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564000cd80 con 0x7f564c142e70 2024-09-13T18:31:14.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c159ba0 con 0x7f564c142e70 2024-09-13T18:31:14.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f564a7fc640 1 -- 172.21.15.53:0/627913065 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 86194+0+0 (secure 0 0 0) 0x7f5640013420 con 0x7f564c142e70 2024-09-13T18:31:14.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.810+0000 7f564a7fc640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56380667e0 0x7f5638068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:14.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.814+0000 7f564a7fc640 1 -- 172.21.15.53:0/627913065 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5640083fc0 con 0x7f564c142e70 2024-09-13T18:31:14.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.814+0000 7f5651ae2640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56380667e0 0x7f5638068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:14.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.814+0000 7f5651ae2640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56380667e0 0x7f5638068ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56440af000 tx=0x7f5644004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:14.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:14.818+0000 7f564a7fc640 1 -- 172.21.15.53:0/627913065 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56400b5db0 con 0x7f564c142e70 2024-09-13T18:31:15.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.002+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol78490", "target": ["mon-mgr", ""]}) v1 -- 0x7f564c0cb6d0 con 0x7f56380667e0 2024-09-13T18:31:15.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f564a7fc640 1 -- 172.21.15.53:0/627913065 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+677 (secure 0 0 0) 0x7f56440a5c20 con 0x7f56380667e0 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "atime": "2024-09-13 18:31:12", 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_pcent": "0.00", 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_quota": 10485760, 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_used": 0, 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "created_at": "2024-09-13 18:31:12", 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "ctime": "2024-09-13 18:31:14", 2024-09-13T18:31:15.139 INFO:teuthology.orchestra.run.smithi053.stdout: "data_pool": "cephfs_data", 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "features": [ 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot-clone", 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot-autoprotect" 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "flavor": 1, 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "gid": 0, 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": 16877, 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_addrs": [ 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.53:6789", 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.87:6789", 2024-09-13T18:31:15.140 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.87:6790" 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-13 18:31:12", 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0", 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_namespace": "", 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "complete", 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "subvolume", 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout: "uid": 0 2024-09-13T18:31:15.141 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56380667e0 msgr2=0x7f5638068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56380667e0 0x7f5638068ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56440af000 tx=0x7f5644004ac0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f564c142e70 msgr2=0x7f564c1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f564c142e70 0x7f564c1585b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f56400010f0 tx=0x7f564000eca0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 shutdown_connections 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56380667e0 0x7f5638068ca0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f564c15a5a0 0x7f564c15aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f564c142e70 0x7f564c1585b0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 --2- 172.21.15.53:0/627913065 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56340039b0 0x7f564c142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 >> 172.21.15.53:0/627913065 conn(0x7f564c065c80 msgr2=0x7f564c1563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:15.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 shutdown_connections 2024-09-13T18:31:15.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.026+0000 7f5653d46640 1 -- 172.21.15.53:0/627913065 wait complete. 2024-09-13T18:31:15.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol78490 --mode 777 --uid 1000 --gid 1000 2024-09-13T18:31:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb2a229640 1 Processor -- start 2024-09-13T18:31:15.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb2a229640 1 -- start start 2024-09-13T18:31:15.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb2a229640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb24143e80 0x7ffb2406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb2a229640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 0x7ffb240cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb2a229640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2406f7a0 con 0x7ffb240cd320 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb2a229640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2406fd60 con 0x7ffb24143e80 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb2a229640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240cb960 con 0x7ffb240caee0 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb23fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb240cd320 0x7ffb240cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45160/0 (socket says 172.21.15.53:45160) 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb23fff640 1 -- 172.21.15.53:0/3890037403 learned_addr learned my addr 172.21.15.53:0/3890037403 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb237fe640 1 --2- 172.21.15.53:0/3890037403 >> v2:172.21.15.87:3300/0 conn(0x7ffb24143e80 0x7ffb2406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 0x7ffb240cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379466781 0 0) 0x7ffb2406f7a0 con 0x7ffb240cd320 2024-09-13T18:31:15.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb0c003530 con 0x7ffb240cd320 2024-09-13T18:31:15.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1610756503 0 0) 0x7ffb0c003530 con 0x7ffb240cd320 2024-09-13T18:31:15.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 msgr2=0x7ffb240cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:15.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 0x7ffb240cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 >> v2:172.21.15.87:3300/0 conn(0x7ffb24143e80 msgr2=0x7ffb2406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 --2- 172.21.15.53:0/3890037403 >> v2:172.21.15.87:3300/0 conn(0x7ffb24143e80 0x7ffb2406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240cbc40 con 0x7ffb240cd320 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ffb1c001a00 con 0x7ffb240cd320 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 >> v1:172.21.15.53:6789/0 conn(0x7ffb240cd320 legacy=0x7ffb240cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb0c003980 0x7ffb0c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0047d0 0x7ffb0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 0x7ffb0c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2406fd60 con 0x7ffb0c0047d0 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240cb960 con 0x7ffb0c003980 2024-09-13T18:31:15.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c00b9c0 con 0x7ffb240caee0 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0047d0 0x7ffb0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb237fe640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb0c003980 0x7ffb0c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb23fff640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 0x7ffb0c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb22ffd640 1 -- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 msgr2=0x7ffb0c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb240caee0 0x7ffb0c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb22ffd640 1 -- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb0c003980 msgr2=0x7ffb0c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb0c003980 0x7ffb0c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.290+0000 7ffb22ffd640 1 -- 172.21.15.53:0/3890037403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c003530 con 0x7ffb0c0047d0 2024-09-13T18:31:15.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0047d0 0x7ffb0c004c50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009ae0 tx=0x7ffb1801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e809c665935d09fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:15.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180a6450 con 0x7ffb0c0047d0 2024-09-13T18:31:15.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb180a65b0 con 0x7ffb0c0047d0 2024-09-13T18:31:15.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb227fc640 1 -- 172.21.15.53:0/3890037403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180a6960 con 0x7ffb0c0047d0 2024-09-13T18:31:15.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 -- 172.21.15.53:0/3890037403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0047d0 msgr2=0x7ffb0c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 --2- 172.21.15.53:0/3890037403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0047d0 0x7ffb0c004c50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009ae0 tx=0x7ffb1801c9e0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb23fff640 1 -- 172.21.15.53:0/3890037403 reap_dead start 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 -- 172.21.15.53:0/3890037403 shutdown_connections 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 -- 172.21.15.53:0/3890037403 >> 172.21.15.53:0/3890037403 conn(0x7ffb24065c80 msgr2=0x7ffb24066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 -- 172.21.15.53:0/3890037403 shutdown_connections 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 -- 172.21.15.53:0/3890037403 wait complete. 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 Processor -- start 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.294+0000 7ffb2a229640 1 -- start start 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb0c0047d0 0x7ffb2413a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2413e8b0 0x7ffb2415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2415c520 0x7ffb240b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2413e420 con 0x7ffb2413e8b0 2024-09-13T18:31:15.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2413d830 con 0x7ffb2415c520 2024-09-13T18:31:15.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2413daf0 con 0x7ffb0c0047d0 2024-09-13T18:31:15.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2413e8b0 0x7ffb2415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2413e8b0 0x7ffb2415bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48920/0 (socket says 172.21.15.53:48920) 2024-09-13T18:31:15.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 -- 172.21.15.53:0/2929557036 learned_addr learned my addr 172.21.15.53:0/2929557036 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:15.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb237fe640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb0c0047d0 0x7ffb2413a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb23fff640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2415c520 0x7ffb240b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 -- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb0c0047d0 msgr2=0x7ffb2413a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb0c0047d0 0x7ffb2413a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 -- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2415c520 msgr2=0x7ffb240b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2415c520 0x7ffb240b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 -- 172.21.15.53:0/2929557036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2413ddd0 con 0x7ffb2413e8b0 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb23fff640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2415c520 0x7ffb240b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb237fe640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb0c0047d0 0x7ffb2413a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb22ffd640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2413e8b0 0x7ffb2415bfe0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009ae0 tx=0x7ffb0c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2929557036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800f000 con 0x7ffb2413e8b0 2024-09-13T18:31:15.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2929557036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb180a6da0 con 0x7ffb2413e8b0 2024-09-13T18:31:15.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2413e0b0 con 0x7ffb2413e8b0 2024-09-13T18:31:15.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2929557036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180a7650 con 0x7ffb2413e8b0 2024-09-13T18:31:15.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2413b020 con 0x7ffb2413e8b0 2024-09-13T18:31:15.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb241607b0 con 0x7ffb2413e8b0 2024-09-13T18:31:15.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2929557036 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 86245+0+0 (secure 0 0 0) 0x7ffb180a77b0 con 0x7ffb2413e8b0 2024-09-13T18:31:15.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb0bfff640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb10066870 0x7ffb10068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2929557036 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb1811e0b0 con 0x7ffb2413e8b0 2024-09-13T18:31:15.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb237fe640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb10066870 0x7ffb10068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.298+0000 7ffb237fe640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb10066870 0x7ffb10068d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009b70 tx=0x7ffb14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:15.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.302+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2929557036 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb180eb090 con 0x7ffb2413e8b0 2024-09-13T18:31:15.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.482+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol78490", "mode": "777", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}) v1 -- 0x7ffb240709e0 con 0x7ffb10066870 2024-09-13T18:31:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.510+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2929557036 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ffb140097c0 con 0x7ffb10066870 2024-09-13T18:31:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb10066870 msgr2=0x7ffb10068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb10066870 0x7ffb10068d30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009b70 tx=0x7ffb14008040 comp rx=0 tx=0).stop 2024-09-13T18:31:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2413e8b0 msgr2=0x7ffb2415bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2413e8b0 0x7ffb2415bfe0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009ae0 tx=0x7ffb0c005800 comp rx=0 tx=0).stop 2024-09-13T18:31:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 shutdown_connections 2024-09-13T18:31:15.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffb10066870 0x7ffb10068d30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb2415c520 0x7ffb240b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb2413e8b0 0x7ffb2415bfe0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 --2- 172.21.15.53:0/2929557036 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffb0c0047d0 0x7ffb2413a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 >> 172.21.15.53:0/2929557036 conn(0x7ffb24065c80 msgr2=0x7ffb2415ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 shutdown_connections 2024-09-13T18:31:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.514+0000 7ffb2a229640 1 -- 172.21.15.53:0/2929557036 wait complete. 2024-09-13T18:31:15.532 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol78490 2024-09-13T18:31:15.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa996a39640 1 Processor -- start 2024-09-13T18:31:15.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa996a39640 1 -- start start 2024-09-13T18:31:15.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa996a39640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9900b26a0 0x7fa9900b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa996a39640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa99006e060 0x7fa9900cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa996a39640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99015b0d0 con 0x7fa9900b22c0 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa996a39640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99015ab70 con 0x7fa9900b26a0 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa996a39640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900b33d0 con 0x7fa99006e060 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa98f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9900b26a0 0x7fa9900b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa98f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9900b26a0 0x7fa9900b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48932/0 (socket says 172.21.15.53:48932) 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa98f7fe640 1 -- 172.21.15.53:0/3452336502 learned_addr learned my addr 172.21.15.53:0/3452336502 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa994fd6640 1 --2- 172.21.15.53:0/3452336502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa99006e060 0x7fa9900cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa98f7fe640 1 -- 172.21.15.53:0/3452336502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa99006e060 msgr2=0x7fa9900cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa98f7fe640 1 --2- 172.21.15.53:0/3452336502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa99006e060 0x7fa9900cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa98f7fe640 1 -- 172.21.15.53:0/3452336502 >> v1:172.21.15.87:6789/0 conn(0x7fa9900b22c0 legacy=0x7fa99015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:15.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.658+0000 7fa98f7fe640 1 -- 172.21.15.53:0/3452336502 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900b36b0 con 0x7fa9900b26a0 2024-09-13T18:31:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 --2- 172.21.15.53:0/3452336502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b26a0 0x7fa9900b2ad0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa984009870 tx=0x7fa98401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b0e08088056e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:15.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98effd640 1 -- 172.21.15.53:0/3452336502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840ab640 con 0x7fa9900b26a0 2024-09-13T18:31:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98effd640 1 -- 172.21.15.53:0/3452336502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9840a7070 con 0x7fa9900b26a0 2024-09-13T18:31:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98effd640 1 -- 172.21.15.53:0/3452336502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840ab9c0 con 0x7fa9900b26a0 2024-09-13T18:31:15.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- 172.21.15.53:0/3452336502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b26a0 msgr2=0x7fa9900b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 --2- 172.21.15.53:0/3452336502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b26a0 0x7fa9900b2ad0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa984009870 tx=0x7fa98401c530 comp rx=0 tx=0).stop 2024-09-13T18:31:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- 172.21.15.53:0/3452336502 shutdown_connections 2024-09-13T18:31:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 --2- 172.21.15.53:0/3452336502 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa99006e060 0x7fa9900cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 --2- 172.21.15.53:0/3452336502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b26a0 0x7fa9900b2ad0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- 172.21.15.53:0/3452336502 >> 172.21.15.53:0/3452336502 conn(0x7fa9900ceb80 msgr2=0x7fa9900cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- 172.21.15.53:0/3452336502 shutdown_connections 2024-09-13T18:31:15.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- 172.21.15.53:0/3452336502 wait complete. 2024-09-13T18:31:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 Processor -- start 2024-09-13T18:31:15.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- start start 2024-09-13T18:31:15.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99006e060 0x7fa99014e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b22c0 0x7fa99014b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9900b26a0 0x7fa99015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99014dbe0 con 0x7fa9900b22c0 2024-09-13T18:31:15.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99015f270 con 0x7fa99006e060 2024-09-13T18:31:15.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99015fa80 con 0x7fa9900b26a0 2024-09-13T18:31:15.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b22c0 0x7fa99014b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b22c0 0x7fa99014b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48940/0 (socket says 172.21.15.53:48940) 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 -- 172.21.15.53:0/1353229778 learned_addr learned my addr 172.21.15.53:0/1353229778 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa994fd6640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9900b26a0 0x7fa99015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98ffff640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99006e060 0x7fa99014e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 -- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9900b26a0 msgr2=0x7fa99015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9900b26a0 0x7fa99015fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 -- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99006e060 msgr2=0x7fa99014e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99006e060 0x7fa99014e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 -- 172.21.15.53:0/1353229778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840094d0 con 0x7fa9900b22c0 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa994fd6640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9900b26a0 0x7fa99015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98ffff640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99006e060 0x7fa99014e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98f7fe640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b22c0 0x7fa99014b210 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa9840ad040 tx=0x7fa98401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98cff9640 1 -- 172.21.15.53:0/1353229778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840be3f0 con 0x7fa9900b22c0 2024-09-13T18:31:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98cff9640 1 -- 172.21.15.53:0/1353229778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9840be550 con 0x7fa9900b22c0 2024-09-13T18:31:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99015f4c0 con 0x7fa9900b22c0 2024-09-13T18:31:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.662+0000 7fa98cff9640 1 -- 172.21.15.53:0/1353229778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840be900 con 0x7fa9900b22c0 2024-09-13T18:31:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.666+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99014b750 con 0x7fa9900b22c0 2024-09-13T18:31:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.666+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99014dd20 con 0x7fa9900b22c0 2024-09-13T18:31:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.666+0000 7fa98cff9640 1 -- 172.21.15.53:0/1353229778 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fa9840b43f0 con 0x7fa9900b22c0 2024-09-13T18:31:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.666+0000 7fa98cff9640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa97c066840 0x7fa97c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.666+0000 7fa98cff9640 1 -- 172.21.15.53:0/1353229778 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa98411e420 con 0x7fa9900b22c0 2024-09-13T18:31:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.666+0000 7fa98ffff640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa97c066840 0x7fa97c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:15.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.666+0000 7fa98ffff640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa97c066840 0x7fa97c068d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa980000f70 tx=0x7fa980009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.670+0000 7fa98cff9640 1 -- 172.21.15.53:0/1353229778 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa99014dd20 con 0x7fa9900b22c0 2024-09-13T18:31:15.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.854+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol78490", "target": ["mon-mgr", ""]}) v1 -- 0x7fa99014dd20 con 0x7fa97c066840 2024-09-13T18:31:15.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa98cff9640 1 -- 172.21.15.53:0/1353229778 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7fa99014dd20 con 0x7fa97c066840 2024-09-13T18:31:15.875 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa97c066840 msgr2=0x7fa97c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa97c066840 0x7fa97c068d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa980000f70 tx=0x7fa980009040 comp rx=0 tx=0).stop 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b22c0 msgr2=0x7fa99014b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b22c0 0x7fa99014b210 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa9840ad040 tx=0x7fa98401ad70 comp rx=0 tx=0).stop 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 shutdown_connections 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa97c066840 0x7fa97c068d00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa9900b26a0 0x7fa99015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9900b22c0 0x7fa99014b210 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 --2- 172.21.15.53:0/1353229778 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa99006e060 0x7fa99014e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 >> 172.21.15.53:0/1353229778 conn(0x7fa9900ceb80 msgr2=0x7fa9900cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 shutdown_connections 2024-09-13T18:31:15.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:15.874+0000 7fa996a39640 1 -- 172.21.15.53:0/1353229778 wait complete. 2024-09-13T18:31:15.893 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol78490 with 8 files each 1MB size under directory volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0 2024-09-13T18:31:15.893 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:15.893 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:15.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:15.899 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104363 s, 100 MB/s 2024-09-13T18:31:15.961 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:15.961 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:16.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:16.006 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:16.084 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:16.085 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:16.085 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160836 s, 65.2 MB/s 2024-09-13T18:31:16.086 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:16.086 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:16.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:16.131 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172161 s, 60.9 MB/s 2024-09-13T18:31:16.206 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:16.206 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:16.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:16.260 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:16.338 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:16.338 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:16.338 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019459 s, 53.9 MB/s 2024-09-13T18:31:16.339 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:16.339 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:16.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:16.388 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172703 s, 60.7 MB/s 2024-09-13T18:31:16.463 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:16.463 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:16.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:16.512 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162116 s, 64.7 MB/s 2024-09-13T18:31:16.588 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:16.588 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:16.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:16.637 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171629 s, 61.1 MB/s 2024-09-13T18:31:16.712 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:16.712 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:16.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:16.760 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-13T18:31:16.838 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-13T18:31:16.838 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-13T18:31:16.838 INFO:teuthology.orchestra.run.smithi053.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200501 s, 52.3 MB/s 2024-09-13T18:31:16.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol78490 subvol_snap630 2024-09-13T18:31:17.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.018+0000 7fc8ee1cd640 1 Processor -- start 2024-09-13T18:31:17.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.018+0000 7fc8ee1cd640 1 -- start start 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8ee1cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8e8070fd0 0x7fc8e80b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8ee1cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070a90 0x7fc8e80cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8ee1cd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e806d630 con 0x7fc8e8159580 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8ee1cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e806cd40 con 0x7fc8e8070fd0 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8ee1cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8071490 con 0x7fc8e8070a90 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8e8070fd0 0x7fc8e80b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc8e8159580 0x7fc8e8070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44878/0 (socket says 172.21.15.53:44878) 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8e8070fd0 0x7fc8e80b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34592/0 (socket says 172.21.15.53:34592) 2024-09-13T18:31:17.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e77fe640 1 -- 172.21.15.53:0/3317584204 learned_addr learned my addr 172.21.15.53:0/3317584204 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:17.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e7fff640 1 --2- 172.21.15.53:0/3317584204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070a90 0x7fc8e80cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e6ffd640 1 -- 172.21.15.53:0/3317584204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070a90 msgr2=0x7fc8e80cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:17.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e6ffd640 1 --2- 172.21.15.53:0/3317584204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070a90 0x7fc8e80cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e6ffd640 1 -- 172.21.15.53:0/3317584204 >> v1:172.21.15.53:6789/0 conn(0x7fc8e8159580 legacy=0x7fc8e8070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e6ffd640 1 -- 172.21.15.53:0/3317584204 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e806cfe0 con 0x7fc8e8070fd0 2024-09-13T18:31:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.022+0000 7fc8e6ffd640 1 --2- 172.21.15.53:0/3317584204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8070fd0 0x7fc8e80b3a60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00ba60 tx=0x7fc8dc01eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50736ba451aac6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e67fc640 1 -- 172.21.15.53:0/3317584204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0a7710 con 0x7fc8e8070fd0 2024-09-13T18:31:17.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e67fc640 1 -- 172.21.15.53:0/3317584204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc0a7870 con 0x7fc8e8070fd0 2024-09-13T18:31:17.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e67fc640 1 -- 172.21.15.53:0/3317584204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0a7c00 con 0x7fc8e8070fd0 2024-09-13T18:31:17.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/3317584204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8070fd0 msgr2=0x7fc8e80b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/3317584204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8070fd0 0x7fc8e80b3a60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00ba60 tx=0x7fc8dc01eab0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/3317584204 shutdown_connections 2024-09-13T18:31:17.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/3317584204 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070a90 0x7fc8e80cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/3317584204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8070fd0 0x7fc8e80b3a60 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/3317584204 >> 172.21.15.53:0/3317584204 conn(0x7fc8e80b11a0 msgr2=0x7fc8e80b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:17.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/3317584204 shutdown_connections 2024-09-13T18:31:17.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/3317584204 wait complete. 2024-09-13T18:31:17.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 Processor -- start 2024-09-13T18:31:17.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- start start 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8e8070a90 0x7fc8e813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070fd0 0x7fc8e8157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8159580 0x7fc8e81584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a84d0 con 0x7fc8e8159580 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a9050 con 0x7fc8e8070a90 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8ee1cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a8720 con 0x7fc8e8070fd0 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8159580 0x7fc8e81584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8159580 0x7fc8e81584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34598/0 (socket says 172.21.15.53:34598) 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 -- 172.21.15.53:0/655646047 learned_addr learned my addr 172.21.15.53:0/655646047 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:17.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e6ffd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070fd0 0x7fc8e8157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e77fe640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8e8070a90 0x7fc8e813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 -- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070fd0 msgr2=0x7fc8e8157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070fd0 0x7fc8e8157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 -- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8e8070a90 msgr2=0x7fc8e813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8e8070a90 0x7fc8e813fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 -- 172.21.15.53:0/655646047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc00b6c0 con 0x7fc8e8159580 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e6ffd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070fd0 0x7fc8e8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8e7fff640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8159580 0x7fc8e81584c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0007e30 tx=0x7fc8e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8cffff640 1 -- 172.21.15.53:0/655646047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0014620 con 0x7fc8e8159580 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.026+0000 7fc8cffff640 1 -- 172.21.15.53:0/655646047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e000ee90 con 0x7fc8e8159580 2024-09-13T18:31:17.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e80a8a00 con 0x7fc8e8159580 2024-09-13T18:31:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8cffff640 1 -- 172.21.15.53:0/655646047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00149c0 con 0x7fc8e8159580 2024-09-13T18:31:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e8140240 con 0x7fc8e8159580 2024-09-13T18:31:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e80a91c0 con 0x7fc8e8159580 2024-09-13T18:31:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8cffff640 1 -- 172.21.15.53:0/655646047 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fc8e0014b20 con 0x7fc8e8159580 2024-09-13T18:31:17.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8cffff640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc8d4066870 0x7fc8d4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8e77fe640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc8d4066870 0x7fc8d4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8cffff640 1 -- 172.21.15.53:0/655646047 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8e0084eb0 con 0x7fc8e8159580 2024-09-13T18:31:17.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.030+0000 7fc8e77fe640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc8d4066870 0x7fc8d4068d30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8000f70 tx=0x7fc8d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.034+0000 7fc8cffff640 1 -- 172.21.15.53:0/655646047 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8e0051fa0 con 0x7fc8e8159580 2024-09-13T18:31:17.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.226+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol78490", "snap_name": "subvol_snap630", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8e80a8eb0 con 0x7fc8d4066870 2024-09-13T18:31:17.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.262+0000 7fc8cffff640 1 -- 172.21.15.53:0/655646047 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc8d80011b0 con 0x7fc8d4066870 2024-09-13T18:31:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc8d4066870 msgr2=0x7fc8d4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc8d4066870 0x7fc8d4068d30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8000f70 tx=0x7fc8d8009040 comp rx=0 tx=0).stop 2024-09-13T18:31:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8159580 msgr2=0x7fc8e81584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8159580 0x7fc8e81584c0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0007e30 tx=0x7fc8e000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 shutdown_connections 2024-09-13T18:31:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc8d4066870 0x7fc8d4068d30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8e8070fd0 0x7fc8e8157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8e8159580 0x7fc8e81584c0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 --2- 172.21.15.53:0/655646047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8e8070a90 0x7fc8e813fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 >> 172.21.15.53:0/655646047 conn(0x7fc8e80b11a0 msgr2=0x7fc8e8066370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 shutdown_connections 2024-09-13T18:31:17.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.266+0000 7fc8ee1cd640 1 -- 172.21.15.53:0/655646047 wait complete. 2024-09-13T18:31:17.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol78490 subvol_snap630 subvol_clone91250 2024-09-13T18:31:17.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.414+0000 7f101390e640 1 Processor -- start 2024-09-13T18:31:17.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.414+0000 7f101390e640 1 -- start start 2024-09-13T18:31:17.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f101390e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f100c156c40 0x7f100c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f101390e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c157020 0x7f100c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f101390e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c06d6e0 con 0x7f100c06d270 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f101390e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c070340 con 0x7f100c156c40 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f101390e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0b15a0 con 0x7f100c157020 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f10116aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f100c156c40 0x7f100c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f10116aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f100c156c40 0x7f100c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34604/0 (socket says 172.21.15.53:34604) 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f10116aa640 1 -- 172.21.15.53:0/2822837770 learned_addr learned my addr 172.21.15.53:0/2822837770 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f1010ea9640 1 --2- 172.21.15.53:0/2822837770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c157020 0x7f100c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f10116aa640 1 -- 172.21.15.53:0/2822837770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c157020 msgr2=0x7f100c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f10116aa640 1 --2- 172.21.15.53:0/2822837770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c157020 0x7f100c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f1003fff640 1 -- 172.21.15.53:0/2822837770 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144266847 0 0) 0x7f100c06d6e0 con 0x7f100c06d270 2024-09-13T18:31:17.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f10116aa640 1 -- 172.21.15.53:0/2822837770 >> v1:172.21.15.53:6789/0 conn(0x7f100c06d270 legacy=0x7f100c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.418+0000 7f10116aa640 1 -- 172.21.15.53:0/2822837770 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c0b1880 con 0x7f100c156c40 2024-09-13T18:31:17.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f10116aa640 1 --2- 172.21.15.53:0/2822837770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c156c40 0x7f100c070ee0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f100800bb10 tx=0x7f100801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856b441474da7fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f1003fff640 1 -- 172.21.15.53:0/2822837770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080a7bf0 con 0x7f100c156c40 2024-09-13T18:31:17.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f1003fff640 1 -- 172.21.15.53:0/2822837770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10080a7d50 con 0x7f100c156c40 2024-09-13T18:31:17.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f1003fff640 1 -- 172.21.15.53:0/2822837770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080af660 con 0x7f100c156c40 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- 172.21.15.53:0/2822837770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c156c40 msgr2=0x7f100c070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 --2- 172.21.15.53:0/2822837770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c156c40 0x7f100c070ee0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f100800bb10 tx=0x7f100801ec00 comp rx=0 tx=0).stop 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- 172.21.15.53:0/2822837770 shutdown_connections 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 --2- 172.21.15.53:0/2822837770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c157020 0x7f100c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 --2- 172.21.15.53:0/2822837770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c156c40 0x7f100c070ee0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- 172.21.15.53:0/2822837770 >> 172.21.15.53:0/2822837770 conn(0x7f100c065c80 msgr2=0x7f100c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- 172.21.15.53:0/2822837770 shutdown_connections 2024-09-13T18:31:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- 172.21.15.53:0/2822837770 wait complete. 2024-09-13T18:31:17.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 Processor -- start 2024-09-13T18:31:17.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- start start 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c06d270 0x7f100c142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c156c40 0x7f100c15c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c147950 0x7f100c147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c15b470 con 0x7f100c06d270 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c15b750 con 0x7f100c147950 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f101390e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c15ba30 con 0x7f100c156c40 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f10116aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c06d270 0x7f100c142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f10116aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c06d270 0x7f100c142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34608/0 (socket says 172.21.15.53:34608) 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f10116aa640 1 -- 172.21.15.53:0/3088818365 learned_addr learned my addr 172.21.15.53:0/3088818365 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f1010ea9640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c156c40 0x7f100c15c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.422+0000 7f1011eab640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c147950 0x7f100c147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f10116aa640 1 -- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c156c40 msgr2=0x7f100c15c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f10116aa640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c156c40 0x7f100c15c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f10116aa640 1 -- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c147950 msgr2=0x7f100c147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f10116aa640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c147950 0x7f100c147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f10116aa640 1 -- 172.21.15.53:0/3088818365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100800b770 con 0x7f100c06d270 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1010ea9640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c156c40 0x7f100c15c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f10116aa640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c06d270 0x7f100c142110 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f100800bb10 tx=0x7f100801b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1001ffb640 1 -- 172.21.15.53:0/3088818365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080afdd0 con 0x7f100c06d270 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1001ffb640 1 -- 172.21.15.53:0/3088818365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008004020 con 0x7f100c06d270 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c0aecd0 con 0x7f100c06d270 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1001ffb640 1 -- 172.21.15.53:0/3088818365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080043d0 con 0x7f100c06d270 2024-09-13T18:31:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c148320 con 0x7f100c06d270 2024-09-13T18:31:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c0af1f0 con 0x7f100c06d270 2024-09-13T18:31:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1001ffb640 1 -- 172.21.15.53:0/3088818365 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 86245+0+0 (secure 0 0 0) 0x7f10080b6050 con 0x7f100c06d270 2024-09-13T18:31:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1001ffb640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ff0066840 0x7f0ff0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1001ffb640 1 -- 172.21.15.53:0/3088818365 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1008120d00 con 0x7f100c06d270 2024-09-13T18:31:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1010ea9640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ff0066840 0x7f0ff0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.426+0000 7f1010ea9640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ff0066840 0x7f0ff0068d00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f100c1561f0 tx=0x7f0ffc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.430+0000 7f1001ffb640 1 -- 172.21.15.53:0/3088818365 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f100c0af1f0 con 0x7f100c06d270 2024-09-13T18:31:17.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.622+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol78490", "snap_name": "subvol_snap630", "target_sub_name": "subvol_clone91250", "target": ["mon-mgr", ""]}) v1 -- 0x7f100c0b26c0 con 0x7f0ff0066840 2024-09-13T18:31:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.754+0000 7f1001ffb640 1 -- 172.21.15.53:0/3088818365 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0ffc004030 con 0x7f0ff0066840 2024-09-13T18:31:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ff0066840 msgr2=0x7f0ff0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ff0066840 0x7f0ff0068d00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f100c1561f0 tx=0x7f0ffc008040 comp rx=0 tx=0).stop 2024-09-13T18:31:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c06d270 msgr2=0x7f100c142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c06d270 0x7f100c142110 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f100800bb10 tx=0x7f100801b9a0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 shutdown_connections 2024-09-13T18:31:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ff0066840 0x7f0ff0068d00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f100c156c40 0x7f100c15c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f100c147950 0x7f100c147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 --2- 172.21.15.53:0/3088818365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f100c06d270 0x7f100c142110 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 >> 172.21.15.53:0/3088818365 conn(0x7f100c065c80 msgr2=0x7f100c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 shutdown_connections 2024-09-13T18:31:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.758+0000 7f101390e640 1 -- 172.21.15.53:0/3088818365 wait complete. 2024-09-13T18:31:17.764 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.762+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.764 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.762+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.764 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.762+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.765 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.762+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.765 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.762+0000 7f261ceb9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone91250 2024-09-13T18:31:17.795 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.782+0000 7f261beb7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.795 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.782+0000 7f261beb7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.795 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.782+0000 7f261beb7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.795 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.782+0000 7f261beb7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.795 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:17.782+0000 7f261beb7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:17.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed97b4d640 1 Processor -- start 2024-09-13T18:31:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed97b4d640 1 -- start start 2024-09-13T18:31:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed97b4d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed9006e140 0x7fed901653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed97b4d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900cf1c0 con 0x7fed900b2c90 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed97b4d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900cf4a0 con 0x7fed9015a6c0 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed97b4d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900cf780 con 0x7fed9006e140 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed950e8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fed900b2c90 0x7fed9006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44890/0 (socket says 172.21.15.53:44890) 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.926+0000 7fed950e8640 1 -- 172.21.15.53:0/63186854 learned_addr learned my addr 172.21.15.53:0/63186854 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.930+0000 7fed960ea640 1 --2- 172.21.15.53:0/63186854 >> v2:172.21.15.87:3300/0 conn(0x7fed9006e140 0x7fed901653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.930+0000 7fed948e7640 1 -- 172.21.15.53:0/63186854 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777143537 0 0) 0x7fed900cf1c0 con 0x7fed900b2c90 2024-09-13T18:31:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.930+0000 7fed948e7640 1 -- 172.21.15.53:0/63186854 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed7c003530 con 0x7fed900b2c90 2024-09-13T18:31:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.930+0000 7fed960ea640 1 -- 172.21.15.53:0/63186854 >> v1:172.21.15.87:6789/0 conn(0x7fed9015a6c0 legacy=0x7fed900c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.930+0000 7fed960ea640 1 -- 172.21.15.53:0/63186854 >> v1:172.21.15.53:6789/0 conn(0x7fed900b2c90 legacy=0x7fed9006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.930+0000 7fed960ea640 1 -- 172.21.15.53:0/63186854 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900cfa60 con 0x7fed9006e140 2024-09-13T18:31:17.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.930+0000 7fed960ea640 1 --2- 172.21.15.53:0/63186854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 0x7fed901653b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fed88009d90 tx=0x7fed8801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43dbaed087f685f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed948e7640 1 -- 172.21.15.53:0/63186854 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880a5930 con 0x7fed9006e140 2024-09-13T18:31:17.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed948e7640 1 -- 172.21.15.53:0/63186854 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed880a5a90 con 0x7fed9006e140 2024-09-13T18:31:17.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed948e7640 1 -- 172.21.15.53:0/63186854 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880a5e20 con 0x7fed9006e140 2024-09-13T18:31:17.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- 172.21.15.53:0/63186854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 msgr2=0x7fed901653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 --2- 172.21.15.53:0/63186854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 0x7fed901653b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fed88009d90 tx=0x7fed8801c850 comp rx=0 tx=0).stop 2024-09-13T18:31:17.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- 172.21.15.53:0/63186854 shutdown_connections 2024-09-13T18:31:17.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 --2- 172.21.15.53:0/63186854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 0x7fed901653b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- 172.21.15.53:0/63186854 >> 172.21.15.53:0/63186854 conn(0x7fed900b2170 msgr2=0x7fed900b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:17.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- 172.21.15.53:0/63186854 shutdown_connections 2024-09-13T18:31:17.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- 172.21.15.53:0/63186854 wait complete. 2024-09-13T18:31:17.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 Processor -- start 2024-09-13T18:31:17.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- start start 2024-09-13T18:31:17.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 0x7fed900b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b2c90 0x7fed900cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed9015a6c0 0x7fed90146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9006bb80 con 0x7fed9015a6c0 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9006bfa0 con 0x7fed9006e140 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed97b4d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9006b540 con 0x7fed900b2c90 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed960ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed9015a6c0 0x7fed90146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.934+0000 7fed960ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed9015a6c0 0x7fed90146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34654/0 (socket says 172.21.15.53:34654) 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed960ea640 1 -- 172.21.15.53:0/804689244 learned_addr learned my addr 172.21.15.53:0/804689244 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed958e9640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 0x7fed900b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed950e8640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b2c90 0x7fed900cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed960ea640 1 -- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b2c90 msgr2=0x7fed900cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed960ea640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b2c90 0x7fed900cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed960ea640 1 -- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 msgr2=0x7fed900b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed960ea640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 0x7fed900b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:17.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed960ea640 1 -- 172.21.15.53:0/804689244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009a70 con 0x7fed9015a6c0 2024-09-13T18:31:17.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed960ea640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed9015a6c0 0x7fed90146440 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fed8801a480 tx=0x7fed880195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed867fc640 1 -- 172.21.15.53:0/804689244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880a5930 con 0x7fed9015a6c0 2024-09-13T18:31:17.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed867fc640 1 -- 172.21.15.53:0/804689244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88009450 con 0x7fed9015a6c0 2024-09-13T18:31:17.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9006a3e0 con 0x7fed9015a6c0 2024-09-13T18:31:17.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed867fc640 1 -- 172.21.15.53:0/804689244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880b9650 con 0x7fed9015a6c0 2024-09-13T18:31:17.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9006a680 con 0x7fed9015a6c0 2024-09-13T18:31:17.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9006a870 con 0x7fed9015a6c0 2024-09-13T18:31:17.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed867fc640 1 -- 172.21.15.53:0/804689244 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 86245+0+0 (secure 0 0 0) 0x7fed880b97b0 con 0x7fed9015a6c0 2024-09-13T18:31:17.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed867fc640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066840 0x7fed74068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:17.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed867fc640 1 -- 172.21.15.53:0/804689244 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed9015acb0 con 0x7fed9015a6c0 2024-09-13T18:31:17.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.938+0000 7fed958e9640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066840 0x7fed74068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:17.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.942+0000 7fed958e9640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066840 0x7fed74068d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000f70 tx=0x7fed8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:17.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:17.946+0000 7fed867fc640 1 -- 172.21.15.53:0/804689244 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed9006a870 con 0x7fed9015a6c0 2024-09-13T18:31:18.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:18.166+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone91250", "target": ["mon-mgr", ""]}) v1 -- 0x7fed9006bcc0 con 0x7fed74066840 2024-09-13T18:31:19.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.114+0000 7fed867fc640 1 -- 172.21.15.53:0/804689244 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fed9006bcc0 con 0x7fed74066840 2024-09-13T18:31:19.116 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: "status": { 2024-09-13T18:31:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "complete" 2024-09-13T18:31:19.117 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:19.117 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:19.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066840 msgr2=0x7fed74068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066840 0x7fed74068d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000f70 tx=0x7fed8c009040 comp rx=0 tx=0).stop 2024-09-13T18:31:19.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed9015a6c0 msgr2=0x7fed90146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed9015a6c0 0x7fed90146440 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fed8801a480 tx=0x7fed880195f0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 shutdown_connections 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066840 0x7fed74068d00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b2c90 0x7fed900cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed9015a6c0 0x7fed90146440 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 --2- 172.21.15.53:0/804689244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9006e140 0x7fed900b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 >> 172.21.15.53:0/804689244 conn(0x7fed900b2170 msgr2=0x7fed900b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 shutdown_connections 2024-09-13T18:31:19.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.118+0000 7fed97b4d640 1 -- 172.21.15.53:0/804689244 wait complete. 2024-09-13T18:31:19.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:19.139 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone91250/.meta) 2024-09-13T18:31:19.208 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:31:19.208 INFO:teuthology.orchestra.run.smithi053.stdout:version = 2 2024-09-13T18:31:19.208 INFO:teuthology.orchestra.run.smithi053.stdout:type = clone 2024-09-13T18:31:19.208 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d 2024-09-13T18:31:19.208 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:31:19.208 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:19.210 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol78490 2024-09-13T18:31:19.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.390+0000 7f1114581640 1 Processor -- start 2024-09-13T18:31:19.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.390+0000 7f1114581640 1 -- start start 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1114581640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f110c0ccd10 0x7f110c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1114581640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f110c0d2c80 0x7f110c0d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1114581640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0b7db0 con 0x7f110c15c830 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1114581640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c0d3650 con 0x7f110c0ccd10 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1114581640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c0d0650 con 0x7f110c0d2c80 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f110c0ccd10 0x7f110c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f110c0ccd10 0x7f110c0cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34666/0 (socket says 172.21.15.53:34666) 2024-09-13T18:31:19.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 -- 172.21.15.53:0/3998500478 learned_addr learned my addr 172.21.15.53:0/3998500478 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:19.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1112b1e640 1 --2- 172.21.15.53:0/3998500478 >> v2:172.21.15.87:3300/0 conn(0x7f110c0d2c80 0x7f110c0d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 -- 172.21.15.53:0/3998500478 >> v2:172.21.15.87:3300/0 conn(0x7f110c0d2c80 msgr2=0x7f110c0d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:19.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 --2- 172.21.15.53:0/3998500478 >> v2:172.21.15.87:3300/0 conn(0x7f110c0d2c80 0x7f110c0d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 -- 172.21.15.53:0/3998500478 >> v1:172.21.15.87:6789/0 conn(0x7f110c15c830 legacy=0x7f110c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:19.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 -- 172.21.15.53:0/3998500478 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0d0c10 con 0x7f110c0ccd10 2024-09-13T18:31:19.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f1111b1c640 1 --2- 172.21.15.53:0/3998500478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c0cd180 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f110c0b4290 tx=0x7f10fc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409c7bc34091d83d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f111131b640 1 -- 172.21.15.53:0/3998500478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0ab600 con 0x7f110c0ccd10 2024-09-13T18:31:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f111131b640 1 -- 172.21.15.53:0/3998500478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc0a7050 con 0x7f110c0ccd10 2024-09-13T18:31:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.394+0000 7f111131b640 1 -- 172.21.15.53:0/3998500478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0ab980 con 0x7f110c0ccd10 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- 172.21.15.53:0/3998500478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 msgr2=0x7f110c0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 --2- 172.21.15.53:0/3998500478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c0cd180 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f110c0b4290 tx=0x7f10fc01c4e0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- 172.21.15.53:0/3998500478 shutdown_connections 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 --2- 172.21.15.53:0/3998500478 >> v2:172.21.15.87:3300/0 conn(0x7f110c0d2c80 0x7f110c0d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 --2- 172.21.15.53:0/3998500478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c0cd180 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- 172.21.15.53:0/3998500478 >> 172.21.15.53:0/3998500478 conn(0x7f110c070970 msgr2=0x7f110c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- 172.21.15.53:0/3998500478 shutdown_connections 2024-09-13T18:31:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- 172.21.15.53:0/3998500478 wait complete. 2024-09-13T18:31:19.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 Processor -- start 2024-09-13T18:31:19.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- start start 2024-09-13T18:31:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f110c0d2c80 0x7f110c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f110c15c830 0x7f110c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c15b1f0 con 0x7f110c0ccd10 2024-09-13T18:31:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c9b50 con 0x7f110c0d2c80 2024-09-13T18:31:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0ca1c0 con 0x7f110c15c830 2024-09-13T18:31:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c15dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34678/0 (socket says 172.21.15.53:34678) 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 -- 172.21.15.53:0/3622691345 learned_addr learned my addr 172.21.15.53:0/3622691345 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1112b1e640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f110c15c830 0x7f110c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1111b1c640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f110c0d2c80 0x7f110c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 -- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f110c15c830 msgr2=0x7f110c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f110c15c830 0x7f110c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 -- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f110c0d2c80 msgr2=0x7f110c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f110c0d2c80 0x7f110c0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 -- 172.21.15.53:0/3622691345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0094d0 con 0x7f110c0ccd10 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1111b1c640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f110c0d2c80 0x7f110c0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f111231d640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c15dbe0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f110800b410 tx=0x7f110800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1102ffd640 1 -- 172.21.15.53:0/3622691345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108004020 con 0x7f110c0ccd10 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1102ffd640 1 -- 172.21.15.53:0/3622691345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1108004180 con 0x7f110c0ccd10 2024-09-13T18:31:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c0ca4a0 con 0x7f110c0ccd10 2024-09-13T18:31:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1102ffd640 1 -- 172.21.15.53:0/3622691345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011630 con 0x7f110c0ccd10 2024-09-13T18:31:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.398+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0ca780 con 0x7f110c0ccd10 2024-09-13T18:31:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.402+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c0cd180 con 0x7f110c0ccd10 2024-09-13T18:31:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.402+0000 7f1102ffd640 1 -- 172.21.15.53:0/3622691345 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f1108011790 con 0x7f110c0ccd10 2024-09-13T18:31:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.402+0000 7f1102ffd640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10f0066960 0x7f10f0068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.402+0000 7f1102ffd640 1 -- 172.21.15.53:0/3622691345 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1108084320 con 0x7f110c0ccd10 2024-09-13T18:31:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.402+0000 7f1111b1c640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10f0066960 0x7f10f0068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.402+0000 7f1111b1c640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10f0066960 0x7f10f0068e20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0ad000 tx=0x7f10fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.406+0000 7f1102ffd640 1 -- 172.21.15.53:0/3622691345 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f11080513d0 con 0x7f110c0ccd10 2024-09-13T18:31:19.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.594+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol78490", "target": ["mon-mgr", ""]}) v1 -- 0x7f110c0b5eb0 con 0x7f10f0066960 2024-09-13T18:31:19.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.614+0000 7f1102ffd640 1 -- 172.21.15.53:0/3622691345 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f10fc0ab6a0 con 0x7f10f0066960 2024-09-13T18:31:19.618 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10f0066960 msgr2=0x7f10f0068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10f0066960 0x7f10f0068e20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0ad000 tx=0x7f10fc008040 comp rx=0 tx=0).stop 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 msgr2=0x7f110c15dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c15dbe0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f110800b410 tx=0x7f110800b8d0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 shutdown_connections 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10f0066960 0x7f10f0068e20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f110c15c830 0x7f110c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f110c0d2c80 0x7f110c0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 --2- 172.21.15.53:0/3622691345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f110c0ccd10 0x7f110c15dbe0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 >> 172.21.15.53:0/3622691345 conn(0x7f110c070970 msgr2=0x7f110c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 shutdown_connections 2024-09-13T18:31:19.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.618+0000 7f1114581640 1 -- 172.21.15.53:0/3622691345 wait complete. 2024-09-13T18:31:19.638 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol_clone91250 2024-09-13T18:31:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc258d62640 1 Processor -- start 2024-09-13T18:31:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc258d62640 1 -- start start 2024-09-13T18:31:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc258d62640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc254143e80 0x7fc25406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc258d62640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25406f7a0 con 0x7fc2540cda30 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc258d62640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25406fd60 con 0x7fc2540caee0 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc258d62640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2540cb960 con 0x7fc254143e80 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc25259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc254143e80 0x7fc25406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc252d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc2540cda30 0x7fc2540701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44898/0 (socket says 172.21.15.53:44898) 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.766+0000 7fc252d9d640 1 -- 172.21.15.53:0/2660829506 learned_addr learned my addr 172.21.15.53:0/2660829506 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25159a640 1 -- 172.21.15.53:0/2660829506 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554197803 0 0) 0x7fc25406f7a0 con 0x7fc2540cda30 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25159a640 1 -- 172.21.15.53:0/2660829506 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c003530 con 0x7fc2540cda30 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25259c640 1 -- 172.21.15.53:0/2660829506 >> v1:172.21.15.87:6789/0 conn(0x7fc2540caee0 legacy=0x7fc2540cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25259c640 1 -- 172.21.15.53:0/2660829506 >> v1:172.21.15.53:6789/0 conn(0x7fc2540cda30 legacy=0x7fc2540701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25259c640 1 -- 172.21.15.53:0/2660829506 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540cbc40 con 0x7fc254143e80 2024-09-13T18:31:19.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25259c640 1 --2- 172.21.15.53:0/2660829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc25406b390 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fc2440097c0 tx=0x7fc24401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62596bc6302d004 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25159a640 1 -- 172.21.15.53:0/2660829506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440ab600 con 0x7fc254143e80 2024-09-13T18:31:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25159a640 1 -- 172.21.15.53:0/2660829506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2440a7050 con 0x7fc254143e80 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.770+0000 7fc25159a640 1 -- 172.21.15.53:0/2660829506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440ab980 con 0x7fc254143e80 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- 172.21.15.53:0/2660829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 msgr2=0x7fc25406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 --2- 172.21.15.53:0/2660829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc25406b390 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fc2440097c0 tx=0x7fc24401c350 comp rx=0 tx=0).stop 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- 172.21.15.53:0/2660829506 shutdown_connections 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 --2- 172.21.15.53:0/2660829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc25406b390 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- 172.21.15.53:0/2660829506 >> 172.21.15.53:0/2660829506 conn(0x7fc254065c80 msgr2=0x7fc254066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- 172.21.15.53:0/2660829506 shutdown_connections 2024-09-13T18:31:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- 172.21.15.53:0/2660829506 wait complete. 2024-09-13T18:31:19.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 Processor -- start 2024-09-13T18:31:19.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- start start 2024-09-13T18:31:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2540caee0 0x7fc254136630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2540cda30 0x7fc254136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc254141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254136b70 con 0x7fc254143e80 2024-09-13T18:31:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254159240 con 0x7fc2540cda30 2024-09-13T18:31:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc254159520 con 0x7fc2540caee0 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc254141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc254141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34694/0 (socket says 172.21.15.53:34694) 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 -- 172.21.15.53:0/4027654029 learned_addr learned my addr 172.21.15.53:0/4027654029 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc25259c640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2540caee0 0x7fc254136630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc251d9b640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2540cda30 0x7fc254136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 -- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2540caee0 msgr2=0x7fc254136630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2540caee0 0x7fc254136630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 -- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2540cda30 msgr2=0x7fc254136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2540cda30 0x7fc254136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 -- 172.21.15.53:0/4027654029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc244009420 con 0x7fc254143e80 2024-09-13T18:31:19.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc252d9d640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc254141140 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00caa0 tx=0x7fc24c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc242ffd640 1 -- 172.21.15.53:0/4027654029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00ac00 con 0x7fc254143e80 2024-09-13T18:31:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc242ffd640 1 -- 172.21.15.53:0/4027654029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c00ad60 con 0x7fc254143e80 2024-09-13T18:31:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc254159800 con 0x7fc254143e80 2024-09-13T18:31:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc242ffd640 1 -- 172.21.15.53:0/4027654029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c012620 con 0x7fc254143e80 2024-09-13T18:31:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.774+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc254159dc0 con 0x7fc254143e80 2024-09-13T18:31:19.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.778+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc254159fe0 con 0x7fc254143e80 2024-09-13T18:31:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.778+0000 7fc242ffd640 1 -- 172.21.15.53:0/4027654029 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7fc24c007070 con 0x7fc254143e80 2024-09-13T18:31:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.778+0000 7fc242ffd640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc234066960 0x7fc234068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.778+0000 7fc242ffd640 1 -- 172.21.15.53:0/4027654029 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc24c084500 con 0x7fc254143e80 2024-09-13T18:31:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.778+0000 7fc25259c640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc234066960 0x7fc234068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:19.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.778+0000 7fc25259c640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc234066960 0x7fc234068e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ad000 tx=0x7fc244008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:19.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.782+0000 7fc242ffd640 1 -- 172.21.15.53:0/4027654029 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc24c0515b0 con 0x7fc254143e80 2024-09-13T18:31:19.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.970+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol_clone91250", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2540cb700 con 0x7fc234066960 2024-09-13T18:31:19.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.978+0000 7fc242ffd640 1 -- 172.21.15.53:0/4027654029 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+73 (secure 0 0 0) 0x7fc244006e20 con 0x7fc234066960 2024-09-13T18:31:19.981 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d 2024-09-13T18:31:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc234066960 msgr2=0x7fc234068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc234066960 0x7fc234068e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ad000 tx=0x7fc244008040 comp rx=0 tx=0).stop 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 msgr2=0x7fc254141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc254141140 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00caa0 tx=0x7fc24c00cf60 comp rx=0 tx=0).stop 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 shutdown_connections 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc234066960 0x7fc234068e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc254143e80 0x7fc254141140 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2540cda30 0x7fc254136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 --2- 172.21.15.53:0/4027654029 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2540caee0 0x7fc254136630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 >> 172.21.15.53:0/4027654029 conn(0x7fc254065c80 msgr2=0x7fc25415b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 shutdown_connections 2024-09-13T18:31:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:19.982+0000 7fc258d62640 1 -- 172.21.15.53:0/4027654029 wait complete. 2024-09-13T18:31:20.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.001 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.016 INFO:teuthology.orchestra.run.smithi053.stdout:9 2024-09-13T18:31:20.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.016 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d) 2024-09-13T18:31:20.070 INFO:teuthology.orchestra.run.smithi053.stdout:9 2024-09-13T18:31:20.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol_clone91250 2024-09-13T18:31:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10ce0f6640 1 Processor -- start 2024-09-13T18:31:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10ce0f6640 1 -- start start 2024-09-13T18:31:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10ce0f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10c8156c40 0x7f10c8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10ce0f6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f10c806d440 0x7f10c806f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10ce0f6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c80b15a0 con 0x7f10c8157020 2024-09-13T18:31:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10ce0f6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c80b1880 con 0x7f10c8156c40 2024-09-13T18:31:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10ce0f6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c80b1b60 con 0x7f10c806d440 2024-09-13T18:31:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10c8156c40 0x7f10c8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10c8156c40 0x7f10c8070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34708/0 (socket says 172.21.15.53:34708) 2024-09-13T18:31:20.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c77fe640 1 -- 172.21.15.53:0/3596869835 learned_addr learned my addr 172.21.15.53:0/3596869835 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:20.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c7fff640 1 --2- 172.21.15.53:0/3596869835 >> v2:172.21.15.87:3300/0 conn(0x7f10c806d440 0x7f10c806f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:20.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c77fe640 1 -- 172.21.15.53:0/3596869835 >> v2:172.21.15.87:3300/0 conn(0x7f10c806d440 msgr2=0x7f10c806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:20.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c77fe640 1 --2- 172.21.15.53:0/3596869835 >> v2:172.21.15.87:3300/0 conn(0x7f10c806d440 0x7f10c806f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c77fe640 1 -- 172.21.15.53:0/3596869835 >> v1:172.21.15.87:6789/0 conn(0x7f10c8157020 legacy=0x7f10c806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:20.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.246+0000 7f10c77fe640 1 -- 172.21.15.53:0/3596869835 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80b1e40 con 0x7f10c8156c40 2024-09-13T18:31:20.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10c77fe640 1 --2- 172.21.15.53:0/3596869835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c8156c40 0x7f10c8070ee0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009870 tx=0x7f10b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2510228df859505d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:20.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10c67fc640 1 -- 172.21.15.53:0/3596869835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80aa670 con 0x7f10c8156c40 2024-09-13T18:31:20.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10c67fc640 1 -- 172.21.15.53:0/3596869835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b80aa7d0 con 0x7f10c8156c40 2024-09-13T18:31:20.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10c67fc640 1 -- 172.21.15.53:0/3596869835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80aab60 con 0x7f10c8156c40 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3596869835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c8156c40 msgr2=0x7f10c8070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3596869835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c8156c40 0x7f10c8070ee0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009870 tx=0x7f10b801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3596869835 shutdown_connections 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3596869835 >> v2:172.21.15.87:3300/0 conn(0x7f10c806d440 0x7f10c806f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3596869835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c8156c40 0x7f10c8070ee0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3596869835 >> 172.21.15.53:0/3596869835 conn(0x7f10c8065c80 msgr2=0x7f10c8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3596869835 shutdown_connections 2024-09-13T18:31:20.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3596869835 wait complete. 2024-09-13T18:31:20.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 Processor -- start 2024-09-13T18:31:20.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.250+0000 7f10ce0f6640 1 -- start start 2024-09-13T18:31:20.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c806d440 0x7f10c8154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10c80c3470 0x7f10c813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10c8151b50 0x7f10c8151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81551e0 con 0x7f10c806d440 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8152510 con 0x7f10c8151b50 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c814b8a0 con 0x7f10c80c3470 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c806d440 0x7f10c8154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c806d440 0x7f10c8154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34714/0 (socket says 172.21.15.53:34714) 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 -- 172.21.15.53:0/3176312675 learned_addr learned my addr 172.21.15.53:0/3176312675 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c7fff640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10c8151b50 0x7f10c8151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c6ffd640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10c80c3470 0x7f10c813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 -- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10c80c3470 msgr2=0x7f10c813acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10c80c3470 0x7f10c813acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 -- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10c8151b50 msgr2=0x7f10c8151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:20.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10c8151b50 0x7f10c8151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 -- 172.21.15.53:0/3176312675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b80094d0 con 0x7f10c806d440 2024-09-13T18:31:20.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c77fe640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c806d440 0x7f10c8154c00 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f10b801c9d0 tx=0x7f10b801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:20.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10affff640 1 -- 172.21.15.53:0/3176312675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80b3800 con 0x7f10c806d440 2024-09-13T18:31:20.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10affff640 1 -- 172.21.15.53:0/3176312675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b80b3980 con 0x7f10c806d440 2024-09-13T18:31:20.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c813b230 con 0x7f10c806d440 2024-09-13T18:31:20.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10affff640 1 -- 172.21.15.53:0/3176312675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80b3d30 con 0x7f10c806d440 2024-09-13T18:31:20.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c814aae0 con 0x7f10c806d440 2024-09-13T18:31:20.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c80cc2c0 con 0x7f10c806d440 2024-09-13T18:31:20.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10affff640 1 -- 172.21.15.53:0/3176312675 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f10b80b2380 con 0x7f10c806d440 2024-09-13T18:31:20.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10affff640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10b4066990 0x7f10b4068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:20.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10affff640 1 -- 172.21.15.53:0/3176312675 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10b811e920 con 0x7f10c806d440 2024-09-13T18:31:20.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c6ffd640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10b4066990 0x7f10b4068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:20.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.254+0000 7f10c6ffd640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10b4066990 0x7f10b4068e50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10c815c730 tx=0x7f10bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:20.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.258+0000 7f10affff640 1 -- 172.21.15.53:0/3176312675 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10b80eb970 con 0x7f10c806d440 2024-09-13T18:31:20.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.446+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol_clone91250", "target": ["mon-mgr", ""]}) v1 -- 0x7f10c80c3850 con 0x7f10b4066990 2024-09-13T18:31:20.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10affff640 1 -- 172.21.15.53:0/3176312675 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+722 (secure 0 0 0) 0x7f10c80c3850 con 0x7f10b4066990 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "atime": "2024-09-13 18:31:12", 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_pcent": "80.00", 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_quota": 10485760, 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "bytes_used": 8388608, 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "created_at": "2024-09-13 18:31:17", 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "ctime": "2024-09-13 18:31:18", 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "data_pool": "cephfs_data", 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "features": [ 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot-clone", 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot-autoprotect", 2024-09-13T18:31:20.464 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot-retention" 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "flavor": 2, 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "gid": 1000, 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mode": 16895, 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mon_addrs": [ 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.53:6789", 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.87:6789", 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "172.21.15.87:6790" 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "mtime": "2024-09-13 18:31:16", 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "path": "/volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d", 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "pool_namespace": "", 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "complete", 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "clone", 2024-09-13T18:31:20.465 INFO:teuthology.orchestra.run.smithi053.stdout: "uid": 1000 2024-09-13T18:31:20.466 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:20.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10b4066990 msgr2=0x7f10b4068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:20.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10b4066990 0x7f10b4068e50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10c815c730 tx=0x7f10bc009040 comp rx=0 tx=0).stop 2024-09-13T18:31:20.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c806d440 msgr2=0x7f10c8154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:20.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c806d440 0x7f10c8154c00 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f10b801c9d0 tx=0x7f10b801ad30 comp rx=0 tx=0).stop 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 shutdown_connections 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10b4066990 0x7f10b4068e50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10c80c3470 0x7f10c813acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10c8151b50 0x7f10c8151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 --2- 172.21.15.53:0/3176312675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c806d440 0x7f10c8154c00 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 >> 172.21.15.53:0/3176312675 conn(0x7f10c8065c80 msgr2=0x7f10c80cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 shutdown_connections 2024-09-13T18:31:20.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:20.462+0000 7f10ce0f6640 1 -- 172.21.15.53:0/3176312675 wait complete. 2024-09-13T18:31:20.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.482 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.494 INFO:teuthology.orchestra.run.smithi053.stdout:10485760 2024-09-13T18:31:20.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.494 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.550 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:31:20.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.551 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.610 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.673 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630 2024-09-13T18:31:20.673 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.2 2024-09-13T18:31:20.673 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.5 2024-09-13T18:31:20.673 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.4 2024-09-13T18:31:20.673 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.7 2024-09-13T18:31:20.673 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.6 2024-09-13T18:31:20.673 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.0 2024-09-13T18:31:20.674 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.3 2024-09-13T18:31:20.674 INFO:teuthology.orchestra.run.smithi053.stdout:volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.1 2024-09-13T18:31:20.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.675 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.728 INFO:teuthology.orchestra.run.smithi053.stdout:41ff 2024-09-13T18:31:20.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.729 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/) 2024-09-13T18:31:20.777 INFO:teuthology.orchestra.run.smithi053.stdout:41ff 2024-09-13T18:31:20.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.778 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.832 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:20.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.833 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/) 2024-09-13T18:31:20.880 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:20.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.881 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:20.930 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:20.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.932 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/) 2024-09-13T18:31:20.981 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:20.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:20.982 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630) 2024-09-13T18:31:21.030 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:21.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.031 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/) 2024-09-13T18:31:21.080 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:21.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.081 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.2) 2024-09-13T18:31:21.131 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:21.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.132 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.2) 2024-09-13T18:31:21.189 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:21.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.190 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.2) 2024-09-13T18:31:21.243 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:21.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.244 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.2) 2024-09-13T18:31:21.293 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:21.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.294 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.2) 2024-09-13T18:31:21.346 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:21.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.347 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.2) 2024-09-13T18:31:21.396 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:21.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.397 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.2) 2024-09-13T18:31:21.446 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:21.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.447 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.2) 2024-09-13T18:31:21.497 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:21.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.498 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.5) 2024-09-13T18:31:21.554 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:21.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.555 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.5) 2024-09-13T18:31:21.617 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:21.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.618 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.5) 2024-09-13T18:31:21.670 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:21.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.671 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.5) 2024-09-13T18:31:21.720 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:21.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.721 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.5) 2024-09-13T18:31:21.771 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:21.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.772 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.5) 2024-09-13T18:31:21.821 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:21.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.822 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.5) 2024-09-13T18:31:21.879 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:21.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.880 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.5) 2024-09-13T18:31:21.929 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:21.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.930 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.4) 2024-09-13T18:31:21.983 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:21.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:21.984 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.4) 2024-09-13T18:31:22.042 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:22.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.043 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.4) 2024-09-13T18:31:22.096 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:22.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.097 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.4) 2024-09-13T18:31:22.145 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:22.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.147 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.4) 2024-09-13T18:31:22.200 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:22.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.201 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.4) 2024-09-13T18:31:22.248 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:22.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.250 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.4) 2024-09-13T18:31:22.301 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:22.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.301 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.4) 2024-09-13T18:31:22.348 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:22.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.349 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.7) 2024-09-13T18:31:22.399 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:22.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.400 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.7) 2024-09-13T18:31:22.462 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:22.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.463 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.7) 2024-09-13T18:31:22.515 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:22.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.516 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.7) 2024-09-13T18:31:22.565 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:22.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.566 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.7) 2024-09-13T18:31:22.619 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:22.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.621 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.7) 2024-09-13T18:31:22.669 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:22.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.670 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.7) 2024-09-13T18:31:22.723 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:22.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.724 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.7) 2024-09-13T18:31:22.773 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:22.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.774 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.6) 2024-09-13T18:31:22.827 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:22.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.828 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.6) 2024-09-13T18:31:22.884 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:22.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.885 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.6) 2024-09-13T18:31:22.936 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:22.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.937 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.6) 2024-09-13T18:31:22.984 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:22.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:22.985 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.6) 2024-09-13T18:31:23.035 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:23.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.036 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.6) 2024-09-13T18:31:23.084 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:23.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.085 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.6) 2024-09-13T18:31:23.139 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:23.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.140 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.6) 2024-09-13T18:31:23.188 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:23.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.189 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.0) 2024-09-13T18:31:23.240 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:23.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.240 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.0) 2024-09-13T18:31:23.298 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:23.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.299 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.0) 2024-09-13T18:31:23.355 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:23.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.356 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.0) 2024-09-13T18:31:23.405 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:23.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.406 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.0) 2024-09-13T18:31:23.455 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:23.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.456 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.0) 2024-09-13T18:31:23.509 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:23.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.510 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.0) 2024-09-13T18:31:23.564 INFO:teuthology.orchestra.run.smithi053.stdout:1726252275 2024-09-13T18:31:23.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.565 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.0) 2024-09-13T18:31:23.613 INFO:teuthology.orchestra.run.smithi053.stdout:1726252275 2024-09-13T18:31:23.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.614 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.3) 2024-09-13T18:31:23.668 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:23.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.669 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.3) 2024-09-13T18:31:23.730 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:23.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.732 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.3) 2024-09-13T18:31:23.783 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:23.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.785 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.3) 2024-09-13T18:31:23.833 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:23.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.834 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.3) 2024-09-13T18:31:23.887 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:23.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.889 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.3) 2024-09-13T18:31:23.941 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:23.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.942 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.3) 2024-09-13T18:31:23.995 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:23.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:23.996 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.3) 2024-09-13T18:31:24.045 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:24.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.046 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.1) 2024-09-13T18:31:24.099 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:24.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.100 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.1) 2024-09-13T18:31:24.153 INFO:teuthology.orchestra.run.smithi053.stdout:81b4 2024-09-13T18:31:24.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.154 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.1) 2024-09-13T18:31:24.207 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:24.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.208 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.1) 2024-09-13T18:31:24.257 INFO:teuthology.orchestra.run.smithi053.stdout:1000 2024-09-13T18:31:24.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.258 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.1) 2024-09-13T18:31:24.311 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:24.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.313 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.1) 2024-09-13T18:31:24.361 INFO:teuthology.orchestra.run.smithi053.stdout:1271 2024-09-13T18:31:24.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.362 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0/.snap/subvol_snap630/subvolume_file.1) 2024-09-13T18:31:24.420 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:24.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:24.420 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone91250/409ec983-c3d9-411d-9271-b58d7d4b944d/subvolume_file.1) 2024-09-13T18:31:24.469 INFO:teuthology.orchestra.run.smithi053.stdout:1726252276 2024-09-13T18:31:24.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol78490 fake subvol_clone51201 2024-09-13T18:31:24.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 Processor -- start 2024-09-13T18:31:24.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 -- start start 2024-09-13T18:31:24.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb8c015c830 0x7fb8c00d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8c00ccd10 0x7fb8c00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00d2c80 0x7fb8c00d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00d3650 con 0x7fb8c00ccd10 2024-09-13T18:31:24.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00b7db0 con 0x7fb8c015c830 2024-09-13T18:31:24.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c75ad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00d0650 con 0x7fb8c00d2c80 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8c00ccd10 0x7fb8c00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8c00ccd10 0x7fb8c00cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34730/0 (socket says 172.21.15.53:34730) 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 -- 172.21.15.53:0/3922632197 learned_addr learned my addr 172.21.15.53:0/3922632197 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c5b4a640 1 --2- 172.21.15.53:0/3922632197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00d2c80 0x7fb8c00d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c5349640 1 --2- 172.21.15.53:0/3922632197 >> v2:172.21.15.87:3300/0 conn(0x7fb8c015c830 0x7fb8c00d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 -- 172.21.15.53:0/3922632197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00d2c80 msgr2=0x7fb8c00d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 --2- 172.21.15.53:0/3922632197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00d2c80 0x7fb8c00d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 -- 172.21.15.53:0/3922632197 >> v2:172.21.15.87:3300/0 conn(0x7fb8c015c830 msgr2=0x7fb8c00d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 --2- 172.21.15.53:0/3922632197 >> v2:172.21.15.87:3300/0 conn(0x7fb8c015c830 0x7fb8c00d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.650+0000 7fb8c4b48640 1 -- 172.21.15.53:0/3922632197 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00d0c10 con 0x7fb8c00ccd10 2024-09-13T18:31:24.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c4b48640 1 --2- 172.21.15.53:0/3922632197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00ccd10 0x7fb8c00cd180 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00d0240 tx=0x7fb8b001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882352366d49fe71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:24.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8b7fff640 1 -- 172.21.15.53:0/3922632197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00a89d0 con 0x7fb8c00ccd10 2024-09-13T18:31:24.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8b7fff640 1 -- 172.21.15.53:0/3922632197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b00a8b30 con 0x7fb8c00ccd10 2024-09-13T18:31:24.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8b7fff640 1 -- 172.21.15.53:0/3922632197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00b0440 con 0x7fb8c00ccd10 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 -- 172.21.15.53:0/3922632197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00ccd10 msgr2=0x7fb8c00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/3922632197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00ccd10 0x7fb8c00cd180 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00d0240 tx=0x7fb8b001ed10 comp rx=0 tx=0).stop 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 -- 172.21.15.53:0/3922632197 shutdown_connections 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/3922632197 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00d2c80 0x7fb8c00d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/3922632197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00ccd10 0x7fb8c00cd180 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/3922632197 >> v2:172.21.15.87:3300/0 conn(0x7fb8c015c830 0x7fb8c00d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 -- 172.21.15.53:0/3922632197 >> 172.21.15.53:0/3922632197 conn(0x7fb8c0070970 msgr2=0x7fb8c0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 -- 172.21.15.53:0/3922632197 shutdown_connections 2024-09-13T18:31:24.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 -- 172.21.15.53:0/3922632197 wait complete. 2024-09-13T18:31:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 Processor -- start 2024-09-13T18:31:24.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.654+0000 7fb8c75ad640 1 -- start start 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00ccd10 0x7fb8c01570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00d2c80 0x7fb8c0155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c015c830 0x7fb8c00cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00cc7f0 con 0x7fb8c00d2c80 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00ccad0 con 0x7fb8c015c830 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0156600 con 0x7fb8c00ccd10 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00d2c80 0x7fb8c0155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00d2c80 0x7fb8c0155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34736/0 (socket says 172.21.15.53:34736) 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 -- 172.21.15.53:0/1669794803 learned_addr learned my addr 172.21.15.53:0/1669794803 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:24.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c5b4a640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c015c830 0x7fb8c00cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c5349640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00ccd10 0x7fb8c01570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 -- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00ccd10 msgr2=0x7fb8c01570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00ccd10 0x7fb8c01570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 -- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c015c830 msgr2=0x7fb8c00cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c015c830 0x7fb8c00cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 -- 172.21.15.53:0/1669794803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00094d0 con 0x7fb8c00d2c80 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c5b4a640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c015c830 0x7fb8c00cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c4b48640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00d2c80 0x7fb8c0155c80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00b3040 tx=0x7fb8b001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/1669794803 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00b0e00 con 0x7fb8c00d2c80 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/1669794803 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b00bb470 con 0x7fb8c00d2c80 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c01568e0 con 0x7fb8c00d2c80 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/1669794803 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00bb820 con 0x7fb8c00d2c80 2024-09-13T18:31:24.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c01561c0 con 0x7fb8c00d2c80 2024-09-13T18:31:24.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c0156e00 con 0x7fb8c00d2c80 2024-09-13T18:31:24.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/1669794803 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7fb8b00b7070 con 0x7fb8c00d2c80 2024-09-13T18:31:24.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8b5ffb640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb8a4066960 0x7fb8a4068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/1669794803 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8b01229d0 con 0x7fb8c00d2c80 2024-09-13T18:31:24.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.658+0000 7fb8c5349640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb8a4066960 0x7fb8a4068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.662+0000 7fb8c5349640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb8a4066960 0x7fb8a4068e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc003fd0 tx=0x7fb8bc003ce0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:24.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.666+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/1669794803 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8c0156e00 con 0x7fb8c00d2c80 2024-09-13T18:31:24.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.858+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol78490", "snap_name": "fake", "target_sub_name": "subvol_clone51201", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8c00d08a0 con 0x7fb8a4066960 2024-09-13T18:31:24.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.966+0000 7fb8b5ffb640 1 -- 172.21.15.53:0/1669794803 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb8bc0046c0 con 0x7fb8a4066960 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb8a4066960 msgr2=0x7fb8a4068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb8a4066960 0x7fb8a4068e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc003fd0 tx=0x7fb8bc003ce0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00d2c80 msgr2=0x7fb8c0155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00d2c80 0x7fb8c0155c80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00b3040 tx=0x7fb8b001bab0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 shutdown_connections 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb8a4066960 0x7fb8a4068e20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8c015c830 0x7fb8c00cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8c00d2c80 0x7fb8c0155c80 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 --2- 172.21.15.53:0/1669794803 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8c00ccd10 0x7fb8c01570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 >> 172.21.15.53:0/1669794803 conn(0x7fb8c0070970 msgr2=0x7fb8c00d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 shutdown_connections 2024-09-13T18:31:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:24.970+0000 7fb8c75ad640 1 -- 172.21.15.53:0/1669794803 wait complete. 2024-09-13T18:31:25.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51201 2024-09-13T18:31:25.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.130+0000 7f8f49479640 1 Processor -- start 2024-09-13T18:31:25.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.130+0000 7f8f49479640 1 -- start start 2024-09-13T18:31:25.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f49479640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f44066390 0x7f8f4406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f49479640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f440cf1f0 0x7f8f4415a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f49479640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4406d080 con 0x7f8f4415a4a0 2024-09-13T18:31:25.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f49479640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f440ccd20 con 0x7f8f440cf1f0 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f49479640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4406d2b0 con 0x7f8f44066390 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f437fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f440cf1f0 0x7f8f4415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f42ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8f4415a4a0 0x7f8f44065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44908/0 (socket says 172.21.15.53:44908) 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f42ffd640 1 -- 172.21.15.53:0/2044793417 learned_addr learned my addr 172.21.15.53:0/2044793417 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f427fc640 1 --2- 172.21.15.53:0/2044793417 >> v2:172.21.15.87:3300/0 conn(0x7f8f44066390 0x7f8f4406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f41ffb640 1 -- 172.21.15.53:0/2044793417 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244082736 0 0) 0x7f8f4406d080 con 0x7f8f4415a4a0 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f41ffb640 1 -- 172.21.15.53:0/2044793417 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003530 con 0x7f8f4415a4a0 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f437fe640 1 -- 172.21.15.53:0/2044793417 >> v2:172.21.15.87:3300/0 conn(0x7f8f44066390 msgr2=0x7f8f4406cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f437fe640 1 --2- 172.21.15.53:0/2044793417 >> v2:172.21.15.87:3300/0 conn(0x7f8f44066390 0x7f8f4406cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f437fe640 1 -- 172.21.15.53:0/2044793417 >> v1:172.21.15.53:6789/0 conn(0x7f8f4415a4a0 legacy=0x7f8f44065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f437fe640 1 -- 172.21.15.53:0/2044793417 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4406d590 con 0x7f8f440cf1f0 2024-09-13T18:31:25.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f437fe640 1 --2- 172.21.15.53:0/2044793417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f440cf1f0 0x7f8f4415a880 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f8f440ce250 tx=0x7f8f3401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2fc66ad65b80f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f41ffb640 1 -- 172.21.15.53:0/2044793417 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340ac620 con 0x7f8f440cf1f0 2024-09-13T18:31:25.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f41ffb640 1 -- 172.21.15.53:0/2044793417 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340ac780 con 0x7f8f440cf1f0 2024-09-13T18:31:25.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.134+0000 7f8f41ffb640 1 -- 172.21.15.53:0/2044793417 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340acb10 con 0x7f8f440cf1f0 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- 172.21.15.53:0/2044793417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f440cf1f0 msgr2=0x7f8f4415a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 --2- 172.21.15.53:0/2044793417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f440cf1f0 0x7f8f4415a880 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f8f440ce250 tx=0x7f8f3401c3c0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- 172.21.15.53:0/2044793417 shutdown_connections 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 --2- 172.21.15.53:0/2044793417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f440cf1f0 0x7f8f4415a880 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 --2- 172.21.15.53:0/2044793417 >> v2:172.21.15.87:3300/0 conn(0x7f8f44066390 0x7f8f4406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- 172.21.15.53:0/2044793417 >> 172.21.15.53:0/2044793417 conn(0x7f8f44069f50 msgr2=0x7f8f4406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- 172.21.15.53:0/2044793417 shutdown_connections 2024-09-13T18:31:25.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- 172.21.15.53:0/2044793417 wait complete. 2024-09-13T18:31:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 Processor -- start 2024-09-13T18:31:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- start start 2024-09-13T18:31:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f44066390 0x7f8f441501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f440cf1f0 0x7f8f441f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4415a4a0 0x7f8f44154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440cbfd0 con 0x7f8f4415a4a0 2024-09-13T18:31:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440cb7c0 con 0x7f8f44066390 2024-09-13T18:31:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44151ff0 con 0x7f8f440cf1f0 2024-09-13T18:31:25.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4415a4a0 0x7f8f44154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4415a4a0 0x7f8f44154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34746/0 (socket says 172.21.15.53:34746) 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 -- 172.21.15.53:0/779341984 learned_addr learned my addr 172.21.15.53:0/779341984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f42ffd640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f44066390 0x7f8f441501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f427fc640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f440cf1f0 0x7f8f441f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 -- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f440cf1f0 msgr2=0x7f8f441f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f440cf1f0 0x7f8f441f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 -- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f44066390 msgr2=0x7f8f441501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f44066390 0x7f8f441501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 -- 172.21.15.53:0/779341984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34009420 con 0x7f8f4415a4a0 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f427fc640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f440cf1f0 0x7f8f441f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f42ffd640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f44066390 0x7f8f441501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f437fe640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4415a4a0 0x7f8f44154950 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f8f340af040 tx=0x7f8f34019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/779341984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340b5410 con 0x7f8f4415a4a0 2024-09-13T18:31:25.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/779341984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340b5570 con 0x7f8f4415a4a0 2024-09-13T18:31:25.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f440cba10 con 0x7f8f4415a4a0 2024-09-13T18:31:25.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/779341984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340b5900 con 0x7f8f4415a4a0 2024-09-13T18:31:25.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.138+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f44154150 con 0x7f8f4415a4a0 2024-09-13T18:31:25.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.142+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44153fb0 con 0x7f8f4415a4a0 2024-09-13T18:31:25.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.142+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/779341984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f8f340b3040 con 0x7f8f4415a4a0 2024-09-13T18:31:25.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.142+0000 7f8f3b7fe640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f24066960 0x7f8f24068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.142+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/779341984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f3411e7e0 con 0x7f8f4415a4a0 2024-09-13T18:31:25.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.142+0000 7f8f42ffd640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f24066960 0x7f8f24068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.142+0000 7f8f42ffd640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f24066960 0x7f8f24068e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c001570 tx=0x7f8f3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.146+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/779341984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f44153fb0 con 0x7f8f4415a4a0 2024-09-13T18:31:25.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.346+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51201", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f4415b5d0 con 0x7f8f24066960 2024-09-13T18:31:25.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:25.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.850+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/779341984 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+153 (secure 0 0 0) 0x7f8f3c001dc0 con 0x7f8f24066960 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: "status": { 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "pending", 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: "source": { 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: "volume": "cephfs", 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: "subvolume": "subvol78490", 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot": "fake" 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:25.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:25.855 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f24066960 msgr2=0x7f8f24068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f24066960 0x7f8f24068e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c001570 tx=0x7f8f3c009040 comp rx=0 tx=0).stop 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4415a4a0 msgr2=0x7f8f44154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4415a4a0 0x7f8f44154950 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f8f340af040 tx=0x7f8f34019160 comp rx=0 tx=0).stop 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 shutdown_connections 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f24066960 0x7f8f24068e20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f440cf1f0 0x7f8f441f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4415a4a0 0x7f8f44154950 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 --2- 172.21.15.53:0/779341984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f44066390 0x7f8f441501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 >> 172.21.15.53:0/779341984 conn(0x7f8f44069f50 msgr2=0x7f8f44152e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 shutdown_connections 2024-09-13T18:31:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:25.854+0000 7f8f49479640 1 -- 172.21.15.53:0/779341984 wait complete. 2024-09-13T18:31:26.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone51201 2024-09-13T18:31:27.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.022+0000 7f8f42cc6640 1 Processor -- start 2024-09-13T18:31:27.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.022+0000 7f8f42cc6640 1 -- start start 2024-09-13T18:31:27.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f42cc6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c15c830 0x7f8f3c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:27.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f42cc6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f3c0d3390 0x7f8f3c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:27.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f42cc6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0b7db0 con 0x7f8f3c0ccd10 2024-09-13T18:31:27.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f42cc6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0d0650 con 0x7f8f3c0d3390 2024-09-13T18:31:27.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f42cc6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0d0c10 con 0x7f8f3c15c830 2024-09-13T18:31:27.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f41263640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f3c0d3390 0x7f8f3c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:27.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f40a62640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c15c830 0x7f8f3c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:27.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f41263640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f3c0d3390 0x7f8f3c0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:36444/0 (socket says 172.21.15.53:36444) 2024-09-13T18:31:27.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f41263640 1 -- 172.21.15.53:0/1331088216 learned_addr learned my addr 172.21.15.53:0/1331088216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:27.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f40a62640 1 -- 172.21.15.53:0/1331088216 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c0d3390 msgr2=0x7f8f3c0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:27.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f40a62640 1 --2- 172.21.15.53:0/1331088216 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c0d3390 0x7f8f3c0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f40a62640 1 -- 172.21.15.53:0/1331088216 >> v1:172.21.15.87:6789/0 conn(0x7f8f3c0ccd10 legacy=0x7f8f3c0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:27.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f40a62640 1 -- 172.21.15.53:0/1331088216 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0cd7d0 con 0x7f8f3c15c830 2024-09-13T18:31:27.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.026+0000 7f8f41263640 1 --2- 172.21.15.53:0/1331088216 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c0d3390 0x7f8f3c0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:27.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f40a62640 1 --2- 172.21.15.53:0/1331088216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c15c830 0x7f8f3c0d10a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f300097c0 tx=0x7f8f3001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76a2958cfd8823b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:27.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/1331088216 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300ad640 con 0x7f8f3c15c830 2024-09-13T18:31:27.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/1331088216 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f300ad7a0 con 0x7f8f3c15c830 2024-09-13T18:31:27.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f3b7fe640 1 -- 172.21.15.53:0/1331088216 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300adb30 con 0x7f8f3c15c830 2024-09-13T18:31:27.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- 172.21.15.53:0/1331088216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c15c830 msgr2=0x7f8f3c0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:27.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/1331088216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c15c830 0x7f8f3c0d10a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f300097c0 tx=0x7f8f3001c4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- 172.21.15.53:0/1331088216 shutdown_connections 2024-09-13T18:31:27.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/1331088216 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c0d3390 0x7f8f3c0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/1331088216 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c15c830 0x7f8f3c0d10a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- 172.21.15.53:0/1331088216 >> 172.21.15.53:0/1331088216 conn(0x7f8f3c070970 msgr2=0x7f8f3c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- 172.21.15.53:0/1331088216 shutdown_connections 2024-09-13T18:31:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- 172.21.15.53:0/1331088216 wait complete. 2024-09-13T18:31:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 Processor -- start 2024-09-13T18:31:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- start start 2024-09-13T18:31:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c0ccd10 0x7f8f3c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c0d3390 0x7f8f3c0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f3c15c830 0x7f8f3c0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0c9790 con 0x7f8f3c15c830 2024-09-13T18:31:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c151520 con 0x7f8f3c0ccd10 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f42cc6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c152f30 con 0x7f8f3c0d3390 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f40a62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c0ccd10 0x7f8f3c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f3bfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c0d3390 0x7f8f3c0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f41263640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f3c15c830 0x7f8f3c0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f40a62640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c0ccd10 0x7f8f3c150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:36446/0 (socket says 172.21.15.53:36446) 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f41263640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f3c15c830 0x7f8f3c0cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42050/0 (socket says 172.21.15.53:42050) 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.030+0000 7f8f40a62640 1 -- 172.21.15.53:0/3741383532 learned_addr learned my addr 172.21.15.53:0/3741383532 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f41263640 1 -- 172.21.15.53:0/3741383532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c0d3390 msgr2=0x7f8f3c0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f41263640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c0d3390 0x7f8f3c0cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f41263640 1 -- 172.21.15.53:0/3741383532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c0ccd10 msgr2=0x7f8f3c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f41263640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c0ccd10 0x7f8f3c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f41263640 1 -- 172.21.15.53:0/3741383532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34009b30 con 0x7f8f3c15c830 2024-09-13T18:31:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f41263640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f3c15c830 0x7f8f3c0cb7a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400ef90 tx=0x7f8f3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f397fa640 1 -- 172.21.15.53:0/3741383532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400cd20 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f397fa640 1 -- 172.21.15.53:0/3741383532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3400f040 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f30009420 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f397fa640 1 -- 172.21.15.53:0/3741383532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400cea0 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c0c99e0 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c0cfe90 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f397fa640 1 -- 172.21.15.53:0/3741383532 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f8f340146c0 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f397fa640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f20066960 0x7f8f20068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f397fa640 1 -- 172.21.15.53:0/3741383532 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f34084d80 con 0x7f8f3c15c830 2024-09-13T18:31:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f40a62640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f20066960 0x7f8f20068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:27.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.034+0000 7f8f40a62640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f20066960 0x7f8f20068e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f30000c10 tx=0x7f8f300a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.038+0000 7f8f397fa640 1 -- 172.21.15.53:0/3741383532 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f34051d90 con 0x7f8f3c15c830 2024-09-13T18:31:27.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:27.234+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone51201", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f3c0b5eb0 con 0x7f8f20066960 2024-09-13T18:31:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.842+0000 7f8f397fa640 1 -- 172.21.15.53:0/3741383532 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f8f300bc070 con 0x7f8f20066960 2024-09-13T18:31:30.844 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:30.844 INFO:teuthology.orchestra.run.smithi053.stdout: "status": { 2024-09-13T18:31:30.844 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "complete" 2024-09-13T18:31:30.844 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:30.845 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f20066960 msgr2=0x7f8f20068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f20066960 0x7f8f20068e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f30000c10 tx=0x7f8f300a7070 comp rx=0 tx=0).stop 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f3c15c830 msgr2=0x7f8f3c0cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f3c15c830 0x7f8f3c0cb7a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400ef90 tx=0x7f8f3400c490 comp rx=0 tx=0).stop 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 shutdown_connections 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f20066960 0x7f8f20068e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f3c0d3390 0x7f8f3c0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f3c15c830 0x7f8f3c0cb7a0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 --2- 172.21.15.53:0/3741383532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c0ccd10 0x7f8f3c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 >> 172.21.15.53:0/3741383532 conn(0x7f8f3c070970 msgr2=0x7f8f3c070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 shutdown_connections 2024-09-13T18:31:30.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:30.846+0000 7f8f42cc6640 1 -- 172.21.15.53:0/3741383532 wait complete. 2024-09-13T18:31:30.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:30.867 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone51201/.meta) 2024-09-13T18:31:30.882 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:31:30.883 INFO:teuthology.orchestra.run.smithi053.stdout:version = 2 2024-09-13T18:31:30.883 INFO:teuthology.orchestra.run.smithi053.stdout:type = clone 2024-09-13T18:31:30.883 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol_clone51201/b4754346-a8cc-4503-9a15-9942acd0adf3 2024-09-13T18:31:30.883 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:31:30.883 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:30.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol78490 subvol_snap630 2024-09-13T18:31:31.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.058+0000 7f6b48525640 1 Processor -- start 2024-09-13T18:31:31.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.058+0000 7f6b48525640 1 -- start start 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b48525640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 0x7f6b401673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b48525640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b40160230 con 0x7f6b4015c6d0 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b48525640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4015dac0 con 0x7f6b400acff0 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b48525640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400aec00 con 0x7f6b40066390 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b462c1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b4015c6d0 0x7f6b400ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37232/0 (socket says 172.21.15.53:37232) 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b462c1640 1 -- 172.21.15.53:0/1465168231 learned_addr learned my addr 172.21.15.53:0/1465168231 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b46ac2640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 0x7f6b401673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368892046 0 0) 0x7f6b40160230 con 0x7f6b4015c6d0 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b2c003530 con 0x7f6b4015c6d0 2024-09-13T18:31:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 573167126 0 0) 0x7f6b2c003530 con 0x7f6b4015c6d0 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 msgr2=0x7f6b401673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 0x7f6b401673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 >> v1:172.21.15.87:6789/0 conn(0x7f6b400acff0 legacy=0x7f6b40065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40160460 con 0x7f6b4015c6d0 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6b3c001680 con 0x7f6b4015c6d0 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 >> v1:172.21.15.53:6789/0 conn(0x7f6b4015c6d0 legacy=0x7f6b400ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2c0039b0 0x7f6b2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 0x7f6b2c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400aec00 con 0x7f6b2c004d10 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c00ba40 con 0x7f6b2c0039b0 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c00bc00 con 0x7f6b40066390 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b46ac2640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b462c1640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2c0039b0 0x7f6b2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b45ac0640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 0x7f6b2c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b46ac2640 1 -- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 msgr2=0x7f6b2c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b46ac2640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b40066390 0x7f6b2c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b46ac2640 1 -- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2c0039b0 msgr2=0x7f6b2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b46ac2640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2c0039b0 0x7f6b2c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.062+0000 7f6b46ac2640 1 -- 172.21.15.53:0/1465168231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c003530 con 0x7f6b2c004d10 2024-09-13T18:31:31.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b46ac2640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b2c005190 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009f90 tx=0x7f6b3801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234e29e4b408b110 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b380a5c50 con 0x7f6b2c004d10 2024-09-13T18:31:31.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3800f040 con 0x7f6b2c004d10 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b452bf640 1 -- 172.21.15.53:0/1465168231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b380ad440 con 0x7f6b2c004d10 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- 172.21.15.53:0/1465168231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 msgr2=0x7f6b2c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 --2- 172.21.15.53:0/1465168231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b2c005190 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009f90 tx=0x7f6b3801cc40 comp rx=0 tx=0).stop 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b46ac2640 1 -- 172.21.15.53:0/1465168231 reap_dead start 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- 172.21.15.53:0/1465168231 shutdown_connections 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- 172.21.15.53:0/1465168231 >> 172.21.15.53:0/1465168231 conn(0x7f6b400b11a0 msgr2=0x7f6b400b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- 172.21.15.53:0/1465168231 shutdown_connections 2024-09-13T18:31:31.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- 172.21.15.53:0/1465168231 wait complete. 2024-09-13T18:31:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 Processor -- start 2024-09-13T18:31:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- start start 2024-09-13T18:31:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b400cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cee80 0x7f6b400cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b4006c790 0x7f6b4006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4006d150 con 0x7f6b2c004d10 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4014b140 con 0x7f6b400cee80 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b48525640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4014b420 con 0x7f6b4006c790 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b462c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b400cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b462c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b400cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42070/0 (socket says 172.21.15.53:42070) 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b462c1640 1 -- 172.21.15.53:0/4220760186 learned_addr learned my addr 172.21.15.53:0/4220760186 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b46ac2640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b4006c790 0x7f6b4006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.066+0000 7f6b45ac0640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cee80 0x7f6b400cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b462c1640 1 -- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b4006c790 msgr2=0x7f6b4006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b462c1640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b4006c790 0x7f6b4006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b462c1640 1 -- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cee80 msgr2=0x7f6b400cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b462c1640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cee80 0x7f6b400cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b462c1640 1 -- 172.21.15.53:0/4220760186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4014b700 con 0x7f6b2c004d10 2024-09-13T18:31:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b462c1640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b400cd3e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00e7a0 tx=0x7f6b3c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b36ffd640 1 -- 172.21.15.53:0/4220760186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00c8d0 con 0x7f6b2c004d10 2024-09-13T18:31:31.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b36ffd640 1 -- 172.21.15.53:0/4220760186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00ca50 con 0x7f6b2c004d10 2024-09-13T18:31:31.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4014b9e0 con 0x7f6b2c004d10 2024-09-13T18:31:31.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b36ffd640 1 -- 172.21.15.53:0/4220760186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00ce00 con 0x7f6b2c004d10 2024-09-13T18:31:31.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4014ada0 con 0x7f6b2c004d10 2024-09-13T18:31:31.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b40148da0 con 0x7f6b2c004d10 2024-09-13T18:31:31.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b36ffd640 1 -- 172.21.15.53:0/4220760186 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f6b3c01d460 con 0x7f6b2c004d10 2024-09-13T18:31:31.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b36ffd640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b24066960 0x7f6b24068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b36ffd640 1 -- 172.21.15.53:0/4220760186 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b3c084e90 con 0x7f6b2c004d10 2024-09-13T18:31:31.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b45ac0640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b24066960 0x7f6b24068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.070+0000 7f6b45ac0640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b24066960 0x7f6b24068e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006d4a0 tx=0x7f6b30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.074+0000 7f6b36ffd640 1 -- 172.21.15.53:0/4220760186 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b3c051f80 con 0x7f6b2c004d10 2024-09-13T18:31:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.262+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "cephfs", "sub_name": "subvol78490", "snap_name": "subvol_snap630", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b40067140 con 0x7f6b24066960 2024-09-13T18:31:31.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b36ffd640 1 -- 172.21.15.53:0/4220760186 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+115 (secure 0 0 0) 0x7f6b40067140 con 0x7f6b24066960 2024-09-13T18:31:31.292 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:31.292 INFO:teuthology.orchestra.run.smithi053.stdout: "created_at": "2024-09-13 18:31:17.259627", 2024-09-13T18:31:31.292 INFO:teuthology.orchestra.run.smithi053.stdout: "data_pool": "cephfs_data", 2024-09-13T18:31:31.292 INFO:teuthology.orchestra.run.smithi053.stdout: "has_pending_clones": "no" 2024-09-13T18:31:31.292 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b24066960 msgr2=0x7f6b24068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b24066960 0x7f6b24068e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006d4a0 tx=0x7f6b30009040 comp rx=0 tx=0).stop 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 msgr2=0x7f6b400cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b400cd3e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00e7a0 tx=0x7f6b3c00ec60 comp rx=0 tx=0).stop 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 shutdown_connections 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b24066960 0x7f6b24068e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b4006c790 0x7f6b4006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b400cee80 0x7f6b400cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 --2- 172.21.15.53:0/4220760186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c004d10 0x7f6b400cd3e0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.290+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 >> 172.21.15.53:0/4220760186 conn(0x7f6b400b11a0 msgr2=0x7f6b400af010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:31.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.294+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 shutdown_connections 2024-09-13T18:31:31.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.294+0000 7f6b48525640 1 -- 172.21.15.53:0/4220760186 wait complete. 2024-09-13T18:31:31.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs subvol78490 2024-09-13T18:31:31.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.434+0000 7f0d660d5640 1 Processor -- start 2024-09-13T18:31:31.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.434+0000 7f0d660d5640 1 -- start start 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d6015a580 0x7f0d600b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d600b39b0 0x7f0d600b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600b3df0 con 0x7f0d600b4550 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600adcd0 con 0x7f0d600b39b0 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600adf40 con 0x7f0d6015a580 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d600b39b0 0x7f0d600b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0d600b4550 0x7f0d6006d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37246/0 (socket says 172.21.15.53:37246) 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5ffff640 1 -- 172.21.15.53:0/289522377 learned_addr learned my addr 172.21.15.53:0/289522377 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5f7fe640 1 --2- 172.21.15.53:0/289522377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d6015a580 0x7f0d600b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5e7fc640 1 -- 172.21.15.53:0/289522377 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287700989 0 0) 0x7f0d600b3df0 con 0x7f0d600b4550 2024-09-13T18:31:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5e7fc640 1 -- 172.21.15.53:0/289522377 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d48003530 con 0x7f0d600b4550 2024-09-13T18:31:31.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5effd640 1 -- 172.21.15.53:0/289522377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d6015a580 msgr2=0x7f0d600b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:31.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5effd640 1 --2- 172.21.15.53:0/289522377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d6015a580 0x7f0d600b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5effd640 1 -- 172.21.15.53:0/289522377 >> v1:172.21.15.53:6789/0 conn(0x7f0d600b4550 legacy=0x7f0d6006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5effd640 1 -- 172.21.15.53:0/289522377 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600ae220 con 0x7f0d600b39b0 2024-09-13T18:31:31.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5f7fe640 1 --2- 172.21.15.53:0/289522377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d6015a580 0x7f0d600b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:31.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5effd640 1 --2- 172.21.15.53:0/289522377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600b39b0 0x7f0d600b4010 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f0d540097c0 tx=0x7f0d5401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df50a051cf5bc342 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5e7fc640 1 -- 172.21.15.53:0/289522377 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540ad640 con 0x7f0d600b39b0 2024-09-13T18:31:31.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5e7fc640 1 -- 172.21.15.53:0/289522377 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d540ad7a0 con 0x7f0d600b39b0 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d5e7fc640 1 -- 172.21.15.53:0/289522377 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540adb10 con 0x7f0d600b39b0 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- 172.21.15.53:0/289522377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600b39b0 msgr2=0x7f0d600b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 --2- 172.21.15.53:0/289522377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600b39b0 0x7f0d600b4010 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f0d540097c0 tx=0x7f0d5401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- 172.21.15.53:0/289522377 shutdown_connections 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 --2- 172.21.15.53:0/289522377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d600b39b0 0x7f0d600b4010 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 --2- 172.21.15.53:0/289522377 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d6015a580 0x7f0d600b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- 172.21.15.53:0/289522377 >> 172.21.15.53:0/289522377 conn(0x7f0d600b5990 msgr2=0x7f0d600b5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- 172.21.15.53:0/289522377 shutdown_connections 2024-09-13T18:31:31.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.438+0000 7f0d660d5640 1 -- 172.21.15.53:0/289522377 wait complete. 2024-09-13T18:31:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 Processor -- start 2024-09-13T18:31:31.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 -- start start 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d600b39b0 0x7f0d60140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d600b4550 0x7f0d60151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d6015a580 0x7f0d601517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6015c420 con 0x7f0d6015a580 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6015c700 con 0x7f0d600b4550 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6015c9e0 con 0x7f0d600b39b0 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d6015a580 0x7f0d601517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d6015a580 0x7f0d601517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42080/0 (socket says 172.21.15.53:42080) 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 -- 172.21.15.53:0/810207715 learned_addr learned my addr 172.21.15.53:0/810207715 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5effd640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d600b4550 0x7f0d60151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5f7fe640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d600b39b0 0x7f0d60140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 -- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d600b39b0 msgr2=0x7f0d60140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d600b39b0 0x7f0d60140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 -- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d600b4550 msgr2=0x7f0d60151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d600b4550 0x7f0d60151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 -- 172.21.15.53:0/810207715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009420 con 0x7f0d6015a580 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5f7fe640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d600b39b0 0x7f0d60140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d5ffff640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d6015a580 0x7f0d601517c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800caa0 tx=0x7f0d5800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d47fff640 1 -- 172.21.15.53:0/810207715 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800ac00 con 0x7f0d6015a580 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d47fff640 1 -- 172.21.15.53:0/810207715 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5800ad60 con 0x7f0d6015a580 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d47fff640 1 -- 172.21.15.53:0/810207715 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58012620 con 0x7f0d6015a580 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6015ccc0 con 0x7f0d6015a580 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60140dd0 con 0x7f0d6015a580 2024-09-13T18:31:31.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.442+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6015cf00 con 0x7f0d6015a580 2024-09-13T18:31:31.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.446+0000 7f0d47fff640 1 -- 172.21.15.53:0/810207715 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f0d58007070 con 0x7f0d6015a580 2024-09-13T18:31:31.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.446+0000 7f0d47fff640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d4c066960 0x7f0d4c068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.446+0000 7f0d47fff640 1 -- 172.21.15.53:0/810207715 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d580845c0 con 0x7f0d6015a580 2024-09-13T18:31:31.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.446+0000 7f0d5f7fe640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d4c066960 0x7f0d4c068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.446+0000 7f0d5f7fe640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d4c066960 0x7f0d4c068e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d6015da50 tx=0x7f0d50008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.450+0000 7f0d47fff640 1 -- 172.21.15.53:0/810207715 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d6015cf00 con 0x7f0d6015a580 2024-09-13T18:31:31.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.642+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "subvol78490", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d60167130 con 0x7f0d4c066960 2024-09-13T18:31:31.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d47fff640 1 -- 172.21.15.53:0/810207715 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+85 (secure 0 0 0) 0x7f0d5000f860 con 0x7f0d4c066960 2024-09-13T18:31:31.671 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:31:31.671 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:31.671 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "fake" 2024-09-13T18:31:31.671 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:31.672 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:31.672 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "subvol_snap630" 2024-09-13T18:31:31.672 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:31.672 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:31:31.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d4c066960 msgr2=0x7f0d4c068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d4c066960 0x7f0d4c068e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d6015da50 tx=0x7f0d50008040 comp rx=0 tx=0).stop 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d6015a580 msgr2=0x7f0d601517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d6015a580 0x7f0d601517c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800caa0 tx=0x7f0d5800cf60 comp rx=0 tx=0).stop 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 shutdown_connections 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d4c066960 0x7f0d4c068e20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d6015a580 0x7f0d601517c0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d600b4550 0x7f0d60151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 --2- 172.21.15.53:0/810207715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d600b39b0 0x7f0d60140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 >> 172.21.15.53:0/810207715 conn(0x7f0d600b5990 msgr2=0x7f0d60159230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 shutdown_connections 2024-09-13T18:31:31.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.670+0000 7f0d660d5640 1 -- 172.21.15.53:0/810207715 wait complete. 2024-09-13T18:31:31.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol78490 subvol_snap630 2024-09-13T18:31:31.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.822+0000 7f0e1ebc8640 1 Processor -- start 2024-09-13T18:31:31.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.822+0000 7f0e1ebc8640 1 -- start start 2024-09-13T18:31:31.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1ebc8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0e180cdad0 0x7f0e18143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1ebc8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e18143d50 0x7f0e1806b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1ebc8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180b1ba0 con 0x7f0e180cd6f0 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1ebc8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180b3020 con 0x7f0e18143d50 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1ebc8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180b1f80 con 0x7f0e180cdad0 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e18143d50 0x7f0e1806b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e18143d50 0x7f0e1806b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42094/0 (socket says 172.21.15.53:42094) 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 -- 172.21.15.53:0/2287977807 learned_addr learned my addr 172.21.15.53:0/2287977807 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e17fff640 1 --2- 172.21.15.53:0/2287977807 >> v2:172.21.15.87:3300/0 conn(0x7f0e180cdad0 0x7f0e18143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 -- 172.21.15.53:0/2287977807 >> v2:172.21.15.87:3300/0 conn(0x7f0e180cdad0 msgr2=0x7f0e18143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 --2- 172.21.15.53:0/2287977807 >> v2:172.21.15.87:3300/0 conn(0x7f0e180cdad0 0x7f0e18143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 -- 172.21.15.53:0/2287977807 >> v1:172.21.15.87:6789/0 conn(0x7f0e180cd6f0 legacy=0x7f0e180b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:31.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 -- 172.21.15.53:0/2287977807 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180b2260 con 0x7f0e18143d50 2024-09-13T18:31:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e1d165640 1 --2- 172.21.15.53:0/2287977807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e18143d50 0x7f0e1806b320 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f0e180adae0 tx=0x7f0e1001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f765880877fa828 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e177fe640 1 -- 172.21.15.53:0/2287977807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100a5840 con 0x7f0e18143d50 2024-09-13T18:31:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e177fe640 1 -- 172.21.15.53:0/2287977807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e100a59a0 con 0x7f0e18143d50 2024-09-13T18:31:31.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.826+0000 7f0e177fe640 1 -- 172.21.15.53:0/2287977807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100a5d30 con 0x7f0e18143d50 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/2287977807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e18143d50 msgr2=0x7f0e1806b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/2287977807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e18143d50 0x7f0e1806b320 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f0e180adae0 tx=0x7f0e1001c980 comp rx=0 tx=0).stop 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/2287977807 shutdown_connections 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/2287977807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e18143d50 0x7f0e1806b320 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/2287977807 >> v2:172.21.15.87:3300/0 conn(0x7f0e180cdad0 0x7f0e18143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/2287977807 >> 172.21.15.53:0/2287977807 conn(0x7f0e18073330 msgr2=0x7f0e18065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/2287977807 shutdown_connections 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/2287977807 wait complete. 2024-09-13T18:31:31.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 Processor -- start 2024-09-13T18:31:31.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- start start 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e180cd6f0 0x7f0e18159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e180cdad0 0x7f0e1815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e18143d50 0x7f0e1806f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1815b3b0 con 0x7f0e180cd6f0 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1815b690 con 0x7f0e180cdad0 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1815b970 con 0x7f0e18143d50 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e180cd6f0 0x7f0e18159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e180cd6f0 0x7f0e18159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42106/0 (socket says 172.21.15.53:42106) 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 -- 172.21.15.53:0/3745390356 learned_addr learned my addr 172.21.15.53:0/3745390356 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e17fff640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e180cdad0 0x7f0e1815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1d165640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e18143d50 0x7f0e1806f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 -- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e18143d50 msgr2=0x7f0e1806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e18143d50 0x7f0e1806f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 -- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e180cdad0 msgr2=0x7f0e1815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e180cdad0 0x7f0e1815a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 -- 172.21.15.53:0/3745390356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10009b30 con 0x7f0e180cd6f0 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1d165640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e18143d50 0x7f0e1806f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e17fff640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e180cdad0 0x7f0e1815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1c964640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e180cd6f0 0x7f0e18159e20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c450 tx=0x7f0e0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e157fa640 1 -- 172.21.15.53:0/3745390356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c012830 con 0x7f0e180cd6f0 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e157fa640 1 -- 172.21.15.53:0/3745390356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0129b0 con 0x7f0e180cd6f0 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1815bc50 con 0x7f0e180cd6f0 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e157fa640 1 -- 172.21.15.53:0/3745390356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c012d60 con 0x7f0e180cd6f0 2024-09-13T18:31:31.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.830+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1815c450 con 0x7f0e180cd6f0 2024-09-13T18:31:31.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.834+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e18143810 con 0x7f0e180cd6f0 2024-09-13T18:31:31.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.834+0000 7f0e157fa640 1 -- 172.21.15.53:0/3745390356 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f0e0c01c460 con 0x7f0e180cd6f0 2024-09-13T18:31:31.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.834+0000 7f0e157fa640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0dfc066960 0x7f0dfc068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:31.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.834+0000 7f0e157fa640 1 -- 172.21.15.53:0/3745390356 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e0c0843e0 con 0x7f0e180cd6f0 2024-09-13T18:31:31.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.834+0000 7f0e17fff640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0dfc066960 0x7f0dfc068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:31.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.834+0000 7f0e17fff640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0dfc066960 0x7f0dfc068e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0e180c4730 tx=0x7f0e04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:31.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:31.838+0000 7f0e157fa640 1 -- 172.21.15.53:0/3745390356 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e0c051490 con 0x7f0e180cd6f0 2024-09-13T18:31:32.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.030+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol78490", "snap_name": "subvol_snap630", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e180cbdd0 con 0x7f0dfc066960 2024-09-13T18:31:32.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.082+0000 7f0e157fa640 1 -- 172.21.15.53:0/3745390356 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0e04007660 con 0x7f0dfc066960 2024-09-13T18:31:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0dfc066960 msgr2=0x7f0dfc068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0dfc066960 0x7f0dfc068e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0e180c4730 tx=0x7f0e04008040 comp rx=0 tx=0).stop 2024-09-13T18:31:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e180cd6f0 msgr2=0x7f0e18159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e180cd6f0 0x7f0e18159e20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c450 tx=0x7f0e0c00c910 comp rx=0 tx=0).stop 2024-09-13T18:31:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 shutdown_connections 2024-09-13T18:31:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0dfc066960 0x7f0dfc068e20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0e18143d50 0x7f0e1806f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e180cdad0 0x7f0e1815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 --2- 172.21.15.53:0/3745390356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e180cd6f0 0x7f0e18159e20 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 >> 172.21.15.53:0/3745390356 conn(0x7f0e18073330 msgr2=0x7f0e180b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 shutdown_connections 2024-09-13T18:31:32.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.086+0000 7f0e1ebc8640 1 -- 172.21.15.53:0/3745390356 wait complete. 2024-09-13T18:31:32.106 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol78490 fake 2024-09-13T18:31:32.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.238+0000 7ff8dcdc4640 1 Processor -- start 2024-09-13T18:31:32.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.238+0000 7ff8dcdc4640 1 -- start start 2024-09-13T18:31:32.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8dcdc4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff8d80acff0 0x7ff8d80b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8dcdc4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 0x7ff8d80b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8dcdc4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80706a0 con 0x7ff8d8145400 2024-09-13T18:31:32.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8dcdc4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80b26d0 con 0x7ff8d80acff0 2024-09-13T18:31:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8dcdc4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8160410 con 0x7ff8d8145900 2024-09-13T18:31:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff8d8145400 0x7ff8d80ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37262/0 (socket says 172.21.15.53:37262) 2024-09-13T18:31:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d659c640 1 -- 172.21.15.53:0/1963967057 learned_addr learned my addr 172.21.15.53:0/1963967057 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261266777 0 0) 0x7ff8c8001120 con 0x7ff8d8145400 2024-09-13T18:31:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 0x7ff8d80b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c4003530 con 0x7ff8d8145400 2024-09-13T18:31:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8cffff640 1 --2- 172.21.15.53:0/1963967057 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80acff0 0x7ff8d80b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 670572818 0 0) 0x7ff8c4003530 con 0x7ff8d8145400 2024-09-13T18:31:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 msgr2=0x7ff8d80b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 0x7ff8d80b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80acff0 msgr2=0x7ff8d80b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 --2- 172.21.15.53:0/1963967057 >> v2:172.21.15.87:3300/0 conn(0x7ff8d80acff0 0x7ff8d80b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d81606f0 con 0x7ff8d8145400 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ff8c8001830 con 0x7ff8d8145400 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 >> v1:172.21.15.53:6789/0 conn(0x7ff8d8145400 legacy=0x7ff8d80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 0x7ff8c4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8c4003f00 0x7ff8c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c4004d10 0x7ff8c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80b26d0 con 0x7ff8c4004d10 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8160410 con 0x7ff8c4003f00 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c400b9e0 con 0x7ff8d8145900 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c4004d10 0x7ff8c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d659c640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 0x7ff8c4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8cffff640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8c4003f00 0x7ff8c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 msgr2=0x7ff8c4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8145900 0x7ff8c4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8c4003f00 msgr2=0x7ff8c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:32.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8c4003f00 0x7ff8c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/1963967057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4003530 con 0x7ff8c4004d10 2024-09-13T18:31:32.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.242+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c4004d10 0x7ff8c4005190 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009fc0 tx=0x7ff8d001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5957e7114ea821cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00a5c90 con 0x7ff8c4004d10 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000f040 con 0x7ff8c4004d10 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d5d9b640 1 -- 172.21.15.53:0/1963967057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00ad440 con 0x7ff8c4004d10 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/1963967057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c4004d10 msgr2=0x7ff8c4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 --2- 172.21.15.53:0/1963967057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c4004d10 0x7ff8c4005190 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009fc0 tx=0x7ff8d001cc80 comp rx=0 tx=0).stop 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/1963967057 reap_dead start 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/1963967057 shutdown_connections 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/1963967057 >> 172.21.15.53:0/1963967057 conn(0x7ff8d8073330 msgr2=0x7ff8d8065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/1963967057 shutdown_connections 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/1963967057 wait complete. 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 Processor -- start 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- start start 2024-09-13T18:31:32.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8140d50 0x7ff8d80ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d80cd040 0x7ff8d80cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80c7570 0x7ff8d80c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80cd9e0 con 0x7ff8d80c7570 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80c82c0 con 0x7ff8d80cd040 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80c96f0 con 0x7ff8d8140d50 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80c7570 0x7ff8d80c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80c7570 0x7ff8d80c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42122/0 (socket says 172.21.15.53:42122) 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/2901860845 learned_addr learned my addr 172.21.15.53:0/2901860845 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8cffff640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d80cd040 0x7ff8d80cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d659c640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8140d50 0x7ff8d80ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8140d50 msgr2=0x7ff8d80ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8140d50 0x7ff8d80ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d80cd040 msgr2=0x7ff8d80cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d80cd040 0x7ff8d80cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 -- 172.21.15.53:0/2901860845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80c99d0 con 0x7ff8d80c7570 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8d6d9d640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80c7570 0x7ff8d80c79f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0002240 tx=0x7ff8d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8ceffd640 1 -- 172.21.15.53:0/2901860845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00039a0 con 0x7ff8d80c7570 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8ceffd640 1 -- 172.21.15.53:0/2901860845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0003b00 con 0x7ff8d80c7570 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8ceffd640 1 -- 172.21.15.53:0/2901860845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0003e70 con 0x7ff8d80c7570 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d80c9cb0 con 0x7ff8d80c7570 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.246+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d80ca270 con 0x7ff8d80c7570 2024-09-13T18:31:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.250+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d80cbe60 con 0x7ff8d80c7570 2024-09-13T18:31:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.250+0000 7ff8ceffd640 1 -- 172.21.15.53:0/2901860845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7ff8d00b4040 con 0x7ff8d80c7570 2024-09-13T18:31:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.250+0000 7ff8ceffd640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8b8066990 0x7ff8b8068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.250+0000 7ff8ceffd640 1 -- 172.21.15.53:0/2901860845 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8d011e490 con 0x7ff8d80c7570 2024-09-13T18:31:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.250+0000 7ff8d659c640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8b8066990 0x7ff8b8068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.250+0000 7ff8d659c640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8b8066990 0x7ff8b8068e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8001280 tx=0x7ff8c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.254+0000 7ff8ceffd640 1 -- 172.21.15.53:0/2901860845 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8d00eb640 con 0x7ff8d80c7570 2024-09-13T18:31:32.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.446+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol78490", "snap_name": "fake", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8d8160f90 con 0x7ff8b8066990 2024-09-13T18:31:32.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.482+0000 7ff8ceffd640 1 -- 172.21.15.53:0/2901860845 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff8c8007200 con 0x7ff8b8066990 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8b8066990 msgr2=0x7ff8b8068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8b8066990 0x7ff8b8068e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8001280 tx=0x7ff8c8009040 comp rx=0 tx=0).stop 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80c7570 msgr2=0x7ff8d80c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80c7570 0x7ff8d80c79f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0002240 tx=0x7ff8d0009750 comp rx=0 tx=0).stop 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 shutdown_connections 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8b8066990 0x7ff8b8068e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d80c7570 0x7ff8d80c79f0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8d80cd040 0x7ff8d80cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 --2- 172.21.15.53:0/2901860845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d8140d50 0x7ff8d80ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 >> 172.21.15.53:0/2901860845 conn(0x7ff8d8073330 msgr2=0x7ff8d80b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:32.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 shutdown_connections 2024-09-13T18:31:32.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:32.486+0000 7ff8dcdc4640 1 -- 172.21.15.53:0/2901860845 wait complete. 2024-09-13T18:31:32.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:32.505 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol78490/.meta) 2024-09-13T18:31:35.829 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:31:35.830 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:31:35.830 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:31:35.830 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol78490/8b9b513c-3508-49a7-a9b9-52a54d42abe0 2024-09-13T18:31:35.830 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:31:35.830 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:35.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol78490 2024-09-13T18:31:35.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea83514640 1 Processor -- start 2024-09-13T18:31:35.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea83514640 1 -- start start 2024-09-13T18:31:35.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea83514640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea7c15c830 0x7fea7c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:35.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea83514640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fea7c0d3390 0x7fea7c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:35.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea83514640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c0b7db0 con 0x7fea7c0ccd10 2024-09-13T18:31:35.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea83514640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c0d0650 con 0x7fea7c15c830 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea83514640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c0d0c10 con 0x7fea7c0d3390 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea812b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea7c15c830 0x7fea7c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea812b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea7c15c830 0x7fea7c0d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42124/0 (socket says 172.21.15.53:42124) 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea812b0640 1 -- 172.21.15.53:0/2414050218 learned_addr learned my addr 172.21.15.53:0/2414050218 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea81ab1640 1 --2- 172.21.15.53:0/2414050218 >> v2:172.21.15.87:3300/0 conn(0x7fea7c0d3390 0x7fea7c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea812b0640 1 -- 172.21.15.53:0/2414050218 >> v2:172.21.15.87:3300/0 conn(0x7fea7c0d3390 msgr2=0x7fea7c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea812b0640 1 --2- 172.21.15.53:0/2414050218 >> v2:172.21.15.87:3300/0 conn(0x7fea7c0d3390 0x7fea7c0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea812b0640 1 -- 172.21.15.53:0/2414050218 >> v1:172.21.15.87:6789/0 conn(0x7fea7c0ccd10 legacy=0x7fea7c0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.970+0000 7fea812b0640 1 -- 172.21.15.53:0/2414050218 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c0cd7d0 con 0x7fea7c15c830 2024-09-13T18:31:35.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea812b0640 1 --2- 172.21.15.53:0/2414050218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c15c830 0x7fea7c0d10a0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0b80d0 tx=0x7fea7801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae51599e0496d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea73fff640 1 -- 172.21.15.53:0/2414050218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780ac630 con 0x7fea7c15c830 2024-09-13T18:31:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea73fff640 1 -- 172.21.15.53:0/2414050218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780ac790 con 0x7fea7c15c830 2024-09-13T18:31:35.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea73fff640 1 -- 172.21.15.53:0/2414050218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780acb20 con 0x7fea7c15c830 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- 172.21.15.53:0/2414050218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c15c830 msgr2=0x7fea7c0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 --2- 172.21.15.53:0/2414050218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c15c830 0x7fea7c0d10a0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0b80d0 tx=0x7fea7801c4e0 comp rx=0 tx=0).stop 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- 172.21.15.53:0/2414050218 shutdown_connections 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 --2- 172.21.15.53:0/2414050218 >> v2:172.21.15.87:3300/0 conn(0x7fea7c0d3390 0x7fea7c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 --2- 172.21.15.53:0/2414050218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c15c830 0x7fea7c0d10a0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- 172.21.15.53:0/2414050218 >> 172.21.15.53:0/2414050218 conn(0x7fea7c070970 msgr2=0x7fea7c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- 172.21.15.53:0/2414050218 shutdown_connections 2024-09-13T18:31:35.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- 172.21.15.53:0/2414050218 wait complete. 2024-09-13T18:31:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 Processor -- start 2024-09-13T18:31:35.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- start start 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea7c0ccd10 0x7fea7c152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c0d3390 0x7fea7c14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea7c15c830 0x7fea7c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c14fa40 con 0x7fea7c0d3390 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c153000 con 0x7fea7c0ccd10 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea83514640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c1537f0 con 0x7fea7c15c830 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea80aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c0d3390 0x7fea7c14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea80aaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c0d3390 0x7fea7c14dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42140/0 (socket says 172.21.15.53:42140) 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea80aaf640 1 -- 172.21.15.53:0/2648380497 learned_addr learned my addr 172.21.15.53:0/2648380497 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea812b0640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea7c0ccd10 0x7fea7c152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.974+0000 7fea81ab1640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea7c15c830 0x7fea7c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:35.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea80aaf640 1 -- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea7c15c830 msgr2=0x7fea7c150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea80aaf640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea7c15c830 0x7fea7c150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea80aaf640 1 -- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea7c0ccd10 msgr2=0x7fea7c152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea80aaf640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea7c0ccd10 0x7fea7c152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea80aaf640 1 -- 172.21.15.53:0/2648380497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780094d0 con 0x7fea7c0d3390 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea81ab1640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea7c15c830 0x7fea7c150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea80aaf640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c0d3390 0x7fea7c14dd20 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c480 tx=0x7fea6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea71ffb640 1 -- 172.21.15.53:0/2648380497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c012830 con 0x7fea7c0d3390 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea71ffb640 1 -- 172.21.15.53:0/2648380497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0129b0 con 0x7fea7c0d3390 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c153230 con 0x7fea7c0d3390 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea71ffb640 1 -- 172.21.15.53:0/2648380497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c012d60 con 0x7fea7c0d3390 2024-09-13T18:31:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c0caa40 con 0x7fea7c0d3390 2024-09-13T18:31:35.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c0cd180 con 0x7fea7c0d3390 2024-09-13T18:31:35.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea71ffb640 1 -- 172.21.15.53:0/2648380497 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7fea6c01c460 con 0x7fea7c0d3390 2024-09-13T18:31:35.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea71ffb640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea60066960 0x7fea60068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:35.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea71ffb640 1 -- 172.21.15.53:0/2648380497 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea6c084420 con 0x7fea7c0d3390 2024-09-13T18:31:35.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea812b0640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea60066960 0x7fea60068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:35.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.978+0000 7fea812b0640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea60066960 0x7fea60068e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea780ae000 tx=0x7fea78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:35.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:35.982+0000 7fea71ffb640 1 -- 172.21.15.53:0/2648380497 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea6c051490 con 0x7fea7c0d3390 2024-09-13T18:31:36.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.170+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol78490", "target": ["mon-mgr", ""]}) v1 -- 0x7fea7c0b5eb0 con 0x7fea60066960 2024-09-13T18:31:36.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.242+0000 7fea71ffb640 1 -- 172.21.15.53:0/2648380497 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fea780ac900 con 0x7fea60066960 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea60066960 msgr2=0x7fea60068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea60066960 0x7fea60068e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea780ae000 tx=0x7fea78008040 comp rx=0 tx=0).stop 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c0d3390 msgr2=0x7fea7c14dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c0d3390 0x7fea7c14dd20 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c480 tx=0x7fea6c00c940 comp rx=0 tx=0).stop 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 shutdown_connections 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea60066960 0x7fea60068e20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea7c15c830 0x7fea7c150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea7c0d3390 0x7fea7c14dd20 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 --2- 172.21.15.53:0/2648380497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea7c0ccd10 0x7fea7c152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 >> 172.21.15.53:0/2648380497 conn(0x7fea7c070970 msgr2=0x7fea7c0d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:36.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 shutdown_connections 2024-09-13T18:31:36.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.246+0000 7fea83514640 1 -- 172.21.15.53:0/2648380497 wait complete. 2024-09-13T18:31:36.251 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.250+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.251 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.250+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.252 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.250+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.252 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.250+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.252 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.250+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone91250 2024-09-13T18:31:36.268 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.266+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.269 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.266+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.269 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.266+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.269 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.266+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.269 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:31:36.266+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:31:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.394+0000 7f25e55ea640 1 Processor -- start 2024-09-13T18:31:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.394+0000 7f25e55ea640 1 -- start start 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25e55ea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25e015f070 0x7f25e006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25e55ea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e006d340 con 0x7f25e00b2900 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25e55ea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e006c7c0 con 0x7f25e0156bc0 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25e55ea640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e006caa0 con 0x7f25e015f070 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25de7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f25e00b2900 0x7f25e006ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37268/0 (socket says 172.21.15.53:37268) 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25de7fc640 1 -- 172.21.15.53:0/4242426592 learned_addr learned my addr 172.21.15.53:0/4242426592 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371488246 0 0) 0x7f25e006d340 con 0x7f25e00b2900 2024-09-13T18:31:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c8003530 con 0x7f25e00b2900 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25df7fe640 1 --2- 172.21.15.53:0/4242426592 >> v2:172.21.15.87:3300/0 conn(0x7f25e015f070 0x7f25e006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2784778351 0 0) 0x7f25c8003530 con 0x7f25e00b2900 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 >> v2:172.21.15.87:3300/0 conn(0x7f25e015f070 msgr2=0x7f25e006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 --2- 172.21.15.53:0/4242426592 >> v2:172.21.15.87:3300/0 conn(0x7f25e015f070 0x7f25e006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 >> v1:172.21.15.87:6789/0 conn(0x7f25e0156bc0 legacy=0x7f25e00b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e006cd80 con 0x7f25e00b2900 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f25d4001680 con 0x7f25e00b2900 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 >> v1:172.21.15.53:6789/0 conn(0x7f25e00b2900 legacy=0x7f25e006ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25c8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25c80047d0 0x7f25c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25c80052b0 0x7f25c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e006caa0 con 0x7f25c8003980 2024-09-13T18:31:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c800c160 con 0x7f25c80047d0 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c800c320 con 0x7f25c80052b0 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25deffd640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25c8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25de7fc640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25c80047d0 0x7f25c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25deffd640 1 -- 172.21.15.53:0/4242426592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25c80052b0 msgr2=0x7f25c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25deffd640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25c80052b0 0x7f25c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25deffd640 1 -- 172.21.15.53:0/4242426592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25c80047d0 msgr2=0x7f25c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25deffd640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25c80047d0 0x7f25c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25deffd640 1 -- 172.21.15.53:0/4242426592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8003530 con 0x7f25c8003980 2024-09-13T18:31:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.398+0000 7f25df7fe640 1 -- 172.21.15.53:0/4242426592 reap_dead start 2024-09-13T18:31:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25c8003d80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f25d0007fd0 tx=0x7f25d001c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21c248342d550ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00ab600 con 0x7f25c8003980 2024-09-13T18:31:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d00a7050 con 0x7f25c8003980 2024-09-13T18:31:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25ddffb640 1 -- 172.21.15.53:0/4242426592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00ab9c0 con 0x7f25c8003980 2024-09-13T18:31:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- 172.21.15.53:0/4242426592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 msgr2=0x7f25c8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25c8003d80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f25d0007fd0 tx=0x7f25d001c290 comp rx=0 tx=0).stop 2024-09-13T18:31:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- 172.21.15.53:0/4242426592 shutdown_connections 2024-09-13T18:31:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 --2- 172.21.15.53:0/4242426592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25c8003d80 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- 172.21.15.53:0/4242426592 >> 172.21.15.53:0/4242426592 conn(0x7f25e0069f50 msgr2=0x7f25e006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- 172.21.15.53:0/4242426592 shutdown_connections 2024-09-13T18:31:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- 172.21.15.53:0/4242426592 wait complete. 2024-09-13T18:31:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 Processor -- start 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- start start 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25e0155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e01f5960 0x7f25e01f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e014ea40 0x7f25e014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f8570 con 0x7f25c8003980 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f5de0 con 0x7f25e014ea40 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f87e0 con 0x7f25e01f5960 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25e0155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25e0155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42200/0 (socket says 172.21.15.53:42200) 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 -- 172.21.15.53:0/1867608361 learned_addr learned my addr 172.21.15.53:0/1867608361 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25df7fe640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e014ea40 0x7f25e014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25de7fc640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e01f5960 0x7f25e01f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 -- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e01f5960 msgr2=0x7f25e01f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e01f5960 0x7f25e01f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 -- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e014ea40 msgr2=0x7f25e014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e014ea40 0x7f25e014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 -- 172.21.15.53:0/1867608361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e01f8ac0 con 0x7f25c8003980 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25de7fc640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e01f5960 0x7f25e01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25deffd640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25e0155840 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f25d00ae040 tx=0x7f25d0019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25c77fe640 1 -- 172.21.15.53:0/1867608361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00abd00 con 0x7f25c8003980 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25c77fe640 1 -- 172.21.15.53:0/1867608361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d00abe80 con 0x7f25c8003980 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25c77fe640 1 -- 172.21.15.53:0/1867608361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00b7690 con 0x7f25c8003980 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e01f8da0 con 0x7f25c8003980 2024-09-13T18:31:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.402+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e014f400 con 0x7f25c8003980 2024-09-13T18:31:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.406+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e01f8f60 con 0x7f25c8003980 2024-09-13T18:31:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.406+0000 7f25c77fe640 1 -- 172.21.15.53:0/1867608361 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f25d00b77f0 con 0x7f25c8003980 2024-09-13T18:31:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.406+0000 7f25c77fe640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25cc066960 0x7f25cc068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.406+0000 7f25c77fe640 1 -- 172.21.15.53:0/1867608361 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f25d011eb40 con 0x7f25c8003980 2024-09-13T18:31:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.406+0000 7f25de7fc640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25cc066960 0x7f25cc068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.406+0000 7f25de7fc640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25cc066960 0x7f25cc068e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25d4000f70 tx=0x7f25d4000ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.410+0000 7f25c77fe640 1 -- 172.21.15.53:0/1867608361 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25d00ef5c0 con 0x7f25c8003980 2024-09-13T18:31:36.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.590+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone91250", "target": ["mon-mgr", ""]}) v1 -- 0x7f25e015e060 con 0x7f25cc066960 2024-09-13T18:31:36.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.626+0000 7f25c77fe640 1 -- 172.21.15.53:0/1867608361 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f25d400f7c0 con 0x7f25cc066960 2024-09-13T18:31:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25cc066960 msgr2=0x7f25cc068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25cc066960 0x7f25cc068e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25d4000f70 tx=0x7f25d4000ee0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 msgr2=0x7f25e0155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25e0155840 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f25d00ae040 tx=0x7f25d0019030 comp rx=0 tx=0).stop 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 shutdown_connections 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25cc066960 0x7f25cc068e20 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25d4000f70 tx=0x7f25d4000ee0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25e01f5960 0x7f25e01f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e014ea40 0x7f25e014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 --2- 172.21.15.53:0/1867608361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25c8003980 0x7f25e0155840 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 >> 172.21.15.53:0/1867608361 conn(0x7f25e0069f50 msgr2=0x7f25e00acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 shutdown_connections 2024-09-13T18:31:36.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.630+0000 7f25e55ea640 1 -- 172.21.15.53:0/1867608361 wait complete. 2024-09-13T18:31:36.649 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone51201 2024-09-13T18:31:36.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 Processor -- start 2024-09-13T18:31:36.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 -- start start 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1e74143e80 0x7f1e7406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e740caee0 0x7f1e740cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e740cd320 0x7f1e740cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7406f7a0 con 0x7f1e740caee0 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7406fd60 con 0x7f1e74143e80 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e792aa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740cdd10 con 0x7f1e740cd320 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e740caee0 0x7f1e740cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e740caee0 0x7f1e740cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55478/0 (socket says 172.21.15.53:55478) 2024-09-13T18:31:36.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2196087846 learned_addr learned my addr 172.21.15.53:0/2196087846 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2196087846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e740cd320 msgr2=0x7f1e740cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e737fe640 1 --2- 172.21.15.53:0/2196087846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e740cd320 0x7f1e740cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e72ffd640 1 --2- 172.21.15.53:0/2196087846 >> v2:172.21.15.87:3300/0 conn(0x7f1e74143e80 0x7f1e7406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/2196087846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e740cd320 0x7f1e740cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2196087846 >> v2:172.21.15.87:3300/0 conn(0x7f1e74143e80 msgr2=0x7f1e7406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/2196087846 >> v2:172.21.15.87:3300/0 conn(0x7f1e74143e80 0x7f1e7406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.782+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2196087846 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740cb960 con 0x7f1e740caee0 2024-09-13T18:31:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/2196087846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e740caee0 0x7f1e740cb350 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009870 tx=0x7f1e5c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddb84aed65c44a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e727fc640 1 -- 172.21.15.53:0/2196087846 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0ab620 con 0x7f1e740caee0 2024-09-13T18:31:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e727fc640 1 -- 172.21.15.53:0/2196087846 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c0ab780 con 0x7f1e740caee0 2024-09-13T18:31:36.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e727fc640 1 -- 172.21.15.53:0/2196087846 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0abb10 con 0x7f1e740caee0 2024-09-13T18:31:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- 172.21.15.53:0/2196087846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e740caee0 msgr2=0x7f1e740cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2196087846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e740caee0 0x7f1e740cb350 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009870 tx=0x7f1e5c01c460 comp rx=0 tx=0).stop 2024-09-13T18:31:36.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- 172.21.15.53:0/2196087846 shutdown_connections 2024-09-13T18:31:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2196087846 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e740cd320 0x7f1e740cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2196087846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e740caee0 0x7f1e740cb350 secure :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009870 tx=0x7f1e5c01c460 comp rx=0 tx=0).stop 2024-09-13T18:31:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2196087846 >> v2:172.21.15.87:3300/0 conn(0x7f1e74143e80 0x7f1e7406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- 172.21.15.53:0/2196087846 >> 172.21.15.53:0/2196087846 conn(0x7f1e74065c80 msgr2=0x7f1e74066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- 172.21.15.53:0/2196087846 shutdown_connections 2024-09-13T18:31:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- 172.21.15.53:0/2196087846 wait complete. 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 Processor -- start 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- start start 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e740cd320 0x7f1e74156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e74143e80 0x7f1e740b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e74156bc0 0x7f1e740b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7415e2a0 con 0x7f1e74156bc0 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740b1050 con 0x7f1e740cd320 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740b07b0 con 0x7f1e74143e80 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e74156bc0 0x7f1e740b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e74156bc0 0x7f1e740b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55488/0 (socket says 172.21.15.53:55488) 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 -- 172.21.15.53:0/2434748173 learned_addr learned my addr 172.21.15.53:0/2434748173 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e72ffd640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e740cd320 0x7f1e74156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e74143e80 0x7f1e740b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 -- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e74143e80 msgr2=0x7f1e740b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e74143e80 0x7f1e740b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 -- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e740cd320 msgr2=0x7f1e74156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e740cd320 0x7f1e74156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 -- 172.21.15.53:0/2434748173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0094d0 con 0x7f1e74156bc0 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e737fe640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e74156bc0 0x7f1e740b1f90 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00cb80 tx=0x7f1e6c00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e6b7fe640 1 -- 172.21.15.53:0/2434748173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00ce70 con 0x7f1e74156bc0 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e6b7fe640 1 -- 172.21.15.53:0/2434748173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00abd0 con 0x7f1e74156bc0 2024-09-13T18:31:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e740b0a90 con 0x7f1e74156bc0 2024-09-13T18:31:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e6b7fe640 1 -- 172.21.15.53:0/2434748173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c011410 con 0x7f1e74156bc0 2024-09-13T18:31:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.786+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e74156160 con 0x7f1e74156bc0 2024-09-13T18:31:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.790+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74156350 con 0x7f1e74156bc0 2024-09-13T18:31:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.790+0000 7f1e6b7fe640 1 -- 172.21.15.53:0/2434748173 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f1e6c011570 con 0x7f1e74156bc0 2024-09-13T18:31:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.790+0000 7f1e6b7fe640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e54066960 0x7f1e54068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.790+0000 7f1e6b7fe640 1 -- 172.21.15.53:0/2434748173 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f1e6c084900 con 0x7f1e74156bc0 2024-09-13T18:31:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.790+0000 7f1e72ffd640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e54066960 0x7f1e54068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.790+0000 7f1e72ffd640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e54066960 0x7f1e54068e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e740cabc0 tx=0x7f1e64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.794+0000 7f1e6b7fe640 1 -- 172.21.15.53:0/2434748173 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e6c0517d0 con 0x7f1e74156bc0 2024-09-13T18:31:36.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:36.982+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone51201", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e740ce160 con 0x7f1e54066960 2024-09-13T18:31:37.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.006+0000 7f1e6b7fe640 1 -- 172.21.15.53:0/2434748173 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1e6400c050 con 0x7f1e54066960 2024-09-13T18:31:37.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e54066960 msgr2=0x7f1e54068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e54066960 0x7f1e54068e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e740cabc0 tx=0x7f1e64008040 comp rx=0 tx=0).stop 2024-09-13T18:31:37.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e74156bc0 msgr2=0x7f1e740b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e74156bc0 0x7f1e740b1f90 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00cb80 tx=0x7f1e6c00a4c0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 shutdown_connections 2024-09-13T18:31:37.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1e54066960 0x7f1e54068e20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1e74143e80 0x7f1e740b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e74156bc0 0x7f1e740b1f90 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 --2- 172.21.15.53:0/2434748173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1e740cd320 0x7f1e74156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 >> 172.21.15.53:0/2434748173 conn(0x7f1e74065c80 msgr2=0x7f1e7415a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:37.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 shutdown_connections 2024-09-13T18:31:37.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.010+0000 7f1e792aa640 1 -- 172.21.15.53:0/2434748173 wait complete. 2024-09-13T18:31:37.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:37.033 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:31:37.043 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-09-13T18:31:37.044 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:31:37.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:31:37.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:31:37.248 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:31:37.248 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:37.248 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:37.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8477d67640 1 Processor -- start 2024-09-13T18:31:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8477d67640 1 -- start start 2024-09-13T18:31:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8477d67640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f84700cb980 0x7f84700b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8477d67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84700cbd60 0x7f84700cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8477d67640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700b1ac0 con 0x7f847006b850 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8477d67640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84700b3010 con 0x7f84700cbd60 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8477d67640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8470159ac0 con 0x7f84700cb980 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.430+0000 7f8476304640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84700cbd60 0x7f84700cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8476304640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84700cbd60 0x7f84700cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55490/0 (socket says 172.21.15.53:55490) 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8476304640 1 -- 172.21.15.53:0/4258556921 learned_addr learned my addr 172.21.15.53:0/4258556921 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8475302640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f847006b850 0x7f847006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49128/0 (socket says 172.21.15.53:49128) 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8475b03640 1 --2- 172.21.15.53:0/4258556921 >> v2:172.21.15.87:3300/0 conn(0x7f84700cb980 0x7f84700b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8476304640 1 -- 172.21.15.53:0/4258556921 >> v2:172.21.15.87:3300/0 conn(0x7f84700cb980 msgr2=0x7f84700b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8476304640 1 --2- 172.21.15.53:0/4258556921 >> v2:172.21.15.87:3300/0 conn(0x7f84700cb980 0x7f84700b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8476304640 1 -- 172.21.15.53:0/4258556921 >> v1:172.21.15.53:6789/0 conn(0x7f847006b850 legacy=0x7f847006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8476304640 1 -- 172.21.15.53:0/4258556921 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470159da0 con 0x7f84700cbd60 2024-09-13T18:31:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8476304640 1 --2- 172.21.15.53:0/4258556921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f84700cdd40 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f8470071820 tx=0x7f846801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f809cabbb5969ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8474b01640 1 -- 172.21.15.53:0/4258556921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800b2d0 con 0x7f84700cbd60 2024-09-13T18:31:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8474b01640 1 -- 172.21.15.53:0/4258556921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800b430 con 0x7f84700cbd60 2024-09-13T18:31:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8474b01640 1 -- 172.21.15.53:0/4258556921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680a7c20 con 0x7f84700cbd60 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 -- 172.21.15.53:0/4258556921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 msgr2=0x7f84700cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 --2- 172.21.15.53:0/4258556921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f84700cdd40 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f8470071820 tx=0x7f846801eb30 comp rx=0 tx=0).stop 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 -- 172.21.15.53:0/4258556921 shutdown_connections 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 --2- 172.21.15.53:0/4258556921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f84700cdd40 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 --2- 172.21.15.53:0/4258556921 >> v2:172.21.15.87:3300/0 conn(0x7f84700cb980 0x7f84700b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 -- 172.21.15.53:0/4258556921 >> 172.21.15.53:0/4258556921 conn(0x7f8470065c80 msgr2=0x7f8470066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 -- 172.21.15.53:0/4258556921 shutdown_connections 2024-09-13T18:31:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.434+0000 7f8477d67640 1 -- 172.21.15.53:0/4258556921 wait complete. 2024-09-13T18:31:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 Processor -- start 2024-09-13T18:31:37.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 -- start start 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f847006b850 0x7f84701526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84700cb980 0x7f8470150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f8470150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700add00 con 0x7f84700cbd60 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470151620 con 0x7f847006b850 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8470151900 con 0x7f84700cb980 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f8470150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f8470150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55496/0 (socket says 172.21.15.53:55496) 2024-09-13T18:31:37.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 -- 172.21.15.53:0/2814985555 learned_addr learned my addr 172.21.15.53:0/2814985555 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8475b03640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f847006b850 0x7f84701526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8475302640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84700cb980 0x7f8470150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 -- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84700cb980 msgr2=0x7f8470150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84700cb980 0x7f8470150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 -- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f847006b850 msgr2=0x7f84701526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f847006b850 0x7f84701526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 -- 172.21.15.53:0/2814985555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846800bd40 con 0x7f84700cbd60 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8475b03640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f847006b850 0x7f84701526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8475302640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84700cb980 0x7f8470150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:37.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8476304640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f8470150f80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f846801b740 tx=0x7f846801b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:37.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f84667fc640 1 -- 172.21.15.53:0/2814985555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468009800 con 0x7f84700cbd60 2024-09-13T18:31:37.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f84667fc640 1 -- 172.21.15.53:0/2814985555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468009980 con 0x7f84700cbd60 2024-09-13T18:31:37.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8470151be0 con 0x7f84700cbd60 2024-09-13T18:31:37.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f84667fc640 1 -- 172.21.15.53:0/2814985555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468009d30 con 0x7f84700cbd60 2024-09-13T18:31:37.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84701521a0 con 0x7f84700cbd60 2024-09-13T18:31:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.438+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8470067400 con 0x7f84700cbd60 2024-09-13T18:31:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.442+0000 7f84667fc640 1 -- 172.21.15.53:0/2814985555 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f84680c3460 con 0x7f84700cbd60 2024-09-13T18:31:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.442+0000 7f84667fc640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8454066960 0x7f8454068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.442+0000 7f84667fc640 1 -- 172.21.15.53:0/2814985555 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f846811fe50 con 0x7f84700cbd60 2024-09-13T18:31:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.442+0000 7f8475b03640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8454066960 0x7f8454068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.442+0000 7f8475b03640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8454066960 0x7f8454068e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f84700664b0 tx=0x7f846c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.446+0000 7f84667fc640 1 -- 172.21.15.53:0/2814985555 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f84680ecf60 con 0x7f84700cbd60 2024-09-13T18:31:37.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.610+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8470151a40 con 0x7f84700cbd60 2024-09-13T18:31:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f84667fc640 1 -- 172.21.15.53:0/2814985555 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16578 (secure 0 0 0) 0x7f8470151a40 con 0x7f84700cbd60 2024-09-13T18:31:37.614 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:37.615 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":107,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:36.291725+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:37.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8454066960 msgr2=0x7f8454068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8454066960 0x7f8454068e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f84700664b0 tx=0x7f846c008040 comp rx=0 tx=0).stop 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 msgr2=0x7f8470150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f8470150f80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f846801b740 tx=0x7f846801b8d0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 shutdown_connections 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8454066960 0x7f8454068e20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84700cb980 0x7f8470150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84700cbd60 0x7f8470150f80 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 --2- 172.21.15.53:0/2814985555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f847006b850 0x7f84701526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 >> 172.21.15.53:0/2814985555 conn(0x7f8470065c80 msgr2=0x7f84701487b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 shutdown_connections 2024-09-13T18:31:37.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.614+0000 7f8477d67640 1 -- 172.21.15.53:0/2814985555 wait complete. 2024-09-13T18:31:37.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:30:58.560050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:30:59.064624+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:31:37.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:31:37.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.762+0000 7f2ec006e640 1 Processor -- start 2024-09-13T18:31:37.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.762+0000 7f2ec006e640 1 -- start start 2024-09-13T18:31:37.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ec006e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2eb80caee0 0x7f2eb80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ec006e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ec006e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb806f7a0 con 0x7f2eb8143e80 2024-09-13T18:31:37.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ec006e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb806baa0 con 0x7f2eb80caee0 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ec006e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb806fd60 con 0x7f2eb80cd320 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebd609640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2eb80caee0 0x7f2eb80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebe60b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebe60b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:34048/0 (socket says 172.21.15.53:34048) 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebe60b640 1 -- 172.21.15.53:0/2053370171 learned_addr learned my addr 172.21.15.53:0/2053370171 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebe60b640 1 -- 172.21.15.53:0/2053370171 >> v2:172.21.15.87:3300/0 conn(0x7f2eb80caee0 msgr2=0x7f2eb80cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebe60b640 1 --2- 172.21.15.53:0/2053370171 >> v2:172.21.15.87:3300/0 conn(0x7f2eb80caee0 0x7f2eb80cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebe60b640 1 -- 172.21.15.53:0/2053370171 >> v1:172.21.15.87:6789/0 conn(0x7f2eb8143e80 legacy=0x7f2eb806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.766+0000 7f2ebe60b640 1 -- 172.21.15.53:0/2053370171 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80cdd10 con 0x7f2eb80cd320 2024-09-13T18:31:37.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ebe60b640 1 --2- 172.21.15.53:0/2053370171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80cd7d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00098a0 tx=0x7f2eb001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec88d7e6660d20e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:37.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ebce08640 1 -- 172.21.15.53:0/2053370171 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00ab680 con 0x7f2eb80cd320 2024-09-13T18:31:37.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ebce08640 1 -- 172.21.15.53:0/2053370171 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00ab7e0 con 0x7f2eb80cd320 2024-09-13T18:31:37.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ebce08640 1 -- 172.21.15.53:0/2053370171 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00abb70 con 0x7f2eb80cd320 2024-09-13T18:31:37.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- 172.21.15.53:0/2053370171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 msgr2=0x7f2eb80cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2053370171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80cd7d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00098a0 tx=0x7f2eb001c480 comp rx=0 tx=0).stop 2024-09-13T18:31:37.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- 172.21.15.53:0/2053370171 shutdown_connections 2024-09-13T18:31:37.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2053370171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80cd7d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2053370171 >> v2:172.21.15.87:3300/0 conn(0x7f2eb80caee0 0x7f2eb80cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- 172.21.15.53:0/2053370171 >> 172.21.15.53:0/2053370171 conn(0x7f2eb8065c80 msgr2=0x7f2eb8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:37.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- 172.21.15.53:0/2053370171 shutdown_connections 2024-09-13T18:31:37.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- 172.21.15.53:0/2053370171 wait complete. 2024-09-13T18:31:37.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 Processor -- start 2024-09-13T18:31:37.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- start start 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb80caee0 0x7f2eb813b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb8143e80 0x7f2eb8139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb813b980 con 0x7f2eb80caee0 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb813ca30 con 0x7f2eb8143e80 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ec006e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb80aff00 con 0x7f2eb80cd320 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.770+0000 7f2ebde0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb80caee0 0x7f2eb813b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb80caee0 0x7f2eb813b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55512/0 (socket says 172.21.15.53:55512) 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 -- 172.21.15.53:0/2861450947 learned_addr learned my addr 172.21.15.53:0/2861450947 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:37.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebe60b640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb8143e80 0x7f2eb8139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebd609640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 -- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 msgr2=0x7f2eb80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 -- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb8143e80 msgr2=0x7f2eb8139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb8143e80 0x7f2eb8139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 -- 172.21.15.53:0/2861450947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00094d0 con 0x7f2eb80caee0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebde0a640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb80caee0 0x7f2eb813b440 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400c790 tx=0x7f2eb400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2eae7fc640 1 -- 172.21.15.53:0/2861450947 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400cea0 con 0x7f2eb80caee0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2eae7fc640 1 -- 172.21.15.53:0/2861450947 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb4006d60 con 0x7f2eb80caee0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb813c4d0 con 0x7f2eb80caee0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2eae7fc640 1 -- 172.21.15.53:0/2861450947 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4003bc0 con 0x7f2eb80caee0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8139e80 con 0x7f2eb80caee0 2024-09-13T18:31:37.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb80cb350 con 0x7f2eb80caee0 2024-09-13T18:31:37.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2eae7fc640 1 -- 172.21.15.53:0/2861450947 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f2eb4003d20 con 0x7f2eb80caee0 2024-09-13T18:31:37.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2eae7fc640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e9c066960 0x7f2e9c068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:37.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2eae7fc640 1 -- 172.21.15.53:0/2861450947 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f2eb4084130 con 0x7f2eb80caee0 2024-09-13T18:31:37.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebd609640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e9c066960 0x7f2e9c068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:37.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.774+0000 7f2ebd609640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e9c066960 0x7f2e9c068e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8071520 tx=0x7f2ea8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.778+0000 7f2eae7fc640 1 -- 172.21.15.53:0/2861450947 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2eb4054c30 con 0x7f2eb80caee0 2024-09-13T18:31:37.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.942+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2eb8071270 con 0x7f2eb80caee0 2024-09-13T18:31:37.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.942+0000 7f2eae7fc640 1 -- 172.21.15.53:0/2861450947 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2eb40547c0 con 0x7f2eb80caee0 2024-09-13T18:31:37.944 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:31:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.942+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e9c066960 msgr2=0x7f2e9c068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.942+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e9c066960 0x7f2e9c068e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8071520 tx=0x7f2ea8008040 comp rx=0 tx=0).stop 2024-09-13T18:31:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.942+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb80caee0 msgr2=0x7f2eb813b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.942+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb80caee0 0x7f2eb813b440 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400c790 tx=0x7f2eb400cc50 comp rx=0 tx=0).stop 2024-09-13T18:31:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 shutdown_connections 2024-09-13T18:31:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e9c066960 0x7f2e9c068e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eb80cd320 0x7f2eb80b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eb8143e80 0x7f2eb8139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 --2- 172.21.15.53:0/2861450947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb80caee0 0x7f2eb813b440 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 >> 172.21.15.53:0/2861450947 conn(0x7f2eb8065c80 msgr2=0x7f2eb81414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 shutdown_connections 2024-09-13T18:31:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:37.946+0000 7f2ec006e640 1 -- 172.21.15.53:0/2861450947 wait complete. 2024-09-13T18:31:37.963 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:31:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.094+0000 7f8ec5927640 1 Processor -- start 2024-09-13T18:31:38.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.094+0000 7f8ec5927640 1 -- start start 2024-09-13T18:31:38.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ec5927640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8ec0154a50 0x7f8ec006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ec5927640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec015b470 0x7f8ec00abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ec5927640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec006c980 con 0x7f8ec00ac2e0 2024-09-13T18:31:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ec5927640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec00ac790 con 0x7f8ec0154a50 2024-09-13T18:31:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ec5927640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec006d350 con 0x7f8ec015b470 2024-09-13T18:31:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8ec0154a50 0x7f8ec006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebf7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8ec00ac2e0 0x7f8ec00b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49138/0 (socket says 172.21.15.53:49138) 2024-09-13T18:31:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebf7fe640 1 -- 172.21.15.53:0/1265954410 learned_addr learned my addr 172.21.15.53:0/1265954410 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:38.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebe7fc640 1 --2- 172.21.15.53:0/1265954410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec015b470 0x7f8ec00abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebeffd640 1 -- 172.21.15.53:0/1265954410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec015b470 msgr2=0x7f8ec00abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebeffd640 1 --2- 172.21.15.53:0/1265954410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec015b470 0x7f8ec00abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebeffd640 1 -- 172.21.15.53:0/1265954410 >> v1:172.21.15.53:6789/0 conn(0x7f8ec00ac2e0 legacy=0x7f8ec00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebdffb640 1 -- 172.21.15.53:0/1265954410 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773346828 0 0) 0x7f8ec006c980 con 0x7f8ec00ac2e0 2024-09-13T18:31:38.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebeffd640 1 -- 172.21.15.53:0/1265954410 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec006bd70 con 0x7f8ec0154a50 2024-09-13T18:31:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebeffd640 1 --2- 172.21.15.53:0/1265954410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec0154a50 0x7f8ec006ce10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097c0 tx=0x7f8eb001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc80c27700d8228 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebdffb640 1 -- 172.21.15.53:0/1265954410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00ab670 con 0x7f8ec0154a50 2024-09-13T18:31:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebdffb640 1 -- 172.21.15.53:0/1265954410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb00ab7d0 con 0x7f8ec0154a50 2024-09-13T18:31:38.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ebdffb640 1 -- 172.21.15.53:0/1265954410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00abb60 con 0x7f8ec0154a50 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ec5927640 1 -- 172.21.15.53:0/1265954410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec0154a50 msgr2=0x7f8ec006ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.098+0000 7f8ec5927640 1 --2- 172.21.15.53:0/1265954410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec0154a50 0x7f8ec006ce10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097c0 tx=0x7f8eb001c470 comp rx=0 tx=0).stop 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- 172.21.15.53:0/1265954410 shutdown_connections 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 --2- 172.21.15.53:0/1265954410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec015b470 0x7f8ec00abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 --2- 172.21.15.53:0/1265954410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec0154a50 0x7f8ec006ce10 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- 172.21.15.53:0/1265954410 >> 172.21.15.53:0/1265954410 conn(0x7f8ec0069f50 msgr2=0x7f8ec006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- 172.21.15.53:0/1265954410 shutdown_connections 2024-09-13T18:31:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- 172.21.15.53:0/1265954410 wait complete. 2024-09-13T18:31:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 Processor -- start 2024-09-13T18:31:38.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- start start 2024-09-13T18:31:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ec00ac2e0 0x7f8ec009c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec0154a50 0x7f8ec0151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec015b470 0x7f8ec00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00cc880 con 0x7f8ec015b470 2024-09-13T18:31:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec009af30 con 0x7f8ec00ac2e0 2024-09-13T18:31:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0151dd0 con 0x7f8ec0154a50 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec015b470 0x7f8ec00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec015b470 0x7f8ec00cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55522/0 (socket says 172.21.15.53:55522) 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 -- 172.21.15.53:0/636127549 learned_addr learned my addr 172.21.15.53:0/636127549 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebe7fc640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec0154a50 0x7f8ec0151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebeffd640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ec00ac2e0 0x7f8ec009c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 -- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec0154a50 msgr2=0x7f8ec0151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec0154a50 0x7f8ec0151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 -- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ec00ac2e0 msgr2=0x7f8ec009c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ec00ac2e0 0x7f8ec009c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 -- 172.21.15.53:0/636127549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0009420 con 0x7f8ec015b470 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ebf7fe640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec015b470 0x7f8ec00cb4b0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c7d0 tx=0x7f8eb800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ea7fff640 1 -- 172.21.15.53:0/636127549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800a640 con 0x7f8ec015b470 2024-09-13T18:31:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ea7fff640 1 -- 172.21.15.53:0/636127549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb800a7a0 con 0x7f8ec015b470 2024-09-13T18:31:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ea7fff640 1 -- 172.21.15.53:0/636127549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800ab50 con 0x7f8ec015b470 2024-09-13T18:31:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec009b3c0 con 0x7f8ec015b470 2024-09-13T18:31:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.102+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec009a8e0 con 0x7f8ec015b470 2024-09-13T18:31:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.106+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec009b0c0 con 0x7f8ec015b470 2024-09-13T18:31:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.106+0000 7f8ea7fff640 1 -- 172.21.15.53:0/636127549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 86347+0+0 (secure 0 0 0) 0x7f8eb800acb0 con 0x7f8ec015b470 2024-09-13T18:31:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.106+0000 7f8ea7fff640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8eac066960 0x7f8eac068e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.106+0000 7f8ea7fff640 1 -- 172.21.15.53:0/636127549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f8eb8083c40 con 0x7f8ec015b470 2024-09-13T18:31:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.106+0000 7f8ebeffd640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8eac066960 0x7f8eac068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.106+0000 7f8ebeffd640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8eac066960 0x7f8eac068e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00af000 tx=0x7f8eb00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.110+0000 7f8ea7fff640 1 -- 172.21.15.53:0/636127549 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8eb8050b90 con 0x7f8ec015b470 2024-09-13T18:31:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ec00ae370 con 0x7f8ec015b470 2024-09-13T18:31:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ea7fff640 1 -- 172.21.15.53:0/636127549 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8eb8018020 con 0x7f8ec015b470 2024-09-13T18:31:38.272 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8eac066960 msgr2=0x7f8eac068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8eac066960 0x7f8eac068e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00af000 tx=0x7f8eb00a7000 comp rx=0 tx=0).stop 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec015b470 msgr2=0x7f8ec00cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec015b470 0x7f8ec00cb4b0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c7d0 tx=0x7f8eb800cc90 comp rx=0 tx=0).stop 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 shutdown_connections 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8eac066960 0x7f8eac068e20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8ec0154a50 0x7f8ec0151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec015b470 0x7f8ec00cb4b0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 --2- 172.21.15.53:0/636127549 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ec00ac2e0 0x7f8ec009c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.270+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 >> 172.21.15.53:0/636127549 conn(0x7f8ec0069f50 msgr2=0x7f8ec00b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:38.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.274+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 shutdown_connections 2024-09-13T18:31:38.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.274+0000 7f8ec5927640 1 -- 172.21.15.53:0/636127549 wait complete. 2024-09-13T18:31:38.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:31:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1e69d640 1 Processor -- start 2024-09-13T18:31:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1e69d640 1 -- start start 2024-09-13T18:31:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1e69d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 0x7f7e1806ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1e69d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1806c980 con 0x7f7e180ac4b0 2024-09-13T18:31:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1e69d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1806d350 con 0x7f7e1815b470 2024-09-13T18:31:38.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1e69d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1806bd70 con 0x7f7e18154a50 2024-09-13T18:31:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1cc3a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7e180ac4b0 0x7f7e180b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49144/0 (socket says 172.21.15.53:49144) 2024-09-13T18:31:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1cc3a640 1 -- 172.21.15.53:0/3854635524 learned_addr learned my addr 172.21.15.53:0/3854635524 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e17fff640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 0x7f7e1806ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839176885 0 0) 0x7f7e1806c980 con 0x7f7e180ac4b0 2024-09-13T18:31:38.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e04003530 con 0x7f7e180ac4b0 2024-09-13T18:31:38.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1256774349 0 0) 0x7f7e04003530 con 0x7f7e180ac4b0 2024-09-13T18:31:38.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 msgr2=0x7f7e1806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:38.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 0x7f7e1806ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 >> v1:172.21.15.87:6789/0 conn(0x7f7e1815b470 legacy=0x7f7e180abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1806c050 con 0x7f7e180ac4b0 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7e10001680 con 0x7f7e180ac4b0 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 >> v1:172.21.15.53:6789/0 conn(0x7f7e180ac4b0 legacy=0x7f7e180b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e040039b0 0x7f7e04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 0x7f7e04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1806bd70 con 0x7f7e040047d0 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0400ba40 con 0x7f7e040039b0 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0400bc00 con 0x7f7e18154a50 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e177fe640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e1cc3a640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 0x7f7e04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e17fff640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e040039b0 0x7f7e04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e177fe640 1 -- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 msgr2=0x7f7e04005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:38.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e177fe640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18154a50 0x7f7e04005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e177fe640 1 -- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e040039b0 msgr2=0x7f7e04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:38.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e177fe640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e040039b0 0x7f7e04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e177fe640 1 -- 172.21.15.53:0/3854635524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04003530 con 0x7f7e040047d0 2024-09-13T18:31:38.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.414+0000 7f7e17fff640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e040039b0 0x7f7e04003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:38.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e177fe640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e04004c50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f7e180b4470 tx=0x7f7e0001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca75094de99afab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00003b80 con 0x7f7e040047d0 2024-09-13T18:31:38.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00003ce0 con 0x7f7e040047d0 2024-09-13T18:31:38.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e16ffd640 1 -- 172.21.15.53:0/3854635524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000052c0 con 0x7f7e040047d0 2024-09-13T18:31:38.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 -- 172.21.15.53:0/3854635524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 msgr2=0x7f7e04004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 --2- 172.21.15.53:0/3854635524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e04004c50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f7e180b4470 tx=0x7f7e0001c700 comp rx=0 tx=0).stop 2024-09-13T18:31:38.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1cc3a640 1 -- 172.21.15.53:0/3854635524 reap_dead start 2024-09-13T18:31:38.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 -- 172.21.15.53:0/3854635524 shutdown_connections 2024-09-13T18:31:38.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 -- 172.21.15.53:0/3854635524 >> 172.21.15.53:0/3854635524 conn(0x7f7e18069f50 msgr2=0x7f7e1806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:38.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 -- 172.21.15.53:0/3854635524 shutdown_connections 2024-09-13T18:31:38.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 -- 172.21.15.53:0/3854635524 wait complete. 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 Processor -- start 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.418+0000 7f7e1e69d640 1 -- start start 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e1809c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e18099a70 0x7f7e18156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18143200 0x7f7e18143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180c8e00 con 0x7f7e040047d0 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18143bc0 con 0x7f7e18099a70 2024-09-13T18:31:38.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1809aaf0 con 0x7f7e18143200 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e1809c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e1809c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55542/0 (socket says 172.21.15.53:55542) 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 -- 172.21.15.53:0/1647556938 learned_addr learned my addr 172.21.15.53:0/1647556938 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1cc3a640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18143200 0x7f7e18143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e177fe640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e18099a70 0x7f7e18156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 -- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18143200 msgr2=0x7f7e18143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18143200 0x7f7e18143680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 -- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e18099a70 msgr2=0x7f7e18156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e18099a70 0x7f7e18156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 -- 172.21.15.53:0/1647556938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1809a250 con 0x7f7e040047d0 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e177fe640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e18099a70 0x7f7e18156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e17fff640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e1809c0d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009fd0 tx=0x7f7e08011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e14ff9640 1 -- 172.21.15.53:0/1647556938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08004220 con 0x7f7e040047d0 2024-09-13T18:31:38.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e14ff9640 1 -- 172.21.15.53:0/1647556938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08004380 con 0x7f7e040047d0 2024-09-13T18:31:38.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1809a530 con 0x7f7e040047d0 2024-09-13T18:31:38.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e14ff9640 1 -- 172.21.15.53:0/1647556938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800f9e0 con 0x7f7e040047d0 2024-09-13T18:31:38.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e180c9010 con 0x7f7e040047d0 2024-09-13T18:31:38.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1815b8d0 con 0x7f7e040047d0 2024-09-13T18:31:38.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e14ff9640 1 -- 172.21.15.53:0/1647556938 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7e0800fb40 con 0x7f7e040047d0 2024-09-13T18:31:38.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e14ff9640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df8066a80 0x7f7df8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e14ff9640 1 -- 172.21.15.53:0/1647556938 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f7e08084f50 con 0x7f7e040047d0 2024-09-13T18:31:38.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e177fe640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df8066a80 0x7f7df8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.422+0000 7f7e177fe640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df8066a80 0x7f7df8068f40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e00005000 tx=0x7f7e00001520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.426+0000 7f7e14ff9640 1 -- 172.21.15.53:0/1647556938 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e08051ca0 con 0x7f7e040047d0 2024-09-13T18:31:38.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e180b1ec0 con 0x7f7e040047d0 2024-09-13T18:31:38.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e14ff9640 1 -- 172.21.15.53:0/1647556938 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e08022020 con 0x7f7e040047d0 2024-09-13T18:31:38.583 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:31:38.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df8066a80 msgr2=0x7f7df8068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df8066a80 0x7f7df8068f40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e00005000 tx=0x7f7e00001520 comp rx=0 tx=0).stop 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 msgr2=0x7f7e1809c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e1809c0d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009fd0 tx=0x7f7e08011b30 comp rx=0 tx=0).stop 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 shutdown_connections 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df8066a80 0x7f7df8068f40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e18143200 0x7f7e18143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e18099a70 0x7f7e18156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 --2- 172.21.15.53:0/1647556938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e040047d0 0x7f7e1809c0d0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 >> 172.21.15.53:0/1647556938 conn(0x7f7e18069f50 msgr2=0x7f7e1806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 shutdown_connections 2024-09-13T18:31:38.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.582+0000 7f7e1e69d640 1 -- 172.21.15.53:0/1647556938 wait complete. 2024-09-13T18:31:38.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:31:38.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8fb5cd1640 1 Processor -- start 2024-09-13T18:31:38.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8fb5cd1640 1 -- start start 2024-09-13T18:31:38.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8fb5cd1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb006b850 0x7f8fb00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8fb5cd1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8fb00cbd60 0x7f8fb00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8fb5cd1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb00b1ac0 con 0x7f8fb00cb980 2024-09-13T18:31:38.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8fb5cd1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00b3010 con 0x7f8fb00cbd60 2024-09-13T18:31:38.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8fb5cd1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0159ac0 con 0x7f8fb006b850 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb006b850 0x7f8fb00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8fb00cbd60 0x7f8fb00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb006b850 0x7f8fb00b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:34102/0 (socket says 172.21.15.53:34102) 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faeffd640 1 -- 172.21.15.53:0/1261566128 learned_addr learned my addr 172.21.15.53:0/1261566128 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faf7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8fb00cb980 0x7f8fb006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:49594/0 (socket says 172.21.15.53:49594) 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faffff640 1 -- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb006b850 msgr2=0x7f8fb00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faffff640 1 --2- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb006b850 0x7f8fb00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faffff640 1 -- 172.21.15.53:0/1261566128 >> v1:172.21.15.87:6789/0 conn(0x7f8fb00cb980 legacy=0x7f8fb006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faffff640 1 -- 172.21.15.53:0/1261566128 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0159da0 con 0x7f8fb00cbd60 2024-09-13T18:31:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.722+0000 7f8faeffd640 1 --2- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb006b850 0x7f8fb00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8faffff640 1 --2- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb00cbd60 0x7f8fb00cdd40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009d90 tx=0x7f8fa801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cec77a1bd938eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fae7fc640 1 -- 172.21.15.53:0/1261566128 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80a5970 con 0x7f8fb00cbd60 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fae7fc640 1 -- 172.21.15.53:0/1261566128 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa80a5ad0 con 0x7f8fb00cbd60 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fae7fc640 1 -- 172.21.15.53:0/1261566128 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80a5e60 con 0x7f8fb00cbd60 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb00cbd60 msgr2=0x7f8fb00cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb00cbd60 0x7f8fb00cdd40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009d90 tx=0x7f8fa801c8b0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/1261566128 shutdown_connections 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb00cbd60 0x7f8fb00cdd40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/1261566128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb006b850 0x7f8fb00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/1261566128 >> 172.21.15.53:0/1261566128 conn(0x7f8fb0065c80 msgr2=0x7f8fb0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/1261566128 shutdown_connections 2024-09-13T18:31:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/1261566128 wait complete. 2024-09-13T18:31:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 Processor -- start 2024-09-13T18:31:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.726+0000 7f8fb5cd1640 1 -- start start 2024-09-13T18:31:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb006b850 0x7f8fb0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb00cb980 0x7f8fb014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb00cbd60 0x7f8fb014c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0155950 con 0x7f8fb00cb980 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0158350 con 0x7f8fb006b850 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0158630 con 0x7f8fb00cbd60 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb00cb980 0x7f8fb014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb00cb980 0x7f8fb014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55558/0 (socket says 172.21.15.53:55558) 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 -- 172.21.15.53:0/2804875620 learned_addr learned my addr 172.21.15.53:0/2804875620 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faffff640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb00cbd60 0x7f8fb014c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faf7fe640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb006b850 0x7f8fb0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 -- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb00cbd60 msgr2=0x7f8fb014c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb00cbd60 0x7f8fb014c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 -- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb006b850 msgr2=0x7f8fb0157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb006b850 0x7f8fb0157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 -- 172.21.15.53:0/2804875620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa400b770 con 0x7f8fb00cb980 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faeffd640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb00cb980 0x7f8fb014d210 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4010dc0 tx=0x7f8fa400e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8f97fff640 1 -- 172.21.15.53:0/2804875620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4011860 con 0x7f8fb00cb980 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8f97fff640 1 -- 172.21.15.53:0/2804875620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa40119c0 con 0x7f8fb00cb980 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa8009a70 con 0x7f8fb00cb980 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8f97fff640 1 -- 172.21.15.53:0/2804875620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4011d30 con 0x7f8fb00cb980 2024-09-13T18:31:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb0155570 con 0x7f8fb00cb980 2024-09-13T18:31:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb0067400 con 0x7f8fb00cb980 2024-09-13T18:31:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8f97fff640 1 -- 172.21.15.53:0/2804875620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8fa4019440 con 0x7f8fb00cb980 2024-09-13T18:31:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8f97fff640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f9c066a80 0x7f8f9c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8f97fff640 1 -- 172.21.15.53:0/2804875620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f8fa40879f0 con 0x7f8fb00cb980 2024-09-13T18:31:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.730+0000 7f8faf7fe640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f9c066a80 0x7f8f9c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.734+0000 7f8faf7fe640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f9c066a80 0x7f8f9c068f40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000f70 tx=0x7f8fa0007e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.734+0000 7f8f97fff640 1 -- 172.21.15.53:0/2804875620 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fa4054980 con 0x7f8fb00cb980 2024-09-13T18:31:38.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.906+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8fb01587f0 con 0x7f8fb00cb980 2024-09-13T18:31:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.906+0000 7f8f97fff640 1 -- 172.21.15.53:0/2804875620 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8fa401e080 con 0x7f8fb00cb980 2024-09-13T18:31:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f9c066a80 msgr2=0x7f8f9c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f9c066a80 0x7f8f9c068f40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000f70 tx=0x7f8fa0007e50 comp rx=0 tx=0).stop 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb00cb980 msgr2=0x7f8fb014d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb00cb980 0x7f8fb014d210 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4010dc0 tx=0x7f8fa400e730 comp rx=0 tx=0).stop 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 shutdown_connections 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f9c066a80 0x7f8f9c068f40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fb00cbd60 0x7f8fb014c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb00cb980 0x7f8fb014d210 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 --2- 172.21.15.53:0/2804875620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fb006b850 0x7f8fb0157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:38.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 >> 172.21.15.53:0/2804875620 conn(0x7f8fb0065c80 msgr2=0x7f8fb015ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:38.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 shutdown_connections 2024-09-13T18:31:38.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:38.910+0000 7f8fb5cd1640 1 -- 172.21.15.53:0/2804875620 wait complete. 2024-09-13T18:31:38.928 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:31:38.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:38.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:31:38.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[49177]: fuse finished with error 0 and tester_r 0 2024-09-13T18:31:38.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:31:38.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:38.941 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:31:39.106 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:31:39.106 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:39.113 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b1e1fa640 1 Processor -- start 2024-09-13T18:31:39.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b1e1fa640 1 -- start start 2024-09-13T18:31:39.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b1e1fa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b18158990 0x7f5b1806c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b1e1fa640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5b180b27f0 0x7f5b180abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b1e1fa640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b18159e80 con 0x7f5b180ac2e0 2024-09-13T18:31:39.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b1e1fa640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b18073440 con 0x7f5b180b27f0 2024-09-13T18:31:39.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b1e1fa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1806cc40 con 0x7f5b18158990 2024-09-13T18:31:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b18158990 0x7f5b1806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b16ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5b180b27f0 0x7f5b180abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b177fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b18158990 0x7f5b1806c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:34116/0 (socket says 172.21.15.53:34116) 2024-09-13T18:31:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b177fe640 1 -- 172.21.15.53:0/4285927016 learned_addr learned my addr 172.21.15.53:0/4285927016 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b167fc640 1 -- 172.21.15.53:0/4285927016 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113897254 0 0) 0x7f5b100014a0 con 0x7f5b180ac2e0 2024-09-13T18:31:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b177fe640 1 -- 172.21.15.53:0/4285927016 >> v2:172.21.15.87:3300/0 conn(0x7f5b180b27f0 msgr2=0x7f5b180abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:39.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b177fe640 1 --2- 172.21.15.53:0/4285927016 >> v2:172.21.15.87:3300/0 conn(0x7f5b180b27f0 0x7f5b180abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b177fe640 1 -- 172.21.15.53:0/4285927016 >> v1:172.21.15.87:6789/0 conn(0x7f5b180ac2e0 legacy=0x7f5b18072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.278+0000 7f5b177fe640 1 -- 172.21.15.53:0/4285927016 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1806cf20 con 0x7f5b18158990 2024-09-13T18:31:39.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b177fe640 1 --2- 172.21.15.53:0/4285927016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b18158990 0x7f5b1806c580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009870 tx=0x7f5b0801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67270201474ec957 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b167fc640 1 -- 172.21.15.53:0/4285927016 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b080a6040 con 0x7f5b18158990 2024-09-13T18:31:39.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b167fc640 1 -- 172.21.15.53:0/4285927016 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b080aa600 con 0x7f5b18158990 2024-09-13T18:31:39.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b167fc640 1 -- 172.21.15.53:0/4285927016 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b080aa990 con 0x7f5b18158990 2024-09-13T18:31:39.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/4285927016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b18158990 msgr2=0x7f5b1806c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/4285927016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b18158990 0x7f5b1806c580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009870 tx=0x7f5b0801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/4285927016 shutdown_connections 2024-09-13T18:31:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/4285927016 >> v2:172.21.15.87:3300/0 conn(0x7f5b180b27f0 0x7f5b180abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/4285927016 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b18158990 0x7f5b1806c580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/4285927016 >> 172.21.15.53:0/4285927016 conn(0x7f5b180b0a50 msgr2=0x7f5b180b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/4285927016 shutdown_connections 2024-09-13T18:31:39.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.282+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/4285927016 wait complete. 2024-09-13T18:31:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 Processor -- start 2024-09-13T18:31:39.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 -- start start 2024-09-13T18:31:39.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b180ac2e0 0x7f5b18142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b180b27f0 0x7f5b18156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b18158990 0x7f5b180ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18147c50 con 0x7f5b180b27f0 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18143510 con 0x7f5b18158990 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180ce5c0 con 0x7f5b180ac2e0 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b180b27f0 0x7f5b18156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b180b27f0 0x7f5b18156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55568/0 (socket says 172.21.15.53:55568) 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 -- 172.21.15.53:0/1587832609 learned_addr learned my addr 172.21.15.53:0/1587832609 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b177fe640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b180ac2e0 0x7f5b18142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b17fff640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b18158990 0x7f5b180ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 -- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b180ac2e0 msgr2=0x7f5b18142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b180ac2e0 0x7f5b18142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 -- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b18158990 msgr2=0x7f5b180ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b18158990 0x7f5b180ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 -- 172.21.15.53:0/1587832609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080094d0 con 0x7f5b180b27f0 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b177fe640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b180ac2e0 0x7f5b18142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b16ffd640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b180b27f0 0x7f5b18156810 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000e930 tx=0x7f5b0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b0ffff640 1 -- 172.21.15.53:0/1587832609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00009690 con 0x7f5b180b27f0 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b0ffff640 1 -- 172.21.15.53:0/1587832609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000ca00 con 0x7f5b180b27f0 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b18157300 con 0x7f5b180b27f0 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b0ffff640 1 -- 172.21.15.53:0/1587832609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000cd70 con 0x7f5b180b27f0 2024-09-13T18:31:39.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b18157020 con 0x7f5b180b27f0 2024-09-13T18:31:39.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.286+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b180abda0 con 0x7f5b180b27f0 2024-09-13T18:31:39.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.290+0000 7f5b0ffff640 1 -- 172.21.15.53:0/1587832609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5b00013470 con 0x7f5b180b27f0 2024-09-13T18:31:39.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.290+0000 7f5b0ffff640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5af8066a80 0x7f5af8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.290+0000 7f5b0ffff640 1 -- 172.21.15.53:0/1587832609 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f5b00084af0 con 0x7f5b180b27f0 2024-09-13T18:31:39.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.290+0000 7f5b177fe640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5af8066a80 0x7f5af8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.290+0000 7f5b177fe640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5af8066a80 0x7f5af8068f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009870 tx=0x7f5b080a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.294+0000 7f5b0ffff640 1 -- 172.21.15.53:0/1587832609 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b000519b0 con 0x7f5b180b27f0 2024-09-13T18:31:39.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.446+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b18150d80 con 0x7f5b180b27f0 2024-09-13T18:31:39.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b0ffff640 1 -- 172.21.15.53:0/1587832609 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f5b00017090 con 0x7f5b180b27f0 2024-09-13T18:31:39.451 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:39.451 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":108,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:38.918269+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:39.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5af8066a80 msgr2=0x7f5af8068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5af8066a80 0x7f5af8068f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009870 tx=0x7f5b080a7000 comp rx=0 tx=0).stop 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b180b27f0 msgr2=0x7f5b18156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b180b27f0 0x7f5b18156810 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000e930 tx=0x7f5b0000edf0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 shutdown_connections 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5af8066a80 0x7f5af8068f40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b18158990 0x7f5b180ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b180b27f0 0x7f5b18156810 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 --2- 172.21.15.53:0/1587832609 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b180ac2e0 0x7f5b18142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 >> 172.21.15.53:0/1587832609 conn(0x7f5b180b0a50 msgr2=0x7f5b180b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 shutdown_connections 2024-09-13T18:31:39.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.450+0000 7f5b1e1fa640 1 -- 172.21.15.53:0/1587832609 wait complete. 2024-09-13T18:31:39.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:30:58.560050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:30:59.064624+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:31:39.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:31:39.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f61720d4640 1 Processor -- start 2024-09-13T18:31:39.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f61720d4640 1 -- start start 2024-09-13T18:31:39.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f61720d4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f616c15c830 0x7f616c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f61720d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f61720d4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c0b7db0 con 0x7f616c0d2c80 2024-09-13T18:31:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f61720d4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0d0650 con 0x7f616c15c830 2024-09-13T18:31:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f61720d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0d0c10 con 0x7f616c0ccd10 2024-09-13T18:31:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f616c0d2c80 0x7f616c0b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49156/0 (socket says 172.21.15.53:49156) 2024-09-13T18:31:39.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616bfff640 1 -- 172.21.15.53:0/706758268 learned_addr learned my addr 172.21.15.53:0/706758268 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616affd640 1 --2- 172.21.15.53:0/706758268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616b7fe640 1 --2- 172.21.15.53:0/706758268 >> v2:172.21.15.87:3300/0 conn(0x7f616c15c830 0x7f616c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616a7fc640 1 -- 172.21.15.53:0/706758268 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350617072 0 0) 0x7f616c0b7db0 con 0x7f616c0d2c80 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616a7fc640 1 -- 172.21.15.53:0/706758268 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6154003530 con 0x7f616c0d2c80 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616a7fc640 1 -- 172.21.15.53:0/706758268 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333389853 0 0) 0x7f6154003530 con 0x7f616c0d2c80 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616affd640 1 -- 172.21.15.53:0/706758268 >> v2:172.21.15.87:3300/0 conn(0x7f616c15c830 msgr2=0x7f616c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616affd640 1 --2- 172.21.15.53:0/706758268 >> v2:172.21.15.87:3300/0 conn(0x7f616c15c830 0x7f616c0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616affd640 1 -- 172.21.15.53:0/706758268 >> v1:172.21.15.53:6789/0 conn(0x7f616c0d2c80 legacy=0x7f616c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.598+0000 7f616affd640 1 -- 172.21.15.53:0/706758268 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0cd7d0 con 0x7f616c0ccd10 2024-09-13T18:31:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f616affd640 1 --2- 172.21.15.53:0/706758268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c0cd150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61600097c0 tx=0x7f616001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a64db0cfd723cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f616a7fc640 1 -- 172.21.15.53:0/706758268 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164001a00 con 0x7f616c0ccd10 2024-09-13T18:31:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f616a7fc640 1 -- 172.21.15.53:0/706758268 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61600a7050 con 0x7f616c0ccd10 2024-09-13T18:31:39.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f616a7fc640 1 -- 172.21.15.53:0/706758268 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600ab600 con 0x7f616c0ccd10 2024-09-13T18:31:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- 172.21.15.53:0/706758268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 msgr2=0x7f616c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 --2- 172.21.15.53:0/706758268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c0cd150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61600097c0 tx=0x7f616001c3c0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- 172.21.15.53:0/706758268 shutdown_connections 2024-09-13T18:31:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 --2- 172.21.15.53:0/706758268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c0cd150 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 --2- 172.21.15.53:0/706758268 >> v2:172.21.15.87:3300/0 conn(0x7f616c15c830 0x7f616c0d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- 172.21.15.53:0/706758268 >> 172.21.15.53:0/706758268 conn(0x7f616c070970 msgr2=0x7f616c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:39.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- 172.21.15.53:0/706758268 shutdown_connections 2024-09-13T18:31:39.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- 172.21.15.53:0/706758268 wait complete. 2024-09-13T18:31:39.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 Processor -- start 2024-09-13T18:31:39.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- start start 2024-09-13T18:31:39.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f616c0d2c80 0x7f616c0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c15c830 0x7f616c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c15d290 con 0x7f616c15c830 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c15d570 con 0x7f616c0d2c80 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f61720d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c15d850 con 0x7f616c0ccd10 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.602+0000 7f616bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c15c830 0x7f616c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c15c830 0x7f616c152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55570/0 (socket says 172.21.15.53:55570) 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 -- 172.21.15.53:0/2636399393 learned_addr learned my addr 172.21.15.53:0/2636399393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616b7fe640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616affd640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f616c0d2c80 0x7f616c0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 -- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 msgr2=0x7f616c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 -- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f616c0d2c80 msgr2=0x7f616c0c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f616c0d2c80 0x7f616c0c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 -- 172.21.15.53:0/2636399393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009420 con 0x7f616c15c830 2024-09-13T18:31:39.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616b7fe640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616bfff640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c15c830 0x7f616c152170 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6164001840 tx=0x7f616400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f6153fff640 1 -- 172.21.15.53:0/2636399393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164012400 con 0x7f616c15c830 2024-09-13T18:31:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f6153fff640 1 -- 172.21.15.53:0/2636399393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164012560 con 0x7f616c15c830 2024-09-13T18:31:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c15db30 con 0x7f616c15c830 2024-09-13T18:31:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f6153fff640 1 -- 172.21.15.53:0/2636399393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164012910 con 0x7f616c15c830 2024-09-13T18:31:39.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c1526b0 con 0x7f616c15c830 2024-09-13T18:31:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c0d1080 con 0x7f616c15c830 2024-09-13T18:31:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f6153fff640 1 -- 172.21.15.53:0/2636399393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f6164012a70 con 0x7f616c15c830 2024-09-13T18:31:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f6153fff640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6158066a80 0x7f6158068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f6153fff640 1 -- 172.21.15.53:0/2636399393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f61640850d0 con 0x7f616c15c830 2024-09-13T18:31:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616b7fe640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6158066a80 0x7f6158068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.606+0000 7f616b7fe640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6158066a80 0x7f6158068f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f616c15b4b0 tx=0x7f615c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.610+0000 7f6153fff640 1 -- 172.21.15.53:0/2636399393 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6164051e40 con 0x7f616c15c830 2024-09-13T18:31:39.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f616c0cd290 con 0x7f616c15c830 2024-09-13T18:31:39.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f6153fff640 1 -- 172.21.15.53:0/2636399393 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6164055460 con 0x7f616c15c830 2024-09-13T18:31:39.771 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:31:39.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6158066a80 msgr2=0x7f6158068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6158066a80 0x7f6158068f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f616c15b4b0 tx=0x7f615c008040 comp rx=0 tx=0).stop 2024-09-13T18:31:39.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c15c830 msgr2=0x7f616c152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c15c830 0x7f616c152170 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f6164001840 tx=0x7f616400a430 comp rx=0 tx=0).stop 2024-09-13T18:31:39.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 shutdown_connections 2024-09-13T18:31:39.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6158066a80 0x7f6158068f40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f616c15c830 0x7f616c152170 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f616c0d2c80 0x7f616c0c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 --2- 172.21.15.53:0/2636399393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f616c0ccd10 0x7f616c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 >> 172.21.15.53:0/2636399393 conn(0x7f616c070970 msgr2=0x7f616c0b7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:39.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 shutdown_connections 2024-09-13T18:31:39.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.770+0000 7f61720d4640 1 -- 172.21.15.53:0/2636399393 wait complete. 2024-09-13T18:31:39.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:31:39.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c365f640 1 Processor -- start 2024-09-13T18:31:39.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c365f640 1 -- start start 2024-09-13T18:31:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c365f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc158ba0 0x7fb1bc0cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c365f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1bc06ff40 0x7fb1bc070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c365f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc0b3830 con 0x7fb1bc0b1dd0 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c365f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc06c530 con 0x7fb1bc06ff40 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c365f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc070890 con 0x7fb1bc158ba0 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c1bfc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1bc06ff40 0x7fb1bc070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c1bfc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1bc06ff40 0x7fb1bc070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55584/0 (socket says 172.21.15.53:55584) 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/1673334888 learned_addr learned my addr 172.21.15.53:0/1673334888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c13fb640 1 --2- 172.21.15.53:0/1673334888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc158ba0 0x7fb1bc0cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/1673334888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc158ba0 msgr2=0x7fb1bc0cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c1bfc640 1 --2- 172.21.15.53:0/1673334888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc158ba0 0x7fb1bc0cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/1673334888 >> v1:172.21.15.87:6789/0 conn(0x7fb1bc0b1dd0 legacy=0x7fb1bc0b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:39.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.906+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/1673334888 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc158f80 con 0x7fb1bc06ff40 2024-09-13T18:31:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 --2- 172.21.15.53:0/1673334888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc070350 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009e50 tx=0x7fb1b401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c110fa9f7f43c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1b3fff640 1 -- 172.21.15.53:0/1673334888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5740 con 0x7fb1bc06ff40 2024-09-13T18:31:39.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1b3fff640 1 -- 172.21.15.53:0/1673334888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40a58a0 con 0x7fb1bc06ff40 2024-09-13T18:31:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1b3fff640 1 -- 172.21.15.53:0/1673334888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5c30 con 0x7fb1bc06ff40 2024-09-13T18:31:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- 172.21.15.53:0/1673334888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc06ff40 msgr2=0x7fb1bc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 --2- 172.21.15.53:0/1673334888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc070350 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009e50 tx=0x7fb1b401c8a0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- 172.21.15.53:0/1673334888 shutdown_connections 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 --2- 172.21.15.53:0/1673334888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc070350 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 --2- 172.21.15.53:0/1673334888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc158ba0 0x7fb1bc0cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- 172.21.15.53:0/1673334888 >> 172.21.15.53:0/1673334888 conn(0x7fb1bc065c80 msgr2=0x7fb1bc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- 172.21.15.53:0/1673334888 shutdown_connections 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- 172.21.15.53:0/1673334888 wait complete. 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 Processor -- start 2024-09-13T18:31:39.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- start start 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc0b1dd0 0x7fb1bc151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc158ba0 0x7fb1bc0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0a8e90 con 0x7fb1bc158ba0 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc151ae0 con 0x7fb1bc06ff40 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c365f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc151dc0 con 0x7fb1bc0b1dd0 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc158ba0 0x7fb1bc0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc158ba0 0x7fb1bc0cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55590/0 (socket says 172.21.15.53:55590) 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/3455205272 learned_addr learned my addr 172.21.15.53:0/3455205272 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c13fb640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c0bfa640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc0b1dd0 0x7fb1bc151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc0b1dd0 msgr2=0x7fb1bc151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc0b1dd0 0x7fb1bc151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1bc06ff40 msgr2=0x7fb1bc142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c1bfc640 1 -- 172.21.15.53:0/3455205272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4009b30 con 0x7fb1bc158ba0 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.910+0000 7fb1c13fb640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1c1bfc640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc158ba0 0x7fb1bc0cc770 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fb1b401af50 tx=0x7fb1b4019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1b1ffb640 1 -- 172.21.15.53:0/3455205272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40b8670 con 0x7fb1bc158ba0 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1b1ffb640 1 -- 172.21.15.53:0/3455205272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40b87d0 con 0x7fb1bc158ba0 2024-09-13T18:31:39.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1b1ffb640 1 -- 172.21.15.53:0/3455205272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40b8b60 con 0x7fb1bc158ba0 2024-09-13T18:31:39.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc1520a0 con 0x7fb1bc158ba0 2024-09-13T18:31:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc143290 con 0x7fb1bc158ba0 2024-09-13T18:31:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc070350 con 0x7fb1bc158ba0 2024-09-13T18:31:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1b1ffb640 1 -- 172.21.15.53:0/3455205272 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb1b40b8cc0 con 0x7fb1bc158ba0 2024-09-13T18:31:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1b1ffb640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb1a0066a80 0x7fb1a0068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1b1ffb640 1 -- 172.21.15.53:0/3455205272 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb1b411fca0 con 0x7fb1bc158ba0 2024-09-13T18:31:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1c13fb640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb1a0066a80 0x7fb1a0068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:39.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.914+0000 7fb1c13fb640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb1a0066a80 0x7fb1a0068f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80097a0 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:39.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:39.918+0000 7fb1b1ffb640 1 -- 172.21.15.53:0/3455205272 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1b40ecb40 con 0x7fb1bc158ba0 2024-09-13T18:31:40.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.078+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1bc0b3830 con 0x7fb1bc158ba0 2024-09-13T18:31:40.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.078+0000 7fb1b1ffb640 1 -- 172.21.15.53:0/3455205272 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1bc0b3830 con 0x7fb1bc158ba0 2024-09-13T18:31:40.081 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:31:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb1a0066a80 msgr2=0x7fb1a0068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb1a0066a80 0x7fb1a0068f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80097a0 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2024-09-13T18:31:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc158ba0 msgr2=0x7fb1bc0cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc158ba0 0x7fb1bc0cc770 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fb1b401af50 tx=0x7fb1b4019640 comp rx=0 tx=0).stop 2024-09-13T18:31:40.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 shutdown_connections 2024-09-13T18:31:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb1a0066a80 0x7fb1a0068f40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1bc0b1dd0 0x7fb1bc151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1bc158ba0 0x7fb1bc0cc770 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 --2- 172.21.15.53:0/3455205272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1bc06ff40 0x7fb1bc142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 >> 172.21.15.53:0/3455205272 conn(0x7fb1bc065c80 msgr2=0x7fb1bc066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 shutdown_connections 2024-09-13T18:31:40.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.082+0000 7fb1c365f640 1 -- 172.21.15.53:0/3455205272 wait complete. 2024-09-13T18:31:40.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:31:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0ff08640 1 Processor -- start 2024-09-13T18:31:40.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0ff08640 1 -- start start 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0ff08640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2a080cf0a0 0x7f2a080cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0ff08640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a08160ca0 con 0x7f2a080d09e0 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0ff08640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a08161130 con 0x7f2a0815fd60 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0ff08640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a08160370 con 0x7f2a080cf0a0 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0e4a5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2a080d09e0 0x7f2a080d0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49172/0 (socket says 172.21.15.53:49172) 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0e4a5640 1 -- 172.21.15.53:0/1286031759 learned_addr learned my addr 172.21.15.53:0/1286031759 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1286031759 >> v2:172.21.15.87:3300/0 conn(0x7f2a080cf0a0 0x7f2a080cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767181052 0 0) 0x7f2a08160ca0 con 0x7f2a080d09e0 2024-09-13T18:31:40.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f4003530 con 0x7f2a080d09e0 2024-09-13T18:31:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3863810932 0 0) 0x7f29f4003530 con 0x7f2a080d09e0 2024-09-13T18:31:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 >> v2:172.21.15.87:3300/0 conn(0x7f2a080cf0a0 msgr2=0x7f2a080cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 --2- 172.21.15.53:0/1286031759 >> v2:172.21.15.87:3300/0 conn(0x7f2a080cf0a0 0x7f2a080cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 >> v1:172.21.15.87:6789/0 conn(0x7f2a0815fd60 legacy=0x7f2a080cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08160650 con 0x7f2a080d09e0 2024-09-13T18:31:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f2a00001a00 con 0x7f2a080d09e0 2024-09-13T18:31:40.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 >> v1:172.21.15.53:6789/0 conn(0x7f2a080d09e0 legacy=0x7f2a080d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29f4003980 0x7f29f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f29f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f4005190 0x7f29f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08160370 con 0x7f29f40047d0 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f400c040 con 0x7f29f4005190 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f400c200 con 0x7f29f4003980 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f29f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0dca4640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29f4003980 0x7f29f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0e4a5640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f4005190 0x7f29f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0d4a3640 1 -- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29f4003980 msgr2=0x7f29f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29f4003980 0x7f29f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0d4a3640 1 -- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f4005190 msgr2=0x7f29f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:40.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f4005190 0x7f29f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0d4a3640 1 -- 172.21.15.53:0/1286031759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4003530 con 0x7f29f40047d0 2024-09-13T18:31:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0e4a5640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29f4005190 0x7f29f400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.234+0000 7f2a0e4a5640 1 -- 172.21.15.53:0/1286031759 reap_dead start 2024-09-13T18:31:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f29f4004c50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009ae0 tx=0x7f29f801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb9f08efddb8623 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80a5660 con 0x7f29f40047d0 2024-09-13T18:31:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f80a57c0 con 0x7f29f40047d0 2024-09-13T18:31:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0cca2640 1 -- 172.21.15.53:0/1286031759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80a5b70 con 0x7f29f40047d0 2024-09-13T18:31:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1286031759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 msgr2=0x7f29f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f29f4004c50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009ae0 tx=0x7f29f801ca70 comp rx=0 tx=0).stop 2024-09-13T18:31:40.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1286031759 shutdown_connections 2024-09-13T18:31:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1286031759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f29f4004c50 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1286031759 >> 172.21.15.53:0/1286031759 conn(0x7f2a08070970 msgr2=0x7f2a08070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1286031759 shutdown_connections 2024-09-13T18:31:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1286031759 wait complete. 2024-09-13T18:31:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 Processor -- start 2024-09-13T18:31:40.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.238+0000 7f2a0ff08640 1 -- start start 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f2a08157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a080b6320 0x7f2a080ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a080cad40 0x7f2a080cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080b28b0 con 0x7f29f40047d0 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08158160 con 0x7f2a080b6320 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815ad10 con 0x7f2a080cad40 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f2a08157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f2a08157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55606/0 (socket says 172.21.15.53:55606) 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 -- 172.21.15.53:0/1302025744 learned_addr learned my addr 172.21.15.53:0/1302025744 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a080b6320 0x7f2a080ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0e4a5640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a080cad40 0x7f2a080cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 -- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a080cad40 msgr2=0x7f2a080cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a080cad40 0x7f2a080cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 -- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a080b6320 msgr2=0x7f2a080ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a080b6320 0x7f2a080ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 -- 172.21.15.53:0/1302025744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080b22a0 con 0x7f29f40047d0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0e4a5640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a080cad40 0x7f2a080cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0dca4640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f2a08157800 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400e580 tx=0x7f2a0400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f29fe7fc640 1 -- 172.21.15.53:0/1302025744 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040052e0 con 0x7f29f40047d0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f29fe7fc640 1 -- 172.21.15.53:0/1302025744 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04005440 con 0x7f29f40047d0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0815aa30 con 0x7f29f40047d0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f29fe7fc640 1 -- 172.21.15.53:0/1302025744 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04003820 con 0x7f29f40047d0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a08157d40 con 0x7f29f40047d0 2024-09-13T18:31:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a080cf4c0 con 0x7f29f40047d0 2024-09-13T18:31:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f29fe7fc640 1 -- 172.21.15.53:0/1302025744 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2a04003980 con 0x7f29f40047d0 2024-09-13T18:31:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f29fe7fc640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29ec066a80 0x7f29ec068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f29fe7fc640 1 -- 172.21.15.53:0/1302025744 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f2a040845f0 con 0x7f29f40047d0 2024-09-13T18:31:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29ec066a80 0x7f29ec068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.242+0000 7f2a0d4a3640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29ec066a80 0x7f29ec068f40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29f80af000 tx=0x7f29f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:40.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.246+0000 7f29fe7fc640 1 -- 172.21.15.53:0/1302025744 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a04051470 con 0x7f29f40047d0 2024-09-13T18:31:40.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a080b7a50 con 0x7f29f40047d0 2024-09-13T18:31:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f29fe7fc640 1 -- 172.21.15.53:0/1302025744 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a04054a90 con 0x7f29f40047d0 2024-09-13T18:31:40.411 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:31:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29ec066a80 msgr2=0x7f29ec068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29ec066a80 0x7f29ec068f40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29f80af000 tx=0x7f29f8008040 comp rx=0 tx=0).stop 2024-09-13T18:31:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 msgr2=0x7f2a08157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f2a08157800 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400e580 tx=0x7f2a0400ea40 comp rx=0 tx=0).stop 2024-09-13T18:31:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 shutdown_connections 2024-09-13T18:31:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29ec066a80 0x7f29ec068f40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a080cad40 0x7f2a080cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a080b6320 0x7f2a080ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 --2- 172.21.15.53:0/1302025744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29f40047d0 0x7f2a08157800 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 >> 172.21.15.53:0/1302025744 conn(0x7f2a08070970 msgr2=0x7f2a080b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.410+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 shutdown_connections 2024-09-13T18:31:40.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.414+0000 7f2a0ff08640 1 -- 172.21.15.53:0/1302025744 wait complete. 2024-09-13T18:31:40.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:31:40.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac71274640 1 Processor -- start 2024-09-13T18:31:40.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac71274640 1 -- start start 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac71274640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac6c15b7c0 0x7fac6c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac71274640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac6c0711d0 0x7fac6c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac71274640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c06d480 con 0x7fac6c1582a0 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac71274640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c071680 con 0x7fac6c15b7c0 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac71274640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c15aaf0 con 0x7fac6c0711d0 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fac6c1582a0 0x7fac6c06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49176/0 (socket says 172.21.15.53:49176) 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6affd640 1 -- 172.21.15.53:0/2780339029 learned_addr learned my addr 172.21.15.53:0/2780339029 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6a7fc640 1 --2- 172.21.15.53:0/2780339029 >> v2:172.21.15.53:3300/0 conn(0x7fac6c15b7c0 0x7fac6c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6b7fe640 1 --2- 172.21.15.53:0/2780339029 >> v2:172.21.15.87:3300/0 conn(0x7fac6c0711d0 0x7fac6c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac69ffb640 1 -- 172.21.15.53:0/2780339029 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621415483 0 0) 0x7fac6c06d480 con 0x7fac6c1582a0 2024-09-13T18:31:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac69ffb640 1 -- 172.21.15.53:0/2780339029 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac54003530 con 0x7fac6c1582a0 2024-09-13T18:31:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6a7fc640 1 -- 172.21.15.53:0/2780339029 >> v2:172.21.15.87:3300/0 conn(0x7fac6c0711d0 msgr2=0x7fac6c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6a7fc640 1 --2- 172.21.15.53:0/2780339029 >> v2:172.21.15.87:3300/0 conn(0x7fac6c0711d0 0x7fac6c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6a7fc640 1 -- 172.21.15.53:0/2780339029 >> v1:172.21.15.53:6789/0 conn(0x7fac6c1582a0 legacy=0x7fac6c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6a7fc640 1 -- 172.21.15.53:0/2780339029 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c15ace0 con 0x7fac6c15b7c0 2024-09-13T18:31:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.550+0000 7fac6b7fe640 1 --2- 172.21.15.53:0/2780339029 >> v2:172.21.15.87:3300/0 conn(0x7fac6c0711d0 0x7fac6c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:40.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac6a7fc640 1 --2- 172.21.15.53:0/2780339029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c15b7c0 0x7fac6c070c90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fac6c158680 tx=0x7fac6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d3cb9c1a6d6e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:40.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac69ffb640 1 -- 172.21.15.53:0/2780339029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600ab600 con 0x7fac6c15b7c0 2024-09-13T18:31:40.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac69ffb640 1 -- 172.21.15.53:0/2780339029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac600a7050 con 0x7fac6c15b7c0 2024-09-13T18:31:40.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac69ffb640 1 -- 172.21.15.53:0/2780339029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600ab960 con 0x7fac6c15b7c0 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- 172.21.15.53:0/2780339029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c15b7c0 msgr2=0x7fac6c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 --2- 172.21.15.53:0/2780339029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c15b7c0 0x7fac6c070c90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fac6c158680 tx=0x7fac6001c480 comp rx=0 tx=0).stop 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- 172.21.15.53:0/2780339029 shutdown_connections 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 --2- 172.21.15.53:0/2780339029 >> v2:172.21.15.87:3300/0 conn(0x7fac6c0711d0 0x7fac6c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 --2- 172.21.15.53:0/2780339029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c15b7c0 0x7fac6c070c90 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- 172.21.15.53:0/2780339029 >> 172.21.15.53:0/2780339029 conn(0x7fac6c065c80 msgr2=0x7fac6c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- 172.21.15.53:0/2780339029 shutdown_connections 2024-09-13T18:31:40.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- 172.21.15.53:0/2780339029 wait complete. 2024-09-13T18:31:40.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 Processor -- start 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- start start 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac6c0711d0 0x7fac6c14bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c1582a0 0x7fac6c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac6c15b7c0 0x7fac6c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c14f1f0 con 0x7fac6c1582a0 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c14f4d0 con 0x7fac6c0711d0 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac71274640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c14f7b0 con 0x7fac6c15b7c0 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac6a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c1582a0 0x7fac6c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac6a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c1582a0 0x7fac6c0aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55628/0 (socket says 172.21.15.53:55628) 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac6a7fc640 1 -- 172.21.15.53:0/1479881311 learned_addr learned my addr 172.21.15.53:0/1479881311 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:40.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac6affd640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac6c0711d0 0x7fac6c14bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.554+0000 7fac6b7fe640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac6c15b7c0 0x7fac6c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6a7fc640 1 -- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac6c15b7c0 msgr2=0x7fac6c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6a7fc640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac6c15b7c0 0x7fac6c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6a7fc640 1 -- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac6c0711d0 msgr2=0x7fac6c14bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6a7fc640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac6c0711d0 0x7fac6c14bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6a7fc640 1 -- 172.21.15.53:0/1479881311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac60009420 con 0x7fac6c1582a0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6a7fc640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c1582a0 0x7fac6c0aea40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fac60019090 tx=0x7fac60019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac537fe640 1 -- 172.21.15.53:0/1479881311 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60006e20 con 0x7fac6c1582a0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac537fe640 1 -- 172.21.15.53:0/1479881311 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac600b4400 con 0x7fac6c1582a0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c14fa90 con 0x7fac6c1582a0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac537fe640 1 -- 172.21.15.53:0/1479881311 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600b4770 con 0x7fac6c1582a0 2024-09-13T18:31:40.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c14c330 con 0x7fac6c1582a0 2024-09-13T18:31:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c067400 con 0x7fac6c1582a0 2024-09-13T18:31:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac537fe640 1 -- 172.21.15.53:0/1479881311 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fac600b2040 con 0x7fac6c1582a0 2024-09-13T18:31:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac537fe640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac58066a80 0x7fac58068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:40.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac537fe640 1 -- 172.21.15.53:0/1479881311 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fac6011e8c0 con 0x7fac6c1582a0 2024-09-13T18:31:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6affd640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac58066a80 0x7fac58068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:40.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.558+0000 7fac6affd640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac58066a80 0x7fac58068f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac5c005890 tx=0x7fac5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:40.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.562+0000 7fac537fe640 1 -- 172.21.15.53:0/1479881311 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac600eb520 con 0x7fac6c1582a0 2024-09-13T18:31:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.734+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fac6c14ffb0 con 0x7fac6c1582a0 2024-09-13T18:31:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.734+0000 7fac537fe640 1 -- 172.21.15.53:0/1479881311 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v108) v1 ==== 80+0+0 (secure 0 0 0) 0x7fac6c14ffb0 con 0x7fac6c1582a0 2024-09-13T18:31:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:31:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac58066a80 msgr2=0x7fac58068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac58066a80 0x7fac58068f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac5c005890 tx=0x7fac5c009040 comp rx=0 tx=0).stop 2024-09-13T18:31:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c1582a0 msgr2=0x7fac6c0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c1582a0 0x7fac6c0aea40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fac60019090 tx=0x7fac60019220 comp rx=0 tx=0).stop 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 shutdown_connections 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac58066a80 0x7fac58068f40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac6c15b7c0 0x7fac6c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac6c1582a0 0x7fac6c0aea40 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 --2- 172.21.15.53:0/1479881311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac6c0711d0 0x7fac6c14bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 >> 172.21.15.53:0/1479881311 conn(0x7fac6c065c80 msgr2=0x7fac6c066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 shutdown_connections 2024-09-13T18:31:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:40.738+0000 7fac71274640 1 -- 172.21.15.53:0/1479881311 wait complete. 2024-09-13T18:31:40.757 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:31:40.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:40.758 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:31:40.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36079]: fuse finished with error 0 and tester_r 0 2024-09-13T18:31:40.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:31:40.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:40.773 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:31:40.845 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:40.845 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:40.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:31:40.851 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:31:40.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:40.852 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:31:40.898 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:31:40.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:31:40.900 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:31:40.900 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:40.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:31:40.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:31:40.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:31:40.906 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:31:40.955 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:31:40.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:31:40.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:41.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb2e48640 1 Processor -- start 2024-09-13T18:31:41.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb2e48640 1 -- start start 2024-09-13T18:31:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb2e48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fac15b7c0 0x7f0fac070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb2e48640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0fac0711d0 0x7f0fac1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb2e48640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac06d480 con 0x7f0fac1582a0 2024-09-13T18:31:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb2e48640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac071680 con 0x7f0fac15b7c0 2024-09-13T18:31:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb2e48640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac15aaf0 con 0x7f0fac0711d0 2024-09-13T18:31:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fabfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fac15b7c0 0x7f0fac070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fabfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fac15b7c0 0x7f0fac070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55636/0 (socket says 172.21.15.53:55636) 2024-09-13T18:31:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fabfff640 1 -- 172.21.15.53:0/3172611995 learned_addr learned my addr 172.21.15.53:0/3172611995 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fb13e5640 1 --2- 172.21.15.53:0/3172611995 >> v2:172.21.15.87:3300/0 conn(0x7f0fac0711d0 0x7f0fac1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fabfff640 1 -- 172.21.15.53:0/3172611995 >> v2:172.21.15.87:3300/0 conn(0x7f0fac0711d0 msgr2=0x7f0fac1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:41.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fabfff640 1 --2- 172.21.15.53:0/3172611995 >> v2:172.21.15.87:3300/0 conn(0x7f0fac0711d0 0x7f0fac1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fabfff640 1 -- 172.21.15.53:0/3172611995 >> v1:172.21.15.53:6789/0 conn(0x7f0fac1582a0 legacy=0x7f0fac06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.090+0000 7f0fabfff640 1 -- 172.21.15.53:0/3172611995 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac15ace0 con 0x7f0fac15b7c0 2024-09-13T18:31:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fabfff640 1 --2- 172.21.15.53:0/3172611995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac070c90 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f0fac158680 tx=0x7f0f9c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be94255365ef5550 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fab7fe640 1 -- 172.21.15.53:0/3172611995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0ab610 con 0x7f0fac15b7c0 2024-09-13T18:31:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fab7fe640 1 -- 172.21.15.53:0/3172611995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c0ab770 con 0x7f0fac15b7c0 2024-09-13T18:31:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fab7fe640 1 -- 172.21.15.53:0/3172611995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0abb00 con 0x7f0fac15b7c0 2024-09-13T18:31:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- 172.21.15.53:0/3172611995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 msgr2=0x7f0fac070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/3172611995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac070c90 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f0fac158680 tx=0x7f0f9c01c520 comp rx=0 tx=0).stop 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- 172.21.15.53:0/3172611995 shutdown_connections 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/3172611995 >> v2:172.21.15.87:3300/0 conn(0x7f0fac0711d0 0x7f0fac1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/3172611995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac070c90 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- 172.21.15.53:0/3172611995 >> 172.21.15.53:0/3172611995 conn(0x7f0fac065c80 msgr2=0x7f0fac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- 172.21.15.53:0/3172611995 shutdown_connections 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- 172.21.15.53:0/3172611995 wait complete. 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 Processor -- start 2024-09-13T18:31:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- start start 2024-09-13T18:31:41.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fac0711d0 0x7f0fac144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fac1582a0 0x7f0fac1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac145f80 con 0x7f0fac15b7c0 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac145400 con 0x7f0fac0711d0 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb2e48640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1456e0 con 0x7f0fac1582a0 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55646/0 (socket says 172.21.15.53:55646) 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 -- 172.21.15.53:0/2917483499 learned_addr learned my addr 172.21.15.53:0/2917483499 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fabfff640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fac1582a0 0x7f0fac1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb0be4640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fac0711d0 0x7f0fac144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 -- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fac1582a0 msgr2=0x7f0fac1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fac1582a0 0x7f0fac1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 -- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fac0711d0 msgr2=0x7f0fac144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fac0711d0 0x7f0fac144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.094+0000 7f0fb13e5640 1 -- 172.21.15.53:0/2917483499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0094d0 con 0x7f0fac15b7c0 2024-09-13T18:31:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fb13e5640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac140a80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4007e40 tx=0x7f0fa400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fa97fa640 1 -- 172.21.15.53:0/2917483499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4014620 con 0x7f0fac15b7c0 2024-09-13T18:31:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fa97fa640 1 -- 172.21.15.53:0/2917483499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400ee90 con 0x7f0fac15b7c0 2024-09-13T18:31:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac1459c0 con 0x7f0fac15b7c0 2024-09-13T18:31:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fa97fa640 1 -- 172.21.15.53:0/2917483499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40149e0 con 0x7f0fac15b7c0 2024-09-13T18:31:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac1450f0 con 0x7f0fac15b7c0 2024-09-13T18:31:41.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac067400 con 0x7f0fac15b7c0 2024-09-13T18:31:41.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fa97fa640 1 -- 172.21.15.53:0/2917483499 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0fa4014b40 con 0x7f0fac15b7c0 2024-09-13T18:31:41.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fa97fa640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f98066a80 0x7f0f98068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fa97fa640 1 -- 172.21.15.53:0/2917483499 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f0fa4085330 con 0x7f0fac15b7c0 2024-09-13T18:31:41.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fb0be4640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f98066a80 0x7f0f98068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.098+0000 7f0fb0be4640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f98066a80 0x7f0f98068f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0000f70 tx=0x7f0fa0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.102+0000 7f0fa97fa640 1 -- 172.21.15.53:0/2917483499 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0fa4052060 con 0x7f0fac15b7c0 2024-09-13T18:31:41.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.298+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fac0cd490 con 0x7f0fac15b7c0 2024-09-13T18:31:41.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.298+0000 7f0fa97fa640 1 -- 172.21.15.53:0/2917483499 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f0fa4055680 con 0x7f0fac15b7c0 2024-09-13T18:31:41.300 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:41.300 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/1892947074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1892947074},{"type":"v1","addr":"172.21.15.87:6834","nonce":1892947074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3784505733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3784505733},{"type":"v1","addr":"172.21.15.87:6835","nonce":3784505733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/945674829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":945674829},{"type":"v1","addr":"172.21.15.53:6833","nonce":945674829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:00.085788+0000","modified":"2024-09-13T18:31:03.099836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2605273551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2605273551},{"type":"v1","addr":"172.21.15.53:6835","nonce":2605273551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:31:41.300 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2024-09-13T18:31:41.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.298+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f98066a80 msgr2=0x7f0f98068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.298+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f98066a80 0x7f0f98068f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0000f70 tx=0x7f0fa0009040 comp rx=0 tx=0).stop 2024-09-13T18:31:41.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.298+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 msgr2=0x7f0fac140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.298+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac140a80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4007e40 tx=0x7f0fa400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 shutdown_connections 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f98066a80 0x7f0f98068f40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fac1582a0 0x7f0fac1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac15b7c0 0x7f0fac140a80 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 --2- 172.21.15.53:0/2917483499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fac0711d0 0x7f0fac144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 >> 172.21.15.53:0/2917483499 conn(0x7f0fac065c80 msgr2=0x7f0fac06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 shutdown_connections 2024-09-13T18:31:41.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.302+0000 7f0fb2e48640 1 -- 172.21.15.53:0/2917483499 wait complete. 2024-09-13T18:31:41.319 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:41.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.430+0000 7f20f1ce1640 1 Processor -- start 2024-09-13T18:31:41.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.430+0000 7f20f1ce1640 1 -- start start 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20f1ce1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec15b300 0x7f20ec0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20f1ce1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20ec0cc8f0 0x7f20ec0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20f1ce1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0cc3f0 con 0x7f20ec161170 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20f1ce1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec161930 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20f1ce1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec161c10 con 0x7f20ec15b300 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20ec0cc8f0 0x7f20ec0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20ec0cc8f0 0x7f20ec0ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55648/0 (socket says 172.21.15.53:55648) 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 -- 172.21.15.53:0/3035816104 learned_addr learned my addr 172.21.15.53:0/3035816104 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:41.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20eb7fe640 1 --2- 172.21.15.53:0/3035816104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec15b300 0x7f20ec0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 -- 172.21.15.53:0/3035816104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec15b300 msgr2=0x7f20ec0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:41.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 --2- 172.21.15.53:0/3035816104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec15b300 0x7f20ec0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 -- 172.21.15.53:0/3035816104 >> v1:172.21.15.53:6789/0 conn(0x7f20ec161170 legacy=0x7f20ec162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 -- 172.21.15.53:0/3035816104 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec161ef0 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ebfff640 1 --2- 172.21.15.53:0/3035816104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec0ccda0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009e50 tx=0x7f20e401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5e4a03c921df4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ea7fc640 1 -- 172.21.15.53:0/3035816104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40a5810 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ea7fc640 1 -- 172.21.15.53:0/3035816104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40a5970 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.434+0000 7f20ea7fc640 1 -- 172.21.15.53:0/3035816104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40a5d00 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- 172.21.15.53:0/3035816104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 msgr2=0x7f20ec0ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/3035816104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec0ccda0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009e50 tx=0x7f20e401ca30 comp rx=0 tx=0).stop 2024-09-13T18:31:41.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- 172.21.15.53:0/3035816104 shutdown_connections 2024-09-13T18:31:41.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/3035816104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec0ccda0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/3035816104 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec15b300 0x7f20ec0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- 172.21.15.53:0/3035816104 >> 172.21.15.53:0/3035816104 conn(0x7f20ec065c80 msgr2=0x7f20ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:41.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- 172.21.15.53:0/3035816104 shutdown_connections 2024-09-13T18:31:41.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- 172.21.15.53:0/3035816104 wait complete. 2024-09-13T18:31:41.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 Processor -- start 2024-09-13T18:31:41.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- start start 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec15b300 0x7f20ec15e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec161170 0x7f20ec15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec159aa0 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec159490 con 0x7f20ec15b300 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec15cd90 con 0x7f20ec161170 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55654/0 (socket says 172.21.15.53:55654) 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 -- 172.21.15.53:0/736475070 learned_addr learned my addr 172.21.15.53:0/736475070 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20ebfff640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec161170 0x7f20ec15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eaffd640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec15b300 0x7f20ec15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 -- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec161170 msgr2=0x7f20ec15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec161170 0x7f20ec15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 -- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec15b300 msgr2=0x7f20ec15e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec15b300 0x7f20ec15e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 -- 172.21.15.53:0/736475070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4009b30 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eaffd640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec15b300 0x7f20ec15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20eb7fe640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec151170 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00e870 tx=0x7f20dc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20d3fff640 1 -- 172.21.15.53:0/736475070 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc009510 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20d3fff640 1 -- 172.21.15.53:0/736475070 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc00eec0 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec15cab0 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20d3fff640 1 -- 172.21.15.53:0/736475070 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00cb40 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.438+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec15e770 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.442+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec067400 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.442+0000 7f20d3fff640 1 -- 172.21.15.53:0/736475070 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f20dc00cca0 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.442+0000 7f20d3fff640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f20d8066a80 0x7f20d8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.442+0000 7f20d3fff640 1 -- 172.21.15.53:0/736475070 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f20dc084a00 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.442+0000 7f20eaffd640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f20d8066a80 0x7f20d8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.442+0000 7f20eaffd640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f20d8066a80 0x7f20d8068f40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20ec06cd90 tx=0x7f20e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.446+0000 7f20d3fff640 1 -- 172.21.15.53:0/736475070 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f20dc051770 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.606+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20ec0ccda0 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20d3fff640 1 -- 172.21.15.53:0/736475070 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f20dc017090 con 0x7f20ec0cc8f0 2024-09-13T18:31:41.611 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:41.612 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":108,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:38.918269+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f20d8066a80 msgr2=0x7f20d8068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f20d8066a80 0x7f20d8068f40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20ec06cd90 tx=0x7f20e0009040 comp rx=0 tx=0).stop 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 msgr2=0x7f20ec151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec151170 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00e870 tx=0x7f20dc00ec70 comp rx=0 tx=0).stop 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 shutdown_connections 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f20d8066a80 0x7f20d8068f40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20ec161170 0x7f20ec15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20ec15b300 0x7f20ec15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 --2- 172.21.15.53:0/736475070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20ec0cc8f0 0x7f20ec151170 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 >> 172.21.15.53:0/736475070 conn(0x7f20ec065c80 msgr2=0x7f20ec0af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:41.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 shutdown_connections 2024-09-13T18:31:41.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.610+0000 7f20f1ce1640 1 -- 172.21.15.53:0/736475070 wait complete. 2024-09-13T18:31:41.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:30:58.560050+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:30:59.064624+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:31:41.632 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:31:41.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f3305c43640 1 Processor -- start 2024-09-13T18:31:41.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f3305c43640 1 -- start start 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f3305c43640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 0x7f3300165010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f3305c43640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33000cd450 con 0x7f33000cac00 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f3305c43640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330006b330 con 0x7f3300154a40 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f3305c43640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3300154e20 con 0x7f33000ceaf0 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32feffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f33000cac00 0x7f33000ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49190/0 (socket says 172.21.15.53:49190) 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32feffd640 1 -- 172.21.15.53:0/2971449556 learned_addr learned my addr 172.21.15.53:0/2971449556 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fffff640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 0x7f3300165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212926841 0 0) 0x7f33000cd450 con 0x7f33000cac00 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e8003530 con 0x7f33000cac00 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2189246441 0 0) 0x7f32e8003530 con 0x7f33000cac00 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 msgr2=0x7f3300165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 0x7f3300165010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 >> v1:172.21.15.87:6789/0 conn(0x7f3300154a40 legacy=0x7f330006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330006b610 con 0x7f33000cac00 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f32f0001680 con 0x7f33000cac00 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 >> v1:172.21.15.53:6789/0 conn(0x7f33000cac00 legacy=0x7f33000ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f32e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 0x7f32e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32e8004d10 0x7f32e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300154e20 con 0x7f32e80039b0 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e800baa0 con 0x7f32e8004d10 2024-09-13T18:31:41.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e800bc60 con 0x7f33000ceaf0 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32ff7fe640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f32e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32feffd640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 0x7f32e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32fffff640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32e8004d10 0x7f32e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32ff7fe640 1 -- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 msgr2=0x7f32e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32ff7fe640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ceaf0 0x7f32e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32ff7fe640 1 -- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32e8004d10 msgr2=0x7f32e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32ff7fe640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32e8004d10 0x7f32e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.754+0000 7f32ff7fe640 1 -- 172.21.15.53:0/2971449556 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8003530 con 0x7f32e80039b0 2024-09-13T18:31:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f32ff7fe640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f32e8003dd0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001750 tx=0x7f32f401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e69fe0d67a6b607 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40052d0 con 0x7f32e80039b0 2024-09-13T18:31:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f40a7050 con 0x7f32e80039b0 2024-09-13T18:31:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f32fe7fc640 1 -- 172.21.15.53:0/2971449556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4003600 con 0x7f32e80039b0 2024-09-13T18:31:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- 172.21.15.53:0/2971449556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 msgr2=0x7f32e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 --2- 172.21.15.53:0/2971449556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f32e8003dd0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001750 tx=0x7f32f401c3b0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f32fffff640 1 -- 172.21.15.53:0/2971449556 reap_dead start 2024-09-13T18:31:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- 172.21.15.53:0/2971449556 shutdown_connections 2024-09-13T18:31:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- 172.21.15.53:0/2971449556 >> 172.21.15.53:0/2971449556 conn(0x7f3300065e50 msgr2=0x7f3300066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- 172.21.15.53:0/2971449556 shutdown_connections 2024-09-13T18:31:41.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- 172.21.15.53:0/2971449556 wait complete. 2024-09-13T18:31:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 Processor -- start 2024-09-13T18:31:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- start start 2024-09-13T18:31:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f33001532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3300152ce0 0x7f3300143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ade40 0x7f33000ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300144f20 con 0x7f32e80039b0 2024-09-13T18:31:41.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300144910 con 0x7f3300152ce0 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f3305c43640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3300071d60 con 0x7f33000ade40 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.758+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f33001532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f33001532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55670/0 (socket says 172.21.15.53:55670) 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 -- 172.21.15.53:0/1891616268 learned_addr learned my addr 172.21.15.53:0/1891616268 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32feffd640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3300152ce0 0x7f3300143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32fffff640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ade40 0x7f33000ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 -- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ade40 msgr2=0x7f33000ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ade40 0x7f33000ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 -- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3300152ce0 msgr2=0x7f3300143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3300152ce0 0x7f3300143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 -- 172.21.15.53:0/1891616268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300144bb0 con 0x7f32e80039b0 2024-09-13T18:31:41.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32feffd640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3300152ce0 0x7f3300143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32ff7fe640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f33001532a0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f32f4005040 tx=0x7f32e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32e7fff640 1 -- 172.21.15.53:0/1891616268 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4007180 con 0x7f32e80039b0 2024-09-13T18:31:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32e7fff640 1 -- 172.21.15.53:0/1891616268 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f40072e0 con 0x7f32e80039b0 2024-09-13T18:31:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3300072040 con 0x7f32e80039b0 2024-09-13T18:31:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32e7fff640 1 -- 172.21.15.53:0/1891616268 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4007670 con 0x7f32e80039b0 2024-09-13T18:31:41.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33001444a0 con 0x7f32e80039b0 2024-09-13T18:31:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3300144750 con 0x7f32e80039b0 2024-09-13T18:31:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32e7fff640 1 -- 172.21.15.53:0/1891616268 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f32f40067e0 con 0x7f32e80039b0 2024-09-13T18:31:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32e7fff640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f32ec066ab0 0x7f32ec068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32e7fff640 1 -- 172.21.15.53:0/1891616268 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f32f411ed80 con 0x7f32e80039b0 2024-09-13T18:31:41.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32feffd640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f32ec066ab0 0x7f32ec068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:41.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.762+0000 7f32feffd640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f32ec066ab0 0x7f32ec068f70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001bd0 tx=0x7f32f0000f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:41.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.766+0000 7f32e7fff640 1 -- 172.21.15.53:0/1891616268 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32f40ebb00 con 0x7f32e80039b0 2024-09-13T18:31:41.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.926+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3300144d40 con 0x7f32e80039b0 2024-09-13T18:31:41.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f32e7fff640 1 -- 172.21.15.53:0/1891616268 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32f40ef120 con 0x7f32e80039b0 2024-09-13T18:31:41.930 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:31:41.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f32ec066ab0 msgr2=0x7f32ec068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f32ec066ab0 0x7f32ec068f70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001bd0 tx=0x7f32f0000f40 comp rx=0 tx=0).stop 2024-09-13T18:31:41.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 msgr2=0x7f33001532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:41.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f33001532a0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f32f4005040 tx=0x7f32e8005800 comp rx=0 tx=0).stop 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 shutdown_connections 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f32ec066ab0 0x7f32ec068f70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33000ade40 0x7f33000ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3300152ce0 0x7f3300143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 --2- 172.21.15.53:0/1891616268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32e80039b0 0x7f33001532a0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 >> 172.21.15.53:0/1891616268 conn(0x7f3300065e50 msgr2=0x7f33000cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 shutdown_connections 2024-09-13T18:31:41.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:41.930+0000 7f3305c43640 1 -- 172.21.15.53:0/1891616268 wait complete. 2024-09-13T18:31:41.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:31:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.070+0000 7f7ce43a6640 1 Processor -- start 2024-09-13T18:31:42.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.070+0000 7f7ce43a6640 1 -- start start 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.070+0000 7f7ce43a6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7cdc0cda30 0x7f7cdc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.070+0000 7f7ce43a6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc06f7a0 con 0x7f7cdc143e80 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.070+0000 7f7ce43a6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc06fd60 con 0x7f7cdc0caee0 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.070+0000 7f7ce43a6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc06baa0 con 0x7f7cdc0cda30 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2142640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7cdc143e80 0x7f7cdc06b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49202/0 (socket says 172.21.15.53:49202) 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2142640 1 -- 172.21.15.53:0/1915786417 learned_addr learned my addr 172.21.15.53:0/1915786417 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 --2- 172.21.15.53:0/1915786417 >> v2:172.21.15.87:3300/0 conn(0x7f7cdc0cda30 0x7f7cdc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753141224 0 0) 0x7f7cdc06f7a0 con 0x7f7cdc143e80 2024-09-13T18:31:42.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc8003530 con 0x7f7cdc143e80 2024-09-13T18:31:42.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1807307025 0 0) 0x7f7cc8003530 con 0x7f7cdc143e80 2024-09-13T18:31:42.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 >> v2:172.21.15.87:3300/0 conn(0x7f7cdc0cda30 msgr2=0x7f7cdc0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 --2- 172.21.15.53:0/1915786417 >> v2:172.21.15.87:3300/0 conn(0x7f7cdc0cda30 0x7f7cdc0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 >> v1:172.21.15.87:6789/0 conn(0x7f7cdc0caee0 legacy=0x7f7cdc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0cb960 con 0x7f7cdc143e80 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7ccc001680 con 0x7f7cdc143e80 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 >> v1:172.21.15.53:6789/0 conn(0x7f7cdc143e80 legacy=0x7f7cdc06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cc8003980 0x7f7cc8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc80047d0 0x7f7cc8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cc800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc06baa0 con 0x7f7cc80052b0 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc800c180 con 0x7f7cc80047d0 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc800c340 con 0x7f7cc8003980 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cc800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2142640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cc8003980 0x7f7cc8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce1941640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc80047d0 0x7f7cc8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 -- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cc8003980 msgr2=0x7f7cc8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cc8003980 0x7f7cc8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 -- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc80047d0 msgr2=0x7f7cc8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc80047d0 0x7f7cc8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 -- 172.21.15.53:0/1915786417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc8003530 con 0x7f7cc80052b0 2024-09-13T18:31:42.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 -- 172.21.15.53:0/1915786417 reap_dead start 2024-09-13T18:31:42.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.074+0000 7f7ce2943640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cc800b990 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0cb890 tx=0x7f7cd401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d747dc560089202c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd40a5c20 con 0x7f7cc80052b0 2024-09-13T18:31:42.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd400f040 con 0x7f7cc80052b0 2024-09-13T18:31:42.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce1140640 1 -- 172.21.15.53:0/1915786417 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd40ad440 con 0x7f7cc80052b0 2024-09-13T18:31:42.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- 172.21.15.53:0/1915786417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 msgr2=0x7f7cc800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cc800b990 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0cb890 tx=0x7f7cd401cc30 comp rx=0 tx=0).stop 2024-09-13T18:31:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- 172.21.15.53:0/1915786417 shutdown_connections 2024-09-13T18:31:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/1915786417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cc800b990 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- 172.21.15.53:0/1915786417 >> 172.21.15.53:0/1915786417 conn(0x7f7cdc065c80 msgr2=0x7f7cdc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- 172.21.15.53:0/1915786417 shutdown_connections 2024-09-13T18:31:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- 172.21.15.53:0/1915786417 wait complete. 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 Processor -- start 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- start start 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cdc142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cdc13a7d0 0x7f7cdc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cdc13ac50 0x7f7cdc0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc1436b0 con 0x7f7cc80052b0 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc142e10 con 0x7f7cdc13ac50 2024-09-13T18:31:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc1430f0 con 0x7f7cdc13a7d0 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cdc142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cdc142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55692/0 (socket says 172.21.15.53:55692) 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 -- 172.21.15.53:0/779413383 learned_addr learned my addr 172.21.15.53:0/779413383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2943640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cdc13ac50 0x7f7cdc0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce1941640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cdc13a7d0 0x7f7cdc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 -- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cdc13a7d0 msgr2=0x7f7cdc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cdc13a7d0 0x7f7cdc0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 -- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cdc13ac50 msgr2=0x7f7cdc0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cdc13ac50 0x7f7cdc0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 -- 172.21.15.53:0/779413383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc1433d0 con 0x7f7cc80052b0 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce2142640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cdc142730 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00e7b0 tx=0x7f7ccc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7cd2ffd640 1 -- 172.21.15.53:0/779413383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00c6c0 con 0x7f7cc80052b0 2024-09-13T18:31:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7cd2ffd640 1 -- 172.21.15.53:0/779413383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00c820 con 0x7f7cc80052b0 2024-09-13T18:31:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc0b26f0 con 0x7f7cc80052b0 2024-09-13T18:31:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7cd2ffd640 1 -- 172.21.15.53:0/779413383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00cbd0 con 0x7f7cc80052b0 2024-09-13T18:31:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.078+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc0b2c10 con 0x7f7cc80052b0 2024-09-13T18:31:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.082+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc0b2910 con 0x7f7cc80052b0 2024-09-13T18:31:42.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.082+0000 7f7cd2ffd640 1 -- 172.21.15.53:0/779413383 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7ccc00cd30 con 0x7f7cc80052b0 2024-09-13T18:31:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.082+0000 7f7cd2ffd640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cc0066a80 0x7f7cc0068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.082+0000 7f7ce1941640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cc0066a80 0x7f7cc0068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.082+0000 7f7cd2ffd640 1 -- 172.21.15.53:0/779413383 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7ccc0846b0 con 0x7f7cc80052b0 2024-09-13T18:31:42.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.082+0000 7f7ce1941640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cc0066a80 0x7f7cc0068f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8000c10 tx=0x7f7cd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.086+0000 7f7cd2ffd640 1 -- 172.21.15.53:0/779413383 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ccc051440 con 0x7f7cc80052b0 2024-09-13T18:31:42.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cdc070e30 con 0x7f7cc80052b0 2024-09-13T18:31:42.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7cd2ffd640 1 -- 172.21.15.53:0/779413383 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ccc054a60 con 0x7f7cc80052b0 2024-09-13T18:31:42.247 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cc0066a80 msgr2=0x7f7cc0068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cc0066a80 0x7f7cc0068f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8000c10 tx=0x7f7cd8009040 comp rx=0 tx=0).stop 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 msgr2=0x7f7cdc142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cdc142730 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00e7b0 tx=0x7f7ccc00ec70 comp rx=0 tx=0).stop 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 shutdown_connections 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cc0066a80 0x7f7cc0068f40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cdc13a7d0 0x7f7cdc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cdc13ac50 0x7f7cdc0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 --2- 172.21.15.53:0/779413383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc80052b0 0x7f7cdc142730 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 >> 172.21.15.53:0/779413383 conn(0x7f7cdc065c80 msgr2=0x7f7cdc0ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 shutdown_connections 2024-09-13T18:31:42.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.246+0000 7f7ce43a6640 1 -- 172.21.15.53:0/779413383 wait complete. 2024-09-13T18:31:42.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:31:42.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3ef17ad640 1 Processor -- start 2024-09-13T18:31:42.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3ef17ad640 1 -- start start 2024-09-13T18:31:42.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3ef17ad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3eec15c830 0x7f3eec0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3ef17ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3eec0d3390 0x7f3eec0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3ef17ad640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0b7db0 con 0x7f3eec0ccd10 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3ef17ad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0d0650 con 0x7f3eec0d3390 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3ef17ad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0d0c10 con 0x7f3eec15c830 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3eec0d3390 0x7f3eec0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3eec0d3390 0x7f3eec0cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55706/0 (socket says 172.21.15.53:55706) 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeb7fe640 1 -- 172.21.15.53:0/2123049259 learned_addr learned my addr 172.21.15.53:0/2123049259 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeaffd640 1 --2- 172.21.15.53:0/2123049259 >> v2:172.21.15.87:3300/0 conn(0x7f3eec15c830 0x7f3eec0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeb7fe640 1 -- 172.21.15.53:0/2123049259 >> v2:172.21.15.87:3300/0 conn(0x7f3eec15c830 msgr2=0x7f3eec0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeb7fe640 1 --2- 172.21.15.53:0/2123049259 >> v2:172.21.15.87:3300/0 conn(0x7f3eec15c830 0x7f3eec0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeb7fe640 1 -- 172.21.15.53:0/2123049259 >> v1:172.21.15.87:6789/0 conn(0x7f3eec0ccd10 legacy=0x7f3eec0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.390+0000 7f3eeb7fe640 1 -- 172.21.15.53:0/2123049259 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0cd7d0 con 0x7f3eec0d3390 2024-09-13T18:31:42.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eeb7fe640 1 --2- 172.21.15.53:0/2123049259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0cd180 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0d0240 tx=0x7f3ee401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3067e8f7aa40b2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ee9ffb640 1 -- 172.21.15.53:0/2123049259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee40ac630 con 0x7f3eec0d3390 2024-09-13T18:31:42.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ee9ffb640 1 -- 172.21.15.53:0/2123049259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee40ac790 con 0x7f3eec0d3390 2024-09-13T18:31:42.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ee9ffb640 1 -- 172.21.15.53:0/2123049259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee40acb20 con 0x7f3eec0d3390 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2123049259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 msgr2=0x7f3eec0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2123049259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0cd180 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0d0240 tx=0x7f3ee401c4e0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2123049259 shutdown_connections 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2123049259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0cd180 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2123049259 >> v2:172.21.15.87:3300/0 conn(0x7f3eec15c830 0x7f3eec0d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2123049259 >> 172.21.15.53:0/2123049259 conn(0x7f3eec070970 msgr2=0x7f3eec070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2123049259 shutdown_connections 2024-09-13T18:31:42.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2123049259 wait complete. 2024-09-13T18:31:42.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 Processor -- start 2024-09-13T18:31:42.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- start start 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec0ccd10 0x7f3eec15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec15c830 0x7f3eec0b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0ca0a0 con 0x7f3eec0d3390 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec15f3a0 con 0x7f3eec15c830 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3ef17ad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c95f0 con 0x7f3eec0ccd10 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55710/0 (socket says 172.21.15.53:55710) 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 -- 172.21.15.53:0/2251726186 learned_addr learned my addr 172.21.15.53:0/2251726186 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eeb7fe640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec15c830 0x7f3eec0b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eeaffd640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec0ccd10 0x7f3eec15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 -- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec0ccd10 msgr2=0x7f3eec15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec0ccd10 0x7f3eec15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 -- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec15c830 msgr2=0x7f3eec0b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec15c830 0x7f3eec0b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eea7fc640 1 -- 172.21.15.53:0/2251726186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40094d0 con 0x7f3eec0d3390 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.394+0000 7f3eeb7fe640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec15c830 0x7f3eec0b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3eea7fc640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0b62a0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400c480 tx=0x7f3ed400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ee37fe640 1 -- 172.21.15.53:0/2251726186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4012830 con 0x7f3eec0d3390 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ee37fe640 1 -- 172.21.15.53:0/2251726186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed40129b0 con 0x7f3eec0d3390 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec0c9790 con 0x7f3eec0d3390 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ee37fe640 1 -- 172.21.15.53:0/2251726186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4012d60 con 0x7f3eec0d3390 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec0c99e0 con 0x7f3eec0d3390 2024-09-13T18:31:42.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec0ca1e0 con 0x7f3eec0d3390 2024-09-13T18:31:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ee37fe640 1 -- 172.21.15.53:0/2251726186 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f3ed401c460 con 0x7f3eec0d3390 2024-09-13T18:31:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ee37fe640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ecc066a80 0x7f3ecc068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3ee37fe640 1 -- 172.21.15.53:0/2251726186 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f3ed4084730 con 0x7f3eec0d3390 2024-09-13T18:31:42.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3eeaffd640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ecc066a80 0x7f3ecc068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.398+0000 7f3eeaffd640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ecc066a80 0x7f3ecc068f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3edc003fd0 tx=0x7f3edc0039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.402+0000 7f3ee37fe640 1 -- 172.21.15.53:0/2251726186 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3eec0ca1e0 con 0x7f3eec0d3390 2024-09-13T18:31:42.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3eec0ca1e0 con 0x7f3eec0d3390 2024-09-13T18:31:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ee37fe640 1 -- 172.21.15.53:0/2251726186 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3eec0ca1e0 con 0x7f3eec0d3390 2024-09-13T18:31:42.563 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:31:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ecc066a80 msgr2=0x7f3ecc068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ecc066a80 0x7f3ecc068f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3edc003fd0 tx=0x7f3edc0039a0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 msgr2=0x7f3eec0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0b62a0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400c480 tx=0x7f3ed400c940 comp rx=0 tx=0).stop 2024-09-13T18:31:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 shutdown_connections 2024-09-13T18:31:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ecc066a80 0x7f3ecc068f40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3eec15c830 0x7f3eec0b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3eec0d3390 0x7f3eec0b62a0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 --2- 172.21.15.53:0/2251726186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3eec0ccd10 0x7f3eec15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 >> 172.21.15.53:0/2251726186 conn(0x7f3eec070970 msgr2=0x7f3eec0d2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 shutdown_connections 2024-09-13T18:31:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.562+0000 7f3ef17ad640 1 -- 172.21.15.53:0/2251726186 wait complete. 2024-09-13T18:31:42.585 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:42.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.702+0000 7efc2f8ef640 1 Processor -- start 2024-09-13T18:31:42.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.702+0000 7efc2f8ef640 1 -- start start 2024-09-13T18:31:42.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2f8ef640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815a630 0x7efc2815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2f8ef640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc2815b990 0x7efc280cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2f8ef640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc28069f50 0x7efc2806a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2f8ef640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2806a940 con 0x7efc28069f50 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2f8ef640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc280cd7b0 con 0x7efc2815b990 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2f8ef640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc280cda90 con 0x7efc2815a630 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc28069f50 0x7efc2806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efc28069f50 0x7efc2806a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55718/0 (socket says 172.21.15.53:55718) 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 -- 172.21.15.53:0/2059534866 learned_addr learned my addr 172.21.15.53:0/2059534866 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2d68b640 1 --2- 172.21.15.53:0/2059534866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815a630 0x7efc2815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2ce8a640 1 --2- 172.21.15.53:0/2059534866 >> v2:172.21.15.87:3300/0 conn(0x7efc2815b990 0x7efc280cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 -- 172.21.15.53:0/2059534866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815a630 msgr2=0x7efc2815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 --2- 172.21.15.53:0/2059534866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815a630 0x7efc2815eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 -- 172.21.15.53:0/2059534866 >> v2:172.21.15.87:3300/0 conn(0x7efc2815b990 msgr2=0x7efc280cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 --2- 172.21.15.53:0/2059534866 >> v2:172.21.15.87:3300/0 conn(0x7efc2815b990 0x7efc280cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 -- 172.21.15.53:0/2059534866 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2815e2c0 con 0x7efc28069f50 2024-09-13T18:31:42.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2ce8a640 1 --2- 172.21.15.53:0/2059534866 >> v2:172.21.15.87:3300/0 conn(0x7efc2815b990 0x7efc280cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:42.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2d68b640 1 --2- 172.21.15.53:0/2059534866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815a630 0x7efc2815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:42.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc2de8c640 1 --2- 172.21.15.53:0/2059534866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc28069f50 0x7efc2806a400 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7efc280cc920 tx=0x7efc2001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf671f0a98b46bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc1ffff640 1 -- 172.21.15.53:0/2059534866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200a57b0 con 0x7efc28069f50 2024-09-13T18:31:42.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc1ffff640 1 -- 172.21.15.53:0/2059534866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc200a5910 con 0x7efc28069f50 2024-09-13T18:31:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.706+0000 7efc1ffff640 1 -- 172.21.15.53:0/2059534866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200a5ca0 con 0x7efc28069f50 2024-09-13T18:31:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- 172.21.15.53:0/2059534866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc28069f50 msgr2=0x7efc2806a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/2059534866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc28069f50 0x7efc2806a400 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7efc280cc920 tx=0x7efc2001c930 comp rx=0 tx=0).stop 2024-09-13T18:31:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- 172.21.15.53:0/2059534866 shutdown_connections 2024-09-13T18:31:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/2059534866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc28069f50 0x7efc2806a400 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/2059534866 >> v2:172.21.15.87:3300/0 conn(0x7efc2815b990 0x7efc280cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/2059534866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815a630 0x7efc2815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- 172.21.15.53:0/2059534866 >> 172.21.15.53:0/2059534866 conn(0x7efc280b0a30 msgr2=0x7efc280b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- 172.21.15.53:0/2059534866 shutdown_connections 2024-09-13T18:31:42.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- 172.21.15.53:0/2059534866 wait complete. 2024-09-13T18:31:42.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 Processor -- start 2024-09-13T18:31:42.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- start start 2024-09-13T18:31:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc28069f50 0x7efc2814e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2815a630 0x7efc28158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815b990 0x7efc28158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc28155a70 con 0x7efc2815a630 2024-09-13T18:31:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc28155d50 con 0x7efc28069f50 2024-09-13T18:31:42.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc28156030 con 0x7efc2815b990 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2815a630 0x7efc28158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2815a630 0x7efc28158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55730/0 (socket says 172.21.15.53:55730) 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 -- 172.21.15.53:0/3091906945 learned_addr learned my addr 172.21.15.53:0/3091906945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2d68b640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc28069f50 0x7efc2814e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2de8c640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815b990 0x7efc28158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 -- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815b990 msgr2=0x7efc28158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815b990 0x7efc28158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 -- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc28069f50 msgr2=0x7efc2814e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc28069f50 0x7efc2814e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 -- 172.21.15.53:0/3091906945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20009b30 con 0x7efc2815a630 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2de8c640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815b990 0x7efc28158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2ce8a640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2815a630 0x7efc28158700 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d5c0 tx=0x7efc1800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc1dffb640 1 -- 172.21.15.53:0/3091906945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc180059a0 con 0x7efc2815a630 2024-09-13T18:31:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc1dffb640 1 -- 172.21.15.53:0/3091906945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc18005b00 con 0x7efc2815a630 2024-09-13T18:31:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc1dffb640 1 -- 172.21.15.53:0/3091906945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18006030 con 0x7efc2815a630 2024-09-13T18:31:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc28156310 con 0x7efc2815a630 2024-09-13T18:31:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.710+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc28158100 con 0x7efc2815a630 2024-09-13T18:31:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.714+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2806d5e0 con 0x7efc2815a630 2024-09-13T18:31:42.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.714+0000 7efc1dffb640 1 -- 172.21.15.53:0/3091906945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7efc18006190 con 0x7efc2815a630 2024-09-13T18:31:42.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.714+0000 7efc1dffb640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efc0c066a80 0x7efc0c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:42.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.714+0000 7efc1dffb640 1 -- 172.21.15.53:0/3091906945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7efc18084f90 con 0x7efc2815a630 2024-09-13T18:31:42.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.714+0000 7efc2d68b640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efc0c066a80 0x7efc0c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:42.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.714+0000 7efc2d68b640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efc0c066a80 0x7efc0c068f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc281586b0 tx=0x7efc24008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.718+0000 7efc1dffb640 1 -- 172.21.15.53:0/3091906945 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc18051cc0 con 0x7efc2815a630 2024-09-13T18:31:42.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.906+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc28155bb0 con 0x7efc2815a630 2024-09-13T18:31:42.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.906+0000 7efc1dffb640 1 -- 172.21.15.53:0/3091906945 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4733 (secure 0 0 0) 0x7efc28155bb0 con 0x7efc2815a630 2024-09-13T18:31:42.910 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:42.910 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/1892947074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1892947074},{"type":"v1","addr":"172.21.15.87:6834","nonce":1892947074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3784505733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3784505733},{"type":"v1","addr":"172.21.15.87:6835","nonce":3784505733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/945674829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":945674829},{"type":"v1","addr":"172.21.15.53:6833","nonce":945674829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:00.085788+0000","modified":"2024-09-13T18:31:03.099836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2605273551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2605273551},{"type":"v1","addr":"172.21.15.53:6835","nonce":2605273551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:31:42.910 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2024-09-13T18:31:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efc0c066a80 msgr2=0x7efc0c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efc0c066a80 0x7efc0c068f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc281586b0 tx=0x7efc24008040 comp rx=0 tx=0).stop 2024-09-13T18:31:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2815a630 msgr2=0x7efc28158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2815a630 0x7efc28158700 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d5c0 tx=0x7efc1800da80 comp rx=0 tx=0).stop 2024-09-13T18:31:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 shutdown_connections 2024-09-13T18:31:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efc0c066a80 0x7efc0c068f40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc2815b990 0x7efc28158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc2815a630 0x7efc28158700 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 --2- 172.21.15.53:0/3091906945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efc28069f50 0x7efc2814e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 >> 172.21.15.53:0/3091906945 conn(0x7efc280b0a30 msgr2=0x7efc280ac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 shutdown_connections 2024-09-13T18:31:42.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:42.910+0000 7efc2f8ef640 1 -- 172.21.15.53:0/3091906945 wait complete. 2024-09-13T18:31:42.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.050+0000 7f7e0e7ca640 1 Processor -- start 2024-09-13T18:31:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.050+0000 7f7e0e7ca640 1 -- start start 2024-09-13T18:31:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.050+0000 7f7e0e7ca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e081582a0 0x7f7e0806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e0815b7c0 0x7f7e0806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e08070c90 0x7f7e08071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0815aaf0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0806d760 con 0x7f7e081582a0 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08071650 con 0x7f7e08070c90 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e0815b7c0 0x7f7e0806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e0815b7c0 0x7f7e0806ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55742/0 (socket says 172.21.15.53:55742) 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 -- 172.21.15.53:0/2120094872 learned_addr learned my addr 172.21.15.53:0/2120094872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0cd67640 1 --2- 172.21.15.53:0/2120094872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e08070c90 0x7f7e08071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e07fff640 1 --2- 172.21.15.53:0/2120094872 >> v2:172.21.15.87:3300/0 conn(0x7f7e081582a0 0x7f7e0806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 -- 172.21.15.53:0/2120094872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e08070c90 msgr2=0x7f7e08071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 --2- 172.21.15.53:0/2120094872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e08070c90 0x7f7e08071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 -- 172.21.15.53:0/2120094872 >> v2:172.21.15.87:3300/0 conn(0x7f7e081582a0 msgr2=0x7f7e0806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 --2- 172.21.15.53:0/2120094872 >> v2:172.21.15.87:3300/0 conn(0x7f7e081582a0 0x7f7e0806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 -- 172.21.15.53:0/2120094872 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0806d480 con 0x7f7e0815b7c0 2024-09-13T18:31:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e077fe640 1 --2- 172.21.15.53:0/2120094872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e0806ce40 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f7e08069f50 tx=0x7f7dfc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25d36d08201f20a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e06ffd640 1 -- 172.21.15.53:0/2120094872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0aa610 con 0x7f7e0815b7c0 2024-09-13T18:31:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e06ffd640 1 -- 172.21.15.53:0/2120094872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc0a6040 con 0x7f7e0815b7c0 2024-09-13T18:31:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e06ffd640 1 -- 172.21.15.53:0/2120094872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0aa990 con 0x7f7e0815b7c0 2024-09-13T18:31:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/2120094872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 msgr2=0x7f7e0806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/2120094872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e0806ce40 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f7e08069f50 tx=0x7f7dfc01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/2120094872 shutdown_connections 2024-09-13T18:31:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/2120094872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e08070c90 0x7f7e08071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/2120094872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e0806ce40 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/2120094872 >> v2:172.21.15.87:3300/0 conn(0x7f7e081582a0 0x7f7e0806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/2120094872 >> 172.21.15.53:0/2120094872 conn(0x7f7e08065c80 msgr2=0x7f7e08066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/2120094872 shutdown_connections 2024-09-13T18:31:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.054+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/2120094872 wait complete. 2024-09-13T18:31:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 Processor -- start 2024-09-13T18:31:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 -- start start 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e08070c90 0x7f7e0813fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e081582a0 0x7f7e081593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e08159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08151a70 con 0x7f7e0815b7c0 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081534b0 con 0x7f7e08070c90 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08150df0 con 0x7f7e081582a0 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e08159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e08159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55744/0 (socket says 172.21.15.53:55744) 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 -- 172.21.15.53:0/877987542 learned_addr learned my addr 172.21.15.53:0/877987542 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e077fe640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e081582a0 0x7f7e081593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e07fff640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e08070c90 0x7f7e0813fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 -- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e081582a0 msgr2=0x7f7e081593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e081582a0 0x7f7e081593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 -- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e08070c90 msgr2=0x7f7e0813fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e08070c90 0x7f7e0813fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 -- 172.21.15.53:0/877987542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc0094d0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e077fe640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e081582a0 0x7f7e081593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0cd67640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e08159900 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000d830 tx=0x7f7e0000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e04ff9640 1 -- 172.21.15.53:0/877987542 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000096c0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e04ff9640 1 -- 172.21.15.53:0/877987542 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00009820 con 0x7f7e0815b7c0 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e081510d0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e04ff9640 1 -- 172.21.15.53:0/877987542 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00009bd0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e08151690 con 0x7f7e0815b7c0 2024-09-13T18:31:43.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.058+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e08067400 con 0x7f7e0815b7c0 2024-09-13T18:31:43.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.062+0000 7f7e04ff9640 1 -- 172.21.15.53:0/877987542 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7e00014410 con 0x7f7e0815b7c0 2024-09-13T18:31:43.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.062+0000 7f7e04ff9640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df4066a80 0x7f7df4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.062+0000 7f7e04ff9640 1 -- 172.21.15.53:0/877987542 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7e000851d0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.062+0000 7f7e07fff640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df4066a80 0x7f7df4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.062+0000 7f7e07fff640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df4066a80 0x7f7df4068f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7df8003fd0 tx=0x7f7df80039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.066+0000 7f7e04ff9640 1 -- 172.21.15.53:0/877987542 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e00051fd0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.226+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e08151bb0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e04ff9640 1 -- 172.21.15.53:0/877987542 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f7e08151bb0 con 0x7f7e0815b7c0 2024-09-13T18:31:43.231 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:43.231 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":108,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:38.918269+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df4066a80 msgr2=0x7f7df4068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df4066a80 0x7f7df4068f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7df8003fd0 tx=0x7f7df80039a0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 msgr2=0x7f7e08159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e08159900 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000d830 tx=0x7f7e0000dcf0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 shutdown_connections 2024-09-13T18:31:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7df4066a80 0x7f7df4068f40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e081582a0 0x7f7e081593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e0815b7c0 0x7f7e08159900 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 --2- 172.21.15.53:0/877987542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e08070c90 0x7f7e0813fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 >> 172.21.15.53:0/877987542 conn(0x7f7e08065c80 msgr2=0x7f7e080adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 shutdown_connections 2024-09-13T18:31:43.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.230+0000 7f7e0e7ca640 1 -- 172.21.15.53:0/877987542 wait complete. 2024-09-13T18:31:43.251 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:31:43.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:43.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741ff6a640 1 Processor -- start 2024-09-13T18:31:43.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741ff6a640 1 -- start start 2024-09-13T18:31:43.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741ff6a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f7418070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741ff6a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74180711d0 0x7f74181640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741ff6a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741806d480 con 0x7f74181582a0 2024-09-13T18:31:43.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741ff6a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741815aaf0 con 0x7f74180711d0 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741ff6a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741806d760 con 0x7f741815b7c0 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741e507640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74180711d0 0x7f74181640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741e507640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74180711d0 0x7f74181640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55748/0 (socket says 172.21.15.53:55748) 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741e507640 1 -- 172.21.15.53:0/856848296 learned_addr learned my addr 172.21.15.53:0/856848296 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741d505640 1 --2- 172.21.15.53:0/856848296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f7418070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741e507640 1 -- 172.21.15.53:0/856848296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 msgr2=0x7f7418070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741e507640 1 --2- 172.21.15.53:0/856848296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f7418070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741e507640 1 -- 172.21.15.53:0/856848296 >> v1:172.21.15.87:6789/0 conn(0x7f74181582a0 legacy=0x7f741806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.370+0000 7f741e507640 1 -- 172.21.15.53:0/856848296 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741815ace0 con 0x7f74180711d0 2024-09-13T18:31:43.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741e507640 1 --2- 172.21.15.53:0/856848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f74181640f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8cb3e8b6bcfcbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741cd04640 1 -- 172.21.15.53:0/856848296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100ab650 con 0x7f74180711d0 2024-09-13T18:31:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741cd04640 1 -- 172.21.15.53:0/856848296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74100ab7b0 con 0x7f74180711d0 2024-09-13T18:31:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741cd04640 1 -- 172.21.15.53:0/856848296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100abb40 con 0x7f74180711d0 2024-09-13T18:31:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- 172.21.15.53:0/856848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 msgr2=0x7f74181640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 --2- 172.21.15.53:0/856848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f74181640f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741001c560 comp rx=0 tx=0).stop 2024-09-13T18:31:43.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- 172.21.15.53:0/856848296 shutdown_connections 2024-09-13T18:31:43.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 --2- 172.21.15.53:0/856848296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f74181640f0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 --2- 172.21.15.53:0/856848296 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f7418070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- 172.21.15.53:0/856848296 >> 172.21.15.53:0/856848296 conn(0x7f7418065c80 msgr2=0x7f7418066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- 172.21.15.53:0/856848296 shutdown_connections 2024-09-13T18:31:43.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- 172.21.15.53:0/856848296 wait complete. 2024-09-13T18:31:43.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 Processor -- start 2024-09-13T18:31:43.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- start start 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f7418146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74181582a0 0x7f74181465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f741814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7418146140 con 0x7f74180711d0 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741815a620 con 0x7f74181582a0 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741ff6a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7418145810 con 0x7f741815b7c0 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741dd06640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f7418146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741dd06640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f7418146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55750/0 (socket says 172.21.15.53:55750) 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.374+0000 7f741dd06640 1 -- 172.21.15.53:0/2036836739 learned_addr learned my addr 172.21.15.53:0/2036836739 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741d505640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74181582a0 0x7f74181465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741e507640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f741814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741dd06640 1 -- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 msgr2=0x7f741814b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741dd06640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f741814b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741dd06640 1 -- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74181582a0 msgr2=0x7f74181465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741dd06640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74181582a0 0x7f74181465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741dd06640 1 -- 172.21.15.53:0/2036836739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100094d0 con 0x7f74180711d0 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741dd06640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f7418146bb0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f740800c820 tx=0x7f740800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f74167fc640 1 -- 172.21.15.53:0/2036836739 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408003b80 con 0x7f74180711d0 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f74167fc640 1 -- 172.21.15.53:0/2036836739 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408003ce0 con 0x7f74180711d0 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7418145af0 con 0x7f74180711d0 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f74167fc640 1 -- 172.21.15.53:0/2036836739 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800aa90 con 0x7f74180711d0 2024-09-13T18:31:43.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7418144e40 con 0x7f74180711d0 2024-09-13T18:31:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418067400 con 0x7f74180711d0 2024-09-13T18:31:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f74167fc640 1 -- 172.21.15.53:0/2036836739 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f740800abf0 con 0x7f74180711d0 2024-09-13T18:31:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f74167fc640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7404066ab0 0x7f7404068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f74167fc640 1 -- 172.21.15.53:0/2036836739 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f74080848c0 con 0x7f74180711d0 2024-09-13T18:31:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741d505640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7404066ab0 0x7f7404068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.378+0000 7f741d505640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7404066ab0 0x7f7404068f70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7418157660 tx=0x7f740c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.382+0000 7f74167fc640 1 -- 172.21.15.53:0/2036836739 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7408051630 con 0x7f74180711d0 2024-09-13T18:31:43.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74180679b0 con 0x7f74180711d0 2024-09-13T18:31:43.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f74167fc640 1 -- 172.21.15.53:0/2036836739 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f7408054c50 con 0x7f74180711d0 2024-09-13T18:31:43.579 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:43.579 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/1892947074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1892947074},{"type":"v1","addr":"172.21.15.87:6834","nonce":1892947074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3784505733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3784505733},{"type":"v1","addr":"172.21.15.87:6835","nonce":3784505733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/945674829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":945674829},{"type":"v1","addr":"172.21.15.53:6833","nonce":945674829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:00.085788+0000","modified":"2024-09-13T18:31:03.099836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2605273551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2605273551},{"type":"v1","addr":"172.21.15.53:6835","nonce":2605273551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:31:43.580 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2024-09-13T18:31:43.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7404066ab0 msgr2=0x7f7404068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7404066ab0 0x7f7404068f70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7418157660 tx=0x7f740c008040 comp rx=0 tx=0).stop 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 msgr2=0x7f7418146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f7418146bb0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f740800c820 tx=0x7f740800cce0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 shutdown_connections 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7404066ab0 0x7f7404068f70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f741815b7c0 0x7f741814b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74181582a0 0x7f74181465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 --2- 172.21.15.53:0/2036836739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74180711d0 0x7f7418146bb0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 >> 172.21.15.53:0/2036836739 conn(0x7f7418065c80 msgr2=0x7f74180aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 shutdown_connections 2024-09-13T18:31:43.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.578+0000 7f741ff6a640 1 -- 172.21.15.53:0/2036836739 wait complete. 2024-09-13T18:31:43.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:43.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774ec08640 1 Processor -- start 2024-09-13T18:31:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774ec08640 1 -- start start 2024-09-13T18:31:43.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774ec08640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f774806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774ec08640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77480cbb60 0x7f77480b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774ec08640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77480b2340 con 0x7f774806f370 2024-09-13T18:31:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774ec08640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77480b2860 con 0x7f77480cbb60 2024-09-13T18:31:43.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774ec08640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7748158f80 con 0x7f7748158ba0 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774c9a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f774806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f7747fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77480cbb60 0x7f77480b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774c9a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f774806b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:34338/0 (socket says 172.21.15.53:34338) 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774c9a4640 1 -- 172.21.15.53:0/2774831621 learned_addr learned my addr 172.21.15.53:0/2774831621 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774c9a4640 1 -- 172.21.15.53:0/2774831621 >> v2:172.21.15.87:3300/0 conn(0x7f77480cbb60 msgr2=0x7f77480b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774c9a4640 1 --2- 172.21.15.53:0/2774831621 >> v2:172.21.15.87:3300/0 conn(0x7f77480cbb60 0x7f77480b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774c9a4640 1 -- 172.21.15.53:0/2774831621 >> v1:172.21.15.87:6789/0 conn(0x7f774806f370 legacy=0x7f77480cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.718+0000 7f774c9a4640 1 -- 172.21.15.53:0/2774831621 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77480b2580 con 0x7f7748158ba0 2024-09-13T18:31:43.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774c9a4640 1 --2- 172.21.15.53:0/2774831621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f774806b390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f773c009870 tx=0x7f773c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97f5ec1ac51237c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f77477fe640 1 -- 172.21.15.53:0/2774831621 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0ac620 con 0x7f7748158ba0 2024-09-13T18:31:43.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f77477fe640 1 -- 172.21.15.53:0/2774831621 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c0ac780 con 0x7f7748158ba0 2024-09-13T18:31:43.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f77477fe640 1 -- 172.21.15.53:0/2774831621 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0acb10 con 0x7f7748158ba0 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 -- 172.21.15.53:0/2774831621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 msgr2=0x7f774806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 --2- 172.21.15.53:0/2774831621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f774806b390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f773c009870 tx=0x7f773c01c4d0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 -- 172.21.15.53:0/2774831621 shutdown_connections 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 --2- 172.21.15.53:0/2774831621 >> v2:172.21.15.87:3300/0 conn(0x7f77480cbb60 0x7f77480b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 --2- 172.21.15.53:0/2774831621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f774806b390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 -- 172.21.15.53:0/2774831621 >> 172.21.15.53:0/2774831621 conn(0x7f7748065c80 msgr2=0x7f7748066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 -- 172.21.15.53:0/2774831621 shutdown_connections 2024-09-13T18:31:43.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.722+0000 7f774ec08640 1 -- 172.21.15.53:0/2774831621 wait complete. 2024-09-13T18:31:43.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 Processor -- start 2024-09-13T18:31:43.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 -- start start 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f774806f370 0x7f774815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77480cbb60 0x7f7748166d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f7748159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748161e90 con 0x7f77480cbb60 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748162170 con 0x7f774806f370 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7748166240 con 0x7f7748158ba0 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77480cbb60 0x7f7748166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77480cbb60 0x7f7748166d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55764/0 (socket says 172.21.15.53:55764) 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 -- 172.21.15.53:0/1478738981 learned_addr learned my addr 172.21.15.53:0/1478738981 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774c9a4640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f774806f370 0x7f774815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774d1a5640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f7748159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 -- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 msgr2=0x7f7748159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f7748159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 -- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f774806f370 msgr2=0x7f774815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f774806f370 0x7f774815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 -- 172.21.15.53:0/1478738981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0094d0 con 0x7f77480cbb60 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f7747fff640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77480cbb60 0x7f7748166d00 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f773400e900 tx=0x7f773400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f77457fa640 1 -- 172.21.15.53:0/1478738981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734009690 con 0x7f77480cbb60 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f77457fa640 1 -- 172.21.15.53:0/1478738981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400ca00 con 0x7f77480cbb60 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7748166520 con 0x7f77480cbb60 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f77457fa640 1 -- 172.21.15.53:0/1478738981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400cd90 con 0x7f77480cbb60 2024-09-13T18:31:43.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7748159f70 con 0x7f77480cbb60 2024-09-13T18:31:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.726+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7748067400 con 0x7f77480cbb60 2024-09-13T18:31:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.730+0000 7f77457fa640 1 -- 172.21.15.53:0/1478738981 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7734013470 con 0x7f77480cbb60 2024-09-13T18:31:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.730+0000 7f77457fa640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f772c066a80 0x7f772c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.730+0000 7f77457fa640 1 -- 172.21.15.53:0/1478738981 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7734084b40 con 0x7f77480cbb60 2024-09-13T18:31:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.730+0000 7f774c9a4640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f772c066a80 0x7f772c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:43.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.730+0000 7f774c9a4640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f772c066a80 0x7f772c068f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f773c0ae000 tx=0x7f773c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:43.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.734+0000 7f77457fa640 1 -- 172.21.15.53:0/1478738981 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f77340518b0 con 0x7f77480cbb60 2024-09-13T18:31:43.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.922+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77480b1e00 con 0x7f77480cbb60 2024-09-13T18:31:43.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.922+0000 7f77457fa640 1 -- 172.21.15.53:0/1478738981 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4733 (secure 0 0 0) 0x7f7734017090 con 0x7f77480cbb60 2024-09-13T18:31:43.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:43.926 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/1892947074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1892947074},{"type":"v1","addr":"172.21.15.87:6834","nonce":1892947074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3784505733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3784505733},{"type":"v1","addr":"172.21.15.87:6835","nonce":3784505733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/945674829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":945674829},{"type":"v1","addr":"172.21.15.53:6833","nonce":945674829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:00.085788+0000","modified":"2024-09-13T18:31:03.099836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7920":{"gid":7920,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2605273551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2605273551},{"type":"v1","addr":"172.21.15.53:6835","nonce":2605273551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:31:43.927 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2024-09-13T18:31:43.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f772c066a80 msgr2=0x7f772c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f772c066a80 0x7f772c068f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f773c0ae000 tx=0x7f773c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:31:43.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77480cbb60 msgr2=0x7f7748166d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77480cbb60 0x7f7748166d00 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f773400e900 tx=0x7f773400edc0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 shutdown_connections 2024-09-13T18:31:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f772c066a80 0x7f772c068f40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7748158ba0 0x7f7748159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77480cbb60 0x7f7748166d00 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 --2- 172.21.15.53:0/1478738981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f774806f370 0x7f774815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 >> 172.21.15.53:0/1478738981 conn(0x7f7748065c80 msgr2=0x7f7748067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 shutdown_connections 2024-09-13T18:31:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:43.926+0000 7f774ec08640 1 -- 172.21.15.53:0/1478738981 wait complete. 2024-09-13T18:31:43.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:44.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54c18e4640 1 Processor -- start 2024-09-13T18:31:44.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54c18e4640 1 -- start start 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54c18e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc06b850 0x7f54bc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54c18e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54bc0cbd60 0x7f54bc0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54c18e4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0b1ac0 con 0x7f54bc0cb980 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54c18e4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0b3010 con 0x7f54bc0cbd60 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54c18e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc159ac0 con 0x7f54bc06b850 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54bb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54bc0cbd60 0x7f54bc0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54bb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f54bc0cbd60 0x7f54bc0cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55766/0 (socket says 172.21.15.53:55766) 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54bb7fe640 1 -- 172.21.15.53:0/1980580544 learned_addr learned my addr 172.21.15.53:0/1980580544 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:44.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.058+0000 7f54ba7fc640 1 --2- 172.21.15.53:0/1980580544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc06b850 0x7f54bc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54bb7fe640 1 -- 172.21.15.53:0/1980580544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc06b850 msgr2=0x7f54bc0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54bb7fe640 1 --2- 172.21.15.53:0/1980580544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc06b850 0x7f54bc0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54bb7fe640 1 -- 172.21.15.53:0/1980580544 >> v1:172.21.15.87:6789/0 conn(0x7f54bc0cb980 legacy=0x7f54bc06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54bb7fe640 1 -- 172.21.15.53:0/1980580544 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc159da0 con 0x7f54bc0cbd60 2024-09-13T18:31:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54ba7fc640 1 --2- 172.21.15.53:0/1980580544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc06b850 0x7f54bc0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54bb7fe640 1 --2- 172.21.15.53:0/1980580544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cdd40 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009e50 tx=0x7f54b401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6d1e84e42a97e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54b9ffb640 1 -- 172.21.15.53:0/1980580544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40a57b0 con 0x7f54bc0cbd60 2024-09-13T18:31:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54b9ffb640 1 -- 172.21.15.53:0/1980580544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40a5910 con 0x7f54bc0cbd60 2024-09-13T18:31:44.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54b9ffb640 1 -- 172.21.15.53:0/1980580544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40a5ca0 con 0x7f54bc0cbd60 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 -- 172.21.15.53:0/1980580544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 msgr2=0x7f54bc0cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 --2- 172.21.15.53:0/1980580544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cdd40 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009e50 tx=0x7f54b401c930 comp rx=0 tx=0).stop 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 -- 172.21.15.53:0/1980580544 shutdown_connections 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 --2- 172.21.15.53:0/1980580544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cdd40 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 --2- 172.21.15.53:0/1980580544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc06b850 0x7f54bc0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 -- 172.21.15.53:0/1980580544 >> 172.21.15.53:0/1980580544 conn(0x7f54bc065c80 msgr2=0x7f54bc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 -- 172.21.15.53:0/1980580544 shutdown_connections 2024-09-13T18:31:44.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.062+0000 7f54c18e4640 1 -- 172.21.15.53:0/1980580544 wait complete. 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 Processor -- start 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 -- start start 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54bc06b850 0x7f54bc148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc0cb980 0x7f54bc162df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc163330 con 0x7f54bc0cbd60 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc14d3b0 con 0x7f54bc06b850 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1494b0 con 0x7f54bc0cb980 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55770/0 (socket says 172.21.15.53:55770) 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 -- 172.21.15.53:0/3802496995 learned_addr learned my addr 172.21.15.53:0/3802496995 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:44.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54baffd640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54bc06b850 0x7f54bc148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54ba7fc640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc0cb980 0x7f54bc162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 -- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc0cb980 msgr2=0x7f54bc162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc0cb980 0x7f54bc162df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 -- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54bc06b850 msgr2=0x7f54bc148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54bc06b850 0x7f54bc148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 -- 172.21.15.53:0/3802496995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4009b30 con 0x7f54bc0cbd60 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54ba7fc640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc0cb980 0x7f54bc162df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54baffd640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54bc06b850 0x7f54bc148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54bb7fe640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cc270 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f54b40af040 tx=0x7f54b40196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54b3fff640 1 -- 172.21.15.53:0/3802496995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40b8670 con 0x7f54bc0cbd60 2024-09-13T18:31:44.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54b3fff640 1 -- 172.21.15.53:0/3802496995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40b87d0 con 0x7f54bc0cbd60 2024-09-13T18:31:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc14c590 con 0x7f54bc0cbd60 2024-09-13T18:31:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54b3fff640 1 -- 172.21.15.53:0/3802496995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40b8b80 con 0x7f54bc0cbd60 2024-09-13T18:31:44.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc14d8e0 con 0x7f54bc0cbd60 2024-09-13T18:31:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc067400 con 0x7f54bc0cbd60 2024-09-13T18:31:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.066+0000 7f54b3fff640 1 -- 172.21.15.53:0/3802496995 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f54b40b8ce0 con 0x7f54bc0cbd60 2024-09-13T18:31:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.070+0000 7f54b3fff640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f549c066ae0 0x7f549c068fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.070+0000 7f54b3fff640 1 -- 172.21.15.53:0/3802496995 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f54b411fb10 con 0x7f54bc0cbd60 2024-09-13T18:31:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.070+0000 7f54baffd640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f549c066ae0 0x7f549c068fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.070+0000 7f54baffd640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f549c066ae0 0x7f549c068fa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f54ac003e40 tx=0x7f54ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.074+0000 7f54b3fff640 1 -- 172.21.15.53:0/3802496995 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f54b40ec880 con 0x7f54bc0cbd60 2024-09-13T18:31:44.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.226+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54bc067400 con 0x7f54bc0cbd60 2024-09-13T18:31:44.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54b3fff640 1 -- 172.21.15.53:0/3802496995 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16534 (secure 0 0 0) 0x7f54b40efea0 con 0x7f54bc0cbd60 2024-09-13T18:31:44.231 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:44.231 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":108,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:38.918269+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:30:58.560050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:30:59.064624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f549c066ae0 msgr2=0x7f549c068fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f549c066ae0 0x7f549c068fa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f54ac003e40 tx=0x7f54ac009040 comp rx=0 tx=0).stop 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 msgr2=0x7f54bc0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cc270 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f54b40af040 tx=0x7f54b40196d0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 shutdown_connections 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f549c066ae0 0x7f549c068fa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f54bc0cb980 0x7f54bc162df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54bc0cbd60 0x7f54bc0cc270 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 --2- 172.21.15.53:0/3802496995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f54bc06b850 0x7f54bc148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 >> 172.21.15.53:0/3802496995 conn(0x7f54bc065c80 msgr2=0x7f54bc0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 shutdown_connections 2024-09-13T18:31:44.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.230+0000 7f54c18e4640 1 -- 172.21.15.53:0/3802496995 wait complete. 2024-09-13T18:31:44.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:31:44.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc11dfb640 1 Processor -- start 2024-09-13T18:31:44.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc11dfb640 1 -- start start 2024-09-13T18:31:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc11dfb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcc0c15cd50 0x7fcc0c06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc11dfb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c06b5b0 0x7fcc0c06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc11dfb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c06bf60 con 0x7fcc0c06e2e0 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc11dfb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0b46d0 con 0x7fcc0c15cd50 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc11dfb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0b48b0 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc03fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcc0c15cd50 0x7fcc0c06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc03fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcc0c15cd50 0x7fcc0c06e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55776/0 (socket says 172.21.15.53:55776) 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc03fff640 1 -- 172.21.15.53:0/1378911619 learned_addr learned my addr 172.21.15.53:0/1378911619 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc0bfff640 1 --2- 172.21.15.53:0/1378911619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c06b5b0 0x7fcc0c06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc03fff640 1 -- 172.21.15.53:0/1378911619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c06b5b0 msgr2=0x7fcc0c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc03fff640 1 --2- 172.21.15.53:0/1378911619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c06b5b0 0x7fcc0c06ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc03fff640 1 -- 172.21.15.53:0/1378911619 >> v1:172.21.15.87:6789/0 conn(0x7fcc0c06e2e0 legacy=0x7fcc0c0b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc03fff640 1 -- 172.21.15.53:0/1378911619 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0b4b70 con 0x7fcc0c15cd50 2024-09-13T18:31:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.366+0000 7fcc0bfff640 1 --2- 172.21.15.53:0/1378911619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c06b5b0 0x7fcc0c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc03fff640 1 --2- 172.21.15.53:0/1378911619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c15cd50 0x7fcc0c06e6c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009870 tx=0x7fcbf401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb38df98d911915 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc0affd640 1 -- 172.21.15.53:0/1378911619 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40aa640 con 0x7fcc0c15cd50 2024-09-13T18:31:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc0affd640 1 -- 172.21.15.53:0/1378911619 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf40aa7a0 con 0x7fcc0c15cd50 2024-09-13T18:31:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc0affd640 1 -- 172.21.15.53:0/1378911619 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40aab30 con 0x7fcc0c15cd50 2024-09-13T18:31:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 -- 172.21.15.53:0/1378911619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c15cd50 msgr2=0x7fcc0c06e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/1378911619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c15cd50 0x7fcc0c06e6c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009870 tx=0x7fcbf401c520 comp rx=0 tx=0).stop 2024-09-13T18:31:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 -- 172.21.15.53:0/1378911619 shutdown_connections 2024-09-13T18:31:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/1378911619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c06b5b0 0x7fcc0c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/1378911619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c15cd50 0x7fcc0c06e6c0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 -- 172.21.15.53:0/1378911619 >> 172.21.15.53:0/1378911619 conn(0x7fcc0c071ae0 msgr2=0x7fcc0c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 -- 172.21.15.53:0/1378911619 shutdown_connections 2024-09-13T18:31:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 -- 172.21.15.53:0/1378911619 wait complete. 2024-09-13T18:31:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 Processor -- start 2024-09-13T18:31:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.370+0000 7fcc11dfb640 1 -- start start 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c06b5b0 0x7fcc0c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc0c06e2e0 0x7fcc0c14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c15cd50 0x7fcc0c159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c14cf40 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c14e490 con 0x7fcc0c06e2e0 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c14d190 con 0x7fcc0c15cd50 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c06b5b0 0x7fcc0c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c06b5b0 0x7fcc0c14b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55780/0 (socket says 172.21.15.53:55780) 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 -- 172.21.15.53:0/4002335395 learned_addr learned my addr 172.21.15.53:0/4002335395 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:44.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 -- 172.21.15.53:0/4002335395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c15cd50 msgr2=0x7fcc0c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c15cd50 0x7fcc0c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 -- 172.21.15.53:0/4002335395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc0c06e2e0 msgr2=0x7fcc0c14df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc03fff640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc0c06e2e0 0x7fcc0c14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc0c06e2e0 0x7fcc0c14df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 -- 172.21.15.53:0/4002335395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40094d0 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc0b7fe640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c06b5b0 0x7fcc0c14b480 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00c450 tx=0x7fcbfc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc08ff9640 1 -- 172.21.15.53:0/4002335395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc012830 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc08ff9640 1 -- 172.21.15.53:0/4002335395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0129b0 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c14d470 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc08ff9640 1 -- 172.21.15.53:0/4002335395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc012d60 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c14da30 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c14dc50 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc08ff9640 1 -- 172.21.15.53:0/4002335395 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fcbfc01c460 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc08ff9640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbec066a80 0x7fcbec068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc08ff9640 1 -- 172.21.15.53:0/4002335395 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fcbfc085260 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.374+0000 7fcc03fff640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbec066a80 0x7fcbec068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.378+0000 7fcc03fff640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbec066a80 0x7fcbec068f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40ae000 tx=0x7fcbf4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.378+0000 7fcc08ff9640 1 -- 172.21.15.53:0/4002335395 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbfc052010 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.566+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcc0c06aec0 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.571 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:31:44.570+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:31:44.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.578+0000 7fcc08ff9640 1 -- 172.21.15.53:0/4002335395 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcbfc055630 con 0x7fcc0c06b5b0 2024-09-13T18:31:44.582 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:31:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbec066a80 msgr2=0x7fcbec068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbec066a80 0x7fcbec068f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40ae000 tx=0x7fcbf4008040 comp rx=0 tx=0).stop 2024-09-13T18:31:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c06b5b0 msgr2=0x7fcc0c14b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c06b5b0 0x7fcc0c14b480 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00c450 tx=0x7fcbfc00c910 comp rx=0 tx=0).stop 2024-09-13T18:31:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 shutdown_connections 2024-09-13T18:31:44.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbec066a80 0x7fcbec068f40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc0c15cd50 0x7fcc0c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc0c06e2e0 0x7fcc0c14df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 --2- 172.21.15.53:0/4002335395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc0c06b5b0 0x7fcc0c14b480 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 >> 172.21.15.53:0/4002335395 conn(0x7fcc0c071ae0 msgr2=0x7fcc0c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 shutdown_connections 2024-09-13T18:31:44.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.582+0000 7fcc11dfb640 1 -- 172.21.15.53:0/4002335395 wait complete. 2024-09-13T18:31:44.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:31:44.620 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:31:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.710+0000 7fd4c787d640 1 Processor -- start 2024-09-13T18:31:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.710+0000 7fd4c787d640 1 -- start start 2024-09-13T18:31:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c787d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c787d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4c00b2d30 0x7fd4c016a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c787d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c0160ed0 con 0x7fd4c006bdd0 2024-09-13T18:31:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c787d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c00b23d0 con 0x7fd4c00b2d30 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c787d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00b1500 con 0x7fd4c006d1c0 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4c00b2d30 0x7fd4c016a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4c00b2d30 0x7fd4c016a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55802/0 (socket says 172.21.15.53:55802) 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/2023129427 learned_addr learned my addr 172.21.15.53:0/2023129427 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c4e18640 1 --2- 172.21.15.53:0/2023129427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/2023129427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 msgr2=0x7fd4c00b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 --2- 172.21.15.53:0/2023129427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/2023129427 >> v1:172.21.15.87:6789/0 conn(0x7fd4c006bdd0 legacy=0x7fd4c00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/2023129427 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00b1750 con 0x7fd4c00b2d30 2024-09-13T18:31:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4c5e1a640 1 --2- 172.21.15.53:0/2023129427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c016a630 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba738bb9061ca7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4b7fff640 1 -- 172.21.15.53:0/2023129427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0ad660 con 0x7fd4c00b2d30 2024-09-13T18:31:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4b7fff640 1 -- 172.21.15.53:0/2023129427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0ad7c0 con 0x7fd4c00b2d30 2024-09-13T18:31:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.714+0000 7fd4b7fff640 1 -- 172.21.15.53:0/2023129427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0adb50 con 0x7fd4c00b2d30 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- 172.21.15.53:0/2023129427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 msgr2=0x7fd4c016a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 --2- 172.21.15.53:0/2023129427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c016a630 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc01c560 comp rx=0 tx=0).stop 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- 172.21.15.53:0/2023129427 shutdown_connections 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 --2- 172.21.15.53:0/2023129427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c016a630 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 --2- 172.21.15.53:0/2023129427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- 172.21.15.53:0/2023129427 >> 172.21.15.53:0/2023129427 conn(0x7fd4c0065c80 msgr2=0x7fd4c0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- 172.21.15.53:0/2023129427 shutdown_connections 2024-09-13T18:31:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- 172.21.15.53:0/2023129427 wait complete. 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 Processor -- start 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- start start 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c006bdd0 0x7fd4c01f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00a9ca0 con 0x7fd4c00b2d30 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00a8ee0 con 0x7fd4c006bdd0 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c00a9180 con 0x7fd4c006d1c0 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c015c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55816/0 (socket says 172.21.15.53:55816) 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/325887456 learned_addr learned my addr 172.21.15.53:0/325887456 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c4e18640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5619640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c006bdd0 0x7fd4c01f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 msgr2=0x7fd4c00a89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00a89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c006bdd0 msgr2=0x7fd4c01f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c006bdd0 0x7fd4c01f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 -- 172.21.15.53:0/325887456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0094d0 con 0x7fd4c00b2d30 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c5e1a640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c015c640 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0b0040 tx=0x7fd4bc019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4b5ffb640 1 -- 172.21.15.53:0/325887456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0b6640 con 0x7fd4c00b2d30 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4b5ffb640 1 -- 172.21.15.53:0/325887456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0b67a0 con 0x7fd4c00b2d30 2024-09-13T18:31:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c00a9460 con 0x7fd4c00b2d30 2024-09-13T18:31:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4b5ffb640 1 -- 172.21.15.53:0/325887456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0b6b50 con 0x7fd4c00b2d30 2024-09-13T18:31:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.718+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c00a9740 con 0x7fd4c00b2d30 2024-09-13T18:31:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.722+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c00b27f0 con 0x7fd4c00b2d30 2024-09-13T18:31:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.722+0000 7fd4b5ffb640 1 -- 172.21.15.53:0/325887456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fd4bc0b4070 con 0x7fd4c00b2d30 2024-09-13T18:31:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.722+0000 7fd4b5ffb640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4a4066a80 0x7fd4a4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:44.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.722+0000 7fd4b5ffb640 1 -- 172.21.15.53:0/325887456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd4bc11ee90 con 0x7fd4c00b2d30 2024-09-13T18:31:44.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.722+0000 7fd4c5619640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4a4066a80 0x7fd4a4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:44.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.722+0000 7fd4c5619640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4a4066a80 0x7fd4a4068f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0160200 tx=0x7fd4b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:44.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.726+0000 7fd4b5ffb640 1 -- 172.21.15.53:0/325887456 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4bc0ebc40 con 0x7fd4c00b2d30 2024-09-13T18:31:44.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:44.922+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4c00aa0e0 con 0x7fd4c00b2d30 2024-09-13T18:31:45.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.582+0000 7fd4b5ffb640 1 -- 172.21.15.53:0/325887456 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd4bc0ef260 con 0x7fd4c00b2d30 2024-09-13T18:31:45.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4a4066a80 msgr2=0x7fd4a4068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4a4066a80 0x7fd4a4068f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0160200 tx=0x7fd4b8009040 comp rx=0 tx=0).stop 2024-09-13T18:31:45.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 msgr2=0x7fd4c015c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c015c640 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0b0040 tx=0x7fd4bc019300 comp rx=0 tx=0).stop 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 shutdown_connections 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd4a4066a80 0x7fd4a4068f40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4c006d1c0 0x7fd4c00a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4c00b2d30 0x7fd4c015c640 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 --2- 172.21.15.53:0/325887456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4c006bdd0 0x7fd4c01f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 >> 172.21.15.53:0/325887456 conn(0x7fd4c0065c80 msgr2=0x7fd4c00ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 shutdown_connections 2024-09-13T18:31:45.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.586+0000 7fd4c787d640 1 -- 172.21.15.53:0/325887456 wait complete. 2024-09-13T18:31:45.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:31:45.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42db7ff640 1 Processor -- start 2024-09-13T18:31:45.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42db7ff640 1 -- start start 2024-09-13T18:31:45.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42db7ff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cdad0 0x7f42d4143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42db7ff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f42d4143d50 0x7f42d406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42db7ff640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40b1ba0 con 0x7f42d40cd6f0 2024-09-13T18:31:45.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42db7ff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40b3020 con 0x7f42d4143d50 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42db7ff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b1f80 con 0x7f42d40cdad0 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42d8d9a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cdad0 0x7f42d4143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42d9d9c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f42d4143d50 0x7f42d406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42d8d9a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cdad0 0x7f42d4143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:34420/0 (socket says 172.21.15.53:34420) 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42d9d9c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f42d4143d50 0x7f42d406b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:37566/0 (socket says 172.21.15.53:37566) 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.790+0000 7f42d8d9a640 1 -- 172.21.15.53:0/1506656630 learned_addr learned my addr 172.21.15.53:0/1506656630 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42d9d9c640 1 -- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cdad0 msgr2=0x7f42d4143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42d9d9c640 1 --2- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cdad0 0x7f42d4143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42d9d9c640 1 -- 172.21.15.53:0/1506656630 >> v1:172.21.15.87:6789/0 conn(0x7f42d40cd6f0 legacy=0x7f42d40b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42d9d9c640 1 -- 172.21.15.53:0/1506656630 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40b2260 con 0x7f42d4143d50 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42d8d9a640 1 --2- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cdad0 0x7f42d4143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:45.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42d9d9c640 1 --2- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d4143d50 0x7f42d406b320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009d90 tx=0x7f42cc01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8232f0bb33eb9826 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42cbfff640 1 -- 172.21.15.53:0/1506656630 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a5910 con 0x7f42d4143d50 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42cbfff640 1 -- 172.21.15.53:0/1506656630 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0a5a70 con 0x7f42d4143d50 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42cbfff640 1 -- 172.21.15.53:0/1506656630 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a5e00 con 0x7f42d4143d50 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 -- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d4143d50 msgr2=0x7f42d406b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 --2- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d4143d50 0x7f42d406b320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009d90 tx=0x7f42cc01c940 comp rx=0 tx=0).stop 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 -- 172.21.15.53:0/1506656630 shutdown_connections 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 --2- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d4143d50 0x7f42d406b320 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 --2- 172.21.15.53:0/1506656630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cdad0 0x7f42d4143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 -- 172.21.15.53:0/1506656630 >> 172.21.15.53:0/1506656630 conn(0x7f42d4073330 msgr2=0x7f42d4065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 -- 172.21.15.53:0/1506656630 shutdown_connections 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.794+0000 7f42db7ff640 1 -- 172.21.15.53:0/1506656630 wait complete. 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 Processor -- start 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 -- start start 2024-09-13T18:31:45.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cd6f0 0x7f42d413eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d40cdad0 0x7f42d415e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d4143d50 0x7f42d415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4140b60 con 0x7f42d4143d50 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d415ed50 con 0x7f42d40cdad0 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4140270 con 0x7f42d40cd6f0 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d4143d50 0x7f42d415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d4143d50 0x7f42d415b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55824/0 (socket says 172.21.15.53:55824) 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 -- 172.21.15.53:0/78972473 learned_addr learned my addr 172.21.15.53:0/78972473 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d8d9a640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d40cdad0 0x7f42d415e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d959b640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cd6f0 0x7f42d413eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 -- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cd6f0 msgr2=0x7f42d413eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cd6f0 0x7f42d413eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 -- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d40cdad0 msgr2=0x7f42d415e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d40cdad0 0x7f42d415e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 -- 172.21.15.53:0/78972473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40094d0 con 0x7f42d4143d50 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d959b640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cd6f0 0x7f42d413eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d8d9a640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d40cdad0 0x7f42d415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42d9d9c640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d4143d50 0x7f42d415b050 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f42cc01a570 tx=0x7f42cc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42c9ffb640 1 -- 172.21.15.53:0/78972473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a5910 con 0x7f42d4143d50 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42c9ffb640 1 -- 172.21.15.53:0/78972473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0ad850 con 0x7f42d4143d50 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc009a70 con 0x7f42d4143d50 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42c9ffb640 1 -- 172.21.15.53:0/78972473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0adc00 con 0x7f42d4143d50 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.798+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d41407f0 con 0x7f42d4143d50 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.802+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4143810 con 0x7f42d4143d50 2024-09-13T18:31:45.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.802+0000 7f42c9ffb640 1 -- 172.21.15.53:0/78972473 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f42cc0b4070 con 0x7f42d4143d50 2024-09-13T18:31:45.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.802+0000 7f42c9ffb640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f42b8066ab0 0x7f42b8068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:45.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.802+0000 7f42c9ffb640 1 -- 172.21.15.53:0/78972473 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f42cc120100 con 0x7f42d4143d50 2024-09-13T18:31:45.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.802+0000 7f42d959b640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f42b8066ab0 0x7f42b8068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:45.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.802+0000 7f42d959b640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f42b8066ab0 0x7f42b8068f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001710 tx=0x7f42d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:45.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.806+0000 7f42c9ffb640 1 -- 172.21.15.53:0/78972473 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f42cc0ecfc0 con 0x7f42d4143d50 2024-09-13T18:31:45.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:45.962+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42d413c910 con 0x7f42d4143d50 2024-09-13T18:31:46.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.594+0000 7f42c9ffb640 1 -- 172.21.15.53:0/78972473 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) v1 ==== 181+0+0 (secure 0 0 0) 0x7f42cc0b20d0 con 0x7f42d4143d50 2024-09-13T18:31:46.598 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:31:46.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f42b8066ab0 msgr2=0x7f42b8068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f42b8066ab0 0x7f42b8068f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001710 tx=0x7f42d0009040 comp rx=0 tx=0).stop 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d4143d50 msgr2=0x7f42d415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d4143d50 0x7f42d415b050 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f42cc01a570 tx=0x7f42cc0196e0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 shutdown_connections 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f42b8066ab0 0x7f42b8068f70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42d4143d50 0x7f42d415b050 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42d40cdad0 0x7f42d415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 --2- 172.21.15.53:0/78972473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42d40cd6f0 0x7f42d413eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 >> 172.21.15.53:0/78972473 conn(0x7f42d4073330 msgr2=0x7f42d40a8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 shutdown_connections 2024-09-13T18:31:46.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.598+0000 7f42db7ff640 1 -- 172.21.15.53:0/78972473 wait complete. 2024-09-13T18:31:46.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:31:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae37cf640 1 Processor -- start 2024-09-13T18:31:46.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae37cf640 1 -- start start 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae37cf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdadc06ccc0 0x7fdadc06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae37cf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc070fb0 con 0x7fdadc15c5e0 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae37cf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc06d620 con 0x7fdadc0cc800 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae37cf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc070a10 con 0x7fdadc06ccc0 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae156b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdadc15c5e0 0x7fdadc15d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46392/0 (socket says 172.21.15.53:46392) 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.754+0000 7fdae156b640 1 -- 172.21.15.53:0/1705995418 learned_addr learned my addr 172.21.15.53:0/1705995418 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae0d6a640 1 --2- 172.21.15.53:0/1705995418 >> v2:172.21.15.87:3300/0 conn(0x7fdadc06ccc0 0x7fdadc06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289549128 0 0) 0x7fdadc070fb0 con 0x7fdadc15c5e0 2024-09-13T18:31:46.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac8003530 con 0x7fdadc15c5e0 2024-09-13T18:31:46.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3771306640 0 0) 0x7fdac8003530 con 0x7fdadc15c5e0 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 >> v2:172.21.15.87:3300/0 conn(0x7fdadc06ccc0 msgr2=0x7fdadc06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 --2- 172.21.15.53:0/1705995418 >> v2:172.21.15.87:3300/0 conn(0x7fdadc06ccc0 0x7fdadc06d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 >> v1:172.21.15.87:6789/0 conn(0x7fdadc0cc800 legacy=0x7fdadc0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0711e0 con 0x7fdadc15c5e0 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdad8001680 con 0x7fdadc15c5e0 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 >> v1:172.21.15.53:6789/0 conn(0x7fdadc15c5e0 legacy=0x7fdadc15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdac8003980 0x7fdac8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdac80047d0 0x7fdac8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdac800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc070a10 con 0x7fdac8005190 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac800c030 con 0x7fdac8003980 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac800c1f0 con 0x7fdac80047d0 2024-09-13T18:31:46.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdac800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae0d6a640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdac80047d0 0x7fdac8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae156b640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdac8003980 0x7fdac8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 -- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdac80047d0 msgr2=0x7fdac8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdac80047d0 0x7fdac8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 -- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdac8003980 msgr2=0x7fdac8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdac8003980 0x7fdac8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 -- 172.21.15.53:0/1705995418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8003530 con 0x7fdac8005190 2024-09-13T18:31:46.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 -- 172.21.15.53:0/1705995418 reap_dead start 2024-09-13T18:31:46.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdae1d6c640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdac800b990 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdad4001e70 tx=0x7fdad401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd71e8114ce79a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4003b80 con 0x7fdac8005190 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4003d00 con 0x7fdac8005190 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.758+0000 7fdad3fff640 1 -- 172.21.15.53:0/1705995418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4005260 con 0x7fdac8005190 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- 172.21.15.53:0/1705995418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 msgr2=0x7fdac800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdac800b990 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdad4001e70 tx=0x7fdad401c780 comp rx=0 tx=0).stop 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- 172.21.15.53:0/1705995418 shutdown_connections 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 --2- 172.21.15.53:0/1705995418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdac800b990 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- 172.21.15.53:0/1705995418 >> 172.21.15.53:0/1705995418 conn(0x7fdadc073330 msgr2=0x7fdadc065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- 172.21.15.53:0/1705995418 shutdown_connections 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- 172.21.15.53:0/1705995418 wait complete. 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 Processor -- start 2024-09-13T18:31:46.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- start start 2024-09-13T18:31:46.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdadc145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc151ce0 0x7fdadc1e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc1e40c0 0x7fdadc1e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1e7210 con 0x7fdac8005190 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc152550 con 0x7fdadc151ce0 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1e6240 con 0x7fdadc1e40c0 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdadc145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdadc145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39378/0 (socket says 172.21.15.53:39378) 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 -- 172.21.15.53:0/2559592488 learned_addr learned my addr 172.21.15.53:0/2559592488 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae1d6c640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc1e40c0 0x7fdadc1e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae0d6a640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc151ce0 0x7fdadc1e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 -- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc1e40c0 msgr2=0x7fdadc1e16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc1e40c0 0x7fdadc1e16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 -- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc151ce0 msgr2=0x7fdadc1e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc151ce0 0x7fdadc1e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 -- 172.21.15.53:0/2559592488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc146270 con 0x7fdac8005190 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae0d6a640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc151ce0 0x7fdadc1e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae1d6c640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc1e40c0 0x7fdadc1e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae156b640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdadc145d30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fdad800e700 tx=0x7fdad800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdad1ffb640 1 -- 172.21.15.53:0/2559592488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800ee10 con 0x7fdac8005190 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdad1ffb640 1 -- 172.21.15.53:0/2559592488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad800c870 con 0x7fdac8005190 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc1e6450 con 0x7fdac8005190 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdad1ffb640 1 -- 172.21.15.53:0/2559592488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800cc00 con 0x7fdac8005190 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.762+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc1e6a10 con 0x7fdac8005190 2024-09-13T18:31:46.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.766+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc070670 con 0x7fdac8005190 2024-09-13T18:31:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.766+0000 7fdad1ffb640 1 -- 172.21.15.53:0/2559592488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fdad801d460 con 0x7fdac8005190 2024-09-13T18:31:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.766+0000 7fdad1ffb640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdac0066a80 0x7fdac0068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.766+0000 7fdad1ffb640 1 -- 172.21.15.53:0/2559592488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fdad80845c0 con 0x7fdac8005190 2024-09-13T18:31:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.766+0000 7fdae0d6a640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdac0066a80 0x7fdac0068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:46.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.766+0000 7fdae0d6a640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdac0066a80 0x7fdac0068f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdadc065d30 tx=0x7fdacc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:46.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.770+0000 7fdad1ffb640 1 -- 172.21.15.53:0/2559592488 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdad8051530 con 0x7fdac8005190 2024-09-13T18:31:46.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:46.922+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdadc1e44a0 con 0x7fdac8005190 2024-09-13T18:31:47.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.602+0000 7fdad1ffb640 1 -- 172.21.15.53:0/2559592488 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdad8054b50 con 0x7fdac8005190 2024-09-13T18:31:47.604 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:31:47.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.606+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdac0066a80 msgr2=0x7fdac0068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:47.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.606+0000 7fdae37cf640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdac0066a80 0x7fdac0068f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdadc065d30 tx=0x7fdacc008040 comp rx=0 tx=0).stop 2024-09-13T18:31:47.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.606+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 msgr2=0x7fdadc145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:47.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.606+0000 7fdae37cf640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdadc145d30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fdad800e700 tx=0x7fdad800ebc0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 shutdown_connections 2024-09-13T18:31:47.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdac0066a80 0x7fdac0068f40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdadc1e40c0 0x7fdadc1e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdadc151ce0 0x7fdadc1e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 --2- 172.21.15.53:0/2559592488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdac8005190 0x7fdadc145d30 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 >> 172.21.15.53:0/2559592488 conn(0x7fdadc073330 msgr2=0x7fdadc06bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 shutdown_connections 2024-09-13T18:31:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.610+0000 7fdae37cf640 1 -- 172.21.15.53:0/2559592488 wait complete. 2024-09-13T18:31:47.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:31:47.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.762+0000 7ff424612640 1 Processor -- start 2024-09-13T18:31:47.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.762+0000 7ff424612640 1 -- start start 2024-09-13T18:31:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff424612640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff41c1457c0 0x7ff41c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff424612640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff424612640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff41c071220 0x7ff41c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:47.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff424612640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0702d0 con 0x7ff41c1457c0 2024-09-13T18:31:47.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff424612640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c146180 con 0x7ff41c071220 2024-09-13T18:31:47.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff424612640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c06c4c0 con 0x7ff41c0b1a40 2024-09-13T18:31:47.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff41c1457c0 0x7ff41c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:47.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff41c1457c0 0x7ff41c0b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39386/0 (socket says 172.21.15.53:39386) 2024-09-13T18:31:47.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 -- 172.21.15.53:0/1395408051 learned_addr learned my addr 172.21.15.53:0/1395408051 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:47.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff422baf640 1 --2- 172.21.15.53:0/1395408051 >> v2:172.21.15.87:3300/0 conn(0x7ff41c071220 0x7ff41c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:47.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff421bad640 1 --2- 172.21.15.53:0/1395408051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:47.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 -- 172.21.15.53:0/1395408051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 msgr2=0x7ff41c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:47.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 --2- 172.21.15.53:0/1395408051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 -- 172.21.15.53:0/1395408051 >> v2:172.21.15.87:3300/0 conn(0x7ff41c071220 msgr2=0x7ff41c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:47.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 --2- 172.21.15.53:0/1395408051 >> v2:172.21.15.87:3300/0 conn(0x7ff41c071220 0x7ff41c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 -- 172.21.15.53:0/1395408051 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c06bf00 con 0x7ff41c1457c0 2024-09-13T18:31:47.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4223ae640 1 --2- 172.21.15.53:0/1395408051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c0b1500 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b0190 tx=0x7ff41801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bfc2f42034a13f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4213ac640 1 -- 172.21.15.53:0/1395408051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180ac620 con 0x7ff41c1457c0 2024-09-13T18:31:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4213ac640 1 -- 172.21.15.53:0/1395408051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180ac780 con 0x7ff41c1457c0 2024-09-13T18:31:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.766+0000 7ff4213ac640 1 -- 172.21.15.53:0/1395408051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180acb10 con 0x7ff41c1457c0 2024-09-13T18:31:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- 172.21.15.53:0/1395408051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 msgr2=0x7ff41c0b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 --2- 172.21.15.53:0/1395408051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c0b1500 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0b0190 tx=0x7ff41801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- 172.21.15.53:0/1395408051 shutdown_connections 2024-09-13T18:31:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 --2- 172.21.15.53:0/1395408051 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 --2- 172.21.15.53:0/1395408051 >> v2:172.21.15.87:3300/0 conn(0x7ff41c071220 0x7ff41c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 --2- 172.21.15.53:0/1395408051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c0b1500 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- 172.21.15.53:0/1395408051 >> 172.21.15.53:0/1395408051 conn(0x7ff41c065c80 msgr2=0x7ff41c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:47.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- 172.21.15.53:0/1395408051 shutdown_connections 2024-09-13T18:31:47.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- 172.21.15.53:0/1395408051 wait complete. 2024-09-13T18:31:47.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 Processor -- start 2024-09-13T18:31:47.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- start start 2024-09-13T18:31:47.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff41c071220 0x7ff41c1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:47.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:47.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:47.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c13dbe0 con 0x7ff41c1457c0 2024-09-13T18:31:47.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c158f30 con 0x7ff41c071220 2024-09-13T18:31:47.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c13cf60 con 0x7ff41c0b1a40 2024-09-13T18:31:47.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:47.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39402/0 (socket says 172.21.15.53:39402) 2024-09-13T18:31:47.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 -- 172.21.15.53:0/1364336157 learned_addr learned my addr 172.21.15.53:0/1364336157 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:47.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff4223ae640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff41c071220 0x7ff41c1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:47.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff421bad640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:47.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 -- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 msgr2=0x7ff41c15bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:47.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c15bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 -- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff41c071220 msgr2=0x7ff41c1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:47.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff41c071220 0x7ff41c1589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 -- 172.21.15.53:0/1364336157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180094d0 con 0x7ff41c1457c0 2024-09-13T18:31:47.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff422baf640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c159d10 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff414007e60 tx=0x7ff41400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:47.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff412ffd640 1 -- 172.21.15.53:0/1364336157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414014420 con 0x7ff41c1457c0 2024-09-13T18:31:47.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff412ffd640 1 -- 172.21.15.53:0/1364336157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140145a0 con 0x7ff41c1457c0 2024-09-13T18:31:47.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c13d240 con 0x7ff41c1457c0 2024-09-13T18:31:47.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff412ffd640 1 -- 172.21.15.53:0/1364336157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414014950 con 0x7ff41c1457c0 2024-09-13T18:31:47.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.770+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c13d800 con 0x7ff41c1457c0 2024-09-13T18:31:47.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.774+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c070ce0 con 0x7ff41c1457c0 2024-09-13T18:31:47.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.774+0000 7ff412ffd640 1 -- 172.21.15.53:0/1364336157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff414014ab0 con 0x7ff41c1457c0 2024-09-13T18:31:47.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.774+0000 7ff412ffd640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff400066a80 0x7ff400068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:47.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.774+0000 7ff412ffd640 1 -- 172.21.15.53:0/1364336157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff414084ee0 con 0x7ff41c1457c0 2024-09-13T18:31:47.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.774+0000 7ff4223ae640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff400066a80 0x7ff400068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:47.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.774+0000 7ff4223ae640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff400066a80 0x7ff400068f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4180ae000 tx=0x7ff418008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:47.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.778+0000 7ff412ffd640 1 -- 172.21.15.53:0/1364336157 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff414051f70 con 0x7ff41c1457c0 2024-09-13T18:31:47.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.946+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff41c15cda0 con 0x7ff41c1457c0 2024-09-13T18:31:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff412ffd640 1 -- 172.21.15.53:0/1364336157 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff414055590 con 0x7ff41c1457c0 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff400066a80 msgr2=0x7ff400068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff400066a80 0x7ff400068f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4180ae000 tx=0x7ff418008040 comp rx=0 tx=0).stop 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 msgr2=0x7ff41c159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c159d10 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff414007e60 tx=0x7ff41400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 shutdown_connections 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff400066a80 0x7ff400068f40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff41c0b1a40 0x7ff41c15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff41c1457c0 0x7ff41c159d10 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 --2- 172.21.15.53:0/1364336157 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff41c071220 0x7ff41c1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 >> 172.21.15.53:0/1364336157 conn(0x7ff41c065c80 msgr2=0x7ff41c15d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 shutdown_connections 2024-09-13T18:31:47.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:47.966+0000 7ff424612640 1 -- 172.21.15.53:0/1364336157 wait complete. 2024-09-13T18:31:47.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-13T18:31:48.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf74bd640 1 Processor -- start 2024-09-13T18:31:48.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf74bd640 1 -- start start 2024-09-13T18:31:48.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf74bd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffbf00cb980 0x7ffbf00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf74bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf006b850 0x7ffbf00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf74bd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbf00b1ac0 con 0x7ffbf00cbd60 2024-09-13T18:31:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf74bd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbf00b3010 con 0x7ffbf00cb980 2024-09-13T18:31:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf74bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf0159ac0 con 0x7ffbf006b850 2024-09-13T18:31:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf5a5a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffbf00cbd60 0x7ffbf006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46408/0 (socket says 172.21.15.53:46408) 2024-09-13T18:31:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf5a5a640 1 -- 172.21.15.53:0/15989793 learned_addr learned my addr 172.21.15.53:0/15989793 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:48.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf006b850 0x7ffbf00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf5259640 1 --2- 172.21.15.53:0/15989793 >> v2:172.21.15.87:3300/0 conn(0x7ffbf00cb980 0x7ffbf00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891709616 0 0) 0x7ffbf00b1ac0 con 0x7ffbf00cbd60 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbdc003530 con 0x7ffbf00cbd60 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212514214 0 0) 0x7ffbdc003530 con 0x7ffbf00cbd60 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf006b850 msgr2=0x7ffbf00cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf006b850 0x7ffbf00cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 >> v2:172.21.15.87:3300/0 conn(0x7ffbf00cb980 msgr2=0x7ffbf00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 --2- 172.21.15.53:0/15989793 >> v2:172.21.15.87:3300/0 conn(0x7ffbf00cb980 0x7ffbf00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf0159da0 con 0x7ffbf00cbd60 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ffbe8001a00 con 0x7ffbf00cbd60 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 >> v1:172.21.15.53:6789/0 conn(0x7ffbf00cbd60 legacy=0x7ffbf006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc003980 0x7ffbdc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbdc0047d0 0x7ffbdc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf006b850 0x7ffbdc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00b3010 con 0x7ffbdc0047d0 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf0159ac0 con 0x7ffbdc003980 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc00b990 con 0x7ffbf006b850 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbdc0047d0 0x7ffbdc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf5259640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc003980 0x7ffbdc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf4a58640 1 -- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf006b850 msgr2=0x7ffbdc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf006b850 0x7ffbdc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf4a58640 1 -- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc003980 msgr2=0x7ffbdc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc003980 0x7ffbdc003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.106+0000 7ffbf4a58640 1 -- 172.21.15.53:0/15989793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc003530 con 0x7ffbdc0047d0 2024-09-13T18:31:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbdc0047d0 0x7ffbdc004c50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009ab0 tx=0x7ffbe001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a8ff29716eb7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe00a5510 con 0x7ffbdc0047d0 2024-09-13T18:31:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe00a5670 con 0x7ffbdc0047d0 2024-09-13T18:31:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbe7fff640 1 -- 172.21.15.53:0/15989793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe00a5a20 con 0x7ffbdc0047d0 2024-09-13T18:31:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- 172.21.15.53:0/15989793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbdc0047d0 msgr2=0x7ffbdc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 --2- 172.21.15.53:0/15989793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbdc0047d0 0x7ffbdc004c50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009ab0 tx=0x7ffbe001ca20 comp rx=0 tx=0).stop 2024-09-13T18:31:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf5a5a640 1 -- 172.21.15.53:0/15989793 reap_dead start 2024-09-13T18:31:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- 172.21.15.53:0/15989793 shutdown_connections 2024-09-13T18:31:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- 172.21.15.53:0/15989793 >> 172.21.15.53:0/15989793 conn(0x7ffbf0065c80 msgr2=0x7ffbf0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- 172.21.15.53:0/15989793 shutdown_connections 2024-09-13T18:31:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- 172.21.15.53:0/15989793 wait complete. 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 Processor -- start 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- start start 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc0047d0 0x7ffbf0165b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbf01634d0 0x7ffbf014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf00aefe0 0x7ffbf00af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf01f5d30 con 0x7ffbf01634d0 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00af980 con 0x7ffbdc0047d0 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.110+0000 7ffbf74bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf01f50b0 con 0x7ffbf00aefe0 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbf01634d0 0x7ffbf014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbf01634d0 0x7ffbf014cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39414/0 (socket says 172.21.15.53:39414) 2024-09-13T18:31:48.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 -- 172.21.15.53:0/339227164 learned_addr learned my addr 172.21.15.53:0/339227164 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf5259640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc0047d0 0x7ffbf0165b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf5a5a640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf00aefe0 0x7ffbf00af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 -- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf00aefe0 msgr2=0x7ffbf00af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf00aefe0 0x7ffbf00af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 -- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc0047d0 msgr2=0x7ffbf0165b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc0047d0 0x7ffbf0165b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 -- 172.21.15.53:0/339227164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf01f5390 con 0x7ffbf01634d0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf4a58640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbf01634d0 0x7ffbf014cda0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ffbe001c850 tx=0x7ffbdc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbe5ffb640 1 -- 172.21.15.53:0/339227164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe000f000 con 0x7ffbf01634d0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbe5ffb640 1 -- 172.21.15.53:0/339227164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe0004020 con 0x7ffbf01634d0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbf01f5670 con 0x7ffbf01634d0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbe5ffb640 1 -- 172.21.15.53:0/339227164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0004390 con 0x7ffbf01634d0 2024-09-13T18:31:48.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf014d2e0 con 0x7ffbf01634d0 2024-09-13T18:31:48.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf0067400 con 0x7ffbf01634d0 2024-09-13T18:31:48.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbe5ffb640 1 -- 172.21.15.53:0/339227164 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ffbe00b4040 con 0x7ffbf01634d0 2024-09-13T18:31:48.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbe5ffb640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffbd4066a80 0x7ffbd4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbe5ffb640 1 -- 172.21.15.53:0/339227164 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffbe011e550 con 0x7ffbf01634d0 2024-09-13T18:31:48.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf5259640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffbd4066a80 0x7ffbd4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.114+0000 7ffbf5259640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffbd4066a80 0x7ffbd4068f40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009ab0 tx=0x7ffbec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.118+0000 7ffbe5ffb640 1 -- 172.21.15.53:0/339227164 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffbe00eb7b0 con 0x7ffbf01634d0 2024-09-13T18:31:48.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.338+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) v1 -- 0x7ffbf00cdcf0 con 0x7ffbf01634d0 2024-09-13T18:31:48.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbe5ffb640 1 -- 172.21.15.53:0/339227164 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v371) v1 ==== 149+0+0 (secure 0 0 0) 0x7ffbe00eedd0 con 0x7ffbf01634d0 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffbd4066a80 msgr2=0x7ffbd4068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffbd4066a80 0x7ffbd4068f40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009ab0 tx=0x7ffbec008040 comp rx=0 tx=0).stop 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbf01634d0 msgr2=0x7ffbf014cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbf01634d0 0x7ffbf014cda0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ffbe001c850 tx=0x7ffbdc005800 comp rx=0 tx=0).stop 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 shutdown_connections 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffbd4066a80 0x7ffbd4068f40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffbf00aefe0 0x7ffbf00af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbf01634d0 0x7ffbf014cda0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 --2- 172.21.15.53:0/339227164 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbdc0047d0 0x7ffbf0165b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 >> 172.21.15.53:0/339227164 conn(0x7ffbf0065c80 msgr2=0x7ffbf006f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.618+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 shutdown_connections 2024-09-13T18:31:48.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.622+0000 7ffbf74bd640 1 -- 172.21.15.53:0/339227164 wait complete. 2024-09-13T18:31:48.642 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-13T18:31:48.642 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-13T18:31:48.642 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:31:48.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:48.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8ff715640 1 Processor -- start 2024-09-13T18:31:48.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8ff715640 1 -- start start 2024-09-13T18:31:48.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8ff715640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8ff715640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8f80cbc70 0x7fa8f80cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8ff715640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f806d9e0 con 0x7fa8f815ef80 2024-09-13T18:31:48.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8ff715640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f806c680 con 0x7fa8f80cbc70 2024-09-13T18:31:48.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8ff715640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f806bd50 con 0x7fa8f815a610 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fd4b1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fdcb2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8f80cbc70 0x7fa8f80cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fd4b1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f806d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:55498/0 (socket says 172.21.15.53:55498) 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/109221811 learned_addr learned my addr 172.21.15.53:0/109221811 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/109221811 >> v2:172.21.15.87:3300/0 conn(0x7fa8f80cbc70 msgr2=0x7fa8f80cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fd4b1640 1 --2- 172.21.15.53:0/109221811 >> v2:172.21.15.87:3300/0 conn(0x7fa8f80cbc70 0x7fa8f80cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/109221811 >> v1:172.21.15.87:6789/0 conn(0x7fa8f815ef80 legacy=0x7fa8f80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.770+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/109221811 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f806c030 con 0x7fa8f815a610 2024-09-13T18:31:48.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8fd4b1640 1 --2- 172.21.15.53:0/109221811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f806d090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009e50 tx=0x7fa8e801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c32efa6d75bdc4da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8f7fff640 1 -- 172.21.15.53:0/109221811 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a5850 con 0x7fa8f815a610 2024-09-13T18:31:48.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8f7fff640 1 -- 172.21.15.53:0/109221811 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80a59b0 con 0x7fa8f815a610 2024-09-13T18:31:48.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8f7fff640 1 -- 172.21.15.53:0/109221811 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a5d40 con 0x7fa8f815a610 2024-09-13T18:31:48.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 -- 172.21.15.53:0/109221811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 msgr2=0x7fa8f806d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 --2- 172.21.15.53:0/109221811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f806d090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009e50 tx=0x7fa8e801c970 comp rx=0 tx=0).stop 2024-09-13T18:31:48.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 -- 172.21.15.53:0/109221811 shutdown_connections 2024-09-13T18:31:48.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 --2- 172.21.15.53:0/109221811 >> v2:172.21.15.87:3300/0 conn(0x7fa8f80cbc70 0x7fa8f80cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 --2- 172.21.15.53:0/109221811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f806d090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 -- 172.21.15.53:0/109221811 >> 172.21.15.53:0/109221811 conn(0x7fa8f80b0840 msgr2=0x7fa8f80b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:48.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 -- 172.21.15.53:0/109221811 shutdown_connections 2024-09-13T18:31:48.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.774+0000 7fa8ff715640 1 -- 172.21.15.53:0/109221811 wait complete. 2024-09-13T18:31:48.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 Processor -- start 2024-09-13T18:31:48.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 -- start start 2024-09-13T18:31:48.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f80cbc70 0x7fa8f8143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f81561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f815ef80 0x7fa8f8144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80c8600 con 0x7fa8f80cbc70 2024-09-13T18:31:48.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8141320 con 0x7fa8f815ef80 2024-09-13T18:31:48.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f81442d0 con 0x7fa8f815a610 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f80cbc70 0x7fa8f8143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f80cbc70 0x7fa8f8143d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39430/0 (socket says 172.21.15.53:39430) 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/186094295 learned_addr learned my addr 172.21.15.53:0/186094295 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fdcb2640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f815ef80 0x7fa8f8144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fccb0640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f81561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 msgr2=0x7fa8f81561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f81561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f815ef80 msgr2=0x7fa8f8144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f815ef80 0x7fa8f8144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 -- 172.21.15.53:0/186094295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8009b30 con 0x7fa8f80cbc70 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fccb0640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8fd4b1640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f80cbc70 0x7fa8f8143d90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fa8e801a5a0 tx=0x7fa8e8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8f5ffb640 1 -- 172.21.15.53:0/186094295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80bd070 con 0x7fa8f80cbc70 2024-09-13T18:31:48.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8f5ffb640 1 -- 172.21.15.53:0/186094295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80b8470 con 0x7fa8f80cbc70 2024-09-13T18:31:48.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f8141570 con 0x7fa8f80cbc70 2024-09-13T18:31:48.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8f5ffb640 1 -- 172.21.15.53:0/186094295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80b87e0 con 0x7fa8f80cbc70 2024-09-13T18:31:48.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.778+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f8141b30 con 0x7fa8f80cbc70 2024-09-13T18:31:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.782+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f80cca70 con 0x7fa8f80cbc70 2024-09-13T18:31:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.782+0000 7fa8f5ffb640 1 -- 172.21.15.53:0/186094295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa8e80b8940 con 0x7fa8f80cbc70 2024-09-13T18:31:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.782+0000 7fa8f5ffb640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e4066a80 0x7fa8e4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.782+0000 7fa8f5ffb640 1 -- 172.21.15.53:0/186094295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8e811f5a0 con 0x7fa8f80cbc70 2024-09-13T18:31:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.782+0000 7fa8fccb0640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e4066a80 0x7fa8e4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:48.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.782+0000 7fa8fccb0640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e4066a80 0x7fa8e4068f40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8147a30 tx=0x7fa8ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:48.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.786+0000 7fa8f5ffb640 1 -- 172.21.15.53:0/186094295 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8e80ec5f0 con 0x7fa8f80cbc70 2024-09-13T18:31:48.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.950+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8f80b24a0 con 0x7fa8f80cbc70 2024-09-13T18:31:48.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.950+0000 7fa8f5ffb640 1 -- 172.21.15.53:0/186094295 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+12936 (secure 0 0 0) 0x7fa8e80efc10 con 0x7fa8f80cbc70 2024-09-13T18:31:48.953 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:48.953 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":111,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:47.592342+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/2605273551":"2024-09-14T18:31:44.571476+0000","172.21.15.53:6834/2605273551":"2024-09-14T18:31:44.571476+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:48.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e4066a80 msgr2=0x7fa8e4068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e4066a80 0x7fa8e4068f40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8147a30 tx=0x7fa8ec009040 comp rx=0 tx=0).stop 2024-09-13T18:31:48.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f80cbc70 msgr2=0x7fa8f8143d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:48.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f80cbc70 0x7fa8f8143d90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fa8e801a5a0 tx=0x7fa8e8019710 comp rx=0 tx=0).stop 2024-09-13T18:31:48.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 shutdown_connections 2024-09-13T18:31:48.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e4066a80 0x7fa8e4068f40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8f815a610 0x7fa8f81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8f815ef80 0x7fa8f8144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 --2- 172.21.15.53:0/186094295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8f80cbc70 0x7fa8f8143d90 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:48.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 >> 172.21.15.53:0/186094295 conn(0x7fa8f80b0840 msgr2=0x7fa8f806fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:48.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 shutdown_connections 2024-09-13T18:31:48.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:48.954+0000 7fa8ff715640 1 -- 172.21.15.53:0/186094295 wait complete. 2024-09-13T18:31:48.972 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:31:48.972 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:31:49.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f4db3f640 1 Processor -- start 2024-09-13T18:31:49.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f4db3f640 1 -- start start 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f4db3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f48143e80 0x7f5f4806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f4db3f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f480caee0 0x7f5f480cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f4db3f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4806f7a0 con 0x7f5f480cd320 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f4db3f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4806fd60 con 0x7f5f48143e80 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f4db3f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480cb960 con 0x7f5f480caee0 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f48143e80 0x7f5f4806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f48143e80 0x7f5f4806b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39442/0 (socket says 172.21.15.53:39442) 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f477fe640 1 -- 172.21.15.53:0/2288305531 learned_addr learned my addr 172.21.15.53:0/2288305531 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f477fe640 1 -- 172.21.15.53:0/2288305531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f480caee0 msgr2=0x7f5f480cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:49.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f477fe640 1 --2- 172.21.15.53:0/2288305531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f480caee0 0x7f5f480cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f477fe640 1 -- 172.21.15.53:0/2288305531 >> v1:172.21.15.87:6789/0 conn(0x7f5f480cd320 legacy=0x7f5f480cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:49.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.102+0000 7f5f477fe640 1 -- 172.21.15.53:0/2288305531 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480cbc40 con 0x7f5f48143e80 2024-09-13T18:31:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f477fe640 1 --2- 172.21.15.53:0/2288305531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f48143e80 0x7f5f4806b390 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009e50 tx=0x7f5f3801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fc8d0caf30eedf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:49.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f467fc640 1 -- 172.21.15.53:0/2288305531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380a5790 con 0x7f5f48143e80 2024-09-13T18:31:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f467fc640 1 -- 172.21.15.53:0/2288305531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380a58f0 con 0x7f5f48143e80 2024-09-13T18:31:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f467fc640 1 -- 172.21.15.53:0/2288305531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380a5c80 con 0x7f5f48143e80 2024-09-13T18:31:49.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 -- 172.21.15.53:0/2288305531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f48143e80 msgr2=0x7f5f4806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/2288305531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f48143e80 0x7f5f4806b390 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009e50 tx=0x7f5f3801c930 comp rx=0 tx=0).stop 2024-09-13T18:31:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 -- 172.21.15.53:0/2288305531 shutdown_connections 2024-09-13T18:31:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/2288305531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f480caee0 0x7f5f480cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/2288305531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f48143e80 0x7f5f4806b390 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 -- 172.21.15.53:0/2288305531 >> 172.21.15.53:0/2288305531 conn(0x7f5f48065c80 msgr2=0x7f5f48066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 -- 172.21.15.53:0/2288305531 shutdown_connections 2024-09-13T18:31:49.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 -- 172.21.15.53:0/2288305531 wait complete. 2024-09-13T18:31:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 Processor -- start 2024-09-13T18:31:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.106+0000 7f5f4db3f640 1 -- start start 2024-09-13T18:31:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f480caee0 0x7f5f480af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f480cd320 0x7f5f4813fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f48143e80 0x7f5f4813ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4815b950 con 0x7f5f480cd320 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4815a8b0 con 0x7f5f480caee0 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4815ab90 con 0x7f5f48143e80 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f480cd320 0x7f5f4813fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f480cd320 0x7f5f4813fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39444/0 (socket says 172.21.15.53:39444) 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 -- 172.21.15.53:0/1118239736 learned_addr learned my addr 172.21.15.53:0/1118239736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f477fe640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f480caee0 0x7f5f480af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f47fff640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f48143e80 0x7f5f4813ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 -- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f48143e80 msgr2=0x7f5f4813ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f48143e80 0x7f5f4813ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 -- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f480caee0 msgr2=0x7f5f480af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f480caee0 0x7f5f480af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 -- 172.21.15.53:0/1118239736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009b30 con 0x7f5f480cd320 2024-09-13T18:31:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f477fe640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f480caee0 0x7f5f480af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f46ffd640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f480cd320 0x7f5f4813fa30 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b410 tx=0x7f5f3000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f3ffff640 1 -- 172.21.15.53:0/1118239736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30011830 con 0x7f5f480cd320 2024-09-13T18:31:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f3ffff640 1 -- 172.21.15.53:0/1118239736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30011990 con 0x7f5f480cd320 2024-09-13T18:31:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f3ffff640 1 -- 172.21.15.53:0/1118239736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30011d40 con 0x7f5f480cd320 2024-09-13T18:31:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4815ae70 con 0x7f5f480cd320 2024-09-13T18:31:49.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4815b430 con 0x7f5f480cd320 2024-09-13T18:31:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4815b620 con 0x7f5f480cd320 2024-09-13T18:31:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f3ffff640 1 -- 172.21.15.53:0/1118239736 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5f3001a400 con 0x7f5f480cd320 2024-09-13T18:31:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f3ffff640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5f28066a80 0x7f5f28068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f3ffff640 1 -- 172.21.15.53:0/1118239736 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5f300846f0 con 0x7f5f480cd320 2024-09-13T18:31:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f477fe640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5f28066a80 0x7f5f28068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.110+0000 7f5f477fe640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5f28066a80 0x7f5f28068f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f380ae000 tx=0x7f5f380a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:49.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.114+0000 7f5f3ffff640 1 -- 172.21.15.53:0/1118239736 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f30051810 con 0x7f5f480cd320 2024-09-13T18:31:49.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.274+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f480cb320 con 0x7f5f480cd320 2024-09-13T18:31:49.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.274+0000 7f5f3ffff640 1 -- 172.21.15.53:0/1118239736 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f300150a0 con 0x7f5f480cd320 2024-09-13T18:31:49.277 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5f28066a80 msgr2=0x7f5f28068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5f28066a80 0x7f5f28068f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f380ae000 tx=0x7f5f380a7070 comp rx=0 tx=0).stop 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f480cd320 msgr2=0x7f5f4813fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f480cd320 0x7f5f4813fa30 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b410 tx=0x7f5f3000b8d0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 shutdown_connections 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5f28066a80 0x7f5f28068f40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5f48143e80 0x7f5f4813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f480cd320 0x7f5f4813fa30 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 --2- 172.21.15.53:0/1118239736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5f480caee0 0x7f5f480af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 >> 172.21.15.53:0/1118239736 conn(0x7f5f48065c80 msgr2=0x7f5f4815c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:49.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 shutdown_connections 2024-09-13T18:31:49.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.278+0000 7f5f4db3f640 1 -- 172.21.15.53:0/1118239736 wait complete. 2024-09-13T18:31:49.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-13T18:31:49.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c45a9b640 1 Processor -- start 2024-09-13T18:31:49.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c45a9b640 1 -- start start 2024-09-13T18:31:49.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c45a9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c4015c7b0 0x7f7c400b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c45a9b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c400b5a00 con 0x7f7c400d14e0 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c45a9b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c400b4af0 con 0x7f7c400b4690 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c45a9b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c400b5870 con 0x7f7c4015c7b0 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c3f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c4015c7b0 0x7f7c400b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c3ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c400d14e0 0x7f7c400b5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46422/0 (socket says 172.21.15.53:46422) 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c3ffff640 1 -- 172.21.15.53:0/3164067543 learned_addr learned my addr 172.21.15.53:0/3164067543 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/3164067543 >> v1:172.21.15.87:6789/0 conn(0x7f7c400b4690 legacy=0x7f7c400d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/3164067543 >> v1:172.21.15.53:6789/0 conn(0x7f7c400d14e0 legacy=0x7f7c400b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/3164067543 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400d18f0 con 0x7f7c4015c7b0 2024-09-13T18:31:49.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.422+0000 7f7c3e7fc640 1 -- 172.21.15.53:0/3164067543 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583934246 0 0) 0x7f7c400b5a00 con 0x7f7c400d14e0 2024-09-13T18:31:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c3f7fe640 1 --2- 172.21.15.53:0/3164067543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4015c7b0 0x7f7c400b4150 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f7c300097c0 tx=0x7f7c3001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3919d640ba480c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c3e7fc640 1 -- 172.21.15.53:0/3164067543 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300ac640 con 0x7f7c4015c7b0 2024-09-13T18:31:49.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c3e7fc640 1 -- 172.21.15.53:0/3164067543 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c300ac7a0 con 0x7f7c4015c7b0 2024-09-13T18:31:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c3e7fc640 1 -- 172.21.15.53:0/3164067543 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300acb30 con 0x7f7c4015c7b0 2024-09-13T18:31:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c45a9b640 1 -- 172.21.15.53:0/3164067543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4015c7b0 msgr2=0x7f7c400b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/3164067543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4015c7b0 0x7f7c400b4150 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f7c300097c0 tx=0x7f7c3001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c45a9b640 1 -- 172.21.15.53:0/3164067543 shutdown_connections 2024-09-13T18:31:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/3164067543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c4015c7b0 0x7f7c400b4150 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c45a9b640 1 -- 172.21.15.53:0/3164067543 >> 172.21.15.53:0/3164067543 conn(0x7f7c40065c80 msgr2=0x7f7c40066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c45a9b640 1 -- 172.21.15.53:0/3164067543 shutdown_connections 2024-09-13T18:31:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.426+0000 7f7c45a9b640 1 -- 172.21.15.53:0/3164067543 wait complete. 2024-09-13T18:31:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 Processor -- start 2024-09-13T18:31:49.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 -- start start 2024-09-13T18:31:49.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c400b4690 0x7f7c4014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c400d14e0 0x7f7c400b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c4015c7b0 0x7f7c400c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400c99b0 con 0x7f7c400b4690 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400cc810 con 0x7f7c400d14e0 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400cbf70 con 0x7f7c4015c7b0 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c400b4690 0x7f7c4014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c400b4690 0x7f7c4014ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39468/0 (socket says 172.21.15.53:39468) 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2165836439 learned_addr learned my addr 172.21.15.53:0/2165836439 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c4015c7b0 msgr2=0x7f7c400c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c4015c7b0 0x7f7c400c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3effd640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c400d14e0 0x7f7c400b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c400d14e0 msgr2=0x7f7c400b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c400d14e0 0x7f7c400b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 -- 172.21.15.53:0/2165836439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30009420 con 0x7f7c400b4690 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3effd640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c400d14e0 0x7f7c400b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c3f7fe640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c400b4690 0x7f7c4014ae90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f7c30018ff0 tx=0x7f7c3001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c27fff640 1 -- 172.21.15.53:0/2165836439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300b7860 con 0x7f7c400b4690 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c27fff640 1 -- 172.21.15.53:0/2165836439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c300b79c0 con 0x7f7c400b4690 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c400cc250 con 0x7f7c400b4690 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c27fff640 1 -- 172.21.15.53:0/2165836439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300b7d70 con 0x7f7c400b4690 2024-09-13T18:31:49.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c400cbc00 con 0x7f7c400b4690 2024-09-13T18:31:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c40073860 con 0x7f7c400b4690 2024-09-13T18:31:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.430+0000 7f7c27fff640 1 -- 172.21.15.53:0/2165836439 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7c300b3070 con 0x7f7c400b4690 2024-09-13T18:31:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.434+0000 7f7c27fff640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c2c066a80 0x7f7c2c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.434+0000 7f7c27fff640 1 -- 172.21.15.53:0/2165836439 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c3011f060 con 0x7f7c400b4690 2024-09-13T18:31:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.434+0000 7f7c3effd640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c2c066a80 0x7f7c2c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.434+0000 7f7c3effd640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c2c066a80 0x7f7c2c068f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7c400ccc80 tx=0x7f7c34009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.438+0000 7f7c27fff640 1 -- 172.21.15.53:0/2165836439 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c300ec180 con 0x7f7c400b4690 2024-09-13T18:31:49.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:49.650+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) v1 -- 0x7f7c400b7140 con 0x7f7c400b4690 2024-09-13T18:31:50.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c27fff640 1 -- 172.21.15.53:0/2165836439 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v373) v1 ==== 151+0+0 (secure 0 0 0) 0x7f7c300ef7a0 con 0x7f7c400b4690 2024-09-13T18:31:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c2c066a80 msgr2=0x7f7c2c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c2c066a80 0x7f7c2c068f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7c400ccc80 tx=0x7f7c34009040 comp rx=0 tx=0).stop 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c400b4690 msgr2=0x7f7c4014ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c400b4690 0x7f7c4014ae90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f7c30018ff0 tx=0x7f7c3001ac20 comp rx=0 tx=0).stop 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 shutdown_connections 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c2c066a80 0x7f7c2c068f40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c4015c7b0 0x7f7c400c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c400d14e0 0x7f7c400b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 --2- 172.21.15.53:0/2165836439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c400b4690 0x7f7c4014ae90 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 >> 172.21.15.53:0/2165836439 conn(0x7f7c40065c80 msgr2=0x7f7c400cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 shutdown_connections 2024-09-13T18:31:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.630+0000 7f7c45a9b640 1 -- 172.21.15.53:0/2165836439 wait complete. 2024-09-13T18:31:50.654 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:31:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.778+0000 7fcb1e09c640 1 Processor -- start 2024-09-13T18:31:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.778+0000 7fcb1e09c640 1 -- start start 2024-09-13T18:31:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb1e09c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb18143e80 0x7fcb1806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb1e09c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180caee0 0x7fcb180cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb1e09c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1806f7a0 con 0x7fcb180cd320 2024-09-13T18:31:50.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb1e09c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1806fd60 con 0x7fcb18143e80 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb1e09c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180cb960 con 0x7fcb180caee0 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb18143e80 0x7fcb1806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb18143e80 0x7fcb1806b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39470/0 (socket says 172.21.15.53:39470) 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb177fe640 1 -- 172.21.15.53:0/2647666447 learned_addr learned my addr 172.21.15.53:0/2647666447 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb0effd640 1 --2- 172.21.15.53:0/2647666447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180caee0 0x7fcb180cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb177fe640 1 -- 172.21.15.53:0/2647666447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180caee0 msgr2=0x7fcb180cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb177fe640 1 --2- 172.21.15.53:0/2647666447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180caee0 0x7fcb180cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb177fe640 1 -- 172.21.15.53:0/2647666447 >> v1:172.21.15.87:6789/0 conn(0x7fcb180cd320 legacy=0x7fcb180cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.782+0000 7fcb177fe640 1 -- 172.21.15.53:0/2647666447 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180cbc40 con 0x7fcb18143e80 2024-09-13T18:31:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 --2- 172.21.15.53:0/2647666447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18143e80 0x7fcb1806b390 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009870 tx=0x7fcb0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c8658ef7e63264 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb16ffd640 1 -- 172.21.15.53:0/2647666447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080ab600 con 0x7fcb18143e80 2024-09-13T18:31:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb16ffd640 1 -- 172.21.15.53:0/2647666447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080ab760 con 0x7fcb18143e80 2024-09-13T18:31:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb16ffd640 1 -- 172.21.15.53:0/2647666447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080abaf0 con 0x7fcb18143e80 2024-09-13T18:31:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- 172.21.15.53:0/2647666447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18143e80 msgr2=0x7fcb1806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/2647666447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18143e80 0x7fcb1806b390 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009870 tx=0x7fcb0801c460 comp rx=0 tx=0).stop 2024-09-13T18:31:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- 172.21.15.53:0/2647666447 shutdown_connections 2024-09-13T18:31:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/2647666447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180caee0 0x7fcb180cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/2647666447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb18143e80 0x7fcb1806b390 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- 172.21.15.53:0/2647666447 >> 172.21.15.53:0/2647666447 conn(0x7fcb18065c80 msgr2=0x7fcb18066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- 172.21.15.53:0/2647666447 shutdown_connections 2024-09-13T18:31:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- 172.21.15.53:0/2647666447 wait complete. 2024-09-13T18:31:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 Processor -- start 2024-09-13T18:31:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- start start 2024-09-13T18:31:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb180caee0 0x7fcb1815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180cd320 0x7fcb180ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb18143e80 0x7fcb181f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180aa360 con 0x7fcb180caee0 2024-09-13T18:31:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180aa600 con 0x7fcb18143e80 2024-09-13T18:31:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb1e09c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180aa8e0 con 0x7fcb180cd320 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb180caee0 0x7fcb1815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb180caee0 0x7fcb1815adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39482/0 (socket says 172.21.15.53:39482) 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 -- 172.21.15.53:0/3614537115 learned_addr learned my addr 172.21.15.53:0/3614537115 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb0effd640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180cd320 0x7fcb180ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb17fff640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb18143e80 0x7fcb181f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 -- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180cd320 msgr2=0x7fcb180ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180cd320 0x7fcb180ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 -- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb18143e80 msgr2=0x7fcb181f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb18143e80 0x7fcb181f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.786+0000 7fcb177fe640 1 -- 172.21.15.53:0/3614537115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080094d0 con 0x7fcb180caee0 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb177fe640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb180caee0 0x7fcb1815adc0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ad040 tx=0x7fcb0801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb14ff9640 1 -- 172.21.15.53:0/3614537115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080ab600 con 0x7fcb180caee0 2024-09-13T18:31:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb14ff9640 1 -- 172.21.15.53:0/3614537115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080b4800 con 0x7fcb180caee0 2024-09-13T18:31:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb14ff9640 1 -- 172.21.15.53:0/3614537115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080b4bb0 con 0x7fcb180caee0 2024-09-13T18:31:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180aabc0 con 0x7fcb180caee0 2024-09-13T18:31:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb181434e0 con 0x7fcb180caee0 2024-09-13T18:31:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb180aadb0 con 0x7fcb180caee0 2024-09-13T18:31:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb14ff9640 1 -- 172.21.15.53:0/3614537115 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fcb080b4d10 con 0x7fcb180caee0 2024-09-13T18:31:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb14ff9640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcaf8066a80 0x7fcaf8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb14ff9640 1 -- 172.21.15.53:0/3614537115 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcb0811f170 con 0x7fcb180caee0 2024-09-13T18:31:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb0effd640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcaf8066a80 0x7fcaf8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.790+0000 7fcb0effd640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcaf8066a80 0x7fcaf8068f40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcb181438a0 tx=0x7fcb00008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.794+0000 7fcb14ff9640 1 -- 172.21.15.53:0/3614537115 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcb080ec220 con 0x7fcb180caee0 2024-09-13T18:31:50.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.954+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcb180aaa20 con 0x7fcb180caee0 2024-09-13T18:31:50.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb14ff9640 1 -- 172.21.15.53:0/3614537115 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb180aaa20 con 0x7fcb180caee0 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcaf8066a80 msgr2=0x7fcaf8068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcaf8066a80 0x7fcaf8068f40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcb181438a0 tx=0x7fcb00008040 comp rx=0 tx=0).stop 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb180caee0 msgr2=0x7fcb1815adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb180caee0 0x7fcb1815adc0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ad040 tx=0x7fcb0801aca0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 shutdown_connections 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcaf8066a80 0x7fcaf8068f40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb180cd320 0x7fcb180ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb18143e80 0x7fcb181f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 --2- 172.21.15.53:0/3614537115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb180caee0 0x7fcb1815adc0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 >> 172.21.15.53:0/3614537115 conn(0x7fcb18065c80 msgr2=0x7fcb18157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 shutdown_connections 2024-09-13T18:31:50.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:50.962+0000 7fcb1e09c640 1 -- 172.21.15.53:0/3614537115 wait complete. 2024-09-13T18:31:50.982 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:31:50.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:31:51.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:31:51.132 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:31:51.132 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:51.132 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:51.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:31:51.139 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:31:51.139 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:51.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:31:51.145 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:31:51.145 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:51.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:31:51.193 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:31:51.193 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:31:51.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:31:51.199 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:31:51.199 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.366+0000 7fcfa8d06640 1 Processor -- start 2024-09-13T18:31:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.366+0000 7fcfa8d06640 1 -- start start 2024-09-13T18:31:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa8d06640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcfa40cbe20 0x7fcfa41644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa8d06640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa406cdf0 con 0x7fcfa4159590 2024-09-13T18:31:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa8d06640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa406c1e0 con 0x7fcfa406bc70 2024-09-13T18:31:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa8d06640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa406db90 con 0x7fcfa40cbe20 2024-09-13T18:31:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcfa4159590 0x7fcfa406d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46434/0 (socket says 172.21.15.53:46434) 2024-09-13T18:31:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa259c640 1 -- 172.21.15.53:0/526833870 learned_addr learned my addr 172.21.15.53:0/526833870 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 --2- 172.21.15.53:0/526833870 >> v2:172.21.15.87:3300/0 conn(0x7fcfa40cbe20 0x7fcfa41644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869771893 0 0) 0x7fcfa406cdf0 con 0x7fcfa4159590 2024-09-13T18:31:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf90003530 con 0x7fcfa4159590 2024-09-13T18:31:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 11403993 0 0) 0x7fcf90003530 con 0x7fcfa4159590 2024-09-13T18:31:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 >> v2:172.21.15.87:3300/0 conn(0x7fcfa40cbe20 msgr2=0x7fcfa41644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 --2- 172.21.15.53:0/526833870 >> v2:172.21.15.87:3300/0 conn(0x7fcfa40cbe20 0x7fcfa41644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 >> v1:172.21.15.87:6789/0 conn(0x7fcfa406bc70 legacy=0x7fcfa40cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa406c4c0 con 0x7fcfa4159590 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fcf94001680 con 0x7fcfa4159590 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 >> v1:172.21.15.53:6789/0 conn(0x7fcfa4159590 legacy=0x7fcfa406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf900039b0 0x7fcf90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900047d0 0x7fcf90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf900051e0 0x7fcf9000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa406db90 con 0x7fcf900051e0 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9000c110 con 0x7fcf900047d0 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9000c2d0 con 0x7fcf900039b0 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf900051e0 0x7fcf9000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcf9bfff640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900047d0 0x7fcf90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa259c640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf900039b0 0x7fcf90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 -- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf900039b0 msgr2=0x7fcf90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcf900039b0 0x7fcf90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 -- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900047d0 msgr2=0x7fcf90004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900047d0 0x7fcf90004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 -- 172.21.15.53:0/526833870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90003530 con 0x7fcf900051e0 2024-09-13T18:31:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 -- 172.21.15.53:0/526833870 reap_dead start 2024-09-13T18:31:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.370+0000 7fcfa2d9d640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf900051e0 0x7fcf9000b990 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40b1ac0 tx=0x7fcf9c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c152d913470acf48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c003ba0 con 0x7fcf900051e0 2024-09-13T18:31:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00f040 con 0x7fcf900051e0 2024-09-13T18:31:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa1d9b640 1 -- 172.21.15.53:0/526833870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0a5960 con 0x7fcf900051e0 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- 172.21.15.53:0/526833870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf900051e0 msgr2=0x7fcf9000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf900051e0 0x7fcf9000b990 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40b1ac0 tx=0x7fcf9c01cc60 comp rx=0 tx=0).stop 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- 172.21.15.53:0/526833870 shutdown_connections 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/526833870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf900051e0 0x7fcf9000b990 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- 172.21.15.53:0/526833870 >> 172.21.15.53:0/526833870 conn(0x7fcfa40b0a30 msgr2=0x7fcfa40b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- 172.21.15.53:0/526833870 shutdown_connections 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- 172.21.15.53:0/526833870 wait complete. 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 Processor -- start 2024-09-13T18:31:51.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- start start 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900051e0 0x7fcfa415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa414f400 0x7fcfa414f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfa4154760 0x7fcfa4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4151900 con 0x7fcfa414f400 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa414fdc0 con 0x7fcf900051e0 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa41508f0 con 0x7fcfa4154760 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa414f400 0x7fcfa414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa414f400 0x7fcfa414f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39504/0 (socket says 172.21.15.53:39504) 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 -- 172.21.15.53:0/2709559713 learned_addr learned my addr 172.21.15.53:0/2709559713 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:51.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa259c640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900051e0 0x7fcfa415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa2d9d640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfa4154760 0x7fcfa4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 -- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfa4154760 msgr2=0x7fcfa4154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfa4154760 0x7fcfa4154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 -- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900051e0 msgr2=0x7fcfa415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900051e0 0x7fcfa415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 -- 172.21.15.53:0/2709559713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4150b40 con 0x7fcfa414f400 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa259c640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900051e0 0x7fcfa415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9bfff640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa414f400 0x7fcfa414f880 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00e4e0 tx=0x7fcf8c00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9affd640 1 -- 172.21.15.53:0/2709559713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0052e0 con 0x7fcfa414f400 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9affd640 1 -- 172.21.15.53:0/2709559713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c005440 con 0x7fcfa414f400 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcf9affd640 1 -- 172.21.15.53:0/2709559713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c003870 con 0x7fcfa414f400 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa4150e20 con 0x7fcfa414f400 2024-09-13T18:31:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.374+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa41513e0 con 0x7fcfa414f400 2024-09-13T18:31:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.378+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa4151570 con 0x7fcfa414f400 2024-09-13T18:31:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.378+0000 7fcf9affd640 1 -- 172.21.15.53:0/2709559713 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fcf8c0039d0 con 0x7fcfa414f400 2024-09-13T18:31:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.378+0000 7fcf9affd640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcf84066a80 0x7fcf84068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.378+0000 7fcf9affd640 1 -- 172.21.15.53:0/2709559713 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf8c0842a0 con 0x7fcfa414f400 2024-09-13T18:31:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.378+0000 7fcfa259c640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcf84066a80 0x7fcf84068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.378+0000 7fcfa259c640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcf84066a80 0x7fcf84068f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf940053a0 tx=0x7fcf94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.382+0000 7fcf9affd640 1 -- 172.21.15.53:0/2709559713 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf8c0513c0 con 0x7fcfa414f400 2024-09-13T18:31:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfa40b0e10 con 0x7fcfa414f400 2024-09-13T18:31:51.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcf9affd640 1 -- 172.21.15.53:0/2709559713 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fcf8c0549e0 con 0x7fcfa414f400 2024-09-13T18:31:51.579 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:51.580 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/1892947074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1892947074},{"type":"v1","addr":"172.21.15.87:6834","nonce":1892947074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3784505733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3784505733},{"type":"v1","addr":"172.21.15.87:6835","nonce":3784505733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/945674829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":945674829},{"type":"v1","addr":"172.21.15.53:6833","nonce":945674829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8403,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1758164963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1758164963},{"type":"v1","addr":"172.21.15.53:6835","nonce":1758164963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2024-09-13T18:31:51.580 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 65 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcf84066a80 msgr2=0x7fcf84068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcf84066a80 0x7fcf84068f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcf940053a0 tx=0x7fcf94009040 comp rx=0 tx=0).stop 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa414f400 msgr2=0x7fcfa414f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa414f400 0x7fcfa414f880 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00e4e0 tx=0x7fcf8c00e9a0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 shutdown_connections 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcf84066a80 0x7fcf84068f40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcfa4154760 0x7fcfa4154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfa414f400 0x7fcfa414f880 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 --2- 172.21.15.53:0/2709559713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf900051e0 0x7fcfa415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.578+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 >> 172.21.15.53:0/2709559713 conn(0x7fcfa40b0a30 msgr2=0x7fcfa41573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.582+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 shutdown_connections 2024-09-13T18:31:51.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.582+0000 7fcfa8d06640 1 -- 172.21.15.53:0/2709559713 wait complete. 2024-09-13T18:31:51.600 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:31:51.600 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:31:51.600 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:31:51.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:31:51.601 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:31:51.601 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:31:51.601 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:31:51.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:31:51.601 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:31:51.601 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:31:51.602 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:31:51.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:31:51.602 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:31:51.602 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:31:51.602 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:31:51.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:31:51.611 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:31:51.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:31:51.614 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:31:51.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:31:51.616 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:31:51.617 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:31:51.617 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:31:51.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:31:51.658 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:31:51.659 DEBUG:teuthology.parallel:result is None 2024-09-13T18:31:51.660 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:31:51.660 DEBUG:teuthology.parallel:result is None 2024-09-13T18:31:51.661 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:31:51.661 DEBUG:teuthology.parallel:result is None 2024-09-13T18:31:51.662 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:31:51.662 DEBUG:teuthology.parallel:result is None 2024-09-13T18:31:51.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:31:51.725 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:31:51.727 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:31:51.730 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:31:51.735 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:31:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d82e8b640 1 Processor -- start 2024-09-13T18:31:51.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d82e8b640 1 -- start start 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d82e8b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 0x7f9d7c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d82e8b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0d2400 con 0x7f9d7c0cf600 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d82e8b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0d1530 con 0x7f9d7c15cab0 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d82e8b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cfab0 con 0x7f9d7c0d19c0 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9d7c0cf600 0x7f9d7c0b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46440/0 (socket says 172.21.15.53:46440) 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 -- 172.21.15.53:0/3485978890 learned_addr learned my addr 172.21.15.53:0/3485978890 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7bfff640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 0x7f9d7c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760793643 0 0) 0x7f9d7c0d2400 con 0x7f9d7c0cf600 2024-09-13T18:31:51.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d64003530 con 0x7f9d7c0cf600 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1985478123 0 0) 0x7f9d64003530 con 0x7f9d7c0cf600 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 msgr2=0x7f9d7c0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 0x7f9d7c0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 >> v1:172.21.15.87:6789/0 conn(0x7f9d7c15cab0 legacy=0x7f9d7c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0cddd0 con 0x7f9d7c0cf600 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9d74001a00 con 0x7f9d7c0cf600 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 >> v1:172.21.15.53:6789/0 conn(0x7f9d7c0cf600 legacy=0x7f9d7c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d640039b0 0x7f9d64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 0x7f9d640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d64004d10 0x7f9d64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cfab0 con 0x7f9d64004d10 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400ba70 con 0x7f9d640039b0 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400bc30 con 0x7f9d7c0d19c0 2024-09-13T18:31:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d64004d10 0x7f9d64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d80c27640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d640039b0 0x7f9d64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d7bfff640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 0x7f9d640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 -- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 msgr2=0x7f9d640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d7c0d19c0 0x7f9d640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 -- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d640039b0 msgr2=0x7f9d64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:51.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d640039b0 0x7f9d64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.782+0000 7f9d81428640 1 -- 172.21.15.53:0/3485978890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d64003530 con 0x7f9d64004d10 2024-09-13T18:31:51.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d81428640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d64004d10 0x7f9d64005190 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400a800 tx=0x7f9d7401d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9382986e77c6122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740072d0 con 0x7f9d64004d10 2024-09-13T18:31:51.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740a8070 con 0x7f9d64004d10 2024-09-13T18:31:51.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d7b7fe640 1 -- 172.21.15.53:0/3485978890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740076b0 con 0x7f9d64004d10 2024-09-13T18:31:51.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d82e8b640 1 -- 172.21.15.53:0/3485978890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d64004d10 msgr2=0x7f9d64005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d82e8b640 1 --2- 172.21.15.53:0/3485978890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d64004d10 0x7f9d64005190 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400a800 tx=0x7f9d7401d320 comp rx=0 tx=0).stop 2024-09-13T18:31:51.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d81428640 1 -- 172.21.15.53:0/3485978890 reap_dead start 2024-09-13T18:31:51.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d82e8b640 1 -- 172.21.15.53:0/3485978890 shutdown_connections 2024-09-13T18:31:51.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d82e8b640 1 -- 172.21.15.53:0/3485978890 >> 172.21.15.53:0/3485978890 conn(0x7f9d7c065c80 msgr2=0x7f9d7c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:51.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d82e8b640 1 -- 172.21.15.53:0/3485978890 shutdown_connections 2024-09-13T18:31:51.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d82e8b640 1 -- 172.21.15.53:0/3485978890 wait complete. 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.786+0000 7f9d82e8b640 1 Processor -- start 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 -- start start 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d64004d10 0x7f9d7c14cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d7c157b10 0x7f9d7c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0cb6f0 0x7f9d7c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cc0b0 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c14d090 con 0x7f9d7c157b10 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c157050 con 0x7f9d64004d10 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0cb6f0 0x7f9d7c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0cb6f0 0x7f9d7c0cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39546/0 (socket says 172.21.15.53:39546) 2024-09-13T18:31:51.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 -- 172.21.15.53:0/952835945 learned_addr learned my addr 172.21.15.53:0/952835945 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d80c27640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d64004d10 0x7f9d7c14cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d7bfff640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d7c157b10 0x7f9d7c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 -- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d64004d10 msgr2=0x7f9d7c14cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d64004d10 0x7f9d7c14cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 -- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d7c157b10 msgr2=0x7f9d7c159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d7c157b10 0x7f9d7c159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 -- 172.21.15.53:0/952835945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0cad10 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d81428640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0cb6f0 0x7f9d7c0cbb70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f9d7401d150 tx=0x7f9d64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d797fa640 1 -- 172.21.15.53:0/952835945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740017c0 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d797fa640 1 -- 172.21.15.53:0/952835945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74001920 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c157310 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d797fa640 1 -- 172.21.15.53:0/952835945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74004d70 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c159770 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c0d11c0 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d797fa640 1 -- 172.21.15.53:0/952835945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9d740aa030 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d797fa640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d68066a80 0x7f9d68068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d797fa640 1 -- 172.21.15.53:0/952835945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d7411d640 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.790+0000 7f9d80c27640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d68066a80 0x7f9d68068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:51.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.794+0000 7f9d80c27640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d68066a80 0x7f9d68068f40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c007fd0 tx=0x7f9d6c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:51.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.798+0000 7f9d797fa640 1 -- 172.21.15.53:0/952835945 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d740ea650 con 0x7f9d7c0cb6f0 2024-09-13T18:31:51.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:51.962+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9d7c0d11c0 con 0x7f9d7c0cb6f0 2024-09-13T18:31:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.778+0000 7f9d797fa640 1 -- 172.21.15.53:0/952835945 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v116) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9d740edc70 con 0x7f9d7c0cb6f0 2024-09-13T18:31:52.781 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:31:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d68066a80 msgr2=0x7f9d68068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d68066a80 0x7f9d68068f40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c007fd0 tx=0x7f9d6c009040 comp rx=0 tx=0).stop 2024-09-13T18:31:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0cb6f0 msgr2=0x7f9d7c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:52.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0cb6f0 0x7f9d7c0cbb70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f9d7401d150 tx=0x7f9d64005800 comp rx=0 tx=0).stop 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 shutdown_connections 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9d68066a80 0x7f9d68068f40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d7c0cb6f0 0x7f9d7c0cbb70 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d7c157b10 0x7f9d7c159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 --2- 172.21.15.53:0/952835945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d64004d10 0x7f9d7c14cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 >> 172.21.15.53:0/952835945 conn(0x7f9d7c065c80 msgr2=0x7f9d7c15a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 shutdown_connections 2024-09-13T18:31:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.782+0000 7f9d82e8b640 1 -- 172.21.15.53:0/952835945 wait complete. 2024-09-13T18:31:52.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:31:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9e5870640 1 Processor -- start 2024-09-13T18:31:52.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9e5870640 1 -- start start 2024-09-13T18:31:52.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9e5870640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 0x7fe9e006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9e5870640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00b2860 con 0x7fe9e00cbb60 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9e5870640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00cb540 con 0x7fe9e0158ba0 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9e5870640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0158f80 con 0x7fe9e006fa80 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9df7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe9e00cbb60 0x7fe9e00cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46442/0 (socket says 172.21.15.53:46442) 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9df7fe640 1 -- 172.21.15.53:0/3352167286 learned_addr learned my addr 172.21.15.53:0/3352167286 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9de7fc640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 0x7fe9e006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033115479 0 0) 0x7fe9e00b2860 con 0x7fe9e00cbb60 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9cc003530 con 0x7fe9e00cbb60 2024-09-13T18:31:52.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1817731719 0 0) 0x7fe9cc003530 con 0x7fe9e00cbb60 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 msgr2=0x7fe9e006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 0x7fe9e006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 >> v1:172.21.15.87:6789/0 conn(0x7fe9e0158ba0 legacy=0x7fe9e006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00b2580 con 0x7fe9e00cbb60 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe9d8001a00 con 0x7fe9e00cbb60 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 >> v1:172.21.15.53:6789/0 conn(0x7fe9e00cbb60 legacy=0x7fe9e00cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc0039b0 0x7fe9cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0047d0 0x7fe9cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 0x7fe9cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0158f80 con 0x7fe9cc0039b0 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc00bac0 con 0x7fe9cc0047d0 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc00bc80 con 0x7fe9e006fa80 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9deffd640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc0039b0 0x7fe9cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9de7fc640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0047d0 0x7fe9cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9df7fe640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 0x7fe9cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9deffd640 1 -- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 msgr2=0x7fe9cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9deffd640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9e006fa80 0x7fe9cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9deffd640 1 -- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0047d0 msgr2=0x7fe9cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9deffd640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9cc0047d0 0x7fe9cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.930+0000 7fe9deffd640 1 -- 172.21.15.53:0/3352167286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc003530 con 0x7fe9cc0039b0 2024-09-13T18:31:52.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9deffd640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc0039b0 0x7fe9cc003dd0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8001360 tx=0x7fe9c801e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55249c345885629c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80052d0 con 0x7fe9cc0039b0 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8005450 con 0x7fe9cc0039b0 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9ddffb640 1 -- 172.21.15.53:0/3352167286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8003840 con 0x7fe9cc0039b0 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 -- 172.21.15.53:0/3352167286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc0039b0 msgr2=0x7fe9cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 --2- 172.21.15.53:0/3352167286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9cc0039b0 0x7fe9cc003dd0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8001360 tx=0x7fe9c801e630 comp rx=0 tx=0).stop 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9df7fe640 1 -- 172.21.15.53:0/3352167286 reap_dead start 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 -- 172.21.15.53:0/3352167286 shutdown_connections 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 -- 172.21.15.53:0/3352167286 >> 172.21.15.53:0/3352167286 conn(0x7fe9e0065c80 msgr2=0x7fe9e0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 -- 172.21.15.53:0/3352167286 shutdown_connections 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 -- 172.21.15.53:0/3352167286 wait complete. 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 Processor -- start 2024-09-13T18:31:52.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.934+0000 7fe9e5870640 1 -- start start 2024-09-13T18:31:52.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0039b0 0x7fe9e01f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e00c9dd0 0x7fe9e00aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e00aacf0 0x7fe9e00acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0155670 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00ca250 con 0x7fe9e00aacf0 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00a84d0 con 0x7fe9cc0039b0 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e00c9dd0 0x7fe9e00aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e00c9dd0 0x7fe9e00aa7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39560/0 (socket says 172.21.15.53:39560) 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 -- 172.21.15.53:0/4081169933 learned_addr learned my addr 172.21.15.53:0/4081169933 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9deffd640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0039b0 0x7fe9e01f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9df7fe640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e00aacf0 0x7fe9e00acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 -- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0039b0 msgr2=0x7fe9e01f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0039b0 0x7fe9e01f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 -- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e00aacf0 msgr2=0x7fe9e00acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e00aacf0 0x7fe9e00acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:52.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 -- 172.21.15.53:0/4081169933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00a8d70 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9de7fc640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e00c9dd0 0x7fe9e00aa7b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0011630 tx=0x7fe9d0011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9d7fff640 1 -- 172.21.15.53:0/4081169933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000f8c0 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9d7fff640 1 -- 172.21.15.53:0/4081169933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d000fa20 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9d7fff640 1 -- 172.21.15.53:0/4081169933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000fdd0 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e00ab170 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e00a8720 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e0067400 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9d7fff640 1 -- 172.21.15.53:0/4081169933 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe9d0015460 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9d7fff640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe9c0066a80 0x7fe9c0068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:52.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9d7fff640 1 -- 172.21.15.53:0/4081169933 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe9d0084d60 con 0x7fe9e00c9dd0 2024-09-13T18:31:52.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9deffd640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe9c0066a80 0x7fe9c0068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:52.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.938+0000 7fe9deffd640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe9c0066a80 0x7fe9c0068f40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8001750 tx=0x7fe9c80011a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:52.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:52.942+0000 7fe9d7fff640 1 -- 172.21.15.53:0/4081169933 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9d0051e40 con 0x7fe9e00c9dd0 2024-09-13T18:31:53.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.166+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe9e00a8f00 con 0x7fe9e00c9dd0 2024-09-13T18:31:53.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.166+0000 7fe9d7fff640 1 -- 172.21.15.53:0/4081169933 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe9d0022090 con 0x7fe9e00c9dd0 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.168 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.169 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.170 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.171 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:31:53.172 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.173 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.174 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.175 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:31:53.176 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:31:53.177 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:31:53.178 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:31:53.179 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:31:53.180 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:31:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.166+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe9c0066a80 msgr2=0x7fe9c0068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe9c0066a80 0x7fe9c0068f40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8001750 tx=0x7fe9c80011a0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e00c9dd0 msgr2=0x7fe9e00aa7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e00c9dd0 0x7fe9e00aa7b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0011630 tx=0x7fe9d0011af0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 shutdown_connections 2024-09-13T18:31:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe9c0066a80 0x7fe9c0068f40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9e00aacf0 0x7fe9e00acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9e00c9dd0 0x7fe9e00aa7b0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 --2- 172.21.15.53:0/4081169933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9cc0039b0 0x7fe9e01f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 >> 172.21.15.53:0/4081169933 conn(0x7fe9e0065c80 msgr2=0x7fe9e00b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:53.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 shutdown_connections 2024-09-13T18:31:53.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.170+0000 7fe9e5870640 1 -- 172.21.15.53:0/4081169933 wait complete. 2024-09-13T18:31:53.188 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:53.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.302+0000 7fe47de08640 1 Processor -- start 2024-09-13T18:31:53.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.302+0000 7fe47de08640 1 -- start start 2024-09-13T18:31:53.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe47de08640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4780ae330 0x7fe4780ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe47de08640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe478065c80 0x7fe47806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe47de08640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe47815cb40 0x7fe4780ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe47de08640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe478157040 con 0x7fe478065c80 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe47de08640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4780aec50 con 0x7fe47815cb40 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe47de08640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47815d450 con 0x7fe4780ae330 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe478065c80 0x7fe47806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe478065c80 0x7fe47806c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39562/0 (socket says 172.21.15.53:39562) 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 -- 172.21.15.53:0/3216461023 learned_addr learned my addr 172.21.15.53:0/3216461023 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe477fff640 1 --2- 172.21.15.53:0/3216461023 >> v2:172.21.15.87:3300/0 conn(0x7fe47815cb40 0x7fe4780ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe4777fe640 1 --2- 172.21.15.53:0/3216461023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4780ae330 0x7fe4780ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 -- 172.21.15.53:0/3216461023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4780ae330 msgr2=0x7fe4780ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 --2- 172.21.15.53:0/3216461023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4780ae330 0x7fe4780ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 -- 172.21.15.53:0/3216461023 >> v2:172.21.15.87:3300/0 conn(0x7fe47815cb40 msgr2=0x7fe4780ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 --2- 172.21.15.53:0/3216461023 >> v2:172.21.15.87:3300/0 conn(0x7fe47815cb40 0x7fe4780ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 -- 172.21.15.53:0/3216461023 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47815d730 con 0x7fe478065c80 2024-09-13T18:31:53.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.306+0000 7fe476ffd640 1 --2- 172.21.15.53:0/3216461023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe478065c80 0x7fe47806c5c0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fe4780b27f0 tx=0x7fe46c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bcf7c0dd681822 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe4767fc640 1 -- 172.21.15.53:0/3216461023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0aa610 con 0x7fe478065c80 2024-09-13T18:31:53.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe4767fc640 1 -- 172.21.15.53:0/3216461023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c0a6040 con 0x7fe478065c80 2024-09-13T18:31:53.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe4767fc640 1 -- 172.21.15.53:0/3216461023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0aa990 con 0x7fe478065c80 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- 172.21.15.53:0/3216461023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe478065c80 msgr2=0x7fe47806c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 --2- 172.21.15.53:0/3216461023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe478065c80 0x7fe47806c5c0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fe4780b27f0 tx=0x7fe46c01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- 172.21.15.53:0/3216461023 shutdown_connections 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 --2- 172.21.15.53:0/3216461023 >> v2:172.21.15.87:3300/0 conn(0x7fe47815cb40 0x7fe4780ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 --2- 172.21.15.53:0/3216461023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe478065c80 0x7fe47806c5c0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 --2- 172.21.15.53:0/3216461023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe4780ae330 0x7fe4780ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- 172.21.15.53:0/3216461023 >> 172.21.15.53:0/3216461023 conn(0x7fe478073130 msgr2=0x7fe478069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- 172.21.15.53:0/3216461023 shutdown_connections 2024-09-13T18:31:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- 172.21.15.53:0/3216461023 wait complete. 2024-09-13T18:31:53.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 Processor -- start 2024-09-13T18:31:53.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- start start 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe478065c80 0x7fe4781586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4780ae330 0x7fe47813bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47815cb40 0x7fe478150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe478157420 con 0x7fe47815cb40 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4781505f0 con 0x7fe4780ae330 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe47de08640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780b1b00 con 0x7fe478065c80 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47815cb40 0x7fe478150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47815cb40 0x7fe478150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39564/0 (socket says 172.21.15.53:39564) 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 -- 172.21.15.53:0/692443064 learned_addr learned my addr 172.21.15.53:0/692443064 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:53.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe4777fe640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe478065c80 0x7fe4781586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe476ffd640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4780ae330 0x7fe47813bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 -- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe478065c80 msgr2=0x7fe4781586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe478065c80 0x7fe4781586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 -- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4780ae330 msgr2=0x7fe47813bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4780ae330 0x7fe47813bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 -- 172.21.15.53:0/692443064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c0094d0 con 0x7fe47815cb40 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe476ffd640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4780ae330 0x7fe47813bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.310+0000 7fe477fff640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47815cb40 0x7fe478150ec0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fe470007e60 tx=0x7fe47000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe45ffff640 1 -- 172.21.15.53:0/692443064 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470014420 con 0x7fe47815cb40 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe45ffff640 1 -- 172.21.15.53:0/692443064 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4700145a0 con 0x7fe47815cb40 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47815c000 con 0x7fe47815cb40 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe45ffff640 1 -- 172.21.15.53:0/692443064 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470014950 con 0x7fe47815cb40 2024-09-13T18:31:53.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47813c1b0 con 0x7fe47815cb40 2024-09-13T18:31:53.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe478157210 con 0x7fe47815cb40 2024-09-13T18:31:53.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe45ffff640 1 -- 172.21.15.53:0/692443064 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe470014ab0 con 0x7fe47815cb40 2024-09-13T18:31:53.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe45ffff640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe464066a80 0x7fe464068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe45ffff640 1 -- 172.21.15.53:0/692443064 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe470084e60 con 0x7fe47815cb40 2024-09-13T18:31:53.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe4777fe640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe464066a80 0x7fe464068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.314+0000 7fe4777fe640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe464066a80 0x7fe464068f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe4680045f0 tx=0x7fe468008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.318+0000 7fe45ffff640 1 -- 172.21.15.53:0/692443064 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe470051f00 con 0x7fe47815cb40 2024-09-13T18:31:53.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.478+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4780ae710 con 0x7fe47815cb40 2024-09-13T18:31:53.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.478+0000 7fe45ffff640 1 -- 172.21.15.53:0/692443064 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+12807 (secure 0 0 0) 0x7fe470055520 con 0x7fe47815cb40 2024-09-13T18:31:53.480 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:53.480 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":116,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:52.769977+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:53.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe464066a80 msgr2=0x7fe464068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe464066a80 0x7fe464068f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe4680045f0 tx=0x7fe468008040 comp rx=0 tx=0).stop 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47815cb40 msgr2=0x7fe478150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47815cb40 0x7fe478150ec0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fe470007e60 tx=0x7fe47000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 shutdown_connections 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe464066a80 0x7fe464068f40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47815cb40 0x7fe478150ec0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4780ae330 0x7fe47813bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 --2- 172.21.15.53:0/692443064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe478065c80 0x7fe4781586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 >> 172.21.15.53:0/692443064 conn(0x7fe478073130 msgr2=0x7fe478153c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 shutdown_connections 2024-09-13T18:31:53.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.482+0000 7fe47de08640 1 -- 172.21.15.53:0/692443064 wait complete. 2024-09-13T18:31:53.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:31:53.499 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:31:53.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.614+0000 7f1d1cb1b640 1 Processor -- start 2024-09-13T18:31:53.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.614+0000 7f1d1cb1b640 1 -- start start 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1d1815c840 0x7f1d180b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d180ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1806a540 con 0x7f1d1806b5e0 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1806b1c0 con 0x7f1d1815c840 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1806a820 con 0x7f1d180d0c10 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1d1815c840 0x7f1d180b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1d1815c840 0x7f1d180b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39572/0 (socket says 172.21.15.53:39572) 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 -- 172.21.15.53:0/951728819 learned_addr learned my addr 172.21.15.53:0/951728819 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 -- 172.21.15.53:0/951728819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 msgr2=0x7f1d180ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d16d9d640 1 --2- 172.21.15.53:0/951728819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d180ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 --2- 172.21.15.53:0/951728819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d180ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 -- 172.21.15.53:0/951728819 >> v1:172.21.15.53:6789/0 conn(0x7f1d1806b5e0 legacy=0x7f1d180d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1559a640 1 -- 172.21.15.53:0/951728819 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196901698 0 0) 0x7f1d1806a540 con 0x7f1d1806b5e0 2024-09-13T18:31:53.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 -- 172.21.15.53:0/951728819 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1806ab00 con 0x7f1d1815c840 2024-09-13T18:31:53.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1659c640 1 --2- 172.21.15.53:0/951728819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1815c840 0x7f1d180b5270 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009870 tx=0x7f1d0801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1886f798a7b7380a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1559a640 1 -- 172.21.15.53:0/951728819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080a9610 con 0x7f1d1815c840 2024-09-13T18:31:53.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1559a640 1 -- 172.21.15.53:0/951728819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d080a9770 con 0x7f1d1815c840 2024-09-13T18:31:53.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1559a640 1 -- 172.21.15.53:0/951728819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080a9b00 con 0x7f1d1815c840 2024-09-13T18:31:53.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/951728819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1815c840 msgr2=0x7f1d180b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/951728819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1815c840 0x7f1d180b5270 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009870 tx=0x7f1d0801c530 comp rx=0 tx=0).stop 2024-09-13T18:31:53.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/951728819 shutdown_connections 2024-09-13T18:31:53.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/951728819 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d180ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/951728819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1815c840 0x7f1d180b5270 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/951728819 >> 172.21.15.53:0/951728819 conn(0x7f1d18071ac0 msgr2=0x7f1d18099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:53.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/951728819 shutdown_connections 2024-09-13T18:31:53.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.618+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/951728819 wait complete. 2024-09-13T18:31:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 Processor -- start 2024-09-13T18:31:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 -- start start 2024-09-13T18:31:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1806b5e0 0x7f1d1809a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d18156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d1815c840 0x7f1d1815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18155ec0 con 0x7f1d1806b5e0 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18156860 con 0x7f1d1815c840 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18160f40 con 0x7f1d180d0c10 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1806b5e0 0x7f1d1809a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1806b5e0 0x7f1d1809a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39582/0 (socket says 172.21.15.53:39582) 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 -- 172.21.15.53:0/835718023 learned_addr learned my addr 172.21.15.53:0/835718023 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d15d9b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d18156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d16d9d640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d1815c840 0x7f1d1815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 -- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 msgr2=0x7f1d18156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d18156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 -- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d1815c840 msgr2=0x7f1d1815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d1815c840 0x7f1d1815e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 -- 172.21.15.53:0/835718023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080094d0 con 0x7f1d1806b5e0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d15d9b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d18156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1659c640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1806b5e0 0x7f1d1809a660 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f1d0801a160 tx=0x7f1d080192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d06ffd640 1 -- 172.21.15.53:0/835718023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08004220 con 0x7f1d1806b5e0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d06ffd640 1 -- 172.21.15.53:0/835718023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d08004380 con 0x7f1d1806b5e0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d181562a0 con 0x7f1d1806b5e0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d06ffd640 1 -- 172.21.15.53:0/835718023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08003840 con 0x7f1d1806b5e0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1809aba0 con 0x7f1d1806b5e0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d180670f0 con 0x7f1d1806b5e0 2024-09-13T18:31:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.622+0000 7f1d06ffd640 1 -- 172.21.15.53:0/835718023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f1d080039a0 con 0x7f1d1806b5e0 2024-09-13T18:31:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.626+0000 7f1d06ffd640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cf8066ab0 0x7f1cf8068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.626+0000 7f1d06ffd640 1 -- 172.21.15.53:0/835718023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d0811e900 con 0x7f1d1806b5e0 2024-09-13T18:31:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.626+0000 7f1d15d9b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cf8066ab0 0x7f1cf8068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.626+0000 7f1d15d9b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cf8066ab0 0x7f1cf8068f70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d1815d6b0 tx=0x7f1d0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.630+0000 7f1d06ffd640 1 -- 172.21.15.53:0/835718023 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d080eb890 con 0x7f1d1806b5e0 2024-09-13T18:31:53.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.786+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d18156100 con 0x7f1d1806b5e0 2024-09-13T18:31:53.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d06ffd640 1 -- 172.21.15.53:0/835718023 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d18156100 con 0x7f1d1806b5e0 2024-09-13T18:31:53.791 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cf8066ab0 msgr2=0x7f1cf8068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cf8066ab0 0x7f1cf8068f70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d1815d6b0 tx=0x7f1d0c009040 comp rx=0 tx=0).stop 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1806b5e0 msgr2=0x7f1d1809a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1806b5e0 0x7f1d1809a660 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f1d0801a160 tx=0x7f1d080192d0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 shutdown_connections 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cf8066ab0 0x7f1cf8068f70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1d180d0c10 0x7f1d18156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d1815c840 0x7f1d1815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 --2- 172.21.15.53:0/835718023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d1806b5e0 0x7f1d1809a660 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 >> 172.21.15.53:0/835718023 conn(0x7f1d18071ac0 msgr2=0x7f1d18166e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:53.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 shutdown_connections 2024-09-13T18:31:53.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.790+0000 7f1d1cb1b640 1 -- 172.21.15.53:0/835718023 wait complete. 2024-09-13T18:31:53.810 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:31:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72cadd3640 1 Processor -- start 2024-09-13T18:31:53.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72cadd3640 1 -- start start 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72cadd3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f72c41580e0 0x7f72c415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72cadd3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72c415c2a0 0x7f72c415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72cadd3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c415c760 con 0x7f72c415dd40 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72cadd3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c415ca40 con 0x7f72c41580e0 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72cadd3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c415cd20 con 0x7f72c415c2a0 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c8b6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f72c41580e0 0x7f72c415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c9370640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f72c415dd40 0x7f72c4158800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46458/0 (socket says 172.21.15.53:46458) 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c9370640 1 -- 172.21.15.53:0/2422705650 learned_addr learned my addr 172.21.15.53:0/2422705650 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:53.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c3fff640 1 --2- 172.21.15.53:0/2422705650 >> v2:172.21.15.87:3300/0 conn(0x7f72c415c2a0 0x7f72c415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c8b6f640 1 -- 172.21.15.53:0/2422705650 >> v2:172.21.15.87:3300/0 conn(0x7f72c415c2a0 msgr2=0x7f72c415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c8b6f640 1 --2- 172.21.15.53:0/2422705650 >> v2:172.21.15.87:3300/0 conn(0x7f72c415c2a0 0x7f72c415d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c8b6f640 1 -- 172.21.15.53:0/2422705650 >> v1:172.21.15.53:6789/0 conn(0x7f72c415dd40 legacy=0x7f72c4158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.922+0000 7f72c8b6f640 1 -- 172.21.15.53:0/2422705650 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c415d000 con 0x7f72c41580e0 2024-09-13T18:31:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c8b6f640 1 --2- 172.21.15.53:0/2422705650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c41580e0 0x7f72c415bd60 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f72c40b3990 tx=0x7f72b801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572476715927b14b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c37fe640 1 -- 172.21.15.53:0/2422705650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b80ad660 con 0x7f72c41580e0 2024-09-13T18:31:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c37fe640 1 -- 172.21.15.53:0/2422705650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b80ad7c0 con 0x7f72c41580e0 2024-09-13T18:31:53.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c37fe640 1 -- 172.21.15.53:0/2422705650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b80adb50 con 0x7f72c41580e0 2024-09-13T18:31:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- 172.21.15.53:0/2422705650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c41580e0 msgr2=0x7f72c415bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 --2- 172.21.15.53:0/2422705650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c41580e0 0x7f72c415bd60 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f72c40b3990 tx=0x7f72b801c450 comp rx=0 tx=0).stop 2024-09-13T18:31:53.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- 172.21.15.53:0/2422705650 shutdown_connections 2024-09-13T18:31:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 --2- 172.21.15.53:0/2422705650 >> v2:172.21.15.87:3300/0 conn(0x7f72c415c2a0 0x7f72c415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 --2- 172.21.15.53:0/2422705650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c41580e0 0x7f72c415bd60 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- 172.21.15.53:0/2422705650 >> 172.21.15.53:0/2422705650 conn(0x7f72c4071ac0 msgr2=0x7f72c4099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- 172.21.15.53:0/2422705650 shutdown_connections 2024-09-13T18:31:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- 172.21.15.53:0/2422705650 wait complete. 2024-09-13T18:31:53.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 Processor -- start 2024-09-13T18:31:53.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- start start 2024-09-13T18:31:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c41580e0 0x7f72c413eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72c415c2a0 0x7f72c409c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c415dd40 0x7f72c409ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c409b3b0 con 0x7f72c415dd40 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c409e3d0 con 0x7f72c41580e0 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72cadd3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c409d330 con 0x7f72c415c2a0 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c415dd40 0x7f72c409ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c415dd40 0x7f72c409ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39590/0 (socket says 172.21.15.53:39590) 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 -- 172.21.15.53:0/1039345767 learned_addr learned my addr 172.21.15.53:0/1039345767 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c3fff640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72c415c2a0 0x7f72c409c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 -- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72c415c2a0 msgr2=0x7f72c409c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72c415c2a0 0x7f72c409c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c8b6f640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c41580e0 0x7f72c413eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 -- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c41580e0 msgr2=0x7f72c413eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c41580e0 0x7f72c413eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.926+0000 7f72c9370640 1 -- 172.21.15.53:0/1039345767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b8009420 con 0x7f72c415dd40 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c9370640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c415dd40 0x7f72c409ccb0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00ca80 tx=0x7f72bc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c17fa640 1 -- 172.21.15.53:0/1039345767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00ac30 con 0x7f72c415dd40 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c17fa640 1 -- 172.21.15.53:0/1039345767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc00ad90 con 0x7f72c415dd40 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c409d610 con 0x7f72c415dd40 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c17fa640 1 -- 172.21.15.53:0/1039345767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc012600 con 0x7f72c415dd40 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c409dbd0 con 0x7f72c415dd40 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c409a180 con 0x7f72c415dd40 2024-09-13T18:31:53.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c17fa640 1 -- 172.21.15.53:0/1039345767 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f72bc007070 con 0x7f72c415dd40 2024-09-13T18:31:53.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c17fa640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f72b0066a80 0x7f72b0068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:53.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c17fa640 1 -- 172.21.15.53:0/1039345767 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f72bc084330 con 0x7f72c415dd40 2024-09-13T18:31:53.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c8b6f640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f72b0066a80 0x7f72b0068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:53.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.930+0000 7f72c8b6f640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f72b0066a80 0x7f72b0068f40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72b80af000 tx=0x7f72b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:53.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:53.934+0000 7f72c17fa640 1 -- 172.21.15.53:0/1039345767 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72bc0514c0 con 0x7f72c415dd40 2024-09-13T18:31:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.094+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f72c415bd60 con 0x7f72c415dd40 2024-09-13T18:31:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.094+0000 7f72c17fa640 1 -- 172.21.15.53:0/1039345767 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v116) v1 ==== 84+0+65 (secure 0 0 0) 0x7f72bc054ae0 con 0x7f72c415dd40 2024-09-13T18:31:54.096 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:54.096 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:31:54.096 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:31:54.096 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:31:54.096 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:31:54.097 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:31:54.097 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:31:54.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f72b0066a80 msgr2=0x7f72b0068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f72b0066a80 0x7f72b0068f40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72b80af000 tx=0x7f72b8008040 comp rx=0 tx=0).stop 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c415dd40 msgr2=0x7f72c409ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c415dd40 0x7f72c409ccb0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00ca80 tx=0x7f72bc00cf40 comp rx=0 tx=0).stop 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 shutdown_connections 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f72b0066a80 0x7f72b0068f40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72c415c2a0 0x7f72c409c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72c415dd40 0x7f72c409ccb0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 --2- 172.21.15.53:0/1039345767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72c41580e0 0x7f72c413eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 >> 172.21.15.53:0/1039345767 conn(0x7f72c4071ac0 msgr2=0x7f72c4164550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 shutdown_connections 2024-09-13T18:31:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.098+0000 7f72cadd3640 1 -- 172.21.15.53:0/1039345767 wait complete. 2024-09-13T18:31:54.114 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:31:54.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:31:54.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85b4c5a640 1 Processor -- start 2024-09-13T18:31:54.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85b4c5a640 1 -- start start 2024-09-13T18:31:54.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85b4c5a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85b00cdb70 0x7f85b00cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85b4c5a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85b00cf620 0x7f85b00b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85b4c5a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b00cfa50 con 0x7f85b015c860 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85b4c5a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b00d1b20 con 0x7f85b00cf620 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85b4c5a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b00d1d10 con 0x7f85b00cdb70 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85aed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85b00cf620 0x7f85b00b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85ae59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f85b015c860 0x7f85b00d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46462/0 (socket says 172.21.15.53:46462) 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85aed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85b00cf620 0x7f85b00b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39598/0 (socket says 172.21.15.53:39598) 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85ae59c640 1 -- 172.21.15.53:0/1917569662 learned_addr learned my addr 172.21.15.53:0/1917569662 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85add9b640 1 --2- 172.21.15.53:0/1917569662 >> v2:172.21.15.87:3300/0 conn(0x7f85b00cdb70 0x7f85b00cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85aed9d640 1 -- 172.21.15.53:0/1917569662 >> v2:172.21.15.87:3300/0 conn(0x7f85b00cdb70 msgr2=0x7f85b00cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85aed9d640 1 --2- 172.21.15.53:0/1917569662 >> v2:172.21.15.87:3300/0 conn(0x7f85b00cdb70 0x7f85b00cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85aed9d640 1 -- 172.21.15.53:0/1917569662 >> v1:172.21.15.53:6789/0 conn(0x7f85b015c860 legacy=0x7f85b00d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85aed9d640 1 -- 172.21.15.53:0/1917569662 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00d1ff0 con 0x7f85b00cf620 2024-09-13T18:31:54.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.230+0000 7f85ad59a640 1 -- 172.21.15.53:0/1917569662 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754750183 0 0) 0x7f85b00cfa50 con 0x7f85b015c860 2024-09-13T18:31:54.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85aed9d640 1 --2- 172.21.15.53:0/1917569662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cf620 0x7f85b00b6100 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f85b0071420 tx=0x7f85a801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569fecce60697ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:54.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85ad59a640 1 -- 172.21.15.53:0/1917569662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80af600 con 0x7f85b00cf620 2024-09-13T18:31:54.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85ad59a640 1 -- 172.21.15.53:0/1917569662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a80ab050 con 0x7f85b00cf620 2024-09-13T18:31:54.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85ad59a640 1 -- 172.21.15.53:0/1917569662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80af980 con 0x7f85b00cf620 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- 172.21.15.53:0/1917569662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cf620 msgr2=0x7f85b00b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/1917569662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cf620 0x7f85b00b6100 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f85b0071420 tx=0x7f85a801f110 comp rx=0 tx=0).stop 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- 172.21.15.53:0/1917569662 shutdown_connections 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/1917569662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cf620 0x7f85b00b6100 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/1917569662 >> v2:172.21.15.87:3300/0 conn(0x7f85b00cdb70 0x7f85b00cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- 172.21.15.53:0/1917569662 >> 172.21.15.53:0/1917569662 conn(0x7f85b0065c80 msgr2=0x7f85b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- 172.21.15.53:0/1917569662 shutdown_connections 2024-09-13T18:31:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- 172.21.15.53:0/1917569662 wait complete. 2024-09-13T18:31:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 Processor -- start 2024-09-13T18:31:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- start start 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cdb70 0x7f85b00b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85b00cf620 0x7f85b00b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85b015c860 0x7f85b00b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00b4d00 con 0x7f85b00cdb70 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00c6160 con 0x7f85b00cf620 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85b4c5a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00c6440 con 0x7f85b015c860 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.234+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cdb70 0x7f85b00b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cdb70 0x7f85b00b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39608/0 (socket says 172.21.15.53:39608) 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 -- 172.21.15.53:0/43196629 learned_addr learned my addr 172.21.15.53:0/43196629 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85aed9d640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85b015c860 0x7f85b00b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 -- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85b015c860 msgr2=0x7f85b00b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85add9b640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85b00cf620 0x7f85b00b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85b015c860 0x7f85b00b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 -- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85b00cf620 msgr2=0x7f85b00b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85b00cf620 0x7f85b00b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 -- 172.21.15.53:0/43196629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8009a70 con 0x7f85b00cdb70 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85aed9d640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85b015c860 0x7f85b00b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85ae59c640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cdb70 0x7f85b00b46b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c480 tx=0x7f85a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f859effd640 1 -- 172.21.15.53:0/43196629 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00074e0 con 0x7f85b00cdb70 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f859effd640 1 -- 172.21.15.53:0/43196629 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a0007660 con 0x7f85b00cdb70 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f859effd640 1 -- 172.21.15.53:0/43196629 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0004a30 con 0x7f85b00cdb70 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b00c6720 con 0x7f85b00cdb70 2024-09-13T18:31:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b014fe90 con 0x7f85b00cdb70 2024-09-13T18:31:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b00cf0e0 con 0x7f85b00cdb70 2024-09-13T18:31:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f859effd640 1 -- 172.21.15.53:0/43196629 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f85a0004b90 con 0x7f85b00cdb70 2024-09-13T18:31:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f859effd640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8590066a80 0x7f8590068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f859effd640 1 -- 172.21.15.53:0/43196629 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85a00836c0 con 0x7f85b00cdb70 2024-09-13T18:31:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.238+0000 7f85add9b640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8590066a80 0x7f8590068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.242+0000 7f85add9b640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8590066a80 0x7f8590068f40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85b0159bf0 tx=0x7f85a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:54.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.246+0000 7f859effd640 1 -- 172.21.15.53:0/43196629 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f85a00542c0 con 0x7f85b00cdb70 2024-09-13T18:31:54.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.398+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f85b00cd950 con 0x7f85b00cdb70 2024-09-13T18:31:54.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.654+0000 7f859effd640 1 -- 172.21.15.53:0/43196629 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v117) v1 ==== 138+0+0 (secure 0 0 0) 0x7f85a00180b0 con 0x7f85b00cdb70 2024-09-13T18:31:54.655 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:31:54.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.658+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8590066a80 msgr2=0x7f8590068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.658+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8590066a80 0x7f8590068f40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f85b0159bf0 tx=0x7f85a4008040 comp rx=0 tx=0).stop 2024-09-13T18:31:54.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.658+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cdb70 msgr2=0x7f85b00b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.658+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cdb70 0x7f85b00b46b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c480 tx=0x7f85a000c940 comp rx=0 tx=0).stop 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 shutdown_connections 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8590066a80 0x7f8590068f40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85b015c860 0x7f85b00b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85b00cf620 0x7f85b00b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 --2- 172.21.15.53:0/43196629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85b00cdb70 0x7f85b00b46b0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 >> 172.21.15.53:0/43196629 conn(0x7f85b0065c80 msgr2=0x7f85b00d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 shutdown_connections 2024-09-13T18:31:54.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.662+0000 7f85b4c5a640 1 -- 172.21.15.53:0/43196629 wait complete. 2024-09-13T18:31:54.688 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:31:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe3629a5640 1 Processor -- start 2024-09-13T18:31:54.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe3629a5640 1 -- start start 2024-09-13T18:31:54.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe3629a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 0x7fe35c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe3629a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe35c0cda30 0x7fe35c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe3629a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c06f7a0 con 0x7fe35c0caee0 2024-09-13T18:31:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe3629a5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c06fd60 con 0x7fe35c0cda30 2024-09-13T18:31:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe3629a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0cb960 con 0x7fe35c143e80 2024-09-13T18:31:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe35b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe35c0caee0 0x7fe35c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46468/0 (socket says 172.21.15.53:46468) 2024-09-13T18:31:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.822+0000 7fe35b7fe640 1 -- 172.21.15.53:0/3747520832 learned_addr learned my addr 172.21.15.53:0/3747520832 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe360f42640 1 --2- 172.21.15.53:0/3747520832 >> v2:172.21.15.87:3300/0 conn(0x7fe35c0cda30 0x7fe35c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35bfff640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 0x7fe35c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700859073 0 0) 0x7fe35c06f7a0 con 0x7fe35c0caee0 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe344003530 con 0x7fe35c0caee0 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657905256 0 0) 0x7fe344003530 con 0x7fe35c0caee0 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 msgr2=0x7fe35c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 0x7fe35c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 >> v2:172.21.15.87:3300/0 conn(0x7fe35c0cda30 msgr2=0x7fe35c0cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 --2- 172.21.15.53:0/3747520832 >> v2:172.21.15.87:3300/0 conn(0x7fe35c0cda30 0x7fe35c0cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0cbc40 con 0x7fe35c0caee0 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe350001680 con 0x7fe35c0caee0 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 >> v1:172.21.15.53:6789/0 conn(0x7fe35c0caee0 legacy=0x7fe35c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 0x7fe344003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe344003f00 0x7fe3440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344004d10 0x7fe344005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c06fd60 con 0x7fe344003f00 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0cb960 con 0x7fe344004d10 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34400b9e0 con 0x7fe35c143e80 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35b7fe640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe344003f00 0x7fe3440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35bfff640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 0x7fe344003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe360f42640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344004d10 0x7fe344005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35b7fe640 1 -- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 msgr2=0x7fe344003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35b7fe640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c143e80 0x7fe344003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35b7fe640 1 -- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344004d10 msgr2=0x7fe344005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35b7fe640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344004d10 0x7fe344005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35b7fe640 1 -- 172.21.15.53:0/3747520832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344003530 con 0x7fe344003f00 2024-09-13T18:31:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe360f42640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344004d10 0x7fe344005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:54.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35b7fe640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe344003f00 0x7fe3440047d0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c270 tx=0x7fe35001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710a724d85846f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:54.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500058e0 con 0x7fe344003f00 2024-09-13T18:31:54.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350005a40 con 0x7fe344003f00 2024-09-13T18:31:54.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe35affd640 1 -- 172.21.15.53:0/3747520832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350005e50 con 0x7fe344003f00 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe3629a5640 1 -- 172.21.15.53:0/3747520832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe344003f00 msgr2=0x7fe3440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe3629a5640 1 --2- 172.21.15.53:0/3747520832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe344003f00 0x7fe3440047d0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c270 tx=0x7fe35001cc50 comp rx=0 tx=0).stop 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe360f42640 1 -- 172.21.15.53:0/3747520832 reap_dead start 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe3629a5640 1 -- 172.21.15.53:0/3747520832 shutdown_connections 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.826+0000 7fe3629a5640 1 -- 172.21.15.53:0/3747520832 >> 172.21.15.53:0/3747520832 conn(0x7fe35c065c80 msgr2=0x7fe35c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- 172.21.15.53:0/3747520832 shutdown_connections 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- 172.21.15.53:0/3747520832 wait complete. 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 Processor -- start 2024-09-13T18:31:54.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- start start 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344003f00 0x7fe35c1f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c13d0c0 0x7fe35c13c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35c0c8200 0x7fe35c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c1f5690 con 0x7fe35c0c8200 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c13cde0 con 0x7fe344003f00 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c13e860 con 0x7fe35c13d0c0 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35c0c8200 0x7fe35c0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35c0c8200 0x7fe35c0c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39630/0 (socket says 172.21.15.53:39630) 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 -- 172.21.15.53:0/2972762572 learned_addr learned my addr 172.21.15.53:0/2972762572 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe35b7fe640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c13d0c0 0x7fe35c13c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe35bfff640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344003f00 0x7fe35c1f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 -- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c13d0c0 msgr2=0x7fe35c13c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c13d0c0 0x7fe35c13c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 -- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344003f00 msgr2=0x7fe35c1f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344003f00 0x7fe35c1f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 -- 172.21.15.53:0/2972762572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c13eb40 con 0x7fe35c0c8200 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe360f42640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35c0c8200 0x7fe35c0c9ec0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0cbaa0 tx=0x7fe35400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe358ff9640 1 -- 172.21.15.53:0/2972762572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354017400 con 0x7fe35c0c8200 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe358ff9640 1 -- 172.21.15.53:0/2972762572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354011040 con 0x7fe35c0c8200 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c13ee20 con 0x7fe35c0c8200 2024-09-13T18:31:54.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe358ff9640 1 -- 172.21.15.53:0/2972762572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354017780 con 0x7fe35c0c8200 2024-09-13T18:31:54.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c13f3e0 con 0x7fe35c0c8200 2024-09-13T18:31:54.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.830+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35c13f5d0 con 0x7fe35c0c8200 2024-09-13T18:31:54.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.834+0000 7fe358ff9640 1 -- 172.21.15.53:0/2972762572 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe354021440 con 0x7fe35c0c8200 2024-09-13T18:31:54.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.834+0000 7fe358ff9640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe348066a80 0x7fe348068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:54.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.834+0000 7fe358ff9640 1 -- 172.21.15.53:0/2972762572 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe354084f20 con 0x7fe35c0c8200 2024-09-13T18:31:54.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.834+0000 7fe35bfff640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe348066a80 0x7fe348068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:54.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.834+0000 7fe35bfff640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe348066a80 0x7fe348068f40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009950 tx=0x7fe34c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:54.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.838+0000 7fe358ff9640 1 -- 172.21.15.53:0/2972762572 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe354051e80 con 0x7fe35c0c8200 2024-09-13T18:31:54.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:54.994+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe35c15a970 con 0x7fe35c0c8200 2024-09-13T18:31:55.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:55.418 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:31:55.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.662+0000 7fe358ff9640 1 -- 172.21.15.53:0/2972762572 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v118) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe3540554a0 con 0x7fe35c0c8200 2024-09-13T18:31:55.664 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:31:55.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.670+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe348066a80 msgr2=0x7fe348068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:55.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.670+0000 7fe3629a5640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe348066a80 0x7fe348068f40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009950 tx=0x7fe34c008040 comp rx=0 tx=0).stop 2024-09-13T18:31:55.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.670+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35c0c8200 msgr2=0x7fe35c0c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:55.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.670+0000 7fe3629a5640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35c0c8200 0x7fe35c0c9ec0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0cbaa0 tx=0x7fe35400f4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 shutdown_connections 2024-09-13T18:31:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe348066a80 0x7fe348068f40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe35c13d0c0 0x7fe35c13c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35c0c8200 0x7fe35c0c9ec0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 --2- 172.21.15.53:0/2972762572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe344003f00 0x7fe35c1f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 >> 172.21.15.53:0/2972762572 conn(0x7fe35c065c80 msgr2=0x7fe35c157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 shutdown_connections 2024-09-13T18:31:55.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.674+0000 7fe3629a5640 1 -- 172.21.15.53:0/2972762572 wait complete. 2024-09-13T18:31:55.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:31:55.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b56742640 1 Processor -- start 2024-09-13T18:31:55.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b56742640 1 -- start start 2024-09-13T18:31:55.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b56742640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b50143e80 0x7f0b5006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:55.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b56742640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b500caee0 0x7f0b500cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b56742640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5006f7a0 con 0x7f0b500cd320 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b56742640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5006fd60 con 0x7f0b500caee0 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b56742640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500cb960 con 0x7f0b50143e80 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b500caee0 0x7f0b500cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b500caee0 0x7f0b500cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39632/0 (socket says 172.21.15.53:39632) 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4f7fe640 1 -- 172.21.15.53:0/204486417 learned_addr learned my addr 172.21.15.53:0/204486417 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4ffff640 1 --2- 172.21.15.53:0/204486417 >> v2:172.21.15.87:3300/0 conn(0x7f0b50143e80 0x7f0b5006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4f7fe640 1 -- 172.21.15.53:0/204486417 >> v2:172.21.15.87:3300/0 conn(0x7f0b50143e80 msgr2=0x7f0b5006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4f7fe640 1 --2- 172.21.15.53:0/204486417 >> v2:172.21.15.87:3300/0 conn(0x7f0b50143e80 0x7f0b5006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4f7fe640 1 -- 172.21.15.53:0/204486417 >> v1:172.21.15.87:6789/0 conn(0x7f0b500cd320 legacy=0x7f0b500cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:55.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.826+0000 7f0b4f7fe640 1 -- 172.21.15.53:0/204486417 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500cbc40 con 0x7f0b500caee0 2024-09-13T18:31:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b4f7fe640 1 --2- 172.21.15.53:0/204486417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b500caee0 0x7f0b500cb350 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009870 tx=0x7f0b3801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5627966b296bdc8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b4effd640 1 -- 172.21.15.53:0/204486417 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b380ab640 con 0x7f0b500caee0 2024-09-13T18:31:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b4effd640 1 -- 172.21.15.53:0/204486417 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b380a7070 con 0x7f0b500caee0 2024-09-13T18:31:55.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b4effd640 1 -- 172.21.15.53:0/204486417 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b380ab9c0 con 0x7f0b500caee0 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 -- 172.21.15.53:0/204486417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b500caee0 msgr2=0x7f0b500cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 --2- 172.21.15.53:0/204486417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b500caee0 0x7f0b500cb350 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009870 tx=0x7f0b3801c460 comp rx=0 tx=0).stop 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 -- 172.21.15.53:0/204486417 shutdown_connections 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 --2- 172.21.15.53:0/204486417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b500caee0 0x7f0b500cb350 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 --2- 172.21.15.53:0/204486417 >> v2:172.21.15.87:3300/0 conn(0x7f0b50143e80 0x7f0b5006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 -- 172.21.15.53:0/204486417 >> 172.21.15.53:0/204486417 conn(0x7f0b50065c80 msgr2=0x7f0b50066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 -- 172.21.15.53:0/204486417 shutdown_connections 2024-09-13T18:31:55.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 -- 172.21.15.53:0/204486417 wait complete. 2024-09-13T18:31:55.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 Processor -- start 2024-09-13T18:31:55.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.830+0000 7f0b56742640 1 -- start start 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b500caee0 0x7f0b5013bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b500cd320 0x7f0b500afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b50143e80 0x7f0b501f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501f55b0 con 0x7f0b50143e80 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501f5890 con 0x7f0b500caee0 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501f5b70 con 0x7f0b500cd320 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b50143e80 0x7f0b501f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b50143e80 0x7f0b501f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39634/0 (socket says 172.21.15.53:39634) 2024-09-13T18:31:55.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 -- 172.21.15.53:0/2460437437 learned_addr learned my addr 172.21.15.53:0/2460437437 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4f7fe640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b500cd320 0x7f0b500afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4ffff640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b500caee0 0x7f0b5013bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 -- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b500cd320 msgr2=0x7f0b500afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b500cd320 0x7f0b500afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 -- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b500caee0 msgr2=0x7f0b5013bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b500caee0 0x7f0b5013bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 -- 172.21.15.53:0/2460437437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380094d0 con 0x7f0b50143e80 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b54cdf640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b50143e80 0x7f0b501f4d10 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c770 tx=0x7f0b4800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4cff9640 1 -- 172.21.15.53:0/2460437437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48003b80 con 0x7f0b50143e80 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4cff9640 1 -- 172.21.15.53:0/2460437437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48003ce0 con 0x7f0b50143e80 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4cff9640 1 -- 172.21.15.53:0/2460437437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800aa90 con 0x7f0b50143e80 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b500b2040 con 0x7f0b50143e80 2024-09-13T18:31:55.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b501f5250 con 0x7f0b50143e80 2024-09-13T18:31:55.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b500cb350 con 0x7f0b50143e80 2024-09-13T18:31:55.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4cff9640 1 -- 172.21.15.53:0/2460437437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0b4800abf0 con 0x7f0b50143e80 2024-09-13T18:31:55.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4cff9640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b30066a80 0x7f0b30068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:55.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4cff9640 1 -- 172.21.15.53:0/2460437437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0b480850f0 con 0x7f0b50143e80 2024-09-13T18:31:55.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.834+0000 7f0b4ffff640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b30066a80 0x7f0b30068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:55.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.838+0000 7f0b4ffff640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b30066a80 0x7f0b30068f40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b930 tx=0x7f0b40008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:55.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:55.838+0000 7f0b4cff9640 1 -- 172.21.15.53:0/2460437437 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b48051fe0 con 0x7f0b50143e80 2024-09-13T18:31:56.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.038+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0b50156fd0 con 0x7f0b50143e80 2024-09-13T18:31:56.049 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 18 and data pool 19 2024-09-13T18:31:56.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.046+0000 7f0b4cff9640 1 -- 172.21.15.53:0/2460437437 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0b48055600 con 0x7f0b50143e80 2024-09-13T18:31:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b30066a80 msgr2=0x7f0b30068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b30066a80 0x7f0b30068f40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000b930 tx=0x7f0b40008040 comp rx=0 tx=0).stop 2024-09-13T18:31:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b50143e80 msgr2=0x7f0b501f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b50143e80 0x7f0b501f4d10 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c770 tx=0x7f0b4800cc30 comp rx=0 tx=0).stop 2024-09-13T18:31:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 shutdown_connections 2024-09-13T18:31:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b30066a80 0x7f0b30068f40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0b500cd320 0x7f0b500afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b50143e80 0x7f0b501f4d10 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 --2- 172.21.15.53:0/2460437437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b500caee0 0x7f0b5013bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 >> 172.21.15.53:0/2460437437 conn(0x7f0b50065c80 msgr2=0x7f0b50156130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 shutdown_connections 2024-09-13T18:31:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.066+0000 7f0b56742640 1 -- 172.21.15.53:0/2460437437 wait complete. 2024-09-13T18:31:56.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:56.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.206+0000 7fe1d2bf4640 1 Processor -- start 2024-09-13T18:31:56.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.206+0000 7fe1d2bf4640 1 -- start start 2024-09-13T18:31:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d2bf4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1cc158ba0 0x7fe1cc06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d2bf4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe1cc0cbb60 0x7fe1cc0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d2bf4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc0b2340 con 0x7fe1cc06f370 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d2bf4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b2860 con 0x7fe1cc158ba0 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d2bf4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc158f80 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1cc158ba0 0x7fe1cc06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1cc158ba0 0x7fe1cc06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39642/0 (socket says 172.21.15.53:39642) 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 -- 172.21.15.53:0/1118305424 learned_addr learned my addr 172.21.15.53:0/1118305424 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1cbfff640 1 --2- 172.21.15.53:0/1118305424 >> v2:172.21.15.87:3300/0 conn(0x7fe1cc0cbb60 0x7fe1cc0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 -- 172.21.15.53:0/1118305424 >> v2:172.21.15.87:3300/0 conn(0x7fe1cc0cbb60 msgr2=0x7fe1cc0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 --2- 172.21.15.53:0/1118305424 >> v2:172.21.15.87:3300/0 conn(0x7fe1cc0cbb60 0x7fe1cc0b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 -- 172.21.15.53:0/1118305424 >> v1:172.21.15.87:6789/0 conn(0x7fe1cc06f370 legacy=0x7fe1cc0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 -- 172.21.15.53:0/1118305424 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0b2580 con 0x7fe1cc158ba0 2024-09-13T18:31:56.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1cbfff640 1 --2- 172.21.15.53:0/1118305424 >> v2:172.21.15.87:3300/0 conn(0x7fe1cc0cbb60 0x7fe1cc0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:56.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1d0990640 1 --2- 172.21.15.53:0/1118305424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc158ba0 0x7fe1cc06b390 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc070ed0 tx=0x7fe1c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b53d24dead9644a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1cb7fe640 1 -- 172.21.15.53:0/1118305424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00ab650 con 0x7fe1cc158ba0 2024-09-13T18:31:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1cb7fe640 1 -- 172.21.15.53:0/1118305424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c00ab7b0 con 0x7fe1cc158ba0 2024-09-13T18:31:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.210+0000 7fe1cb7fe640 1 -- 172.21.15.53:0/1118305424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00abb40 con 0x7fe1cc158ba0 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1118305424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc158ba0 msgr2=0x7fe1cc06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1118305424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc158ba0 0x7fe1cc06b390 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc070ed0 tx=0x7fe1c001c450 comp rx=0 tx=0).stop 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1118305424 shutdown_connections 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1118305424 >> v2:172.21.15.87:3300/0 conn(0x7fe1cc0cbb60 0x7fe1cc0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1118305424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc158ba0 0x7fe1cc06b390 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1118305424 >> 172.21.15.53:0/1118305424 conn(0x7fe1cc065c80 msgr2=0x7fe1cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1118305424 shutdown_connections 2024-09-13T18:31:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1118305424 wait complete. 2024-09-13T18:31:56.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 Processor -- start 2024-09-13T18:31:56.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- start start 2024-09-13T18:31:56.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1cc06f370 0x7fe1cc0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc0cbb60 0x7fe1cc1f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1cc158ba0 0x7fe1cc14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c4230 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c3390 con 0x7fe1cc158ba0 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c3670 con 0x7fe1cc06f370 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc0cbb60 0x7fe1cc1f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc0cbb60 0x7fe1cc1f8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39658/0 (socket says 172.21.15.53:39658) 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 -- 172.21.15.53:0/1364723139 learned_addr learned my addr 172.21.15.53:0/1364723139 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d0990640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1cc06f370 0x7fe1cc0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d1191640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1cc158ba0 0x7fe1cc14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 -- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1cc06f370 msgr2=0x7fe1cc0ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1cc06f370 0x7fe1cc0ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 -- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1cc158ba0 msgr2=0x7fe1cc14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1cc158ba0 0x7fe1cc14dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 -- 172.21.15.53:0/1364723139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00094d0 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1cbfff640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc0cbb60 0x7fe1cc1f8f80 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c7c0 tx=0x7fe1b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1c97fa640 1 -- 172.21.15.53:0/1364723139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8007a30 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1c97fa640 1 -- 172.21.15.53:0/1364723139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8007b90 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc0c3950 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1c97fa640 1 -- 172.21.15.53:0/1364723139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800ce70 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.214+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc1f9ae0 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.218+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc067400 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.218+0000 7fe1c97fa640 1 -- 172.21.15.53:0/1364723139 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe1b80113f0 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.218+0000 7fe1c97fa640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1b0066ab0 0x7fe1b0068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.218+0000 7fe1c97fa640 1 -- 172.21.15.53:0/1364723139 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1b8084dc0 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.218+0000 7fe1d0990640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1b0066ab0 0x7fe1b0068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.218+0000 7fe1d0990640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1b0066ab0 0x7fe1b0068f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00af000 tx=0x7fe1c00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.222+0000 7fe1c97fa640 1 -- 172.21.15.53:0/1364723139 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe1b8051ad0 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.390+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1cc0b1e00 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.390+0000 7fe1c97fa640 1 -- 172.21.15.53:0/1364723139 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16532 (secure 0 0 0) 0x7fe1b80550f0 con 0x7fe1cc0cbb60 2024-09-13T18:31:56.392 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:56.393 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":119,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:56.041882+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1b0066ab0 msgr2=0x7fe1b0068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1b0066ab0 0x7fe1b0068f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00af000 tx=0x7fe1c00a7000 comp rx=0 tx=0).stop 2024-09-13T18:31:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc0cbb60 msgr2=0x7fe1cc1f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc0cbb60 0x7fe1cc1f8f80 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c7c0 tx=0x7fe1b800cc80 comp rx=0 tx=0).stop 2024-09-13T18:31:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 shutdown_connections 2024-09-13T18:31:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1b0066ab0 0x7fe1b0068f70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1cc158ba0 0x7fe1cc14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1cc0cbb60 0x7fe1cc1f8f80 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 --2- 172.21.15.53:0/1364723139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe1cc06f370 0x7fe1cc0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 >> 172.21.15.53:0/1364723139 conn(0x7fe1cc065c80 msgr2=0x7fe1cc157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 shutdown_connections 2024-09-13T18:31:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.394+0000 7fe1d2bf4640 1 -- 172.21.15.53:0/1364723139 wait complete. 2024-09-13T18:31:56.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:56.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.534+0000 7fb46d0e9640 1 Processor -- start 2024-09-13T18:31:56.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.534+0000 7fb46d0e9640 1 -- start start 2024-09-13T18:31:56.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46d0e9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4681582a0 0x7fb46806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46d0e9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46806d480 con 0x7fb4680713a0 2024-09-13T18:31:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46d0e9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46815ace0 con 0x7fb46815b7c0 2024-09-13T18:31:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46d0e9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46815aaf0 con 0x7fb4681582a0 2024-09-13T18:31:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46759e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb4680713a0 0x7fb4681640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46478/0 (socket says 172.21.15.53:46478) 2024-09-13T18:31:56.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46759e640 1 -- 172.21.15.53:0/271697022 learned_addr learned my addr 172.21.15.53:0/271697022 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb466d9d640 1 --2- 172.21.15.53:0/271697022 >> v2:172.21.15.87:3300/0 conn(0x7fb4681582a0 0x7fb46806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212911961 0 0) 0x7fb46806d480 con 0x7fb4680713a0 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb450003530 con 0x7fb4680713a0 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 798840931 0 0) 0x7fb450003530 con 0x7fb4680713a0 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 >> v2:172.21.15.87:3300/0 conn(0x7fb4681582a0 msgr2=0x7fb46806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 --2- 172.21.15.53:0/271697022 >> v2:172.21.15.87:3300/0 conn(0x7fb4681582a0 0x7fb46806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 >> v1:172.21.15.87:6789/0 conn(0x7fb46815b7c0 legacy=0x7fb468070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46815afc0 con 0x7fb4680713a0 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb460001a00 con 0x7fb4680713a0 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 >> v1:172.21.15.53:6789/0 conn(0x7fb4680713a0 legacy=0x7fb4681640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb450003980 0x7fb450003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4500047d0 0x7fb450004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450005190 0x7fb45000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45000c000 con 0x7fb450003980 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45000c170 con 0x7fb4500047d0 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45000c330 con 0x7fb450005190 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb466d9d640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb450003980 0x7fb450003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46659c640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4500047d0 0x7fb450004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46759e640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450005190 0x7fb45000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb466d9d640 1 -- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450005190 msgr2=0x7fb45000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb466d9d640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450005190 0x7fb45000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb466d9d640 1 -- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4500047d0 msgr2=0x7fb450004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb466d9d640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4500047d0 0x7fb450004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb466d9d640 1 -- 172.21.15.53:0/271697022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450003530 con 0x7fb450003980 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46759e640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450005190 0x7fb45000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:56.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.538+0000 7fb46759e640 1 -- 172.21.15.53:0/271697022 reap_dead start 2024-09-13T18:31:56.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb466d9d640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb450003980 0x7fb450003da0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb458009ae0 tx=0x7fb45801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7344b1297bd26b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4580a55e0 con 0x7fb450003980 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4580a5740 con 0x7fb450003980 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb465d9b640 1 -- 172.21.15.53:0/271697022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4580a5af0 con 0x7fb450003980 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 -- 172.21.15.53:0/271697022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb450003980 msgr2=0x7fb450003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb450003980 0x7fb450003da0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb458009ae0 tx=0x7fb45801ca70 comp rx=0 tx=0).stop 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 -- 172.21.15.53:0/271697022 shutdown_connections 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/271697022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb450003980 0x7fb450003da0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 -- 172.21.15.53:0/271697022 >> 172.21.15.53:0/271697022 conn(0x7fb468065c80 msgr2=0x7fb468066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 -- 172.21.15.53:0/271697022 shutdown_connections 2024-09-13T18:31:56.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 -- 172.21.15.53:0/271697022 wait complete. 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 Processor -- start 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.542+0000 7fb46d0e9640 1 -- start start 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450003980 0x7fb4681552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb468150f40 0x7fb468143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4681f5960 0x7fb468154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb468156c60 con 0x7fb4681f5960 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb468156f40 con 0x7fb468150f40 2024-09-13T18:31:56.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4681586b0 con 0x7fb450003980 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4681f5960 0x7fb468154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4681f5960 0x7fb468154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44516/0 (socket says 172.21.15.53:44516) 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 -- 172.21.15.53:0/2217318888 learned_addr learned my addr 172.21.15.53:0/2217318888 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46659c640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb468150f40 0x7fb468143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb466d9d640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450003980 0x7fb4681552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 -- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450003980 msgr2=0x7fb4681552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450003980 0x7fb4681552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 -- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb468150f40 msgr2=0x7fb468143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb468150f40 0x7fb468143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 -- 172.21.15.53:0/2217318888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468158990 con 0x7fb4681f5960 2024-09-13T18:31:56.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46759e640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4681f5960 0x7fb468154030 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb4600012f0 tx=0x7fb46000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb44f7fe640 1 -- 172.21.15.53:0/2217318888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600020d0 con 0x7fb4681f5960 2024-09-13T18:31:56.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb44f7fe640 1 -- 172.21.15.53:0/2217318888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46000bb80 con 0x7fb4681f5960 2024-09-13T18:31:56.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb468158c70 con 0x7fb4681f5960 2024-09-13T18:31:56.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb44f7fe640 1 -- 172.21.15.53:0/2217318888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460007070 con 0x7fb4681f5960 2024-09-13T18:31:56.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb468154570 con 0x7fb4681f5960 2024-09-13T18:31:56.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb468067400 con 0x7fb4681f5960 2024-09-13T18:31:56.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb44f7fe640 1 -- 172.21.15.53:0/2217318888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb4600071d0 con 0x7fb4681f5960 2024-09-13T18:31:56.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb44f7fe640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb454066ab0 0x7fb454068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb44f7fe640 1 -- 172.21.15.53:0/2217318888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb460085410 con 0x7fb4681f5960 2024-09-13T18:31:56.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb466d9d640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb454066ab0 0x7fb454068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.546+0000 7fb466d9d640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb454066ab0 0x7fb454068f70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb4580af000 tx=0x7fb458008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.550+0000 7fb44f7fe640 1 -- 172.21.15.53:0/2217318888 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb460052190 con 0x7fb4681f5960 2024-09-13T18:31:56.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.710+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb468158e60 con 0x7fb4681f5960 2024-09-13T18:31:56.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb44f7fe640 1 -- 172.21.15.53:0/2217318888 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16532 (secure 0 0 0) 0x7fb4600557b0 con 0x7fb4681f5960 2024-09-13T18:31:56.715 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:56.715 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":119,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:56.041882+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:56.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb454066ab0 msgr2=0x7fb454068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb454066ab0 0x7fb454068f70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb4580af000 tx=0x7fb458008040 comp rx=0 tx=0).stop 2024-09-13T18:31:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4681f5960 msgr2=0x7fb468154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4681f5960 0x7fb468154030 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb4600012f0 tx=0x7fb46000b4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 shutdown_connections 2024-09-13T18:31:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb454066ab0 0x7fb454068f70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4681f5960 0x7fb468154030 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb468150f40 0x7fb468143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 --2- 172.21.15.53:0/2217318888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb450003980 0x7fb4681552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 >> 172.21.15.53:0/2217318888 conn(0x7fb468065c80 msgr2=0x7fb4680cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:56.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 shutdown_connections 2024-09-13T18:31:56.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.714+0000 7fb46d0e9640 1 -- 172.21.15.53:0/2217318888 wait complete. 2024-09-13T18:31:56.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:31:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3581166640 1 Processor -- start 2024-09-13T18:31:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3581166640 1 -- start start 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3581166640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c1457c0 0x7f357c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3581166640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f357c0b1a40 0x7f357c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3581166640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c146180 con 0x7f357c071220 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3581166640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0702d0 con 0x7f357c0b1a40 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3581166640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c06c4c0 con 0x7f357c1457c0 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357a59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f357c0b1a40 0x7f357c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357ad9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c1457c0 0x7f357c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357ad9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c1457c0 0x7f357c0b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:42476/0 (socket says 172.21.15.53:42476) 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357ad9d640 1 -- 172.21.15.53:0/2935764257 learned_addr learned my addr 172.21.15.53:0/2935764257 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357b59e640 1 --1- 172.21.15.53:0/2935764257 >> v1:172.21.15.87:6789/0 conn(0x7f357c071220 0x7f357c06b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:52498/0 (socket says 172.21.15.53:52498) 2024-09-13T18:31:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357ad9d640 1 -- 172.21.15.53:0/2935764257 >> v2:172.21.15.87:3300/0 conn(0x7f357c0b1a40 msgr2=0x7f357c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357ad9d640 1 --2- 172.21.15.53:0/2935764257 >> v2:172.21.15.87:3300/0 conn(0x7f357c0b1a40 0x7f357c070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357ad9d640 1 -- 172.21.15.53:0/2935764257 >> v1:172.21.15.87:6789/0 conn(0x7f357c071220 legacy=0x7f357c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357ad9d640 1 -- 172.21.15.53:0/2935764257 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c06bf00 con 0x7f357c1457c0 2024-09-13T18:31:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f3579d9b640 1 -- 172.21.15.53:0/2935764257 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215876909 0 0) 0x7f357c146180 con 0x7f357c071220 2024-09-13T18:31:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.866+0000 7f357a59c640 1 --2- 172.21.15.53:0/2935764257 >> v2:172.21.15.87:3300/0 conn(0x7f357c0b1a40 0x7f357c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f357ad9d640 1 --2- 172.21.15.53:0/2935764257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c1457c0 0x7f357c0b1500 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f356c009870 tx=0x7f356c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d37e3a6e3a66d8df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3579d9b640 1 -- 172.21.15.53:0/2935764257 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0ab640 con 0x7f357c1457c0 2024-09-13T18:31:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3579d9b640 1 -- 172.21.15.53:0/2935764257 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0a7070 con 0x7f357c1457c0 2024-09-13T18:31:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3579d9b640 1 -- 172.21.15.53:0/2935764257 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0ab9c0 con 0x7f357c1457c0 2024-09-13T18:31:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 -- 172.21.15.53:0/2935764257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c1457c0 msgr2=0x7f357c0b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 --2- 172.21.15.53:0/2935764257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c1457c0 0x7f357c0b1500 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f356c009870 tx=0x7f356c01c530 comp rx=0 tx=0).stop 2024-09-13T18:31:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 -- 172.21.15.53:0/2935764257 shutdown_connections 2024-09-13T18:31:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 --2- 172.21.15.53:0/2935764257 >> v2:172.21.15.87:3300/0 conn(0x7f357c0b1a40 0x7f357c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 --2- 172.21.15.53:0/2935764257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c1457c0 0x7f357c0b1500 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 -- 172.21.15.53:0/2935764257 >> 172.21.15.53:0/2935764257 conn(0x7f357c065c80 msgr2=0x7f357c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 -- 172.21.15.53:0/2935764257 shutdown_connections 2024-09-13T18:31:56.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 -- 172.21.15.53:0/2935764257 wait complete. 2024-09-13T18:31:56.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 Processor -- start 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.870+0000 7f3581166640 1 -- start start 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f357c071220 0x7f357c13bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c0b1a40 0x7f357c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c1457c0 0x7f357c0af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c15c1a0 con 0x7f357c1457c0 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c142570 con 0x7f357c071220 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c15b540 con 0x7f357c0b1a40 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c1457c0 0x7f357c0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c1457c0 0x7f357c0af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44532/0 (socket says 172.21.15.53:44532) 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 -- 172.21.15.53:0/1692081156 learned_addr learned my addr 172.21.15.53:0/1692081156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357ad9d640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f357c071220 0x7f357c13bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357a59c640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c0b1a40 0x7f357c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 -- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c0b1a40 msgr2=0x7f357c0af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c0b1a40 0x7f357c0af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 -- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f357c071220 msgr2=0x7f357c13bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f357c071220 0x7f357c13bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 -- 172.21.15.53:0/1692081156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570009420 con 0x7f357c1457c0 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357a59c640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c0b1a40 0x7f357c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357b59e640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c1457c0 0x7f357c0af910 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f357400c810 tx=0x7f357400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f35637fe640 1 -- 172.21.15.53:0/1692081156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400a640 con 0x7f357c1457c0 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f35637fe640 1 -- 172.21.15.53:0/1692081156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357400a7c0 con 0x7f357c1457c0 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c0094d0 con 0x7f357c1457c0 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f35637fe640 1 -- 172.21.15.53:0/1692081156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400ab70 con 0x7f357c1457c0 2024-09-13T18:31:56.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c15bb00 con 0x7f357c1457c0 2024-09-13T18:31:56.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c070ce0 con 0x7f357c1457c0 2024-09-13T18:31:56.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f35637fe640 1 -- 172.21.15.53:0/1692081156 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f357400acd0 con 0x7f357c1457c0 2024-09-13T18:31:56.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f35637fe640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3568066a80 0x7f3568068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:56.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f357ad9d640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3568066a80 0x7f3568068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:56.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.874+0000 7f35637fe640 1 -- 172.21.15.53:0/1692081156 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3574083d90 con 0x7f357c1457c0 2024-09-13T18:31:56.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.878+0000 7f357ad9d640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3568066a80 0x7f3568068f40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f356c0af000 tx=0x7f356c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:56.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:56.878+0000 7f35637fe640 1 -- 172.21.15.53:0/1692081156 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3574050b20 con 0x7f357c1457c0 2024-09-13T18:31:57.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:57.074+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f357c0b0e10 con 0x7f357c1457c0 2024-09-13T18:31:57.650 INFO:tasks.ceph.mds.c.smithi053.stderr:2024-09-13T18:31:57.650+0000 7f591500c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:31:58.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.058+0000 7f35637fe640 1 -- 172.21.15.53:0/1692081156 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3574018020 con 0x7f357c1457c0 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3568066a80 msgr2=0x7f3568068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3568066a80 0x7f3568068f40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f356c0af000 tx=0x7f356c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c1457c0 msgr2=0x7f357c0af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c1457c0 0x7f357c0af910 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f357400c810 tx=0x7f357400ccd0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 shutdown_connections 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3568066a80 0x7f3568068f40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f357c0b1a40 0x7f357c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c1457c0 0x7f357c0af910 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 --2- 172.21.15.53:0/1692081156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f357c071220 0x7f357c13bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 >> 172.21.15.53:0/1692081156 conn(0x7f357c065c80 msgr2=0x7f357c15d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 shutdown_connections 2024-09-13T18:31:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.062+0000 7f3581166640 1 -- 172.21.15.53:0/1692081156 wait complete. 2024-09-13T18:31:58.083 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:31:58.083 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:31:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.210+0000 7f70a08f2640 1 Processor -- start 2024-09-13T18:31:58.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.210+0000 7f70a08f2640 1 -- start start 2024-09-13T18:31:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f70a08f2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f709c143e80 0x7f709c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f70a08f2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f709c0caee0 0x7f709c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f70a08f2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c06f7a0 con 0x7f709c0cd320 2024-09-13T18:31:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f70a08f2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c06fd60 con 0x7f709c0caee0 2024-09-13T18:31:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f70a08f2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0cb960 con 0x7f709c143e80 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f709c0cd320 0x7f709c0cd780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42292/0 (socket says 172.21.15.53:42292) 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709ad9d640 1 -- 172.21.15.53:0/222224417 learned_addr learned my addr 172.21.15.53:0/222224417 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f7099d9b640 1 --2- 172.21.15.53:0/222224417 >> v2:172.21.15.53:3300/0 conn(0x7f709c0caee0 0x7f709c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709a59c640 1 --2- 172.21.15.53:0/222224417 >> v2:172.21.15.87:3300/0 conn(0x7f709c143e80 0x7f709c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709959a640 1 -- 172.21.15.53:0/222224417 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263582279 0 0) 0x7f709c06f7a0 con 0x7f709c0cd320 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709959a640 1 -- 172.21.15.53:0/222224417 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7084003530 con 0x7f709c0cd320 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f7099d9b640 1 -- 172.21.15.53:0/222224417 >> v2:172.21.15.87:3300/0 conn(0x7f709c143e80 msgr2=0x7f709c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f7099d9b640 1 --2- 172.21.15.53:0/222224417 >> v2:172.21.15.87:3300/0 conn(0x7f709c143e80 0x7f709c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f7099d9b640 1 -- 172.21.15.53:0/222224417 >> v1:172.21.15.53:6789/0 conn(0x7f709c0cd320 legacy=0x7f709c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f7099d9b640 1 -- 172.21.15.53:0/222224417 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0cbc40 con 0x7f709c0caee0 2024-09-13T18:31:58.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f7099d9b640 1 --2- 172.21.15.53:0/222224417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0cb350 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f70900097c0 tx=0x7f709001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9310b2da0f1cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:58.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709959a640 1 -- 172.21.15.53:0/222224417 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900ad680 con 0x7f709c0caee0 2024-09-13T18:31:58.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709959a640 1 -- 172.21.15.53:0/222224417 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70900ad7e0 con 0x7f709c0caee0 2024-09-13T18:31:58.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.214+0000 7f709959a640 1 -- 172.21.15.53:0/222224417 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900adb70 con 0x7f709c0caee0 2024-09-13T18:31:58.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- 172.21.15.53:0/222224417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 msgr2=0x7f709c0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 --2- 172.21.15.53:0/222224417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0cb350 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f70900097c0 tx=0x7f709001c3a0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- 172.21.15.53:0/222224417 shutdown_connections 2024-09-13T18:31:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 --2- 172.21.15.53:0/222224417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0cb350 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 --2- 172.21.15.53:0/222224417 >> v2:172.21.15.87:3300/0 conn(0x7f709c143e80 0x7f709c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- 172.21.15.53:0/222224417 >> 172.21.15.53:0/222224417 conn(0x7f709c065c80 msgr2=0x7f709c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- 172.21.15.53:0/222224417 shutdown_connections 2024-09-13T18:31:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- 172.21.15.53:0/222224417 wait complete. 2024-09-13T18:31:58.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 Processor -- start 2024-09-13T18:31:58.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- start start 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f709c0cd320 0x7f709c13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c143e80 0x7f709c0aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0abc20 con 0x7f709c0caee0 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0a9040 con 0x7f709c143e80 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0ab940 con 0x7f709c0cd320 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0ad020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44558/0 (socket says 172.21.15.53:44558) 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 -- 172.21.15.53:0/969123080 learned_addr learned my addr 172.21.15.53:0/969123080 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:58.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f7099d9b640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f709c0cd320 0x7f709c13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 -- 172.21.15.53:0/969123080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f709c0cd320 msgr2=0x7f709c13fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f709c0cd320 0x7f709c13fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 -- 172.21.15.53:0/969123080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c143e80 msgr2=0x7f709c0aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c143e80 0x7f709c0aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 -- 172.21.15.53:0/969123080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090009420 con 0x7f709c0caee0 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f709a59c640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0ad020 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f708c00d5f0 tx=0x7f708c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f708affd640 1 -- 172.21.15.53:0/969123080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0125f0 con 0x7f709c0caee0 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f708affd640 1 -- 172.21.15.53:0/969123080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c012750 con 0x7f709c0caee0 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f708affd640 1 -- 172.21.15.53:0/969123080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c012ae0 con 0x7f709c0caee0 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c0a92c0 con 0x7f709c0caee0 2024-09-13T18:31:58.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.218+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c0a9880 con 0x7f709c0caee0 2024-09-13T18:31:58.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.222+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c0cb350 con 0x7f709c0caee0 2024-09-13T18:31:58.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.222+0000 7f708affd640 1 -- 172.21.15.53:0/969123080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f708c012c40 con 0x7f709c0caee0 2024-09-13T18:31:58.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.222+0000 7f708affd640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f707c066ab0 0x7f707c068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.222+0000 7f708affd640 1 -- 172.21.15.53:0/969123080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f708c084d00 con 0x7f709c0caee0 2024-09-13T18:31:58.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.222+0000 7f7099d9b640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f707c066ab0 0x7f707c068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.222+0000 7f7099d9b640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f707c066ab0 0x7f707c068f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f70900af000 tx=0x7f7090008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:58.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.226+0000 7f708affd640 1 -- 172.21.15.53:0/969123080 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f708c051b20 con 0x7f709c0caee0 2024-09-13T18:31:58.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:58.418+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f709c0ae960 con 0x7f709c0caee0 2024-09-13T18:31:59.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.058+0000 7f708affd640 1 -- 172.21.15.53:0/969123080 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) v1 ==== 122+0+0 (secure 0 0 0) 0x7f708c007380 con 0x7f709c0caee0 2024-09-13T18:31:59.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f707c066ab0 msgr2=0x7f707c068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f707c066ab0 0x7f707c068f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f70900af000 tx=0x7f7090008040 comp rx=0 tx=0).stop 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 msgr2=0x7f709c0ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0ad020 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f708c00d5f0 tx=0x7f708c00dab0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 shutdown_connections 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f707c066ab0 0x7f707c068f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f709c0cd320 0x7f709c13fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f709c143e80 0x7f709c0aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 --2- 172.21.15.53:0/969123080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f709c0caee0 0x7f709c0ad020 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 >> 172.21.15.53:0/969123080 conn(0x7f709c065c80 msgr2=0x7f709c156040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 shutdown_connections 2024-09-13T18:31:59.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.062+0000 7f70a08f2640 1 -- 172.21.15.53:0/969123080 wait complete. 2024-09-13T18:31:59.088 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:31:59.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:31:59.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.214+0000 7f7dccf0d640 1 Processor -- start 2024-09-13T18:31:59.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dccf0d640 1 -- start start 2024-09-13T18:31:59.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dccf0d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7dc80cf7d0 0x7f7dc80b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dccf0d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80d2400 con 0x7f7dc80d19c0 2024-09-13T18:31:59.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dccf0d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80d1530 con 0x7f7dc815cab0 2024-09-13T18:31:59.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dccf0d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80cddd0 con 0x7f7dc80cf7d0 2024-09-13T18:31:59.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7dc80d19c0 0x7f7dc80cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42306/0 (socket says 172.21.15.53:42306) 2024-09-13T18:31:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 -- 172.21.15.53:0/1251488259 learned_addr learned my addr 172.21.15.53:0/1251488259 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc6d9d640 1 --2- 172.21.15.53:0/1251488259 >> v2:172.21.15.87:3300/0 conn(0x7f7dc80cf7d0 0x7f7dc80b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009391338 0 0) 0x7f7dc80d2400 con 0x7f7dc80d19c0 2024-09-13T18:31:59.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db4003530 con 0x7f7dc80d19c0 2024-09-13T18:31:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261780584 0 0) 0x7f7db4003530 con 0x7f7dc80d19c0 2024-09-13T18:31:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 >> v2:172.21.15.87:3300/0 conn(0x7f7dc80cf7d0 msgr2=0x7f7dc80b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:59.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 --2- 172.21.15.53:0/1251488259 >> v2:172.21.15.87:3300/0 conn(0x7f7dc80cf7d0 0x7f7dc80b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 >> v1:172.21.15.87:6789/0 conn(0x7f7dc815cab0 legacy=0x7f7dc80cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80d1e30 con 0x7f7dc80d19c0 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7db0001680 con 0x7f7dc80d19c0 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 >> v1:172.21.15.53:6789/0 conn(0x7f7dc80d19c0 legacy=0x7f7dc80cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db4003980 0x7f7db4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7db40047d0 0x7f7db4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db4005190 0x7f7db400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80cddd0 con 0x7f7db40047d0 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db400c030 con 0x7f7db4005190 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db400c1f0 con 0x7f7db4003980 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7db40047d0 0x7f7db4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc6d9d640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db4005190 0x7f7db400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc659c640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db4003980 0x7f7db4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 -- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db4003980 msgr2=0x7f7db4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:59.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db4003980 0x7f7db4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 -- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db4005190 msgr2=0x7f7db400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:59.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db4005190 0x7f7db400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dbffff640 1 -- 172.21.15.53:0/1251488259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db4003530 con 0x7f7db40047d0 2024-09-13T18:31:59.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.218+0000 7f7dc6d9d640 1 -- 172.21.15.53:0/1251488259 reap_dead start 2024-09-13T18:31:59.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dbffff640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7db40047d0 0x7f7db4004c50 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c240 tx=0x7f7db001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cabf1e82699a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0005ae0 con 0x7f7db40047d0 2024-09-13T18:31:59.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00ab070 con 0x7f7db40047d0 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dc5d9b640 1 -- 172.21.15.53:0/1251488259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0007070 con 0x7f7db40047d0 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- 172.21.15.53:0/1251488259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7db40047d0 msgr2=0x7f7db4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7db40047d0 0x7f7db4004c50 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c240 tx=0x7f7db001f390 comp rx=0 tx=0).stop 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- 172.21.15.53:0/1251488259 shutdown_connections 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/1251488259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7db40047d0 0x7f7db4004c50 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- 172.21.15.53:0/1251488259 >> 172.21.15.53:0/1251488259 conn(0x7f7dc8065c80 msgr2=0x7f7dc8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- 172.21.15.53:0/1251488259 shutdown_connections 2024-09-13T18:31:59.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- 172.21.15.53:0/1251488259 wait complete. 2024-09-13T18:31:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 Processor -- start 2024-09-13T18:31:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- start start 2024-09-13T18:31:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db40047d0 0x7f7dc814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc80c9780 0x7f7dc80c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dc80cba00 0x7f7dc80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80cc3c0 con 0x7f7dc80c9780 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80cb270 con 0x7f7dc80cba00 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.222+0000 7f7dccf0d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80ca1d0 con 0x7f7db40047d0 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc80c9780 0x7f7dc80c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc80c9780 0x7f7dc80c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44572/0 (socket says 172.21.15.53:44572) 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 -- 172.21.15.53:0/3455178724 learned_addr learned my addr 172.21.15.53:0/3455178724 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dc659c640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db40047d0 0x7f7dc814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dc6d9d640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dc80cba00 0x7f7dc80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 -- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db40047d0 msgr2=0x7f7dc814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db40047d0 0x7f7dc814c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 -- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dc80cba00 msgr2=0x7f7dc80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dc80cba00 0x7f7dc80cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 -- 172.21.15.53:0/3455178724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80ca4b0 con 0x7f7dc80c9780 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dc659c640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db40047d0 0x7f7dc814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbffff640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc80c9780 0x7f7dc80c9be0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7db001f1c0 tx=0x7f7db4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbeffd640 1 -- 172.21.15.53:0/3455178724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0001680 con 0x7f7dc80c9780 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbeffd640 1 -- 172.21.15.53:0/3455178724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db0007070 con 0x7f7dc80c9780 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc80ca790 con 0x7f7dc80c9780 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbeffd640 1 -- 172.21.15.53:0/3455178724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0007400 con 0x7f7dc80c9780 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc80cad50 con 0x7f7dc80c9780 2024-09-13T18:31:59.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80d05b0 con 0x7f7dc80c9780 2024-09-13T18:31:59.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbeffd640 1 -- 172.21.15.53:0/3455178724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7db00b9030 con 0x7f7dc80c9780 2024-09-13T18:31:59.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbeffd640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7da8066a80 0x7f7da8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dbeffd640 1 -- 172.21.15.53:0/3455178724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7db00b7070 con 0x7f7dc80c9780 2024-09-13T18:31:59.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dc659c640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7da8066a80 0x7f7da8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.226+0000 7f7dc659c640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7da8066a80 0x7f7da8068f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7db8000c10 tx=0x7f7db8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.230+0000 7f7dbeffd640 1 -- 172.21.15.53:0/3455178724 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7db00ee490 con 0x7f7dc80c9780 2024-09-13T18:31:59.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.414+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dc80b7460 con 0x7f7dc80c9780 2024-09-13T18:31:59.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dbeffd640 1 -- 172.21.15.53:0/3455178724 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f7db00c1070 con 0x7f7dc80c9780 2024-09-13T18:31:59.419 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:59.419 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3448118459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3448118459},{"type":"v1","addr":"172.21.15.87:6833","nonce":3448118459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2784676391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2784676391},{"type":"v1","addr":"172.21.15.87:6835","nonce":2784676391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1340459922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1340459922},{"type":"v1","addr":"172.21.15.53:6833","nonce":1340459922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:56.042381+0000","modified":"2024-09-13T18:31:59.056844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8472":{"gid":8472,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2654273195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2654273195},{"type":"v1","addr":"172.21.15.53:6835","nonce":2654273195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:31:59.420 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 71 2024-09-13T18:31:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7da8066a80 msgr2=0x7f7da8068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7da8066a80 0x7f7da8068f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7db8000c10 tx=0x7f7db8009040 comp rx=0 tx=0).stop 2024-09-13T18:31:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc80c9780 msgr2=0x7f7dc80c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc80c9780 0x7f7dc80c9be0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7db001f1c0 tx=0x7f7db4005800 comp rx=0 tx=0).stop 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 shutdown_connections 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7da8066a80 0x7f7da8068f40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7dc80cba00 0x7f7dc80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc80c9780 0x7f7dc80c9be0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 --2- 172.21.15.53:0/3455178724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7db40047d0 0x7f7dc814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 >> 172.21.15.53:0/3455178724 conn(0x7f7dc8065c80 msgr2=0x7f7dc80cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 shutdown_connections 2024-09-13T18:31:59.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.418+0000 7f7dccf0d640 1 -- 172.21.15.53:0/3455178724 wait complete. 2024-09-13T18:31:59.437 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:31:59.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.546+0000 7f87a8b95640 1 Processor -- start 2024-09-13T18:31:59.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.546+0000 7f87a8b95640 1 -- start start 2024-09-13T18:31:59.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a8b95640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87a415a520 0x7f87a40ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a8b95640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a40cf420 con 0x7f87a40b5300 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a8b95640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a406c8a0 con 0x7f87a40cd230 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a8b95640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a406cb80 con 0x7f87a415a520 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87a415a520 0x7f87a40ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87a415a520 0x7f87a40ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44574/0 (socket says 172.21.15.53:44574) 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a259c640 1 -- 172.21.15.53:0/3771101268 learned_addr learned my addr 172.21.15.53:0/3771101268 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a2d9d640 1 --1- 172.21.15.53:0/3771101268 >> v1:172.21.15.53:6789/0 conn(0x7f87a40b5300 0x7f87a415a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42314/0 (socket says 172.21.15.53:42314) 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a259c640 1 -- 172.21.15.53:0/3771101268 >> v1:172.21.15.87:6789/0 conn(0x7f87a40cd230 legacy=0x7f87a40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a259c640 1 -- 172.21.15.53:0/3771101268 >> v1:172.21.15.53:6789/0 conn(0x7f87a40b5300 legacy=0x7f87a415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.550+0000 7f87a259c640 1 -- 172.21.15.53:0/3771101268 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a406ce60 con 0x7f87a415a520 2024-09-13T18:31:59.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a259c640 1 --2- 172.21.15.53:0/3771101268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415a520 0x7f87a40ce9b0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28895b1f0155e0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a1d9b640 1 -- 172.21.15.53:0/3771101268 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940aa610 con 0x7f87a415a520 2024-09-13T18:31:59.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a1d9b640 1 -- 172.21.15.53:0/3771101268 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87940a6040 con 0x7f87a415a520 2024-09-13T18:31:59.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a1d9b640 1 -- 172.21.15.53:0/3771101268 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940aa990 con 0x7f87a415a520 2024-09-13T18:31:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- 172.21.15.53:0/3771101268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415a520 msgr2=0x7f87a40ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 --2- 172.21.15.53:0/3771101268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415a520 0x7f87a40ce9b0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879401c490 comp rx=0 tx=0).stop 2024-09-13T18:31:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- 172.21.15.53:0/3771101268 shutdown_connections 2024-09-13T18:31:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 --2- 172.21.15.53:0/3771101268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a415a520 0x7f87a40ce9b0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- 172.21.15.53:0/3771101268 >> 172.21.15.53:0/3771101268 conn(0x7f87a4069f50 msgr2=0x7f87a406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- 172.21.15.53:0/3771101268 shutdown_connections 2024-09-13T18:31:59.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- 172.21.15.53:0/3771101268 wait complete. 2024-09-13T18:31:59.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 Processor -- start 2024-09-13T18:31:59.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- start start 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87a40b5300 0x7f87a4149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a40cd230 0x7f87a4149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87a415a520 0x7f87a41f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a414a280 con 0x7f87a40cd230 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4151e10 con 0x7f87a415a520 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f87a8b95640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4151b30 con 0x7f87a40b5300 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.554+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a40cd230 0x7f87a4149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a40cd230 0x7f87a4149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44576/0 (socket says 172.21.15.53:44576) 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 -- 172.21.15.53:0/1320309588 learned_addr learned my addr 172.21.15.53:0/1320309588 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a259c640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87a40b5300 0x7f87a4149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a2d9d640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87a415a520 0x7f87a41f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 -- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87a40b5300 msgr2=0x7f87a4149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87a40b5300 0x7f87a4149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 -- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87a415a520 msgr2=0x7f87a41f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87a415a520 0x7f87a41f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 -- 172.21.15.53:0/1320309588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940094d0 con 0x7f87a40cd230 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a259c640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87a40b5300 0x7f87a4149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f8799d9b640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a40cd230 0x7f87a4149230 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c450 tx=0x7f878c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f879b7fe640 1 -- 172.21.15.53:0/1320309588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c012830 con 0x7f87a40cd230 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f879b7fe640 1 -- 172.21.15.53:0/1320309588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0129b0 con 0x7f87a40cd230 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f879b7fe640 1 -- 172.21.15.53:0/1320309588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c012d60 con 0x7f87a40cd230 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a415baf0 con 0x7f87a40cd230 2024-09-13T18:31:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a40b3800 con 0x7f87a40cd230 2024-09-13T18:31:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a40b3a20 con 0x7f87a40cd230 2024-09-13T18:31:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f879b7fe640 1 -- 172.21.15.53:0/1320309588 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f878c01c460 con 0x7f87a40cd230 2024-09-13T18:31:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f879b7fe640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8784066a80 0x7f8784068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a259c640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8784066a80 0x7f8784068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f879b7fe640 1 -- 172.21.15.53:0/1320309588 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f878c0846c0 con 0x7f87a40cd230 2024-09-13T18:31:59.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.558+0000 7f87a259c640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8784066a80 0x7f8784068f40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f87940ae000 tx=0x7f8794008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.562+0000 7f879b7fe640 1 -- 172.21.15.53:0/1320309588 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f878c051500 con 0x7f87a40cd230 2024-09-13T18:31:59.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.734+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87a40ce9b0 con 0x7f87a40cd230 2024-09-13T18:31:59.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f879b7fe640 1 -- 172.21.15.53:0/1320309588 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f878c054b20 con 0x7f87a40cd230 2024-09-13T18:31:59.738 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:31:59.738 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":120,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:31:57.045142+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:31:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8784066a80 msgr2=0x7f8784068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8784066a80 0x7f8784068f40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f87940ae000 tx=0x7f8794008040 comp rx=0 tx=0).stop 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a40cd230 msgr2=0x7f87a4149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a40cd230 0x7f87a4149230 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c450 tx=0x7f878c00c910 comp rx=0 tx=0).stop 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 shutdown_connections 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8784066a80 0x7f8784068f40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87a415a520 0x7f87a41f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87a40cd230 0x7f87a4149230 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 --2- 172.21.15.53:0/1320309588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87a40b5300 0x7f87a4149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 >> 172.21.15.53:0/1320309588 conn(0x7f87a4069f50 msgr2=0x7f87a4158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 shutdown_connections 2024-09-13T18:31:59.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.738+0000 7f87a8b95640 1 -- 172.21.15.53:0/1320309588 wait complete. 2024-09-13T18:31:59.758 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:31:59.758 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:31:59.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a4701f640 1 Processor -- start 2024-09-13T18:31:59.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a4701f640 1 -- start start 2024-09-13T18:31:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a4701f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a401582a0 0x7f7a4006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a4701f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7a400713a0 0x7f7a4006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a4701f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4006d480 con 0x7f7a4015b7c0 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a4701f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4015aaf0 con 0x7f7a400713a0 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a4701f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4006d760 con 0x7f7a401582a0 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a3ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7a4015b7c0 0x7f7a40070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42322/0 (socket says 172.21.15.53:42322) 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a3ffff640 1 -- 172.21.15.53:0/4022190651 learned_addr learned my addr 172.21.15.53:0/4022190651 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a44dbb640 1 --2- 172.21.15.53:0/4022190651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a401582a0 0x7f7a4006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a455bc640 1 --2- 172.21.15.53:0/4022190651 >> v2:172.21.15.87:3300/0 conn(0x7f7a400713a0 0x7f7a4006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a3f7fe640 1 -- 172.21.15.53:0/4022190651 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101447030 0 0) 0x7f7a4006d480 con 0x7f7a4015b7c0 2024-09-13T18:31:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a3f7fe640 1 -- 172.21.15.53:0/4022190651 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c003530 con 0x7f7a4015b7c0 2024-09-13T18:31:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a44dbb640 1 -- 172.21.15.53:0/4022190651 >> v2:172.21.15.87:3300/0 conn(0x7f7a400713a0 msgr2=0x7f7a4006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:31:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a44dbb640 1 --2- 172.21.15.53:0/4022190651 >> v2:172.21.15.87:3300/0 conn(0x7f7a400713a0 0x7f7a4006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a44dbb640 1 -- 172.21.15.53:0/4022190651 >> v1:172.21.15.53:6789/0 conn(0x7f7a4015b7c0 legacy=0x7f7a40070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.882+0000 7f7a44dbb640 1 -- 172.21.15.53:0/4022190651 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4015ace0 con 0x7f7a401582a0 2024-09-13T18:31:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a44dbb640 1 --2- 172.21.15.53:0/4022190651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a401582a0 0x7f7a4006c900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a280097c0 tx=0x7f7a2801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f53611438c8f5ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a3f7fe640 1 -- 172.21.15.53:0/4022190651 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280ab670 con 0x7f7a401582a0 2024-09-13T18:31:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a3f7fe640 1 -- 172.21.15.53:0/4022190651 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a280ab7d0 con 0x7f7a401582a0 2024-09-13T18:31:59.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a3f7fe640 1 -- 172.21.15.53:0/4022190651 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280abb40 con 0x7f7a401582a0 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 -- 172.21.15.53:0/4022190651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a401582a0 msgr2=0x7f7a4006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 --2- 172.21.15.53:0/4022190651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a401582a0 0x7f7a4006c900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a280097c0 tx=0x7f7a2801c470 comp rx=0 tx=0).stop 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 -- 172.21.15.53:0/4022190651 shutdown_connections 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 --2- 172.21.15.53:0/4022190651 >> v2:172.21.15.87:3300/0 conn(0x7f7a400713a0 0x7f7a4006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 --2- 172.21.15.53:0/4022190651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a401582a0 0x7f7a4006c900 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 -- 172.21.15.53:0/4022190651 >> 172.21.15.53:0/4022190651 conn(0x7f7a40065c80 msgr2=0x7f7a40066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 -- 172.21.15.53:0/4022190651 shutdown_connections 2024-09-13T18:31:59.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 -- 172.21.15.53:0/4022190651 wait complete. 2024-09-13T18:31:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 Processor -- start 2024-09-13T18:31:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.886+0000 7f7a4701f640 1 -- start start 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a400713a0 0x7f7a40149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a401582a0 0x7f7a40146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a4015b7c0 0x7f7a4014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a401487d0 con 0x7f7a400713a0 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40148160 con 0x7f7a401582a0 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40149b80 con 0x7f7a4015b7c0 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a400713a0 0x7f7a40149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a400713a0 0x7f7a40149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44592/0 (socket says 172.21.15.53:44592) 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 -- 172.21.15.53:0/1479659810 learned_addr learned my addr 172.21.15.53:0/1479659810 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:31:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a455bc640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a4015b7c0 0x7f7a4014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a3ffff640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a401582a0 0x7f7a40146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 -- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a4015b7c0 msgr2=0x7f7a4014c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a4015b7c0 0x7f7a4014c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 -- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a401582a0 msgr2=0x7f7a40146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a401582a0 0x7f7a40146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 -- 172.21.15.53:0/1479659810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a28009420 con 0x7f7a400713a0 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a3ffff640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a401582a0 0x7f7a40146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a44dbb640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a400713a0 0x7f7a40149640 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f7a2801a0a0 tx=0x7f7a2801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a3d7fa640 1 -- 172.21.15.53:0/1479659810 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280bf610 con 0x7f7a400713a0 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a3d7fa640 1 -- 172.21.15.53:0/1479659810 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a280bf770 con 0x7f7a400713a0 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4014a080 con 0x7f7a400713a0 2024-09-13T18:31:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a3d7fa640 1 -- 172.21.15.53:0/1479659810 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280bfb20 con 0x7f7a400713a0 2024-09-13T18:31:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a401483f0 con 0x7f7a400713a0 2024-09-13T18:31:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a40067400 con 0x7f7a400713a0 2024-09-13T18:31:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a3d7fa640 1 -- 172.21.15.53:0/1479659810 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7a280bfc80 con 0x7f7a400713a0 2024-09-13T18:31:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.890+0000 7f7a3d7fa640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7a20066ab0 0x7f7a20068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.894+0000 7f7a3d7fa640 1 -- 172.21.15.53:0/1479659810 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2811f760 con 0x7f7a400713a0 2024-09-13T18:31:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.894+0000 7f7a3ffff640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7a20066ab0 0x7f7a20068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.894+0000 7f7a3ffff640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7a20066ab0 0x7f7a20068f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a400703e0 tx=0x7f7a30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:31:59.898+0000 7f7a3d7fa640 1 -- 172.21.15.53:0/1479659810 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a280ec490 con 0x7f7a400713a0 2024-09-13T18:32:00.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.094+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a400679b0 con 0x7f7a20066ab0 2024-09-13T18:32:00.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.102+0000 7f7a3d7fa640 1 -- 172.21.15.53:0/1479659810 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288243 (secure 0 0 0) 0x7f7a400679b0 con 0x7f7a20066ab0 2024-09-13T18:32:00.109 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:00.111 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:32:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7a20066ab0 msgr2=0x7f7a20068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7a20066ab0 0x7f7a20068f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a400703e0 tx=0x7f7a30009040 comp rx=0 tx=0).stop 2024-09-13T18:32:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a400713a0 msgr2=0x7f7a40149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a400713a0 0x7f7a40149640 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f7a2801a0a0 tx=0x7f7a2801acb0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 shutdown_connections 2024-09-13T18:32:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7a20066ab0 0x7f7a20068f70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7a4015b7c0 0x7f7a4014c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a401582a0 0x7f7a40146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 --2- 172.21.15.53:0/1479659810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a400713a0 0x7f7a40149640 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 >> 172.21.15.53:0/1479659810 conn(0x7f7a40065c80 msgr2=0x7f7a400adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 shutdown_connections 2024-09-13T18:32:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.106+0000 7f7a4701f640 1 -- 172.21.15.53:0/1479659810 wait complete. 2024-09-13T18:32:00.126 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-09-13T18:31:59.855579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278236,"kb_used_data":12912,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754696484,"statfs":{"total":773094113280,"available":772809199616,"internally_reserved":0,"allocated":13221888,"data_stored":6458356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.201162"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149767+0000","last_change":"2024-09-13T18:31:56.079618+0000","last_active":"2024-09-13T18:31:57.149767+0000","last_peered":"2024-09-13T18:31:57.149767+0000","last_clean":"2024-09-13T18:31:57.149767+0000","last_became_active":"2024-09-13T18:31:56.079313+0000","last_became_peered":"2024-09-13T18:31:56.079313+0000","last_unstale":"2024-09-13T18:31:57.149767+0000","last_undegraded":"2024-09-13T18:31:57.149767+0000","last_fullsized":"2024-09-13T18:31:57.149767+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:49.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057543+0000","last_change":"2024-09-13T18:31:56.074692+0000","last_active":"2024-09-13T18:31:57.057543+0000","last_peered":"2024-09-13T18:31:57.057543+0000","last_clean":"2024-09-13T18:31:57.057543+0000","last_became_active":"2024-09-13T18:31:56.074402+0000","last_became_peered":"2024-09-13T18:31:56.074402+0000","last_unstale":"2024-09-13T18:31:57.057543+0000","last_undegraded":"2024-09-13T18:31:57.057543+0000","last_fullsized":"2024-09-13T18:31:57.057543+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:20.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149712+0000","last_change":"2024-09-13T18:31:56.063772+0000","last_active":"2024-09-13T18:31:57.149712+0000","last_peered":"2024-09-13T18:31:57.149712+0000","last_clean":"2024-09-13T18:31:57.149712+0000","last_became_active":"2024-09-13T18:31:56.063029+0000","last_became_peered":"2024-09-13T18:31:56.063029+0000","last_unstale":"2024-09-13T18:31:57.149712+0000","last_undegraded":"2024-09-13T18:31:57.149712+0000","last_fullsized":"2024-09-13T18:31:57.149712+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:27.944996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149199+0000","last_change":"2024-09-13T18:31:56.075828+0000","last_active":"2024-09-13T18:31:57.149199+0000","last_peered":"2024-09-13T18:31:57.149199+0000","last_clean":"2024-09-13T18:31:57.149199+0000","last_became_active":"2024-09-13T18:31:56.075516+0000","last_became_peered":"2024-09-13T18:31:56.075516+0000","last_unstale":"2024-09-13T18:31:57.149199+0000","last_undegraded":"2024-09-13T18:31:57.149199+0000","last_fullsized":"2024-09-13T18:31:57.149199+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:20.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149007+0000","last_change":"2024-09-13T18:31:56.110401+0000","last_active":"2024-09-13T18:31:57.149007+0000","last_peered":"2024-09-13T18:31:57.149007+0000","last_clean":"2024-09-13T18:31:57.149007+0000","last_became_active":"2024-09-13T18:31:56.109500+0000","last_became_peered":"2024-09-13T18:31:56.109500+0000","last_unstale":"2024-09-13T18:31:57.149007+0000","last_undegraded":"2024-09-13T18:31:57.149007+0000","last_fullsized":"2024-09-13T18:31:57.149007+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:24.584926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148816+0000","last_change":"2024-09-13T18:31:56.080555+0000","last_active":"2024-09-13T18:31:57.148816+0000","last_peered":"2024-09-13T18:31:57.148816+0000","last_clean":"2024-09-13T18:31:57.148816+0000","last_became_active":"2024-09-13T18:31:56.078949+0000","last_became_peered":"2024-09-13T18:31:56.078949+0000","last_unstale":"2024-09-13T18:31:57.148816+0000","last_undegraded":"2024-09-13T18:31:57.148816+0000","last_fullsized":"2024-09-13T18:31:57.148816+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:16.543003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147888+0000","last_change":"2024-09-13T18:31:56.089455+0000","last_active":"2024-09-13T18:31:57.147888+0000","last_peered":"2024-09-13T18:31:57.147888+0000","last_clean":"2024-09-13T18:31:57.147888+0000","last_became_active":"2024-09-13T18:31:56.088681+0000","last_became_peered":"2024-09-13T18:31:56.088681+0000","last_unstale":"2024-09-13T18:31:57.147888+0000","last_undegraded":"2024-09-13T18:31:57.147888+0000","last_fullsized":"2024-09-13T18:31:57.147888+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:24.584926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149692+0000","last_change":"2024-09-13T18:31:56.080627+0000","last_active":"2024-09-13T18:31:57.149692+0000","last_peered":"2024-09-13T18:31:57.149692+0000","last_clean":"2024-09-13T18:31:57.149692+0000","last_became_active":"2024-09-13T18:31:56.077041+0000","last_became_peered":"2024-09-13T18:31:56.077041+0000","last_unstale":"2024-09-13T18:31:57.149692+0000","last_undegraded":"2024-09-13T18:31:57.149692+0000","last_fullsized":"2024-09-13T18:31:57.149692+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:25.156024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150804+0000","last_change":"2024-09-13T18:31:56.101644+0000","last_active":"2024-09-13T18:31:57.150804+0000","last_peered":"2024-09-13T18:31:57.150804+0000","last_clean":"2024-09-13T18:31:57.150804+0000","last_became_active":"2024-09-13T18:31:56.100966+0000","last_became_peered":"2024-09-13T18:31:56.100966+0000","last_unstale":"2024-09-13T18:31:57.150804+0000","last_undegraded":"2024-09-13T18:31:57.150804+0000","last_fullsized":"2024-09-13T18:31:57.150804+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:19.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057622+0000","last_change":"2024-09-13T18:31:56.074377+0000","last_active":"2024-09-13T18:31:57.057622+0000","last_peered":"2024-09-13T18:31:57.057622+0000","last_clean":"2024-09-13T18:31:57.057622+0000","last_became_active":"2024-09-13T18:31:56.074047+0000","last_became_peered":"2024-09-13T18:31:56.074047+0000","last_unstale":"2024-09-13T18:31:57.057622+0000","last_undegraded":"2024-09-13T18:31:57.057622+0000","last_fullsized":"2024-09-13T18:31:57.057622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:52.215720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149286+0000","last_change":"2024-09-13T18:31:56.068659+0000","last_active":"2024-09-13T18:31:57.149286+0000","last_peered":"2024-09-13T18:31:57.149286+0000","last_clean":"2024-09-13T18:31:57.149286+0000","last_became_active":"2024-09-13T18:31:56.068071+0000","last_became_peered":"2024-09-13T18:31:56.068071+0000","last_unstale":"2024-09-13T18:31:57.149286+0000","last_undegraded":"2024-09-13T18:31:57.149286+0000","last_fullsized":"2024-09-13T18:31:57.149286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:29.697455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149997+0000","last_change":"2024-09-13T18:31:56.102675+0000","last_active":"2024-09-13T18:31:57.149997+0000","last_peered":"2024-09-13T18:31:57.149997+0000","last_clean":"2024-09-13T18:31:57.149997+0000","last_became_active":"2024-09-13T18:31:56.101024+0000","last_became_peered":"2024-09-13T18:31:56.101024+0000","last_unstale":"2024-09-13T18:31:57.149997+0000","last_undegraded":"2024-09-13T18:31:57.149997+0000","last_fullsized":"2024-09-13T18:31:57.149997+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:40.424506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149621+0000","last_change":"2024-09-13T18:31:56.078603+0000","last_active":"2024-09-13T18:31:57.149621+0000","last_peered":"2024-09-13T18:31:57.149621+0000","last_clean":"2024-09-13T18:31:57.149621+0000","last_became_active":"2024-09-13T18:31:56.078307+0000","last_became_peered":"2024-09-13T18:31:56.078307+0000","last_unstale":"2024-09-13T18:31:57.149621+0000","last_undegraded":"2024-09-13T18:31:57.149621+0000","last_fullsized":"2024-09-13T18:31:57.149621+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:20.464396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057628+0000","last_change":"2024-09-13T18:31:56.068294+0000","last_active":"2024-09-13T18:31:57.057628+0000","last_peered":"2024-09-13T18:31:57.057628+0000","last_clean":"2024-09-13T18:31:57.057628+0000","last_became_active":"2024-09-13T18:31:56.068039+0000","last_became_peered":"2024-09-13T18:31:56.068039+0000","last_unstale":"2024-09-13T18:31:57.057628+0000","last_undegraded":"2024-09-13T18:31:57.057628+0000","last_fullsized":"2024-09-13T18:31:57.057628+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:36.804349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147996+0000","last_change":"2024-09-13T18:31:56.058792+0000","last_active":"2024-09-13T18:31:57.147996+0000","last_peered":"2024-09-13T18:31:57.147996+0000","last_clean":"2024-09-13T18:31:57.147996+0000","last_became_active":"2024-09-13T18:31:56.058370+0000","last_became_peered":"2024-09-13T18:31:56.058370+0000","last_unstale":"2024-09-13T18:31:57.147996+0000","last_undegraded":"2024-09-13T18:31:57.147996+0000","last_fullsized":"2024-09-13T18:31:57.147996+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:10.919680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148770+0000","last_change":"2024-09-13T18:31:56.068259+0000","last_active":"2024-09-13T18:31:57.148770+0000","last_peered":"2024-09-13T18:31:57.148770+0000","last_clean":"2024-09-13T18:31:57.148770+0000","last_became_active":"2024-09-13T18:31:56.067950+0000","last_became_peered":"2024-09-13T18:31:56.067950+0000","last_unstale":"2024-09-13T18:31:57.148770+0000","last_undegraded":"2024-09-13T18:31:57.148770+0000","last_fullsized":"2024-09-13T18:31:57.148770+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.844885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148516+0000","last_change":"2024-09-13T18:31:56.080148+0000","last_active":"2024-09-13T18:31:57.148516+0000","last_peered":"2024-09-13T18:31:57.148516+0000","last_clean":"2024-09-13T18:31:57.148516+0000","last_became_active":"2024-09-13T18:31:56.078187+0000","last_became_peered":"2024-09-13T18:31:56.078187+0000","last_unstale":"2024-09-13T18:31:57.148516+0000","last_undegraded":"2024-09-13T18:31:57.148516+0000","last_fullsized":"2024-09-13T18:31:57.148516+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.243790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150469+0000","last_change":"2024-09-13T18:31:56.081401+0000","last_active":"2024-09-13T18:31:57.150469+0000","last_peered":"2024-09-13T18:31:57.150469+0000","last_clean":"2024-09-13T18:31:57.150469+0000","last_became_active":"2024-09-13T18:31:56.081149+0000","last_became_peered":"2024-09-13T18:31:56.081149+0000","last_unstale":"2024-09-13T18:31:57.150469+0000","last_undegraded":"2024-09-13T18:31:57.150469+0000","last_fullsized":"2024-09-13T18:31:57.150469+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:56.623633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149495+0000","last_change":"2024-09-13T18:31:56.089609+0000","last_active":"2024-09-13T18:31:57.149495+0000","last_peered":"2024-09-13T18:31:57.149495+0000","last_clean":"2024-09-13T18:31:57.149495+0000","last_became_active":"2024-09-13T18:31:56.089389+0000","last_became_peered":"2024-09-13T18:31:56.089389+0000","last_unstale":"2024-09-13T18:31:57.149495+0000","last_undegraded":"2024-09-13T18:31:57.149495+0000","last_fullsized":"2024-09-13T18:31:57.149495+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:56.150810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150469+0000","last_change":"2024-09-13T18:31:56.066606+0000","last_active":"2024-09-13T18:31:57.150469+0000","last_peered":"2024-09-13T18:31:57.150469+0000","last_clean":"2024-09-13T18:31:57.150469+0000","last_became_active":"2024-09-13T18:31:56.066250+0000","last_became_peered":"2024-09-13T18:31:56.066250+0000","last_unstale":"2024-09-13T18:31:57.150469+0000","last_undegraded":"2024-09-13T18:31:57.150469+0000","last_fullsized":"2024-09-13T18:31:57.150469+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.243790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148633+0000","last_change":"2024-09-13T18:31:56.108738+0000","last_active":"2024-09-13T18:31:57.148633+0000","last_peered":"2024-09-13T18:31:57.148633+0000","last_clean":"2024-09-13T18:31:57.148633+0000","last_became_active":"2024-09-13T18:31:56.108057+0000","last_became_peered":"2024-09-13T18:31:56.108057+0000","last_unstale":"2024-09-13T18:31:57.148633+0000","last_undegraded":"2024-09-13T18:31:57.148633+0000","last_fullsized":"2024-09-13T18:31:57.148633+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:32.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148461+0000","last_change":"2024-09-13T18:31:56.065885+0000","last_active":"2024-09-13T18:31:57.148461+0000","last_peered":"2024-09-13T18:31:57.148461+0000","last_clean":"2024-09-13T18:31:57.148461+0000","last_became_active":"2024-09-13T18:31:56.065545+0000","last_became_peered":"2024-09-13T18:31:56.065545+0000","last_unstale":"2024-09-13T18:31:57.148461+0000","last_undegraded":"2024-09-13T18:31:57.148461+0000","last_fullsized":"2024-09-13T18:31:57.148461+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:27.292342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150252+0000","last_change":"2024-09-13T18:31:56.096900+0000","last_active":"2024-09-13T18:31:57.150252+0000","last_peered":"2024-09-13T18:31:57.150252+0000","last_clean":"2024-09-13T18:31:57.150252+0000","last_became_active":"2024-09-13T18:31:56.096288+0000","last_became_peered":"2024-09-13T18:31:56.096288+0000","last_unstale":"2024-09-13T18:31:57.150252+0000","last_undegraded":"2024-09-13T18:31:57.150252+0000","last_fullsized":"2024-09-13T18:31:57.150252+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:23.277937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147864+0000","last_change":"2024-09-13T18:31:56.083691+0000","last_active":"2024-09-13T18:31:57.147864+0000","last_peered":"2024-09-13T18:31:57.147864+0000","last_clean":"2024-09-13T18:31:57.147864+0000","last_became_active":"2024-09-13T18:31:56.082869+0000","last_became_peered":"2024-09-13T18:31:56.082869+0000","last_unstale":"2024-09-13T18:31:57.147864+0000","last_undegraded":"2024-09-13T18:31:57.147864+0000","last_fullsized":"2024-09-13T18:31:57.147864+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:38.574340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.058425+0000","last_change":"2024-09-13T18:31:56.075307+0000","last_active":"2024-09-13T18:31:57.058425+0000","last_peered":"2024-09-13T18:31:57.058425+0000","last_clean":"2024-09-13T18:31:57.058425+0000","last_became_active":"2024-09-13T18:31:56.075018+0000","last_became_peered":"2024-09-13T18:31:56.075018+0000","last_unstale":"2024-09-13T18:31:57.058425+0000","last_undegraded":"2024-09-13T18:31:57.058425+0000","last_fullsized":"2024-09-13T18:31:57.058425+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:34.200784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150745+0000","last_change":"2024-09-13T18:31:56.068444+0000","last_active":"2024-09-13T18:31:57.150745+0000","last_peered":"2024-09-13T18:31:57.150745+0000","last_clean":"2024-09-13T18:31:57.150745+0000","last_became_active":"2024-09-13T18:31:56.068062+0000","last_became_peered":"2024-09-13T18:31:56.068062+0000","last_unstale":"2024-09-13T18:31:57.150745+0000","last_undegraded":"2024-09-13T18:31:57.150745+0000","last_fullsized":"2024-09-13T18:31:57.150745+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:24.584926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149672+0000","last_change":"2024-09-13T18:31:56.085923+0000","last_active":"2024-09-13T18:31:57.149672+0000","last_peered":"2024-09-13T18:31:57.149672+0000","last_clean":"2024-09-13T18:31:57.149672+0000","last_became_active":"2024-09-13T18:31:56.085702+0000","last_became_peered":"2024-09-13T18:31:56.085702+0000","last_unstale":"2024-09-13T18:31:57.149672+0000","last_undegraded":"2024-09-13T18:31:57.149672+0000","last_fullsized":"2024-09-13T18:31:57.149672+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:15.845205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060677+0000","last_change":"2024-09-13T18:31:56.094661+0000","last_active":"2024-09-13T18:31:57.060677+0000","last_peered":"2024-09-13T18:31:57.060677+0000","last_clean":"2024-09-13T18:31:57.060677+0000","last_became_active":"2024-09-13T18:31:56.093852+0000","last_became_peered":"2024-09-13T18:31:56.093852+0000","last_unstale":"2024-09-13T18:31:57.060677+0000","last_undegraded":"2024-09-13T18:31:57.060677+0000","last_fullsized":"2024-09-13T18:31:57.060677+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:43.678995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149863+0000","last_change":"2024-09-13T18:31:56.060909+0000","last_active":"2024-09-13T18:31:57.149863+0000","last_peered":"2024-09-13T18:31:57.149863+0000","last_clean":"2024-09-13T18:31:57.149863+0000","last_became_active":"2024-09-13T18:31:56.060623+0000","last_became_peered":"2024-09-13T18:31:56.060623+0000","last_unstale":"2024-09-13T18:31:57.149863+0000","last_undegraded":"2024-09-13T18:31:57.149863+0000","last_fullsized":"2024-09-13T18:31:57.149863+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:11.245620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148583+0000","last_change":"2024-09-13T18:31:56.056233+0000","last_active":"2024-09-13T18:31:57.148583+0000","last_peered":"2024-09-13T18:31:57.148583+0000","last_clean":"2024-09-13T18:31:57.148583+0000","last_became_active":"2024-09-13T18:31:56.055845+0000","last_became_peered":"2024-09-13T18:31:56.055845+0000","last_unstale":"2024-09-13T18:31:57.148583+0000","last_undegraded":"2024-09-13T18:31:57.148583+0000","last_fullsized":"2024-09-13T18:31:57.148583+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:30.797004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147998+0000","last_change":"2024-09-13T18:31:56.102081+0000","last_active":"2024-09-13T18:31:57.147998+0000","last_peered":"2024-09-13T18:31:57.147998+0000","last_clean":"2024-09-13T18:31:57.147998+0000","last_became_active":"2024-09-13T18:31:56.101379+0000","last_became_peered":"2024-09-13T18:31:56.101379+0000","last_unstale":"2024-09-13T18:31:57.147998+0000","last_undegraded":"2024-09-13T18:31:57.147998+0000","last_fullsized":"2024-09-13T18:31:57.147998+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:40.956945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148026+0000","last_change":"2024-09-13T18:31:56.078553+0000","last_active":"2024-09-13T18:31:57.148026+0000","last_peered":"2024-09-13T18:31:57.148026+0000","last_clean":"2024-09-13T18:31:57.148026+0000","last_became_active":"2024-09-13T18:31:56.073490+0000","last_became_peered":"2024-09-13T18:31:56.073490+0000","last_unstale":"2024-09-13T18:31:57.148026+0000","last_undegraded":"2024-09-13T18:31:57.148026+0000","last_fullsized":"2024-09-13T18:31:57.148026+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.844885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150910+0000","last_change":"2024-09-13T18:31:56.083298+0000","last_active":"2024-09-13T18:31:57.150910+0000","last_peered":"2024-09-13T18:31:57.150910+0000","last_clean":"2024-09-13T18:31:57.150910+0000","last_became_active":"2024-09-13T18:31:56.083040+0000","last_became_peered":"2024-09-13T18:31:56.083040+0000","last_unstale":"2024-09-13T18:31:57.150910+0000","last_undegraded":"2024-09-13T18:31:57.150910+0000","last_fullsized":"2024-09-13T18:31:57.150910+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:41.358018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"119'4","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149171+0000","last_change":"2024-09-13T18:31:55.697978+0000","last_active":"2024-09-13T18:31:57.149171+0000","last_peered":"2024-09-13T18:31:57.149171+0000","last_clean":"2024-09-13T18:31:57.149171+0000","last_became_active":"2024-09-13T18:31:55.696175+0000","last_became_peered":"2024-09-13T18:31:55.696175+0000","last_unstale":"2024-09-13T18:31:57.149171+0000","last_undegraded":"2024-09-13T18:31:57.149171+0000","last_fullsized":"2024-09-13T18:31:57.149171+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:39.414416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150862+0000","last_change":"2024-09-13T18:31:56.077763+0000","last_active":"2024-09-13T18:31:57.150862+0000","last_peered":"2024-09-13T18:31:57.150862+0000","last_clean":"2024-09-13T18:31:57.150862+0000","last_became_active":"2024-09-13T18:31:56.075408+0000","last_became_peered":"2024-09-13T18:31:56.075408+0000","last_unstale":"2024-09-13T18:31:57.150862+0000","last_undegraded":"2024-09-13T18:31:57.150862+0000","last_fullsized":"2024-09-13T18:31:57.150862+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:43.678995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060756+0000","last_change":"2024-09-13T18:31:55.700809+0000","last_active":"2024-09-13T18:31:57.060756+0000","last_peered":"2024-09-13T18:31:57.060756+0000","last_clean":"2024-09-13T18:31:57.060756+0000","last_became_active":"2024-09-13T18:31:55.700076+0000","last_became_peered":"2024-09-13T18:31:55.700076+0000","last_unstale":"2024-09-13T18:31:57.060756+0000","last_undegraded":"2024-09-13T18:31:57.060756+0000","last_fullsized":"2024-09-13T18:31:57.060756+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:25.345372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149681+0000","last_change":"2024-09-13T18:31:56.104582+0000","last_active":"2024-09-13T18:31:57.149681+0000","last_peered":"2024-09-13T18:31:57.149681+0000","last_clean":"2024-09-13T18:31:57.149681+0000","last_became_active":"2024-09-13T18:31:56.103321+0000","last_became_peered":"2024-09-13T18:31:56.103321+0000","last_unstale":"2024-09-13T18:31:57.149681+0000","last_undegraded":"2024-09-13T18:31:57.149681+0000","last_fullsized":"2024-09-13T18:31:57.149681+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:21.398146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149698+0000","last_change":"2024-09-13T18:31:55.680175+0000","last_active":"2024-09-13T18:31:57.149698+0000","last_peered":"2024-09-13T18:31:57.149698+0000","last_clean":"2024-09-13T18:31:57.149698+0000","last_became_active":"2024-09-13T18:31:55.679645+0000","last_became_peered":"2024-09-13T18:31:55.679645+0000","last_unstale":"2024-09-13T18:31:57.149698+0000","last_undegraded":"2024-09-13T18:31:57.149698+0000","last_fullsized":"2024-09-13T18:31:57.149698+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.846277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148874+0000","last_change":"2024-09-13T18:31:56.098447+0000","last_active":"2024-09-13T18:31:57.148874+0000","last_peered":"2024-09-13T18:31:57.148874+0000","last_clean":"2024-09-13T18:31:57.148874+0000","last_became_active":"2024-09-13T18:31:56.097715+0000","last_became_peered":"2024-09-13T18:31:56.097715+0000","last_unstale":"2024-09-13T18:31:57.148874+0000","last_undegraded":"2024-09-13T18:31:57.148874+0000","last_fullsized":"2024-09-13T18:31:57.148874+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:16.543003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.058279+0000","last_change":"2024-09-13T18:31:55.674135+0000","last_active":"2024-09-13T18:31:57.058279+0000","last_peered":"2024-09-13T18:31:57.058279+0000","last_clean":"2024-09-13T18:31:57.058279+0000","last_became_active":"2024-09-13T18:31:55.673878+0000","last_became_peered":"2024-09-13T18:31:55.673878+0000","last_unstale":"2024-09-13T18:31:57.058279+0000","last_undegraded":"2024-09-13T18:31:57.058279+0000","last_fullsized":"2024-09-13T18:31:57.058279+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:17.386625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150191+0000","last_change":"2024-09-13T18:31:56.080430+0000","last_active":"2024-09-13T18:31:57.150191+0000","last_peered":"2024-09-13T18:31:57.150191+0000","last_clean":"2024-09-13T18:31:57.150191+0000","last_became_active":"2024-09-13T18:31:56.080118+0000","last_became_peered":"2024-09-13T18:31:56.080118+0000","last_unstale":"2024-09-13T18:31:57.150191+0000","last_undegraded":"2024-09-13T18:31:57.150191+0000","last_fullsized":"2024-09-13T18:31:57.150191+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:03.994845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057609+0000","last_change":"2024-09-13T18:31:55.680199+0000","last_active":"2024-09-13T18:31:57.057609+0000","last_peered":"2024-09-13T18:31:57.057609+0000","last_clean":"2024-09-13T18:31:57.057609+0000","last_became_active":"2024-09-13T18:31:55.679890+0000","last_became_peered":"2024-09-13T18:31:55.679890+0000","last_unstale":"2024-09-13T18:31:57.057609+0000","last_undegraded":"2024-09-13T18:31:57.057609+0000","last_fullsized":"2024-09-13T18:31:57.057609+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:10.749697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148486+0000","last_change":"2024-09-13T18:31:56.072883+0000","last_active":"2024-09-13T18:31:57.148486+0000","last_peered":"2024-09-13T18:31:57.148486+0000","last_clean":"2024-09-13T18:31:57.148486+0000","last_became_active":"2024-09-13T18:31:56.072183+0000","last_became_peered":"2024-09-13T18:31:56.072183+0000","last_unstale":"2024-09-13T18:31:57.148486+0000","last_undegraded":"2024-09-13T18:31:57.148486+0000","last_fullsized":"2024-09-13T18:31:57.148486+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:21.398146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150428+0000","last_change":"2024-09-13T18:31:55.679554+0000","last_active":"2024-09-13T18:31:57.150428+0000","last_peered":"2024-09-13T18:31:57.150428+0000","last_clean":"2024-09-13T18:31:57.150428+0000","last_became_active":"2024-09-13T18:31:55.679253+0000","last_became_peered":"2024-09-13T18:31:55.679253+0000","last_unstale":"2024-09-13T18:31:57.150428+0000","last_undegraded":"2024-09-13T18:31:57.150428+0000","last_fullsized":"2024-09-13T18:31:57.150428+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:34.401172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149951+0000","last_change":"2024-09-13T18:31:56.061633+0000","last_active":"2024-09-13T18:31:57.149951+0000","last_peered":"2024-09-13T18:31:57.149951+0000","last_clean":"2024-09-13T18:31:57.149951+0000","last_became_active":"2024-09-13T18:31:56.060881+0000","last_became_peered":"2024-09-13T18:31:56.060881+0000","last_unstale":"2024-09-13T18:31:57.149951+0000","last_undegraded":"2024-09-13T18:31:57.149951+0000","last_fullsized":"2024-09-13T18:31:57.149951+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:29.475648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150506+0000","last_change":"2024-09-13T18:31:55.690402+0000","last_active":"2024-09-13T18:31:57.150506+0000","last_peered":"2024-09-13T18:31:57.150506+0000","last_clean":"2024-09-13T18:31:57.150506+0000","last_became_active":"2024-09-13T18:31:55.689621+0000","last_became_peered":"2024-09-13T18:31:55.689621+0000","last_unstale":"2024-09-13T18:31:57.150506+0000","last_undegraded":"2024-09-13T18:31:57.150506+0000","last_fullsized":"2024-09-13T18:31:57.150506+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:14.560243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057260+0000","last_change":"2024-09-13T18:31:56.065879+0000","last_active":"2024-09-13T18:31:57.057260+0000","last_peered":"2024-09-13T18:31:57.057260+0000","last_clean":"2024-09-13T18:31:57.057260+0000","last_became_active":"2024-09-13T18:31:56.065686+0000","last_became_peered":"2024-09-13T18:31:56.065686+0000","last_unstale":"2024-09-13T18:31:57.057260+0000","last_undegraded":"2024-09-13T18:31:57.057260+0000","last_fullsized":"2024-09-13T18:31:57.057260+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.924428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057418+0000","last_change":"2024-09-13T18:31:55.678457+0000","last_active":"2024-09-13T18:31:57.057418+0000","last_peered":"2024-09-13T18:31:57.057418+0000","last_clean":"2024-09-13T18:31:57.057418+0000","last_became_active":"2024-09-13T18:31:55.677971+0000","last_became_peered":"2024-09-13T18:31:55.677971+0000","last_unstale":"2024-09-13T18:31:57.057418+0000","last_undegraded":"2024-09-13T18:31:57.057418+0000","last_fullsized":"2024-09-13T18:31:57.057418+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:37.043337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150217+0000","last_change":"2024-09-13T18:31:56.058247+0000","last_active":"2024-09-13T18:31:57.150217+0000","last_peered":"2024-09-13T18:31:57.150217+0000","last_clean":"2024-09-13T18:31:57.150217+0000","last_became_active":"2024-09-13T18:31:56.058019+0000","last_became_peered":"2024-09-13T18:31:56.058019+0000","last_unstale":"2024-09-13T18:31:57.150217+0000","last_undegraded":"2024-09-13T18:31:57.150217+0000","last_fullsized":"2024-09-13T18:31:57.150217+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:37.128186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.061182+0000","last_change":"2024-09-13T18:31:55.693070+0000","last_active":"2024-09-13T18:31:57.061182+0000","last_peered":"2024-09-13T18:31:57.061182+0000","last_clean":"2024-09-13T18:31:57.061182+0000","last_became_active":"2024-09-13T18:31:55.691328+0000","last_became_peered":"2024-09-13T18:31:55.691328+0000","last_unstale":"2024-09-13T18:31:57.061182+0000","last_undegraded":"2024-09-13T18:31:57.061182+0000","last_fullsized":"2024-09-13T18:31:57.061182+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:35.082308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060957+0000","last_change":"2024-09-13T18:31:56.096314+0000","last_active":"2024-09-13T18:31:57.060957+0000","last_peered":"2024-09-13T18:31:57.060957+0000","last_clean":"2024-09-13T18:31:57.060957+0000","last_became_active":"2024-09-13T18:31:56.095655+0000","last_became_peered":"2024-09-13T18:31:56.095655+0000","last_unstale":"2024-09-13T18:31:57.060957+0000","last_undegraded":"2024-09-13T18:31:57.060957+0000","last_fullsized":"2024-09-13T18:31:57.060957+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:47.883932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.151027+0000","last_change":"2024-09-13T18:31:55.693332+0000","last_active":"2024-09-13T18:31:57.151027+0000","last_peered":"2024-09-13T18:31:57.151027+0000","last_clean":"2024-09-13T18:31:57.151027+0000","last_became_active":"2024-09-13T18:31:55.693013+0000","last_became_peered":"2024-09-13T18:31:55.693013+0000","last_unstale":"2024-09-13T18:31:57.151027+0000","last_undegraded":"2024-09-13T18:31:57.151027+0000","last_fullsized":"2024-09-13T18:31:57.151027+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:35.540009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149799+0000","last_change":"2024-09-13T18:31:56.104940+0000","last_active":"2024-09-13T18:31:57.149799+0000","last_peered":"2024-09-13T18:31:57.149799+0000","last_clean":"2024-09-13T18:31:57.149799+0000","last_became_active":"2024-09-13T18:31:56.103926+0000","last_became_peered":"2024-09-13T18:31:56.103926+0000","last_unstale":"2024-09-13T18:31:57.149799+0000","last_undegraded":"2024-09-13T18:31:57.149799+0000","last_fullsized":"2024-09-13T18:31:57.149799+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:03.327372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"119'3","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060420+0000","last_change":"2024-09-13T18:31:55.689843+0000","last_active":"2024-09-13T18:31:57.060420+0000","last_peered":"2024-09-13T18:31:57.060420+0000","last_clean":"2024-09-13T18:31:57.060420+0000","last_became_active":"2024-09-13T18:31:55.689090+0000","last_became_peered":"2024-09-13T18:31:55.689090+0000","last_unstale":"2024-09-13T18:31:57.060420+0000","last_undegraded":"2024-09-13T18:31:57.060420+0000","last_fullsized":"2024-09-13T18:31:57.060420+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.973718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148410+0000","last_change":"2024-09-13T18:31:56.101874+0000","last_active":"2024-09-13T18:31:57.148410+0000","last_peered":"2024-09-13T18:31:57.148410+0000","last_clean":"2024-09-13T18:31:57.148410+0000","last_became_active":"2024-09-13T18:31:56.099224+0000","last_became_peered":"2024-09-13T18:31:56.099224+0000","last_unstale":"2024-09-13T18:31:57.148410+0000","last_undegraded":"2024-09-13T18:31:57.148410+0000","last_fullsized":"2024-09-13T18:31:57.148410+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.844885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"119'6","reported_seq":17,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150171+0000","last_change":"2024-09-13T18:31:55.697654+0000","last_active":"2024-09-13T18:31:57.150171+0000","last_peered":"2024-09-13T18:31:57.150171+0000","last_clean":"2024-09-13T18:31:57.150171+0000","last_became_active":"2024-09-13T18:31:55.696954+0000","last_became_peered":"2024-09-13T18:31:55.696954+0000","last_unstale":"2024-09-13T18:31:57.150171+0000","last_undegraded":"2024-09-13T18:31:57.150171+0000","last_fullsized":"2024-09-13T18:31:57.150171+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:08.052421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150108+0000","last_change":"2024-09-13T18:31:56.058509+0000","last_active":"2024-09-13T18:31:57.150108+0000","last_peered":"2024-09-13T18:31:57.150108+0000","last_clean":"2024-09-13T18:31:57.150108+0000","last_became_active":"2024-09-13T18:31:56.058198+0000","last_became_peered":"2024-09-13T18:31:56.058198+0000","last_unstale":"2024-09-13T18:31:57.150108+0000","last_undegraded":"2024-09-13T18:31:57.150108+0000","last_fullsized":"2024-09-13T18:31:57.150108+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:35.712261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148802+0000","last_change":"2024-09-13T18:31:55.680639+0000","last_active":"2024-09-13T18:31:57.148802+0000","last_peered":"2024-09-13T18:31:57.148802+0000","last_clean":"2024-09-13T18:31:57.148802+0000","last_became_active":"2024-09-13T18:31:55.680339+0000","last_became_peered":"2024-09-13T18:31:55.680339+0000","last_unstale":"2024-09-13T18:31:57.148802+0000","last_undegraded":"2024-09-13T18:31:57.148802+0000","last_fullsized":"2024-09-13T18:31:57.148802+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:39.917422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057191+0000","last_change":"2024-09-13T18:31:56.074684+0000","last_active":"2024-09-13T18:31:57.057191+0000","last_peered":"2024-09-13T18:31:57.057191+0000","last_clean":"2024-09-13T18:31:57.057191+0000","last_became_active":"2024-09-13T18:31:56.074378+0000","last_became_peered":"2024-09-13T18:31:56.074378+0000","last_unstale":"2024-09-13T18:31:57.057191+0000","last_undegraded":"2024-09-13T18:31:57.057191+0000","last_fullsized":"2024-09-13T18:31:57.057191+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:26.355462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057309+0000","last_change":"2024-09-13T18:31:55.679913+0000","last_active":"2024-09-13T18:31:57.057309+0000","last_peered":"2024-09-13T18:31:57.057309+0000","last_clean":"2024-09-13T18:31:57.057309+0000","last_became_active":"2024-09-13T18:31:55.679496+0000","last_became_peered":"2024-09-13T18:31:55.679496+0000","last_unstale":"2024-09-13T18:31:57.057309+0000","last_undegraded":"2024-09-13T18:31:57.057309+0000","last_fullsized":"2024-09-13T18:31:57.057309+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:28.126201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150085+0000","last_change":"2024-09-13T18:31:56.106136+0000","last_active":"2024-09-13T18:31:57.150085+0000","last_peered":"2024-09-13T18:31:57.150085+0000","last_clean":"2024-09-13T18:31:57.150085+0000","last_became_active":"2024-09-13T18:31:56.103032+0000","last_became_peered":"2024-09-13T18:31:56.103032+0000","last_unstale":"2024-09-13T18:31:57.150085+0000","last_undegraded":"2024-09-13T18:31:57.150085+0000","last_fullsized":"2024-09-13T18:31:57.150085+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:43.539439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"119'8","reported_seq":19,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150339+0000","last_change":"2024-09-13T18:31:55.689377+0000","last_active":"2024-09-13T18:31:57.150339+0000","last_peered":"2024-09-13T18:31:57.150339+0000","last_clean":"2024-09-13T18:31:57.150339+0000","last_became_active":"2024-09-13T18:31:55.687218+0000","last_became_peered":"2024-09-13T18:31:55.687218+0000","last_unstale":"2024-09-13T18:31:57.150339+0000","last_undegraded":"2024-09-13T18:31:57.150339+0000","last_fullsized":"2024-09-13T18:31:57.150339+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.973718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150728+0000","last_change":"2024-09-13T18:31:56.077575+0000","last_active":"2024-09-13T18:31:57.150728+0000","last_peered":"2024-09-13T18:31:57.150728+0000","last_clean":"2024-09-13T18:31:57.150728+0000","last_became_active":"2024-09-13T18:31:56.075861+0000","last_became_peered":"2024-09-13T18:31:56.075861+0000","last_unstale":"2024-09-13T18:31:57.150728+0000","last_undegraded":"2024-09-13T18:31:57.150728+0000","last_fullsized":"2024-09-13T18:31:57.150728+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:47.883932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.061135+0000","last_change":"2024-09-13T18:31:55.703056+0000","last_active":"2024-09-13T18:31:57.061135+0000","last_peered":"2024-09-13T18:31:57.061135+0000","last_clean":"2024-09-13T18:31:57.061135+0000","last_became_active":"2024-09-13T18:31:55.702451+0000","last_became_peered":"2024-09-13T18:31:55.702451+0000","last_unstale":"2024-09-13T18:31:57.061135+0000","last_undegraded":"2024-09-13T18:31:57.061135+0000","last_fullsized":"2024-09-13T18:31:57.061135+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:07.856738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060909+0000","last_change":"2024-09-13T18:31:56.103551+0000","last_active":"2024-09-13T18:31:57.060909+0000","last_peered":"2024-09-13T18:31:57.060909+0000","last_clean":"2024-09-13T18:31:57.060909+0000","last_became_active":"2024-09-13T18:31:56.102924+0000","last_became_peered":"2024-09-13T18:31:56.102924+0000","last_unstale":"2024-09-13T18:31:57.060909+0000","last_undegraded":"2024-09-13T18:31:57.060909+0000","last_fullsized":"2024-09-13T18:31:57.060909+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:04.662410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150512+0000","last_change":"2024-09-13T18:31:55.692074+0000","last_active":"2024-09-13T18:31:57.150512+0000","last_peered":"2024-09-13T18:31:57.150512+0000","last_clean":"2024-09-13T18:31:57.150512+0000","last_became_active":"2024-09-13T18:31:55.691775+0000","last_became_peered":"2024-09-13T18:31:55.691775+0000","last_unstale":"2024-09-13T18:31:57.150512+0000","last_undegraded":"2024-09-13T18:31:57.150512+0000","last_fullsized":"2024-09-13T18:31:57.150512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:20.517419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150740+0000","last_change":"2024-09-13T18:31:56.068497+0000","last_active":"2024-09-13T18:31:57.150740+0000","last_peered":"2024-09-13T18:31:57.150740+0000","last_clean":"2024-09-13T18:31:57.150740+0000","last_became_active":"2024-09-13T18:31:56.068178+0000","last_became_peered":"2024-09-13T18:31:56.068178+0000","last_unstale":"2024-09-13T18:31:57.150740+0000","last_undegraded":"2024-09-13T18:31:57.150740+0000","last_fullsized":"2024-09-13T18:31:57.150740+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:21.398146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149519+0000","last_change":"2024-09-13T18:31:55.680833+0000","last_active":"2024-09-13T18:31:57.149519+0000","last_peered":"2024-09-13T18:31:57.149519+0000","last_clean":"2024-09-13T18:31:57.149519+0000","last_became_active":"2024-09-13T18:31:55.680073+0000","last_became_peered":"2024-09-13T18:31:55.680073+0000","last_unstale":"2024-09-13T18:31:57.149519+0000","last_undegraded":"2024-09-13T18:31:57.149519+0000","last_fullsized":"2024-09-13T18:31:57.149519+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:35.540009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057594+0000","last_change":"2024-09-13T18:31:56.066860+0000","last_active":"2024-09-13T18:31:57.057594+0000","last_peered":"2024-09-13T18:31:57.057594+0000","last_clean":"2024-09-13T18:31:57.057594+0000","last_became_active":"2024-09-13T18:31:56.066607+0000","last_became_peered":"2024-09-13T18:31:56.066607+0000","last_unstale":"2024-09-13T18:31:57.057594+0000","last_undegraded":"2024-09-13T18:31:57.057594+0000","last_fullsized":"2024-09-13T18:31:57.057594+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:54.512340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060569+0000","last_change":"2024-09-13T18:31:55.690594+0000","last_active":"2024-09-13T18:31:57.060569+0000","last_peered":"2024-09-13T18:31:57.060569+0000","last_clean":"2024-09-13T18:31:57.060569+0000","last_became_active":"2024-09-13T18:31:55.688103+0000","last_became_peered":"2024-09-13T18:31:55.688103+0000","last_unstale":"2024-09-13T18:31:57.060569+0000","last_undegraded":"2024-09-13T18:31:57.060569+0000","last_fullsized":"2024-09-13T18:31:57.060569+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:33.190693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148753+0000","last_change":"2024-09-13T18:31:56.079683+0000","last_active":"2024-09-13T18:31:57.148753+0000","last_peered":"2024-09-13T18:31:57.148753+0000","last_clean":"2024-09-13T18:31:57.148753+0000","last_became_active":"2024-09-13T18:31:56.079425+0000","last_became_peered":"2024-09-13T18:31:56.079425+0000","last_unstale":"2024-09-13T18:31:57.148753+0000","last_undegraded":"2024-09-13T18:31:57.148753+0000","last_fullsized":"2024-09-13T18:31:57.148753+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:52.215720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060337+0000","last_change":"2024-09-13T18:31:55.686700+0000","last_active":"2024-09-13T18:31:57.060337+0000","last_peered":"2024-09-13T18:31:57.060337+0000","last_clean":"2024-09-13T18:31:57.060337+0000","last_became_active":"2024-09-13T18:31:55.685817+0000","last_became_peered":"2024-09-13T18:31:55.685817+0000","last_unstale":"2024-09-13T18:31:57.060337+0000","last_undegraded":"2024-09-13T18:31:57.060337+0000","last_fullsized":"2024-09-13T18:31:57.060337+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:14.589306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148737+0000","last_change":"2024-09-13T18:31:56.087704+0000","last_active":"2024-09-13T18:31:57.148737+0000","last_peered":"2024-09-13T18:31:57.148737+0000","last_clean":"2024-09-13T18:31:57.148737+0000","last_became_active":"2024-09-13T18:31:56.086982+0000","last_became_peered":"2024-09-13T18:31:56.086982+0000","last_unstale":"2024-09-13T18:31:57.148737+0000","last_undegraded":"2024-09-13T18:31:57.148737+0000","last_fullsized":"2024-09-13T18:31:57.148737+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:32.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150625+0000","last_change":"2024-09-13T18:31:55.693122+0000","last_active":"2024-09-13T18:31:57.150625+0000","last_peered":"2024-09-13T18:31:57.150625+0000","last_clean":"2024-09-13T18:31:57.150625+0000","last_became_active":"2024-09-13T18:31:55.692783+0000","last_became_peered":"2024-09-13T18:31:55.692783+0000","last_unstale":"2024-09-13T18:31:57.150625+0000","last_undegraded":"2024-09-13T18:31:57.150625+0000","last_fullsized":"2024-09-13T18:31:57.150625+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:18.832389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057332+0000","last_change":"2024-09-13T18:31:56.065761+0000","last_active":"2024-09-13T18:31:57.057332+0000","last_peered":"2024-09-13T18:31:57.057332+0000","last_clean":"2024-09-13T18:31:57.057332+0000","last_became_active":"2024-09-13T18:31:56.065484+0000","last_became_peered":"2024-09-13T18:31:56.065484+0000","last_unstale":"2024-09-13T18:31:57.057332+0000","last_undegraded":"2024-09-13T18:31:57.057332+0000","last_fullsized":"2024-09-13T18:31:57.057332+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:10.919680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149663+0000","last_change":"2024-09-13T18:31:55.693107+0000","last_active":"2024-09-13T18:31:57.149663+0000","last_peered":"2024-09-13T18:31:57.149663+0000","last_clean":"2024-09-13T18:31:57.149663+0000","last_became_active":"2024-09-13T18:31:55.692672+0000","last_became_peered":"2024-09-13T18:31:55.692672+0000","last_unstale":"2024-09-13T18:31:57.149663+0000","last_undegraded":"2024-09-13T18:31:57.149663+0000","last_fullsized":"2024-09-13T18:31:57.149663+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:43.791366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147843+0000","last_change":"2024-09-13T18:31:56.089001+0000","last_active":"2024-09-13T18:31:57.147843+0000","last_peered":"2024-09-13T18:31:57.147843+0000","last_clean":"2024-09-13T18:31:57.147843+0000","last_became_active":"2024-09-13T18:31:56.087255+0000","last_became_peered":"2024-09-13T18:31:56.087255+0000","last_unstale":"2024-09-13T18:31:57.147843+0000","last_undegraded":"2024-09-13T18:31:57.147843+0000","last_fullsized":"2024-09-13T18:31:57.147843+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:30.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148069+0000","last_change":"2024-09-13T18:31:55.688516+0000","last_active":"2024-09-13T18:31:57.148069+0000","last_peered":"2024-09-13T18:31:57.148069+0000","last_clean":"2024-09-13T18:31:57.148069+0000","last_became_active":"2024-09-13T18:31:55.688217+0000","last_became_peered":"2024-09-13T18:31:55.688217+0000","last_unstale":"2024-09-13T18:31:57.148069+0000","last_undegraded":"2024-09-13T18:31:57.148069+0000","last_fullsized":"2024-09-13T18:31:57.148069+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:20.140095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150956+0000","last_change":"2024-09-13T18:31:56.104215+0000","last_active":"2024-09-13T18:31:57.150956+0000","last_peered":"2024-09-13T18:31:57.150956+0000","last_clean":"2024-09-13T18:31:57.150956+0000","last_became_active":"2024-09-13T18:31:56.103667+0000","last_became_peered":"2024-09-13T18:31:56.103667+0000","last_unstale":"2024-09-13T18:31:57.150956+0000","last_undegraded":"2024-09-13T18:31:57.150956+0000","last_fullsized":"2024-09-13T18:31:57.150956+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:03.994845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150088+0000","last_change":"2024-09-13T18:31:55.691736+0000","last_active":"2024-09-13T18:31:57.150088+0000","last_peered":"2024-09-13T18:31:57.150088+0000","last_clean":"2024-09-13T18:31:57.150088+0000","last_became_active":"2024-09-13T18:31:55.691470+0000","last_became_peered":"2024-09-13T18:31:55.691470+0000","last_unstale":"2024-09-13T18:31:57.150088+0000","last_undegraded":"2024-09-13T18:31:57.150088+0000","last_fullsized":"2024-09-13T18:31:57.150088+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:46.452030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150989+0000","last_change":"2024-09-13T18:31:56.060128+0000","last_active":"2024-09-13T18:31:57.150989+0000","last_peered":"2024-09-13T18:31:57.150989+0000","last_clean":"2024-09-13T18:31:57.150989+0000","last_became_active":"2024-09-13T18:31:56.059777+0000","last_became_peered":"2024-09-13T18:31:56.059777+0000","last_unstale":"2024-09-13T18:31:57.150989+0000","last_undegraded":"2024-09-13T18:31:57.150989+0000","last_fullsized":"2024-09-13T18:31:57.150989+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:48.661838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148633+0000","last_change":"2024-09-13T18:31:55.697585+0000","last_active":"2024-09-13T18:31:57.148633+0000","last_peered":"2024-09-13T18:31:57.148633+0000","last_clean":"2024-09-13T18:31:57.148633+0000","last_became_active":"2024-09-13T18:31:55.696403+0000","last_became_peered":"2024-09-13T18:31:55.696403+0000","last_unstale":"2024-09-13T18:31:57.148633+0000","last_undegraded":"2024-09-13T18:31:57.148633+0000","last_fullsized":"2024-09-13T18:31:57.148633+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:24.145933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.058162+0000","last_change":"2024-09-13T18:31:56.075297+0000","last_active":"2024-09-13T18:31:57.058162+0000","last_peered":"2024-09-13T18:31:57.058162+0000","last_clean":"2024-09-13T18:31:57.058162+0000","last_became_active":"2024-09-13T18:31:56.074970+0000","last_became_peered":"2024-09-13T18:31:56.074970+0000","last_unstale":"2024-09-13T18:31:57.058162+0000","last_undegraded":"2024-09-13T18:31:57.058162+0000","last_fullsized":"2024-09-13T18:31:57.058162+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:17.251568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057679+0000","last_change":"2024-09-13T18:31:55.688838+0000","last_active":"2024-09-13T18:31:57.057679+0000","last_peered":"2024-09-13T18:31:57.057679+0000","last_clean":"2024-09-13T18:31:57.057679+0000","last_became_active":"2024-09-13T18:31:55.688358+0000","last_became_peered":"2024-09-13T18:31:55.688358+0000","last_unstale":"2024-09-13T18:31:57.057679+0000","last_undegraded":"2024-09-13T18:31:57.057679+0000","last_fullsized":"2024-09-13T18:31:57.057679+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:03.317408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149300+0000","last_change":"2024-09-13T18:31:56.084742+0000","last_active":"2024-09-13T18:31:57.149300+0000","last_peered":"2024-09-13T18:31:57.149300+0000","last_clean":"2024-09-13T18:31:57.149300+0000","last_became_active":"2024-09-13T18:31:56.083952+0000","last_became_peered":"2024-09-13T18:31:56.083952+0000","last_unstale":"2024-09-13T18:31:57.149300+0000","last_undegraded":"2024-09-13T18:31:57.149300+0000","last_fullsized":"2024-09-13T18:31:57.149300+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:30.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148905+0000","last_change":"2024-09-13T18:31:55.674046+0000","last_active":"2024-09-13T18:31:57.148905+0000","last_peered":"2024-09-13T18:31:57.148905+0000","last_clean":"2024-09-13T18:31:57.148905+0000","last_became_active":"2024-09-13T18:31:55.673666+0000","last_became_peered":"2024-09-13T18:31:55.673666+0000","last_unstale":"2024-09-13T18:31:57.148905+0000","last_undegraded":"2024-09-13T18:31:57.148905+0000","last_fullsized":"2024-09-13T18:31:57.148905+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:14.172379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148054+0000","last_change":"2024-09-13T18:31:56.088632+0000","last_active":"2024-09-13T18:31:57.148054+0000","last_peered":"2024-09-13T18:31:57.148054+0000","last_clean":"2024-09-13T18:31:57.148054+0000","last_became_active":"2024-09-13T18:31:56.087836+0000","last_became_peered":"2024-09-13T18:31:56.087836+0000","last_unstale":"2024-09-13T18:31:57.148054+0000","last_undegraded":"2024-09-13T18:31:57.148054+0000","last_fullsized":"2024-09-13T18:31:57.148054+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.243790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057842+0000","last_change":"2024-09-13T18:31:55.679590+0000","last_active":"2024-09-13T18:31:57.057842+0000","last_peered":"2024-09-13T18:31:57.057842+0000","last_clean":"2024-09-13T18:31:57.057842+0000","last_became_active":"2024-09-13T18:31:55.679263+0000","last_became_peered":"2024-09-13T18:31:55.679263+0000","last_unstale":"2024-09-13T18:31:57.057842+0000","last_undegraded":"2024-09-13T18:31:57.057842+0000","last_fullsized":"2024-09-13T18:31:57.057842+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:17.166526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060263+0000","last_change":"2024-09-13T18:31:56.071501+0000","last_active":"2024-09-13T18:31:57.060263+0000","last_peered":"2024-09-13T18:31:57.060263+0000","last_clean":"2024-09-13T18:31:57.060263+0000","last_became_active":"2024-09-13T18:31:56.070819+0000","last_became_peered":"2024-09-13T18:31:56.070819+0000","last_unstale":"2024-09-13T18:31:57.060263+0000","last_undegraded":"2024-09-13T18:31:57.060263+0000","last_fullsized":"2024-09-13T18:31:57.060263+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:58.837937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148299+0000","last_change":"2024-09-13T18:31:55.697519+0000","last_active":"2024-09-13T18:31:57.148299+0000","last_peered":"2024-09-13T18:31:57.148299+0000","last_clean":"2024-09-13T18:31:57.148299+0000","last_became_active":"2024-09-13T18:31:55.696907+0000","last_became_peered":"2024-09-13T18:31:55.696907+0000","last_unstale":"2024-09-13T18:31:57.148299+0000","last_undegraded":"2024-09-13T18:31:57.148299+0000","last_fullsized":"2024-09-13T18:31:57.148299+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:26.934905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149007+0000","last_change":"2024-09-13T18:31:56.063080+0000","last_active":"2024-09-13T18:31:57.149007+0000","last_peered":"2024-09-13T18:31:57.149007+0000","last_clean":"2024-09-13T18:31:57.149007+0000","last_became_active":"2024-09-13T18:31:56.062801+0000","last_became_peered":"2024-09-13T18:31:56.062801+0000","last_unstale":"2024-09-13T18:31:57.149007+0000","last_undegraded":"2024-09-13T18:31:57.149007+0000","last_fullsized":"2024-09-13T18:31:57.149007+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:32.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149883+0000","last_change":"2024-09-13T18:31:55.687059+0000","last_active":"2024-09-13T18:31:57.149883+0000","last_peered":"2024-09-13T18:31:57.149883+0000","last_clean":"2024-09-13T18:31:57.149883+0000","last_became_active":"2024-09-13T18:31:55.686792+0000","last_became_peered":"2024-09-13T18:31:55.686792+0000","last_unstale":"2024-09-13T18:31:57.149883+0000","last_undegraded":"2024-09-13T18:31:57.149883+0000","last_fullsized":"2024-09-13T18:31:57.149883+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:14.560243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057211+0000","last_change":"2024-09-13T18:31:56.076007+0000","last_active":"2024-09-13T18:31:57.057211+0000","last_peered":"2024-09-13T18:31:57.057211+0000","last_clean":"2024-09-13T18:31:57.057211+0000","last_became_active":"2024-09-13T18:31:56.075759+0000","last_became_peered":"2024-09-13T18:31:56.075759+0000","last_unstale":"2024-09-13T18:31:57.057211+0000","last_undegraded":"2024-09-13T18:31:57.057211+0000","last_fullsized":"2024-09-13T18:31:57.057211+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:31.550759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148303+0000","last_change":"2024-09-13T18:31:55.674551+0000","last_active":"2024-09-13T18:31:57.148303+0000","last_peered":"2024-09-13T18:31:57.148303+0000","last_clean":"2024-09-13T18:31:57.148303+0000","last_became_active":"2024-09-13T18:31:55.674286+0000","last_became_peered":"2024-09-13T18:31:55.674286+0000","last_unstale":"2024-09-13T18:31:57.148303+0000","last_undegraded":"2024-09-13T18:31:57.148303+0000","last_fullsized":"2024-09-13T18:31:57.148303+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:41.799138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147770+0000","last_change":"2024-09-13T18:31:56.086398+0000","last_active":"2024-09-13T18:31:57.147770+0000","last_peered":"2024-09-13T18:31:57.147770+0000","last_clean":"2024-09-13T18:31:57.147770+0000","last_became_active":"2024-09-13T18:31:56.076017+0000","last_became_peered":"2024-09-13T18:31:56.076017+0000","last_unstale":"2024-09-13T18:31:57.147770+0000","last_undegraded":"2024-09-13T18:31:57.147770+0000","last_fullsized":"2024-09-13T18:31:57.147770+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:10.422987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149239+0000","last_change":"2024-09-13T18:31:55.698586+0000","last_active":"2024-09-13T18:31:57.149239+0000","last_peered":"2024-09-13T18:31:57.149239+0000","last_clean":"2024-09-13T18:31:57.149239+0000","last_became_active":"2024-09-13T18:31:55.697613+0000","last_became_peered":"2024-09-13T18:31:55.697613+0000","last_unstale":"2024-09-13T18:31:57.149239+0000","last_undegraded":"2024-09-13T18:31:57.149239+0000","last_fullsized":"2024-09-13T18:31:57.149239+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:22.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":284,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-13T18:31:56.063121+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:31:56.063121+0000","last_peered":"2024-09-13T18:31:56.063121+0000","last_clean":"2024-09-13T18:31:56.063121+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:31:56.063121+0000","last_undegraded":"2024-09-13T18:31:56.063121+0000","last_fullsized":"2024-09-13T18:31:56.063121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2117632,"data_stored":1253257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.292,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.103},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96299999999999997,"15min":0.89500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.333,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.042}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.93100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.173,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95699999999999996,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.274,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1459999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83699999999999997,"15min":0.80200000000000005},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.997,"5min":1.276,"15min":1.276},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.88200000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.2190000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.89400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88300000000000001,"15min":0.88100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":1.349,"15min":1.448},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.91600000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2230000000000001,"5min":1.397,"15min":1.397},"last":1.0109999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.879,"15min":0.88500000000000001},"min":{"1min":0.61699999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2569999999999999,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.93799999999999994},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.266},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98799999999999999,"15min":1.032},"min":{"1min":0.60799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.5609999999999999,"15min":1.877},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0089999999999999,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.69399999999999995,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.044,"15min":1},"min":{"1min":0.69199999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1779999999999999,"5min":1.506,"15min":1.506},"last":1.0760000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1511424,"data_stored":662251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.312,"15min":0.312},"max":{"1min":1.47,"5min":1.47,"15min":2.9990000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82099999999999995,"15min":0.78600000000000003},"min":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.46600000000000003},"max":{"1min":1.1240000000000001,"5min":1.381,"15min":1.3879999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.92100000000000004,"15min":0.88800000000000001},"min":{"1min":0.56200000000000006,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2709999999999999,"5min":1.506,"15min":1.577},"last":1.26},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.90600000000000003},"min":{"1min":0.61599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1220000000000001,"5min":1.464,"15min":1.464},"last":0.754}]},{"osd":2,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.48899999999999999},"max":{"1min":1.0740000000000001,"5min":1.268,"15min":1.268},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.96499999999999997},"min":{"1min":0.67600000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.26,"5min":1.587,"15min":2.4220000000000002},"last":1.1919999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52300000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.306},"last":0.80800000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.79700000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2050000000000001,"5min":1.337,"15min":2.9140000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.0329999999999999,"15min":1.002},"min":{"1min":0.68100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.319,"5min":1.526,"15min":1.526},"last":1.153}]},{"osd":5,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.91400000000000003,"15min":0.93600000000000005},"min":{"1min":0.627,"5min":0.439,"15min":0.439},"max":{"1min":1.2390000000000001,"5min":1.2609999999999999,"15min":1.4330000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.024,"15min":1.0920000000000001},"min":{"1min":0.69899999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3879999999999999,"5min":1.6559999999999999,"15min":2.762},"last":1.4450000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.01,"15min":1.038},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4259999999999999,"5min":1.4419999999999999,"15min":1.9299999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.0149999999999999,"15min":1.04},"min":{"1min":0.71299999999999997,"5min":0.57299999999999995,"15min":0.52400000000000002},"max":{"1min":1.341,"5min":1.5840000000000001,"15min":1.72},"last":1.026}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1507328,"data_stored":660799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":0.84999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2390000000000001,"5min":1.5469999999999999,"15min":2.0209999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.86699999999999999,"15min":0.90300000000000002},"min":{"1min":0.59999999999999998,"5min":0.45300000000000001,"15min":0.437},"max":{"1min":1.105,"5min":1.2010000000000001,"15min":2.1840000000000002},"last":1.264}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.88400000000000001,"15min":0.83599999999999997},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.1559999999999999,"5min":1.22,"15min":1.4419999999999999},"last":1.603},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85099999999999998,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.109,"5min":1.157,"15min":1.5029999999999999},"last":1.3280000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90000000000000002,"15min":0.88100000000000001},"min":{"1min":0.51700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1599999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91500000000000004,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3839999999999999,"5min":1.4730000000000001,"15min":2.2589999999999999},"last":1.401}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2350000000000001,"5min":1.3740000000000001,"15min":2.0840000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.97099999999999997},"min":{"1min":0.61099999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.339,"5min":1.6719999999999999,"15min":1.871},"last":1.4419999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.163,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":1.042},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3180000000000001,"5min":1.4059999999999999,"15min":1.5049999999999999},"last":1.357}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.96999999999999997,"15min":1.0249999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4239999999999999,"5min":1.5229999999999999,"15min":1.5680000000000001},"last":1.532},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93899999999999995,"15min":1.018},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.6779999999999999},"last":1.117}]},{"osd":7,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.0029999999999999,"15min":1.105},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3779999999999999,"5min":1.4039999999999999,"15min":2.246},"last":1.488},{"interface":"front","average":{"1min":0.995,"5min":1.042,"15min":1.1279999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2969999999999999,"5min":1.5980000000000001,"15min":1.9379999999999999},"last":1.173}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1503232,"data_stored":660757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.91200000000000003,"15min":0.82999999999999996},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":4.3490000000000002},{"interface":"front","average":{"1min":1.034,"5min":0.91200000000000003,"15min":0.88600000000000001},"min":{"1min":0.52900000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":2.4060000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.143,"5min":1.536,"15min":1.536},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.026,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.502,"5min":0.499,"15min":0.499},"max":{"1min":4.4509999999999996,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.8069999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88800000000000001,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1910000000000001,"5min":1.216,"15min":1.216},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.89900000000000002,"15min":0.89300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3149999999999999,"5min":1.323,"15min":1.323},"last":2.3220000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1679999999999999,"5min":1.476,"15min":1.476},"last":2.5190000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.01,"15min":0.95799999999999996},"min":{"1min":0.63100000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":10.44,"5min":10.44,"15min":10.44},"last":1.4159999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.3280000000000003,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.94899999999999995,"15min":0.96499999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":2.1309999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.841,"5min":1.0980000000000001,"15min":1.0349999999999999},"min":{"1min":0.70799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":19.254000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1950000000000001,"15min":1.085},"min":{"1min":0.88400000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":19.434000000000001,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.8979999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.181,"15min":1.0900000000000001},"min":{"1min":0.623,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":15.593,"5min":15.593,"15min":15.593},"last":2.2269999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.034,"15min":1.073},"min":{"1min":0.877,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.323,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":2.7519999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1507328,"data_stored":660847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.88200000000000001,"5min":2.113,"15min":2.113},"last":0.436},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77600000000000002,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.115,"5min":1.4199999999999999,"15min":1.704},"last":0.378},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.079,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.376,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.742,"15min":1.742},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79100000000000004,"15min":0.748},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.0629999999999999,"5min":1.224,"15min":1.399},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.69999999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2190000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.536,"5min":1.536,"15min":2.8740000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98599999999999999,"15min":1.016},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.294,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2589999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.0549999999999999},"min":{"1min":0.71299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.665,"5min":1.665,"15min":2.6190000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.0509999999999999},"min":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53400000000000003},"max":{"1min":1.502,"5min":1.6890000000000001,"15min":1.96},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.036,"15min":1.0880000000000001},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4470000000000001,"5min":1.665,"15min":3},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.032,"15min":1.006},"min":{"1min":0.66900000000000004,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.80200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36684,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335156,"statfs":{"total":96636764160,"available":96599199744,"internally_reserved":0,"allocated":1507328,"data_stored":661303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.92500000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.34100000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.335},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.65500000000000003},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.97699999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.749},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.44700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2190000000000001,"5min":1.288,"15min":1.423},"last":0.86099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.161,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.995}]},{"osd":4,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91900000000000004,"15min":0.90800000000000003},"min":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.367,"5min":1.367,"15min":1.611},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.623,"5min":0.498,"15min":0.498},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.1970000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.999},"min":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4950000000000001,"5min":1.5109999999999999,"15min":1.9179999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.702},"last":1.2450000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.62,"5min":0.5,"15min":0.5},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.472},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0249999999999999,"15min":1.0469999999999999},"min":{"1min":0.72199999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.522}]},{"osd":7,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.377},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0620000000000001,"15min":1.079},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4850000000000001,"5min":1.6499999999999999,"15min":1.8089999999999999},"last":1.4330000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36664,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335176,"statfs":{"total":96636764160,"available":96599220224,"internally_reserved":0,"allocated":1486848,"data_stored":654387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.61399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":1.0680000000000001,"15min":1.177},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.29699999999999999,"15min":0.28199999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.36299999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.87},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":1.423,"15min":1.423},"last":0.98599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.90700000000000003},"min":{"1min":0.628,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93600000000000005,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.42899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92800000000000005,"15min":0.92100000000000004},"min":{"1min":0.64200000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3460000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.69499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4059999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.081}]},{"osd":6,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.018,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.27,"5min":1.5900000000000001,"15min":1.653},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.425,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":1.016}]},{"osd":7,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.091,"15min":1.0529999999999999},"min":{"1min":0.74299999999999999,"5min":0.61899999999999999,"15min":0.52500000000000002},"max":{"1min":1.4790000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.196,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.196}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37248,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334592,"statfs":{"total":96636764160,"available":96598622208,"internally_reserved":0,"allocated":2080768,"data_stored":1244755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0169999999999999,"15min":1.147},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.03,"5min":1.244,"15min":1.4359999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1299999999999999,"5min":1.333,"15min":1.333},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.05,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.87}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.99199999999999999,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.93200000000000005},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.075,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96499999999999997,"15min":0.98699999999999999},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3089999999999999,"5min":1.5069999999999999,"15min":1.986},"last":1.3089999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97899999999999998,"15min":1.002},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.492,"5min":1.8799999999999999,"15min":2.641},"last":1.492},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.032},"min":{"1min":0.61599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.304,"5min":1.3580000000000001,"15min":1.6699999999999999},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0349999999999999,"15min":1.0649999999999999},"min":{"1min":0.64600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.321,"5min":1.466,"15min":1.891},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.036,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.72999999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.181}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.006,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":2.2949999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.75600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.724,"15min":2.2480000000000002},"last":1.4159999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:32:00.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:32:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d7404640 1 Processor -- start 2024-09-13T18:32:00.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d7404640 1 -- start start 2024-09-13T18:32:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d7404640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25d00cf800 0x7f25d00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d7404640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25d00b7b40 0x7f25d01662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d7404640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d015cc10 con 0x7f25d015c830 2024-09-13T18:32:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d7404640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00b50c0 con 0x7f25d00b7b40 2024-09-13T18:32:00.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d7404640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00b41d0 con 0x7f25d00cf800 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d59a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25d00b7b40 0x7f25d01662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d59a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f25d00b7b40 0x7f25d01662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44602/0 (socket says 172.21.15.53:44602) 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d59a1640 1 -- 172.21.15.53:0/4270766406 learned_addr learned my addr 172.21.15.53:0/4270766406 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d499f640 1 --2- 172.21.15.53:0/4270766406 >> v2:172.21.15.87:3300/0 conn(0x7f25d00cf800 0x7f25d00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d59a1640 1 -- 172.21.15.53:0/4270766406 >> v2:172.21.15.87:3300/0 conn(0x7f25d00cf800 msgr2=0x7f25d00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d59a1640 1 --2- 172.21.15.53:0/4270766406 >> v2:172.21.15.87:3300/0 conn(0x7f25d00cf800 0x7f25d00cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d59a1640 1 -- 172.21.15.53:0/4270766406 >> v1:172.21.15.87:6789/0 conn(0x7f25d015c830 legacy=0x7f25d00cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:00.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.294+0000 7f25d59a1640 1 -- 172.21.15.53:0/4270766406 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d00b44b0 con 0x7f25d00b7b40 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d59a1640 1 --2- 172.21.15.53:0/4270766406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d00b7b40 0x7f25d01662f0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f25d008bb90 tx=0x7f25c801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e965aba7fe3e581b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25c7fff640 1 -- 172.21.15.53:0/4270766406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80af400 con 0x7f25d00b7b40 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25c7fff640 1 -- 172.21.15.53:0/4270766406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c80ab050 con 0x7f25d00b7b40 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25c7fff640 1 -- 172.21.15.53:0/4270766406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80af780 con 0x7f25d00b7b40 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 -- 172.21.15.53:0/4270766406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d00b7b40 msgr2=0x7f25d01662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 --2- 172.21.15.53:0/4270766406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d00b7b40 0x7f25d01662f0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f25d008bb90 tx=0x7f25c801f1a0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 -- 172.21.15.53:0/4270766406 shutdown_connections 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 --2- 172.21.15.53:0/4270766406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d00b7b40 0x7f25d01662f0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 --2- 172.21.15.53:0/4270766406 >> v2:172.21.15.87:3300/0 conn(0x7f25d00cf800 0x7f25d00cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 -- 172.21.15.53:0/4270766406 >> 172.21.15.53:0/4270766406 conn(0x7f25d0070970 msgr2=0x7f25d0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 -- 172.21.15.53:0/4270766406 shutdown_connections 2024-09-13T18:32:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 -- 172.21.15.53:0/4270766406 wait complete. 2024-09-13T18:32:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 Processor -- start 2024-09-13T18:32:00.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.298+0000 7f25d7404640 1 -- start start 2024-09-13T18:32:00.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25d00b7b40 0x7f25d00cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25d00cf800 0x7f25d00cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d015c830 0x7f25d015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d015f1e0 con 0x7f25d015c830 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00cc830 con 0x7f25d00b7b40 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00cbbc0 con 0x7f25d00cf800 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d015c830 0x7f25d015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d015c830 0x7f25d015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44612/0 (socket says 172.21.15.53:44612) 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 -- 172.21.15.53:0/1344861071 learned_addr learned my addr 172.21.15.53:0/1344861071 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 -- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25d00cf800 msgr2=0x7f25d00cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d499f640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25d00cf800 0x7f25d00cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d51a0640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25d00b7b40 0x7f25d00cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25d00cf800 0x7f25d00cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 -- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25d00b7b40 msgr2=0x7f25d00cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25d00b7b40 0x7f25d00cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 -- 172.21.15.53:0/1344861071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8009b30 con 0x7f25d015c830 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d51a0640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25d00b7b40 0x7f25d00cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d59a1640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d015c830 0x7f25d015adf0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f25c801cdd0 tx=0x7f25c801bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25c5ffb640 1 -- 172.21.15.53:0/1344861071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80afdc0 con 0x7f25d015c830 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25c5ffb640 1 -- 172.21.15.53:0/1344861071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8009510 con 0x7f25d015c830 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d015e8b0 con 0x7f25d015c830 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25c5ffb640 1 -- 172.21.15.53:0/1344861071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80ba660 con 0x7f25d015c830 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d015ee00 con 0x7f25d015c830 2024-09-13T18:32:00.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d00cd930 con 0x7f25d015c830 2024-09-13T18:32:00.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25c5ffb640 1 -- 172.21.15.53:0/1344861071 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f25c80b6040 con 0x7f25d015c830 2024-09-13T18:32:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25c5ffb640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25b4066a80 0x7f25b4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25c5ffb640 1 -- 172.21.15.53:0/1344861071 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25c8122b80 con 0x7f25d015c830 2024-09-13T18:32:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d51a0640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25b4066a80 0x7f25b4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.302+0000 7f25d51a0640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25b4066a80 0x7f25b4068f40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25d015e7e0 tx=0x7f25cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:00.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.306+0000 7f25c5ffb640 1 -- 172.21.15.53:0/1344861071 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25c80ef850 con 0x7f25d015c830 2024-09-13T18:32:00.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.458+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25d00b4d50 con 0x7f25b4066a80 2024-09-13T18:32:00.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.470+0000 7f25c5ffb640 1 -- 172.21.15.53:0/1344861071 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288243 (secure 0 0 0) 0x7f25cc00a440 con 0x7f25b4066a80 2024-09-13T18:32:00.475 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:00.476 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:32:00.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25b4066a80 msgr2=0x7f25b4068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25b4066a80 0x7f25b4068f40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25d015e7e0 tx=0x7f25cc008040 comp rx=0 tx=0).stop 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d015c830 msgr2=0x7f25d015adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d015c830 0x7f25d015adf0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f25c801cdd0 tx=0x7f25c801bf40 comp rx=0 tx=0).stop 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 shutdown_connections 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f25b4066a80 0x7f25b4068f40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25d00cf800 0x7f25d00cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25d015c830 0x7f25d015adf0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 --2- 172.21.15.53:0/1344861071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25d00b7b40 0x7f25d00cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 >> 172.21.15.53:0/1344861071 conn(0x7f25d0070970 msgr2=0x7f25d0070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 shutdown_connections 2024-09-13T18:32:00.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.474+0000 7f25d7404640 1 -- 172.21.15.53:0/1344861071 wait complete. 2024-09-13T18:32:00.492 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-09-13T18:31:59.855579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278236,"kb_used_data":12912,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754696484,"statfs":{"total":773094113280,"available":772809199616,"internally_reserved":0,"allocated":13221888,"data_stored":6458356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":271568440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.201162"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149767+0000","last_change":"2024-09-13T18:31:56.079618+0000","last_active":"2024-09-13T18:31:57.149767+0000","last_peered":"2024-09-13T18:31:57.149767+0000","last_clean":"2024-09-13T18:31:57.149767+0000","last_became_active":"2024-09-13T18:31:56.079313+0000","last_became_peered":"2024-09-13T18:31:56.079313+0000","last_unstale":"2024-09-13T18:31:57.149767+0000","last_undegraded":"2024-09-13T18:31:57.149767+0000","last_fullsized":"2024-09-13T18:31:57.149767+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:49.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057543+0000","last_change":"2024-09-13T18:31:56.074692+0000","last_active":"2024-09-13T18:31:57.057543+0000","last_peered":"2024-09-13T18:31:57.057543+0000","last_clean":"2024-09-13T18:31:57.057543+0000","last_became_active":"2024-09-13T18:31:56.074402+0000","last_became_peered":"2024-09-13T18:31:56.074402+0000","last_unstale":"2024-09-13T18:31:57.057543+0000","last_undegraded":"2024-09-13T18:31:57.057543+0000","last_fullsized":"2024-09-13T18:31:57.057543+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:20.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149712+0000","last_change":"2024-09-13T18:31:56.063772+0000","last_active":"2024-09-13T18:31:57.149712+0000","last_peered":"2024-09-13T18:31:57.149712+0000","last_clean":"2024-09-13T18:31:57.149712+0000","last_became_active":"2024-09-13T18:31:56.063029+0000","last_became_peered":"2024-09-13T18:31:56.063029+0000","last_unstale":"2024-09-13T18:31:57.149712+0000","last_undegraded":"2024-09-13T18:31:57.149712+0000","last_fullsized":"2024-09-13T18:31:57.149712+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:27.944996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149199+0000","last_change":"2024-09-13T18:31:56.075828+0000","last_active":"2024-09-13T18:31:57.149199+0000","last_peered":"2024-09-13T18:31:57.149199+0000","last_clean":"2024-09-13T18:31:57.149199+0000","last_became_active":"2024-09-13T18:31:56.075516+0000","last_became_peered":"2024-09-13T18:31:56.075516+0000","last_unstale":"2024-09-13T18:31:57.149199+0000","last_undegraded":"2024-09-13T18:31:57.149199+0000","last_fullsized":"2024-09-13T18:31:57.149199+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:20.610174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149007+0000","last_change":"2024-09-13T18:31:56.110401+0000","last_active":"2024-09-13T18:31:57.149007+0000","last_peered":"2024-09-13T18:31:57.149007+0000","last_clean":"2024-09-13T18:31:57.149007+0000","last_became_active":"2024-09-13T18:31:56.109500+0000","last_became_peered":"2024-09-13T18:31:56.109500+0000","last_unstale":"2024-09-13T18:31:57.149007+0000","last_undegraded":"2024-09-13T18:31:57.149007+0000","last_fullsized":"2024-09-13T18:31:57.149007+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:24.584926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148816+0000","last_change":"2024-09-13T18:31:56.080555+0000","last_active":"2024-09-13T18:31:57.148816+0000","last_peered":"2024-09-13T18:31:57.148816+0000","last_clean":"2024-09-13T18:31:57.148816+0000","last_became_active":"2024-09-13T18:31:56.078949+0000","last_became_peered":"2024-09-13T18:31:56.078949+0000","last_unstale":"2024-09-13T18:31:57.148816+0000","last_undegraded":"2024-09-13T18:31:57.148816+0000","last_fullsized":"2024-09-13T18:31:57.148816+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:16.543003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147888+0000","last_change":"2024-09-13T18:31:56.089455+0000","last_active":"2024-09-13T18:31:57.147888+0000","last_peered":"2024-09-13T18:31:57.147888+0000","last_clean":"2024-09-13T18:31:57.147888+0000","last_became_active":"2024-09-13T18:31:56.088681+0000","last_became_peered":"2024-09-13T18:31:56.088681+0000","last_unstale":"2024-09-13T18:31:57.147888+0000","last_undegraded":"2024-09-13T18:31:57.147888+0000","last_fullsized":"2024-09-13T18:31:57.147888+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:24.584926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149692+0000","last_change":"2024-09-13T18:31:56.080627+0000","last_active":"2024-09-13T18:31:57.149692+0000","last_peered":"2024-09-13T18:31:57.149692+0000","last_clean":"2024-09-13T18:31:57.149692+0000","last_became_active":"2024-09-13T18:31:56.077041+0000","last_became_peered":"2024-09-13T18:31:56.077041+0000","last_unstale":"2024-09-13T18:31:57.149692+0000","last_undegraded":"2024-09-13T18:31:57.149692+0000","last_fullsized":"2024-09-13T18:31:57.149692+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:25.156024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150804+0000","last_change":"2024-09-13T18:31:56.101644+0000","last_active":"2024-09-13T18:31:57.150804+0000","last_peered":"2024-09-13T18:31:57.150804+0000","last_clean":"2024-09-13T18:31:57.150804+0000","last_became_active":"2024-09-13T18:31:56.100966+0000","last_became_peered":"2024-09-13T18:31:56.100966+0000","last_unstale":"2024-09-13T18:31:57.150804+0000","last_undegraded":"2024-09-13T18:31:57.150804+0000","last_fullsized":"2024-09-13T18:31:57.150804+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:19.842480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057622+0000","last_change":"2024-09-13T18:31:56.074377+0000","last_active":"2024-09-13T18:31:57.057622+0000","last_peered":"2024-09-13T18:31:57.057622+0000","last_clean":"2024-09-13T18:31:57.057622+0000","last_became_active":"2024-09-13T18:31:56.074047+0000","last_became_peered":"2024-09-13T18:31:56.074047+0000","last_unstale":"2024-09-13T18:31:57.057622+0000","last_undegraded":"2024-09-13T18:31:57.057622+0000","last_fullsized":"2024-09-13T18:31:57.057622+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:52.215720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149286+0000","last_change":"2024-09-13T18:31:56.068659+0000","last_active":"2024-09-13T18:31:57.149286+0000","last_peered":"2024-09-13T18:31:57.149286+0000","last_clean":"2024-09-13T18:31:57.149286+0000","last_became_active":"2024-09-13T18:31:56.068071+0000","last_became_peered":"2024-09-13T18:31:56.068071+0000","last_unstale":"2024-09-13T18:31:57.149286+0000","last_undegraded":"2024-09-13T18:31:57.149286+0000","last_fullsized":"2024-09-13T18:31:57.149286+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:29.697455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149997+0000","last_change":"2024-09-13T18:31:56.102675+0000","last_active":"2024-09-13T18:31:57.149997+0000","last_peered":"2024-09-13T18:31:57.149997+0000","last_clean":"2024-09-13T18:31:57.149997+0000","last_became_active":"2024-09-13T18:31:56.101024+0000","last_became_peered":"2024-09-13T18:31:56.101024+0000","last_unstale":"2024-09-13T18:31:57.149997+0000","last_undegraded":"2024-09-13T18:31:57.149997+0000","last_fullsized":"2024-09-13T18:31:57.149997+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:40.424506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149621+0000","last_change":"2024-09-13T18:31:56.078603+0000","last_active":"2024-09-13T18:31:57.149621+0000","last_peered":"2024-09-13T18:31:57.149621+0000","last_clean":"2024-09-13T18:31:57.149621+0000","last_became_active":"2024-09-13T18:31:56.078307+0000","last_became_peered":"2024-09-13T18:31:56.078307+0000","last_unstale":"2024-09-13T18:31:57.149621+0000","last_undegraded":"2024-09-13T18:31:57.149621+0000","last_fullsized":"2024-09-13T18:31:57.149621+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:20.464396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057628+0000","last_change":"2024-09-13T18:31:56.068294+0000","last_active":"2024-09-13T18:31:57.057628+0000","last_peered":"2024-09-13T18:31:57.057628+0000","last_clean":"2024-09-13T18:31:57.057628+0000","last_became_active":"2024-09-13T18:31:56.068039+0000","last_became_peered":"2024-09-13T18:31:56.068039+0000","last_unstale":"2024-09-13T18:31:57.057628+0000","last_undegraded":"2024-09-13T18:31:57.057628+0000","last_fullsized":"2024-09-13T18:31:57.057628+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:36.804349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147996+0000","last_change":"2024-09-13T18:31:56.058792+0000","last_active":"2024-09-13T18:31:57.147996+0000","last_peered":"2024-09-13T18:31:57.147996+0000","last_clean":"2024-09-13T18:31:57.147996+0000","last_became_active":"2024-09-13T18:31:56.058370+0000","last_became_peered":"2024-09-13T18:31:56.058370+0000","last_unstale":"2024-09-13T18:31:57.147996+0000","last_undegraded":"2024-09-13T18:31:57.147996+0000","last_fullsized":"2024-09-13T18:31:57.147996+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:10.919680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148770+0000","last_change":"2024-09-13T18:31:56.068259+0000","last_active":"2024-09-13T18:31:57.148770+0000","last_peered":"2024-09-13T18:31:57.148770+0000","last_clean":"2024-09-13T18:31:57.148770+0000","last_became_active":"2024-09-13T18:31:56.067950+0000","last_became_peered":"2024-09-13T18:31:56.067950+0000","last_unstale":"2024-09-13T18:31:57.148770+0000","last_undegraded":"2024-09-13T18:31:57.148770+0000","last_fullsized":"2024-09-13T18:31:57.148770+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.844885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148516+0000","last_change":"2024-09-13T18:31:56.080148+0000","last_active":"2024-09-13T18:31:57.148516+0000","last_peered":"2024-09-13T18:31:57.148516+0000","last_clean":"2024-09-13T18:31:57.148516+0000","last_became_active":"2024-09-13T18:31:56.078187+0000","last_became_peered":"2024-09-13T18:31:56.078187+0000","last_unstale":"2024-09-13T18:31:57.148516+0000","last_undegraded":"2024-09-13T18:31:57.148516+0000","last_fullsized":"2024-09-13T18:31:57.148516+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.243790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150469+0000","last_change":"2024-09-13T18:31:56.081401+0000","last_active":"2024-09-13T18:31:57.150469+0000","last_peered":"2024-09-13T18:31:57.150469+0000","last_clean":"2024-09-13T18:31:57.150469+0000","last_became_active":"2024-09-13T18:31:56.081149+0000","last_became_peered":"2024-09-13T18:31:56.081149+0000","last_unstale":"2024-09-13T18:31:57.150469+0000","last_undegraded":"2024-09-13T18:31:57.150469+0000","last_fullsized":"2024-09-13T18:31:57.150469+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:56.623633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149495+0000","last_change":"2024-09-13T18:31:56.089609+0000","last_active":"2024-09-13T18:31:57.149495+0000","last_peered":"2024-09-13T18:31:57.149495+0000","last_clean":"2024-09-13T18:31:57.149495+0000","last_became_active":"2024-09-13T18:31:56.089389+0000","last_became_peered":"2024-09-13T18:31:56.089389+0000","last_unstale":"2024-09-13T18:31:57.149495+0000","last_undegraded":"2024-09-13T18:31:57.149495+0000","last_fullsized":"2024-09-13T18:31:57.149495+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:56.150810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150469+0000","last_change":"2024-09-13T18:31:56.066606+0000","last_active":"2024-09-13T18:31:57.150469+0000","last_peered":"2024-09-13T18:31:57.150469+0000","last_clean":"2024-09-13T18:31:57.150469+0000","last_became_active":"2024-09-13T18:31:56.066250+0000","last_became_peered":"2024-09-13T18:31:56.066250+0000","last_unstale":"2024-09-13T18:31:57.150469+0000","last_undegraded":"2024-09-13T18:31:57.150469+0000","last_fullsized":"2024-09-13T18:31:57.150469+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.243790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148633+0000","last_change":"2024-09-13T18:31:56.108738+0000","last_active":"2024-09-13T18:31:57.148633+0000","last_peered":"2024-09-13T18:31:57.148633+0000","last_clean":"2024-09-13T18:31:57.148633+0000","last_became_active":"2024-09-13T18:31:56.108057+0000","last_became_peered":"2024-09-13T18:31:56.108057+0000","last_unstale":"2024-09-13T18:31:57.148633+0000","last_undegraded":"2024-09-13T18:31:57.148633+0000","last_fullsized":"2024-09-13T18:31:57.148633+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:32.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148461+0000","last_change":"2024-09-13T18:31:56.065885+0000","last_active":"2024-09-13T18:31:57.148461+0000","last_peered":"2024-09-13T18:31:57.148461+0000","last_clean":"2024-09-13T18:31:57.148461+0000","last_became_active":"2024-09-13T18:31:56.065545+0000","last_became_peered":"2024-09-13T18:31:56.065545+0000","last_unstale":"2024-09-13T18:31:57.148461+0000","last_undegraded":"2024-09-13T18:31:57.148461+0000","last_fullsized":"2024-09-13T18:31:57.148461+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:27.292342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150252+0000","last_change":"2024-09-13T18:31:56.096900+0000","last_active":"2024-09-13T18:31:57.150252+0000","last_peered":"2024-09-13T18:31:57.150252+0000","last_clean":"2024-09-13T18:31:57.150252+0000","last_became_active":"2024-09-13T18:31:56.096288+0000","last_became_peered":"2024-09-13T18:31:56.096288+0000","last_unstale":"2024-09-13T18:31:57.150252+0000","last_undegraded":"2024-09-13T18:31:57.150252+0000","last_fullsized":"2024-09-13T18:31:57.150252+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:23.277937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147864+0000","last_change":"2024-09-13T18:31:56.083691+0000","last_active":"2024-09-13T18:31:57.147864+0000","last_peered":"2024-09-13T18:31:57.147864+0000","last_clean":"2024-09-13T18:31:57.147864+0000","last_became_active":"2024-09-13T18:31:56.082869+0000","last_became_peered":"2024-09-13T18:31:56.082869+0000","last_unstale":"2024-09-13T18:31:57.147864+0000","last_undegraded":"2024-09-13T18:31:57.147864+0000","last_fullsized":"2024-09-13T18:31:57.147864+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:38.574340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.058425+0000","last_change":"2024-09-13T18:31:56.075307+0000","last_active":"2024-09-13T18:31:57.058425+0000","last_peered":"2024-09-13T18:31:57.058425+0000","last_clean":"2024-09-13T18:31:57.058425+0000","last_became_active":"2024-09-13T18:31:56.075018+0000","last_became_peered":"2024-09-13T18:31:56.075018+0000","last_unstale":"2024-09-13T18:31:57.058425+0000","last_undegraded":"2024-09-13T18:31:57.058425+0000","last_fullsized":"2024-09-13T18:31:57.058425+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:34.200784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150745+0000","last_change":"2024-09-13T18:31:56.068444+0000","last_active":"2024-09-13T18:31:57.150745+0000","last_peered":"2024-09-13T18:31:57.150745+0000","last_clean":"2024-09-13T18:31:57.150745+0000","last_became_active":"2024-09-13T18:31:56.068062+0000","last_became_peered":"2024-09-13T18:31:56.068062+0000","last_unstale":"2024-09-13T18:31:57.150745+0000","last_undegraded":"2024-09-13T18:31:57.150745+0000","last_fullsized":"2024-09-13T18:31:57.150745+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:24.584926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149672+0000","last_change":"2024-09-13T18:31:56.085923+0000","last_active":"2024-09-13T18:31:57.149672+0000","last_peered":"2024-09-13T18:31:57.149672+0000","last_clean":"2024-09-13T18:31:57.149672+0000","last_became_active":"2024-09-13T18:31:56.085702+0000","last_became_peered":"2024-09-13T18:31:56.085702+0000","last_unstale":"2024-09-13T18:31:57.149672+0000","last_undegraded":"2024-09-13T18:31:57.149672+0000","last_fullsized":"2024-09-13T18:31:57.149672+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:15.845205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060677+0000","last_change":"2024-09-13T18:31:56.094661+0000","last_active":"2024-09-13T18:31:57.060677+0000","last_peered":"2024-09-13T18:31:57.060677+0000","last_clean":"2024-09-13T18:31:57.060677+0000","last_became_active":"2024-09-13T18:31:56.093852+0000","last_became_peered":"2024-09-13T18:31:56.093852+0000","last_unstale":"2024-09-13T18:31:57.060677+0000","last_undegraded":"2024-09-13T18:31:57.060677+0000","last_fullsized":"2024-09-13T18:31:57.060677+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:43.678995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149863+0000","last_change":"2024-09-13T18:31:56.060909+0000","last_active":"2024-09-13T18:31:57.149863+0000","last_peered":"2024-09-13T18:31:57.149863+0000","last_clean":"2024-09-13T18:31:57.149863+0000","last_became_active":"2024-09-13T18:31:56.060623+0000","last_became_peered":"2024-09-13T18:31:56.060623+0000","last_unstale":"2024-09-13T18:31:57.149863+0000","last_undegraded":"2024-09-13T18:31:57.149863+0000","last_fullsized":"2024-09-13T18:31:57.149863+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:11.245620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148583+0000","last_change":"2024-09-13T18:31:56.056233+0000","last_active":"2024-09-13T18:31:57.148583+0000","last_peered":"2024-09-13T18:31:57.148583+0000","last_clean":"2024-09-13T18:31:57.148583+0000","last_became_active":"2024-09-13T18:31:56.055845+0000","last_became_peered":"2024-09-13T18:31:56.055845+0000","last_unstale":"2024-09-13T18:31:57.148583+0000","last_undegraded":"2024-09-13T18:31:57.148583+0000","last_fullsized":"2024-09-13T18:31:57.148583+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:30.797004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147998+0000","last_change":"2024-09-13T18:31:56.102081+0000","last_active":"2024-09-13T18:31:57.147998+0000","last_peered":"2024-09-13T18:31:57.147998+0000","last_clean":"2024-09-13T18:31:57.147998+0000","last_became_active":"2024-09-13T18:31:56.101379+0000","last_became_peered":"2024-09-13T18:31:56.101379+0000","last_unstale":"2024-09-13T18:31:57.147998+0000","last_undegraded":"2024-09-13T18:31:57.147998+0000","last_fullsized":"2024-09-13T18:31:57.147998+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:40.956945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148026+0000","last_change":"2024-09-13T18:31:56.078553+0000","last_active":"2024-09-13T18:31:57.148026+0000","last_peered":"2024-09-13T18:31:57.148026+0000","last_clean":"2024-09-13T18:31:57.148026+0000","last_became_active":"2024-09-13T18:31:56.073490+0000","last_became_peered":"2024-09-13T18:31:56.073490+0000","last_unstale":"2024-09-13T18:31:57.148026+0000","last_undegraded":"2024-09-13T18:31:57.148026+0000","last_fullsized":"2024-09-13T18:31:57.148026+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.844885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150910+0000","last_change":"2024-09-13T18:31:56.083298+0000","last_active":"2024-09-13T18:31:57.150910+0000","last_peered":"2024-09-13T18:31:57.150910+0000","last_clean":"2024-09-13T18:31:57.150910+0000","last_became_active":"2024-09-13T18:31:56.083040+0000","last_became_peered":"2024-09-13T18:31:56.083040+0000","last_unstale":"2024-09-13T18:31:57.150910+0000","last_undegraded":"2024-09-13T18:31:57.150910+0000","last_fullsized":"2024-09-13T18:31:57.150910+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:41.358018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"119'4","reported_seq":15,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149171+0000","last_change":"2024-09-13T18:31:55.697978+0000","last_active":"2024-09-13T18:31:57.149171+0000","last_peered":"2024-09-13T18:31:57.149171+0000","last_clean":"2024-09-13T18:31:57.149171+0000","last_became_active":"2024-09-13T18:31:55.696175+0000","last_became_peered":"2024-09-13T18:31:55.696175+0000","last_unstale":"2024-09-13T18:31:57.149171+0000","last_undegraded":"2024-09-13T18:31:57.149171+0000","last_fullsized":"2024-09-13T18:31:57.149171+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:39.414416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150862+0000","last_change":"2024-09-13T18:31:56.077763+0000","last_active":"2024-09-13T18:31:57.150862+0000","last_peered":"2024-09-13T18:31:57.150862+0000","last_clean":"2024-09-13T18:31:57.150862+0000","last_became_active":"2024-09-13T18:31:56.075408+0000","last_became_peered":"2024-09-13T18:31:56.075408+0000","last_unstale":"2024-09-13T18:31:57.150862+0000","last_undegraded":"2024-09-13T18:31:57.150862+0000","last_fullsized":"2024-09-13T18:31:57.150862+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:43.678995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060756+0000","last_change":"2024-09-13T18:31:55.700809+0000","last_active":"2024-09-13T18:31:57.060756+0000","last_peered":"2024-09-13T18:31:57.060756+0000","last_clean":"2024-09-13T18:31:57.060756+0000","last_became_active":"2024-09-13T18:31:55.700076+0000","last_became_peered":"2024-09-13T18:31:55.700076+0000","last_unstale":"2024-09-13T18:31:57.060756+0000","last_undegraded":"2024-09-13T18:31:57.060756+0000","last_fullsized":"2024-09-13T18:31:57.060756+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:25.345372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149681+0000","last_change":"2024-09-13T18:31:56.104582+0000","last_active":"2024-09-13T18:31:57.149681+0000","last_peered":"2024-09-13T18:31:57.149681+0000","last_clean":"2024-09-13T18:31:57.149681+0000","last_became_active":"2024-09-13T18:31:56.103321+0000","last_became_peered":"2024-09-13T18:31:56.103321+0000","last_unstale":"2024-09-13T18:31:57.149681+0000","last_undegraded":"2024-09-13T18:31:57.149681+0000","last_fullsized":"2024-09-13T18:31:57.149681+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:21.398146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149698+0000","last_change":"2024-09-13T18:31:55.680175+0000","last_active":"2024-09-13T18:31:57.149698+0000","last_peered":"2024-09-13T18:31:57.149698+0000","last_clean":"2024-09-13T18:31:57.149698+0000","last_became_active":"2024-09-13T18:31:55.679645+0000","last_became_peered":"2024-09-13T18:31:55.679645+0000","last_unstale":"2024-09-13T18:31:57.149698+0000","last_undegraded":"2024-09-13T18:31:57.149698+0000","last_fullsized":"2024-09-13T18:31:57.149698+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:47.846277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148874+0000","last_change":"2024-09-13T18:31:56.098447+0000","last_active":"2024-09-13T18:31:57.148874+0000","last_peered":"2024-09-13T18:31:57.148874+0000","last_clean":"2024-09-13T18:31:57.148874+0000","last_became_active":"2024-09-13T18:31:56.097715+0000","last_became_peered":"2024-09-13T18:31:56.097715+0000","last_unstale":"2024-09-13T18:31:57.148874+0000","last_undegraded":"2024-09-13T18:31:57.148874+0000","last_fullsized":"2024-09-13T18:31:57.148874+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:16.543003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.058279+0000","last_change":"2024-09-13T18:31:55.674135+0000","last_active":"2024-09-13T18:31:57.058279+0000","last_peered":"2024-09-13T18:31:57.058279+0000","last_clean":"2024-09-13T18:31:57.058279+0000","last_became_active":"2024-09-13T18:31:55.673878+0000","last_became_peered":"2024-09-13T18:31:55.673878+0000","last_unstale":"2024-09-13T18:31:57.058279+0000","last_undegraded":"2024-09-13T18:31:57.058279+0000","last_fullsized":"2024-09-13T18:31:57.058279+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:17.386625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150191+0000","last_change":"2024-09-13T18:31:56.080430+0000","last_active":"2024-09-13T18:31:57.150191+0000","last_peered":"2024-09-13T18:31:57.150191+0000","last_clean":"2024-09-13T18:31:57.150191+0000","last_became_active":"2024-09-13T18:31:56.080118+0000","last_became_peered":"2024-09-13T18:31:56.080118+0000","last_unstale":"2024-09-13T18:31:57.150191+0000","last_undegraded":"2024-09-13T18:31:57.150191+0000","last_fullsized":"2024-09-13T18:31:57.150191+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:03.994845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057609+0000","last_change":"2024-09-13T18:31:55.680199+0000","last_active":"2024-09-13T18:31:57.057609+0000","last_peered":"2024-09-13T18:31:57.057609+0000","last_clean":"2024-09-13T18:31:57.057609+0000","last_became_active":"2024-09-13T18:31:55.679890+0000","last_became_peered":"2024-09-13T18:31:55.679890+0000","last_unstale":"2024-09-13T18:31:57.057609+0000","last_undegraded":"2024-09-13T18:31:57.057609+0000","last_fullsized":"2024-09-13T18:31:57.057609+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:10.749697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148486+0000","last_change":"2024-09-13T18:31:56.072883+0000","last_active":"2024-09-13T18:31:57.148486+0000","last_peered":"2024-09-13T18:31:57.148486+0000","last_clean":"2024-09-13T18:31:57.148486+0000","last_became_active":"2024-09-13T18:31:56.072183+0000","last_became_peered":"2024-09-13T18:31:56.072183+0000","last_unstale":"2024-09-13T18:31:57.148486+0000","last_undegraded":"2024-09-13T18:31:57.148486+0000","last_fullsized":"2024-09-13T18:31:57.148486+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:21.398146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150428+0000","last_change":"2024-09-13T18:31:55.679554+0000","last_active":"2024-09-13T18:31:57.150428+0000","last_peered":"2024-09-13T18:31:57.150428+0000","last_clean":"2024-09-13T18:31:57.150428+0000","last_became_active":"2024-09-13T18:31:55.679253+0000","last_became_peered":"2024-09-13T18:31:55.679253+0000","last_unstale":"2024-09-13T18:31:57.150428+0000","last_undegraded":"2024-09-13T18:31:57.150428+0000","last_fullsized":"2024-09-13T18:31:57.150428+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:34.401172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149951+0000","last_change":"2024-09-13T18:31:56.061633+0000","last_active":"2024-09-13T18:31:57.149951+0000","last_peered":"2024-09-13T18:31:57.149951+0000","last_clean":"2024-09-13T18:31:57.149951+0000","last_became_active":"2024-09-13T18:31:56.060881+0000","last_became_peered":"2024-09-13T18:31:56.060881+0000","last_unstale":"2024-09-13T18:31:57.149951+0000","last_undegraded":"2024-09-13T18:31:57.149951+0000","last_fullsized":"2024-09-13T18:31:57.149951+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:29.475648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150506+0000","last_change":"2024-09-13T18:31:55.690402+0000","last_active":"2024-09-13T18:31:57.150506+0000","last_peered":"2024-09-13T18:31:57.150506+0000","last_clean":"2024-09-13T18:31:57.150506+0000","last_became_active":"2024-09-13T18:31:55.689621+0000","last_became_peered":"2024-09-13T18:31:55.689621+0000","last_unstale":"2024-09-13T18:31:57.150506+0000","last_undegraded":"2024-09-13T18:31:57.150506+0000","last_fullsized":"2024-09-13T18:31:57.150506+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:14.560243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057260+0000","last_change":"2024-09-13T18:31:56.065879+0000","last_active":"2024-09-13T18:31:57.057260+0000","last_peered":"2024-09-13T18:31:57.057260+0000","last_clean":"2024-09-13T18:31:57.057260+0000","last_became_active":"2024-09-13T18:31:56.065686+0000","last_became_peered":"2024-09-13T18:31:56.065686+0000","last_unstale":"2024-09-13T18:31:57.057260+0000","last_undegraded":"2024-09-13T18:31:57.057260+0000","last_fullsized":"2024-09-13T18:31:57.057260+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:48.924428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057418+0000","last_change":"2024-09-13T18:31:55.678457+0000","last_active":"2024-09-13T18:31:57.057418+0000","last_peered":"2024-09-13T18:31:57.057418+0000","last_clean":"2024-09-13T18:31:57.057418+0000","last_became_active":"2024-09-13T18:31:55.677971+0000","last_became_peered":"2024-09-13T18:31:55.677971+0000","last_unstale":"2024-09-13T18:31:57.057418+0000","last_undegraded":"2024-09-13T18:31:57.057418+0000","last_fullsized":"2024-09-13T18:31:57.057418+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:37.043337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150217+0000","last_change":"2024-09-13T18:31:56.058247+0000","last_active":"2024-09-13T18:31:57.150217+0000","last_peered":"2024-09-13T18:31:57.150217+0000","last_clean":"2024-09-13T18:31:57.150217+0000","last_became_active":"2024-09-13T18:31:56.058019+0000","last_became_peered":"2024-09-13T18:31:56.058019+0000","last_unstale":"2024-09-13T18:31:57.150217+0000","last_undegraded":"2024-09-13T18:31:57.150217+0000","last_fullsized":"2024-09-13T18:31:57.150217+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:37.128186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.061182+0000","last_change":"2024-09-13T18:31:55.693070+0000","last_active":"2024-09-13T18:31:57.061182+0000","last_peered":"2024-09-13T18:31:57.061182+0000","last_clean":"2024-09-13T18:31:57.061182+0000","last_became_active":"2024-09-13T18:31:55.691328+0000","last_became_peered":"2024-09-13T18:31:55.691328+0000","last_unstale":"2024-09-13T18:31:57.061182+0000","last_undegraded":"2024-09-13T18:31:57.061182+0000","last_fullsized":"2024-09-13T18:31:57.061182+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:35.082308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060957+0000","last_change":"2024-09-13T18:31:56.096314+0000","last_active":"2024-09-13T18:31:57.060957+0000","last_peered":"2024-09-13T18:31:57.060957+0000","last_clean":"2024-09-13T18:31:57.060957+0000","last_became_active":"2024-09-13T18:31:56.095655+0000","last_became_peered":"2024-09-13T18:31:56.095655+0000","last_unstale":"2024-09-13T18:31:57.060957+0000","last_undegraded":"2024-09-13T18:31:57.060957+0000","last_fullsized":"2024-09-13T18:31:57.060957+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:47.883932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.151027+0000","last_change":"2024-09-13T18:31:55.693332+0000","last_active":"2024-09-13T18:31:57.151027+0000","last_peered":"2024-09-13T18:31:57.151027+0000","last_clean":"2024-09-13T18:31:57.151027+0000","last_became_active":"2024-09-13T18:31:55.693013+0000","last_became_peered":"2024-09-13T18:31:55.693013+0000","last_unstale":"2024-09-13T18:31:57.151027+0000","last_undegraded":"2024-09-13T18:31:57.151027+0000","last_fullsized":"2024-09-13T18:31:57.151027+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:35.540009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149799+0000","last_change":"2024-09-13T18:31:56.104940+0000","last_active":"2024-09-13T18:31:57.149799+0000","last_peered":"2024-09-13T18:31:57.149799+0000","last_clean":"2024-09-13T18:31:57.149799+0000","last_became_active":"2024-09-13T18:31:56.103926+0000","last_became_peered":"2024-09-13T18:31:56.103926+0000","last_unstale":"2024-09-13T18:31:57.149799+0000","last_undegraded":"2024-09-13T18:31:57.149799+0000","last_fullsized":"2024-09-13T18:31:57.149799+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:03.327372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"119'3","reported_seq":14,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060420+0000","last_change":"2024-09-13T18:31:55.689843+0000","last_active":"2024-09-13T18:31:57.060420+0000","last_peered":"2024-09-13T18:31:57.060420+0000","last_clean":"2024-09-13T18:31:57.060420+0000","last_became_active":"2024-09-13T18:31:55.689090+0000","last_became_peered":"2024-09-13T18:31:55.689090+0000","last_unstale":"2024-09-13T18:31:57.060420+0000","last_undegraded":"2024-09-13T18:31:57.060420+0000","last_fullsized":"2024-09-13T18:31:57.060420+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.973718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148410+0000","last_change":"2024-09-13T18:31:56.101874+0000","last_active":"2024-09-13T18:31:57.148410+0000","last_peered":"2024-09-13T18:31:57.148410+0000","last_clean":"2024-09-13T18:31:57.148410+0000","last_became_active":"2024-09-13T18:31:56.099224+0000","last_became_peered":"2024-09-13T18:31:56.099224+0000","last_unstale":"2024-09-13T18:31:57.148410+0000","last_undegraded":"2024-09-13T18:31:57.148410+0000","last_fullsized":"2024-09-13T18:31:57.148410+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:12.844885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"119'6","reported_seq":17,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150171+0000","last_change":"2024-09-13T18:31:55.697654+0000","last_active":"2024-09-13T18:31:57.150171+0000","last_peered":"2024-09-13T18:31:57.150171+0000","last_clean":"2024-09-13T18:31:57.150171+0000","last_became_active":"2024-09-13T18:31:55.696954+0000","last_became_peered":"2024-09-13T18:31:55.696954+0000","last_unstale":"2024-09-13T18:31:57.150171+0000","last_undegraded":"2024-09-13T18:31:57.150171+0000","last_fullsized":"2024-09-13T18:31:57.150171+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:08.052421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150108+0000","last_change":"2024-09-13T18:31:56.058509+0000","last_active":"2024-09-13T18:31:57.150108+0000","last_peered":"2024-09-13T18:31:57.150108+0000","last_clean":"2024-09-13T18:31:57.150108+0000","last_became_active":"2024-09-13T18:31:56.058198+0000","last_became_peered":"2024-09-13T18:31:56.058198+0000","last_unstale":"2024-09-13T18:31:57.150108+0000","last_undegraded":"2024-09-13T18:31:57.150108+0000","last_fullsized":"2024-09-13T18:31:57.150108+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:35.712261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148802+0000","last_change":"2024-09-13T18:31:55.680639+0000","last_active":"2024-09-13T18:31:57.148802+0000","last_peered":"2024-09-13T18:31:57.148802+0000","last_clean":"2024-09-13T18:31:57.148802+0000","last_became_active":"2024-09-13T18:31:55.680339+0000","last_became_peered":"2024-09-13T18:31:55.680339+0000","last_unstale":"2024-09-13T18:31:57.148802+0000","last_undegraded":"2024-09-13T18:31:57.148802+0000","last_fullsized":"2024-09-13T18:31:57.148802+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:39.917422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057191+0000","last_change":"2024-09-13T18:31:56.074684+0000","last_active":"2024-09-13T18:31:57.057191+0000","last_peered":"2024-09-13T18:31:57.057191+0000","last_clean":"2024-09-13T18:31:57.057191+0000","last_became_active":"2024-09-13T18:31:56.074378+0000","last_became_peered":"2024-09-13T18:31:56.074378+0000","last_unstale":"2024-09-13T18:31:57.057191+0000","last_undegraded":"2024-09-13T18:31:57.057191+0000","last_fullsized":"2024-09-13T18:31:57.057191+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:26.355462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057309+0000","last_change":"2024-09-13T18:31:55.679913+0000","last_active":"2024-09-13T18:31:57.057309+0000","last_peered":"2024-09-13T18:31:57.057309+0000","last_clean":"2024-09-13T18:31:57.057309+0000","last_became_active":"2024-09-13T18:31:55.679496+0000","last_became_peered":"2024-09-13T18:31:55.679496+0000","last_unstale":"2024-09-13T18:31:57.057309+0000","last_undegraded":"2024-09-13T18:31:57.057309+0000","last_fullsized":"2024-09-13T18:31:57.057309+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:28.126201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150085+0000","last_change":"2024-09-13T18:31:56.106136+0000","last_active":"2024-09-13T18:31:57.150085+0000","last_peered":"2024-09-13T18:31:57.150085+0000","last_clean":"2024-09-13T18:31:57.150085+0000","last_became_active":"2024-09-13T18:31:56.103032+0000","last_became_peered":"2024-09-13T18:31:56.103032+0000","last_unstale":"2024-09-13T18:31:57.150085+0000","last_undegraded":"2024-09-13T18:31:57.150085+0000","last_fullsized":"2024-09-13T18:31:57.150085+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:43.539439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"119'8","reported_seq":19,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150339+0000","last_change":"2024-09-13T18:31:55.689377+0000","last_active":"2024-09-13T18:31:57.150339+0000","last_peered":"2024-09-13T18:31:57.150339+0000","last_clean":"2024-09-13T18:31:57.150339+0000","last_became_active":"2024-09-13T18:31:55.687218+0000","last_became_peered":"2024-09-13T18:31:55.687218+0000","last_unstale":"2024-09-13T18:31:57.150339+0000","last_undegraded":"2024-09-13T18:31:57.150339+0000","last_fullsized":"2024-09-13T18:31:57.150339+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.973718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150728+0000","last_change":"2024-09-13T18:31:56.077575+0000","last_active":"2024-09-13T18:31:57.150728+0000","last_peered":"2024-09-13T18:31:57.150728+0000","last_clean":"2024-09-13T18:31:57.150728+0000","last_became_active":"2024-09-13T18:31:56.075861+0000","last_became_peered":"2024-09-13T18:31:56.075861+0000","last_unstale":"2024-09-13T18:31:57.150728+0000","last_undegraded":"2024-09-13T18:31:57.150728+0000","last_fullsized":"2024-09-13T18:31:57.150728+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:47.883932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.061135+0000","last_change":"2024-09-13T18:31:55.703056+0000","last_active":"2024-09-13T18:31:57.061135+0000","last_peered":"2024-09-13T18:31:57.061135+0000","last_clean":"2024-09-13T18:31:57.061135+0000","last_became_active":"2024-09-13T18:31:55.702451+0000","last_became_peered":"2024-09-13T18:31:55.702451+0000","last_unstale":"2024-09-13T18:31:57.061135+0000","last_undegraded":"2024-09-13T18:31:57.061135+0000","last_fullsized":"2024-09-13T18:31:57.061135+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:07.856738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060909+0000","last_change":"2024-09-13T18:31:56.103551+0000","last_active":"2024-09-13T18:31:57.060909+0000","last_peered":"2024-09-13T18:31:57.060909+0000","last_clean":"2024-09-13T18:31:57.060909+0000","last_became_active":"2024-09-13T18:31:56.102924+0000","last_became_peered":"2024-09-13T18:31:56.102924+0000","last_unstale":"2024-09-13T18:31:57.060909+0000","last_undegraded":"2024-09-13T18:31:57.060909+0000","last_fullsized":"2024-09-13T18:31:57.060909+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:04.662410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150512+0000","last_change":"2024-09-13T18:31:55.692074+0000","last_active":"2024-09-13T18:31:57.150512+0000","last_peered":"2024-09-13T18:31:57.150512+0000","last_clean":"2024-09-13T18:31:57.150512+0000","last_became_active":"2024-09-13T18:31:55.691775+0000","last_became_peered":"2024-09-13T18:31:55.691775+0000","last_unstale":"2024-09-13T18:31:57.150512+0000","last_undegraded":"2024-09-13T18:31:57.150512+0000","last_fullsized":"2024-09-13T18:31:57.150512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:20.517419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150740+0000","last_change":"2024-09-13T18:31:56.068497+0000","last_active":"2024-09-13T18:31:57.150740+0000","last_peered":"2024-09-13T18:31:57.150740+0000","last_clean":"2024-09-13T18:31:57.150740+0000","last_became_active":"2024-09-13T18:31:56.068178+0000","last_became_peered":"2024-09-13T18:31:56.068178+0000","last_unstale":"2024-09-13T18:31:57.150740+0000","last_undegraded":"2024-09-13T18:31:57.150740+0000","last_fullsized":"2024-09-13T18:31:57.150740+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:21.398146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"119'1","reported_seq":12,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149519+0000","last_change":"2024-09-13T18:31:55.680833+0000","last_active":"2024-09-13T18:31:57.149519+0000","last_peered":"2024-09-13T18:31:57.149519+0000","last_clean":"2024-09-13T18:31:57.149519+0000","last_became_active":"2024-09-13T18:31:55.680073+0000","last_became_peered":"2024-09-13T18:31:55.680073+0000","last_unstale":"2024-09-13T18:31:57.149519+0000","last_undegraded":"2024-09-13T18:31:57.149519+0000","last_fullsized":"2024-09-13T18:31:57.149519+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:35.540009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057594+0000","last_change":"2024-09-13T18:31:56.066860+0000","last_active":"2024-09-13T18:31:57.057594+0000","last_peered":"2024-09-13T18:31:57.057594+0000","last_clean":"2024-09-13T18:31:57.057594+0000","last_became_active":"2024-09-13T18:31:56.066607+0000","last_became_peered":"2024-09-13T18:31:56.066607+0000","last_unstale":"2024-09-13T18:31:57.057594+0000","last_undegraded":"2024-09-13T18:31:57.057594+0000","last_fullsized":"2024-09-13T18:31:57.057594+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:54.512340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060569+0000","last_change":"2024-09-13T18:31:55.690594+0000","last_active":"2024-09-13T18:31:57.060569+0000","last_peered":"2024-09-13T18:31:57.060569+0000","last_clean":"2024-09-13T18:31:57.060569+0000","last_became_active":"2024-09-13T18:31:55.688103+0000","last_became_peered":"2024-09-13T18:31:55.688103+0000","last_unstale":"2024-09-13T18:31:57.060569+0000","last_undegraded":"2024-09-13T18:31:57.060569+0000","last_fullsized":"2024-09-13T18:31:57.060569+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:33.190693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148753+0000","last_change":"2024-09-13T18:31:56.079683+0000","last_active":"2024-09-13T18:31:57.148753+0000","last_peered":"2024-09-13T18:31:57.148753+0000","last_clean":"2024-09-13T18:31:57.148753+0000","last_became_active":"2024-09-13T18:31:56.079425+0000","last_became_peered":"2024-09-13T18:31:56.079425+0000","last_unstale":"2024-09-13T18:31:57.148753+0000","last_undegraded":"2024-09-13T18:31:57.148753+0000","last_fullsized":"2024-09-13T18:31:57.148753+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:52.215720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060337+0000","last_change":"2024-09-13T18:31:55.686700+0000","last_active":"2024-09-13T18:31:57.060337+0000","last_peered":"2024-09-13T18:31:57.060337+0000","last_clean":"2024-09-13T18:31:57.060337+0000","last_became_active":"2024-09-13T18:31:55.685817+0000","last_became_peered":"2024-09-13T18:31:55.685817+0000","last_unstale":"2024-09-13T18:31:57.060337+0000","last_undegraded":"2024-09-13T18:31:57.060337+0000","last_fullsized":"2024-09-13T18:31:57.060337+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:14.589306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148737+0000","last_change":"2024-09-13T18:31:56.087704+0000","last_active":"2024-09-13T18:31:57.148737+0000","last_peered":"2024-09-13T18:31:57.148737+0000","last_clean":"2024-09-13T18:31:57.148737+0000","last_became_active":"2024-09-13T18:31:56.086982+0000","last_became_peered":"2024-09-13T18:31:56.086982+0000","last_unstale":"2024-09-13T18:31:57.148737+0000","last_undegraded":"2024-09-13T18:31:57.148737+0000","last_fullsized":"2024-09-13T18:31:57.148737+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:32.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150625+0000","last_change":"2024-09-13T18:31:55.693122+0000","last_active":"2024-09-13T18:31:57.150625+0000","last_peered":"2024-09-13T18:31:57.150625+0000","last_clean":"2024-09-13T18:31:57.150625+0000","last_became_active":"2024-09-13T18:31:55.692783+0000","last_became_peered":"2024-09-13T18:31:55.692783+0000","last_unstale":"2024-09-13T18:31:57.150625+0000","last_undegraded":"2024-09-13T18:31:57.150625+0000","last_fullsized":"2024-09-13T18:31:57.150625+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:18.832389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057332+0000","last_change":"2024-09-13T18:31:56.065761+0000","last_active":"2024-09-13T18:31:57.057332+0000","last_peered":"2024-09-13T18:31:57.057332+0000","last_clean":"2024-09-13T18:31:57.057332+0000","last_became_active":"2024-09-13T18:31:56.065484+0000","last_became_peered":"2024-09-13T18:31:56.065484+0000","last_unstale":"2024-09-13T18:31:57.057332+0000","last_undegraded":"2024-09-13T18:31:57.057332+0000","last_fullsized":"2024-09-13T18:31:57.057332+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:10.919680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149663+0000","last_change":"2024-09-13T18:31:55.693107+0000","last_active":"2024-09-13T18:31:57.149663+0000","last_peered":"2024-09-13T18:31:57.149663+0000","last_clean":"2024-09-13T18:31:57.149663+0000","last_became_active":"2024-09-13T18:31:55.692672+0000","last_became_peered":"2024-09-13T18:31:55.692672+0000","last_unstale":"2024-09-13T18:31:57.149663+0000","last_undegraded":"2024-09-13T18:31:57.149663+0000","last_fullsized":"2024-09-13T18:31:57.149663+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:43.791366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147843+0000","last_change":"2024-09-13T18:31:56.089001+0000","last_active":"2024-09-13T18:31:57.147843+0000","last_peered":"2024-09-13T18:31:57.147843+0000","last_clean":"2024-09-13T18:31:57.147843+0000","last_became_active":"2024-09-13T18:31:56.087255+0000","last_became_peered":"2024-09-13T18:31:56.087255+0000","last_unstale":"2024-09-13T18:31:57.147843+0000","last_undegraded":"2024-09-13T18:31:57.147843+0000","last_fullsized":"2024-09-13T18:31:57.147843+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:30.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148069+0000","last_change":"2024-09-13T18:31:55.688516+0000","last_active":"2024-09-13T18:31:57.148069+0000","last_peered":"2024-09-13T18:31:57.148069+0000","last_clean":"2024-09-13T18:31:57.148069+0000","last_became_active":"2024-09-13T18:31:55.688217+0000","last_became_peered":"2024-09-13T18:31:55.688217+0000","last_unstale":"2024-09-13T18:31:57.148069+0000","last_undegraded":"2024-09-13T18:31:57.148069+0000","last_fullsized":"2024-09-13T18:31:57.148069+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:20.140095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150956+0000","last_change":"2024-09-13T18:31:56.104215+0000","last_active":"2024-09-13T18:31:57.150956+0000","last_peered":"2024-09-13T18:31:57.150956+0000","last_clean":"2024-09-13T18:31:57.150956+0000","last_became_active":"2024-09-13T18:31:56.103667+0000","last_became_peered":"2024-09-13T18:31:56.103667+0000","last_unstale":"2024-09-13T18:31:57.150956+0000","last_undegraded":"2024-09-13T18:31:57.150956+0000","last_fullsized":"2024-09-13T18:31:57.150956+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:03.994845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150088+0000","last_change":"2024-09-13T18:31:55.691736+0000","last_active":"2024-09-13T18:31:57.150088+0000","last_peered":"2024-09-13T18:31:57.150088+0000","last_clean":"2024-09-13T18:31:57.150088+0000","last_became_active":"2024-09-13T18:31:55.691470+0000","last_became_peered":"2024-09-13T18:31:55.691470+0000","last_unstale":"2024-09-13T18:31:57.150088+0000","last_undegraded":"2024-09-13T18:31:57.150088+0000","last_fullsized":"2024-09-13T18:31:57.150088+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:46.452030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.150989+0000","last_change":"2024-09-13T18:31:56.060128+0000","last_active":"2024-09-13T18:31:57.150989+0000","last_peered":"2024-09-13T18:31:57.150989+0000","last_clean":"2024-09-13T18:31:57.150989+0000","last_became_active":"2024-09-13T18:31:56.059777+0000","last_became_peered":"2024-09-13T18:31:56.059777+0000","last_unstale":"2024-09-13T18:31:57.150989+0000","last_undegraded":"2024-09-13T18:31:57.150989+0000","last_fullsized":"2024-09-13T18:31:57.150989+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:48.661838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148633+0000","last_change":"2024-09-13T18:31:55.697585+0000","last_active":"2024-09-13T18:31:57.148633+0000","last_peered":"2024-09-13T18:31:57.148633+0000","last_clean":"2024-09-13T18:31:57.148633+0000","last_became_active":"2024-09-13T18:31:55.696403+0000","last_became_peered":"2024-09-13T18:31:55.696403+0000","last_unstale":"2024-09-13T18:31:57.148633+0000","last_undegraded":"2024-09-13T18:31:57.148633+0000","last_fullsized":"2024-09-13T18:31:57.148633+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:24.145933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.058162+0000","last_change":"2024-09-13T18:31:56.075297+0000","last_active":"2024-09-13T18:31:57.058162+0000","last_peered":"2024-09-13T18:31:57.058162+0000","last_clean":"2024-09-13T18:31:57.058162+0000","last_became_active":"2024-09-13T18:31:56.074970+0000","last_became_peered":"2024-09-13T18:31:56.074970+0000","last_unstale":"2024-09-13T18:31:57.058162+0000","last_undegraded":"2024-09-13T18:31:57.058162+0000","last_fullsized":"2024-09-13T18:31:57.058162+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:57:17.251568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057679+0000","last_change":"2024-09-13T18:31:55.688838+0000","last_active":"2024-09-13T18:31:57.057679+0000","last_peered":"2024-09-13T18:31:57.057679+0000","last_clean":"2024-09-13T18:31:57.057679+0000","last_became_active":"2024-09-13T18:31:55.688358+0000","last_became_peered":"2024-09-13T18:31:55.688358+0000","last_unstale":"2024-09-13T18:31:57.057679+0000","last_undegraded":"2024-09-13T18:31:57.057679+0000","last_fullsized":"2024-09-13T18:31:57.057679+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:03.317408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149300+0000","last_change":"2024-09-13T18:31:56.084742+0000","last_active":"2024-09-13T18:31:57.149300+0000","last_peered":"2024-09-13T18:31:57.149300+0000","last_clean":"2024-09-13T18:31:57.149300+0000","last_became_active":"2024-09-13T18:31:56.083952+0000","last_became_peered":"2024-09-13T18:31:56.083952+0000","last_unstale":"2024-09-13T18:31:57.149300+0000","last_undegraded":"2024-09-13T18:31:57.149300+0000","last_fullsized":"2024-09-13T18:31:57.149300+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:30.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148905+0000","last_change":"2024-09-13T18:31:55.674046+0000","last_active":"2024-09-13T18:31:57.148905+0000","last_peered":"2024-09-13T18:31:57.148905+0000","last_clean":"2024-09-13T18:31:57.148905+0000","last_became_active":"2024-09-13T18:31:55.673666+0000","last_became_peered":"2024-09-13T18:31:55.673666+0000","last_unstale":"2024-09-13T18:31:57.148905+0000","last_undegraded":"2024-09-13T18:31:57.148905+0000","last_fullsized":"2024-09-13T18:31:57.148905+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:14.172379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148054+0000","last_change":"2024-09-13T18:31:56.088632+0000","last_active":"2024-09-13T18:31:57.148054+0000","last_peered":"2024-09-13T18:31:57.148054+0000","last_clean":"2024-09-13T18:31:57.148054+0000","last_became_active":"2024-09-13T18:31:56.087836+0000","last_became_peered":"2024-09-13T18:31:56.087836+0000","last_unstale":"2024-09-13T18:31:57.148054+0000","last_undegraded":"2024-09-13T18:31:57.148054+0000","last_fullsized":"2024-09-13T18:31:57.148054+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:03.243790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057842+0000","last_change":"2024-09-13T18:31:55.679590+0000","last_active":"2024-09-13T18:31:57.057842+0000","last_peered":"2024-09-13T18:31:57.057842+0000","last_clean":"2024-09-13T18:31:57.057842+0000","last_became_active":"2024-09-13T18:31:55.679263+0000","last_became_peered":"2024-09-13T18:31:55.679263+0000","last_unstale":"2024-09-13T18:31:57.057842+0000","last_undegraded":"2024-09-13T18:31:57.057842+0000","last_fullsized":"2024-09-13T18:31:57.057842+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:17.166526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.060263+0000","last_change":"2024-09-13T18:31:56.071501+0000","last_active":"2024-09-13T18:31:57.060263+0000","last_peered":"2024-09-13T18:31:57.060263+0000","last_clean":"2024-09-13T18:31:57.060263+0000","last_became_active":"2024-09-13T18:31:56.070819+0000","last_became_peered":"2024-09-13T18:31:56.070819+0000","last_unstale":"2024-09-13T18:31:57.060263+0000","last_undegraded":"2024-09-13T18:31:57.060263+0000","last_fullsized":"2024-09-13T18:31:57.060263+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:58.837937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148299+0000","last_change":"2024-09-13T18:31:55.697519+0000","last_active":"2024-09-13T18:31:57.148299+0000","last_peered":"2024-09-13T18:31:57.148299+0000","last_clean":"2024-09-13T18:31:57.148299+0000","last_became_active":"2024-09-13T18:31:55.696907+0000","last_became_peered":"2024-09-13T18:31:55.696907+0000","last_unstale":"2024-09-13T18:31:57.148299+0000","last_undegraded":"2024-09-13T18:31:57.148299+0000","last_fullsized":"2024-09-13T18:31:57.148299+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:26.934905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149007+0000","last_change":"2024-09-13T18:31:56.063080+0000","last_active":"2024-09-13T18:31:57.149007+0000","last_peered":"2024-09-13T18:31:57.149007+0000","last_clean":"2024-09-13T18:31:57.149007+0000","last_became_active":"2024-09-13T18:31:56.062801+0000","last_became_peered":"2024-09-13T18:31:56.062801+0000","last_unstale":"2024-09-13T18:31:57.149007+0000","last_undegraded":"2024-09-13T18:31:57.149007+0000","last_fullsized":"2024-09-13T18:31:57.149007+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:32.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149883+0000","last_change":"2024-09-13T18:31:55.687059+0000","last_active":"2024-09-13T18:31:57.149883+0000","last_peered":"2024-09-13T18:31:57.149883+0000","last_clean":"2024-09-13T18:31:57.149883+0000","last_became_active":"2024-09-13T18:31:55.686792+0000","last_became_peered":"2024-09-13T18:31:55.686792+0000","last_unstale":"2024-09-13T18:31:57.149883+0000","last_undegraded":"2024-09-13T18:31:57.149883+0000","last_fullsized":"2024-09-13T18:31:57.149883+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:14.560243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.057211+0000","last_change":"2024-09-13T18:31:56.076007+0000","last_active":"2024-09-13T18:31:57.057211+0000","last_peered":"2024-09-13T18:31:57.057211+0000","last_clean":"2024-09-13T18:31:57.057211+0000","last_became_active":"2024-09-13T18:31:56.075759+0000","last_became_peered":"2024-09-13T18:31:56.075759+0000","last_unstale":"2024-09-13T18:31:57.057211+0000","last_undegraded":"2024-09-13T18:31:57.057211+0000","last_fullsized":"2024-09-13T18:31:57.057211+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:31.550759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.148303+0000","last_change":"2024-09-13T18:31:55.674551+0000","last_active":"2024-09-13T18:31:57.148303+0000","last_peered":"2024-09-13T18:31:57.148303+0000","last_clean":"2024-09-13T18:31:57.148303+0000","last_became_active":"2024-09-13T18:31:55.674286+0000","last_became_peered":"2024-09-13T18:31:55.674286+0000","last_unstale":"2024-09-13T18:31:57.148303+0000","last_undegraded":"2024-09-13T18:31:57.148303+0000","last_fullsized":"2024-09-13T18:31:57.148303+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:41.799138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.147770+0000","last_change":"2024-09-13T18:31:56.086398+0000","last_active":"2024-09-13T18:31:57.147770+0000","last_peered":"2024-09-13T18:31:57.147770+0000","last_clean":"2024-09-13T18:31:57.147770+0000","last_became_active":"2024-09-13T18:31:56.076017+0000","last_became_peered":"2024-09-13T18:31:56.076017+0000","last_unstale":"2024-09-13T18:31:57.147770+0000","last_undegraded":"2024-09-13T18:31:57.147770+0000","last_fullsized":"2024-09-13T18:31:57.147770+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:55.651177+0000","last_clean_scrub_stamp":"2024-09-13T18:31:55.651177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:10.422987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"119'2","reported_seq":13,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-09-13T18:31:57.149239+0000","last_change":"2024-09-13T18:31:55.698586+0000","last_active":"2024-09-13T18:31:57.149239+0000","last_peered":"2024-09-13T18:31:57.149239+0000","last_clean":"2024-09-13T18:31:57.149239+0000","last_became_active":"2024-09-13T18:31:55.697613+0000","last_became_peered":"2024-09-13T18:31:55.697613+0000","last_unstale":"2024-09-13T18:31:57.149239+0000","last_undegraded":"2024-09-13T18:31:57.149239+0000","last_fullsized":"2024-09-13T18:31:57.149239+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:31:54.641087+0000","last_clean_scrub_stamp":"2024-09-13T18:31:54.641087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:22.267846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":284,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-13T18:31:56.063121+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:31:56.063121+0000","last_peered":"2024-09-13T18:31:56.063121+0000","last_clean":"2024-09-13T18:31:56.063121+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:31:56.063121+0000","last_undegraded":"2024-09-13T18:31:56.063121+0000","last_fullsized":"2024-09-13T18:31:56.063121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2117632,"data_stored":1253257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.879},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.292,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.103},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.96299999999999997,"15min":0.89500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.333,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.042}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.94099999999999995,"15min":0.93100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.173,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95699999999999996,"15min":0.92700000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.274,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1459999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83699999999999997,"15min":0.80200000000000005},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.997,"5min":1.276,"15min":1.276},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.88200000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.2190000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.89400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88300000000000001,"15min":0.88100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.165,"5min":1.349,"15min":1.448},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.91600000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2230000000000001,"5min":1.397,"15min":1.397},"last":1.0109999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.879,"15min":0.88500000000000001},"min":{"1min":0.61699999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2569999999999999,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.93799999999999994},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.0960000000000001,"5min":1.266,"15min":1.266},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98799999999999999,"15min":1.032},"min":{"1min":0.60799999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.5609999999999999,"15min":1.877},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0089999999999999,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.69399999999999995,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.044,"15min":1},"min":{"1min":0.69199999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.1779999999999999,"5min":1.506,"15min":1.506},"last":1.0760000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1511424,"data_stored":662251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.312,"15min":0.312},"max":{"1min":1.47,"5min":1.47,"15min":2.9990000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.82099999999999995,"15min":0.78600000000000003},"min":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.46600000000000003},"max":{"1min":1.1240000000000001,"5min":1.381,"15min":1.3879999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.92100000000000004,"15min":0.88800000000000001},"min":{"1min":0.56200000000000006,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2709999999999999,"5min":1.506,"15min":1.577},"last":1.26},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.90600000000000003},"min":{"1min":0.61599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1220000000000001,"5min":1.464,"15min":1.464},"last":0.754}]},{"osd":2,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.48899999999999999},"max":{"1min":1.0740000000000001,"5min":1.268,"15min":1.268},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.96499999999999997},"min":{"1min":0.67600000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.26,"5min":1.587,"15min":2.4220000000000002},"last":1.1919999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.52300000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.306},"last":0.80800000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.79700000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2050000000000001,"5min":1.337,"15min":2.9140000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.0329999999999999,"15min":1.002},"min":{"1min":0.68100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.319,"5min":1.526,"15min":1.526},"last":1.153}]},{"osd":5,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.91400000000000003,"15min":0.93600000000000005},"min":{"1min":0.627,"5min":0.439,"15min":0.439},"max":{"1min":1.2390000000000001,"5min":1.2609999999999999,"15min":1.4330000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.024,"15min":1.0920000000000001},"min":{"1min":0.69899999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3879999999999999,"5min":1.6559999999999999,"15min":2.762},"last":1.4450000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:31:04 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.01,"15min":1.038},"min":{"1min":0.70099999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4259999999999999,"5min":1.4419999999999999,"15min":1.9299999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.0149999999999999,"15min":1.04},"min":{"1min":0.71299999999999997,"5min":0.57299999999999995,"15min":0.52400000000000002},"max":{"1min":1.341,"5min":1.5840000000000001,"15min":1.72},"last":1.026}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1507328,"data_stored":660799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":0.84999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2390000000000001,"5min":1.5469999999999999,"15min":2.0209999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.86699999999999999,"15min":0.90300000000000002},"min":{"1min":0.59999999999999998,"5min":0.45300000000000001,"15min":0.437},"max":{"1min":1.105,"5min":1.2010000000000001,"15min":2.1840000000000002},"last":1.264}]},{"osd":1,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.88400000000000001,"15min":0.83599999999999997},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.1559999999999999,"5min":1.22,"15min":1.4419999999999999},"last":1.603},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85099999999999998,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.109,"5min":1.157,"15min":1.5029999999999999},"last":1.3280000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90000000000000002,"15min":0.88100000000000001},"min":{"1min":0.51700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1599999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91500000000000004,"15min":0.96499999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3839999999999999,"5min":1.4730000000000001,"15min":2.2589999999999999},"last":1.401}]},{"osd":3,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93400000000000005,"15min":0.95999999999999996},"min":{"1min":0.69899999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2350000000000001,"5min":1.3740000000000001,"15min":2.0840000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.97099999999999997},"min":{"1min":0.61099999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.339,"5min":1.6719999999999999,"15min":1.871},"last":1.4419999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90700000000000003,"15min":0.93799999999999994},"min":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.163,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":1.042},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3180000000000001,"5min":1.4059999999999999,"15min":1.5049999999999999},"last":1.357}]},{"osd":6,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.96999999999999997,"15min":1.0249999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4239999999999999,"5min":1.5229999999999999,"15min":1.5680000000000001},"last":1.532},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93899999999999995,"15min":1.018},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.6779999999999999},"last":1.117}]},{"osd":7,"last update":"Fri Sep 13 18:30:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.0029999999999999,"15min":1.105},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3779999999999999,"5min":1.4039999999999999,"15min":2.246},"last":1.488},{"interface":"front","average":{"1min":0.995,"5min":1.042,"15min":1.1279999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2969999999999999,"5min":1.5980000000000001,"15min":1.9379999999999999},"last":1.173}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1503232,"data_stored":660757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.91200000000000003,"15min":0.82999999999999996},"min":{"1min":0.51700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":4.3490000000000002},{"interface":"front","average":{"1min":1.034,"5min":0.91200000000000003,"15min":0.88600000000000001},"min":{"1min":0.52900000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":2.4060000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83299999999999996,"15min":0.84199999999999997},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.143,"5min":1.536,"15min":1.536},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.026,"5min":0.94099999999999995,"15min":0.89100000000000001},"min":{"1min":0.502,"5min":0.499,"15min":0.499},"max":{"1min":4.4509999999999996,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.8069999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.88800000000000001,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1910000000000001,"5min":1.216,"15min":1.216},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.89900000000000002,"15min":0.89300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3149999999999999,"5min":1.323,"15min":1.323},"last":2.3220000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1679999999999999,"5min":1.476,"15min":1.476},"last":2.5190000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.01,"15min":0.95799999999999996},"min":{"1min":0.63100000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":10.44,"5min":10.44,"15min":10.44},"last":1.4159999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.3280000000000003,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.94899999999999995,"15min":0.96499999999999997},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":2.1309999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.841,"5min":1.0980000000000001,"15min":1.0349999999999999},"min":{"1min":0.70799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":19.254000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1950000000000001,"15min":1.085},"min":{"1min":0.88400000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":19.434000000000001,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.8979999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:31:02 2024","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.181,"15min":1.0900000000000001},"min":{"1min":0.623,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":15.593,"5min":15.593,"15min":15.593},"last":2.2269999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.034,"15min":1.073},"min":{"1min":0.877,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.323,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":2.7519999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1507328,"data_stored":660847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.88200000000000001,"5min":2.113,"15min":2.113},"last":0.436},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77600000000000002,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.115,"5min":1.4199999999999999,"15min":1.704},"last":0.378},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.079,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.376,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.742,"15min":1.742},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79100000000000004,"15min":0.748},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.0629999999999999,"5min":1.224,"15min":1.399},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.69999999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2190000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.536,"5min":1.536,"15min":2.8740000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98599999999999999,"15min":1.016},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.294,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2589999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.0549999999999999},"min":{"1min":0.71299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.665,"5min":1.665,"15min":2.6190000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.0509999999999999},"min":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53400000000000003},"max":{"1min":1.502,"5min":1.6890000000000001,"15min":1.96},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.036,"15min":1.0880000000000001},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4470000000000001,"5min":1.665,"15min":3},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.032,"15min":1.006},"min":{"1min":0.66900000000000004,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.80200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36684,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335156,"statfs":{"total":96636764160,"available":96599199744,"internally_reserved":0,"allocated":1507328,"data_stored":661303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.92500000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.34100000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.335},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66500000000000004,"15min":0.65500000000000003},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.97699999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.749},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.44700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.2190000000000001,"5min":1.288,"15min":1.423},"last":0.86099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70899999999999996,"15min":0.71699999999999997},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.161,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.995}]},{"osd":4,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91900000000000004,"15min":0.90800000000000003},"min":{"1min":0.61599999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.367,"5min":1.367,"15min":1.611},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.623,"5min":0.498,"15min":0.498},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.1970000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.999},"min":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4950000000000001,"5min":1.5109999999999999,"15min":1.9179999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.702},"last":1.2450000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.62,"5min":0.5,"15min":0.5},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.472},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0249999999999999,"15min":1.0469999999999999},"min":{"1min":0.72199999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.522}]},{"osd":7,"last update":"Fri Sep 13 18:30:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97799999999999998,"15min":0.98299999999999998},"min":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.377},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0620000000000001,"15min":1.079},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4850000000000001,"5min":1.6499999999999999,"15min":1.8089999999999999},"last":1.4330000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36664,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335176,"statfs":{"total":96636764160,"available":96599220224,"internally_reserved":0,"allocated":1486848,"data_stored":654387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.61399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":1.0680000000000001,"15min":1.177},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.29699999999999999,"15min":0.28199999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.36299999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.87},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":1.423,"15min":1.423},"last":0.98599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.90700000000000003},"min":{"1min":0.628,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93600000000000005,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.42899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92800000000000005,"15min":0.92100000000000004},"min":{"1min":0.64200000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3460000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.69499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4059999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.081}]},{"osd":6,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.018,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.27,"5min":1.5900000000000001,"15min":1.653},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.425,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":1.016}]},{"osd":7,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.091,"15min":1.0529999999999999},"min":{"1min":0.74299999999999999,"5min":0.61899999999999999,"15min":0.52500000000000002},"max":{"1min":1.4790000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.196,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.196}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37248,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334592,"statfs":{"total":96636764160,"available":96598622208,"internally_reserved":0,"allocated":2080768,"data_stored":1244755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0169999999999999,"15min":1.147},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.03,"5min":1.244,"15min":1.4359999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1299999999999999,"5min":1.333,"15min":1.333},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.05,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.87}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.99199999999999999,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.93200000000000005},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.075,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96499999999999997,"15min":0.98699999999999999},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3089999999999999,"5min":1.5069999999999999,"15min":1.986},"last":1.3089999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97899999999999998,"15min":1.002},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.492,"5min":1.8799999999999999,"15min":2.641},"last":1.492},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.032},"min":{"1min":0.61599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.304,"5min":1.3580000000000001,"15min":1.6699999999999999},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0349999999999999,"15min":1.0649999999999999},"min":{"1min":0.64600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.321,"5min":1.466,"15min":1.891},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.036,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.72999999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.181}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.006,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":2.2949999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.75600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.724,"15min":2.2480000000000002},"last":1.4159999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:32:00.497 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:32:00.497 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:32:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338f03b640 1 Processor -- start 2024-09-13T18:32:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338f03b640 1 -- start start 2024-09-13T18:32:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338f03b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f338806ff40 0x7f3388070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338f03b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880b3830 con 0x7f3388158ba0 2024-09-13T18:32:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338f03b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338806bc20 con 0x7f33880b1dd0 2024-09-13T18:32:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338f03b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338806c530 con 0x7f338806ff40 2024-09-13T18:32:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338cdd7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3388158ba0 0x7f33880cb9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42328/0 (socket says 172.21.15.53:42328) 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.666+0000 7f338cdd7640 1 -- 172.21.15.53:0/2754030531 learned_addr learned my addr 172.21.15.53:0/2754030531 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338d5d8640 1 --2- 172.21.15.53:0/2754030531 >> v2:172.21.15.87:3300/0 conn(0x7f338806ff40 0x7f3388070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214846694 0 0) 0x7f3370001120 con 0x7f3388158ba0 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003530 con 0x7f3388158ba0 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033874253 0 0) 0x7f3374003530 con 0x7f3388158ba0 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 >> v2:172.21.15.87:3300/0 conn(0x7f338806ff40 msgr2=0x7f3388070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 --2- 172.21.15.53:0/2754030531 >> v2:172.21.15.87:3300/0 conn(0x7f338806ff40 0x7f3388070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 >> v1:172.21.15.87:6789/0 conn(0x7f33880b1dd0 legacy=0x7f33880b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388070890 con 0x7f3388158ba0 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3370001810 con 0x7f3388158ba0 2024-09-13T18:32:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 >> v1:172.21.15.53:6789/0 conn(0x7f3388158ba0 legacy=0x7f33880cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f3374003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33740047d0 0x7f3374004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3374005190 0x7f337400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338806c530 con 0x7f3374003980 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337400c0e0 con 0x7f33740047d0 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337400c2a0 con 0x7f3374005190 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338cdd7640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f3374003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f3387fff640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33740047d0 0x7f3374004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338d5d8640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3374005190 0x7f337400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338cdd7640 1 -- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3374005190 msgr2=0x7f337400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338cdd7640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3374005190 0x7f337400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338cdd7640 1 -- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33740047d0 msgr2=0x7f3374004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338cdd7640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33740047d0 0x7f3374004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338cdd7640 1 -- 172.21.15.53:0/2754030531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374003530 con 0x7f3374003980 2024-09-13T18:32:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338d5d8640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3374005190 0x7f337400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338d5d8640 1 -- 172.21.15.53:0/2754030531 reap_dead start 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f338cdd7640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f3374003d60 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f337000c1c0 tx=0x7f337001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d644c399200790a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370005ae0 con 0x7f3374003980 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3370005c60 con 0x7f3374003980 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.670+0000 7f33877fe640 1 -- 172.21.15.53:0/2754030531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33700a5a20 con 0x7f3374003980 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- 172.21.15.53:0/2754030531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 msgr2=0x7f3374003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f3374003d60 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f337000c1c0 tx=0x7f337001cba0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- 172.21.15.53:0/2754030531 shutdown_connections 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 --2- 172.21.15.53:0/2754030531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f3374003d60 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- 172.21.15.53:0/2754030531 >> 172.21.15.53:0/2754030531 conn(0x7f3388065c80 msgr2=0x7f3388066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- 172.21.15.53:0/2754030531 shutdown_connections 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- 172.21.15.53:0/2754030531 wait complete. 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 Processor -- start 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- start start 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f33881569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3388156180 0x7f3388154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3388155090 0x7f3388155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338814fd20 con 0x7f3374003980 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388156f10 con 0x7f3388155090 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33881571e0 con 0x7f3388156180 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f33881569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f33881569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44628/0 (socket says 172.21.15.53:44628) 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 -- 172.21.15.53:0/2472479005 learned_addr learned my addr 172.21.15.53:0/2472479005 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338d5d8640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3388155090 0x7f3388155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f3387fff640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3388156180 0x7f3388154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 -- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3388156180 msgr2=0x7f3388154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3388156180 0x7f3388154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 -- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3388155090 msgr2=0x7f3388155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3388155090 0x7f3388155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 -- 172.21.15.53:0/2472479005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33881574c0 con 0x7f3374003980 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338cdd7640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f33881569d0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f337001c9d0 tx=0x7f3374005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f33857fa640 1 -- 172.21.15.53:0/2472479005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33700b4070 con 0x7f3374003980 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f33857fa640 1 -- 172.21.15.53:0/2472479005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3370001790 con 0x7f3374003980 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33881577a0 con 0x7f3374003980 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f33857fa640 1 -- 172.21.15.53:0/2472479005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370004c00 con 0x7f3374003980 2024-09-13T18:32:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.674+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3388157d60 con 0x7f3374003980 2024-09-13T18:32:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.678+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33880ade50 con 0x7f3374003980 2024-09-13T18:32:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.678+0000 7f33857fa640 1 -- 172.21.15.53:0/2472479005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f33700a57e0 con 0x7f3374003980 2024-09-13T18:32:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.678+0000 7f33857fa640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3368066a80 0x7f3368068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.678+0000 7f33857fa640 1 -- 172.21.15.53:0/2472479005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f337011dfd0 con 0x7f3374003980 2024-09-13T18:32:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.678+0000 7f3387fff640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3368066a80 0x7f3368068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.678+0000 7f3387fff640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3368066a80 0x7f3368068f40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3378007fd0 tx=0x7f3378007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.682+0000 7f33857fa640 1 -- 172.21.15.53:0/2472479005 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33700eacd0 con 0x7f3374003980 2024-09-13T18:32:00.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.902+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f33880b3830 con 0x7f3374003980 2024-09-13T18:32:00.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.906+0000 7f33857fa640 1 -- 172.21.15.53:0/2472479005 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f33880b3830 con 0x7f3374003980 2024-09-13T18:32:00.909 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:32:00.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3368066a80 msgr2=0x7f3368068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3368066a80 0x7f3368068f40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3378007fd0 tx=0x7f3378007ac0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 msgr2=0x7f33881569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f33881569d0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f337001c9d0 tx=0x7f3374005800 comp rx=0 tx=0).stop 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 shutdown_connections 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3368066a80 0x7f3368068f40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3388156180 0x7f3388154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3388155090 0x7f3388155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 --2- 172.21.15.53:0/2472479005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3374003980 0x7f33881569d0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 >> 172.21.15.53:0/2472479005 conn(0x7f3388065c80 msgr2=0x7f3388159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 shutdown_connections 2024-09-13T18:32:00.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:00.910+0000 7f338f03b640 1 -- 172.21.15.53:0/2472479005 wait complete. 2024-09-13T18:32:00.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:01.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cf13f640 1 Processor -- start 2024-09-13T18:32:01.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cf13f640 1 -- start start 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cf13f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34c80d19c0 0x7f34c80cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cf13f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f34c80cf600 0x7f34c80b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cf13f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c80d2400 con 0x7f34c815cab0 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cf13f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c80cfa90 con 0x7f34c80d19c0 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cf13f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c80d1530 con 0x7f34c80cf600 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34c7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34c80d19c0 0x7f34c80cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34ccedb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f34c815cab0 0x7f34c80cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42338/0 (socket says 172.21.15.53:42338) 2024-09-13T18:32:01.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34c7fff640 1 --2- 172.21.15.53:0/2373606214 >> v2:172.21.15.53:3300/0 conn(0x7f34c80d19c0 0x7f34c80cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44642/0 (socket says 172.21.15.53:44642) 2024-09-13T18:32:01.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34ccedb640 1 -- 172.21.15.53:0/2373606214 learned_addr learned my addr 172.21.15.53:0/2373606214 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:01.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34cd6dc640 1 --2- 172.21.15.53:0/2373606214 >> v2:172.21.15.87:3300/0 conn(0x7f34c80cf600 0x7f34c80b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34c7fff640 1 -- 172.21.15.53:0/2373606214 >> v2:172.21.15.87:3300/0 conn(0x7f34c80cf600 msgr2=0x7f34c80b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34c7fff640 1 --2- 172.21.15.53:0/2373606214 >> v2:172.21.15.87:3300/0 conn(0x7f34c80cf600 0x7f34c80b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34c7fff640 1 -- 172.21.15.53:0/2373606214 >> v1:172.21.15.53:6789/0 conn(0x7f34c815cab0 legacy=0x7f34c80cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.050+0000 7f34c7fff640 1 -- 172.21.15.53:0/2373606214 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80cddd0 con 0x7f34c80d19c0 2024-09-13T18:32:01.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34c7fff640 1 --2- 172.21.15.53:0/2373606214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c80d19c0 0x7f34c80cf0c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f34c80b7fe0 tx=0x7f34b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1182c288fd2764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34c77fe640 1 -- 172.21.15.53:0/2373606214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b40ab600 con 0x7f34c80d19c0 2024-09-13T18:32:01.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34c77fe640 1 -- 172.21.15.53:0/2373606214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b40a7050 con 0x7f34c80d19c0 2024-09-13T18:32:01.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34c77fe640 1 -- 172.21.15.53:0/2373606214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b40ab980 con 0x7f34c80d19c0 2024-09-13T18:32:01.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 -- 172.21.15.53:0/2373606214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c80d19c0 msgr2=0x7f34c80cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 --2- 172.21.15.53:0/2373606214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c80d19c0 0x7f34c80cf0c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f34c80b7fe0 tx=0x7f34b401c480 comp rx=0 tx=0).stop 2024-09-13T18:32:01.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 -- 172.21.15.53:0/2373606214 shutdown_connections 2024-09-13T18:32:01.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 --2- 172.21.15.53:0/2373606214 >> v2:172.21.15.87:3300/0 conn(0x7f34c80cf600 0x7f34c80b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 --2- 172.21.15.53:0/2373606214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c80d19c0 0x7f34c80cf0c0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 -- 172.21.15.53:0/2373606214 >> 172.21.15.53:0/2373606214 conn(0x7f34c8065c80 msgr2=0x7f34c8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 -- 172.21.15.53:0/2373606214 shutdown_connections 2024-09-13T18:32:01.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 -- 172.21.15.53:0/2373606214 wait complete. 2024-09-13T18:32:01.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 Processor -- start 2024-09-13T18:32:01.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.054+0000 7f34cf13f640 1 -- start start 2024-09-13T18:32:01.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c80cf600 0x7f34c814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c80d19c0 0x7f34c813e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c815cab0 0x7f34c815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c813ee20 con 0x7f34c815cab0 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8154880 con 0x7f34c80d19c0 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8154b60 con 0x7f34c80cf600 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c815cab0 0x7f34c815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c815cab0 0x7f34c815a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44654/0 (socket says 172.21.15.53:44654) 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 -- 172.21.15.53:0/517147515 learned_addr learned my addr 172.21.15.53:0/517147515 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34c7fff640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c80d19c0 0x7f34c813e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34ccedb640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c80cf600 0x7f34c814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 -- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c80cf600 msgr2=0x7f34c814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c80cf600 0x7f34c814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 -- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c80d19c0 msgr2=0x7f34c813e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c80d19c0 0x7f34c813e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 -- 172.21.15.53:0/517147515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b4009420 con 0x7f34c815cab0 2024-09-13T18:32:01.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cd6dc640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c815cab0 0x7f34c815a4e0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f34c000cc30 tx=0x7f34c000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34c57fa640 1 -- 172.21.15.53:0/517147515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c000ce40 con 0x7f34c815cab0 2024-09-13T18:32:01.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34c57fa640 1 -- 172.21.15.53:0/517147515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c00039a0 con 0x7f34c815cab0 2024-09-13T18:32:01.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c8154e40 con 0x7f34c815cab0 2024-09-13T18:32:01.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34c57fa640 1 -- 172.21.15.53:0/517147515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0003d30 con 0x7f34c815cab0 2024-09-13T18:32:01.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c8150460 con 0x7f34c815cab0 2024-09-13T18:32:01.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c8150650 con 0x7f34c815cab0 2024-09-13T18:32:01.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34c57fa640 1 -- 172.21.15.53:0/517147515 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f34c0003e90 con 0x7f34c815cab0 2024-09-13T18:32:01.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34c57fa640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f34ac066a80 0x7f34ac068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34c57fa640 1 -- 172.21.15.53:0/517147515 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34c0084df0 con 0x7f34c815cab0 2024-09-13T18:32:01.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34ccedb640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f34ac066a80 0x7f34ac068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.058+0000 7f34ccedb640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f34ac066a80 0x7f34ac068f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34bc005890 tx=0x7f34bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.062+0000 7f34c57fa640 1 -- 172.21.15.53:0/517147515 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34c0051a70 con 0x7f34c815cab0 2024-09-13T18:32:01.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.258+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34c80b5870 con 0x7f34c815cab0 2024-09-13T18:32:01.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.258+0000 7f34c57fa640 1 -- 172.21.15.53:0/517147515 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f34c001d070 con 0x7f34c815cab0 2024-09-13T18:32:01.261 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:01.261 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3448118459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3448118459},{"type":"v1","addr":"172.21.15.87:6833","nonce":3448118459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2784676391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2784676391},{"type":"v1","addr":"172.21.15.87:6835","nonce":2784676391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1340459922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1340459922},{"type":"v1","addr":"172.21.15.53:6833","nonce":1340459922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:56.042381+0000","modified":"2024-09-13T18:31:59.056844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8472":{"gid":8472,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2654273195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2654273195},{"type":"v1","addr":"172.21.15.53:6835","nonce":2654273195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:32:01.261 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 71 2024-09-13T18:32:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f34ac066a80 msgr2=0x7f34ac068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f34ac066a80 0x7f34ac068f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34bc005890 tx=0x7f34bc009040 comp rx=0 tx=0).stop 2024-09-13T18:32:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c815cab0 msgr2=0x7f34c815a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c815cab0 0x7f34c815a4e0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f34c000cc30 tx=0x7f34c000a5c0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 shutdown_connections 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f34ac066a80 0x7f34ac068f40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34c815cab0 0x7f34c815a4e0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c80d19c0 0x7f34c813e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 --2- 172.21.15.53:0/517147515 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c80cf600 0x7f34c814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 >> 172.21.15.53:0/517147515 conn(0x7f34c8065c80 msgr2=0x7f34c80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 shutdown_connections 2024-09-13T18:32:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.262+0000 7f34cf13f640 1 -- 172.21.15.53:0/517147515 wait complete. 2024-09-13T18:32:01.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:31:56.042381+0000', 'modified': '2024-09-13T18:31:59.056844+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8472': {'gid': 8472, 'name': 'c', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/2654273195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 2654273195}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 2654273195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:32:01.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:32:01.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:32:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f3156640 1 Processor -- start 2024-09-13T18:32:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f3156640 1 -- start start 2024-09-13T18:32:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f3156640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 0x7f90ec0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f3156640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90ec06b850 0x7f90ec0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f3156640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0b1ac0 con 0x7f90ec0cbd60 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f3156640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0b3010 con 0x7f90ec06b850 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f3156640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec159ac0 con 0x7f90ec0cb980 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f16f3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f90ec0cbd60 0x7f90ec06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42354/0 (socket says 172.21.15.53:42354) 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f16f3640 1 -- 172.21.15.53:0/1755061234 learned_addr learned my addr 172.21.15.53:0/1755061234 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 0x7f90ec0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351395861 0 0) 0x7f90ec0b1ac0 con 0x7f90ec0cbd60 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90ebfff640 1 --2- 172.21.15.53:0/1755061234 >> v2:172.21.15.87:3300/0 conn(0x7f90ec06b850 0x7f90ec0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d8003530 con 0x7f90ec0cbd60 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3534214988 0 0) 0x7f90d8003530 con 0x7f90ec0cbd60 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 msgr2=0x7f90ec0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 0x7f90ec0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 >> v2:172.21.15.87:3300/0 conn(0x7f90ec06b850 msgr2=0x7f90ec0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 --2- 172.21.15.53:0/1755061234 >> v2:172.21.15.87:3300/0 conn(0x7f90ec06b850 0x7f90ec0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec159da0 con 0x7f90ec0cbd60 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f90dc001680 con 0x7f90ec0cbd60 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 >> v1:172.21.15.53:6789/0 conn(0x7f90ec0cbd60 legacy=0x7f90ec06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.814+0000 7f90eb7fe640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 0x7f90d8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d8003f00 0x7f90d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90d8004d10 0x7f90d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b3010 con 0x7f90d8004d10 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec159ac0 con 0x7f90d8003f00 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d800b9e0 con 0x7f90ec0cb980 2024-09-13T18:32:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90d8004d10 0x7f90d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90ebfff640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d8003f00 0x7f90d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 0x7f90d8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 -- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 msgr2=0x7f90d8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb980 0x7f90d8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 -- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d8003f00 msgr2=0x7f90d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d8003f00 0x7f90d80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 -- 172.21.15.53:0/1755061234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8003530 con 0x7f90d8004d10 2024-09-13T18:32:01.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90ebfff640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d8003f00 0x7f90d80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90d8004d10 0x7f90d8005190 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f90dc007cb0 tx=0x7f90dc0215e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e0c9619a09e26f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc005ae0 con 0x7f90d8004d10 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0ad070 con 0x7f90d8004d10 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90eb7fe640 1 -- 172.21.15.53:0/1755061234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc005ea0 con 0x7f90d8004d10 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f3156640 1 -- 172.21.15.53:0/1755061234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90d8004d10 msgr2=0x7f90d8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f3156640 1 --2- 172.21.15.53:0/1755061234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90d8004d10 0x7f90d8005190 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f90dc007cb0 tx=0x7f90dc0215e0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f16f3640 1 -- 172.21.15.53:0/1755061234 reap_dead start 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f3156640 1 -- 172.21.15.53:0/1755061234 shutdown_connections 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f3156640 1 -- 172.21.15.53:0/1755061234 >> 172.21.15.53:0/1755061234 conn(0x7f90ec065c80 msgr2=0x7f90ec066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f3156640 1 -- 172.21.15.53:0/1755061234 shutdown_connections 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.818+0000 7f90f3156640 1 -- 172.21.15.53:0/1755061234 wait complete. 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 Processor -- start 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 -- start start 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec1f0aa0 0x7f90ec0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ec1f0e80 0x7f90ec0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec0a84d0 0x7f90ec0a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0a9200 con 0x7f90ec1f0e80 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0a94e0 con 0x7f90ec0a84d0 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0a97c0 con 0x7f90ec1f0aa0 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ec1f0e80 0x7f90ec0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ec1f0e80 0x7f90ec0ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44682/0 (socket says 172.21.15.53:44682) 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 -- 172.21.15.53:0/3864826976 learned_addr learned my addr 172.21.15.53:0/3864826976 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f16f3640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec0a84d0 0x7f90ec0a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec1f0aa0 0x7f90ec0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 -- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec1f0aa0 msgr2=0x7f90ec0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec1f0aa0 0x7f90ec0ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 -- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec0a84d0 msgr2=0x7f90ec0a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec0a84d0 0x7f90ec0a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 -- 172.21.15.53:0/3864826976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0a9aa0 con 0x7f90ec1f0e80 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f16f3640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec0a84d0 0x7f90ec0a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90ebfff640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ec1f0e80 0x7f90ec0ad370 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f90d40108f0 tx=0x7f90d4010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90e97fa640 1 -- 172.21.15.53:0/3864826976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4004220 con 0x7f90ec1f0e80 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90e97fa640 1 -- 172.21.15.53:0/3864826976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4004380 con 0x7f90ec1f0e80 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90e97fa640 1 -- 172.21.15.53:0/3864826976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d400eb60 con 0x7f90ec1f0e80 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0a9d80 con 0x7f90ec1f0e80 2024-09-13T18:32:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.822+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0ca530 con 0x7f90ec1f0e80 2024-09-13T18:32:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90e97fa640 1 -- 172.21.15.53:0/3864826976 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f90d400ecc0 con 0x7f90ec1f0e80 2024-09-13T18:32:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90e97fa640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90cc066ab0 0x7f90cc068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90e97fa640 1 -- 172.21.15.53:0/3864826976 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90d4084870 con 0x7f90ec1f0e80 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90cc066ab0 0x7f90cc068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90cc066ab0 0x7f90cc068f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007520 tx=0x7f90e400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 Processor -- start 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- start start 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9de35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9d99200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9d99b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee9c61e80 con 0x564ee9de3b10 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee9befaf0 con 0x564ee9d99740 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee9bed0c0 con 0x564ee9de31f0 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9d99200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9d99200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44698/0 (socket says 172.21.15.53:44698) 2024-09-13T18:32:01.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 -- 172.21.15.53:0/341318820 learned_addr learned my addr 172.21.15.53:0/341318820 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9de35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f16f3640 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9d99b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 -- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 msgr2=0x564ee9de35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9de35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 -- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 msgr2=0x564ee9d99b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9d99b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 -- 172.21.15.53:0/341318820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ee98e4890 con 0x564ee9de3b10 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9de35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90ebfff640 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9d99200 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009fd0 tx=0x7f90d4054ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea32b599a5c66c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90e27fc640 1 -- 172.21.15.53:0/341318820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4055280 con 0x564ee9de3b10 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90e27fc640 1 -- 172.21.15.53:0/341318820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40590b0 con 0x564ee9de3b10 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90e27fc640 1 -- 172.21.15.53:0/341318820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d405d670 con 0x564ee9de3b10 2024-09-13T18:32:01.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- 172.21.15.53:0/341318820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 msgr2=0x564ee9d99200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9d99200 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009fd0 tx=0x7f90d4054ce0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- 172.21.15.53:0/341318820 shutdown_connections 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9d99b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9d99200 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 --2- 172.21.15.53:0/341318820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9de35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- 172.21.15.53:0/341318820 >> 172.21.15.53:0/341318820 conn(0x564ee9d9ffb0 msgr2=0x564ee9da0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- 172.21.15.53:0/341318820 shutdown_connections 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.826+0000 7f90f629f000 1 -- 172.21.15.53:0/341318820 wait complete. 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 -- start start 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 Processor -- start 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9da4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de31f0 0x564ee9da54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de3b10 0x564ee9da5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee9be89b0 con 0x564ee9de31f0 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee9b87c00 con 0x564ee9d99740 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee9ba6070 con 0x564ee9de3b10 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 10 client.0 _ll_register_callbacks cb 0x564ee9d85ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de31f0 0x564ee9da54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de31f0 0x564ee9da54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44714/0 (socket says 172.21.15.53:44714) 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 -- 172.21.15.53:0/3343043485 learned_addr learned my addr 172.21.15.53:0/3343043485 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f16f3640 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de3b10 0x564ee9da5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 -- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de3b10 msgr2=0x564ee9da5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9da4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de3b10 0x564ee9da5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 -- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 msgr2=0x564ee9da4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9da4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 -- 172.21.15.53:0/3343043485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0ca530 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90ebfff640 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de31f0 0x564ee9da54f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f90d4055210 tx=0x7f90d401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9859d46601a9ff4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 1 -- 172.21.15.53:0/3343043485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40590b0 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 1 -- 172.21.15.53:0/3343043485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90d405d670 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ee9ba55f0 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 1 -- 172.21.15.53:0/3343043485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90d405b070 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 10 client.8616 fetch_fsmap learned FSMap version 71 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x564ee9badab0 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 1 -- 172.21.15.53:0/3343043485 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ee9ba55f0 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 1 -- 172.21.15.53:0/3343043485 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 71) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90d401a030 con 0x564ee9de31f0 2024-09-13T18:32:01.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 10 client.8616 fetch_fsmap finished waiting for FSMap version 71 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 10 client.8616 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 20 client.8616 populate_metadata read hostname 'smithi053' 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9da6440 0x564ee9df52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 4 client.8616 mds_command: new command op to 8472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 --> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ee9be5790 con 0x564ee9da6440 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9da6440 0x564ee9df52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9da6440 0x564ee9df52a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5bee831da25662 server_cookie=bc28c6e1c191f186 in_seq=0 out_seq=0 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 10 client.8616 ms_handle_connect on v2:172.21.15.53:6834/2654273195 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 1 -- 172.21.15.53:0/3343043485 <== mds.0 v2:172.21.15.53:6834/2654273195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564ee9be5790 con 0x564ee9da6440 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90cb7fe640 10 client.8616 handle_command_reply: tid=0 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.830+0000 7f90f629f000 1 client.8616 shutdown 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de31f0 msgr2=0x564ee9da54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de31f0 0x564ee9da54f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f90d4055210 tx=0x7f90d401e070 comp rx=0 tx=0).stop 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 shutdown_connections 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9da6440 0x564ee9df52a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de3b10 0x564ee9da5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de31f0 0x564ee9da54f0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90cb7fe640 0 client.8616 ms_handle_reset on v2:172.21.15.53:6834/2654273195 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 --2- 172.21.15.53:0/3343043485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9da4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 >> 172.21.15.53:0/3343043485 conn(0x564ee9d9ffb0 msgr2=0x564ee9d981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 shutdown_connections 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 1 -- 172.21.15.53:0/3343043485 wait complete. 2024-09-13T18:32:01.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.834+0000 7f90f629f000 20 client.8616 trim_cache size 0 max 16384 2024-09-13T18:32:01.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.846+0000 7f90f629f000 1 Processor -- start 2024-09-13T18:32:01.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.846+0000 7f90f629f000 1 -- start start 2024-09-13T18:32:01.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9e3f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9e3f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e3fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee98a5940 con 0x564ee9de3b10 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee9be5db0 con 0x564ee9d99740 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee9be41a0 con 0x564ee9de31f0 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e3fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e3fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44718/0 (socket says 172.21.15.53:44718) 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 -- 172.21.15.53:0/3281715503 learned_addr learned my addr 172.21.15.53:0/3281715503 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9e3f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90ebfff640 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9e3f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 -- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 msgr2=0x564ee9e3f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9e3f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 -- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 msgr2=0x564ee9e3f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9e3f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 -- 172.21.15.53:0/3281715503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ee9b93c00 con 0x564ee9de3b10 2024-09-13T18:32:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e3fdb0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c210 tx=0x7f90dc001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51afbb868d94ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90e2ffd640 1 -- 172.21.15.53:0/3281715503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc001440 con 0x564ee9de3b10 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90e2ffd640 1 -- 172.21.15.53:0/3281715503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0015a0 con 0x564ee9de3b10 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90e2ffd640 1 -- 172.21.15.53:0/3281715503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc004ab0 con 0x564ee9de3b10 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- 172.21.15.53:0/3281715503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 msgr2=0x564ee9e3fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e3fdb0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c210 tx=0x7f90dc001a10 comp rx=0 tx=0).stop 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- 172.21.15.53:0/3281715503 shutdown_connections 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9de31f0 0x564ee9e3f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e3fdb0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- 172.21.15.53:0/3281715503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9d99740 0x564ee9e3f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- 172.21.15.53:0/3281715503 >> 172.21.15.53:0/3281715503 conn(0x564ee9d9ffb0 msgr2=0x564ee9d979d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- 172.21.15.53:0/3281715503 shutdown_connections 2024-09-13T18:32:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- 172.21.15.53:0/3281715503 wait complete. 2024-09-13T18:32:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- start start 2024-09-13T18:32:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 Processor -- start 2024-09-13T18:32:01.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9d99740 0x564ee9e40dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9de31f0 0x564ee9e41300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e41840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee9c2b5f0 con 0x564ee9de3b10 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee9be61c0 con 0x564ee9de31f0 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ee9da51e0 con 0x564ee9d99740 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f629f000 10 client.0 _ll_register_callbacks cb 0x7f90d40515c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e41840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e41840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44724/0 (socket says 172.21.15.53:44724) 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f16f3640 1 -- 172.21.15.53:0/1519373196 learned_addr learned my addr 172.21.15.53:0/1519373196 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.850+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9d99740 0x564ee9e40dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90ebfff640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9de31f0 0x564ee9e41300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f16f3640 1 -- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9d99740 msgr2=0x564ee9e40dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f16f3640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9d99740 0x564ee9e40dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f16f3640 1 -- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9de31f0 msgr2=0x564ee9e41300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f16f3640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9de31f0 0x564ee9e41300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f16f3640 1 -- 172.21.15.53:0/1519373196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8003530 con 0x564ee9de3b10 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90ebfff640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9de31f0 0x564ee9e41300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f16f3640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e41840 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f90dc006040 tx=0x7f90dc01e380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd7547c847bdc74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 1 -- 172.21.15.53:0/1519373196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0c4070 con 0x564ee9de3b10 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 1 -- 172.21.15.53:0/1519373196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90dc001710 con 0x564ee9de3b10 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ee9bb8460 con 0x564ee9de3b10 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 1 -- 172.21.15.53:0/1519373196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90dc001440 con 0x564ee9de3b10 2024-09-13T18:32:01.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 10 client.8622 fetch_fsmap learned FSMap version 71 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x564ee98e4cc0 con 0x564ee9de3b10 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 1 -- 172.21.15.53:0/1519373196 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ee9bb8460 con 0x564ee9de3b10 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 1 -- 172.21.15.53:0/1519373196 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 71) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90dc0048b0 con 0x564ee9de3b10 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 10 client.8622 fetch_fsmap finished waiting for FSMap version 71 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 10 client.8622 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 20 client.8622 populate_metadata read hostname 'smithi053' 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9e41d80 0x564ee9e42160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 4 client.8622 mds_command: new command op to 8472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 --> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564ee9bb19c0 con 0x564ee9e41d80 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9e41d80 0x564ee9e42160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 10 client.8622 ms_handle_connect on v2:172.21.15.53:6834/2654273195 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f0ef2640 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9e41d80 0x564ee9e42160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcd3827190e77df5 server_cookie=a0c9b680b2b534c3 in_seq=0 out_seq=0 2024-09-13T18:32:01.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 1 -- 172.21.15.53:0/1519373196 <== mds.0 v2:172.21.15.53:6834/2654273195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x564ee9bb19c0 con 0x564ee9e41d80 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 10 client.8622 handle_command_reply: tid=0 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 client.8622 shutdown 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 msgr2=0x564ee9e41840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e41840 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f90dc006040 tx=0x7f90dc01e380 comp rx=0 tx=0).stop 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 shutdown_connections 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:6834/2654273195,v1:172.21.15.53:6835/2654273195] conn(0x564ee9e41d80 0x564ee9e42160 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee9de3b10 0x564ee9e41840 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564ee9de31f0 0x564ee9e41300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90cb7fe640 0 client.8622 ms_handle_reset on v2:172.21.15.53:6834/2654273195 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 --2- 172.21.15.53:0/1519373196 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564ee9d99740 0x564ee9e40dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 >> 172.21.15.53:0/1519373196 conn(0x564ee9d9ffb0 msgr2=0x564ee9d981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 shutdown_connections 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 1 -- 172.21.15.53:0/1519373196 wait complete. 2024-09-13T18:32:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f629f000 20 client.8622 trim_cache size 0 max 16384 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8472, 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 5.8120196079999999, 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 71, 2024-09-13T18:32:01.863 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 120, 2024-09-13T18:32:01.864 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 120, 2024-09-13T18:32:01.864 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 10.127203902 2024-09-13T18:32:01.864 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:32:01.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90cc066ab0 msgr2=0x7f90cc068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90cc066ab0 0x7f90cc068f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007520 tx=0x7f90e400b040 comp rx=0 tx=0).stop 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ec1f0e80 msgr2=0x7f90ec0ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ec1f0e80 0x7f90ec0ad370 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f90d40108f0 tx=0x7f90d4010db0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 shutdown_connections 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90cc066ab0 0x7f90cc068f70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec0a84d0 0x7f90ec0a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90ec1f0e80 0x7f90ec0ad370 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 --2- 172.21.15.53:0/3864826976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec1f0aa0 0x7f90ec0ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 >> 172.21.15.53:0/3864826976 conn(0x7f90ec065c80 msgr2=0x7f90ec0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 shutdown_connections 2024-09-13T18:32:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.854+0000 7f90f3156640 1 -- 172.21.15.53:0/3864826976 wait complete. 2024-09-13T18:32:01.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:32:01.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff550793640 1 Processor -- start 2024-09-13T18:32:01.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff550793640 1 -- start start 2024-09-13T18:32:01.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff550793640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff54815cab0 0x7ff5480d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff550793640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cf7d0 0x7ff5480b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff550793640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480d2400 con 0x7ff5480cd6c0 2024-09-13T18:32:01.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff550793640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480d1530 con 0x7ff54815cab0 2024-09-13T18:32:01.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff550793640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480d0920 con 0x7ff5480cf7d0 2024-09-13T18:32:01.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54e52f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff54815cab0 0x7ff5480d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54e52f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff54815cab0 0x7ff5480d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44726/0 (socket says 172.21.15.53:44726) 2024-09-13T18:32:01.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54e52f640 1 -- 172.21.15.53:0/3593437982 learned_addr learned my addr 172.21.15.53:0/3593437982 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54ed30640 1 --2- 172.21.15.53:0/3593437982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cf7d0 0x7ff5480b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54e52f640 1 -- 172.21.15.53:0/3593437982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cf7d0 msgr2=0x7ff5480b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54e52f640 1 --2- 172.21.15.53:0/3593437982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cf7d0 0x7ff5480b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54e52f640 1 -- 172.21.15.53:0/3593437982 >> v1:172.21.15.87:6789/0 conn(0x7ff5480cd6c0 legacy=0x7ff5480cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:01.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.990+0000 7ff54e52f640 1 -- 172.21.15.53:0/3593437982 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480d0c00 con 0x7ff54815cab0 2024-09-13T18:32:01.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff54e52f640 1 --2- 172.21.15.53:0/3593437982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5480d19c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff544009870 tx=0x7ff54401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d853c837e7aff693 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:01.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff54d52d640 1 -- 172.21.15.53:0/3593437982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440aa610 con 0x7ff54815cab0 2024-09-13T18:32:01.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff54d52d640 1 -- 172.21.15.53:0/3593437982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5440a6040 con 0x7ff54815cab0 2024-09-13T18:32:01.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff54d52d640 1 -- 172.21.15.53:0/3593437982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440aa990 con 0x7ff54815cab0 2024-09-13T18:32:01.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- 172.21.15.53:0/3593437982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 msgr2=0x7ff5480d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 --2- 172.21.15.53:0/3593437982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5480d19c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff544009870 tx=0x7ff54401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- 172.21.15.53:0/3593437982 shutdown_connections 2024-09-13T18:32:01.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 --2- 172.21.15.53:0/3593437982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cf7d0 0x7ff5480b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 --2- 172.21.15.53:0/3593437982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5480d19c0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- 172.21.15.53:0/3593437982 >> 172.21.15.53:0/3593437982 conn(0x7ff548065c80 msgr2=0x7ff548066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:01.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- 172.21.15.53:0/3593437982 shutdown_connections 2024-09-13T18:32:01.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- 172.21.15.53:0/3593437982 wait complete. 2024-09-13T18:32:01.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 Processor -- start 2024-09-13T18:32:01.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- start start 2024-09-13T18:32:01.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cd6c0 0x7ff548166a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5480cf7d0 0x7ff5480cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5481547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548155a50 con 0x7ff54815cab0 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548155c60 con 0x7ff5480cf7d0 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff550793640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff548155f40 con 0x7ff5480cd6c0 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.994+0000 7ff54ed30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5481547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5481547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44732/0 (socket says 172.21.15.53:44732) 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 -- 172.21.15.53:0/1810114361 learned_addr learned my addr 172.21.15.53:0/1810114361 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54e52f640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cd6c0 0x7ff548166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54dd2e640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5480cf7d0 0x7ff5480cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 -- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cd6c0 msgr2=0x7ff548166a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cd6c0 0x7ff548166a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:01.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 -- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5480cf7d0 msgr2=0x7ff5480cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5480cf7d0 0x7ff5480cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 -- 172.21.15.53:0/1810114361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440094d0 con 0x7ff54815cab0 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54dd2e640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5480cf7d0 0x7ff5480cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54ed30640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5481547a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff540007e40 tx=0x7ff54000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff53effd640 1 -- 172.21.15.53:0/1810114361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540014620 con 0x7ff54815cab0 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff53effd640 1 -- 172.21.15.53:0/1810114361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54000ee90 con 0x7ff54815cab0 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff548156220 con 0x7ff54815cab0 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff53effd640 1 -- 172.21.15.53:0/1810114361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400149e0 con 0x7ff54815cab0 2024-09-13T18:32:02.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff548154ce0 con 0x7ff54815cab0 2024-09-13T18:32:02.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5480c9930 con 0x7ff54815cab0 2024-09-13T18:32:02.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff53effd640 1 -- 172.21.15.53:0/1810114361 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff540014b40 con 0x7ff54815cab0 2024-09-13T18:32:02.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff53effd640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff52c066a80 0x7ff52c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:02.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff53effd640 1 -- 172.21.15.53:0/1810114361 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5400851f0 con 0x7ff54815cab0 2024-09-13T18:32:02.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54e52f640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff52c066a80 0x7ff52c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:02.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:01.998+0000 7ff54e52f640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff52c066a80 0x7ff52c068f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5440ae000 tx=0x7ff5440b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:02.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.002+0000 7ff53effd640 1 -- 172.21.15.53:0/1810114361 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff540051f80 con 0x7ff54815cab0 2024-09-13T18:32:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5480b5870 con 0x7ff54815cab0 2024-09-13T18:32:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff53effd640 1 -- 172.21.15.53:0/1810114361 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff5400555a0 con 0x7ff54815cab0 2024-09-13T18:32:02.207 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:32:02.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff52c066a80 msgr2=0x7ff52c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:02.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff52c066a80 0x7ff52c068f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5440ae000 tx=0x7ff5440b5040 comp rx=0 tx=0).stop 2024-09-13T18:32:02.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 msgr2=0x7ff5481547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5481547a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff540007e40 tx=0x7ff54000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 shutdown_connections 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff52c066a80 0x7ff52c068f40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff54815cab0 0x7ff5481547a0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5480cf7d0 0x7ff5480cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 --2- 172.21.15.53:0/1810114361 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5480cd6c0 0x7ff548166a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 >> 172.21.15.53:0/1810114361 conn(0x7ff548065c80 msgr2=0x7ff54815f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 shutdown_connections 2024-09-13T18:32:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:02.206+0000 7ff550793640 1 -- 172.21.15.53:0/1810114361 wait complete. 2024-09-13T18:32:02.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:32:02.226 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:32:02.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.226 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:02.233 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42074sec preferred_lft 42074sec 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:32:02.234 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:32:02.235 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.236 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:32:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:32:02.236 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:02.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.236 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:32:02.282 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:32:02.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.284 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:32:02.331 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:32:02.332 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:32:02.332 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:32:02.332 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:32:02.332 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:32:02.332 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:32:02.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.332 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:32:02.332 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:32:02.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:32:02.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:32:02.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:32:02.333 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:32:02.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.409 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:32:02.454 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:32:02.455 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:32:02.455 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:32:02.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:32:02.511 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:32:02.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:02.511 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:02.563 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:32:02.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:02.563 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:02.610 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:32:02.668 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:02.668 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:02.722 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:02.724 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:02.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.724 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:32:02.775 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:32:02.775 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:32:02.823 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:32:02.839 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:02.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:02.894 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:02.895 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:02.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:02.896 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:32:02.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:32:02.906+0000 7fbae8daa580 -1 init, newargv = 0x55f765c95a20 newargc=15 2024-09-13T18:32:02.907 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[51686]: starting ceph client 2024-09-13T18:32:02.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[51686]: starting fuse 2024-09-13T18:32:04.013 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:32:04.030 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:04.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:04.087 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:04.088 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:04.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:04.088 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:32:04.135 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:32:04.135 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:32:04.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:32:04.135 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:32:04.135 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:32:04.135 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:32:04.136 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:32:04.137 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:32:04.259 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.51686.asok 2024-09-13T18:32:04.441 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51686.asok 2024-09-13T18:32:04.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:04.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51686.asok status 2024-09-13T18:32:04.603 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:32:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:32:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:32:04.603 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "51686", 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8634, 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 8634 2024-09-13T18:32:04.604 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3963950272 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3963950272 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.8634 192.168.0.1:0/3963950272", 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3963950272", 2024-09-13T18:32:04.605 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:32:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 71, 2024-09-13T18:32:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 121, 2024-09-13T18:32:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:32:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:32:04.606 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:32:04.606 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:32:04.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:04.617 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:32:04.617 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:04.623 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:32:04.623 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:04.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:04.623 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:04.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:32:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e4d2cd640 1 Processor -- start 2024-09-13T18:32:04.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e4d2cd640 1 -- start start 2024-09-13T18:32:04.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e4d2cd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9e481582a0 0x7f9e4806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e4d2cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9e480713a0 0x7f9e4806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e4d2cd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4806d480 con 0x7f9e4815b7c0 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e4d2cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4815aaf0 con 0x7f9e480713a0 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e4d2cd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4806d760 con 0x7f9e481582a0 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9e480713a0 0x7f9e4806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9e480713a0 0x7f9e4806ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44742/0 (socket says 172.21.15.53:44742) 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e477fe640 1 -- 172.21.15.53:0/114364830 learned_addr learned my addr 172.21.15.53:0/114364830 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e46ffd640 1 --2- 172.21.15.53:0/114364830 >> v2:172.21.15.87:3300/0 conn(0x7f9e481582a0 0x7f9e4806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e477fe640 1 -- 172.21.15.53:0/114364830 >> v2:172.21.15.87:3300/0 conn(0x7f9e481582a0 msgr2=0x7f9e4806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e477fe640 1 --2- 172.21.15.53:0/114364830 >> v2:172.21.15.87:3300/0 conn(0x7f9e481582a0 0x7f9e4806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:04.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e477fe640 1 -- 172.21.15.53:0/114364830 >> v1:172.21.15.87:6789/0 conn(0x7f9e4815b7c0 legacy=0x7f9e48070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.849+0000 7f9e477fe640 1 -- 172.21.15.53:0/114364830 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4815ace0 con 0x7f9e480713a0 2024-09-13T18:32:04.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e477fe640 1 --2- 172.21.15.53:0/114364830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e480713a0 0x7f9e4806ce40 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f9e48069f50 tx=0x7f9e4001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c89cb696300bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e467fc640 1 -- 172.21.15.53:0/114364830 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400a5880 con 0x7f9e480713a0 2024-09-13T18:32:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e467fc640 1 -- 172.21.15.53:0/114364830 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e400a59e0 con 0x7f9e480713a0 2024-09-13T18:32:04.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e467fc640 1 -- 172.21.15.53:0/114364830 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400a5d70 con 0x7f9e480713a0 2024-09-13T18:32:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/114364830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e480713a0 msgr2=0x7f9e4806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/114364830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e480713a0 0x7f9e4806ce40 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f9e48069f50 tx=0x7f9e4001c9c0 comp rx=0 tx=0).stop 2024-09-13T18:32:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/114364830 shutdown_connections 2024-09-13T18:32:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/114364830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e480713a0 0x7f9e4806ce40 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/114364830 >> v2:172.21.15.87:3300/0 conn(0x7f9e481582a0 0x7f9e4806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:04.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/114364830 >> 172.21.15.53:0/114364830 conn(0x7f9e48065c80 msgr2=0x7f9e48066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:04.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/114364830 shutdown_connections 2024-09-13T18:32:04.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/114364830 wait complete. 2024-09-13T18:32:04.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 Processor -- start 2024-09-13T18:32:04.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.853+0000 7f9e4d2cd640 1 -- start start 2024-09-13T18:32:04.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e480713a0 0x7f9e480cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:04.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e481582a0 0x7f9e4814a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e4815b7c0 0x7f9e48138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480cd7d0 con 0x7f9e4815b7c0 2024-09-13T18:32:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e481f30e0 con 0x7f9e481582a0 2024-09-13T18:32:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4814ab80 con 0x7f9e480713a0 2024-09-13T18:32:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e4815b7c0 0x7f9e48138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:04.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e4815b7c0 0x7f9e48138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44748/0 (socket says 172.21.15.53:44748) 2024-09-13T18:32:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 -- 172.21.15.53:0/3000165692 learned_addr learned my addr 172.21.15.53:0/3000165692 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e46ffd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e480713a0 0x7f9e480cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e3e7fc640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e481582a0 0x7f9e4814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 -- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e480713a0 msgr2=0x7f9e480cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:04.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e480713a0 0x7f9e480cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 -- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e481582a0 msgr2=0x7f9e4814a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e481582a0 0x7f9e4814a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 -- 172.21.15.53:0/3000165692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40009b30 con 0x7f9e4815b7c0 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e477fe640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e4815b7c0 0x7f9e48138ac0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f9e400195d0 tx=0x7f9e40019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e3ffff640 1 -- 172.21.15.53:0/3000165692 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400b8670 con 0x7f9e4815b7c0 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e3ffff640 1 -- 172.21.15.53:0/3000165692 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e400b87d0 con 0x7f9e4815b7c0 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4814ae20 con 0x7f9e4815b7c0 2024-09-13T18:32:04.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e3ffff640 1 -- 172.21.15.53:0/3000165692 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400b8b60 con 0x7f9e4815b7c0 2024-09-13T18:32:04.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4814b3e0 con 0x7f9e4815b7c0 2024-09-13T18:32:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e48067400 con 0x7f9e4815b7c0 2024-09-13T18:32:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e3ffff640 1 -- 172.21.15.53:0/3000165692 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9e400b8cc0 con 0x7f9e4815b7c0 2024-09-13T18:32:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e3ffff640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9e28066a80 0x7f9e28068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e3ffff640 1 -- 172.21.15.53:0/3000165692 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9e4011fe80 con 0x7f9e4815b7c0 2024-09-13T18:32:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.857+0000 7f9e46ffd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9e28066a80 0x7f9e28068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:04.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.861+0000 7f9e46ffd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9e28066a80 0x7f9e28068f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009af0 tx=0x7f9e38008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:04.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:04.861+0000 7f9e3ffff640 1 -- 172.21.15.53:0/3000165692 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e400ece40 con 0x7f9e4815b7c0 2024-09-13T18:32:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.057+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e480cd920 con 0x7f9e4815b7c0 2024-09-13T18:32:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.057+0000 7f9e3ffff640 1 -- 172.21.15.53:0/3000165692 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9e400bc060 con 0x7f9e4815b7c0 2024-09-13T18:32:05.061 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:32:05.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9e28066a80 msgr2=0x7f9e28068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9e28066a80 0x7f9e28068f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009af0 tx=0x7f9e38008040 comp rx=0 tx=0).stop 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e4815b7c0 msgr2=0x7f9e48138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e4815b7c0 0x7f9e48138ac0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f9e400195d0 tx=0x7f9e40019760 comp rx=0 tx=0).stop 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 shutdown_connections 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9e28066a80 0x7f9e28068f40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e4815b7c0 0x7f9e48138ac0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9e481582a0 0x7f9e4814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 --2- 172.21.15.53:0/3000165692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e480713a0 0x7f9e480cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 >> 172.21.15.53:0/3000165692 conn(0x7f9e48065c80 msgr2=0x7f9e48066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 shutdown_connections 2024-09-13T18:32:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:05.061+0000 7f9e4d2cd640 1 -- 172.21.15.53:0/3000165692 wait complete. 2024-09-13T18:32:05.080 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:32:05.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:32:05.080 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:32:05.080 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:32:05.080 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:05.081 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:32:05.081 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:32:05.081 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:32:05.081 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:32:05.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.081 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:32:05.088 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:32:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:32:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:32:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:32:05.088 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.088 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:32:05.089 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42078sec preferred_lft 42078sec 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:32:05.090 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:05.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.091 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:32:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:32:05.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.143 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:32:05.195 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:32:05.196 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:32:05.196 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:32:05.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.196 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:32:05.196 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:32:05.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:32:05.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:32:05.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:32:05.196 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:32:05.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.270 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:32:05.319 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:32:05.320 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:32:05.320 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:32:05.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.321 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:32:05.375 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:32:05.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:05.376 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:05.423 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:32:05.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:05.424 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:05.471 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:32:05.528 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:05.528 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:05.581 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:05.582 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:05.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.583 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:32:05.630 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:32:05.631 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:32:05.676 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:32:05.691 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:05.691 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:05.745 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:05.747 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:05.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:05.748 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:32:05.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:32:05.753+0000 7fce97587580 -1 init, newargv = 0x5617550773e0 newargc=15 2024-09-13T18:32:05.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36234]: starting ceph client 2024-09-13T18:32:05.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36234]: starting fuse 2024-09-13T18:32:06.861 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:32:06.877 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:06.877 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:06.930 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:06.931 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:06.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:06.932 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:32:06.983 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:32:06.983 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:32:06.983 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:32:06.983 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:32:06.983 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:32:06.983 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:32:06.983 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:32:06.984 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:32:06.985 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:32:07.104 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.36234.asok 2024-09-13T18:32:07.286 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.36234.asok 2024-09-13T18:32:07.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:07.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.36234.asok status 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:32:07.442 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "36234", 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 7618, 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 7618 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1678387532 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1678387532 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.7618 192.168.0.1:0/1678387532", 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1678387532", 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 71, 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 122, 2024-09-13T18:32:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:32:07.445 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:32:07.445 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:32:07.445 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:32:07.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:07.457 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:32:07.457 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:07.463 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:32:07.464 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:07.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:07.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:07.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:32:07.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 Processor -- start 2024-09-13T18:32:07.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 -- start start 2024-09-13T18:32:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03ac15c5e0 0x7f03ac15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03ac06ccc0 0x7f03ac06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06f370 0x7f03ac06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac070fb0 con 0x7f03ac15c5e0 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ac06d620 con 0x7f03ac06ccc0 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03b0de2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac15dd30 con 0x7f03ac06f370 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03ac15c5e0 0x7f03ac15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03ac15c5e0 0x7f03ac15d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34392/0 (socket says 172.21.15.53:34392) 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 -- 172.21.15.53:0/1301423562 learned_addr learned my addr 172.21.15.53:0/1301423562 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03a9d9b640 1 --2- 172.21.15.53:0/1301423562 >> v2:172.21.15.87:3300/0 conn(0x7f03ac06ccc0 0x7f03ac06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aad9d640 1 --2- 172.21.15.53:0/1301423562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06f370 0x7f03ac06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 -- 172.21.15.53:0/1301423562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06f370 msgr2=0x7f03ac06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 --2- 172.21.15.53:0/1301423562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06f370 0x7f03ac06f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 -- 172.21.15.53:0/1301423562 >> v2:172.21.15.87:3300/0 conn(0x7f03ac06ccc0 msgr2=0x7f03ac06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 --2- 172.21.15.53:0/1301423562 >> v2:172.21.15.87:3300/0 conn(0x7f03ac06ccc0 0x7f03ac06d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03aa59c640 1 -- 172.21.15.53:0/1301423562 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac070a10 con 0x7f03ac15c5e0 2024-09-13T18:32:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.657+0000 7f03a9d9b640 1 --2- 172.21.15.53:0/1301423562 >> v2:172.21.15.87:3300/0 conn(0x7f03ac06ccc0 0x7f03ac06d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03aa59c640 1 --2- 172.21.15.53:0/1301423562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac15d7f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0ce3b0 tx=0x7f039c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333983dbbd1a6970 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03a959a640 1 -- 172.21.15.53:0/1301423562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c0aa610 con 0x7f03ac15c5e0 2024-09-13T18:32:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03a959a640 1 -- 172.21.15.53:0/1301423562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c0a6040 con 0x7f03ac15c5e0 2024-09-13T18:32:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03a959a640 1 -- 172.21.15.53:0/1301423562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c0aa990 con 0x7f03ac15c5e0 2024-09-13T18:32:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 -- 172.21.15.53:0/1301423562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 msgr2=0x7f03ac15d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 --2- 172.21.15.53:0/1301423562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac15d7f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0ce3b0 tx=0x7f039c01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 -- 172.21.15.53:0/1301423562 shutdown_connections 2024-09-13T18:32:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 --2- 172.21.15.53:0/1301423562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06f370 0x7f03ac06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 --2- 172.21.15.53:0/1301423562 >> v2:172.21.15.87:3300/0 conn(0x7f03ac06ccc0 0x7f03ac06d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 --2- 172.21.15.53:0/1301423562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac15d7f0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 -- 172.21.15.53:0/1301423562 >> 172.21.15.53:0/1301423562 conn(0x7f03ac073330 msgr2=0x7f03ac065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 -- 172.21.15.53:0/1301423562 shutdown_connections 2024-09-13T18:32:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.661+0000 7f03b0de2640 1 -- 172.21.15.53:0/1301423562 wait complete. 2024-09-13T18:32:07.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 Processor -- start 2024-09-13T18:32:07.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 -- start start 2024-09-13T18:32:07.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06ccc0 0x7f03ac0b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:07.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ac06f370 0x7f03ac150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:07.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac166fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac156e60 con 0x7f03ac15c5e0 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0b0fc0 con 0x7f03ac06f370 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac150860 con 0x7f03ac06ccc0 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac166fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac166fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34400/0 (socket says 172.21.15.53:34400) 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 -- 172.21.15.53:0/497235286 learned_addr learned my addr 172.21.15.53:0/497235286 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03a9d9b640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ac06f370 0x7f03ac150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aa59c640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06ccc0 0x7f03ac0b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 -- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06ccc0 msgr2=0x7f03ac0b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06ccc0 0x7f03ac0b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 -- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ac06f370 msgr2=0x7f03ac150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:07.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ac06f370 0x7f03ac150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 -- 172.21.15.53:0/497235286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0094d0 con 0x7f03ac15c5e0 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03aad9d640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac166fe0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f03a4007ea0 tx=0x7f03a4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f039affd640 1 -- 172.21.15.53:0/497235286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4014620 con 0x7f03ac15c5e0 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f039affd640 1 -- 172.21.15.53:0/497235286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a40147a0 con 0x7f03ac15c5e0 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac1570b0 con 0x7f03ac15c5e0 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f039affd640 1 -- 172.21.15.53:0/497235286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4014b50 con 0x7f03ac15c5e0 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac157670 con 0x7f03ac15c5e0 2024-09-13T18:32:07.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac0b1c50 con 0x7f03ac15c5e0 2024-09-13T18:32:07.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f039affd640 1 -- 172.21.15.53:0/497235286 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f03a4014cb0 con 0x7f03ac15c5e0 2024-09-13T18:32:07.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.665+0000 7f039affd640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f038c066a80 0x7f038c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:07.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.669+0000 7f039affd640 1 -- 172.21.15.53:0/497235286 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f03a4085260 con 0x7f03ac15c5e0 2024-09-13T18:32:07.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.669+0000 7f03aa59c640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f038c066a80 0x7f038c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:07.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.669+0000 7f03aa59c640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f038c066a80 0x7f038c068f40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f039c0ae000 tx=0x7f039c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:07.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.673+0000 7f039affd640 1 -- 172.21.15.53:0/497235286 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03a4051fb0 con 0x7f03ac15c5e0 2024-09-13T18:32:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:07.869+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f03ac0cac50 con 0x7f03ac15c5e0 2024-09-13T18:32:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.109+0000 7f039affd640 1 -- 172.21.15.53:0/497235286 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 136+0+0 (secure 0 0 0) 0x7f03a40555d0 con 0x7f03ac15c5e0 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f038c066a80 msgr2=0x7f038c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f038c066a80 0x7f038c068f40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f039c0ae000 tx=0x7f039c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 msgr2=0x7f03ac166fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac166fe0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f03a4007ea0 tx=0x7f03a4007f90 comp rx=0 tx=0).stop 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 shutdown_connections 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f038c066a80 0x7f038c068f40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03ac15c5e0 0x7f03ac166fe0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03ac06f370 0x7f03ac150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 --2- 172.21.15.53:0/497235286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03ac06ccc0 0x7f03ac0b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 >> 172.21.15.53:0/497235286 conn(0x7f03ac073330 msgr2=0x7f03ac1533a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 shutdown_connections 2024-09-13T18:32:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.113+0000 7f03b0de2640 1 -- 172.21.15.53:0/497235286 wait complete. 2024-09-13T18:32:08.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:32:08.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.265+0000 7f0061cd8640 1 Processor -- start 2024-09-13T18:32:08.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.265+0000 7f0061cd8640 1 -- start start 2024-09-13T18:32:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f0061cd8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c0b1960 0x7f005c0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f0061cd8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f005c0ae5d0 0x7f005c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f0061cd8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c0ad530 con 0x7f005c15db40 2024-09-13T18:32:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f0061cd8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c0ae1b0 con 0x7f005c0ae5d0 2024-09-13T18:32:08.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f0061cd8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0ad810 con 0x7f005c0b1960 2024-09-13T18:32:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f0053fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c0b1960 0x7f005c0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f005c0ae5d0 0x7f005c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f005c0ae5d0 0x7f005c0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:51054/0 (socket says 172.21.15.53:51054) 2024-09-13T18:32:08.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f005c15db40 0x7f005c0afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:53390/0 (socket says 172.21.15.53:53390) 2024-09-13T18:32:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 -- 172.21.15.53:0/3117692764 learned_addr learned my addr 172.21.15.53:0/3117692764 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 -- 172.21.15.53:0/3117692764 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c0b1960 msgr2=0x7f005c0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 --2- 172.21.15.53:0/3117692764 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c0b1960 0x7f005c0b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005affd640 1 -- 172.21.15.53:0/3117692764 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769323432 0 0) 0x7f005c0ad530 con 0x7f005c15db40 2024-09-13T18:32:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 -- 172.21.15.53:0/3117692764 >> v1:172.21.15.87:6789/0 conn(0x7f005c15db40 legacy=0x7f005c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 -- 172.21.15.53:0/3117692764 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c0adaf0 con 0x7f005c0ae5d0 2024-09-13T18:32:08.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.269+0000 7f005bfff640 1 --2- 172.21.15.53:0/3117692764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 0x7f005c0aea20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0054009e50 tx=0x7f005401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd928b6949f4279 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:08.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f005affd640 1 -- 172.21.15.53:0/3117692764 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540a5810 con 0x7f005c0ae5d0 2024-09-13T18:32:08.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f005affd640 1 -- 172.21.15.53:0/3117692764 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00540a5970 con 0x7f005c0ae5d0 2024-09-13T18:32:08.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f005affd640 1 -- 172.21.15.53:0/3117692764 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540a5d00 con 0x7f005c0ae5d0 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- 172.21.15.53:0/3117692764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 msgr2=0x7f005c0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 --2- 172.21.15.53:0/3117692764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 0x7f005c0aea20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0054009e50 tx=0x7f005401c970 comp rx=0 tx=0).stop 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- 172.21.15.53:0/3117692764 shutdown_connections 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 --2- 172.21.15.53:0/3117692764 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 0x7f005c0aea20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 --2- 172.21.15.53:0/3117692764 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c0b1960 0x7f005c0b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- 172.21.15.53:0/3117692764 >> 172.21.15.53:0/3117692764 conn(0x7f005c0b20d0 msgr2=0x7f005c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- 172.21.15.53:0/3117692764 shutdown_connections 2024-09-13T18:32:08.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- 172.21.15.53:0/3117692764 wait complete. 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 Processor -- start 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- start start 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 0x7f005c0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f005c0b1960 0x7f005c1f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c15db40 0x7f005c157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0c42a0 con 0x7f005c0b1960 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c152140 con 0x7f005c0ae5d0 2024-09-13T18:32:08.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0c44d0 con 0x7f005c15db40 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f005c0b1960 0x7f005c1f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f005c0b1960 0x7f005c1f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34410/0 (socket says 172.21.15.53:34410) 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 -- 172.21.15.53:0/4013366010 learned_addr learned my addr 172.21.15.53:0/4013366010 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f005b7fe640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 0x7f005c0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f005bfff640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c15db40 0x7f005c157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 -- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c15db40 msgr2=0x7f005c157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c15db40 0x7f005c157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 -- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 msgr2=0x7f005c0c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 0x7f005c0c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 -- 172.21.15.53:0/4013366010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054009b30 con 0x7f005c0b1960 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0053fff640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f005c0b1960 0x7f005c1f8fc0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f004400e930 tx=0x7f004400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0058ff9640 1 -- 172.21.15.53:0/4013366010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044009690 con 0x7f005c0b1960 2024-09-13T18:32:08.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0058ff9640 1 -- 172.21.15.53:0/4013366010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400ca00 con 0x7f005c0b1960 2024-09-13T18:32:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c0c47b0 con 0x7f005c0b1960 2024-09-13T18:32:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.273+0000 7f0058ff9640 1 -- 172.21.15.53:0/4013366010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400cd70 con 0x7f005c0b1960 2024-09-13T18:32:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.277+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c1f87c0 con 0x7f005c0b1960 2024-09-13T18:32:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.277+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c073a10 con 0x7f005c0b1960 2024-09-13T18:32:08.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.277+0000 7f0058ff9640 1 -- 172.21.15.53:0/4013366010 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0044013470 con 0x7f005c0b1960 2024-09-13T18:32:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.277+0000 7f0058ff9640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f003c066a80 0x7f003c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.277+0000 7f005b7fe640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f003c066a80 0x7f003c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.277+0000 7f0058ff9640 1 -- 172.21.15.53:0/4013366010 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0044084b10 con 0x7f005c0b1960 2024-09-13T18:32:08.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.277+0000 7f005b7fe640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f003c066a80 0x7f003c068f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f004c000f70 tx=0x7f004c007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:08.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.281+0000 7f0058ff9640 1 -- 172.21.15.53:0/4013366010 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00440519d0 con 0x7f005c0b1960 2024-09-13T18:32:08.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.461+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f005c0ad530 con 0x7f003c066a80 2024-09-13T18:32:08.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0058ff9640 1 -- 172.21.15.53:0/4013366010 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f005c0ad530 con 0x7f003c066a80 2024-09-13T18:32:08.467 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:32:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:32:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:08.468 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:32:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f003c066a80 msgr2=0x7f003c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f003c066a80 0x7f003c068f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f004c000f70 tx=0x7f004c007df0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f005c0b1960 msgr2=0x7f005c1f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f005c0b1960 0x7f005c1f8fc0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f004400e930 tx=0x7f004400edf0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 shutdown_connections 2024-09-13T18:32:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f003c066a80 0x7f003c068f40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f005c15db40 0x7f005c157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f005c0b1960 0x7f005c1f8fc0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 --2- 172.21.15.53:0/4013366010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f005c0ae5d0 0x7f005c0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 >> 172.21.15.53:0/4013366010 conn(0x7f005c0b20d0 msgr2=0x7f005c06d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 shutdown_connections 2024-09-13T18:32:08.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.465+0000 7f0061cd8640 1 -- 172.21.15.53:0/4013366010 wait complete. 2024-09-13T18:32:08.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:32:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0eafb640 1 Processor -- start 2024-09-13T18:32:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0eafb640 1 -- start start 2024-09-13T18:32:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0eafb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b08156c40 0x7f3b08070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0eafb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b0806d440 0x7f3b0806f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0eafb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080b15a0 con 0x7f3b08157020 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0eafb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080b1880 con 0x7f3b08156c40 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0eafb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080b1b60 con 0x7f3b0806d440 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0c897640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3b08156c40 0x7f3b08070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b07fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3b08157020 0x7f3b0806cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50946/0 (socket says 172.21.15.53:50946) 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b07fff640 1 -- 172.21.15.53:0/2739396338 learned_addr learned my addr 172.21.15.53:0/2739396338 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0d098640 1 --2- 172.21.15.53:0/2739396338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b0806d440 0x7f3b0806f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0c897640 1 -- 172.21.15.53:0/2739396338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b0806d440 msgr2=0x7f3b0806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0c897640 1 --2- 172.21.15.53:0/2739396338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b0806d440 0x7f3b0806f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0c897640 1 -- 172.21.15.53:0/2739396338 >> v1:172.21.15.53:6789/0 conn(0x7f3b08157020 legacy=0x7f3b0806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.605+0000 7f3b0c897640 1 -- 172.21.15.53:0/2739396338 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080b1e40 con 0x7f3b08156c40 2024-09-13T18:32:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0c897640 1 --2- 172.21.15.53:0/2739396338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b08070ee0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3af00097c0 tx=0x7f3af001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a2e2179cc9b2d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b077fe640 1 -- 172.21.15.53:0/2739396338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af00aa5f0 con 0x7f3b08156c40 2024-09-13T18:32:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b077fe640 1 -- 172.21.15.53:0/2739396338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af00aa750 con 0x7f3b08156c40 2024-09-13T18:32:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b077fe640 1 -- 172.21.15.53:0/2739396338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af00aaae0 con 0x7f3b08156c40 2024-09-13T18:32:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 -- 172.21.15.53:0/2739396338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 msgr2=0x7f3b08070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/2739396338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b08070ee0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3af00097c0 tx=0x7f3af001c470 comp rx=0 tx=0).stop 2024-09-13T18:32:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 -- 172.21.15.53:0/2739396338 shutdown_connections 2024-09-13T18:32:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/2739396338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b0806d440 0x7f3b0806f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/2739396338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b08070ee0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 -- 172.21.15.53:0/2739396338 >> 172.21.15.53:0/2739396338 conn(0x7f3b08065c80 msgr2=0x7f3b08066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 -- 172.21.15.53:0/2739396338 shutdown_connections 2024-09-13T18:32:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 -- 172.21.15.53:0/2739396338 wait complete. 2024-09-13T18:32:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 Processor -- start 2024-09-13T18:32:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.609+0000 7f3b0eafb640 1 -- start start 2024-09-13T18:32:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0806d440 0x7f3b0815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b0814f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b081493e0 0x7f3b08149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08149db0 con 0x7f3b08156c40 2024-09-13T18:32:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0814e150 con 0x7f3b0806d440 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0814e430 con 0x7f3b081493e0 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b0814f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b0814f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34432/0 (socket says 172.21.15.53:34432) 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 -- 172.21.15.53:0/34165679 learned_addr learned my addr 172.21.15.53:0/34165679 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0c897640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0806d440 0x7f3b0815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0d098640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b081493e0 0x7f3b08149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 -- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b081493e0 msgr2=0x7f3b08149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b081493e0 0x7f3b08149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 -- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0806d440 msgr2=0x7f3b0815ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0806d440 0x7f3b0815ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 -- 172.21.15.53:0/34165679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0009420 con 0x7f3b08156c40 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b07fff640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b0814f950 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f3af800ca70 tx=0x7f3af800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b057fa640 1 -- 172.21.15.53:0/34165679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800abd0 con 0x7f3b08156c40 2024-09-13T18:32:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b057fa640 1 -- 172.21.15.53:0/34165679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800ad30 con 0x7f3b08156c40 2024-09-13T18:32:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0814e710 con 0x7f3b08156c40 2024-09-13T18:32:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b057fa640 1 -- 172.21.15.53:0/34165679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8012620 con 0x7f3b08156c40 2024-09-13T18:32:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0814eaa0 con 0x7f3b08156c40 2024-09-13T18:32:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0806f330 con 0x7f3b08156c40 2024-09-13T18:32:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b057fa640 1 -- 172.21.15.53:0/34165679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f3af8007070 con 0x7f3b08156c40 2024-09-13T18:32:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b057fa640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae8066a80 0x7f3ae8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b057fa640 1 -- 172.21.15.53:0/34165679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3af8084840 con 0x7f3b08156c40 2024-09-13T18:32:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.613+0000 7f3b0c897640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae8066a80 0x7f3ae8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.617+0000 7f3b0c897640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae8066a80 0x7f3ae8068f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3af00ae000 tx=0x7f3af00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.617+0000 7f3b057fa640 1 -- 172.21.15.53:0/34165679 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3af8051590 con 0x7f3b08156c40 2024-09-13T18:32:08.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.777+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3b0814a200 con 0x7f3b08156c40 2024-09-13T18:32:08.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b057fa640 1 -- 172.21.15.53:0/34165679 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3af8054bb0 con 0x7f3b08156c40 2024-09-13T18:32:08.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae8066a80 msgr2=0x7f3ae8068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae8066a80 0x7f3ae8068f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3af00ae000 tx=0x7f3af00a7000 comp rx=0 tx=0).stop 2024-09-13T18:32:08.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 msgr2=0x7f3b0814f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b0814f950 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f3af800ca70 tx=0x7f3af800cf30 comp rx=0 tx=0).stop 2024-09-13T18:32:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 shutdown_connections 2024-09-13T18:32:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae8066a80 0x7f3ae8068f40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b081493e0 0x7f3b08149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b08156c40 0x7f3b0814f950 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 --2- 172.21.15.53:0/34165679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b0806d440 0x7f3b0815ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 >> 172.21.15.53:0/34165679 conn(0x7f3b08065c80 msgr2=0x7f3b080cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 shutdown_connections 2024-09-13T18:32:08.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:08.781+0000 7f3b0eafb640 1 -- 172.21.15.53:0/34165679 wait complete. 2024-09-13T18:32:08.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:08.802 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol22330/54ac3c9b-4815-46e4-bbdb-cdd750a579ed) 2024-09-13T18:32:08.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:08.830 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol22330/54ac3c9b-4815-46e4-bbdb-cdd750a579ed/.snap/fake) 2024-09-13T18:32:08.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:08.900 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:32:08.948 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:32:08.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:08.949 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol22330/54ac3c9b-4815-46e4-bbdb-cdd750a579ed) 2024-09-13T18:32:09.008 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:09.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol22330/.meta 2024-09-13T18:32:09.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:09.072 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp73420/subvol63631/d5090046-d77e-4a87-98c1-7133c6f7016b) 2024-09-13T18:32:09.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:09.135 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp73420/subvol63631/d5090046-d77e-4a87-98c1-7133c6f7016b/.snap/fake) 2024-09-13T18:32:09.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:09.209 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:32:09.266 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:32:09.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:09.267 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp73420/subvol63631/d5090046-d77e-4a87-98c1-7133c6f7016b) 2024-09-13T18:32:09.332 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:09.332 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp73420/subvol63631/.meta 2024-09-13T18:32:09.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:09.390 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol97432/0b0f1031-1ede-4df6-976d-111804fb8cce) 2024-09-13T18:32:09.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:09.453 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:32:09.501 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:32:09.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:09.502 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol97432/0b0f1031-1ede-4df6-976d-111804fb8cce) 2024-09-13T18:32:09.567 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:09.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol97432/.meta 2024-09-13T18:32:09.624 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol22330 2024-09-13T18:32:09.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907c7df640 1 Processor -- start 2024-09-13T18:32:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907c7df640 1 -- start start 2024-09-13T18:32:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907c7df640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 0x7f90740cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907c7df640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907406f7a0 con 0x7f9074143e80 2024-09-13T18:32:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907c7df640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907406fd60 con 0x7f90740caee0 2024-09-13T18:32:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907c7df640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907406baa0 con 0x7f90740cda30 2024-09-13T18:32:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907a57b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9074143e80 0x7f907406b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50952/0 (socket says 172.21.15.53:50952) 2024-09-13T18:32:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907a57b640 1 -- 172.21.15.53:0/3876377561 learned_addr learned my addr 172.21.15.53:0/3876377561 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907ad7c640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 0x7f90740cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605180660 0 0) 0x7f907406f7a0 con 0x7f9074143e80 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9060003530 con 0x7f9074143e80 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049524906 0 0) 0x7f907406fd60 con 0x7f90740caee0 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f907406f7a0 con 0x7f90740caee0 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2735556739 0 0) 0x7f9060003530 con 0x7f9074143e80 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 msgr2=0x7f90740cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 0x7f90740cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 >> v1:172.21.15.87:6789/0 conn(0x7f90740caee0 legacy=0x7f90740cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740cb960 con 0x7f9074143e80 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9070001680 con 0x7f9074143e80 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 >> v1:172.21.15.53:6789/0 conn(0x7f9074143e80 legacy=0x7f907406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 0x7f9060003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90600040f0 0x7f90600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9060004d10 0x7f9060005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907406baa0 con 0x7f90600040f0 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906000bbf0 con 0x7f9060004d10 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906000bdb0 con 0x7f90740cda30 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079d7a640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90600040f0 0x7f90600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907a57b640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 0x7f9060003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907ad7c640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9060004d10 0x7f9060005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079d7a640 1 -- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 msgr2=0x7f9060003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079d7a640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90740cda30 0x7f9060003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079d7a640 1 -- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9060004d10 msgr2=0x7f9060005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079d7a640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9060004d10 0x7f9060005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f9079d7a640 1 -- 172.21.15.53:0/3876377561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060003530 con 0x7f90600040f0 2024-09-13T18:32:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.797+0000 7f907ad7c640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9060004d10 0x7f9060005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f9079d7a640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90600040f0 0x7f90600047d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f90680018d0 tx=0x7f906801c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503d29ccfe135529 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680052d0 con 0x7f90600040f0 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068005450 con 0x7f90600040f0 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f9079579640 1 -- 172.21.15.53:0/3876377561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068003840 con 0x7f90600040f0 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 -- 172.21.15.53:0/3876377561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90600040f0 msgr2=0x7f90600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 --2- 172.21.15.53:0/3876377561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90600040f0 0x7f90600047d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f90680018d0 tx=0x7f906801c550 comp rx=0 tx=0).stop 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907ad7c640 1 -- 172.21.15.53:0/3876377561 reap_dead start 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 -- 172.21.15.53:0/3876377561 shutdown_connections 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 -- 172.21.15.53:0/3876377561 >> 172.21.15.53:0/3876377561 conn(0x7f9074065c80 msgr2=0x7f9074066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 -- 172.21.15.53:0/3876377561 shutdown_connections 2024-09-13T18:32:09.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 -- 172.21.15.53:0/3876377561 wait complete. 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 Processor -- start 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.801+0000 7f907c7df640 1 -- start start 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90600040f0 0x7f9074136e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907413e6e0 0x7f90741f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f907413eb60 0x7f90741f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9074138920 con 0x7f907413e6e0 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9074137380 con 0x7f90600040f0 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9074138b00 con 0x7f907413eb60 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907413e6e0 0x7f90741f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907413e6e0 0x7f90741f33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34456/0 (socket says 172.21.15.53:34456) 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 -- 172.21.15.53:0/3998052357 learned_addr learned my addr 172.21.15.53:0/3998052357 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:09.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907a57b640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90600040f0 0x7f9074136e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907ad7c640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f907413eb60 0x7f90741f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 -- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f907413eb60 msgr2=0x7f90741f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f907413eb60 0x7f90741f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 -- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90600040f0 msgr2=0x7f9074136e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90600040f0 0x7f9074136e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 -- 172.21.15.53:0/3998052357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074138de0 con 0x7f907413e6e0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907ad7c640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f907413eb60 0x7f90741f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9079d7a640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907413e6e0 0x7f90741f33b0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f9068000c10 tx=0x7f9060005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9066ffd640 1 -- 172.21.15.53:0/3998052357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680bd070 con 0x7f907413e6e0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9066ffd640 1 -- 172.21.15.53:0/3998052357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068003600 con 0x7f907413e6e0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90741390c0 con 0x7f907413e6e0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9066ffd640 1 -- 172.21.15.53:0/3998052357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068003770 con 0x7f907413e6e0 2024-09-13T18:32:09.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907413d950 con 0x7f907413e6e0 2024-09-13T18:32:09.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907413db40 con 0x7f907413e6e0 2024-09-13T18:32:09.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9066ffd640 1 -- 172.21.15.53:0/3998052357 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f90680038d0 con 0x7f907413e6e0 2024-09-13T18:32:09.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9066ffd640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9058066ab0 0x7f9058068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:09.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f907a57b640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9058066ab0 0x7f9058068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:09.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.805+0000 7f9066ffd640 1 -- 172.21.15.53:0/3998052357 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f906811e910 con 0x7f907413e6e0 2024-09-13T18:32:09.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.809+0000 7f907a57b640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9058066ab0 0x7f9058068f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9070000c10 tx=0x7f9070001010 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:09.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.813+0000 7f9066ffd640 1 -- 172.21.15.53:0/3998052357 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90680eb600 con 0x7f907413e6e0 2024-09-13T18:32:09.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:09.997+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol22330", "target": ["mon-mgr", ""]}) v1 -- 0x7f90740ce160 con 0x7f9058066ab0 2024-09-13T18:32:10.011 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:10.009+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:10.011 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:10.009+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:10.011 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:10.009+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:10.011 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:10.009+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:10.011 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:10.009+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:10.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.045+0000 7f9066ffd640 1 -- 172.21.15.53:0/3998052357 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f90700015a0 con 0x7f9058066ab0 2024-09-13T18:32:10.049 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol22330/54ac3c9b-4815-46e4-bbdb-cdd750a579ed 2024-09-13T18:32:10.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9058066ab0 msgr2=0x7f9058068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9058066ab0 0x7f9058068f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9070000c10 tx=0x7f9070001010 comp rx=0 tx=0).stop 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907413e6e0 msgr2=0x7f90741f33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907413e6e0 0x7f90741f33b0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f9068000c10 tx=0x7f9060005800 comp rx=0 tx=0).stop 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 shutdown_connections 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9058066ab0 0x7f9058068f70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f907413eb60 0x7f90741f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f907413e6e0 0x7f90741f33b0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 --2- 172.21.15.53:0/3998052357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90600040f0 0x7f9074136e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 >> 172.21.15.53:0/3998052357 conn(0x7f9074065c80 msgr2=0x7f9074157010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:10.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 shutdown_connections 2024-09-13T18:32:10.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.049+0000 7f907c7df640 1 -- 172.21.15.53:0/3998052357 wait complete. 2024-09-13T18:32:10.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol63631 subvol_grp73420 2024-09-13T18:32:10.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.193+0000 7f2ad3227640 1 Processor -- start 2024-09-13T18:32:10.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.193+0000 7f2ad3227640 1 -- start start 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad3227640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad3227640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2acc145900 0x7f2acc0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad3227640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc0706a0 con 0x7f2acc145e50 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad3227640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc0b26d0 con 0x7f2acc145900 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad3227640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0b3920 con 0x7f2acc145400 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2acbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2acc145900 0x7f2acc0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad17c4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2acc145e50 0x7f2acc06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50966/0 (socket says 172.21.15.53:50966) 2024-09-13T18:32:10.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad17c4640 1 -- 172.21.15.53:0/3329170074 learned_addr learned my addr 172.21.15.53:0/3329170074 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2ad0fc3640 1 --2- 172.21.15.53:0/3329170074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2acbfff640 1 -- 172.21.15.53:0/3329170074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 msgr2=0x7f2acc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2acbfff640 1 --2- 172.21.15.53:0/3329170074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2acbfff640 1 -- 172.21.15.53:0/3329170074 >> v1:172.21.15.53:6789/0 conn(0x7f2acc145e50 legacy=0x7f2acc06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2acbfff640 1 -- 172.21.15.53:0/3329170074 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc160410 con 0x7f2acc145900 2024-09-13T18:32:10.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2acbfff640 1 --2- 172.21.15.53:0/3329170074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145900 0x7f2acc0ace20 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097c0 tx=0x7f2ac001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedd9251cdefb6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.197+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3329170074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ab600 con 0x7f2acc145900 2024-09-13T18:32:10.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3329170074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac00a7050 con 0x7f2acc145900 2024-09-13T18:32:10.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2acb7fe640 1 -- 172.21.15.53:0/3329170074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ab980 con 0x7f2acc145900 2024-09-13T18:32:10.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- 172.21.15.53:0/3329170074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145900 msgr2=0x7f2acc0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 --2- 172.21.15.53:0/3329170074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145900 0x7f2acc0ace20 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097c0 tx=0x7f2ac001c330 comp rx=0 tx=0).stop 2024-09-13T18:32:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- 172.21.15.53:0/3329170074 shutdown_connections 2024-09-13T18:32:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 --2- 172.21.15.53:0/3329170074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145900 0x7f2acc0ace20 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 --2- 172.21.15.53:0/3329170074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- 172.21.15.53:0/3329170074 >> 172.21.15.53:0/3329170074 conn(0x7f2acc073330 msgr2=0x7f2acc065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- 172.21.15.53:0/3329170074 shutdown_connections 2024-09-13T18:32:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- 172.21.15.53:0/3329170074 wait complete. 2024-09-13T18:32:10.203 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 Processor -- start 2024-09-13T18:32:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- start start 2024-09-13T18:32:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2acc145900 0x7f2acc0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145e50 0x7f2acc0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0cdd90 con 0x7f2acc145e50 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0ce070 con 0x7f2acc145900 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc12e850 con 0x7f2acc145400 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145e50 0x7f2acc0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145e50 0x7f2acc0af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34508/0 (socket says 172.21.15.53:34508) 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 -- 172.21.15.53:0/252534114 learned_addr learned my addr 172.21.15.53:0/252534114 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad0fc3640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2acbfff640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2acc145900 0x7f2acc0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 -- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 msgr2=0x7f2acc15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc15d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 -- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2acc145900 msgr2=0x7f2acc0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2acc145900 0x7f2acc0aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 -- 172.21.15.53:0/252534114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0009420 con 0x7f2acc145e50 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2acbfff640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2acc145900 0x7f2acc0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad0fc3640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc15d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad17c4640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145e50 0x7f2acc0af3c0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400d360 tx=0x7f2ac400d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ac97fa640 1 -- 172.21.15.53:0/252534114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400a580 con 0x7f2acc145e50 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ac97fa640 1 -- 172.21.15.53:0/252534114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac400a6e0 con 0x7f2acc145e50 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc12eb30 con 0x7f2acc145e50 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ac97fa640 1 -- 172.21.15.53:0/252534114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400aa90 con 0x7f2acc145e50 2024-09-13T18:32:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.201+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc15da10 con 0x7f2acc145e50 2024-09-13T18:32:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.205+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc0cace0 con 0x7f2acc145e50 2024-09-13T18:32:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.205+0000 7f2ac97fa640 1 -- 172.21.15.53:0/252534114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2ac4015400 con 0x7f2acc145e50 2024-09-13T18:32:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.205+0000 7f2ac97fa640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ab8066a80 0x7f2ab8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.205+0000 7f2ac97fa640 1 -- 172.21.15.53:0/252534114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2ac40886b0 con 0x7f2acc145e50 2024-09-13T18:32:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.205+0000 7f2ad0fc3640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ab8066a80 0x7f2ab8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.205+0000 7f2ad0fc3640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ab8066a80 0x7f2ab8068f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097a0 tx=0x7f2abc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.209+0000 7f2ac97fa640 1 -- 172.21.15.53:0/252534114 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ac4055530 con 0x7f2acc145e50 2024-09-13T18:32:10.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.393+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol63631", "group_name": "subvol_grp73420", "target": ["mon-mgr", ""]}) v1 -- 0x7f2acc160cb0 con 0x7f2ab8066a80 2024-09-13T18:32:10.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ac97fa640 1 -- 172.21.15.53:0/252534114 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f2abc009d80 con 0x7f2ab8066a80 2024-09-13T18:32:10.443 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp73420/subvol63631/d5090046-d77e-4a87-98c1-7133c6f7016b 2024-09-13T18:32:10.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ab8066a80 msgr2=0x7f2ab8068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ab8066a80 0x7f2ab8068f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097a0 tx=0x7f2abc008040 comp rx=0 tx=0).stop 2024-09-13T18:32:10.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145e50 msgr2=0x7f2acc0af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145e50 0x7f2acc0af3c0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400d360 tx=0x7f2ac400d820 comp rx=0 tx=0).stop 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 shutdown_connections 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ab8066a80 0x7f2ab8068f40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2acc145e50 0x7f2acc0af3c0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2acc145900 0x7f2acc0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 --2- 172.21.15.53:0/252534114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2acc145400 0x7f2acc15d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 >> 172.21.15.53:0/252534114 conn(0x7f2acc073330 msgr2=0x7f2acc06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 shutdown_connections 2024-09-13T18:32:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.441+0000 7f2ad3227640 1 -- 172.21.15.53:0/252534114 wait complete. 2024-09-13T18:32:10.464 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol97432 2024-09-13T18:32:10.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.585+0000 7fccf8f85640 1 Processor -- start 2024-09-13T18:32:10.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.585+0000 7fccf8f85640 1 -- start start 2024-09-13T18:32:10.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf8f85640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fccf4143e80 0x7fccf406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf8f85640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fccf40caee0 0x7fccf40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf8f85640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf40cd320 0x7fccf40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf8f85640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf406f7a0 con 0x7fccf40caee0 2024-09-13T18:32:10.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf8f85640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf406fd60 con 0x7fccf4143e80 2024-09-13T18:32:10.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf8f85640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40cdd10 con 0x7fccf40cd320 2024-09-13T18:32:10.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fccf40caee0 0x7fccf40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fccf40caee0 0x7fccf40cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34520/0 (socket says 172.21.15.53:34520) 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 -- 172.21.15.53:0/994957960 learned_addr learned my addr 172.21.15.53:0/994957960 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf259c640 1 --2- 172.21.15.53:0/994957960 >> v2:172.21.15.87:3300/0 conn(0x7fccf4143e80 0x7fccf406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf2d9d640 1 --2- 172.21.15.53:0/994957960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf40cd320 0x7fccf40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 -- 172.21.15.53:0/994957960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf40cd320 msgr2=0x7fccf40cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 --2- 172.21.15.53:0/994957960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf40cd320 0x7fccf40cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 -- 172.21.15.53:0/994957960 >> v2:172.21.15.87:3300/0 conn(0x7fccf4143e80 msgr2=0x7fccf406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 --2- 172.21.15.53:0/994957960 >> v2:172.21.15.87:3300/0 conn(0x7fccf4143e80 0x7fccf406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf1d9b640 1 -- 172.21.15.53:0/994957960 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40cb960 con 0x7fccf40caee0 2024-09-13T18:32:10.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.589+0000 7fccf2d9d640 1 --2- 172.21.15.53:0/994957960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf40cd320 0x7fccf40cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:10.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 --2- 172.21.15.53:0/994957960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40caee0 0x7fccf40cb350 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009870 tx=0x7fccdc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da76036189ec7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf159a640 1 -- 172.21.15.53:0/994957960 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0ab620 con 0x7fccf40caee0 2024-09-13T18:32:10.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf159a640 1 -- 172.21.15.53:0/994957960 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc0ab780 con 0x7fccf40caee0 2024-09-13T18:32:10.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf159a640 1 -- 172.21.15.53:0/994957960 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0abb10 con 0x7fccf40caee0 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- 172.21.15.53:0/994957960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40caee0 msgr2=0x7fccf40cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 --2- 172.21.15.53:0/994957960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40caee0 0x7fccf40cb350 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009870 tx=0x7fccdc01c460 comp rx=0 tx=0).stop 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- 172.21.15.53:0/994957960 shutdown_connections 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 --2- 172.21.15.53:0/994957960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf40cd320 0x7fccf40cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 --2- 172.21.15.53:0/994957960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40caee0 0x7fccf40cb350 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 --2- 172.21.15.53:0/994957960 >> v2:172.21.15.87:3300/0 conn(0x7fccf4143e80 0x7fccf406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- 172.21.15.53:0/994957960 >> 172.21.15.53:0/994957960 conn(0x7fccf4065c80 msgr2=0x7fccf4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:10.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- 172.21.15.53:0/994957960 shutdown_connections 2024-09-13T18:32:10.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- 172.21.15.53:0/994957960 wait complete. 2024-09-13T18:32:10.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 Processor -- start 2024-09-13T18:32:10.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- start start 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccf40caee0 0x7fccf4157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40cd320 0x7fccf41f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf4143e80 0x7fccf41f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4138580 con 0x7fccf40cd320 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf41583a0 con 0x7fccf40caee0 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf8f85640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4159f90 con 0x7fccf4143e80 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40cd320 0x7fccf41f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40cd320 0x7fccf41f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34526/0 (socket says 172.21.15.53:34526) 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 -- 172.21.15.53:0/2487401042 learned_addr learned my addr 172.21.15.53:0/2487401042 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf259c640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccf40caee0 0x7fccf4157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 -- 172.21.15.53:0/2487401042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf4143e80 msgr2=0x7fccf41f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf4143e80 0x7fccf41f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 -- 172.21.15.53:0/2487401042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccf40caee0 msgr2=0x7fccf4157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccf40caee0 0x7fccf4157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.593+0000 7fccf1d9b640 1 -- 172.21.15.53:0/2487401042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0094d0 con 0x7fccf40cd320 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fccf1d9b640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40cd320 0x7fccf41f4470 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fccdc01cd00 tx=0x7fccdc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fcceaffd640 1 -- 172.21.15.53:0/2487401042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0abe40 con 0x7fccf40cd320 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fcceaffd640 1 -- 172.21.15.53:0/2487401042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc0be3f0 con 0x7fccf40cd320 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf41571e0 con 0x7fccf40cd320 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fcceaffd640 1 -- 172.21.15.53:0/2487401042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0be7a0 con 0x7fccf40cd320 2024-09-13T18:32:10.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf415a530 con 0x7fccf40cd320 2024-09-13T18:32:10.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf40709e0 con 0x7fccf40cd320 2024-09-13T18:32:10.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fcceaffd640 1 -- 172.21.15.53:0/2487401042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fccdc0b43f0 con 0x7fccf40cd320 2024-09-13T18:32:10.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fcceaffd640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fccd4066a80 0x7fccd4068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fccf259c640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fccd4066a80 0x7fccd4068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fcceaffd640 1 -- 172.21.15.53:0/2487401042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fccdc11f0e0 con 0x7fccf40cd320 2024-09-13T18:32:10.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.597+0000 7fccf259c640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fccd4066a80 0x7fccd4068f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fccec007380 tx=0x7fccec00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.601+0000 7fcceaffd640 1 -- 172.21.15.53:0/2487401042 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fccdc0ebd20 con 0x7fccf40cd320 2024-09-13T18:32:10.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.793+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol97432", "target": ["mon-mgr", ""]}) v1 -- 0x7fccf40ce160 con 0x7fccd4066a80 2024-09-13T18:32:10.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fcceaffd640 1 -- 172.21.15.53:0/2487401042 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+144 (secure 0 0 0) 0x7fccec009c90 con 0x7fccd4066a80 2024-09-13T18:32:10.830 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:32:10.830 INFO:teuthology.orchestra.run.smithi053.stdout: "status": { 2024-09-13T18:32:10.830 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "pending", 2024-09-13T18:32:10.831 INFO:teuthology.orchestra.run.smithi053.stdout: "source": { 2024-09-13T18:32:10.831 INFO:teuthology.orchestra.run.smithi053.stdout: "volume": "fake", 2024-09-13T18:32:10.831 INFO:teuthology.orchestra.run.smithi053.stdout: "subvolume": "fake", 2024-09-13T18:32:10.831 INFO:teuthology.orchestra.run.smithi053.stdout: "snapshot": "fake" 2024-09-13T18:32:10.831 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:10.831 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:10.831 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fccd4066a80 msgr2=0x7fccd4068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fccd4066a80 0x7fccd4068f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fccec007380 tx=0x7fccec00b040 comp rx=0 tx=0).stop 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40cd320 msgr2=0x7fccf41f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40cd320 0x7fccf41f4470 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fccdc01cd00 tx=0x7fccdc01aca0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 shutdown_connections 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fccd4066a80 0x7fccd4068f40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccf4143e80 0x7fccf41f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccf40cd320 0x7fccf41f4470 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 --2- 172.21.15.53:0/2487401042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccf40caee0 0x7fccf4157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 >> 172.21.15.53:0/2487401042 conn(0x7fccf4065c80 msgr2=0x7fccf40b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:10.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 shutdown_connections 2024-09-13T18:32:10.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.829+0000 7fccf8f85640 1 -- 172.21.15.53:0/2487401042 wait complete. 2024-09-13T18:32:10.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol22330 fake 2024-09-13T18:32:10.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.961+0000 7fa17a90d640 1 Processor -- start 2024-09-13T18:32:10.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.961+0000 7fa17a90d640 1 -- start start 2024-09-13T18:32:10.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa17a90d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa17415c5e0 0x7fa17415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa17a90d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1740cc800 0x7fa1740ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa17a90d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa174070fb0 con 0x7fa17406ccc0 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa17a90d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17415dd30 con 0x7fa1740cc800 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa17a90d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa174070a10 con 0x7fa17415c5e0 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1740cc800 0x7fa1740ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1740cc800 0x7fa1740ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34540/0 (socket says 172.21.15.53:34540) 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 -- 172.21.15.53:0/3283074700 learned_addr learned my addr 172.21.15.53:0/3283074700 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa173fff640 1 --2- 172.21.15.53:0/3283074700 >> v2:172.21.15.87:3300/0 conn(0x7fa17415c5e0 0x7fa17415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 -- 172.21.15.53:0/3283074700 >> v2:172.21.15.87:3300/0 conn(0x7fa17415c5e0 msgr2=0x7fa17415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 --2- 172.21.15.53:0/3283074700 >> v2:172.21.15.87:3300/0 conn(0x7fa17415c5e0 0x7fa17415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 -- 172.21.15.53:0/3283074700 >> v1:172.21.15.87:6789/0 conn(0x7fa17406ccc0 legacy=0x7fa17406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:10.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 -- 172.21.15.53:0/3283074700 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740711e0 con 0x7fa1740cc800 2024-09-13T18:32:10.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa173fff640 1 --2- 172.21.15.53:0/3283074700 >> v2:172.21.15.87:3300/0 conn(0x7fa17415c5e0 0x7fa17415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:10.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa178eaa640 1 --2- 172.21.15.53:0/3283074700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1740cc800 0x7fa1740ccc90 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fa174066920 tx=0x7fa16c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f887188f78a2590b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa172ffd640 1 -- 172.21.15.53:0/3283074700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0ab650 con 0x7fa1740cc800 2024-09-13T18:32:10.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa172ffd640 1 -- 172.21.15.53:0/3283074700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c0ab7b0 con 0x7fa1740cc800 2024-09-13T18:32:10.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.965+0000 7fa172ffd640 1 -- 172.21.15.53:0/3283074700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0abb40 con 0x7fa1740cc800 2024-09-13T18:32:10.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- 172.21.15.53:0/3283074700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1740cc800 msgr2=0x7fa1740ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 --2- 172.21.15.53:0/3283074700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1740cc800 0x7fa1740ccc90 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fa174066920 tx=0x7fa16c01c4b0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- 172.21.15.53:0/3283074700 shutdown_connections 2024-09-13T18:32:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 --2- 172.21.15.53:0/3283074700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1740cc800 0x7fa1740ccc90 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 --2- 172.21.15.53:0/3283074700 >> v2:172.21.15.87:3300/0 conn(0x7fa17415c5e0 0x7fa17415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- 172.21.15.53:0/3283074700 >> 172.21.15.53:0/3283074700 conn(0x7fa174073330 msgr2=0x7fa174065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- 172.21.15.53:0/3283074700 shutdown_connections 2024-09-13T18:32:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- 172.21.15.53:0/3283074700 wait complete. 2024-09-13T18:32:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 Processor -- start 2024-09-13T18:32:10.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- start start 2024-09-13T18:32:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17406ccc0 0x7fa1741486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1740cc800 0x7fa1740ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa17415c5e0 0x7fa1740ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17414f170 con 0x7fa17415c5e0 2024-09-13T18:32:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741f8520 con 0x7fa1740cc800 2024-09-13T18:32:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa17a90d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741f8770 con 0x7fa17406ccc0 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa17415c5e0 0x7fa1740ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa17415c5e0 0x7fa1740ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34546/0 (socket says 172.21.15.53:34546) 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 -- 172.21.15.53:0/2469138523 learned_addr learned my addr 172.21.15.53:0/2469138523 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa1737fe640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1740cc800 0x7fa1740ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa173fff640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17406ccc0 0x7fa1741486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 -- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17406ccc0 msgr2=0x7fa1741486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17406ccc0 0x7fa1741486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 -- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1740cc800 msgr2=0x7fa1740ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1740cc800 0x7fa1740ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.969+0000 7fa178eaa640 1 -- 172.21.15.53:0/2469138523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0094d0 con 0x7fa17415c5e0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa178eaa640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa17415c5e0 0x7fa1740ace20 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa16c01a0e0 tx=0x7fa16c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa170ff9640 1 -- 172.21.15.53:0/2469138523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0b4800 con 0x7fa17415c5e0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa170ff9640 1 -- 172.21.15.53:0/2469138523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c0b4960 con 0x7fa17415c5e0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa170ff9640 1 -- 172.21.15.53:0/2469138523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0b4d10 con 0x7fa17415c5e0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1741f8a50 con 0x7fa17415c5e0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1741f9010 con 0x7fa17415c5e0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1741f4fa0 con 0x7fa17415c5e0 2024-09-13T18:32:10.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa170ff9640 1 -- 172.21.15.53:0/2469138523 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa16c0b3380 con 0x7fa17415c5e0 2024-09-13T18:32:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa170ff9640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa160066a80 0x7fa160068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa170ff9640 1 -- 172.21.15.53:0/2469138523 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa16c11f1f0 con 0x7fa17415c5e0 2024-09-13T18:32:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa173fff640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa160066a80 0x7fa160068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:10.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.973+0000 7fa173fff640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa160066a80 0x7fa160068f40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa164007510 tx=0x7fa1640074a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:10.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:10.977+0000 7fa170ff9640 1 -- 172.21.15.53:0/2469138523 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1741f4fa0 con 0x7fa17415c5e0 2024-09-13T18:32:11.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.161+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol22330", "snap_name": "fake", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1740b1490 con 0x7fa160066a80 2024-09-13T18:32:11.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa170ff9640 1 -- 172.21.15.53:0/2469138523 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa164013070 con 0x7fa160066a80 2024-09-13T18:32:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa160066a80 msgr2=0x7fa160068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa160066a80 0x7fa160068f40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa164007510 tx=0x7fa1640074a0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa17415c5e0 msgr2=0x7fa1740ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa17415c5e0 0x7fa1740ace20 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa16c01a0e0 tx=0x7fa16c01acf0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 shutdown_connections 2024-09-13T18:32:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa160066a80 0x7fa160068f40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa17415c5e0 0x7fa1740ace20 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1740cc800 0x7fa1740ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 --2- 172.21.15.53:0/2469138523 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa17406ccc0 0x7fa1741486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 >> 172.21.15.53:0/2469138523 conn(0x7fa174073330 msgr2=0x7fa1741524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 shutdown_connections 2024-09-13T18:32:11.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.217+0000 7fa17a90d640 1 -- 172.21.15.53:0/2469138523 wait complete. 2024-09-13T18:32:11.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol63631 fake subvol_grp73420 2024-09-13T18:32:11.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488d054640 1 Processor -- start 2024-09-13T18:32:11.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488d054640 1 -- start start 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488d054640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4888158ba0 0x7f48880cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488d054640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f488806ff40 0x7f4888070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488d054640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48880b3830 con 0x7f48880b1dd0 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488d054640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488806c530 con 0x7f4888158ba0 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488d054640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488806bc20 con 0x7f488806ff40 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f4886d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4888158ba0 0x7f48880cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f4886d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4888158ba0 0x7f48880cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34562/0 (socket says 172.21.15.53:34562) 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f4886d9d640 1 -- 172.21.15.53:0/1695939151 learned_addr learned my addr 172.21.15.53:0/1695939151 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488759e640 1 --2- 172.21.15.53:0/1695939151 >> v2:172.21.15.87:3300/0 conn(0x7f488806ff40 0x7f4888070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f4886d9d640 1 -- 172.21.15.53:0/1695939151 >> v2:172.21.15.87:3300/0 conn(0x7f488806ff40 msgr2=0x7f4888070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f4886d9d640 1 --2- 172.21.15.53:0/1695939151 >> v2:172.21.15.87:3300/0 conn(0x7f488806ff40 0x7f4888070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f4886d9d640 1 -- 172.21.15.53:0/1695939151 >> v1:172.21.15.87:6789/0 conn(0x7f48880b1dd0 legacy=0x7f48880b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f4886d9d640 1 -- 172.21.15.53:0/1695939151 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888070890 con 0x7f4888158ba0 2024-09-13T18:32:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.369+0000 7f488759e640 1 --2- 172.21.15.53:0/1695939151 >> v2:172.21.15.87:3300/0 conn(0x7f488806ff40 0x7f4888070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f4886d9d640 1 --2- 172.21.15.53:0/1695939151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f48880cb9d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f488806fed0 tx=0x7f487801ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dd94a3b32062c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f4885d9b640 1 -- 172.21.15.53:0/1695939151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780a79d0 con 0x7f4888158ba0 2024-09-13T18:32:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f4885d9b640 1 -- 172.21.15.53:0/1695939151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48780a7b30 con 0x7f4888158ba0 2024-09-13T18:32:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f4885d9b640 1 -- 172.21.15.53:0/1695939151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780af440 con 0x7f4888158ba0 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- 172.21.15.53:0/1695939151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 msgr2=0x7f48880cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 --2- 172.21.15.53:0/1695939151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f48880cb9d0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f488806fed0 tx=0x7f487801ea90 comp rx=0 tx=0).stop 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- 172.21.15.53:0/1695939151 shutdown_connections 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 --2- 172.21.15.53:0/1695939151 >> v2:172.21.15.87:3300/0 conn(0x7f488806ff40 0x7f4888070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 --2- 172.21.15.53:0/1695939151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f48880cb9d0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- 172.21.15.53:0/1695939151 >> 172.21.15.53:0/1695939151 conn(0x7f4888065c80 msgr2=0x7f4888066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- 172.21.15.53:0/1695939151 shutdown_connections 2024-09-13T18:32:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- 172.21.15.53:0/1695939151 wait complete. 2024-09-13T18:32:11.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 Processor -- start 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- start start 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488806ff40 0x7f4888155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48880b1dd0 0x7f48880ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f4888145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48880ae5b0 con 0x7f4888158ba0 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881455b0 con 0x7f48880b1dd0 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488d054640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48880ae7e0 con 0x7f488806ff40 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f4888145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f4888145070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34574/0 (socket says 172.21.15.53:34574) 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 -- 172.21.15.53:0/2321202578 learned_addr learned my addr 172.21.15.53:0/2321202578 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488659c640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48880b1dd0 0x7f48880ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f4886d9d640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488806ff40 0x7f4888155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 -- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488806ff40 msgr2=0x7f4888155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488806ff40 0x7f4888155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 -- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48880b1dd0 msgr2=0x7f48880ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48880b1dd0 0x7f48880ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 -- 172.21.15.53:0/2321202578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487800b770 con 0x7f4888158ba0 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488659c640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48880b1dd0 0x7f48880ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f4886d9d640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488806ff40 0x7f4888155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f488759e640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f4888145070 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f488000c7f0 tx=0x7f488000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.373+0000 7f486f7fe640 1 -- 172.21.15.53:0/2321202578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880007820 con 0x7f4888158ba0 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f486f7fe640 1 -- 172.21.15.53:0/2321202578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800079c0 con 0x7f4888158ba0 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48880aeac0 con 0x7f4888158ba0 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f486f7fe640 1 -- 172.21.15.53:0/2321202578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880007d70 con 0x7f4888158ba0 2024-09-13T18:32:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48880af080 con 0x7f4888158ba0 2024-09-13T18:32:11.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4888070350 con 0x7f4888158ba0 2024-09-13T18:32:11.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f486f7fe640 1 -- 172.21.15.53:0/2321202578 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f48800113f0 con 0x7f4888158ba0 2024-09-13T18:32:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f486f7fe640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4874066a80 0x7f4874068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f486f7fe640 1 -- 172.21.15.53:0/2321202578 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4880084da0 con 0x7f4888158ba0 2024-09-13T18:32:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f4886d9d640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4874066a80 0x7f4874068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.377+0000 7f4886d9d640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4874066a80 0x7f4874068f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48780b1000 tx=0x7f4878008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:11.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.381+0000 7f486f7fe640 1 -- 172.21.15.53:0/2321202578 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48800517d0 con 0x7f4888158ba0 2024-09-13T18:32:11.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.565+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol63631", "snap_name": "fake", "group_name": "subvol_grp73420", "target": ["mon-mgr", ""]}) v1 -- 0x7f48880ade50 con 0x7f4874066a80 2024-09-13T18:32:11.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.609+0000 7f486f7fe640 1 -- 172.21.15.53:0/2321202578 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f48880ade50 con 0x7f4874066a80 2024-09-13T18:32:11.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4874066a80 msgr2=0x7f4874068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4874066a80 0x7f4874068f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48780b1000 tx=0x7f4878008040 comp rx=0 tx=0).stop 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 msgr2=0x7f4888145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f4888145070 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f488000c7f0 tx=0x7f488000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 shutdown_connections 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4874066a80 0x7f4874068f40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4888158ba0 0x7f4888145070 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48880b1dd0 0x7f48880ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 --2- 172.21.15.53:0/2321202578 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488806ff40 0x7f4888155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 >> 172.21.15.53:0/2321202578 conn(0x7f4888065c80 msgr2=0x7f488815a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 shutdown_connections 2024-09-13T18:32:11.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.613+0000 7f488d054640 1 -- 172.21.15.53:0/2321202578 wait complete. 2024-09-13T18:32:11.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:11.632 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol22330/.meta) 2024-09-13T18:32:11.648 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:32:11.648 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:32:11.648 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:32:11.648 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol22330/54ac3c9b-4815-46e4-bbdb-cdd750a579ed 2024-09-13T18:32:11.648 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:32:11.648 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:11.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:11.649 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp73420/subvol63631/.meta) 2024-09-13T18:32:11.712 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:32:11.712 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:32:11.713 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:32:11.713 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/subvol_grp73420/subvol63631/d5090046-d77e-4a87-98c1-7133c6f7016b 2024-09-13T18:32:11.713 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:32:11.713 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:11.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol22330 2024-09-13T18:32:11.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb621439640 1 Processor -- start 2024-09-13T18:32:11.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb621439640 1 -- start start 2024-09-13T18:32:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb621439640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb61c15c830 0x7fb61c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb621439640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0ccd10 0x7fb61c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb621439640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61c0b7db0 con 0x7fb61c0d2c80 2024-09-13T18:32:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb621439640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61c0d0650 con 0x7fb61c15c830 2024-09-13T18:32:11.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb621439640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0d0c10 con 0x7fb61c0ccd10 2024-09-13T18:32:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61a7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0ccd10 0x7fb61c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb61c15c830 0x7fb61c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61a7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0ccd10 0x7fb61c0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:60926/0 (socket says 172.21.15.53:60926) 2024-09-13T18:32:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61a7fc640 1 -- 172.21.15.53:0/2479266257 learned_addr learned my addr 172.21.15.53:0/2479266257 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61a7fc640 1 -- 172.21.15.53:0/2479266257 >> v2:172.21.15.87:3300/0 conn(0x7fb61c15c830 msgr2=0x7fb61c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61a7fc640 1 --2- 172.21.15.53:0/2479266257 >> v2:172.21.15.87:3300/0 conn(0x7fb61c15c830 0x7fb61c0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61a7fc640 1 -- 172.21.15.53:0/2479266257 >> v1:172.21.15.87:6789/0 conn(0x7fb61c0d2c80 legacy=0x7fb61c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61a7fc640 1 -- 172.21.15.53:0/2479266257 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0cd7d0 con 0x7fb61c0ccd10 2024-09-13T18:32:11.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.889+0000 7fb61affd640 1 --2- 172.21.15.53:0/2479266257 >> v2:172.21.15.87:3300/0 conn(0x7fb61c15c830 0x7fb61c0d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb61a7fc640 1 --2- 172.21.15.53:0/2479266257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0ccd10 0x7fb61c0cd150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb604009870 tx=0x7fb60401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4b05bfa7a30247 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb619ffb640 1 -- 172.21.15.53:0/2479266257 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040ad660 con 0x7fb61c0ccd10 2024-09-13T18:32:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb619ffb640 1 -- 172.21.15.53:0/2479266257 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6040ad7c0 con 0x7fb61c0ccd10 2024-09-13T18:32:11.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb619ffb640 1 -- 172.21.15.53:0/2479266257 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040adb50 con 0x7fb61c0ccd10 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 -- 172.21.15.53:0/2479266257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0ccd10 msgr2=0x7fb61c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 --2- 172.21.15.53:0/2479266257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0ccd10 0x7fb61c0cd150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb604009870 tx=0x7fb60401c560 comp rx=0 tx=0).stop 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 -- 172.21.15.53:0/2479266257 shutdown_connections 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 --2- 172.21.15.53:0/2479266257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0ccd10 0x7fb61c0cd150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 --2- 172.21.15.53:0/2479266257 >> v2:172.21.15.87:3300/0 conn(0x7fb61c15c830 0x7fb61c0d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 -- 172.21.15.53:0/2479266257 >> 172.21.15.53:0/2479266257 conn(0x7fb61c070970 msgr2=0x7fb61c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 -- 172.21.15.53:0/2479266257 shutdown_connections 2024-09-13T18:32:11.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 -- 172.21.15.53:0/2479266257 wait complete. 2024-09-13T18:32:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.893+0000 7fb621439640 1 Processor -- start 2024-09-13T18:32:11.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 -- start start 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb61c0ccd10 0x7fb61c15dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0d2c80 0x7fb61c15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb61c15c830 0x7fb61c15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c15e650 con 0x7fb61c0ccd10 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c1f5ba0 con 0x7fb61c15c830 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c1f5e20 con 0x7fb61c0d2c80 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb61c0ccd10 0x7fb61c15dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb61c0ccd10 0x7fb61c15dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34586/0 (socket says 172.21.15.53:34586) 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 -- 172.21.15.53:0/1483180075 learned_addr learned my addr 172.21.15.53:0/1483180075 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61a7fc640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0d2c80 0x7fb61c15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61b7fe640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb61c15c830 0x7fb61c15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 -- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0d2c80 msgr2=0x7fb61c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0d2c80 0x7fb61c15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 -- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb61c15c830 msgr2=0x7fb61c15ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb61c15c830 0x7fb61c15ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 -- 172.21.15.53:0/1483180075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009420 con 0x7fb61c0ccd10 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61b7fe640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb61c15c830 0x7fb61c15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb61affd640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb61c0ccd10 0x7fb61c15dc00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00ebe0 tx=0x7fb60c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00eee0 con 0x7fb61c0ccd10 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c00cc30 con 0x7fb61c0ccd10 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6040094d0 con 0x7fb61c0ccd10 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c013470 con 0x7fb61c0ccd10 2024-09-13T18:32:11.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c1f63e0 con 0x7fb61c0ccd10 2024-09-13T18:32:11.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c0d1080 con 0x7fb61c0ccd10 2024-09-13T18:32:11.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.897+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb60c0135d0 con 0x7fb61c0ccd10 2024-09-13T18:32:11.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.901+0000 7fb6137fe640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb5fc066a80 0x7fb5fc068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:11.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.901+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb60c084b90 con 0x7fb61c0ccd10 2024-09-13T18:32:11.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.901+0000 7fb61a7fc640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb5fc066a80 0x7fb5fc068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:11.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.901+0000 7fb61a7fc640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb5fc066a80 0x7fb5fc068f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6040af000 tx=0x7fb6040a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:11.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:11.905+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb60c0519e0 con 0x7fb61c0ccd10 2024-09-13T18:32:12.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.085+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol22330", "target": ["mon-mgr", ""]}) v1 -- 0x7fb61c0d1590 con 0x7fb5fc066a80 2024-09-13T18:32:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.141+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 20) v1 ==== 86500+0+0 (secure 0 0 0) 0x7fb60c051db0 con 0x7fb61c0ccd10 2024-09-13T18:32:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.189+0000 7fb6137fe640 1 -- 172.21.15.53:0/1483180075 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb61c0d1590 con 0x7fb5fc066a80 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb5fc066a80 msgr2=0x7fb5fc068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb5fc066a80 0x7fb5fc068f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6040af000 tx=0x7fb6040a7000 comp rx=0 tx=0).stop 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb61c0ccd10 msgr2=0x7fb61c15dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb61c0ccd10 0x7fb61c15dc00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00ebe0 tx=0x7fb60c00c520 comp rx=0 tx=0).stop 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 shutdown_connections 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb5fc066a80 0x7fb5fc068f40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb61c0d2c80 0x7fb61c15b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb61c15c830 0x7fb61c15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 --2- 172.21.15.53:0/1483180075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb61c0ccd10 0x7fb61c15dc00 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 >> 172.21.15.53:0/1483180075 conn(0x7fb61c070970 msgr2=0x7fb61c070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 shutdown_connections 2024-09-13T18:32:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.193+0000 7fb621439640 1 -- 172.21.15.53:0/1483180075 wait complete. 2024-09-13T18:32:12.200 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.197+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.200 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.197+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.200 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.197+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.200 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.197+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.200 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.197+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.215 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.213+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.215 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.213+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.215 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.213+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.215 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.213+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.215 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.213+0000 7f26196b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:12.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol63631 subvol_grp73420 2024-09-13T18:32:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3bcab3640 1 Processor -- start 2024-09-13T18:32:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3bcab3640 1 -- start start 2024-09-13T18:32:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3bcab3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3b80cdad0 0x7fd3b8143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3bcab3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b806b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3bcab3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80b1ba0 con 0x7fd3b80cd6f0 2024-09-13T18:32:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3bcab3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80b3020 con 0x7fd3b80cdad0 2024-09-13T18:32:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3bcab3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80b1f80 con 0x7fd3b8143d50 2024-09-13T18:32:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b806b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b5d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3b80cdad0 0x7fd3b8143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b6d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b806b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:60974/0 (socket says 172.21.15.53:60974) 2024-09-13T18:32:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b659c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd3b80cd6f0 0x7fd3b80b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:53442/0 (socket says 172.21.15.53:53442) 2024-09-13T18:32:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b6d9d640 1 -- 172.21.15.53:0/929682798 learned_addr learned my addr 172.21.15.53:0/929682798 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b5d9b640 1 -- 172.21.15.53:0/929682798 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 msgr2=0x7fd3b806b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:12.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b5d9b640 1 --2- 172.21.15.53:0/929682798 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b806b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b5d9b640 1 -- 172.21.15.53:0/929682798 >> v1:172.21.15.87:6789/0 conn(0x7fd3b80cd6f0 legacy=0x7fd3b80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.349+0000 7fd3b5d9b640 1 -- 172.21.15.53:0/929682798 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80b2260 con 0x7fd3b80cdad0 2024-09-13T18:32:12.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3b5d9b640 1 --2- 172.21.15.53:0/929682798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cdad0 0x7fd3b8143810 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0097c0 tx=0x7fd3ac01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d2ec69bff39e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:12.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3b559a640 1 -- 172.21.15.53:0/929682798 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0ab670 con 0x7fd3b80cdad0 2024-09-13T18:32:12.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3b559a640 1 -- 172.21.15.53:0/929682798 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0ab7d0 con 0x7fd3b80cdad0 2024-09-13T18:32:12.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3b559a640 1 -- 172.21.15.53:0/929682798 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0abb60 con 0x7fd3b80cdad0 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 -- 172.21.15.53:0/929682798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cdad0 msgr2=0x7fd3b8143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/929682798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cdad0 0x7fd3b8143810 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0097c0 tx=0x7fd3ac01c470 comp rx=0 tx=0).stop 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 -- 172.21.15.53:0/929682798 shutdown_connections 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/929682798 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b806b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/929682798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cdad0 0x7fd3b8143810 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 -- 172.21.15.53:0/929682798 >> 172.21.15.53:0/929682798 conn(0x7fd3b8073330 msgr2=0x7fd3b8065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 -- 172.21.15.53:0/929682798 shutdown_connections 2024-09-13T18:32:12.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 -- 172.21.15.53:0/929682798 wait complete. 2024-09-13T18:32:12.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 Processor -- start 2024-09-13T18:32:12.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.353+0000 7fd3bcab3640 1 -- start start 2024-09-13T18:32:12.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cd6f0 0x7fd3b80ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3b80cdad0 0x7fd3b80ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b813dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80ab180 con 0x7fd3b80cdad0 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b81646a0 con 0x7fd3b80cd6f0 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b81643c0 con 0x7fd3b8143d50 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3b80cdad0 0x7fd3b80ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3b80cdad0 0x7fd3b80ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34632/0 (socket says 172.21.15.53:34632) 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 -- 172.21.15.53:0/3887614235 learned_addr learned my addr 172.21.15.53:0/3887614235 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b659c640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cd6f0 0x7fd3b80ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b6d9d640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b813dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 -- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 msgr2=0x7fd3b813dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b813dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 -- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cd6f0 msgr2=0x7fd3b80ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cd6f0 0x7fd3b80ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 -- 172.21.15.53:0/3887614235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009420 con 0x7fd3b80cdad0 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3b5d9b640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3b80cdad0 0x7fd3b80ac4b0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0ad040 tx=0x7fd3ac01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3a6ffd640 1 -- 172.21.15.53:0/3887614235 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0b5810 con 0x7fd3b80cdad0 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b81404e0 con 0x7fd3b80cdad0 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3a6ffd640 1 -- 172.21.15.53:0/3887614235 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0b5970 con 0x7fd3b80cdad0 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3a6ffd640 1 -- 172.21.15.53:0/3887614235 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0b5d00 con 0x7fd3b80cdad0 2024-09-13T18:32:12.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b80ac9f0 con 0x7fd3b80cdad0 2024-09-13T18:32:12.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b80ab330 con 0x7fd3b80cdad0 2024-09-13T18:32:12.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.357+0000 7fd3a6ffd640 1 -- 172.21.15.53:0/3887614235 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) v1 ==== 86500+0+0 (secure 0 0 0) 0x7fd3ac0ca430 con 0x7fd3b80cdad0 2024-09-13T18:32:12.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.361+0000 7fd3a6ffd640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd398066b10 0x7fd398068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.361+0000 7fd3a6ffd640 1 -- 172.21.15.53:0/3887614235 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fd3ac11f820 con 0x7fd3b80cdad0 2024-09-13T18:32:12.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.361+0000 7fd3b659c640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd398066b10 0x7fd398068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.361+0000 7fd3b659c640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd398066b10 0x7fd398068fd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8000f70 tx=0x7fd3a8007e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:12.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.361+0000 7fd3a6ffd640 1 -- 172.21.15.53:0/3887614235 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3ac0ec6e0 con 0x7fd3b80cdad0 2024-09-13T18:32:12.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.541+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol63631", "group_name": "subvol_grp73420", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3b8144160 con 0x7fd398066b10 2024-09-13T18:32:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.605+0000 7fd3a6ffd640 1 -- 172.21.15.53:0/3887614235 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd3a80072c0 con 0x7fd398066b10 2024-09-13T18:32:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd398066b10 msgr2=0x7fd398068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd398066b10 0x7fd398068fd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8000f70 tx=0x7fd3a8007e30 comp rx=0 tx=0).stop 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3b80cdad0 msgr2=0x7fd3b80ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3b80cdad0 0x7fd3b80ac4b0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0ad040 tx=0x7fd3ac01acb0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 shutdown_connections 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd398066b10 0x7fd398068fd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3b8143d50 0x7fd3b813dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3b80cdad0 0x7fd3b80ac4b0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 --2- 172.21.15.53:0/3887614235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3b80cd6f0 0x7fd3b80ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 >> 172.21.15.53:0/3887614235 conn(0x7fd3b8073330 msgr2=0x7fd3b80a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 shutdown_connections 2024-09-13T18:32:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.609+0000 7fd3bcab3640 1 -- 172.21.15.53:0/3887614235 wait complete. 2024-09-13T18:32:12.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol97432 2024-09-13T18:32:12.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.749+0000 7ff9c6fde640 1 Processor -- start 2024-09-13T18:32:12.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.749+0000 7ff9c6fde640 1 -- start start 2024-09-13T18:32:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9c00caee0 0x7ff9c00cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c006f7a0 con 0x7ff9c00cd320 2024-09-13T18:32:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c006fd60 con 0x7ff9c00caee0 2024-09-13T18:32:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00cb960 con 0x7ff9c0143e80 2024-09-13T18:32:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9c00caee0 0x7ff9c00cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c557b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff9c00cd320 0x7ff9c00cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50978/0 (socket says 172.21.15.53:50978) 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff9c00caee0 0x7ff9c00cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34636/0 (socket says 172.21.15.53:34636) 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c557b640 1 -- 172.21.15.53:0/603959635 learned_addr learned my addr 172.21.15.53:0/603959635 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c4d7a640 1 --2- 172.21.15.53:0/603959635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bffff640 1 -- 172.21.15.53:0/603959635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 msgr2=0x7ff9c006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bffff640 1 --2- 172.21.15.53:0/603959635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bffff640 1 -- 172.21.15.53:0/603959635 >> v1:172.21.15.53:6789/0 conn(0x7ff9c00cd320 legacy=0x7ff9c00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bffff640 1 -- 172.21.15.53:0/603959635 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00cbc40 con 0x7ff9c00caee0 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bf7fe640 1 -- 172.21.15.53:0/603959635 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993035471 0 0) 0x7ff9c006f7a0 con 0x7ff9c00cd320 2024-09-13T18:32:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c4d7a640 1 --2- 172.21.15.53:0/603959635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bffff640 1 --2- 172.21.15.53:0/603959635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 0x7ff9c00cb320 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00097c0 tx=0x7ff9b001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33c35d2bef59f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bf7fe640 1 -- 172.21.15.53:0/603959635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00ac620 con 0x7ff9c00caee0 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bf7fe640 1 -- 172.21.15.53:0/603959635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b00ac780 con 0x7ff9c00caee0 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9bf7fe640 1 -- 172.21.15.53:0/603959635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00acb10 con 0x7ff9c00caee0 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- 172.21.15.53:0/603959635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 msgr2=0x7ff9c00cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 --2- 172.21.15.53:0/603959635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 0x7ff9c00cb320 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00097c0 tx=0x7ff9b001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- 172.21.15.53:0/603959635 shutdown_connections 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 --2- 172.21.15.53:0/603959635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 0x7ff9c00cb320 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 --2- 172.21.15.53:0/603959635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- 172.21.15.53:0/603959635 >> 172.21.15.53:0/603959635 conn(0x7ff9c0065c80 msgr2=0x7ff9c0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- 172.21.15.53:0/603959635 shutdown_connections 2024-09-13T18:32:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.753+0000 7ff9c6fde640 1 -- 172.21.15.53:0/603959635 wait complete. 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 Processor -- start 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 -- start start 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 0x7ff9c00af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c00cd320 0x7ff9c015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c01426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0159ab0 con 0x7ff9c00caee0 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00afd30 con 0x7ff9c00cd320 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00b0010 con 0x7ff9c0143e80 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 0x7ff9c00af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 0x7ff9c00af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34646/0 (socket says 172.21.15.53:34646) 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 -- 172.21.15.53:0/1758666823 learned_addr learned my addr 172.21.15.53:0/1758666823 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c557b640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c01426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9bffff640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c00cd320 0x7ff9c015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 -- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 msgr2=0x7ff9c01426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c01426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 -- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c00cd320 msgr2=0x7ff9c015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c00cd320 0x7ff9c015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 -- 172.21.15.53:0/1758666823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0009420 con 0x7ff9c00caee0 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c557b640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9c0143e80 0x7ff9c01426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9bffff640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c00cd320 0x7ff9c015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c4d7a640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9c00caee0 0x7ff9c00af450 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c7f0 tx=0x7ff9a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9bd7fa640 1 -- 172.21.15.53:0/1758666823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8007820 con 0x7ff9c00caee0 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9bd7fa640 1 -- 172.21.15.53:0/1758666823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8007980 con 0x7ff9c00caee0 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 -- 172.21.15.53:0/1758666823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c0159740 con 0x7ff9c00caee0 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9bd7fa640 1 -- 172.21.15.53:0/1758666823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8007d30 con 0x7ff9c00caee0 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 -- 172.21.15.53:0/1758666823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c01f4b00 con 0x7ff9c00caee0 2024-09-13T18:32:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.757+0000 7ff9c6fde640 1 -- 172.21.15.53:0/1758666823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c01595a0 con 0x7ff9c00caee0 2024-09-13T18:32:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.761+0000 7ff9bd7fa640 1 -- 172.21.15.53:0/1758666823 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) v1 ==== 86500+0+0 (secure 0 0 0) 0x7ff9a80113f0 con 0x7ff9c00caee0 2024-09-13T18:32:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.761+0000 7ff9bd7fa640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9a0066b10 0x7ff9a0068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.761+0000 7ff9bd7fa640 1 -- 172.21.15.53:0/1758666823 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7ff9a8084ec0 con 0x7ff9c00caee0 2024-09-13T18:32:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.761+0000 7ff9bffff640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9a0066b10 0x7ff9a0068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:12.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.761+0000 7ff9bffff640 1 --2- 172.21.15.53:0/1758666823 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff9a0066b10 0x7ff9a0068fd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00ae000 tx=0x7ff9b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:12.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.765+0000 7ff9bd7fa640 1 -- 172.21.15.53:0/1758666823 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff9c01595a0 con 0x7ff9c00caee0 2024-09-13T18:32:12.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.941+0000 7ff9c6fde640 1 -- 172.21.15.53:0/1758666823 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol97432", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9c00709e0 con 0x7ff9a0066b10 2024-09-13T18:32:12.955 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:12.953+0000 7f2616ead640 -1 mgr.server reply reply (11) Resource temporarily unavailable subvolume 'subvol97432' is not ready for operation rm (use --force to override) 2024-09-13T18:32:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:12.953+0000 7ff9bd7fa640 1 -- 172.21.15.53:0/1758666823 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -11 subvolume 'subvol97432' is not ready for operation rm (use --force to override)) v1 ==== 87+0+0 (secure 0 0 0) 0x7ff9b00ac8f0 con 0x7ff9a0066b10 2024-09-13T18:32:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:Error EAGAIN: subvolume 'subvol97432' is not ready for operation rm (use --force to override) 2024-09-13T18:32:12.960 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-09-13T18:32:12.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:12.960 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol97432/.meta) 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:type = clone 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol97432/0b0f1031-1ede-4df6-976d-111804fb8cce 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:state = pending 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:[source] 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:volume = fake 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:subvolume = fake 2024-09-13T18:32:12.977 INFO:teuthology.orchestra.run.smithi053.stdout:snapshot = fake 2024-09-13T18:32:12.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol97432 --force 2024-09-13T18:32:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f97773640 1 Processor -- start 2024-09-13T18:32:13.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f97773640 1 -- start start 2024-09-13T18:32:13.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f97773640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f900cdad0 0x7f3f90143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f97773640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3f90143d50 0x7f3f9006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f97773640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f900b1ba0 con 0x7f3f900cd6f0 2024-09-13T18:32:13.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f97773640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f900b3020 con 0x7f3f900cdad0 2024-09-13T18:32:13.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f97773640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f900b1f80 con 0x7f3f90143d50 2024-09-13T18:32:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f9550f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3f900cd6f0 0x7f3f900b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50988/0 (socket says 172.21.15.53:50988) 2024-09-13T18:32:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f9550f640 1 -- 172.21.15.53:0/1473737242 learned_addr learned my addr 172.21.15.53:0/1473737242 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f94d0e640 1 --2- 172.21.15.53:0/1473737242 >> v2:172.21.15.53:3300/0 conn(0x7f3f900cdad0 0x7f3f90143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f95d10640 1 --2- 172.21.15.53:0/1473737242 >> v2:172.21.15.87:3300/0 conn(0x7f3f90143d50 0x7f3f9006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f87fff640 1 -- 172.21.15.53:0/1473737242 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439766203 0 0) 0x7f3f900b1ba0 con 0x7f3f900cd6f0 2024-09-13T18:32:13.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f87fff640 1 -- 172.21.15.53:0/1473737242 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f7c003530 con 0x7f3f900cd6f0 2024-09-13T18:32:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f94d0e640 1 -- 172.21.15.53:0/1473737242 >> v2:172.21.15.87:3300/0 conn(0x7f3f90143d50 msgr2=0x7f3f9006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f94d0e640 1 --2- 172.21.15.53:0/1473737242 >> v2:172.21.15.87:3300/0 conn(0x7f3f90143d50 0x7f3f9006b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f94d0e640 1 -- 172.21.15.53:0/1473737242 >> v1:172.21.15.53:6789/0 conn(0x7f3f900cd6f0 legacy=0x7f3f900b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f94d0e640 1 -- 172.21.15.53:0/1473737242 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900b2260 con 0x7f3f900cdad0 2024-09-13T18:32:13.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.149+0000 7f3f95d10640 1 --2- 172.21.15.53:0/1473737242 >> v2:172.21.15.87:3300/0 conn(0x7f3f90143d50 0x7f3f9006b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.153+0000 7f3f94d0e640 1 --2- 172.21.15.53:0/1473737242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f90143810 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f3f9015de40 tx=0x7f3f8001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6dc7f0cf0dd728 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.153+0000 7f3f87fff640 1 -- 172.21.15.53:0/1473737242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800ab650 con 0x7f3f900cdad0 2024-09-13T18:32:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.153+0000 7f3f87fff640 1 -- 172.21.15.53:0/1473737242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f800ab7b0 con 0x7f3f900cdad0 2024-09-13T18:32:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.153+0000 7f3f87fff640 1 -- 172.21.15.53:0/1473737242 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800abb40 con 0x7f3f900cdad0 2024-09-13T18:32:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- 172.21.15.53:0/1473737242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 msgr2=0x7f3f90143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 --2- 172.21.15.53:0/1473737242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f90143810 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f3f9015de40 tx=0x7f3f8001c450 comp rx=0 tx=0).stop 2024-09-13T18:32:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- 172.21.15.53:0/1473737242 shutdown_connections 2024-09-13T18:32:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 --2- 172.21.15.53:0/1473737242 >> v2:172.21.15.87:3300/0 conn(0x7f3f90143d50 0x7f3f9006b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 --2- 172.21.15.53:0/1473737242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f90143810 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- 172.21.15.53:0/1473737242 >> 172.21.15.53:0/1473737242 conn(0x7f3f90073330 msgr2=0x7f3f90065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- 172.21.15.53:0/1473737242 shutdown_connections 2024-09-13T18:32:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- 172.21.15.53:0/1473737242 wait complete. 2024-09-13T18:32:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 Processor -- start 2024-09-13T18:32:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- start start 2024-09-13T18:32:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f900cd6f0 0x7f3f900ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f9015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f90143d50 0x7f3f900affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90159190 con 0x7f3f900cdad0 2024-09-13T18:32:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90159470 con 0x7f3f900cd6f0 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90159750 con 0x7f3f90143d50 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f9015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f9015a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34656/0 (socket says 172.21.15.53:34656) 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 -- 172.21.15.53:0/2775108593 learned_addr learned my addr 172.21.15.53:0/2775108593 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f9550f640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f900cd6f0 0x7f3f900ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f95d10640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f90143d50 0x7f3f900affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 -- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f90143d50 msgr2=0x7f3f900affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f90143d50 0x7f3f900affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 -- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f900cd6f0 msgr2=0x7f3f900ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f900cd6f0 0x7f3f900ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 -- 172.21.15.53:0/2775108593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f80009420 con 0x7f3f900cdad0 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f94d0e640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f9015a230 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3f800ad040 tx=0x7f3f8001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f85ffb640 1 -- 172.21.15.53:0/2775108593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800bf610 con 0x7f3f900cdad0 2024-09-13T18:32:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f85ffb640 1 -- 172.21.15.53:0/2775108593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f800bf770 con 0x7f3f900cdad0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f85ffb640 1 -- 172.21.15.53:0/2775108593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800bfb00 con 0x7f3f900cdad0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f90159a30 con 0x7f3f900cdad0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.157+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f900b04e0 con 0x7f3f900cdad0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.161+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f90143810 con 0x7f3f900cdad0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.161+0000 7f3f85ffb640 1 -- 172.21.15.53:0/2775108593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) v1 ==== 86500+0+0 (secure 0 0 0) 0x7f3f800b5400 con 0x7f3f900cdad0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.161+0000 7f3f85ffb640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f74066b10 0x7f3f74068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.161+0000 7f3f85ffb640 1 -- 172.21.15.53:0/2775108593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f3f8011f5d0 con 0x7f3f900cdad0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.161+0000 7f3f9550f640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f74066b10 0x7f3f74068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.161+0000 7f3f9550f640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f74066b10 0x7f3f74068fd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0011f0 tx=0x7f3f8c007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.165+0000 7f3f85ffb640 1 -- 172.21.15.53:0/2775108593 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f800ec280 con 0x7f3f900cdad0 2024-09-13T18:32:13.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.341+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol97432", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3f901595e0 con 0x7f3f74066b10 2024-09-13T18:32:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f85ffb640 1 -- 172.21.15.53:0/2775108593 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3f901595e0 con 0x7f3f74066b10 2024-09-13T18:32:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f74066b10 msgr2=0x7f3f74068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f74066b10 0x7f3f74068fd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0011f0 tx=0x7f3f8c007d40 comp rx=0 tx=0).stop 2024-09-13T18:32:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 msgr2=0x7f3f9015a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f9015a230 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3f800ad040 tx=0x7f3f8001ac90 comp rx=0 tx=0).stop 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 shutdown_connections 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f74066b10 0x7f3f74068fd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f90143d50 0x7f3f900affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f900cdad0 0x7f3f9015a230 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 --2- 172.21.15.53:0/2775108593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f900cd6f0 0x7f3f900ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 >> 172.21.15.53:0/2775108593 conn(0x7f3f90073330 msgr2=0x7f3f9013c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 shutdown_connections 2024-09-13T18:32:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.369+0000 7f3f97773640 1 -- 172.21.15.53:0/2775108593 wait complete. 2024-09-13T18:32:13.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-13T18:32:13.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 Processor -- start 2024-09-13T18:32:13.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 -- start start 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f506c15fd60 0x7f506c0cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c0cd580 0x7f506c0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f506c0cf5e0 0x7f506c0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0cd9a0 con 0x7f506c0cf5e0 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c160ca0 con 0x7f506c15fd60 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.513+0000 7f5072d7a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0cfa90 con 0x7f506c0cd580 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f506c0cf5e0 0x7f506c0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f506c0cf5e0 0x7f506c0b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34668/0 (socket says 172.21.15.53:34668) 2024-09-13T18:32:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 -- 172.21.15.53:0/1937805699 learned_addr learned my addr 172.21.15.53:0/1937805699 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5070b16640 1 --2- 172.21.15.53:0/1937805699 >> v2:172.21.15.87:3300/0 conn(0x7f506c15fd60 0x7f506c0cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f506bfff640 1 --2- 172.21.15.53:0/1937805699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c0cd580 0x7f506c0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 -- 172.21.15.53:0/1937805699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c0cd580 msgr2=0x7f506c0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 --2- 172.21.15.53:0/1937805699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c0cd580 0x7f506c0cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 -- 172.21.15.53:0/1937805699 >> v2:172.21.15.87:3300/0 conn(0x7f506c15fd60 msgr2=0x7f506c0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 --2- 172.21.15.53:0/1937805699 >> v2:172.21.15.87:3300/0 conn(0x7f506c15fd60 0x7f506c0cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 -- 172.21.15.53:0/1937805699 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c161130 con 0x7f506c0cf5e0 2024-09-13T18:32:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5070b16640 1 --2- 172.21.15.53:0/1937805699 >> v2:172.21.15.87:3300/0 conn(0x7f506c15fd60 0x7f506c0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5071317640 1 --2- 172.21.15.53:0/1937805699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c0b41f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f506c0c9760 tx=0x7f506401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2f597c2a7bf9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:13.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f506b7fe640 1 -- 172.21.15.53:0/1937805699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640af400 con 0x7f506c0cf5e0 2024-09-13T18:32:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f506b7fe640 1 -- 172.21.15.53:0/1937805699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640ab050 con 0x7f506c0cf5e0 2024-09-13T18:32:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f506b7fe640 1 -- 172.21.15.53:0/1937805699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640af780 con 0x7f506c0cf5e0 2024-09-13T18:32:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 -- 172.21.15.53:0/1937805699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 msgr2=0x7f506c0b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 --2- 172.21.15.53:0/1937805699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c0b41f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f506c0c9760 tx=0x7f506401f1e0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 -- 172.21.15.53:0/1937805699 shutdown_connections 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 --2- 172.21.15.53:0/1937805699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c0cd580 0x7f506c0cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 --2- 172.21.15.53:0/1937805699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c0b41f0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 --2- 172.21.15.53:0/1937805699 >> v2:172.21.15.87:3300/0 conn(0x7f506c15fd60 0x7f506c0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 -- 172.21.15.53:0/1937805699 >> 172.21.15.53:0/1937805699 conn(0x7f506c070970 msgr2=0x7f506c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 -- 172.21.15.53:0/1937805699 shutdown_connections 2024-09-13T18:32:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.517+0000 7f5072d7a640 1 -- 172.21.15.53:0/1937805699 wait complete. 2024-09-13T18:32:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 Processor -- start 2024-09-13T18:32:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 -- start start 2024-09-13T18:32:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd580 0x7f506c1f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15fd60 0x7f506c1f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0aa1a0 con 0x7f506c0cf5e0 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c1f32c0 con 0x7f506c0cd580 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0a9520 con 0x7f506c15fd60 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34680/0 (socket says 172.21.15.53:34680) 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 -- 172.21.15.53:0/22837738 learned_addr learned my addr 172.21.15.53:0/22837738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5071317640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15fd60 0x7f506c1f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5070b16640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd580 0x7f506c1f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 -- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15fd60 msgr2=0x7f506c1f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15fd60 0x7f506c1f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 -- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd580 msgr2=0x7f506c1f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd580 0x7f506c1f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 -- 172.21.15.53:0/22837738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009b30 con 0x7f506c0cf5e0 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5071317640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15fd60 0x7f506c1f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5070b16640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd580 0x7f506c1f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f506bfff640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c150ab0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f505c00d7d0 tx=0x7f505c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f50697fa640 1 -- 172.21.15.53:0/22837738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c004020 con 0x7f506c0cf5e0 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f50697fa640 1 -- 172.21.15.53:0/22837738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c004180 con 0x7f506c0cf5e0 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c0a9800 con 0x7f506c0cf5e0 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f50697fa640 1 -- 172.21.15.53:0/22837738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c004330 con 0x7f506c0cf5e0 2024-09-13T18:32:13.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0a9dc0 con 0x7f506c0cf5e0 2024-09-13T18:32:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.521+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c0cdbb0 con 0x7f506c0cf5e0 2024-09-13T18:32:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.525+0000 7f50697fa640 1 -- 172.21.15.53:0/22837738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) v1 ==== 86500+0+0 (secure 0 0 0) 0x7f505c0096a0 con 0x7f506c0cf5e0 2024-09-13T18:32:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.525+0000 7f50697fa640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f504c066b10 0x7f504c068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.525+0000 7f50697fa640 1 -- 172.21.15.53:0/22837738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f505c084ce0 con 0x7f506c0cf5e0 2024-09-13T18:32:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.525+0000 7f5070b16640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f504c066b10 0x7f504c068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.525+0000 7f5070b16640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f504c066b10 0x7f504c068fd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f505400b990 tx=0x7f5054008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.529+0000 7f50697fa640 1 -- 172.21.15.53:0/22837738 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f505c0519b0 con 0x7f506c0cf5e0 2024-09-13T18:32:13.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.713+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f506c160930 con 0x7f504c066b10 2024-09-13T18:32:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f50697fa640 1 -- 172.21.15.53:0/22837738 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f505400b660 con 0x7f504c066b10 2024-09-13T18:32:13.723 INFO:teuthology.orchestra.run.smithi053.stdout:[] 2024-09-13T18:32:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f504c066b10 msgr2=0x7f504c068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f504c066b10 0x7f504c068fd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f505400b990 tx=0x7f5054008040 comp rx=0 tx=0).stop 2024-09-13T18:32:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 msgr2=0x7f506c150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c150ab0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f505c00d7d0 tx=0x7f505c00dc90 comp rx=0 tx=0).stop 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 shutdown_connections 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f504c066b10 0x7f504c068fd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15fd60 0x7f506c1f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c0cf5e0 0x7f506c150ab0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 --2- 172.21.15.53:0/22837738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c0cd580 0x7f506c1f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 >> 172.21.15.53:0/22837738 conn(0x7f506c070970 msgr2=0x7f506c0b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 shutdown_connections 2024-09-13T18:32:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:13.721+0000 7f5072d7a640 1 -- 172.21.15.53:0/22837738 wait complete. 2024-09-13T18:32:13.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:13.742 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:32:13.751 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-09-13T18:32:13.752 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:32:13.752 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:13.863 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:13.940 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:32:13.940 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:13.940 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:13.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:14.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 Processor -- start 2024-09-13T18:32:14.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 -- start start 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd180cb980 0x7fbd180b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd1806b850 0x7fbd180cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd180cbd60 0x7fbd1806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180b1ac0 con 0x7fbd1806b850 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd18159ac0 con 0x7fbd180cbd60 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1fff5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18159da0 con 0x7fbd180cb980 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd1806b850 0x7fbd180cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbd1806b850 0x7fbd180cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34684/0 (socket says 172.21.15.53:34684) 2024-09-13T18:32:14.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 -- 172.21.15.53:0/2540782522 learned_addr learned my addr 172.21.15.53:0/2540782522 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1e592640 1 --2- 172.21.15.53:0/2540782522 >> v2:172.21.15.87:3300/0 conn(0x7fbd180cbd60 0x7fbd1806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1dd91640 1 --2- 172.21.15.53:0/2540782522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd180cb980 0x7fbd180b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 -- 172.21.15.53:0/2540782522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd180cb980 msgr2=0x7fbd180b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 --2- 172.21.15.53:0/2540782522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd180cb980 0x7fbd180b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 -- 172.21.15.53:0/2540782522 >> v2:172.21.15.87:3300/0 conn(0x7fbd180cbd60 msgr2=0x7fbd1806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 --2- 172.21.15.53:0/2540782522 >> v2:172.21.15.87:3300/0 conn(0x7fbd180cbd60 0x7fbd1806fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1d590640 1 -- 172.21.15.53:0/2540782522 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1815a080 con 0x7fbd1806b850 2024-09-13T18:32:14.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.121+0000 7fbd1e592640 1 --2- 172.21.15.53:0/2540782522 >> v2:172.21.15.87:3300/0 conn(0x7fbd180cbd60 0x7fbd1806fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:14.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1d590640 1 --2- 172.21.15.53:0/2540782522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd1806b850 0x7fbd180cdd40 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4433b7152da3f7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1cd8f640 1 -- 172.21.15.53:0/2540782522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080ab600 con 0x7fbd1806b850 2024-09-13T18:32:14.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1cd8f640 1 -- 172.21.15.53:0/2540782522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080a7050 con 0x7fbd1806b850 2024-09-13T18:32:14.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1cd8f640 1 -- 172.21.15.53:0/2540782522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080ab980 con 0x7fbd1806b850 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- 172.21.15.53:0/2540782522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd1806b850 msgr2=0x7fbd180cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/2540782522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd1806b850 0x7fbd180cdd40 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009870 tx=0x7fbd0801c460 comp rx=0 tx=0).stop 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- 172.21.15.53:0/2540782522 shutdown_connections 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/2540782522 >> v2:172.21.15.87:3300/0 conn(0x7fbd180cbd60 0x7fbd1806fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/2540782522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd1806b850 0x7fbd180cdd40 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/2540782522 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd180cb980 0x7fbd180b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- 172.21.15.53:0/2540782522 >> 172.21.15.53:0/2540782522 conn(0x7fbd18065c80 msgr2=0x7fbd18066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- 172.21.15.53:0/2540782522 shutdown_connections 2024-09-13T18:32:14.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- 172.21.15.53:0/2540782522 wait complete. 2024-09-13T18:32:14.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 Processor -- start 2024-09-13T18:32:14.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- start start 2024-09-13T18:32:14.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1806b850 0x7fbd180af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd180cb980 0x7fbd1814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd180cbd60 0x7fbd1815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815be90 con 0x7fbd180cb980 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815adf0 con 0x7fbd180cbd60 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1fff5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815b0d0 con 0x7fbd1806b850 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1d590640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd180cb980 0x7fbd1814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1d590640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd180cb980 0x7fbd1814c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34686/0 (socket says 172.21.15.53:34686) 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1d590640 1 -- 172.21.15.53:0/1304093553 learned_addr learned my addr 172.21.15.53:0/1304093553 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1e592640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd180cbd60 0x7fbd1815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1d590640 1 -- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1806b850 msgr2=0x7fbd180af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1dd91640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1806b850 0x7fbd180af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.125+0000 7fbd1d590640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1806b850 0x7fbd180af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1d590640 1 -- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd180cbd60 msgr2=0x7fbd1815e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1d590640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd180cbd60 0x7fbd1815e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1d590640 1 -- 172.21.15.53:0/1304093553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080094d0 con 0x7fbd180cb980 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1dd91640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1806b850 0x7fbd180af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1d590640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd180cb980 0x7fbd1814c950 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fbd080ae040 tx=0x7fbd08019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080b4440 con 0x7fbd180cb980 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080b45a0 con 0x7fbd180cb980 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1815b3b0 con 0x7fbd180cb980 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080b4950 con 0x7fbd180cb980 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1815b970 con 0x7fbd180cb980 2024-09-13T18:32:14.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd18067400 con 0x7fbd180cb980 2024-09-13T18:32:14.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 20) v1 ==== 86500+0+0 (secure 0 0 0) 0x7fbd080b2070 con 0x7fbd180cb980 2024-09-13T18:32:14.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd0e7fc640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbcfc066b10 0x7fbcfc068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fbd0811ea20 con 0x7fbd180cb980 2024-09-13T18:32:14.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1dd91640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbcfc066b10 0x7fbcfc068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.129+0000 7fbd1dd91640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbcfc066b10 0x7fbcfc068fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009840 tx=0x7fbd14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.133+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd080eb550 con 0x7fbd180cb980 2024-09-13T18:32:14.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.145+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fbd080eb920 con 0x7fbd180cb980 2024-09-13T18:32:14.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.297+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd1815b210 con 0x7fbd180cb980 2024-09-13T18:32:14.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.297+0000 7fbd0e7fc640 1 -- 172.21.15.53:0/1304093553 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16672 (secure 0 0 0) 0x7fbd1815b210 con 0x7fbd180cb980 2024-09-13T18:32:14.301 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:14.301 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":123,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:12.123936+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":123,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:14.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbcfc066b10 msgr2=0x7fbcfc068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbcfc066b10 0x7fbcfc068fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009840 tx=0x7fbd14008040 comp rx=0 tx=0).stop 2024-09-13T18:32:14.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd180cb980 msgr2=0x7fbd1814c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd180cb980 0x7fbd1814c950 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fbd080ae040 tx=0x7fbd08019200 comp rx=0 tx=0).stop 2024-09-13T18:32:14.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 shutdown_connections 2024-09-13T18:32:14.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbcfc066b10 0x7fbcfc068fd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd180cbd60 0x7fbd1815e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd180cb980 0x7fbd1814c950 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 --2- 172.21.15.53:0/1304093553 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbd1806b850 0x7fbd180af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 >> 172.21.15.53:0/1304093553 conn(0x7fbd18065c80 msgr2=0x7fbd180b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:14.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 shutdown_connections 2024-09-13T18:32:14.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.301+0000 7fbd1fff5640 1 -- 172.21.15.53:0/1304093553 wait complete. 2024-09-13T18:32:14.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:31:54.444062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:31:55.038831+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 123, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:32:14.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:32:14.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963c1f7640 1 Processor -- start 2024-09-13T18:32:14.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963c1f7640 1 -- start start 2024-09-13T18:32:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963c1f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96340c34f0 0x7f96340b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963c1f7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f96340b2bf0 0x7f96340ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963c1f7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963406bee0 con 0x7f9634160db0 2024-09-13T18:32:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963c1f7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340aff40 con 0x7f96340c34f0 2024-09-13T18:32:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963c1f7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963406a2c0 con 0x7f96340b2bf0 2024-09-13T18:32:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f9639f93640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96340c34f0 0x7f96340b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f9639f93640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96340c34f0 0x7f96340b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34688/0 (socket says 172.21.15.53:34688) 2024-09-13T18:32:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f9639f93640 1 -- 172.21.15.53:0/2557762639 learned_addr learned my addr 172.21.15.53:0/2557762639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f963a794640 1 --2- 172.21.15.53:0/2557762639 >> v2:172.21.15.87:3300/0 conn(0x7f96340b2bf0 0x7f96340ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f9639f93640 1 -- 172.21.15.53:0/2557762639 >> v2:172.21.15.87:3300/0 conn(0x7f96340b2bf0 msgr2=0x7f96340ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f9639f93640 1 --2- 172.21.15.53:0/2557762639 >> v2:172.21.15.87:3300/0 conn(0x7f96340b2bf0 0x7f96340ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f9639f93640 1 -- 172.21.15.53:0/2557762639 >> v1:172.21.15.87:6789/0 conn(0x7f9634160db0 legacy=0x7f96340c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.449+0000 7f9639f93640 1 -- 172.21.15.53:0/2557762639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963406a5a0 con 0x7f96340c34f0 2024-09-13T18:32:14.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f9639f93640 1 --2- 172.21.15.53:0/2557762639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f96340b0a00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f9634071280 tx=0x7f962401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b692c847e46807 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f9638f91640 1 -- 172.21.15.53:0/2557762639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340cee20 con 0x7f96340c34f0 2024-09-13T18:32:14.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f9638f91640 1 -- 172.21.15.53:0/2557762639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96240a5880 con 0x7f96340c34f0 2024-09-13T18:32:14.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f9638f91640 1 -- 172.21.15.53:0/2557762639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240a5c10 con 0x7f96340c34f0 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 -- 172.21.15.53:0/2557762639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 msgr2=0x7f96340b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 --2- 172.21.15.53:0/2557762639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f96340b0a00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f9634071280 tx=0x7f962401c9c0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 -- 172.21.15.53:0/2557762639 shutdown_connections 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 --2- 172.21.15.53:0/2557762639 >> v2:172.21.15.87:3300/0 conn(0x7f96340b2bf0 0x7f96340ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 --2- 172.21.15.53:0/2557762639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f96340b0a00 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 -- 172.21.15.53:0/2557762639 >> 172.21.15.53:0/2557762639 conn(0x7f96340b20d0 msgr2=0x7f96340b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 -- 172.21.15.53:0/2557762639 shutdown_connections 2024-09-13T18:32:14.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.453+0000 7f963c1f7640 1 -- 172.21.15.53:0/2557762639 wait complete. 2024-09-13T18:32:14.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 Processor -- start 2024-09-13T18:32:14.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 -- start start 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96340b2bf0 0x7f96340c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f963409c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9634160db0 0x7f963415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963409e380 con 0x7f96340c34f0 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340c50e0 con 0x7f9634160db0 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340c44d0 con 0x7f96340b2bf0 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f963409c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f963409c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34692/0 (socket says 172.21.15.53:34692) 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 -- 172.21.15.53:0/1454594091 learned_addr learned my addr 172.21.15.53:0/1454594091 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963a794640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9634160db0 0x7f963415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639f93640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96340b2bf0 0x7f96340c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 -- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96340b2bf0 msgr2=0x7f96340c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96340b2bf0 0x7f96340c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 -- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9634160db0 msgr2=0x7f963415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9634160db0 0x7f963415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 -- 172.21.15.53:0/1454594091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624009b30 con 0x7f96340c34f0 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639792640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f963409c3e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f962800c3c0 tx=0x7f962800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f96327fc640 1 -- 172.21.15.53:0/1454594091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280052d0 con 0x7f96340c34f0 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f96327fc640 1 -- 172.21.15.53:0/1454594091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9628005430 con 0x7f96340c34f0 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96340c47b0 con 0x7f96340c34f0 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f96327fc640 1 -- 172.21.15.53:0/1454594091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628003840 con 0x7f96340c34f0 2024-09-13T18:32:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96340c4d70 con 0x7f96340c34f0 2024-09-13T18:32:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96340c5290 con 0x7f96340c34f0 2024-09-13T18:32:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f96327fc640 1 -- 172.21.15.53:0/1454594091 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f96280039a0 con 0x7f96340c34f0 2024-09-13T18:32:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f96327fc640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9620066c30 0x7f96200690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f96327fc640 1 -- 172.21.15.53:0/1454594091 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f9628084150 con 0x7f96340c34f0 2024-09-13T18:32:14.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.457+0000 7f9639f93640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9620066c30 0x7f96200690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.461+0000 7f9639f93640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9620066c30 0x7f96200690f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f96240ae000 tx=0x7f96240a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.465+0000 7f96327fc640 1 -- 172.21.15.53:0/1454594091 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96340c5290 con 0x7f96340c34f0 2024-09-13T18:32:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.621+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9634073a10 con 0x7f96340c34f0 2024-09-13T18:32:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f96327fc640 1 -- 172.21.15.53:0/1454594091 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9628050be0 con 0x7f96340c34f0 2024-09-13T18:32:14.626 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:32:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9620066c30 msgr2=0x7f96200690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9620066c30 0x7f96200690f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f96240ae000 tx=0x7f96240a7070 comp rx=0 tx=0).stop 2024-09-13T18:32:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 msgr2=0x7f963409c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f963409c3e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f962800c3c0 tx=0x7f962800c880 comp rx=0 tx=0).stop 2024-09-13T18:32:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 shutdown_connections 2024-09-13T18:32:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9620066c30 0x7f96200690f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9634160db0 0x7f963415d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96340c34f0 0x7f963409c3e0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 --2- 172.21.15.53:0/1454594091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96340b2bf0 0x7f96340c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 >> 172.21.15.53:0/1454594091 conn(0x7f96340b20d0 msgr2=0x7f96340b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 shutdown_connections 2024-09-13T18:32:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.625+0000 7f963c1f7640 1 -- 172.21.15.53:0/1454594091 wait complete. 2024-09-13T18:32:14.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:32:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f904140f640 1 Processor -- start 2024-09-13T18:32:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f904140f640 1 -- start start 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f904140f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f903c143e80 0x7f903c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f904140f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f903c0cda30 0x7f903c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f904140f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c06f7a0 con 0x7f903c0caee0 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f904140f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c06fd60 con 0x7f903c0cda30 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f904140f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0cb960 con 0x7f903c143e80 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f903c0cda30 0x7f903c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f903c0cda30 0x7f903c0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34698/0 (socket says 172.21.15.53:34698) 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903b7fe640 1 -- 172.21.15.53:0/954835909 learned_addr learned my addr 172.21.15.53:0/954835909 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903affd640 1 --2- 172.21.15.53:0/954835909 >> v2:172.21.15.87:3300/0 conn(0x7f903c143e80 0x7f903c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903b7fe640 1 -- 172.21.15.53:0/954835909 >> v2:172.21.15.87:3300/0 conn(0x7f903c143e80 msgr2=0x7f903c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903b7fe640 1 --2- 172.21.15.53:0/954835909 >> v2:172.21.15.87:3300/0 conn(0x7f903c143e80 0x7f903c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903b7fe640 1 -- 172.21.15.53:0/954835909 >> v1:172.21.15.87:6789/0 conn(0x7f903c0caee0 legacy=0x7f903c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.769+0000 7f903b7fe640 1 -- 172.21.15.53:0/954835909 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0cbc40 con 0x7f903c0cda30 2024-09-13T18:32:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f903b7fe640 1 --2- 172.21.15.53:0/954835909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0cda30 0x7f903c0cb350 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f903c0676d0 tx=0x7f903401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54ad39251e83910 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f9039ffb640 1 -- 172.21.15.53:0/954835909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340a5740 con 0x7f903c0cda30 2024-09-13T18:32:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f9039ffb640 1 -- 172.21.15.53:0/954835909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90340a58a0 con 0x7f903c0cda30 2024-09-13T18:32:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f9039ffb640 1 -- 172.21.15.53:0/954835909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340a5c30 con 0x7f903c0cda30 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 -- 172.21.15.53:0/954835909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0cda30 msgr2=0x7f903c0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 --2- 172.21.15.53:0/954835909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0cda30 0x7f903c0cb350 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f903c0676d0 tx=0x7f903401c8a0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 -- 172.21.15.53:0/954835909 shutdown_connections 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 --2- 172.21.15.53:0/954835909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0cda30 0x7f903c0cb350 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 --2- 172.21.15.53:0/954835909 >> v2:172.21.15.87:3300/0 conn(0x7f903c143e80 0x7f903c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 -- 172.21.15.53:0/954835909 >> 172.21.15.53:0/954835909 conn(0x7f903c065c80 msgr2=0x7f903c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 -- 172.21.15.53:0/954835909 shutdown_connections 2024-09-13T18:32:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 -- 172.21.15.53:0/954835909 wait complete. 2024-09-13T18:32:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 Processor -- start 2024-09-13T18:32:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.773+0000 7f904140f640 1 -- start start 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0caee0 0x7f903c1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f903c0cda30 0x7f903c1f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f903c143e80 0x7f903c0c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1f4ae0 con 0x7f903c0caee0 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c3ca0 con 0x7f903c143e80 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c3f80 con 0x7f903c0cda30 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0caee0 0x7f903c1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0caee0 0x7f903c1f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34710/0 (socket says 172.21.15.53:34710) 2024-09-13T18:32:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 -- 172.21.15.53:0/326679042 learned_addr learned my addr 172.21.15.53:0/326679042 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903a7fc640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f903c0cda30 0x7f903c1f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903b7fe640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f903c143e80 0x7f903c0c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 -- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f903c0cda30 msgr2=0x7f903c1f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f903c0cda30 0x7f903c1f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 -- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f903c143e80 msgr2=0x7f903c0c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f903c143e80 0x7f903c0c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 -- 172.21.15.53:0/326679042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034009b30 con 0x7f903c0caee0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903a7fc640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f903c0cda30 0x7f903c1f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903affd640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0caee0 0x7f903c1f5880 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f902c00d5f0 tx=0x7f902c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f90237fe640 1 -- 172.21.15.53:0/326679042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0125f0 con 0x7f903c0caee0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f90237fe640 1 -- 172.21.15.53:0/326679042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c012750 con 0x7f903c0caee0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c0c4260 con 0x7f903c0caee0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f90237fe640 1 -- 172.21.15.53:0/326679042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c012ae0 con 0x7f903c0caee0 2024-09-13T18:32:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c0c4820 con 0x7f903c0caee0 2024-09-13T18:32:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0cb350 con 0x7f903c0caee0 2024-09-13T18:32:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f90237fe640 1 -- 172.21.15.53:0/326679042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f902c012c40 con 0x7f903c0caee0 2024-09-13T18:32:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f90237fe640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9028066c30 0x7f90280690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f903a7fc640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9028066c30 0x7f90280690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.777+0000 7f90237fe640 1 -- 172.21.15.53:0/326679042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f902c085c20 con 0x7f903c0caee0 2024-09-13T18:32:14.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.781+0000 7f903a7fc640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9028066c30 0x7f90280690f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f903c13f930 tx=0x7f9030009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:14.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.781+0000 7f90237fe640 1 -- 172.21.15.53:0/326679042 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f902c052780 con 0x7f903c0caee0 2024-09-13T18:32:14.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f903c0b3030 con 0x7f903c0caee0 2024-09-13T18:32:14.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f90237fe640 1 -- 172.21.15.53:0/326679042 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f902c055da0 con 0x7f903c0caee0 2024-09-13T18:32:14.947 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:32:14.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9028066c30 msgr2=0x7f90280690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9028066c30 0x7f90280690f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f903c13f930 tx=0x7f9030009040 comp rx=0 tx=0).stop 2024-09-13T18:32:14.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0caee0 msgr2=0x7f903c1f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:14.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0caee0 0x7f903c1f5880 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f902c00d5f0 tx=0x7f902c00dab0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 shutdown_connections 2024-09-13T18:32:14.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9028066c30 0x7f90280690f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f903c0cda30 0x7f903c1f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f903c143e80 0x7f903c0c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 --2- 172.21.15.53:0/326679042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f903c0caee0 0x7f903c1f5880 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:14.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 >> 172.21.15.53:0/326679042 conn(0x7f903c065c80 msgr2=0x7f903c0cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:14.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 shutdown_connections 2024-09-13T18:32:14.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:14.945+0000 7f904140f640 1 -- 172.21.15.53:0/326679042 wait complete. 2024-09-13T18:32:14.966 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:32:15.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2ba86640 1 Processor -- start 2024-09-13T18:32:15.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2ba86640 1 -- start start 2024-09-13T18:32:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2ba86640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb24157020 0x7fcb2406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2ba86640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb2406d270 0x7fcb2406f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2ba86640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2406d6e0 con 0x7fcb24156c40 2024-09-13T18:32:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2ba86640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb240715f0 con 0x7fcb24157020 2024-09-13T18:32:15.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2ba86640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240b15a0 con 0x7fcb2406d270 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2a023640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb2406d270 0x7fcb2406f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb29021640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb24157020 0x7fcb2406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2a023640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb2406d270 0x7fcb2406f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:32844/0 (socket says 172.21.15.53:32844) 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2a023640 1 -- 172.21.15.53:0/26605732 learned_addr learned my addr 172.21.15.53:0/26605732 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb29822640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcb24156c40 0x7fcb24070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:53472/0 (socket says 172.21.15.53:53472) 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2a023640 1 -- 172.21.15.53:0/26605732 >> v2:172.21.15.87:3300/0 conn(0x7fcb24157020 msgr2=0x7fcb2406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2a023640 1 --2- 172.21.15.53:0/26605732 >> v2:172.21.15.87:3300/0 conn(0x7fcb24157020 0x7fcb2406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2a023640 1 -- 172.21.15.53:0/26605732 >> v1:172.21.15.87:6789/0 conn(0x7fcb24156c40 legacy=0x7fcb24070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.097+0000 7fcb2a023640 1 -- 172.21.15.53:0/26605732 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240b1880 con 0x7fcb2406d270 2024-09-13T18:32:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2a023640 1 --2- 172.21.15.53:0/26605732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb2406d270 0x7fcb2406f330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009e50 tx=0x7fcb1c01ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bda71b35556658 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb28820640 1 -- 172.21.15.53:0/26605732 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0a58d0 con 0x7fcb2406d270 2024-09-13T18:32:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb28820640 1 -- 172.21.15.53:0/26605732 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0a5a30 con 0x7fcb2406d270 2024-09-13T18:32:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb28820640 1 -- 172.21.15.53:0/26605732 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0a5dc0 con 0x7fcb2406d270 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 -- 172.21.15.53:0/26605732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb2406d270 msgr2=0x7fcb2406f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/26605732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb2406d270 0x7fcb2406f330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009e50 tx=0x7fcb1c01ca00 comp rx=0 tx=0).stop 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 -- 172.21.15.53:0/26605732 shutdown_connections 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/26605732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb2406d270 0x7fcb2406f330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/26605732 >> v2:172.21.15.87:3300/0 conn(0x7fcb24157020 0x7fcb2406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 -- 172.21.15.53:0/26605732 >> 172.21.15.53:0/26605732 conn(0x7fcb24065c80 msgr2=0x7fcb24066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 -- 172.21.15.53:0/26605732 shutdown_connections 2024-09-13T18:32:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 -- 172.21.15.53:0/26605732 wait complete. 2024-09-13T18:32:15.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 Processor -- start 2024-09-13T18:32:15.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.101+0000 7fcb2ba86640 1 -- start start 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb2406d270 0x7fcb2414cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb24156c40 0x7fcb24155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb24155ba0 0x7fcb24140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24141a90 con 0x7fcb2406d270 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24156050 con 0x7fcb24156c40 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24140e10 con 0x7fcb24155ba0 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb2406d270 0x7fcb2414cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb2406d270 0x7fcb2414cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34722/0 (socket says 172.21.15.53:34722) 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 -- 172.21.15.53:0/4175759161 learned_addr learned my addr 172.21.15.53:0/4175759161 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2a023640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb24155ba0 0x7fcb24140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29021640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb24156c40 0x7fcb24155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 -- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb24155ba0 msgr2=0x7fcb24140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb24155ba0 0x7fcb24140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 -- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb24156c40 msgr2=0x7fcb24155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb24156c40 0x7fcb24155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 -- 172.21.15.53:0/4175759161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c009b30 con 0x7fcb2406d270 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29822640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb2406d270 0x7fcb2414cf80 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c420 tx=0x7fcb2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb1a7fc640 1 -- 172.21.15.53:0/4175759161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200074e0 con 0x7fcb2406d270 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb1a7fc640 1 -- 172.21.15.53:0/4175759161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb20007640 con 0x7fcb2406d270 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb1a7fc640 1 -- 172.21.15.53:0/4175759161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20004a30 con 0x7fcb2406d270 2024-09-13T18:32:15.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb241410f0 con 0x7fcb2406d270 2024-09-13T18:32:15.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb241416b0 con 0x7fcb2406d270 2024-09-13T18:32:15.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2414df70 con 0x7fcb2406d270 2024-09-13T18:32:15.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb1a7fc640 1 -- 172.21.15.53:0/4175759161 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fcb20004b90 con 0x7fcb2406d270 2024-09-13T18:32:15.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb1a7fc640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcb08066c30 0x7fcb080690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb1a7fc640 1 -- 172.21.15.53:0/4175759161 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fcb20084570 con 0x7fcb2406d270 2024-09-13T18:32:15.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.105+0000 7fcb29021640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcb08066c30 0x7fcb080690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.109+0000 7fcb29021640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcb08066c30 0x7fcb080690f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb241562f0 tx=0x7fcb14009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.113+0000 7fcb1a7fc640 1 -- 172.21.15.53:0/4175759161 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcb20051140 con 0x7fcb2406d270 2024-09-13T18:32:15.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.269+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb2406f330 con 0x7fcb2406d270 2024-09-13T18:32:15.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb1a7fc640 1 -- 172.21.15.53:0/4175759161 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb20054760 con 0x7fcb2406d270 2024-09-13T18:32:15.274 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcb08066c30 msgr2=0x7fcb080690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcb08066c30 0x7fcb080690f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb241562f0 tx=0x7fcb14009190 comp rx=0 tx=0).stop 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb2406d270 msgr2=0x7fcb2414cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb2406d270 0x7fcb2414cf80 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c420 tx=0x7fcb2000c8e0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 shutdown_connections 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcb08066c30 0x7fcb080690f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb24155ba0 0x7fcb24140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb24156c40 0x7fcb24155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 --2- 172.21.15.53:0/4175759161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb2406d270 0x7fcb2414cf80 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 >> 172.21.15.53:0/4175759161 conn(0x7fcb24065c80 msgr2=0x7fcb240cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:15.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 shutdown_connections 2024-09-13T18:32:15.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.273+0000 7fcb2ba86640 1 -- 172.21.15.53:0/4175759161 wait complete. 2024-09-13T18:32:15.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:32:15.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f37154ca640 1 Processor -- start 2024-09-13T18:32:15.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f37154ca640 1 -- start start 2024-09-13T18:32:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f37154ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37100b1960 0x7f37100b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f37154ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37100ad530 con 0x7f371015db40 2024-09-13T18:32:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f37154ca640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37100ad810 con 0x7f37100ae5d0 2024-09-13T18:32:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f37154ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37100ae1b0 con 0x7f37100b1960 2024-09-13T18:32:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f370e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37100b1960 0x7f37100b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f370effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f371015db40 0x7f37100afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51004/0 (socket says 172.21.15.53:51004) 2024-09-13T18:32:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f370effd640 1 -- 172.21.15.53:0/1479395024 learned_addr learned my addr 172.21.15.53:0/1479395024 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f370e7fc640 1 -- 172.21.15.53:0/1479395024 >> v1:172.21.15.87:6789/0 conn(0x7f37100ae5d0 legacy=0x7f37100ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f370e7fc640 1 -- 172.21.15.53:0/1479395024 >> v1:172.21.15.53:6789/0 conn(0x7f371015db40 legacy=0x7f37100afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f370dffb640 1 -- 172.21.15.53:0/1479395024 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808998472 0 0) 0x7f37100ad530 con 0x7f371015db40 2024-09-13T18:32:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.421+0000 7f370e7fc640 1 -- 172.21.15.53:0/1479395024 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100adaf0 con 0x7f37100b1960 2024-09-13T18:32:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f370e7fc640 1 --2- 172.21.15.53:0/1479395024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37100b1960 0x7f37100b0480 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f36f80097c0 tx=0x7f36f801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516e3a7bf1cbb5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f370dffb640 1 -- 172.21.15.53:0/1479395024 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80ac620 con 0x7f37100b1960 2024-09-13T18:32:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f370dffb640 1 -- 172.21.15.53:0/1479395024 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f80ac780 con 0x7f37100b1960 2024-09-13T18:32:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f370dffb640 1 -- 172.21.15.53:0/1479395024 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80acb10 con 0x7f37100b1960 2024-09-13T18:32:15.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 -- 172.21.15.53:0/1479395024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37100b1960 msgr2=0x7f37100b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 --2- 172.21.15.53:0/1479395024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37100b1960 0x7f37100b0480 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f36f80097c0 tx=0x7f36f801c3e0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 -- 172.21.15.53:0/1479395024 shutdown_connections 2024-09-13T18:32:15.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 --2- 172.21.15.53:0/1479395024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37100b1960 0x7f37100b0480 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 -- 172.21.15.53:0/1479395024 >> 172.21.15.53:0/1479395024 conn(0x7f37100b20d0 msgr2=0x7f37100b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 -- 172.21.15.53:0/1479395024 shutdown_connections 2024-09-13T18:32:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 -- 172.21.15.53:0/1479395024 wait complete. 2024-09-13T18:32:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 Processor -- start 2024-09-13T18:32:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.425+0000 7f37154ca640 1 -- start start 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37100ae5d0 0x7f371015b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100b1960 0x7f37100c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371015db40 0x7f37100c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100b6410 con 0x7f371015db40 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100c6990 con 0x7f37100b1960 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100c6c70 con 0x7f37100ae5d0 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371015db40 0x7f37100c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371015db40 0x7f37100c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34740/0 (socket says 172.21.15.53:34740) 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 -- 172.21.15.53:0/2544283659 learned_addr learned my addr 172.21.15.53:0/2544283659 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370effd640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37100ae5d0 0x7f371015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370e7fc640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100b1960 0x7f37100c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 -- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37100ae5d0 msgr2=0x7f371015b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37100ae5d0 0x7f371015b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 -- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100b1960 msgr2=0x7f37100c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100b1960 0x7f37100c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 -- 172.21.15.53:0/2544283659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8009420 con 0x7f371015db40 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370e7fc640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100b1960 0x7f37100c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370f7fe640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371015db40 0x7f37100c5b60 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f370000c430 tx=0x7f370000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37077fe640 1 -- 172.21.15.53:0/2544283659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700005220 con 0x7f371015db40 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37077fe640 1 -- 172.21.15.53:0/2544283659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3700005380 con 0x7f371015db40 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37100c6f50 con 0x7f371015db40 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37077fe640 1 -- 172.21.15.53:0/2544283659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700007270 con 0x7f371015db40 2024-09-13T18:32:15.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37100b3b60 con 0x7f371015db40 2024-09-13T18:32:15.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37100b3d50 con 0x7f371015db40 2024-09-13T18:32:15.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37077fe640 1 -- 172.21.15.53:0/2544283659 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f37000073d0 con 0x7f371015db40 2024-09-13T18:32:15.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37077fe640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36f0066c60 0x7f36f0069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f37077fe640 1 -- 172.21.15.53:0/2544283659 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f3700084040 con 0x7f371015db40 2024-09-13T18:32:15.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370effd640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36f0066c60 0x7f36f0069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.429+0000 7f370effd640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36f0066c60 0x7f36f0069120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f37080012f0 tx=0x7f3708005c40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.433+0000 7f37077fe640 1 -- 172.21.15.53:0/2544283659 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3700050b60 con 0x7f371015db40 2024-09-13T18:32:15.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.605+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f37100ae9e0 con 0x7f371015db40 2024-09-13T18:32:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.605+0000 7f37077fe640 1 -- 172.21.15.53:0/2544283659 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v123) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3700054180 con 0x7f371015db40 2024-09-13T18:32:15.609 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:32:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36f0066c60 msgr2=0x7f36f0069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36f0066c60 0x7f36f0069120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f37080012f0 tx=0x7f3708005c40 comp rx=0 tx=0).stop 2024-09-13T18:32:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371015db40 msgr2=0x7f37100c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371015db40 0x7f37100c5b60 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f370000c430 tx=0x7f370000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 shutdown_connections 2024-09-13T18:32:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36f0066c60 0x7f36f0069120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f371015db40 0x7f37100c5b60 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f37100b1960 0x7f37100c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 --2- 172.21.15.53:0/2544283659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f37100ae5d0 0x7f371015b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 >> 172.21.15.53:0/2544283659 conn(0x7f37100b20d0 msgr2=0x7f3710069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 shutdown_connections 2024-09-13T18:32:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.609+0000 7f37154ca640 1 -- 172.21.15.53:0/2544283659 wait complete. 2024-09-13T18:32:15.629 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:32:15.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:15.629 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:15.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[51686]: fuse finished with error 0 and tester_r 0 2024-09-13T18:32:15.642 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:32:15.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:15.643 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:32:15.707 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:32:15.708 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:15.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f5322403640 1 Processor -- start 2024-09-13T18:32:15.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f5322403640 1 -- start start 2024-09-13T18:32:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f5322403640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 0x7f531c165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f5322403640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c06d480 con 0x7f531c1582a0 2024-09-13T18:32:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f5322403640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c15ace0 con 0x7f531c15b7c0 2024-09-13T18:32:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f5322403640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c15aaf0 con 0x7f531c0713a0 2024-09-13T18:32:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f531c1582a0 0x7f531c06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51010/0 (socket says 172.21.15.53:51010) 2024-09-13T18:32:15.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 -- 172.21.15.53:0/478634402 learned_addr learned my addr 172.21.15.53:0/478634402 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f53209a0640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 0x7f531c165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200179837 0 0) 0x7f531c06d480 con 0x7f531c1582a0 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5304003530 con 0x7f531c1582a0 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141876103 0 0) 0x7f5304003530 con 0x7f531c1582a0 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 msgr2=0x7f531c165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 0x7f531c165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 >> v1:172.21.15.87:6789/0 conn(0x7f531c15b7c0 legacy=0x7f531c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c15afc0 con 0x7f531c1582a0 2024-09-13T18:32:15.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f530c001680 con 0x7f531c1582a0 2024-09-13T18:32:15.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 >> v1:172.21.15.53:6789/0 conn(0x7f531c1582a0 legacy=0x7f531c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f5304003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 0x7f53040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5304004d10 0x7f5304005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530400ba40 con 0x7f53040039b0 2024-09-13T18:32:15.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530400bb80 con 0x7f5304004d10 2024-09-13T18:32:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530400bd40 con 0x7f531c0713a0 2024-09-13T18:32:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f5304003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531b7fe640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 0x7f53040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f53209a0640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5304004d10 0x7f5304005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 -- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 msgr2=0x7f53040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c0713a0 0x7f53040047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 -- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5304004d10 msgr2=0x7f5304005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5304004d10 0x7f5304005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f531bfff640 1 -- 172.21.15.53:0/478634402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304003530 con 0x7f53040039b0 2024-09-13T18:32:15.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.861+0000 7f53209a0640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5304004d10 0x7f5304005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:15.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f531bfff640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f5304003dd0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c210 tx=0x7f530c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7332e9385ba7c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c005ae0 con 0x7f53040039b0 2024-09-13T18:32:15.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c005c40 con 0x7f53040039b0 2024-09-13T18:32:15.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f531affd640 1 -- 172.21.15.53:0/478634402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0a5830 con 0x7f53040039b0 2024-09-13T18:32:15.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 -- 172.21.15.53:0/478634402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 msgr2=0x7f5304003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 --2- 172.21.15.53:0/478634402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f5304003dd0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c210 tx=0x7f530c01cc40 comp rx=0 tx=0).stop 2024-09-13T18:32:15.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f53209a0640 1 -- 172.21.15.53:0/478634402 reap_dead start 2024-09-13T18:32:15.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 -- 172.21.15.53:0/478634402 shutdown_connections 2024-09-13T18:32:15.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 -- 172.21.15.53:0/478634402 >> 172.21.15.53:0/478634402 conn(0x7f531c065c80 msgr2=0x7f531c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:15.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 -- 172.21.15.53:0/478634402 shutdown_connections 2024-09-13T18:32:15.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 -- 172.21.15.53:0/478634402 wait complete. 2024-09-13T18:32:15.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 Processor -- start 2024-09-13T18:32:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.865+0000 7f5322403640 1 -- start start 2024-09-13T18:32:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f531c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c14f400 0x7f531c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c06fc80 0x7f531c070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c14ff70 con 0x7f53040039b0 2024-09-13T18:32:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c070640 con 0x7f531c14f400 2024-09-13T18:32:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c14c7b0 con 0x7f531c06fc80 2024-09-13T18:32:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f531c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f531c151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34758/0 (socket says 172.21.15.53:34758) 2024-09-13T18:32:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 -- 172.21.15.53:0/483567174 learned_addr learned my addr 172.21.15.53:0/483567174 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531b7fe640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c14f400 0x7f531c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f53209a0640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c06fc80 0x7f531c070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 -- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c06fc80 msgr2=0x7f531c070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c06fc80 0x7f531c070100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 -- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c14f400 msgr2=0x7f531c14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c14f400 0x7f531c14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:15.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 -- 172.21.15.53:0/483567174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c152150 con 0x7f53040039b0 2024-09-13T18:32:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531bfff640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f531c151c10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f530c01cc80 tx=0x7f5304005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5318ff9640 1 -- 172.21.15.53:0/483567174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0b4070 con 0x7f53040039b0 2024-09-13T18:32:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5318ff9640 1 -- 172.21.15.53:0/483567174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c005db0 con 0x7f53040039b0 2024-09-13T18:32:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c14bbe0 con 0x7f53040039b0 2024-09-13T18:32:15.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5318ff9640 1 -- 172.21.15.53:0/483567174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c0a5a30 con 0x7f53040039b0 2024-09-13T18:32:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c14c160 con 0x7f53040039b0 2024-09-13T18:32:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c067400 con 0x7f53040039b0 2024-09-13T18:32:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5318ff9640 1 -- 172.21.15.53:0/483567174 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f530c0a5b90 con 0x7f53040039b0 2024-09-13T18:32:15.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5318ff9640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5308066c30 0x7f53080690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f5318ff9640 1 -- 172.21.15.53:0/483567174 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f530c11e3f0 con 0x7f53040039b0 2024-09-13T18:32:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.869+0000 7f531b7fe640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5308066c30 0x7f53080690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.873+0000 7f531b7fe640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5308066c30 0x7f53080690f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5310007fd0 tx=0x7f5310009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:15.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:15.873+0000 7f5318ff9640 1 -- 172.21.15.53:0/483567174 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f530c0eae80 con 0x7f53040039b0 2024-09-13T18:32:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.033+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f531c06c900 con 0x7f53040039b0 2024-09-13T18:32:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.037+0000 7f5318ff9640 1 -- 172.21.15.53:0/483567174 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16672 (secure 0 0 0) 0x7f530c0ee4a0 con 0x7f53040039b0 2024-09-13T18:32:16.041 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:16.041 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":123,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:12.123936+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":123,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5308066c30 msgr2=0x7f53080690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5308066c30 0x7f53080690f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5310007fd0 tx=0x7f5310009040 comp rx=0 tx=0).stop 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 msgr2=0x7f531c151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f531c151c10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f530c01cc80 tx=0x7f5304005800 comp rx=0 tx=0).stop 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 shutdown_connections 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5308066c30 0x7f53080690f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f531c06fc80 0x7f531c070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f531c14f400 0x7f531c14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 --2- 172.21.15.53:0/483567174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53040039b0 0x7f531c151c10 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 >> 172.21.15.53:0/483567174 conn(0x7f531c065c80 msgr2=0x7f531c070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 shutdown_connections 2024-09-13T18:32:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.041+0000 7f5322403640 1 -- 172.21.15.53:0/483567174 wait complete. 2024-09-13T18:32:16.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:31:54.444062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:31:55.038831+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 123, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:32:16.060 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:32:16.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51df2ca640 1 Processor -- start 2024-09-13T18:32:16.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51df2ca640 1 -- start start 2024-09-13T18:32:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51df2ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 0x7f51d81606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51df2ca640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51d80cf6a0 0x7f51d8160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51df2ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d8161160 con 0x7f51d815c9e0 2024-09-13T18:32:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51df2ca640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d80aff30 con 0x7f51d80cf6a0 2024-09-13T18:32:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51df2ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d806ac90 con 0x7f51d8160300 2024-09-13T18:32:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dc865640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f51d815c9e0 0x7f51d80b06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51026/0 (socket says 172.21.15.53:51026) 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dc865640 1 -- 172.21.15.53:0/4214937814 learned_addr learned my addr 172.21.15.53:0/4214937814 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd867640 1 --2- 172.21.15.53:0/4214937814 >> v2:172.21.15.87:3300/0 conn(0x7f51d80cf6a0 0x7f51d8160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd066640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 0x7f51d81606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625571022 0 0) 0x7f51d8161160 con 0x7f51d815c9e0 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c4003530 con 0x7f51d815c9e0 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 430819602 0 0) 0x7f51c4003530 con 0x7f51d815c9e0 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 msgr2=0x7f51d81606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 0x7f51d81606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 >> v2:172.21.15.87:3300/0 conn(0x7f51d80cf6a0 msgr2=0x7f51d8160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 --2- 172.21.15.53:0/4214937814 >> v2:172.21.15.87:3300/0 conn(0x7f51d80cf6a0 0x7f51d8160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d806af70 con 0x7f51d815c9e0 2024-09-13T18:32:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f51c8001680 con 0x7f51d815c9e0 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 >> v1:172.21.15.53:6789/0 conn(0x7f51d815c9e0 legacy=0x7f51d80b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c4003980 0x7f51c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 0x7f51c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c4004d10 0x7f51c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80aff30 con 0x7f51c4003980 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d806ac90 con 0x7f51c4004d10 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c400b990 con 0x7f51d8160300 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd066640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c4003980 0x7f51c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dc865640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 0x7f51c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd066640 1 -- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 msgr2=0x7f51c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd066640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51d8160300 0x7f51c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd066640 1 -- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c4004d10 msgr2=0x7f51c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd066640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51c4004d10 0x7f51c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.193+0000 7f51dd066640 1 -- 172.21.15.53:0/4214937814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4003530 con 0x7f51c4003980 2024-09-13T18:32:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51dd066640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c4003980 0x7f51c4003da0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009fc0 tx=0x7f51d401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3286acc30556707e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40a5a70 con 0x7f51c4003980 2024-09-13T18:32:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400f040 con 0x7f51c4003980 2024-09-13T18:32:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51cffff640 1 -- 172.21.15.53:0/4214937814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40a5e10 con 0x7f51c4003980 2024-09-13T18:32:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- 172.21.15.53:0/4214937814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c4003980 msgr2=0x7f51c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 --2- 172.21.15.53:0/4214937814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51c4003980 0x7f51c4003da0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009fc0 tx=0x7f51d401cc80 comp rx=0 tx=0).stop 2024-09-13T18:32:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51dd867640 1 -- 172.21.15.53:0/4214937814 reap_dead start 2024-09-13T18:32:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- 172.21.15.53:0/4214937814 shutdown_connections 2024-09-13T18:32:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- 172.21.15.53:0/4214937814 >> 172.21.15.53:0/4214937814 conn(0x7f51d80b20d0 msgr2=0x7f51d80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- 172.21.15.53:0/4214937814 shutdown_connections 2024-09-13T18:32:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- 172.21.15.53:0/4214937814 wait complete. 2024-09-13T18:32:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 Processor -- start 2024-09-13T18:32:16.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- start start 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51c4003980 0x7f51d8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51d8156b20 0x7f51d80b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d80c75d0 0x7f51d80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80c7fc0 con 0x7f51d8156b20 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81568b0 con 0x7f51d80c75d0 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.197+0000 7f51df2ca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80c9570 con 0x7f51c4003980 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51d8156b20 0x7f51d80b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51d8156b20 0x7f51d80b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34778/0 (socket says 172.21.15.53:34778) 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 -- 172.21.15.53:0/4202792454 learned_addr learned my addr 172.21.15.53:0/4202792454 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dd867640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d80c75d0 0x7f51d80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dd066640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51c4003980 0x7f51d8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 -- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51c4003980 msgr2=0x7f51d8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51c4003980 0x7f51d8156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 -- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d80c75d0 msgr2=0x7f51d80c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d80c75d0 0x7f51d80c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 -- 172.21.15.53:0/4202792454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d81f4df0 con 0x7f51d8156b20 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dc865640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51d8156b20 0x7f51d80b5cb0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e7b0 tx=0x7f51c800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51cdffb640 1 -- 172.21.15.53:0/4202792454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c800ee60 con 0x7f51d8156b20 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51cdffb640 1 -- 172.21.15.53:0/4202792454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c800c8d0 con 0x7f51d8156b20 2024-09-13T18:32:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d80c9810 con 0x7f51d8156b20 2024-09-13T18:32:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51cdffb640 1 -- 172.21.15.53:0/4202792454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c800cc40 con 0x7f51d8156b20 2024-09-13T18:32:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d80c9dd0 con 0x7f51d8156b20 2024-09-13T18:32:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d80c9f60 con 0x7f51d8156b20 2024-09-13T18:32:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51cdffb640 1 -- 172.21.15.53:0/4202792454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f51c8013420 con 0x7f51d8156b20 2024-09-13T18:32:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51cdffb640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f51bc066c60 0x7f51bc069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dd066640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f51bc066c60 0x7f51bc069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51cdffb640 1 -- 172.21.15.53:0/4202792454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f51c80848a0 con 0x7f51d8156b20 2024-09-13T18:32:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.201+0000 7f51dd066640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f51bc066c60 0x7f51bc069120 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51d40af000 tx=0x7f51d4004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.205+0000 7f51cdffb640 1 -- 172.21.15.53:0/4202792454 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51c80513c0 con 0x7f51d8156b20 2024-09-13T18:32:16.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.365+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51d8160c00 con 0x7f51d8156b20 2024-09-13T18:32:16.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.365+0000 7f51cdffb640 1 -- 172.21.15.53:0/4202792454 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51c80549e0 con 0x7f51d8156b20 2024-09-13T18:32:16.368 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f51bc066c60 msgr2=0x7f51bc069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f51bc066c60 0x7f51bc069120 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51d40af000 tx=0x7f51d4004ac0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51d8156b20 msgr2=0x7f51d80b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51d8156b20 0x7f51d80b5cb0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e7b0 tx=0x7f51c800ec70 comp rx=0 tx=0).stop 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 shutdown_connections 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f51bc066c60 0x7f51bc069120 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51d80c75d0 0x7f51d80c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51d8156b20 0x7f51d80b5cb0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 --2- 172.21.15.53:0/4202792454 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f51c4003980 0x7f51d8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 >> 172.21.15.53:0/4202792454 conn(0x7f51d80b20d0 msgr2=0x7f51d8067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 shutdown_connections 2024-09-13T18:32:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.369+0000 7f51df2ca640 1 -- 172.21.15.53:0/4202792454 wait complete. 2024-09-13T18:32:16.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:32:16.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56fa10f640 1 Processor -- start 2024-09-13T18:32:16.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56fa10f640 1 -- start start 2024-09-13T18:32:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56fa10f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56f40cda30 0x7f56f40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56fa10f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f406f7a0 con 0x7f56f40caee0 2024-09-13T18:32:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56fa10f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f406fd60 con 0x7f56f4143e80 2024-09-13T18:32:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56fa10f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f406baa0 con 0x7f56f40cda30 2024-09-13T18:32:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56f3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56f40cda30 0x7f56f40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56f3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56f40cda30 0x7f56f40cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34780/0 (socket says 172.21.15.53:34780) 2024-09-13T18:32:16.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56f3fff640 1 -- 172.21.15.53:0/2507632134 learned_addr learned my addr 172.21.15.53:0/2507632134 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56f2ffd640 1 --1- 172.21.15.53:0/2507632134 >> v1:172.21.15.53:6789/0 conn(0x7f56f40caee0 0x7f56f40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51042/0 (socket says 172.21.15.53:51042) 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56f3fff640 1 -- 172.21.15.53:0/2507632134 >> v1:172.21.15.87:6789/0 conn(0x7f56f4143e80 legacy=0x7f56f406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56f3fff640 1 -- 172.21.15.53:0/2507632134 >> v1:172.21.15.53:6789/0 conn(0x7f56f40caee0 legacy=0x7f56f40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.517+0000 7f56f3fff640 1 -- 172.21.15.53:0/2507632134 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40cb960 con 0x7f56f40cda30 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56f3fff640 1 --2- 172.21.15.53:0/2507632134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f40cda30 0x7f56f40cb350 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009e50 tx=0x7f56ec01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b38caecce43019e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56f27fc640 1 -- 172.21.15.53:0/2507632134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0a57a0 con 0x7f56f40cda30 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56f27fc640 1 -- 172.21.15.53:0/2507632134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0a5900 con 0x7f56f40cda30 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56f27fc640 1 -- 172.21.15.53:0/2507632134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0a5c90 con 0x7f56f40cda30 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- 172.21.15.53:0/2507632134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f40cda30 msgr2=0x7f56f40cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 --2- 172.21.15.53:0/2507632134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f40cda30 0x7f56f40cb350 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009e50 tx=0x7f56ec01c8e0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- 172.21.15.53:0/2507632134 shutdown_connections 2024-09-13T18:32:16.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 --2- 172.21.15.53:0/2507632134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f40cda30 0x7f56f40cb350 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- 172.21.15.53:0/2507632134 >> 172.21.15.53:0/2507632134 conn(0x7f56f4065c80 msgr2=0x7f56f4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- 172.21.15.53:0/2507632134 shutdown_connections 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- 172.21.15.53:0/2507632134 wait complete. 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 Processor -- start 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- start start 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56f40caee0 0x7f56f413d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56f40cda30 0x7f56f40ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f4143e80 0x7f56f40ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f415c980 con 0x7f56f4143e80 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40a99c0 con 0x7f56f40caee0 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56fa10f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f415c3c0 con 0x7f56f40cda30 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f4143e80 0x7f56f40ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f4143e80 0x7f56f40ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34790/0 (socket says 172.21.15.53:34790) 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.521+0000 7f56f3fff640 1 -- 172.21.15.53:0/1887339262 learned_addr learned my addr 172.21.15.53:0/1887339262 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f37fe640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56f40caee0 0x7f56f413d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f2ffd640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56f40cda30 0x7f56f40ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f3fff640 1 -- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56f40cda30 msgr2=0x7f56f40ac060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f3fff640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56f40cda30 0x7f56f40ac060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f3fff640 1 -- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56f40caee0 msgr2=0x7f56f413d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f3fff640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56f40caee0 0x7f56f413d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f3fff640 1 -- 172.21.15.53:0/1887339262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec009b30 con 0x7f56f4143e80 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f2ffd640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56f40cda30 0x7f56f40ac060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f3fff640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f4143e80 0x7f56f40ac980 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009e50 tx=0x7f56ec019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56ebfff640 1 -- 172.21.15.53:0/1887339262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0b8670 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56ebfff640 1 -- 172.21.15.53:0/1887339262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0b87d0 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f415c6a0 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56ebfff640 1 -- 172.21.15.53:0/1887339262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0b8b80 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f413dbb0 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f40a9b50 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56ebfff640 1 -- 172.21.15.53:0/1887339262 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f56ec0b8ce0 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56ebfff640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56d4066c30 0x7f56d40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f37fe640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56d4066c30 0x7f56d40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56ebfff640 1 -- 172.21.15.53:0/1887339262 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f56ec120300 con 0x7f56f4143e80 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.525+0000 7f56f37fe640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56d4066c30 0x7f56d40690f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000f70 tx=0x7f56dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.529+0000 7f56ebfff640 1 -- 172.21.15.53:0/1887339262 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56ec0ece80 con 0x7f56f4143e80 2024-09-13T18:32:16.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.689+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56f40cb350 con 0x7f56f4143e80 2024-09-13T18:32:16.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.689+0000 7f56ebfff640 1 -- 172.21.15.53:0/1887339262 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56ec0f04a0 con 0x7f56f4143e80 2024-09-13T18:32:16.692 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56d4066c30 msgr2=0x7f56d40690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56d4066c30 0x7f56d40690f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000f70 tx=0x7f56dc009040 comp rx=0 tx=0).stop 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f4143e80 msgr2=0x7f56f40ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f4143e80 0x7f56f40ac980 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009e50 tx=0x7f56ec019680 comp rx=0 tx=0).stop 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 shutdown_connections 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f56d4066c30 0x7f56d40690f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56f40cda30 0x7f56f40ac060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56f4143e80 0x7f56f40ac980 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 --2- 172.21.15.53:0/1887339262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56f40caee0 0x7f56f413d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 >> 172.21.15.53:0/1887339262 conn(0x7f56f4065c80 msgr2=0x7f56f40af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 shutdown_connections 2024-09-13T18:32:16.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.693+0000 7f56fa10f640 1 -- 172.21.15.53:0/1887339262 wait complete. 2024-09-13T18:32:16.712 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:32:16.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbb01530640 1 Processor -- start 2024-09-13T18:32:16.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbb01530640 1 -- start start 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbb01530640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbafc0caee0 0x7fbafc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbb01530640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbafc0cd320 0x7fbafc0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbb01530640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbafc06f7a0 con 0x7fbafc143e80 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbb01530640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc06baa0 con 0x7fbafc0caee0 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbb01530640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc06fd60 con 0x7fbafc0cd320 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafa7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbafc0caee0 0x7fbafc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafa7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbafc0caee0 0x7fbafc0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42772/0 (socket says 172.21.15.53:42772) 2024-09-13T18:32:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafa7fc640 1 -- 172.21.15.53:0/3846081049 learned_addr learned my addr 172.21.15.53:0/3846081049 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:16.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafb7fe640 1 --2- 172.21.15.53:0/3846081049 >> v2:172.21.15.87:3300/0 conn(0x7fbafc0cd320 0x7fbafc0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafa7fc640 1 -- 172.21.15.53:0/3846081049 >> v2:172.21.15.87:3300/0 conn(0x7fbafc0cd320 msgr2=0x7fbafc0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:16.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafa7fc640 1 --2- 172.21.15.53:0/3846081049 >> v2:172.21.15.87:3300/0 conn(0x7fbafc0cd320 0x7fbafc0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafa7fc640 1 -- 172.21.15.53:0/3846081049 >> v1:172.21.15.87:6789/0 conn(0x7fbafc143e80 legacy=0x7fbafc06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:16.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.833+0000 7fbafa7fc640 1 -- 172.21.15.53:0/3846081049 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0cb960 con 0x7fbafc0caee0 2024-09-13T18:32:16.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbafa7fc640 1 --2- 172.21.15.53:0/3846081049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc0caee0 0x7fbafc0cb350 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009870 tx=0x7fbaf001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3829e279ae7767 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbaf9ffb640 1 -- 172.21.15.53:0/3846081049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00ab620 con 0x7fbafc0caee0 2024-09-13T18:32:16.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbaf9ffb640 1 -- 172.21.15.53:0/3846081049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf00ab780 con 0x7fbafc0caee0 2024-09-13T18:32:16.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbaf9ffb640 1 -- 172.21.15.53:0/3846081049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00abb10 con 0x7fbafc0caee0 2024-09-13T18:32:16.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- 172.21.15.53:0/3846081049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc0caee0 msgr2=0x7fbafc0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 --2- 172.21.15.53:0/3846081049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc0caee0 0x7fbafc0cb350 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009870 tx=0x7fbaf001c420 comp rx=0 tx=0).stop 2024-09-13T18:32:16.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- 172.21.15.53:0/3846081049 shutdown_connections 2024-09-13T18:32:16.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 --2- 172.21.15.53:0/3846081049 >> v2:172.21.15.87:3300/0 conn(0x7fbafc0cd320 0x7fbafc0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 --2- 172.21.15.53:0/3846081049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc0caee0 0x7fbafc0cb350 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- 172.21.15.53:0/3846081049 >> 172.21.15.53:0/3846081049 conn(0x7fbafc065c80 msgr2=0x7fbafc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:16.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- 172.21.15.53:0/3846081049 shutdown_connections 2024-09-13T18:32:16.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- 172.21.15.53:0/3846081049 wait complete. 2024-09-13T18:32:16.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 Processor -- start 2024-09-13T18:32:16.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- start start 2024-09-13T18:32:16.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbafc0caee0 0x7fbafc0b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbafc0cd320 0x7fbafc13fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc143e80 0x7fbafc1f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc140ec0 con 0x7fbafc143e80 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0b1b40 con 0x7fbafc0caee0 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbb01530640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0b1d70 con 0x7fbafc0cd320 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc143e80 0x7fbafc1f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc143e80 0x7fbafc1f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42774/0 (socket says 172.21.15.53:42774) 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.837+0000 7fbafb7fe640 1 -- 172.21.15.53:0/4189827391 learned_addr learned my addr 172.21.15.53:0/4189827391 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafaffd640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbafc0caee0 0x7fbafc0b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafa7fc640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbafc0cd320 0x7fbafc13fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafb7fe640 1 -- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbafc0cd320 msgr2=0x7fbafc13fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafb7fe640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbafc0cd320 0x7fbafc13fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafb7fe640 1 -- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbafc0caee0 msgr2=0x7fbafc0b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafb7fe640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbafc0caee0 0x7fbafc0b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafb7fe640 1 -- 172.21.15.53:0/4189827391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf00094d0 con 0x7fbafc143e80 2024-09-13T18:32:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafb7fe640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc143e80 0x7fbafc1f50a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4007e40 tx=0x7fbaf400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbae37fe640 1 -- 172.21.15.53:0/4189827391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4014620 con 0x7fbafc143e80 2024-09-13T18:32:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbae37fe640 1 -- 172.21.15.53:0/4189827391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400ee90 con 0x7fbafc143e80 2024-09-13T18:32:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc0b2050 con 0x7fbafc143e80 2024-09-13T18:32:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbae37fe640 1 -- 172.21.15.53:0/4189827391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40149e0 con 0x7fbafc143e80 2024-09-13T18:32:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbafc159e10 con 0x7fbafc143e80 2024-09-13T18:32:16.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbafc15a000 con 0x7fbafc143e80 2024-09-13T18:32:16.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbae37fe640 1 -- 172.21.15.53:0/4189827391 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fbaf4014b40 con 0x7fbafc143e80 2024-09-13T18:32:16.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbae37fe640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbae8066c30 0x7fbae80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:16.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbae37fe640 1 -- 172.21.15.53:0/4189827391 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fbaf4085440 con 0x7fbafc143e80 2024-09-13T18:32:16.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafaffd640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbae8066c30 0x7fbae80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:16.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.841+0000 7fbafaffd640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbae8066c30 0x7fbae80690f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0098e0 tx=0x7fbaec009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:16.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:16.845+0000 7fbae37fe640 1 -- 172.21.15.53:0/4189827391 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbaf4052010 con 0x7fbafc143e80 2024-09-13T18:32:17.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.005+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbafc0cb350 con 0x7fbafc143e80 2024-09-13T18:32:17.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.005+0000 7fbae37fe640 1 -- 172.21.15.53:0/4189827391 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbaf4055630 con 0x7fbafc143e80 2024-09-13T18:32:17.009 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:32:17.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbae8066c30 msgr2=0x7fbae80690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbae8066c30 0x7fbae80690f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0098e0 tx=0x7fbaec009060 comp rx=0 tx=0).stop 2024-09-13T18:32:17.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc143e80 msgr2=0x7fbafc1f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc143e80 0x7fbafc1f50a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4007e40 tx=0x7fbaf400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 shutdown_connections 2024-09-13T18:32:17.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbae8066c30 0x7fbae80690f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbafc0cd320 0x7fbafc13fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbafc143e80 0x7fbafc1f50a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 --2- 172.21.15.53:0/4189827391 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbafc0caee0 0x7fbafc0b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 >> 172.21.15.53:0/4189827391 conn(0x7fbafc065c80 msgr2=0x7fbafc15caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 shutdown_connections 2024-09-13T18:32:17.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.009+0000 7fbb01530640 1 -- 172.21.15.53:0/4189827391 wait complete. 2024-09-13T18:32:17.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:32:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9689a76640 1 Processor -- start 2024-09-13T18:32:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9689a76640 1 -- start start 2024-09-13T18:32:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9689a76640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f96841582a0 0x7f968406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9689a76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96840713a0 0x7f968406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9689a76640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968406d480 con 0x7f968415b7c0 2024-09-13T18:32:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9689a76640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968415aaf0 con 0x7f96840713a0 2024-09-13T18:32:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9689a76640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968406d760 con 0x7f96841582a0 2024-09-13T18:32:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9683fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96840713a0 0x7f968406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9683fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96840713a0 0x7f968406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42782/0 (socket says 172.21.15.53:42782) 2024-09-13T18:32:17.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9683fff640 1 -- 172.21.15.53:0/4104999643 learned_addr learned my addr 172.21.15.53:0/4104999643 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:17.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f96837fe640 1 --2- 172.21.15.53:0/4104999643 >> v2:172.21.15.87:3300/0 conn(0x7f96841582a0 0x7f968406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9683fff640 1 -- 172.21.15.53:0/4104999643 >> v2:172.21.15.87:3300/0 conn(0x7f96841582a0 msgr2=0x7f968406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:17.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9683fff640 1 --2- 172.21.15.53:0/4104999643 >> v2:172.21.15.87:3300/0 conn(0x7f96841582a0 0x7f968406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9683fff640 1 -- 172.21.15.53:0/4104999643 >> v1:172.21.15.87:6789/0 conn(0x7f968415b7c0 legacy=0x7f9684070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:17.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.141+0000 7f9683fff640 1 -- 172.21.15.53:0/4104999643 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968415ace0 con 0x7f96840713a0 2024-09-13T18:32:17.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9683fff640 1 --2- 172.21.15.53:0/4104999643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f968406ce40 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f9684069f50 tx=0x7f967c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40f73dcf4c5615d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:17.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f96827fc640 1 -- 172.21.15.53:0/4104999643 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c0a5840 con 0x7f96840713a0 2024-09-13T18:32:17.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f96827fc640 1 -- 172.21.15.53:0/4104999643 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c0a59a0 con 0x7f96840713a0 2024-09-13T18:32:17.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f96827fc640 1 -- 172.21.15.53:0/4104999643 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c0a5d30 con 0x7f96840713a0 2024-09-13T18:32:17.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- 172.21.15.53:0/4104999643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 msgr2=0x7f968406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 --2- 172.21.15.53:0/4104999643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f968406ce40 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f9684069f50 tx=0x7f967c01c980 comp rx=0 tx=0).stop 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- 172.21.15.53:0/4104999643 shutdown_connections 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 --2- 172.21.15.53:0/4104999643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f968406ce40 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 --2- 172.21.15.53:0/4104999643 >> v2:172.21.15.87:3300/0 conn(0x7f96841582a0 0x7f968406c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- 172.21.15.53:0/4104999643 >> 172.21.15.53:0/4104999643 conn(0x7f9684065c80 msgr2=0x7f9684066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- 172.21.15.53:0/4104999643 shutdown_connections 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- 172.21.15.53:0/4104999643 wait complete. 2024-09-13T18:32:17.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 Processor -- start 2024-09-13T18:32:17.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- start start 2024-09-13T18:32:17.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f9684138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96841582a0 0x7f96841475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f968415b7c0 0x7f9684155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968414fb90 con 0x7f96840713a0 2024-09-13T18:32:17.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968414efa0 con 0x7f968415b7c0 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f9689a76640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968414f1f0 con 0x7f96841582a0 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f96837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f9684138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f96837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f9684138d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42784/0 (socket says 172.21.15.53:42784) 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.145+0000 7f96837fe640 1 -- 172.21.15.53:0/1272803709 learned_addr learned my addr 172.21.15.53:0/1272803709 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9682ffd640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96841582a0 0x7f96841475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9683fff640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f968415b7c0 0x7f9684155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f96837fe640 1 -- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96841582a0 msgr2=0x7f96841475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f96837fe640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96841582a0 0x7f96841475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f96837fe640 1 -- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f968415b7c0 msgr2=0x7f9684155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f96837fe640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f968415b7c0 0x7f9684155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f96837fe640 1 -- 172.21.15.53:0/1272803709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009b30 con 0x7f96840713a0 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9683fff640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f968415b7c0 0x7f9684155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f96837fe640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f9684138d80 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f967400d800 tx=0x7f967400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:17.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f966bfff640 1 -- 172.21.15.53:0/1272803709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400b6c0 con 0x7f96840713a0 2024-09-13T18:32:17.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f966bfff640 1 -- 172.21.15.53:0/1272803709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400b820 con 0x7f96840713a0 2024-09-13T18:32:17.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968414f4d0 con 0x7f96840713a0 2024-09-13T18:32:17.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f966bfff640 1 -- 172.21.15.53:0/1272803709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400bb90 con 0x7f96840713a0 2024-09-13T18:32:17.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968414c770 con 0x7f96840713a0 2024-09-13T18:32:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9684067400 con 0x7f96840713a0 2024-09-13T18:32:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f966bfff640 1 -- 172.21.15.53:0/1272803709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f967400bcf0 con 0x7f96840713a0 2024-09-13T18:32:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f966bfff640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9670066c30 0x7f96700690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f966bfff640 1 -- 172.21.15.53:0/1272803709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f9674085120 con 0x7f96840713a0 2024-09-13T18:32:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9682ffd640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9670066c30 0x7f96700690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.149+0000 7f9682ffd640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9670066c30 0x7f96700690f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f968406f800 tx=0x7f9678008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:17.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.153+0000 7f966bfff640 1 -- 172.21.15.53:0/1272803709 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9674051c40 con 0x7f96840713a0 2024-09-13T18:32:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.317+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f968414fe00 con 0x7f96840713a0 2024-09-13T18:32:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.317+0000 7f966bfff640 1 -- 172.21.15.53:0/1272803709 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v123) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9674055260 con 0x7f96840713a0 2024-09-13T18:32:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:32:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9670066c30 msgr2=0x7f96700690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9670066c30 0x7f96700690f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f968406f800 tx=0x7f9678008040 comp rx=0 tx=0).stop 2024-09-13T18:32:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 msgr2=0x7f9684138d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f9684138d80 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f967400d800 tx=0x7f967400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 shutdown_connections 2024-09-13T18:32:17.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9670066c30 0x7f96700690f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96841582a0 0x7f96841475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f968415b7c0 0x7f9684155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 --2- 172.21.15.53:0/1272803709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96840713a0 0x7f9684138d80 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 >> 172.21.15.53:0/1272803709 conn(0x7f9684065c80 msgr2=0x7f96840aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 shutdown_connections 2024-09-13T18:32:17.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.321+0000 7f9689a76640 1 -- 172.21.15.53:0/1272803709 wait complete. 2024-09-13T18:32:17.338 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:32:17.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:17.339 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:17.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36234]: fuse finished with error 0 and tester_r 0 2024-09-13T18:32:17.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:32:17.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:17.354 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:32:17.526 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:17.526 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:17.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:32:17.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:32:17.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:17.533 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:32:17.581 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:32:17.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:17.582 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:32:17.582 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:17.588 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:32:17.588 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:32:17.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:17.588 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:32:17.635 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:32:17.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:32:17.636 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.761+0000 7f656bfea640 1 Processor -- start 2024-09-13T18:32:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.761+0000 7f656bfea640 1 -- start start 2024-09-13T18:32:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f656bfea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f656415b7c0 0x7f6564070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f656bfea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656406d480 con 0x7f65641582a0 2024-09-13T18:32:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f656bfea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656415ace0 con 0x7f65640711d0 2024-09-13T18:32:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f656bfea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6564071680 con 0x7f656415b7c0 2024-09-13T18:32:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569585640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f656415b7c0 0x7f6564070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569d86640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f65641582a0 0x7f656406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33240/0 (socket says 172.21.15.53:33240) 2024-09-13T18:32:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569585640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f656415b7c0 0x7f6564070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42792/0 (socket says 172.21.15.53:42792) 2024-09-13T18:32:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569d86640 1 -- 172.21.15.53:0/2642433704 learned_addr learned my addr 172.21.15.53:0/2642433704 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569585640 1 -- 172.21.15.53:0/2642433704 >> v1:172.21.15.87:6789/0 conn(0x7f65640711d0 legacy=0x7f65641640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569585640 1 -- 172.21.15.53:0/2642433704 >> v1:172.21.15.53:6789/0 conn(0x7f65641582a0 legacy=0x7f656406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569585640 1 -- 172.21.15.53:0/2642433704 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656415afc0 con 0x7f656415b7c0 2024-09-13T18:32:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6568d84640 1 -- 172.21.15.53:0/2642433704 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537515326 0 0) 0x7f656406d480 con 0x7f65641582a0 2024-09-13T18:32:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6569585640 1 --2- 172.21.15.53:0/2642433704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656415b7c0 0x7f6564070c90 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f65540097c0 tx=0x7f655401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9697ddb33f93af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6568d84640 1 -- 172.21.15.53:0/2642433704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540ab600 con 0x7f656415b7c0 2024-09-13T18:32:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6568d84640 1 -- 172.21.15.53:0/2642433704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65540a7050 con 0x7f656415b7c0 2024-09-13T18:32:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.765+0000 7f6568d84640 1 -- 172.21.15.53:0/2642433704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540ab980 con 0x7f656415b7c0 2024-09-13T18:32:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- 172.21.15.53:0/2642433704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656415b7c0 msgr2=0x7f6564070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 --2- 172.21.15.53:0/2642433704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656415b7c0 0x7f6564070c90 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f65540097c0 tx=0x7f655401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- 172.21.15.53:0/2642433704 shutdown_connections 2024-09-13T18:32:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 --2- 172.21.15.53:0/2642433704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656415b7c0 0x7f6564070c90 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- 172.21.15.53:0/2642433704 >> 172.21.15.53:0/2642433704 conn(0x7f6564065c80 msgr2=0x7f6564066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- 172.21.15.53:0/2642433704 shutdown_connections 2024-09-13T18:32:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- 172.21.15.53:0/2642433704 wait complete. 2024-09-13T18:32:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 Processor -- start 2024-09-13T18:32:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- start start 2024-09-13T18:32:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65640711d0 0x7f65641552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65641582a0 0x7f65641599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656415b7c0 0x7f656414a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656414b7e0 con 0x7f65640711d0 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6564154ec0 con 0x7f656415b7c0 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656414b500 con 0x7f65641582a0 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65640711d0 0x7f65641552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65640711d0 0x7f65641552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42806/0 (socket says 172.21.15.53:42806) 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 -- 172.21.15.53:0/3819781604 learned_addr learned my addr 172.21.15.53:0/3819781604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656a587640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656415b7c0 0x7f656414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569585640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65641582a0 0x7f65641599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 -- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65641582a0 msgr2=0x7f65641599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65641582a0 0x7f65641599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 -- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656415b7c0 msgr2=0x7f656414a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656415b7c0 0x7f656414a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 -- 172.21.15.53:0/3819781604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6554009420 con 0x7f65640711d0 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656a587640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656415b7c0 0x7f656414a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f6569d86640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65640711d0 0x7f65641552e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f656000c4a0 tx=0x7f656000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f655a7fc640 1 -- 172.21.15.53:0/3819781604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600074e0 con 0x7f65640711d0 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f655a7fc640 1 -- 172.21.15.53:0/3819781604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6560007640 con 0x7f65640711d0 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6564154800 con 0x7f65640711d0 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f655a7fc640 1 -- 172.21.15.53:0/3819781604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560004a30 con 0x7f65640711d0 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.769+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6564159ee0 con 0x7f65640711d0 2024-09-13T18:32:17.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.773+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6564067400 con 0x7f65640711d0 2024-09-13T18:32:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.773+0000 7f655a7fc640 1 -- 172.21.15.53:0/3819781604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f6560004b90 con 0x7f65640711d0 2024-09-13T18:32:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.773+0000 7f655a7fc640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6548066c30 0x7f65480690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.773+0000 7f655a7fc640 1 -- 172.21.15.53:0/3819781604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f6560084110 con 0x7f65640711d0 2024-09-13T18:32:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.773+0000 7f6569585640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6548066c30 0x7f65480690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:17.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.773+0000 7f6569585640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6548066c30 0x7f65480690f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f65540ad000 tx=0x7f65540a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:17.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.777+0000 7f655a7fc640 1 -- 172.21.15.53:0/3819781604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65600b5db0 con 0x7f65640711d0 2024-09-13T18:32:17.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.973+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6564154660 con 0x7f65640711d0 2024-09-13T18:32:17.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.973+0000 7f655a7fc640 1 -- 172.21.15.53:0/3819781604 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f6564154660 con 0x7f65640711d0 2024-09-13T18:32:17.976 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:17.976 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3448118459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3448118459},{"type":"v1","addr":"172.21.15.87:6833","nonce":3448118459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2784676391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2784676391},{"type":"v1","addr":"172.21.15.87:6835","nonce":2784676391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1340459922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1340459922},{"type":"v1","addr":"172.21.15.53:6833","nonce":1340459922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:56.042381+0000","modified":"2024-09-13T18:31:59.056844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8472":{"gid":8472,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2654273195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2654273195},{"type":"v1","addr":"172.21.15.53:6835","nonce":2654273195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:32:17.976 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 72 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.973+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6548066c30 msgr2=0x7f65480690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.973+0000 7f656bfea640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6548066c30 0x7f65480690f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f65540ad000 tx=0x7f65540a6000 comp rx=0 tx=0).stop 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.973+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65640711d0 msgr2=0x7f65641552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.973+0000 7f656bfea640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65640711d0 0x7f65641552e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f656000c4a0 tx=0x7f656000c960 comp rx=0 tx=0).stop 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 shutdown_connections 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6548066c30 0x7f65480690f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65641582a0 0x7f65641599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656415b7c0 0x7f656414a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 --2- 172.21.15.53:0/3819781604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65640711d0 0x7f65641552e0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 >> 172.21.15.53:0/3819781604 conn(0x7f6564065c80 msgr2=0x7f6564066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:17.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 shutdown_connections 2024-09-13T18:32:17.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:17.977+0000 7f656bfea640 1 -- 172.21.15.53:0/3819781604 wait complete. 2024-09-13T18:32:17.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:18.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.117+0000 7fbb144a4640 1 Processor -- start 2024-09-13T18:32:18.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.117+0000 7fbb144a4640 1 -- start start 2024-09-13T18:32:18.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb144a4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb0c0cd780 0x7fbb0c162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb144a4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0cc3f0 con 0x7fbb0c15b300 2024-09-13T18:32:18.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb144a4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c161930 con 0x7fbb0c162850 2024-09-13T18:32:18.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb144a4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c161c10 con 0x7fbb0c0cd780 2024-09-13T18:32:18.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb11a3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb0c0cd780 0x7fbb0c162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb12240640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbb0c15b300 0x7fbb0c161170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33254/0 (socket says 172.21.15.53:33254) 2024-09-13T18:32:18.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb12240640 1 -- 172.21.15.53:0/3672850711 learned_addr learned my addr 172.21.15.53:0/3672850711 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb1123e640 1 -- 172.21.15.53:0/3672850711 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740861859 0 0) 0x7fbb0c0cc3f0 con 0x7fbb0c15b300 2024-09-13T18:32:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb11a3f640 1 -- 172.21.15.53:0/3672850711 >> v1:172.21.15.87:6789/0 conn(0x7fbb0c162850 legacy=0x7fbb0c0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb11a3f640 1 -- 172.21.15.53:0/3672850711 >> v1:172.21.15.53:6789/0 conn(0x7fbb0c15b300 legacy=0x7fbb0c161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.121+0000 7fbb11a3f640 1 -- 172.21.15.53:0/3672850711 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c161ef0 con 0x7fbb0c0cd780 2024-09-13T18:32:18.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb11a3f640 1 --2- 172.21.15.53:0/3672850711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c162310 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0097c0 tx=0x7fbafc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3959b2dbfa7505b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb1123e640 1 -- 172.21.15.53:0/3672850711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ac410 con 0x7fbb0c0cd780 2024-09-13T18:32:18.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb1123e640 1 -- 172.21.15.53:0/3672850711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc0ac570 con 0x7fbb0c0cd780 2024-09-13T18:32:18.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb1123e640 1 -- 172.21.15.53:0/3672850711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ac900 con 0x7fbb0c0cd780 2024-09-13T18:32:18.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- 172.21.15.53:0/3672850711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 msgr2=0x7fbb0c162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 --2- 172.21.15.53:0/3672850711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c162310 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0097c0 tx=0x7fbafc01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- 172.21.15.53:0/3672850711 shutdown_connections 2024-09-13T18:32:18.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 --2- 172.21.15.53:0/3672850711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c162310 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- 172.21.15.53:0/3672850711 >> 172.21.15.53:0/3672850711 conn(0x7fbb0c065c80 msgr2=0x7fbb0c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:18.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- 172.21.15.53:0/3672850711 shutdown_connections 2024-09-13T18:32:18.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- 172.21.15.53:0/3672850711 wait complete. 2024-09-13T18:32:18.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 Processor -- start 2024-09-13T18:32:18.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- start start 2024-09-13T18:32:18.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb0c15b300 0x7fbb0c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb0c162850 0x7fbb0c155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c1439d0 con 0x7fbb0c0cd780 2024-09-13T18:32:18.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0a9a60 con 0x7fbb0c162850 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb144a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0a9d40 con 0x7fbb0c15b300 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb12240640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb12240640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42824/0 (socket says 172.21.15.53:42824) 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.125+0000 7fbb12240640 1 -- 172.21.15.53:0/1652975534 learned_addr learned my addr 172.21.15.53:0/1652975534 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb11a3f640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb0c15b300 0x7fbb0c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb12a41640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb0c162850 0x7fbb0c155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb12240640 1 -- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb0c15b300 msgr2=0x7fbb0c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb12240640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb0c15b300 0x7fbb0c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb12240640 1 -- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb0c162850 msgr2=0x7fbb0c155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb12240640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb0c162850 0x7fbb0c155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb12240640 1 -- 172.21.15.53:0/1652975534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc009420 con 0x7fbb0c0cd780 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb12240640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c143490 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c8c0 tx=0x7fbb0400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb02ffd640 1 -- 172.21.15.53:0/1652975534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400a640 con 0x7fbb0c0cd780 2024-09-13T18:32:18.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb02ffd640 1 -- 172.21.15.53:0/1652975534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0400a7a0 con 0x7fbb0c0cd780 2024-09-13T18:32:18.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c071660 con 0x7fbb0c0cd780 2024-09-13T18:32:18.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb02ffd640 1 -- 172.21.15.53:0/1652975534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400ab90 con 0x7fbb0c0cd780 2024-09-13T18:32:18.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c0cd210 con 0x7fbb0c0cd780 2024-09-13T18:32:18.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c067400 con 0x7fbb0c0cd780 2024-09-13T18:32:18.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb02ffd640 1 -- 172.21.15.53:0/1652975534 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fbb0400acf0 con 0x7fbb0c0cd780 2024-09-13T18:32:18.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb02ffd640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbaf0066c30 0x7fbaf00690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb02ffd640 1 -- 172.21.15.53:0/1652975534 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fbb040845e0 con 0x7fbb0c0cd780 2024-09-13T18:32:18.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb11a3f640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbaf0066c30 0x7fbaf00690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.129+0000 7fbb11a3f640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbaf0066c30 0x7fbaf00690f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ae000 tx=0x7fbafc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.133+0000 7fbb02ffd640 1 -- 172.21.15.53:0/1652975534 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb04050fe0 con 0x7fbb0c0cd780 2024-09-13T18:32:18.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.293+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb0c162310 con 0x7fbb0c0cd780 2024-09-13T18:32:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.293+0000 7fbb02ffd640 1 -- 172.21.15.53:0/1652975534 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16672 (secure 0 0 0) 0x7fbb04018090 con 0x7fbb0c0cd780 2024-09-13T18:32:18.296 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:18.296 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":123,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:12.123936+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":123,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:18.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbaf0066c30 msgr2=0x7fbaf00690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbaf0066c30 0x7fbaf00690f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ae000 tx=0x7fbafc008040 comp rx=0 tx=0).stop 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 msgr2=0x7fbb0c143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c143490 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c8c0 tx=0x7fbb0400cd80 comp rx=0 tx=0).stop 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 shutdown_connections 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbaf0066c30 0x7fbaf00690f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb0c15b300 0x7fbb0c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb0c162850 0x7fbb0c155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 --2- 172.21.15.53:0/1652975534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0c0cd780 0x7fbb0c143490 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 >> 172.21.15.53:0/1652975534 conn(0x7fbb0c065c80 msgr2=0x7fbb0c0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 shutdown_connections 2024-09-13T18:32:18.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.297+0000 7fbb144a4640 1 -- 172.21.15.53:0/1652975534 wait complete. 2024-09-13T18:32:18.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:31:54.444062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:31:55.038831+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 123, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:32:18.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:32:18.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cdb31c640 1 Processor -- start 2024-09-13T18:32:18.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cdb31c640 1 -- start start 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cdb31c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 0x7f7cd40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cdb31c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7cd40cd320 0x7f7cd40cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cdb31c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd406f7a0 con 0x7f7cd4143e80 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cdb31c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd406baa0 con 0x7f7cd40cd320 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cdb31c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd406fd60 con 0x7f7cd40caee0 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd90b8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7cd4143e80 0x7f7cd406b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33266/0 (socket says 172.21.15.53:33266) 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd90b8640 1 -- 172.21.15.53:0/3645647068 learned_addr learned my addr 172.21.15.53:0/3645647068 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd88b7640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 0x7f7cd40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd98b9640 1 --2- 172.21.15.53:0/3645647068 >> v2:172.21.15.87:3300/0 conn(0x7f7cd40cd320 0x7f7cd40cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852910179 0 0) 0x7f7cd406f7a0 con 0x7f7cd4143e80 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc0003530 con 0x7f7cd4143e80 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 377867005 0 0) 0x7f7cc0003530 con 0x7f7cd4143e80 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 msgr2=0x7f7cd40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 0x7f7cd40cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 >> v2:172.21.15.87:3300/0 conn(0x7f7cd40cd320 msgr2=0x7f7cd40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 --2- 172.21.15.53:0/3645647068 >> v2:172.21.15.87:3300/0 conn(0x7f7cd40cd320 0x7f7cd40cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40cb960 con 0x7f7cd4143e80 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7cd0001680 con 0x7f7cd4143e80 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 >> v1:172.21.15.53:6789/0 conn(0x7f7cd4143e80 legacy=0x7f7cd406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 0x7f7cc0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0003f00 0x7f7cc00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc0004d10 0x7f7cc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd406baa0 con 0x7f7cc0004d10 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd406fd60 con 0x7f7cc0003f00 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc000b9e0 con 0x7f7cd40caee0 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd98b9640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc0004d10 0x7f7cc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd88b7640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0003f00 0x7f7cc00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd90b8640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 0x7f7cc0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd98b9640 1 -- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 msgr2=0x7f7cc0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd98b9640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd40caee0 0x7f7cc0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd98b9640 1 -- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0003f00 msgr2=0x7f7cc00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd98b9640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cc0003f00 0x7f7cc00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.433+0000 7f7cd98b9640 1 -- 172.21.15.53:0/3645647068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0003530 con 0x7f7cc0004d10 2024-09-13T18:32:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cd98b9640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc0004d10 0x7f7cc0005190 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00e170 tx=0x7f7ccc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7483a6f50c7f6194 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0a5ba0 con 0x7f7cc0004d10 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00f040 con 0x7f7cc0004d10 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7ccbfff640 1 -- 172.21.15.53:0/3645647068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0ad440 con 0x7f7cc0004d10 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cdb31c640 1 -- 172.21.15.53:0/3645647068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc0004d10 msgr2=0x7f7cc0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cdb31c640 1 --2- 172.21.15.53:0/3645647068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cc0004d10 0x7f7cc0005190 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00e170 tx=0x7f7ccc01cca0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cd98b9640 1 -- 172.21.15.53:0/3645647068 reap_dead start 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cdb31c640 1 -- 172.21.15.53:0/3645647068 shutdown_connections 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cdb31c640 1 -- 172.21.15.53:0/3645647068 >> 172.21.15.53:0/3645647068 conn(0x7f7cd4065c80 msgr2=0x7f7cd4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cdb31c640 1 -- 172.21.15.53:0/3645647068 shutdown_connections 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.437+0000 7f7cdb31c640 1 -- 172.21.15.53:0/3645647068 wait complete. 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 Processor -- start 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 -- start start 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd4131d60 0x7f7cd4132140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cd4142c50 0x7f7cd415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd4142690 0x7f7cd415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd415ad90 con 0x7f7cd4142c50 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd412f690 con 0x7f7cd4131d60 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41e3040 con 0x7f7cd4142690 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cd4142c50 0x7f7cd415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cd4142c50 0x7f7cd415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42848/0 (socket says 172.21.15.53:42848) 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 -- 172.21.15.53:0/4062794842 learned_addr learned my addr 172.21.15.53:0/4062794842 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd90b8640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd4131d60 0x7f7cd4132140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd98b9640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd4142690 0x7f7cd415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 -- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd4142690 msgr2=0x7f7cd415c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd4142690 0x7f7cd415c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 -- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd4131d60 msgr2=0x7f7cd4132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd4131d60 0x7f7cd4132140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 -- 172.21.15.53:0/4062794842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd415afe0 con 0x7f7cd4142c50 2024-09-13T18:32:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd90b8640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd4131d60 0x7f7cd4132140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd88b7640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cd4142c50 0x7f7cd415bac0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4011560 tx=0x7f7cc4011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cc9ffb640 1 -- 172.21.15.53:0/4062794842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4015930 con 0x7f7cd4142c50 2024-09-13T18:32:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cc9ffb640 1 -- 172.21.15.53:0/4062794842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc4015a90 con 0x7f7cd4142c50 2024-09-13T18:32:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cc9ffb640 1 -- 172.21.15.53:0/4062794842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4015e60 con 0x7f7cd4142c50 2024-09-13T18:32:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd415b2c0 con 0x7f7cd4142c50 2024-09-13T18:32:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd41e2c80 con 0x7f7cd4142c50 2024-09-13T18:32:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd40ce160 con 0x7f7cd4142c50 2024-09-13T18:32:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cc9ffb640 1 -- 172.21.15.53:0/4062794842 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f7cc400f460 con 0x7f7cd4142c50 2024-09-13T18:32:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cc9ffb640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cb8066c30 0x7f7cb80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cc9ffb640 1 -- 172.21.15.53:0/4062794842 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f7cc40854c0 con 0x7f7cd4142c50 2024-09-13T18:32:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.441+0000 7f7cd90b8640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cb8066c30 0x7f7cb80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.445+0000 7f7cd90b8640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cb8066c30 0x7f7cb80690f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0001cd0 tx=0x7f7cd0001c60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.445+0000 7f7cc9ffb640 1 -- 172.21.15.53:0/4062794842 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7cc4051f50 con 0x7f7cd4142c50 2024-09-13T18:32:18.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cd40713f0 con 0x7f7cd4142c50 2024-09-13T18:32:18.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cc9ffb640 1 -- 172.21.15.53:0/4062794842 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cc4055570 con 0x7f7cd4142c50 2024-09-13T18:32:18.607 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:32:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cb8066c30 msgr2=0x7f7cb80690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cb8066c30 0x7f7cb80690f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0001cd0 tx=0x7f7cd0001c60 comp rx=0 tx=0).stop 2024-09-13T18:32:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cd4142c50 msgr2=0x7f7cd415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cd4142c50 0x7f7cd415bac0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4011560 tx=0x7f7cc4011a20 comp rx=0 tx=0).stop 2024-09-13T18:32:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 shutdown_connections 2024-09-13T18:32:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cb8066c30 0x7f7cb80690f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7cd4142690 0x7f7cd415c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7cd4142c50 0x7f7cd415bac0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 --2- 172.21.15.53:0/4062794842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7cd4131d60 0x7f7cd4132140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 >> 172.21.15.53:0/4062794842 conn(0x7f7cd4065c80 msgr2=0x7f7cd4156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 shutdown_connections 2024-09-13T18:32:18.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.605+0000 7f7cdb31c640 1 -- 172.21.15.53:0/4062794842 wait complete. 2024-09-13T18:32:18.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:32:18.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.741+0000 7fdd1f075640 1 Processor -- start 2024-09-13T18:32:18.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.741+0000 7fdd1f075640 1 -- start start 2024-09-13T18:32:18.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1f075640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd18159370 0x7fdd1815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1f075640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd180b37c0 0x7fdd180cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1f075640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180b3fa0 con 0x7fdd180d00d0 2024-09-13T18:32:18.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1f075640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180b4c20 con 0x7fdd180b37c0 2024-09-13T18:32:18.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1f075640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180d0580 con 0x7fdd18159370 2024-09-13T18:32:18.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1ce11640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd18159370 0x7fdd1815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd17fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd180b37c0 0x7fdd180cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1d612640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdd180d00d0 0x7fdd18070610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:40938/0 (socket says 172.21.15.53:40938) 2024-09-13T18:32:18.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1d612640 1 -- 172.21.15.53:0/3968852543 learned_addr learned my addr 172.21.15.53:0/3968852543 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:18.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd177fe640 1 -- 172.21.15.53:0/3968852543 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106718865 0 0) 0x7fdd180b3fa0 con 0x7fdd180d00d0 2024-09-13T18:32:18.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd177fe640 1 -- 172.21.15.53:0/3968852543 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd08003530 con 0x7fdd180d00d0 2024-09-13T18:32:18.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd17fff640 1 -- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd18159370 msgr2=0x7fdd1815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:18.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd17fff640 1 --2- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd18159370 0x7fdd1815a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd17fff640 1 -- 172.21.15.53:0/3968852543 >> v1:172.21.15.87:6789/0 conn(0x7fdd180d00d0 legacy=0x7fdd18070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd17fff640 1 -- 172.21.15.53:0/3968852543 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180b4280 con 0x7fdd180b37c0 2024-09-13T18:32:18.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.745+0000 7fdd1ce11640 1 --2- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd18159370 0x7fdd1815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:18.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 --2- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd180b37c0 0x7fdd180cfb90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097c0 tx=0x7fdd0401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e0e257a8d7eea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd177fe640 1 -- 172.21.15.53:0/3968852543 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ab670 con 0x7fdd180b37c0 2024-09-13T18:32:18.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd177fe640 1 -- 172.21.15.53:0/3968852543 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040ab7d0 con 0x7fdd180b37c0 2024-09-13T18:32:18.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd177fe640 1 -- 172.21.15.53:0/3968852543 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040abb60 con 0x7fdd180b37c0 2024-09-13T18:32:18.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd180b37c0 msgr2=0x7fdd180cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 --2- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd180b37c0 0x7fdd180cfb90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097c0 tx=0x7fdd0401c470 comp rx=0 tx=0).stop 2024-09-13T18:32:18.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- 172.21.15.53:0/3968852543 shutdown_connections 2024-09-13T18:32:18.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 --2- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd180b37c0 0x7fdd180cfb90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 --2- 172.21.15.53:0/3968852543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd18159370 0x7fdd1815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- 172.21.15.53:0/3968852543 >> 172.21.15.53:0/3968852543 conn(0x7fdd1806a350 msgr2=0x7fdd1806a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- 172.21.15.53:0/3968852543 shutdown_connections 2024-09-13T18:32:18.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- 172.21.15.53:0/3968852543 wait complete. 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 Processor -- start 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- start start 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd180b37c0 0x7fdd180cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd180d00d0 0x7fdd180cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd18159370 0x7fdd180cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181f5780 con 0x7fdd180d00d0 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181f59d0 con 0x7fdd18159370 2024-09-13T18:32:18.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1f075640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181f5cb0 con 0x7fdd180b37c0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd180d00d0 0x7fdd180cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd180d00d0 0x7fdd180cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42860/0 (socket says 172.21.15.53:42860) 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 -- 172.21.15.53:0/1021495007 learned_addr learned my addr 172.21.15.53:0/1021495007 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1ce11640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd180b37c0 0x7fdd180cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd1d612640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd18159370 0x7fdd180cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 -- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd180b37c0 msgr2=0x7fdd180cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd180b37c0 0x7fdd180cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 -- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd18159370 msgr2=0x7fdd180cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd18159370 0x7fdd180cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.749+0000 7fdd17fff640 1 -- 172.21.15.53:0/1021495007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c009420 con 0x7fdd180d00d0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd17fff640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd180d00d0 0x7fdd180cc490 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fdd040ad040 tx=0x7fdd0401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd157fa640 1 -- 172.21.15.53:0/1021495007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040bf610 con 0x7fdd180d00d0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd157fa640 1 -- 172.21.15.53:0/1021495007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040bf7b0 con 0x7fdd180d00d0 2024-09-13T18:32:18.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd04009420 con 0x7fdd180d00d0 2024-09-13T18:32:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd157fa640 1 -- 172.21.15.53:0/1021495007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040bfb60 con 0x7fdd180d00d0 2024-09-13T18:32:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd181f6270 con 0x7fdd180d00d0 2024-09-13T18:32:18.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd180cfb90 con 0x7fdd180d00d0 2024-09-13T18:32:18.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd157fa640 1 -- 172.21.15.53:0/1021495007 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fdd040bfcc0 con 0x7fdd180d00d0 2024-09-13T18:32:18.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd157fa640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdcfc066c30 0x7fdcfc0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:18.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd157fa640 1 -- 172.21.15.53:0/1021495007 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fdd0411fa90 con 0x7fdd180d00d0 2024-09-13T18:32:18.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd1ce11640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdcfc066c30 0x7fdcfc0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:18.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.753+0000 7fdd1ce11640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdcfc066c30 0x7fdcfc0690f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009be0 tx=0x7fdd0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:18.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.757+0000 7fdd157fa640 1 -- 172.21.15.53:0/1021495007 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdd040ec4a0 con 0x7fdd180d00d0 2024-09-13T18:32:18.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.917+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd180cbe70 con 0x7fdd180d00d0 2024-09-13T18:32:18.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.917+0000 7fdd157fa640 1 -- 172.21.15.53:0/1021495007 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd040efac0 con 0x7fdd180d00d0 2024-09-13T18:32:18.920 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:32:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdcfc066c30 msgr2=0x7fdcfc0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdcfc066c30 0x7fdcfc0690f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009be0 tx=0x7fdd0c008040 comp rx=0 tx=0).stop 2024-09-13T18:32:18.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd180d00d0 msgr2=0x7fdd180cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd180d00d0 0x7fdd180cc490 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fdd040ad040 tx=0x7fdd0401acb0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 shutdown_connections 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdcfc066c30 0x7fdcfc0690f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd18159370 0x7fdd180cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd180d00d0 0x7fdd180cc490 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 --2- 172.21.15.53:0/1021495007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd180b37c0 0x7fdd180cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 >> 172.21.15.53:0/1021495007 conn(0x7fdd1806a350 msgr2=0x7fdd180af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 shutdown_connections 2024-09-13T18:32:18.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:18.921+0000 7fdd1f075640 1 -- 172.21.15.53:0/1021495007 wait complete. 2024-09-13T18:32:18.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:32:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff20c1c640 1 Processor -- start 2024-09-13T18:32:19.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff20c1c640 1 -- start start 2024-09-13T18:32:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff20c1c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 0x7eff1c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff20c1c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c06f7a0 con 0x7eff1c0caee0 2024-09-13T18:32:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff20c1c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c06fd60 con 0x7eff1c0cda30 2024-09-13T18:32:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff20c1c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0cb960 con 0x7eff1c143e80 2024-09-13T18:32:19.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff19d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7eff1c0caee0 0x7eff1c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33270/0 (socket says 172.21.15.53:33270) 2024-09-13T18:32:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff19d9b640 1 -- 172.21.15.53:0/2950909486 learned_addr learned my addr 172.21.15.53:0/2950909486 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1a59c640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 0x7eff1c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602762033 0 0) 0x7eff1c06f7a0 con 0x7eff1c0caee0 2024-09-13T18:32:19.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff08003530 con 0x7eff1c0caee0 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118548272 0 0) 0x7eff08003530 con 0x7eff1c0caee0 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 msgr2=0x7eff1c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 0x7eff1c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 >> v1:172.21.15.87:6789/0 conn(0x7eff1c0cda30 legacy=0x7eff1c0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0cbc40 con 0x7eff1c0caee0 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7eff04001680 con 0x7eff1c0caee0 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 >> v1:172.21.15.53:6789/0 conn(0x7eff1c0caee0 legacy=0x7eff1c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 0x7eff080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff08003ef0 0x7eff080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff08004d10 0x7eff08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0cb960 con 0x7eff08004d10 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0800baa0 con 0x7eff08003ef0 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0800bc60 con 0x7eff1c143e80 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1ad9d640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff08004d10 0x7eff08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1a59c640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 0x7eff080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff19d9b640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff08003ef0 0x7eff080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1ad9d640 1 -- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 msgr2=0x7eff080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1ad9d640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c143e80 0x7eff080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1ad9d640 1 -- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff08003ef0 msgr2=0x7eff080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1ad9d640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff08003ef0 0x7eff080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.069+0000 7eff1ad9d640 1 -- 172.21.15.53:0/2950909486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08003530 con 0x7eff08004d10 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff1ad9d640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff08004d10 0x7eff08005190 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7eff0c001910 tx=0x7eff0c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba8926aa1aa33ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0ab670 con 0x7eff08004d10 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0ab7f0 con 0x7eff08004d10 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff1959a640 1 -- 172.21.15.53:0/2950909486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0abba0 con 0x7eff08004d10 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff20c1c640 1 -- 172.21.15.53:0/2950909486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff08004d10 msgr2=0x7eff08005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff20c1c640 1 --2- 172.21.15.53:0/2950909486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff08004d10 0x7eff08005190 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7eff0c001910 tx=0x7eff0c01c530 comp rx=0 tx=0).stop 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff1ad9d640 1 -- 172.21.15.53:0/2950909486 reap_dead start 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff20c1c640 1 -- 172.21.15.53:0/2950909486 shutdown_connections 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff20c1c640 1 -- 172.21.15.53:0/2950909486 >> 172.21.15.53:0/2950909486 conn(0x7eff1c065c80 msgr2=0x7eff1c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff20c1c640 1 -- 172.21.15.53:0/2950909486 shutdown_connections 2024-09-13T18:32:19.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.073+0000 7eff20c1c640 1 -- 172.21.15.53:0/2950909486 wait complete. 2024-09-13T18:32:19.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 Processor -- start 2024-09-13T18:32:19.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 -- start start 2024-09-13T18:32:19.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c142800 0x7eff1c0c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c142be0 0x7eff1c0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff1c1f3580 0x7eff1c1f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0aa060 con 0x7eff1c1f3580 2024-09-13T18:32:19.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0aa340 con 0x7eff1c142800 2024-09-13T18:32:19.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0aa620 con 0x7eff1c142be0 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff1c1f3580 0x7eff1c1f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff1c1f3580 0x7eff1c1f3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42870/0 (socket says 172.21.15.53:42870) 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 -- 172.21.15.53:0/3014590226 learned_addr learned my addr 172.21.15.53:0/3014590226 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1a59c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c142800 0x7eff1c0c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff19d9b640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c142be0 0x7eff1c0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 -- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c142be0 msgr2=0x7eff1c0c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c142be0 0x7eff1c0c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 -- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c142800 msgr2=0x7eff1c0c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c142800 0x7eff1c0c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 -- 172.21.15.53:0/3014590226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0aa900 con 0x7eff1c1f3580 2024-09-13T18:32:19.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1a59c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c142800 0x7eff1c0c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:19.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff19d9b640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c142be0 0x7eff1c0c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:19.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff1ad9d640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff1c1f3580 0x7eff1c1f3a10 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7eff0c001910 tx=0x7eff08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff12ffd640 1 -- 172.21.15.53:0/3014590226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0ab670 con 0x7eff1c1f3580 2024-09-13T18:32:19.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff12ffd640 1 -- 172.21.15.53:0/3014590226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c007a80 con 0x7eff1c1f3580 2024-09-13T18:32:19.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff12ffd640 1 -- 172.21.15.53:0/3014590226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0abb60 con 0x7eff1c1f3580 2024-09-13T18:32:19.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c0aabe0 con 0x7eff1c1f3580 2024-09-13T18:32:19.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c1f4120 con 0x7eff1c1f3580 2024-09-13T18:32:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.077+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0cd320 con 0x7eff1c1f3580 2024-09-13T18:32:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.081+0000 7eff12ffd640 1 -- 172.21.15.53:0/3014590226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7eff0c0abcc0 con 0x7eff1c1f3580 2024-09-13T18:32:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.081+0000 7eff12ffd640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efefc066c30 0x7efefc0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.081+0000 7eff12ffd640 1 -- 172.21.15.53:0/3014590226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5795+0+0 (secure 0 0 0) 0x7eff0c11dcd0 con 0x7eff1c1f3580 2024-09-13T18:32:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.081+0000 7eff1a59c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efefc066c30 0x7efefc0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.081+0000 7eff1a59c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efefc066c30 0x7efefc0690f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff14007440 tx=0x7eff1400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.085+0000 7eff12ffd640 1 -- 172.21.15.53:0/3014590226 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff0c0ee180 con 0x7eff1c1f3580 2024-09-13T18:32:19.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.249+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff1c0aada0 con 0x7eff1c1f3580 2024-09-13T18:32:19.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff12ffd640 1 -- 172.21.15.53:0/3014590226 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff0c000e50 con 0x7eff1c1f3580 2024-09-13T18:32:19.254 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:32:19.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efefc066c30 msgr2=0x7efefc0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efefc066c30 0x7efefc0690f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff14007440 tx=0x7eff1400b040 comp rx=0 tx=0).stop 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff1c1f3580 msgr2=0x7eff1c1f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff1c1f3580 0x7eff1c1f3a10 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7eff0c001910 tx=0x7eff08005800 comp rx=0 tx=0).stop 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 shutdown_connections 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efefc066c30 0x7efefc0690f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff1c142be0 0x7eff1c0c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff1c1f3580 0x7eff1c1f3a10 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 --2- 172.21.15.53:0/3014590226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c142800 0x7eff1c0c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 >> 172.21.15.53:0/3014590226 conn(0x7eff1c065c80 msgr2=0x7eff1c0ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 shutdown_connections 2024-09-13T18:32:19.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.253+0000 7eff20c1c640 1 -- 172.21.15.53:0/3014590226 wait complete. 2024-09-13T18:32:19.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:19.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.393+0000 7f3654deb640 1 Processor -- start 2024-09-13T18:32:19.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.393+0000 7f3654deb640 1 -- start start 2024-09-13T18:32:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f365015c830 0x7f36500cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36500cf800 0x7f36501662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365015cc10 con 0x7f36500b7b40 2024-09-13T18:32:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500b50c0 con 0x7f365015c830 2024-09-13T18:32:19.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500b41d0 con 0x7f36500cf800 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f365015c830 0x7f36500cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f365015c830 0x7f36500cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42886/0 (socket says 172.21.15.53:42886) 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3647fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f36500b7b40 0x7f36500cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33272/0 (socket says 172.21.15.53:33272) 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 -- 172.21.15.53:0/1115006469 learned_addr learned my addr 172.21.15.53:0/1115006469 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364ed9d640 1 --2- 172.21.15.53:0/1115006469 >> v2:172.21.15.87:3300/0 conn(0x7f36500cf800 0x7f36501662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 -- 172.21.15.53:0/1115006469 >> v2:172.21.15.87:3300/0 conn(0x7f36500cf800 msgr2=0x7f36501662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364dd9b640 1 -- 172.21.15.53:0/1115006469 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671944983 0 0) 0x7f3638004a80 con 0x7f36500b7b40 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 --2- 172.21.15.53:0/1115006469 >> v2:172.21.15.87:3300/0 conn(0x7f36500cf800 0x7f36501662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 -- 172.21.15.53:0/1115006469 >> v1:172.21.15.53:6789/0 conn(0x7f36500b7b40 legacy=0x7f36500cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 -- 172.21.15.53:0/1115006469 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500b44b0 con 0x7f365015c830 2024-09-13T18:32:19.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364ed9d640 1 --2- 172.21.15.53:0/1115006469 >> v2:172.21.15.87:3300/0 conn(0x7f36500cf800 0x7f36501662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:19.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364e59c640 1 --2- 172.21.15.53:0/1115006469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365015c830 0x7f36500cd930 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f36500d0110 tx=0x7f364001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47927cc726333689 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364dd9b640 1 -- 172.21.15.53:0/1115006469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400a8a10 con 0x7f365015c830 2024-09-13T18:32:19.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364dd9b640 1 -- 172.21.15.53:0/1115006469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400a8b70 con 0x7f365015c830 2024-09-13T18:32:19.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f364dd9b640 1 -- 172.21.15.53:0/1115006469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400b0440 con 0x7f365015c830 2024-09-13T18:32:19.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- 172.21.15.53:0/1115006469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365015c830 msgr2=0x7f36500cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 --2- 172.21.15.53:0/1115006469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365015c830 0x7f36500cd930 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f36500d0110 tx=0x7f364001ed10 comp rx=0 tx=0).stop 2024-09-13T18:32:19.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- 172.21.15.53:0/1115006469 shutdown_connections 2024-09-13T18:32:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 --2- 172.21.15.53:0/1115006469 >> v2:172.21.15.87:3300/0 conn(0x7f36500cf800 0x7f36501662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 --2- 172.21.15.53:0/1115006469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f365015c830 0x7f36500cd930 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- 172.21.15.53:0/1115006469 >> 172.21.15.53:0/1115006469 conn(0x7f3650070970 msgr2=0x7f3650070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- 172.21.15.53:0/1115006469 shutdown_connections 2024-09-13T18:32:19.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.397+0000 7f3654deb640 1 -- 172.21.15.53:0/1115006469 wait complete. 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 Processor -- start 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 -- start start 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36500b7b40 0x7f365015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36500cf800 0x7f36501e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f365015c830 0x7f36501e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501e8960 con 0x7f36500cf800 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501e6190 con 0x7f36500b7b40 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365015b4a0 con 0x7f365015c830 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36500cf800 0x7f36501e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36500cf800 0x7f36501e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42892/0 (socket says 172.21.15.53:42892) 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 -- 172.21.15.53:0/1604343554 learned_addr learned my addr 172.21.15.53:0/1604343554 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 -- 172.21.15.53:0/1604343554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f365015c830 msgr2=0x7f36501e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f365015c830 0x7f36501e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 -- 172.21.15.53:0/1604343554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36500b7b40 msgr2=0x7f365015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36500b7b40 0x7f365015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 -- 172.21.15.53:0/1604343554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400094d0 con 0x7f36500cf800 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3647fff640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36500cf800 0x7f36501e5710 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f363800b890 tx=0x7f363800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3646ffd640 1 -- 172.21.15.53:0/1604343554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800cbd0 con 0x7f36500cf800 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3646ffd640 1 -- 172.21.15.53:0/1604343554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363800cd30 con 0x7f36500cf800 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3646ffd640 1 -- 172.21.15.53:0/1604343554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380156b0 con 0x7f36500cf800 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36501e8d80 con 0x7f36500cf800 2024-09-13T18:32:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36501e8050 con 0x7f36500cf800 2024-09-13T18:32:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36501e8aa0 con 0x7f36500cf800 2024-09-13T18:32:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.401+0000 7f3646ffd640 1 -- 172.21.15.53:0/1604343554 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f3638012070 con 0x7f36500cf800 2024-09-13T18:32:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.405+0000 7f3646ffd640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3630066c30 0x7f36300690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.405+0000 7f3646ffd640 1 -- 172.21.15.53:0/1604343554 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3638084460 con 0x7f36500cf800 2024-09-13T18:32:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.405+0000 7f364e59c640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3630066c30 0x7f36300690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.405+0000 7f364e59c640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3630066c30 0x7f36300690f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f36400b2000 tx=0x7f3640004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.409+0000 7f3646ffd640 1 -- 172.21.15.53:0/1604343554 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36501e8aa0 con 0x7f36500cf800 2024-09-13T18:32:19.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.605+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f365015cc10 con 0x7f36500cf800 2024-09-13T18:32:19.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.605+0000 7f3646ffd640 1 -- 172.21.15.53:0/1604343554 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f365015cc10 con 0x7f36500cf800 2024-09-13T18:32:19.608 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:19.608 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3448118459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3448118459},{"type":"v1","addr":"172.21.15.87:6833","nonce":3448118459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2784676391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2784676391},{"type":"v1","addr":"172.21.15.87:6835","nonce":2784676391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1340459922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1340459922},{"type":"v1","addr":"172.21.15.53:6833","nonce":1340459922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:56.042381+0000","modified":"2024-09-13T18:31:59.056844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8472":{"gid":8472,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2654273195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2654273195},{"type":"v1","addr":"172.21.15.53:6835","nonce":2654273195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:32:19.608 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 72 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3630066c30 msgr2=0x7f36300690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3630066c30 0x7f36300690f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f36400b2000 tx=0x7f3640004740 comp rx=0 tx=0).stop 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36500cf800 msgr2=0x7f36501e5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36500cf800 0x7f36501e5710 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f363800b890 tx=0x7f363800bd50 comp rx=0 tx=0).stop 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 shutdown_connections 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3630066c30 0x7f36300690f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f365015c830 0x7f36501e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36500cf800 0x7f36501e5710 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 --2- 172.21.15.53:0/1604343554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36500b7b40 0x7f365015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 >> 172.21.15.53:0/1604343554 conn(0x7f3650070970 msgr2=0x7f36500d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:19.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 shutdown_connections 2024-09-13T18:32:19.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.609+0000 7f3654deb640 1 -- 172.21.15.53:0/1604343554 wait complete. 2024-09-13T18:32:19.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:19.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.753+0000 7f212a682640 1 Processor -- start 2024-09-13T18:32:19.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.753+0000 7f212a682640 1 -- start start 2024-09-13T18:32:19.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.753+0000 7f212a682640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21240b1960 0x7f21240b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.753+0000 7f212a682640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21240ae5d0 0x7f21240aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.753+0000 7f212a682640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21240ad530 con 0x7f212415db40 2024-09-13T18:32:19.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.753+0000 7f212a682640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240ae1b0 con 0x7f21240ae5d0 2024-09-13T18:32:19.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.753+0000 7f212a682640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21240ad810 con 0x7f21240b1960 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21240ae5d0 0x7f21240aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21240ae5d0 0x7f21240aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42896/0 (socket says 172.21.15.53:42896) 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 -- 172.21.15.53:0/156384645 learned_addr learned my addr 172.21.15.53:0/156384645 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f211bfff640 1 --2- 172.21.15.53:0/156384645 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21240b1960 0x7f21240b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 -- 172.21.15.53:0/156384645 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21240b1960 msgr2=0x7f21240b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 --2- 172.21.15.53:0/156384645 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21240b1960 0x7f21240b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 -- 172.21.15.53:0/156384645 >> v1:172.21.15.87:6789/0 conn(0x7f212415db40 legacy=0x7f21240afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 -- 172.21.15.53:0/156384645 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240adaf0 con 0x7f21240ae5d0 2024-09-13T18:32:19.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f2128c1f640 1 --2- 172.21.15.53:0/156384645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21240aea20 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f211c009e50 tx=0x7f211c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30951c0258a3a0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.757+0000 7f21237fe640 1 -- 172.21.15.53:0/156384645 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0a5810 con 0x7f21240ae5d0 2024-09-13T18:32:19.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f21237fe640 1 -- 172.21.15.53:0/156384645 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c0a5970 con 0x7f21240ae5d0 2024-09-13T18:32:19.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f21237fe640 1 -- 172.21.15.53:0/156384645 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0a5d00 con 0x7f21240ae5d0 2024-09-13T18:32:19.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- 172.21.15.53:0/156384645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 msgr2=0x7f21240aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 --2- 172.21.15.53:0/156384645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21240aea20 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f211c009e50 tx=0x7f211c01c970 comp rx=0 tx=0).stop 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- 172.21.15.53:0/156384645 shutdown_connections 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 --2- 172.21.15.53:0/156384645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21240aea20 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 --2- 172.21.15.53:0/156384645 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21240b1960 0x7f21240b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- 172.21.15.53:0/156384645 >> 172.21.15.53:0/156384645 conn(0x7f21240b20d0 msgr2=0x7f21240b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- 172.21.15.53:0/156384645 shutdown_connections 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- 172.21.15.53:0/156384645 wait complete. 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 Processor -- start 2024-09-13T18:32:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- start start 2024-09-13T18:32:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21241485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21240b1960 0x7f212415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f212415db40 0x7f212414c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124150b70 con 0x7f21240ae5d0 2024-09-13T18:32:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212415c2e0 con 0x7f21240b1960 2024-09-13T18:32:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212415b6d0 con 0x7f212415db40 2024-09-13T18:32:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21241485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21241485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42908/0 (socket says 172.21.15.53:42908) 2024-09-13T18:32:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 -- 172.21.15.53:0/2777886668 learned_addr learned my addr 172.21.15.53:0/2777886668 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 -- 172.21.15.53:0/2777886668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f212415db40 msgr2=0x7f212414c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f211bfff640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21240b1960 0x7f212415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f212415db40 0x7f212414c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 -- 172.21.15.53:0/2777886668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21240b1960 msgr2=0x7f212415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21240b1960 0x7f212415c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 -- 172.21.15.53:0/2777886668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c009b30 con 0x7f21240ae5d0 2024-09-13T18:32:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f2123fff640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21241485a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f211400c3f0 tx=0x7f211400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f21217fa640 1 -- 172.21.15.53:0/2777886668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21140052d0 con 0x7f21240ae5d0 2024-09-13T18:32:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f21217fa640 1 -- 172.21.15.53:0/2777886668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114005430 con 0x7f21240ae5d0 2024-09-13T18:32:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212415b9b0 con 0x7f21240ae5d0 2024-09-13T18:32:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f21217fa640 1 -- 172.21.15.53:0/2777886668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114003840 con 0x7f21240ae5d0 2024-09-13T18:32:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.761+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212415bf70 con 0x7f21240ae5d0 2024-09-13T18:32:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.765+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2124073a10 con 0x7f21240ae5d0 2024-09-13T18:32:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.765+0000 7f21217fa640 1 -- 172.21.15.53:0/2777886668 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f21140039a0 con 0x7f21240ae5d0 2024-09-13T18:32:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.765+0000 7f21217fa640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2104066c60 0x7f2104069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.765+0000 7f21217fa640 1 -- 172.21.15.53:0/2777886668 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f21140842a0 con 0x7f21240ae5d0 2024-09-13T18:32:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.765+0000 7f211bfff640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2104066c60 0x7f2104069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.765+0000 7f211bfff640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2104066c60 0x7f2104069120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f21240caba0 tx=0x7f210c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.769+0000 7f21217fa640 1 -- 172.21.15.53:0/2777886668 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2114050c70 con 0x7f21240ae5d0 2024-09-13T18:32:19.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.925+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21240aea20 con 0x7f21240ae5d0 2024-09-13T18:32:19.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.929+0000 7f21217fa640 1 -- 172.21.15.53:0/2777886668 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16628 (secure 0 0 0) 0x7f2114054290 con 0x7f21240ae5d0 2024-09-13T18:32:19.931 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:19.932 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":124,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:18.926381+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":123,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:19.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.929+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2104066c60 msgr2=0x7f2104069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.929+0000 7f212a682640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2104066c60 0x7f2104069120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f21240caba0 tx=0x7f210c008040 comp rx=0 tx=0).stop 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.929+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 msgr2=0x7f21241485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.929+0000 7f212a682640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21241485a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f211400c3f0 tx=0x7f211400c8b0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 shutdown_connections 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2104066c60 0x7f2104069120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f212415db40 0x7f212414c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21240b1960 0x7f212415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 --2- 172.21.15.53:0/2777886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21240ae5d0 0x7f21241485a0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:19.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 >> 172.21.15.53:0/2777886668 conn(0x7f21240b20d0 msgr2=0x7f212406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:19.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 shutdown_connections 2024-09-13T18:32:19.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:19.933+0000 7f212a682640 1 -- 172.21.15.53:0/2777886668 wait complete. 2024-09-13T18:32:19.950 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:32:19.950 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd86d535640 1 Processor -- start 2024-09-13T18:32:20.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd86d535640 1 -- start start 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd86d535640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 0x7fd86806c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd86d535640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86806e200 con 0x7fd8680cf9f0 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd86d535640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86815d1a0 con 0x7fd86806ddc0 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd86d535640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815d480 con 0x7fd8681591c0 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd8677fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd8680cf9f0 0x7fd868159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33288/0 (socket says 172.21.15.53:33288) 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd8677fe640 1 -- 172.21.15.53:0/75171495 learned_addr learned my addr 172.21.15.53:0/75171495 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd866ffd640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 0x7fd86806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751911806 0 0) 0x7fd86806e200 con 0x7fd8680cf9f0 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd850003530 con 0x7fd8680cf9f0 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994683832 0 0) 0x7fd850003530 con 0x7fd8680cf9f0 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 msgr2=0x7fd86806c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 0x7fd86806c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 >> v1:172.21.15.87:6789/0 conn(0x7fd86806ddc0 legacy=0x7fd8680cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86815d760 con 0x7fd8680cf9f0 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd860001a00 con 0x7fd8680cf9f0 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 >> v1:172.21.15.53:6789/0 conn(0x7fd8680cf9f0 legacy=0x7fd868159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8500039b0 0x7fd850003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 0x7fd8500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd850004d10 0x7fd850005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86815d480 con 0x7fd8500039b0 2024-09-13T18:32:20.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85000ba40 con 0x7fd850004d10 2024-09-13T18:32:20.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85000bc00 con 0x7fd8681591c0 2024-09-13T18:32:20.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.073+0000 7fd866ffd640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8500039b0 0x7fd850003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd8667fc640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 0x7fd8500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd8677fe640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd850004d10 0x7fd850005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd866ffd640 1 -- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 msgr2=0x7fd8500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:20.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd866ffd640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8681591c0 0x7fd8500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd866ffd640 1 -- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd850004d10 msgr2=0x7fd850005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:20.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd866ffd640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd850004d10 0x7fd850005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd866ffd640 1 -- 172.21.15.53:0/75171495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850003530 con 0x7fd8500039b0 2024-09-13T18:32:20.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd8677fe640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd850004d10 0x7fd850005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd866ffd640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8500039b0 0x7fd850003dd0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd85800bd50 tx=0x7fd85801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337b42337482357e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580ae600 con 0x7fd8500039b0 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8580aa050 con 0x7fd8500039b0 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd865ffb640 1 -- 172.21.15.53:0/75171495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580ae9a0 con 0x7fd8500039b0 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd86d535640 1 -- 172.21.15.53:0/75171495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8500039b0 msgr2=0x7fd850003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd86d535640 1 --2- 172.21.15.53:0/75171495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8500039b0 0x7fd850003dd0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd85800bd50 tx=0x7fd85801f350 comp rx=0 tx=0).stop 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd8677fe640 1 -- 172.21.15.53:0/75171495 reap_dead start 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd86d535640 1 -- 172.21.15.53:0/75171495 shutdown_connections 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd86d535640 1 -- 172.21.15.53:0/75171495 >> 172.21.15.53:0/75171495 conn(0x7fd868073130 msgr2=0x7fd868069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:20.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd86d535640 1 -- 172.21.15.53:0/75171495 shutdown_connections 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.077+0000 7fd86d535640 1 -- 172.21.15.53:0/75171495 wait complete. 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 Processor -- start 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 -- start start 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd86814a140 0x7fd8680b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8680b14f0 0x7fd8680ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8680ce7a0 0x7fd8680ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8681f6bc0 con 0x7fd8680b14f0 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86814a520 con 0x7fd86814a140 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680cec20 con 0x7fd8680ce7a0 2024-09-13T18:32:20.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8680b14f0 0x7fd8680ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8680b14f0 0x7fd8680ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42926/0 (socket says 172.21.15.53:42926) 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 -- 172.21.15.53:0/3859712328 learned_addr learned my addr 172.21.15.53:0/3859712328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd866ffd640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd86814a140 0x7fd8680b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8677fe640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8680ce7a0 0x7fd8680ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 -- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8680ce7a0 msgr2=0x7fd8680ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8680ce7a0 0x7fd8680ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 -- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd86814a140 msgr2=0x7fd8680b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd86814a140 0x7fd8680b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 -- 172.21.15.53:0/3859712328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8681f5f40 con 0x7fd8680b14f0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd8667fc640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8680b14f0 0x7fd8680ce260 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e4b0 tx=0x7fd85c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd84f7fe640 1 -- 172.21.15.53:0/3859712328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0052e0 con 0x7fd8680b14f0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd84f7fe640 1 -- 172.21.15.53:0/3859712328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c005440 con 0x7fd8680b14f0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8681f6220 con 0x7fd8680b14f0 2024-09-13T18:32:20.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd84f7fe640 1 -- 172.21.15.53:0/3859712328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c003840 con 0x7fd8680b14f0 2024-09-13T18:32:20.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8681f67e0 con 0x7fd8680b14f0 2024-09-13T18:32:20.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8681f6d00 con 0x7fd8680b14f0 2024-09-13T18:32:20.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.081+0000 7fd84f7fe640 1 -- 172.21.15.53:0/3859712328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fd85c0039a0 con 0x7fd8680b14f0 2024-09-13T18:32:20.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.085+0000 7fd84f7fe640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd854066c30 0x7fd8540690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.085+0000 7fd84f7fe640 1 -- 172.21.15.53:0/3859712328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd85c084a50 con 0x7fd8680b14f0 2024-09-13T18:32:20.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.085+0000 7fd866ffd640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd854066c30 0x7fd8540690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.085+0000 7fd866ffd640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd854066c30 0x7fd8540690f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd8580b0000 tx=0x7fd8580046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.089+0000 7fd84f7fe640 1 -- 172.21.15.53:0/3859712328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8681f6d00 con 0x7fd8680b14f0 2024-09-13T18:32:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.277+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8681f6d00 con 0x7fd8680b14f0 2024-09-13T18:32:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.277+0000 7fd84f7fe640 1 -- 172.21.15.53:0/3859712328 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fd85c051460 con 0x7fd8680b14f0 2024-09-13T18:32:20.280 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:20.281 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3448118459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3448118459},{"type":"v1","addr":"172.21.15.87:6833","nonce":3448118459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2784676391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2784676391},{"type":"v1","addr":"172.21.15.87:6835","nonce":2784676391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1340459922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1340459922},{"type":"v1","addr":"172.21.15.53:6833","nonce":1340459922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:56.042381+0000","modified":"2024-09-13T18:31:59.056844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8472":{"gid":8472,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2654273195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2654273195},{"type":"v1","addr":"172.21.15.53:6835","nonce":2654273195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:32:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 72 2024-09-13T18:32:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd854066c30 msgr2=0x7fd8540690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd854066c30 0x7fd8540690f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd8580b0000 tx=0x7fd8580046d0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8680b14f0 msgr2=0x7fd8680ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8680b14f0 0x7fd8680ce260 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e4b0 tx=0x7fd85c00e970 comp rx=0 tx=0).stop 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 shutdown_connections 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd854066c30 0x7fd8540690f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8680ce7a0 0x7fd8680ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8680b14f0 0x7fd8680ce260 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 --2- 172.21.15.53:0/3859712328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd86814a140 0x7fd8680b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 >> 172.21.15.53:0/3859712328 conn(0x7fd868073130 msgr2=0x7fd8680cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 shutdown_connections 2024-09-13T18:32:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.281+0000 7fd86d535640 1 -- 172.21.15.53:0/3859712328 wait complete. 2024-09-13T18:32:20.298 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.409+0000 7fbc035ba640 1 Processor -- start 2024-09-13T18:32:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.409+0000 7fbc035ba640 1 -- start start 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc035ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbfc06b850 0x7fbbfc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc035ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc0cbd60 0x7fbbfc0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc035ba640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc0b1ac0 con 0x7fbbfc0cb980 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc035ba640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b3010 con 0x7fbbfc06b850 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc035ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc159ac0 con 0x7fbbfc0cbd60 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbfc06b850 0x7fbbfc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbfc06b850 0x7fbbfc0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42932/0 (socket says 172.21.15.53:42932) 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 -- 172.21.15.53:0/2801818393 learned_addr learned my addr 172.21.15.53:0/2801818393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:20.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc01b57640 1 --2- 172.21.15.53:0/2801818393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc0cbd60 0x7fbbfc0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 -- 172.21.15.53:0/2801818393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc0cbd60 msgr2=0x7fbbfc0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 --2- 172.21.15.53:0/2801818393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc0cbd60 0x7fbbfc0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 -- 172.21.15.53:0/2801818393 >> v1:172.21.15.87:6789/0 conn(0x7fbbfc0cb980 legacy=0x7fbbfc06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:20.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 -- 172.21.15.53:0/2801818393 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc159da0 con 0x7fbbfc06b850 2024-09-13T18:32:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbc00b55640 1 --2- 172.21.15.53:0/2801818393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc06b850 0x7fbbfc0b33b0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009870 tx=0x7fbbec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6c1035d789d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbbf3fff640 1 -- 172.21.15.53:0/2801818393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ab620 con 0x7fbbfc06b850 2024-09-13T18:32:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbbf3fff640 1 -- 172.21.15.53:0/2801818393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec0ab780 con 0x7fbbfc06b850 2024-09-13T18:32:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.413+0000 7fbbf3fff640 1 -- 172.21.15.53:0/2801818393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0abb10 con 0x7fbbfc06b850 2024-09-13T18:32:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- 172.21.15.53:0/2801818393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc06b850 msgr2=0x7fbbfc0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 --2- 172.21.15.53:0/2801818393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc06b850 0x7fbbfc0b33b0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009870 tx=0x7fbbec01c460 comp rx=0 tx=0).stop 2024-09-13T18:32:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- 172.21.15.53:0/2801818393 shutdown_connections 2024-09-13T18:32:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 --2- 172.21.15.53:0/2801818393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc0cbd60 0x7fbbfc0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 --2- 172.21.15.53:0/2801818393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc06b850 0x7fbbfc0b33b0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- 172.21.15.53:0/2801818393 >> 172.21.15.53:0/2801818393 conn(0x7fbbfc065c80 msgr2=0x7fbbfc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- 172.21.15.53:0/2801818393 shutdown_connections 2024-09-13T18:32:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- 172.21.15.53:0/2801818393 wait complete. 2024-09-13T18:32:20.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 Processor -- start 2024-09-13T18:32:20.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- start start 2024-09-13T18:32:20.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc06b850 0x7fbbfc1420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc0cb980 0x7fbbfc141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbfc0cbd60 0x7fbbfc14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc149a70 con 0x7fbbfc0cb980 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc149720 con 0x7fbbfc0cbd60 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc14e760 con 0x7fbbfc06b850 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc0cb980 0x7fbbfc141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc0cb980 0x7fbbfc141350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42942/0 (socket says 172.21.15.53:42942) 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 -- 172.21.15.53:0/1089786463 learned_addr learned my addr 172.21.15.53:0/1089786463 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc01356640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc06b850 0x7fbbfc1420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc01b57640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbfc0cbd60 0x7fbbfc14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 -- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc06b850 msgr2=0x7fbbfc1420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc06b850 0x7fbbfc1420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 -- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbfc0cbd60 msgr2=0x7fbbfc14d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbfc0cbd60 0x7fbbfc14d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 -- 172.21.15.53:0/1089786463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0094d0 con 0x7fbbfc0cb980 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc00b55640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc0cb980 0x7fbbfc141350 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0ad040 tx=0x7fbbec01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbbf1ffb640 1 -- 172.21.15.53:0/1089786463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0be3f0 con 0x7fbbfc0cb980 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbbf1ffb640 1 -- 172.21.15.53:0/1089786463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec0be570 con 0x7fbbfc0cb980 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc14ea40 con 0x7fbbfc0cb980 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbbf1ffb640 1 -- 172.21.15.53:0/1089786463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0be920 con 0x7fbbfc0cb980 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.417+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc141890 con 0x7fbbfc0cb980 2024-09-13T18:32:20.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.421+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc067400 con 0x7fbbfc0cb980 2024-09-13T18:32:20.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.421+0000 7fbbf1ffb640 1 -- 172.21.15.53:0/1089786463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fbbec0b43f0 con 0x7fbbfc0cb980 2024-09-13T18:32:20.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.421+0000 7fbbf1ffb640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbbe0066c30 0x7fbbe00690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.421+0000 7fbc01356640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbbe0066c30 0x7fbbe00690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.421+0000 7fbbf1ffb640 1 -- 172.21.15.53:0/1089786463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbbec11ead0 con 0x7fbbfc0cb980 2024-09-13T18:32:20.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.421+0000 7fbc01356640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbbe0066c30 0x7fbbe00690f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc163470 tx=0x7fbbf8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.425+0000 7fbbf1ffb640 1 -- 172.21.15.53:0/1089786463 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbbec0eb460 con 0x7fbbfc0cb980 2024-09-13T18:32:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.621+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbfc149bb0 con 0x7fbbfc0cb980 2024-09-13T18:32:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.621+0000 7fbbf1ffb640 1 -- 172.21.15.53:0/1089786463 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fbbfc149bb0 con 0x7fbbfc0cb980 2024-09-13T18:32:20.624 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:20.625 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3448118459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3448118459},{"type":"v1","addr":"172.21.15.87:6833","nonce":3448118459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2784676391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2784676391},{"type":"v1","addr":"172.21.15.87:6835","nonce":2784676391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1340459922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1340459922},{"type":"v1","addr":"172.21.15.53:6833","nonce":1340459922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:31:56.042381+0000","modified":"2024-09-13T18:31:59.056844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8472":{"gid":8472,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2654273195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2654273195},{"type":"v1","addr":"172.21.15.53:6835","nonce":2654273195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:32:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 72 2024-09-13T18:32:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbbe0066c30 msgr2=0x7fbbe00690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbbe0066c30 0x7fbbe00690f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc163470 tx=0x7fbbf8009040 comp rx=0 tx=0).stop 2024-09-13T18:32:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc0cb980 msgr2=0x7fbbfc141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc0cb980 0x7fbbfc141350 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0ad040 tx=0x7fbbec01aca0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 shutdown_connections 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbbe0066c30 0x7fbbe00690f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbfc0cbd60 0x7fbbfc14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbfc0cb980 0x7fbbfc141350 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 --2- 172.21.15.53:0/1089786463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbfc06b850 0x7fbbfc1420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 >> 172.21.15.53:0/1089786463 conn(0x7fbbfc065c80 msgr2=0x7fbbfc0cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 shutdown_connections 2024-09-13T18:32:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.625+0000 7fbc035ba640 1 -- 172.21.15.53:0/1089786463 wait complete. 2024-09-13T18:32:20.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:20.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.765+0000 7f805bc5e640 1 Processor -- start 2024-09-13T18:32:20.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.765+0000 7f805bc5e640 1 -- start start 2024-09-13T18:32:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8054158ba0 0x7f805406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f805406fa80 0x7f80540b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80540b2340 con 0x7f80540cbb60 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80540b2860 con 0x7f8054158ba0 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8054158f80 con 0x7f805406fa80 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8054158ba0 0x7f805406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8054158ba0 0x7f805406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42946/0 (socket says 172.21.15.53:42946) 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 -- 172.21.15.53:0/1559083962 learned_addr learned my addr 172.21.15.53:0/1559083962 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80591f9640 1 --1- 172.21.15.53:0/1559083962 >> v1:172.21.15.53:6789/0 conn(0x7f80540cbb60 0x7f805406f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33300/0 (socket says 172.21.15.53:33300) 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805a1fb640 1 --2- 172.21.15.53:0/1559083962 >> v2:172.21.15.87:3300/0 conn(0x7f805406fa80 0x7f80540b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 -- 172.21.15.53:0/1559083962 >> v2:172.21.15.87:3300/0 conn(0x7f805406fa80 msgr2=0x7f80540b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 --2- 172.21.15.53:0/1559083962 >> v2:172.21.15.87:3300/0 conn(0x7f805406fa80 0x7f80540b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 -- 172.21.15.53:0/1559083962 >> v1:172.21.15.53:6789/0 conn(0x7f80540cbb60 legacy=0x7f805406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 -- 172.21.15.53:0/1559083962 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80540b2580 con 0x7f8054158ba0 2024-09-13T18:32:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80589f8640 1 -- 172.21.15.53:0/1559083962 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076195674 0 0) 0x7f8048001120 con 0x7f80540cbb60 2024-09-13T18:32:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80599fa640 1 --2- 172.21.15.53:0/1559083962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054158ba0 0x7f805406b390 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f805000aa10 tx=0x7f805001d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01a4a8cfbc2c7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80589f8640 1 -- 172.21.15.53:0/1559083962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500a6890 con 0x7f8054158ba0 2024-09-13T18:32:20.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80589f8640 1 -- 172.21.15.53:0/1559083962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80500a69f0 con 0x7f8054158ba0 2024-09-13T18:32:20.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f80589f8640 1 -- 172.21.15.53:0/1559083962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500a6d80 con 0x7f8054158ba0 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- 172.21.15.53:0/1559083962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054158ba0 msgr2=0x7f805406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 --2- 172.21.15.53:0/1559083962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054158ba0 0x7f805406b390 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f805000aa10 tx=0x7f805001d860 comp rx=0 tx=0).stop 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- 172.21.15.53:0/1559083962 shutdown_connections 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 --2- 172.21.15.53:0/1559083962 >> v2:172.21.15.87:3300/0 conn(0x7f805406fa80 0x7f80540b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 --2- 172.21.15.53:0/1559083962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8054158ba0 0x7f805406b390 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- 172.21.15.53:0/1559083962 >> 172.21.15.53:0/1559083962 conn(0x7f8054065c80 msgr2=0x7f8054066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- 172.21.15.53:0/1559083962 shutdown_connections 2024-09-13T18:32:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.769+0000 7f805bc5e640 1 -- 172.21.15.53:0/1559083962 wait complete. 2024-09-13T18:32:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 Processor -- start 2024-09-13T18:32:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 -- start start 2024-09-13T18:32:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805406fa80 0x7f805415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80540cbb60 0x7f8054154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8054158ba0 0x7f805413ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8054161d10 con 0x7f805406fa80 2024-09-13T18:32:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8054161ea0 con 0x7f80540cbb60 2024-09-13T18:32:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8054154d80 con 0x7f8054158ba0 2024-09-13T18:32:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805406fa80 0x7f805415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805406fa80 0x7f805415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42958/0 (socket says 172.21.15.53:42958) 2024-09-13T18:32:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 -- 172.21.15.53:0/4037410390 learned_addr learned my addr 172.21.15.53:0/4037410390 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805a1fb640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8054158ba0 0x7f805413ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80591f9640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80540cbb60 0x7f8054154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 -- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8054158ba0 msgr2=0x7f805413ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8054158ba0 0x7f805413ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 -- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80540cbb60 msgr2=0x7f8054154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80540cbb60 0x7f8054154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 -- 172.21.15.53:0/4037410390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805000a670 con 0x7f805406fa80 2024-09-13T18:32:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80591f9640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80540cbb60 0x7f8054154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80599fa640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805406fa80 0x7f805415dc00 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f805000a1c0 tx=0x7f805001c0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80467fc640 1 -- 172.21.15.53:0/4037410390 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500b9920 con 0x7f805406fa80 2024-09-13T18:32:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80467fc640 1 -- 172.21.15.53:0/4037410390 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80500b9a80 con 0x7f805406fa80 2024-09-13T18:32:20.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8054155060 con 0x7f805406fa80 2024-09-13T18:32:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f80467fc640 1 -- 172.21.15.53:0/4037410390 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500b9e30 con 0x7f805406fa80 2024-09-13T18:32:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8054155620 con 0x7f805406fa80 2024-09-13T18:32:20.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.773+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8054067400 con 0x7f805406fa80 2024-09-13T18:32:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.777+0000 7f80467fc640 1 -- 172.21.15.53:0/4037410390 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f80500b5070 con 0x7f805406fa80 2024-09-13T18:32:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.777+0000 7f80467fc640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8038066c30 0x7f80380690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.777+0000 7f80467fc640 1 -- 172.21.15.53:0/4037410390 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f805011f700 con 0x7f805406fa80 2024-09-13T18:32:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.777+0000 7f80591f9640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8038066c30 0x7f80380690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.777+0000 7f80591f9640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8038066c30 0x7f80380690f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8048007fd0 tx=0x7f8048009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:20.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.781+0000 7f80467fc640 1 -- 172.21.15.53:0/4037410390 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f80500ec450 con 0x7f805406fa80 2024-09-13T18:32:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.933+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80540b1e00 con 0x7f805406fa80 2024-09-13T18:32:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f80467fc640 1 -- 172.21.15.53:0/4037410390 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16628 (secure 0 0 0) 0x7f80500b3090 con 0x7f805406fa80 2024-09-13T18:32:20.939 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:20.939 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":124,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:18.926381+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:31:54.444062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:31:55.038831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":123,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.3f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8038066c30 msgr2=0x7f80380690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8038066c30 0x7f80380690f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8048007fd0 tx=0x7f8048009040 comp rx=0 tx=0).stop 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805406fa80 msgr2=0x7f805415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805406fa80 0x7f805415dc00 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f805000a1c0 tx=0x7f805001c0a0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 shutdown_connections 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8038066c30 0x7f80380690f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8054158ba0 0x7f805413ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80540cbb60 0x7f8054154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 --2- 172.21.15.53:0/4037410390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f805406fa80 0x7f805415dc00 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 >> 172.21.15.53:0/4037410390 conn(0x7f8054065c80 msgr2=0x7f80540b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 shutdown_connections 2024-09-13T18:32:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:20.937+0000 7f805bc5e640 1 -- 172.21.15.53:0/4037410390 wait complete. 2024-09-13T18:32:20.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:32:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1159cc6640 1 Processor -- start 2024-09-13T18:32:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1159cc6640 1 -- start start 2024-09-13T18:32:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1159cc6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f115415a470 0x7f11540cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1159cc6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11540b1c10 0x7f11540b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1159cc6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115406f550 con 0x7f115415cc60 2024-09-13T18:32:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1159cc6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115406f880 con 0x7f115415a470 2024-09-13T18:32:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1159cc6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540b25e0 con 0x7f11540b1c10 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f11537fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f115415a470 0x7f11540cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1152ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f115415cc60 0x7f1154071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:40990/0 (socket says 172.21.15.53:40990) 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1153fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11540b1c10 0x7f11540b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1152ffd640 1 -- 172.21.15.53:0/3559839047 learned_addr learned my addr 172.21.15.53:0/3559839047 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f11537fe640 1 -- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11540b1c10 msgr2=0x7f11540b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f11537fe640 1 --2- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11540b1c10 0x7f11540b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f11537fe640 1 -- 172.21.15.53:0/3559839047 >> v1:172.21.15.87:6789/0 conn(0x7f115415cc60 legacy=0x7f1154071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f11537fe640 1 -- 172.21.15.53:0/3559839047 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115415dc40 con 0x7f115415a470 2024-09-13T18:32:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.077+0000 7f1153fff640 1 --2- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11540b1c10 0x7f11540b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f11537fe640 1 --2- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f115415a470 0x7f11540cc270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f113c0097c0 tx=0x7f113c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e77fa8073dff49d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f11527fc640 1 -- 172.21.15.53:0/3559839047 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0a6040 con 0x7f115415a470 2024-09-13T18:32:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f11527fc640 1 -- 172.21.15.53:0/3559839047 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c0aa600 con 0x7f115415a470 2024-09-13T18:32:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f11527fc640 1 -- 172.21.15.53:0/3559839047 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0aa990 con 0x7f115415a470 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 -- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f115415a470 msgr2=0x7f11540cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 --2- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f115415a470 0x7f11540cc270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f113c0097c0 tx=0x7f113c01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 -- 172.21.15.53:0/3559839047 shutdown_connections 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 --2- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f11540b1c10 0x7f11540b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 --2- 172.21.15.53:0/3559839047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f115415a470 0x7f11540cc270 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 -- 172.21.15.53:0/3559839047 >> 172.21.15.53:0/3559839047 conn(0x7f1154065c80 msgr2=0x7f1154066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 -- 172.21.15.53:0/3559839047 shutdown_connections 2024-09-13T18:32:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.081+0000 7f1159cc6640 1 -- 172.21.15.53:0/3559839047 wait complete. 2024-09-13T18:32:21.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 Processor -- start 2024-09-13T18:32:21.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 -- start start 2024-09-13T18:32:21.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11540b1c10 0x7f1154150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f115415a470 0x7f11540c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f115415cc60 0x7f1154151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154152f30 con 0x7f115415cc60 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c3d80 con 0x7f11540b1c10 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c4060 con 0x7f115415a470 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f115415cc60 0x7f1154151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f115415cc60 0x7f1154151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42974/0 (socket says 172.21.15.53:42974) 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 -- 172.21.15.53:0/2370515963 learned_addr learned my addr 172.21.15.53:0/2370515963 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f11537fe640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11540b1c10 0x7f1154150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1152ffd640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f115415a470 0x7f11540c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 -- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f115415a470 msgr2=0x7f11540c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f115415a470 0x7f11540c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 -- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11540b1c10 msgr2=0x7f1154150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11540b1c10 0x7f1154150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 -- 172.21.15.53:0/2370515963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c009a70 con 0x7f115415cc60 2024-09-13T18:32:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1153fff640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f115415cc60 0x7f1154151730 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f114c00efc0 tx=0x7f114c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f114bfff640 1 -- 172.21.15.53:0/2370515963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c009d70 con 0x7f115415cc60 2024-09-13T18:32:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f114bfff640 1 -- 172.21.15.53:0/2370515963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c00f040 con 0x7f115415cc60 2024-09-13T18:32:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f114bfff640 1 -- 172.21.15.53:0/2370515963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0039a0 con 0x7f115415cc60 2024-09-13T18:32:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c009420 con 0x7f115415cc60 2024-09-13T18:32:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1154159200 con 0x7f115415cc60 2024-09-13T18:32:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.085+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1154067400 con 0x7f115415cc60 2024-09-13T18:32:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.089+0000 7f114bfff640 1 -- 172.21.15.53:0/2370515963 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f114c0144a0 con 0x7f115415cc60 2024-09-13T18:32:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.089+0000 7f114bfff640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1134066c30 0x7f11340690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.089+0000 7f114bfff640 1 -- 172.21.15.53:0/2370515963 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f114c085a20 con 0x7f115415cc60 2024-09-13T18:32:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.089+0000 7f11537fe640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1134066c30 0x7f11340690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.089+0000 7f11537fe640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1134066c30 0x7f11340690f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f113c0ae000 tx=0x7f113c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:21.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.093+0000 7f114bfff640 1 -- 172.21.15.53:0/2370515963 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f114c0523b0 con 0x7f115415cc60 2024-09-13T18:32:21.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.281+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f11540c4580 con 0x7f115415cc60 2024-09-13T18:32:21.285 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:32:21.281+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:32:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.301+0000 7f114bfff640 1 -- 172.21.15.53:0/2370515963 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f11540c4580 con 0x7f115415cc60 2024-09-13T18:32:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1134066c30 msgr2=0x7f11340690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1134066c30 0x7f11340690f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f113c0ae000 tx=0x7f113c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f115415cc60 msgr2=0x7f1154151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f115415cc60 0x7f1154151730 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f114c00efc0 tx=0x7f114c009f90 comp rx=0 tx=0).stop 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 shutdown_connections 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1134066c30 0x7f11340690f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f115415a470 0x7f11540c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f115415cc60 0x7f1154151730 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 --2- 172.21.15.53:0/2370515963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11540b1c10 0x7f1154150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 >> 172.21.15.53:0/2370515963 conn(0x7f1154065c80 msgr2=0x7f115406c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 shutdown_connections 2024-09-13T18:32:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.305+0000 7f1159cc6640 1 -- 172.21.15.53:0/2370515963 wait complete. 2024-09-13T18:32:21.324 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:32:21.340 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:32:21.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 Processor -- start 2024-09-13T18:32:21.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 -- start start 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f068415c830 0x7f06840d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840ccd10 0x7f06840cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f06840d2c80 0x7f06840d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06840d3670 con 0x7f068415c830 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06840b7db0 con 0x7f06840d2c80 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f068a298640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840d0650 con 0x7f06840ccd10 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f068415c830 0x7f06840d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f068415c830 0x7f06840d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43012/0 (socket says 172.21.15.53:43012) 2024-09-13T18:32:21.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 -- 172.21.15.53:0/823222811 learned_addr learned my addr 172.21.15.53:0/823222811 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0688835640 1 --2- 172.21.15.53:0/823222811 >> v2:172.21.15.87:3300/0 conn(0x7f06840d2c80 0x7f06840d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f06837fe640 1 --2- 172.21.15.53:0/823222811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840ccd10 0x7f06840cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 -- 172.21.15.53:0/823222811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840ccd10 msgr2=0x7f06840cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 --2- 172.21.15.53:0/823222811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840ccd10 0x7f06840cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 -- 172.21.15.53:0/823222811 >> v2:172.21.15.87:3300/0 conn(0x7f06840d2c80 msgr2=0x7f06840d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 --2- 172.21.15.53:0/823222811 >> v2:172.21.15.87:3300/0 conn(0x7f06840d2c80 0x7f06840d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0683fff640 1 -- 172.21.15.53:0/823222811 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840d0c10 con 0x7f068415c830 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f06837fe640 1 --2- 172.21.15.53:0/823222811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840ccd10 0x7f06840cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:21.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.433+0000 7f0688835640 1 --2- 172.21.15.53:0/823222811 >> v2:172.21.15.87:3300/0 conn(0x7f06840d2c80 0x7f06840d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f0683fff640 1 --2- 172.21.15.53:0/823222811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f068415c830 0x7f06840d10a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f06840d0190 tx=0x7f067401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ecc140d3548751 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f0682ffd640 1 -- 172.21.15.53:0/823222811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740a89d0 con 0x7f068415c830 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f0682ffd640 1 -- 172.21.15.53:0/823222811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06740a8b30 con 0x7f068415c830 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f0682ffd640 1 -- 172.21.15.53:0/823222811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740b0440 con 0x7f068415c830 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 -- 172.21.15.53:0/823222811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f068415c830 msgr2=0x7f06840d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 --2- 172.21.15.53:0/823222811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f068415c830 0x7f06840d10a0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f06840d0190 tx=0x7f067401ed10 comp rx=0 tx=0).stop 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 -- 172.21.15.53:0/823222811 shutdown_connections 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 --2- 172.21.15.53:0/823222811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840ccd10 0x7f06840cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 --2- 172.21.15.53:0/823222811 >> v2:172.21.15.87:3300/0 conn(0x7f06840d2c80 0x7f06840d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 --2- 172.21.15.53:0/823222811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f068415c830 0x7f06840d10a0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 -- 172.21.15.53:0/823222811 >> 172.21.15.53:0/823222811 conn(0x7f0684070970 msgr2=0x7f0684070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:21.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 -- 172.21.15.53:0/823222811 shutdown_connections 2024-09-13T18:32:21.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 -- 172.21.15.53:0/823222811 wait complete. 2024-09-13T18:32:21.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 Processor -- start 2024-09-13T18:32:21.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.437+0000 7f068a298640 1 -- start start 2024-09-13T18:32:21.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06840ccd10 0x7f06841565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840d2c80 0x7f06840cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f068415c830 0x7f06840b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0684157c90 con 0x7f06840ccd10 2024-09-13T18:32:21.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0684156bb0 con 0x7f068415c830 2024-09-13T18:32:21.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0684156e90 con 0x7f06840d2c80 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06840ccd10 0x7f06841565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06840ccd10 0x7f06841565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43024/0 (socket says 172.21.15.53:43024) 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 -- 172.21.15.53:0/3362807641 learned_addr learned my addr 172.21.15.53:0/3362807641 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0688835640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f068415c830 0x7f06840b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f06837fe640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840d2c80 0x7f06840cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 -- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840d2c80 msgr2=0x7f06840cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840d2c80 0x7f06840cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 -- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f068415c830 msgr2=0x7f06840b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f068415c830 0x7f06840b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 -- 172.21.15.53:0/3362807641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740094d0 con 0x7f06840ccd10 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0688835640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f068415c830 0x7f06840b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0683fff640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06840ccd10 0x7f06841565d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f06740b3040 tx=0x7f067401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:21.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0680ff9640 1 -- 172.21.15.53:0/3362807641 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740b0e80 con 0x7f06840ccd10 2024-09-13T18:32:21.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0680ff9640 1 -- 172.21.15.53:0/3362807641 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06740bb480 con 0x7f06840ccd10 2024-09-13T18:32:21.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0684157170 con 0x7f06840ccd10 2024-09-13T18:32:21.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0680ff9640 1 -- 172.21.15.53:0/3362807641 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06740bb810 con 0x7f06840ccd10 2024-09-13T18:32:21.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06840ccac0 con 0x7f06840ccd10 2024-09-13T18:32:21.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06840cd150 con 0x7f06840ccd10 2024-09-13T18:32:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0680ff9640 1 -- 172.21.15.53:0/3362807641 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f06740bb970 con 0x7f06840ccd10 2024-09-13T18:32:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0680ff9640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0670066c30 0x7f06700690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f0680ff9640 1 -- 172.21.15.53:0/3362807641 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0674123400 con 0x7f06840ccd10 2024-09-13T18:32:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f06837fe640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0670066c30 0x7f06700690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:21.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.441+0000 7f06837fe640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0670066c30 0x7f06700690f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0678006fd0 tx=0x7f0678008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:21.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.445+0000 7f0680ff9640 1 -- 172.21.15.53:0/3362807641 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06740efe70 con 0x7f06840ccd10 2024-09-13T18:32:21.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:21.637+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f06840b2ea0 con 0x7f06840ccd10 2024-09-13T18:32:22.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.305+0000 7f0680ff9640 1 -- 172.21.15.53:0/3362807641 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7f06740f3490 con 0x7f06840ccd10 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.305+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0670066c30 msgr2=0x7f06700690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.305+0000 7f068a298640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0670066c30 0x7f06700690f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0678006fd0 tx=0x7f0678008040 comp rx=0 tx=0).stop 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.305+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06840ccd10 msgr2=0x7f06841565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.305+0000 7f068a298640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06840ccd10 0x7f06841565d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f06740b3040 tx=0x7f067401bab0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 shutdown_connections 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0670066c30 0x7f06700690f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06840d2c80 0x7f06840cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f068415c830 0x7f06840b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 --2- 172.21.15.53:0/3362807641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06840ccd10 0x7f06841565d0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 >> 172.21.15.53:0/3362807641 conn(0x7f0684070970 msgr2=0x7f06840663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:22.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 shutdown_connections 2024-09-13T18:32:22.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.309+0000 7f068a298640 1 -- 172.21.15.53:0/3362807641 wait complete. 2024-09-13T18:32:22.331 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:32:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.505+0000 7f82ec9af640 1 Processor -- start 2024-09-13T18:32:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.505+0000 7f82ec9af640 1 -- start start 2024-09-13T18:32:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82ec9af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82ec9af640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82e80d1410 0x7f82e80cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82ec9af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80d1d10 con 0x7f82e80d1830 2024-09-13T18:32:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82ec9af640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e80d1ff0 con 0x7f82e80d1410 2024-09-13T18:32:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82ec9af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80d22d0 con 0x7f82e815c860 2024-09-13T18:32:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e5d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82e80d1410 0x7f82e80cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e659c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e659c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e80cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:36634/0 (socket says 172.21.15.53:36634) 2024-09-13T18:32:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e6d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f82e80d1830 0x7f82e80b4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:41008/0 (socket says 172.21.15.53:41008) 2024-09-13T18:32:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e5d9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82e80d1410 0x7f82e80cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:46574/0 (socket says 172.21.15.53:46574) 2024-09-13T18:32:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e659c640 1 -- 172.21.15.53:0/2130776103 learned_addr learned my addr 172.21.15.53:0/2130776103 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e659c640 1 -- 172.21.15.53:0/2130776103 >> v2:172.21.15.87:3300/0 conn(0x7f82e80d1410 msgr2=0x7f82e80cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e659c640 1 --2- 172.21.15.53:0/2130776103 >> v2:172.21.15.87:3300/0 conn(0x7f82e80d1410 0x7f82e80cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e659c640 1 -- 172.21.15.53:0/2130776103 >> v1:172.21.15.87:6789/0 conn(0x7f82e80d1830 legacy=0x7f82e80b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.509+0000 7f82e659c640 1 -- 172.21.15.53:0/2130776103 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e80b5be0 con 0x7f82e815c860 2024-09-13T18:32:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82e659c640 1 --2- 172.21.15.53:0/2130776103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e80cdb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009e50 tx=0x7f82d801f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4355066ff8e38be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82e559a640 1 -- 172.21.15.53:0/2130776103 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80af400 con 0x7f82e815c860 2024-09-13T18:32:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82e559a640 1 -- 172.21.15.53:0/2130776103 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d80ab050 con 0x7f82e815c860 2024-09-13T18:32:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82e559a640 1 -- 172.21.15.53:0/2130776103 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80af780 con 0x7f82e815c860 2024-09-13T18:32:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- 172.21.15.53:0/2130776103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 msgr2=0x7f82e80cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 --2- 172.21.15.53:0/2130776103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e80cdb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009e50 tx=0x7f82d801f210 comp rx=0 tx=0).stop 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- 172.21.15.53:0/2130776103 shutdown_connections 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 --2- 172.21.15.53:0/2130776103 >> v2:172.21.15.87:3300/0 conn(0x7f82e80d1410 0x7f82e80cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 --2- 172.21.15.53:0/2130776103 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e80cdb70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- 172.21.15.53:0/2130776103 >> 172.21.15.53:0/2130776103 conn(0x7f82e8065c80 msgr2=0x7f82e8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- 172.21.15.53:0/2130776103 shutdown_connections 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- 172.21.15.53:0/2130776103 wait complete. 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 Processor -- start 2024-09-13T18:32:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- start start 2024-09-13T18:32:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82e80d1410 0x7f82e8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82e80d1830 0x7f82e81f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80b3650 con 0x7f82e80d1830 2024-09-13T18:32:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80b38a0 con 0x7f82e80d1410 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82ec9af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80b3b80 con 0x7f82e815c860 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82e5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82e80d1830 0x7f82e81f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.513+0000 7f82e5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82e80d1830 0x7f82e81f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43030/0 (socket says 172.21.15.53:43030) 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e5d9b640 1 -- 172.21.15.53:0/1955378626 learned_addr learned my addr 172.21.15.53:0/1955378626 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e659c640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82e80d1410 0x7f82e8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e6d9d640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e5d9b640 1 -- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 msgr2=0x7f82e815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e5d9b640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e5d9b640 1 -- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82e80d1410 msgr2=0x7f82e8159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e5d9b640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82e80d1410 0x7f82e8159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e5d9b640 1 -- 172.21.15.53:0/1955378626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009b30 con 0x7f82e80d1830 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e659c640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82e80d1410 0x7f82e8159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e5d9b640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82e80d1830 0x7f82e81f2560 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00e930 tx=0x7f82dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82d6ffd640 1 -- 172.21.15.53:0/1955378626 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc009690 con 0x7f82e80d1830 2024-09-13T18:32:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82d6ffd640 1 -- 172.21.15.53:0/1955378626 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc00ca00 con 0x7f82e80d1830 2024-09-13T18:32:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80b3e60 con 0x7f82e80d1830 2024-09-13T18:32:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82d6ffd640 1 -- 172.21.15.53:0/1955378626 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00cd70 con 0x7f82e80d1830 2024-09-13T18:32:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e81f2aa0 con 0x7f82e80d1830 2024-09-13T18:32:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e80b76e0 con 0x7f82e80d1830 2024-09-13T18:32:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82d6ffd640 1 -- 172.21.15.53:0/1955378626 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f82dc013470 con 0x7f82e80d1830 2024-09-13T18:32:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82d6ffd640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f82c8066c30 0x7f82c80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82d6ffd640 1 -- 172.21.15.53:0/1955378626 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f82dc084e60 con 0x7f82e80d1830 2024-09-13T18:32:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e659c640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f82c8066c30 0x7f82c80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:22.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.517+0000 7f82e659c640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f82c8066c30 0x7f82c80690f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f82d80b1000 tx=0x7f82d80aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:22.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.521+0000 7f82d6ffd640 1 -- 172.21.15.53:0/1955378626 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82dc051a20 con 0x7f82e80d1830 2024-09-13T18:32:22.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:22.681+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f82e80c9f60 con 0x7f82e80d1830 2024-09-13T18:32:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.321+0000 7f82d6ffd640 1 -- 172.21.15.53:0/1955378626 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v126) v1 ==== 181+0+0 (secure 0 0 0) 0x7f82dc0170d0 con 0x7f82e80d1830 2024-09-13T18:32:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:32:23.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f82c8066c30 msgr2=0x7f82c80690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:23.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f82c8066c30 0x7f82c80690f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f82d80b1000 tx=0x7f82d80aa000 comp rx=0 tx=0).stop 2024-09-13T18:32:23.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82e80d1830 msgr2=0x7f82e81f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:23.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82e80d1830 0x7f82e81f2560 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00e930 tx=0x7f82dc00edf0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 shutdown_connections 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f82c8066c30 0x7f82c80690f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82e815c860 0x7f82e815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82e80d1830 0x7f82e81f2560 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 --2- 172.21.15.53:0/1955378626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82e80d1410 0x7f82e8159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 >> 172.21.15.53:0/1955378626 conn(0x7f82e8065c80 msgr2=0x7f82e80b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 shutdown_connections 2024-09-13T18:32:23.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.325+0000 7f82ec9af640 1 -- 172.21.15.53:0/1955378626 wait complete. 2024-09-13T18:32:23.350 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:32:23.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9799600640 1 Processor -- start 2024-09-13T18:32:23.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9799600640 1 -- start start 2024-09-13T18:32:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9799600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97940cd6f0 0x7f97940b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9799600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9794143f20 0x7f979406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9799600640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940b3020 con 0x7f97940cdad0 2024-09-13T18:32:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9799600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97940b1f80 con 0x7f9794143f20 2024-09-13T18:32:23.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9799600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97940b2260 con 0x7f97940cd6f0 2024-09-13T18:32:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f97937fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9794143f20 0x7f979406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9792ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97940cd6f0 0x7f97940b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9792ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97940cd6f0 0x7f97940b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:36658/0 (socket says 172.21.15.53:36658) 2024-09-13T18:32:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f97927fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f97940cdad0 0x7f9794143810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:41020/0 (socket says 172.21.15.53:41020) 2024-09-13T18:32:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f9792ffd640 1 -- 172.21.15.53:0/3502490049 learned_addr learned my addr 172.21.15.53:0/3502490049 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:23.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.481+0000 7f97937fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9794143f20 0x7f979406b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:46588/0 (socket says 172.21.15.53:46588) 2024-09-13T18:32:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f97937fe640 1 -- 172.21.15.53:0/3502490049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97940cd6f0 msgr2=0x7f97940b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f97937fe640 1 --2- 172.21.15.53:0/3502490049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97940cd6f0 0x7f97940b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f97937fe640 1 -- 172.21.15.53:0/3502490049 >> v1:172.21.15.87:6789/0 conn(0x7f97940cdad0 legacy=0x7f9794143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:23.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f97937fe640 1 -- 172.21.15.53:0/3502490049 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940b2540 con 0x7f9794143f20 2024-09-13T18:32:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f97937fe640 1 --2- 172.21.15.53:0/3502490049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9794143f20 0x7f979406b320 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f978c009d90 tx=0x7f978c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29602a0e2b7e9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f9791ffb640 1 -- 172.21.15.53:0/3502490049 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c0a5910 con 0x7f9794143f20 2024-09-13T18:32:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f9791ffb640 1 -- 172.21.15.53:0/3502490049 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c0a5a70 con 0x7f9794143f20 2024-09-13T18:32:23.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.485+0000 7f9791ffb640 1 -- 172.21.15.53:0/3502490049 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c0a5e00 con 0x7f9794143f20 2024-09-13T18:32:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- 172.21.15.53:0/3502490049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9794143f20 msgr2=0x7f979406b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 --2- 172.21.15.53:0/3502490049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9794143f20 0x7f979406b320 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f978c009d90 tx=0x7f978c01c940 comp rx=0 tx=0).stop 2024-09-13T18:32:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- 172.21.15.53:0/3502490049 shutdown_connections 2024-09-13T18:32:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 --2- 172.21.15.53:0/3502490049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9794143f20 0x7f979406b320 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 --2- 172.21.15.53:0/3502490049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f97940cd6f0 0x7f97940b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- 172.21.15.53:0/3502490049 >> 172.21.15.53:0/3502490049 conn(0x7f9794073330 msgr2=0x7f9794065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:23.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- 172.21.15.53:0/3502490049 shutdown_connections 2024-09-13T18:32:23.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- 172.21.15.53:0/3502490049 wait complete. 2024-09-13T18:32:23.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 Processor -- start 2024-09-13T18:32:23.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- start start 2024-09-13T18:32:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97940cd6f0 0x7f9794142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97940cdad0 0x7f9794155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9794143f20 0x7f97940aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:23.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794156710 con 0x7f97940cdad0 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97941569f0 con 0x7f97940cd6f0 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9799600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9794156cd0 con 0x7f9794143f20 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f97927fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97940cdad0 0x7f9794155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f97927fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97940cdad0 0x7f9794155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43038/0 (socket says 172.21.15.53:43038) 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f97927fc640 1 -- 172.21.15.53:0/866487095 learned_addr learned my addr 172.21.15.53:0/866487095 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f9792ffd640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97940cd6f0 0x7f9794142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.489+0000 7f97937fe640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9794143f20 0x7f97940aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f97927fc640 1 -- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9794143f20 msgr2=0x7f97940aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f97927fc640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9794143f20 0x7f97940aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f97927fc640 1 -- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97940cd6f0 msgr2=0x7f9794142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f97927fc640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97940cd6f0 0x7f9794142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f97927fc640 1 -- 172.21.15.53:0/866487095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c009a70 con 0x7f97940cdad0 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f97937fe640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9794143f20 0x7f97940aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:23.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f97927fc640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97940cdad0 0x7f9794155c20 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f978400c430 tx=0x7f978400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f978b7fe640 1 -- 172.21.15.53:0/866487095 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840074e0 con 0x7f97940cdad0 2024-09-13T18:32:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f978b7fe640 1 -- 172.21.15.53:0/866487095 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784007640 con 0x7f97940cdad0 2024-09-13T18:32:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f978b7fe640 1 -- 172.21.15.53:0/866487095 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784004a30 con 0x7f97940cdad0 2024-09-13T18:32:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794156fb0 con 0x7f97940cdad0 2024-09-13T18:32:23.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979413bfe0 con 0x7f97940cdad0 2024-09-13T18:32:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97940b1490 con 0x7f97940cdad0 2024-09-13T18:32:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f978b7fe640 1 -- 172.21.15.53:0/866487095 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f9784004b90 con 0x7f97940cdad0 2024-09-13T18:32:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f978b7fe640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9774066c30 0x7f97740690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f978b7fe640 1 -- 172.21.15.53:0/866487095 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f9784084470 con 0x7f97940cdad0 2024-09-13T18:32:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f9792ffd640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9774066c30 0x7f97740690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:23.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.493+0000 7f9792ffd640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9774066c30 0x7f97740690f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f977c009b50 tx=0x7f977c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:23.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.497+0000 7f978b7fe640 1 -- 172.21.15.53:0/866487095 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9784051090 con 0x7f97940cdad0 2024-09-13T18:32:23.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:23.657+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97940b0a50 con 0x7f97940cdad0 2024-09-13T18:32:24.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.325+0000 7f978b7fe640 1 -- 172.21.15.53:0/866487095 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v127) v1 ==== 169+0+0 (secure 0 0 0) 0x7f97840546b0 con 0x7f97940cdad0 2024-09-13T18:32:24.336 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9774066c30 msgr2=0x7f97740690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9774066c30 0x7f97740690f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f977c009b50 tx=0x7f977c009240 comp rx=0 tx=0).stop 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97940cdad0 msgr2=0x7f9794155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97940cdad0 0x7f9794155c20 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f978400c430 tx=0x7f978400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 shutdown_connections 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9774066c30 0x7f97740690f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9794143f20 0x7f97940aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f97940cdad0 0x7f9794155c20 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 --2- 172.21.15.53:0/866487095 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f97940cd6f0 0x7f9794142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 >> 172.21.15.53:0/866487095 conn(0x7f9794073330 msgr2=0x7f97940a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 shutdown_connections 2024-09-13T18:32:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.337+0000 7f9799600640 1 -- 172.21.15.53:0/866487095 wait complete. 2024-09-13T18:32:24.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:32:24.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03ae55b640 1 Processor -- start 2024-09-13T18:32:24.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03ae55b640 1 -- start start 2024-09-13T18:32:24.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03ae55b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80ccf10 0x7f03a80cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03ae55b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03a80ced50 0x7f03a80b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03ae55b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80ccd60 con 0x7f03a80b2bf0 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03ae55b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80cc190 con 0x7f03a80ced50 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03ae55b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80ce270 con 0x7f03a80ccf10 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03acaf8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03a80ced50 0x7f03a80b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03acaf8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03a80ced50 0x7f03a80b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43054/0 (socket says 172.21.15.53:43054) 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03acaf8640 1 -- 172.21.15.53:0/64655066 learned_addr learned my addr 172.21.15.53:0/64655066 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03a7fff640 1 --2- 172.21.15.53:0/64655066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80ccf10 0x7f03a80cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03acaf8640 1 -- 172.21.15.53:0/64655066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80ccf10 msgr2=0x7f03a80cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03acaf8640 1 --2- 172.21.15.53:0/64655066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80ccf10 0x7f03a80cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03acaf8640 1 -- 172.21.15.53:0/64655066 >> v1:172.21.15.87:6789/0 conn(0x7f03a80b2bf0 legacy=0x7f03a80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03acaf8640 1 -- 172.21.15.53:0/64655066 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80ce550 con 0x7f03a80ced50 2024-09-13T18:32:24.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.489+0000 7f03a7fff640 1 --2- 172.21.15.53:0/64655066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80ccf10 0x7f03a80cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:24.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 --2- 172.21.15.53:0/64655066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80b33d0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009e50 tx=0x7f03a001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65381cf4f90b6de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:24.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03a6ffd640 1 -- 172.21.15.53:0/64655066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00a5710 con 0x7f03a80ced50 2024-09-13T18:32:24.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03a6ffd640 1 -- 172.21.15.53:0/64655066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a00a5870 con 0x7f03a80ced50 2024-09-13T18:32:24.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03a6ffd640 1 -- 172.21.15.53:0/64655066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00a5c00 con 0x7f03a80ced50 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- 172.21.15.53:0/64655066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 msgr2=0x7f03a80b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 --2- 172.21.15.53:0/64655066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80b33d0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009e50 tx=0x7f03a001c930 comp rx=0 tx=0).stop 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- 172.21.15.53:0/64655066 shutdown_connections 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 --2- 172.21.15.53:0/64655066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80b33d0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 --2- 172.21.15.53:0/64655066 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80ccf10 0x7f03a80cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- 172.21.15.53:0/64655066 >> 172.21.15.53:0/64655066 conn(0x7f03a80b20d0 msgr2=0x7f03a80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- 172.21.15.53:0/64655066 shutdown_connections 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- 172.21.15.53:0/64655066 wait complete. 2024-09-13T18:32:24.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 Processor -- start 2024-09-13T18:32:24.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- start start 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80b2bf0 0x7f03a8152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03a80ccf10 0x7f03a80c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815b7e0 con 0x7f03a80ced50 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c9400 con 0x7f03a80ccf10 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03ae55b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8153290 con 0x7f03a80b2bf0 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43066/0 (socket says 172.21.15.53:43066) 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 -- 172.21.15.53:0/2477341328 learned_addr learned my addr 172.21.15.53:0/2477341328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03a77fe640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03a80ccf10 0x7f03a80c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03a7fff640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80b2bf0 0x7f03a8152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 -- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80b2bf0 msgr2=0x7f03a8152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80b2bf0 0x7f03a8152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 -- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03a80ccf10 msgr2=0x7f03a80c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03a80ccf10 0x7f03a80c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 -- 172.21.15.53:0/2477341328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0009b30 con 0x7f03a80ced50 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.493+0000 7f03acaf8640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80c8ec0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f03a00af040 tx=0x7f03a00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a4ff9640 1 -- 172.21.15.53:0/2477341328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00b8670 con 0x7f03a80ced50 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a4ff9640 1 -- 172.21.15.53:0/2477341328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a00b87d0 con 0x7f03a80ced50 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a815abd0 con 0x7f03a80ced50 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a4ff9640 1 -- 172.21.15.53:0/2477341328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00b8b80 con 0x7f03a80ced50 2024-09-13T18:32:24.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a815b190 con 0x7f03a80ced50 2024-09-13T18:32:24.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a815b990 con 0x7f03a80ced50 2024-09-13T18:32:24.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a4ff9640 1 -- 172.21.15.53:0/2477341328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f03a00b8ce0 con 0x7f03a80ced50 2024-09-13T18:32:24.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a4ff9640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0394066c60 0x7f0394069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a4ff9640 1 -- 172.21.15.53:0/2477341328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f03a011ff50 con 0x7f03a80ced50 2024-09-13T18:32:24.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a7fff640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0394066c60 0x7f0394069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.497+0000 7f03a7fff640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0394066c60 0x7f0394069120 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f039800a9a0 tx=0x7f0398008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:24.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.501+0000 7f03a4ff9640 1 -- 172.21.15.53:0/2477341328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03a815b990 con 0x7f03a80ced50 2024-09-13T18:32:24.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.669+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f03a815b990 con 0x7f03a80ced50 2024-09-13T18:32:24.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03a4ff9640 1 -- 172.21.15.53:0/2477341328 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03a815b990 con 0x7f03a80ced50 2024-09-13T18:32:24.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0394066c60 msgr2=0x7f0394069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0394066c60 0x7f0394069120 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f039800a9a0 tx=0x7f0398008040 comp rx=0 tx=0).stop 2024-09-13T18:32:24.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 msgr2=0x7f03a80c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80c8ec0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f03a00af040 tx=0x7f03a00196d0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 shutdown_connections 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0394066c60 0x7f0394069120 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03a80ced50 0x7f03a80c8ec0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03a80ccf10 0x7f03a80c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 --2- 172.21.15.53:0/2477341328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03a80b2bf0 0x7f03a8152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 >> 172.21.15.53:0/2477341328 conn(0x7f03a80b20d0 msgr2=0x7f03a80cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 shutdown_connections 2024-09-13T18:32:24.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.677+0000 7f03ae55b640 1 -- 172.21.15.53:0/2477341328 wait complete. 2024-09-13T18:32:24.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc286e6b640 1 Processor -- start 2024-09-13T18:32:24.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc286e6b640 1 -- start start 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc286e6b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2800d19c0 0x7fc2800cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc286e6b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc2800b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc286e6b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2800d2400 con 0x7fc28015cab0 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc286e6b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2800cfa90 con 0x7fc2800d19c0 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc286e6b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2800d1530 con 0x7fc2800cf600 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc27ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2800d19c0 0x7fc2800cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc284c07640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc28015cab0 0x7fc2800cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33310/0 (socket says 172.21.15.53:33310) 2024-09-13T18:32:24.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc27ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2800d19c0 0x7fc2800cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43070/0 (socket says 172.21.15.53:43070) 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc284c07640 1 -- 172.21.15.53:0/1556480504 learned_addr learned my addr 172.21.15.53:0/1556480504 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc285408640 1 --2- 172.21.15.53:0/1556480504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc2800b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc27ffff640 1 -- 172.21.15.53:0/1556480504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 msgr2=0x7fc2800b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc27ffff640 1 --2- 172.21.15.53:0/1556480504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc2800b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc27ffff640 1 -- 172.21.15.53:0/1556480504 >> v1:172.21.15.53:6789/0 conn(0x7fc28015cab0 legacy=0x7fc2800cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.821+0000 7fc27ffff640 1 -- 172.21.15.53:0/1556480504 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2800cddd0 con 0x7fc2800d19c0 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc27ffff640 1 --2- 172.21.15.53:0/1556480504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2800d19c0 0x7fc2800cf0c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fc2680097c0 tx=0x7fc26801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852ce63378c93989 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc27f7fe640 1 -- 172.21.15.53:0/1556480504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680ad640 con 0x7fc2800d19c0 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc27f7fe640 1 -- 172.21.15.53:0/1556480504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2680ad7a0 con 0x7fc2800d19c0 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc27f7fe640 1 -- 172.21.15.53:0/1556480504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680adb30 con 0x7fc2800d19c0 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- 172.21.15.53:0/1556480504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2800d19c0 msgr2=0x7fc2800cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1556480504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2800d19c0 0x7fc2800cf0c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fc2680097c0 tx=0x7fc26801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- 172.21.15.53:0/1556480504 shutdown_connections 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1556480504 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc2800b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1556480504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2800d19c0 0x7fc2800cf0c0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- 172.21.15.53:0/1556480504 >> 172.21.15.53:0/1556480504 conn(0x7fc280065c80 msgr2=0x7fc280066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- 172.21.15.53:0/1556480504 shutdown_connections 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- 172.21.15.53:0/1556480504 wait complete. 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 Processor -- start 2024-09-13T18:32:24.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- start start 2024-09-13T18:32:24.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc28014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2800d19c0 0x7fc28014e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28015cab0 0x7fc28014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc280150ca0 con 0x7fc28015cab0 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc280153ce0 con 0x7fc2800d19c0 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc286e6b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2800c9920 con 0x7fc2800cf600 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc285408640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28015cab0 0x7fc28014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc285408640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28015cab0 0x7fc28014e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43082/0 (socket says 172.21.15.53:43082) 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.825+0000 7fc285408640 1 -- 172.21.15.53:0/1446850453 learned_addr learned my addr 172.21.15.53:0/1446850453 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc284c07640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc28014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc285408640 1 -- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 msgr2=0x7fc28014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc285408640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc28014dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27ffff640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2800d19c0 0x7fc28014e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc285408640 1 -- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2800d19c0 msgr2=0x7fc28014e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc285408640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2800d19c0 0x7fc28014e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc285408640 1 -- 172.21.15.53:0/1446850453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268009420 con 0x7fc28015cab0 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc284c07640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc28014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27ffff640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2800d19c0 0x7fc28014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc285408640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28015cab0 0x7fc28014e700 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc27000d560 tx=0x7fc27000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27d7fa640 1 -- 172.21.15.53:0/1446850453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2700125f0 con 0x7fc28015cab0 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27d7fa640 1 -- 172.21.15.53:0/1446850453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc270012770 con 0x7fc28015cab0 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2800c9c00 con 0x7fc28015cab0 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27d7fa640 1 -- 172.21.15.53:0/1446850453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270012b20 con 0x7fc28015cab0 2024-09-13T18:32:24.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280153970 con 0x7fc28015cab0 2024-09-13T18:32:24.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc280153e50 con 0x7fc28015cab0 2024-09-13T18:32:24.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27d7fa640 1 -- 172.21.15.53:0/1446850453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fc270012c80 con 0x7fc28015cab0 2024-09-13T18:32:24.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27d7fa640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc260066c30 0x7fc2600690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:24.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc27d7fa640 1 -- 172.21.15.53:0/1446850453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc270084d60 con 0x7fc28015cab0 2024-09-13T18:32:24.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc284c07640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc260066c30 0x7fc2600690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:24.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.829+0000 7fc284c07640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc260066c30 0x7fc2600690f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc278005c10 tx=0x7fc278009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:24.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:24.833+0000 7fc27d7fa640 1 -- 172.21.15.53:0/1446850453 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc270051bf0 con 0x7fc28015cab0 2024-09-13T18:32:25.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.053+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) v1 -- 0x7fc2800b5870 con 0x7fc28015cab0 2024-09-13T18:32:25.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.329+0000 7fc27d7fa640 1 -- 172.21.15.53:0/1446850453 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v405) v1 ==== 148+0+0 (secure 0 0 0) 0x7fc270055210 con 0x7fc28015cab0 2024-09-13T18:32:25.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc260066c30 msgr2=0x7fc2600690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc260066c30 0x7fc2600690f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc278005c10 tx=0x7fc278009040 comp rx=0 tx=0).stop 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28015cab0 msgr2=0x7fc28014e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28015cab0 0x7fc28014e700 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc27000d560 tx=0x7fc27000da20 comp rx=0 tx=0).stop 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 shutdown_connections 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc260066c30 0x7fc2600690f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28015cab0 0x7fc28014e700 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2800d19c0 0x7fc28014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 --2- 172.21.15.53:0/1446850453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2800cf600 0x7fc28014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 >> 172.21.15.53:0/1446850453 conn(0x7fc280065c80 msgr2=0x7fc2800b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 shutdown_connections 2024-09-13T18:32:25.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.333+0000 7fc286e6b640 1 -- 172.21.15.53:0/1446850453 wait complete. 2024-09-13T18:32:25.361 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-13T18:32:25.362 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:32:25.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 Processor -- start 2024-09-13T18:32:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 -- start start 2024-09-13T18:32:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3afc0cd630 0x7f3afc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc0b1af0 0x7f3afc069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3afc06a490 0x7f3afc0ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0d0120 con 0x7f3afc0cd630 2024-09-13T18:32:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0cfe80 con 0x7f3afc06a490 2024-09-13T18:32:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b04567640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc06ac20 con 0x7f3afc0b1af0 2024-09-13T18:32:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3afc0cd630 0x7f3afc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3afc0cd630 0x7f3afc0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43098/0 (socket says 172.21.15.53:43098) 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 -- 172.21.15.53:0/3029920046 learned_addr learned my addr 172.21.15.53:0/3029920046 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b01b02640 1 --2- 172.21.15.53:0/3029920046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc0b1af0 0x7f3afc069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02b04640 1 --2- 172.21.15.53:0/3029920046 >> v2:172.21.15.87:3300/0 conn(0x7f3afc06a490 0x7f3afc0ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 -- 172.21.15.53:0/3029920046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc0b1af0 msgr2=0x7f3afc069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 --2- 172.21.15.53:0/3029920046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc0b1af0 0x7f3afc069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 -- 172.21.15.53:0/3029920046 >> v2:172.21.15.87:3300/0 conn(0x7f3afc06a490 msgr2=0x7f3afc0ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 --2- 172.21.15.53:0/3029920046 >> v2:172.21.15.87:3300/0 conn(0x7f3afc06a490 0x7f3afc0ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.489+0000 7f3b02303640 1 -- 172.21.15.53:0/3029920046 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc06af00 con 0x7f3afc0cd630 2024-09-13T18:32:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b02303640 1 --2- 172.21.15.53:0/3029920046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0cd630 0x7f3afc0b0cf0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f3afc071450 tx=0x7f3af801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed1915a45f91ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b01301640 1 -- 172.21.15.53:0/3029920046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80ab600 con 0x7f3afc0cd630 2024-09-13T18:32:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b01301640 1 -- 172.21.15.53:0/3029920046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af80a7050 con 0x7f3afc0cd630 2024-09-13T18:32:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b01301640 1 -- 172.21.15.53:0/3029920046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80ab980 con 0x7f3afc0cd630 2024-09-13T18:32:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 -- 172.21.15.53:0/3029920046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0cd630 msgr2=0x7f3afc0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 --2- 172.21.15.53:0/3029920046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0cd630 0x7f3afc0b0cf0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f3afc071450 tx=0x7f3af801c400 comp rx=0 tx=0).stop 2024-09-13T18:32:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 -- 172.21.15.53:0/3029920046 shutdown_connections 2024-09-13T18:32:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 --2- 172.21.15.53:0/3029920046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc0b1af0 0x7f3afc069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 --2- 172.21.15.53:0/3029920046 >> v2:172.21.15.87:3300/0 conn(0x7f3afc06a490 0x7f3afc0ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 --2- 172.21.15.53:0/3029920046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0cd630 0x7f3afc0b0cf0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 -- 172.21.15.53:0/3029920046 >> 172.21.15.53:0/3029920046 conn(0x7f3afc0b20d0 msgr2=0x7f3afc0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 -- 172.21.15.53:0/3029920046 shutdown_connections 2024-09-13T18:32:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 -- 172.21.15.53:0/3029920046 wait complete. 2024-09-13T18:32:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 Processor -- start 2024-09-13T18:32:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.493+0000 7f3b04567640 1 -- start start 2024-09-13T18:32:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc06a490 0x7f3afc1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0b1af0 0x7f3afc158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3afc0cd630 0x7f3afc15f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc159ac0 con 0x7f3afc0b1af0 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1597e0 con 0x7f3afc0cd630 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc157aa0 con 0x7f3afc06a490 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0b1af0 0x7f3afc158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0b1af0 0x7f3afc158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43112/0 (socket says 172.21.15.53:43112) 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 -- 172.21.15.53:0/3351360001 learned_addr learned my addr 172.21.15.53:0/3351360001 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b02303640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc06a490 0x7f3afc1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b02b04640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3afc0cd630 0x7f3afc15f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 -- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc06a490 msgr2=0x7f3afc1525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc06a490 0x7f3afc1525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 -- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3afc0cd630 msgr2=0x7f3afc15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3afc0cd630 0x7f3afc15f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 -- 172.21.15.53:0/3351360001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af80094d0 con 0x7f3afc0b1af0 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b02b04640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3afc0cd630 0x7f3afc15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b01b02640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0b1af0 0x7f3afc158ee0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3af000d800 tx=0x7f3af000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3aeeffd640 1 -- 172.21.15.53:0/3351360001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000b6c0 con 0x7f3afc0b1af0 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3aeeffd640 1 -- 172.21.15.53:0/3351360001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000b820 con 0x7f3afc0b1af0 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc157d80 con 0x7f3afc0b1af0 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3aeeffd640 1 -- 172.21.15.53:0/3351360001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000bb90 con 0x7f3afc0b1af0 2024-09-13T18:32:25.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc152b10 con 0x7f3afc0b1af0 2024-09-13T18:32:25.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc0c3f00 con 0x7f3afc0b1af0 2024-09-13T18:32:25.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3aeeffd640 1 -- 172.21.15.53:0/3351360001 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f3af000bcf0 con 0x7f3afc0b1af0 2024-09-13T18:32:25.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.497+0000 7f3aeeffd640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae0066c60 0x7f3ae0069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.501+0000 7f3b02303640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae0066c60 0x7f3ae0069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.501+0000 7f3aeeffd640 1 -- 172.21.15.53:0/3351360001 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3af0084e50 con 0x7f3afc0b1af0 2024-09-13T18:32:25.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.501+0000 7f3b02303640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae0066c60 0x7f3ae0069120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3af80ad000 tx=0x7f3af8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:25.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.505+0000 7f3aeeffd640 1 -- 172.21.15.53:0/3351360001 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3af0051ca0 con 0x7f3afc0b1af0 2024-09-13T18:32:25.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:25.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:25.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.673+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3afc06d8a0 con 0x7f3afc0b1af0 2024-09-13T18:32:25.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.673+0000 7f3aeeffd640 1 -- 172.21.15.53:0/3351360001 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+12936 (secure 0 0 0) 0x7f3af00552c0 con 0x7f3afc0b1af0 2024-09-13T18:32:25.676 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:25.676 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":127,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:24.316888+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/2654273195":"2024-09-14T18:32:21.286456+0000","172.21.15.53:6834/2654273195":"2024-09-14T18:32:21.286456+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae0066c60 msgr2=0x7f3ae0069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae0066c60 0x7f3ae0069120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3af80ad000 tx=0x7f3af8008040 comp rx=0 tx=0).stop 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0b1af0 msgr2=0x7f3afc158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0b1af0 0x7f3afc158ee0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3af000d800 tx=0x7f3af000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 shutdown_connections 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3ae0066c60 0x7f3ae0069120 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3afc0cd630 0x7f3afc15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3afc0b1af0 0x7f3afc158ee0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 --2- 172.21.15.53:0/3351360001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3afc06a490 0x7f3afc1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 >> 172.21.15.53:0/3351360001 conn(0x7f3afc0b20d0 msgr2=0x7f3afc06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 shutdown_connections 2024-09-13T18:32:25.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.677+0000 7f3b04567640 1 -- 172.21.15.53:0/3351360001 wait complete. 2024-09-13T18:32:25.694 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:32:25.695 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:32:25.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.817+0000 7f7c2f316640 1 Processor -- start 2024-09-13T18:32:25.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.817+0000 7f7c2f316640 1 -- start start 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2f316640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 0x7f7c2806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2f316640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7c280cf1f0 0x7f7c2815a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2f316640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2806d080 con 0x7f7c2815a4a0 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2f316640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280ccd20 con 0x7f7c280cf1f0 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2f316640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2806d2b0 con 0x7f7c28066390 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2d0b2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c2815a4a0 0x7f7c28065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33324/0 (socket says 172.21.15.53:33324) 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2d0b2640 1 -- 172.21.15.53:0/3877992720 learned_addr learned my addr 172.21.15.53:0/3877992720 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:25.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2d8b3640 1 --2- 172.21.15.53:0/3877992720 >> v2:172.21.15.87:3300/0 conn(0x7f7c280cf1f0 0x7f7c2815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926060537 0 0) 0x7f7c2806d080 con 0x7f7c2815a4a0 2024-09-13T18:32:25.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 0x7f7c2806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c10003530 con 0x7f7c2815a4a0 2024-09-13T18:32:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570325696 0 0) 0x7f7c10003530 con 0x7f7c2815a4a0 2024-09-13T18:32:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 msgr2=0x7f7c2806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 0x7f7c2806cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 >> v2:172.21.15.87:3300/0 conn(0x7f7c280cf1f0 msgr2=0x7f7c2815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 --2- 172.21.15.53:0/3877992720 >> v2:172.21.15.87:3300/0 conn(0x7f7c280cf1f0 0x7f7c2815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2806d590 con 0x7f7c2815a4a0 2024-09-13T18:32:25.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7c20001a00 con 0x7f7c2815a4a0 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 >> v1:172.21.15.53:6789/0 conn(0x7f7c2815a4a0 legacy=0x7f7c28065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 0x7f7c10003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c10003fb0 0x7f7c100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c10004d10 0x7f7c10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280ccd20 con 0x7f7c10003fb0 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2806d2b0 con 0x7f7c10004d10 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1000ba90 con 0x7f7c28066390 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2d8b3640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c10004d10 0x7f7c10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2d0b2640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 0x7f7c10003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c10003fb0 0x7f7c100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2c8b1640 1 -- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 msgr2=0x7f7c10003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28066390 0x7f7c10003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2c8b1640 1 -- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c10004d10 msgr2=0x7f7c10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:25.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c10004d10 0x7f7c10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2c8b1640 1 -- 172.21.15.53:0/3877992720 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10003530 con 0x7f7c10003fb0 2024-09-13T18:32:25.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.821+0000 7f7c2d8b3640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c10004d10 0x7f7c10005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c10003fb0 0x7f7c100047d0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00ba30 tx=0x7f7c1c01c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c424f3719e0437 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0ac440 con 0x7f7c10003fb0 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0ac5a0 con 0x7f7c10003fb0 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c27fff640 1 -- 172.21.15.53:0/3877992720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0ac950 con 0x7f7c10003fb0 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 -- 172.21.15.53:0/3877992720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c10003fb0 msgr2=0x7f7c100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 --2- 172.21.15.53:0/3877992720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c10003fb0 0x7f7c100047d0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00ba30 tx=0x7f7c1c01c6a0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2d8b3640 1 -- 172.21.15.53:0/3877992720 reap_dead start 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 -- 172.21.15.53:0/3877992720 shutdown_connections 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 -- 172.21.15.53:0/3877992720 >> 172.21.15.53:0/3877992720 conn(0x7f7c28069f50 msgr2=0x7f7c2806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 -- 172.21.15.53:0/3877992720 shutdown_connections 2024-09-13T18:32:25.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 -- 172.21.15.53:0/3877992720 wait complete. 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 Processor -- start 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.825+0000 7f7c2f316640 1 -- start start 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28140b80 0x7f7c280af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c280af660 0x7f7c2814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c28140f60 0x7f7c2814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280b0ba0 con 0x7f7c280af660 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280afb00 con 0x7f7c28140f60 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280afde0 con 0x7f7c28140b80 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c280af660 0x7f7c2814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c280af660 0x7f7c2814beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43126/0 (socket says 172.21.15.53:43126) 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 -- 172.21.15.53:0/760069062 learned_addr learned my addr 172.21.15.53:0/760069062 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:25.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2d0b2640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28140b80 0x7f7c280af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2d8b3640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c28140f60 0x7f7c2814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 -- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28140b80 msgr2=0x7f7c280af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28140b80 0x7f7c280af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 -- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c28140f60 msgr2=0x7f7c2814c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c28140f60 0x7f7c2814c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 -- 172.21.15.53:0/760069062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280b00c0 con 0x7f7c280af660 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2d8b3640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c28140f60 0x7f7c2814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2c8b1640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c280af660 0x7f7c2814beb0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ae040 tx=0x7f7c10005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c25ffb640 1 -- 172.21.15.53:0/760069062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004020 con 0x7f7c280af660 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c25ffb640 1 -- 172.21.15.53:0/760069062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0b9070 con 0x7f7c280af660 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c280b03a0 con 0x7f7c280af660 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c25ffb640 1 -- 172.21.15.53:0/760069062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0043a0 con 0x7f7c280af660 2024-09-13T18:32:25.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2815aa10 con 0x7f7c280af660 2024-09-13T18:32:25.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c280008e0 con 0x7f7c280af660 2024-09-13T18:32:25.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c25ffb640 1 -- 172.21.15.53:0/760069062 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f7c1c0aa050 con 0x7f7c280af660 2024-09-13T18:32:25.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c25ffb640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c14066c60 0x7f7c14069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:25.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c25ffb640 1 -- 172.21.15.53:0/760069062 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c1c11f030 con 0x7f7c280af660 2024-09-13T18:32:25.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2d0b2640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c14066c60 0x7f7c14069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:25.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.829+0000 7f7c2d0b2640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c14066c60 0x7f7c14069120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c20001bb0 tx=0x7f7c2000a060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:25.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.833+0000 7f7c25ffb640 1 -- 172.21.15.53:0/760069062 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c1c0ec050 con 0x7f7c280af660 2024-09-13T18:32:25.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.993+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c280008e0 con 0x7f7c280af660 2024-09-13T18:32:25.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c25ffb640 1 -- 172.21.15.53:0/760069062 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v127) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c1c0ef670 con 0x7f7c280af660 2024-09-13T18:32:25.997 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c14066c60 msgr2=0x7f7c14069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c14066c60 0x7f7c14069120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c20001bb0 tx=0x7f7c2000a060 comp rx=0 tx=0).stop 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c280af660 msgr2=0x7f7c2814beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c280af660 0x7f7c2814beb0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ae040 tx=0x7f7c10005800 comp rx=0 tx=0).stop 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 shutdown_connections 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c14066c60 0x7f7c14069120 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c28140f60 0x7f7c2814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c280af660 0x7f7c2814beb0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 --2- 172.21.15.53:0/760069062 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c28140b80 0x7f7c280af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 >> 172.21.15.53:0/760069062 conn(0x7f7c28069f50 msgr2=0x7f7c2814d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 shutdown_connections 2024-09-13T18:32:26.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:25.997+0000 7f7c2f316640 1 -- 172.21.15.53:0/760069062 wait complete. 2024-09-13T18:32:26.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-13T18:32:26.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.133+0000 7fe799b8d640 1 Processor -- start 2024-09-13T18:32:26.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.133+0000 7fe799b8d640 1 -- start start 2024-09-13T18:32:26.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe799b8d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe79415a770 0x7fe79406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:26.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe799b8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940cccb0 0x7fe7940b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:26.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe799b8d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79406d660 con 0x7fe7940b5130 2024-09-13T18:32:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe799b8d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940ce160 con 0x7fe79415a770 2024-09-13T18:32:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe799b8d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940b55a0 con 0x7fe7940cccb0 2024-09-13T18:32:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe792ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940cccb0 0x7fe7940b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe7937fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe79415a770 0x7fe79406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:26.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe792ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940cccb0 0x7fe7940b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:36760/0 (socket says 172.21.15.53:36760) 2024-09-13T18:32:26.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe792ffd640 1 -- 172.21.15.53:0/3082545136 learned_addr learned my addr 172.21.15.53:0/3082545136 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:26.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe792ffd640 1 -- 172.21.15.53:0/3082545136 >> v2:172.21.15.87:3300/0 conn(0x7fe79415a770 msgr2=0x7fe79406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:26.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe792ffd640 1 --2- 172.21.15.53:0/3082545136 >> v2:172.21.15.87:3300/0 conn(0x7fe79415a770 0x7fe79406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe792ffd640 1 -- 172.21.15.53:0/3082545136 >> v1:172.21.15.87:6789/0 conn(0x7fe7940b5130 legacy=0x7fe794065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:26.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.137+0000 7fe792ffd640 1 -- 172.21.15.53:0/3082545136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940cd490 con 0x7fe7940cccb0 2024-09-13T18:32:26.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe792ffd640 1 --2- 172.21.15.53:0/3082545136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940cccb0 0x7fe7940b4bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009870 tx=0x7fe77c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461f009ea24897d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:26.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe7927fc640 1 -- 172.21.15.53:0/3082545136 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0a9610 con 0x7fe7940cccb0 2024-09-13T18:32:26.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe7927fc640 1 -- 172.21.15.53:0/3082545136 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c0a9770 con 0x7fe7940cccb0 2024-09-13T18:32:26.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe7927fc640 1 -- 172.21.15.53:0/3082545136 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0a9b00 con 0x7fe7940cccb0 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- 172.21.15.53:0/3082545136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940cccb0 msgr2=0x7fe7940b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 --2- 172.21.15.53:0/3082545136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940cccb0 0x7fe7940b4bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009870 tx=0x7fe77c01c530 comp rx=0 tx=0).stop 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- 172.21.15.53:0/3082545136 shutdown_connections 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 --2- 172.21.15.53:0/3082545136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940cccb0 0x7fe7940b4bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 --2- 172.21.15.53:0/3082545136 >> v2:172.21.15.87:3300/0 conn(0x7fe79415a770 0x7fe79406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- 172.21.15.53:0/3082545136 >> 172.21.15.53:0/3082545136 conn(0x7fe794069f50 msgr2=0x7fe79406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- 172.21.15.53:0/3082545136 shutdown_connections 2024-09-13T18:32:26.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- 172.21.15.53:0/3082545136 wait complete. 2024-09-13T18:32:26.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 Processor -- start 2024-09-13T18:32:26.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- start start 2024-09-13T18:32:26.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940b5130 0x7fe79413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:26.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7940cccb0 0x7fe7941484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe79415a770 0x7fe7941489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79414a930 con 0x7fe79415a770 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79414ac10 con 0x7fe7940cccb0 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe799b8d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79414aef0 con 0x7fe7940b5130 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe793fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe79415a770 0x7fe7941489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe793fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe79415a770 0x7fe7941489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43136/0 (socket says 172.21.15.53:43136) 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe793fff640 1 -- 172.21.15.53:0/2339765067 learned_addr learned my addr 172.21.15.53:0/2339765067 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe7937fe640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940b5130 0x7fe79413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.141+0000 7fe792ffd640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7940cccb0 0x7fe7941484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe793fff640 1 -- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940b5130 msgr2=0x7fe79413ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe793fff640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940b5130 0x7fe79413ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe793fff640 1 -- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7940cccb0 msgr2=0x7fe7941484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:26.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe793fff640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7940cccb0 0x7fe7941484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:26.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe793fff640 1 -- 172.21.15.53:0/2339765067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0094d0 con 0x7fe79415a770 2024-09-13T18:32:26.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe792ffd640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7940cccb0 0x7fe7941484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe793fff640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe79415a770 0x7fe7941489f0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fe78400c770 tx=0x7fe78400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe78bfff640 1 -- 172.21.15.53:0/2339765067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784003b80 con 0x7fe79415a770 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe78bfff640 1 -- 172.21.15.53:0/2339765067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe784003ce0 con 0x7fe79415a770 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79414b1d0 con 0x7fe79415a770 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe78bfff640 1 -- 172.21.15.53:0/2339765067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400aa90 con 0x7fe79415a770 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79413efc0 con 0x7fe79415a770 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79414b410 con 0x7fe79415a770 2024-09-13T18:32:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe78bfff640 1 -- 172.21.15.53:0/2339765067 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fe78400abf0 con 0x7fe79415a770 2024-09-13T18:32:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe78bfff640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe774066c30 0x7fe7740690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe7937fe640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe774066c30 0x7fe7740690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe78bfff640 1 -- 172.21.15.53:0/2339765067 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe7840846b0 con 0x7fe79415a770 2024-09-13T18:32:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.145+0000 7fe7937fe640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe774066c30 0x7fe7740690f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe794152150 tx=0x7fe78c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:26.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.149+0000 7fe78bfff640 1 -- 172.21.15.53:0/2339765067 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe79414b410 con 0x7fe79415a770 2024-09-13T18:32:26.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:26.369+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) v1 -- 0x7fe79414b3c0 con 0x7fe79415a770 2024-09-13T18:32:27.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.337+0000 7fe78bfff640 1 -- 172.21.15.53:0/2339765067 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v407) v1 ==== 154+0+0 (secure 0 0 0) 0x7fe7840514b0 con 0x7fe79415a770 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe774066c30 msgr2=0x7fe7740690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe774066c30 0x7fe7740690f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe794152150 tx=0x7fe78c009190 comp rx=0 tx=0).stop 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe79415a770 msgr2=0x7fe7941489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe79415a770 0x7fe7941489f0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fe78400c770 tx=0x7fe78400cc30 comp rx=0 tx=0).stop 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 shutdown_connections 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe774066c30 0x7fe7740690f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe79415a770 0x7fe7941489f0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7940cccb0 0x7fe7941484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 --2- 172.21.15.53:0/2339765067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7940b5130 0x7fe79413ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 >> 172.21.15.53:0/2339765067 conn(0x7fe794069f50 msgr2=0x7fe79415d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 shutdown_connections 2024-09-13T18:32:27.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.341+0000 7fe799b8d640 1 -- 172.21.15.53:0/2339765067 wait complete. 2024-09-13T18:32:27.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:32:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18e0936640 1 Processor -- start 2024-09-13T18:32:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18e0936640 1 -- start start 2024-09-13T18:32:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18e0936640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc15fd60 0x7f18dc0cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18e0936640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18dc0cf7b0 0x7f18dc0d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18e0936640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc160ca0 con 0x7f18dc0cd580 2024-09-13T18:32:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18e0936640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0cd9a0 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18e0936640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc161130 con 0x7f18dc15fd60 2024-09-13T18:32:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18dad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18dc0cf7b0 0x7f18dc0d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18d9d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f18dc0cd580 0x7f18dc0cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45072/0 (socket says 172.21.15.53:45072) 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18d9d9b640 1 -- 172.21.15.53:0/4092203005 learned_addr learned my addr 172.21.15.53:0/4092203005 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18da59c640 1 --2- 172.21.15.53:0/4092203005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc15fd60 0x7f18dc0cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18dad9d640 1 -- 172.21.15.53:0/4092203005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc15fd60 msgr2=0x7f18dc0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18dad9d640 1 --2- 172.21.15.53:0/4092203005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc15fd60 0x7f18dc0cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18dad9d640 1 -- 172.21.15.53:0/4092203005 >> v1:172.21.15.53:6789/0 conn(0x7f18dc0cd580 legacy=0x7f18dc0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18dad9d640 1 -- 172.21.15.53:0/4092203005 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc160370 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18d959a640 1 -- 172.21.15.53:0/4092203005 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483384284 0 0) 0x7f18dc160ca0 con 0x7f18dc0cd580 2024-09-13T18:32:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.501+0000 7f18dad9d640 1 --2- 172.21.15.53:0/4092203005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0d09e0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009d90 tx=0x7f18d401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283982280e3ac41f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d959a640 1 -- 172.21.15.53:0/4092203005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40af600 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d959a640 1 -- 172.21.15.53:0/4092203005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d40ab050 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d959a640 1 -- 172.21.15.53:0/4092203005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40af980 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- 172.21.15.53:0/4092203005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 msgr2=0x7f18dc0d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 --2- 172.21.15.53:0/4092203005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0d09e0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009d90 tx=0x7f18d401f150 comp rx=0 tx=0).stop 2024-09-13T18:32:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- 172.21.15.53:0/4092203005 shutdown_connections 2024-09-13T18:32:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 --2- 172.21.15.53:0/4092203005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0d09e0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 --2- 172.21.15.53:0/4092203005 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc15fd60 0x7f18dc0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- 172.21.15.53:0/4092203005 >> 172.21.15.53:0/4092203005 conn(0x7f18dc070970 msgr2=0x7f18dc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- 172.21.15.53:0/4092203005 shutdown_connections 2024-09-13T18:32:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- 172.21.15.53:0/4092203005 wait complete. 2024-09-13T18:32:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 Processor -- start 2024-09-13T18:32:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- start start 2024-09-13T18:32:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0cd580 0x7f18dc1f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc15fd60 0x7f18dc1f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1f6460 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1f5850 con 0x7f18dc15fd60 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1f5b30 con 0x7f18dc0cd580 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59024/0 (socket says 172.21.15.53:59024) 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 -- 172.21.15.53:0/2175925579 learned_addr learned my addr 172.21.15.53:0/2175925579 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18da59c640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0cd580 0x7f18dc1f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18dad9d640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc15fd60 0x7f18dc1f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 -- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0cd580 msgr2=0x7f18dc1f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0cd580 0x7f18dc1f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 -- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc15fd60 msgr2=0x7f18dc1f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc15fd60 0x7f18dc1f4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 -- 172.21.15.53:0/2175925579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4009a70 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18d9d9b640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0b6fb0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c4b0 tx=0x7f18d000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:27.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18caffd640 1 -- 172.21.15.53:0/2175925579 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00074e0 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18caffd640 1 -- 172.21.15.53:0/2175925579 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0007660 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc1f5e10 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18caffd640 1 -- 172.21.15.53:0/2175925579 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0004a30 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.505+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc1f5560 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.509+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc0cb0b0 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.509+0000 7f18caffd640 1 -- 172.21.15.53:0/2175925579 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f18d0004b90 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.509+0000 7f18caffd640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18bc066c60 0x7f18bc069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.509+0000 7f18caffd640 1 -- 172.21.15.53:0/2175925579 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f18d00839b0 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.509+0000 7f18da59c640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18bc066c60 0x7f18bc069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:27.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.509+0000 7f18da59c640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18bc066c60 0x7f18bc069120 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0096f0 tx=0x7f18cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:27.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.513+0000 7f18caffd640 1 -- 172.21.15.53:0/2175925579 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18dc0cb0b0 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.669+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f18dc0cb0b0 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.673+0000 7f18caffd640 1 -- 172.21.15.53:0/2175925579 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f18dc0cb0b0 con 0x7f18dc0cf7b0 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.673+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18bc066c60 msgr2=0x7f18bc069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.673+0000 7f18e0936640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18bc066c60 0x7f18bc069120 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0096f0 tx=0x7f18cc008040 comp rx=0 tx=0).stop 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 msgr2=0x7f18dc0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0b6fb0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c4b0 tx=0x7f18d000c970 comp rx=0 tx=0).stop 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 shutdown_connections 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18bc066c60 0x7f18bc069120 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc15fd60 0x7f18dc1f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0cf7b0 0x7f18dc0b6fb0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 --2- 172.21.15.53:0/2175925579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0cd580 0x7f18dc1f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 >> 172.21.15.53:0/2175925579 conn(0x7f18dc070970 msgr2=0x7f18dc0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 shutdown_connections 2024-09-13T18:32:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:27.677+0000 7f18e0936640 1 -- 172.21.15.53:0/2175925579 wait complete. 2024-09-13T18:32:27.694 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:32:27.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:27.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:27.851 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:32:27.852 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:27.852 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:27.858 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:32:27.858 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:32:27.858 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:27.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:32:27.864 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:27.864 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:27.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:32:27.906 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:32:27.906 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:27.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:32:27.912 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:32:27.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:28.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12fca80640 1 Processor -- start 2024-09-13T18:32:28.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12fca80640 1 -- start start 2024-09-13T18:32:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12fca80640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12f815cab0 0x7f12f80d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12fca80640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f80d2400 con 0x7f12f80cf7d0 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12fca80640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f80d1530 con 0x7f12f80cd6c0 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12fca80640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80d0920 con 0x7f12f815cab0 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12f659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12f815cab0 0x7f12f80d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12f659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f12f815cab0 0x7f12f80d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59030/0 (socket says 172.21.15.53:59030) 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12f659c640 1 -- 172.21.15.53:0/3429253359 learned_addr learned my addr 172.21.15.53:0/3429253359 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12f659c640 1 -- 172.21.15.53:0/3429253359 >> v1:172.21.15.87:6789/0 conn(0x7f12f80cd6c0 legacy=0x7f12f80cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12f659c640 1 -- 172.21.15.53:0/3429253359 >> v1:172.21.15.53:6789/0 conn(0x7f12f80cf7d0 legacy=0x7f12f80b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12f659c640 1 -- 172.21.15.53:0/3429253359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80d0c00 con 0x7f12f815cab0 2024-09-13T18:32:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.077+0000 7f12f559a640 1 -- 172.21.15.53:0/3429253359 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335931241 0 0) 0x7f12f80d2400 con 0x7f12f80cf7d0 2024-09-13T18:32:28.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f659c640 1 --2- 172.21.15.53:0/3429253359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80d19c0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009870 tx=0x7f12e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce2c2d0c340646b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:28.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f559a640 1 -- 172.21.15.53:0/3429253359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80aa650 con 0x7f12f815cab0 2024-09-13T18:32:28.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f559a640 1 -- 172.21.15.53:0/3429253359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e80aa7b0 con 0x7f12f815cab0 2024-09-13T18:32:28.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f559a640 1 -- 172.21.15.53:0/3429253359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80aab40 con 0x7f12f815cab0 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- 172.21.15.53:0/3429253359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 msgr2=0x7f12f80d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 --2- 172.21.15.53:0/3429253359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80d19c0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009870 tx=0x7f12e801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- 172.21.15.53:0/3429253359 shutdown_connections 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 --2- 172.21.15.53:0/3429253359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80d19c0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- 172.21.15.53:0/3429253359 >> 172.21.15.53:0/3429253359 conn(0x7f12f8065c80 msgr2=0x7f12f8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- 172.21.15.53:0/3429253359 shutdown_connections 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- 172.21.15.53:0/3429253359 wait complete. 2024-09-13T18:32:28.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 Processor -- start 2024-09-13T18:32:28.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- start start 2024-09-13T18:32:28.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12f80cd6c0 0x7f12f8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12f80cf7d0 0x7f12f80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8155a70 con 0x7f12f815cab0 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8155d50 con 0x7f12f80cf7d0 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12fca80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8156030 con 0x7f12f80cd6c0 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59032/0 (socket says 172.21.15.53:59032) 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 -- 172.21.15.53:0/3999752843 learned_addr learned my addr 172.21.15.53:0/3999752843 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f659c640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12f80cd6c0 0x7f12f8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f5d9b640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12f80cf7d0 0x7f12f80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 -- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12f80cd6c0 msgr2=0x7f12f8156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12f80cd6c0 0x7f12f8156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 -- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12f80cf7d0 msgr2=0x7f12f80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12f80cf7d0 0x7f12f80b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 -- 172.21.15.53:0/3999752843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e80094d0 con 0x7f12f815cab0 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.081+0000 7f12f6d9d640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80b3fe0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c770 tx=0x7f12f000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12e6ffd640 1 -- 172.21.15.53:0/3999752843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0003db0 con 0x7f12f815cab0 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12e6ffd640 1 -- 172.21.15.53:0/3999752843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f000ce80 con 0x7f12f815cab0 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f8156310 con 0x7f12f815cab0 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12e6ffd640 1 -- 172.21.15.53:0/3999752843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f00052b0 con 0x7f12f815cab0 2024-09-13T18:32:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f8155600 con 0x7f12f815cab0 2024-09-13T18:32:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f81567c0 con 0x7f12f815cab0 2024-09-13T18:32:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12e6ffd640 1 -- 172.21.15.53:0/3999752843 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f12f0005410 con 0x7f12f815cab0 2024-09-13T18:32:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12e6ffd640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12d8066c30 0x7f12d80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12e6ffd640 1 -- 172.21.15.53:0/3999752843 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f12f00841e0 con 0x7f12f815cab0 2024-09-13T18:32:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12f659c640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12d8066c30 0x7f12d80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.085+0000 7f12f659c640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12d8066c30 0x7f12d80690f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12e80ae000 tx=0x7f12e80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:28.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.089+0000 7f12e6ffd640 1 -- 172.21.15.53:0/3999752843 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12f0050fe0 con 0x7f12f815cab0 2024-09-13T18:32:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.285+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12f80d19a0 con 0x7f12f815cab0 2024-09-13T18:32:28.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.285+0000 7f12e6ffd640 1 -- 172.21.15.53:0/3999752843 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f12f0017090 con 0x7f12f815cab0 2024-09-13T18:32:28.287 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:28.288 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3448118459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3448118459},{"type":"v1","addr":"172.21.15.87:6833","nonce":3448118459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6701,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2784676391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2784676391},{"type":"v1","addr":"172.21.15.87:6835","nonce":2784676391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1340459922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1340459922},{"type":"v1","addr":"172.21.15.53:6833","nonce":1340459922}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":8880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2948680470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2948680470},{"type":"v1","addr":"172.21.15.53:6835","nonce":2948680470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[]} 2024-09-13T18:32:28.288 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 74 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12d8066c30 msgr2=0x7f12d80690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12d8066c30 0x7f12d80690f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12e80ae000 tx=0x7f12e80a7000 comp rx=0 tx=0).stop 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 msgr2=0x7f12f80b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80b3fe0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c770 tx=0x7f12f000cc30 comp rx=0 tx=0).stop 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 shutdown_connections 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12d8066c30 0x7f12d80690f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12f815cab0 0x7f12f80b3fe0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12f80cf7d0 0x7f12f80b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 --2- 172.21.15.53:0/3999752843 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f12f80cd6c0 0x7f12f8156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 >> 172.21.15.53:0/3999752843 conn(0x7f12f8065c80 msgr2=0x7f12f8066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 shutdown_connections 2024-09-13T18:32:28.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.289+0000 7f12fca80640 1 -- 172.21.15.53:0/3999752843 wait complete. 2024-09-13T18:32:28.308 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:32:28.308 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:32:28.308 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:32:28.308 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:32:28.308 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:32:28.308 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:32:28.309 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:32:28.309 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:32:28.309 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:32:28.309 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:32:28.309 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:32:28.309 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:32:28.309 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:32:28.310 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:32:28.310 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:32:28.310 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:32:28.318 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:32:28.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:32:28.319 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:32:28.319 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:32:28.322 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:32:28.322 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:32:28.326 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:32:28.326 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:32:28.363 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:32:28.363 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:28.364 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:32:28.364 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:28.375 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:32:28.375 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:28.376 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:32:28.376 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:28.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:32:28.433 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:32:28.433 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:32:28.448 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:32:28.450 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:32:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 Processor -- start 2024-09-13T18:32:28.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 -- start start 2024-09-13T18:32:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe03015cab0 0x7fe0300d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cd6c0 0x7fe0300cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe0300cdb00 0x7fe0300cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0300d2400 con 0x7fe0300cdb00 2024-09-13T18:32:28.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0300d1530 con 0x7fe03015cab0 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe0353bc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300d0920 con 0x7fe0300cd6c0 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe0300cdb00 0x7fe0300cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe0300cdb00 0x7fe0300cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59076/0 (socket says 172.21.15.53:59076) 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 -- 172.21.15.53:0/1867651728 learned_addr learned my addr 172.21.15.53:0/1867651728 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02e7fc640 1 --2- 172.21.15.53:0/1867651728 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cd6c0 0x7fe0300cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02effd640 1 --2- 172.21.15.53:0/1867651728 >> v2:172.21.15.87:3300/0 conn(0x7fe03015cab0 0x7fe0300d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 -- 172.21.15.53:0/1867651728 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cd6c0 msgr2=0x7fe0300cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 --2- 172.21.15.53:0/1867651728 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cd6c0 0x7fe0300cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 -- 172.21.15.53:0/1867651728 >> v2:172.21.15.87:3300/0 conn(0x7fe03015cab0 msgr2=0x7fe0300d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 --2- 172.21.15.53:0/1867651728 >> v2:172.21.15.87:3300/0 conn(0x7fe03015cab0 0x7fe0300d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02f7fe640 1 -- 172.21.15.53:0/1867651728 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0300d0c00 con 0x7fe0300cdb00 2024-09-13T18:32:28.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.497+0000 7fe02effd640 1 --2- 172.21.15.53:0/1867651728 >> v2:172.21.15.87:3300/0 conn(0x7fe03015cab0 0x7fe0300d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02f7fe640 1 --2- 172.21.15.53:0/1867651728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0300cdb00 0x7fe0300cf600 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fe030066930 tx=0x7fe02801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0ec589d55e9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02dffb640 1 -- 172.21.15.53:0/1867651728 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a5840 con 0x7fe0300cdb00 2024-09-13T18:32:28.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02dffb640 1 -- 172.21.15.53:0/1867651728 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0280a59a0 con 0x7fe0300cdb00 2024-09-13T18:32:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02dffb640 1 -- 172.21.15.53:0/1867651728 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a5d30 con 0x7fe0300cdb00 2024-09-13T18:32:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- 172.21.15.53:0/1867651728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0300cdb00 msgr2=0x7fe0300cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 --2- 172.21.15.53:0/1867651728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0300cdb00 0x7fe0300cf600 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fe030066930 tx=0x7fe02801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- 172.21.15.53:0/1867651728 shutdown_connections 2024-09-13T18:32:28.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 --2- 172.21.15.53:0/1867651728 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cd6c0 0x7fe0300cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 --2- 172.21.15.53:0/1867651728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0300cdb00 0x7fe0300cf600 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 --2- 172.21.15.53:0/1867651728 >> v2:172.21.15.87:3300/0 conn(0x7fe03015cab0 0x7fe0300d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- 172.21.15.53:0/1867651728 >> 172.21.15.53:0/1867651728 conn(0x7fe030065c80 msgr2=0x7fe030066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- 172.21.15.53:0/1867651728 shutdown_connections 2024-09-13T18:32:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- 172.21.15.53:0/1867651728 wait complete. 2024-09-13T18:32:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 Processor -- start 2024-09-13T18:32:28.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- start start 2024-09-13T18:32:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0300cd6c0 0x7fe030166e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cdb00 0x7fe0300caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe03015cab0 0x7fe03015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015c2a0 con 0x7fe03015cab0 2024-09-13T18:32:28.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300cafe0 con 0x7fe0300cd6c0 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe0353bc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015b3d0 con 0x7fe0300cdb00 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe03015cab0 0x7fe03015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe03015cab0 0x7fe03015e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59090/0 (socket says 172.21.15.53:59090) 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02f7fe640 1 -- 172.21.15.53:0/3962651583 learned_addr learned my addr 172.21.15.53:0/3962651583 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02e7fc640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cdb00 0x7fe0300caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.501+0000 7fe02effd640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0300cd6c0 0x7fe030166e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02f7fe640 1 -- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cdb00 msgr2=0x7fe0300caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02f7fe640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cdb00 0x7fe0300caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02f7fe640 1 -- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0300cd6c0 msgr2=0x7fe030166e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02f7fe640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0300cd6c0 0x7fe030166e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02f7fe640 1 -- 172.21.15.53:0/3962651583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028009b30 con 0x7fe03015cab0 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02f7fe640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe03015cab0 0x7fe03015e1f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fe02801b070 tx=0x7fe028019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:28.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0177fe640 1 -- 172.21.15.53:0/3962651583 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280bd070 con 0x7fe03015cab0 2024-09-13T18:32:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0177fe640 1 -- 172.21.15.53:0/3962651583 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0280b8470 con 0x7fe03015cab0 2024-09-13T18:32:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03015b620 con 0x7fe03015cab0 2024-09-13T18:32:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0177fe640 1 -- 172.21.15.53:0/3962651583 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280b8820 con 0x7fe03015cab0 2024-09-13T18:32:28.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03015bbe0 con 0x7fe03015cab0 2024-09-13T18:32:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0300d1980 con 0x7fe03015cab0 2024-09-13T18:32:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0177fe640 1 -- 172.21.15.53:0/3962651583 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fe0280b8980 con 0x7fe03015cab0 2024-09-13T18:32:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0177fe640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe01c066c30 0x7fe01c0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe0177fe640 1 -- 172.21.15.53:0/3962651583 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe02811fef0 con 0x7fe03015cab0 2024-09-13T18:32:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02effd640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe01c066c30 0x7fe01c0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:28.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.505+0000 7fe02effd640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe01c066c30 0x7fe01c0690f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe0300b3430 tx=0x7fe020008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:28.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.509+0000 7fe0177fe640 1 -- 172.21.15.53:0/3962651583 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0280ecf00 con 0x7fe03015cab0 2024-09-13T18:32:28.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:28.681+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe030067910 con 0x7fe03015cab0 2024-09-13T18:32:29.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.681+0000 7fe0177fe640 1 -- 172.21.15.53:0/3962651583 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe030067910 con 0x7fe03015cab0 2024-09-13T18:32:29.682 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:32:29.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe01c066c30 msgr2=0x7fe01c0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:29.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe01c066c30 0x7fe01c0690f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe0300b3430 tx=0x7fe020008040 comp rx=0 tx=0).stop 2024-09-13T18:32:29.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe03015cab0 msgr2=0x7fe03015e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:29.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe03015cab0 0x7fe03015e1f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fe02801b070 tx=0x7fe028019760 comp rx=0 tx=0).stop 2024-09-13T18:32:29.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 shutdown_connections 2024-09-13T18:32:29.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe01c066c30 0x7fe01c0690f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe0300cdb00 0x7fe0300caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe03015cab0 0x7fe03015e1f0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 --2- 172.21.15.53:0/3962651583 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0300cd6c0 0x7fe030166e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 >> 172.21.15.53:0/3962651583 conn(0x7fe030065c80 msgr2=0x7fe030155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:29.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 shutdown_connections 2024-09-13T18:32:29.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.685+0000 7fe0353bc640 1 -- 172.21.15.53:0/3962651583 wait complete. 2024-09-13T18:32:29.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:32:29.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.837+0000 7f7b331a6640 1 Processor -- start 2024-09-13T18:32:29.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.837+0000 7f7b331a6640 1 -- start start 2024-09-13T18:32:29.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b331a6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b2c0cbd60 0x7f7b2c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b331a6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c0b1ac0 con 0x7f7b2c0cb980 2024-09-13T18:32:29.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b331a6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c159ac0 con 0x7f7b2c06b850 2024-09-13T18:32:29.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b331a6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c159da0 con 0x7f7b2c0cbd60 2024-09-13T18:32:29.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b30f42640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7b2c0cb980 0x7f7b2c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45100/0 (socket says 172.21.15.53:45100) 2024-09-13T18:32:29.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b30f42640 1 -- 172.21.15.53:0/3782502132 learned_addr learned my addr 172.21.15.53:0/3782502132 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:29.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 --2- 172.21.15.53:0/3782502132 >> v2:172.21.15.87:3300/0 conn(0x7f7b2c0cbd60 0x7f7b2c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893462854 0 0) 0x7f7b2c0b1ac0 con 0x7f7b2c0cb980 2024-09-13T18:32:29.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c003530 con 0x7f7b2c0cb980 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921781623 0 0) 0x7f7b1c003530 con 0x7f7b2c0cb980 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 >> v2:172.21.15.87:3300/0 conn(0x7f7b2c0cbd60 msgr2=0x7f7b2c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 --2- 172.21.15.53:0/3782502132 >> v2:172.21.15.87:3300/0 conn(0x7f7b2c0cbd60 0x7f7b2c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 >> v1:172.21.15.87:6789/0 conn(0x7f7b2c06b850 legacy=0x7f7b2c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c15a080 con 0x7f7b2c0cb980 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7b200016a0 con 0x7f7b2c0cb980 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 --2- 172.21.15.53:0/3782502132 >> v2:172.21.15.87:3300/0 conn(0x7f7b2c0cbd60 0x7f7b2c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 >> v1:172.21.15.53:6789/0 conn(0x7f7b2c0cb980 legacy=0x7f7b2c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c003980 0x7f7b1c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1c0047d0 0x7f7b1c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1c0052b0 0x7f7b1c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c159da0 con 0x7f7b1c0052b0 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c00c180 con 0x7f7b1c0047d0 2024-09-13T18:32:29.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c00c340 con 0x7f7b1c003980 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1c0052b0 0x7f7b1c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b2bfff640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1c0047d0 0x7f7b1c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b30f42640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c003980 0x7f7b1c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 -- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c003980 msgr2=0x7f7b1c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c003980 0x7f7b1c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 -- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1c0047d0 msgr2=0x7f7b1c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1c0047d0 0x7f7b1c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.841+0000 7f7b31743640 1 -- 172.21.15.53:0/3782502132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c003530 con 0x7f7b1c0052b0 2024-09-13T18:32:29.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b31743640 1 -- 172.21.15.53:0/3782502132 reap_dead start 2024-09-13T18:32:29.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b31743640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1c0052b0 0x7f7b1c00b990 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0b38f0 tx=0x7f7b2401cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3142bef06500f8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:29.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240a5de0 con 0x7f7b1c0052b0 2024-09-13T18:32:29.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2400f040 con 0x7f7b1c0052b0 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2b7fe640 1 -- 172.21.15.53:0/3782502132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24003ba0 con 0x7f7b1c0052b0 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- 172.21.15.53:0/3782502132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1c0052b0 msgr2=0x7f7b1c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1c0052b0 0x7f7b1c00b990 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0b38f0 tx=0x7f7b2401cdf0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- 172.21.15.53:0/3782502132 shutdown_connections 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3782502132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1c0052b0 0x7f7b1c00b990 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- 172.21.15.53:0/3782502132 >> 172.21.15.53:0/3782502132 conn(0x7f7b2c065c80 msgr2=0x7f7b2c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- 172.21.15.53:0/3782502132 shutdown_connections 2024-09-13T18:32:29.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- 172.21.15.53:0/3782502132 wait complete. 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 Processor -- start 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- start start 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c0052b0 0x7f7b2c0ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b2c14f890 0x7f7b2c0ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2c161fa0 0x7f7b2c162420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0ac340 con 0x7f7b2c14f890 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15fc30 con 0x7f7b2c161fa0 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b331a6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0abd80 con 0x7f7b1c0052b0 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b2c14f890 0x7f7b2c0ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b2c14f890 0x7f7b2c0ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59108/0 (socket says 172.21.15.53:59108) 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 -- 172.21.15.53:0/3525973972 learned_addr learned my addr 172.21.15.53:0/3525973972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b31743640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2c161fa0 0x7f7b2c162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b30f42640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c0052b0 0x7f7b2c0ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 -- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c0052b0 msgr2=0x7f7b2c0ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c0052b0 0x7f7b2c0ab530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 -- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2c161fa0 msgr2=0x7f7b2c162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2c161fa0 0x7f7b2c162420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 -- 172.21.15.53:0/3525973972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0ac060 con 0x7f7b2c14f890 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b31743640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2c161fa0 0x7f7b2c162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.845+0000 7f7b2bfff640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b2c14f890 0x7f7b2c0ad5f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800e440 tx=0x7f7b1800e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b297fa640 1 -- 172.21.15.53:0/3525973972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180052e0 con 0x7f7b2c14f890 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b297fa640 1 -- 172.21.15.53:0/3525973972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18005440 con 0x7f7b2c14f890 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b297fa640 1 -- 172.21.15.53:0/3525973972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18003840 con 0x7f7b2c14f890 2024-09-13T18:32:29.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c15f8c0 con 0x7f7b2c14f890 2024-09-13T18:32:29.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c0adb30 con 0x7f7b2c14f890 2024-09-13T18:32:29.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c067400 con 0x7f7b2c14f890 2024-09-13T18:32:29.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b297fa640 1 -- 172.21.15.53:0/3525973972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f7b180039a0 con 0x7f7b2c14f890 2024-09-13T18:32:29.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b297fa640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b10066c60 0x7f7b10069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:29.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b297fa640 1 -- 172.21.15.53:0/3525973972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7b18084520 con 0x7f7b2c14f890 2024-09-13T18:32:29.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b30f42640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b10066c60 0x7f7b10069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:29.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.849+0000 7f7b30f42640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b10066c60 0x7f7b10069120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7b20001230 tx=0x7f7b20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:29.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:29.853+0000 7f7b297fa640 1 -- 172.21.15.53:0/3525973972 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b18051400 con 0x7f7b2c14f890 2024-09-13T18:32:30.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.073+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7b2c15fd70 con 0x7f7b2c14f890 2024-09-13T18:32:30.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b297fa640 1 -- 172.21.15.53:0/3525973972 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7b18054a20 con 0x7f7b2c14f890 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.078 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:32:30.079 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:32:30.080 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.082 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.083 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.084 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.085 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:32:30.086 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.087 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.088 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.089 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:32:30.090 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:32:30.091 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:32:30.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b10066c60 msgr2=0x7f7b10069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b10066c60 0x7f7b10069120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7b20001230 tx=0x7f7b20009040 comp rx=0 tx=0).stop 2024-09-13T18:32:30.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b2c14f890 msgr2=0x7f7b2c0ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b2c14f890 0x7f7b2c0ad5f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800e440 tx=0x7f7b1800e900 comp rx=0 tx=0).stop 2024-09-13T18:32:30.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 shutdown_connections 2024-09-13T18:32:30.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b10066c60 0x7f7b10069120 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b2c161fa0 0x7f7b2c162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b2c14f890 0x7f7b2c0ad5f0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 --2- 172.21.15.53:0/3525973972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1c0052b0 0x7f7b2c0ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 >> 172.21.15.53:0/3525973972 conn(0x7f7b2c065c80 msgr2=0x7f7b2c164960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 shutdown_connections 2024-09-13T18:32:30.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.077+0000 7f7b331a6640 1 -- 172.21.15.53:0/3525973972 wait complete. 2024-09-13T18:32:30.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f16774bd640 1 Processor -- start 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f16774bd640 1 -- start start 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f16774bd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f167006fa80 0x7f167006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f16774bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16700cbb60 0x7f16700b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f16774bd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700b2340 con 0x7f1670158ba0 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f16774bd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16700b2860 con 0x7f167006fa80 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f16774bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1670158f80 con 0x7f16700cbb60 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1674a58640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f167006fa80 0x7f167006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1674a58640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f167006fa80 0x7f167006b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59116/0 (socket says 172.21.15.53:59116) 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1674a58640 1 -- 172.21.15.53:0/676923520 learned_addr learned my addr 172.21.15.53:0/676923520 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:30.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1675a5a640 1 --2- 172.21.15.53:0/676923520 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16700cbb60 0x7f16700b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1674a58640 1 -- 172.21.15.53:0/676923520 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16700cbb60 msgr2=0x7f16700b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:30.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1674a58640 1 --2- 172.21.15.53:0/676923520 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16700cbb60 0x7f16700b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1674a58640 1 -- 172.21.15.53:0/676923520 >> v1:172.21.15.87:6789/0 conn(0x7f1670158ba0 legacy=0x7f167006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:30.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1674a58640 1 -- 172.21.15.53:0/676923520 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700b2580 con 0x7f167006fa80 2024-09-13T18:32:30.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.221+0000 7f1675a5a640 1 --2- 172.21.15.53:0/676923520 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16700cbb60 0x7f16700b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:30.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f1674a58640 1 --2- 172.21.15.53:0/676923520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f167006b390 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f1660006fd0 tx=0x7f166001e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d50275f7d78172 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f1667fff640 1 -- 172.21.15.53:0/676923520 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660004230 con 0x7f167006fa80 2024-09-13T18:32:30.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f1667fff640 1 -- 172.21.15.53:0/676923520 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16600ab070 con 0x7f167006fa80 2024-09-13T18:32:30.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f1667fff640 1 -- 172.21.15.53:0/676923520 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16600a77b0 con 0x7f167006fa80 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- 172.21.15.53:0/676923520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 msgr2=0x7f167006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 --2- 172.21.15.53:0/676923520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f167006b390 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f1660006fd0 tx=0x7f166001e960 comp rx=0 tx=0).stop 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- 172.21.15.53:0/676923520 shutdown_connections 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 --2- 172.21.15.53:0/676923520 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16700cbb60 0x7f16700b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 --2- 172.21.15.53:0/676923520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f167006b390 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- 172.21.15.53:0/676923520 >> 172.21.15.53:0/676923520 conn(0x7f1670065c80 msgr2=0x7f1670066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- 172.21.15.53:0/676923520 shutdown_connections 2024-09-13T18:32:30.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- 172.21.15.53:0/676923520 wait complete. 2024-09-13T18:32:30.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 Processor -- start 2024-09-13T18:32:30.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- start start 2024-09-13T18:32:30.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f16700c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16700cbb60 0x7f1670150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1670158ba0 0x7f16700aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1670156c90 con 0x7f167006fa80 2024-09-13T18:32:30.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1670156110 con 0x7f16700cbb60 2024-09-13T18:32:30.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.225+0000 7f16774bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16701563f0 con 0x7f1670158ba0 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f16700c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f16700c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59124/0 (socket says 172.21.15.53:59124) 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 -- 172.21.15.53:0/1830776011 learned_addr learned my addr 172.21.15.53:0/1830776011 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675a5a640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1670158ba0 0x7f16700aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1674a58640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16700cbb60 0x7f1670150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 -- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1670158ba0 msgr2=0x7f16700aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1670158ba0 0x7f16700aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 -- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16700cbb60 msgr2=0x7f1670150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16700cbb60 0x7f1670150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 -- 172.21.15.53:0/1830776011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166000b780 con 0x7f167006fa80 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1675259640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f16700c54c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c370 tx=0x7f166c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1665ffb640 1 -- 172.21.15.53:0/1830776011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c0052d0 con 0x7f167006fa80 2024-09-13T18:32:30.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1665ffb640 1 -- 172.21.15.53:0/1830776011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c005430 con 0x7f167006fa80 2024-09-13T18:32:30.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16701566d0 con 0x7f167006fa80 2024-09-13T18:32:30.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1665ffb640 1 -- 172.21.15.53:0/1830776011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c007260 con 0x7f167006fa80 2024-09-13T18:32:30.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1670151160 con 0x7f167006fa80 2024-09-13T18:32:30.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1670067400 con 0x7f167006fa80 2024-09-13T18:32:30.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1665ffb640 1 -- 172.21.15.53:0/1830776011 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f166c0073c0 con 0x7f167006fa80 2024-09-13T18:32:30.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1665ffb640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1654066c30 0x7f16540690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1665ffb640 1 -- 172.21.15.53:0/1830776011 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f166c083980 con 0x7f167006fa80 2024-09-13T18:32:30.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1674a58640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1654066c30 0x7f16540690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.229+0000 7f1674a58640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1654066c30 0x7f16540690f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16600b1000 tx=0x7f16600a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.233+0000 7f1665ffb640 1 -- 172.21.15.53:0/1830776011 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f166c050910 con 0x7f167006fa80 2024-09-13T18:32:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.393+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16700b2340 con 0x7f167006fa80 2024-09-13T18:32:30.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f1665ffb640 1 -- 172.21.15.53:0/1830776011 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+12807 (secure 0 0 0) 0x7f16700b2340 con 0x7f167006fa80 2024-09-13T18:32:30.399 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:30.399 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":132,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:29.676556+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:30.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1654066c30 msgr2=0x7f16540690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1654066c30 0x7f16540690f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16600b1000 tx=0x7f16600a9070 comp rx=0 tx=0).stop 2024-09-13T18:32:30.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 msgr2=0x7f16700c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f16700c54c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c370 tx=0x7f166c00c830 comp rx=0 tx=0).stop 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 shutdown_connections 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1654066c30 0x7f16540690f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1670158ba0 0x7f16700aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16700cbb60 0x7f1670150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 --2- 172.21.15.53:0/1830776011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f167006fa80 0x7f16700c54c0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.397+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 >> 172.21.15.53:0/1830776011 conn(0x7f1670065c80 msgr2=0x7f1670067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.401+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 shutdown_connections 2024-09-13T18:32:30.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.401+0000 7f16774bd640 1 -- 172.21.15.53:0/1830776011 wait complete. 2024-09-13T18:32:30.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:32:30.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:32:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d403c640 1 Processor -- start 2024-09-13T18:32:30.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d403c640 1 -- start start 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d403c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 0x7fb7cc0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d403c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb7cc0d3390 0x7fb7cc0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d403c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc0b7db0 con 0x7fb7cc0ccd10 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d403c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc0d0650 con 0x7fb7cc0d3390 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d403c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0d0c10 con 0x7fb7cc15c830 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb7cc0ccd10 0x7fb7cc0d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45114/0 (socket says 172.21.15.53:45114) 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 -- 172.21.15.53:0/3455932544 learned_addr learned my addr 172.21.15.53:0/3455932544 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:30.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d1dd8640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 0x7fb7cc0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d25d9640 1 --2- 172.21.15.53:0/3455932544 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc0d3390 0x7fb7cc0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039650964 0 0) 0x7fb7cc0b7db0 con 0x7fb7cc0ccd10 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b8003530 con 0x7fb7cc0ccd10 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2414784157 0 0) 0x7fb7b8003530 con 0x7fb7cc0ccd10 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 msgr2=0x7fb7cc0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 0x7fb7cc0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc0d3390 msgr2=0x7fb7cc0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 --2- 172.21.15.53:0/3455932544 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc0d3390 0x7fb7cc0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0cd7d0 con 0x7fb7cc0ccd10 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb7bc001680 con 0x7fb7cc0ccd10 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 >> v1:172.21.15.53:6789/0 conn(0x7fb7cc0ccd10 legacy=0x7fb7cc0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 0x7fb7b8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b8004d10 0x7fb7b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0d0650 con 0x7fb7b8003f00 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0d0c10 con 0x7fb7b8004d10 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b800b990 con 0x7fb7cc15c830 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d25d9640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b8004d10 0x7fb7b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d1dd8640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 0x7fb7b8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 -- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 msgr2=0x7fb7b8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc15c830 0x7fb7b8003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 -- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b8004d10 msgr2=0x7fb7b8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b8004d10 0x7fb7b8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d15d7640 1 -- 172.21.15.53:0/3455932544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8003530 con 0x7fb7b8003f00 2024-09-13T18:32:30.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.549+0000 7fb7d25d9640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7b8004d10 0x7fb7b8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d15d7640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7b80047d0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0b43f0 tx=0x7fb7bc01f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7524160dd3b94a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc005ae0 con 0x7fb7b8003f00 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0ab070 con 0x7fb7b8003f00 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d0dd6640 1 -- 172.21.15.53:0/3455932544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc005e80 con 0x7fb7b8003f00 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 -- 172.21.15.53:0/3455932544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 msgr2=0x7fb7b80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 --2- 172.21.15.53:0/3455932544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7b80047d0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0b43f0 tx=0x7fb7bc01f330 comp rx=0 tx=0).stop 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d25d9640 1 -- 172.21.15.53:0/3455932544 reap_dead start 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 -- 172.21.15.53:0/3455932544 shutdown_connections 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 -- 172.21.15.53:0/3455932544 >> 172.21.15.53:0/3455932544 conn(0x7fb7cc070970 msgr2=0x7fb7cc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 -- 172.21.15.53:0/3455932544 shutdown_connections 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 -- 172.21.15.53:0/3455932544 wait complete. 2024-09-13T18:32:30.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 Processor -- start 2024-09-13T18:32:30.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.553+0000 7fb7d403c640 1 -- start start 2024-09-13T18:32:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7cc0a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc0ab980 0x7fb7cc0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc1f5780 0x7fb7cc1f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc1f6150 con 0x7fb7b8003f00 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc15a740 con 0x7fb7cc1f5780 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0aa0f0 con 0x7fb7cc0ab980 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7cc0a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7cc0a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59156/0 (socket says 172.21.15.53:59156) 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 -- 172.21.15.53:0/1846382630 learned_addr learned my addr 172.21.15.53:0/1846382630 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d25d9640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc1f5780 0x7fb7cc1f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d15d7640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc0ab980 0x7fb7cc0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 -- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc0ab980 msgr2=0x7fb7cc0b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc0ab980 0x7fb7cc0b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 -- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc1f5780 msgr2=0x7fb7cc1f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc1f5780 0x7fb7cc1f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 -- 172.21.15.53:0/1846382630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0aa8e0 con 0x7fb7b8003f00 2024-09-13T18:32:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d1dd8640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7cc0a9bb0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8010890 tx=0x7fb7c8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7c27fc640 1 -- 172.21.15.53:0/1846382630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8009630 con 0x7fb7b8003f00 2024-09-13T18:32:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7c27fc640 1 -- 172.21.15.53:0/1846382630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c800eae0 con 0x7fb7b8003f00 2024-09-13T18:32:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 -- 172.21.15.53:0/1846382630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc0aac20 con 0x7fb7b8003f00 2024-09-13T18:32:30.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7c27fc640 1 -- 172.21.15.53:0/1846382630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800ee90 con 0x7fb7b8003f00 2024-09-13T18:32:30.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d403c640 1 -- 172.21.15.53:0/1846382630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc0ab460 con 0x7fb7b8003f00 2024-09-13T18:32:30.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a8005260 con 0x7fb7b8003f00 2024-09-13T18:32:30.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7c27fc640 1 -- 172.21.15.53:0/1846382630 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fb7c801c400 con 0x7fb7b8003f00 2024-09-13T18:32:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7c27fc640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb7b0066c30 0x7fb7b00690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7c27fc640 1 -- 172.21.15.53:0/1846382630 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb7c8084d10 con 0x7fb7b8003f00 2024-09-13T18:32:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d15d7640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb7b0066c30 0x7fb7b00690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.557+0000 7fb7d15d7640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb7b0066c30 0x7fb7b00690f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ae000 tx=0x7fb7bc000ff0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.561+0000 7fb7c27fc640 1 -- 172.21.15.53:0/1846382630 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7c8051c10 con 0x7fb7b8003f00 2024-09-13T18:32:30.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.721+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7a8005a90 con 0x7fb7b8003f00 2024-09-13T18:32:30.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7c27fc640 1 -- 172.21.15.53:0/1846382630 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7c8055230 con 0x7fb7b8003f00 2024-09-13T18:32:30.726 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:32:30.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb7b0066c30 msgr2=0x7fb7b00690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb7b0066c30 0x7fb7b00690f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0ae000 tx=0x7fb7bc000ff0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 msgr2=0x7fb7cc0a9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7cc0a9bb0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8010890 tx=0x7fb7c8010d50 comp rx=0 tx=0).stop 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 shutdown_connections 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb7b0066c30 0x7fb7b00690f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc0ab980 0x7fb7cc0b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc1f5780 0x7fb7cc1f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 --2- 172.21.15.53:0/1846382630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7b8003f00 0x7fb7cc0a9bb0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 >> 172.21.15.53:0/1846382630 conn(0x7fb7cc070970 msgr2=0x7fb7cc0664f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 shutdown_connections 2024-09-13T18:32:30.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.725+0000 7fb7affff640 1 -- 172.21.15.53:0/1846382630 wait complete. 2024-09-13T18:32:30.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:32:30.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff1141b8640 1 Processor -- start 2024-09-13T18:32:30.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff1141b8640 1 -- start start 2024-09-13T18:32:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff1141b8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff10c06b850 0x7ff10c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff1141b8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff10c0cbd60 0x7ff10c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff1141b8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0b1ac0 con 0x7ff10c0cb980 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff1141b8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c0b3010 con 0x7ff10c0cbd60 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff1141b8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c159ac0 con 0x7ff10c06b850 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff112755640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff10c0cbd60 0x7ff10c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff112755640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff10c0cbd60 0x7ff10c0cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59164/0 (socket says 172.21.15.53:59164) 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff112755640 1 -- 172.21.15.53:0/2571416766 learned_addr learned my addr 172.21.15.53:0/2571416766 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff111f54640 1 --1- 172.21.15.53:0/2571416766 >> v1:172.21.15.53:6789/0 conn(0x7ff10c0cb980 0x7ff10c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45128/0 (socket says 172.21.15.53:45128) 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff111753640 1 --2- 172.21.15.53:0/2571416766 >> v2:172.21.15.87:3300/0 conn(0x7ff10c06b850 0x7ff10c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff112755640 1 -- 172.21.15.53:0/2571416766 >> v2:172.21.15.87:3300/0 conn(0x7ff10c06b850 msgr2=0x7ff10c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff112755640 1 --2- 172.21.15.53:0/2571416766 >> v2:172.21.15.87:3300/0 conn(0x7ff10c06b850 0x7ff10c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff112755640 1 -- 172.21.15.53:0/2571416766 >> v1:172.21.15.53:6789/0 conn(0x7ff10c0cb980 legacy=0x7ff10c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff110f52640 1 -- 172.21.15.53:0/2571416766 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406512067 0 0) 0x7ff10c0b1ac0 con 0x7ff10c0cb980 2024-09-13T18:32:30.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.865+0000 7ff112755640 1 -- 172.21.15.53:0/2571416766 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c159da0 con 0x7ff10c0cbd60 2024-09-13T18:32:30.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff112755640 1 --2- 172.21.15.53:0/2571416766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cdd40 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0709a0 tx=0x7ff10401eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c71950818192f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff110f52640 1 -- 172.21.15.53:0/2571416766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400b2d0 con 0x7ff10c0cbd60 2024-09-13T18:32:30.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff110f52640 1 -- 172.21.15.53:0/2571416766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400b430 con 0x7ff10c0cbd60 2024-09-13T18:32:30.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff110f52640 1 -- 172.21.15.53:0/2571416766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040a7b90 con 0x7ff10c0cbd60 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- 172.21.15.53:0/2571416766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 msgr2=0x7ff10c0cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 --2- 172.21.15.53:0/2571416766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cdd40 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0709a0 tx=0x7ff10401eaa0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- 172.21.15.53:0/2571416766 shutdown_connections 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 --2- 172.21.15.53:0/2571416766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cdd40 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 --2- 172.21.15.53:0/2571416766 >> v2:172.21.15.87:3300/0 conn(0x7ff10c06b850 0x7ff10c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- 172.21.15.53:0/2571416766 >> 172.21.15.53:0/2571416766 conn(0x7ff10c065c80 msgr2=0x7ff10c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- 172.21.15.53:0/2571416766 shutdown_connections 2024-09-13T18:32:30.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- 172.21.15.53:0/2571416766 wait complete. 2024-09-13T18:32:30.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 Processor -- start 2024-09-13T18:32:30.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- start start 2024-09-13T18:32:30.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c06b850 0x7ff10c0ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0cb980 0x7ff10c0ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c1404d0 con 0x7ff10c0cbd60 2024-09-13T18:32:30.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c13f850 con 0x7ff10c06b850 2024-09-13T18:32:30.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff1141b8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c13fb30 con 0x7ff10c0cb980 2024-09-13T18:32:30.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.869+0000 7ff112755640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59174/0 (socket says 172.21.15.53:59174) 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 -- 172.21.15.53:0/939542208 learned_addr learned my addr 172.21.15.53:0/939542208 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff111f54640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c06b850 0x7ff10c0ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff111753640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0cb980 0x7ff10c0ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 -- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0cb980 msgr2=0x7ff10c0ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0cb980 0x7ff10c0ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 -- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c06b850 msgr2=0x7ff10c0ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c06b850 0x7ff10c0ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 -- 172.21.15.53:0/939542208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10400bd40 con 0x7ff10c0cbd60 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff112755640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cc6d0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff1040b1040 tx=0x7ff10401b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1027fc640 1 -- 172.21.15.53:0/939542208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104009800 con 0x7ff10c0cbd60 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1027fc640 1 -- 172.21.15.53:0/939542208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104009980 con 0x7ff10c0cbd60 2024-09-13T18:32:30.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1027fc640 1 -- 172.21.15.53:0/939542208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104009d30 con 0x7ff10c0cbd60 2024-09-13T18:32:30.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c13fe10 con 0x7ff10c0cbd60 2024-09-13T18:32:30.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c0ad8c0 con 0x7ff10c0cbd60 2024-09-13T18:32:30.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c067400 con 0x7ff10c0cbd60 2024-09-13T18:32:30.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1027fc640 1 -- 172.21.15.53:0/939542208 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7ff1040c3460 con 0x7ff10c0cbd60 2024-09-13T18:32:30.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1027fc640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0f0066c30 0x7ff0f00690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff111f54640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0f0066c30 0x7ff0f00690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff1027fc640 1 -- 172.21.15.53:0/939542208 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff104120300 con 0x7ff10c0cbd60 2024-09-13T18:32:30.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.873+0000 7ff111f54640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0f0066c30 0x7ff0f00690f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff108000f70 tx=0x7ff108007b80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:30.877+0000 7ff1027fc640 1 -- 172.21.15.53:0/939542208 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1040ed300 con 0x7ff10c0cbd60 2024-09-13T18:32:31.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff10c0b2ba0 con 0x7ff10c0cbd60 2024-09-13T18:32:31.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1027fc640 1 -- 172.21.15.53:0/939542208 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff1040f0920 con 0x7ff10c0cbd60 2024-09-13T18:32:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:31.043 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:32:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:32:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:32:31.043 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:31.044 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:32:31.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0f0066c30 msgr2=0x7ff0f00690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0f0066c30 0x7ff0f00690f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff108000f70 tx=0x7ff108007b80 comp rx=0 tx=0).stop 2024-09-13T18:32:31.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 msgr2=0x7ff10c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cc6d0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff1040b1040 tx=0x7ff10401b840 comp rx=0 tx=0).stop 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 shutdown_connections 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0f0066c30 0x7ff0f00690f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0cb980 0x7ff10c0ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff10c0cbd60 0x7ff10c0cc6d0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 --2- 172.21.15.53:0/939542208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c06b850 0x7ff10c0ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.041+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 >> 172.21.15.53:0/939542208 conn(0x7ff10c065c80 msgr2=0x7ff10c15ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.045+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 shutdown_connections 2024-09-13T18:32:31.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.045+0000 7ff1141b8640 1 -- 172.21.15.53:0/939542208 wait complete. 2024-09-13T18:32:31.063 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:32:31.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:32:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5893b1640 1 Processor -- start 2024-09-13T18:32:31.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5893b1640 1 -- start start 2024-09-13T18:32:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5893b1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc58415c5e0 0x7fc58415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5893b1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc5840ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5893b1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc584070fb0 con 0x7fc58406ccc0 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5893b1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58415dd30 con 0x7fc58415c5e0 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5893b1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc584070a10 con 0x7fc5840cc800 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc582ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc58415c5e0 0x7fc58415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5827fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc58406ccc0 0x7fc58406d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:37550/0 (socket says 172.21.15.53:37550) 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc5827fc640 1 -- 172.21.15.53:0/3691001842 learned_addr learned my addr 172.21.15.53:0/3691001842 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.185+0000 7fc582ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc58415c5e0 0x7fc58415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59190/0 (socket says 172.21.15.53:59190) 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5837fe640 1 --2- 172.21.15.53:0/3691001842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc5840ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc582ffd640 1 -- 172.21.15.53:0/3691001842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 msgr2=0x7fc5840ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc582ffd640 1 --2- 172.21.15.53:0/3691001842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc5840ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc582ffd640 1 -- 172.21.15.53:0/3691001842 >> v1:172.21.15.87:6789/0 conn(0x7fc58406ccc0 legacy=0x7fc58406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc582ffd640 1 -- 172.21.15.53:0/3691001842 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840711e0 con 0x7fc58415c5e0 2024-09-13T18:32:31.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc582ffd640 1 --2- 172.21.15.53:0/3691001842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415d7f0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc57400bfa0 tx=0x7fc57401eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53323f67c2f9e800 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc581ffb640 1 -- 172.21.15.53:0/3691001842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400b2d0 con 0x7fc58415c5e0 2024-09-13T18:32:31.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc581ffb640 1 -- 172.21.15.53:0/3691001842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740a78b0 con 0x7fc58415c5e0 2024-09-13T18:32:31.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc581ffb640 1 -- 172.21.15.53:0/3691001842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740a7c40 con 0x7fc58415c5e0 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 -- 172.21.15.53:0/3691001842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 msgr2=0x7fc58415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 --2- 172.21.15.53:0/3691001842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415d7f0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc57400bfa0 tx=0x7fc57401eb40 comp rx=0 tx=0).stop 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 -- 172.21.15.53:0/3691001842 shutdown_connections 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 --2- 172.21.15.53:0/3691001842 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc5840ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 --2- 172.21.15.53:0/3691001842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415d7f0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 -- 172.21.15.53:0/3691001842 >> 172.21.15.53:0/3691001842 conn(0x7fc584073330 msgr2=0x7fc584065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 -- 172.21.15.53:0/3691001842 shutdown_connections 2024-09-13T18:32:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.189+0000 7fc5893b1640 1 -- 172.21.15.53:0/3691001842 wait complete. 2024-09-13T18:32:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 Processor -- start 2024-09-13T18:32:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 -- start start 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406ccc0 0x7fc5841f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc58414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5841f9d40 con 0x7fc58415c5e0 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584151480 con 0x7fc58406ccc0 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc584151910 con 0x7fc5840cc800 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59198/0 (socket says 172.21.15.53:59198) 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 -- 172.21.15.53:0/2199989276 learned_addr learned my addr 172.21.15.53:0/2199989276 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5827fc640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc58414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc582ffd640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406ccc0 0x7fc5841f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 -- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 msgr2=0x7fc58414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc58414baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 -- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406ccc0 msgr2=0x7fc5841f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406ccc0 0x7fc5841f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 -- 172.21.15.53:0/2199989276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57400bc80 con 0x7fc58415c5e0 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5827fc640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc58414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5837fe640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415ac90 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00d560 tx=0x7fc57c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc56b7fe640 1 -- 172.21.15.53:0/2199989276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0125f0 con 0x7fc58415c5e0 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc56b7fe640 1 -- 172.21.15.53:0/2199989276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c012770 con 0x7fc58415c5e0 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc584150870 con 0x7fc58415c5e0 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc56b7fe640 1 -- 172.21.15.53:0/2199989276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c012b20 con 0x7fc58415c5e0 2024-09-13T18:32:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584150e30 con 0x7fc58415c5e0 2024-09-13T18:32:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc584151610 con 0x7fc58415c5e0 2024-09-13T18:32:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.193+0000 7fc56b7fe640 1 -- 172.21.15.53:0/2199989276 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fc57c012c80 con 0x7fc58415c5e0 2024-09-13T18:32:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.197+0000 7fc56b7fe640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc570066c30 0x7fc5700690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.197+0000 7fc56b7fe640 1 -- 172.21.15.53:0/2199989276 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc57c084cc0 con 0x7fc58415c5e0 2024-09-13T18:32:31.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.197+0000 7fc582ffd640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc570066c30 0x7fc5700690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.197+0000 7fc582ffd640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc570066c30 0x7fc5700690f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b0000 tx=0x7fc5740a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.201+0000 7fc56b7fe640 1 -- 172.21.15.53:0/2199989276 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc57c051ba0 con 0x7fc58415c5e0 2024-09-13T18:32:31.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:31.361+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc58415c9c0 con 0x7fc58415c5e0 2024-09-13T18:32:32.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.373+0000 7fc56b7fe640 1 -- 172.21.15.53:0/2199989276 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc57c0551c0 con 0x7fc58415c5e0 2024-09-13T18:32:32.375 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:32:32.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc570066c30 msgr2=0x7fc5700690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc570066c30 0x7fc5700690f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b0000 tx=0x7fc5740a9070 comp rx=0 tx=0).stop 2024-09-13T18:32:32.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 msgr2=0x7fc58415ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415ac90 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00d560 tx=0x7fc57c00da20 comp rx=0 tx=0).stop 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 shutdown_connections 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc570066c30 0x7fc5700690f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5840cc800 0x7fc58414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58415c5e0 0x7fc58415ac90 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 --2- 172.21.15.53:0/2199989276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc58406ccc0 0x7fc5841f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.377+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 >> 172.21.15.53:0/2199989276 conn(0x7fc584073330 msgr2=0x7fc58406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.381+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 shutdown_connections 2024-09-13T18:32:32.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.381+0000 7fc5893b1640 1 -- 172.21.15.53:0/2199989276 wait complete. 2024-09-13T18:32:32.406 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:32:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0eb968640 1 Processor -- start 2024-09-13T18:32:32.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0eb968640 1 -- start start 2024-09-13T18:32:32.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0eb968640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa0e4143e80 0x7fa0e406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0eb968640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e406f7a0 con 0x7fa0e40caee0 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0eb968640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e406fd60 con 0x7fa0e40cda30 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0eb968640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e40cb960 con 0x7fa0e4143e80 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0e9704640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa0e4143e80 0x7fa0e406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0e8f03640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa0e40caee0 0x7fa0e40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45140/0 (socket says 172.21.15.53:45140) 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0e8f03640 1 -- 172.21.15.53:0/1220461258 learned_addr learned my addr 172.21.15.53:0/1220461258 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0e9704640 1 -- 172.21.15.53:0/1220461258 >> v1:172.21.15.87:6789/0 conn(0x7fa0e40cda30 legacy=0x7fa0e40701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0e9704640 1 -- 172.21.15.53:0/1220461258 >> v1:172.21.15.53:6789/0 conn(0x7fa0e40caee0 legacy=0x7fa0e40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0e9704640 1 -- 172.21.15.53:0/1220461258 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e40cbc40 con 0x7fa0e4143e80 2024-09-13T18:32:32.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.541+0000 7fa0dbfff640 1 -- 172.21.15.53:0/1220461258 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401221288 0 0) 0x7fa0e406f7a0 con 0x7fa0e40caee0 2024-09-13T18:32:32.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0e9704640 1 --2- 172.21.15.53:0/1220461258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e4143e80 0x7fa0e406b390 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40097c0 tx=0x7fa0d401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d473f63ec0aebc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:32.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0dbfff640 1 -- 172.21.15.53:0/1220461258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40ab600 con 0x7fa0e4143e80 2024-09-13T18:32:32.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0dbfff640 1 -- 172.21.15.53:0/1220461258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40a7050 con 0x7fa0e4143e80 2024-09-13T18:32:32.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0dbfff640 1 -- 172.21.15.53:0/1220461258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40ab980 con 0x7fa0e4143e80 2024-09-13T18:32:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 -- 172.21.15.53:0/1220461258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e4143e80 msgr2=0x7fa0e406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1220461258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e4143e80 0x7fa0e406b390 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40097c0 tx=0x7fa0d401c350 comp rx=0 tx=0).stop 2024-09-13T18:32:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 -- 172.21.15.53:0/1220461258 shutdown_connections 2024-09-13T18:32:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1220461258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e4143e80 0x7fa0e406b390 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 -- 172.21.15.53:0/1220461258 >> 172.21.15.53:0/1220461258 conn(0x7fa0e4065c80 msgr2=0x7fa0e4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 -- 172.21.15.53:0/1220461258 shutdown_connections 2024-09-13T18:32:32.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 -- 172.21.15.53:0/1220461258 wait complete. 2024-09-13T18:32:32.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 Processor -- start 2024-09-13T18:32:32.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.545+0000 7fa0eb968640 1 -- start start 2024-09-13T18:32:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e40caee0 0x7fa0e413f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0e40cda30 0x7fa0e41f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e4143e80 0x7fa0e4142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41429c0 con 0x7fa0e40caee0 2024-09-13T18:32:32.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40b26f0 con 0x7fa0e4143e80 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40b1ae0 con 0x7fa0e40cda30 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e40caee0 0x7fa0e413f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e40caee0 0x7fa0e413f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59212/0 (socket says 172.21.15.53:59212) 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 -- 172.21.15.53:0/1168260400 learned_addr learned my addr 172.21.15.53:0/1168260400 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e8f03640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0e40cda30 0x7fa0e41f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9f05640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e4143e80 0x7fa0e4142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 -- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0e40cda30 msgr2=0x7fa0e41f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0e40cda30 0x7fa0e41f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 -- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e4143e80 msgr2=0x7fa0e4142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e4143e80 0x7fa0e4142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 -- 172.21.15.53:0/1168260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4009420 con 0x7fa0e40caee0 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9f05640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e4143e80 0x7fa0e4142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:32.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0e9704640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e40caee0 0x7fa0e413f6a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4018f60 tx=0x7fa0d40190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0d9ffb640 1 -- 172.21.15.53:0/1168260400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40b4610 con 0x7fa0e40caee0 2024-09-13T18:32:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0d9ffb640 1 -- 172.21.15.53:0/1168260400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40abe90 con 0x7fa0e40caee0 2024-09-13T18:32:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0d9ffb640 1 -- 172.21.15.53:0/1168260400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40b49d0 con 0x7fa0e40caee0 2024-09-13T18:32:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e40b1dc0 con 0x7fa0e40caee0 2024-09-13T18:32:32.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e40b2380 con 0x7fa0e40caee0 2024-09-13T18:32:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e4070440 con 0x7fa0e40caee0 2024-09-13T18:32:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.549+0000 7fa0d9ffb640 1 -- 172.21.15.53:0/1168260400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fa0d40b2040 con 0x7fa0e40caee0 2024-09-13T18:32:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.553+0000 7fa0d9ffb640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0c8066c30 0x7fa0c80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.553+0000 7fa0e8f03640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0c8066c30 0x7fa0c80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.553+0000 7fa0d9ffb640 1 -- 172.21.15.53:0/1168260400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa0d411eae0 con 0x7fa0e40caee0 2024-09-13T18:32:32.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.553+0000 7fa0e8f03640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0c8066c30 0x7fa0c80690f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40b16b0 tx=0x7fa0e0007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:32.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.557+0000 7fa0d9ffb640 1 -- 172.21.15.53:0/1168260400 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa0d40eb740 con 0x7fa0e40caee0 2024-09-13T18:32:32.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:32.717+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa0e4071420 con 0x7fa0e40caee0 2024-09-13T18:32:33.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.385+0000 7fa0d9ffb640 1 -- 172.21.15.53:0/1168260400 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa0d40b00d0 con 0x7fa0e40caee0 2024-09-13T18:32:33.388 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:32:33.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.389+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0c8066c30 msgr2=0x7fa0c80690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.389+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0c8066c30 0x7fa0c80690f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40b16b0 tx=0x7fa0e0007c10 comp rx=0 tx=0).stop 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.389+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e40caee0 msgr2=0x7fa0e413f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.389+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e40caee0 0x7fa0e413f6a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4018f60 tx=0x7fa0d40190f0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 shutdown_connections 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa0c8066c30 0x7fa0c80690f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa0e40cda30 0x7fa0e41f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa0e4143e80 0x7fa0e4142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 --2- 172.21.15.53:0/1168260400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0e40caee0 0x7fa0e413f6a0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 >> 172.21.15.53:0/1168260400 conn(0x7fa0e4065c80 msgr2=0x7fa0e40b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 shutdown_connections 2024-09-13T18:32:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.393+0000 7fa0eb968640 1 -- 172.21.15.53:0/1168260400 wait complete. 2024-09-13T18:32:33.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:32:33.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 Processor -- start 2024-09-13T18:32:33.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 -- start start 2024-09-13T18:32:33.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbd815fd70 0x7fcbd80cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd8069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcbd806b3b0 0x7fcbd806a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd80cf1c0 con 0x7fcbd815fd70 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd80b2f20 con 0x7fcbd806b3b0 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbde3a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd806ab20 con 0x7fcbd8160150 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbd815fd70 0x7fcbd80cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbd815fd70 0x7fcbd80cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59226/0 (socket says 172.21.15.53:59226) 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 -- 172.21.15.53:0/4099773908 learned_addr learned my addr 172.21.15.53:0/4099773908 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbdc941640 1 --2- 172.21.15.53:0/4099773908 >> v2:172.21.15.87:3300/0 conn(0x7fcbd806b3b0 0x7fcbd806a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd77fe640 1 --2- 172.21.15.53:0/4099773908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd8069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 -- 172.21.15.53:0/4099773908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 msgr2=0x7fcbd8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 --2- 172.21.15.53:0/4099773908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd8069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 -- 172.21.15.53:0/4099773908 >> v2:172.21.15.87:3300/0 conn(0x7fcbd806b3b0 msgr2=0x7fcbd806a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 --2- 172.21.15.53:0/4099773908 >> v2:172.21.15.87:3300/0 conn(0x7fcbd806b3b0 0x7fcbd806a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.553+0000 7fcbd7fff640 1 -- 172.21.15.53:0/4099773908 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd806ae00 con 0x7fcbd815fd70 2024-09-13T18:32:33.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbd7fff640 1 --2- 172.21.15.53:0/4099773908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd80cf650 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8072280 tx=0x7fcbc801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be70ccc6c567d70f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:33.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbd6ffd640 1 -- 172.21.15.53:0/4099773908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80ad680 con 0x7fcbd815fd70 2024-09-13T18:32:33.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbd6ffd640 1 -- 172.21.15.53:0/4099773908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc80ad7e0 con 0x7fcbd815fd70 2024-09-13T18:32:33.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbd6ffd640 1 -- 172.21.15.53:0/4099773908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80adb70 con 0x7fcbd815fd70 2024-09-13T18:32:33.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 -- 172.21.15.53:0/4099773908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 msgr2=0x7fcbd80cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/4099773908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd80cf650 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8072280 tx=0x7fcbc801c490 comp rx=0 tx=0).stop 2024-09-13T18:32:33.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 -- 172.21.15.53:0/4099773908 shutdown_connections 2024-09-13T18:32:33.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/4099773908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd8069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/4099773908 >> v2:172.21.15.87:3300/0 conn(0x7fcbd806b3b0 0x7fcbd806a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/4099773908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd80cf650 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 -- 172.21.15.53:0/4099773908 >> 172.21.15.53:0/4099773908 conn(0x7fcbd80b2060 msgr2=0x7fcbd80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:33.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 -- 172.21.15.53:0/4099773908 shutdown_connections 2024-09-13T18:32:33.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.557+0000 7fcbde3a4640 1 -- 172.21.15.53:0/4099773908 wait complete. 2024-09-13T18:32:33.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 Processor -- start 2024-09-13T18:32:33.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 -- start start 2024-09-13T18:32:33.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbd806b3b0 0x7fcbd80c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd81576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd80cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80c4470 con 0x7fcbd815fd70 2024-09-13T18:32:33.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80c5510 con 0x7fcbd806b3b0 2024-09-13T18:32:33.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80c6b10 con 0x7fcbd8160150 2024-09-13T18:32:33.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd81576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd81576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59238/0 (socket says 172.21.15.53:59238) 2024-09-13T18:32:33.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 -- 172.21.15.53:0/3406866771 learned_addr learned my addr 172.21.15.53:0/3406866771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd7fff640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbd806b3b0 0x7fcbd80c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbdc941640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd80cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 -- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 msgr2=0x7fcbd80cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd80cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 -- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbd806b3b0 msgr2=0x7fcbd80c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbd806b3b0 0x7fcbd80c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 -- 172.21.15.53:0/3406866771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80094d0 con 0x7fcbd815fd70 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbdc941640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd80cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd77fe640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd81576d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00d600 tx=0x7fcbcc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd4ff9640 1 -- 172.21.15.53:0/3406866771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc004240 con 0x7fcbd815fd70 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd4ff9640 1 -- 172.21.15.53:0/3406866771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0043a0 con 0x7fcbd815fd70 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbd4ff9640 1 -- 172.21.15.53:0/3406866771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc003840 con 0x7fcbd815fd70 2024-09-13T18:32:33.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd80c6db0 con 0x7fcbd815fd70 2024-09-13T18:32:33.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd80cc290 con 0x7fcbd815fd70 2024-09-13T18:32:33.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.561+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd80c6fa0 con 0x7fcbd815fd70 2024-09-13T18:32:33.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.565+0000 7fcbd4ff9640 1 -- 172.21.15.53:0/3406866771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fcbcc0039a0 con 0x7fcbd815fd70 2024-09-13T18:32:33.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.565+0000 7fcbd4ff9640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbc4066c30 0x7fcbc40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.565+0000 7fcbd4ff9640 1 -- 172.21.15.53:0/3406866771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcbcc0857f0 con 0x7fcbd815fd70 2024-09-13T18:32:33.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.565+0000 7fcbd7fff640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbc4066c30 0x7fcbc40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.565+0000 7fcbd7fff640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbc4066c30 0x7fcbc40690f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80af000 tx=0x7fcbc8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:33.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.569+0000 7fcbd4ff9640 1 -- 172.21.15.53:0/3406866771 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbcc052390 con 0x7fcbd815fd70 2024-09-13T18:32:33.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.765+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcbd80b26f0 con 0x7fcbd815fd70 2024-09-13T18:32:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbd4ff9640 1 -- 172.21.15.53:0/3406866771 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v76) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcbcc0559b0 con 0x7fcbd815fd70 2024-09-13T18:32:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 20 and data pool 21 2024-09-13T18:32:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbc4066c30 msgr2=0x7fcbc40690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbc4066c30 0x7fcbc40690f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80af000 tx=0x7fcbc8008040 comp rx=0 tx=0).stop 2024-09-13T18:32:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 msgr2=0x7fcbd81576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd81576d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00d600 tx=0x7fcbcc00dac0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 shutdown_connections 2024-09-13T18:32:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcbc4066c30 0x7fcbc40690f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcbd8160150 0x7fcbd80cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbd815fd70 0x7fcbd81576d0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 --2- 172.21.15.53:0/3406866771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbd806b3b0 0x7fcbd80c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.773+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 >> 172.21.15.53:0/3406866771 conn(0x7fcbd80b2060 msgr2=0x7fcbd80b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:33.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.781+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 shutdown_connections 2024-09-13T18:32:33.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.781+0000 7fcbde3a4640 1 -- 172.21.15.53:0/3406866771 wait complete. 2024-09-13T18:32:33.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:33.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb43d0640 1 Processor -- start 2024-09-13T18:32:33.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb43d0640 1 -- start start 2024-09-13T18:32:33.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb43d0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7eac0cc270 0x7f7eac15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb43d0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb43d0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac06f550 con 0x7f7eac15a470 2024-09-13T18:32:33.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb43d0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac06f880 con 0x7f7eac0cc270 2024-09-13T18:32:33.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb43d0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15d1a0 con 0x7f7eac0b1c10 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb196b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7eac0cc270 0x7f7eac15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb296d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb196b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7eac0cc270 0x7f7eac15cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:52276/0 (socket says 172.21.15.53:52276) 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb196b640 1 -- 172.21.15.53:0/1924223755 learned_addr learned my addr 172.21.15.53:0/1924223755 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb216c640 1 --1- 172.21.15.53:0/1924223755 >> v1:172.21.15.87:6789/0 conn(0x7f7eac15a470 0x7f7eac071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:37568/0 (socket says 172.21.15.53:37568) 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb196b640 1 -- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 msgr2=0x7f7eac0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb196b640 1 --2- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb196b640 1 -- 172.21.15.53:0/1924223755 >> v1:172.21.15.87:6789/0 conn(0x7f7eac15a470 legacy=0x7f7eac071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb196b640 1 -- 172.21.15.53:0/1924223755 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac15dc40 con 0x7f7eac0cc270 2024-09-13T18:32:33.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.921+0000 7f7eb296d640 1 --2- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:33.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb196b640 1 --2- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac0cc270 0x7f7eac15cc60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e98641393432c726 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:33.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb116a640 1 -- 172.21.15.53:0/1924223755 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00ad660 con 0x7f7eac0cc270 2024-09-13T18:32:33.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb116a640 1 -- 172.21.15.53:0/1924223755 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea00ad7c0 con 0x7f7eac0cc270 2024-09-13T18:32:33.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb116a640 1 -- 172.21.15.53:0/1924223755 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00adb50 con 0x7f7eac0cc270 2024-09-13T18:32:33.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 -- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac0cc270 msgr2=0x7f7eac15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac0cc270 0x7f7eac15cc60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea001c560 comp rx=0 tx=0).stop 2024-09-13T18:32:33.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 -- 172.21.15.53:0/1924223755 shutdown_connections 2024-09-13T18:32:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/1924223755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac0cc270 0x7f7eac15cc60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 -- 172.21.15.53:0/1924223755 >> 172.21.15.53:0/1924223755 conn(0x7f7eac065c80 msgr2=0x7f7eac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 -- 172.21.15.53:0/1924223755 shutdown_connections 2024-09-13T18:32:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 -- 172.21.15.53:0/1924223755 wait complete. 2024-09-13T18:32:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.925+0000 7f7eb43d0640 1 Processor -- start 2024-09-13T18:32:33.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 -- start start 2024-09-13T18:32:33.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eac0cc270 0x7f7eac146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac15a470 0x7f7eac0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c47f0 con 0x7f7eac0cc270 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac157d30 con 0x7f7eac15a470 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac147320 con 0x7f7eac0b1c10 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eac0cc270 0x7f7eac146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eac0cc270 0x7f7eac146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59244/0 (socket says 172.21.15.53:59244) 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 -- 172.21.15.53:0/2229156429 learned_addr learned my addr 172.21.15.53:0/2229156429 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb216c640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb296d640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac15a470 0x7f7eac0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 -- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 msgr2=0x7f7eac1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 -- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac15a470 msgr2=0x7f7eac0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac15a470 0x7f7eac0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 -- 172.21.15.53:0/2229156429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009a70 con 0x7f7eac0cc270 2024-09-13T18:32:33.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb196b640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eac0cc270 0x7f7eac146980 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f7ea001a190 tx=0x7f7ea0019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:33.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eaaffd640 1 -- 172.21.15.53:0/2229156429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00b8620 con 0x7f7eac0cc270 2024-09-13T18:32:33.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea00094d0 con 0x7f7eac0cc270 2024-09-13T18:32:33.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eaaffd640 1 -- 172.21.15.53:0/2229156429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea00b87a0 con 0x7f7eac0cc270 2024-09-13T18:32:33.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eaaffd640 1 -- 172.21.15.53:0/2229156429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00b8b50 con 0x7f7eac0cc270 2024-09-13T18:32:33.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac0c4480 con 0x7f7eac0cc270 2024-09-13T18:32:33.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac067400 con 0x7f7eac0cc270 2024-09-13T18:32:33.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eaaffd640 1 -- 172.21.15.53:0/2229156429 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f7ea00b4040 con 0x7f7eac0cc270 2024-09-13T18:32:33.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eaaffd640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e98066c60 0x7f7e98069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:33.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.929+0000 7f7eaaffd640 1 -- 172.21.15.53:0/2229156429 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ea011ecd0 con 0x7f7eac0cc270 2024-09-13T18:32:33.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.933+0000 7f7eb216c640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e98066c60 0x7f7e98069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:33.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.933+0000 7f7eb216c640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e98066c60 0x7f7e98069120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000f70 tx=0x7f7e9c007cd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:33.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:33.937+0000 7f7eaaffd640 1 -- 172.21.15.53:0/2229156429 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ea00eb7e0 con 0x7f7eac0cc270 2024-09-13T18:32:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.089+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eac0c4930 con 0x7f7eac0cc270 2024-09-13T18:32:34.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eaaffd640 1 -- 172.21.15.53:0/2229156429 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f7ea00eee00 con 0x7f7eac0cc270 2024-09-13T18:32:34.095 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:34.095 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":135,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:33.768857+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:34.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e98066c60 msgr2=0x7f7e98069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e98066c60 0x7f7e98069120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000f70 tx=0x7f7e9c007cd0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eac0cc270 msgr2=0x7f7eac146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eac0cc270 0x7f7eac146980 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f7ea001a190 tx=0x7f7ea0019300 comp rx=0 tx=0).stop 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 shutdown_connections 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e98066c60 0x7f7e98069120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eac15a470 0x7f7eac0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eac0cc270 0x7f7eac146980 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 --2- 172.21.15.53:0/2229156429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7eac0b1c10 0x7f7eac1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 >> 172.21.15.53:0/2229156429 conn(0x7f7eac065c80 msgr2=0x7f7eac159620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 shutdown_connections 2024-09-13T18:32:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.093+0000 7f7eb43d0640 1 -- 172.21.15.53:0/2229156429 wait complete. 2024-09-13T18:32:34.112 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:34.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.217+0000 7f7478b9d640 1 Processor -- start 2024-09-13T18:32:34.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.217+0000 7f7478b9d640 1 -- start start 2024-09-13T18:32:34.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7478b9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 0x7f747406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7478b9d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747406d480 con 0x7f747415b7c0 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7478b9d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747415ace0 con 0x7f74740713a0 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7478b9d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747415aaf0 con 0x7f74741582a0 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f746bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f747415b7c0 0x7f7474070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45150/0 (socket says 172.21.15.53:45150) 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f746bfff640 1 -- 172.21.15.53:0/2699170240 learned_addr learned my addr 172.21.15.53:0/2699170240 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f747259c640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 0x7f747406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826287755 0 0) 0x7f747406d480 con 0x7f747415b7c0 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7460003530 con 0x7f747415b7c0 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3654861181 0 0) 0x7f7460003530 con 0x7f747415b7c0 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 msgr2=0x7f747406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 0x7f747406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 >> v1:172.21.15.87:6789/0 conn(0x7f74740713a0 legacy=0x7f74741640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747415afc0 con 0x7f747415b7c0 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f745c001680 con 0x7f747415b7c0 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 >> v1:172.21.15.53:6789/0 conn(0x7f747415b7c0 legacy=0x7f7474070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 0x7f74600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460003f30 0x7f74600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7460004d10 0x7f7460005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746000ba40 con 0x7f7460004d10 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746000bbb0 con 0x7f7460003f30 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746000bd70 con 0x7f74741582a0 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7472d9d640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7460004d10 0x7f7460005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f746bfff640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460003f30 0x7f74600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f747259c640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 0x7f74600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7472d9d640 1 -- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 msgr2=0x7f74600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7472d9d640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741582a0 0x7f74600039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7472d9d640 1 -- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460003f30 msgr2=0x7f74600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7472d9d640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460003f30 0x7f74600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f7472d9d640 1 -- 172.21.15.53:0/2699170240 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460003530 con 0x7f7460004d10 2024-09-13T18:32:34.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.221+0000 7f746bfff640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460003f30 0x7f74600047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7460004d10 0x7f7460005190 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f746c001e70 tx=0x7f746c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7923cdccd6ab28c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c003b80 con 0x7f7460004d10 2024-09-13T18:32:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c003ce0 con 0x7f7460004d10 2024-09-13T18:32:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7471d9b640 1 -- 172.21.15.53:0/2699170240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0052c0 con 0x7f7460004d10 2024-09-13T18:32:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- 172.21.15.53:0/2699170240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7460004d10 msgr2=0x7f7460005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 --2- 172.21.15.53:0/2699170240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7460004d10 0x7f7460005190 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f746c001e70 tx=0x7f746c01c780 comp rx=0 tx=0).stop 2024-09-13T18:32:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 -- 172.21.15.53:0/2699170240 reap_dead start 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- 172.21.15.53:0/2699170240 shutdown_connections 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- 172.21.15.53:0/2699170240 >> 172.21.15.53:0/2699170240 conn(0x7f7474065c80 msgr2=0x7f7474066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- 172.21.15.53:0/2699170240 shutdown_connections 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- 172.21.15.53:0/2699170240 wait complete. 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 Processor -- start 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- start start 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460004d10 0x7f7474155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741555d0 0x7f7474147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7474147cb0 0x7f74740a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474155a50 con 0x7f7474147cb0 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74741f0280 con 0x7f7460004d10 2024-09-13T18:32:34.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74741f0560 con 0x7f74741555d0 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7474147cb0 0x7f74740a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7474147cb0 0x7f74740a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59260/0 (socket says 172.21.15.53:59260) 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 -- 172.21.15.53:0/1261924102 learned_addr learned my addr 172.21.15.53:0/1261924102 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f747259c640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460004d10 0x7f7474155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f746bfff640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741555d0 0x7f7474147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 -- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741555d0 msgr2=0x7f7474147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741555d0 0x7f7474147770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 -- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460004d10 msgr2=0x7f7474155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460004d10 0x7f7474155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 -- 172.21.15.53:0/1261924102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74741f0840 con 0x7f7474147cb0 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f747259c640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460004d10 0x7f7474155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7472d9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7474147cb0 0x7f74740a84d0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f746c01cc60 tx=0x7f7460005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f746affd640 1 -- 172.21.15.53:0/1261924102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c006d60 con 0x7f7474147cb0 2024-09-13T18:32:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f746affd640 1 -- 172.21.15.53:0/1261924102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c005840 con 0x7f7474147cb0 2024-09-13T18:32:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74741f0b20 con 0x7f7474147cb0 2024-09-13T18:32:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f746affd640 1 -- 172.21.15.53:0/1261924102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0a6680 con 0x7f7474147cb0 2024-09-13T18:32:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.225+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74741efe50 con 0x7f7474147cb0 2024-09-13T18:32:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.229+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474067400 con 0x7f7474147cb0 2024-09-13T18:32:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.229+0000 7f746affd640 1 -- 172.21.15.53:0/1261924102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f746c0a67e0 con 0x7f7474147cb0 2024-09-13T18:32:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.229+0000 7f746affd640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7454066c60 0x7f7454069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.229+0000 7f746affd640 1 -- 172.21.15.53:0/1261924102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f746c11e9c0 con 0x7f7474147cb0 2024-09-13T18:32:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.229+0000 7f747259c640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7454066c60 0x7f7454069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.229+0000 7f747259c640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7454066c60 0x7f7454069120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7464009a00 tx=0x7f7464008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:34.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.233+0000 7f746affd640 1 -- 172.21.15.53:0/1261924102 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f746c0eb440 con 0x7f7474147cb0 2024-09-13T18:32:34.360 INFO:tasks.ceph.mds.a.smithi053.stderr:2024-09-13T18:32:34.357+0000 7f4474eaf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:32:34.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.385+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f747406ce10 con 0x7f7474147cb0 2024-09-13T18:32:34.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.389+0000 7f746affd640 1 -- 172.21.15.53:0/1261924102 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f746c0ba090 con 0x7f7474147cb0 2024-09-13T18:32:34.392 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:34.392 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":135,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:33.768857+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7454066c60 msgr2=0x7f7454069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7454066c60 0x7f7454069120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7464009a00 tx=0x7f7464008040 comp rx=0 tx=0).stop 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7474147cb0 msgr2=0x7f74740a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7474147cb0 0x7f74740a84d0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f746c01cc60 tx=0x7f7460005800 comp rx=0 tx=0).stop 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 shutdown_connections 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7454066c60 0x7f7454069120 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74741555d0 0x7f7474147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7474147cb0 0x7f74740a84d0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 --2- 172.21.15.53:0/1261924102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7460004d10 0x7f7474155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 >> 172.21.15.53:0/1261924102 conn(0x7f7474065c80 msgr2=0x7f74741572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:34.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 shutdown_connections 2024-09-13T18:32:34.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.393+0000 7f7478b9d640 1 -- 172.21.15.53:0/1261924102 wait complete. 2024-09-13T18:32:34.410 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:32:34.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb1a21ad640 1 Processor -- start 2024-09-13T18:32:34.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb1a21ad640 1 -- start start 2024-09-13T18:32:34.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb1a21ad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 0x7fb19c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb1a21ad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb19c157020 0x7fb19c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb1a21ad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c06d6e0 con 0x7fb19c06d270 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb1a21ad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c070340 con 0x7fb19c157020 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb1a21ad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0b15a0 con 0x7fb19c156c40 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb19bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb19c06d270 0x7fb19c15cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45166/0 (socket says 172.21.15.53:45166) 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb19bfff640 1 -- 172.21.15.53:0/975186908 learned_addr learned my addr 172.21.15.53:0/975186908 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb19affd640 1 --2- 172.21.15.53:0/975186908 >> v2:172.21.15.87:3300/0 conn(0x7fb19c157020 0x7fb19c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.529+0000 7fb19b7fe640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 0x7fb19c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921132709 0 0) 0x7fb19c06d6e0 con 0x7fb19c06d270 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb184003530 con 0x7fb19c06d270 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007955374 0 0) 0x7fb184003530 con 0x7fb19c06d270 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 msgr2=0x7fb19c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 0x7fb19c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 >> v2:172.21.15.87:3300/0 conn(0x7fb19c157020 msgr2=0x7fb19c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 --2- 172.21.15.53:0/975186908 >> v2:172.21.15.87:3300/0 conn(0x7fb19c157020 0x7fb19c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0b1880 con 0x7fb19c06d270 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb194001a00 con 0x7fb19c06d270 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 >> v1:172.21.15.53:6789/0 conn(0x7fb19c06d270 legacy=0x7fb19c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 0x7fb184003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb184003f00 0x7fb1840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184004d10 0x7fb184005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0b15a0 con 0x7fb184003f00 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400b990 con 0x7fb184004d10 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400bad0 con 0x7fb19c156c40 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19affd640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb184003f00 0x7fb1840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19b7fe640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 0x7fb184003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19bfff640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184004d10 0x7fb184005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19affd640 1 -- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 msgr2=0x7fb184003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:34.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19affd640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c156c40 0x7fb184003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19affd640 1 -- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184004d10 msgr2=0x7fb184005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:34.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19affd640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184004d10 0x7fb184005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19affd640 1 -- 172.21.15.53:0/975186908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184003530 con 0x7fb184003f00 2024-09-13T18:32:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19affd640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb184003f00 0x7fb1840047d0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fb190009ae0 tx=0x7fb19001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe49b1f7379ce39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900a5590 con 0x7fb184003f00 2024-09-13T18:32:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1900a56f0 con 0x7fb184003f00 2024-09-13T18:32:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19a7fc640 1 -- 172.21.15.53:0/975186908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900a5aa0 con 0x7fb184003f00 2024-09-13T18:32:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb1a21ad640 1 -- 172.21.15.53:0/975186908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb184003f00 msgr2=0x7fb1840047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb1a21ad640 1 --2- 172.21.15.53:0/975186908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb184003f00 0x7fb1840047d0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fb190009ae0 tx=0x7fb19001ca50 comp rx=0 tx=0).stop 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb19bfff640 1 -- 172.21.15.53:0/975186908 reap_dead start 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb1a21ad640 1 -- 172.21.15.53:0/975186908 shutdown_connections 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb1a21ad640 1 -- 172.21.15.53:0/975186908 >> 172.21.15.53:0/975186908 conn(0x7fb19c065c80 msgr2=0x7fb19c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb1a21ad640 1 -- 172.21.15.53:0/975186908 shutdown_connections 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.533+0000 7fb1a21ad640 1 -- 172.21.15.53:0/975186908 wait complete. 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 Processor -- start 2024-09-13T18:32:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 -- start start 2024-09-13T18:32:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184003f00 0x7fb19c144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c1438a0 0x7fb19c145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c159c90 0x7fb19c06f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c147b40 con 0x7fb19c1438a0 2024-09-13T18:32:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c143d20 con 0x7fb184003f00 2024-09-13T18:32:34.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c147250 con 0x7fb19c159c90 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c1438a0 0x7fb19c145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c1438a0 0x7fb19c145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59276/0 (socket says 172.21.15.53:59276) 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 -- 172.21.15.53:0/3334832213 learned_addr learned my addr 172.21.15.53:0/3334832213 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19b7fe640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184003f00 0x7fb19c144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19bfff640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c159c90 0x7fb19c06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 -- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c159c90 msgr2=0x7fb19c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c159c90 0x7fb19c06f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 -- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184003f00 msgr2=0x7fb19c144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184003f00 0x7fb19c144910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 -- 172.21.15.53:0/3334832213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c145dc0 con 0x7fb19c1438a0 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19bfff640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c159c90 0x7fb19c06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb19affd640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c1438a0 0x7fb19c145880 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb190009ae0 tx=0x7fb184005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:34.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb183fff640 1 -- 172.21.15.53:0/3334832213 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190004220 con 0x7fb19c1438a0 2024-09-13T18:32:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb183fff640 1 -- 172.21.15.53:0/3334832213 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190004380 con 0x7fb19c1438a0 2024-09-13T18:32:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c145010 con 0x7fb19c1438a0 2024-09-13T18:32:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb183fff640 1 -- 172.21.15.53:0/3334832213 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900ad850 con 0x7fb19c1438a0 2024-09-13T18:32:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c1477d0 con 0x7fb19c1438a0 2024-09-13T18:32:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c1564c0 con 0x7fb19c1438a0 2024-09-13T18:32:34.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.537+0000 7fb183fff640 1 -- 172.21.15.53:0/3334832213 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fb1900b4040 con 0x7fb19c1438a0 2024-09-13T18:32:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.541+0000 7fb183fff640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb188066c60 0x7fb188069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.541+0000 7fb183fff640 1 -- 172.21.15.53:0/3334832213 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb19011f3c0 con 0x7fb19c1438a0 2024-09-13T18:32:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.541+0000 7fb19b7fe640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb188066c60 0x7fb188069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:34.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.541+0000 7fb19b7fe640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb188066c60 0x7fb188069120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ad790 tx=0x7fb18c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:34.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.545+0000 7fb183fff640 1 -- 172.21.15.53:0/3334832213 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1900ec0a0 con 0x7fb19c1438a0 2024-09-13T18:32:34.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:34.737+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb19c070870 con 0x7fb19c1438a0 2024-09-13T18:32:35.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.397+0000 7fb183fff640 1 -- 172.21.15.53:0/3334832213 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v78) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb1900ef6c0 con 0x7fb19c1438a0 2024-09-13T18:32:35.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb188066c60 msgr2=0x7fb188069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:35.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb188066c60 0x7fb188069120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ad790 tx=0x7fb18c008040 comp rx=0 tx=0).stop 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c1438a0 msgr2=0x7fb19c145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c1438a0 0x7fb19c145880 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb190009ae0 tx=0x7fb184005800 comp rx=0 tx=0).stop 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 shutdown_connections 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb188066c60 0x7fb188069120 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb19c159c90 0x7fb19c06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb19c1438a0 0x7fb19c145880 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 --2- 172.21.15.53:0/3334832213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb184003f00 0x7fb19c144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 >> 172.21.15.53:0/3334832213 conn(0x7fb19c065c80 msgr2=0x7fb19c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 shutdown_connections 2024-09-13T18:32:35.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.401+0000 7fb1a21ad640 1 -- 172.21.15.53:0/3334832213 wait complete. 2024-09-13T18:32:35.425 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:32:35.425 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:32:35.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff115793640 1 Processor -- start 2024-09-13T18:32:35.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff115793640 1 -- start start 2024-09-13T18:32:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff115793640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1100b2c90 0x7ff11006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff115793640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff1100c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff115793640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11006e3a0 con 0x7ff11015a6c0 2024-09-13T18:32:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff115793640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100cf1c0 con 0x7ff1100b2c90 2024-09-13T18:32:35.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff115793640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100cf4a0 con 0x7ff11006df70 2024-09-13T18:32:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1100b2c90 0x7ff11006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1100b2c90 0x7ff11006da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59292/0 (socket says 172.21.15.53:59292) 2024-09-13T18:32:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10e7fc640 1 -- 172.21.15.53:0/868036378 learned_addr learned my addr 172.21.15.53:0/868036378 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10f7fe640 1 --2- 172.21.15.53:0/868036378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff1100c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10e7fc640 1 -- 172.21.15.53:0/868036378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 msgr2=0x7ff1100c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10e7fc640 1 --2- 172.21.15.53:0/868036378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff1100c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10e7fc640 1 -- 172.21.15.53:0/868036378 >> v1:172.21.15.87:6789/0 conn(0x7ff11015a6c0 legacy=0x7ff1100c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:35.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.557+0000 7ff10e7fc640 1 -- 172.21.15.53:0/868036378 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100cf780 con 0x7ff1100b2c90 2024-09-13T18:32:35.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff10e7fc640 1 --2- 172.21.15.53:0/868036378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff11006da30 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7ff104009870 tx=0x7ff10401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f188a3a2bd55cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:35.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff10dffb640 1 -- 172.21.15.53:0/868036378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040a7070 con 0x7ff1100b2c90 2024-09-13T18:32:35.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff10dffb640 1 -- 172.21.15.53:0/868036378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1040ab430 con 0x7ff1100b2c90 2024-09-13T18:32:35.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff10dffb640 1 -- 172.21.15.53:0/868036378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040ab7c0 con 0x7ff1100b2c90 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 -- 172.21.15.53:0/868036378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 msgr2=0x7ff11006da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 --2- 172.21.15.53:0/868036378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff11006da30 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7ff104009870 tx=0x7ff10401c410 comp rx=0 tx=0).stop 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 -- 172.21.15.53:0/868036378 shutdown_connections 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 --2- 172.21.15.53:0/868036378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff1100c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 --2- 172.21.15.53:0/868036378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff11006da30 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 -- 172.21.15.53:0/868036378 >> 172.21.15.53:0/868036378 conn(0x7ff1100b2170 msgr2=0x7ff1100b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 -- 172.21.15.53:0/868036378 shutdown_connections 2024-09-13T18:32:35.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 -- 172.21.15.53:0/868036378 wait complete. 2024-09-13T18:32:35.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 Processor -- start 2024-09-13T18:32:35.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.561+0000 7ff115793640 1 -- start start 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff110147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff1100b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff11015a6c0 0x7ff11014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100b3e80 con 0x7ff1100b2c90 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101477c0 con 0x7ff11015a6c0 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100af5d0 con 0x7ff11006df70 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff1100b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff1100b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59306/0 (socket says 172.21.15.53:59306) 2024-09-13T18:32:35.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 -- 172.21.15.53:0/1212230927 learned_addr learned my addr 172.21.15.53:0/1212230927 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10f7fe640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff11015a6c0 0x7ff11014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10effd640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff110147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 -- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 msgr2=0x7ff110147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff110147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 -- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff11015a6c0 msgr2=0x7ff11014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff11015a6c0 0x7ff11014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 -- 172.21.15.53:0/1212230927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1040094d0 con 0x7ff1100b2c90 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10e7fc640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff1100b4bb0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff1040ad040 tx=0x7ff1040191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff0f77fe640 1 -- 172.21.15.53:0/1212230927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040b4830 con 0x7ff1100b2c90 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff0f77fe640 1 -- 172.21.15.53:0/1212230927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1040b4990 con 0x7ff1100b2c90 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1100b40d0 con 0x7ff1100b2c90 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff0f77fe640 1 -- 172.21.15.53:0/1212230927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040b4d40 con 0x7ff1100b2c90 2024-09-13T18:32:35.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1100b4690 con 0x7ff1100b2c90 2024-09-13T18:32:35.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1100b4880 con 0x7ff1100b2c90 2024-09-13T18:32:35.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff0f77fe640 1 -- 172.21.15.53:0/1212230927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7ff1040c0460 con 0x7ff1100b2c90 2024-09-13T18:32:35.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff0f77fe640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0fc066c30 0x7ff0fc0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:35.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff0f77fe640 1 -- 172.21.15.53:0/1212230927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff11015acb0 con 0x7ff1100b2c90 2024-09-13T18:32:35.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.565+0000 7ff10effd640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0fc066c30 0x7ff0fc0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:35.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.569+0000 7ff10effd640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0fc066c30 0x7ff0fc0690f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff1080012f0 tx=0x7ff108009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:35.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.569+0000 7ff0f77fe640 1 -- 172.21.15.53:0/1212230927 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1040ec5a0 con 0x7ff1100b2c90 2024-09-13T18:32:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:35.757+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff1100c57c0 con 0x7ff1100b2c90 2024-09-13T18:32:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.405+0000 7ff0f77fe640 1 -- 172.21.15.53:0/1212230927 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v79) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff1040efbc0 con 0x7ff1100b2c90 2024-09-13T18:32:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0fc066c30 msgr2=0x7ff0fc0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0fc066c30 0x7ff0fc0690f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff1080012f0 tx=0x7ff108009040 comp rx=0 tx=0).stop 2024-09-13T18:32:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 msgr2=0x7ff1100b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff1100b4bb0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff1040ad040 tx=0x7ff1040191b0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 shutdown_connections 2024-09-13T18:32:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff0fc066c30 0x7ff0fc0690f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff11015a6c0 0x7ff11014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1100b2c90 0x7ff1100b4bb0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 --2- 172.21.15.53:0/1212230927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff11006df70 0x7ff110147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 >> 172.21.15.53:0/1212230927 conn(0x7ff1100b2170 msgr2=0x7ff1101517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 shutdown_connections 2024-09-13T18:32:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.409+0000 7ff115793640 1 -- 172.21.15.53:0/1212230927 wait complete. 2024-09-13T18:32:36.431 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:32:36.432 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:36.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68aa4cf640 1 Processor -- start 2024-09-13T18:32:36.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68aa4cf640 1 -- start start 2024-09-13T18:32:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68aa4cf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415c840 0x7f68a4160220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68aa4cf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4160a70 con 0x7f68a40b1650 2024-09-13T18:32:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68aa4cf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4160d50 con 0x7f68a40b4e50 2024-09-13T18:32:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68aa4cf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40cdd80 con 0x7f68a415c840 2024-09-13T18:32:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f689b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f68a40b1650 0x7f68a40b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58226/0 (socket says 172.21.15.53:58226) 2024-09-13T18:32:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f689b7fe640 1 -- 172.21.15.53:0/914788790 learned_addr learned my addr 172.21.15.53:0/914788790 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:36.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a3fff640 1 --2- 172.21.15.53:0/914788790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415c840 0x7f68a4160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921489401 0 0) 0x7f68a4160a70 con 0x7f68a40b1650 2024-09-13T18:32:36.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6890003530 con 0x7f68a40b1650 2024-09-13T18:32:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981576179 0 0) 0x7f68a4160d50 con 0x7f68a40b4e50 2024-09-13T18:32:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a4160a70 con 0x7f68a40b4e50 2024-09-13T18:32:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249028831 0 0) 0x7f6890003530 con 0x7f68a40b1650 2024-09-13T18:32:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a3fff640 1 -- 172.21.15.53:0/914788790 >> v1:172.21.15.87:6789/0 conn(0x7f68a40b4e50 legacy=0x7f68a40d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a3fff640 1 -- 172.21.15.53:0/914788790 >> v1:172.21.15.53:6789/0 conn(0x7f68a40b1650 legacy=0x7f68a40b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.561+0000 7f68a3fff640 1 -- 172.21.15.53:0/914788790 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4161030 con 0x7f68a415c840 2024-09-13T18:32:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a3fff640 1 --2- 172.21.15.53:0/914788790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415c840 0x7f68a4160220 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68940097f0 tx=0x7f689401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98e7ef7be29a163b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c001680 con 0x7f68a415c840 2024-09-13T18:32:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940a7050 con 0x7f68a415c840 2024-09-13T18:32:36.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a37fe640 1 -- 172.21.15.53:0/914788790 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894004230 con 0x7f68a415c840 2024-09-13T18:32:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- 172.21.15.53:0/914788790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415c840 msgr2=0x7f68a4160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/914788790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415c840 0x7f68a4160220 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68940097f0 tx=0x7f689401c3d0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- 172.21.15.53:0/914788790 shutdown_connections 2024-09-13T18:32:36.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/914788790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415c840 0x7f68a4160220 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- 172.21.15.53:0/914788790 >> 172.21.15.53:0/914788790 conn(0x7f68a4066080 msgr2=0x7f68a4066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:36.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- 172.21.15.53:0/914788790 shutdown_connections 2024-09-13T18:32:36.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- 172.21.15.53:0/914788790 wait complete. 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 Processor -- start 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- start start 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a40b1650 0x7f68a40cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b4e50 0x7f68a414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a415c840 0x7f68a414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40cc660 con 0x7f68a40b1650 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4152df0 con 0x7f68a415c840 2024-09-13T18:32:36.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68aa4cf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a41530d0 con 0x7f68a40b4e50 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a40b1650 0x7f68a40cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a40b1650 0x7f68a40cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42002/0 (socket says 172.21.15.53:42002) 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a3fff640 1 -- 172.21.15.53:0/4147121156 learned_addr learned my addr 172.21.15.53:0/4147121156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f689b7fe640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b4e50 0x7f68a414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.565+0000 7f68a8a6c640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a415c840 0x7f68a414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a3fff640 1 -- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b4e50 msgr2=0x7f68a414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a3fff640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b4e50 0x7f68a414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a3fff640 1 -- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a415c840 msgr2=0x7f68a414d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a3fff640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a415c840 0x7f68a414d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a3fff640 1 -- 172.21.15.53:0/4147121156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894009420 con 0x7f68a40b1650 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a3fff640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a40b1650 0x7f68a40cc120 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f689401a000 tx=0x7f6894019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a17fa640 1 -- 172.21.15.53:0/4147121156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940bb070 con 0x7f68a40b1650 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a17fa640 1 -- 172.21.15.53:0/4147121156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6894003830 con 0x7f68a40b1650 2024-09-13T18:32:36.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a17fa640 1 -- 172.21.15.53:0/4147121156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894003bc0 con 0x7f68a40b1650 2024-09-13T18:32:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a41533b0 con 0x7f68a40b1650 2024-09-13T18:32:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a4153970 con 0x7f68a40b1650 2024-09-13T18:32:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4160220 con 0x7f68a40b1650 2024-09-13T18:32:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a17fa640 1 -- 172.21.15.53:0/4147121156 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f68940b2050 con 0x7f68a40b1650 2024-09-13T18:32:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a17fa640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6884066c30 0x7f68840690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f68a17fa640 1 -- 172.21.15.53:0/4147121156 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f689411e330 con 0x7f68a40b1650 2024-09-13T18:32:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f689b7fe640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6884066c30 0x7f68840690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.569+0000 7f689b7fe640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6884066c30 0x7f68840690f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f68a40cdad0 tx=0x7f688c00f1d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:36.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.573+0000 7f68a17fa640 1 -- 172.21.15.53:0/4147121156 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68940eaef0 con 0x7f68a40b1650 2024-09-13T18:32:36.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.769+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68a40cd400 con 0x7f68a40b1650 2024-09-13T18:32:36.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.769+0000 7f68a17fa640 1 -- 172.21.15.53:0/4147121156 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f68940ee510 con 0x7f68a40b1650 2024-09-13T18:32:36.771 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:36.771 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2946475465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2946475465},{"type":"v1","addr":"172.21.15.87:6833","nonce":2946475465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3953952610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3953952610},{"type":"v1","addr":"172.21.15.87:6835","nonce":3953952610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1516456617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1516456617},{"type":"v1","addr":"172.21.15.53:6833","nonce":1516456617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:32:33.769589+0000","modified":"2024-09-13T18:32:36.397069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/275376653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":275376653},{"type":"v1","addr":"172.21.15.53:6835","nonce":275376653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:32:36.772 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 79 2024-09-13T18:32:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6884066c30 msgr2=0x7f68840690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6884066c30 0x7f68840690f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f68a40cdad0 tx=0x7f688c00f1d0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a40b1650 msgr2=0x7f68a40cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a40b1650 0x7f68a40cc120 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f689401a000 tx=0x7f6894019170 comp rx=0 tx=0).stop 2024-09-13T18:32:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 shutdown_connections 2024-09-13T18:32:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6884066c30 0x7f68840690f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b4e50 0x7f68a414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a415c840 0x7f68a414d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 --2- 172.21.15.53:0/4147121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a40b1650 0x7f68a40cc120 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 >> 172.21.15.53:0/4147121156 conn(0x7f68a4066080 msgr2=0x7f68a40cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:36.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 shutdown_connections 2024-09-13T18:32:36.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.773+0000 7f68aa4cf640 1 -- 172.21.15.53:0/4147121156 wait complete. 2024-09-13T18:32:36.792 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.909+0000 7f6857804640 1 Processor -- start 2024-09-13T18:32:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.909+0000 7f6857804640 1 -- start start 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6857804640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 0x7f6850070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6857804640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685006d480 con 0x7f68501582a0 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6857804640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685015ace0 con 0x7f68500711d0 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6857804640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685015aaf0 con 0x7f685015b7c0 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f68501582a0 0x7f685006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58234/0 (socket says 172.21.15.53:58234) 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 -- 172.21.15.53:0/2018489829 learned_addr learned my addr 172.21.15.53:0/2018489829 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6854d9f640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 0x7f6850070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076291178 0 0) 0x7f685006d480 con 0x7f68501582a0 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f683c003530 con 0x7f68501582a0 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126959139 0 0) 0x7f683c003530 con 0x7f68501582a0 2024-09-13T18:32:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 msgr2=0x7f6850070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 0x7f6850070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 >> v1:172.21.15.87:6789/0 conn(0x7f68500711d0 legacy=0x7f68501640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685015afc0 con 0x7f68501582a0 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f684c001680 con 0x7f68501582a0 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 >> v1:172.21.15.53:6789/0 conn(0x7f68501582a0 legacy=0x7f685006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c0039b0 0x7f683c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0047d0 0x7f683c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 0x7f683c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c00ba40 con 0x7f683c0039b0 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c00bbb0 con 0x7f683c0047d0 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c00bd70 con 0x7f685015b7c0 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c0039b0 0x7f683c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6854d9f640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0047d0 0x7f683c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6855da1640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 0x7f683c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 -- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 msgr2=0x7f683c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 0x7f683c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 -- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0047d0 msgr2=0x7f683c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0047d0 0x7f683c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f68555a0640 1 -- 172.21.15.53:0/2018489829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c003530 con 0x7f683c0039b0 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6854d9f640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0047d0 0x7f683c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:36.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.913+0000 7f6855da1640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f685015b7c0 0x7f683c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f68555a0640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c0039b0 0x7f683c003dd0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c190 tx=0x7f684c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dbe3aca3136829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c005ae0 con 0x7f683c0039b0 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c005c40 con 0x7f683c0039b0 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6847fff640 1 -- 172.21.15.53:0/2018489829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c007070 con 0x7f683c0039b0 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- 172.21.15.53:0/2018489829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c0039b0 msgr2=0x7f683c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 --2- 172.21.15.53:0/2018489829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f683c0039b0 0x7f683c003dd0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c190 tx=0x7f684c01cc00 comp rx=0 tx=0).stop 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 -- 172.21.15.53:0/2018489829 reap_dead start 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- 172.21.15.53:0/2018489829 shutdown_connections 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- 172.21.15.53:0/2018489829 >> 172.21.15.53:0/2018489829 conn(0x7f6850065c80 msgr2=0x7f6850066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- 172.21.15.53:0/2018489829 shutdown_connections 2024-09-13T18:32:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- 172.21.15.53:0/2018489829 wait complete. 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 Processor -- start 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- start start 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0039b0 0x7f6850142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6850143810 0x7f6850153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6850153dc0 0x7f68500ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501567f0 con 0x7f6850153dc0 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68500b18a0 con 0x7f683c0039b0 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68500b2700 con 0x7f6850143810 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6850153dc0 0x7f68500ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6850153dc0 0x7f68500ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42010/0 (socket says 172.21.15.53:42010) 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 -- 172.21.15.53:0/70629238 learned_addr learned my addr 172.21.15.53:0/70629238 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6854d9f640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6850143810 0x7f6850153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f68555a0640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0039b0 0x7f6850142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 -- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6850143810 msgr2=0x7f6850153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6850143810 0x7f6850153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 -- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0039b0 msgr2=0x7f6850142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0039b0 0x7f6850142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 -- 172.21.15.53:0/70629238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500b1af0 con 0x7f6850153dc0 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f68555a0640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0039b0 0x7f6850142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6855da1640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6850153dc0 0x7f68500ae720 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f68500cbf70 tx=0x7f684800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6845ffb640 1 -- 172.21.15.53:0/70629238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848006d60 con 0x7f6850153dc0 2024-09-13T18:32:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6845ffb640 1 -- 172.21.15.53:0/70629238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848003980 con 0x7f6850153dc0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68500b1dd0 con 0x7f6850153dc0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6845ffb640 1 -- 172.21.15.53:0/70629238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848003d70 con 0x7f6850153dc0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.917+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68500b2390 con 0x7f6850153dc0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.921+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68500b2550 con 0x7f6850153dc0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.921+0000 7f6845ffb640 1 -- 172.21.15.53:0/70629238 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f6848005070 con 0x7f6850153dc0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.921+0000 7f6845ffb640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6834066c30 0x7f68340690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.921+0000 7f6845ffb640 1 -- 172.21.15.53:0/70629238 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6848085050 con 0x7f6850153dc0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.921+0000 7f68555a0640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6834066c30 0x7f68340690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.921+0000 7f68555a0640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6834066c30 0x7f68340690f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f684c0ab000 tx=0x7f684c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:36.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:36.925+0000 7f6845ffb640 1 -- 172.21.15.53:0/70629238 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6848051bd0 con 0x7f6850153dc0 2024-09-13T18:32:37.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.085+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6850067400 con 0x7f6850153dc0 2024-09-13T18:32:37.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6845ffb640 1 -- 172.21.15.53:0/70629238 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f68480551f0 con 0x7f6850153dc0 2024-09-13T18:32:37.091 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:37.091 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":136,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:34.772690+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:37.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6834066c30 msgr2=0x7f68340690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6834066c30 0x7f68340690f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f684c0ab000 tx=0x7f684c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:32:37.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6850153dc0 msgr2=0x7f68500ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6850153dc0 0x7f68500ae720 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f68500cbf70 tx=0x7f684800dc00 comp rx=0 tx=0).stop 2024-09-13T18:32:37.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 shutdown_connections 2024-09-13T18:32:37.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6834066c30 0x7f68340690f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6850143810 0x7f6850153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6850153dc0 0x7f68500ae720 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 --2- 172.21.15.53:0/70629238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f683c0039b0 0x7f6850142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 >> 172.21.15.53:0/70629238 conn(0x7f6850065c80 msgr2=0x7f68500700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 shutdown_connections 2024-09-13T18:32:37.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.089+0000 7f6857804640 1 -- 172.21.15.53:0/70629238 wait complete. 2024-09-13T18:32:37.111 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:32:37.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:32:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea43c3640 1 Processor -- start 2024-09-13T18:32:37.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea43c3640 1 -- start start 2024-09-13T18:32:37.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea43c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e9c158ba0 0x7f4e9c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea43c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c06fa80 0x7f4e9c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea43c3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c0b2340 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea43c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c0b2860 con 0x7f4e9c158ba0 2024-09-13T18:32:37.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea43c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c158f80 con 0x7f4e9c06fa80 2024-09-13T18:32:37.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea215f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e9c158ba0 0x7f4e9c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea215f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e9c158ba0 0x7f4e9c06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42016/0 (socket says 172.21.15.53:42016) 2024-09-13T18:32:37.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea215f640 1 -- 172.21.15.53:0/2488091233 learned_addr learned my addr 172.21.15.53:0/2488091233 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:37.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea2960640 1 --2- 172.21.15.53:0/2488091233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c06fa80 0x7f4e9c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea215f640 1 -- 172.21.15.53:0/2488091233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c06fa80 msgr2=0x7f4e9c0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:37.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea215f640 1 --2- 172.21.15.53:0/2488091233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c06fa80 0x7f4e9c0b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea215f640 1 -- 172.21.15.53:0/2488091233 >> v1:172.21.15.87:6789/0 conn(0x7f4e9c0cbb60 legacy=0x7f4e9c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:37.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.237+0000 7f4ea215f640 1 -- 172.21.15.53:0/2488091233 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0b2580 con 0x7f4e9c158ba0 2024-09-13T18:32:37.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea215f640 1 --2- 172.21.15.53:0/2488091233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c158ba0 0x7f4e9c06b390 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009870 tx=0x7f4e9801e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef2f99c87f84241 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea115d640 1 -- 172.21.15.53:0/2488091233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e980ab670 con 0x7f4e9c158ba0 2024-09-13T18:32:37.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea115d640 1 -- 172.21.15.53:0/2488091233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e980ab7d0 con 0x7f4e9c158ba0 2024-09-13T18:32:37.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea115d640 1 -- 172.21.15.53:0/2488091233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e980abb60 con 0x7f4e9c158ba0 2024-09-13T18:32:37.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- 172.21.15.53:0/2488091233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c158ba0 msgr2=0x7f4e9c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/2488091233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c158ba0 0x7f4e9c06b390 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009870 tx=0x7f4e9801e5e0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- 172.21.15.53:0/2488091233 shutdown_connections 2024-09-13T18:32:37.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/2488091233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c06fa80 0x7f4e9c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/2488091233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c158ba0 0x7f4e9c06b390 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- 172.21.15.53:0/2488091233 >> 172.21.15.53:0/2488091233 conn(0x7f4e9c065c80 msgr2=0x7f4e9c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:37.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- 172.21.15.53:0/2488091233 shutdown_connections 2024-09-13T18:32:37.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- 172.21.15.53:0/2488091233 wait complete. 2024-09-13T18:32:37.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 Processor -- start 2024-09-13T18:32:37.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- start start 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e9c06fa80 0x7f4e9c0ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0cbb60 0x7f4e9c148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c158ba0 0x7f4e9c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1550c0 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c154540 con 0x7f4e9c06fa80 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea43c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c154820 con 0x7f4e9c158ba0 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0cbb60 0x7f4e9c148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0cbb60 0x7f4e9c148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42026/0 (socket says 172.21.15.53:42026) 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 -- 172.21.15.53:0/3161880269 learned_addr learned my addr 172.21.15.53:0/3161880269 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea2960640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c158ba0 0x7f4e9c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea215f640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e9c06fa80 0x7f4e9c0ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 -- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c158ba0 msgr2=0x7f4e9c156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c158ba0 0x7f4e9c156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 -- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e9c06fa80 msgr2=0x7f4e9c0ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e9c06fa80 0x7f4e9c0ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea195e640 1 -- 172.21.15.53:0/3161880269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980094d0 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.241+0000 7f4ea215f640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e9c06fa80 0x7f4e9c0ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4ea195e640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0cbb60 0x7f4e9c148410 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c450 tx=0x7f4e8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4e92ffd640 1 -- 172.21.15.53:0/3161880269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c012830 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4e92ffd640 1 -- 172.21.15.53:0/3161880269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c0129b0 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4e92ffd640 1 -- 172.21.15.53:0/3161880269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c012d60 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c154b00 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c0ad870 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c067400 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4e92ffd640 1 -- 172.21.15.53:0/3161880269 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f4e8c01c460 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4e92ffd640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e80066c30 0x7f4e800690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4e92ffd640 1 -- 172.21.15.53:0/3161880269 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e8c084a40 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4ea215f640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e80066c30 0x7f4e800690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.245+0000 7f4ea215f640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e80066c30 0x7f4e800690f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b0000 tx=0x7f4e980a9000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.249+0000 7f4e92ffd640 1 -- 172.21.15.53:0/3161880269 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e8c051590 con 0x7f4e9c0cbb60 2024-09-13T18:32:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.409+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e9c0b1760 con 0x7f4e80066c30 2024-09-13T18:32:37.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.421+0000 7f4e92ffd640 1 -- 172.21.15.53:0/3161880269 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277619 (secure 0 0 0) 0x7f4e9c0b1760 con 0x7f4e80066c30 2024-09-13T18:32:37.429 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:32:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e80066c30 msgr2=0x7f4e800690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e80066c30 0x7f4e800690f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b0000 tx=0x7f4e980a9000 comp rx=0 tx=0).stop 2024-09-13T18:32:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0cbb60 msgr2=0x7f4e9c148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0cbb60 0x7f4e9c148410 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c450 tx=0x7f4e8c00c910 comp rx=0 tx=0).stop 2024-09-13T18:32:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 shutdown_connections 2024-09-13T18:32:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e80066c30 0x7f4e800690f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e9c158ba0 0x7f4e9c156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e9c0cbb60 0x7f4e9c148410 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 --2- 172.21.15.53:0/3161880269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e9c06fa80 0x7f4e9c0ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 >> 172.21.15.53:0/3161880269 conn(0x7f4e9c065c80 msgr2=0x7f4e9c0af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 shutdown_connections 2024-09-13T18:32:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.429+0000 7f4ea43c3640 1 -- 172.21.15.53:0/3161880269 wait complete. 2024-09-13T18:32:37.448 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-13T18:32:35.865285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283552,"kb_used_data":14136,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754691168,"statfs":{"total":773094113280,"available":772803756032,"internally_reserved":0,"allocated":14475264,"data_stored":7033268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000802"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.383960+0000","last_change":"2024-09-13T18:32:32.383960+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.383960+0000","last_undegraded":"2024-09-13T18:32:32.383960+0000","last_fullsized":"2024-09-13T18:32:32.383960+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:08.119303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.386000+0000","last_change":"2024-09-13T18:32:32.386000+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.386000+0000","last_undegraded":"2024-09-13T18:32:32.386000+0000","last_fullsized":"2024-09-13T18:32:32.386000+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.401915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377438+0000","last_change":"2024-09-13T18:32:32.377438+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377438+0000","last_undegraded":"2024-09-13T18:32:32.377438+0000","last_fullsized":"2024-09-13T18:32:32.377438+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:22.801823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377415+0000","last_change":"2024-09-13T18:32:32.377415+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377415+0000","last_undegraded":"2024-09-13T18:32:32.377415+0000","last_fullsized":"2024-09-13T18:32:32.377415+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:44.889998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382520+0000","last_change":"2024-09-13T18:32:32.382520+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382520+0000","last_undegraded":"2024-09-13T18:32:32.382520+0000","last_fullsized":"2024-09-13T18:32:32.382520+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:57.855160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387564+0000","last_change":"2024-09-13T18:32:32.387564+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387564+0000","last_undegraded":"2024-09-13T18:32:32.387564+0000","last_fullsized":"2024-09-13T18:32:32.387564+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:47.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382776+0000","last_change":"2024-09-13T18:32:32.382776+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382776+0000","last_undegraded":"2024-09-13T18:32:32.382776+0000","last_fullsized":"2024-09-13T18:32:32.382776+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:43.005792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377419+0000","last_change":"2024-09-13T18:32:32.377419+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377419+0000","last_undegraded":"2024-09-13T18:32:32.377419+0000","last_fullsized":"2024-09-13T18:32:32.377419+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:43.220669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.384966+0000","last_change":"2024-09-13T18:32:32.384966+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.384966+0000","last_undegraded":"2024-09-13T18:32:32.384966+0000","last_fullsized":"2024-09-13T18:32:32.384966+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:17.779023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382143+0000","last_change":"2024-09-13T18:32:32.382143+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382143+0000","last_undegraded":"2024-09-13T18:32:32.382143+0000","last_fullsized":"2024-09-13T18:32:32.382143+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:44.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.380587+0000","last_change":"2024-09-13T18:32:32.380587+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.380587+0000","last_undegraded":"2024-09-13T18:32:32.380587+0000","last_fullsized":"2024-09-13T18:32:32.380587+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:57.374528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387896+0000","last_change":"2024-09-13T18:32:32.387896+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387896+0000","last_undegraded":"2024-09-13T18:32:32.387896+0000","last_fullsized":"2024-09-13T18:32:32.387896+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:45.039938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.388055+0000","last_change":"2024-09-13T18:32:32.388055+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.388055+0000","last_undegraded":"2024-09-13T18:32:32.388055+0000","last_fullsized":"2024-09-13T18:32:32.388055+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.416581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.378056+0000","last_change":"2024-09-13T18:32:32.378056+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.378056+0000","last_undegraded":"2024-09-13T18:32:32.378056+0000","last_fullsized":"2024-09-13T18:32:32.378056+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:03.997316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382280+0000","last_change":"2024-09-13T18:32:32.382280+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382280+0000","last_undegraded":"2024-09-13T18:32:32.382280+0000","last_fullsized":"2024-09-13T18:32:32.382280+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:45.743441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387482+0000","last_change":"2024-09-13T18:32:32.387482+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387482+0000","last_undegraded":"2024-09-13T18:32:32.387482+0000","last_fullsized":"2024-09-13T18:32:32.387482+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:57.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.385425+0000","last_change":"2024-09-13T18:32:32.385425+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.385425+0000","last_undegraded":"2024-09-13T18:32:32.385425+0000","last_fullsized":"2024-09-13T18:32:32.385425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.455048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382524+0000","last_change":"2024-09-13T18:32:32.382524+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382524+0000","last_undegraded":"2024-09-13T18:32:32.382524+0000","last_fullsized":"2024-09-13T18:32:32.382524+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:19.514202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.384890+0000","last_change":"2024-09-13T18:32:32.384890+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.384890+0000","last_undegraded":"2024-09-13T18:32:32.384890+0000","last_fullsized":"2024-09-13T18:32:32.384890+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:06.225819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.381764+0000","last_change":"2024-09-13T18:32:32.381764+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.381764+0000","last_undegraded":"2024-09-13T18:32:32.381764+0000","last_fullsized":"2024-09-13T18:32:32.381764+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.903860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.383227+0000","last_change":"2024-09-13T18:32:32.383227+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.383227+0000","last_undegraded":"2024-09-13T18:32:32.383227+0000","last_fullsized":"2024-09-13T18:32:32.383227+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:59.982897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.381933+0000","last_change":"2024-09-13T18:32:32.381933+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.381933+0000","last_undegraded":"2024-09-13T18:32:32.381933+0000","last_fullsized":"2024-09-13T18:32:32.381933+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:49.041040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387591+0000","last_change":"2024-09-13T18:32:32.387591+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387591+0000","last_undegraded":"2024-09-13T18:32:32.387591+0000","last_fullsized":"2024-09-13T18:32:32.387591+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:19.163626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382014+0000","last_change":"2024-09-13T18:32:32.382014+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382014+0000","last_undegraded":"2024-09-13T18:32:32.382014+0000","last_fullsized":"2024-09-13T18:32:32.382014+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.211604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377629+0000","last_change":"2024-09-13T18:32:32.377629+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377629+0000","last_undegraded":"2024-09-13T18:32:32.377629+0000","last_fullsized":"2024-09-13T18:32:32.377629+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:06.402429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377746+0000","last_change":"2024-09-13T18:32:32.377746+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377746+0000","last_undegraded":"2024-09-13T18:32:32.377746+0000","last_fullsized":"2024-09-13T18:32:32.377746+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:40.969205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377791+0000","last_change":"2024-09-13T18:32:32.377791+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377791+0000","last_undegraded":"2024-09-13T18:32:32.377791+0000","last_fullsized":"2024-09-13T18:32:32.377791+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:15.279314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.380813+0000","last_change":"2024-09-13T18:32:32.380813+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.380813+0000","last_undegraded":"2024-09-13T18:32:32.380813+0000","last_fullsized":"2024-09-13T18:32:32.380813+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:27.578442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382060+0000","last_change":"2024-09-13T18:32:32.382060+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382060+0000","last_undegraded":"2024-09-13T18:32:32.382060+0000","last_fullsized":"2024-09-13T18:32:32.382060+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387610+0000","last_change":"2024-09-13T18:32:32.387610+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387610+0000","last_undegraded":"2024-09-13T18:32:32.387610+0000","last_fullsized":"2024-09-13T18:32:32.387610+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.063539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.384820+0000","last_change":"2024-09-13T18:32:32.384820+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.384820+0000","last_undegraded":"2024-09-13T18:32:32.384820+0000","last_fullsized":"2024-09-13T18:32:32.384820+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387599+0000","last_change":"2024-09-13T18:32:32.387599+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387599+0000","last_undegraded":"2024-09-13T18:32:32.387599+0000","last_fullsized":"2024-09-13T18:32:32.387599+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:39.532247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":295,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-13T18:32:30.250221+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:32:30.250221+0000","last_peered":"2024-09-13T18:32:30.250221+0000","last_clean":"2024-09-13T18:32:30.250221+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:32:30.250221+0000","last_undegraded":"2024-09-13T18:32:30.250221+0000","last_fullsized":"2024-09-13T18:32:30.250221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33324,"kb_used_data":2208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2260992,"data_stored":1324843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90500000000000003,"15min":0.88300000000000001},"min":{"1min":0.52100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2330000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":0.90000000000000002},"min":{"1min":0.51100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.143,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.79500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.95199999999999996,"15min":0.93000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.129,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.73899999999999999,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.57499999999999996,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.1040000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88100000000000001,"15min":0.879},"min":{"1min":0.61799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2070000000000001,"5min":1.349,"15min":1.448},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.94599999999999995,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1930000000000001,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.66700000000000004,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.4019999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96299999999999997,"15min":1.0249999999999999},"min":{"1min":0.74399999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1919999999999999,"5min":1.5609999999999999,"15min":1.877},"last":1.081},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.98699999999999999,"15min":0.97899999999999998},"min":{"1min":0.63900000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.409,"15min":1.409},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0489999999999999,"15min":1.0589999999999999},"min":{"1min":0.74199999999999999,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.4490000000000001,"5min":1.476,"15min":1.476},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.038,"5min":1.0349999999999999,"15min":1.004},"min":{"1min":0.77600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.361,"5min":1.506,"15min":1.506},"last":1.2689999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1654784,"data_stored":728658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.312},"max":{"1min":1.2230000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81000000000000005,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.48799999999999999,"15min":0.46600000000000003},"max":{"1min":1.117,"5min":1.252,"15min":1.3879999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.92600000000000005,"15min":0.89600000000000002},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.34899999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.577},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.91300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.218,"15min":1.464},"last":1.0489999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.84299999999999997,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.752},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92100000000000004,"15min":0.96299999999999997},"min":{"1min":0.69799999999999995,"5min":0.59599999999999997,"15min":0.47499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":2.4220000000000002},"last":1.069}]},{"osd":3,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91700000000000004,"15min":0.88600000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.65900000000000003,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.306},"last":0.93999999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":0.97299999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.042,"15min":1.0089999999999999},"min":{"1min":0.69399999999999995,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.624,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2310000000000001,"5min":1.2390000000000001,"15min":1.4330000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.03,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":2.762},"last":1.181}]},{"osd":7,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.028,"15min":1.0409999999999999},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.9299999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.0249999999999999,"15min":1.044},"min":{"1min":0.84299999999999997,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.72},"last":1.02}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1667072,"data_stored":734475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1850000000000001,"5min":1.2390000000000001,"15min":2.0209999999999999},"last":0.624},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.437},"max":{"1min":1.264,"5min":1.264,"15min":2.1840000000000002},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.88300000000000001,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86399999999999999,"15min":0.83399999999999996},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.5029999999999999},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.292,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90800000000000003,"15min":0.95999999999999996},"min":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":2.2589999999999999},"last":1.095}]},{"osd":3,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.96599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4650000000000001,"5min":1.6719999999999999,"15min":1.871},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.93899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.071,"5min":0.998,"15min":1.0409999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.5049999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.98799999999999999,"15min":1.0229999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.95299999999999996,"15min":1.0169999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.1439999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":1.488,"15min":2.246},"last":1.05},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.05,"15min":1.1220000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.9379999999999999},"last":0.92700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1654784,"data_stored":728658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95099999999999996,"15min":0.84399999999999997},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3490000000000002,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.94399999999999995,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.41699999999999998},"max":{"1min":2.4060000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.56000000000000005,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.2589999999999999,"5min":1.536,"15min":1.536},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61799999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.8069999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89300000000000002,"15min":0.875},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.139,"5min":1.216,"15min":1.216},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.89800000000000002},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.006},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.026,"15min":0.95899999999999996},"min":{"1min":0.76300000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":1.4159999999999999,"5min":10.44,"15min":10.44},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.65200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.044,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.67100000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.087}]},{"osd":6,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.117,"15min":1.0349999999999999},"min":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.52000000000000002},"max":{"1min":1.4890000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.284},{"interface":"front","average":{"1min":1.085,"5min":1.2070000000000001,"15min":1.0880000000000001},"min":{"1min":0.76000000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":1.8979999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.222}]},{"osd":7,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.095},"min":{"1min":0.69099999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2269999999999999,"5min":15.593,"15min":15.593},"last":1.165},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.0569999999999999,"15min":1.0780000000000001},"min":{"1min":0.77800000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.349}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36828,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335012,"statfs":{"total":96636764160,"available":96599052288,"internally_reserved":0,"allocated":1654784,"data_stored":728658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.88200000000000001,"5min":2.113,"15min":2.113},"last":0.75},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77600000000000002,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.115,"5min":1.4199999999999999,"15min":1.704},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.079,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.376,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.742,"15min":1.742},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79100000000000004,"15min":0.748},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.0629999999999999,"5min":1.224,"15min":1.399},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.69999999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2190000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.536,"5min":1.536,"15min":2.8740000000000001},"last":1.008}]},{"osd":5,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98599999999999999,"15min":1.016},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.294,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2589999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.0740000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.0549999999999999},"min":{"1min":0.71299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.665,"5min":1.665,"15min":2.6190000000000002},"last":1.099},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.0509999999999999},"min":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53400000000000003},"max":{"1min":1.502,"5min":1.6890000000000001,"15min":1.96},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.036,"15min":1.0880000000000001},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4470000000000001,"5min":1.665,"15min":3},"last":1.056},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.032,"15min":1.006},"min":{"1min":0.66900000000000004,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.123}]}]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1667072,"data_stored":734475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.83399999999999996,"5min":0.97999999999999998,"15min":1.0309999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67500000000000004,"15min":0.65300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.93500000000000005,"5min":1.1200000000000001,"15min":1.335},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94999999999999996,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":1.0309999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.748},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.141,"5min":1.405,"15min":1.405},"last":0.93200000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.91700000000000004,"15min":0.91200000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.212,"5min":1.367,"15min":1.611},"last":1.157},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.91600000000000004},"min":{"1min":0.68600000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2210000000000001,"5min":1.587,"15min":1.587},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.60399999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.9179999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.98099999999999998,"15min":0.97299999999999998},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2450000000000001,"5min":1.552,"15min":1.702},"last":1.079}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.472,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.66800000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.522,"5min":1.645,"15min":1.645},"last":1.117}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.623,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.843,"15min":1.843},"last":0.995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4330000000000001,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":1.028}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1667072,"data_stored":734475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.61399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":1.0680000000000001,"15min":1.177},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.29699999999999999,"15min":0.28199999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.36299999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.125},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":1.423,"15min":1.423},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.90700000000000003},"min":{"1min":0.628,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":1.014},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93600000000000005,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.42899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92800000000000005,"15min":0.92100000000000004},"min":{"1min":0.64200000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3460000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.69499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4059999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.018,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.27,"5min":1.5900000000000001,"15min":1.653},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.425,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":1.2130000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.091,"15min":1.0529999999999999},"min":{"1min":0.74299999999999999,"5min":0.61899999999999999,"15min":0.52500000000000002},"max":{"1min":1.4790000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.196,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.256}]}]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41512,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330328,"statfs":{"total":96636764160,"available":96594255872,"internally_reserved":0,"allocated":2248704,"data_stored":1319026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0169999999999999,"15min":1.147},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.03,"5min":1.244,"15min":1.4359999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1299999999999999,"5min":1.333,"15min":1.333},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.05,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.99199999999999999,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.93200000000000005},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.075,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96499999999999997,"15min":0.98699999999999999},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3089999999999999,"5min":1.5069999999999999,"15min":1.986},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97899999999999998,"15min":1.002},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.492,"5min":1.8799999999999999,"15min":2.641},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.032},"min":{"1min":0.61599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.304,"5min":1.3580000000000001,"15min":1.6699999999999999},"last":1.024}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0349999999999999,"15min":1.0649999999999999},"min":{"1min":0.64600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.321,"5min":1.466,"15min":1.891},"last":1.079},{"interface":"front","average":{"1min":1.036,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.72999999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.006,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":2.2949999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.75600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:32:37.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:32:37.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.605+0000 7fe226d64640 1 Processor -- start 2024-09-13T18:32:37.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.605+0000 7fe226d64640 1 -- start start 2024-09-13T18:32:37.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe226d64640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe22015a470 0x7fe2200cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe226d64640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe22015cc60 0x7fe220071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe226d64640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22006f550 con 0x7fe2200b1c10 2024-09-13T18:32:37.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe226d64640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22006f880 con 0x7fe22015cc60 2024-09-13T18:32:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe226d64640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22015dc40 con 0x7fe22015a470 2024-09-13T18:32:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe21ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe22015cc60 0x7fe220071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe21ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe22015cc60 0x7fe220071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42034/0 (socket says 172.21.15.53:42034) 2024-09-13T18:32:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe21ffff640 1 -- 172.21.15.53:0/172737193 learned_addr learned my addr 172.21.15.53:0/172737193 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe224b00640 1 --2- 172.21.15.53:0/172737193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe22015a470 0x7fe2200cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe21ffff640 1 -- 172.21.15.53:0/172737193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe22015a470 msgr2=0x7fe2200cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe21ffff640 1 --2- 172.21.15.53:0/172737193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe22015a470 0x7fe2200cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe21ffff640 1 -- 172.21.15.53:0/172737193 >> v1:172.21.15.87:6789/0 conn(0x7fe2200b1c10 legacy=0x7fe22006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.609+0000 7fe21ffff640 1 -- 172.21.15.53:0/172737193 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200715a0 con 0x7fe22015cc60 2024-09-13T18:32:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe21ffff640 1 --2- 172.21.15.53:0/172737193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015cc60 0x7fe220071060 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fe208009870 tx=0x7fe20801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cecb2163b8dbfcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe21f7fe640 1 -- 172.21.15.53:0/172737193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080a9620 con 0x7fe22015cc60 2024-09-13T18:32:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe21f7fe640 1 -- 172.21.15.53:0/172737193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2080a9780 con 0x7fe22015cc60 2024-09-13T18:32:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe21f7fe640 1 -- 172.21.15.53:0/172737193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080a9b10 con 0x7fe22015cc60 2024-09-13T18:32:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- 172.21.15.53:0/172737193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015cc60 msgr2=0x7fe220071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 --2- 172.21.15.53:0/172737193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015cc60 0x7fe220071060 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fe208009870 tx=0x7fe20801c560 comp rx=0 tx=0).stop 2024-09-13T18:32:37.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- 172.21.15.53:0/172737193 shutdown_connections 2024-09-13T18:32:37.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 --2- 172.21.15.53:0/172737193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015cc60 0x7fe220071060 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 --2- 172.21.15.53:0/172737193 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe22015a470 0x7fe2200cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- 172.21.15.53:0/172737193 >> 172.21.15.53:0/172737193 conn(0x7fe220065c80 msgr2=0x7fe220066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:37.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- 172.21.15.53:0/172737193 shutdown_connections 2024-09-13T18:32:37.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- 172.21.15.53:0/172737193 wait complete. 2024-09-13T18:32:37.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 Processor -- start 2024-09-13T18:32:37.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- start start 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2200b1c10 0x7fe220151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015a470 0x7fe2200ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe22015cc60 0x7fe2200ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220159580 con 0x7fe22015a470 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220158900 con 0x7fe22015cc60 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe226d64640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe220158be0 con 0x7fe2200b1c10 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe21ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015a470 0x7fe2200ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe21ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015a470 0x7fe2200ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42038/0 (socket says 172.21.15.53:42038) 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe21ffff640 1 -- 172.21.15.53:0/1178885738 learned_addr learned my addr 172.21.15.53:0/1178885738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe224b00640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2200b1c10 0x7fe220151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.613+0000 7fe225301640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe22015cc60 0x7fe2200ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21ffff640 1 -- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2200b1c10 msgr2=0x7fe220151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21ffff640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2200b1c10 0x7fe220151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21ffff640 1 -- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe22015cc60 msgr2=0x7fe2200ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21ffff640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe22015cc60 0x7fe2200ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21ffff640 1 -- 172.21.15.53:0/1178885738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080094d0 con 0x7fe22015a470 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21ffff640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015a470 0x7fe2200ca660 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fe20801ac10 tx=0x7fe208019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21d7fa640 1 -- 172.21.15.53:0/1178885738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080b9420 con 0x7fe22015a470 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21d7fa640 1 -- 172.21.15.53:0/1178885738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2080b9580 con 0x7fe22015a470 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe220158ec0 con 0x7fe22015a470 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21d7fa640 1 -- 172.21.15.53:0/1178885738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080b98f0 con 0x7fe22015a470 2024-09-13T18:32:37.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2201599a0 con 0x7fe22015a470 2024-09-13T18:32:37.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe220159b90 con 0x7fe22015a470 2024-09-13T18:32:37.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21d7fa640 1 -- 172.21.15.53:0/1178885738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fe2080b13f0 con 0x7fe22015a470 2024-09-13T18:32:37.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21d7fa640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe200066c60 0x7fe200069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe21d7fa640 1 -- 172.21.15.53:0/1178885738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe20811e7d0 con 0x7fe22015a470 2024-09-13T18:32:37.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe224b00640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe200066c60 0x7fe200069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.617+0000 7fe224b00640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe200066c60 0x7fe200069120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2200afa30 tx=0x7fe210008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.621+0000 7fe21d7fa640 1 -- 172.21.15.53:0/1178885738 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2080eb360 con 0x7fe22015a470 2024-09-13T18:32:37.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.777+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe22015d0c0 con 0x7fe200066c60 2024-09-13T18:32:37.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.785+0000 7fe21d7fa640 1 -- 172.21.15.53:0/1178885738 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277619 (secure 0 0 0) 0x7fe210009d60 con 0x7fe200066c60 2024-09-13T18:32:37.790 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:37.792 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:32:37.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe200066c60 msgr2=0x7fe200069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe200066c60 0x7fe200069120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2200afa30 tx=0x7fe210008040 comp rx=0 tx=0).stop 2024-09-13T18:32:37.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015a470 msgr2=0x7fe2200ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015a470 0x7fe2200ca660 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fe20801ac10 tx=0x7fe208019300 comp rx=0 tx=0).stop 2024-09-13T18:32:37.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 shutdown_connections 2024-09-13T18:32:37.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe200066c60 0x7fe200069120 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe22015cc60 0x7fe2200ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe22015a470 0x7fe2200ca660 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 --2- 172.21.15.53:0/1178885738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe2200b1c10 0x7fe220151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 >> 172.21.15.53:0/1178885738 conn(0x7fe220065c80 msgr2=0x7fe220066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:37.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 shutdown_connections 2024-09-13T18:32:37.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.789+0000 7fe226d64640 1 -- 172.21.15.53:0/1178885738 wait complete. 2024-09-13T18:32:37.807 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-13T18:32:35.865285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283552,"kb_used_data":14136,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754691168,"statfs":{"total":773094113280,"available":772803756032,"internally_reserved":0,"allocated":14475264,"data_stored":7033268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000802"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.383960+0000","last_change":"2024-09-13T18:32:32.383960+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.383960+0000","last_undegraded":"2024-09-13T18:32:32.383960+0000","last_fullsized":"2024-09-13T18:32:32.383960+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:08.119303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.386000+0000","last_change":"2024-09-13T18:32:32.386000+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.386000+0000","last_undegraded":"2024-09-13T18:32:32.386000+0000","last_fullsized":"2024-09-13T18:32:32.386000+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.401915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377438+0000","last_change":"2024-09-13T18:32:32.377438+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377438+0000","last_undegraded":"2024-09-13T18:32:32.377438+0000","last_fullsized":"2024-09-13T18:32:32.377438+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:22.801823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377415+0000","last_change":"2024-09-13T18:32:32.377415+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377415+0000","last_undegraded":"2024-09-13T18:32:32.377415+0000","last_fullsized":"2024-09-13T18:32:32.377415+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:44.889998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382520+0000","last_change":"2024-09-13T18:32:32.382520+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382520+0000","last_undegraded":"2024-09-13T18:32:32.382520+0000","last_fullsized":"2024-09-13T18:32:32.382520+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:57.855160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387564+0000","last_change":"2024-09-13T18:32:32.387564+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387564+0000","last_undegraded":"2024-09-13T18:32:32.387564+0000","last_fullsized":"2024-09-13T18:32:32.387564+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:47.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382776+0000","last_change":"2024-09-13T18:32:32.382776+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382776+0000","last_undegraded":"2024-09-13T18:32:32.382776+0000","last_fullsized":"2024-09-13T18:32:32.382776+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:43.005792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377419+0000","last_change":"2024-09-13T18:32:32.377419+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377419+0000","last_undegraded":"2024-09-13T18:32:32.377419+0000","last_fullsized":"2024-09-13T18:32:32.377419+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:43.220669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.384966+0000","last_change":"2024-09-13T18:32:32.384966+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.384966+0000","last_undegraded":"2024-09-13T18:32:32.384966+0000","last_fullsized":"2024-09-13T18:32:32.384966+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:17.779023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382143+0000","last_change":"2024-09-13T18:32:32.382143+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382143+0000","last_undegraded":"2024-09-13T18:32:32.382143+0000","last_fullsized":"2024-09-13T18:32:32.382143+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:44.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.380587+0000","last_change":"2024-09-13T18:32:32.380587+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.380587+0000","last_undegraded":"2024-09-13T18:32:32.380587+0000","last_fullsized":"2024-09-13T18:32:32.380587+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:57.374528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387896+0000","last_change":"2024-09-13T18:32:32.387896+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387896+0000","last_undegraded":"2024-09-13T18:32:32.387896+0000","last_fullsized":"2024-09-13T18:32:32.387896+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:45.039938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.388055+0000","last_change":"2024-09-13T18:32:32.388055+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.388055+0000","last_undegraded":"2024-09-13T18:32:32.388055+0000","last_fullsized":"2024-09-13T18:32:32.388055+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.416581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.378056+0000","last_change":"2024-09-13T18:32:32.378056+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.378056+0000","last_undegraded":"2024-09-13T18:32:32.378056+0000","last_fullsized":"2024-09-13T18:32:32.378056+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:03.997316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382280+0000","last_change":"2024-09-13T18:32:32.382280+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382280+0000","last_undegraded":"2024-09-13T18:32:32.382280+0000","last_fullsized":"2024-09-13T18:32:32.382280+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:45.743441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387482+0000","last_change":"2024-09-13T18:32:32.387482+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387482+0000","last_undegraded":"2024-09-13T18:32:32.387482+0000","last_fullsized":"2024-09-13T18:32:32.387482+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:57.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.385425+0000","last_change":"2024-09-13T18:32:32.385425+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.385425+0000","last_undegraded":"2024-09-13T18:32:32.385425+0000","last_fullsized":"2024-09-13T18:32:32.385425+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.455048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382524+0000","last_change":"2024-09-13T18:32:32.382524+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382524+0000","last_undegraded":"2024-09-13T18:32:32.382524+0000","last_fullsized":"2024-09-13T18:32:32.382524+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:19.514202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.384890+0000","last_change":"2024-09-13T18:32:32.384890+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.384890+0000","last_undegraded":"2024-09-13T18:32:32.384890+0000","last_fullsized":"2024-09-13T18:32:32.384890+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:06.225819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.381764+0000","last_change":"2024-09-13T18:32:32.381764+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.381764+0000","last_undegraded":"2024-09-13T18:32:32.381764+0000","last_fullsized":"2024-09-13T18:32:32.381764+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.903860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.383227+0000","last_change":"2024-09-13T18:32:32.383227+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.383227+0000","last_undegraded":"2024-09-13T18:32:32.383227+0000","last_fullsized":"2024-09-13T18:32:32.383227+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:59.982897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.381933+0000","last_change":"2024-09-13T18:32:32.381933+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.381933+0000","last_undegraded":"2024-09-13T18:32:32.381933+0000","last_fullsized":"2024-09-13T18:32:32.381933+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:49.041040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387591+0000","last_change":"2024-09-13T18:32:32.387591+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387591+0000","last_undegraded":"2024-09-13T18:32:32.387591+0000","last_fullsized":"2024-09-13T18:32:32.387591+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:19.163626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382014+0000","last_change":"2024-09-13T18:32:32.382014+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382014+0000","last_undegraded":"2024-09-13T18:32:32.382014+0000","last_fullsized":"2024-09-13T18:32:32.382014+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.211604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377629+0000","last_change":"2024-09-13T18:32:32.377629+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377629+0000","last_undegraded":"2024-09-13T18:32:32.377629+0000","last_fullsized":"2024-09-13T18:32:32.377629+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:06.402429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377746+0000","last_change":"2024-09-13T18:32:32.377746+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377746+0000","last_undegraded":"2024-09-13T18:32:32.377746+0000","last_fullsized":"2024-09-13T18:32:32.377746+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:40.969205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.377791+0000","last_change":"2024-09-13T18:32:32.377791+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.377791+0000","last_undegraded":"2024-09-13T18:32:32.377791+0000","last_fullsized":"2024-09-13T18:32:32.377791+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:15.279314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.380813+0000","last_change":"2024-09-13T18:32:32.380813+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.380813+0000","last_undegraded":"2024-09-13T18:32:32.380813+0000","last_fullsized":"2024-09-13T18:32:32.380813+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:27.578442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.382060+0000","last_change":"2024-09-13T18:32:32.382060+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.382060+0000","last_undegraded":"2024-09-13T18:32:32.382060+0000","last_fullsized":"2024-09-13T18:32:32.382060+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387610+0000","last_change":"2024-09-13T18:32:32.387610+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387610+0000","last_undegraded":"2024-09-13T18:32:32.387610+0000","last_fullsized":"2024-09-13T18:32:32.387610+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.063539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.384820+0000","last_change":"2024-09-13T18:32:32.384820+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.384820+0000","last_undegraded":"2024-09-13T18:32:32.384820+0000","last_fullsized":"2024-09-13T18:32:32.384820+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:32:33.372022+0000","last_change":"2024-09-13T18:32:33.372022+0000","last_active":"2024-09-13T18:32:33.372022+0000","last_peered":"2024-09-13T18:32:33.372022+0000","last_clean":"2024-09-13T18:32:33.372022+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:33.372022+0000","last_undegraded":"2024-09-13T18:32:33.372022+0000","last_fullsized":"2024-09-13T18:32:33.372022+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-13T18:32:32.387599+0000","last_change":"2024-09-13T18:32:32.387599+0000","last_active":"2024-09-13T18:32:32.356151+0000","last_peered":"2024-09-13T18:32:32.356151+0000","last_clean":"2024-09-13T18:32:32.356151+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:32:32.387599+0000","last_undegraded":"2024-09-13T18:32:32.387599+0000","last_fullsized":"2024-09-13T18:32:32.387599+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:39.532247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":295,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-13T18:32:30.250221+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:32:30.250221+0000","last_peered":"2024-09-13T18:32:30.250221+0000","last_clean":"2024-09-13T18:32:30.250221+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:32:30.250221+0000","last_undegraded":"2024-09-13T18:32:30.250221+0000","last_fullsized":"2024-09-13T18:32:30.250221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33324,"kb_used_data":2208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338516,"statfs":{"total":96636764160,"available":96602640384,"internally_reserved":0,"allocated":2260992,"data_stored":1324843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90500000000000003,"15min":0.88300000000000001},"min":{"1min":0.52100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2330000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":0.90000000000000002},"min":{"1min":0.51100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.143,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.79500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.95199999999999996,"15min":0.93000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.129,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.73899999999999999,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.57499999999999996,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.1040000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88100000000000001,"15min":0.879},"min":{"1min":0.61799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2070000000000001,"5min":1.349,"15min":1.448},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.94599999999999995,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1930000000000001,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.66700000000000004,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.4019999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96299999999999997,"15min":1.0249999999999999},"min":{"1min":0.74399999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1919999999999999,"5min":1.5609999999999999,"15min":1.877},"last":1.081},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.98699999999999999,"15min":0.97899999999999998},"min":{"1min":0.63900000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.409,"15min":1.409},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0489999999999999,"15min":1.0589999999999999},"min":{"1min":0.74199999999999999,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.4490000000000001,"5min":1.476,"15min":1.476},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.038,"5min":1.0349999999999999,"15min":1.004},"min":{"1min":0.77600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.361,"5min":1.506,"15min":1.506},"last":1.2689999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1654784,"data_stored":728658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.312},"max":{"1min":1.2230000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81000000000000005,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.48799999999999999,"15min":0.46600000000000003},"max":{"1min":1.117,"5min":1.252,"15min":1.3879999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.92600000000000005,"15min":0.89600000000000002},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.34899999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.577},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.91300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.218,"15min":1.464},"last":1.0489999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.84299999999999997,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.752},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92100000000000004,"15min":0.96299999999999997},"min":{"1min":0.69799999999999995,"5min":0.59599999999999997,"15min":0.47499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":2.4220000000000002},"last":1.069}]},{"osd":3,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91700000000000004,"15min":0.88600000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.65900000000000003,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.306},"last":0.93999999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":0.97299999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.042,"15min":1.0089999999999999},"min":{"1min":0.69399999999999995,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.624,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2310000000000001,"5min":1.2390000000000001,"15min":1.4330000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.03,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":2.762},"last":1.181}]},{"osd":7,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.028,"15min":1.0409999999999999},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.9299999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.0249999999999999,"15min":1.044},"min":{"1min":0.84299999999999997,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.72},"last":1.02}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1667072,"data_stored":734475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1850000000000001,"5min":1.2390000000000001,"15min":2.0209999999999999},"last":0.624},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.437},"max":{"1min":1.264,"5min":1.264,"15min":2.1840000000000002},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.88300000000000001,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86399999999999999,"15min":0.83399999999999996},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.5029999999999999},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.292,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90800000000000003,"15min":0.95999999999999996},"min":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":2.2589999999999999},"last":1.095}]},{"osd":3,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.96599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4650000000000001,"5min":1.6719999999999999,"15min":1.871},"last":0.69699999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.93899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.071,"5min":0.998,"15min":1.0409999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.5049999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.98799999999999999,"15min":1.0229999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.95299999999999996,"15min":1.0169999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.1439999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":1.488,"15min":2.246},"last":1.05},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.05,"15min":1.1220000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.9379999999999999},"last":0.92700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1654784,"data_stored":728658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95099999999999996,"15min":0.84399999999999997},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3490000000000002,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.94399999999999995,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.41699999999999998},"max":{"1min":2.4060000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.56000000000000005,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.2589999999999999,"5min":1.536,"15min":1.536},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61799999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.8069999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89300000000000002,"15min":0.875},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.139,"5min":1.216,"15min":1.216},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.89800000000000002},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.006},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.026,"15min":0.95899999999999996},"min":{"1min":0.76300000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":1.4159999999999999,"5min":10.44,"15min":10.44},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.65200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.044,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.67100000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.087}]},{"osd":6,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.117,"15min":1.0349999999999999},"min":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.52000000000000002},"max":{"1min":1.4890000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.284},{"interface":"front","average":{"1min":1.085,"5min":1.2070000000000001,"15min":1.0880000000000001},"min":{"1min":0.76000000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":1.8979999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.222}]},{"osd":7,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.095},"min":{"1min":0.69099999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2269999999999999,"5min":15.593,"15min":15.593},"last":1.165},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.0569999999999999,"15min":1.0780000000000001},"min":{"1min":0.77800000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.349}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36828,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335012,"statfs":{"total":96636764160,"available":96599052288,"internally_reserved":0,"allocated":1654784,"data_stored":728658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.88200000000000001,"5min":2.113,"15min":2.113},"last":0.75},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77600000000000002,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.115,"5min":1.4199999999999999,"15min":1.704},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.079,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.376,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.742,"15min":1.742},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79100000000000004,"15min":0.748},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.0629999999999999,"5min":1.224,"15min":1.399},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.69999999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2190000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.536,"5min":1.536,"15min":2.8740000000000001},"last":1.008}]},{"osd":5,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98599999999999999,"15min":1.016},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.294,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2589999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.0740000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.0549999999999999},"min":{"1min":0.71299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.665,"5min":1.665,"15min":2.6190000000000002},"last":1.099},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.0509999999999999},"min":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53400000000000003},"max":{"1min":1.502,"5min":1.6890000000000001,"15min":1.96},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.036,"15min":1.0880000000000001},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4470000000000001,"5min":1.665,"15min":3},"last":1.056},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.032,"15min":1.006},"min":{"1min":0.66900000000000004,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.123}]}]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1667072,"data_stored":734475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.83399999999999996,"5min":0.97999999999999998,"15min":1.0309999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67500000000000004,"15min":0.65300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.93500000000000005,"5min":1.1200000000000001,"15min":1.335},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94999999999999996,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":1.0309999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.748},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.141,"5min":1.405,"15min":1.405},"last":0.93200000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.91700000000000004,"15min":0.91200000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.212,"5min":1.367,"15min":1.611},"last":1.157},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.91600000000000004},"min":{"1min":0.68600000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2210000000000001,"5min":1.587,"15min":1.587},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.60399999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.9179999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.98099999999999998,"15min":0.97299999999999998},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2450000000000001,"5min":1.552,"15min":1.702},"last":1.079}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.472,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.66800000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.522,"5min":1.645,"15min":1.645},"last":1.117}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.623,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.843,"15min":1.843},"last":0.995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4330000000000001,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":1.028}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1667072,"data_stored":734475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.61399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":1.0680000000000001,"15min":1.177},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.29699999999999999,"15min":0.28199999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.36299999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.125},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":1.423,"15min":1.423},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.90700000000000003},"min":{"1min":0.628,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":1.014},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93600000000000005,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.42899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92800000000000005,"15min":0.92100000000000004},"min":{"1min":0.64200000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3460000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.69499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4059999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.018,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.27,"5min":1.5900000000000001,"15min":1.653},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.425,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":1.2130000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.091,"15min":1.0529999999999999},"min":{"1min":0.74299999999999999,"5min":0.61899999999999999,"15min":0.52500000000000002},"max":{"1min":1.4790000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.196,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.256}]}]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41512,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330328,"statfs":{"total":96636764160,"available":96594255872,"internally_reserved":0,"allocated":2248704,"data_stored":1319026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0169999999999999,"15min":1.147},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.03,"5min":1.244,"15min":1.4359999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1299999999999999,"5min":1.333,"15min":1.333},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.05,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.99199999999999999,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.93200000000000005},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.075,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96499999999999997,"15min":0.98699999999999999},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3089999999999999,"5min":1.5069999999999999,"15min":1.986},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97899999999999998,"15min":1.002},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.492,"5min":1.8799999999999999,"15min":2.641},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.032},"min":{"1min":0.61599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.304,"5min":1.3580000000000001,"15min":1.6699999999999999},"last":1.024}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0349999999999999,"15min":1.0649999999999999},"min":{"1min":0.64600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.321,"5min":1.466,"15min":1.891},"last":1.079},{"interface":"front","average":{"1min":1.036,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.72999999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.006,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":2.2949999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.75600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:32:37.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:32:37.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.969+0000 7f31f2b69640 1 Processor -- start 2024-09-13T18:32:37.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.969+0000 7f31f2b69640 1 -- start start 2024-09-13T18:32:37.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f2b69640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31ec0cf800 0x7f31ec0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f2b69640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0b7b40 0x7f31ec1662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f2b69640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec15cc10 con 0x7f31ec15c830 2024-09-13T18:32:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f2b69640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec0b50c0 con 0x7f31ec0cf800 2024-09-13T18:32:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f2b69640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0b41d0 con 0x7f31ec0b7b40 2024-09-13T18:32:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31ebfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31ec0cf800 0x7f31ec0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f1106640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0b7b40 0x7f31ec1662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f0905640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f31ec15c830 0x7f31ec0cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:37932/0 (socket says 172.21.15.53:37932) 2024-09-13T18:32:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f0905640 1 -- 172.21.15.53:0/2825869862 learned_addr learned my addr 172.21.15.53:0/2825869862 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31ebfff640 1 --2- 172.21.15.53:0/2825869862 >> v2:172.21.15.87:3300/0 conn(0x7f31ec0cf800 0x7f31ec0cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:42472/0 (socket says 172.21.15.53:42472) 2024-09-13T18:32:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f1106640 1 -- 172.21.15.53:0/2825869862 >> v2:172.21.15.87:3300/0 conn(0x7f31ec0cf800 msgr2=0x7f31ec0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f1106640 1 --2- 172.21.15.53:0/2825869862 >> v2:172.21.15.87:3300/0 conn(0x7f31ec0cf800 0x7f31ec0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f1106640 1 -- 172.21.15.53:0/2825869862 >> v1:172.21.15.87:6789/0 conn(0x7f31ec15c830 legacy=0x7f31ec0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31f1106640 1 -- 172.21.15.53:0/2825869862 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0b44b0 con 0x7f31ec0b7b40 2024-09-13T18:32:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.973+0000 7f31ebfff640 1 --2- 172.21.15.53:0/2825869862 >> v2:172.21.15.87:3300/0 conn(0x7f31ec0cf800 0x7f31ec0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f1106640 1 --2- 172.21.15.53:0/2825869862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0b7b40 0x7f31ec1662f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009d90 tx=0x7f31e401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e69d5a5f2ebe7b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31eb7fe640 1 -- 172.21.15.53:0/2825869862 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40af600 con 0x7f31ec0b7b40 2024-09-13T18:32:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31eb7fe640 1 -- 172.21.15.53:0/2825869862 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40ab050 con 0x7f31ec0b7b40 2024-09-13T18:32:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31eb7fe640 1 -- 172.21.15.53:0/2825869862 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40af980 con 0x7f31ec0b7b40 2024-09-13T18:32:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- 172.21.15.53:0/2825869862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0b7b40 msgr2=0x7f31ec1662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 --2- 172.21.15.53:0/2825869862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0b7b40 0x7f31ec1662f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009d90 tx=0x7f31e401f150 comp rx=0 tx=0).stop 2024-09-13T18:32:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- 172.21.15.53:0/2825869862 shutdown_connections 2024-09-13T18:32:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 --2- 172.21.15.53:0/2825869862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0b7b40 0x7f31ec1662f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 --2- 172.21.15.53:0/2825869862 >> v2:172.21.15.87:3300/0 conn(0x7f31ec0cf800 0x7f31ec0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- 172.21.15.53:0/2825869862 >> 172.21.15.53:0/2825869862 conn(0x7f31ec070970 msgr2=0x7f31ec070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- 172.21.15.53:0/2825869862 shutdown_connections 2024-09-13T18:32:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- 172.21.15.53:0/2825869862 wait complete. 2024-09-13T18:32:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 Processor -- start 2024-09-13T18:32:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- start start 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ec0b7b40 0x7f31ec156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0cf800 0x7f31ec148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ec15c830 0x7f31ec0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec15fd80 con 0x7f31ec0b7b40 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec15d250 con 0x7f31ec15c830 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f2b69640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec148f50 con 0x7f31ec0cf800 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ec0b7b40 0x7f31ec156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ec0b7b40 0x7f31ec156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42048/0 (socket says 172.21.15.53:42048) 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 -- 172.21.15.53:0/1005148907 learned_addr learned my addr 172.21.15.53:0/1005148907 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f1106640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ec15c830 0x7f31ec0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31ebfff640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0cf800 0x7f31ec148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 -- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0cf800 msgr2=0x7f31ec148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0cf800 0x7f31ec148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 -- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ec15c830 msgr2=0x7f31ec0c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ec15c830 0x7f31ec0c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.977+0000 7f31f0905640 1 -- 172.21.15.53:0/1005148907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0093b0 con 0x7f31ec0b7b40 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31f0905640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ec0b7b40 0x7f31ec156110 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f31d400c430 tx=0x7f31d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31e97fa640 1 -- 172.21.15.53:0/1005148907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4005cf0 con 0x7f31ec0b7b40 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31e97fa640 1 -- 172.21.15.53:0/1005148907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d4005e50 con 0x7f31ec0b7b40 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e4009a70 con 0x7f31ec0b7b40 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31e97fa640 1 -- 172.21.15.53:0/1005148907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d40072d0 con 0x7f31ec0b7b40 2024-09-13T18:32:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec15faa0 con 0x7f31ec0b7b40 2024-09-13T18:32:37.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec15e840 con 0x7f31ec0b7b40 2024-09-13T18:32:37.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31e97fa640 1 -- 172.21.15.53:0/1005148907 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f31d4007430 con 0x7f31ec0b7b40 2024-09-13T18:32:37.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31e97fa640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31cc066c60 0x7f31cc069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:37.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31e97fa640 1 -- 172.21.15.53:0/1005148907 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d4083e90 con 0x7f31ec0b7b40 2024-09-13T18:32:37.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31ebfff640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31cc066c60 0x7f31cc069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.981+0000 7f31ebfff640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31cc066c60 0x7f31cc069120 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0b4150 tx=0x7f31dc006f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:37.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:37.985+0000 7f31e97fa640 1 -- 172.21.15.53:0/1005148907 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f31d4050a50 con 0x7f31ec0b7b40 2024-09-13T18:32:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.141+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31ec0b4d50 con 0x7f31cc066c60 2024-09-13T18:32:38.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.153+0000 7f31e97fa640 1 -- 172.21.15.53:0/1005148907 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288721 (secure 0 0 0) 0x7f31dc009940 con 0x7f31cc066c60 2024-09-13T18:32:38.159 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:38.161 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31cc066c60 msgr2=0x7f31cc069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31cc066c60 0x7f31cc069120 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0b4150 tx=0x7f31dc006f90 comp rx=0 tx=0).stop 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ec0b7b40 msgr2=0x7f31ec156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ec0b7b40 0x7f31ec156110 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f31d400c430 tx=0x7f31d400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 shutdown_connections 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31cc066c60 0x7f31cc069120 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31ec0cf800 0x7f31ec148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31ec15c830 0x7f31ec0c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 --2- 172.21.15.53:0/1005148907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31ec0b7b40 0x7f31ec156110 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 >> 172.21.15.53:0/1005148907 conn(0x7f31ec070970 msgr2=0x7f31ec0b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:38.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 shutdown_connections 2024-09-13T18:32:38.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.157+0000 7f31f2b69640 1 -- 172.21.15.53:0/1005148907 wait complete. 2024-09-13T18:32:38.179 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-13T18:32:37.865788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283976,"kb_used_data":14536,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754690744,"statfs":{"total":773094113280,"available":772803321856,"internally_reserved":0,"allocated":14884864,"data_stored":7216060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.492115"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787606+0000","last_change":"2024-09-13T18:32:33.811702+0000","last_active":"2024-09-13T18:32:34.787606+0000","last_peered":"2024-09-13T18:32:34.787606+0000","last_clean":"2024-09-13T18:32:34.787606+0000","last_became_active":"2024-09-13T18:32:33.811431+0000","last_became_peered":"2024-09-13T18:32:33.811431+0000","last_unstale":"2024-09-13T18:32:34.787606+0000","last_undegraded":"2024-09-13T18:32:34.787606+0000","last_fullsized":"2024-09-13T18:32:34.787606+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:54.841297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977990+0000","last_change":"2024-09-13T18:32:33.789940+0000","last_active":"2024-09-13T18:32:35.977990+0000","last_peered":"2024-09-13T18:32:35.977990+0000","last_clean":"2024-09-13T18:32:35.977990+0000","last_became_active":"2024-09-13T18:32:33.789710+0000","last_became_peered":"2024-09-13T18:32:33.789710+0000","last_unstale":"2024-09-13T18:32:35.977990+0000","last_undegraded":"2024-09-13T18:32:35.977990+0000","last_fullsized":"2024-09-13T18:32:35.977990+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:58.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977747+0000","last_change":"2024-09-13T18:32:33.828419+0000","last_active":"2024-09-13T18:32:35.977747+0000","last_peered":"2024-09-13T18:32:35.977747+0000","last_clean":"2024-09-13T18:32:35.977747+0000","last_became_active":"2024-09-13T18:32:33.827494+0000","last_became_peered":"2024-09-13T18:32:33.827494+0000","last_unstale":"2024-09-13T18:32:35.977747+0000","last_undegraded":"2024-09-13T18:32:35.977747+0000","last_fullsized":"2024-09-13T18:32:35.977747+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:18.651202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.789070+0000","last_change":"2024-09-13T18:32:33.834165+0000","last_active":"2024-09-13T18:32:34.789070+0000","last_peered":"2024-09-13T18:32:34.789070+0000","last_clean":"2024-09-13T18:32:34.789070+0000","last_became_active":"2024-09-13T18:32:33.833102+0000","last_became_peered":"2024-09-13T18:32:33.833102+0000","last_unstale":"2024-09-13T18:32:34.789070+0000","last_undegraded":"2024-09-13T18:32:34.789070+0000","last_fullsized":"2024-09-13T18:32:34.789070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:04.488154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978048+0000","last_change":"2024-09-13T18:32:33.819392+0000","last_active":"2024-09-13T18:32:35.978048+0000","last_peered":"2024-09-13T18:32:35.978048+0000","last_clean":"2024-09-13T18:32:35.978048+0000","last_became_active":"2024-09-13T18:32:33.818308+0000","last_became_peered":"2024-09-13T18:32:33.818308+0000","last_unstale":"2024-09-13T18:32:35.978048+0000","last_undegraded":"2024-09-13T18:32:35.978048+0000","last_fullsized":"2024-09-13T18:32:35.978048+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:27.274268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786969+0000","last_change":"2024-09-13T18:32:33.827300+0000","last_active":"2024-09-13T18:32:34.786969+0000","last_peered":"2024-09-13T18:32:34.786969+0000","last_clean":"2024-09-13T18:32:34.786969+0000","last_became_active":"2024-09-13T18:32:33.827033+0000","last_became_peered":"2024-09-13T18:32:33.827033+0000","last_unstale":"2024-09-13T18:32:34.786969+0000","last_undegraded":"2024-09-13T18:32:34.786969+0000","last_fullsized":"2024-09-13T18:32:34.786969+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:46.055809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978046+0000","last_change":"2024-09-13T18:32:33.818453+0000","last_active":"2024-09-13T18:32:35.978046+0000","last_peered":"2024-09-13T18:32:35.978046+0000","last_clean":"2024-09-13T18:32:35.978046+0000","last_became_active":"2024-09-13T18:32:33.818186+0000","last_became_peered":"2024-09-13T18:32:33.818186+0000","last_unstale":"2024-09-13T18:32:35.978046+0000","last_undegraded":"2024-09-13T18:32:35.978046+0000","last_fullsized":"2024-09-13T18:32:35.978046+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:21.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786405+0000","last_change":"2024-09-13T18:32:33.784740+0000","last_active":"2024-09-13T18:32:34.786405+0000","last_peered":"2024-09-13T18:32:34.786405+0000","last_clean":"2024-09-13T18:32:34.786405+0000","last_became_active":"2024-09-13T18:32:33.784452+0000","last_became_peered":"2024-09-13T18:32:33.784452+0000","last_unstale":"2024-09-13T18:32:34.786405+0000","last_undegraded":"2024-09-13T18:32:34.786405+0000","last_fullsized":"2024-09-13T18:32:34.786405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:20.179497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977162+0000","last_change":"2024-09-13T18:32:33.790722+0000","last_active":"2024-09-13T18:32:35.977162+0000","last_peered":"2024-09-13T18:32:35.977162+0000","last_clean":"2024-09-13T18:32:35.977162+0000","last_became_active":"2024-09-13T18:32:33.790424+0000","last_became_peered":"2024-09-13T18:32:33.790424+0000","last_unstale":"2024-09-13T18:32:35.977162+0000","last_undegraded":"2024-09-13T18:32:35.977162+0000","last_fullsized":"2024-09-13T18:32:35.977162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:45.919731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950990+0000","last_change":"2024-09-13T18:32:33.821759+0000","last_active":"2024-09-13T18:32:34.950990+0000","last_peered":"2024-09-13T18:32:34.950990+0000","last_clean":"2024-09-13T18:32:34.950990+0000","last_became_active":"2024-09-13T18:32:33.821137+0000","last_became_peered":"2024-09-13T18:32:33.821137+0000","last_unstale":"2024-09-13T18:32:34.950990+0000","last_undegraded":"2024-09-13T18:32:34.950990+0000","last_fullsized":"2024-09-13T18:32:34.950990+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:58.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786770+0000","last_change":"2024-09-13T18:32:33.790635+0000","last_active":"2024-09-13T18:32:34.786770+0000","last_peered":"2024-09-13T18:32:34.786770+0000","last_clean":"2024-09-13T18:32:34.786770+0000","last_became_active":"2024-09-13T18:32:33.790382+0000","last_became_peered":"2024-09-13T18:32:33.790382+0000","last_unstale":"2024-09-13T18:32:34.786770+0000","last_undegraded":"2024-09-13T18:32:34.786770+0000","last_fullsized":"2024-09-13T18:32:34.786770+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:00.079410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950792+0000","last_change":"2024-09-13T18:32:33.822373+0000","last_active":"2024-09-13T18:32:34.950792+0000","last_peered":"2024-09-13T18:32:34.950792+0000","last_clean":"2024-09-13T18:32:34.950792+0000","last_became_active":"2024-09-13T18:32:33.821727+0000","last_became_peered":"2024-09-13T18:32:33.821727+0000","last_unstale":"2024-09-13T18:32:34.950792+0000","last_undegraded":"2024-09-13T18:32:34.950792+0000","last_fullsized":"2024-09-13T18:32:34.950792+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978354+0000","last_change":"2024-09-13T18:32:33.817767+0000","last_active":"2024-09-13T18:32:35.978354+0000","last_peered":"2024-09-13T18:32:35.978354+0000","last_clean":"2024-09-13T18:32:35.978354+0000","last_became_active":"2024-09-13T18:32:33.816781+0000","last_became_peered":"2024-09-13T18:32:33.816781+0000","last_unstale":"2024-09-13T18:32:35.978354+0000","last_undegraded":"2024-09-13T18:32:35.978354+0000","last_fullsized":"2024-09-13T18:32:35.978354+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:58.586795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788548+0000","last_change":"2024-09-13T18:32:33.827648+0000","last_active":"2024-09-13T18:32:34.788548+0000","last_peered":"2024-09-13T18:32:34.788548+0000","last_clean":"2024-09-13T18:32:34.788548+0000","last_became_active":"2024-09-13T18:32:33.824848+0000","last_became_peered":"2024-09-13T18:32:33.824848+0000","last_unstale":"2024-09-13T18:32:34.788548+0000","last_undegraded":"2024-09-13T18:32:34.788548+0000","last_fullsized":"2024-09-13T18:32:34.788548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:41.154706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950144+0000","last_change":"2024-09-13T18:32:33.804780+0000","last_active":"2024-09-13T18:32:34.950144+0000","last_peered":"2024-09-13T18:32:34.950144+0000","last_clean":"2024-09-13T18:32:34.950144+0000","last_became_active":"2024-09-13T18:32:33.804071+0000","last_became_peered":"2024-09-13T18:32:33.804071+0000","last_unstale":"2024-09-13T18:32:34.950144+0000","last_undegraded":"2024-09-13T18:32:34.950144+0000","last_fullsized":"2024-09-13T18:32:34.950144+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:54.557300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977916+0000","last_change":"2024-09-13T18:32:33.788921+0000","last_active":"2024-09-13T18:32:35.977916+0000","last_peered":"2024-09-13T18:32:35.977916+0000","last_clean":"2024-09-13T18:32:35.977916+0000","last_became_active":"2024-09-13T18:32:33.787379+0000","last_became_peered":"2024-09-13T18:32:33.787379+0000","last_unstale":"2024-09-13T18:32:35.977916+0000","last_undegraded":"2024-09-13T18:32:35.977916+0000","last_fullsized":"2024-09-13T18:32:35.977916+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:23.550606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951092+0000","last_change":"2024-09-13T18:32:33.815748+0000","last_active":"2024-09-13T18:32:34.951092+0000","last_peered":"2024-09-13T18:32:34.951092+0000","last_clean":"2024-09-13T18:32:34.951092+0000","last_became_active":"2024-09-13T18:32:33.814966+0000","last_became_peered":"2024-09-13T18:32:33.814966+0000","last_unstale":"2024-09-13T18:32:34.951092+0000","last_undegraded":"2024-09-13T18:32:34.951092+0000","last_fullsized":"2024-09-13T18:32:34.951092+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:20.205346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977070+0000","last_change":"2024-09-13T18:32:33.824811+0000","last_active":"2024-09-13T18:32:35.977070+0000","last_peered":"2024-09-13T18:32:35.977070+0000","last_clean":"2024-09-13T18:32:35.977070+0000","last_became_active":"2024-09-13T18:32:33.823742+0000","last_became_peered":"2024-09-13T18:32:33.823742+0000","last_unstale":"2024-09-13T18:32:35.977070+0000","last_undegraded":"2024-09-13T18:32:35.977070+0000","last_fullsized":"2024-09-13T18:32:35.977070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:58.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787230+0000","last_change":"2024-09-13T18:32:33.786294+0000","last_active":"2024-09-13T18:32:34.787230+0000","last_peered":"2024-09-13T18:32:34.787230+0000","last_clean":"2024-09-13T18:32:34.787230+0000","last_became_active":"2024-09-13T18:32:33.786018+0000","last_became_peered":"2024-09-13T18:32:33.786018+0000","last_unstale":"2024-09-13T18:32:34.787230+0000","last_undegraded":"2024-09-13T18:32:34.787230+0000","last_fullsized":"2024-09-13T18:32:34.787230+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:40.548118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979901+0000","last_change":"2024-09-13T18:32:33.786100+0000","last_active":"2024-09-13T18:32:35.979901+0000","last_peered":"2024-09-13T18:32:35.979901+0000","last_clean":"2024-09-13T18:32:35.979901+0000","last_became_active":"2024-09-13T18:32:33.785846+0000","last_became_peered":"2024-09-13T18:32:33.785846+0000","last_unstale":"2024-09-13T18:32:35.979901+0000","last_undegraded":"2024-09-13T18:32:35.979901+0000","last_fullsized":"2024-09-13T18:32:35.979901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:10.553097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950719+0000","last_change":"2024-09-13T18:32:33.831887+0000","last_active":"2024-09-13T18:32:34.950719+0000","last_peered":"2024-09-13T18:32:34.950719+0000","last_clean":"2024-09-13T18:32:34.950719+0000","last_became_active":"2024-09-13T18:32:33.831272+0000","last_became_peered":"2024-09-13T18:32:33.831272+0000","last_unstale":"2024-09-13T18:32:34.950719+0000","last_undegraded":"2024-09-13T18:32:34.950719+0000","last_fullsized":"2024-09-13T18:32:34.950719+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:13.873493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.789097+0000","last_change":"2024-09-13T18:32:33.827054+0000","last_active":"2024-09-13T18:32:34.789097+0000","last_peered":"2024-09-13T18:32:34.789097+0000","last_clean":"2024-09-13T18:32:34.789097+0000","last_became_active":"2024-09-13T18:32:33.824083+0000","last_became_peered":"2024-09-13T18:32:33.824083+0000","last_unstale":"2024-09-13T18:32:34.789097+0000","last_undegraded":"2024-09-13T18:32:34.789097+0000","last_fullsized":"2024-09-13T18:32:34.789097+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:00.414722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788371+0000","last_change":"2024-09-13T18:32:33.820207+0000","last_active":"2024-09-13T18:32:34.788371+0000","last_peered":"2024-09-13T18:32:34.788371+0000","last_clean":"2024-09-13T18:32:34.788371+0000","last_became_active":"2024-09-13T18:32:33.818585+0000","last_became_peered":"2024-09-13T18:32:33.818585+0000","last_unstale":"2024-09-13T18:32:34.788371+0000","last_undegraded":"2024-09-13T18:32:34.788371+0000","last_fullsized":"2024-09-13T18:32:34.788371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:41.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950207+0000","last_change":"2024-09-13T18:32:33.822129+0000","last_active":"2024-09-13T18:32:34.950207+0000","last_peered":"2024-09-13T18:32:34.950207+0000","last_clean":"2024-09-13T18:32:34.950207+0000","last_became_active":"2024-09-13T18:32:33.821422+0000","last_became_peered":"2024-09-13T18:32:33.821422+0000","last_unstale":"2024-09-13T18:32:34.950207+0000","last_undegraded":"2024-09-13T18:32:34.950207+0000","last_fullsized":"2024-09-13T18:32:34.950207+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:07.091127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979868+0000","last_change":"2024-09-13T18:32:33.788247+0000","last_active":"2024-09-13T18:32:35.979868+0000","last_peered":"2024-09-13T18:32:35.979868+0000","last_clean":"2024-09-13T18:32:35.979868+0000","last_became_active":"2024-09-13T18:32:33.787764+0000","last_became_peered":"2024-09-13T18:32:33.787764+0000","last_unstale":"2024-09-13T18:32:35.979868+0000","last_undegraded":"2024-09-13T18:32:35.979868+0000","last_fullsized":"2024-09-13T18:32:35.979868+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:49.661271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787420+0000","last_change":"2024-09-13T18:32:33.791031+0000","last_active":"2024-09-13T18:32:34.787420+0000","last_peered":"2024-09-13T18:32:34.787420+0000","last_clean":"2024-09-13T18:32:34.787420+0000","last_became_active":"2024-09-13T18:32:33.790485+0000","last_became_peered":"2024-09-13T18:32:33.790485+0000","last_unstale":"2024-09-13T18:32:34.787420+0000","last_undegraded":"2024-09-13T18:32:34.787420+0000","last_fullsized":"2024-09-13T18:32:34.787420+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:18.227242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979000+0000","last_change":"2024-09-13T18:32:33.828807+0000","last_active":"2024-09-13T18:32:35.979000+0000","last_peered":"2024-09-13T18:32:35.979000+0000","last_clean":"2024-09-13T18:32:35.979000+0000","last_became_active":"2024-09-13T18:32:33.828520+0000","last_became_peered":"2024-09-13T18:32:33.828520+0000","last_unstale":"2024-09-13T18:32:35.979000+0000","last_undegraded":"2024-09-13T18:32:35.979000+0000","last_fullsized":"2024-09-13T18:32:35.979000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:58.270636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979418+0000","last_change":"2024-09-13T18:32:33.832439+0000","last_active":"2024-09-13T18:32:35.979418+0000","last_peered":"2024-09-13T18:32:35.979418+0000","last_clean":"2024-09-13T18:32:35.979418+0000","last_became_active":"2024-09-13T18:32:33.832160+0000","last_became_peered":"2024-09-13T18:32:33.832160+0000","last_unstale":"2024-09-13T18:32:35.979418+0000","last_undegraded":"2024-09-13T18:32:35.979418+0000","last_fullsized":"2024-09-13T18:32:35.979418+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:08.827000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786593+0000","last_change":"2024-09-13T18:32:33.826859+0000","last_active":"2024-09-13T18:32:34.786593+0000","last_peered":"2024-09-13T18:32:34.786593+0000","last_clean":"2024-09-13T18:32:34.786593+0000","last_became_active":"2024-09-13T18:32:33.826583+0000","last_became_peered":"2024-09-13T18:32:33.826583+0000","last_unstale":"2024-09-13T18:32:34.786593+0000","last_undegraded":"2024-09-13T18:32:34.786593+0000","last_fullsized":"2024-09-13T18:32:34.786593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:11.432452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788778+0000","last_change":"2024-09-13T18:32:33.826451+0000","last_active":"2024-09-13T18:32:34.788778+0000","last_peered":"2024-09-13T18:32:34.788778+0000","last_clean":"2024-09-13T18:32:34.788778+0000","last_became_active":"2024-09-13T18:32:33.823214+0000","last_became_peered":"2024-09-13T18:32:33.823214+0000","last_unstale":"2024-09-13T18:32:34.788778+0000","last_undegraded":"2024-09-13T18:32:34.788778+0000","last_fullsized":"2024-09-13T18:32:34.788778+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:41.125154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977287+0000","last_change":"2024-09-13T18:32:33.824255+0000","last_active":"2024-09-13T18:32:35.977287+0000","last_peered":"2024-09-13T18:32:35.977287+0000","last_clean":"2024-09-13T18:32:35.977287+0000","last_became_active":"2024-09-13T18:32:33.823964+0000","last_became_peered":"2024-09-13T18:32:33.823964+0000","last_unstale":"2024-09-13T18:32:35.977287+0000","last_undegraded":"2024-09-13T18:32:35.977287+0000","last_fullsized":"2024-09-13T18:32:35.977287+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978162+0000","last_change":"2024-09-13T18:32:33.785340+0000","last_active":"2024-09-13T18:32:35.978162+0000","last_peered":"2024-09-13T18:32:35.978162+0000","last_clean":"2024-09-13T18:32:35.978162+0000","last_became_active":"2024-09-13T18:32:33.785090+0000","last_became_peered":"2024-09-13T18:32:33.785090+0000","last_unstale":"2024-09-13T18:32:35.978162+0000","last_undegraded":"2024-09-13T18:32:35.978162+0000","last_fullsized":"2024-09-13T18:32:35.978162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:22.574049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951243+0000","last_change":"2024-09-13T18:32:33.827675+0000","last_active":"2024-09-13T18:32:34.951243+0000","last_peered":"2024-09-13T18:32:34.951243+0000","last_clean":"2024-09-13T18:32:34.951243+0000","last_became_active":"2024-09-13T18:32:33.827033+0000","last_became_peered":"2024-09-13T18:32:33.827033+0000","last_unstale":"2024-09-13T18:32:34.951243+0000","last_undegraded":"2024-09-13T18:32:34.951243+0000","last_fullsized":"2024-09-13T18:32:34.951243+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:45.423965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"135'4","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.835512+0000","last_change":"2024-09-13T18:32:33.426755+0000","last_active":"2024-09-13T18:32:33.835512+0000","last_peered":"2024-09-13T18:32:33.835512+0000","last_clean":"2024-09-13T18:32:33.835512+0000","last_became_active":"2024-09-13T18:32:33.425067+0000","last_became_peered":"2024-09-13T18:32:33.425067+0000","last_unstale":"2024-09-13T18:32:33.835512+0000","last_undegraded":"2024-09-13T18:32:33.835512+0000","last_fullsized":"2024-09-13T18:32:33.835512+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:08.119303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978446+0000","last_change":"2024-09-13T18:32:33.789719+0000","last_active":"2024-09-13T18:32:35.978446+0000","last_peered":"2024-09-13T18:32:35.978446+0000","last_clean":"2024-09-13T18:32:35.978446+0000","last_became_active":"2024-09-13T18:32:33.789469+0000","last_became_peered":"2024-09-13T18:32:33.789469+0000","last_unstale":"2024-09-13T18:32:35.978446+0000","last_undegraded":"2024-09-13T18:32:35.978446+0000","last_fullsized":"2024-09-13T18:32:35.978446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:23.933809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815760+0000","last_change":"2024-09-13T18:32:33.400314+0000","last_active":"2024-09-13T18:32:33.815760+0000","last_peered":"2024-09-13T18:32:33.815760+0000","last_clean":"2024-09-13T18:32:33.815760+0000","last_became_active":"2024-09-13T18:32:33.400037+0000","last_became_peered":"2024-09-13T18:32:33.400037+0000","last_unstale":"2024-09-13T18:32:33.815760+0000","last_undegraded":"2024-09-13T18:32:33.815760+0000","last_fullsized":"2024-09-13T18:32:33.815760+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.401915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786761+0000","last_change":"2024-09-13T18:32:33.819421+0000","last_active":"2024-09-13T18:32:34.786761+0000","last_peered":"2024-09-13T18:32:34.786761+0000","last_clean":"2024-09-13T18:32:34.786761+0000","last_became_active":"2024-09-13T18:32:33.819124+0000","last_became_peered":"2024-09-13T18:32:33.819124+0000","last_unstale":"2024-09-13T18:32:34.786761+0000","last_undegraded":"2024-09-13T18:32:34.786761+0000","last_fullsized":"2024-09-13T18:32:34.786761+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:23.808011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.837457+0000","last_change":"2024-09-13T18:32:33.423218+0000","last_active":"2024-09-13T18:32:33.837457+0000","last_peered":"2024-09-13T18:32:33.837457+0000","last_clean":"2024-09-13T18:32:33.837457+0000","last_became_active":"2024-09-13T18:32:33.422543+0000","last_became_peered":"2024-09-13T18:32:33.422543+0000","last_unstale":"2024-09-13T18:32:33.837457+0000","last_undegraded":"2024-09-13T18:32:33.837457+0000","last_fullsized":"2024-09-13T18:32:33.837457+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:22.801823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950638+0000","last_change":"2024-09-13T18:32:33.827593+0000","last_active":"2024-09-13T18:32:34.950638+0000","last_peered":"2024-09-13T18:32:34.950638+0000","last_clean":"2024-09-13T18:32:34.950638+0000","last_became_active":"2024-09-13T18:32:33.826966+0000","last_became_peered":"2024-09-13T18:32:33.826966+0000","last_unstale":"2024-09-13T18:32:34.950638+0000","last_undegraded":"2024-09-13T18:32:34.950638+0000","last_fullsized":"2024-09-13T18:32:34.950638+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:45.919731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.837441+0000","last_change":"2024-09-13T18:32:33.415194+0000","last_active":"2024-09-13T18:32:33.837441+0000","last_peered":"2024-09-13T18:32:33.837441+0000","last_clean":"2024-09-13T18:32:33.837441+0000","last_became_active":"2024-09-13T18:32:33.413840+0000","last_became_peered":"2024-09-13T18:32:33.413840+0000","last_unstale":"2024-09-13T18:32:33.837441+0000","last_undegraded":"2024-09-13T18:32:33.837441+0000","last_fullsized":"2024-09-13T18:32:33.837441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:44.889998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977735+0000","last_change":"2024-09-13T18:32:33.826111+0000","last_active":"2024-09-13T18:32:35.977735+0000","last_peered":"2024-09-13T18:32:35.977735+0000","last_clean":"2024-09-13T18:32:35.977735+0000","last_became_active":"2024-09-13T18:32:33.825828+0000","last_became_peered":"2024-09-13T18:32:33.825828+0000","last_unstale":"2024-09-13T18:32:35.977735+0000","last_undegraded":"2024-09-13T18:32:35.977735+0000","last_fullsized":"2024-09-13T18:32:35.977735+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:07.091127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815930+0000","last_change":"2024-09-13T18:32:33.428261+0000","last_active":"2024-09-13T18:32:33.815930+0000","last_peered":"2024-09-13T18:32:33.815930+0000","last_clean":"2024-09-13T18:32:33.815930+0000","last_became_active":"2024-09-13T18:32:33.427870+0000","last_became_peered":"2024-09-13T18:32:33.427870+0000","last_unstale":"2024-09-13T18:32:33.815930+0000","last_undegraded":"2024-09-13T18:32:33.815930+0000","last_fullsized":"2024-09-13T18:32:33.815930+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:57.855160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788663+0000","last_change":"2024-09-13T18:32:33.829559+0000","last_active":"2024-09-13T18:32:34.788663+0000","last_peered":"2024-09-13T18:32:34.788663+0000","last_clean":"2024-09-13T18:32:34.788663+0000","last_became_active":"2024-09-13T18:32:33.828891+0000","last_became_peered":"2024-09-13T18:32:33.828891+0000","last_unstale":"2024-09-13T18:32:34.788663+0000","last_undegraded":"2024-09-13T18:32:34.788663+0000","last_fullsized":"2024-09-13T18:32:34.788663+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:54.990593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.816688+0000","last_change":"2024-09-13T18:32:33.430224+0000","last_active":"2024-09-13T18:32:33.816688+0000","last_peered":"2024-09-13T18:32:33.816688+0000","last_clean":"2024-09-13T18:32:33.816688+0000","last_became_active":"2024-09-13T18:32:33.429571+0000","last_became_peered":"2024-09-13T18:32:33.429571+0000","last_unstale":"2024-09-13T18:32:33.816688+0000","last_undegraded":"2024-09-13T18:32:33.816688+0000","last_fullsized":"2024-09-13T18:32:33.816688+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:47.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977233+0000","last_change":"2024-09-13T18:32:33.788325+0000","last_active":"2024-09-13T18:32:35.977233+0000","last_peered":"2024-09-13T18:32:35.977233+0000","last_clean":"2024-09-13T18:32:35.977233+0000","last_became_active":"2024-09-13T18:32:33.788044+0000","last_became_peered":"2024-09-13T18:32:33.788044+0000","last_unstale":"2024-09-13T18:32:35.977233+0000","last_undegraded":"2024-09-13T18:32:35.977233+0000","last_fullsized":"2024-09-13T18:32:35.977233+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:34.559447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.778008+0000","last_change":"2024-09-13T18:32:33.408358+0000","last_active":"2024-09-13T18:32:33.778008+0000","last_peered":"2024-09-13T18:32:33.778008+0000","last_clean":"2024-09-13T18:32:33.778008+0000","last_became_active":"2024-09-13T18:32:33.408047+0000","last_became_peered":"2024-09-13T18:32:33.408047+0000","last_unstale":"2024-09-13T18:32:33.778008+0000","last_undegraded":"2024-09-13T18:32:33.778008+0000","last_fullsized":"2024-09-13T18:32:33.778008+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:43.005792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978544+0000","last_change":"2024-09-13T18:32:33.789016+0000","last_active":"2024-09-13T18:32:35.978544+0000","last_peered":"2024-09-13T18:32:35.978544+0000","last_clean":"2024-09-13T18:32:35.978544+0000","last_became_active":"2024-09-13T18:32:33.788357+0000","last_became_peered":"2024-09-13T18:32:33.788357+0000","last_unstale":"2024-09-13T18:32:35.978544+0000","last_undegraded":"2024-09-13T18:32:35.978544+0000","last_fullsized":"2024-09-13T18:32:35.978544+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:47.237441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.798974+0000","last_change":"2024-09-13T18:32:33.429356+0000","last_active":"2024-09-13T18:32:33.798974+0000","last_peered":"2024-09-13T18:32:33.798974+0000","last_clean":"2024-09-13T18:32:33.798974+0000","last_became_active":"2024-09-13T18:32:33.428721+0000","last_became_peered":"2024-09-13T18:32:33.428721+0000","last_unstale":"2024-09-13T18:32:33.798974+0000","last_undegraded":"2024-09-13T18:32:33.798974+0000","last_fullsized":"2024-09-13T18:32:33.798974+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:43.220669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978375+0000","last_change":"2024-09-13T18:32:33.787225+0000","last_active":"2024-09-13T18:32:35.978375+0000","last_peered":"2024-09-13T18:32:35.978375+0000","last_clean":"2024-09-13T18:32:35.978375+0000","last_became_active":"2024-09-13T18:32:33.786516+0000","last_became_peered":"2024-09-13T18:32:33.786516+0000","last_unstale":"2024-09-13T18:32:35.978375+0000","last_undegraded":"2024-09-13T18:32:35.978375+0000","last_fullsized":"2024-09-13T18:32:35.978375+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:46.055809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.783455+0000","last_change":"2024-09-13T18:32:33.401321+0000","last_active":"2024-09-13T18:32:33.783455+0000","last_peered":"2024-09-13T18:32:33.783455+0000","last_clean":"2024-09-13T18:32:33.783455+0000","last_became_active":"2024-09-13T18:32:33.401054+0000","last_became_peered":"2024-09-13T18:32:33.401054+0000","last_unstale":"2024-09-13T18:32:33.783455+0000","last_undegraded":"2024-09-13T18:32:33.783455+0000","last_fullsized":"2024-09-13T18:32:33.783455+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:17.779023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950931+0000","last_change":"2024-09-13T18:32:33.814876+0000","last_active":"2024-09-13T18:32:34.950931+0000","last_peered":"2024-09-13T18:32:34.950931+0000","last_clean":"2024-09-13T18:32:34.950931+0000","last_became_active":"2024-09-13T18:32:33.814132+0000","last_became_peered":"2024-09-13T18:32:33.814132+0000","last_unstale":"2024-09-13T18:32:34.950931+0000","last_undegraded":"2024-09-13T18:32:34.950931+0000","last_fullsized":"2024-09-13T18:32:34.950931+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:58.390399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.801311+0000","last_change":"2024-09-13T18:32:33.425239+0000","last_active":"2024-09-13T18:32:33.801311+0000","last_peered":"2024-09-13T18:32:33.801311+0000","last_clean":"2024-09-13T18:32:33.801311+0000","last_became_active":"2024-09-13T18:32:33.424481+0000","last_became_peered":"2024-09-13T18:32:33.424481+0000","last_unstale":"2024-09-13T18:32:33.801311+0000","last_undegraded":"2024-09-13T18:32:33.801311+0000","last_fullsized":"2024-09-13T18:32:33.801311+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:44.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979123+0000","last_change":"2024-09-13T18:32:33.782307+0000","last_active":"2024-09-13T18:32:35.979123+0000","last_peered":"2024-09-13T18:32:35.979123+0000","last_clean":"2024-09-13T18:32:35.979123+0000","last_became_active":"2024-09-13T18:32:33.782057+0000","last_became_peered":"2024-09-13T18:32:33.782057+0000","last_unstale":"2024-09-13T18:32:35.979123+0000","last_undegraded":"2024-09-13T18:32:35.979123+0000","last_fullsized":"2024-09-13T18:32:35.979123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:37.268301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"135'6","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.817574+0000","last_change":"2024-09-13T18:32:33.405310+0000","last_active":"2024-09-13T18:32:33.817574+0000","last_peered":"2024-09-13T18:32:33.817574+0000","last_clean":"2024-09-13T18:32:33.817574+0000","last_became_active":"2024-09-13T18:32:33.405021+0000","last_became_peered":"2024-09-13T18:32:33.405021+0000","last_unstale":"2024-09-13T18:32:33.817574+0000","last_undegraded":"2024-09-13T18:32:33.817574+0000","last_fullsized":"2024-09-13T18:32:33.817574+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:57.374528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.976836+0000","last_change":"2024-09-13T18:32:33.834679+0000","last_active":"2024-09-13T18:32:35.976836+0000","last_peered":"2024-09-13T18:32:35.976836+0000","last_clean":"2024-09-13T18:32:35.976836+0000","last_became_active":"2024-09-13T18:32:33.833989+0000","last_became_peered":"2024-09-13T18:32:33.833989+0000","last_unstale":"2024-09-13T18:32:35.976836+0000","last_undegraded":"2024-09-13T18:32:35.976836+0000","last_fullsized":"2024-09-13T18:32:35.976836+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.528466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826365+0000","last_change":"2024-09-13T18:32:33.421547+0000","last_active":"2024-09-13T18:32:33.826365+0000","last_peered":"2024-09-13T18:32:33.826365+0000","last_clean":"2024-09-13T18:32:33.826365+0000","last_became_active":"2024-09-13T18:32:33.420825+0000","last_became_peered":"2024-09-13T18:32:33.420825+0000","last_unstale":"2024-09-13T18:32:33.826365+0000","last_undegraded":"2024-09-13T18:32:33.826365+0000","last_fullsized":"2024-09-13T18:32:33.826365+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:45.039938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978009+0000","last_change":"2024-09-13T18:32:33.789271+0000","last_active":"2024-09-13T18:32:35.978009+0000","last_peered":"2024-09-13T18:32:35.978009+0000","last_clean":"2024-09-13T18:32:35.978009+0000","last_became_active":"2024-09-13T18:32:33.788779+0000","last_became_peered":"2024-09-13T18:32:33.788779+0000","last_unstale":"2024-09-13T18:32:35.978009+0000","last_undegraded":"2024-09-13T18:32:35.978009+0000","last_fullsized":"2024-09-13T18:32:35.978009+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:13.873493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.803704+0000","last_change":"2024-09-13T18:32:33.430829+0000","last_active":"2024-09-13T18:32:33.803704+0000","last_peered":"2024-09-13T18:32:33.803704+0000","last_clean":"2024-09-13T18:32:33.803704+0000","last_became_active":"2024-09-13T18:32:33.430182+0000","last_became_peered":"2024-09-13T18:32:33.430182+0000","last_unstale":"2024-09-13T18:32:33.803704+0000","last_undegraded":"2024-09-13T18:32:33.803704+0000","last_fullsized":"2024-09-13T18:32:33.803704+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.416581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978346+0000","last_change":"2024-09-13T18:32:33.814214+0000","last_active":"2024-09-13T18:32:35.978346+0000","last_peered":"2024-09-13T18:32:35.978346+0000","last_clean":"2024-09-13T18:32:35.978346+0000","last_became_active":"2024-09-13T18:32:33.813501+0000","last_became_peered":"2024-09-13T18:32:33.813501+0000","last_unstale":"2024-09-13T18:32:35.978346+0000","last_undegraded":"2024-09-13T18:32:35.978346+0000","last_fullsized":"2024-09-13T18:32:35.978346+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:50.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.779832+0000","last_change":"2024-09-13T18:32:33.403647+0000","last_active":"2024-09-13T18:32:33.779832+0000","last_peered":"2024-09-13T18:32:33.779832+0000","last_clean":"2024-09-13T18:32:33.779832+0000","last_became_active":"2024-09-13T18:32:33.403296+0000","last_became_peered":"2024-09-13T18:32:33.403296+0000","last_unstale":"2024-09-13T18:32:33.779832+0000","last_undegraded":"2024-09-13T18:32:33.779832+0000","last_fullsized":"2024-09-13T18:32:33.779832+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:03.997316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.976587+0000","last_change":"2024-09-13T18:32:33.823851+0000","last_active":"2024-09-13T18:32:35.976587+0000","last_peered":"2024-09-13T18:32:35.976587+0000","last_clean":"2024-09-13T18:32:35.976587+0000","last_became_active":"2024-09-13T18:32:33.823081+0000","last_became_peered":"2024-09-13T18:32:33.823081+0000","last_unstale":"2024-09-13T18:32:35.976587+0000","last_undegraded":"2024-09-13T18:32:35.976587+0000","last_fullsized":"2024-09-13T18:32:35.976587+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"135'8","reported_seq":19,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826039+0000","last_change":"2024-09-13T18:32:33.421915+0000","last_active":"2024-09-13T18:32:33.826039+0000","last_peered":"2024-09-13T18:32:33.826039+0000","last_clean":"2024-09-13T18:32:33.826039+0000","last_became_active":"2024-09-13T18:32:33.421614+0000","last_became_peered":"2024-09-13T18:32:33.421614+0000","last_unstale":"2024-09-13T18:32:33.826039+0000","last_undegraded":"2024-09-13T18:32:33.826039+0000","last_fullsized":"2024-09-13T18:32:33.826039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:45.743441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951243+0000","last_change":"2024-09-13T18:32:33.814705+0000","last_active":"2024-09-13T18:32:34.951243+0000","last_peered":"2024-09-13T18:32:34.951243+0000","last_clean":"2024-09-13T18:32:34.951243+0000","last_became_active":"2024-09-13T18:32:33.814015+0000","last_became_peered":"2024-09-13T18:32:33.814015+0000","last_unstale":"2024-09-13T18:32:34.951243+0000","last_undegraded":"2024-09-13T18:32:34.951243+0000","last_fullsized":"2024-09-13T18:32:34.951243+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:28.594313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.824281+0000","last_change":"2024-09-13T18:32:33.424045+0000","last_active":"2024-09-13T18:32:33.824281+0000","last_peered":"2024-09-13T18:32:33.824281+0000","last_clean":"2024-09-13T18:32:33.824281+0000","last_became_active":"2024-09-13T18:32:33.423417+0000","last_became_peered":"2024-09-13T18:32:33.423417+0000","last_unstale":"2024-09-13T18:32:33.824281+0000","last_undegraded":"2024-09-13T18:32:33.824281+0000","last_fullsized":"2024-09-13T18:32:33.824281+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:57.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979938+0000","last_change":"2024-09-13T18:32:33.809476+0000","last_active":"2024-09-13T18:32:35.979938+0000","last_peered":"2024-09-13T18:32:35.979938+0000","last_clean":"2024-09-13T18:32:35.979938+0000","last_became_active":"2024-09-13T18:32:33.808979+0000","last_became_peered":"2024-09-13T18:32:33.808979+0000","last_unstale":"2024-09-13T18:32:35.979938+0000","last_undegraded":"2024-09-13T18:32:35.979938+0000","last_fullsized":"2024-09-13T18:32:35.979938+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:48.321038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.823899+0000","last_change":"2024-09-13T18:32:33.423041+0000","last_active":"2024-09-13T18:32:33.823899+0000","last_peered":"2024-09-13T18:32:33.823899+0000","last_clean":"2024-09-13T18:32:33.823899+0000","last_became_active":"2024-09-13T18:32:33.422681+0000","last_became_peered":"2024-09-13T18:32:33.422681+0000","last_unstale":"2024-09-13T18:32:33.823899+0000","last_undegraded":"2024-09-13T18:32:33.823899+0000","last_fullsized":"2024-09-13T18:32:33.823899+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.455048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977318+0000","last_change":"2024-09-13T18:32:33.829637+0000","last_active":"2024-09-13T18:32:35.977318+0000","last_peered":"2024-09-13T18:32:35.977318+0000","last_clean":"2024-09-13T18:32:35.977318+0000","last_became_active":"2024-09-13T18:32:33.828758+0000","last_became_peered":"2024-09-13T18:32:33.828758+0000","last_unstale":"2024-09-13T18:32:35.977318+0000","last_undegraded":"2024-09-13T18:32:35.977318+0000","last_fullsized":"2024-09-13T18:32:35.977318+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:54.057976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815547+0000","last_change":"2024-09-13T18:32:33.428265+0000","last_active":"2024-09-13T18:32:33.815547+0000","last_peered":"2024-09-13T18:32:33.815547+0000","last_clean":"2024-09-13T18:32:33.815547+0000","last_became_active":"2024-09-13T18:32:33.427867+0000","last_became_peered":"2024-09-13T18:32:33.427867+0000","last_unstale":"2024-09-13T18:32:33.815547+0000","last_undegraded":"2024-09-13T18:32:33.815547+0000","last_fullsized":"2024-09-13T18:32:33.815547+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:19.514202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787017+0000","last_change":"2024-09-13T18:32:33.832331+0000","last_active":"2024-09-13T18:32:34.787017+0000","last_peered":"2024-09-13T18:32:34.787017+0000","last_clean":"2024-09-13T18:32:34.787017+0000","last_became_active":"2024-09-13T18:32:33.832076+0000","last_became_peered":"2024-09-13T18:32:33.832076+0000","last_unstale":"2024-09-13T18:32:34.787017+0000","last_undegraded":"2024-09-13T18:32:34.787017+0000","last_fullsized":"2024-09-13T18:32:34.787017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:36.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.783875+0000","last_change":"2024-09-13T18:32:33.407815+0000","last_active":"2024-09-13T18:32:33.783875+0000","last_peered":"2024-09-13T18:32:33.783875+0000","last_clean":"2024-09-13T18:32:33.783875+0000","last_became_active":"2024-09-13T18:32:33.407449+0000","last_became_peered":"2024-09-13T18:32:33.407449+0000","last_unstale":"2024-09-13T18:32:33.783875+0000","last_undegraded":"2024-09-13T18:32:33.783875+0000","last_fullsized":"2024-09-13T18:32:33.783875+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:06.225819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788919+0000","last_change":"2024-09-13T18:32:33.825789+0000","last_active":"2024-09-13T18:32:34.788919+0000","last_peered":"2024-09-13T18:32:34.788919+0000","last_clean":"2024-09-13T18:32:34.788919+0000","last_became_active":"2024-09-13T18:32:33.822350+0000","last_became_peered":"2024-09-13T18:32:33.822350+0000","last_unstale":"2024-09-13T18:32:34.788919+0000","last_undegraded":"2024-09-13T18:32:34.788919+0000","last_fullsized":"2024-09-13T18:32:34.788919+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:56.855304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826572+0000","last_change":"2024-09-13T18:32:33.422797+0000","last_active":"2024-09-13T18:32:33.826572+0000","last_peered":"2024-09-13T18:32:33.826572+0000","last_clean":"2024-09-13T18:32:33.826572+0000","last_became_active":"2024-09-13T18:32:33.422493+0000","last_became_peered":"2024-09-13T18:32:33.422493+0000","last_unstale":"2024-09-13T18:32:33.826572+0000","last_undegraded":"2024-09-13T18:32:33.826572+0000","last_fullsized":"2024-09-13T18:32:33.826572+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.903860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979066+0000","last_change":"2024-09-13T18:32:33.831089+0000","last_active":"2024-09-13T18:32:35.979066+0000","last_peered":"2024-09-13T18:32:35.979066+0000","last_clean":"2024-09-13T18:32:35.979066+0000","last_became_active":"2024-09-13T18:32:33.830776+0000","last_became_peered":"2024-09-13T18:32:33.830776+0000","last_unstale":"2024-09-13T18:32:35.979066+0000","last_undegraded":"2024-09-13T18:32:35.979066+0000","last_fullsized":"2024-09-13T18:32:35.979066+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.793870+0000","last_change":"2024-09-13T18:32:33.414874+0000","last_active":"2024-09-13T18:32:33.793870+0000","last_peered":"2024-09-13T18:32:33.793870+0000","last_clean":"2024-09-13T18:32:33.793870+0000","last_became_active":"2024-09-13T18:32:33.414166+0000","last_became_peered":"2024-09-13T18:32:33.414166+0000","last_unstale":"2024-09-13T18:32:33.793870+0000","last_undegraded":"2024-09-13T18:32:33.793870+0000","last_fullsized":"2024-09-13T18:32:33.793870+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:59.982897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787995+0000","last_change":"2024-09-13T18:32:33.819506+0000","last_active":"2024-09-13T18:32:34.787995+0000","last_peered":"2024-09-13T18:32:34.787995+0000","last_clean":"2024-09-13T18:32:34.787995+0000","last_became_active":"2024-09-13T18:32:33.818617+0000","last_became_peered":"2024-09-13T18:32:33.818617+0000","last_unstale":"2024-09-13T18:32:34.787995+0000","last_undegraded":"2024-09-13T18:32:34.787995+0000","last_fullsized":"2024-09-13T18:32:34.787995+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:33.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.793549+0000","last_change":"2024-09-13T18:32:33.419123+0000","last_active":"2024-09-13T18:32:33.793549+0000","last_peered":"2024-09-13T18:32:33.793549+0000","last_clean":"2024-09-13T18:32:33.793549+0000","last_became_active":"2024-09-13T18:32:33.418219+0000","last_became_peered":"2024-09-13T18:32:33.418219+0000","last_unstale":"2024-09-13T18:32:33.793549+0000","last_undegraded":"2024-09-13T18:32:33.793549+0000","last_fullsized":"2024-09-13T18:32:33.793549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:49.041040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978294+0000","last_change":"2024-09-13T18:32:33.818290+0000","last_active":"2024-09-13T18:32:35.978294+0000","last_peered":"2024-09-13T18:32:35.978294+0000","last_clean":"2024-09-13T18:32:35.978294+0000","last_became_active":"2024-09-13T18:32:33.818079+0000","last_became_peered":"2024-09-13T18:32:33.818079+0000","last_unstale":"2024-09-13T18:32:35.978294+0000","last_undegraded":"2024-09-13T18:32:35.978294+0000","last_fullsized":"2024-09-13T18:32:35.978294+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:16.162671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.799916+0000","last_change":"2024-09-13T18:32:33.421507+0000","last_active":"2024-09-13T18:32:33.799916+0000","last_peered":"2024-09-13T18:32:33.799916+0000","last_clean":"2024-09-13T18:32:33.799916+0000","last_became_active":"2024-09-13T18:32:33.420729+0000","last_became_peered":"2024-09-13T18:32:33.420729+0000","last_unstale":"2024-09-13T18:32:33.799916+0000","last_undegraded":"2024-09-13T18:32:33.799916+0000","last_fullsized":"2024-09-13T18:32:33.799916+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:19.163626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978637+0000","last_change":"2024-09-13T18:32:33.814762+0000","last_active":"2024-09-13T18:32:35.978637+0000","last_peered":"2024-09-13T18:32:35.978637+0000","last_clean":"2024-09-13T18:32:35.978637+0000","last_became_active":"2024-09-13T18:32:33.812509+0000","last_became_peered":"2024-09-13T18:32:33.812509+0000","last_unstale":"2024-09-13T18:32:35.978637+0000","last_undegraded":"2024-09-13T18:32:35.978637+0000","last_fullsized":"2024-09-13T18:32:35.978637+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:44.604924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.835391+0000","last_change":"2024-09-13T18:32:33.427335+0000","last_active":"2024-09-13T18:32:33.835391+0000","last_peered":"2024-09-13T18:32:33.835391+0000","last_clean":"2024-09-13T18:32:33.835391+0000","last_became_active":"2024-09-13T18:32:33.425972+0000","last_became_peered":"2024-09-13T18:32:33.425972+0000","last_unstale":"2024-09-13T18:32:33.835391+0000","last_undegraded":"2024-09-13T18:32:33.835391+0000","last_fullsized":"2024-09-13T18:32:33.835391+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.211604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977631+0000","last_change":"2024-09-13T18:32:33.838185+0000","last_active":"2024-09-13T18:32:35.977631+0000","last_peered":"2024-09-13T18:32:35.977631+0000","last_clean":"2024-09-13T18:32:35.977631+0000","last_became_active":"2024-09-13T18:32:33.837708+0000","last_became_peered":"2024-09-13T18:32:33.837708+0000","last_unstale":"2024-09-13T18:32:35.977631+0000","last_undegraded":"2024-09-13T18:32:35.977631+0000","last_fullsized":"2024-09-13T18:32:35.977631+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:45.905869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.784327+0000","last_change":"2024-09-13T18:32:33.425880+0000","last_active":"2024-09-13T18:32:33.784327+0000","last_peered":"2024-09-13T18:32:33.784327+0000","last_clean":"2024-09-13T18:32:33.784327+0000","last_became_active":"2024-09-13T18:32:33.425653+0000","last_became_peered":"2024-09-13T18:32:33.425653+0000","last_unstale":"2024-09-13T18:32:33.784327+0000","last_undegraded":"2024-09-13T18:32:33.784327+0000","last_fullsized":"2024-09-13T18:32:33.784327+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:06.402429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977997+0000","last_change":"2024-09-13T18:32:33.819050+0000","last_active":"2024-09-13T18:32:35.977997+0000","last_peered":"2024-09-13T18:32:35.977997+0000","last_clean":"2024-09-13T18:32:35.977997+0000","last_became_active":"2024-09-13T18:32:33.818753+0000","last_became_peered":"2024-09-13T18:32:33.818753+0000","last_unstale":"2024-09-13T18:32:35.977997+0000","last_undegraded":"2024-09-13T18:32:35.977997+0000","last_fullsized":"2024-09-13T18:32:35.977997+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:54.557300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.785597+0000","last_change":"2024-09-13T18:32:33.405477+0000","last_active":"2024-09-13T18:32:33.785597+0000","last_peered":"2024-09-13T18:32:33.785597+0000","last_clean":"2024-09-13T18:32:33.785597+0000","last_became_active":"2024-09-13T18:32:33.405040+0000","last_became_peered":"2024-09-13T18:32:33.405040+0000","last_unstale":"2024-09-13T18:32:33.785597+0000","last_undegraded":"2024-09-13T18:32:33.785597+0000","last_fullsized":"2024-09-13T18:32:33.785597+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:40.969205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787017+0000","last_change":"2024-09-13T18:32:33.818707+0000","last_active":"2024-09-13T18:32:34.787017+0000","last_peered":"2024-09-13T18:32:34.787017+0000","last_clean":"2024-09-13T18:32:34.787017+0000","last_became_active":"2024-09-13T18:32:33.818396+0000","last_became_peered":"2024-09-13T18:32:33.818396+0000","last_unstale":"2024-09-13T18:32:34.787017+0000","last_undegraded":"2024-09-13T18:32:34.787017+0000","last_fullsized":"2024-09-13T18:32:34.787017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:47.237441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.785062+0000","last_change":"2024-09-13T18:32:33.405578+0000","last_active":"2024-09-13T18:32:33.785062+0000","last_peered":"2024-09-13T18:32:33.785062+0000","last_clean":"2024-09-13T18:32:33.785062+0000","last_became_active":"2024-09-13T18:32:33.405064+0000","last_became_peered":"2024-09-13T18:32:33.405064+0000","last_unstale":"2024-09-13T18:32:33.785062+0000","last_undegraded":"2024-09-13T18:32:33.785062+0000","last_fullsized":"2024-09-13T18:32:33.785062+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:15.279314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978537+0000","last_change":"2024-09-13T18:32:33.831054+0000","last_active":"2024-09-13T18:32:35.978537+0000","last_peered":"2024-09-13T18:32:35.978537+0000","last_clean":"2024-09-13T18:32:35.978537+0000","last_became_active":"2024-09-13T18:32:33.830434+0000","last_became_peered":"2024-09-13T18:32:33.830434+0000","last_unstale":"2024-09-13T18:32:35.978537+0000","last_undegraded":"2024-09-13T18:32:35.978537+0000","last_fullsized":"2024-09-13T18:32:35.978537+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:18.145689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.780589+0000","last_change":"2024-09-13T18:32:33.413972+0000","last_active":"2024-09-13T18:32:33.780589+0000","last_peered":"2024-09-13T18:32:33.780589+0000","last_clean":"2024-09-13T18:32:33.780589+0000","last_became_active":"2024-09-13T18:32:33.413631+0000","last_became_peered":"2024-09-13T18:32:33.413631+0000","last_unstale":"2024-09-13T18:32:33.780589+0000","last_undegraded":"2024-09-13T18:32:33.780589+0000","last_fullsized":"2024-09-13T18:32:33.780589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:27.578442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978673+0000","last_change":"2024-09-13T18:32:33.832539+0000","last_active":"2024-09-13T18:32:35.978673+0000","last_peered":"2024-09-13T18:32:35.978673+0000","last_clean":"2024-09-13T18:32:35.978673+0000","last_became_active":"2024-09-13T18:32:33.831858+0000","last_became_peered":"2024-09-13T18:32:33.831858+0000","last_unstale":"2024-09-13T18:32:35.978673+0000","last_undegraded":"2024-09-13T18:32:35.978673+0000","last_fullsized":"2024-09-13T18:32:35.978673+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:56.705450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.794127+0000","last_change":"2024-09-13T18:32:33.424181+0000","last_active":"2024-09-13T18:32:33.794127+0000","last_peered":"2024-09-13T18:32:33.794127+0000","last_clean":"2024-09-13T18:32:33.794127+0000","last_became_active":"2024-09-13T18:32:33.423421+0000","last_became_peered":"2024-09-13T18:32:33.423421+0000","last_unstale":"2024-09-13T18:32:33.794127+0000","last_undegraded":"2024-09-13T18:32:33.794127+0000","last_fullsized":"2024-09-13T18:32:33.794127+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950412+0000","last_change":"2024-09-13T18:32:33.804551+0000","last_active":"2024-09-13T18:32:34.950412+0000","last_peered":"2024-09-13T18:32:34.950412+0000","last_clean":"2024-09-13T18:32:34.950412+0000","last_became_active":"2024-09-13T18:32:33.803899+0000","last_became_peered":"2024-09-13T18:32:33.803899+0000","last_unstale":"2024-09-13T18:32:34.950412+0000","last_undegraded":"2024-09-13T18:32:34.950412+0000","last_fullsized":"2024-09-13T18:32:34.950412+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:34.559447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.789586+0000","last_change":"2024-09-13T18:32:33.422034+0000","last_active":"2024-09-13T18:32:33.789586+0000","last_peered":"2024-09-13T18:32:33.789586+0000","last_clean":"2024-09-13T18:32:33.789586+0000","last_became_active":"2024-09-13T18:32:33.421457+0000","last_became_peered":"2024-09-13T18:32:33.421457+0000","last_unstale":"2024-09-13T18:32:33.789586+0000","last_undegraded":"2024-09-13T18:32:33.789586+0000","last_fullsized":"2024-09-13T18:32:33.789586+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.063539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978270+0000","last_change":"2024-09-13T18:32:33.785222+0000","last_active":"2024-09-13T18:32:35.978270+0000","last_peered":"2024-09-13T18:32:35.978270+0000","last_clean":"2024-09-13T18:32:35.978270+0000","last_became_active":"2024-09-13T18:32:33.784722+0000","last_became_peered":"2024-09-13T18:32:33.784722+0000","last_unstale":"2024-09-13T18:32:35.978270+0000","last_undegraded":"2024-09-13T18:32:35.978270+0000","last_fullsized":"2024-09-13T18:32:35.978270+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:36.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.781679+0000","last_change":"2024-09-13T18:32:33.418240+0000","last_active":"2024-09-13T18:32:33.781679+0000","last_peered":"2024-09-13T18:32:33.781679+0000","last_clean":"2024-09-13T18:32:33.781679+0000","last_became_active":"2024-09-13T18:32:33.417865+0000","last_became_peered":"2024-09-13T18:32:33.417865+0000","last_unstale":"2024-09-13T18:32:33.781679+0000","last_undegraded":"2024-09-13T18:32:33.781679+0000","last_fullsized":"2024-09-13T18:32:33.781679+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979552+0000","last_change":"2024-09-13T18:32:33.819666+0000","last_active":"2024-09-13T18:32:35.979552+0000","last_peered":"2024-09-13T18:32:35.979552+0000","last_clean":"2024-09-13T18:32:35.979552+0000","last_became_active":"2024-09-13T18:32:33.819396+0000","last_became_peered":"2024-09-13T18:32:33.819396+0000","last_unstale":"2024-09-13T18:32:35.979552+0000","last_undegraded":"2024-09-13T18:32:35.979552+0000","last_fullsized":"2024-09-13T18:32:35.979552+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:45.423965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"135'3","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.827088+0000","last_change":"2024-09-13T18:32:33.423551+0000","last_active":"2024-09-13T18:32:33.827088+0000","last_peered":"2024-09-13T18:32:33.827088+0000","last_clean":"2024-09-13T18:32:33.827088+0000","last_became_active":"2024-09-13T18:32:33.421681+0000","last_became_peered":"2024-09-13T18:32:33.421681+0000","last_unstale":"2024-09-13T18:32:33.827088+0000","last_undegraded":"2024-09-13T18:32:33.827088+0000","last_fullsized":"2024-09-13T18:32:33.827088+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:39.532247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":298,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.794410+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:32:33.794410+0000","last_peered":"2024-09-13T18:32:33.794410+0000","last_clean":"2024-09-13T18:32:33.794410+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:32:33.794410+0000","last_undegraded":"2024-09-13T18:32:33.794410+0000","last_fullsized":"2024-09-13T18:32:33.794410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33376,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338464,"statfs":{"total":96636764160,"available":96602587136,"internally_reserved":0,"allocated":2306048,"data_stored":1344845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90500000000000003,"15min":0.88300000000000001},"min":{"1min":0.52100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2330000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.624},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":0.90000000000000002},"min":{"1min":0.51100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.143,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.95199999999999996,"15min":0.93000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.129,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.73899999999999999,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.57499999999999996,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.1040000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88100000000000001,"15min":0.879},"min":{"1min":0.61799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2070000000000001,"5min":1.349,"15min":1.448},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.94599999999999995,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.84599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1930000000000001,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":1.016},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.66700000000000004,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96299999999999997,"15min":1.0249999999999999},"min":{"1min":0.74399999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1919999999999999,"5min":1.5609999999999999,"15min":1.877},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.98699999999999999,"15min":0.97899999999999998},"min":{"1min":0.63900000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.409,"15min":1.409},"last":1.1319999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0489999999999999,"15min":1.0589999999999999},"min":{"1min":0.74199999999999999,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.4490000000000001,"5min":1.476,"15min":1.476},"last":1.079},{"interface":"front","average":{"1min":1.038,"5min":1.0349999999999999,"15min":1.004},"min":{"1min":0.77600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.361,"5min":1.506,"15min":1.506},"last":1.044}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1716224,"data_stored":753971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.312},"max":{"1min":1.2230000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81000000000000005,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.48799999999999999,"15min":0.46600000000000003},"max":{"1min":1.117,"5min":1.252,"15min":1.3879999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.92600000000000005,"15min":0.89600000000000002},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.34899999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.577},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.91300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.218,"15min":1.464},"last":0.872}]},{"osd":2,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.84299999999999997,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92100000000000004,"15min":0.96299999999999997},"min":{"1min":0.69799999999999995,"5min":0.59599999999999997,"15min":0.47499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":2.4220000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91700000000000004,"15min":0.88600000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.65900000000000003,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.306},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":0.97299999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.042,"15min":1.0089999999999999},"min":{"1min":0.69399999999999995,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.624,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2310000000000001,"5min":1.2390000000000001,"15min":1.4330000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.03,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":2.762},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.028,"15min":1.0409999999999999},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.9299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.111,"5min":1.0249999999999999,"15min":1.044},"min":{"1min":0.84299999999999997,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.72},"last":1.113}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1708032,"data_stored":753847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1850000000000001,"5min":1.2390000000000001,"15min":2.0209999999999999},"last":0.876},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.437},"max":{"1min":1.264,"5min":1.264,"15min":2.1840000000000002},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.88300000000000001,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86399999999999999,"15min":0.83399999999999996},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.5029999999999999},"last":1.048}]},{"osd":2,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.292,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.625},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90800000000000003,"15min":0.95999999999999996},"min":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":2.2589999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.96599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4650000000000001,"5min":1.6719999999999999,"15min":1.871},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.93899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.071,"5min":0.998,"15min":1.0409999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.5049999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.98799999999999999,"15min":1.0229999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.95299999999999996,"15min":1.0169999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":1.488,"15min":2.246},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.05,"15min":1.1220000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.9379999999999999},"last":1.0720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1703936,"data_stored":753825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95099999999999996,"15min":0.84399999999999997},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3490000000000002,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.94399999999999995,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.41699999999999998},"max":{"1min":2.4060000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.56000000000000005,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.2589999999999999,"5min":1.536,"15min":1.536},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61799999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.8069999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.337}]},{"osd":2,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89300000000000002,"15min":0.875},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.139,"5min":1.216,"15min":1.216},"last":1.109},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.89800000000000002},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.367}]},{"osd":3,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.026,"15min":0.95899999999999996},"min":{"1min":0.76300000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":1.4159999999999999,"5min":10.44,"15min":10.44},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.65200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.044,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.67100000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.04}]},{"osd":6,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.117,"15min":1.0349999999999999},"min":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.52000000000000002},"max":{"1min":1.4890000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.3},{"interface":"front","average":{"1min":1.085,"5min":1.2070000000000001,"15min":1.0880000000000001},"min":{"1min":0.76000000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":1.8979999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":0.92300000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.095},"min":{"1min":0.69099999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2269999999999999,"5min":15.593,"15min":15.593},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.0569999999999999,"15min":1.0780000000000001},"min":{"1min":0.77800000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.0089999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1708032,"data_stored":753915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.88200000000000001,"5min":2.113,"15min":2.113},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77600000000000002,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.115,"5min":1.4199999999999999,"15min":1.704},"last":0.745},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.079,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.376,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.742,"15min":1.742},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79100000000000004,"15min":0.748},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.0629999999999999,"5min":1.224,"15min":1.399},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.69999999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2190000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.536,"5min":1.536,"15min":2.8740000000000001},"last":1.304}]},{"osd":5,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98599999999999999,"15min":1.016},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.294,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2589999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.0549999999999999},"min":{"1min":0.71299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.665,"5min":1.665,"15min":2.6190000000000002},"last":1.419},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.0509999999999999},"min":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53400000000000003},"max":{"1min":1.502,"5min":1.6890000000000001,"15min":1.96},"last":1.167}]},{"osd":7,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.036,"15min":1.0880000000000001},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4470000000000001,"5min":1.665,"15min":3},"last":1.5029999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.032,"15min":1.006},"min":{"1min":0.66900000000000004,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.3460000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1720320,"data_stored":755459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.83399999999999996,"5min":0.97999999999999998,"15min":1.0309999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67500000000000004,"15min":0.65300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.93500000000000005,"5min":1.1200000000000001,"15min":1.335},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94999999999999996,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":1.0309999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.141,"5min":1.405,"15min":1.405},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.91700000000000004,"15min":0.91200000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.212,"5min":1.367,"15min":1.611},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.91600000000000004},"min":{"1min":0.68600000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2210000000000001,"5min":1.587,"15min":1.587},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.60399999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.9179999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.98099999999999998,"15min":0.97299999999999998},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2450000000000001,"5min":1.552,"15min":1.702},"last":0.877}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.472,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.66800000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.522,"5min":1.645,"15min":1.645},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.623,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.843,"15min":1.843},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4330000000000001,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1708032,"data_stored":754407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.61399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":1.0680000000000001,"15min":1.177},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.29699999999999999,"15min":0.28199999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.36299999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":1.423,"15min":1.423},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.90700000000000003},"min":{"1min":0.628,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93600000000000005,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.42899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.02}]},{"osd":5,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92800000000000005,"15min":0.92100000000000004},"min":{"1min":0.64200000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3460000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.69499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4059999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.018,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.27,"5min":1.5900000000000001,"15min":1.653},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.425,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.091,"15min":1.0529999999999999},"min":{"1min":0.74299999999999999,"5min":0.61899999999999999,"15min":0.52500000000000002},"max":{"1min":1.4790000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.196,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.038}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41568,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330272,"statfs":{"total":96636764160,"available":96594198528,"internally_reserved":0,"allocated":2314240,"data_stored":1345791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0169999999999999,"15min":1.147},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.03,"5min":1.244,"15min":1.4359999999999999},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1299999999999999,"5min":1.333,"15min":1.333},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.05,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.432}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.99199999999999999,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.93200000000000005},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.075,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96499999999999997,"15min":0.98699999999999999},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3089999999999999,"5min":1.5069999999999999,"15min":1.986},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97899999999999998,"15min":1.002},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.492,"5min":1.8799999999999999,"15min":2.641},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.032},"min":{"1min":0.61599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.304,"5min":1.3580000000000001,"15min":1.6699999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0349999999999999,"15min":1.0649999999999999},"min":{"1min":0.64600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.321,"5min":1.466,"15min":1.891},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.036,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.72999999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.752}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.006,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":2.2949999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.75600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:32:38.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:32:38.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.349+0000 7fecfcacc640 1 Processor -- start 2024-09-13T18:32:38.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.349+0000 7fecfcacc640 1 -- start start 2024-09-13T18:32:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecfcacc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 0x7fecf80afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecfcacc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf80ad530 con 0x7fecf80ae5d0 2024-09-13T18:32:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecfcacc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf80ad810 con 0x7fecf80b1960 2024-09-13T18:32:38.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecfcacc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80ae1b0 con 0x7fecf815db40 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fecf80ae5d0 0x7fecf80aea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58240/0 (socket says 172.21.15.53:58240) 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 -- 172.21.15.53:0/3409726274 learned_addr learned my addr 172.21.15.53:0/3409726274 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf659c640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 0x7fecf80afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378455754 0 0) 0x7fecf80ad530 con 0x7fecf80ae5d0 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece0003530 con 0x7fecf80ae5d0 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2701362855 0 0) 0x7fece0003530 con 0x7fecf80ae5d0 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 msgr2=0x7fecf80afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 0x7fecf80afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 >> v1:172.21.15.87:6789/0 conn(0x7fecf80b1960 legacy=0x7fecf80b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf80adaf0 con 0x7fecf80ae5d0 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fecf0001a00 con 0x7fecf80ae5d0 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 >> v1:172.21.15.53:6789/0 conn(0x7fecf80ae5d0 legacy=0x7fecf80aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 0x7fece00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0003f30 0x7fece00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece0004d10 0x7fece0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80ae1b0 con 0x7fece0004d10 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece000bb20 con 0x7fece0003f30 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece000bce0 con 0x7fecf815db40 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece0004d10 0x7fece0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf5d9b640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0003f30 0x7fece00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf659c640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 0x7fece00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 -- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 msgr2=0x7fece00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf815db40 0x7fece00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 -- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0003f30 msgr2=0x7fece00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece0003f30 0x7fece00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.353+0000 7fecf6d9d640 1 -- 172.21.15.53:0/3409726274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0003530 con 0x7fece0004d10 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf6d9d640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece0004d10 0x7fece0005190 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fecf000a830 tx=0x7fecf001fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d306e7bd88985e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00aa6f0 con 0x7fece0004d10 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00aa870 con 0x7fece0004d10 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf559a640 1 -- 172.21.15.53:0/3409726274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00aac20 con 0x7fece0004d10 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- 172.21.15.53:0/3409726274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece0004d10 msgr2=0x7fece0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 --2- 172.21.15.53:0/3409726274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece0004d10 0x7fece0005190 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fecf000a830 tx=0x7fecf001fac0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf6d9d640 1 -- 172.21.15.53:0/3409726274 reap_dead start 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- 172.21.15.53:0/3409726274 shutdown_connections 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- 172.21.15.53:0/3409726274 >> 172.21.15.53:0/3409726274 conn(0x7fecf80b20d0 msgr2=0x7fecf80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- 172.21.15.53:0/3409726274 shutdown_connections 2024-09-13T18:32:38.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- 172.21.15.53:0/3409726274 wait complete. 2024-09-13T18:32:38.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 Processor -- start 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- start start 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf80c9390 0x7fecf81476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf8156810 0x7fecf80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf80c9cb0 0x7fecf80c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80c75b0 con 0x7fecf80c9390 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80b3830 con 0x7fecf8156810 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecfcacc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80b3b10 con 0x7fecf80c9cb0 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf80c9390 0x7fecf81476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf80c9390 0x7fecf81476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42058/0 (socket says 172.21.15.53:42058) 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 -- 172.21.15.53:0/3378856988 learned_addr learned my addr 172.21.15.53:0/3378856988 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf5d9b640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf8156810 0x7fecf80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf6d9d640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf80c9cb0 0x7fecf80c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 -- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf80c9cb0 msgr2=0x7fecf80c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf80c9cb0 0x7fecf80c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 -- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf8156810 msgr2=0x7fecf80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf8156810 0x7fecf80c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 -- 172.21.15.53:0/3378856988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf80c7800 con 0x7fecf80c9390 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.357+0000 7fecf659c640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf80c9390 0x7fecf81476e0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fece80115e0 tx=0x7fece8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fece6ffd640 1 -- 172.21.15.53:0/3378856988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece800f8f0 con 0x7fecf80c9390 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fece6ffd640 1 -- 172.21.15.53:0/3378856988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece800fa50 con 0x7fecf80c9390 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fece6ffd640 1 -- 172.21.15.53:0/3378856988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece800fdc0 con 0x7fecf80c9390 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf80c7ae0 con 0x7fecf80c9390 2024-09-13T18:32:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf80c6190 con 0x7fecf80c9390 2024-09-13T18:32:38.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf80c7c70 con 0x7fecf80c9390 2024-09-13T18:32:38.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fece6ffd640 1 -- 172.21.15.53:0/3378856988 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fece8015460 con 0x7fecf80c9390 2024-09-13T18:32:38.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fece6ffd640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fecd8066c60 0x7fecd8069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fece6ffd640 1 -- 172.21.15.53:0/3378856988 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fece8084ef0 con 0x7fecf80c9390 2024-09-13T18:32:38.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fecf5d9b640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fecd8066c60 0x7fecd8069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.361+0000 7fecf5d9b640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fecd8066c60 0x7fecd8069120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fecf806e540 tx=0x7fecec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:38.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.365+0000 7fece6ffd640 1 -- 172.21.15.53:0/3378856988 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fece8051af0 con 0x7fecf80c9390 2024-09-13T18:32:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.585+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fecf80cf2d0 con 0x7fecf80c9390 2024-09-13T18:32:38.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.585+0000 7fece6ffd640 1 -- 172.21.15.53:0/3378856988 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1435 (secure 0 0 0) 0x7fece8055110 con 0x7fecf80c9390 2024-09-13T18:32:38.588 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:38.588 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":484,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726251884,"num_in_osds":8,"osd_in_since":1726251876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":290791424,"bytes_avail":772803321856,"bytes_total":773094113280,"write_bytes_sec":2610,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":79,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":8955}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-13T18:32:21.862267+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:32:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fecd8066c60 msgr2=0x7fecd8069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fecd8066c60 0x7fecd8069120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fecf806e540 tx=0x7fecec009040 comp rx=0 tx=0).stop 2024-09-13T18:32:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf80c9390 msgr2=0x7fecf81476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf80c9390 0x7fecf81476e0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fece80115e0 tx=0x7fece8011aa0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 shutdown_connections 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fecd8066c60 0x7fecd8069120 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf80c9cb0 0x7fecf80c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf8156810 0x7fecf80c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 --2- 172.21.15.53:0/3378856988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf80c9390 0x7fecf81476e0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 >> 172.21.15.53:0/3378856988 conn(0x7fecf80b20d0 msgr2=0x7fecf80ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 shutdown_connections 2024-09-13T18:32:38.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.589+0000 7fecfcacc640 1 -- 172.21.15.53:0/3378856988 wait complete. 2024-09-13T18:32:38.607 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:32:38.608 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:32:38.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb029a0c640 1 Processor -- start 2024-09-13T18:32:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb029a0c640 1 -- start start 2024-09-13T18:32:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb029a0c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb02415c880 0x7fb0240d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb029a0c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02415d0c0 con 0x7fb0240d10f0 2024-09-13T18:32:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb029a0c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02406b650 con 0x7fb0240b4900 2024-09-13T18:32:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb029a0c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0240b4dc0 con 0x7fb02415c880 2024-09-13T18:32:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb0237fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0240d10f0 0x7fb02415d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58252/0 (socket says 172.21.15.53:58252) 2024-09-13T18:32:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb0237fe640 1 -- 172.21.15.53:0/157755814 learned_addr learned my addr 172.21.15.53:0/157755814 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb022ffd640 1 --2- 172.21.15.53:0/157755814 >> v2:172.21.15.87:3300/0 conn(0x7fb02415c880 0x7fb0240d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698789057 0 0) 0x7fb02415d0c0 con 0x7fb0240d10f0 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb010003530 con 0x7fb0240d10f0 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649615729 0 0) 0x7fb010003530 con 0x7fb0240d10f0 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 >> v2:172.21.15.87:3300/0 conn(0x7fb02415c880 msgr2=0x7fb0240d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 --2- 172.21.15.53:0/157755814 >> v2:172.21.15.87:3300/0 conn(0x7fb02415c880 0x7fb0240d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 >> v1:172.21.15.87:6789/0 conn(0x7fb0240b4900 legacy=0x7fb0240d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240b50a0 con 0x7fb0240d10f0 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb01c001680 con 0x7fb0240d10f0 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 >> v1:172.21.15.53:6789/0 conn(0x7fb0240d10f0 legacy=0x7fb02415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb010003980 0x7fb010003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb010004380 0x7fb010004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010005050 0x7fb01000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240b4dc0 con 0x7fb010004380 2024-09-13T18:32:38.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01000bfb0 con 0x7fb010003980 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01000c170 con 0x7fb010005050 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb0227fc640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb010004380 0x7fb010004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb022ffd640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb010003980 0x7fb010003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.725+0000 7fb0237fe640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010005050 0x7fb01000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb0227fc640 1 -- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010005050 msgr2=0x7fb01000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb0227fc640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010005050 0x7fb01000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb0227fc640 1 -- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb010003980 msgr2=0x7fb010003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb0227fc640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb010003980 0x7fb010003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb0237fe640 1 -- 172.21.15.53:0/157755814 reap_dead start 2024-09-13T18:32:38.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb0227fc640 1 -- 172.21.15.53:0/157755814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010003530 con 0x7fb010004380 2024-09-13T18:32:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb0227fc640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb010004380 0x7fb010004850 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fb00c001860 tx=0x7fb00c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eab17b18aa8de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0ab600 con 0x7fb010004380 2024-09-13T18:32:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c0a7050 con 0x7fb010004380 2024-09-13T18:32:38.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb021ffb640 1 -- 172.21.15.53:0/157755814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0ab9e0 con 0x7fb010004380 2024-09-13T18:32:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb029a0c640 1 -- 172.21.15.53:0/157755814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb010004380 msgr2=0x7fb010004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb029a0c640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb010004380 0x7fb010004850 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fb00c001860 tx=0x7fb00c01c4b0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb029a0c640 1 -- 172.21.15.53:0/157755814 shutdown_connections 2024-09-13T18:32:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb029a0c640 1 --2- 172.21.15.53:0/157755814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb010004380 0x7fb010004850 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb029a0c640 1 -- 172.21.15.53:0/157755814 >> 172.21.15.53:0/157755814 conn(0x7fb0240b5920 msgr2=0x7fb0240b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:38.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb029a0c640 1 -- 172.21.15.53:0/157755814 shutdown_connections 2024-09-13T18:32:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.729+0000 7fb029a0c640 1 -- 172.21.15.53:0/157755814 wait complete. 2024-09-13T18:32:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 Processor -- start 2024-09-13T18:32:38.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 -- start start 2024-09-13T18:32:38.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010004380 0x7fb024160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0240cd210 0x7fb02414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02415a520 0x7fb02415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240cdef0 con 0x7fb02415a520 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02415aee0 con 0x7fb0240cd210 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240cfb70 con 0x7fb010004380 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02415a520 0x7fb02415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02415a520 0x7fb02415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42082/0 (socket says 172.21.15.53:42082) 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 -- 172.21.15.53:0/2382754470 learned_addr learned my addr 172.21.15.53:0/2382754470 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb022ffd640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010004380 0x7fb024160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0227fc640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0240cd210 0x7fb02414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 -- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010004380 msgr2=0x7fb024160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010004380 0x7fb024160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 -- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0240cd210 msgr2=0x7fb02414aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0240cd210 0x7fb02414aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 -- 172.21.15.53:0/2382754470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb024160570 con 0x7fb02415a520 2024-09-13T18:32:38.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb0237fe640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02415a520 0x7fb02415a9a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fb02406bd00 tx=0x7fb01c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:38.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb01bfff640 1 -- 172.21.15.53:0/2382754470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00eed0 con 0x7fb02415a520 2024-09-13T18:32:38.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb01bfff640 1 -- 172.21.15.53:0/2382754470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00c690 con 0x7fb02415a520 2024-09-13T18:32:38.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0240cdba0 con 0x7fb02415a520 2024-09-13T18:32:38.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb01bfff640 1 -- 172.21.15.53:0/2382754470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00ca20 con 0x7fb02415a520 2024-09-13T18:32:38.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0240d0080 con 0x7fb02415a520 2024-09-13T18:32:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.733+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0240ce030 con 0x7fb02415a520 2024-09-13T18:32:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.737+0000 7fb01bfff640 1 -- 172.21.15.53:0/2382754470 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fb01c00cb80 con 0x7fb02415a520 2024-09-13T18:32:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.737+0000 7fb01bfff640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb004066c30 0x7fb0040690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.737+0000 7fb01bfff640 1 -- 172.21.15.53:0/2382754470 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01c0845d0 con 0x7fb02415a520 2024-09-13T18:32:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.737+0000 7fb022ffd640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb004066c30 0x7fb0040690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:38.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.737+0000 7fb022ffd640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb004066c30 0x7fb0040690f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb024067c60 tx=0x7fb01400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:38.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.741+0000 7fb01bfff640 1 -- 172.21.15.53:0/2382754470 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0240ce030 con 0x7fb02415a520 2024-09-13T18:32:38.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.897+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0240d0cb0 con 0x7fb004066c30 2024-09-13T18:32:38.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.909+0000 7fb01bfff640 1 -- 172.21.15.53:0/2382754470 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288721 (secure 0 0 0) 0x7fb01400f040 con 0x7fb004066c30 2024-09-13T18:32:38.914 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:38.916 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:32:38.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb004066c30 msgr2=0x7fb0040690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb004066c30 0x7fb0040690f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb024067c60 tx=0x7fb01400b040 comp rx=0 tx=0).stop 2024-09-13T18:32:38.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02415a520 msgr2=0x7fb02415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:38.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02415a520 0x7fb02415a9a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fb02406bd00 tx=0x7fb01c00eb90 comp rx=0 tx=0).stop 2024-09-13T18:32:38.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 shutdown_connections 2024-09-13T18:32:38.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb004066c30 0x7fb0040690f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02415a520 0x7fb02415a9a0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb0240cd210 0x7fb02414aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 --2- 172.21.15.53:0/2382754470 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb010004380 0x7fb024160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:38.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 >> 172.21.15.53:0/2382754470 conn(0x7fb0240b5920 msgr2=0x7fb024158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:38.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 shutdown_connections 2024-09-13T18:32:38.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:38.913+0000 7fb029a0c640 1 -- 172.21.15.53:0/2382754470 wait complete. 2024-09-13T18:32:38.934 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-13T18:32:37.865788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283976,"kb_used_data":14536,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754690744,"statfs":{"total":773094113280,"available":772803321856,"internally_reserved":0,"allocated":14884864,"data_stored":7216060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.492115"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787606+0000","last_change":"2024-09-13T18:32:33.811702+0000","last_active":"2024-09-13T18:32:34.787606+0000","last_peered":"2024-09-13T18:32:34.787606+0000","last_clean":"2024-09-13T18:32:34.787606+0000","last_became_active":"2024-09-13T18:32:33.811431+0000","last_became_peered":"2024-09-13T18:32:33.811431+0000","last_unstale":"2024-09-13T18:32:34.787606+0000","last_undegraded":"2024-09-13T18:32:34.787606+0000","last_fullsized":"2024-09-13T18:32:34.787606+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:54.841297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977990+0000","last_change":"2024-09-13T18:32:33.789940+0000","last_active":"2024-09-13T18:32:35.977990+0000","last_peered":"2024-09-13T18:32:35.977990+0000","last_clean":"2024-09-13T18:32:35.977990+0000","last_became_active":"2024-09-13T18:32:33.789710+0000","last_became_peered":"2024-09-13T18:32:33.789710+0000","last_unstale":"2024-09-13T18:32:35.977990+0000","last_undegraded":"2024-09-13T18:32:35.977990+0000","last_fullsized":"2024-09-13T18:32:35.977990+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:58.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977747+0000","last_change":"2024-09-13T18:32:33.828419+0000","last_active":"2024-09-13T18:32:35.977747+0000","last_peered":"2024-09-13T18:32:35.977747+0000","last_clean":"2024-09-13T18:32:35.977747+0000","last_became_active":"2024-09-13T18:32:33.827494+0000","last_became_peered":"2024-09-13T18:32:33.827494+0000","last_unstale":"2024-09-13T18:32:35.977747+0000","last_undegraded":"2024-09-13T18:32:35.977747+0000","last_fullsized":"2024-09-13T18:32:35.977747+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:18.651202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.789070+0000","last_change":"2024-09-13T18:32:33.834165+0000","last_active":"2024-09-13T18:32:34.789070+0000","last_peered":"2024-09-13T18:32:34.789070+0000","last_clean":"2024-09-13T18:32:34.789070+0000","last_became_active":"2024-09-13T18:32:33.833102+0000","last_became_peered":"2024-09-13T18:32:33.833102+0000","last_unstale":"2024-09-13T18:32:34.789070+0000","last_undegraded":"2024-09-13T18:32:34.789070+0000","last_fullsized":"2024-09-13T18:32:34.789070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:04.488154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978048+0000","last_change":"2024-09-13T18:32:33.819392+0000","last_active":"2024-09-13T18:32:35.978048+0000","last_peered":"2024-09-13T18:32:35.978048+0000","last_clean":"2024-09-13T18:32:35.978048+0000","last_became_active":"2024-09-13T18:32:33.818308+0000","last_became_peered":"2024-09-13T18:32:33.818308+0000","last_unstale":"2024-09-13T18:32:35.978048+0000","last_undegraded":"2024-09-13T18:32:35.978048+0000","last_fullsized":"2024-09-13T18:32:35.978048+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:27.274268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786969+0000","last_change":"2024-09-13T18:32:33.827300+0000","last_active":"2024-09-13T18:32:34.786969+0000","last_peered":"2024-09-13T18:32:34.786969+0000","last_clean":"2024-09-13T18:32:34.786969+0000","last_became_active":"2024-09-13T18:32:33.827033+0000","last_became_peered":"2024-09-13T18:32:33.827033+0000","last_unstale":"2024-09-13T18:32:34.786969+0000","last_undegraded":"2024-09-13T18:32:34.786969+0000","last_fullsized":"2024-09-13T18:32:34.786969+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:46.055809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978046+0000","last_change":"2024-09-13T18:32:33.818453+0000","last_active":"2024-09-13T18:32:35.978046+0000","last_peered":"2024-09-13T18:32:35.978046+0000","last_clean":"2024-09-13T18:32:35.978046+0000","last_became_active":"2024-09-13T18:32:33.818186+0000","last_became_peered":"2024-09-13T18:32:33.818186+0000","last_unstale":"2024-09-13T18:32:35.978046+0000","last_undegraded":"2024-09-13T18:32:35.978046+0000","last_fullsized":"2024-09-13T18:32:35.978046+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:21.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786405+0000","last_change":"2024-09-13T18:32:33.784740+0000","last_active":"2024-09-13T18:32:34.786405+0000","last_peered":"2024-09-13T18:32:34.786405+0000","last_clean":"2024-09-13T18:32:34.786405+0000","last_became_active":"2024-09-13T18:32:33.784452+0000","last_became_peered":"2024-09-13T18:32:33.784452+0000","last_unstale":"2024-09-13T18:32:34.786405+0000","last_undegraded":"2024-09-13T18:32:34.786405+0000","last_fullsized":"2024-09-13T18:32:34.786405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:20.179497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977162+0000","last_change":"2024-09-13T18:32:33.790722+0000","last_active":"2024-09-13T18:32:35.977162+0000","last_peered":"2024-09-13T18:32:35.977162+0000","last_clean":"2024-09-13T18:32:35.977162+0000","last_became_active":"2024-09-13T18:32:33.790424+0000","last_became_peered":"2024-09-13T18:32:33.790424+0000","last_unstale":"2024-09-13T18:32:35.977162+0000","last_undegraded":"2024-09-13T18:32:35.977162+0000","last_fullsized":"2024-09-13T18:32:35.977162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:45.919731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950990+0000","last_change":"2024-09-13T18:32:33.821759+0000","last_active":"2024-09-13T18:32:34.950990+0000","last_peered":"2024-09-13T18:32:34.950990+0000","last_clean":"2024-09-13T18:32:34.950990+0000","last_became_active":"2024-09-13T18:32:33.821137+0000","last_became_peered":"2024-09-13T18:32:33.821137+0000","last_unstale":"2024-09-13T18:32:34.950990+0000","last_undegraded":"2024-09-13T18:32:34.950990+0000","last_fullsized":"2024-09-13T18:32:34.950990+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:58.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786770+0000","last_change":"2024-09-13T18:32:33.790635+0000","last_active":"2024-09-13T18:32:34.786770+0000","last_peered":"2024-09-13T18:32:34.786770+0000","last_clean":"2024-09-13T18:32:34.786770+0000","last_became_active":"2024-09-13T18:32:33.790382+0000","last_became_peered":"2024-09-13T18:32:33.790382+0000","last_unstale":"2024-09-13T18:32:34.786770+0000","last_undegraded":"2024-09-13T18:32:34.786770+0000","last_fullsized":"2024-09-13T18:32:34.786770+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:00.079410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950792+0000","last_change":"2024-09-13T18:32:33.822373+0000","last_active":"2024-09-13T18:32:34.950792+0000","last_peered":"2024-09-13T18:32:34.950792+0000","last_clean":"2024-09-13T18:32:34.950792+0000","last_became_active":"2024-09-13T18:32:33.821727+0000","last_became_peered":"2024-09-13T18:32:33.821727+0000","last_unstale":"2024-09-13T18:32:34.950792+0000","last_undegraded":"2024-09-13T18:32:34.950792+0000","last_fullsized":"2024-09-13T18:32:34.950792+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978354+0000","last_change":"2024-09-13T18:32:33.817767+0000","last_active":"2024-09-13T18:32:35.978354+0000","last_peered":"2024-09-13T18:32:35.978354+0000","last_clean":"2024-09-13T18:32:35.978354+0000","last_became_active":"2024-09-13T18:32:33.816781+0000","last_became_peered":"2024-09-13T18:32:33.816781+0000","last_unstale":"2024-09-13T18:32:35.978354+0000","last_undegraded":"2024-09-13T18:32:35.978354+0000","last_fullsized":"2024-09-13T18:32:35.978354+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:58.586795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788548+0000","last_change":"2024-09-13T18:32:33.827648+0000","last_active":"2024-09-13T18:32:34.788548+0000","last_peered":"2024-09-13T18:32:34.788548+0000","last_clean":"2024-09-13T18:32:34.788548+0000","last_became_active":"2024-09-13T18:32:33.824848+0000","last_became_peered":"2024-09-13T18:32:33.824848+0000","last_unstale":"2024-09-13T18:32:34.788548+0000","last_undegraded":"2024-09-13T18:32:34.788548+0000","last_fullsized":"2024-09-13T18:32:34.788548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:41.154706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950144+0000","last_change":"2024-09-13T18:32:33.804780+0000","last_active":"2024-09-13T18:32:34.950144+0000","last_peered":"2024-09-13T18:32:34.950144+0000","last_clean":"2024-09-13T18:32:34.950144+0000","last_became_active":"2024-09-13T18:32:33.804071+0000","last_became_peered":"2024-09-13T18:32:33.804071+0000","last_unstale":"2024-09-13T18:32:34.950144+0000","last_undegraded":"2024-09-13T18:32:34.950144+0000","last_fullsized":"2024-09-13T18:32:34.950144+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:54.557300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977916+0000","last_change":"2024-09-13T18:32:33.788921+0000","last_active":"2024-09-13T18:32:35.977916+0000","last_peered":"2024-09-13T18:32:35.977916+0000","last_clean":"2024-09-13T18:32:35.977916+0000","last_became_active":"2024-09-13T18:32:33.787379+0000","last_became_peered":"2024-09-13T18:32:33.787379+0000","last_unstale":"2024-09-13T18:32:35.977916+0000","last_undegraded":"2024-09-13T18:32:35.977916+0000","last_fullsized":"2024-09-13T18:32:35.977916+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:23.550606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951092+0000","last_change":"2024-09-13T18:32:33.815748+0000","last_active":"2024-09-13T18:32:34.951092+0000","last_peered":"2024-09-13T18:32:34.951092+0000","last_clean":"2024-09-13T18:32:34.951092+0000","last_became_active":"2024-09-13T18:32:33.814966+0000","last_became_peered":"2024-09-13T18:32:33.814966+0000","last_unstale":"2024-09-13T18:32:34.951092+0000","last_undegraded":"2024-09-13T18:32:34.951092+0000","last_fullsized":"2024-09-13T18:32:34.951092+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:20.205346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977070+0000","last_change":"2024-09-13T18:32:33.824811+0000","last_active":"2024-09-13T18:32:35.977070+0000","last_peered":"2024-09-13T18:32:35.977070+0000","last_clean":"2024-09-13T18:32:35.977070+0000","last_became_active":"2024-09-13T18:32:33.823742+0000","last_became_peered":"2024-09-13T18:32:33.823742+0000","last_unstale":"2024-09-13T18:32:35.977070+0000","last_undegraded":"2024-09-13T18:32:35.977070+0000","last_fullsized":"2024-09-13T18:32:35.977070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:58.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787230+0000","last_change":"2024-09-13T18:32:33.786294+0000","last_active":"2024-09-13T18:32:34.787230+0000","last_peered":"2024-09-13T18:32:34.787230+0000","last_clean":"2024-09-13T18:32:34.787230+0000","last_became_active":"2024-09-13T18:32:33.786018+0000","last_became_peered":"2024-09-13T18:32:33.786018+0000","last_unstale":"2024-09-13T18:32:34.787230+0000","last_undegraded":"2024-09-13T18:32:34.787230+0000","last_fullsized":"2024-09-13T18:32:34.787230+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:40.548118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979901+0000","last_change":"2024-09-13T18:32:33.786100+0000","last_active":"2024-09-13T18:32:35.979901+0000","last_peered":"2024-09-13T18:32:35.979901+0000","last_clean":"2024-09-13T18:32:35.979901+0000","last_became_active":"2024-09-13T18:32:33.785846+0000","last_became_peered":"2024-09-13T18:32:33.785846+0000","last_unstale":"2024-09-13T18:32:35.979901+0000","last_undegraded":"2024-09-13T18:32:35.979901+0000","last_fullsized":"2024-09-13T18:32:35.979901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:10.553097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950719+0000","last_change":"2024-09-13T18:32:33.831887+0000","last_active":"2024-09-13T18:32:34.950719+0000","last_peered":"2024-09-13T18:32:34.950719+0000","last_clean":"2024-09-13T18:32:34.950719+0000","last_became_active":"2024-09-13T18:32:33.831272+0000","last_became_peered":"2024-09-13T18:32:33.831272+0000","last_unstale":"2024-09-13T18:32:34.950719+0000","last_undegraded":"2024-09-13T18:32:34.950719+0000","last_fullsized":"2024-09-13T18:32:34.950719+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:13.873493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.789097+0000","last_change":"2024-09-13T18:32:33.827054+0000","last_active":"2024-09-13T18:32:34.789097+0000","last_peered":"2024-09-13T18:32:34.789097+0000","last_clean":"2024-09-13T18:32:34.789097+0000","last_became_active":"2024-09-13T18:32:33.824083+0000","last_became_peered":"2024-09-13T18:32:33.824083+0000","last_unstale":"2024-09-13T18:32:34.789097+0000","last_undegraded":"2024-09-13T18:32:34.789097+0000","last_fullsized":"2024-09-13T18:32:34.789097+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:00.414722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788371+0000","last_change":"2024-09-13T18:32:33.820207+0000","last_active":"2024-09-13T18:32:34.788371+0000","last_peered":"2024-09-13T18:32:34.788371+0000","last_clean":"2024-09-13T18:32:34.788371+0000","last_became_active":"2024-09-13T18:32:33.818585+0000","last_became_peered":"2024-09-13T18:32:33.818585+0000","last_unstale":"2024-09-13T18:32:34.788371+0000","last_undegraded":"2024-09-13T18:32:34.788371+0000","last_fullsized":"2024-09-13T18:32:34.788371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:41.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950207+0000","last_change":"2024-09-13T18:32:33.822129+0000","last_active":"2024-09-13T18:32:34.950207+0000","last_peered":"2024-09-13T18:32:34.950207+0000","last_clean":"2024-09-13T18:32:34.950207+0000","last_became_active":"2024-09-13T18:32:33.821422+0000","last_became_peered":"2024-09-13T18:32:33.821422+0000","last_unstale":"2024-09-13T18:32:34.950207+0000","last_undegraded":"2024-09-13T18:32:34.950207+0000","last_fullsized":"2024-09-13T18:32:34.950207+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:07.091127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979868+0000","last_change":"2024-09-13T18:32:33.788247+0000","last_active":"2024-09-13T18:32:35.979868+0000","last_peered":"2024-09-13T18:32:35.979868+0000","last_clean":"2024-09-13T18:32:35.979868+0000","last_became_active":"2024-09-13T18:32:33.787764+0000","last_became_peered":"2024-09-13T18:32:33.787764+0000","last_unstale":"2024-09-13T18:32:35.979868+0000","last_undegraded":"2024-09-13T18:32:35.979868+0000","last_fullsized":"2024-09-13T18:32:35.979868+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:49.661271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787420+0000","last_change":"2024-09-13T18:32:33.791031+0000","last_active":"2024-09-13T18:32:34.787420+0000","last_peered":"2024-09-13T18:32:34.787420+0000","last_clean":"2024-09-13T18:32:34.787420+0000","last_became_active":"2024-09-13T18:32:33.790485+0000","last_became_peered":"2024-09-13T18:32:33.790485+0000","last_unstale":"2024-09-13T18:32:34.787420+0000","last_undegraded":"2024-09-13T18:32:34.787420+0000","last_fullsized":"2024-09-13T18:32:34.787420+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:18.227242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979000+0000","last_change":"2024-09-13T18:32:33.828807+0000","last_active":"2024-09-13T18:32:35.979000+0000","last_peered":"2024-09-13T18:32:35.979000+0000","last_clean":"2024-09-13T18:32:35.979000+0000","last_became_active":"2024-09-13T18:32:33.828520+0000","last_became_peered":"2024-09-13T18:32:33.828520+0000","last_unstale":"2024-09-13T18:32:35.979000+0000","last_undegraded":"2024-09-13T18:32:35.979000+0000","last_fullsized":"2024-09-13T18:32:35.979000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:58.270636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979418+0000","last_change":"2024-09-13T18:32:33.832439+0000","last_active":"2024-09-13T18:32:35.979418+0000","last_peered":"2024-09-13T18:32:35.979418+0000","last_clean":"2024-09-13T18:32:35.979418+0000","last_became_active":"2024-09-13T18:32:33.832160+0000","last_became_peered":"2024-09-13T18:32:33.832160+0000","last_unstale":"2024-09-13T18:32:35.979418+0000","last_undegraded":"2024-09-13T18:32:35.979418+0000","last_fullsized":"2024-09-13T18:32:35.979418+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:08.827000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786593+0000","last_change":"2024-09-13T18:32:33.826859+0000","last_active":"2024-09-13T18:32:34.786593+0000","last_peered":"2024-09-13T18:32:34.786593+0000","last_clean":"2024-09-13T18:32:34.786593+0000","last_became_active":"2024-09-13T18:32:33.826583+0000","last_became_peered":"2024-09-13T18:32:33.826583+0000","last_unstale":"2024-09-13T18:32:34.786593+0000","last_undegraded":"2024-09-13T18:32:34.786593+0000","last_fullsized":"2024-09-13T18:32:34.786593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:11.432452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788778+0000","last_change":"2024-09-13T18:32:33.826451+0000","last_active":"2024-09-13T18:32:34.788778+0000","last_peered":"2024-09-13T18:32:34.788778+0000","last_clean":"2024-09-13T18:32:34.788778+0000","last_became_active":"2024-09-13T18:32:33.823214+0000","last_became_peered":"2024-09-13T18:32:33.823214+0000","last_unstale":"2024-09-13T18:32:34.788778+0000","last_undegraded":"2024-09-13T18:32:34.788778+0000","last_fullsized":"2024-09-13T18:32:34.788778+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:41.125154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977287+0000","last_change":"2024-09-13T18:32:33.824255+0000","last_active":"2024-09-13T18:32:35.977287+0000","last_peered":"2024-09-13T18:32:35.977287+0000","last_clean":"2024-09-13T18:32:35.977287+0000","last_became_active":"2024-09-13T18:32:33.823964+0000","last_became_peered":"2024-09-13T18:32:33.823964+0000","last_unstale":"2024-09-13T18:32:35.977287+0000","last_undegraded":"2024-09-13T18:32:35.977287+0000","last_fullsized":"2024-09-13T18:32:35.977287+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978162+0000","last_change":"2024-09-13T18:32:33.785340+0000","last_active":"2024-09-13T18:32:35.978162+0000","last_peered":"2024-09-13T18:32:35.978162+0000","last_clean":"2024-09-13T18:32:35.978162+0000","last_became_active":"2024-09-13T18:32:33.785090+0000","last_became_peered":"2024-09-13T18:32:33.785090+0000","last_unstale":"2024-09-13T18:32:35.978162+0000","last_undegraded":"2024-09-13T18:32:35.978162+0000","last_fullsized":"2024-09-13T18:32:35.978162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:22.574049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951243+0000","last_change":"2024-09-13T18:32:33.827675+0000","last_active":"2024-09-13T18:32:34.951243+0000","last_peered":"2024-09-13T18:32:34.951243+0000","last_clean":"2024-09-13T18:32:34.951243+0000","last_became_active":"2024-09-13T18:32:33.827033+0000","last_became_peered":"2024-09-13T18:32:33.827033+0000","last_unstale":"2024-09-13T18:32:34.951243+0000","last_undegraded":"2024-09-13T18:32:34.951243+0000","last_fullsized":"2024-09-13T18:32:34.951243+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:45.423965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"135'4","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.835512+0000","last_change":"2024-09-13T18:32:33.426755+0000","last_active":"2024-09-13T18:32:33.835512+0000","last_peered":"2024-09-13T18:32:33.835512+0000","last_clean":"2024-09-13T18:32:33.835512+0000","last_became_active":"2024-09-13T18:32:33.425067+0000","last_became_peered":"2024-09-13T18:32:33.425067+0000","last_unstale":"2024-09-13T18:32:33.835512+0000","last_undegraded":"2024-09-13T18:32:33.835512+0000","last_fullsized":"2024-09-13T18:32:33.835512+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:08.119303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978446+0000","last_change":"2024-09-13T18:32:33.789719+0000","last_active":"2024-09-13T18:32:35.978446+0000","last_peered":"2024-09-13T18:32:35.978446+0000","last_clean":"2024-09-13T18:32:35.978446+0000","last_became_active":"2024-09-13T18:32:33.789469+0000","last_became_peered":"2024-09-13T18:32:33.789469+0000","last_unstale":"2024-09-13T18:32:35.978446+0000","last_undegraded":"2024-09-13T18:32:35.978446+0000","last_fullsized":"2024-09-13T18:32:35.978446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:23.933809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815760+0000","last_change":"2024-09-13T18:32:33.400314+0000","last_active":"2024-09-13T18:32:33.815760+0000","last_peered":"2024-09-13T18:32:33.815760+0000","last_clean":"2024-09-13T18:32:33.815760+0000","last_became_active":"2024-09-13T18:32:33.400037+0000","last_became_peered":"2024-09-13T18:32:33.400037+0000","last_unstale":"2024-09-13T18:32:33.815760+0000","last_undegraded":"2024-09-13T18:32:33.815760+0000","last_fullsized":"2024-09-13T18:32:33.815760+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.401915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786761+0000","last_change":"2024-09-13T18:32:33.819421+0000","last_active":"2024-09-13T18:32:34.786761+0000","last_peered":"2024-09-13T18:32:34.786761+0000","last_clean":"2024-09-13T18:32:34.786761+0000","last_became_active":"2024-09-13T18:32:33.819124+0000","last_became_peered":"2024-09-13T18:32:33.819124+0000","last_unstale":"2024-09-13T18:32:34.786761+0000","last_undegraded":"2024-09-13T18:32:34.786761+0000","last_fullsized":"2024-09-13T18:32:34.786761+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:23.808011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.837457+0000","last_change":"2024-09-13T18:32:33.423218+0000","last_active":"2024-09-13T18:32:33.837457+0000","last_peered":"2024-09-13T18:32:33.837457+0000","last_clean":"2024-09-13T18:32:33.837457+0000","last_became_active":"2024-09-13T18:32:33.422543+0000","last_became_peered":"2024-09-13T18:32:33.422543+0000","last_unstale":"2024-09-13T18:32:33.837457+0000","last_undegraded":"2024-09-13T18:32:33.837457+0000","last_fullsized":"2024-09-13T18:32:33.837457+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:22.801823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950638+0000","last_change":"2024-09-13T18:32:33.827593+0000","last_active":"2024-09-13T18:32:34.950638+0000","last_peered":"2024-09-13T18:32:34.950638+0000","last_clean":"2024-09-13T18:32:34.950638+0000","last_became_active":"2024-09-13T18:32:33.826966+0000","last_became_peered":"2024-09-13T18:32:33.826966+0000","last_unstale":"2024-09-13T18:32:34.950638+0000","last_undegraded":"2024-09-13T18:32:34.950638+0000","last_fullsized":"2024-09-13T18:32:34.950638+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:45.919731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.837441+0000","last_change":"2024-09-13T18:32:33.415194+0000","last_active":"2024-09-13T18:32:33.837441+0000","last_peered":"2024-09-13T18:32:33.837441+0000","last_clean":"2024-09-13T18:32:33.837441+0000","last_became_active":"2024-09-13T18:32:33.413840+0000","last_became_peered":"2024-09-13T18:32:33.413840+0000","last_unstale":"2024-09-13T18:32:33.837441+0000","last_undegraded":"2024-09-13T18:32:33.837441+0000","last_fullsized":"2024-09-13T18:32:33.837441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:44.889998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977735+0000","last_change":"2024-09-13T18:32:33.826111+0000","last_active":"2024-09-13T18:32:35.977735+0000","last_peered":"2024-09-13T18:32:35.977735+0000","last_clean":"2024-09-13T18:32:35.977735+0000","last_became_active":"2024-09-13T18:32:33.825828+0000","last_became_peered":"2024-09-13T18:32:33.825828+0000","last_unstale":"2024-09-13T18:32:35.977735+0000","last_undegraded":"2024-09-13T18:32:35.977735+0000","last_fullsized":"2024-09-13T18:32:35.977735+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:07.091127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815930+0000","last_change":"2024-09-13T18:32:33.428261+0000","last_active":"2024-09-13T18:32:33.815930+0000","last_peered":"2024-09-13T18:32:33.815930+0000","last_clean":"2024-09-13T18:32:33.815930+0000","last_became_active":"2024-09-13T18:32:33.427870+0000","last_became_peered":"2024-09-13T18:32:33.427870+0000","last_unstale":"2024-09-13T18:32:33.815930+0000","last_undegraded":"2024-09-13T18:32:33.815930+0000","last_fullsized":"2024-09-13T18:32:33.815930+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:57.855160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788663+0000","last_change":"2024-09-13T18:32:33.829559+0000","last_active":"2024-09-13T18:32:34.788663+0000","last_peered":"2024-09-13T18:32:34.788663+0000","last_clean":"2024-09-13T18:32:34.788663+0000","last_became_active":"2024-09-13T18:32:33.828891+0000","last_became_peered":"2024-09-13T18:32:33.828891+0000","last_unstale":"2024-09-13T18:32:34.788663+0000","last_undegraded":"2024-09-13T18:32:34.788663+0000","last_fullsized":"2024-09-13T18:32:34.788663+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:54.990593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.816688+0000","last_change":"2024-09-13T18:32:33.430224+0000","last_active":"2024-09-13T18:32:33.816688+0000","last_peered":"2024-09-13T18:32:33.816688+0000","last_clean":"2024-09-13T18:32:33.816688+0000","last_became_active":"2024-09-13T18:32:33.429571+0000","last_became_peered":"2024-09-13T18:32:33.429571+0000","last_unstale":"2024-09-13T18:32:33.816688+0000","last_undegraded":"2024-09-13T18:32:33.816688+0000","last_fullsized":"2024-09-13T18:32:33.816688+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:47.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977233+0000","last_change":"2024-09-13T18:32:33.788325+0000","last_active":"2024-09-13T18:32:35.977233+0000","last_peered":"2024-09-13T18:32:35.977233+0000","last_clean":"2024-09-13T18:32:35.977233+0000","last_became_active":"2024-09-13T18:32:33.788044+0000","last_became_peered":"2024-09-13T18:32:33.788044+0000","last_unstale":"2024-09-13T18:32:35.977233+0000","last_undegraded":"2024-09-13T18:32:35.977233+0000","last_fullsized":"2024-09-13T18:32:35.977233+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:34.559447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.778008+0000","last_change":"2024-09-13T18:32:33.408358+0000","last_active":"2024-09-13T18:32:33.778008+0000","last_peered":"2024-09-13T18:32:33.778008+0000","last_clean":"2024-09-13T18:32:33.778008+0000","last_became_active":"2024-09-13T18:32:33.408047+0000","last_became_peered":"2024-09-13T18:32:33.408047+0000","last_unstale":"2024-09-13T18:32:33.778008+0000","last_undegraded":"2024-09-13T18:32:33.778008+0000","last_fullsized":"2024-09-13T18:32:33.778008+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:43.005792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978544+0000","last_change":"2024-09-13T18:32:33.789016+0000","last_active":"2024-09-13T18:32:35.978544+0000","last_peered":"2024-09-13T18:32:35.978544+0000","last_clean":"2024-09-13T18:32:35.978544+0000","last_became_active":"2024-09-13T18:32:33.788357+0000","last_became_peered":"2024-09-13T18:32:33.788357+0000","last_unstale":"2024-09-13T18:32:35.978544+0000","last_undegraded":"2024-09-13T18:32:35.978544+0000","last_fullsized":"2024-09-13T18:32:35.978544+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:47.237441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.798974+0000","last_change":"2024-09-13T18:32:33.429356+0000","last_active":"2024-09-13T18:32:33.798974+0000","last_peered":"2024-09-13T18:32:33.798974+0000","last_clean":"2024-09-13T18:32:33.798974+0000","last_became_active":"2024-09-13T18:32:33.428721+0000","last_became_peered":"2024-09-13T18:32:33.428721+0000","last_unstale":"2024-09-13T18:32:33.798974+0000","last_undegraded":"2024-09-13T18:32:33.798974+0000","last_fullsized":"2024-09-13T18:32:33.798974+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:43.220669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978375+0000","last_change":"2024-09-13T18:32:33.787225+0000","last_active":"2024-09-13T18:32:35.978375+0000","last_peered":"2024-09-13T18:32:35.978375+0000","last_clean":"2024-09-13T18:32:35.978375+0000","last_became_active":"2024-09-13T18:32:33.786516+0000","last_became_peered":"2024-09-13T18:32:33.786516+0000","last_unstale":"2024-09-13T18:32:35.978375+0000","last_undegraded":"2024-09-13T18:32:35.978375+0000","last_fullsized":"2024-09-13T18:32:35.978375+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:46.055809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.783455+0000","last_change":"2024-09-13T18:32:33.401321+0000","last_active":"2024-09-13T18:32:33.783455+0000","last_peered":"2024-09-13T18:32:33.783455+0000","last_clean":"2024-09-13T18:32:33.783455+0000","last_became_active":"2024-09-13T18:32:33.401054+0000","last_became_peered":"2024-09-13T18:32:33.401054+0000","last_unstale":"2024-09-13T18:32:33.783455+0000","last_undegraded":"2024-09-13T18:32:33.783455+0000","last_fullsized":"2024-09-13T18:32:33.783455+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:17.779023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950931+0000","last_change":"2024-09-13T18:32:33.814876+0000","last_active":"2024-09-13T18:32:34.950931+0000","last_peered":"2024-09-13T18:32:34.950931+0000","last_clean":"2024-09-13T18:32:34.950931+0000","last_became_active":"2024-09-13T18:32:33.814132+0000","last_became_peered":"2024-09-13T18:32:33.814132+0000","last_unstale":"2024-09-13T18:32:34.950931+0000","last_undegraded":"2024-09-13T18:32:34.950931+0000","last_fullsized":"2024-09-13T18:32:34.950931+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:58.390399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.801311+0000","last_change":"2024-09-13T18:32:33.425239+0000","last_active":"2024-09-13T18:32:33.801311+0000","last_peered":"2024-09-13T18:32:33.801311+0000","last_clean":"2024-09-13T18:32:33.801311+0000","last_became_active":"2024-09-13T18:32:33.424481+0000","last_became_peered":"2024-09-13T18:32:33.424481+0000","last_unstale":"2024-09-13T18:32:33.801311+0000","last_undegraded":"2024-09-13T18:32:33.801311+0000","last_fullsized":"2024-09-13T18:32:33.801311+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:44.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979123+0000","last_change":"2024-09-13T18:32:33.782307+0000","last_active":"2024-09-13T18:32:35.979123+0000","last_peered":"2024-09-13T18:32:35.979123+0000","last_clean":"2024-09-13T18:32:35.979123+0000","last_became_active":"2024-09-13T18:32:33.782057+0000","last_became_peered":"2024-09-13T18:32:33.782057+0000","last_unstale":"2024-09-13T18:32:35.979123+0000","last_undegraded":"2024-09-13T18:32:35.979123+0000","last_fullsized":"2024-09-13T18:32:35.979123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:37.268301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"135'6","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.817574+0000","last_change":"2024-09-13T18:32:33.405310+0000","last_active":"2024-09-13T18:32:33.817574+0000","last_peered":"2024-09-13T18:32:33.817574+0000","last_clean":"2024-09-13T18:32:33.817574+0000","last_became_active":"2024-09-13T18:32:33.405021+0000","last_became_peered":"2024-09-13T18:32:33.405021+0000","last_unstale":"2024-09-13T18:32:33.817574+0000","last_undegraded":"2024-09-13T18:32:33.817574+0000","last_fullsized":"2024-09-13T18:32:33.817574+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:57.374528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.976836+0000","last_change":"2024-09-13T18:32:33.834679+0000","last_active":"2024-09-13T18:32:35.976836+0000","last_peered":"2024-09-13T18:32:35.976836+0000","last_clean":"2024-09-13T18:32:35.976836+0000","last_became_active":"2024-09-13T18:32:33.833989+0000","last_became_peered":"2024-09-13T18:32:33.833989+0000","last_unstale":"2024-09-13T18:32:35.976836+0000","last_undegraded":"2024-09-13T18:32:35.976836+0000","last_fullsized":"2024-09-13T18:32:35.976836+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.528466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826365+0000","last_change":"2024-09-13T18:32:33.421547+0000","last_active":"2024-09-13T18:32:33.826365+0000","last_peered":"2024-09-13T18:32:33.826365+0000","last_clean":"2024-09-13T18:32:33.826365+0000","last_became_active":"2024-09-13T18:32:33.420825+0000","last_became_peered":"2024-09-13T18:32:33.420825+0000","last_unstale":"2024-09-13T18:32:33.826365+0000","last_undegraded":"2024-09-13T18:32:33.826365+0000","last_fullsized":"2024-09-13T18:32:33.826365+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:45.039938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978009+0000","last_change":"2024-09-13T18:32:33.789271+0000","last_active":"2024-09-13T18:32:35.978009+0000","last_peered":"2024-09-13T18:32:35.978009+0000","last_clean":"2024-09-13T18:32:35.978009+0000","last_became_active":"2024-09-13T18:32:33.788779+0000","last_became_peered":"2024-09-13T18:32:33.788779+0000","last_unstale":"2024-09-13T18:32:35.978009+0000","last_undegraded":"2024-09-13T18:32:35.978009+0000","last_fullsized":"2024-09-13T18:32:35.978009+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:13.873493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.803704+0000","last_change":"2024-09-13T18:32:33.430829+0000","last_active":"2024-09-13T18:32:33.803704+0000","last_peered":"2024-09-13T18:32:33.803704+0000","last_clean":"2024-09-13T18:32:33.803704+0000","last_became_active":"2024-09-13T18:32:33.430182+0000","last_became_peered":"2024-09-13T18:32:33.430182+0000","last_unstale":"2024-09-13T18:32:33.803704+0000","last_undegraded":"2024-09-13T18:32:33.803704+0000","last_fullsized":"2024-09-13T18:32:33.803704+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.416581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978346+0000","last_change":"2024-09-13T18:32:33.814214+0000","last_active":"2024-09-13T18:32:35.978346+0000","last_peered":"2024-09-13T18:32:35.978346+0000","last_clean":"2024-09-13T18:32:35.978346+0000","last_became_active":"2024-09-13T18:32:33.813501+0000","last_became_peered":"2024-09-13T18:32:33.813501+0000","last_unstale":"2024-09-13T18:32:35.978346+0000","last_undegraded":"2024-09-13T18:32:35.978346+0000","last_fullsized":"2024-09-13T18:32:35.978346+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:50.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.779832+0000","last_change":"2024-09-13T18:32:33.403647+0000","last_active":"2024-09-13T18:32:33.779832+0000","last_peered":"2024-09-13T18:32:33.779832+0000","last_clean":"2024-09-13T18:32:33.779832+0000","last_became_active":"2024-09-13T18:32:33.403296+0000","last_became_peered":"2024-09-13T18:32:33.403296+0000","last_unstale":"2024-09-13T18:32:33.779832+0000","last_undegraded":"2024-09-13T18:32:33.779832+0000","last_fullsized":"2024-09-13T18:32:33.779832+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:03.997316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.976587+0000","last_change":"2024-09-13T18:32:33.823851+0000","last_active":"2024-09-13T18:32:35.976587+0000","last_peered":"2024-09-13T18:32:35.976587+0000","last_clean":"2024-09-13T18:32:35.976587+0000","last_became_active":"2024-09-13T18:32:33.823081+0000","last_became_peered":"2024-09-13T18:32:33.823081+0000","last_unstale":"2024-09-13T18:32:35.976587+0000","last_undegraded":"2024-09-13T18:32:35.976587+0000","last_fullsized":"2024-09-13T18:32:35.976587+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"135'8","reported_seq":19,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826039+0000","last_change":"2024-09-13T18:32:33.421915+0000","last_active":"2024-09-13T18:32:33.826039+0000","last_peered":"2024-09-13T18:32:33.826039+0000","last_clean":"2024-09-13T18:32:33.826039+0000","last_became_active":"2024-09-13T18:32:33.421614+0000","last_became_peered":"2024-09-13T18:32:33.421614+0000","last_unstale":"2024-09-13T18:32:33.826039+0000","last_undegraded":"2024-09-13T18:32:33.826039+0000","last_fullsized":"2024-09-13T18:32:33.826039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:45.743441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951243+0000","last_change":"2024-09-13T18:32:33.814705+0000","last_active":"2024-09-13T18:32:34.951243+0000","last_peered":"2024-09-13T18:32:34.951243+0000","last_clean":"2024-09-13T18:32:34.951243+0000","last_became_active":"2024-09-13T18:32:33.814015+0000","last_became_peered":"2024-09-13T18:32:33.814015+0000","last_unstale":"2024-09-13T18:32:34.951243+0000","last_undegraded":"2024-09-13T18:32:34.951243+0000","last_fullsized":"2024-09-13T18:32:34.951243+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:28.594313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.824281+0000","last_change":"2024-09-13T18:32:33.424045+0000","last_active":"2024-09-13T18:32:33.824281+0000","last_peered":"2024-09-13T18:32:33.824281+0000","last_clean":"2024-09-13T18:32:33.824281+0000","last_became_active":"2024-09-13T18:32:33.423417+0000","last_became_peered":"2024-09-13T18:32:33.423417+0000","last_unstale":"2024-09-13T18:32:33.824281+0000","last_undegraded":"2024-09-13T18:32:33.824281+0000","last_fullsized":"2024-09-13T18:32:33.824281+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:57.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979938+0000","last_change":"2024-09-13T18:32:33.809476+0000","last_active":"2024-09-13T18:32:35.979938+0000","last_peered":"2024-09-13T18:32:35.979938+0000","last_clean":"2024-09-13T18:32:35.979938+0000","last_became_active":"2024-09-13T18:32:33.808979+0000","last_became_peered":"2024-09-13T18:32:33.808979+0000","last_unstale":"2024-09-13T18:32:35.979938+0000","last_undegraded":"2024-09-13T18:32:35.979938+0000","last_fullsized":"2024-09-13T18:32:35.979938+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:48.321038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.823899+0000","last_change":"2024-09-13T18:32:33.423041+0000","last_active":"2024-09-13T18:32:33.823899+0000","last_peered":"2024-09-13T18:32:33.823899+0000","last_clean":"2024-09-13T18:32:33.823899+0000","last_became_active":"2024-09-13T18:32:33.422681+0000","last_became_peered":"2024-09-13T18:32:33.422681+0000","last_unstale":"2024-09-13T18:32:33.823899+0000","last_undegraded":"2024-09-13T18:32:33.823899+0000","last_fullsized":"2024-09-13T18:32:33.823899+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.455048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977318+0000","last_change":"2024-09-13T18:32:33.829637+0000","last_active":"2024-09-13T18:32:35.977318+0000","last_peered":"2024-09-13T18:32:35.977318+0000","last_clean":"2024-09-13T18:32:35.977318+0000","last_became_active":"2024-09-13T18:32:33.828758+0000","last_became_peered":"2024-09-13T18:32:33.828758+0000","last_unstale":"2024-09-13T18:32:35.977318+0000","last_undegraded":"2024-09-13T18:32:35.977318+0000","last_fullsized":"2024-09-13T18:32:35.977318+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:54.057976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815547+0000","last_change":"2024-09-13T18:32:33.428265+0000","last_active":"2024-09-13T18:32:33.815547+0000","last_peered":"2024-09-13T18:32:33.815547+0000","last_clean":"2024-09-13T18:32:33.815547+0000","last_became_active":"2024-09-13T18:32:33.427867+0000","last_became_peered":"2024-09-13T18:32:33.427867+0000","last_unstale":"2024-09-13T18:32:33.815547+0000","last_undegraded":"2024-09-13T18:32:33.815547+0000","last_fullsized":"2024-09-13T18:32:33.815547+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:19.514202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787017+0000","last_change":"2024-09-13T18:32:33.832331+0000","last_active":"2024-09-13T18:32:34.787017+0000","last_peered":"2024-09-13T18:32:34.787017+0000","last_clean":"2024-09-13T18:32:34.787017+0000","last_became_active":"2024-09-13T18:32:33.832076+0000","last_became_peered":"2024-09-13T18:32:33.832076+0000","last_unstale":"2024-09-13T18:32:34.787017+0000","last_undegraded":"2024-09-13T18:32:34.787017+0000","last_fullsized":"2024-09-13T18:32:34.787017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:36.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.783875+0000","last_change":"2024-09-13T18:32:33.407815+0000","last_active":"2024-09-13T18:32:33.783875+0000","last_peered":"2024-09-13T18:32:33.783875+0000","last_clean":"2024-09-13T18:32:33.783875+0000","last_became_active":"2024-09-13T18:32:33.407449+0000","last_became_peered":"2024-09-13T18:32:33.407449+0000","last_unstale":"2024-09-13T18:32:33.783875+0000","last_undegraded":"2024-09-13T18:32:33.783875+0000","last_fullsized":"2024-09-13T18:32:33.783875+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:06.225819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788919+0000","last_change":"2024-09-13T18:32:33.825789+0000","last_active":"2024-09-13T18:32:34.788919+0000","last_peered":"2024-09-13T18:32:34.788919+0000","last_clean":"2024-09-13T18:32:34.788919+0000","last_became_active":"2024-09-13T18:32:33.822350+0000","last_became_peered":"2024-09-13T18:32:33.822350+0000","last_unstale":"2024-09-13T18:32:34.788919+0000","last_undegraded":"2024-09-13T18:32:34.788919+0000","last_fullsized":"2024-09-13T18:32:34.788919+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:56.855304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826572+0000","last_change":"2024-09-13T18:32:33.422797+0000","last_active":"2024-09-13T18:32:33.826572+0000","last_peered":"2024-09-13T18:32:33.826572+0000","last_clean":"2024-09-13T18:32:33.826572+0000","last_became_active":"2024-09-13T18:32:33.422493+0000","last_became_peered":"2024-09-13T18:32:33.422493+0000","last_unstale":"2024-09-13T18:32:33.826572+0000","last_undegraded":"2024-09-13T18:32:33.826572+0000","last_fullsized":"2024-09-13T18:32:33.826572+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.903860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979066+0000","last_change":"2024-09-13T18:32:33.831089+0000","last_active":"2024-09-13T18:32:35.979066+0000","last_peered":"2024-09-13T18:32:35.979066+0000","last_clean":"2024-09-13T18:32:35.979066+0000","last_became_active":"2024-09-13T18:32:33.830776+0000","last_became_peered":"2024-09-13T18:32:33.830776+0000","last_unstale":"2024-09-13T18:32:35.979066+0000","last_undegraded":"2024-09-13T18:32:35.979066+0000","last_fullsized":"2024-09-13T18:32:35.979066+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.793870+0000","last_change":"2024-09-13T18:32:33.414874+0000","last_active":"2024-09-13T18:32:33.793870+0000","last_peered":"2024-09-13T18:32:33.793870+0000","last_clean":"2024-09-13T18:32:33.793870+0000","last_became_active":"2024-09-13T18:32:33.414166+0000","last_became_peered":"2024-09-13T18:32:33.414166+0000","last_unstale":"2024-09-13T18:32:33.793870+0000","last_undegraded":"2024-09-13T18:32:33.793870+0000","last_fullsized":"2024-09-13T18:32:33.793870+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:59.982897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787995+0000","last_change":"2024-09-13T18:32:33.819506+0000","last_active":"2024-09-13T18:32:34.787995+0000","last_peered":"2024-09-13T18:32:34.787995+0000","last_clean":"2024-09-13T18:32:34.787995+0000","last_became_active":"2024-09-13T18:32:33.818617+0000","last_became_peered":"2024-09-13T18:32:33.818617+0000","last_unstale":"2024-09-13T18:32:34.787995+0000","last_undegraded":"2024-09-13T18:32:34.787995+0000","last_fullsized":"2024-09-13T18:32:34.787995+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:33.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.793549+0000","last_change":"2024-09-13T18:32:33.419123+0000","last_active":"2024-09-13T18:32:33.793549+0000","last_peered":"2024-09-13T18:32:33.793549+0000","last_clean":"2024-09-13T18:32:33.793549+0000","last_became_active":"2024-09-13T18:32:33.418219+0000","last_became_peered":"2024-09-13T18:32:33.418219+0000","last_unstale":"2024-09-13T18:32:33.793549+0000","last_undegraded":"2024-09-13T18:32:33.793549+0000","last_fullsized":"2024-09-13T18:32:33.793549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:49.041040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978294+0000","last_change":"2024-09-13T18:32:33.818290+0000","last_active":"2024-09-13T18:32:35.978294+0000","last_peered":"2024-09-13T18:32:35.978294+0000","last_clean":"2024-09-13T18:32:35.978294+0000","last_became_active":"2024-09-13T18:32:33.818079+0000","last_became_peered":"2024-09-13T18:32:33.818079+0000","last_unstale":"2024-09-13T18:32:35.978294+0000","last_undegraded":"2024-09-13T18:32:35.978294+0000","last_fullsized":"2024-09-13T18:32:35.978294+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:16.162671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.799916+0000","last_change":"2024-09-13T18:32:33.421507+0000","last_active":"2024-09-13T18:32:33.799916+0000","last_peered":"2024-09-13T18:32:33.799916+0000","last_clean":"2024-09-13T18:32:33.799916+0000","last_became_active":"2024-09-13T18:32:33.420729+0000","last_became_peered":"2024-09-13T18:32:33.420729+0000","last_unstale":"2024-09-13T18:32:33.799916+0000","last_undegraded":"2024-09-13T18:32:33.799916+0000","last_fullsized":"2024-09-13T18:32:33.799916+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:19.163626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978637+0000","last_change":"2024-09-13T18:32:33.814762+0000","last_active":"2024-09-13T18:32:35.978637+0000","last_peered":"2024-09-13T18:32:35.978637+0000","last_clean":"2024-09-13T18:32:35.978637+0000","last_became_active":"2024-09-13T18:32:33.812509+0000","last_became_peered":"2024-09-13T18:32:33.812509+0000","last_unstale":"2024-09-13T18:32:35.978637+0000","last_undegraded":"2024-09-13T18:32:35.978637+0000","last_fullsized":"2024-09-13T18:32:35.978637+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:44.604924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.835391+0000","last_change":"2024-09-13T18:32:33.427335+0000","last_active":"2024-09-13T18:32:33.835391+0000","last_peered":"2024-09-13T18:32:33.835391+0000","last_clean":"2024-09-13T18:32:33.835391+0000","last_became_active":"2024-09-13T18:32:33.425972+0000","last_became_peered":"2024-09-13T18:32:33.425972+0000","last_unstale":"2024-09-13T18:32:33.835391+0000","last_undegraded":"2024-09-13T18:32:33.835391+0000","last_fullsized":"2024-09-13T18:32:33.835391+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.211604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977631+0000","last_change":"2024-09-13T18:32:33.838185+0000","last_active":"2024-09-13T18:32:35.977631+0000","last_peered":"2024-09-13T18:32:35.977631+0000","last_clean":"2024-09-13T18:32:35.977631+0000","last_became_active":"2024-09-13T18:32:33.837708+0000","last_became_peered":"2024-09-13T18:32:33.837708+0000","last_unstale":"2024-09-13T18:32:35.977631+0000","last_undegraded":"2024-09-13T18:32:35.977631+0000","last_fullsized":"2024-09-13T18:32:35.977631+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:45.905869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.784327+0000","last_change":"2024-09-13T18:32:33.425880+0000","last_active":"2024-09-13T18:32:33.784327+0000","last_peered":"2024-09-13T18:32:33.784327+0000","last_clean":"2024-09-13T18:32:33.784327+0000","last_became_active":"2024-09-13T18:32:33.425653+0000","last_became_peered":"2024-09-13T18:32:33.425653+0000","last_unstale":"2024-09-13T18:32:33.784327+0000","last_undegraded":"2024-09-13T18:32:33.784327+0000","last_fullsized":"2024-09-13T18:32:33.784327+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:06.402429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977997+0000","last_change":"2024-09-13T18:32:33.819050+0000","last_active":"2024-09-13T18:32:35.977997+0000","last_peered":"2024-09-13T18:32:35.977997+0000","last_clean":"2024-09-13T18:32:35.977997+0000","last_became_active":"2024-09-13T18:32:33.818753+0000","last_became_peered":"2024-09-13T18:32:33.818753+0000","last_unstale":"2024-09-13T18:32:35.977997+0000","last_undegraded":"2024-09-13T18:32:35.977997+0000","last_fullsized":"2024-09-13T18:32:35.977997+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:54.557300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.785597+0000","last_change":"2024-09-13T18:32:33.405477+0000","last_active":"2024-09-13T18:32:33.785597+0000","last_peered":"2024-09-13T18:32:33.785597+0000","last_clean":"2024-09-13T18:32:33.785597+0000","last_became_active":"2024-09-13T18:32:33.405040+0000","last_became_peered":"2024-09-13T18:32:33.405040+0000","last_unstale":"2024-09-13T18:32:33.785597+0000","last_undegraded":"2024-09-13T18:32:33.785597+0000","last_fullsized":"2024-09-13T18:32:33.785597+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:40.969205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787017+0000","last_change":"2024-09-13T18:32:33.818707+0000","last_active":"2024-09-13T18:32:34.787017+0000","last_peered":"2024-09-13T18:32:34.787017+0000","last_clean":"2024-09-13T18:32:34.787017+0000","last_became_active":"2024-09-13T18:32:33.818396+0000","last_became_peered":"2024-09-13T18:32:33.818396+0000","last_unstale":"2024-09-13T18:32:34.787017+0000","last_undegraded":"2024-09-13T18:32:34.787017+0000","last_fullsized":"2024-09-13T18:32:34.787017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:47.237441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.785062+0000","last_change":"2024-09-13T18:32:33.405578+0000","last_active":"2024-09-13T18:32:33.785062+0000","last_peered":"2024-09-13T18:32:33.785062+0000","last_clean":"2024-09-13T18:32:33.785062+0000","last_became_active":"2024-09-13T18:32:33.405064+0000","last_became_peered":"2024-09-13T18:32:33.405064+0000","last_unstale":"2024-09-13T18:32:33.785062+0000","last_undegraded":"2024-09-13T18:32:33.785062+0000","last_fullsized":"2024-09-13T18:32:33.785062+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:15.279314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978537+0000","last_change":"2024-09-13T18:32:33.831054+0000","last_active":"2024-09-13T18:32:35.978537+0000","last_peered":"2024-09-13T18:32:35.978537+0000","last_clean":"2024-09-13T18:32:35.978537+0000","last_became_active":"2024-09-13T18:32:33.830434+0000","last_became_peered":"2024-09-13T18:32:33.830434+0000","last_unstale":"2024-09-13T18:32:35.978537+0000","last_undegraded":"2024-09-13T18:32:35.978537+0000","last_fullsized":"2024-09-13T18:32:35.978537+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:18.145689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.780589+0000","last_change":"2024-09-13T18:32:33.413972+0000","last_active":"2024-09-13T18:32:33.780589+0000","last_peered":"2024-09-13T18:32:33.780589+0000","last_clean":"2024-09-13T18:32:33.780589+0000","last_became_active":"2024-09-13T18:32:33.413631+0000","last_became_peered":"2024-09-13T18:32:33.413631+0000","last_unstale":"2024-09-13T18:32:33.780589+0000","last_undegraded":"2024-09-13T18:32:33.780589+0000","last_fullsized":"2024-09-13T18:32:33.780589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:27.578442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978673+0000","last_change":"2024-09-13T18:32:33.832539+0000","last_active":"2024-09-13T18:32:35.978673+0000","last_peered":"2024-09-13T18:32:35.978673+0000","last_clean":"2024-09-13T18:32:35.978673+0000","last_became_active":"2024-09-13T18:32:33.831858+0000","last_became_peered":"2024-09-13T18:32:33.831858+0000","last_unstale":"2024-09-13T18:32:35.978673+0000","last_undegraded":"2024-09-13T18:32:35.978673+0000","last_fullsized":"2024-09-13T18:32:35.978673+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:56.705450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.794127+0000","last_change":"2024-09-13T18:32:33.424181+0000","last_active":"2024-09-13T18:32:33.794127+0000","last_peered":"2024-09-13T18:32:33.794127+0000","last_clean":"2024-09-13T18:32:33.794127+0000","last_became_active":"2024-09-13T18:32:33.423421+0000","last_became_peered":"2024-09-13T18:32:33.423421+0000","last_unstale":"2024-09-13T18:32:33.794127+0000","last_undegraded":"2024-09-13T18:32:33.794127+0000","last_fullsized":"2024-09-13T18:32:33.794127+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950412+0000","last_change":"2024-09-13T18:32:33.804551+0000","last_active":"2024-09-13T18:32:34.950412+0000","last_peered":"2024-09-13T18:32:34.950412+0000","last_clean":"2024-09-13T18:32:34.950412+0000","last_became_active":"2024-09-13T18:32:33.803899+0000","last_became_peered":"2024-09-13T18:32:33.803899+0000","last_unstale":"2024-09-13T18:32:34.950412+0000","last_undegraded":"2024-09-13T18:32:34.950412+0000","last_fullsized":"2024-09-13T18:32:34.950412+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:34.559447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.789586+0000","last_change":"2024-09-13T18:32:33.422034+0000","last_active":"2024-09-13T18:32:33.789586+0000","last_peered":"2024-09-13T18:32:33.789586+0000","last_clean":"2024-09-13T18:32:33.789586+0000","last_became_active":"2024-09-13T18:32:33.421457+0000","last_became_peered":"2024-09-13T18:32:33.421457+0000","last_unstale":"2024-09-13T18:32:33.789586+0000","last_undegraded":"2024-09-13T18:32:33.789586+0000","last_fullsized":"2024-09-13T18:32:33.789586+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.063539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978270+0000","last_change":"2024-09-13T18:32:33.785222+0000","last_active":"2024-09-13T18:32:35.978270+0000","last_peered":"2024-09-13T18:32:35.978270+0000","last_clean":"2024-09-13T18:32:35.978270+0000","last_became_active":"2024-09-13T18:32:33.784722+0000","last_became_peered":"2024-09-13T18:32:33.784722+0000","last_unstale":"2024-09-13T18:32:35.978270+0000","last_undegraded":"2024-09-13T18:32:35.978270+0000","last_fullsized":"2024-09-13T18:32:35.978270+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:36.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.781679+0000","last_change":"2024-09-13T18:32:33.418240+0000","last_active":"2024-09-13T18:32:33.781679+0000","last_peered":"2024-09-13T18:32:33.781679+0000","last_clean":"2024-09-13T18:32:33.781679+0000","last_became_active":"2024-09-13T18:32:33.417865+0000","last_became_peered":"2024-09-13T18:32:33.417865+0000","last_unstale":"2024-09-13T18:32:33.781679+0000","last_undegraded":"2024-09-13T18:32:33.781679+0000","last_fullsized":"2024-09-13T18:32:33.781679+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979552+0000","last_change":"2024-09-13T18:32:33.819666+0000","last_active":"2024-09-13T18:32:35.979552+0000","last_peered":"2024-09-13T18:32:35.979552+0000","last_clean":"2024-09-13T18:32:35.979552+0000","last_became_active":"2024-09-13T18:32:33.819396+0000","last_became_peered":"2024-09-13T18:32:33.819396+0000","last_unstale":"2024-09-13T18:32:35.979552+0000","last_undegraded":"2024-09-13T18:32:35.979552+0000","last_fullsized":"2024-09-13T18:32:35.979552+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:45.423965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"135'3","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.827088+0000","last_change":"2024-09-13T18:32:33.423551+0000","last_active":"2024-09-13T18:32:33.827088+0000","last_peered":"2024-09-13T18:32:33.827088+0000","last_clean":"2024-09-13T18:32:33.827088+0000","last_became_active":"2024-09-13T18:32:33.421681+0000","last_became_peered":"2024-09-13T18:32:33.421681+0000","last_unstale":"2024-09-13T18:32:33.827088+0000","last_undegraded":"2024-09-13T18:32:33.827088+0000","last_fullsized":"2024-09-13T18:32:33.827088+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:39.532247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":298,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.794410+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:32:33.794410+0000","last_peered":"2024-09-13T18:32:33.794410+0000","last_clean":"2024-09-13T18:32:33.794410+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:32:33.794410+0000","last_undegraded":"2024-09-13T18:32:33.794410+0000","last_fullsized":"2024-09-13T18:32:33.794410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33376,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338464,"statfs":{"total":96636764160,"available":96602587136,"internally_reserved":0,"allocated":2306048,"data_stored":1344845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90500000000000003,"15min":0.88300000000000001},"min":{"1min":0.52100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2330000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.624},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":0.90000000000000002},"min":{"1min":0.51100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.143,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.95199999999999996,"15min":0.93000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.129,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.73899999999999999,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.57499999999999996,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.1040000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88100000000000001,"15min":0.879},"min":{"1min":0.61799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2070000000000001,"5min":1.349,"15min":1.448},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.94599999999999995,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.84599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1930000000000001,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":1.016},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.66700000000000004,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96299999999999997,"15min":1.0249999999999999},"min":{"1min":0.74399999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1919999999999999,"5min":1.5609999999999999,"15min":1.877},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.98699999999999999,"15min":0.97899999999999998},"min":{"1min":0.63900000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.409,"15min":1.409},"last":1.1319999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0489999999999999,"15min":1.0589999999999999},"min":{"1min":0.74199999999999999,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.4490000000000001,"5min":1.476,"15min":1.476},"last":1.079},{"interface":"front","average":{"1min":1.038,"5min":1.0349999999999999,"15min":1.004},"min":{"1min":0.77600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.361,"5min":1.506,"15min":1.506},"last":1.044}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1716224,"data_stored":753971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.312},"max":{"1min":1.2230000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81000000000000005,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.48799999999999999,"15min":0.46600000000000003},"max":{"1min":1.117,"5min":1.252,"15min":1.3879999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.92600000000000005,"15min":0.89600000000000002},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.34899999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.577},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.91300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.218,"15min":1.464},"last":0.872}]},{"osd":2,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.84299999999999997,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92100000000000004,"15min":0.96299999999999997},"min":{"1min":0.69799999999999995,"5min":0.59599999999999997,"15min":0.47499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":2.4220000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91700000000000004,"15min":0.88600000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.65900000000000003,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.306},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":0.97299999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.042,"15min":1.0089999999999999},"min":{"1min":0.69399999999999995,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.624,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2310000000000001,"5min":1.2390000000000001,"15min":1.4330000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.03,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":2.762},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.028,"15min":1.0409999999999999},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.9299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.111,"5min":1.0249999999999999,"15min":1.044},"min":{"1min":0.84299999999999997,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.72},"last":1.113}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1708032,"data_stored":753847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1850000000000001,"5min":1.2390000000000001,"15min":2.0209999999999999},"last":0.876},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.437},"max":{"1min":1.264,"5min":1.264,"15min":2.1840000000000002},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.88300000000000001,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86399999999999999,"15min":0.83399999999999996},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.5029999999999999},"last":1.048}]},{"osd":2,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.292,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.625},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90800000000000003,"15min":0.95999999999999996},"min":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":2.2589999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.96599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4650000000000001,"5min":1.6719999999999999,"15min":1.871},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.93899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.071,"5min":0.998,"15min":1.0409999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.5049999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.98799999999999999,"15min":1.0229999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.95299999999999996,"15min":1.0169999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":1.488,"15min":2.246},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.05,"15min":1.1220000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.9379999999999999},"last":1.0720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1703936,"data_stored":753825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95099999999999996,"15min":0.84399999999999997},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3490000000000002,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.94399999999999995,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.41699999999999998},"max":{"1min":2.4060000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.56000000000000005,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.2589999999999999,"5min":1.536,"15min":1.536},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61799999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.8069999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.337}]},{"osd":2,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89300000000000002,"15min":0.875},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.139,"5min":1.216,"15min":1.216},"last":1.109},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.89800000000000002},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.367}]},{"osd":3,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.026,"15min":0.95899999999999996},"min":{"1min":0.76300000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":1.4159999999999999,"5min":10.44,"15min":10.44},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.65200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.044,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.67100000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.04}]},{"osd":6,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.117,"15min":1.0349999999999999},"min":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.52000000000000002},"max":{"1min":1.4890000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.3},{"interface":"front","average":{"1min":1.085,"5min":1.2070000000000001,"15min":1.0880000000000001},"min":{"1min":0.76000000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":1.8979999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":0.92300000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.095},"min":{"1min":0.69099999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2269999999999999,"5min":15.593,"15min":15.593},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.0569999999999999,"15min":1.0780000000000001},"min":{"1min":0.77800000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.0089999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1708032,"data_stored":753915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.88200000000000001,"5min":2.113,"15min":2.113},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77600000000000002,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.115,"5min":1.4199999999999999,"15min":1.704},"last":0.745},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.079,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.376,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.742,"15min":1.742},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79100000000000004,"15min":0.748},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.0629999999999999,"5min":1.224,"15min":1.399},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.69999999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2190000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.536,"5min":1.536,"15min":2.8740000000000001},"last":1.304}]},{"osd":5,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98599999999999999,"15min":1.016},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.294,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2589999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.0549999999999999},"min":{"1min":0.71299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.665,"5min":1.665,"15min":2.6190000000000002},"last":1.419},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.0509999999999999},"min":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53400000000000003},"max":{"1min":1.502,"5min":1.6890000000000001,"15min":1.96},"last":1.167}]},{"osd":7,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.036,"15min":1.0880000000000001},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4470000000000001,"5min":1.665,"15min":3},"last":1.5029999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.032,"15min":1.006},"min":{"1min":0.66900000000000004,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.3460000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1720320,"data_stored":755459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.83399999999999996,"5min":0.97999999999999998,"15min":1.0309999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67500000000000004,"15min":0.65300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.93500000000000005,"5min":1.1200000000000001,"15min":1.335},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94999999999999996,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":1.0309999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.141,"5min":1.405,"15min":1.405},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.91700000000000004,"15min":0.91200000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.212,"5min":1.367,"15min":1.611},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.91600000000000004},"min":{"1min":0.68600000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2210000000000001,"5min":1.587,"15min":1.587},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.60399999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.9179999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.98099999999999998,"15min":0.97299999999999998},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2450000000000001,"5min":1.552,"15min":1.702},"last":0.877}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.472,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.66800000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.522,"5min":1.645,"15min":1.645},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.623,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.843,"15min":1.843},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4330000000000001,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1708032,"data_stored":754407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.61399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":1.0680000000000001,"15min":1.177},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.29699999999999999,"15min":0.28199999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.36299999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":1.423,"15min":1.423},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.90700000000000003},"min":{"1min":0.628,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93600000000000005,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.42899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.02}]},{"osd":5,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92800000000000005,"15min":0.92100000000000004},"min":{"1min":0.64200000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3460000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.69499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4059999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.018,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.27,"5min":1.5900000000000001,"15min":1.653},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.425,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.091,"15min":1.0529999999999999},"min":{"1min":0.74299999999999999,"5min":0.61899999999999999,"15min":0.52500000000000002},"max":{"1min":1.4790000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.196,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.038}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41568,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330272,"statfs":{"total":96636764160,"available":96594198528,"internally_reserved":0,"allocated":2314240,"data_stored":1345791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0169999999999999,"15min":1.147},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.03,"5min":1.244,"15min":1.4359999999999999},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1299999999999999,"5min":1.333,"15min":1.333},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.05,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.432}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.99199999999999999,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.93200000000000005},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.075,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96499999999999997,"15min":0.98699999999999999},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3089999999999999,"5min":1.5069999999999999,"15min":1.986},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97899999999999998,"15min":1.002},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.492,"5min":1.8799999999999999,"15min":2.641},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.032},"min":{"1min":0.61599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.304,"5min":1.3580000000000001,"15min":1.6699999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0349999999999999,"15min":1.0649999999999999},"min":{"1min":0.64600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.321,"5min":1.466,"15min":1.891},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.036,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.72999999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.752}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.006,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":2.2949999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.75600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:32:41.940 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:32:42.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febfaf5e640 1 Processor -- start 2024-09-13T18:32:42.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febfaf5e640 1 -- start start 2024-09-13T18:32:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febfaf5e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febf415b7c0 0x7febf4070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febfaf5e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7febf40711d0 0x7febf41640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febfaf5e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf406d480 con 0x7febf41582a0 2024-09-13T18:32:42.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febfaf5e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf4071680 con 0x7febf415b7c0 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febfaf5e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf415aaf0 con 0x7febf40711d0 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febf415b7c0 0x7febf4070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febf415b7c0 0x7febf4070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42086/0 (socket says 172.21.15.53:42086) 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf8cfa640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7febf41582a0 0x7febf406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58264/0 (socket says 172.21.15.53:58264) 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf3fff640 1 -- 172.21.15.53:0/2314964470 learned_addr learned my addr 172.21.15.53:0/2314964470 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf94fb640 1 --2- 172.21.15.53:0/2314964470 >> v2:172.21.15.87:3300/0 conn(0x7febf40711d0 0x7febf41640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf3fff640 1 -- 172.21.15.53:0/2314964470 >> v2:172.21.15.87:3300/0 conn(0x7febf40711d0 msgr2=0x7febf41640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf3fff640 1 --2- 172.21.15.53:0/2314964470 >> v2:172.21.15.87:3300/0 conn(0x7febf40711d0 0x7febf41640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf3fff640 1 -- 172.21.15.53:0/2314964470 >> v1:172.21.15.53:6789/0 conn(0x7febf41582a0 legacy=0x7febf406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.077+0000 7febf3fff640 1 -- 172.21.15.53:0/2314964470 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf415ace0 con 0x7febf415b7c0 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf3fff640 1 --2- 172.21.15.53:0/2314964470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4070c90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7febf4158680 tx=0x7febe801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d62d64c7263683 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf37fe640 1 -- 172.21.15.53:0/2314964470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80ab610 con 0x7febf415b7c0 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf37fe640 1 -- 172.21.15.53:0/2314964470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe80ab770 con 0x7febf415b7c0 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf37fe640 1 -- 172.21.15.53:0/2314964470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80abb00 con 0x7febf415b7c0 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- 172.21.15.53:0/2314964470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 msgr2=0x7febf4070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 --2- 172.21.15.53:0/2314964470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4070c90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7febf4158680 tx=0x7febe801c520 comp rx=0 tx=0).stop 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- 172.21.15.53:0/2314964470 shutdown_connections 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 --2- 172.21.15.53:0/2314964470 >> v2:172.21.15.87:3300/0 conn(0x7febf40711d0 0x7febf41640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 --2- 172.21.15.53:0/2314964470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4070c90 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.083 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- 172.21.15.53:0/2314964470 >> 172.21.15.53:0/2314964470 conn(0x7febf4065c80 msgr2=0x7febf4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- 172.21.15.53:0/2314964470 shutdown_connections 2024-09-13T18:32:42.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- 172.21.15.53:0/2314964470 wait complete. 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 Processor -- start 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- start start 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febf40711d0 0x7febf4144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febf41582a0 0x7febf41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4145f80 con 0x7febf415b7c0 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4145400 con 0x7febf41582a0 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febfaf5e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf41456e0 con 0x7febf40711d0 2024-09-13T18:32:42.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf94fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf94fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42090/0 (socket says 172.21.15.53:42090) 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf94fb640 1 -- 172.21.15.53:0/3534607382 learned_addr learned my addr 172.21.15.53:0/3534607382 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf3fff640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febf41582a0 0x7febf41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.081+0000 7febf8cfa640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febf40711d0 0x7febf4144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf94fb640 1 -- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febf40711d0 msgr2=0x7febf4144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf94fb640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febf40711d0 0x7febf4144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf94fb640 1 -- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febf41582a0 msgr2=0x7febf41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf94fb640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febf41582a0 0x7febf41547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf94fb640 1 -- 172.21.15.53:0/3534607382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80094d0 con 0x7febf415b7c0 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf94fb640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4140a80 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7febec007e40 tx=0x7febec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf17fa640 1 -- 172.21.15.53:0/3534607382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec014620 con 0x7febf415b7c0 2024-09-13T18:32:42.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf17fa640 1 -- 172.21.15.53:0/3534607382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00ee90 con 0x7febf415b7c0 2024-09-13T18:32:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf41459c0 con 0x7febf415b7c0 2024-09-13T18:32:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf17fa640 1 -- 172.21.15.53:0/3534607382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec0149e0 con 0x7febf415b7c0 2024-09-13T18:32:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf41450f0 con 0x7febf415b7c0 2024-09-13T18:32:42.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf4067400 con 0x7febf415b7c0 2024-09-13T18:32:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf17fa640 1 -- 172.21.15.53:0/3534607382 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7febec014b40 con 0x7febf415b7c0 2024-09-13T18:32:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf17fa640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7febe0066c30 0x7febe00690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf17fa640 1 -- 172.21.15.53:0/3534607382 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febec0855d0 con 0x7febf415b7c0 2024-09-13T18:32:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf8cfa640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7febe0066c30 0x7febe00690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.085+0000 7febf8cfa640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7febe0066c30 0x7febe00690f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febe4000f70 tx=0x7febe4007c90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.089+0000 7febf17fa640 1 -- 172.21.15.53:0/3534607382 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7febec0520d0 con 0x7febf415b7c0 2024-09-13T18:32:42.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.249+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febf40cd490 con 0x7febe0066c30 2024-09-13T18:32:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.269+0000 7febf17fa640 1 -- 172.21.15.53:0/3534607382 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288721 (secure 0 0 0) 0x7febf40cd490 con 0x7febe0066c30 2024-09-13T18:32:42.275 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:32:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7febe0066c30 msgr2=0x7febe00690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7febe0066c30 0x7febe00690f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febe4000f70 tx=0x7febe4007c90 comp rx=0 tx=0).stop 2024-09-13T18:32:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 msgr2=0x7febf4140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4140a80 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7febec007e40 tx=0x7febec00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 shutdown_connections 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7febe0066c30 0x7febe00690f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febf415b7c0 0x7febf4140a80 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febf41582a0 0x7febf41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 --2- 172.21.15.53:0/3534607382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febf40711d0 0x7febf4144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 >> 172.21.15.53:0/3534607382 conn(0x7febf4065c80 msgr2=0x7febf406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 shutdown_connections 2024-09-13T18:32:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.273+0000 7febfaf5e640 1 -- 172.21.15.53:0/3534607382 wait complete. 2024-09-13T18:32:42.295 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-13T18:32:41.867274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283976,"kb_used_data":14536,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754690744,"statfs":{"total":773094113280,"available":772803321856,"internally_reserved":0,"allocated":14884864,"data_stored":7216060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.093081"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787606+0000","last_change":"2024-09-13T18:32:33.811702+0000","last_active":"2024-09-13T18:32:34.787606+0000","last_peered":"2024-09-13T18:32:34.787606+0000","last_clean":"2024-09-13T18:32:34.787606+0000","last_became_active":"2024-09-13T18:32:33.811431+0000","last_became_peered":"2024-09-13T18:32:33.811431+0000","last_unstale":"2024-09-13T18:32:34.787606+0000","last_undegraded":"2024-09-13T18:32:34.787606+0000","last_fullsized":"2024-09-13T18:32:34.787606+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:54.841297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977990+0000","last_change":"2024-09-13T18:32:33.789940+0000","last_active":"2024-09-13T18:32:35.977990+0000","last_peered":"2024-09-13T18:32:35.977990+0000","last_clean":"2024-09-13T18:32:35.977990+0000","last_became_active":"2024-09-13T18:32:33.789710+0000","last_became_peered":"2024-09-13T18:32:33.789710+0000","last_unstale":"2024-09-13T18:32:35.977990+0000","last_undegraded":"2024-09-13T18:32:35.977990+0000","last_fullsized":"2024-09-13T18:32:35.977990+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:58.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977747+0000","last_change":"2024-09-13T18:32:33.828419+0000","last_active":"2024-09-13T18:32:35.977747+0000","last_peered":"2024-09-13T18:32:35.977747+0000","last_clean":"2024-09-13T18:32:35.977747+0000","last_became_active":"2024-09-13T18:32:33.827494+0000","last_became_peered":"2024-09-13T18:32:33.827494+0000","last_unstale":"2024-09-13T18:32:35.977747+0000","last_undegraded":"2024-09-13T18:32:35.977747+0000","last_fullsized":"2024-09-13T18:32:35.977747+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:18.651202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.789070+0000","last_change":"2024-09-13T18:32:33.834165+0000","last_active":"2024-09-13T18:32:34.789070+0000","last_peered":"2024-09-13T18:32:34.789070+0000","last_clean":"2024-09-13T18:32:34.789070+0000","last_became_active":"2024-09-13T18:32:33.833102+0000","last_became_peered":"2024-09-13T18:32:33.833102+0000","last_unstale":"2024-09-13T18:32:34.789070+0000","last_undegraded":"2024-09-13T18:32:34.789070+0000","last_fullsized":"2024-09-13T18:32:34.789070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:04.488154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978048+0000","last_change":"2024-09-13T18:32:33.819392+0000","last_active":"2024-09-13T18:32:35.978048+0000","last_peered":"2024-09-13T18:32:35.978048+0000","last_clean":"2024-09-13T18:32:35.978048+0000","last_became_active":"2024-09-13T18:32:33.818308+0000","last_became_peered":"2024-09-13T18:32:33.818308+0000","last_unstale":"2024-09-13T18:32:35.978048+0000","last_undegraded":"2024-09-13T18:32:35.978048+0000","last_fullsized":"2024-09-13T18:32:35.978048+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:27.274268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786969+0000","last_change":"2024-09-13T18:32:33.827300+0000","last_active":"2024-09-13T18:32:34.786969+0000","last_peered":"2024-09-13T18:32:34.786969+0000","last_clean":"2024-09-13T18:32:34.786969+0000","last_became_active":"2024-09-13T18:32:33.827033+0000","last_became_peered":"2024-09-13T18:32:33.827033+0000","last_unstale":"2024-09-13T18:32:34.786969+0000","last_undegraded":"2024-09-13T18:32:34.786969+0000","last_fullsized":"2024-09-13T18:32:34.786969+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:46.055809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978046+0000","last_change":"2024-09-13T18:32:33.818453+0000","last_active":"2024-09-13T18:32:35.978046+0000","last_peered":"2024-09-13T18:32:35.978046+0000","last_clean":"2024-09-13T18:32:35.978046+0000","last_became_active":"2024-09-13T18:32:33.818186+0000","last_became_peered":"2024-09-13T18:32:33.818186+0000","last_unstale":"2024-09-13T18:32:35.978046+0000","last_undegraded":"2024-09-13T18:32:35.978046+0000","last_fullsized":"2024-09-13T18:32:35.978046+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:21.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786405+0000","last_change":"2024-09-13T18:32:33.784740+0000","last_active":"2024-09-13T18:32:34.786405+0000","last_peered":"2024-09-13T18:32:34.786405+0000","last_clean":"2024-09-13T18:32:34.786405+0000","last_became_active":"2024-09-13T18:32:33.784452+0000","last_became_peered":"2024-09-13T18:32:33.784452+0000","last_unstale":"2024-09-13T18:32:34.786405+0000","last_undegraded":"2024-09-13T18:32:34.786405+0000","last_fullsized":"2024-09-13T18:32:34.786405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:20.179497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977162+0000","last_change":"2024-09-13T18:32:33.790722+0000","last_active":"2024-09-13T18:32:35.977162+0000","last_peered":"2024-09-13T18:32:35.977162+0000","last_clean":"2024-09-13T18:32:35.977162+0000","last_became_active":"2024-09-13T18:32:33.790424+0000","last_became_peered":"2024-09-13T18:32:33.790424+0000","last_unstale":"2024-09-13T18:32:35.977162+0000","last_undegraded":"2024-09-13T18:32:35.977162+0000","last_fullsized":"2024-09-13T18:32:35.977162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:45.919731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950990+0000","last_change":"2024-09-13T18:32:33.821759+0000","last_active":"2024-09-13T18:32:34.950990+0000","last_peered":"2024-09-13T18:32:34.950990+0000","last_clean":"2024-09-13T18:32:34.950990+0000","last_became_active":"2024-09-13T18:32:33.821137+0000","last_became_peered":"2024-09-13T18:32:33.821137+0000","last_unstale":"2024-09-13T18:32:34.950990+0000","last_undegraded":"2024-09-13T18:32:34.950990+0000","last_fullsized":"2024-09-13T18:32:34.950990+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:58.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786770+0000","last_change":"2024-09-13T18:32:33.790635+0000","last_active":"2024-09-13T18:32:34.786770+0000","last_peered":"2024-09-13T18:32:34.786770+0000","last_clean":"2024-09-13T18:32:34.786770+0000","last_became_active":"2024-09-13T18:32:33.790382+0000","last_became_peered":"2024-09-13T18:32:33.790382+0000","last_unstale":"2024-09-13T18:32:34.786770+0000","last_undegraded":"2024-09-13T18:32:34.786770+0000","last_fullsized":"2024-09-13T18:32:34.786770+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:00.079410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950792+0000","last_change":"2024-09-13T18:32:33.822373+0000","last_active":"2024-09-13T18:32:34.950792+0000","last_peered":"2024-09-13T18:32:34.950792+0000","last_clean":"2024-09-13T18:32:34.950792+0000","last_became_active":"2024-09-13T18:32:33.821727+0000","last_became_peered":"2024-09-13T18:32:33.821727+0000","last_unstale":"2024-09-13T18:32:34.950792+0000","last_undegraded":"2024-09-13T18:32:34.950792+0000","last_fullsized":"2024-09-13T18:32:34.950792+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978354+0000","last_change":"2024-09-13T18:32:33.817767+0000","last_active":"2024-09-13T18:32:35.978354+0000","last_peered":"2024-09-13T18:32:35.978354+0000","last_clean":"2024-09-13T18:32:35.978354+0000","last_became_active":"2024-09-13T18:32:33.816781+0000","last_became_peered":"2024-09-13T18:32:33.816781+0000","last_unstale":"2024-09-13T18:32:35.978354+0000","last_undegraded":"2024-09-13T18:32:35.978354+0000","last_fullsized":"2024-09-13T18:32:35.978354+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:58.586795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788548+0000","last_change":"2024-09-13T18:32:33.827648+0000","last_active":"2024-09-13T18:32:34.788548+0000","last_peered":"2024-09-13T18:32:34.788548+0000","last_clean":"2024-09-13T18:32:34.788548+0000","last_became_active":"2024-09-13T18:32:33.824848+0000","last_became_peered":"2024-09-13T18:32:33.824848+0000","last_unstale":"2024-09-13T18:32:34.788548+0000","last_undegraded":"2024-09-13T18:32:34.788548+0000","last_fullsized":"2024-09-13T18:32:34.788548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:41.154706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950144+0000","last_change":"2024-09-13T18:32:33.804780+0000","last_active":"2024-09-13T18:32:34.950144+0000","last_peered":"2024-09-13T18:32:34.950144+0000","last_clean":"2024-09-13T18:32:34.950144+0000","last_became_active":"2024-09-13T18:32:33.804071+0000","last_became_peered":"2024-09-13T18:32:33.804071+0000","last_unstale":"2024-09-13T18:32:34.950144+0000","last_undegraded":"2024-09-13T18:32:34.950144+0000","last_fullsized":"2024-09-13T18:32:34.950144+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:54.557300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977916+0000","last_change":"2024-09-13T18:32:33.788921+0000","last_active":"2024-09-13T18:32:35.977916+0000","last_peered":"2024-09-13T18:32:35.977916+0000","last_clean":"2024-09-13T18:32:35.977916+0000","last_became_active":"2024-09-13T18:32:33.787379+0000","last_became_peered":"2024-09-13T18:32:33.787379+0000","last_unstale":"2024-09-13T18:32:35.977916+0000","last_undegraded":"2024-09-13T18:32:35.977916+0000","last_fullsized":"2024-09-13T18:32:35.977916+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:23.550606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951092+0000","last_change":"2024-09-13T18:32:33.815748+0000","last_active":"2024-09-13T18:32:34.951092+0000","last_peered":"2024-09-13T18:32:34.951092+0000","last_clean":"2024-09-13T18:32:34.951092+0000","last_became_active":"2024-09-13T18:32:33.814966+0000","last_became_peered":"2024-09-13T18:32:33.814966+0000","last_unstale":"2024-09-13T18:32:34.951092+0000","last_undegraded":"2024-09-13T18:32:34.951092+0000","last_fullsized":"2024-09-13T18:32:34.951092+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:20.205346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977070+0000","last_change":"2024-09-13T18:32:33.824811+0000","last_active":"2024-09-13T18:32:35.977070+0000","last_peered":"2024-09-13T18:32:35.977070+0000","last_clean":"2024-09-13T18:32:35.977070+0000","last_became_active":"2024-09-13T18:32:33.823742+0000","last_became_peered":"2024-09-13T18:32:33.823742+0000","last_unstale":"2024-09-13T18:32:35.977070+0000","last_undegraded":"2024-09-13T18:32:35.977070+0000","last_fullsized":"2024-09-13T18:32:35.977070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:58.915412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787230+0000","last_change":"2024-09-13T18:32:33.786294+0000","last_active":"2024-09-13T18:32:34.787230+0000","last_peered":"2024-09-13T18:32:34.787230+0000","last_clean":"2024-09-13T18:32:34.787230+0000","last_became_active":"2024-09-13T18:32:33.786018+0000","last_became_peered":"2024-09-13T18:32:33.786018+0000","last_unstale":"2024-09-13T18:32:34.787230+0000","last_undegraded":"2024-09-13T18:32:34.787230+0000","last_fullsized":"2024-09-13T18:32:34.787230+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:40.548118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979901+0000","last_change":"2024-09-13T18:32:33.786100+0000","last_active":"2024-09-13T18:32:35.979901+0000","last_peered":"2024-09-13T18:32:35.979901+0000","last_clean":"2024-09-13T18:32:35.979901+0000","last_became_active":"2024-09-13T18:32:33.785846+0000","last_became_peered":"2024-09-13T18:32:33.785846+0000","last_unstale":"2024-09-13T18:32:35.979901+0000","last_undegraded":"2024-09-13T18:32:35.979901+0000","last_fullsized":"2024-09-13T18:32:35.979901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:10.553097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950719+0000","last_change":"2024-09-13T18:32:33.831887+0000","last_active":"2024-09-13T18:32:34.950719+0000","last_peered":"2024-09-13T18:32:34.950719+0000","last_clean":"2024-09-13T18:32:34.950719+0000","last_became_active":"2024-09-13T18:32:33.831272+0000","last_became_peered":"2024-09-13T18:32:33.831272+0000","last_unstale":"2024-09-13T18:32:34.950719+0000","last_undegraded":"2024-09-13T18:32:34.950719+0000","last_fullsized":"2024-09-13T18:32:34.950719+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:13.873493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.789097+0000","last_change":"2024-09-13T18:32:33.827054+0000","last_active":"2024-09-13T18:32:34.789097+0000","last_peered":"2024-09-13T18:32:34.789097+0000","last_clean":"2024-09-13T18:32:34.789097+0000","last_became_active":"2024-09-13T18:32:33.824083+0000","last_became_peered":"2024-09-13T18:32:33.824083+0000","last_unstale":"2024-09-13T18:32:34.789097+0000","last_undegraded":"2024-09-13T18:32:34.789097+0000","last_fullsized":"2024-09-13T18:32:34.789097+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:00.414722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788371+0000","last_change":"2024-09-13T18:32:33.820207+0000","last_active":"2024-09-13T18:32:34.788371+0000","last_peered":"2024-09-13T18:32:34.788371+0000","last_clean":"2024-09-13T18:32:34.788371+0000","last_became_active":"2024-09-13T18:32:33.818585+0000","last_became_peered":"2024-09-13T18:32:33.818585+0000","last_unstale":"2024-09-13T18:32:34.788371+0000","last_undegraded":"2024-09-13T18:32:34.788371+0000","last_fullsized":"2024-09-13T18:32:34.788371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:41.663464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950207+0000","last_change":"2024-09-13T18:32:33.822129+0000","last_active":"2024-09-13T18:32:34.950207+0000","last_peered":"2024-09-13T18:32:34.950207+0000","last_clean":"2024-09-13T18:32:34.950207+0000","last_became_active":"2024-09-13T18:32:33.821422+0000","last_became_peered":"2024-09-13T18:32:33.821422+0000","last_unstale":"2024-09-13T18:32:34.950207+0000","last_undegraded":"2024-09-13T18:32:34.950207+0000","last_fullsized":"2024-09-13T18:32:34.950207+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:07.091127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979868+0000","last_change":"2024-09-13T18:32:33.788247+0000","last_active":"2024-09-13T18:32:35.979868+0000","last_peered":"2024-09-13T18:32:35.979868+0000","last_clean":"2024-09-13T18:32:35.979868+0000","last_became_active":"2024-09-13T18:32:33.787764+0000","last_became_peered":"2024-09-13T18:32:33.787764+0000","last_unstale":"2024-09-13T18:32:35.979868+0000","last_undegraded":"2024-09-13T18:32:35.979868+0000","last_fullsized":"2024-09-13T18:32:35.979868+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:49.661271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787420+0000","last_change":"2024-09-13T18:32:33.791031+0000","last_active":"2024-09-13T18:32:34.787420+0000","last_peered":"2024-09-13T18:32:34.787420+0000","last_clean":"2024-09-13T18:32:34.787420+0000","last_became_active":"2024-09-13T18:32:33.790485+0000","last_became_peered":"2024-09-13T18:32:33.790485+0000","last_unstale":"2024-09-13T18:32:34.787420+0000","last_undegraded":"2024-09-13T18:32:34.787420+0000","last_fullsized":"2024-09-13T18:32:34.787420+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:18.227242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979000+0000","last_change":"2024-09-13T18:32:33.828807+0000","last_active":"2024-09-13T18:32:35.979000+0000","last_peered":"2024-09-13T18:32:35.979000+0000","last_clean":"2024-09-13T18:32:35.979000+0000","last_became_active":"2024-09-13T18:32:33.828520+0000","last_became_peered":"2024-09-13T18:32:33.828520+0000","last_unstale":"2024-09-13T18:32:35.979000+0000","last_undegraded":"2024-09-13T18:32:35.979000+0000","last_fullsized":"2024-09-13T18:32:35.979000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:58.270636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979418+0000","last_change":"2024-09-13T18:32:33.832439+0000","last_active":"2024-09-13T18:32:35.979418+0000","last_peered":"2024-09-13T18:32:35.979418+0000","last_clean":"2024-09-13T18:32:35.979418+0000","last_became_active":"2024-09-13T18:32:33.832160+0000","last_became_peered":"2024-09-13T18:32:33.832160+0000","last_unstale":"2024-09-13T18:32:35.979418+0000","last_undegraded":"2024-09-13T18:32:35.979418+0000","last_fullsized":"2024-09-13T18:32:35.979418+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:08.827000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786593+0000","last_change":"2024-09-13T18:32:33.826859+0000","last_active":"2024-09-13T18:32:34.786593+0000","last_peered":"2024-09-13T18:32:34.786593+0000","last_clean":"2024-09-13T18:32:34.786593+0000","last_became_active":"2024-09-13T18:32:33.826583+0000","last_became_peered":"2024-09-13T18:32:33.826583+0000","last_unstale":"2024-09-13T18:32:34.786593+0000","last_undegraded":"2024-09-13T18:32:34.786593+0000","last_fullsized":"2024-09-13T18:32:34.786593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:11.432452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788778+0000","last_change":"2024-09-13T18:32:33.826451+0000","last_active":"2024-09-13T18:32:34.788778+0000","last_peered":"2024-09-13T18:32:34.788778+0000","last_clean":"2024-09-13T18:32:34.788778+0000","last_became_active":"2024-09-13T18:32:33.823214+0000","last_became_peered":"2024-09-13T18:32:33.823214+0000","last_unstale":"2024-09-13T18:32:34.788778+0000","last_undegraded":"2024-09-13T18:32:34.788778+0000","last_fullsized":"2024-09-13T18:32:34.788778+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:41.125154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977287+0000","last_change":"2024-09-13T18:32:33.824255+0000","last_active":"2024-09-13T18:32:35.977287+0000","last_peered":"2024-09-13T18:32:35.977287+0000","last_clean":"2024-09-13T18:32:35.977287+0000","last_became_active":"2024-09-13T18:32:33.823964+0000","last_became_peered":"2024-09-13T18:32:33.823964+0000","last_unstale":"2024-09-13T18:32:35.977287+0000","last_undegraded":"2024-09-13T18:32:35.977287+0000","last_fullsized":"2024-09-13T18:32:35.977287+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978162+0000","last_change":"2024-09-13T18:32:33.785340+0000","last_active":"2024-09-13T18:32:35.978162+0000","last_peered":"2024-09-13T18:32:35.978162+0000","last_clean":"2024-09-13T18:32:35.978162+0000","last_became_active":"2024-09-13T18:32:33.785090+0000","last_became_peered":"2024-09-13T18:32:33.785090+0000","last_unstale":"2024-09-13T18:32:35.978162+0000","last_undegraded":"2024-09-13T18:32:35.978162+0000","last_fullsized":"2024-09-13T18:32:35.978162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:22.574049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951243+0000","last_change":"2024-09-13T18:32:33.827675+0000","last_active":"2024-09-13T18:32:34.951243+0000","last_peered":"2024-09-13T18:32:34.951243+0000","last_clean":"2024-09-13T18:32:34.951243+0000","last_became_active":"2024-09-13T18:32:33.827033+0000","last_became_peered":"2024-09-13T18:32:33.827033+0000","last_unstale":"2024-09-13T18:32:34.951243+0000","last_undegraded":"2024-09-13T18:32:34.951243+0000","last_fullsized":"2024-09-13T18:32:34.951243+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:45.423965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"135'4","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.835512+0000","last_change":"2024-09-13T18:32:33.426755+0000","last_active":"2024-09-13T18:32:33.835512+0000","last_peered":"2024-09-13T18:32:33.835512+0000","last_clean":"2024-09-13T18:32:33.835512+0000","last_became_active":"2024-09-13T18:32:33.425067+0000","last_became_peered":"2024-09-13T18:32:33.425067+0000","last_unstale":"2024-09-13T18:32:33.835512+0000","last_undegraded":"2024-09-13T18:32:33.835512+0000","last_fullsized":"2024-09-13T18:32:33.835512+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:08.119303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978446+0000","last_change":"2024-09-13T18:32:33.789719+0000","last_active":"2024-09-13T18:32:35.978446+0000","last_peered":"2024-09-13T18:32:35.978446+0000","last_clean":"2024-09-13T18:32:35.978446+0000","last_became_active":"2024-09-13T18:32:33.789469+0000","last_became_peered":"2024-09-13T18:32:33.789469+0000","last_unstale":"2024-09-13T18:32:35.978446+0000","last_undegraded":"2024-09-13T18:32:35.978446+0000","last_fullsized":"2024-09-13T18:32:35.978446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:23.933809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815760+0000","last_change":"2024-09-13T18:32:33.400314+0000","last_active":"2024-09-13T18:32:33.815760+0000","last_peered":"2024-09-13T18:32:33.815760+0000","last_clean":"2024-09-13T18:32:33.815760+0000","last_became_active":"2024-09-13T18:32:33.400037+0000","last_became_peered":"2024-09-13T18:32:33.400037+0000","last_unstale":"2024-09-13T18:32:33.815760+0000","last_undegraded":"2024-09-13T18:32:33.815760+0000","last_fullsized":"2024-09-13T18:32:33.815760+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:13.401915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.786761+0000","last_change":"2024-09-13T18:32:33.819421+0000","last_active":"2024-09-13T18:32:34.786761+0000","last_peered":"2024-09-13T18:32:34.786761+0000","last_clean":"2024-09-13T18:32:34.786761+0000","last_became_active":"2024-09-13T18:32:33.819124+0000","last_became_peered":"2024-09-13T18:32:33.819124+0000","last_unstale":"2024-09-13T18:32:34.786761+0000","last_undegraded":"2024-09-13T18:32:34.786761+0000","last_fullsized":"2024-09-13T18:32:34.786761+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:23.808011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.837457+0000","last_change":"2024-09-13T18:32:33.423218+0000","last_active":"2024-09-13T18:32:33.837457+0000","last_peered":"2024-09-13T18:32:33.837457+0000","last_clean":"2024-09-13T18:32:33.837457+0000","last_became_active":"2024-09-13T18:32:33.422543+0000","last_became_peered":"2024-09-13T18:32:33.422543+0000","last_unstale":"2024-09-13T18:32:33.837457+0000","last_undegraded":"2024-09-13T18:32:33.837457+0000","last_fullsized":"2024-09-13T18:32:33.837457+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:22.801823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950638+0000","last_change":"2024-09-13T18:32:33.827593+0000","last_active":"2024-09-13T18:32:34.950638+0000","last_peered":"2024-09-13T18:32:34.950638+0000","last_clean":"2024-09-13T18:32:34.950638+0000","last_became_active":"2024-09-13T18:32:33.826966+0000","last_became_peered":"2024-09-13T18:32:33.826966+0000","last_unstale":"2024-09-13T18:32:34.950638+0000","last_undegraded":"2024-09-13T18:32:34.950638+0000","last_fullsized":"2024-09-13T18:32:34.950638+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:45.919731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.837441+0000","last_change":"2024-09-13T18:32:33.415194+0000","last_active":"2024-09-13T18:32:33.837441+0000","last_peered":"2024-09-13T18:32:33.837441+0000","last_clean":"2024-09-13T18:32:33.837441+0000","last_became_active":"2024-09-13T18:32:33.413840+0000","last_became_peered":"2024-09-13T18:32:33.413840+0000","last_unstale":"2024-09-13T18:32:33.837441+0000","last_undegraded":"2024-09-13T18:32:33.837441+0000","last_fullsized":"2024-09-13T18:32:33.837441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:44.889998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977735+0000","last_change":"2024-09-13T18:32:33.826111+0000","last_active":"2024-09-13T18:32:35.977735+0000","last_peered":"2024-09-13T18:32:35.977735+0000","last_clean":"2024-09-13T18:32:35.977735+0000","last_became_active":"2024-09-13T18:32:33.825828+0000","last_became_peered":"2024-09-13T18:32:33.825828+0000","last_unstale":"2024-09-13T18:32:35.977735+0000","last_undegraded":"2024-09-13T18:32:35.977735+0000","last_fullsized":"2024-09-13T18:32:35.977735+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:07.091127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815930+0000","last_change":"2024-09-13T18:32:33.428261+0000","last_active":"2024-09-13T18:32:33.815930+0000","last_peered":"2024-09-13T18:32:33.815930+0000","last_clean":"2024-09-13T18:32:33.815930+0000","last_became_active":"2024-09-13T18:32:33.427870+0000","last_became_peered":"2024-09-13T18:32:33.427870+0000","last_unstale":"2024-09-13T18:32:33.815930+0000","last_undegraded":"2024-09-13T18:32:33.815930+0000","last_fullsized":"2024-09-13T18:32:33.815930+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:57.855160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788663+0000","last_change":"2024-09-13T18:32:33.829559+0000","last_active":"2024-09-13T18:32:34.788663+0000","last_peered":"2024-09-13T18:32:34.788663+0000","last_clean":"2024-09-13T18:32:34.788663+0000","last_became_active":"2024-09-13T18:32:33.828891+0000","last_became_peered":"2024-09-13T18:32:33.828891+0000","last_unstale":"2024-09-13T18:32:34.788663+0000","last_undegraded":"2024-09-13T18:32:34.788663+0000","last_fullsized":"2024-09-13T18:32:34.788663+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:54.990593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.816688+0000","last_change":"2024-09-13T18:32:33.430224+0000","last_active":"2024-09-13T18:32:33.816688+0000","last_peered":"2024-09-13T18:32:33.816688+0000","last_clean":"2024-09-13T18:32:33.816688+0000","last_became_active":"2024-09-13T18:32:33.429571+0000","last_became_peered":"2024-09-13T18:32:33.429571+0000","last_unstale":"2024-09-13T18:32:33.816688+0000","last_undegraded":"2024-09-13T18:32:33.816688+0000","last_fullsized":"2024-09-13T18:32:33.816688+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:47.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977233+0000","last_change":"2024-09-13T18:32:33.788325+0000","last_active":"2024-09-13T18:32:35.977233+0000","last_peered":"2024-09-13T18:32:35.977233+0000","last_clean":"2024-09-13T18:32:35.977233+0000","last_became_active":"2024-09-13T18:32:33.788044+0000","last_became_peered":"2024-09-13T18:32:33.788044+0000","last_unstale":"2024-09-13T18:32:35.977233+0000","last_undegraded":"2024-09-13T18:32:35.977233+0000","last_fullsized":"2024-09-13T18:32:35.977233+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:34.559447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.778008+0000","last_change":"2024-09-13T18:32:33.408358+0000","last_active":"2024-09-13T18:32:33.778008+0000","last_peered":"2024-09-13T18:32:33.778008+0000","last_clean":"2024-09-13T18:32:33.778008+0000","last_became_active":"2024-09-13T18:32:33.408047+0000","last_became_peered":"2024-09-13T18:32:33.408047+0000","last_unstale":"2024-09-13T18:32:33.778008+0000","last_undegraded":"2024-09-13T18:32:33.778008+0000","last_fullsized":"2024-09-13T18:32:33.778008+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:43.005792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978544+0000","last_change":"2024-09-13T18:32:33.789016+0000","last_active":"2024-09-13T18:32:35.978544+0000","last_peered":"2024-09-13T18:32:35.978544+0000","last_clean":"2024-09-13T18:32:35.978544+0000","last_became_active":"2024-09-13T18:32:33.788357+0000","last_became_peered":"2024-09-13T18:32:33.788357+0000","last_unstale":"2024-09-13T18:32:35.978544+0000","last_undegraded":"2024-09-13T18:32:35.978544+0000","last_fullsized":"2024-09-13T18:32:35.978544+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:47.237441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.798974+0000","last_change":"2024-09-13T18:32:33.429356+0000","last_active":"2024-09-13T18:32:33.798974+0000","last_peered":"2024-09-13T18:32:33.798974+0000","last_clean":"2024-09-13T18:32:33.798974+0000","last_became_active":"2024-09-13T18:32:33.428721+0000","last_became_peered":"2024-09-13T18:32:33.428721+0000","last_unstale":"2024-09-13T18:32:33.798974+0000","last_undegraded":"2024-09-13T18:32:33.798974+0000","last_fullsized":"2024-09-13T18:32:33.798974+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:43.220669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978375+0000","last_change":"2024-09-13T18:32:33.787225+0000","last_active":"2024-09-13T18:32:35.978375+0000","last_peered":"2024-09-13T18:32:35.978375+0000","last_clean":"2024-09-13T18:32:35.978375+0000","last_became_active":"2024-09-13T18:32:33.786516+0000","last_became_peered":"2024-09-13T18:32:33.786516+0000","last_unstale":"2024-09-13T18:32:35.978375+0000","last_undegraded":"2024-09-13T18:32:35.978375+0000","last_fullsized":"2024-09-13T18:32:35.978375+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:46.055809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.783455+0000","last_change":"2024-09-13T18:32:33.401321+0000","last_active":"2024-09-13T18:32:33.783455+0000","last_peered":"2024-09-13T18:32:33.783455+0000","last_clean":"2024-09-13T18:32:33.783455+0000","last_became_active":"2024-09-13T18:32:33.401054+0000","last_became_peered":"2024-09-13T18:32:33.401054+0000","last_unstale":"2024-09-13T18:32:33.783455+0000","last_undegraded":"2024-09-13T18:32:33.783455+0000","last_fullsized":"2024-09-13T18:32:33.783455+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:17.779023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950931+0000","last_change":"2024-09-13T18:32:33.814876+0000","last_active":"2024-09-13T18:32:34.950931+0000","last_peered":"2024-09-13T18:32:34.950931+0000","last_clean":"2024-09-13T18:32:34.950931+0000","last_became_active":"2024-09-13T18:32:33.814132+0000","last_became_peered":"2024-09-13T18:32:33.814132+0000","last_unstale":"2024-09-13T18:32:34.950931+0000","last_undegraded":"2024-09-13T18:32:34.950931+0000","last_fullsized":"2024-09-13T18:32:34.950931+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:58.390399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.801311+0000","last_change":"2024-09-13T18:32:33.425239+0000","last_active":"2024-09-13T18:32:33.801311+0000","last_peered":"2024-09-13T18:32:33.801311+0000","last_clean":"2024-09-13T18:32:33.801311+0000","last_became_active":"2024-09-13T18:32:33.424481+0000","last_became_peered":"2024-09-13T18:32:33.424481+0000","last_unstale":"2024-09-13T18:32:33.801311+0000","last_undegraded":"2024-09-13T18:32:33.801311+0000","last_fullsized":"2024-09-13T18:32:33.801311+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:44.756564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979123+0000","last_change":"2024-09-13T18:32:33.782307+0000","last_active":"2024-09-13T18:32:35.979123+0000","last_peered":"2024-09-13T18:32:35.979123+0000","last_clean":"2024-09-13T18:32:35.979123+0000","last_became_active":"2024-09-13T18:32:33.782057+0000","last_became_peered":"2024-09-13T18:32:33.782057+0000","last_unstale":"2024-09-13T18:32:35.979123+0000","last_undegraded":"2024-09-13T18:32:35.979123+0000","last_fullsized":"2024-09-13T18:32:35.979123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:37.268301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"135'6","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.817574+0000","last_change":"2024-09-13T18:32:33.405310+0000","last_active":"2024-09-13T18:32:33.817574+0000","last_peered":"2024-09-13T18:32:33.817574+0000","last_clean":"2024-09-13T18:32:33.817574+0000","last_became_active":"2024-09-13T18:32:33.405021+0000","last_became_peered":"2024-09-13T18:32:33.405021+0000","last_unstale":"2024-09-13T18:32:33.817574+0000","last_undegraded":"2024-09-13T18:32:33.817574+0000","last_fullsized":"2024-09-13T18:32:33.817574+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:57.374528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.976836+0000","last_change":"2024-09-13T18:32:33.834679+0000","last_active":"2024-09-13T18:32:35.976836+0000","last_peered":"2024-09-13T18:32:35.976836+0000","last_clean":"2024-09-13T18:32:35.976836+0000","last_became_active":"2024-09-13T18:32:33.833989+0000","last_became_peered":"2024-09-13T18:32:33.833989+0000","last_unstale":"2024-09-13T18:32:35.976836+0000","last_undegraded":"2024-09-13T18:32:35.976836+0000","last_fullsized":"2024-09-13T18:32:35.976836+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:07.528466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826365+0000","last_change":"2024-09-13T18:32:33.421547+0000","last_active":"2024-09-13T18:32:33.826365+0000","last_peered":"2024-09-13T18:32:33.826365+0000","last_clean":"2024-09-13T18:32:33.826365+0000","last_became_active":"2024-09-13T18:32:33.420825+0000","last_became_peered":"2024-09-13T18:32:33.420825+0000","last_unstale":"2024-09-13T18:32:33.826365+0000","last_undegraded":"2024-09-13T18:32:33.826365+0000","last_fullsized":"2024-09-13T18:32:33.826365+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:45.039938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978009+0000","last_change":"2024-09-13T18:32:33.789271+0000","last_active":"2024-09-13T18:32:35.978009+0000","last_peered":"2024-09-13T18:32:35.978009+0000","last_clean":"2024-09-13T18:32:35.978009+0000","last_became_active":"2024-09-13T18:32:33.788779+0000","last_became_peered":"2024-09-13T18:32:33.788779+0000","last_unstale":"2024-09-13T18:32:35.978009+0000","last_undegraded":"2024-09-13T18:32:35.978009+0000","last_fullsized":"2024-09-13T18:32:35.978009+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:13.873493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.803704+0000","last_change":"2024-09-13T18:32:33.430829+0000","last_active":"2024-09-13T18:32:33.803704+0000","last_peered":"2024-09-13T18:32:33.803704+0000","last_clean":"2024-09-13T18:32:33.803704+0000","last_became_active":"2024-09-13T18:32:33.430182+0000","last_became_peered":"2024-09-13T18:32:33.430182+0000","last_unstale":"2024-09-13T18:32:33.803704+0000","last_undegraded":"2024-09-13T18:32:33.803704+0000","last_fullsized":"2024-09-13T18:32:33.803704+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.416581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978346+0000","last_change":"2024-09-13T18:32:33.814214+0000","last_active":"2024-09-13T18:32:35.978346+0000","last_peered":"2024-09-13T18:32:35.978346+0000","last_clean":"2024-09-13T18:32:35.978346+0000","last_became_active":"2024-09-13T18:32:33.813501+0000","last_became_peered":"2024-09-13T18:32:33.813501+0000","last_unstale":"2024-09-13T18:32:35.978346+0000","last_undegraded":"2024-09-13T18:32:35.978346+0000","last_fullsized":"2024-09-13T18:32:35.978346+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:50.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.779832+0000","last_change":"2024-09-13T18:32:33.403647+0000","last_active":"2024-09-13T18:32:33.779832+0000","last_peered":"2024-09-13T18:32:33.779832+0000","last_clean":"2024-09-13T18:32:33.779832+0000","last_became_active":"2024-09-13T18:32:33.403296+0000","last_became_peered":"2024-09-13T18:32:33.403296+0000","last_unstale":"2024-09-13T18:32:33.779832+0000","last_undegraded":"2024-09-13T18:32:33.779832+0000","last_fullsized":"2024-09-13T18:32:33.779832+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:03.997316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.976587+0000","last_change":"2024-09-13T18:32:33.823851+0000","last_active":"2024-09-13T18:32:35.976587+0000","last_peered":"2024-09-13T18:32:35.976587+0000","last_clean":"2024-09-13T18:32:35.976587+0000","last_became_active":"2024-09-13T18:32:33.823081+0000","last_became_peered":"2024-09-13T18:32:33.823081+0000","last_unstale":"2024-09-13T18:32:35.976587+0000","last_undegraded":"2024-09-13T18:32:35.976587+0000","last_fullsized":"2024-09-13T18:32:35.976587+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.009571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"135'8","reported_seq":19,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826039+0000","last_change":"2024-09-13T18:32:33.421915+0000","last_active":"2024-09-13T18:32:33.826039+0000","last_peered":"2024-09-13T18:32:33.826039+0000","last_clean":"2024-09-13T18:32:33.826039+0000","last_became_active":"2024-09-13T18:32:33.421614+0000","last_became_peered":"2024-09-13T18:32:33.421614+0000","last_unstale":"2024-09-13T18:32:33.826039+0000","last_undegraded":"2024-09-13T18:32:33.826039+0000","last_fullsized":"2024-09-13T18:32:33.826039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:45.743441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.951243+0000","last_change":"2024-09-13T18:32:33.814705+0000","last_active":"2024-09-13T18:32:34.951243+0000","last_peered":"2024-09-13T18:32:34.951243+0000","last_clean":"2024-09-13T18:32:34.951243+0000","last_became_active":"2024-09-13T18:32:33.814015+0000","last_became_peered":"2024-09-13T18:32:33.814015+0000","last_unstale":"2024-09-13T18:32:34.951243+0000","last_undegraded":"2024-09-13T18:32:34.951243+0000","last_fullsized":"2024-09-13T18:32:34.951243+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:28.594313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.824281+0000","last_change":"2024-09-13T18:32:33.424045+0000","last_active":"2024-09-13T18:32:33.824281+0000","last_peered":"2024-09-13T18:32:33.824281+0000","last_clean":"2024-09-13T18:32:33.824281+0000","last_became_active":"2024-09-13T18:32:33.423417+0000","last_became_peered":"2024-09-13T18:32:33.423417+0000","last_unstale":"2024-09-13T18:32:33.824281+0000","last_undegraded":"2024-09-13T18:32:33.824281+0000","last_fullsized":"2024-09-13T18:32:33.824281+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:57.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979938+0000","last_change":"2024-09-13T18:32:33.809476+0000","last_active":"2024-09-13T18:32:35.979938+0000","last_peered":"2024-09-13T18:32:35.979938+0000","last_clean":"2024-09-13T18:32:35.979938+0000","last_became_active":"2024-09-13T18:32:33.808979+0000","last_became_peered":"2024-09-13T18:32:33.808979+0000","last_unstale":"2024-09-13T18:32:35.979938+0000","last_undegraded":"2024-09-13T18:32:35.979938+0000","last_fullsized":"2024-09-13T18:32:35.979938+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:40:48.321038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.823899+0000","last_change":"2024-09-13T18:32:33.423041+0000","last_active":"2024-09-13T18:32:33.823899+0000","last_peered":"2024-09-13T18:32:33.823899+0000","last_clean":"2024-09-13T18:32:33.823899+0000","last_became_active":"2024-09-13T18:32:33.422681+0000","last_became_peered":"2024-09-13T18:32:33.422681+0000","last_unstale":"2024-09-13T18:32:33.823899+0000","last_undegraded":"2024-09-13T18:32:33.823899+0000","last_fullsized":"2024-09-13T18:32:33.823899+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:27.455048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977318+0000","last_change":"2024-09-13T18:32:33.829637+0000","last_active":"2024-09-13T18:32:35.977318+0000","last_peered":"2024-09-13T18:32:35.977318+0000","last_clean":"2024-09-13T18:32:35.977318+0000","last_became_active":"2024-09-13T18:32:33.828758+0000","last_became_peered":"2024-09-13T18:32:33.828758+0000","last_unstale":"2024-09-13T18:32:35.977318+0000","last_undegraded":"2024-09-13T18:32:35.977318+0000","last_fullsized":"2024-09-13T18:32:35.977318+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:54.057976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"135'1","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.815547+0000","last_change":"2024-09-13T18:32:33.428265+0000","last_active":"2024-09-13T18:32:33.815547+0000","last_peered":"2024-09-13T18:32:33.815547+0000","last_clean":"2024-09-13T18:32:33.815547+0000","last_became_active":"2024-09-13T18:32:33.427867+0000","last_became_peered":"2024-09-13T18:32:33.427867+0000","last_unstale":"2024-09-13T18:32:33.815547+0000","last_undegraded":"2024-09-13T18:32:33.815547+0000","last_fullsized":"2024-09-13T18:32:33.815547+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:19.514202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787017+0000","last_change":"2024-09-13T18:32:33.832331+0000","last_active":"2024-09-13T18:32:34.787017+0000","last_peered":"2024-09-13T18:32:34.787017+0000","last_clean":"2024-09-13T18:32:34.787017+0000","last_became_active":"2024-09-13T18:32:33.832076+0000","last_became_peered":"2024-09-13T18:32:33.832076+0000","last_unstale":"2024-09-13T18:32:34.787017+0000","last_undegraded":"2024-09-13T18:32:34.787017+0000","last_fullsized":"2024-09-13T18:32:34.787017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:36.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.783875+0000","last_change":"2024-09-13T18:32:33.407815+0000","last_active":"2024-09-13T18:32:33.783875+0000","last_peered":"2024-09-13T18:32:33.783875+0000","last_clean":"2024-09-13T18:32:33.783875+0000","last_became_active":"2024-09-13T18:32:33.407449+0000","last_became_peered":"2024-09-13T18:32:33.407449+0000","last_unstale":"2024-09-13T18:32:33.783875+0000","last_undegraded":"2024-09-13T18:32:33.783875+0000","last_fullsized":"2024-09-13T18:32:33.783875+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:06.225819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.788919+0000","last_change":"2024-09-13T18:32:33.825789+0000","last_active":"2024-09-13T18:32:34.788919+0000","last_peered":"2024-09-13T18:32:34.788919+0000","last_clean":"2024-09-13T18:32:34.788919+0000","last_became_active":"2024-09-13T18:32:33.822350+0000","last_became_peered":"2024-09-13T18:32:33.822350+0000","last_unstale":"2024-09-13T18:32:34.788919+0000","last_undegraded":"2024-09-13T18:32:34.788919+0000","last_fullsized":"2024-09-13T18:32:34.788919+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:56.855304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.826572+0000","last_change":"2024-09-13T18:32:33.422797+0000","last_active":"2024-09-13T18:32:33.826572+0000","last_peered":"2024-09-13T18:32:33.826572+0000","last_clean":"2024-09-13T18:32:33.826572+0000","last_became_active":"2024-09-13T18:32:33.422493+0000","last_became_peered":"2024-09-13T18:32:33.422493+0000","last_unstale":"2024-09-13T18:32:33.826572+0000","last_undegraded":"2024-09-13T18:32:33.826572+0000","last_fullsized":"2024-09-13T18:32:33.826572+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:44.903860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979066+0000","last_change":"2024-09-13T18:32:33.831089+0000","last_active":"2024-09-13T18:32:35.979066+0000","last_peered":"2024-09-13T18:32:35.979066+0000","last_clean":"2024-09-13T18:32:35.979066+0000","last_became_active":"2024-09-13T18:32:33.830776+0000","last_became_peered":"2024-09-13T18:32:33.830776+0000","last_unstale":"2024-09-13T18:32:35.979066+0000","last_undegraded":"2024-09-13T18:32:35.979066+0000","last_fullsized":"2024-09-13T18:32:35.979066+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:48.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.793870+0000","last_change":"2024-09-13T18:32:33.414874+0000","last_active":"2024-09-13T18:32:33.793870+0000","last_peered":"2024-09-13T18:32:33.793870+0000","last_clean":"2024-09-13T18:32:33.793870+0000","last_became_active":"2024-09-13T18:32:33.414166+0000","last_became_peered":"2024-09-13T18:32:33.414166+0000","last_unstale":"2024-09-13T18:32:33.793870+0000","last_undegraded":"2024-09-13T18:32:33.793870+0000","last_fullsized":"2024-09-13T18:32:33.793870+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:59.982897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787995+0000","last_change":"2024-09-13T18:32:33.819506+0000","last_active":"2024-09-13T18:32:34.787995+0000","last_peered":"2024-09-13T18:32:34.787995+0000","last_clean":"2024-09-13T18:32:34.787995+0000","last_became_active":"2024-09-13T18:32:33.818617+0000","last_became_peered":"2024-09-13T18:32:33.818617+0000","last_unstale":"2024-09-13T18:32:34.787995+0000","last_undegraded":"2024-09-13T18:32:34.787995+0000","last_fullsized":"2024-09-13T18:32:34.787995+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:33.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.793549+0000","last_change":"2024-09-13T18:32:33.419123+0000","last_active":"2024-09-13T18:32:33.793549+0000","last_peered":"2024-09-13T18:32:33.793549+0000","last_clean":"2024-09-13T18:32:33.793549+0000","last_became_active":"2024-09-13T18:32:33.418219+0000","last_became_peered":"2024-09-13T18:32:33.418219+0000","last_unstale":"2024-09-13T18:32:33.793549+0000","last_undegraded":"2024-09-13T18:32:33.793549+0000","last_fullsized":"2024-09-13T18:32:33.793549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:49.041040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978294+0000","last_change":"2024-09-13T18:32:33.818290+0000","last_active":"2024-09-13T18:32:35.978294+0000","last_peered":"2024-09-13T18:32:35.978294+0000","last_clean":"2024-09-13T18:32:35.978294+0000","last_became_active":"2024-09-13T18:32:33.818079+0000","last_became_peered":"2024-09-13T18:32:33.818079+0000","last_unstale":"2024-09-13T18:32:35.978294+0000","last_undegraded":"2024-09-13T18:32:35.978294+0000","last_fullsized":"2024-09-13T18:32:35.978294+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:16.162671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.799916+0000","last_change":"2024-09-13T18:32:33.421507+0000","last_active":"2024-09-13T18:32:33.799916+0000","last_peered":"2024-09-13T18:32:33.799916+0000","last_clean":"2024-09-13T18:32:33.799916+0000","last_became_active":"2024-09-13T18:32:33.420729+0000","last_became_peered":"2024-09-13T18:32:33.420729+0000","last_unstale":"2024-09-13T18:32:33.799916+0000","last_undegraded":"2024-09-13T18:32:33.799916+0000","last_fullsized":"2024-09-13T18:32:33.799916+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:19.163626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978637+0000","last_change":"2024-09-13T18:32:33.814762+0000","last_active":"2024-09-13T18:32:35.978637+0000","last_peered":"2024-09-13T18:32:35.978637+0000","last_clean":"2024-09-13T18:32:35.978637+0000","last_became_active":"2024-09-13T18:32:33.812509+0000","last_became_peered":"2024-09-13T18:32:33.812509+0000","last_unstale":"2024-09-13T18:32:35.978637+0000","last_undegraded":"2024-09-13T18:32:35.978637+0000","last_fullsized":"2024-09-13T18:32:35.978637+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:44.604924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"135'2","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.835391+0000","last_change":"2024-09-13T18:32:33.427335+0000","last_active":"2024-09-13T18:32:33.835391+0000","last_peered":"2024-09-13T18:32:33.835391+0000","last_clean":"2024-09-13T18:32:33.835391+0000","last_became_active":"2024-09-13T18:32:33.425972+0000","last_became_peered":"2024-09-13T18:32:33.425972+0000","last_unstale":"2024-09-13T18:32:33.835391+0000","last_undegraded":"2024-09-13T18:32:33.835391+0000","last_fullsized":"2024-09-13T18:32:33.835391+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.211604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977631+0000","last_change":"2024-09-13T18:32:33.838185+0000","last_active":"2024-09-13T18:32:35.977631+0000","last_peered":"2024-09-13T18:32:35.977631+0000","last_clean":"2024-09-13T18:32:35.977631+0000","last_became_active":"2024-09-13T18:32:33.837708+0000","last_became_peered":"2024-09-13T18:32:33.837708+0000","last_unstale":"2024-09-13T18:32:35.977631+0000","last_undegraded":"2024-09-13T18:32:35.977631+0000","last_fullsized":"2024-09-13T18:32:35.977631+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:45.905869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.784327+0000","last_change":"2024-09-13T18:32:33.425880+0000","last_active":"2024-09-13T18:32:33.784327+0000","last_peered":"2024-09-13T18:32:33.784327+0000","last_clean":"2024-09-13T18:32:33.784327+0000","last_became_active":"2024-09-13T18:32:33.425653+0000","last_became_peered":"2024-09-13T18:32:33.425653+0000","last_unstale":"2024-09-13T18:32:33.784327+0000","last_undegraded":"2024-09-13T18:32:33.784327+0000","last_fullsized":"2024-09-13T18:32:33.784327+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:06.402429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.977997+0000","last_change":"2024-09-13T18:32:33.819050+0000","last_active":"2024-09-13T18:32:35.977997+0000","last_peered":"2024-09-13T18:32:35.977997+0000","last_clean":"2024-09-13T18:32:35.977997+0000","last_became_active":"2024-09-13T18:32:33.818753+0000","last_became_peered":"2024-09-13T18:32:33.818753+0000","last_unstale":"2024-09-13T18:32:35.977997+0000","last_undegraded":"2024-09-13T18:32:35.977997+0000","last_fullsized":"2024-09-13T18:32:35.977997+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:54.557300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.785597+0000","last_change":"2024-09-13T18:32:33.405477+0000","last_active":"2024-09-13T18:32:33.785597+0000","last_peered":"2024-09-13T18:32:33.785597+0000","last_clean":"2024-09-13T18:32:33.785597+0000","last_became_active":"2024-09-13T18:32:33.405040+0000","last_became_peered":"2024-09-13T18:32:33.405040+0000","last_unstale":"2024-09-13T18:32:33.785597+0000","last_undegraded":"2024-09-13T18:32:33.785597+0000","last_fullsized":"2024-09-13T18:32:33.785597+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:40.969205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.787017+0000","last_change":"2024-09-13T18:32:33.818707+0000","last_active":"2024-09-13T18:32:34.787017+0000","last_peered":"2024-09-13T18:32:34.787017+0000","last_clean":"2024-09-13T18:32:34.787017+0000","last_became_active":"2024-09-13T18:32:33.818396+0000","last_became_peered":"2024-09-13T18:32:33.818396+0000","last_unstale":"2024-09-13T18:32:34.787017+0000","last_undegraded":"2024-09-13T18:32:34.787017+0000","last_fullsized":"2024-09-13T18:32:34.787017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:47.237441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.785062+0000","last_change":"2024-09-13T18:32:33.405578+0000","last_active":"2024-09-13T18:32:33.785062+0000","last_peered":"2024-09-13T18:32:33.785062+0000","last_clean":"2024-09-13T18:32:33.785062+0000","last_became_active":"2024-09-13T18:32:33.405064+0000","last_became_peered":"2024-09-13T18:32:33.405064+0000","last_unstale":"2024-09-13T18:32:33.785062+0000","last_undegraded":"2024-09-13T18:32:33.785062+0000","last_fullsized":"2024-09-13T18:32:33.785062+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:15.279314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978537+0000","last_change":"2024-09-13T18:32:33.831054+0000","last_active":"2024-09-13T18:32:35.978537+0000","last_peered":"2024-09-13T18:32:35.978537+0000","last_clean":"2024-09-13T18:32:35.978537+0000","last_became_active":"2024-09-13T18:32:33.830434+0000","last_became_peered":"2024-09-13T18:32:33.830434+0000","last_unstale":"2024-09-13T18:32:35.978537+0000","last_undegraded":"2024-09-13T18:32:35.978537+0000","last_fullsized":"2024-09-13T18:32:35.978537+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:18.145689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.780589+0000","last_change":"2024-09-13T18:32:33.413972+0000","last_active":"2024-09-13T18:32:33.780589+0000","last_peered":"2024-09-13T18:32:33.780589+0000","last_clean":"2024-09-13T18:32:33.780589+0000","last_became_active":"2024-09-13T18:32:33.413631+0000","last_became_peered":"2024-09-13T18:32:33.413631+0000","last_unstale":"2024-09-13T18:32:33.780589+0000","last_undegraded":"2024-09-13T18:32:33.780589+0000","last_fullsized":"2024-09-13T18:32:33.780589+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:27.578442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978673+0000","last_change":"2024-09-13T18:32:33.832539+0000","last_active":"2024-09-13T18:32:35.978673+0000","last_peered":"2024-09-13T18:32:35.978673+0000","last_clean":"2024-09-13T18:32:35.978673+0000","last_became_active":"2024-09-13T18:32:33.831858+0000","last_became_peered":"2024-09-13T18:32:33.831858+0000","last_unstale":"2024-09-13T18:32:35.978673+0000","last_undegraded":"2024-09-13T18:32:35.978673+0000","last_fullsized":"2024-09-13T18:32:35.978673+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:56.705450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.794127+0000","last_change":"2024-09-13T18:32:33.424181+0000","last_active":"2024-09-13T18:32:33.794127+0000","last_peered":"2024-09-13T18:32:33.794127+0000","last_clean":"2024-09-13T18:32:33.794127+0000","last_became_active":"2024-09-13T18:32:33.423421+0000","last_became_peered":"2024-09-13T18:32:33.423421+0000","last_unstale":"2024-09-13T18:32:33.794127+0000","last_undegraded":"2024-09-13T18:32:33.794127+0000","last_fullsized":"2024-09-13T18:32:33.794127+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:34.950412+0000","last_change":"2024-09-13T18:32:33.804551+0000","last_active":"2024-09-13T18:32:34.950412+0000","last_peered":"2024-09-13T18:32:34.950412+0000","last_clean":"2024-09-13T18:32:34.950412+0000","last_became_active":"2024-09-13T18:32:33.803899+0000","last_became_peered":"2024-09-13T18:32:33.803899+0000","last_unstale":"2024-09-13T18:32:34.950412+0000","last_undegraded":"2024-09-13T18:32:34.950412+0000","last_fullsized":"2024-09-13T18:32:34.950412+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:34.559447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.789586+0000","last_change":"2024-09-13T18:32:33.422034+0000","last_active":"2024-09-13T18:32:33.789586+0000","last_peered":"2024-09-13T18:32:33.789586+0000","last_clean":"2024-09-13T18:32:33.789586+0000","last_became_active":"2024-09-13T18:32:33.421457+0000","last_became_peered":"2024-09-13T18:32:33.421457+0000","last_unstale":"2024-09-13T18:32:33.789586+0000","last_undegraded":"2024-09-13T18:32:33.789586+0000","last_fullsized":"2024-09-13T18:32:33.789586+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:59.063539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.978270+0000","last_change":"2024-09-13T18:32:33.785222+0000","last_active":"2024-09-13T18:32:35.978270+0000","last_peered":"2024-09-13T18:32:35.978270+0000","last_clean":"2024-09-13T18:32:35.978270+0000","last_became_active":"2024-09-13T18:32:33.784722+0000","last_became_peered":"2024-09-13T18:32:33.784722+0000","last_unstale":"2024-09-13T18:32:35.978270+0000","last_undegraded":"2024-09-13T18:32:35.978270+0000","last_fullsized":"2024-09-13T18:32:35.978270+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:36.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.781679+0000","last_change":"2024-09-13T18:32:33.418240+0000","last_active":"2024-09-13T18:32:33.781679+0000","last_peered":"2024-09-13T18:32:33.781679+0000","last_clean":"2024-09-13T18:32:33.781679+0000","last_became_active":"2024-09-13T18:32:33.417865+0000","last_became_peered":"2024-09-13T18:32:33.417865+0000","last_unstale":"2024-09-13T18:32:33.781679+0000","last_undegraded":"2024-09-13T18:32:33.781679+0000","last_fullsized":"2024-09-13T18:32:33.781679+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:32.923804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-13T18:32:35.979552+0000","last_change":"2024-09-13T18:32:33.819666+0000","last_active":"2024-09-13T18:32:35.979552+0000","last_peered":"2024-09-13T18:32:35.979552+0000","last_clean":"2024-09-13T18:32:35.979552+0000","last_became_active":"2024-09-13T18:32:33.819396+0000","last_became_peered":"2024-09-13T18:32:33.819396+0000","last_unstale":"2024-09-13T18:32:35.979552+0000","last_undegraded":"2024-09-13T18:32:35.979552+0000","last_fullsized":"2024-09-13T18:32:35.979552+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:33.372022+0000","last_clean_scrub_stamp":"2024-09-13T18:32:33.372022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:45.423965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"135'3","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.827088+0000","last_change":"2024-09-13T18:32:33.423551+0000","last_active":"2024-09-13T18:32:33.827088+0000","last_peered":"2024-09-13T18:32:33.827088+0000","last_clean":"2024-09-13T18:32:33.827088+0000","last_became_active":"2024-09-13T18:32:33.421681+0000","last_became_peered":"2024-09-13T18:32:33.421681+0000","last_unstale":"2024-09-13T18:32:33.827088+0000","last_undegraded":"2024-09-13T18:32:33.827088+0000","last_fullsized":"2024-09-13T18:32:33.827088+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:32:32.356151+0000","last_clean_scrub_stamp":"2024-09-13T18:32:32.356151+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:39.532247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":298,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-13T18:32:33.794410+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:32:33.794410+0000","last_peered":"2024-09-13T18:32:33.794410+0000","last_clean":"2024-09-13T18:32:33.794410+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:32:33.794410+0000","last_undegraded":"2024-09-13T18:32:33.794410+0000","last_fullsized":"2024-09-13T18:32:33.794410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33376,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338464,"statfs":{"total":96636764160,"available":96602587136,"internally_reserved":0,"allocated":2306048,"data_stored":1344845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90500000000000003,"15min":0.88300000000000001},"min":{"1min":0.52100000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2330000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.624},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.96399999999999997,"15min":0.90000000000000002},"min":{"1min":0.51100000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.143,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.95199999999999996,"15min":0.93000000000000005},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.129,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.73899999999999999,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.323,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.80600000000000005},"min":{"1min":0.53800000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.57499999999999996,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.1040000000000001,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.88100000000000001,"15min":0.879},"min":{"1min":0.61799999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2070000000000001,"5min":1.349,"15min":1.448},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.94599999999999995,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.84599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1930000000000001,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":1.016},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.93999999999999995},"min":{"1min":0.66700000000000004,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96299999999999997,"15min":1.0249999999999999},"min":{"1min":0.74399999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1919999999999999,"5min":1.5609999999999999,"15min":1.877},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.98699999999999999,"15min":0.97899999999999998},"min":{"1min":0.63900000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.409,"15min":1.409},"last":1.1319999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:31:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0489999999999999,"15min":1.0589999999999999},"min":{"1min":0.74199999999999999,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.4490000000000001,"5min":1.476,"15min":1.476},"last":1.079},{"interface":"front","average":{"1min":1.038,"5min":1.0349999999999999,"15min":1.004},"min":{"1min":0.77600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.361,"5min":1.506,"15min":1.506},"last":1.044}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1716224,"data_stored":753971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.312},"max":{"1min":1.2230000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81000000000000005,"15min":0.78900000000000003},"min":{"1min":0.56499999999999995,"5min":0.48799999999999999,"15min":0.46600000000000003},"max":{"1min":1.117,"5min":1.252,"15min":1.3879999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.92600000000000005,"15min":0.89600000000000002},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.34899999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.577},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97099999999999997,"15min":0.91300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.218,"15min":1.464},"last":0.872}]},{"osd":2,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.84299999999999997,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.92100000000000004,"15min":0.96299999999999997},"min":{"1min":0.69799999999999995,"5min":0.59599999999999997,"15min":0.47499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":2.4220000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91700000000000004,"15min":0.88600000000000001},"min":{"1min":0.68000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88400000000000001,"15min":0.88600000000000001},"min":{"1min":0.65900000000000003,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.306},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.94899999999999995,"15min":0.97299999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.042,"15min":1.0089999999999999},"min":{"1min":0.69399999999999995,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.624,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2310000000000001,"5min":1.2390000000000001,"15min":1.4330000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.03,"15min":1.0880000000000001},"min":{"1min":0.77800000000000002,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":2.762},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:32:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.028,"15min":1.0409999999999999},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.9299999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.111,"5min":1.0249999999999999,"15min":1.044},"min":{"1min":0.84299999999999997,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.72},"last":1.113}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1708032,"data_stored":753847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1850000000000001,"5min":1.2390000000000001,"15min":2.0209999999999999},"last":0.876},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.51000000000000001,"5min":0.46800000000000003,"15min":0.437},"max":{"1min":1.264,"5min":1.264,"15min":2.1840000000000002},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.88300000000000001,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.86399999999999999,"15min":0.83399999999999996},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.5029999999999999},"last":1.048}]},{"osd":2,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.89000000000000001,"15min":0.88},"min":{"1min":0.54800000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.292,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.625},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90800000000000003,"15min":0.95999999999999996},"min":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":2.2589999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.96599999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4650000000000001,"5min":1.6719999999999999,"15min":1.871},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.92600000000000005,"15min":0.93899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.071,"5min":0.998,"15min":1.0409999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.5049999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.98799999999999999,"15min":1.0229999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.95299999999999996,"15min":1.0169999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:32:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"min":{"1min":0.55700000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.488,"5min":1.488,"15min":2.246},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.05,"15min":1.1220000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.9379999999999999},"last":1.0720000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1703936,"data_stored":753825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.95099999999999996,"15min":0.84399999999999997},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3490000000000002,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.94399999999999995,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.52300000000000002,"15min":0.41699999999999998},"max":{"1min":2.4060000000000001,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.56000000000000005,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.2589999999999999,"5min":1.536,"15min":1.536},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61799999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.8069999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.337}]},{"osd":2,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89300000000000002,"15min":0.875},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.139,"5min":1.216,"15min":1.216},"last":1.109},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.89800000000000002},"min":{"1min":0.63200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.367}]},{"osd":3,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.92900000000000005,"15min":0.90700000000000003},"min":{"1min":0.60599999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.026,"15min":0.95899999999999996},"min":{"1min":0.76300000000000001,"5min":0.57799999999999996,"15min":0.52000000000000002},"max":{"1min":1.4159999999999999,"5min":10.44,"15min":10.44},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.65200000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.044,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.67100000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.04}]},{"osd":6,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.117,"15min":1.0349999999999999},"min":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.52000000000000002},"max":{"1min":1.4890000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.3},{"interface":"front","average":{"1min":1.085,"5min":1.2070000000000001,"15min":1.0880000000000001},"min":{"1min":0.76000000000000001,"5min":0.67500000000000004,"15min":0.54100000000000004},"max":{"1min":1.8979999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":0.92300000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:32:05 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1950000000000001,"15min":1.095},"min":{"1min":0.69099999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2269999999999999,"5min":15.593,"15min":15.593},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.0569999999999999,"15min":1.0780000000000001},"min":{"1min":0.77800000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.0089999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1708032,"data_stored":753915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.88200000000000001,"5min":2.113,"15min":2.113},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.77600000000000002,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.67300000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.115,"5min":1.4199999999999999,"15min":1.704},"last":0.745},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.623},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.079,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.376,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.742,"15min":1.742},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.79100000000000004,"15min":0.748},"min":{"1min":0.442,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":1.0629999999999999,"5min":1.224,"15min":1.399},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.69999999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2190000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.98499999999999999,"15min":1.085},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.536,"5min":1.536,"15min":2.8740000000000001},"last":1.304}]},{"osd":5,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98599999999999999,"15min":1.016},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.294,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.94799999999999995,"15min":0.93799999999999994},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2589999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":1.054}]},{"osd":6,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.0549999999999999},"min":{"1min":0.71299999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.665,"5min":1.665,"15min":2.6190000000000002},"last":1.419},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.044,"15min":1.0509999999999999},"min":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53400000000000003},"max":{"1min":1.502,"5min":1.6890000000000001,"15min":1.96},"last":1.167}]},{"osd":7,"last update":"Fri Sep 13 18:31:54 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.036,"15min":1.0880000000000001},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.4470000000000001,"5min":1.665,"15min":3},"last":1.5029999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.032,"15min":1.006},"min":{"1min":0.66900000000000004,"5min":0.625,"15min":0.58699999999999997},"max":{"1min":1.327,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":1.3460000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1720320,"data_stored":755459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.83399999999999996,"5min":0.97999999999999998,"15min":1.0309999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67500000000000004,"15min":0.65300000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.93500000000000005,"5min":1.1200000000000001,"15min":1.335},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.44500000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94999999999999996,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.71399999999999997},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":1.0309999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1859999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.79300000000000004,"15min":0.78000000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.141,"5min":1.405,"15min":1.405},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.91700000000000004,"15min":0.91200000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.212,"5min":1.367,"15min":1.611},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.91600000000000004},"min":{"1min":0.68600000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2210000000000001,"5min":1.587,"15min":1.587},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96699999999999997,"15min":0.997},"min":{"1min":0.60399999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.9179999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.98099999999999998,"15min":0.97299999999999998},"min":{"1min":0.745,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2450000000000001,"5min":1.552,"15min":1.702},"last":0.877}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.57799999999999996,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.472,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0349999999999999,"15min":1.0449999999999999},"min":{"1min":0.66800000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.522,"5min":1.645,"15min":1.645},"last":0.89300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.98299999999999998},"min":{"1min":0.623,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.843,"15min":1.843},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0600000000000001,"15min":1.077},"min":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4330000000000001,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1708032,"data_stored":754407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.61399999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.75900000000000001,"5min":1.0680000000000001,"15min":1.177},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.29699999999999999,"15min":0.28199999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.36299999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.438}]},{"osd":3,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.77200000000000002},"min":{"1min":0.40200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":1.423,"15min":1.423},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.90700000000000003},"min":{"1min":0.628,"5min":0.60899999999999999,"15min":0.51100000000000001},"max":{"1min":1.1220000000000001,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93600000000000005,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.42899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.02}]},{"osd":5,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92800000000000005,"15min":0.92100000000000004},"min":{"1min":0.64200000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3460000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.69499999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4059999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.018,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.27,"5min":1.5900000000000001,"15min":1.653},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.425,"5min":1.5580000000000001,"15min":1.5740000000000001},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:31:56 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.091,"15min":1.0529999999999999},"min":{"1min":0.74299999999999999,"5min":0.61899999999999999,"15min":0.52500000000000002},"max":{"1min":1.4790000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.022},"min":{"1min":0.65800000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.196,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.038}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41568,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330272,"statfs":{"total":96636764160,"available":96594198528,"internally_reserved":0,"allocated":2314240,"data_stored":1345791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.65200000000000002},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0169999999999999,"15min":1.147},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.76300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.03,"5min":1.244,"15min":1.4359999999999999},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1299999999999999,"5min":1.333,"15min":1.333},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.05,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.432}]},{"osd":3,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.69099999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.99199999999999999,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.99299999999999999,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.872,"15min":0.93200000000000005},"min":{"1min":0.56399999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.075,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.96499999999999997,"15min":0.98699999999999999},"min":{"1min":0.59099999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3089999999999999,"5min":1.5069999999999999,"15min":1.986},"last":0.77100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.97899999999999998,"15min":1.002},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.492,"5min":1.8799999999999999,"15min":2.641},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.032},"min":{"1min":0.61599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.304,"5min":1.3580000000000001,"15min":1.6699999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0349999999999999,"15min":1.0649999999999999},"min":{"1min":0.64600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.321,"5min":1.466,"15min":1.891},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.036,"5min":0.996,"15min":1.0229999999999999},"min":{"1min":0.72999999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.752}]},{"osd":7,"last update":"Fri Sep 13 18:31:57 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.006,"15min":1.0249999999999999},"min":{"1min":0.67100000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.669,"5min":1.669,"15min":2.2949999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.1000000000000001},"min":{"1min":0.75600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:32:42.300 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:32:42.300 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:32:42.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53bb4e0640 1 Processor -- start 2024-09-13T18:32:42.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53bb4e0640 1 -- start start 2024-09-13T18:32:42.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53bb4e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 0x7f53b40d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53bb4e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b40b7db0 con 0x7f53b40d3390 2024-09-13T18:32:42.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53bb4e0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b40d0650 con 0x7f53b40ccd10 2024-09-13T18:32:42.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53bb4e0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40d0c10 con 0x7f53b415c830 2024-09-13T18:32:42.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53b9a7d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f53b40d3390 0x7f53b40b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58278/0 (socket says 172.21.15.53:58278) 2024-09-13T18:32:42.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53b9a7d640 1 -- 172.21.15.53:0/173783224 learned_addr learned my addr 172.21.15.53:0/173783224 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:42.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53b927c640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 0x7f53b40d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359860270 0 0) 0x7f53b40b7db0 con 0x7f53b40d3390 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.473+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a0003530 con 0x7f53b40d3390 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2862339306 0 0) 0x7f53a0003530 con 0x7f53b40d3390 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 msgr2=0x7f53b40d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 0x7f53b40d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 >> v1:172.21.15.87:6789/0 conn(0x7f53b40ccd10 legacy=0x7f53b40d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b40cd7d0 con 0x7f53b40d3390 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f53ac001a00 con 0x7f53b40d3390 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 0x7f53b40d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 >> v1:172.21.15.53:6789/0 conn(0x7f53b40d3390 legacy=0x7f53b40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00039b0 0x7f53a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 0x7f53a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a0004d10 0x7f53a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40d0c10 con 0x7f53a00039b0 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a000ba40 con 0x7f53a0004d10 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a000bbb0 con 0x7f53b415c830 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00039b0 0x7f53a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b9a7d640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a0004d10 0x7f53a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b8a7b640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 0x7f53a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 -- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 msgr2=0x7f53a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53b415c830 0x7f53a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 -- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a0004d10 msgr2=0x7f53a0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53a0004d10 0x7f53a0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 -- 172.21.15.53:0/173783224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b0009420 con 0x7f53a00039b0 2024-09-13T18:32:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b927c640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00039b0 0x7f53a0003dd0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009cb0 tx=0x7f53b001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84946779c3db6928 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b00a56b0 con 0x7f53a00039b0 2024-09-13T18:32:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b00a5810 con 0x7f53a00039b0 2024-09-13T18:32:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53abfff640 1 -- 172.21.15.53:0/173783224 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b00a5bc0 con 0x7f53a00039b0 2024-09-13T18:32:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53bb4e0640 1 -- 172.21.15.53:0/173783224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00039b0 msgr2=0x7f53a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53bb4e0640 1 --2- 172.21.15.53:0/173783224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53a00039b0 0x7f53a0003dd0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009cb0 tx=0x7f53b001cc10 comp rx=0 tx=0).stop 2024-09-13T18:32:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53b9a7d640 1 -- 172.21.15.53:0/173783224 reap_dead start 2024-09-13T18:32:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53bb4e0640 1 -- 172.21.15.53:0/173783224 shutdown_connections 2024-09-13T18:32:42.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53bb4e0640 1 -- 172.21.15.53:0/173783224 >> 172.21.15.53:0/173783224 conn(0x7f53b4070970 msgr2=0x7f53b4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:42.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53bb4e0640 1 -- 172.21.15.53:0/173783224 shutdown_connections 2024-09-13T18:32:42.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.477+0000 7f53bb4e0640 1 -- 172.21.15.53:0/173783224 wait complete. 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 Processor -- start 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 -- start start 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00039b0 0x7f53b4163310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53b40c7d10 0x7f53b415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40c8ae0 0x7f53b40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40c78f0 con 0x7f53b40c8ae0 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b415bbd0 con 0x7f53b40c7d10 2024-09-13T18:32:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40c6f50 con 0x7f53a00039b0 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40c8ae0 0x7f53b40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40c8ae0 0x7f53b40b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42108/0 (socket says 172.21.15.53:42108) 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 -- 172.21.15.53:0/2495727612 learned_addr learned my addr 172.21.15.53:0/2495727612 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b927c640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00039b0 0x7f53b4163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b8a7b640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53b40c7d10 0x7f53b415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 -- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00039b0 msgr2=0x7f53b4163310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00039b0 0x7f53b4163310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 -- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53b40c7d10 msgr2=0x7f53b415b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53b40c7d10 0x7f53b415b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 -- 172.21.15.53:0/2495727612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b40c7230 con 0x7f53b40c8ae0 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53b9a7d640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40c8ae0 0x7f53b40b21b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b4290 tx=0x7f53ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53a9ffb640 1 -- 172.21.15.53:0/2495727612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac007a80 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53a9ffb640 1 -- 172.21.15.53:0/2495727612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00edc0 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b40c7510 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53a9ffb640 1 -- 172.21.15.53:0/2495727612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac014670 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b40b26f0 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.481+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b40008e0 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.485+0000 7f53a9ffb640 1 -- 172.21.15.53:0/2495727612 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f53ac0147d0 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.485+0000 7f53a9ffb640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5398066c60 0x7f5398069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.485+0000 7f53a9ffb640 1 -- 172.21.15.53:0/2495727612 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53ac084930 con 0x7f53b40c8ae0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.485+0000 7f53b927c640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5398066c60 0x7f5398069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.485+0000 7f53b927c640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5398066c60 0x7f5398069120 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f53b00af000 tx=0x7f53b00046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.489+0000 7f53a9ffb640 1 -- 172.21.15.53:0/2495727612 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f53ac0514c0 con 0x7f53b40c8ae0 2024-09-13T18:32:42.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.709+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f53b406a270 con 0x7f53b40c8ae0 2024-09-13T18:32:42.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.713+0000 7f53a9ffb640 1 -- 172.21.15.53:0/2495727612 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7f53ac001e40 con 0x7f53b40c8ae0 2024-09-13T18:32:42.717 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:32:42.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5398066c60 msgr2=0x7f5398069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5398066c60 0x7f5398069120 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f53b00af000 tx=0x7f53b00046d0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40c8ae0 msgr2=0x7f53b40b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40c8ae0 0x7f53b40b21b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b4290 tx=0x7f53ac00e530 comp rx=0 tx=0).stop 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 shutdown_connections 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5398066c60 0x7f5398069120 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40c8ae0 0x7f53b40b21b0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53b40c7d10 0x7f53b415b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 --2- 172.21.15.53:0/2495727612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53a00039b0 0x7f53b4163310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 >> 172.21.15.53:0/2495727612 conn(0x7f53b4070970 msgr2=0x7f53b4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 shutdown_connections 2024-09-13T18:32:42.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.717+0000 7f53bb4e0640 1 -- 172.21.15.53:0/2495727612 wait complete. 2024-09-13T18:32:42.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:32:42.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.857+0000 7fec2686c640 1 Processor -- start 2024-09-13T18:32:42.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.857+0000 7fec2686c640 1 -- start start 2024-09-13T18:32:42.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec2686c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec200b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec2686c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec2006d380 0x7fec200b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec2686c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec200cf420 con 0x7fec2015a520 2024-09-13T18:32:42.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec2686c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2006c8a0 con 0x7fec2006d380 2024-09-13T18:32:42.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec2686c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2006cb80 con 0x7fec200cd230 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec24e09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec2006d380 0x7fec200b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fec2015a520 0x7fec200ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58294/0 (socket says 172.21.15.53:58294) 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1ffff640 1 -- 172.21.15.53:0/109180368 learned_addr learned my addr 172.21.15.53:0/109180368 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1f7fe640 1 --2- 172.21.15.53:0/109180368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec200b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1effd640 1 -- 172.21.15.53:0/109180368 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046289841 0 0) 0x7fec200cf420 con 0x7fec2015a520 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1effd640 1 -- 172.21.15.53:0/109180368 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec08003530 con 0x7fec2015a520 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec24e09640 1 -- 172.21.15.53:0/109180368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 msgr2=0x7fec200b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:42.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec24e09640 1 --2- 172.21.15.53:0/109180368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec200b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec24e09640 1 -- 172.21.15.53:0/109180368 >> v1:172.21.15.53:6789/0 conn(0x7fec2015a520 legacy=0x7fec200ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec24e09640 1 -- 172.21.15.53:0/109180368 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2006ce60 con 0x7fec2006d380 2024-09-13T18:32:42.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec24e09640 1 --2- 172.21.15.53:0/109180368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec200b5130 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fec18009d90 tx=0x7fec1801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7054a452c88fb476 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1effd640 1 -- 172.21.15.53:0/109180368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180a59c0 con 0x7fec2006d380 2024-09-13T18:32:42.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1effd640 1 -- 172.21.15.53:0/109180368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec180a5b20 con 0x7fec2006d380 2024-09-13T18:32:42.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.861+0000 7fec1effd640 1 -- 172.21.15.53:0/109180368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180ad440 con 0x7fec2006d380 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- 172.21.15.53:0/109180368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 msgr2=0x7fec200b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 --2- 172.21.15.53:0/109180368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec200b5130 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fec18009d90 tx=0x7fec1801c8e0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- 172.21.15.53:0/109180368 shutdown_connections 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 --2- 172.21.15.53:0/109180368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec200b5130 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 --2- 172.21.15.53:0/109180368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec200b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- 172.21.15.53:0/109180368 >> 172.21.15.53:0/109180368 conn(0x7fec20069f50 msgr2=0x7fec2006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- 172.21.15.53:0/109180368 shutdown_connections 2024-09-13T18:32:42.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- 172.21.15.53:0/109180368 wait complete. 2024-09-13T18:32:42.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 Processor -- start 2024-09-13T18:32:42.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- start start 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec20156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec20157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec2015a520 0x7fec20144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2014f6f0 con 0x7fec2006d380 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec201455f0 con 0x7fec2015a520 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec20150ec0 con 0x7fec200cd230 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec20156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec20156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42136/0 (socket says 172.21.15.53:42136) 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 -- 172.21.15.53:0/1350341269 learned_addr learned my addr 172.21.15.53:0/1350341269 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1f7fe640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec20157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec24e09640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec2015a520 0x7fec20144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 -- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 msgr2=0x7fec20157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec20157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 -- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec2015a520 msgr2=0x7fec20144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec2015a520 0x7fec20144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 -- 172.21.15.53:0/1350341269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18009a70 con 0x7fec2006d380 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1ffff640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec20156860 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fec1000c420 tx=0x7fec1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1cff9640 1 -- 172.21.15.53:0/1350341269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10005cf0 con 0x7fec2006d380 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1cff9640 1 -- 172.21.15.53:0/1350341269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10005e50 con 0x7fec2006d380 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec201511a0 con 0x7fec2006d380 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec1cff9640 1 -- 172.21.15.53:0/1350341269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec100072d0 con 0x7fec2006d380 2024-09-13T18:32:42.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.865+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec20151a40 con 0x7fec2006d380 2024-09-13T18:32:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.869+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec200cdca0 con 0x7fec2006d380 2024-09-13T18:32:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.869+0000 7fec1cff9640 1 -- 172.21.15.53:0/1350341269 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fec10007430 con 0x7fec2006d380 2024-09-13T18:32:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.869+0000 7fec1cff9640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec0c066c30 0x7fec0c0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.869+0000 7fec1cff9640 1 -- 172.21.15.53:0/1350341269 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec10084080 con 0x7fec2006d380 2024-09-13T18:32:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.869+0000 7fec1f7fe640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec0c066c30 0x7fec0c0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.869+0000 7fec1f7fe640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec0c066c30 0x7fec0c0690f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec200ceda0 tx=0x7fec14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:42.873+0000 7fec1cff9640 1 -- 172.21.15.53:0/1350341269 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec10050cc0 con 0x7fec2006d380 2024-09-13T18:32:43.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.069+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec2006a670 con 0x7fec2006d380 2024-09-13T18:32:43.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.069+0000 7fec1cff9640 1 -- 172.21.15.53:0/1350341269 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4735 (secure 0 0 0) 0x7fec10017020 con 0x7fec2006d380 2024-09-13T18:32:43.073 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:43.073 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2946475465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2946475465},{"type":"v1","addr":"172.21.15.87:6833","nonce":2946475465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3953952610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3953952610},{"type":"v1","addr":"172.21.15.87:6835","nonce":3953952610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1516456617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1516456617},{"type":"v1","addr":"172.21.15.53:6833","nonce":1516456617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:32:33.769589+0000","modified":"2024-09-13T18:32:36.397069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/275376653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":275376653},{"type":"v1","addr":"172.21.15.53:6835","nonce":275376653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:32:43.073 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 79 2024-09-13T18:32:43.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec0c066c30 msgr2=0x7fec0c0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec0c066c30 0x7fec0c0690f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec200ceda0 tx=0x7fec14008040 comp rx=0 tx=0).stop 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 msgr2=0x7fec20156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec20156860 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fec1000c420 tx=0x7fec1000c8e0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 shutdown_connections 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec0c066c30 0x7fec0c0690f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec200cd230 0x7fec20157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec2015a520 0x7fec20144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 --2- 172.21.15.53:0/1350341269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec2006d380 0x7fec20156860 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 >> 172.21.15.53:0/1350341269 conn(0x7fec20069f50 msgr2=0x7fec200b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 shutdown_connections 2024-09-13T18:32:43.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.073+0000 7fec2686c640 1 -- 172.21.15.53:0/1350341269 wait complete. 2024-09-13T18:32:43.494 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:32:33.769589+0000', 'modified': '2024-09-13T18:32:36.397069+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8955': {'gid': 8955, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/275376653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 275376653}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 275376653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:32:43.494 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:32:43.494 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:32:43.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f9013d71640 1 Processor -- start 2024-09-13T18:32:43.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f9013d71640 1 -- start start 2024-09-13T18:32:43.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f9013d71640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f900c0713a0 0x7f900c165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f9013d71640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c06d480 con 0x7f900c15b7c0 2024-09-13T18:32:43.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f9013d71640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c15ace0 con 0x7f900c1582a0 2024-09-13T18:32:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f9013d71640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c15aaf0 con 0x7f900c0713a0 2024-09-13T18:32:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f901230e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f900c0713a0 0x7f900c165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f901130c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f900c15b7c0 0x7f900c070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58298/0 (socket says 172.21.15.53:58298) 2024-09-13T18:32:43.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f901130c640 1 -- 172.21.15.53:0/1784240596 learned_addr learned my addr 172.21.15.53:0/1784240596 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:43.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f901230e640 1 -- 172.21.15.53:0/1784240596 >> v1:172.21.15.87:6789/0 conn(0x7f900c1582a0 legacy=0x7f900c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f901230e640 1 -- 172.21.15.53:0/1784240596 >> v1:172.21.15.53:6789/0 conn(0x7f900c15b7c0 legacy=0x7f900c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f901230e640 1 -- 172.21.15.53:0/1784240596 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c15afc0 con 0x7f900c0713a0 2024-09-13T18:32:43.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.629+0000 7f9010b0b640 1 -- 172.21.15.53:0/1784240596 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846036513 0 0) 0x7f900c06d480 con 0x7f900c15b7c0 2024-09-13T18:32:43.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f901230e640 1 --2- 172.21.15.53:0/1784240596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c165100 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f9004009d90 tx=0x7f900401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12afd8da62ccd37b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9010b0b640 1 -- 172.21.15.53:0/1784240596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040a5940 con 0x7f900c0713a0 2024-09-13T18:32:43.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9010b0b640 1 -- 172.21.15.53:0/1784240596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90040a5aa0 con 0x7f900c0713a0 2024-09-13T18:32:43.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9010b0b640 1 -- 172.21.15.53:0/1784240596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040a5e30 con 0x7f900c0713a0 2024-09-13T18:32:43.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 -- 172.21.15.53:0/1784240596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 msgr2=0x7f900c165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 --2- 172.21.15.53:0/1784240596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c165100 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f9004009d90 tx=0x7f900401c970 comp rx=0 tx=0).stop 2024-09-13T18:32:43.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 -- 172.21.15.53:0/1784240596 shutdown_connections 2024-09-13T18:32:43.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 --2- 172.21.15.53:0/1784240596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c165100 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 -- 172.21.15.53:0/1784240596 >> 172.21.15.53:0/1784240596 conn(0x7f900c065c80 msgr2=0x7f900c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 -- 172.21.15.53:0/1784240596 shutdown_connections 2024-09-13T18:32:43.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 -- 172.21.15.53:0/1784240596 wait complete. 2024-09-13T18:32:43.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.633+0000 7f9013d71640 1 Processor -- start 2024-09-13T18:32:43.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 -- start start 2024-09-13T18:32:43.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c14f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f900c1582a0 0x7f900c1525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f900c15b7c0 0x7f900c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c14fe50 con 0x7f900c0713a0 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0b2e90 con 0x7f900c1582a0 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0b2280 con 0x7f900c15b7c0 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c14f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42146/0 (socket says 172.21.15.53:42146) 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 -- 172.21.15.53:0/1938807236 learned_addr learned my addr 172.21.15.53:0/1938807236 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f901130c640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f900c1582a0 0x7f900c1525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f901230e640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f900c15b7c0 0x7f900c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 -- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f900c15b7c0 msgr2=0x7f900c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f900c15b7c0 0x7f900c152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 -- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f900c1582a0 msgr2=0x7f900c1525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f900c1582a0 0x7f900c1525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 -- 172.21.15.53:0/1938807236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004009a70 con 0x7f900c0713a0 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9011b0d640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c14f910 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f900800c500 tx=0x7f900800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f90027fc640 1 -- 172.21.15.53:0/1938807236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008005220 con 0x7f900c0713a0 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f90027fc640 1 -- 172.21.15.53:0/1938807236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008005380 con 0x7f900c0713a0 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c0b2560 con 0x7f900c0713a0 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f90027fc640 1 -- 172.21.15.53:0/1938807236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008007270 con 0x7f900c0713a0 2024-09-13T18:32:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c0b2b20 con 0x7f900c0713a0 2024-09-13T18:32:43.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.637+0000 7f90027fc640 1 -- 172.21.15.53:0/1938807236 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f90080073d0 con 0x7f900c0713a0 2024-09-13T18:32:43.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f90027fc640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ff0066c30 0x7f8ff00690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f901130c640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ff0066c30 0x7f8ff00690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f90027fc640 1 -- 172.21.15.53:0/1938807236 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9008084520 con 0x7f900c0713a0 2024-09-13T18:32:43.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f901130c640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ff0066c30 0x7f8ff00690f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f900c165230 tx=0x7f8ffc007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 Processor -- start 2024-09-13T18:32:43.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- start start 2024-09-13T18:32:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256f515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f07200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256f07b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256dcfe80 con 0x564256f511f0 2024-09-13T18:32:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256d5daf0 con 0x564256f51b10 2024-09-13T18:32:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564256d5b0c0 con 0x564256f07740 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256f515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256f515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42148/0 (socket says 172.21.15.53:42148) 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 -- 172.21.15.53:0/3695397509 learned_addr learned my addr 172.21.15.53:0/3695397509 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f901230e640 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256f07b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 -- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 msgr2=0x564256f07b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f901130c640 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f07200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256f07b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 -- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 msgr2=0x564256f07200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f07200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 -- 172.21.15.53:0/3695397509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564256a52890 con 0x564256f511f0 2024-09-13T18:32:43.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f901130c640 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f07200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9011b0d640 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256f515d0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f900800cec0 tx=0x7f9008007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6e8975884daaf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f8fef7fe640 1 -- 172.21.15.53:0/3695397509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900806c070 con 0x564256f511f0 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f8fef7fe640 1 -- 172.21.15.53:0/3695397509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008058ae0 con 0x564256f511f0 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f8fef7fe640 1 -- 172.21.15.53:0/3695397509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008082100 con 0x564256f511f0 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- 172.21.15.53:0/3695397509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 msgr2=0x564256f515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256f515d0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f900800cec0 tx=0x7f9008007680 comp rx=0 tx=0).stop 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- 172.21.15.53:0/3695397509 shutdown_connections 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256f07b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f07200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 --2- 172.21.15.53:0/3695397509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256f515d0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- 172.21.15.53:0/3695397509 >> 172.21.15.53:0/3695397509 conn(0x564256f0dfb0 msgr2=0x564256f0e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- 172.21.15.53:0/3695397509 shutdown_connections 2024-09-13T18:32:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- 172.21.15.53:0/3695397509 wait complete. 2024-09-13T18:32:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.641+0000 7f9016eba000 1 -- start start 2024-09-13T18:32:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 Processor -- start 2024-09-13T18:32:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256f12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f511f0 0x564256f134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f51b10 0x564256f13a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256d569b0 con 0x564256f51b10 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256cf5c00 con 0x564256f07740 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564256d14070 con 0x564256f511f0 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 10 client.0 _ll_register_callbacks cb 0x564256ef3ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f51b10 0x564256f13a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f51b10 0x564256f13a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42150/0 (socket says 172.21.15.53:42150) 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 -- 172.21.15.53:0/2346315665 learned_addr learned my addr 172.21.15.53:0/2346315665 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901130c640 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f511f0 0x564256f134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9011b0d640 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256f12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 -- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f511f0 msgr2=0x564256f134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f511f0 0x564256f134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 -- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 msgr2=0x564256f12fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256f12fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 -- 172.21.15.53:0/2346315665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c0b2b20 con 0x564256f51b10 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f901230e640 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f51b10 0x564256f13a30 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9004009d90 tx=0x7f900401b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54560afc68b7e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 1 -- 172.21.15.53:0/2346315665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040ad920 con 0x564256f51b10 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 1 -- 172.21.15.53:0/2346315665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90040ada80 con 0x564256f51b10 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564256d135f0 con 0x564256f51b10 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 1 -- 172.21.15.53:0/2346315665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90040adc40 con 0x564256f51b10 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 10 client.9120 fetch_fsmap learned FSMap version 79 2024-09-13T18:32:43.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x564256d1bab0 con 0x564256f51b10 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 1 -- 172.21.15.53:0/2346315665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564256d135f0 con 0x564256f51b10 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 1 -- 172.21.15.53:0/2346315665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90040b8450 con 0x564256f51b10 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 10 client.9120 fetch_fsmap finished waiting for FSMap version 79 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 10 client.9120 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 20 client.9120 populate_metadata read hostname 'smithi053' 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f14440 0x564256f632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 4 client.9120 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 --> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564256d53790 con 0x564256f14440 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9011b0d640 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f14440 0x564256f632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 10 client.9120 ms_handle_connect on v2:172.21.15.53:6834/275376653 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9011b0d640 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f14440 0x564256f632a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=224bf59548a0e28c server_cookie=e91ab27e8b12154f in_seq=0 out_seq=0 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 1 -- 172.21.15.53:0/2346315665 <== mds.0 v2:172.21.15.53:6834/275376653 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x564256d53790 con 0x564256f14440 2024-09-13T18:32:43.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 10 client.9120 handle_command_reply: tid=0 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 client.9120 shutdown 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f51b10 msgr2=0x564256f13a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f51b10 0x564256f13a30 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9004009d90 tx=0x7f900401b1b0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 shutdown_connections 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f14440 0x564256f632a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f511f0 0x564256f134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f51b10 0x564256f13a30 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 --2- 172.21.15.53:0/2346315665 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256f12fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 >> 172.21.15.53:0/2346315665 conn(0x564256f0dfb0 msgr2=0x564256f061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f8fecff9640 0 client.9120 ms_handle_reset on v2:172.21.15.53:6834/275376653 2024-09-13T18:32:43.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.645+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 shutdown_connections 2024-09-13T18:32:43.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.649+0000 7f9016eba000 1 -- 172.21.15.53:0/2346315665 wait complete. 2024-09-13T18:32:43.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.649+0000 7f9016eba000 20 client.9120 trim_cache size 0 max 16384 2024-09-13T18:32:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.661+0000 7f9016eba000 1 Processor -- start 2024-09-13T18:32:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.661+0000 7f9016eba000 1 -- start start 2024-09-13T18:32:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256fad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f51b10 0x564256fadfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256a13940 con 0x564256f511f0 2024-09-13T18:32:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256f0a590 con 0x564256f07740 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564256d521a0 con 0x564256f51b10 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42162/0 (socket says 172.21.15.53:42162) 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 -- 172.21.15.53:0/955853861 learned_addr learned my addr 172.21.15.53:0/955853861 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901230e640 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f51b10 0x564256fadfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 -- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f51b10 msgr2=0x564256fadfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f51b10 0x564256fadfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9011b0d640 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256fad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 -- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 msgr2=0x564256fad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256fad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 -- 172.21.15.53:0/955853861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564256d01c00 con 0x564256f511f0 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fada80 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f900c152370 tx=0x7f8ffc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6a5f76a59be963 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f8feffff640 1 -- 172.21.15.53:0/955853861 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc015110 con 0x564256f511f0 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f8feffff640 1 -- 172.21.15.53:0/955853861 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc01b030 con 0x564256f511f0 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f8feffff640 1 -- 172.21.15.53:0/955853861 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc015270 con 0x564256f511f0 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- 172.21.15.53:0/955853861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 msgr2=0x564256fada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fada80 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f900c152370 tx=0x7f8ffc012000 comp rx=0 tx=0).stop 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- 172.21.15.53:0/955853861 shutdown_connections 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f51b10 0x564256fadfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fada80 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- 172.21.15.53:0/955853861 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f07740 0x564256fad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- 172.21.15.53:0/955853861 >> 172.21.15.53:0/955853861 conn(0x564256f0dfb0 msgr2=0x564256f059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- 172.21.15.53:0/955853861 shutdown_connections 2024-09-13T18:32:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- 172.21.15.53:0/955853861 wait complete. 2024-09-13T18:32:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- start start 2024-09-13T18:32:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 Processor -- start 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256fb29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fb2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f99d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256d59510 con 0x564256f511f0 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x564256d541c0 con 0x564256f51b10 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x564256f131e0 con 0x564256f07740 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f9016eba000 10 client.0 _ll_register_callbacks cb 0x7f9008050ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fb2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fb2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42164/0 (socket says 172.21.15.53:42164) 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.665+0000 7f901130c640 1 -- 172.21.15.53:0/1743377920 learned_addr learned my addr 172.21.15.53:0/1743377920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9011b0d640 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256fb29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f901230e640 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f99d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f901130c640 1 -- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 msgr2=0x564256fb29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f901130c640 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256fb29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f901130c640 1 -- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 msgr2=0x564256f99d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f901130c640 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f99d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f901130c640 1 -- 172.21.15.53:0/1743377920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc00f040 con 0x564256f511f0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f901130c640 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fb2ee0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc001ec0 tx=0x7f8ffc007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d878de8c6cf5b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 1 -- 172.21.15.53:0/1743377920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc013420 con 0x564256f511f0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 1 -- 172.21.15.53:0/1743377920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ffc013580 con 0x564256f511f0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564256d26460 con 0x564256f511f0 2024-09-13T18:32:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 1 -- 172.21.15.53:0/1743377920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ffc013740 con 0x564256f511f0 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 10 client.9126 fetch_fsmap learned FSMap version 79 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x564256a52cc0 con 0x564256f511f0 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 1 -- 172.21.15.53:0/1743377920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564256d26460 con 0x564256f511f0 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 1 -- 172.21.15.53:0/1743377920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 79) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8ffc020070 con 0x564256f511f0 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 10 client.9126 fetch_fsmap finished waiting for FSMap version 79 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 10 client.9126 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 20 client.9126 populate_metadata read hostname 'smithi053' 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f9a260 0x564256f9a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 4 client.9126 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 --> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564256d1f9c0 con 0x564256f9a260 2024-09-13T18:32:43.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9011b0d640 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f9a260 0x564256f9a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 10 client.9126 ms_handle_connect on v2:172.21.15.53:6834/275376653 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9011b0d640 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f9a260 0x564256f9a640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3882339af63f42d server_cookie=541086b7c1b87604 in_seq=0 out_seq=0 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 1 -- 172.21.15.53:0/1743377920 <== mds.0 v2:172.21.15.53:6834/275376653 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x564256d1f9c0 con 0x564256f9a260 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 10 client.9126 handle_command_reply: tid=0 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 client.9126 shutdown 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 msgr2=0x564256fb2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fb2ee0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc001ec0 tx=0x7f8ffc007b50 comp rx=0 tx=0).stop 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 shutdown_connections 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:6834/275376653,v1:172.21.15.53:6835/275376653] conn(0x564256f9a260 0x564256f9a640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x564256f51b10 0x564256f99d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564256f511f0 0x564256fb2ee0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f8fecff9640 0 client.9126 ms_handle_reset on v2:172.21.15.53:6834/275376653 2024-09-13T18:32:43.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 --2- 172.21.15.53:0/1743377920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x564256f07740 0x564256fb29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 >> 172.21.15.53:0/1743377920 conn(0x564256f0dfb0 msgr2=0x564256f061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 shutdown_connections 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 1 -- 172.21.15.53:0/1743377920 wait complete. 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9016eba000 20 client.9126 trim_cache size 0 max 16384 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8955, 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:32:43.679 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:32:43.680 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:32:43.680 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 9.9004004160000001, 2024-09-13T18:32:43.680 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 79, 2024-09-13T18:32:43.680 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 136, 2024-09-13T18:32:43.680 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 136, 2024-09-13T18:32:43.680 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.236112615 2024-09-13T18:32:43.680 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:32:43.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ff0066c30 msgr2=0x7f8ff00690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ff0066c30 0x7f8ff00690f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f900c165230 tx=0x7f8ffc007d30 comp rx=0 tx=0).stop 2024-09-13T18:32:43.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 msgr2=0x7f900c14f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c14f910 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f900800c500 tx=0x7f900800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 shutdown_connections 2024-09-13T18:32:43.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ff0066c30 0x7f8ff00690f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f900c15b7c0 0x7f900c152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f900c1582a0 0x7f900c1525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 --2- 172.21.15.53:0/1938807236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900c0713a0 0x7f900c14f910 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 >> 172.21.15.53:0/1938807236 conn(0x7f900c065c80 msgr2=0x7f900c070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 shutdown_connections 2024-09-13T18:32:43.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.669+0000 7f9013d71640 1 -- 172.21.15.53:0/1938807236 wait complete. 2024-09-13T18:32:43.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:32:43.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.801+0000 7fcd36ea2640 1 Processor -- start 2024-09-13T18:32:43.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.801+0000 7fcd36ea2640 1 -- start start 2024-09-13T18:32:43.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd36ea2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 0x7fcd3006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd36ea2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3006d480 con 0x7fcd300713a0 2024-09-13T18:32:43.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd36ea2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3015ace0 con 0x7fcd3015b7c0 2024-09-13T18:32:43.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd36ea2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3015aaf0 con 0x7fcd301582a0 2024-09-13T18:32:43.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd3543f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcd300713a0 0x7fcd301640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58306/0 (socket says 172.21.15.53:58306) 2024-09-13T18:32:43.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd3543f640 1 -- 172.21.15.53:0/4135312933 learned_addr learned my addr 172.21.15.53:0/4135312933 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:43.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 0x7fcd3006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743409733 0 0) 0x7fcd3006d480 con 0x7fcd300713a0 2024-09-13T18:32:43.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd18003530 con 0x7fcd300713a0 2024-09-13T18:32:43.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817421506 0 0) 0x7fcd18003530 con 0x7fcd300713a0 2024-09-13T18:32:43.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 msgr2=0x7fcd3006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 0x7fcd3006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 >> v1:172.21.15.87:6789/0 conn(0x7fcd3015b7c0 legacy=0x7fcd30070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3015afc0 con 0x7fcd300713a0 2024-09-13T18:32:43.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fcd28001a00 con 0x7fcd300713a0 2024-09-13T18:32:43.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 >> v1:172.21.15.53:6789/0 conn(0x7fcd300713a0 legacy=0x7fcd301640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 0x7fcd180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd18004d10 0x7fcd18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800ba40 con 0x7fcd180039b0 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800bb80 con 0x7fcd18004d10 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800bd40 con 0x7fcd301582a0 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd2ffff640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 0x7fcd180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd3543f640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd18004d10 0x7fcd18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd34c3e640 1 -- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 msgr2=0x7fcd180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301582a0 0x7fcd180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd34c3e640 1 -- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd18004d10 msgr2=0x7fcd18005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd18004d10 0x7fcd18005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd34c3e640 1 -- 172.21.15.53:0/4135312933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18003530 con 0x7fcd180039b0 2024-09-13T18:32:43.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.805+0000 7fcd3543f640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd18004d10 0x7fcd18005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd18003dd0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ab0 tx=0x7fcd2001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7b64f35e547ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200a5530 con 0x7fcd180039b0 2024-09-13T18:32:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd200a5690 con 0x7fcd180039b0 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd2f7fe640 1 -- 172.21.15.53:0/4135312933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200a5a40 con 0x7fcd180039b0 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- 172.21.15.53:0/4135312933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 msgr2=0x7fcd18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 --2- 172.21.15.53:0/4135312933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd18003dd0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ab0 tx=0x7fcd2001ca50 comp rx=0 tx=0).stop 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd3543f640 1 -- 172.21.15.53:0/4135312933 reap_dead start 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- 172.21.15.53:0/4135312933 shutdown_connections 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- 172.21.15.53:0/4135312933 >> 172.21.15.53:0/4135312933 conn(0x7fcd30065c80 msgr2=0x7fcd30066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- 172.21.15.53:0/4135312933 shutdown_connections 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- 172.21.15.53:0/4135312933 wait complete. 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 Processor -- start 2024-09-13T18:32:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- start start 2024-09-13T18:32:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd301f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3013fdf0 0x7fcd30159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301f35d0 0x7fcd30159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3014fe10 con 0x7fcd180039b0 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30151210 con 0x7fcd3013fdf0 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd36ea2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3014f980 con 0x7fcd301f35d0 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd34c3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd301f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd34c3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd301f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42184/0 (socket says 172.21.15.53:42184) 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.809+0000 7fcd34c3e640 1 -- 172.21.15.53:0/1728926872 learned_addr learned my addr 172.21.15.53:0/1728926872 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd3543f640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301f35d0 0x7fcd30159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2ffff640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3013fdf0 0x7fcd30159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd34c3e640 1 -- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301f35d0 msgr2=0x7fcd30159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301f35d0 0x7fcd30159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd34c3e640 1 -- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3013fdf0 msgr2=0x7fcd30159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3013fdf0 0x7fcd30159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd34c3e640 1 -- 172.21.15.53:0/1728926872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30070210 con 0x7fcd180039b0 2024-09-13T18:32:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd34c3e640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd301f3090 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ab0 tx=0x7fcd18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2d7fa640 1 -- 172.21.15.53:0/1728926872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200be070 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2d7fa640 1 -- 172.21.15.53:0/1728926872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd200a5e80 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2d7fa640 1 -- 172.21.15.53:0/1728926872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20004020 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd30151440 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3014f610 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30067400 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2d7fa640 1 -- 172.21.15.53:0/1728926872 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fcd200b4040 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2d7fa640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd1c066c60 0x7fcd1c069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2d7fa640 1 -- 172.21.15.53:0/1728926872 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd2011e6a0 con 0x7fcd180039b0 2024-09-13T18:32:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2ffff640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd1c066c60 0x7fcd1c069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:43.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.813+0000 7fcd2ffff640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd1c066c60 0x7fcd1c069120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd30159e00 tx=0x7fcd24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:43.821+0000 7fcd2d7fa640 1 -- 172.21.15.53:0/1728926872 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd200eb330 con 0x7fcd180039b0 2024-09-13T18:32:44.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.017+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd300ca7d0 con 0x7fcd180039b0 2024-09-13T18:32:44.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.017+0000 7fcd2d7fa640 1 -- 172.21.15.53:0/1728926872 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcd200ee950 con 0x7fcd180039b0 2024-09-13T18:32:44.019 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd1c066c60 msgr2=0x7fcd1c069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd1c066c60 0x7fcd1c069120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcd30159e00 tx=0x7fcd24009040 comp rx=0 tx=0).stop 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 msgr2=0x7fcd301f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd301f3090 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ab0 tx=0x7fcd18005800 comp rx=0 tx=0).stop 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 shutdown_connections 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd1c066c60 0x7fcd1c069120 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd301f35d0 0x7fcd30159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd3013fdf0 0x7fcd30159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 --2- 172.21.15.53:0/1728926872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd180039b0 0x7fcd301f3090 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 >> 172.21.15.53:0/1728926872 conn(0x7fcd30065c80 msgr2=0x7fcd30066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 shutdown_connections 2024-09-13T18:32:44.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:44.021+0000 7fcd36ea2640 1 -- 172.21.15.53:0/1728926872 wait complete. 2024-09-13T18:32:44.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:32:44.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:32:44.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:32:44.037 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:32:44.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:44.038 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:32:44.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:32:44.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:32:44.038 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:32:44.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.038 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:32:44.043 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:32:44.043 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:32:44.043 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:32:44.043 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.043 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:32:44.043 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42033sec preferred_lft 42033sec 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:44.044 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.045 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:44.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.046 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:32:44.095 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:32:44.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.097 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:32:44.143 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:32:44.144 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:32:44.144 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:32:44.144 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:32:44.144 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:32:44.144 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:32:44.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.144 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:32:44.144 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:32:44.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:32:44.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:32:44.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:32:44.145 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:32:44.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.219 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:32:44.266 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:32:44.266 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:32:44.267 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:32:44.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.267 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:32:44.326 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:32:44.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:44.327 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:44.374 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:32:44.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:44.375 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:44.422 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:32:44.480 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:44.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:44.533 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:44.535 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:44.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.536 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:32:44.582 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:32:44.582 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:32:44.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:32:44.642 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:44.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:44.697 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:44.698 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:44.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:44.699 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:32:44.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:32:44.709+0000 7fe776a0e580 -1 init, newargv = 0x55b12d495690 newargc=15 2024-09-13T18:32:44.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[53770]: starting ceph client 2024-09-13T18:32:44.715 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[53770]: starting fuse 2024-09-13T18:32:45.816 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:32:45.832 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:45.833 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:45.890 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:45.891 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:45.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:45.891 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:32:45.938 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:32:45.938 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:32:45.938 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:32:45.938 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:32:45.939 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:32:45.940 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:32:46.063 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.53770.asok 2024-09-13T18:32:46.245 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53770.asok 2024-09-13T18:32:46.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:46.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53770.asok status 2024-09-13T18:32:46.409 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:32:46.409 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:32:46.409 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:32:46.410 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:32:46.410 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:32:46.410 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:32:46.410 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:32:46.410 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "53770", 2024-09-13T18:32:46.410 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:32:46.410 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:46.411 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:32:46.411 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:32:46.411 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9138, 2024-09-13T18:32:46.411 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:32:46.411 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:32:46.411 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:32:46.411 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 9138 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3497897507 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:46.412 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:32:46.413 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:32:46.413 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:46.413 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3497897507 2024-09-13T18:32:46.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:32:46.413 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.9138 192.168.0.1:0/3497897507", 2024-09-13T18:32:46.413 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3497897507", 2024-09-13T18:32:46.413 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:32:46.414 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 79, 2024-09-13T18:32:46.414 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 136, 2024-09-13T18:32:46.414 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:32:46.414 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:32:46.414 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:32:46.415 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:32:46.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:46.424 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:32:46.424 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:46.431 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:32:46.431 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:46.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:46.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:32:46.487 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:32:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff84de1640 1 Processor -- start 2024-09-13T18:32:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff84de1640 1 -- start start 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff84de1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff8015cab0 0x7eff800d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff84de1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800d2400 con 0x7eff800cf7d0 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff84de1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800d1530 con 0x7eff800cd6c0 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff84de1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800d0920 con 0x7eff8015cab0 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7eff800cf7d0 0x7eff800b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54092/0 (socket says 172.21.15.53:54092) 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7ed9d640 1 -- 172.21.15.53:0/3577617015 learned_addr learned my addr 172.21.15.53:0/3577617015 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3577617015 >> v2:172.21.15.87:3300/0 conn(0x7eff8015cab0 0x7eff800d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134534272 0 0) 0x7eff800d2400 con 0x7eff800cf7d0 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff6c003530 con 0x7eff800cf7d0 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570233335 0 0) 0x7eff6c003530 con 0x7eff800cf7d0 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 >> v2:172.21.15.87:3300/0 conn(0x7eff8015cab0 msgr2=0x7eff800d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 --2- 172.21.15.53:0/3577617015 >> v2:172.21.15.87:3300/0 conn(0x7eff8015cab0 0x7eff800d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 >> v1:172.21.15.87:6789/0 conn(0x7eff800cd6c0 legacy=0x7eff800cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800d0c00 con 0x7eff800cf7d0 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7eff78001a00 con 0x7eff800cf7d0 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 >> v1:172.21.15.53:6789/0 conn(0x7eff800cf7d0 legacy=0x7eff800b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff6c0047d0 0x7eff6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff6c005190 0x7eff6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800d0920 con 0x7eff6c003980 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c00c030 con 0x7eff6c0047d0 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c00c1f0 con 0x7eff6c005190 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff77fff640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff6c0047d0 0x7eff6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7ed9d640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff6c005190 0x7eff6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7e59c640 1 -- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff6c005190 msgr2=0x7eff6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff6c005190 0x7eff6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7e59c640 1 -- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff6c0047d0 msgr2=0x7eff6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff6c0047d0 0x7eff6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7ed9d640 1 -- 172.21.15.53:0/3577617015 reap_dead start 2024-09-13T18:32:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.657+0000 7eff7e59c640 1 -- 172.21.15.53:0/3577617015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c003530 con 0x7eff6c003980 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff6c003da0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7eff70009ae0 tx=0x7eff7001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5a6552f3fd2eea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff700a56e0 con 0x7eff6c003980 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff700a5840 con 0x7eff6c003980 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff7dd9b640 1 -- 172.21.15.53:0/3577617015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff700a5bf0 con 0x7eff6c003980 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 -- 172.21.15.53:0/3577617015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 msgr2=0x7eff6c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff6c003da0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7eff70009ae0 tx=0x7eff7001ca60 comp rx=0 tx=0).stop 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 -- 172.21.15.53:0/3577617015 shutdown_connections 2024-09-13T18:32:46.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 --2- 172.21.15.53:0/3577617015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff6c003da0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 -- 172.21.15.53:0/3577617015 >> 172.21.15.53:0/3577617015 conn(0x7eff80065c80 msgr2=0x7eff80066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:46.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 -- 172.21.15.53:0/3577617015 shutdown_connections 2024-09-13T18:32:46.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 -- 172.21.15.53:0/3577617015 wait complete. 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 Processor -- start 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.661+0000 7eff84de1640 1 -- start start 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff801f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff801f5e20 0x7eff800aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff801f49d0 0x7eff800b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800cbd30 con 0x7eff6c003980 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800aac20 con 0x7eff801f49d0 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff801f6880 con 0x7eff801f5e20 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff801f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff801f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53430/0 (socket says 172.21.15.53:53430) 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 -- 172.21.15.53:0/3155195135 learned_addr learned my addr 172.21.15.53:0/3155195135 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7ed9d640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff801f49d0 0x7eff800b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff77fff640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff801f5e20 0x7eff800aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 -- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff801f5e20 msgr2=0x7eff800aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff801f5e20 0x7eff800aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 -- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff801f49d0 msgr2=0x7eff800b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff801f49d0 0x7eff800b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 -- 172.21.15.53:0/3155195135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800aa670 con 0x7eff6c003980 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7ed9d640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff801f49d0 0x7eff800b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff77fff640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff801f5e20 0x7eff800aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff7e59c640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff801f6340 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7eff70009ae0 tx=0x7eff6c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff76ffd640 1 -- 172.21.15.53:0/3155195135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70004220 con 0x7eff6c003980 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff76ffd640 1 -- 172.21.15.53:0/3155195135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff70004380 con 0x7eff6c003980 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff800aa940 con 0x7eff6c003980 2024-09-13T18:32:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff76ffd640 1 -- 172.21.15.53:0/3155195135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70003860 con 0x7eff6c003980 2024-09-13T18:32:46.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800cb950 con 0x7eff6c003980 2024-09-13T18:32:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800cf0c0 con 0x7eff6c003980 2024-09-13T18:32:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff76ffd640 1 -- 172.21.15.53:0/3155195135 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7eff700b4040 con 0x7eff6c003980 2024-09-13T18:32:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff76ffd640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff60066c30 0x7eff600690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff76ffd640 1 -- 172.21.15.53:0/3155195135 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff7011f280 con 0x7eff6c003980 2024-09-13T18:32:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.665+0000 7eff77fff640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff60066c30 0x7eff600690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.669+0000 7eff77fff640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff60066c30 0x7eff600690f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff68000c10 tx=0x7eff68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:46.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.673+0000 7eff76ffd640 1 -- 172.21.15.53:0/3155195135 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff700ebec0 con 0x7eff6c003980 2024-09-13T18:32:46.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.865+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff800b6a10 con 0x7eff6c003980 2024-09-13T18:32:46.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.865+0000 7eff76ffd640 1 -- 172.21.15.53:0/3155195135 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff700ef4e0 con 0x7eff6c003980 2024-09-13T18:32:46.869 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:32:46.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff60066c30 msgr2=0x7eff600690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:46.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff60066c30 0x7eff600690f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff68000c10 tx=0x7eff68009040 comp rx=0 tx=0).stop 2024-09-13T18:32:46.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 msgr2=0x7eff801f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff801f6340 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7eff70009ae0 tx=0x7eff6c005800 comp rx=0 tx=0).stop 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 shutdown_connections 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7eff60066c30 0x7eff600690f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff801f5e20 0x7eff800aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff801f49d0 0x7eff800b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 --2- 172.21.15.53:0/3155195135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff6c003980 0x7eff801f6340 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 >> 172.21.15.53:0/3155195135 conn(0x7eff80065c80 msgr2=0x7eff8015ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 shutdown_connections 2024-09-13T18:32:46.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:46.869+0000 7eff84de1640 1 -- 172.21.15.53:0/3155195135 wait complete. 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:32:46.888 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:32:46.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:46.889 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:46.896 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42036sec preferred_lft 42036sec 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:32:46.897 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:32:46.898 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:32:46.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:46.899 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:32:46.951 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:32:46.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:46.952 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:32:47.002 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:32:47.002 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:32:47.002 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:32:47.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:47.004 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:32:47.004 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:32:47.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:32:47.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:32:47.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:32:47.004 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:32:47.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:47.079 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:32:47.127 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:32:47.127 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:32:47.127 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:32:47.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:47.127 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:32:47.183 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:32:47.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:47.418 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:47.425 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:32:47.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:32:47.426 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:47.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:32:47.537 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:47.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:47.594 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:47.596 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:47.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:47.596 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:32:47.642 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:32:47.643 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:32:47.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:32:47.701 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:47.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:47.757 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:47.758 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:47.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:47.759 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:32:47.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:32:47.764+0000 7fd64292c580 -1 init, newargv = 0x55b5e88e4660 newargc=15 2024-09-13T18:32:47.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36385]: starting ceph client 2024-09-13T18:32:47.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36385]: starting fuse 2024-09-13T18:32:48.872 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:32:48.888 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:32:48.888 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:32:48.945 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:32:48.947 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:32:48.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:48.947 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:32:48.995 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:32:48.996 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:32:48.996 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:32:48.996 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:32:48.996 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:32:48.996 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:32:48.997 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:32:48.997 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:48.997 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:32:48.997 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:32:48.997 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:32:48.997 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:32:48.998 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:48.998 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:32:48.998 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:32:48.998 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:32:48.998 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:32:48.998 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:48.998 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:32:48.999 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:32:48.999 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:32:48.999 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:32:48.999 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:32:48.999 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:32:48.999 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:32:49.000 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:32:49.000 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:32:49.000 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:32:49.000 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:32:49.115 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.36385.asok 2024-09-13T18:32:49.298 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.36385.asok 2024-09-13T18:32:49.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:49.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.36385.asok status 2024-09-13T18:32:49.455 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "36385", 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 8014, 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 8014 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2476201308 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:49.457 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2476201308 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.8014 192.168.0.1:0/2476201308", 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/2476201308", 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 79, 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 136, 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:32:49.458 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:32:49.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:49.469 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:32:49.470 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:49.476 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:32:49.476 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:49.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:32:49.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:32:49.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:32:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.669+0000 7fd0c965c640 1 Processor -- start 2024-09-13T18:32:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.669+0000 7fd0c965c640 1 -- start start 2024-09-13T18:32:49.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c965c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0c4145400 0x7fd0c40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:49.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c965c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd0c4145900 0x7fd0c40ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:49.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c965c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c40706a0 con 0x7fd0c4145e50 2024-09-13T18:32:49.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c965c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c40b26d0 con 0x7fd0c4145400 2024-09-13T18:32:49.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c965c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c40b3920 con 0x7fd0c4145900 2024-09-13T18:32:49.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0c4145400 0x7fd0c40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:49.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0c4145400 0x7fd0c40ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53444/0 (socket says 172.21.15.53:53444) 2024-09-13T18:32:49.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/2202558204 learned_addr learned my addr 172.21.15.53:0/2202558204 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:49.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c27fc640 1 --2- 172.21.15.53:0/2202558204 >> v2:172.21.15.87:3300/0 conn(0x7fd0c4145900 0x7fd0c40ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:49.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/2202558204 >> v2:172.21.15.87:3300/0 conn(0x7fd0c4145900 msgr2=0x7fd0c40ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:49.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c2ffd640 1 --2- 172.21.15.53:0/2202558204 >> v2:172.21.15.87:3300/0 conn(0x7fd0c4145900 0x7fd0c40ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/2202558204 >> v1:172.21.15.87:6789/0 conn(0x7fd0c4145e50 legacy=0x7fd0c406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:49.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.673+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/2202558204 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4160410 con 0x7fd0c4145400 2024-09-13T18:32:49.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c2ffd640 1 --2- 172.21.15.53:0/2202558204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c40ac8e0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40ae0d0 tx=0x7fd0ac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b32552cfe29dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c1ffb640 1 -- 172.21.15.53:0/2202558204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0a7070 con 0x7fd0c4145400 2024-09-13T18:32:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c1ffb640 1 -- 172.21.15.53:0/2202558204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0ab430 con 0x7fd0c4145400 2024-09-13T18:32:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c1ffb640 1 -- 172.21.15.53:0/2202558204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0ab7c0 con 0x7fd0c4145400 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 -- 172.21.15.53:0/2202558204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 msgr2=0x7fd0c40ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 --2- 172.21.15.53:0/2202558204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c40ac8e0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40ae0d0 tx=0x7fd0ac01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 -- 172.21.15.53:0/2202558204 shutdown_connections 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 --2- 172.21.15.53:0/2202558204 >> v2:172.21.15.87:3300/0 conn(0x7fd0c4145900 0x7fd0c40ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 --2- 172.21.15.53:0/2202558204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c40ac8e0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 -- 172.21.15.53:0/2202558204 >> 172.21.15.53:0/2202558204 conn(0x7fd0c4073330 msgr2=0x7fd0c4065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 -- 172.21.15.53:0/2202558204 shutdown_connections 2024-09-13T18:32:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.677+0000 7fd0c965c640 1 -- 172.21.15.53:0/2202558204 wait complete. 2024-09-13T18:32:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 Processor -- start 2024-09-13T18:32:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 -- start start 2024-09-13T18:32:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c4145900 0x7fd0c40aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c4145e50 0x7fd0c415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c413ed40 con 0x7fd0c4145400 2024-09-13T18:32:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40af1b0 con 0x7fd0c4145e50 2024-09-13T18:32:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40af3f0 con 0x7fd0c4145900 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c413eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53450/0 (socket says 172.21.15.53:53450) 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/1783872801 learned_addr learned my addr 172.21.15.53:0/1783872801 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c37fe640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c4145e50 0x7fd0c415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c27fc640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c4145900 0x7fd0c40aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c4145900 msgr2=0x7fd0c40aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c4145900 0x7fd0c40aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c4145e50 msgr2=0x7fd0c415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c4145e50 0x7fd0c415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 -- 172.21.15.53:0/1783872801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac0094d0 con 0x7fd0c4145400 2024-09-13T18:32:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c2ffd640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c413eeb0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac019100 tx=0x7fd0ac01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0bb7fe640 1 -- 172.21.15.53:0/1783872801 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0b4800 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0bb7fe640 1 -- 172.21.15.53:0/1783872801 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0b4960 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c40af6d0 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0bb7fe640 1 -- 172.21.15.53:0/1783872801 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0b4cf0 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c415e5f0 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.681+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c40cace0 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.685+0000 7fd0bb7fe640 1 -- 172.21.15.53:0/1783872801 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fd0ac0b3380 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.685+0000 7fd0bb7fe640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a4066c30 0x7fd0a40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.685+0000 7fd0bb7fe640 1 -- 172.21.15.53:0/1783872801 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0ac11eb60 con 0x7fd0c4145400 2024-09-13T18:32:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.685+0000 7fd0c27fc640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a4066c30 0x7fd0a40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.685+0000 7fd0c27fc640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a4066c30 0x7fd0a40690f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40cab50 tx=0x7fd0b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.689+0000 7fd0bb7fe640 1 -- 172.21.15.53:0/1783872801 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd0ac0eb720 con 0x7fd0c4145400 2024-09-13T18:32:49.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.885+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd0c40cb980 con 0x7fd0c4145400 2024-09-13T18:32:49.954 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.953+0000 7fd0bb7fe640 1 -- 172.21.15.53:0/1783872801 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 136+0+0 (secure 0 0 0) 0x7fd0ac0eed40 con 0x7fd0c4145400 2024-09-13T18:32:49.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a4066c30 msgr2=0x7fd0a40690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:49.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a4066c30 0x7fd0a40690f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40cab50 tx=0x7fd0b4008040 comp rx=0 tx=0).stop 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 msgr2=0x7fd0c413eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c413eeb0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac019100 tx=0x7fd0ac01ad30 comp rx=0 tx=0).stop 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 shutdown_connections 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a4066c30 0x7fd0a40690f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c4145900 0x7fd0c40aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0c4145e50 0x7fd0c415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 --2- 172.21.15.53:0/1783872801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c4145400 0x7fd0c413eeb0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 >> 172.21.15.53:0/1783872801 conn(0x7fd0c4073330 msgr2=0x7fd0c4166510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 shutdown_connections 2024-09-13T18:32:49.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:49.957+0000 7fd0c965c640 1 -- 172.21.15.53:0/1783872801 wait complete. 2024-09-13T18:32:49.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:32:50.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa002dd7640 1 Processor -- start 2024-09-13T18:32:50.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa002dd7640 1 -- start start 2024-09-13T18:32:50.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa002dd7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 0x7f9ffc0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa002dd7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9ffc0cf600 0x7f9ffc0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa002dd7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ffc0d2400 con 0x7f9ffc15cab0 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa002dd7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc0cfab0 con 0x7f9ffc0cf600 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa002dd7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0d1530 con 0x7f9ffc0d19c0 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9ffc15cab0 0x7f9ffc0cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54108/0 (socket says 172.21.15.53:54108) 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 -- 172.21.15.53:0/3618704344 learned_addr learned my addr 172.21.15.53:0/3618704344 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffbfff640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 0x7f9ffc0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa001374640 1 --2- 172.21.15.53:0/3618704344 >> v2:172.21.15.87:3300/0 conn(0x7f9ffc0cf600 0x7f9ffc0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531480540 0 0) 0x7f9ffc0d2400 con 0x7f9ffc15cab0 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe4003530 con 0x7f9ffc15cab0 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2699299015 0 0) 0x7f9fe4003530 con 0x7f9ffc15cab0 2024-09-13T18:32:50.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 msgr2=0x7f9ffc0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 0x7f9ffc0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 >> v2:172.21.15.87:3300/0 conn(0x7f9ffc0cf600 msgr2=0x7f9ffc0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 --2- 172.21.15.53:0/3618704344 >> v2:172.21.15.87:3300/0 conn(0x7f9ffc0cf600 0x7f9ffc0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc0cddd0 con 0x7f9ffc15cab0 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9fec001680 con 0x7f9ffc15cab0 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 >> v1:172.21.15.53:6789/0 conn(0x7f9ffc15cab0 legacy=0x7f9ffc0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9fe4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 0x7f9fe40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fe4004d10 0x7f9fe4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0cfab0 con 0x7f9fe4003980 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0d1530 con 0x7f9fe4004d10 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe400b990 con 0x7f9ffc0d19c0 2024-09-13T18:32:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9fe4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa001374640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fe4004d10 0x7f9fe4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7f9ffbfff640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 0x7f9fe40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 -- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 msgr2=0x7f9fe40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc0d19c0 0x7f9fe40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 -- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fe4004d10 msgr2=0x7f9fe4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fe4004d10 0x7f9fe4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa000b73640 1 -- 172.21.15.53:0/3618704344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4003530 con 0x7f9fe4003980 2024-09-13T18:32:50.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.101+0000 7fa001374640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9fe4004d10 0x7f9fe4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa000b73640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9fe4003da0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00c2c0 tx=0x7f9fec01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdf3cbc2a9f23f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0058e0 con 0x7f9fe4003980 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec005a40 con 0x7f9fe4003980 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7f9ffb7fe640 1 -- 172.21.15.53:0/3618704344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec005df0 con 0x7f9fe4003980 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa002dd7640 1 -- 172.21.15.53:0/3618704344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 msgr2=0x7f9fe4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa002dd7640 1 --2- 172.21.15.53:0/3618704344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9fe4003da0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00c2c0 tx=0x7f9fec01cce0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa001374640 1 -- 172.21.15.53:0/3618704344 reap_dead start 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa002dd7640 1 -- 172.21.15.53:0/3618704344 shutdown_connections 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa002dd7640 1 -- 172.21.15.53:0/3618704344 >> 172.21.15.53:0/3618704344 conn(0x7f9ffc065c80 msgr2=0x7f9ffc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa002dd7640 1 -- 172.21.15.53:0/3618704344 shutdown_connections 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.105+0000 7fa002dd7640 1 -- 172.21.15.53:0/3618704344 wait complete. 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 Processor -- start 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 -- start start 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9ffc0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc15f3f0 0x7f9ffc15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ffc15f850 0x7f9ffc161de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc147890 con 0x7f9fe4003980 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc147b70 con 0x7f9ffc15f850 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc147e50 con 0x7f9ffc15f3f0 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9ffc0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9ffc0c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53460/0 (socket says 172.21.15.53:53460) 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 -- 172.21.15.53:0/1094938326 learned_addr learned my addr 172.21.15.53:0/1094938326 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 -- 172.21.15.53:0/1094938326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc15f3f0 msgr2=0x7f9ffc15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc15f3f0 0x7f9ffc15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 -- 172.21.15.53:0/1094938326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ffc15f850 msgr2=0x7f9ffc161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ffc15f850 0x7f9ffc161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 -- 172.21.15.53:0/1094938326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc148130 con 0x7f9fe4003980 2024-09-13T18:32:50.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa000b73640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9ffc0c85c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00c2c0 tx=0x7f9fe4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7f9ff97fa640 1 -- 172.21.15.53:0/1094938326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0047f0 con 0x7f9fe4003980 2024-09-13T18:32:50.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7f9ff97fa640 1 -- 172.21.15.53:0/1094938326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec004970 con 0x7f9fe4003980 2024-09-13T18:32:50.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc148410 con 0x7f9fe4003980 2024-09-13T18:32:50.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7f9ff97fa640 1 -- 172.21.15.53:0/1094938326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec004d20 con 0x7f9fe4003980 2024-09-13T18:32:50.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc0c8b00 con 0x7f9fe4003980 2024-09-13T18:32:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc0ce610 con 0x7f9fe4003980 2024-09-13T18:32:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7f9ff97fa640 1 -- 172.21.15.53:0/1094938326 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f9fec0070d0 con 0x7f9fe4003980 2024-09-13T18:32:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7f9ff97fa640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9fe8066c60 0x7f9fe8069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7f9ff97fa640 1 -- 172.21.15.53:0/1094938326 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ffc0b65c0 con 0x7f9fe4003980 2024-09-13T18:32:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.109+0000 7f9ffbfff640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9fe8066c60 0x7f9fe8069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.113+0000 7f9ffbfff640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9fe8066c60 0x7f9fe8069120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc1f8cb0 tx=0x7f9ff0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.117+0000 7f9ff97fa640 1 -- 172.21.15.53:0/1094938326 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9fec0eaa90 con 0x7f9fe4003980 2024-09-13T18:32:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.301+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ffc0d05b0 con 0x7f9fe8066c60 2024-09-13T18:32:50.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.301+0000 7f9ff97fa640 1 -- 172.21.15.53:0/1094938326 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9ff00095e0 con 0x7f9fe8066c60 2024-09-13T18:32:50.304 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:32:50.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:32:50.305 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:32:50.305 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:32:50.305 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9fe8066c60 msgr2=0x7f9fe8069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9fe8066c60 0x7f9fe8069120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc1f8cb0 tx=0x7f9ff0008040 comp rx=0 tx=0).stop 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 msgr2=0x7f9ffc0c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9ffc0c85c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00c2c0 tx=0x7f9fe4005800 comp rx=0 tx=0).stop 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 shutdown_connections 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9fe8066c60 0x7f9fe8069120 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ffc15f3f0 0x7f9ffc15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ffc15f850 0x7f9ffc161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 --2- 172.21.15.53:0/1094938326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fe4003980 0x7f9ffc0c85c0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 >> 172.21.15.53:0/1094938326 conn(0x7f9ffc065c80 msgr2=0x7f9ffc0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 shutdown_connections 2024-09-13T18:32:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.305+0000 7fa002dd7640 1 -- 172.21.15.53:0/1094938326 wait complete. 2024-09-13T18:32:50.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:32:50.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8d05674640 1 Processor -- start 2024-09-13T18:32:50.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8d05674640 1 -- start start 2024-09-13T18:32:50.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8d05674640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 0x7f8d000ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8d05674640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d0006c990 0x7f8d00065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8d05674640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0015baa0 con 0x7f8d000661c0 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8d05674640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d00144360 con 0x7f8d0006c990 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8d05674640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00066630 con 0x7f8d00143f80 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8cff7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d000661c0 0x7f8d00070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54122/0 (socket says 172.21.15.53:54122) 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.449+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1320679601 learned_addr learned my addr 172.21.15.53:0/1320679601 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfeffd640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 0x7f8d000ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfe7fc640 1 --2- 172.21.15.53:0/1320679601 >> v2:172.21.15.87:3300/0 conn(0x7f8d0006c990 0x7f8d00065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348382977 0 0) 0x7f8d0015baa0 con 0x7f8d000661c0 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce8003530 con 0x7f8d000661c0 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986239352 0 0) 0x7f8ce8003530 con 0x7f8d000661c0 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 msgr2=0x7f8d000ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 0x7f8d000ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 >> v2:172.21.15.87:3300/0 conn(0x7f8d0006c990 msgr2=0x7f8d00065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 --2- 172.21.15.53:0/1320679601 >> v2:172.21.15.87:3300/0 conn(0x7f8d0006c990 0x7f8d00065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0006d170 con 0x7f8d000661c0 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8cf8001a00 con 0x7f8d000661c0 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 >> v1:172.21.15.53:6789/0 conn(0x7f8d000661c0 legacy=0x7f8d00070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 0x7f8ce8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce8004d10 0x7f8ce8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00144360 con 0x7f8ce8004d10 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00066630 con 0x7f8ce8003f00 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce800b9c0 con 0x7f8d00143f80 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce8004d10 0x7f8ce8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfe7fc640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfeffd640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 0x7f8ce8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 msgr2=0x7f8ce8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d00143f80 0x7f8ce8003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ce8003f00 msgr2=0x7f8ce80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1320679601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8003530 con 0x7f8ce8004d10 2024-09-13T18:32:50.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfe7fc640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ce8003f00 0x7f8ce80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce8004d10 0x7f8ce8005190 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800a860 tx=0x7f8cf801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb155976a11a027 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80ad630 con 0x7f8ce8004d10 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80a8070 con 0x7f8ce8004d10 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cfdffb640 1 -- 172.21.15.53:0/1320679601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80ada30 con 0x7f8ce8004d10 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8d05674640 1 -- 172.21.15.53:0/1320679601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce8004d10 msgr2=0x7f8ce8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8d05674640 1 --2- 172.21.15.53:0/1320679601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce8004d10 0x7f8ce8005190 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800a860 tx=0x7f8cf801d380 comp rx=0 tx=0).stop 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1320679601 reap_dead start 2024-09-13T18:32:50.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8d05674640 1 -- 172.21.15.53:0/1320679601 shutdown_connections 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8d05674640 1 -- 172.21.15.53:0/1320679601 >> 172.21.15.53:0/1320679601 conn(0x7f8d000b1310 msgr2=0x7f8d000b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8d05674640 1 -- 172.21.15.53:0/1320679601 shutdown_connections 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.453+0000 7f8d05674640 1 -- 172.21.15.53:0/1320679601 wait complete. 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 Processor -- start 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 -- start start 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d000c7bf0 0x7f8d000b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d000c7fd0 0x7f8d000b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d001336d0 0x7f8d00133b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000b40f0 con 0x7f8d001336d0 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00134ba0 con 0x7f8d000c7bf0 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000b3ba0 con 0x7f8d000c7fd0 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d001336d0 0x7f8d00133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d001336d0 0x7f8d00133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53478/0 (socket says 172.21.15.53:53478) 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1828664834 learned_addr learned my addr 172.21.15.53:0/1828664834 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cfe7fc640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d000c7fd0 0x7f8d000b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cfeffd640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d000c7bf0 0x7f8d000b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d000c7fd0 msgr2=0x7f8d000b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d000c7fd0 0x7f8d000b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d000c7bf0 msgr2=0x7f8d000b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d000c7bf0 0x7f8d000b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 -- 172.21.15.53:0/1828664834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000c9980 con 0x7f8d001336d0 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8cff7fe640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d001336d0 0x7f8d00133b80 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8098da0 tx=0x7f8ce8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8ce77fe640 1 -- 172.21.15.53:0/1828664834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8001fe0 con 0x7f8d001336d0 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8ce77fe640 1 -- 172.21.15.53:0/1828664834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80011d0 con 0x7f8d001336d0 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d000b3e10 con 0x7f8d001336d0 2024-09-13T18:32:50.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8ce77fe640 1 -- 172.21.15.53:0/1828664834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80ad630 con 0x7f8d001336d0 2024-09-13T18:32:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d00134830 con 0x7f8d001336d0 2024-09-13T18:32:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.457+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0006e210 con 0x7f8d001336d0 2024-09-13T18:32:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.461+0000 7f8ce77fe640 1 -- 172.21.15.53:0/1828664834 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f8cf80aa030 con 0x7f8d001336d0 2024-09-13T18:32:50.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.461+0000 7f8ce77fe640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8cec066c30 0x7f8cec0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.461+0000 7f8ce77fe640 1 -- 172.21.15.53:0/1828664834 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cf811e120 con 0x7f8d001336d0 2024-09-13T18:32:50.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.461+0000 7f8cfeffd640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8cec066c30 0x7f8cec0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.461+0000 7f8cfeffd640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8cec066c30 0x7f8cec0690f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009a30 tx=0x7f8cf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.465+0000 7f8ce77fe640 1 -- 172.21.15.53:0/1828664834 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8cf80eab10 con 0x7f8d001336d0 2024-09-13T18:32:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.625+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8d00134ce0 con 0x7f8d001336d0 2024-09-13T18:32:50.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.625+0000 7f8ce77fe640 1 -- 172.21.15.53:0/1828664834 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8cf80ee130 con 0x7f8d001336d0 2024-09-13T18:32:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8cec066c30 msgr2=0x7f8cec0690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8cec066c30 0x7f8cec0690f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009a30 tx=0x7f8cf0008040 comp rx=0 tx=0).stop 2024-09-13T18:32:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d001336d0 msgr2=0x7f8d00133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d001336d0 0x7f8d00133b80 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8098da0 tx=0x7f8ce8005800 comp rx=0 tx=0).stop 2024-09-13T18:32:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 shutdown_connections 2024-09-13T18:32:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8cec066c30 0x7f8cec0690f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d000c7fd0 0x7f8d000b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d001336d0 0x7f8d00133b80 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 --2- 172.21.15.53:0/1828664834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d000c7bf0 0x7f8d000b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 >> 172.21.15.53:0/1828664834 conn(0x7f8d000b1310 msgr2=0x7f8d000af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 shutdown_connections 2024-09-13T18:32:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.629+0000 7f8d05674640 1 -- 172.21.15.53:0/1828664834 wait complete. 2024-09-13T18:32:50.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create non_existent_subvolume subvolume_1 2024-09-13T18:32:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea53d90640 1 Processor -- start 2024-09-13T18:32:50.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea53d90640 1 -- start start 2024-09-13T18:32:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea53d90640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea4c143e80 0x7fea4c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea53d90640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c0caee0 0x7fea4c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea53d90640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4c06f7a0 con 0x7fea4c0cd320 2024-09-13T18:32:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea53d90640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4c06fd60 con 0x7fea4c143e80 2024-09-13T18:32:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea53d90640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c0cb960 con 0x7fea4c0caee0 2024-09-13T18:32:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea51b2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea4c143e80 0x7fea4c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea5232d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fea4c0cd320 0x7fea4c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54132/0 (socket says 172.21.15.53:54132) 2024-09-13T18:32:50.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea51b2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea4c143e80 0x7fea4c06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53480/0 (socket says 172.21.15.53:53480) 2024-09-13T18:32:50.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea5232d640 1 -- 172.21.15.53:0/1661630671 learned_addr learned my addr 172.21.15.53:0/1661630671 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:50.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea5132b640 1 --2- 172.21.15.53:0/1661630671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c0caee0 0x7fea4c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea51b2c640 1 -- 172.21.15.53:0/1661630671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c0caee0 msgr2=0x7fea4c0cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:50.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea51b2c640 1 --2- 172.21.15.53:0/1661630671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c0caee0 0x7fea4c0cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea51b2c640 1 -- 172.21.15.53:0/1661630671 >> v1:172.21.15.53:6789/0 conn(0x7fea4c0cd320 legacy=0x7fea4c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea50b2a640 1 -- 172.21.15.53:0/1661630671 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734130475 0 0) 0x7fea4c06f7a0 con 0x7fea4c0cd320 2024-09-13T18:32:50.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.777+0000 7fea51b2c640 1 -- 172.21.15.53:0/1661630671 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0cbc40 con 0x7fea4c143e80 2024-09-13T18:32:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea51b2c640 1 --2- 172.21.15.53:0/1661630671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c143e80 0x7fea4c06b390 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fea44009d90 tx=0x7fea4401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dd05f897f6b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea50b2a640 1 -- 172.21.15.53:0/1661630671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea440a5950 con 0x7fea4c143e80 2024-09-13T18:32:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea50b2a640 1 -- 172.21.15.53:0/1661630671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea440a5ab0 con 0x7fea4c143e80 2024-09-13T18:32:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea50b2a640 1 -- 172.21.15.53:0/1661630671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea440a5e40 con 0x7fea4c143e80 2024-09-13T18:32:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- 172.21.15.53:0/1661630671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c143e80 msgr2=0x7fea4c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 --2- 172.21.15.53:0/1661630671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c143e80 0x7fea4c06b390 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fea44009d90 tx=0x7fea4401c8b0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- 172.21.15.53:0/1661630671 shutdown_connections 2024-09-13T18:32:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 --2- 172.21.15.53:0/1661630671 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c0caee0 0x7fea4c0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 --2- 172.21.15.53:0/1661630671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c143e80 0x7fea4c06b390 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- 172.21.15.53:0/1661630671 >> 172.21.15.53:0/1661630671 conn(0x7fea4c065c80 msgr2=0x7fea4c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- 172.21.15.53:0/1661630671 shutdown_connections 2024-09-13T18:32:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- 172.21.15.53:0/1661630671 wait complete. 2024-09-13T18:32:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 Processor -- start 2024-09-13T18:32:50.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- start start 2024-09-13T18:32:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea4c0caee0 0x7fea4c0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c0cd320 0x7fea4c1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c143e80 0x7fea4c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c142ed0 con 0x7fea4c0cd320 2024-09-13T18:32:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1580b0 con 0x7fea4c0caee0 2024-09-13T18:32:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea53d90640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1365f0 con 0x7fea4c143e80 2024-09-13T18:32:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea5132b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c0cd320 0x7fea4c1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea5132b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c0cd320 0x7fea4c1427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53484/0 (socket says 172.21.15.53:53484) 2024-09-13T18:32:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea5132b640 1 -- 172.21.15.53:0/4287391677 learned_addr learned my addr 172.21.15.53:0/4287391677 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea51b2c640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea4c0caee0 0x7fea4c0b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea5232d640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c143e80 0x7fea4c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.781+0000 7fea5132b640 1 -- 172.21.15.53:0/4287391677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c143e80 msgr2=0x7fea4c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea5132b640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c143e80 0x7fea4c155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea5132b640 1 -- 172.21.15.53:0/4287391677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea4c0caee0 msgr2=0x7fea4c0b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea5132b640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea4c0caee0 0x7fea4c0b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea5132b640 1 -- 172.21.15.53:0/4287391677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44009a70 con 0x7fea4c0cd320 2024-09-13T18:32:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea5232d640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea4c143e80 0x7fea4c155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:50.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea5132b640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea4c0cd320 0x7fea4c1427d0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00d5f0 tx=0x7fea3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea427fc640 1 -- 172.21.15.53:0/4287391677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0125f0 con 0x7fea4c0cd320 2024-09-13T18:32:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea427fc640 1 -- 172.21.15.53:0/4287391677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c012750 con 0x7fea4c0cd320 2024-09-13T18:32:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea53d90640 1 -- 172.21.15.53:0/4287391677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c1556b0 con 0x7fea4c0cd320 2024-09-13T18:32:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea427fc640 1 -- 172.21.15.53:0/4287391677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c012ae0 con 0x7fea4c0cd320 2024-09-13T18:32:50.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea53d90640 1 -- 172.21.15.53:0/4287391677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c157a60 con 0x7fea4c0cd320 2024-09-13T18:32:50.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea53d90640 1 -- 172.21.15.53:0/4287391677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4c0cb320 con 0x7fea4c0cd320 2024-09-13T18:32:50.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea427fc640 1 -- 172.21.15.53:0/4287391677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fea3c012c40 con 0x7fea4c0cd320 2024-09-13T18:32:50.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea427fc640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea30066c30 0x7fea300690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea427fc640 1 -- 172.21.15.53:0/4287391677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea3c085030 con 0x7fea4c0cd320 2024-09-13T18:32:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea51b2c640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea30066c30 0x7fea300690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.785+0000 7fea51b2c640 1 --2- 172.21.15.53:0/4287391677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea30066c30 0x7fea300690f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fea440af000 tx=0x7fea440a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.789+0000 7fea427fc640 1 -- 172.21.15.53:0/4287391677 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea3c051bc0 con 0x7fea4c0cd320 2024-09-13T18:32:50.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.973+0000 7fea53d90640 1 -- 172.21.15.53:0/4287391677 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fea4c070a00 con 0x7fea30066c30 2024-09-13T18:32:50.978 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:50.977+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:50.977+0000 7fea427fc640 1 -- 172.21.15.53:0/4287391677 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7fea440ad540 con 0x7fea30066c30 2024-09-13T18:32:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:50.984 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:50.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm non_existent_subvolume subvolume_1 2024-09-13T18:32:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.109+0000 7f9962736640 1 Processor -- start 2024-09-13T18:32:51.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.109+0000 7f9962736640 1 -- start start 2024-09-13T18:32:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f9962736640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f995c156bc0 0x7f995c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f9962736640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f995c0b2730 0x7f995c06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f9962736640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c06d340 con 0x7f995c06bfb0 2024-09-13T18:32:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f9962736640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0b2bc0 con 0x7f995c0b2730 2024-09-13T18:32:51.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f9962736640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c06c7c0 con 0x7f995c156bc0 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f99537fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f995c0b2730 0x7f995c06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f9960cd3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f995c06bfb0 0x7f995c160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54146/0 (socket says 172.21.15.53:54146) 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f9960cd3640 1 -- 172.21.15.53:0/516428133 learned_addr learned my addr 172.21.15.53:0/516428133 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f995bfff640 1 --2- 172.21.15.53:0/516428133 >> v2:172.21.15.87:3300/0 conn(0x7f995c156bc0 0x7f995c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f99537fe640 1 -- 172.21.15.53:0/516428133 >> v2:172.21.15.87:3300/0 conn(0x7f995c156bc0 msgr2=0x7f995c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f99537fe640 1 --2- 172.21.15.53:0/516428133 >> v2:172.21.15.87:3300/0 conn(0x7f995c156bc0 0x7f995c0b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f99537fe640 1 -- 172.21.15.53:0/516428133 >> v1:172.21.15.53:6789/0 conn(0x7f995c06bfb0 legacy=0x7f995c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f99537fe640 1 -- 172.21.15.53:0/516428133 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c06caa0 con 0x7f995c0b2730 2024-09-13T18:32:51.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f995b7fe640 1 -- 172.21.15.53:0/516428133 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265789123 0 0) 0x7f995c06d340 con 0x7f995c06bfb0 2024-09-13T18:32:51.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.113+0000 7f99537fe640 1 --2- 172.21.15.53:0/516428133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0b2730 0x7f995c06ba70 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3490363afdab0f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995b7fe640 1 -- 172.21.15.53:0/516428133 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440ac600 con 0x7f995c0b2730 2024-09-13T18:32:51.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995b7fe640 1 -- 172.21.15.53:0/516428133 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99440a8050 con 0x7f995c0b2730 2024-09-13T18:32:51.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995b7fe640 1 -- 172.21.15.53:0/516428133 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440ac980 con 0x7f995c0b2730 2024-09-13T18:32:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- 172.21.15.53:0/516428133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0b2730 msgr2=0x7f995c06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 --2- 172.21.15.53:0/516428133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0b2730 0x7f995c06ba70 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401c3a0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- 172.21.15.53:0/516428133 shutdown_connections 2024-09-13T18:32:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 --2- 172.21.15.53:0/516428133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0b2730 0x7f995c06ba70 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 --2- 172.21.15.53:0/516428133 >> v2:172.21.15.87:3300/0 conn(0x7f995c156bc0 0x7f995c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- 172.21.15.53:0/516428133 >> 172.21.15.53:0/516428133 conn(0x7f995c069f50 msgr2=0x7f995c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- 172.21.15.53:0/516428133 shutdown_connections 2024-09-13T18:32:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- 172.21.15.53:0/516428133 wait complete. 2024-09-13T18:32:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 Processor -- start 2024-09-13T18:32:51.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- start start 2024-09-13T18:32:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c06bfb0 0x7f995c1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f995c0b2730 0x7f995c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f995c156bc0 0x7f995c14a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c153800 con 0x7f995c06bfb0 2024-09-13T18:32:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c152c80 con 0x7f995c0b2730 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f9962736640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c152f60 con 0x7f995c156bc0 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c06bfb0 0x7f995c1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c06bfb0 0x7f995c1488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53496/0 (socket says 172.21.15.53:53496) 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 -- 172.21.15.53:0/6818877 learned_addr learned my addr 172.21.15.53:0/6818877 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f99537fe640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f995c0b2730 0x7f995c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 -- 172.21.15.53:0/6818877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f995c156bc0 msgr2=0x7f995c14a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f995c156bc0 0x7f995c14a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 -- 172.21.15.53:0/6818877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f995c0b2730 msgr2=0x7f995c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f995c0b2730 0x7f995c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f995bfff640 1 -- 172.21.15.53:0/6818877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944009420 con 0x7f995c06bfb0 2024-09-13T18:32:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.117+0000 7f99537fe640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f995c0b2730 0x7f995c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f995bfff640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c06bfb0 0x7f995c1488b0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f994c00d5f0 tx=0x7f994c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99597fa640 1 -- 172.21.15.53:0/6818877 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0125f0 con 0x7f995c06bfb0 2024-09-13T18:32:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99597fa640 1 -- 172.21.15.53:0/6818877 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c012750 con 0x7f995c06bfb0 2024-09-13T18:32:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f9962736640 1 -- 172.21.15.53:0/6818877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c153240 con 0x7f995c06bfb0 2024-09-13T18:32:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99597fa640 1 -- 172.21.15.53:0/6818877 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c012ae0 con 0x7f995c06bfb0 2024-09-13T18:32:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f9962736640 1 -- 172.21.15.53:0/6818877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c1528e0 con 0x7f995c06bfb0 2024-09-13T18:32:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f9962736640 1 -- 172.21.15.53:0/6818877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c147370 con 0x7f995c06bfb0 2024-09-13T18:32:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99597fa640 1 -- 172.21.15.53:0/6818877 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f994c012c40 con 0x7f995c06bfb0 2024-09-13T18:32:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99597fa640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f993c066c30 0x7f993c0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99597fa640 1 -- 172.21.15.53:0/6818877 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f994c085070 con 0x7f995c06bfb0 2024-09-13T18:32:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99537fe640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f993c066c30 0x7f993c0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.121+0000 7f99537fe640 1 --2- 172.21.15.53:0/6818877 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f993c066c30 0x7f993c0690f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f99440ae000 tx=0x7f9944008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.125+0000 7f99597fa640 1 -- 172.21.15.53:0/6818877 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f994c051c00 con 0x7f995c06bfb0 2024-09-13T18:32:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.309+0000 7f9962736640 1 -- 172.21.15.53:0/6818877 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f995c1692b0 con 0x7f993c066c30 2024-09-13T18:32:51.315 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:51.313+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.313+0000 7f99597fa640 1 -- 172.21.15.53:0/6818877 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f99440ac7d0 con 0x7f993c066c30 2024-09-13T18:32:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:51.321 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:51.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath non_existent_subvolume subvolume_1 2024-09-13T18:32:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f4df9f640 1 Processor -- start 2024-09-13T18:32:51.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f4df9f640 1 -- start start 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f4df9f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f480ccd10 0x7f8f480cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f4df9f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f480b7db0 con 0x7f8f480d2c80 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f4df9f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f480d0650 con 0x7f8f4815c830 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f4df9f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f480d0c10 con 0x7f8f480ccd10 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f46ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f480ccd10 0x7f8f480cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f47fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8f480d2c80 0x7f8f480b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54156/0 (socket says 172.21.15.53:54156) 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f47fff640 1 -- 172.21.15.53:0/3597881568 learned_addr learned my addr 172.21.15.53:0/3597881568 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:51.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f46ffd640 1 -- 172.21.15.53:0/3597881568 >> v1:172.21.15.87:6789/0 conn(0x7f8f4815c830 legacy=0x7f8f480d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f46ffd640 1 -- 172.21.15.53:0/3597881568 >> v1:172.21.15.53:6789/0 conn(0x7f8f480d2c80 legacy=0x7f8f480b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f467fc640 1 -- 172.21.15.53:0/3597881568 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512013062 0 0) 0x7f8f480b7db0 con 0x7f8f480d2c80 2024-09-13T18:32:51.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.441+0000 7f8f46ffd640 1 -- 172.21.15.53:0/3597881568 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480d17b0 con 0x7f8f480ccd10 2024-09-13T18:32:51.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/3597881568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 0x7f8f480cd180 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f8f300097c0 tx=0x7f8f3001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f6993529b09c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f467fc640 1 -- 172.21.15.53:0/3597881568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300ab600 con 0x7f8f480ccd10 2024-09-13T18:32:51.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f467fc640 1 -- 172.21.15.53:0/3597881568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f300a7050 con 0x7f8f480ccd10 2024-09-13T18:32:51.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f467fc640 1 -- 172.21.15.53:0/3597881568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300ab980 con 0x7f8f480ccd10 2024-09-13T18:32:51.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 -- 172.21.15.53:0/3597881568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 msgr2=0x7f8f480cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 --2- 172.21.15.53:0/3597881568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 0x7f8f480cd180 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f8f300097c0 tx=0x7f8f3001c4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 -- 172.21.15.53:0/3597881568 shutdown_connections 2024-09-13T18:32:51.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 --2- 172.21.15.53:0/3597881568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 0x7f8f480cd180 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 -- 172.21.15.53:0/3597881568 >> 172.21.15.53:0/3597881568 conn(0x7f8f48070970 msgr2=0x7f8f48070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:51.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 -- 172.21.15.53:0/3597881568 shutdown_connections 2024-09-13T18:32:51.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 -- 172.21.15.53:0/3597881568 wait complete. 2024-09-13T18:32:51.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 Processor -- start 2024-09-13T18:32:51.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.445+0000 7f8f4df9f640 1 -- start start 2024-09-13T18:32:51.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 0x7f8f4814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480d2c80 0x7f8f4814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4815c830 0x7f8f4815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4815d810 con 0x7f8f480ccd10 2024-09-13T18:32:51.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4815b880 con 0x7f8f4815c830 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4815ce70 con 0x7f8f480d2c80 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 0x7f8f4814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 0x7f8f4814d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53504/0 (socket says 172.21.15.53:53504) 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 -- 172.21.15.53:0/1829995658 learned_addr learned my addr 172.21.15.53:0/1829995658 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f47fff640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4815c830 0x7f8f4815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480d2c80 0x7f8f4814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 -- 172.21.15.53:0/1829995658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480d2c80 msgr2=0x7f8f4814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f480d2c80 0x7f8f4814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 -- 172.21.15.53:0/1829995658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4815c830 msgr2=0x7f8f4815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f4815c830 0x7f8f4815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 -- 172.21.15.53:0/1829995658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30009420 con 0x7f8f480ccd10 2024-09-13T18:32:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f477fe640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f480ccd10 0x7f8f4814d190 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800c7f0 tx=0x7f8f3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f3ffff640 1 -- 172.21.15.53:0/1829995658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38003b80 con 0x7f8f480ccd10 2024-09-13T18:32:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f3ffff640 1 -- 172.21.15.53:0/1829995658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38003ce0 con 0x7f8f480ccd10 2024-09-13T18:32:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 -- 172.21.15.53:0/1829995658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4815d150 con 0x7f8f480ccd10 2024-09-13T18:32:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f3ffff640 1 -- 172.21.15.53:0/1829995658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800aa90 con 0x7f8f480ccd10 2024-09-13T18:32:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 -- 172.21.15.53:0/1829995658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4814cf00 con 0x7f8f480ccd10 2024-09-13T18:32:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f4df9f640 1 -- 172.21.15.53:0/1829995658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f480cd180 con 0x7f8f480ccd10 2024-09-13T18:32:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f3ffff640 1 -- 172.21.15.53:0/1829995658 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f8f3800abf0 con 0x7f8f480ccd10 2024-09-13T18:32:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f3ffff640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f28066c30 0x7f8f280690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f3ffff640 1 -- 172.21.15.53:0/1829995658 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f38085460 con 0x7f8f480ccd10 2024-09-13T18:32:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.449+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f28066c30 0x7f8f280690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.453+0000 7f8f46ffd640 1 --2- 172.21.15.53:0/1829995658 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f28066c30 0x7f8f280690f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f300ad000 tx=0x7f8f300a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.453+0000 7f8f3ffff640 1 -- 172.21.15.53:0/1829995658 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f380520f0 con 0x7f8f480ccd10 2024-09-13T18:32:51.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.637+0000 7f8f4df9f640 1 -- 172.21.15.53:0/1829995658 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f480d34e0 con 0x7f8f28066c30 2024-09-13T18:32:51.640 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:51.637+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:51.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.637+0000 7f8f3ffff640 1 -- 172.21.15.53:0/1829995658 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f8f300044a0 con 0x7f8f28066c30 2024-09-13T18:32:51.641 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:51.647 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:51.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info non_existent_subvolume subvolume_1 2024-09-13T18:32:51.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.769+0000 7f96c89c9640 1 Processor -- start 2024-09-13T18:32:51.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.769+0000 7f96c89c9640 1 -- start start 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c89c9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c4143e80 0x7f96c406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c89c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96c40cda30 0x7f96c40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c89c9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c406f7a0 con 0x7f96c40caee0 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c89c9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c406fd60 con 0x7f96c40cda30 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c89c9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cb960 con 0x7f96c4143e80 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96bbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f96c40caee0 0x7f96c40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54160/0 (socket says 172.21.15.53:54160) 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96bbfff640 1 -- 172.21.15.53:0/805066748 learned_addr learned my addr 172.21.15.53:0/805066748 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c2d9d640 1 --2- 172.21.15.53:0/805066748 >> v2:172.21.15.53:3300/0 conn(0x7f96c40cda30 0x7f96c40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c259c640 1 --2- 172.21.15.53:0/805066748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c4143e80 0x7f96c406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c1d9b640 1 -- 172.21.15.53:0/805066748 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377039868 0 0) 0x7f96c406f7a0 con 0x7f96c40caee0 2024-09-13T18:32:51.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c1d9b640 1 -- 172.21.15.53:0/805066748 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b0003530 con 0x7f96c40caee0 2024-09-13T18:32:51.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c2d9d640 1 -- 172.21.15.53:0/805066748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c4143e80 msgr2=0x7f96c406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:51.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c2d9d640 1 --2- 172.21.15.53:0/805066748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c4143e80 0x7f96c406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c2d9d640 1 -- 172.21.15.53:0/805066748 >> v1:172.21.15.53:6789/0 conn(0x7f96c40caee0 legacy=0x7f96c40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c2d9d640 1 -- 172.21.15.53:0/805066748 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40cbc40 con 0x7f96c40cda30 2024-09-13T18:32:51.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c2d9d640 1 --2- 172.21.15.53:0/805066748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c40cda30 0x7f96c40cb320 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009d90 tx=0x7f96bc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ede3879a324292d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c1d9b640 1 -- 172.21.15.53:0/805066748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0a5950 con 0x7f96c40cda30 2024-09-13T18:32:51.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c1d9b640 1 -- 172.21.15.53:0/805066748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc0a5ab0 con 0x7f96c40cda30 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.773+0000 7f96c1d9b640 1 -- 172.21.15.53:0/805066748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0a5e40 con 0x7f96c40cda30 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- 172.21.15.53:0/805066748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c40cda30 msgr2=0x7f96c40cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 --2- 172.21.15.53:0/805066748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c40cda30 0x7f96c40cb320 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009d90 tx=0x7f96bc01c8b0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- 172.21.15.53:0/805066748 shutdown_connections 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 --2- 172.21.15.53:0/805066748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c40cda30 0x7f96c40cb320 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 --2- 172.21.15.53:0/805066748 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c4143e80 0x7f96c406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- 172.21.15.53:0/805066748 >> 172.21.15.53:0/805066748 conn(0x7f96c4065c80 msgr2=0x7f96c4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- 172.21.15.53:0/805066748 shutdown_connections 2024-09-13T18:32:51.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- 172.21.15.53:0/805066748 wait complete. 2024-09-13T18:32:51.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 Processor -- start 2024-09-13T18:32:51.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- start start 2024-09-13T18:32:51.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c40caee0 0x7f96c415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c40cda30 0x7f96c40c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4143e80 0x7f96c40c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41589e0 con 0x7f96c4143e80 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4158080 con 0x7f96c40caee0 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4158320 con 0x7f96c40cda30 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4143e80 0x7f96c40c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4143e80 0x7f96c40c3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53526/0 (socket says 172.21.15.53:53526) 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 -- 172.21.15.53:0/1526001290 learned_addr learned my addr 172.21.15.53:0/1526001290 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96bbfff640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c40cda30 0x7f96c40c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c259c640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c40caee0 0x7f96c415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 -- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c40cda30 msgr2=0x7f96c40c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c40cda30 0x7f96c40c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 -- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c40caee0 msgr2=0x7f96c415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c40caee0 0x7f96c415cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:51.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 -- 172.21.15.53:0/1526001290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009a70 con 0x7f96c4143e80 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96bbfff640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f96c40cda30 0x7f96c40c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c259c640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96c40caee0 0x7f96c415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c2d9d640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4143e80 0x7f96c40c3d00 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0b0040 tx=0x7f96bc019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96baffd640 1 -- 172.21.15.53:0/1526001290 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0add90 con 0x7f96c4143e80 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96baffd640 1 -- 172.21.15.53:0/1526001290 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc009450 con 0x7f96c4143e80 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- 172.21.15.53:0/1526001290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c4158600 con 0x7f96c4143e80 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96baffd640 1 -- 172.21.15.53:0/1526001290 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0b9690 con 0x7f96c4143e80 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.777+0000 7f96c89c9640 1 -- 172.21.15.53:0/1526001290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c4140d10 con 0x7f96c4143e80 2024-09-13T18:32:51.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.781+0000 7f96c89c9640 1 -- 172.21.15.53:0/1526001290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4158b20 con 0x7f96c4143e80 2024-09-13T18:32:51.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.781+0000 7f96baffd640 1 -- 172.21.15.53:0/1526001290 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f96bc0b97f0 con 0x7f96c4143e80 2024-09-13T18:32:51.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.781+0000 7f96baffd640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f96a4066c30 0x7f96a40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:51.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.781+0000 7f96baffd640 1 -- 172.21.15.53:0/1526001290 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96bc1202b0 con 0x7f96c4143e80 2024-09-13T18:32:51.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.781+0000 7f96c259c640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f96a4066c30 0x7f96a40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:51.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.781+0000 7f96c259c640 1 --2- 172.21.15.53:0/1526001290 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f96a4066c30 0x7f96a40690f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f96c4156fe0 tx=0x7f96b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:51.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.785+0000 7f96baffd640 1 -- 172.21.15.53:0/1526001290 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96bc0ecf60 con 0x7f96c4143e80 2024-09-13T18:32:51.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.969+0000 7f96c89c9640 1 -- 172.21.15.53:0/1526001290 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f96c406cb20 con 0x7f96a4066c30 2024-09-13T18:32:51.971 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:51.969+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:51.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:51.969+0000 7f96baffd640 1 -- 172.21.15.53:0/1526001290 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f96c406cb20 con 0x7f96a4066c30 2024-09-13T18:32:51.972 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:51.977 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:51.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize non_existent_subvolume subvolname_1 inf 2024-09-13T18:32:52.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8220ea0640 1 Processor -- start 2024-09-13T18:32:52.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8220ea0640 1 -- start start 2024-09-13T18:32:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8220ea0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f821c15c860 0x7f821c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8220ea0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f821c0d1410 0x7f821c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8220ea0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0d1d10 con 0x7f821c0d1860 2024-09-13T18:32:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8220ea0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0d1ff0 con 0x7f821c15c860 2024-09-13T18:32:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8220ea0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0d22d0 con 0x7f821c0d1410 2024-09-13T18:32:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f821a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f821c15c860 0x7f821c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f821a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f821c15c860 0x7f821c0cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53536/0 (socket says 172.21.15.53:53536) 2024-09-13T18:32:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f821a59c640 1 -- 172.21.15.53:0/1331880566 learned_addr learned my addr 172.21.15.53:0/1331880566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.097+0000 7f8213fff640 1 --2- 172.21.15.53:0/1331880566 >> v2:172.21.15.87:3300/0 conn(0x7f821c0d1410 0x7f821c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f821a59c640 1 -- 172.21.15.53:0/1331880566 >> v2:172.21.15.87:3300/0 conn(0x7f821c0d1410 msgr2=0x7f821c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f821a59c640 1 --2- 172.21.15.53:0/1331880566 >> v2:172.21.15.87:3300/0 conn(0x7f821c0d1410 0x7f821c0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f821a59c640 1 -- 172.21.15.53:0/1331880566 >> v1:172.21.15.87:6789/0 conn(0x7f821c0d1860 legacy=0x7f821c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f821a59c640 1 -- 172.21.15.53:0/1331880566 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0b5be0 con 0x7f821c15c860 2024-09-13T18:32:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f821a59c640 1 --2- 172.21.15.53:0/1331880566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 0x7f821c0cdb70 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f821c071420 tx=0x7f820c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d7b5005dfc594f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8219d9b640 1 -- 172.21.15.53:0/1331880566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0a8a10 con 0x7f821c15c860 2024-09-13T18:32:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8219d9b640 1 -- 172.21.15.53:0/1331880566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c0a8b70 con 0x7f821c15c860 2024-09-13T18:32:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8219d9b640 1 -- 172.21.15.53:0/1331880566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0b0440 con 0x7f821c15c860 2024-09-13T18:32:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 -- 172.21.15.53:0/1331880566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 msgr2=0x7f821c0cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 --2- 172.21.15.53:0/1331880566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 0x7f821c0cdb70 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f821c071420 tx=0x7f820c01ed10 comp rx=0 tx=0).stop 2024-09-13T18:32:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 -- 172.21.15.53:0/1331880566 shutdown_connections 2024-09-13T18:32:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 --2- 172.21.15.53:0/1331880566 >> v2:172.21.15.87:3300/0 conn(0x7f821c0d1410 0x7f821c0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 --2- 172.21.15.53:0/1331880566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 0x7f821c0cdb70 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 -- 172.21.15.53:0/1331880566 >> 172.21.15.53:0/1331880566 conn(0x7f821c065c80 msgr2=0x7f821c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 -- 172.21.15.53:0/1331880566 shutdown_connections 2024-09-13T18:32:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.101+0000 7f8220ea0640 1 -- 172.21.15.53:0/1331880566 wait complete. 2024-09-13T18:32:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 Processor -- start 2024-09-13T18:32:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 -- start start 2024-09-13T18:32:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f821c0d1410 0x7f821c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c0d1860 0x7f821c0c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 0x7f821c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c75b0 con 0x7f821c15c860 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c156830 con 0x7f821c0d1860 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c6a30 con 0x7f821c0d1410 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 0x7f821c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 0x7f821c15e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53540/0 (socket says 172.21.15.53:53540) 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 -- 172.21.15.53:0/1329847954 learned_addr learned my addr 172.21.15.53:0/1329847954 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8213fff640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c0d1860 0x7f821c0c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821a59c640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f821c0d1410 0x7f821c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 -- 172.21.15.53:0/1329847954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f821c0d1410 msgr2=0x7f821c155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f821c0d1410 0x7f821c155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 -- 172.21.15.53:0/1329847954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c0d1860 msgr2=0x7f821c0c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f821c0d1860 0x7f821c0c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 -- 172.21.15.53:0/1329847954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0094d0 con 0x7f821c15c860 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f821ad9d640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f821c15c860 0x7f821c15e440 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f821400c7a0 tx=0x7f821400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8212ffd640 1 -- 172.21.15.53:0/1329847954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214003b80 con 0x7f821c15c860 2024-09-13T18:32:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8212ffd640 1 -- 172.21.15.53:0/1329847954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8214003ce0 con 0x7f821c15c860 2024-09-13T18:32:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 -- 172.21.15.53:0/1329847954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0c6d10 con 0x7f821c15c860 2024-09-13T18:32:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8212ffd640 1 -- 172.21.15.53:0/1329847954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400aa30 con 0x7f821c15c860 2024-09-13T18:32:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 -- 172.21.15.53:0/1329847954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0c72d0 con 0x7f821c15c860 2024-09-13T18:32:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8220ea0640 1 -- 172.21.15.53:0/1329847954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c1569a0 con 0x7f821c15c860 2024-09-13T18:32:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8212ffd640 1 -- 172.21.15.53:0/1329847954 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f821400abd0 con 0x7f821c15c860 2024-09-13T18:32:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.105+0000 7f8212ffd640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f81fc066c60 0x7f81fc069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.109+0000 7f8212ffd640 1 -- 172.21.15.53:0/1329847954 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82140849c0 con 0x7f821c15c860 2024-09-13T18:32:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.109+0000 7f821a59c640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f81fc066c60 0x7f81fc069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.109+0000 7f821a59c640 1 --2- 172.21.15.53:0/1329847954 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f81fc066c60 0x7f81fc069120 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f820c0b2000 tx=0x7f820c0aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.113+0000 7f8212ffd640 1 -- 172.21.15.53:0/1329847954 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8214051510 con 0x7f821c15c860 2024-09-13T18:32:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.301+0000 7f8220ea0640 1 -- 172.21.15.53:0/1329847954 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "new_size": "inf", "target": ["mon-mgr", ""]}) v1 -- 0x7f821c0b5890 con 0x7f81fc066c60 2024-09-13T18:32:52.306 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:52.305+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:52.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.305+0000 7f8212ffd640 1 -- 172.21.15.53:0/1329847954 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f820c0bb450 con 0x7f81fc066c60 2024-09-13T18:32:52.307 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:52.312 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:52.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume pin non_existent_subvolume subvolname_1 export 1 2024-09-13T18:32:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27d15eb640 1 Processor -- start 2024-09-13T18:32:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27d15eb640 1 -- start start 2024-09-13T18:32:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27d15eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 0x7f27cc06f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27d15eb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f27cc15e830 0x7f27cc0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27d15eb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc06dfa0 con 0x7f27cc06d620 2024-09-13T18:32:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27d15eb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc06e240 con 0x7f27cc15e830 2024-09-13T18:32:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27d15eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc06e520 con 0x7f27cc151540 2024-09-13T18:32:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f27cc06d620 0x7f27cc15e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54168/0 (socket says 172.21.15.53:54168) 2024-09-13T18:32:52.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 -- 172.21.15.53:0/660287439 learned_addr learned my addr 172.21.15.53:0/660287439 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27cb7fe640 1 --2- 172.21.15.53:0/660287439 >> v2:172.21.15.87:3300/0 conn(0x7f27cc15e830 0x7f27cc0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27caffd640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 0x7f27cc06f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063886720 0 0) 0x7f27cc06dfa0 con 0x7f27cc06d620 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b4003530 con 0x7f27cc06d620 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 188543270 0 0) 0x7f27b4003530 con 0x7f27cc06d620 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 msgr2=0x7f27cc06f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 0x7f27cc06f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 >> v2:172.21.15.87:3300/0 conn(0x7f27cc15e830 msgr2=0x7f27cc0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 --2- 172.21.15.53:0/660287439 >> v2:172.21.15.87:3300/0 conn(0x7f27cc15e830 0x7f27cc0adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc06e800 con 0x7f27cc06d620 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f27bc001680 con 0x7f27cc06d620 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 >> v1:172.21.15.53:6789/0 conn(0x7f27cc06d620 legacy=0x7f27cc15e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 0x7f27b4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b4003f00 0x7f27b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4004d10 0x7f27b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc06e240 con 0x7f27b4003f00 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc06e520 con 0x7f27b4004d10 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400b990 con 0x7f27cc151540 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b4003f00 0x7f27b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27caffd640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 0x7f27b4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27cb7fe640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4004d10 0x7f27b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 -- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 msgr2=0x7f27b4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 0x7f27b4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 -- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4004d10 msgr2=0x7f27b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4004d10 0x7f27b4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27ca7fc640 1 -- 172.21.15.53:0/660287439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4003530 con 0x7f27b4003f00 2024-09-13T18:32:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.441+0000 7f27caffd640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc151540 0x7f27b4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:52.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27ca7fc640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b4003f00 0x7f27b40047d0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c290 tx=0x7f27bc01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1c1b568e1dd8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc005ae0 con 0x7f27b4003f00 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc0ab070 con 0x7f27b4003f00 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27c9ffb640 1 -- 172.21.15.53:0/660287439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc005e80 con 0x7f27b4003f00 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 -- 172.21.15.53:0/660287439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b4003f00 msgr2=0x7f27b40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 --2- 172.21.15.53:0/660287439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b4003f00 0x7f27b40047d0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00c290 tx=0x7f27bc01f3f0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27cb7fe640 1 -- 172.21.15.53:0/660287439 reap_dead start 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 -- 172.21.15.53:0/660287439 shutdown_connections 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 -- 172.21.15.53:0/660287439 >> 172.21.15.53:0/660287439 conn(0x7f27cc071ac0 msgr2=0x7f27cc099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 -- 172.21.15.53:0/660287439 shutdown_connections 2024-09-13T18:32:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 -- 172.21.15.53:0/660287439 wait complete. 2024-09-13T18:32:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 Processor -- start 2024-09-13T18:32:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.445+0000 7f27d15eb640 1 -- start start 2024-09-13T18:32:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4003f00 0x7f27cc155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27cc142c00 0x7f27cc153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc14fa20 0x7f27cc14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc1503e0 con 0x7f27cc142c00 2024-09-13T18:32:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc143040 con 0x7f27b4003f00 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc156150 con 0x7f27cc14fa20 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27cc142c00 0x7f27cc153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27cc142c00 0x7f27cc153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53556/0 (socket says 172.21.15.53:53556) 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 -- 172.21.15.53:0/1664879228 learned_addr learned my addr 172.21.15.53:0/1664879228 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27caffd640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4003f00 0x7f27cc155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27cb7fe640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc14fa20 0x7f27cc14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 -- 172.21.15.53:0/1664879228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc14fa20 msgr2=0x7f27cc14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27cc14fa20 0x7f27cc14fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 -- 172.21.15.53:0/1664879228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4003f00 msgr2=0x7f27cc155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27b4003f00 0x7f27cc155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 -- 172.21.15.53:0/1664879228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc156430 con 0x7f27cc142c00 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27ca7fc640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27cc142c00 0x7f27cc153a50 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f27bc01fc90 tx=0x7f27b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27b37fe640 1 -- 172.21.15.53:0/1664879228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0b7070 con 0x7f27cc142c00 2024-09-13T18:32:52.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27b37fe640 1 -- 172.21.15.53:0/1664879228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc0047f0 con 0x7f27cc142c00 2024-09-13T18:32:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 -- 172.21.15.53:0/1664879228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc156710 con 0x7f27cc142c00 2024-09-13T18:32:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27b37fe640 1 -- 172.21.15.53:0/1664879228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc004ba0 con 0x7f27cc142c00 2024-09-13T18:32:52.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 -- 172.21.15.53:0/1664879228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc153f90 con 0x7f27cc142c00 2024-09-13T18:32:52.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27d15eb640 1 -- 172.21.15.53:0/1664879228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc146800 con 0x7f27cc142c00 2024-09-13T18:32:52.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27b37fe640 1 -- 172.21.15.53:0/1664879228 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f27bc0ad020 con 0x7f27cc142c00 2024-09-13T18:32:52.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27b37fe640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f27b8066c30 0x7f27b80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27b37fe640 1 -- 172.21.15.53:0/1664879228 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27bc1214d0 con 0x7f27cc142c00 2024-09-13T18:32:52.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27caffd640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f27b8066c30 0x7f27b80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.449+0000 7f27caffd640 1 --2- 172.21.15.53:0/1664879228 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f27b8066c30 0x7f27b80690f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f27c00099e0 tx=0x7f27c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.453+0000 7f27b37fe640 1 -- 172.21.15.53:0/1664879228 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27bc0f19e0 con 0x7f27cc142c00 2024-09-13T18:32:52.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.641+0000 7f27d15eb640 1 -- 172.21.15.53:0/1664879228 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume pin", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "pin_type": "export", "pin_setting": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f27cc156bc0 con 0x7f27b8066c30 2024-09-13T18:32:52.645 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:52.641+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.645+0000 7f27b37fe640 1 -- 172.21.15.53:0/1664879228 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f27c0004020 con 0x7f27b8066c30 2024-09-13T18:32:52.645 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:52.652 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:52.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls non_existent_subvolume 2024-09-13T18:32:52.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b478f640 1 Processor -- start 2024-09-13T18:32:52.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b478f640 1 -- start start 2024-09-13T18:32:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b478f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f71ac143e80 0x7f71ac06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b478f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71ac0cda30 0x7f71ac0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b478f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac06f7a0 con 0x7f71ac0caee0 2024-09-13T18:32:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b478f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac06fd60 con 0x7f71ac0cda30 2024-09-13T18:32:52.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b478f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac0cb960 con 0x7f71ac143e80 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b2d2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71ac0cda30 0x7f71ac0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b1d2a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f71ac0caee0 0x7f71ac0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54178/0 (socket says 172.21.15.53:54178) 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b2d2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71ac0cda30 0x7f71ac0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53566/0 (socket says 172.21.15.53:53566) 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.773+0000 7f71b1d2a640 1 -- 172.21.15.53:0/2393502469 learned_addr learned my addr 172.21.15.53:0/2393502469 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b252b640 1 --2- 172.21.15.53:0/2393502469 >> v2:172.21.15.87:3300/0 conn(0x7f71ac143e80 0x7f71ac06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b2d2c640 1 -- 172.21.15.53:0/2393502469 >> v2:172.21.15.87:3300/0 conn(0x7f71ac143e80 msgr2=0x7f71ac06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b2d2c640 1 --2- 172.21.15.53:0/2393502469 >> v2:172.21.15.87:3300/0 conn(0x7f71ac143e80 0x7f71ac06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b2d2c640 1 -- 172.21.15.53:0/2393502469 >> v1:172.21.15.53:6789/0 conn(0x7f71ac0caee0 legacy=0x7f71ac0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b1529640 1 -- 172.21.15.53:0/2393502469 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074449974 0 0) 0x7f71ac06f7a0 con 0x7f71ac0caee0 2024-09-13T18:32:52.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b2d2c640 1 -- 172.21.15.53:0/2393502469 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0cbc40 con 0x7f71ac0cda30 2024-09-13T18:32:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b2d2c640 1 --2- 172.21.15.53:0/2393502469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0cda30 0x7f71ac0cb350 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0676d0 tx=0x7f71a401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339d7f34039f1946 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b1529640 1 -- 172.21.15.53:0/2393502469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40a5880 con 0x7f71ac0cda30 2024-09-13T18:32:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b1529640 1 -- 172.21.15.53:0/2393502469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a40a59e0 con 0x7f71ac0cda30 2024-09-13T18:32:52.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b1529640 1 -- 172.21.15.53:0/2393502469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40a5d70 con 0x7f71ac0cda30 2024-09-13T18:32:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 -- 172.21.15.53:0/2393502469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0cda30 msgr2=0x7f71ac0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 --2- 172.21.15.53:0/2393502469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0cda30 0x7f71ac0cb350 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0676d0 tx=0x7f71a401c7e0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 -- 172.21.15.53:0/2393502469 shutdown_connections 2024-09-13T18:32:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 --2- 172.21.15.53:0/2393502469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0cda30 0x7f71ac0cb350 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 --2- 172.21.15.53:0/2393502469 >> v2:172.21.15.87:3300/0 conn(0x7f71ac143e80 0x7f71ac06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 -- 172.21.15.53:0/2393502469 >> 172.21.15.53:0/2393502469 conn(0x7f71ac065c80 msgr2=0x7f71ac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:52.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 -- 172.21.15.53:0/2393502469 shutdown_connections 2024-09-13T18:32:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.777+0000 7f71b478f640 1 -- 172.21.15.53:0/2393502469 wait complete. 2024-09-13T18:32:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 Processor -- start 2024-09-13T18:32:52.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 -- start start 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0caee0 0x7f71ac1335e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71ac0cda30 0x7f71ac142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac143e80 0x7f71ac159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac133b20 con 0x7f71ac0caee0 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac12f120 con 0x7f71ac143e80 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac12e510 con 0x7f71ac0cda30 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0caee0 0x7f71ac1335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0caee0 0x7f71ac1335e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53570/0 (socket says 172.21.15.53:53570) 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 -- 172.21.15.53:0/3628377371 learned_addr learned my addr 172.21.15.53:0/3628377371 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 -- 172.21.15.53:0/3628377371 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71ac0cda30 msgr2=0x7f71ac142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 --2- 172.21.15.53:0/3628377371 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71ac0cda30 0x7f71ac142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 -- 172.21.15.53:0/3628377371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac143e80 msgr2=0x7f71ac159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 --2- 172.21.15.53:0/3628377371 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71ac143e80 0x7f71ac159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 -- 172.21.15.53:0/3628377371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009a70 con 0x7f71ac0caee0 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b252b640 1 --2- 172.21.15.53:0/3628377371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71ac0caee0 0x7f71ac1335e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f71a800d5f0 tx=0x7f71a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71a2ffd640 1 -- 172.21.15.53:0/3628377371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80125f0 con 0x7f71ac0caee0 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71a2ffd640 1 -- 172.21.15.53:0/3628377371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8012750 con 0x7f71ac0caee0 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 -- 172.21.15.53:0/3628377371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac12e7f0 con 0x7f71ac0caee0 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71a2ffd640 1 -- 172.21.15.53:0/3628377371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8012ae0 con 0x7f71ac0caee0 2024-09-13T18:32:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 -- 172.21.15.53:0/3628377371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac12edb0 con 0x7f71ac0caee0 2024-09-13T18:32:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.781+0000 7f71b478f640 1 -- 172.21.15.53:0/3628377371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac0cb350 con 0x7f71ac0caee0 2024-09-13T18:32:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.785+0000 7f71a2ffd640 1 -- 172.21.15.53:0/3628377371 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f71a8012c40 con 0x7f71ac0caee0 2024-09-13T18:32:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.785+0000 7f71a2ffd640 1 --2- 172.21.15.53:0/3628377371 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7190066c60 0x7f7190069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.785+0000 7f71a2ffd640 1 -- 172.21.15.53:0/3628377371 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71a8085090 con 0x7f71ac0caee0 2024-09-13T18:32:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.785+0000 7f71b1d2a640 1 --2- 172.21.15.53:0/3628377371 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7190066c60 0x7f7190069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.785+0000 7f71b1d2a640 1 --2- 172.21.15.53:0/3628377371 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7190066c60 0x7f7190069120 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f719c0011f0 tx=0x7f719c007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.789+0000 7f71a2ffd640 1 -- 172.21.15.53:0/3628377371 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71a8051b90 con 0x7f71ac0caee0 2024-09-13T18:32:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.965+0000 7f71b478f640 1 -- 172.21.15.53:0/3628377371 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) v1 -- 0x7f71ac0709e0 con 0x7f7190066c60 2024-09-13T18:32:52.970 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:52.969+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:52.969+0000 7f71a2ffd640 1 -- 172.21.15.53:0/3628377371 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f719c0070d0 con 0x7f7190066c60 2024-09-13T18:32:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:52.976 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:52.977 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create non_existent_subvolume subvolume_1 snapshot_1 2024-09-13T18:32:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.093+0000 7f3a0d77f640 1 Processor -- start 2024-09-13T18:32:53.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.093+0000 7f3a0d77f640 1 -- start start 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0815c5e0 0x7f3a0815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a0806ccc0 0x7f3a0806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a08070fb0 con 0x7f3a0806f370 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0806d620 con 0x7f3a0806ccc0 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0815dd30 con 0x7f3a0815c5e0 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f39fffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a0806ccc0 0x7f3a0806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a077fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3a0806f370 0x7f3a0806f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54180/0 (socket says 172.21.15.53:54180) 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a077fe640 1 -- 172.21.15.53:0/2763643330 learned_addr learned my addr 172.21.15.53:0/2763643330 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a06ffd640 1 --2- 172.21.15.53:0/2763643330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0815c5e0 0x7f3a0815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f39fffff640 1 -- 172.21.15.53:0/2763643330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0815c5e0 msgr2=0x7f3a0815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:53.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f39fffff640 1 --2- 172.21.15.53:0/2763643330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0815c5e0 0x7f3a0815d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f39fffff640 1 -- 172.21.15.53:0/2763643330 >> v1:172.21.15.53:6789/0 conn(0x7f3a0806f370 legacy=0x7f3a0806f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f39fffff640 1 -- 172.21.15.53:0/2763643330 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080cd810 con 0x7f3a0806ccc0 2024-09-13T18:32:53.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f39fffff640 1 --2- 172.21.15.53:0/2763643330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0806ccc0 0x7f3a0806d0e0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097c0 tx=0x7f39f001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4593c09db84793fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a067fc640 1 -- 172.21.15.53:0/2763643330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f00ab670 con 0x7f3a0806ccc0 2024-09-13T18:32:53.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a067fc640 1 -- 172.21.15.53:0/2763643330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f00ab7d0 con 0x7f3a0806ccc0 2024-09-13T18:32:53.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a067fc640 1 -- 172.21.15.53:0/2763643330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f00abb60 con 0x7f3a0806ccc0 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2763643330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0806ccc0 msgr2=0x7f3a0806d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 --2- 172.21.15.53:0/2763643330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0806ccc0 0x7f3a0806d0e0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f39f00097c0 tx=0x7f39f001c470 comp rx=0 tx=0).stop 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2763643330 shutdown_connections 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 --2- 172.21.15.53:0/2763643330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0806ccc0 0x7f3a0806d0e0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 --2- 172.21.15.53:0/2763643330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0815c5e0 0x7f3a0815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2763643330 >> 172.21.15.53:0/2763643330 conn(0x7f3a08073330 msgr2=0x7f3a08065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2763643330 shutdown_connections 2024-09-13T18:32:53.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.097+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2763643330 wait complete. 2024-09-13T18:32:53.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 Processor -- start 2024-09-13T18:32:53.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 -- start start 2024-09-13T18:32:53.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a0806ccc0 0x7f3a080ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0806f370 0x7f3a0814f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0815c5e0 0x7f3a081590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080aa290 con 0x7f3a0815c5e0 2024-09-13T18:32:53.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08158c50 con 0x7f3a0806ccc0 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080a8a20 con 0x7f3a0806f370 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0815c5e0 0x7f3a081590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0815c5e0 0x7f3a081590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53596/0 (socket says 172.21.15.53:53596) 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 -- 172.21.15.53:0/2664493163 learned_addr learned my addr 172.21.15.53:0/2664493163 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f39fffff640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0806f370 0x7f3a0814f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a06ffd640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a0806ccc0 0x7f3a080ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 -- 172.21.15.53:0/2664493163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0806f370 msgr2=0x7f3a0814f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a0806f370 0x7f3a0814f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 -- 172.21.15.53:0/2664493163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a0806ccc0 msgr2=0x7f3a080ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a0806ccc0 0x7f3a080ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 -- 172.21.15.53:0/2664493163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f0009420 con 0x7f3a0815c5e0 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a077fe640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a0815c5e0 0x7f3a081590e0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000cbc0 tx=0x7f3a0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2664493163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000ad40 con 0x7f3a0815c5e0 2024-09-13T18:32:53.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2664493163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00012400 con 0x7f3a0815c5e0 2024-09-13T18:32:53.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2664493163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a08158320 con 0x7f3a0815c5e0 2024-09-13T18:32:53.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2664493163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000aea0 con 0x7f3a0815c5e0 2024-09-13T18:32:53.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2664493163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a081588e0 con 0x7f3a0815c5e0 2024-09-13T18:32:53.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2664493163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08158dc0 con 0x7f3a0815c5e0 2024-09-13T18:32:53.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.101+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2664493163 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f3a00007070 con 0x7f3a0815c5e0 2024-09-13T18:32:53.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.105+0000 7f39ff7fe640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39e8066c60 0x7f39e8069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.105+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2664493163 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a00084980 con 0x7f3a0815c5e0 2024-09-13T18:32:53.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.105+0000 7f3a06ffd640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39e8066c60 0x7f39e8069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.105+0000 7f3a06ffd640 1 --2- 172.21.15.53:0/2664493163 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39e8066c60 0x7f39e8069120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a080ad090 tx=0x7f39f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.109+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2664493163 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a000515c0 con 0x7f3a0815c5e0 2024-09-13T18:32:53.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.289+0000 7f3a0d77f640 1 -- 172.21.15.53:0/2664493163 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a080cdc40 con 0x7f39e8066c60 2024-09-13T18:32:53.293 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:53.289+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:53.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.289+0000 7f39ff7fe640 1 -- 172.21.15.53:0/2664493163 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f39f800c040 con 0x7f39e8066c60 2024-09-13T18:32:53.293 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:53.301 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:53.302 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm non_existent_subvolume subvolume_1 snapshot_1 2024-09-13T18:32:53.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.421+0000 7f0c6f450640 1 Processor -- start 2024-09-13T18:32:53.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.421+0000 7f0c6f450640 1 -- start start 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.421+0000 7f0c6f450640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0c680ad3b0 0x7f0c680ad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.421+0000 7f0c6f450640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c680cfb30 con 0x7f0c6815c910 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.421+0000 7f0c6f450640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c680b0ab0 con 0x7f0c68069f50 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.421+0000 7f0c6f450640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6815ccf0 con 0x7f0c680ad3b0 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6d1ec640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0c6815c910 0x7f0c680b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54192/0 (socket says 172.21.15.53:54192) 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6d1ec640 1 -- 172.21.15.53:0/2511932896 learned_addr learned my addr 172.21.15.53:0/2511932896 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/2511932896 >> v2:172.21.15.87:3300/0 conn(0x7f0c680ad3b0 0x7f0c680ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766982463 0 0) 0x7f0c680cfb30 con 0x7f0c6815c910 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c54003530 con 0x7f0c6815c910 2024-09-13T18:32:53.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2775647902 0 0) 0x7f0c54003530 con 0x7f0c6815c910 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 >> v2:172.21.15.87:3300/0 conn(0x7f0c680ad3b0 msgr2=0x7f0c680ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 --2- 172.21.15.53:0/2511932896 >> v2:172.21.15.87:3300/0 conn(0x7f0c680ad3b0 0x7f0c680ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 >> v1:172.21.15.87:6789/0 conn(0x7f0c68069f50 legacy=0x7f0c6806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680b0d90 con 0x7f0c6815c910 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0c58001680 con 0x7f0c6815c910 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 >> v1:172.21.15.53:6789/0 conn(0x7f0c6815c910 legacy=0x7f0c680b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c54003980 0x7f0c54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c54005190 0x7f0c5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6815ccf0 con 0x7f0c540047d0 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5400c030 con 0x7f0c54003980 2024-09-13T18:32:53.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5400c1f0 con 0x7f0c54005190 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6d1ec640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c54003980 0x7f0c54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6d9ed640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c54005190 0x7f0c5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 -- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c54005190 msgr2=0x7f0c5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c54005190 0x7f0c5400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 -- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c54003980 msgr2=0x7f0c54003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c54003980 0x7f0c54003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 -- 172.21.15.53:0/2511932896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c54003530 con 0x7f0c540047d0 2024-09-13T18:32:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6d9ed640 1 -- 172.21.15.53:0/2511932896 reap_dead start 2024-09-13T18:32:53.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c54004c50 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009ae0 tx=0x7f0c6401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfce11e124bb05be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640a5550 con 0x7f0c540047d0 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c640a56b0 con 0x7f0c540047d0 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.425+0000 7f0c5ffff640 1 -- 172.21.15.53:0/2511932896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640a5a60 con 0x7f0c540047d0 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- 172.21.15.53:0/2511932896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 msgr2=0x7f0c54004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c54004c50 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009ae0 tx=0x7f0c6401ca70 comp rx=0 tx=0).stop 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- 172.21.15.53:0/2511932896 shutdown_connections 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 --2- 172.21.15.53:0/2511932896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c54004c50 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- 172.21.15.53:0/2511932896 >> 172.21.15.53:0/2511932896 conn(0x7f0c680b20d0 msgr2=0x7f0c680b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- 172.21.15.53:0/2511932896 shutdown_connections 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- 172.21.15.53:0/2511932896 wait complete. 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 Processor -- start 2024-09-13T18:32:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- start start 2024-09-13T18:32:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c6815fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680b3db0 0x7f0c68153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c680b5000 0x7f0c680b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b59c0 con 0x7f0c540047d0 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c7630 con 0x7f0c680b3db0 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c9a40 con 0x7f0c680b5000 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c6815fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c6815fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53614/0 (socket says 172.21.15.53:53614) 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 -- 172.21.15.53:0/4037920077 learned_addr learned my addr 172.21.15.53:0/4037920077 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680b3db0 0x7f0c68153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d9ed640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c680b5000 0x7f0c680b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 -- 172.21.15.53:0/4037920077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c680b5000 msgr2=0x7f0c680b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c680b5000 0x7f0c680b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 -- 172.21.15.53:0/4037920077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680b3db0 msgr2=0x7f0c68153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680b3db0 0x7f0c68153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 -- 172.21.15.53:0/4037920077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680c9d20 con 0x7f0c540047d0 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6d1ec640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c540047d0 0x7f0c6815fbe0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f0c580118e0 tx=0x7f0c58011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c5dffb640 1 -- 172.21.15.53:0/4037920077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800fb60 con 0x7f0c540047d0 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c5dffb640 1 -- 172.21.15.53:0/4037920077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5800fcc0 con 0x7f0c540047d0 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- 172.21.15.53:0/4037920077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c680ca000 con 0x7f0c540047d0 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c5dffb640 1 -- 172.21.15.53:0/4037920077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58015650 con 0x7f0c540047d0 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.429+0000 7f0c6f450640 1 -- 172.21.15.53:0/4037920077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6815db90 con 0x7f0c540047d0 2024-09-13T18:32:53.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.433+0000 7f0c6f450640 1 -- 172.21.15.53:0/4037920077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6815e0e0 con 0x7f0c540047d0 2024-09-13T18:32:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.433+0000 7f0c5dffb640 1 -- 172.21.15.53:0/4037920077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f0c580157b0 con 0x7f0c540047d0 2024-09-13T18:32:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.433+0000 7f0c5dffb640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c4c066c30 0x7f0c4c0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.433+0000 7f0c5dffb640 1 -- 172.21.15.53:0/4037920077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c58087fa0 con 0x7f0c540047d0 2024-09-13T18:32:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.433+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c4c066c30 0x7f0c4c0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.433+0000 7f0c6c9eb640 1 --2- 172.21.15.53:0/4037920077 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c4c066c30 0x7f0c4c0690f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0c640af000 tx=0x7f0c640046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.437+0000 7f0c5dffb640 1 -- 172.21.15.53:0/4037920077 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c6815e0e0 con 0x7f0c540047d0 2024-09-13T18:32:53.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.621+0000 7f0c6f450640 1 -- 172.21.15.53:0/4037920077 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c680ca240 con 0x7f0c4c066c30 2024-09-13T18:32:53.627 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:53.625+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:53.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.625+0000 7f0c5dffb640 1 -- 172.21.15.53:0/4037920077 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f0c680ca240 con 0x7f0c4c066c30 2024-09-13T18:32:53.628 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:53.633 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:53.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info non_existent_subvolume subvolume_1 snapshot_1 2024-09-13T18:32:53.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d7e4f640 1 Processor -- start 2024-09-13T18:32:53.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d7e4f640 1 -- start start 2024-09-13T18:32:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d7e4f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69d006d950 0x7f69d01410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d7e4f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d0141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d7e4f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d0140d10 con 0x7f69d0140930 2024-09-13T18:32:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d7e4f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d0143a50 con 0x7f69d006d950 2024-09-13T18:32:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d7e4f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d00cddc0 con 0x7f69d006e2f0 2024-09-13T18:32:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d63ec640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d0141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d53ea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69d006d950 0x7f69d01410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d63ec640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d0141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:52772/0 (socket says 172.21.15.53:52772) 2024-09-13T18:32:53.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d53ea640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69d006d950 0x7f69d01410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:60308/0 (socket says 172.21.15.53:60308) 2024-09-13T18:32:53.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d63ec640 1 -- 172.21.15.53:0/3753280692 learned_addr learned my addr 172.21.15.53:0/3753280692 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:53.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d53ea640 1 -- 172.21.15.53:0/3753280692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 msgr2=0x7f69d0141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:53.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d53ea640 1 --2- 172.21.15.53:0/3753280692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d0141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d53ea640 1 -- 172.21.15.53:0/3753280692 >> v1:172.21.15.87:6789/0 conn(0x7f69d0140930 legacy=0x7f69d006d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.761+0000 7f69d53ea640 1 -- 172.21.15.53:0/3753280692 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d00ce060 con 0x7f69d006d950 2024-09-13T18:32:53.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d53ea640 1 --2- 172.21.15.53:0/3753280692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d006d950 0x7f69d01410e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0097c0 tx=0x7f69cc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=589dfbccf58611c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d4be9640 1 -- 172.21.15.53:0/3753280692 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0ab670 con 0x7f69d006d950 2024-09-13T18:32:53.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d4be9640 1 -- 172.21.15.53:0/3753280692 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc0ab7d0 con 0x7f69d006d950 2024-09-13T18:32:53.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d4be9640 1 -- 172.21.15.53:0/3753280692 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0abb60 con 0x7f69d006d950 2024-09-13T18:32:53.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- 172.21.15.53:0/3753280692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d006d950 msgr2=0x7f69d01410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 --2- 172.21.15.53:0/3753280692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d006d950 0x7f69d01410e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0097c0 tx=0x7f69cc01c470 comp rx=0 tx=0).stop 2024-09-13T18:32:53.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- 172.21.15.53:0/3753280692 shutdown_connections 2024-09-13T18:32:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 --2- 172.21.15.53:0/3753280692 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d0141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 --2- 172.21.15.53:0/3753280692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d006d950 0x7f69d01410e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- 172.21.15.53:0/3753280692 >> 172.21.15.53:0/3753280692 conn(0x7f69d006a550 msgr2=0x7f69d00b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- 172.21.15.53:0/3753280692 shutdown_connections 2024-09-13T18:32:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- 172.21.15.53:0/3753280692 wait complete. 2024-09-13T18:32:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 Processor -- start 2024-09-13T18:32:53.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- start start 2024-09-13T18:32:53.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d014c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d0140930 0x7f69d015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d00b3960 0x7f69d00aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d014cdc0 con 0x7f69d00b3960 2024-09-13T18:32:53.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d015a9f0 con 0x7f69d0140930 2024-09-13T18:32:53.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.765+0000 7f69d7e4f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d015ac40 con 0x7f69d006e2f0 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d00b3960 0x7f69d00aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d00b3960 0x7f69d00aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53616/0 (socket says 172.21.15.53:53616) 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 -- 172.21.15.53:0/1025148825 learned_addr learned my addr 172.21.15.53:0/1025148825 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d53ea640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d0140930 0x7f69d015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d5beb640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d014c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 -- 172.21.15.53:0/1025148825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 msgr2=0x7f69d014c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d006e2f0 0x7f69d014c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 -- 172.21.15.53:0/1025148825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d0140930 msgr2=0x7f69d015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d0140930 0x7f69d015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 -- 172.21.15.53:0/1025148825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc009420 con 0x7f69d00b3960 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d63ec640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69d00b3960 0x7f69d00aec50 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f69c800efc0 tx=0x7f69c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69c67fc640 1 -- 172.21.15.53:0/1025148825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800cd20 con 0x7f69d00b3960 2024-09-13T18:32:53.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69c67fc640 1 -- 172.21.15.53:0/1025148825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c800f040 con 0x7f69d00b3960 2024-09-13T18:32:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d7e4f640 1 -- 172.21.15.53:0/1025148825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d015af20 con 0x7f69d00b3960 2024-09-13T18:32:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69c67fc640 1 -- 172.21.15.53:0/1025148825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8003be0 con 0x7f69d00b3960 2024-09-13T18:32:53.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d7e4f640 1 -- 172.21.15.53:0/1025148825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d015b4e0 con 0x7f69d00b3960 2024-09-13T18:32:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d7e4f640 1 -- 172.21.15.53:0/1025148825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d006d240 con 0x7f69d00b3960 2024-09-13T18:32:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69c67fc640 1 -- 172.21.15.53:0/1025148825 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f69c8003d40 con 0x7f69d00b3960 2024-09-13T18:32:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69c67fc640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f69b4066c30 0x7f69b40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69c67fc640 1 -- 172.21.15.53:0/1025148825 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69c80853a0 con 0x7f69d00b3960 2024-09-13T18:32:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d5beb640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f69b4066c30 0x7f69b40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.769+0000 7f69d5beb640 1 --2- 172.21.15.53:0/1025148825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f69b4066c30 0x7f69b40690f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69c0000f70 tx=0x7f69c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.773+0000 7f69c67fc640 1 -- 172.21.15.53:0/1025148825 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69c8051d90 con 0x7f69d00b3960 2024-09-13T18:32:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.965+0000 7f69d7e4f640 1 -- 172.21.15.53:0/1025148825 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f69d0066f50 con 0x7f69b4066c30 2024-09-13T18:32:53.968 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:53.965+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:53.965+0000 7f69c67fc640 1 -- 172.21.15.53:0/1025148825 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f69d0066f50 con 0x7f69b4066c30 2024-09-13T18:32:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:53.973 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:53.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot protect non_existent_subvolume subvolume_1 snapshot_1 2024-09-13T18:32:54.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe89703c640 1 Processor -- start 2024-09-13T18:32:54.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe89703c640 1 -- start start 2024-09-13T18:32:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe89703c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe89015a680 0x7fe89006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe89703c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8900b2560 con 0x7fe890066390 2024-09-13T18:32:54.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe89703c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89006e250 con 0x7fe89006d410 2024-09-13T18:32:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe89703c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89006d9b0 con 0x7fe89015a680 2024-09-13T18:32:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe894dd8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe89015a680 0x7fe89006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe894dd8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe89015a680 0x7fe89006ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53624/0 (socket says 172.21.15.53:53624) 2024-09-13T18:32:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe894dd8640 1 -- 172.21.15.53:0/4103200958 learned_addr learned my addr 172.21.15.53:0/4103200958 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe894dd8640 1 -- 172.21.15.53:0/4103200958 >> v1:172.21.15.87:6789/0 conn(0x7fe89006d410 legacy=0x7fe890065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe894dd8640 1 -- 172.21.15.53:0/4103200958 >> v1:172.21.15.53:6789/0 conn(0x7fe890066390 legacy=0x7fe8900b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.093+0000 7fe894dd8640 1 -- 172.21.15.53:0/4103200958 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89006dc90 con 0x7fe89015a680 2024-09-13T18:32:54.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe894dd8640 1 --2- 172.21.15.53:0/4103200958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 0x7fe89006ced0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe880009870 tx=0x7fe88001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154ba98d5fa2c2e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe88f7fe640 1 -- 172.21.15.53:0/4103200958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8800a7070 con 0x7fe89015a680 2024-09-13T18:32:54.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe88f7fe640 1 -- 172.21.15.53:0/4103200958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8800ab430 con 0x7fe89015a680 2024-09-13T18:32:54.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe88f7fe640 1 -- 172.21.15.53:0/4103200958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8800ab7c0 con 0x7fe89015a680 2024-09-13T18:32:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 -- 172.21.15.53:0/4103200958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 msgr2=0x7fe89006ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 --2- 172.21.15.53:0/4103200958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 0x7fe89006ced0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe880009870 tx=0x7fe88001c520 comp rx=0 tx=0).stop 2024-09-13T18:32:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 -- 172.21.15.53:0/4103200958 shutdown_connections 2024-09-13T18:32:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 --2- 172.21.15.53:0/4103200958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 0x7fe89006ced0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 -- 172.21.15.53:0/4103200958 >> 172.21.15.53:0/4103200958 conn(0x7fe8900cbe80 msgr2=0x7fe8900cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 -- 172.21.15.53:0/4103200958 shutdown_connections 2024-09-13T18:32:54.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 -- 172.21.15.53:0/4103200958 wait complete. 2024-09-13T18:32:54.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 Processor -- start 2024-09-13T18:32:54.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 -- start start 2024-09-13T18:32:54.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe890066390 0x7fe89014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe89006d410 0x7fe890138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.097+0000 7fe89703c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 0x7fe890139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe89703c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8901548e0 con 0x7fe89015a680 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe89703c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe890138420 con 0x7fe890066390 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe89703c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe890137810 con 0x7fe89006d410 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 0x7fe890139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 0x7fe890139190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53640/0 (socket says 172.21.15.53:53640) 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 -- 172.21.15.53:0/3936971328 learned_addr learned my addr 172.21.15.53:0/3936971328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 -- 172.21.15.53:0/3936971328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe89006d410 msgr2=0x7fe890138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 --2- 172.21.15.53:0/3936971328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe89006d410 0x7fe890138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 -- 172.21.15.53:0/3936971328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe890066390 msgr2=0x7fe89014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 --2- 172.21.15.53:0/3936971328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe890066390 0x7fe89014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 -- 172.21.15.53:0/3936971328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800094d0 con 0x7fe89015a680 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe8955d9640 1 --2- 172.21.15.53:0/3936971328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe89015a680 0x7fe890139190 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c400 tx=0x7fe88800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe88d7fa640 1 -- 172.21.15.53:0/3936971328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880052d0 con 0x7fe89015a680 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe88d7fa640 1 -- 172.21.15.53:0/3936971328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888005430 con 0x7fe89015a680 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe89703c640 1 -- 172.21.15.53:0/3936971328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe890137af0 con 0x7fe89015a680 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe88d7fa640 1 -- 172.21.15.53:0/3936971328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888003800 con 0x7fe89015a680 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe89703c640 1 -- 172.21.15.53:0/3936971328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8901380b0 con 0x7fe89015a680 2024-09-13T18:32:54.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe89703c640 1 -- 172.21.15.53:0/3936971328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89006ced0 con 0x7fe89015a680 2024-09-13T18:32:54.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe88d7fa640 1 -- 172.21.15.53:0/3936971328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fe888003960 con 0x7fe89015a680 2024-09-13T18:32:54.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe88d7fa640 1 --2- 172.21.15.53:0/3936971328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe870066c30 0x7fe8700690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe88d7fa640 1 -- 172.21.15.53:0/3936971328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe888084050 con 0x7fe89015a680 2024-09-13T18:32:54.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe894dd8640 1 --2- 172.21.15.53:0/3936971328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe870066c30 0x7fe8700690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.101+0000 7fe894dd8640 1 --2- 172.21.15.53:0/3936971328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe870066c30 0x7fe8700690f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8800af000 tx=0x7fe880008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.105+0000 7fe88d7fa640 1 -- 172.21.15.53:0/3936971328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe888050c00 con 0x7fe89015a680 2024-09-13T18:32:54.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.297+0000 7fe89703c640 1 -- 172.21.15.53:0/3936971328 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot protect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8901680f0 con 0x7fe870066c30 2024-09-13T18:32:54.302 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:54.301+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.301+0000 7fe88d7fa640 1 -- 172.21.15.53:0/3936971328 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7fe8800ab890 con 0x7fe870066c30 2024-09-13T18:32:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:54.308 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:54.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot unprotect non_existent_subvolume subvolume_1 snapshot_1 2024-09-13T18:32:54.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa48369f640 1 Processor -- start 2024-09-13T18:32:54.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa48369f640 1 -- start start 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa48369f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa47c0cf7f0 0x7fa47c167400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa48369f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c0d1d10 con 0x7fa47c0cdb70 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa48369f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c0d1ff0 con 0x7fa47c15c860 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa48369f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47c0d1b20 con 0x7fa47c0cf7f0 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa480c3a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa47c0cdb70 0x7fa47c0cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54220/0 (socket says 172.21.15.53:54220) 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa480c3a640 1 -- 172.21.15.53:0/2787420026 learned_addr learned my addr 172.21.15.53:0/2787420026 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa481c3c640 1 --2- 172.21.15.53:0/2787420026 >> v2:172.21.15.53:3300/0 conn(0x7fa47c0cf7f0 0x7fa47c167400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa473fff640 1 -- 172.21.15.53:0/2787420026 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598251745 0 0) 0x7fa47c0d1d10 con 0x7fa47c0cdb70 2024-09-13T18:32:54.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa473fff640 1 -- 172.21.15.53:0/2787420026 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa468003530 con 0x7fa47c0cdb70 2024-09-13T18:32:54.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa481c3c640 1 -- 172.21.15.53:0/2787420026 >> v1:172.21.15.87:6789/0 conn(0x7fa47c15c860 legacy=0x7fa47c0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa481c3c640 1 -- 172.21.15.53:0/2787420026 >> v1:172.21.15.53:6789/0 conn(0x7fa47c0cdb70 legacy=0x7fa47c0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.433+0000 7fa481c3c640 1 -- 172.21.15.53:0/2787420026 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c0d22d0 con 0x7fa47c0cf7f0 2024-09-13T18:32:54.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa481c3c640 1 --2- 172.21.15.53:0/2787420026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cf7f0 0x7fa47c167400 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa4740097c0 tx=0x7fa47401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b79871b214584e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa473fff640 1 -- 172.21.15.53:0/2787420026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740a8990 con 0x7fa47c0cf7f0 2024-09-13T18:32:54.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa473fff640 1 -- 172.21.15.53:0/2787420026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4740a8af0 con 0x7fa47c0cf7f0 2024-09-13T18:32:54.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa473fff640 1 -- 172.21.15.53:0/2787420026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740a8e80 con 0x7fa47c0cf7f0 2024-09-13T18:32:54.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 -- 172.21.15.53:0/2787420026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cf7f0 msgr2=0x7fa47c167400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 --2- 172.21.15.53:0/2787420026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cf7f0 0x7fa47c167400 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa4740097c0 tx=0x7fa47401ec90 comp rx=0 tx=0).stop 2024-09-13T18:32:54.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 -- 172.21.15.53:0/2787420026 shutdown_connections 2024-09-13T18:32:54.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 --2- 172.21.15.53:0/2787420026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cf7f0 0x7fa47c167400 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 -- 172.21.15.53:0/2787420026 >> 172.21.15.53:0/2787420026 conn(0x7fa47c065c80 msgr2=0x7fa47c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:54.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 -- 172.21.15.53:0/2787420026 shutdown_connections 2024-09-13T18:32:54.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 -- 172.21.15.53:0/2787420026 wait complete. 2024-09-13T18:32:54.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 Processor -- start 2024-09-13T18:32:54.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.437+0000 7fa48369f640 1 -- start start 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cdb70 0x7fa47c0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cf7f0 0x7fa47c0a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c15c860 0x7fa47c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0c7650 con 0x7fa47c0cdb70 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0c7930 con 0x7fa47c15c860 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0c7c10 con 0x7fa47c0cf7f0 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cdb70 0x7fa47c0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cdb70 0x7fa47c0c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53650/0 (socket says 172.21.15.53:53650) 2024-09-13T18:32:54.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 -- 172.21.15.53:0/63028590 learned_addr learned my addr 172.21.15.53:0/63028590 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa481c3c640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c15c860 0x7fa47c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa480c3a640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cf7f0 0x7fa47c0a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 -- 172.21.15.53:0/63028590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cf7f0 msgr2=0x7fa47c0a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0cf7f0 0x7fa47c0a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 -- 172.21.15.53:0/63028590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c15c860 msgr2=0x7fa47c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c15c860 0x7fa47c0b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 -- 172.21.15.53:0/63028590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474009420 con 0x7fa47c0cdb70 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48143b640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa47c0cdb70 0x7fa47c0c6d50 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c7a0 tx=0x7fa47800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa471ffb640 1 -- 172.21.15.53:0/63028590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478003b80 con 0x7fa47c0cdb70 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa471ffb640 1 -- 172.21.15.53:0/63028590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa478003ce0 con 0x7fa47c0cdb70 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa471ffb640 1 -- 172.21.15.53:0/63028590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800aa90 con 0x7fa47c0cdb70 2024-09-13T18:32:54.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 -- 172.21.15.53:0/63028590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c0c7ef0 con 0x7fa47c0cdb70 2024-09-13T18:32:54.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 -- 172.21.15.53:0/63028590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c0c7290 con 0x7fa47c0cdb70 2024-09-13T18:32:54.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa48369f640 1 -- 172.21.15.53:0/63028590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c0cf0e0 con 0x7fa47c0cdb70 2024-09-13T18:32:54.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa471ffb640 1 -- 172.21.15.53:0/63028590 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fa47800abf0 con 0x7fa47c0cdb70 2024-09-13T18:32:54.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa471ffb640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa460066c30 0x7fa4600690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa471ffb640 1 -- 172.21.15.53:0/63028590 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa478084a50 con 0x7fa47c0cdb70 2024-09-13T18:32:54.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa480c3a640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa460066c30 0x7fa4600690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.441+0000 7fa480c3a640 1 --2- 172.21.15.53:0/63028590 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa460066c30 0x7fa4600690f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0b4c60 tx=0x7fa46c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.445+0000 7fa471ffb640 1 -- 172.21.15.53:0/63028590 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa478051550 con 0x7fa47c0cdb70 2024-09-13T18:32:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.629+0000 7fa48369f640 1 -- 172.21.15.53:0/63028590 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot unprotect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa47c0b5890 con 0x7fa460066c30 2024-09-13T18:32:54.632 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:54.629+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:54.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.629+0000 7fa471ffb640 1 -- 172.21.15.53:0/63028590 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7fa46c001c10 con 0x7fa460066c30 2024-09-13T18:32:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:54.638 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:54.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls non_existent_subvolume subvolume_1 2024-09-13T18:32:54.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.753+0000 7fc0f8c1b640 1 Processor -- start 2024-09-13T18:32:54.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.753+0000 7fc0f8c1b640 1 -- start start 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f8c1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f415c5e0 0x7fc0f415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f8c1b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0f406ccc0 0x7fc0f406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f8c1b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f4070fb0 con 0x7fc0f406f370 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f8c1b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f406d620 con 0x7fc0f406ccc0 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f8c1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f415dd30 con 0x7fc0f415c5e0 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0f406ccc0 0x7fc0f406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0f406ccc0 0x7fc0f406d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53658/0 (socket says 172.21.15.53:53658) 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/1793198726 learned_addr learned my addr 172.21.15.53:0/1793198726 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f259c640 1 --2- 172.21.15.53:0/1793198726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f415c5e0 0x7fc0f415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/1793198726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f415c5e0 msgr2=0x7fc0f415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:54.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 --2- 172.21.15.53:0/1793198726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f415c5e0 0x7fc0f415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/1793198726 >> v1:172.21.15.87:6789/0 conn(0x7fc0f406f370 legacy=0x7fc0f406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:54.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/1793198726 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f40cd810 con 0x7fc0f406ccc0 2024-09-13T18:32:54.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f259c640 1 --2- 172.21.15.53:0/1793198726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f415c5e0 0x7fc0f415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:54.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f1d9b640 1 --2- 172.21.15.53:0/1793198726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406ccc0 0x7fc0f406d0e0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800bb10 tx=0x7fc0e801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cdb9a447784820 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f159a640 1 -- 172.21.15.53:0/1793198726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80a7b50 con 0x7fc0f406ccc0 2024-09-13T18:32:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f159a640 1 -- 172.21.15.53:0/1793198726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e80a7cb0 con 0x7fc0f406ccc0 2024-09-13T18:32:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.757+0000 7fc0f159a640 1 -- 172.21.15.53:0/1793198726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80af660 con 0x7fc0f406ccc0 2024-09-13T18:32:54.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/1793198726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406ccc0 msgr2=0x7fc0f406d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 --2- 172.21.15.53:0/1793198726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406ccc0 0x7fc0f406d0e0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800bb10 tx=0x7fc0e801ebc0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/1793198726 shutdown_connections 2024-09-13T18:32:54.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 --2- 172.21.15.53:0/1793198726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406ccc0 0x7fc0f406d0e0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 --2- 172.21.15.53:0/1793198726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f415c5e0 0x7fc0f415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/1793198726 >> 172.21.15.53:0/1793198726 conn(0x7fc0f4073330 msgr2=0x7fc0f4065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:54.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/1793198726 shutdown_connections 2024-09-13T18:32:54.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/1793198726 wait complete. 2024-09-13T18:32:54.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 Processor -- start 2024-09-13T18:32:54.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- start start 2024-09-13T18:32:54.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f406ccc0 0x7fc0f4135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406f370 0x7fc0f4138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0f415c5e0 0x7fc0f4135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f414ba70 con 0x7fc0f406f370 2024-09-13T18:32:54.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f414dd50 con 0x7fc0f415c5e0 2024-09-13T18:32:54.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f8c1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f4135840 con 0x7fc0f406ccc0 2024-09-13T18:32:54.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406f370 0x7fc0f4138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406f370 0x7fc0f4138530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53674/0 (socket says 172.21.15.53:53674) 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/3308152604 learned_addr learned my addr 172.21.15.53:0/3308152604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f259c640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f406ccc0 0x7fc0f4135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/3308152604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f406ccc0 msgr2=0x7fc0f4135300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f2d9d640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0f415c5e0 0x7fc0f4135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0f406ccc0 0x7fc0f4135300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/3308152604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0f415c5e0 msgr2=0x7fc0f4135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0f415c5e0 0x7fc0f4135af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:54.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 -- 172.21.15.53:0/3308152604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e800b770 con 0x7fc0f406f370 2024-09-13T18:32:54.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.761+0000 7fc0f1d9b640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f406f370 0x7fc0f4138530 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800b2c0 tx=0x7fc0e801b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0e2ffd640 1 -- 172.21.15.53:0/3308152604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80be070 con 0x7fc0f406f370 2024-09-13T18:32:54.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0e2ffd640 1 -- 172.21.15.53:0/3308152604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e80afca0 con 0x7fc0f406f370 2024-09-13T18:32:54.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0e2ffd640 1 -- 172.21.15.53:0/3308152604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80ba6c0 con 0x7fc0f406f370 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/3308152604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f414bcc0 con 0x7fc0f406f370 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/3308152604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f414d9e0 con 0x7fc0f406f370 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/3308152604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f414d560 con 0x7fc0f406f370 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0e2ffd640 1 -- 172.21.15.53:0/3308152604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fc0e80c3410 con 0x7fc0f406f370 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0e2ffd640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc0d4066c30 0x7fc0d40690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0e2ffd640 1 -- 172.21.15.53:0/3308152604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0e811fe10 con 0x7fc0f406f370 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0f259c640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc0d4066c30 0x7fc0d40690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:54.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.765+0000 7fc0f259c640 1 --2- 172.21.15.53:0/3308152604 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc0d4066c30 0x7fc0d40690f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4006fd0 tx=0x7fc0e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:54.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.769+0000 7fc0e2ffd640 1 -- 172.21.15.53:0/3308152604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc0f414d560 con 0x7fc0f406f370 2024-09-13T18:32:54.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.953+0000 7fc0f8c1b640 1 -- 172.21.15.53:0/3308152604 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0f40cdc40 con 0x7fc0d4066c30 2024-09-13T18:32:54.956 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:54.953+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:54.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:54.953+0000 7fc0e2ffd640 1 -- 172.21.15.53:0/3308152604 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7fc0e400c040 con 0x7fc0d4066c30 2024-09-13T18:32:54.957 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:54.961 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:54.962 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone non_existent_subvolume subvolume_1 snapshot_1 clone_1 2024-09-13T18:32:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ed485e640 1 Processor -- start 2024-09-13T18:32:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ed485e640 1 -- start start 2024-09-13T18:32:55.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ed485e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 0x7f4ed015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ed485e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed00cd700 con 0x7f4ed0070b90 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ed485e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed00cd9e0 con 0x7f4ed0157020 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ed485e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0157400 con 0x7f4ed00ce4c0 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4ed0070b90 0x7f4ed0159ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54224/0 (socket says 172.21.15.53:54224) 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 -- 172.21.15.53:0/2284436071 learned_addr learned my addr 172.21.15.53:0/2284436071 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987543365 0 0) 0x7f4ed00cd700 con 0x7f4ed0070b90 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb8003530 con 0x7f4ed0070b90 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4eced9d640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 0x7f4ed015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3655849314 0 0) 0x7f4eb8003530 con 0x7f4ed0070b90 2024-09-13T18:32:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 msgr2=0x7f4ed015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 0x7f4ed015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 >> v1:172.21.15.87:6789/0 conn(0x7f4ed0157020 legacy=0x7f4ed0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00cdcc0 con 0x7f4ed0070b90 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f4ec4001680 con 0x7f4ed0070b90 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 >> v1:172.21.15.53:6789/0 conn(0x7f4ed0070b90 legacy=0x7f4ed0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4eb80039b0 0x7f4eb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eb80047d0 0x7f4eb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 0x7f4eb80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0157400 con 0x7f4eb80047d0 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb800bac0 con 0x7f4eb80039b0 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb800bc80 con 0x7f4ed00ce4c0 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eb80047d0 0x7f4eb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ece59c640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4eb80039b0 0x7f4eb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4eced9d640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 0x7f4eb80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 -- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 msgr2=0x7f4eb80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ed00ce4c0 0x7f4eb80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 -- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4eb80039b0 msgr2=0x7f4eb8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4eb80039b0 0x7f4eb8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.097+0000 7f4ecdd9b640 1 -- 172.21.15.53:0/2284436071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8003530 con 0x7f4eb80047d0 2024-09-13T18:32:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ecdd9b640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eb80047d0 0x7f4eb8004c50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c240 tx=0x7f4ec401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9b3f1ca22f861c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4005ae0 con 0x7f4eb80047d0 2024-09-13T18:32:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40ab070 con 0x7f4eb80047d0 2024-09-13T18:32:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ecd59a640 1 -- 172.21.15.53:0/2284436071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4007070 con 0x7f4eb80047d0 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- 172.21.15.53:0/2284436071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eb80047d0 msgr2=0x7f4eb8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 --2- 172.21.15.53:0/2284436071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4eb80047d0 0x7f4eb8004c50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c240 tx=0x7f4ec401f3d0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4eced9d640 1 -- 172.21.15.53:0/2284436071 reap_dead start 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- 172.21.15.53:0/2284436071 shutdown_connections 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- 172.21.15.53:0/2284436071 >> 172.21.15.53:0/2284436071 conn(0x7f4ed00b1380 msgr2=0x7f4ed00b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- 172.21.15.53:0/2284436071 shutdown_connections 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- 172.21.15.53:0/2284436071 wait complete. 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 Processor -- start 2024-09-13T18:32:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- start start 2024-09-13T18:32:55.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4eb80047d0 0x7f4ed014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed014c430 0x7f4ed00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed0157f00 0x7f4ed00ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0141fc0 con 0x7f4ed0157f00 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00b2a90 con 0x7f4ed014c430 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.101+0000 7f4ed485e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0141630 con 0x7f4eb80047d0 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed0157f00 0x7f4ed00ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed0157f00 0x7f4ed00ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53698/0 (socket says 172.21.15.53:53698) 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 -- 172.21.15.53:0/4074659676 learned_addr learned my addr 172.21.15.53:0/4074659676 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ecdd9b640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed014c430 0x7f4ed00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ece59c640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4eb80047d0 0x7f4ed014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 -- 172.21.15.53:0/4074659676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4eb80047d0 msgr2=0x7f4ed014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4eb80047d0 0x7f4ed014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 -- 172.21.15.53:0/4074659676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed014c430 msgr2=0x7f4ed00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed014c430 0x7f4ed00ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 -- 172.21.15.53:0/4074659676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00ae1c0 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ecdd9b640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ed014c430 0x7f4ed00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4eced9d640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ed0157f00 0x7f4ed00ace20 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4ed006bdf0 tx=0x7f4ec8009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ebeffd640 1 -- 172.21.15.53:0/4074659676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8007db0 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ebeffd640 1 -- 172.21.15.53:0/4074659676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec800f050 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ed485e640 1 -- 172.21.15.53:0/4074659676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed00b2720 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ebeffd640 1 -- 172.21.15.53:0/4074659676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8014650 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ed485e640 1 -- 172.21.15.53:0/4074659676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed01412e0 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ed485e640 1 -- 172.21.15.53:0/4074659676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed00b28b0 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ebeffd640 1 -- 172.21.15.53:0/4074659676 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f4ec80147b0 con 0x7f4ed0157f00 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ebeffd640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4eb0066c60 0x7f4eb0069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ece59c640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4eb0066c60 0x7f4eb0069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ebeffd640 1 -- 172.21.15.53:0/4074659676 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ec80851c0 con 0x7f4ed0157f00 2024-09-13T18:32:55.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.105+0000 7f4ece59c640 1 --2- 172.21.15.53:0/4074659676 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4eb0066c60 0x7f4eb0069120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0005510 tx=0x7f4ec0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.109+0000 7f4ebeffd640 1 -- 172.21.15.53:0/4074659676 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ec8051c40 con 0x7f4ed0157f00 2024-09-13T18:32:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.305+0000 7f4ed485e640 1 -- 172.21.15.53:0/4074659676 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ed00cd3f0 con 0x7f4eb0066c60 2024-09-13T18:32:55.314 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.313+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:55.314 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.313+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:55.315 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.313+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:55.315 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.313+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:55.315 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.313+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:32:55.319 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.317+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:55.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.317+0000 7f4ebeffd640 1 -- 172.21.15.53:0/4074659676 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f4ec0001420 con 0x7f4eb0066c60 2024-09-13T18:32:55.320 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:55.325 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:55.325 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status non_existent_subvolume clone_1 2024-09-13T18:32:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 Processor -- start 2024-09-13T18:32:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 -- start start 2024-09-13T18:32:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9fc15c830 0x7fb9fc0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb9fc0ccd10 0x7fb9fc0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0d2c80 0x7fb9fc0d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0d3650 con 0x7fb9fc15c830 2024-09-13T18:32:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0b7db0 con 0x7fb9fc0ccd10 2024-09-13T18:32:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fba01eb2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0d0650 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9fc15c830 0x7fb9fc0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9fc15c830 0x7fb9fc0d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53730/0 (socket says 172.21.15.53:53730) 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 -- 172.21.15.53:0/2800288109 learned_addr learned my addr 172.21.15.53:0/2800288109 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fbfff640 1 --2- 172.21.15.53:0/2800288109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0d2c80 0x7fb9fc0d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9f3fff640 1 --2- 172.21.15.53:0/2800288109 >> v2:172.21.15.87:3300/0 conn(0x7fb9fc0ccd10 0x7fb9fc0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 -- 172.21.15.53:0/2800288109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0d2c80 msgr2=0x7fb9fc0d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 --2- 172.21.15.53:0/2800288109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0d2c80 0x7fb9fc0d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 -- 172.21.15.53:0/2800288109 >> v2:172.21.15.87:3300/0 conn(0x7fb9fc0ccd10 msgr2=0x7fb9fc0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 --2- 172.21.15.53:0/2800288109 >> v2:172.21.15.87:3300/0 conn(0x7fb9fc0ccd10 0x7fb9fc0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 -- 172.21.15.53:0/2800288109 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0d0c10 con 0x7fb9fc15c830 2024-09-13T18:32:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9f3fff640 1 --2- 172.21.15.53:0/2800288109 >> v2:172.21.15.87:3300/0 conn(0x7fb9fc0ccd10 0x7fb9fc0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.445+0000 7fb9fb7fe640 1 --2- 172.21.15.53:0/2800288109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc15c830 0x7fb9fc0d10a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0b43f0 tx=0x7fb9ec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71482c0ead69e422 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9faffd640 1 -- 172.21.15.53:0/2800288109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0a89d0 con 0x7fb9fc15c830 2024-09-13T18:32:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9faffd640 1 -- 172.21.15.53:0/2800288109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0a8b30 con 0x7fb9fc15c830 2024-09-13T18:32:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9faffd640 1 -- 172.21.15.53:0/2800288109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b0440 con 0x7fb9fc15c830 2024-09-13T18:32:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- 172.21.15.53:0/2800288109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc15c830 msgr2=0x7fb9fc0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 --2- 172.21.15.53:0/2800288109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc15c830 0x7fb9fc0d10a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0b43f0 tx=0x7fb9ec01ed10 comp rx=0 tx=0).stop 2024-09-13T18:32:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- 172.21.15.53:0/2800288109 shutdown_connections 2024-09-13T18:32:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 --2- 172.21.15.53:0/2800288109 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0d2c80 0x7fb9fc0d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 --2- 172.21.15.53:0/2800288109 >> v2:172.21.15.87:3300/0 conn(0x7fb9fc0ccd10 0x7fb9fc0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 --2- 172.21.15.53:0/2800288109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc15c830 0x7fb9fc0d10a0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- 172.21.15.53:0/2800288109 >> 172.21.15.53:0/2800288109 conn(0x7fb9fc070970 msgr2=0x7fb9fc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- 172.21.15.53:0/2800288109 shutdown_connections 2024-09-13T18:32:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- 172.21.15.53:0/2800288109 wait complete. 2024-09-13T18:32:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 Processor -- start 2024-09-13T18:32:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- start start 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0ccd10 0x7fb9fc0abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc0d2c80 0x7fb9fc158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9fc15c830 0x7fb9fc0b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1f6240 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1f5350 con 0x7fb9fc15c830 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1f5630 con 0x7fb9fc0ccd10 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc0d2c80 0x7fb9fc158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc0d2c80 0x7fb9fc158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53738/0 (socket says 172.21.15.53:53738) 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 -- 172.21.15.53:0/1230614139 learned_addr learned my addr 172.21.15.53:0/1230614139 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9fbfff640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9fc15c830 0x7fb9fc0b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9fb7fe640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0ccd10 0x7fb9fc0abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 -- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0ccd10 msgr2=0x7fb9fc0abac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0ccd10 0x7fb9fc0abac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 -- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9fc15c830 msgr2=0x7fb9fc0b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9fc15c830 0x7fb9fc0b6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 -- 172.21.15.53:0/1230614139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0094d0 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9fb7fe640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9fc0ccd10 0x7fb9fc0abac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9fbfff640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9fc15c830 0x7fb9fc0b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f3fff640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9fc0d2c80 0x7fb9fc158360 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400c7c0 tx=0x7fb9e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f8ff9640 1 -- 172.21.15.53:0/1230614139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4007a30 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f8ff9640 1 -- 172.21.15.53:0/1230614139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e4007b90 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- 172.21.15.53:0/1230614139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc1f5910 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fb9f8ff9640 1 -- 172.21.15.53:0/1230614139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400ce70 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.449+0000 7fba01eb2640 1 -- 172.21.15.53:0/1230614139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc1f5ed0 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.453+0000 7fba01eb2640 1 -- 172.21.15.53:0/1230614139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc0a91a0 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.453+0000 7fb9f8ff9640 1 -- 172.21.15.53:0/1230614139 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7fb9e40113f0 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.453+0000 7fb9f8ff9640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9dc066c30 0x7fb9dc0690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.453+0000 7fb9f8ff9640 1 -- 172.21.15.53:0/1230614139 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e4085120 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.453+0000 7fb9fb7fe640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9dc066c30 0x7fb9dc0690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.453+0000 7fb9fb7fe640 1 --2- 172.21.15.53:0/1230614139 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9dc066c30 0x7fb9dc0690f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0b2000 tx=0x7fb9ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.457+0000 7fb9f8ff9640 1 -- 172.21.15.53:0/1230614139 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb9fc0a91a0 con 0x7fb9fc0d2c80 2024-09-13T18:32:55.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.645+0000 7fba01eb2640 1 -- 172.21.15.53:0/1230614139 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "non_existent_subvolume", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9fc0d08a0 con 0x7fb9dc066c30 2024-09-13T18:32:55.651 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.649+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:55.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.649+0000 7fb9f8ff9640 1 -- 172.21.15.53:0/1230614139 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7fb9ec0a87d0 con 0x7fb9dc066c30 2024-09-13T18:32:55.652 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:55.655 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:55.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create non_existent_subvolume group_1 2024-09-13T18:32:55.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:55.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:32:55.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfebf5640 1 Processor -- start 2024-09-13T18:32:55.767 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfebf5640 1 -- start start 2024-09-13T18:32:55.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfebf5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf80caee0 0x7f2bf80cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfebf5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2bf80cd320 0x7f2bf80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfebf5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf806f7a0 con 0x7f2bf8143e80 2024-09-13T18:32:55.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfebf5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf806baa0 con 0x7f2bf80cd320 2024-09-13T18:32:55.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfebf5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf806fd60 con 0x7f2bf80caee0 2024-09-13T18:32:55.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bf7fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf80caee0 0x7f2bf80cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfc991640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2bf8143e80 0x7f2bf806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:50196/0 (socket says 172.21.15.53:50196) 2024-09-13T18:32:55.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfc991640 1 -- 172.21.15.53:0/742590959 learned_addr learned my addr 172.21.15.53:0/742590959 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:55.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.765+0000 7f2bfd192640 1 --2- 172.21.15.53:0/742590959 >> v2:172.21.15.87:3300/0 conn(0x7f2bf80cd320 0x7f2bf80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfd192640 1 -- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf80caee0 msgr2=0x7f2bf80cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfd192640 1 --2- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf80caee0 0x7f2bf80cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfd192640 1 -- 172.21.15.53:0/742590959 >> v1:172.21.15.87:6789/0 conn(0x7f2bf8143e80 legacy=0x7f2bf806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfd192640 1 -- 172.21.15.53:0/742590959 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf80cb960 con 0x7f2bf80cd320 2024-09-13T18:32:55.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bf7fff640 1 --2- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf80caee0 0x7f2bf80cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:32:55.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfd192640 1 --2- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 0x7f2bf80cd7b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2be80097c0 tx=0x7f2be801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb4ece1818413bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bf77fe640 1 -- 172.21.15.53:0/742590959 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80ac640 con 0x7f2bf80cd320 2024-09-13T18:32:55.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bf77fe640 1 -- 172.21.15.53:0/742590959 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be80ac7a0 con 0x7f2bf80cd320 2024-09-13T18:32:55.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bf77fe640 1 -- 172.21.15.53:0/742590959 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80acb30 con 0x7f2bf80cd320 2024-09-13T18:32:55.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 -- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 msgr2=0x7f2bf80cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 --2- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 0x7f2bf80cd7b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2be80097c0 tx=0x7f2be801c3e0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 -- 172.21.15.53:0/742590959 shutdown_connections 2024-09-13T18:32:55.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 --2- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 0x7f2bf80cd7b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 --2- 172.21.15.53:0/742590959 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf80caee0 0x7f2bf80cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 -- 172.21.15.53:0/742590959 >> 172.21.15.53:0/742590959 conn(0x7f2bf8065c80 msgr2=0x7f2bf8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:55.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 -- 172.21.15.53:0/742590959 shutdown_connections 2024-09-13T18:32:55.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.769+0000 7f2bfebf5640 1 -- 172.21.15.53:0/742590959 wait complete. 2024-09-13T18:32:55.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 Processor -- start 2024-09-13T18:32:55.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 -- start start 2024-09-13T18:32:55.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bf80caee0 0x7f2bf8138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 0x7f2bf813a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf8143e80 0x7f2bf813e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf81387c0 con 0x7f2bf80caee0 2024-09-13T18:32:55.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf813d4a0 con 0x7f2bf80cd320 2024-09-13T18:32:55.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf813d780 con 0x7f2bf8143e80 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bf80caee0 0x7f2bf8138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bf80caee0 0x7f2bf8138280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53744/0 (socket says 172.21.15.53:53744) 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 -- 172.21.15.53:0/120875637 learned_addr learned my addr 172.21.15.53:0/120875637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf7fff640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 0x7f2bf813a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfd192640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf8143e80 0x7f2bf813e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 -- 172.21.15.53:0/120875637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf8143e80 msgr2=0x7f2bf813e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf8143e80 0x7f2bf813e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 -- 172.21.15.53:0/120875637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 msgr2=0x7f2bf813a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bf80cd320 0x7f2bf813a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 -- 172.21.15.53:0/120875637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0009420 con 0x7f2bf80caee0 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfd192640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bf8143e80 0x7f2bf813e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfc991640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bf80caee0 0x7f2bf8138280 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000cba0 tx=0x7f2bf000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf57fa640 1 -- 172.21.15.53:0/120875637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000ad40 con 0x7f2bf80caee0 2024-09-13T18:32:55.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf57fa640 1 -- 172.21.15.53:0/120875637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0012400 con 0x7f2bf80caee0 2024-09-13T18:32:55.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 -- 172.21.15.53:0/120875637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be8009420 con 0x7f2bf80caee0 2024-09-13T18:32:55.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf57fa640 1 -- 172.21.15.53:0/120875637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000aea0 con 0x7f2bf80caee0 2024-09-13T18:32:55.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 -- 172.21.15.53:0/120875637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf813dd40 con 0x7f2bf80caee0 2024-09-13T18:32:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bfebf5640 1 -- 172.21.15.53:0/120875637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf80cb320 con 0x7f2bf80caee0 2024-09-13T18:32:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf57fa640 1 -- 172.21.15.53:0/120875637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f2bf0007070 con 0x7f2bf80caee0 2024-09-13T18:32:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf57fa640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bd8066c30 0x7f2bd80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf7fff640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bd8066c30 0x7f2bd80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.773+0000 7f2bf57fa640 1 -- 172.21.15.53:0/120875637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bf0084a40 con 0x7f2bf80caee0 2024-09-13T18:32:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.777+0000 7f2bf7fff640 1 --2- 172.21.15.53:0/120875637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bd8066c30 0x7f2bd80690f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8158200 tx=0x7f2be0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.777+0000 7f2bf57fa640 1 -- 172.21.15.53:0/120875637 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2bf0051680 con 0x7f2bf80caee0 2024-09-13T18:32:55.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.965+0000 7f2bfebf5640 1 -- 172.21.15.53:0/120875637 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bf80ce160 con 0x7f2bd8066c30 2024-09-13T18:32:55.968 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:55.965+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:55.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:55.965+0000 7f2bf57fa640 1 -- 172.21.15.53:0/120875637 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f2be0011a70 con 0x7f2bd8066c30 2024-09-13T18:32:55.969 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:55.975 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:55.976 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm non_existent_subvolume group_1 2024-09-13T18:32:56.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.141+0000 7f9a2ebcb640 1 Processor -- start 2024-09-13T18:32:56.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.141+0000 7f9a2ebcb640 1 -- start start 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a28158ba0 0x7f9a280cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a2806ff40 0x7f9a28070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a280b3830 con 0x7f9a280b1dd0 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2806c530 con 0x7f9a2806ff40 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a28070890 con 0x7f9a28158ba0 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2d168640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a2806ff40 0x7f9a28070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a27fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9a280b1dd0 0x7f9a280b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54232/0 (socket says 172.21.15.53:54232) 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a27fff640 1 -- 172.21.15.53:0/3491041014 learned_addr learned my addr 172.21.15.53:0/3491041014 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:56.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2c967640 1 --2- 172.21.15.53:0/3491041014 >> v2:172.21.15.87:3300/0 conn(0x7f9a28158ba0 0x7f9a280cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2d168640 1 -- 172.21.15.53:0/3491041014 >> v2:172.21.15.87:3300/0 conn(0x7f9a28158ba0 msgr2=0x7f9a280cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:56.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2d168640 1 --2- 172.21.15.53:0/3491041014 >> v2:172.21.15.87:3300/0 conn(0x7f9a28158ba0 0x7f9a280cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2d168640 1 -- 172.21.15.53:0/3491041014 >> v1:172.21.15.53:6789/0 conn(0x7f9a280b1dd0 legacy=0x7f9a280b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2d168640 1 -- 172.21.15.53:0/3491041014 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28158f80 con 0x7f9a2806ff40 2024-09-13T18:32:56.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a277fe640 1 -- 172.21.15.53:0/3491041014 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891063848 0 0) 0x7f9a18001120 con 0x7f9a280b1dd0 2024-09-13T18:32:56.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2d168640 1 --2- 172.21.15.53:0/3491041014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a2806ff40 0x7f9a28070350 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f9a2806d7c0 tx=0x7f9a1001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0320a3b09e5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a277fe640 1 -- 172.21.15.53:0/3491041014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100ab600 con 0x7f9a2806ff40 2024-09-13T18:32:56.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a277fe640 1 -- 172.21.15.53:0/3491041014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a100a7050 con 0x7f9a2806ff40 2024-09-13T18:32:56.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a277fe640 1 -- 172.21.15.53:0/3491041014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100ab980 con 0x7f9a2806ff40 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/3491041014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a2806ff40 msgr2=0x7f9a28070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 --2- 172.21.15.53:0/3491041014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a2806ff40 0x7f9a28070350 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f9a2806d7c0 tx=0x7f9a1001c330 comp rx=0 tx=0).stop 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/3491041014 shutdown_connections 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 --2- 172.21.15.53:0/3491041014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a2806ff40 0x7f9a28070350 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 --2- 172.21.15.53:0/3491041014 >> v2:172.21.15.87:3300/0 conn(0x7f9a28158ba0 0x7f9a280cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/3491041014 >> 172.21.15.53:0/3491041014 conn(0x7f9a28065c80 msgr2=0x7f9a28066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/3491041014 shutdown_connections 2024-09-13T18:32:56.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.145+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/3491041014 wait complete. 2024-09-13T18:32:56.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 Processor -- start 2024-09-13T18:32:56.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 -- start start 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2806ff40 0x7f9a281f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a280b1dd0 0x7f9a28153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a28158ba0 0x7f9a280af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28154040 con 0x7f9a280b1dd0 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28154320 con 0x7f9a2806ff40 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28154600 con 0x7f9a28158ba0 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a280b1dd0 0x7f9a28153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a280b1dd0 0x7f9a28153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53750/0 (socket says 172.21.15.53:53750) 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 -- 172.21.15.53:0/2484905335 learned_addr learned my addr 172.21.15.53:0/2484905335 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:56.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 -- 172.21.15.53:0/2484905335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a28158ba0 msgr2=0x7f9a280af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2d168640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a28158ba0 0x7f9a280af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2c967640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2806ff40 0x7f9a281f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9a28158ba0 0x7f9a280af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 -- 172.21.15.53:0/2484905335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2806ff40 msgr2=0x7f9a281f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2806ff40 0x7f9a281f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 -- 172.21.15.53:0/2484905335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009420 con 0x7f9a280b1dd0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a27fff640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a280b1dd0 0x7f9a28153580 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c780 tx=0x7f9a1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a257fa640 1 -- 172.21.15.53:0/2484905335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180072d0 con 0x7f9a280b1dd0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a257fa640 1 -- 172.21.15.53:0/2484905335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18007450 con 0x7f9a280b1dd0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/2484905335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a281548e0 con 0x7f9a280b1dd0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a257fa640 1 -- 172.21.15.53:0/2484905335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180047f0 con 0x7f9a280b1dd0 2024-09-13T18:32:56.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/2484905335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a281f6470 con 0x7f9a280b1dd0 2024-09-13T18:32:56.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/2484905335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a28154e00 con 0x7f9a280b1dd0 2024-09-13T18:32:56.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.149+0000 7f9a257fa640 1 -- 172.21.15.53:0/2484905335 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f9a18004950 con 0x7f9a280b1dd0 2024-09-13T18:32:56.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.153+0000 7f9a257fa640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9a08066c60 0x7f9a08069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.153+0000 7f9a257fa640 1 -- 172.21.15.53:0/2484905335 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a18083f10 con 0x7f9a280b1dd0 2024-09-13T18:32:56.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.153+0000 7f9a2c967640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9a08066c60 0x7f9a08069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.153+0000 7f9a2c967640 1 --2- 172.21.15.53:0/2484905335 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9a08066c60 0x7f9a08069120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009e90 tx=0x7f9a2000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.157+0000 7f9a257fa640 1 -- 172.21.15.53:0/2484905335 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a28154e00 con 0x7f9a280b1dd0 2024-09-13T18:32:56.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.345+0000 7f9a2ebcb640 1 -- 172.21.15.53:0/2484905335 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a280cbf10 con 0x7f9a08066c60 2024-09-13T18:32:56.349 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:56.345+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:56.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.349+0000 7f9a257fa640 1 -- 172.21.15.53:0/2484905335 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f9a20007e40 con 0x7f9a08066c60 2024-09-13T18:32:56.349 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:56.355 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:56.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup getpath non_existent_subvolume group_1 2024-09-13T18:32:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.481+0000 7f434f244640 1 Processor -- start 2024-09-13T18:32:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.481+0000 7f434f244640 1 -- start start 2024-09-13T18:32:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434f244640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43480cda30 0x7f43480cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434f244640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434806f7a0 con 0x7f4348143e80 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434f244640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434806fd60 con 0x7f43480caee0 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434f244640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434806baa0 con 0x7f43480cda30 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434cfe0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4348143e80 0x7f434806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54238/0 (socket says 172.21.15.53:54238) 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434cfe0640 1 -- 172.21.15.53:0/3914080555 learned_addr learned my addr 172.21.15.53:0/3914080555 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434d7e1640 1 --2- 172.21.15.53:0/3914080555 >> v2:172.21.15.87:3300/0 conn(0x7f43480cda30 0x7f43480cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628624752 0 0) 0x7f434806f7a0 con 0x7f4348143e80 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4330003530 con 0x7f4348143e80 2024-09-13T18:32:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3406692418 0 0) 0x7f4330003530 con 0x7f4348143e80 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 >> v2:172.21.15.87:3300/0 conn(0x7f43480cda30 msgr2=0x7f43480cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 --2- 172.21.15.53:0/3914080555 >> v2:172.21.15.87:3300/0 conn(0x7f43480cda30 0x7f43480cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 >> v1:172.21.15.87:6789/0 conn(0x7f43480caee0 legacy=0x7f43480cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480cb960 con 0x7f4348143e80 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f4338001680 con 0x7f4348143e80 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 >> v1:172.21.15.53:6789/0 conn(0x7f4348143e80 legacy=0x7f434806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4330003980 0x7f4330003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300047d0 0x7f4330004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43300052b0 0x7f433000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434806baa0 con 0x7f43300052b0 2024-09-13T18:32:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433000c180 con 0x7f4330003980 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433000c340 con 0x7f43300047d0 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434d7e1640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43300052b0 0x7f433000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434cfe0640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4330003980 0x7f4330003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f4347fff640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300047d0 0x7f4330004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434d7e1640 1 -- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300047d0 msgr2=0x7f4330004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434d7e1640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300047d0 0x7f4330004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434d7e1640 1 -- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4330003980 msgr2=0x7f4330003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434d7e1640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4330003980 0x7f4330003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.485+0000 7f434d7e1640 1 -- 172.21.15.53:0/3914080555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330003530 con 0x7f43300052b0 2024-09-13T18:32:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 -- 172.21.15.53:0/3914080555 reap_dead start 2024-09-13T18:32:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43300052b0 0x7f433000b990 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f43480cb890 tx=0x7f434001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22035e200e243b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400a5c20 con 0x7f43300052b0 2024-09-13T18:32:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434000f040 con 0x7f43300052b0 2024-09-13T18:32:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f43477fe640 1 -- 172.21.15.53:0/3914080555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400ad440 con 0x7f43300052b0 2024-09-13T18:32:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- 172.21.15.53:0/3914080555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43300052b0 msgr2=0x7f433000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43300052b0 0x7f433000b990 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f43480cb890 tx=0x7f434001cc30 comp rx=0 tx=0).stop 2024-09-13T18:32:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- 172.21.15.53:0/3914080555 shutdown_connections 2024-09-13T18:32:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 --2- 172.21.15.53:0/3914080555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43300052b0 0x7f433000b990 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- 172.21.15.53:0/3914080555 >> 172.21.15.53:0/3914080555 conn(0x7f4348065c80 msgr2=0x7f4348066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- 172.21.15.53:0/3914080555 shutdown_connections 2024-09-13T18:32:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- 172.21.15.53:0/3914080555 wait complete. 2024-09-13T18:32:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 Processor -- start 2024-09-13T18:32:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- start start 2024-09-13T18:32:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300052b0 0x7f4348154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4348139ac0 0x7f4348136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43480af480 0x7f43480af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43480afe40 con 0x7f43480af480 2024-09-13T18:32:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4348137570 con 0x7f4348139ac0 2024-09-13T18:32:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434f244640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434813c5e0 con 0x7f43300052b0 2024-09-13T18:32:56.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43480af480 0x7f43480af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43480af480 0x7f43480af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53776/0 (socket says 172.21.15.53:53776) 2024-09-13T18:32:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 -- 172.21.15.53:0/1657351148 learned_addr learned my addr 172.21.15.53:0/1657351148 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434cfe0640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300052b0 0x7f4348154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f4347fff640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4348139ac0 0x7f4348136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 -- 172.21.15.53:0/1657351148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300052b0 msgr2=0x7f4348154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43300052b0 0x7f4348154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 -- 172.21.15.53:0/1657351148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4348139ac0 msgr2=0x7f4348136cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4348139ac0 0x7f4348136cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 -- 172.21.15.53:0/1657351148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434813c8a0 con 0x7f43480af480 2024-09-13T18:32:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f434d7e1640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43480af480 0x7f43480af900 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f434001c6a0 tx=0x7f4340009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f43457fa640 1 -- 172.21.15.53:0/1657351148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400ad780 con 0x7f43480af480 2024-09-13T18:32:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.489+0000 7f43457fa640 1 -- 172.21.15.53:0/1657351148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43400ad8e0 con 0x7f43480af480 2024-09-13T18:32:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f434f244640 1 -- 172.21.15.53:0/1657351148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43481377c0 con 0x7f43480af480 2024-09-13T18:32:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f43457fa640 1 -- 172.21.15.53:0/1657351148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400adc90 con 0x7f43480af480 2024-09-13T18:32:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f434f244640 1 -- 172.21.15.53:0/1657351148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4348137d80 con 0x7f43480af480 2024-09-13T18:32:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f434f244640 1 -- 172.21.15.53:0/1657351148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348070e30 con 0x7f43480af480 2024-09-13T18:32:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f43457fa640 1 -- 172.21.15.53:0/1657351148 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f43400b4040 con 0x7f43480af480 2024-09-13T18:32:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f43457fa640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4334066c30 0x7f43340690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f43457fa640 1 -- 172.21.15.53:0/1657351148 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f434011ebc0 con 0x7f43480af480 2024-09-13T18:32:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f434cfe0640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4334066c30 0x7f43340690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.493+0000 7f434cfe0640 1 --2- 172.21.15.53:0/1657351148 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4334066c30 0x7f43340690f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4338000c10 tx=0x7f4338009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.497+0000 7f43457fa640 1 -- 172.21.15.53:0/1657351148 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43400eb750 con 0x7f43480af480 2024-09-13T18:32:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.673+0000 7f434f244640 1 -- 172.21.15.53:0/1657351148 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup getpath", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f43480ce160 con 0x7f4334066c30 2024-09-13T18:32:56.678 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:56.677+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:56.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.677+0000 7f43457fa640 1 -- 172.21.15.53:0/1657351148 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f4338010830 con 0x7f4334066c30 2024-09-13T18:32:56.679 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:56.684 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:56.684 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup pin non_existent_subvolume group_1 export 0 2024-09-13T18:32:56.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.801+0000 7f27c26d7640 1 Processor -- start 2024-09-13T18:32:56.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.801+0000 7f27c26d7640 1 -- start start 2024-09-13T18:32:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.801+0000 7f27c26d7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f27bc15c860 0x7f27bc0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.801+0000 7f27c26d7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0d1d10 con 0x7f27bc0d1410 2024-09-13T18:32:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.801+0000 7f27c26d7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0d1ff0 con 0x7f27bc0d1860 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.801+0000 7f27c26d7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0d22d0 con 0x7f27bc15c860 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f27bc0d1410 0x7f27bc0cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52196/0 (socket says 172.21.15.53:52196) 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bb7fe640 1 -- 172.21.15.53:0/4156524426 learned_addr learned my addr 172.21.15.53:0/4156524426 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 --2- 172.21.15.53:0/4156524426 >> v2:172.21.15.87:3300/0 conn(0x7f27bc15c860 0x7f27bc0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023603661 0 0) 0x7f27bc0d1d10 con 0x7f27bc0d1410 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a4003530 con 0x7f27bc0d1410 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 761023563 0 0) 0x7f27a4003530 con 0x7f27bc0d1410 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 >> v2:172.21.15.87:3300/0 conn(0x7f27bc15c860 msgr2=0x7f27bc0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 --2- 172.21.15.53:0/4156524426 >> v2:172.21.15.87:3300/0 conn(0x7f27bc15c860 0x7f27bc0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 >> v1:172.21.15.87:6789/0 conn(0x7f27bc0d1860 legacy=0x7f27bc0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0b5be0 con 0x7f27bc0d1410 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f27b0001680 con 0x7f27bc0d1410 2024-09-13T18:32:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 >> v1:172.21.15.53:6789/0 conn(0x7f27bc0d1410 legacy=0x7f27bc0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27a4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27a40047d0 0x7f27a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27a4005190 0x7f27a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0d22d0 con 0x7f27a4003980 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a400c040 con 0x7f27a40047d0 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a400c200 con 0x7f27a4005190 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27a4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bb7fe640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27a40047d0 0x7f27a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 -- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27a4005190 msgr2=0x7f27a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27a4005190 0x7f27a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 -- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27a40047d0 msgr2=0x7f27a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27a40047d0 0x7f27a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 -- 172.21.15.53:0/4156524426 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a4003530 con 0x7f27a4003980 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c0c74640 1 -- 172.21.15.53:0/4156524426 reap_dead start 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bb7fe640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27a40047d0 0x7f27a4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27bbfff640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27a4003da0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009ae0 tx=0x7f27ac01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1b42db7f1b1629 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0a64d0 con 0x7f27a4003980 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac0a6630 con 0x7f27a4003980 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27baffd640 1 -- 172.21.15.53:0/4156524426 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0a69e0 con 0x7f27a4003980 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c26d7640 1 -- 172.21.15.53:0/4156524426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 msgr2=0x7f27a4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c26d7640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27a4003da0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009ae0 tx=0x7f27ac01c8d0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c26d7640 1 -- 172.21.15.53:0/4156524426 shutdown_connections 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c26d7640 1 --2- 172.21.15.53:0/4156524426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27a4003da0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c26d7640 1 -- 172.21.15.53:0/4156524426 >> 172.21.15.53:0/4156524426 conn(0x7f27bc065c80 msgr2=0x7f27bc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c26d7640 1 -- 172.21.15.53:0/4156524426 shutdown_connections 2024-09-13T18:32:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.805+0000 7f27c26d7640 1 -- 172.21.15.53:0/4156524426 wait complete. 2024-09-13T18:32:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 Processor -- start 2024-09-13T18:32:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 -- start start 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27bc0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27bc153d90 0x7f27bc0b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27bc0b4d60 0x7f27bc0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc1f3310 con 0x7f27a4003980 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc1f2690 con 0x7f27bc153d90 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc1f2970 con 0x7f27bc0b4d60 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27bc0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27bc0b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34088/0 (socket says 172.21.15.53:34088) 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 -- 172.21.15.53:0/2307284279 learned_addr learned my addr 172.21.15.53:0/2307284279 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bb7fe640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27bc153d90 0x7f27bc0b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c0c74640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27bc0b4d60 0x7f27bc0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 -- 172.21.15.53:0/2307284279 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27bc0b4d60 msgr2=0x7f27bc0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27bc0b4d60 0x7f27bc0ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 -- 172.21.15.53:0/2307284279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27bc153d90 msgr2=0x7f27bc0b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27bc153d90 0x7f27bc0b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 -- 172.21.15.53:0/2307284279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc1f2c50 con 0x7f27a4003980 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bb7fe640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27bc153d90 0x7f27bc0b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27bbfff640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27a4003980 0x7f27bc0b2130 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0b0040 tx=0x7f27ac019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00f0c0 con 0x7f27a4003980 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac0a69b0 con 0x7f27a4003980 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0a6d20 con 0x7f27a4003980 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 -- 172.21.15.53:0/2307284279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc1f2f30 con 0x7f27a4003980 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 -- 172.21.15.53:0/2307284279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc154210 con 0x7f27a4003980 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.809+0000 7f27c26d7640 1 -- 172.21.15.53:0/2307284279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc0cf0e0 con 0x7f27a4003980 2024-09-13T18:32:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.813+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 21) v1 ==== 86602+0+0 (secure 0 0 0) 0x7f27ac006040 con 0x7f27a4003980 2024-09-13T18:32:56.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.813+0000 7f27b8ff9640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f27a8066c30 0x7f27a80690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:56.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.813+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27ac0aa070 con 0x7f27a4003980 2024-09-13T18:32:56.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.813+0000 7f27bb7fe640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f27a8066c30 0x7f27a80690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:56.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.813+0000 7f27bb7fe640 1 --2- 172.21.15.53:0/2307284279 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f27a8066c30 0x7f27a80690f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0c95e0 tx=0x7f27b0001480 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:56.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.817+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27ac0ec080 con 0x7f27a4003980 2024-09-13T18:32:56.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.993+0000 7f27c26d7640 1 -- 172.21.15.53:0/2307284279 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "non_existent_subvolume", "group_name": "group_1", "pin_type": "export", "pin_setting": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f27bc0ce0d0 con 0x7f27a8066c30 2024-09-13T18:32:56.997 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:56.997+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:56.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.997+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f27bc0ce0d0 con 0x7f27a8066c30 2024-09-13T18:32:56.998 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:57.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:56.997+0000 7f27b8ff9640 1 -- 172.21.15.53:0/2307284279 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f27ac0ec450 con 0x7f27a4003980 2024-09-13T18:32:57.004 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:57.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup ls non_existent_subvolume 2024-09-13T18:32:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f572117d640 1 Processor -- start 2024-09-13T18:32:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f572117d640 1 -- start start 2024-09-13T18:32:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f572117d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 0x7f571c1673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f572117d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c06d600 con 0x7f571c1460d0 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f572117d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c06d8e0 con 0x7f571c06d080 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f572117d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0b3e00 con 0x7f571c066390 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f571c1460d0 0x7f571c0b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52208/0 (socket says 172.21.15.53:52208) 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 -- 172.21.15.53:0/3817235865 learned_addr learned my addr 172.21.15.53:0/3817235865 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833294236 0 0) 0x7f571c06d600 con 0x7f571c1460d0 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5704003530 con 0x7f571c1460d0 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571b59e640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 0x7f571c1673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3072035414 0 0) 0x7f5704003530 con 0x7f571c1460d0 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 msgr2=0x7f571c1673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 0x7f571c1673e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 >> v1:172.21.15.87:6789/0 conn(0x7f571c06d080 legacy=0x7f571c065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c06dbc0 con 0x7f571c1460d0 2024-09-13T18:32:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f570c001680 con 0x7f571c1460d0 2024-09-13T18:32:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571b59e640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 0x7f571c1673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 >> v1:172.21.15.53:6789/0 conn(0x7f571c1460d0 legacy=0x7f571c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57040039b0 0x7f5704003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 0x7f57040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5704004d10 0x7f5704005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570400bb20 con 0x7f57040039b0 2024-09-13T18:32:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570400bc90 con 0x7f5704004d10 2024-09-13T18:32:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570400be50 con 0x7f571c066390 2024-09-13T18:32:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57040039b0 0x7f5704003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571a59c640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 0x7f57040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571b59e640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5704004d10 0x7f5704005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 -- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 msgr2=0x7f57040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f571c066390 0x7f57040047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 -- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5704004d10 msgr2=0x7f5704005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5704004d10 0x7f5704005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.125+0000 7f571ad9d640 1 -- 172.21.15.53:0/3817235865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704003530 con 0x7f57040039b0 2024-09-13T18:32:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f571ad9d640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57040039b0 0x7f5704003dd0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c240 tx=0x7f570c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2ce8609fe73ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0a5b10 con 0x7f57040039b0 2024-09-13T18:32:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c0a5c70 con 0x7f57040039b0 2024-09-13T18:32:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f5719d9b640 1 -- 172.21.15.53:0/3817235865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c005b20 con 0x7f57040039b0 2024-09-13T18:32:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 -- 172.21.15.53:0/3817235865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57040039b0 msgr2=0x7f5704003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 --2- 172.21.15.53:0/3817235865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57040039b0 0x7f5704003dd0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c240 tx=0x7f570c01cc30 comp rx=0 tx=0).stop 2024-09-13T18:32:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f571b59e640 1 -- 172.21.15.53:0/3817235865 reap_dead start 2024-09-13T18:32:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 -- 172.21.15.53:0/3817235865 shutdown_connections 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 -- 172.21.15.53:0/3817235865 >> 172.21.15.53:0/3817235865 conn(0x7f571c069f50 msgr2=0x7f571c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 -- 172.21.15.53:0/3817235865 shutdown_connections 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 -- 172.21.15.53:0/3817235865 wait complete. 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 Processor -- start 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 -- start start 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.129+0000 7f572117d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57040039b0 0x7f571c15f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571c15f810 0x7f571c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571c1426f0 0x7f571c142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c1430b0 con 0x7f571c15f810 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0afb70 con 0x7f571c1426f0 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0afe50 con 0x7f57040039b0 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571c15f810 0x7f571c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571c15f810 0x7f571c0af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34106/0 (socket says 172.21.15.53:34106) 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 -- 172.21.15.53:0/1385857263 learned_addr learned my addr 172.21.15.53:0/1385857263 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571ad9d640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57040039b0 0x7f571c15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571b59e640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571c1426f0 0x7f571c142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 -- 172.21.15.53:0/1385857263 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57040039b0 msgr2=0x7f571c15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57040039b0 0x7f571c15f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 -- 172.21.15.53:0/1385857263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571c1426f0 msgr2=0x7f571c142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571c1426f0 0x7f571c142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 -- 172.21.15.53:0/1385857263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0b0130 con 0x7f571c15f810 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571a59c640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571c15f810 0x7f571c0af320 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f571000d770 tx=0x7f571000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f57037fe640 1 -- 172.21.15.53:0/1385857263 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710005270 con 0x7f571c15f810 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f57037fe640 1 -- 172.21.15.53:0/1385857263 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57100053d0 con 0x7f571c15f810 2024-09-13T18:32:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 -- 172.21.15.53:0/1385857263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c0b0410 con 0x7f571c15f810 2024-09-13T18:32:57.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f57037fe640 1 -- 172.21.15.53:0/1385857263 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000b8b0 con 0x7f571c15f810 2024-09-13T18:32:57.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 -- 172.21.15.53:0/1385857263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c15f5a0 con 0x7f571c15f810 2024-09-13T18:32:57.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f572117d640 1 -- 172.21.15.53:0/1385857263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c06aee0 con 0x7f571c15f810 2024-09-13T18:32:57.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f57037fe640 1 -- 172.21.15.53:0/1385857263 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f571000ba10 con 0x7f571c15f810 2024-09-13T18:32:57.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f57037fe640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5708066cf0 0x7f57080691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f57037fe640 1 -- 172.21.15.53:0/1385857263 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5710084cf0 con 0x7f571c15f810 2024-09-13T18:32:57.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571ad9d640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5708066cf0 0x7f57080691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.133+0000 7f571ad9d640 1 --2- 172.21.15.53:0/1385857263 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5708066cf0 0x7f57080691b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f570c0ab000 tx=0x7f570c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.137+0000 7f57037fe640 1 -- 172.21.15.53:0/1385857263 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5710051610 con 0x7f571c15f810 2024-09-13T18:32:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.325+0000 7f572117d640 1 -- 172.21.15.53:0/1385857263 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) v1 -- 0x7f571c065c80 con 0x7f5708066cf0 2024-09-13T18:32:57.329 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:57.325+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:57.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.325+0000 7f57037fe640 1 -- 172.21.15.53:0/1385857263 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f571c065c80 con 0x7f5708066cf0 2024-09-13T18:32:57.329 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:57.337 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:57.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create non_existent_subvolume group_1 snapshot_1 2024-09-13T18:32:57.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa902f5f640 1 Processor -- start 2024-09-13T18:32:57.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa902f5f640 1 -- start start 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa902f5f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa8fc143f20 0x7fa8fc165060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa902f5f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc0b1ba0 con 0x7fa8fc0cdad0 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa902f5f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc0b3020 con 0x7fa8fc0cd6f0 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa902f5f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc0b1f80 con 0x7fa8fc143f20 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa8fc0cdad0 0x7fa8fc143810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52222/0 (socket says 172.21.15.53:52222) 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 -- 172.21.15.53:0/1181950110 learned_addr learned my addr 172.21.15.53:0/1181950110 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058623530 0 0) 0x7fa8fc0b1ba0 con 0x7fa8fc0cdad0 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa9014fc640 1 --2- 172.21.15.53:0/1181950110 >> v2:172.21.15.87:3300/0 conn(0x7fa8fc143f20 0x7fa8fc165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e4003530 con 0x7fa8fc0cdad0 2024-09-13T18:32:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1752382101 0 0) 0x7fa8e4003530 con 0x7fa8fc0cdad0 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 >> v2:172.21.15.87:3300/0 conn(0x7fa8fc143f20 msgr2=0x7fa8fc165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 --2- 172.21.15.53:0/1181950110 >> v2:172.21.15.87:3300/0 conn(0x7fa8fc143f20 0x7fa8fc165060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 >> v1:172.21.15.87:6789/0 conn(0x7fa8fc0cd6f0 legacy=0x7fa8fc0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0b2260 con 0x7fa8fc0cdad0 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa8f0001a00 con 0x7fa8fc0cdad0 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 >> v1:172.21.15.53:6789/0 conn(0x7fa8fc0cdad0 legacy=0x7fa8fc143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8e40039d0 0x7fa8e4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e40051e0 0x7fa8e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0b1f80 con 0x7fa8e40047d0 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e400c130 con 0x7fa8e40051e0 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e400c2f0 con 0x7fa8e40039d0 2024-09-13T18:32:57.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 -- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8e40039d0 msgr2=0x7fa8e4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa900cfb640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8e40039d0 0x7fa8e4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8e40039d0 0x7fa8e4003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 -- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e40051e0 msgr2=0x7fa8e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa9014fc640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e40051e0 0x7fa8e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8e40051e0 0x7fa8e400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa8fbfff640 1 -- 172.21.15.53:0/1181950110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e4003530 con 0x7fa8e40047d0 2024-09-13T18:32:57.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.469+0000 7fa9014fc640 1 -- 172.21.15.53:0/1181950110 reap_dead start 2024-09-13T18:32:57.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8e4004c50 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000a720 tx=0x7fa8f001d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64676633ef6f204 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00ad630 con 0x7fa8e40047d0 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f00a8070 con 0x7fa8e40047d0 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa8fb7fe640 1 -- 172.21.15.53:0/1181950110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00ad9f0 con 0x7fa8e40047d0 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 -- 172.21.15.53:0/1181950110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 msgr2=0x7fa8e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8e4004c50 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000a720 tx=0x7fa8f001d210 comp rx=0 tx=0).stop 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 -- 172.21.15.53:0/1181950110 shutdown_connections 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 --2- 172.21.15.53:0/1181950110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8e4004c50 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 -- 172.21.15.53:0/1181950110 >> 172.21.15.53:0/1181950110 conn(0x7fa8fc073330 msgr2=0x7fa8fc065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 -- 172.21.15.53:0/1181950110 shutdown_connections 2024-09-13T18:32:57.481 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 -- 172.21.15.53:0/1181950110 wait complete. 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 Processor -- start 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.473+0000 7fa902f5f640 1 -- start start 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8fc13db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8fc0c9fc0 0x7fa8fc0c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8fc15b5a0 0x7fa8fc142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0c4c10 con 0x7fa8e40047d0 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0c4930 con 0x7fa8fc0c9fc0 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc15aac0 con 0x7fa8fc15b5a0 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8fc13db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8fc13db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34116/0 (socket says 172.21.15.53:34116) 2024-09-13T18:32:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 -- 172.21.15.53:0/2376256064 learned_addr learned my addr 172.21.15.53:0/2376256064 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8fc0c9fc0 0x7fa8fc0c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 -- 172.21.15.53:0/2376256064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8fc15b5a0 msgr2=0x7fa8fc142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa8fc15b5a0 0x7fa8fc142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 -- 172.21.15.53:0/2376256064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8fc0c9fc0 msgr2=0x7fa8fc0c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8fc0c9fc0 0x7fa8fc0c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 -- 172.21.15.53:0/2376256064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc15ada0 con 0x7fa8e40047d0 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8fc0c9fc0 0x7fa8fc0c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa900cfb640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40047d0 0x7fa8fc13db80 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400d440 tx=0x7fa8f400d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8f97fa640 1 -- 172.21.15.53:0/2376256064 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4005480 con 0x7fa8e40047d0 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8f97fa640 1 -- 172.21.15.53:0/2376256064 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4003620 con 0x7fa8e40047d0 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 -- 172.21.15.53:0/2376256064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc15b080 con 0x7fa8e40047d0 2024-09-13T18:32:57.483 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8f97fa640 1 -- 172.21.15.53:0/2376256064 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40039f0 con 0x7fa8e40047d0 2024-09-13T18:32:57.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 -- 172.21.15.53:0/2376256064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc13e290 con 0x7fa8e40047d0 2024-09-13T18:32:57.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa902f5f640 1 -- 172.21.15.53:0/2376256064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc15a920 con 0x7fa8e40047d0 2024-09-13T18:32:57.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8f97fa640 1 -- 172.21.15.53:0/2376256064 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fa8f4003b50 con 0x7fa8e40047d0 2024-09-13T18:32:57.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8f97fa640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e8066cc0 0x7fa8e8069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8f97fa640 1 -- 172.21.15.53:0/2376256064 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8f4084a60 con 0x7fa8e40047d0 2024-09-13T18:32:57.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e8066cc0 0x7fa8e8069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.477+0000 7fa8fbfff640 1 --2- 172.21.15.53:0/2376256064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa8e8066cc0 0x7fa8e8069180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00ad000 tx=0x7fa8f00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.481+0000 7fa8f97fa640 1 -- 172.21.15.53:0/2376256064 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8fc15a920 con 0x7fa8e40047d0 2024-09-13T18:32:57.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.665+0000 7fa902f5f640 1 -- 172.21.15.53:0/2376256064 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8fc13e290 con 0x7fa8e8066cc0 2024-09-13T18:32:57.671 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:57.669+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:57.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.669+0000 7fa8f97fa640 1 -- 172.21.15.53:0/2376256064 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7fa8fc13e290 con 0x7fa8e8066cc0 2024-09-13T18:32:57.671 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:57.677 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:57.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot rm non_existent_subvolume group_1 snapshot_1 2024-09-13T18:32:57.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.813+0000 7f4c269c7640 1 Processor -- start 2024-09-13T18:32:57.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.813+0000 7f4c269c7640 1 -- start start 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c269c7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 0x7f4c200acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c269c7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c20065c80 0x7f4c200660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c269c7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c20066600 con 0x7f4c20160f00 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c269c7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2006c760 con 0x7f4c20065c80 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c269c7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2006ca00 con 0x7f4c20145f30 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4c20160f00 0x7f4c200b3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52232/0 (socket says 172.21.15.53:52232) 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 -- 172.21.15.53:0/3114319217 learned_addr learned my addr 172.21.15.53:0/3114319217 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:57.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1ffff640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 0x7f4c200acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c24f64640 1 --2- 172.21.15.53:0/3114319217 >> v2:172.21.15.87:3300/0 conn(0x7f4c20065c80 0x7f4c200660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182230484 0 0) 0x7f4c20066600 con 0x7f4c20160f00 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c0c003530 con 0x7f4c20160f00 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972691450 0 0) 0x7f4c0c003530 con 0x7f4c20160f00 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 msgr2=0x7f4c200acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 0x7f4c200acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 >> v2:172.21.15.87:3300/0 conn(0x7f4c20065c80 msgr2=0x7f4c200660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 --2- 172.21.15.53:0/3114319217 >> v2:172.21.15.87:3300/0 conn(0x7f4c20065c80 0x7f4c200660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2006cce0 con 0x7f4c20160f00 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f4c08001680 con 0x7f4c20160f00 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 >> v1:172.21.15.53:6789/0 conn(0x7f4c20160f00 legacy=0x7f4c200b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 0x7f4c0c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c0c003f00 0x7f4c0c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c004d10 0x7f4c0c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2006c760 con 0x7f4c0c003f00 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2006ca00 con 0x7f4c0c004d10 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c00b990 con 0x7f4c20145f30 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c0c003f00 0x7f4c0c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1ffff640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 0x7f4c0c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 -- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 msgr2=0x7f4c0c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 0x7f4c0c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 -- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c004d10 msgr2=0x7f4c0c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c004d10 0x7f4c0c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c17fff640 1 -- 172.21.15.53:0/3114319217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c003530 con 0x7f4c0c003f00 2024-09-13T18:32:57.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.817+0000 7f4c1ffff640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c20145f30 0x7f4c0c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:57.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c17fff640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c0c003f00 0x7f4c0c0047d0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f4c200cf0f0 tx=0x7f4c0801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3016d4159548c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005ae0 con 0x7f4c0c003f00 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c080ab070 con 0x7f4c0c003f00 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c1f7fe640 1 -- 172.21.15.53:0/3114319217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08007070 con 0x7f4c0c003f00 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 -- 172.21.15.53:0/3114319217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c0c003f00 msgr2=0x7f4c0c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 --2- 172.21.15.53:0/3114319217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c0c003f00 0x7f4c0c0047d0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f4c200cf0f0 tx=0x7f4c0801f350 comp rx=0 tx=0).stop 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c24f64640 1 -- 172.21.15.53:0/3114319217 reap_dead start 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 -- 172.21.15.53:0/3114319217 shutdown_connections 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 -- 172.21.15.53:0/3114319217 >> 172.21.15.53:0/3114319217 conn(0x7f4c200b1310 msgr2=0x7f4c200b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 -- 172.21.15.53:0/3114319217 shutdown_connections 2024-09-13T18:32:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 -- 172.21.15.53:0/3114319217 wait complete. 2024-09-13T18:32:57.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 Processor -- start 2024-09-13T18:32:57.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.821+0000 7f4c269c7640 1 -- start start 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c003f00 0x7f4c201f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2013c6c0 0x7f4c2015b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2015bf90 0x7f4c200ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c201f2bf0 con 0x7f4c2013c6c0 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2013cc30 con 0x7f4c0c003f00 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2013cf10 con 0x7f4c2015bf90 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2013c6c0 0x7f4c2015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2013c6c0 0x7f4c2015b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34146/0 (socket says 172.21.15.53:34146) 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 -- 172.21.15.53:0/1816420423 learned_addr learned my addr 172.21.15.53:0/1816420423 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:57.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c24f64640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2015bf90 0x7f4c200ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1ffff640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c003f00 0x7f4c201f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 -- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2015bf90 msgr2=0x7f4c200ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2015bf90 0x7f4c200ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 -- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c003f00 msgr2=0x7f4c201f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c003f00 0x7f4c201f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 -- 172.21.15.53:0/1816420423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2013d1f0 con 0x7f4c2013c6c0 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c24f64640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4c2015bf90 0x7f4c200ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1ffff640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0c003f00 0x7f4c201f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c17fff640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c2013c6c0 0x7f4c2015b720 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f4c08026020 tx=0x7f4c0c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1d7fa640 1 -- 172.21.15.53:0/1816420423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c080b7070 con 0x7f4c2013c6c0 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1d7fa640 1 -- 172.21.15.53:0/1816420423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08005940 con 0x7f4c2013c6c0 2024-09-13T18:32:57.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 -- 172.21.15.53:0/1816420423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2013d4d0 con 0x7f4c2013c6c0 2024-09-13T18:32:57.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1d7fa640 1 -- 172.21.15.53:0/1816420423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005cb0 con 0x7f4c2013c6c0 2024-09-13T18:32:57.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 -- 172.21.15.53:0/1816420423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2015bc60 con 0x7f4c2013c6c0 2024-09-13T18:32:57.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c269c7640 1 -- 172.21.15.53:0/1816420423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c200660c0 con 0x7f4c2013c6c0 2024-09-13T18:32:57.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1d7fa640 1 -- 172.21.15.53:0/1816420423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f4c080ad020 con 0x7f4c2013c6c0 2024-09-13T18:32:57.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1d7fa640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4c00066cc0 0x7f4c00069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:57.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1ffff640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4c00066cc0 0x7f4c00069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:57.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1d7fa640 1 -- 172.21.15.53:0/1816420423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c08121b50 con 0x7f4c2013c6c0 2024-09-13T18:32:57.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.825+0000 7f4c1ffff640 1 --2- 172.21.15.53:0/1816420423 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4c00066cc0 0x7f4c00069180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4c100099e0 tx=0x7f4c10008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:57.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:57.829+0000 7f4c1d7fa640 1 -- 172.21.15.53:0/1816420423 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c080f1e70 con 0x7f4c2013c6c0 2024-09-13T18:32:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.017+0000 7f4c269c7640 1 -- 172.21.15.53:0/1816420423 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c200b3a90 con 0x7f4c00066cc0 2024-09-13T18:32:58.020 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:58.017+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.017+0000 7f4c1d7fa640 1 -- 172.21.15.53:0/1816420423 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f4c10009670 con 0x7f4c00066cc0 2024-09-13T18:32:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:58.026 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:58.027 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot ls non_existent_subvolume group_1 2024-09-13T18:32:58.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81d24b3640 1 Processor -- start 2024-09-13T18:32:58.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81d24b3640 1 -- start start 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81d24b3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f81cc0ae810 0x7f81cc06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81d24b3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc06c4a0 con 0x7f81cc1593f0 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81d24b3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc0ce010 con 0x7f81cc070440 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81d24b3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc0ce2f0 con 0x7f81cc0ae810 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81cbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f81cc1593f0 0x7f81cc0b2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52242/0 (socket says 172.21.15.53:52242) 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81cbfff640 1 -- 172.21.15.53:0/2577391908 learned_addr learned my addr 172.21.15.53:0/2577391908 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81cb7fe640 1 --2- 172.21.15.53:0/2577391908 >> v2:172.21.15.87:3300/0 conn(0x7f81cc0ae810 0x7f81cc06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036094906 0 0) 0x7f81cc06c4a0 con 0x7f81cc1593f0 2024-09-13T18:32:58.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b8003530 con 0x7f81cc1593f0 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723640630 0 0) 0x7f81b8003530 con 0x7f81cc1593f0 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 >> v2:172.21.15.87:3300/0 conn(0x7f81cc0ae810 msgr2=0x7f81cc06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 --2- 172.21.15.53:0/2577391908 >> v2:172.21.15.87:3300/0 conn(0x7f81cc0ae810 0x7f81cc06dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 >> v1:172.21.15.87:6789/0 conn(0x7f81cc070440 legacy=0x7f81cc070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0ce5d0 con 0x7f81cc1593f0 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f81b4001680 con 0x7f81cc1593f0 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 >> v1:172.21.15.53:6789/0 conn(0x7f81cc1593f0 legacy=0x7f81cc0b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81b8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81b80047d0 0x7f81b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005190 0x7f81b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0ce2f0 con 0x7f81b80047d0 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b800c090 con 0x7f81b8005190 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b800c250 con 0x7f81b80039d0 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81cb7fe640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81b80047d0 0x7f81b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81cbfff640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81b8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.141+0000 7f81d0a50640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005190 0x7f81b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81cbfff640 1 -- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005190 msgr2=0x7f81b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81cbfff640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81b8005190 0x7f81b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81cbfff640 1 -- 172.21.15.53:0/2577391908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81b80047d0 msgr2=0x7f81b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81cbfff640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81b80047d0 0x7f81b8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81cbfff640 1 -- 172.21.15.53:0/2577391908 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b8003530 con 0x7f81b80039d0 2024-09-13T18:32:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d0a50640 1 -- 172.21.15.53:0/2577391908 reap_dead start 2024-09-13T18:32:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81cbfff640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81b8003df0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f81b400c0e0 tx=0x7f81b401f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a345698db72b65a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40058e0 con 0x7f81b80039d0 2024-09-13T18:32:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b4005a40 con 0x7f81b80039d0 2024-09-13T18:32:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81caffd640 1 -- 172.21.15.53:0/2577391908 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4005e70 con 0x7f81b80039d0 2024-09-13T18:32:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d24b3640 1 -- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 msgr2=0x7f81b8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d24b3640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81b8003df0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f81b400c0e0 tx=0x7f81b401f2b0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d24b3640 1 -- 172.21.15.53:0/2577391908 shutdown_connections 2024-09-13T18:32:58.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d24b3640 1 --2- 172.21.15.53:0/2577391908 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81b8003df0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d24b3640 1 -- 172.21.15.53:0/2577391908 >> 172.21.15.53:0/2577391908 conn(0x7f81cc0b1310 msgr2=0x7f81cc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:58.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d24b3640 1 -- 172.21.15.53:0/2577391908 shutdown_connections 2024-09-13T18:32:58.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.145+0000 7f81d24b3640 1 -- 172.21.15.53:0/2577391908 wait complete. 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 Processor -- start 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 -- start start 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81cc1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81cc1569f0 0x7f81cc156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81cc159b40 0x7f81cc159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc158250 con 0x7f81cc159b40 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1573b0 con 0x7f81cc1569f0 2024-09-13T18:32:58.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc157640 con 0x7f81b80039d0 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81cc159b40 0x7f81cc159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81cc159b40 0x7f81cc159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34150/0 (socket says 172.21.15.53:34150) 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 -- 172.21.15.53:0/1718836188 learned_addr learned my addr 172.21.15.53:0/1718836188 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81cb7fe640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81cc1569f0 0x7f81cc156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81cbfff640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81cc1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 -- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 msgr2=0x7f81cc1508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81cc1508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 -- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81cc1569f0 msgr2=0x7f81cc156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81cc1569f0 0x7f81cc156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 -- 172.21.15.53:0/1718836188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc157920 con 0x7f81cc159b40 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81cbfff640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f81b80039d0 0x7f81cc1508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:58.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81cb7fe640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81cc1569f0 0x7f81cc156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d0a50640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81cc159b40 0x7f81cc159fc0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0ce8b0 tx=0x7f81c400f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81c8ff9640 1 -- 172.21.15.53:0/1718836188 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40052e0 con 0x7f81cc159b40 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81c8ff9640 1 -- 172.21.15.53:0/1718836188 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4005460 con 0x7f81cc159b40 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 -- 172.21.15.53:0/1718836188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc157c00 con 0x7f81cc159b40 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81c8ff9640 1 -- 172.21.15.53:0/1718836188 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4003840 con 0x7f81cc159b40 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 -- 172.21.15.53:0/1718836188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc150df0 con 0x7f81cc159b40 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81d24b3640 1 -- 172.21.15.53:0/1718836188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc0cf360 con 0x7f81cc159b40 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81c8ff9640 1 -- 172.21.15.53:0/1718836188 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f81c40039a0 con 0x7f81cc159b40 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.149+0000 7f81c8ff9640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f81ac066cf0 0x7f81ac0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.153+0000 7f81c8ff9640 1 -- 172.21.15.53:0/1718836188 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81c4084950 con 0x7f81cc159b40 2024-09-13T18:32:58.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.153+0000 7f81cbfff640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f81ac066cf0 0x7f81ac0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.153+0000 7f81cbfff640 1 --2- 172.21.15.53:0/1718836188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f81ac066cf0 0x7f81ac0691b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f81b40ae000 tx=0x7f81b40aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:58.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.157+0000 7f81c8ff9640 1 -- 172.21.15.53:0/1718836188 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81c4051380 con 0x7f81cc159b40 2024-09-13T18:32:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.333+0000 7f81d24b3640 1 -- 172.21.15.53:0/1718836188 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot ls", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f81cc0cbe00 con 0x7f81ac066cf0 2024-09-13T18:32:58.338 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:32:58.337+0000 7f2616ead640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-13T18:32:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.337+0000 7f81c8ff9640 1 -- 172.21.15.53:0/1718836188 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) v1 ==== 45+0+0 (secure 0 0 0) 0x7f81cc0cbe00 con 0x7f81ac066cf0 2024-09-13T18:32:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-13T18:32:58.344 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T18:32:58.344 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:32:58.346 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:58.431 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:32:58.499 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:32:58.499 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:32:58.499 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:32:58.505 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:32:58.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a85cd640 1 Processor -- start 2024-09-13T18:32:58.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a85cd640 1 -- start start 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a85cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 0x7f64a006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a85cd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f64a00713a0 0x7f64a006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a85cd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a006d480 con 0x7f64a015b7c0 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a85cd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a015aaf0 con 0x7f64a00713a0 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a85cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a006d760 con 0x7f64a01582a0 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f64a015b7c0 0x7f64a0070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52252/0 (socket says 172.21.15.53:52252) 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 -- 172.21.15.53:0/3609022093 learned_addr learned my addr 172.21.15.53:0/3609022093 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a6b6a640 1 --2- 172.21.15.53:0/3609022093 >> v2:172.21.15.87:3300/0 conn(0x7f64a00713a0 0x7f64a006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a6369640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 0x7f64a006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217554649 0 0) 0x7f64a006d480 con 0x7f64a015b7c0 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6488003530 con 0x7f64a015b7c0 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4214299053 0 0) 0x7f6488003530 con 0x7f64a015b7c0 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 msgr2=0x7f64a006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 0x7f64a006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 >> v2:172.21.15.87:3300/0 conn(0x7f64a00713a0 msgr2=0x7f64a006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 --2- 172.21.15.53:0/3609022093 >> v2:172.21.15.87:3300/0 conn(0x7f64a00713a0 0x7f64a006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a015ace0 con 0x7f64a015b7c0 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6494001680 con 0x7f64a015b7c0 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 >> v1:172.21.15.53:6789/0 conn(0x7f64a015b7c0 legacy=0x7f64a0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 0x7f6488003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6488004d10 0x7f6488005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648800b990 con 0x7f6488003f00 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648800bad0 con 0x7f6488004d10 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648800bc10 con 0x7f64a01582a0 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a6369640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 0x7f6488003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a6b6a640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6488004d10 0x7f6488005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 -- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 msgr2=0x7f6488003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a01582a0 0x7f6488003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 -- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6488004d10 msgr2=0x7f6488005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6488004d10 0x7f6488005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a5b68640 1 -- 172.21.15.53:0/3609022093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488003530 con 0x7f6488003f00 2024-09-13T18:32:58.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.677+0000 7f64a6b6a640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6488004d10 0x7f6488005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a5b68640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64880047d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f649400c210 tx=0x7f649401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9151589da1de96a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494005ae0 con 0x7f6488003f00 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940ab070 con 0x7f6488003f00 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a5367640 1 -- 172.21.15.53:0/3609022093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494007070 con 0x7f6488003f00 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 -- 172.21.15.53:0/3609022093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 msgr2=0x7f64880047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 --2- 172.21.15.53:0/3609022093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64880047d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f649400c210 tx=0x7f649401f370 comp rx=0 tx=0).stop 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a6b6a640 1 -- 172.21.15.53:0/3609022093 reap_dead start 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 -- 172.21.15.53:0/3609022093 shutdown_connections 2024-09-13T18:32:58.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 -- 172.21.15.53:0/3609022093 >> 172.21.15.53:0/3609022093 conn(0x7f64a0065c80 msgr2=0x7f64a0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:58.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 -- 172.21.15.53:0/3609022093 shutdown_connections 2024-09-13T18:32:58.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 -- 172.21.15.53:0/3609022093 wait complete. 2024-09-13T18:32:58.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 Processor -- start 2024-09-13T18:32:58.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.681+0000 7f64a85cd640 1 -- start start 2024-09-13T18:32:58.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64a01404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ab50 0x7f64a013d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a00cade0 0x7f64a00cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a00cb7b0 con 0x7f6488003f00 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a01567a0 con 0x7f64a014ab50 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a014cb90 con 0x7f64a00cade0 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64a01404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64a01404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34158/0 (socket says 172.21.15.53:34158) 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 -- 172.21.15.53:0/789923697 learned_addr learned my addr 172.21.15.53:0/789923697 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a5b68640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ab50 0x7f64a013d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6b6a640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a00cade0 0x7f64a00cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 -- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a00cade0 msgr2=0x7f64a00cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a00cade0 0x7f64a00cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 -- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ab50 msgr2=0x7f64a013d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ab50 0x7f64a013d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 -- 172.21.15.53:0/789923697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a01409f0 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a6369640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64a01404b0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f64900115e0 tx=0x7f6490011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f649effd640 1 -- 172.21.15.53:0/789923697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490015870 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f649effd640 1 -- 172.21.15.53:0/789923697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900159d0 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a01561e0 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f649effd640 1 -- 172.21.15.53:0/789923697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490015d40 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a014ce30 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a0067400 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f649effd640 1 -- 172.21.15.53:0/789923697 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f649000f460 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f649effd640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f648c066cc0 0x7f648c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a5b68640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f648c066cc0 0x7f648c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f649effd640 1 -- 172.21.15.53:0/789923697 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6490085130 con 0x7f6488003f00 2024-09-13T18:32:58.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.685+0000 7f64a5b68640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f648c066cc0 0x7f648c069180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f64940ae000 tx=0x7f6494001a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:58.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.689+0000 7f649effd640 1 -- 172.21.15.53:0/789923697 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6490051b60 con 0x7f6488003f00 2024-09-13T18:32:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.853+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64a006d480 con 0x7f6488003f00 2024-09-13T18:32:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.853+0000 7f649effd640 1 -- 172.21.15.53:0/789923697 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f6490055180 con 0x7f6488003f00 2024-09-13T18:32:58.856 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:32:58.856 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":136,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:34.772690+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f648c066cc0 msgr2=0x7f648c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f648c066cc0 0x7f648c069180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f64940ae000 tx=0x7f6494001a10 comp rx=0 tx=0).stop 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 msgr2=0x7f64a01404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64a01404b0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f64900115e0 tx=0x7f6490011aa0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 shutdown_connections 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f648c066cc0 0x7f648c069180 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f64a00cade0 0x7f64a00cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64a014ab50 0x7f64a013d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 --2- 172.21.15.53:0/789923697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6488003f00 0x7f64a01404b0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 >> 172.21.15.53:0/789923697 conn(0x7f64a0065c80 msgr2=0x7f64a0070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 shutdown_connections 2024-09-13T18:32:58.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:58.857+0000 7f64a85cd640 1 -- 172.21.15.53:0/789923697 wait complete. 2024-09-13T18:32:58.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:32:31.405006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:32:32.764715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:32:58.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:32:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.005+0000 7fd99c6a8640 1 Processor -- start 2024-09-13T18:32:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.005+0000 7fd99c6a8640 1 -- start start 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd99415c870 0x7fd9940d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd9940cd760 0x7fd9940cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9940d19c0 con 0x7fd9940cf4e0 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940d0600 con 0x7fd9940cd760 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940cf930 con 0x7fd99415c870 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd9940cd760 0x7fd9940cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd9940cd760 0x7fd9940cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34174/0 (socket says 172.21.15.53:34174) 2024-09-13T18:32:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 -- 172.21.15.53:0/3326302743 learned_addr learned my addr 172.21.15.53:0/3326302743 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99a444640 1 --2- 172.21.15.53:0/3326302743 >> v2:172.21.15.87:3300/0 conn(0x7fd99415c870 0x7fd9940d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 -- 172.21.15.53:0/3326302743 >> v2:172.21.15.87:3300/0 conn(0x7fd99415c870 msgr2=0x7fd9940d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 --2- 172.21.15.53:0/3326302743 >> v2:172.21.15.87:3300/0 conn(0x7fd99415c870 0x7fd9940d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 -- 172.21.15.53:0/3326302743 >> v1:172.21.15.87:6789/0 conn(0x7fd9940cf4e0 legacy=0x7fd9940b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 -- 172.21.15.53:0/3326302743 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940d1bf0 con 0x7fd9940cd760 2024-09-13T18:32:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99a444640 1 --2- 172.21.15.53:0/3326302743 >> v2:172.21.15.87:3300/0 conn(0x7fd99415c870 0x7fd9940d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999c43640 1 --2- 172.21.15.53:0/3326302743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd9940cefa0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fd9940d0310 tx=0x7fd98401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5c1aa31e43cab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999442640 1 -- 172.21.15.53:0/3326302743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840aa610 con 0x7fd9940cd760 2024-09-13T18:32:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999442640 1 -- 172.21.15.53:0/3326302743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9840a6040 con 0x7fd9940cd760 2024-09-13T18:32:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd999442640 1 -- 172.21.15.53:0/3326302743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840aa990 con 0x7fd9940cd760 2024-09-13T18:32:59.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- 172.21.15.53:0/3326302743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 msgr2=0x7fd9940cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/3326302743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd9940cefa0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fd9940d0310 tx=0x7fd98401c4b0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- 172.21.15.53:0/3326302743 shutdown_connections 2024-09-13T18:32:59.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/3326302743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd9940cefa0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/3326302743 >> v2:172.21.15.87:3300/0 conn(0x7fd99415c870 0x7fd9940d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- 172.21.15.53:0/3326302743 >> 172.21.15.53:0/3326302743 conn(0x7fd994065c80 msgr2=0x7fd994066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- 172.21.15.53:0/3326302743 shutdown_connections 2024-09-13T18:32:59.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.009+0000 7fd99c6a8640 1 -- 172.21.15.53:0/3326302743 wait complete. 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 Processor -- start 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 -- start start 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd99415f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9940cf4e0 0x7fd9940c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd99415c870 0x7fd99414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c91a0 con 0x7fd9940cd760 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c7ed0 con 0x7fd99415c870 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c8d10 con 0x7fd9940cf4e0 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd99415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd99415f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34176/0 (socket says 172.21.15.53:34176) 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 -- 172.21.15.53:0/1418101357 learned_addr learned my addr 172.21.15.53:0/1418101357 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd999c43640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9940cf4e0 0x7fd9940c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 -- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9940cf4e0 msgr2=0x7fd9940c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9940cf4e0 0x7fd9940c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99ac45640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd99415c870 0x7fd99414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 -- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd99415c870 msgr2=0x7fd99414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd99415c870 0x7fd99414c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 -- 172.21.15.53:0/1418101357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984009470 con 0x7fd9940cd760 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99a444640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd99415f610 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c7f0 tx=0x7fd99000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd98affd640 1 -- 172.21.15.53:0/1418101357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99000cea0 con 0x7fd9940cd760 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd98affd640 1 -- 172.21.15.53:0/1418101357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd990007a30 con 0x7fd9940cd760 2024-09-13T18:32:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd98affd640 1 -- 172.21.15.53:0/1418101357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990007de0 con 0x7fd9940cd760 2024-09-13T18:32:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9940c8100 con 0x7fd9940cd760 2024-09-13T18:32:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9940c86c0 con 0x7fd9940cd760 2024-09-13T18:32:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.013+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd994067400 con 0x7fd9940cd760 2024-09-13T18:32:59.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.017+0000 7fd98affd640 1 -- 172.21.15.53:0/1418101357 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fd9900113f0 con 0x7fd9940cd760 2024-09-13T18:32:59.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.017+0000 7fd98affd640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd978066cc0 0x7fd978069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.017+0000 7fd98affd640 1 -- 172.21.15.53:0/1418101357 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd990084e80 con 0x7fd9940cd760 2024-09-13T18:32:59.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.017+0000 7fd999c43640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd978066cc0 0x7fd978069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.017+0000 7fd999c43640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd978066cc0 0x7fd978069180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9840ae000 tx=0x7fd9840a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.021+0000 7fd98affd640 1 -- 172.21.15.53:0/1418101357 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd990051830 con 0x7fd9940cd760 2024-09-13T18:32:59.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.173+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9940cefa0 con 0x7fd9940cd760 2024-09-13T18:32:59.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.173+0000 7fd98affd640 1 -- 172.21.15.53:0/1418101357 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v136) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd99001e0a0 con 0x7fd9940cd760 2024-09-13T18:32:59.176 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:32:59.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd978066cc0 msgr2=0x7fd978069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd978066cc0 0x7fd978069180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9840ae000 tx=0x7fd9840a7000 comp rx=0 tx=0).stop 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 msgr2=0x7fd99415f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd99415f610 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c7f0 tx=0x7fd99000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 shutdown_connections 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd978066cc0 0x7fd978069180 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9940cf4e0 0x7fd9940c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd99415c870 0x7fd99414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 --2- 172.21.15.53:0/1418101357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9940cd760 0x7fd99415f610 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 >> 172.21.15.53:0/1418101357 conn(0x7fd994065c80 msgr2=0x7fd9940b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 shutdown_connections 2024-09-13T18:32:59.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.177+0000 7fd99c6a8640 1 -- 172.21.15.53:0/1418101357 wait complete. 2024-09-13T18:32:59.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:32:59.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.317+0000 7fa3e8dbf640 1 Processor -- start 2024-09-13T18:32:59.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.317+0000 7fa3e8dbf640 1 -- start start 2024-09-13T18:32:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.317+0000 7fa3e8dbf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3e40ad580 0x7fa3e406cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.317+0000 7fa3e8dbf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e406c580 con 0x7fa3e4146290 2024-09-13T18:32:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.317+0000 7fa3e8dbf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e406cb40 con 0x7fa3e406d510 2024-09-13T18:32:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.317+0000 7fa3e8dbf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40ad9c0 con 0x7fa3e40ad580 2024-09-13T18:32:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa3e4146290 0x7fa3e40adb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52256/0 (socket says 172.21.15.53:52256) 2024-09-13T18:32:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 -- 172.21.15.53:0/2348446668 learned_addr learned my addr 172.21.15.53:0/2348446668 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e1d9b640 1 --2- 172.21.15.53:0/2348446668 >> v2:172.21.15.87:3300/0 conn(0x7fa3e40ad580 0x7fa3e406cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701998100 0 0) 0x7fa3e406c580 con 0x7fa3e4146290 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d0003530 con 0x7fa3e4146290 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533841716 0 0) 0x7fa3d0003530 con 0x7fa3e4146290 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 >> v2:172.21.15.87:3300/0 conn(0x7fa3e40ad580 msgr2=0x7fa3e406cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 --2- 172.21.15.53:0/2348446668 >> v2:172.21.15.87:3300/0 conn(0x7fa3e40ad580 0x7fa3e406cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 >> v1:172.21.15.87:6789/0 conn(0x7fa3e406d510 legacy=0x7fa3e4065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4146670 con 0x7fa3e4146290 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa3dc001a00 con 0x7fa3e4146290 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 >> v1:172.21.15.53:6789/0 conn(0x7fa3e4146290 legacy=0x7fa3e40adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d0005190 0x7fa3d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40ad9c0 con 0x7fa3d00039d0 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c090 con 0x7fa3d00047d0 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c250 con 0x7fa3d0005190 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e1d9b640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e2d9d640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d0005190 0x7fa3d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 -- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d0005190 msgr2=0x7fa3d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d0005190 0x7fa3d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 -- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00047d0 msgr2=0x7fa3d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00047d0 0x7fa3d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e259c640 1 -- 172.21.15.53:0/2348446668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0003530 con 0x7fa3d00039d0 2024-09-13T18:32:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e2d9d640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3d0005190 0x7fa3d000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:32:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.321+0000 7fa3e2d9d640 1 -- 172.21.15.53:0/2348446668 reap_dead start 2024-09-13T18:32:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e259c640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00a750 tx=0x7fa3dc01d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330935bdf72a7a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0ad630 con 0x7fa3d00039d0 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0a8070 con 0x7fa3d00039d0 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e159a640 1 -- 172.21.15.53:0/2348446668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0ad9d0 con 0x7fa3d00039d0 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2348446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d00039d0 msgr2=0x7fa3d0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00a750 tx=0x7fa3dc01d280 comp rx=0 tx=0).stop 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2348446668 shutdown_connections 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2348446668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003df0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2348446668 >> 172.21.15.53:0/2348446668 conn(0x7fa3e4073130 msgr2=0x7fa3e4069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2348446668 shutdown_connections 2024-09-13T18:32:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2348446668 wait complete. 2024-09-13T18:32:59.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 Processor -- start 2024-09-13T18:32:59.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- start start 2024-09-13T18:32:59.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00039d0 0x7fa3e41f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3e40ce440 0x7fa3e415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3e40b32f0 0x7fa3e40b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40b3ce0 con 0x7fa3e40ce440 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4141da0 con 0x7fa3d00039d0 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e8dbf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4142080 con 0x7fa3e40b32f0 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3e40ce440 0x7fa3e415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3e40ce440 0x7fa3e415bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34194/0 (socket says 172.21.15.53:34194) 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 -- 172.21.15.53:0/2024550903 learned_addr learned my addr 172.21.15.53:0/2024550903 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e259c640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00039d0 0x7fa3e41f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e2d9d640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3e40b32f0 0x7fa3e40b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 -- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3e40b32f0 msgr2=0x7fa3e40b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3e40b32f0 0x7fa3e40b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 -- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00039d0 msgr2=0x7fa3e41f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00039d0 0x7fa3e41f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 -- 172.21.15.53:0/2024550903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4142360 con 0x7fa3e40ce440 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.325+0000 7fa3e1d9b640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3e40ce440 0x7fa3e415bbe0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc011500 tx=0x7fa3cc0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3daffd640 1 -- 172.21.15.53:0/2024550903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc015870 con 0x7fa3e40ce440 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3daffd640 1 -- 172.21.15.53:0/2024550903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc0159d0 con 0x7fa3e40ce440 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e4142640 con 0x7fa3e40ce440 2024-09-13T18:32:59.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3daffd640 1 -- 172.21.15.53:0/2024550903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc015d40 con 0x7fa3e40ce440 2024-09-13T18:32:59.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e415c120 con 0x7fa3e40ce440 2024-09-13T18:32:59.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e406aee0 con 0x7fa3e40ce440 2024-09-13T18:32:59.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3daffd640 1 -- 172.21.15.53:0/2024550903 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fa3cc01d400 con 0x7fa3e40ce440 2024-09-13T18:32:59.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3daffd640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3c4066cf0 0x7fa3c40691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3daffd640 1 -- 172.21.15.53:0/2024550903 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3cc084e70 con 0x7fa3e40ce440 2024-09-13T18:32:59.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3e259c640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3c4066cf0 0x7fa3c40691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.329+0000 7fa3e259c640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3c4066cf0 0x7fa3c40691b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0ad000 tx=0x7fa3dc0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.333+0000 7fa3daffd640 1 -- 172.21.15.53:0/2024550903 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3cc051960 con 0x7fa3e40ce440 2024-09-13T18:32:59.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.493+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3e40adb90 con 0x7fa3e40ce440 2024-09-13T18:32:59.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.493+0000 7fa3daffd640 1 -- 172.21.15.53:0/2024550903 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3cc054f80 con 0x7fa3e40ce440 2024-09-13T18:32:59.497 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:32:59.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3c4066cf0 msgr2=0x7fa3c40691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3c4066cf0 0x7fa3c40691b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0ad000 tx=0x7fa3dc0a7000 comp rx=0 tx=0).stop 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3e40ce440 msgr2=0x7fa3e415bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3e40ce440 0x7fa3e415bbe0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc011500 tx=0x7fa3cc0119c0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 shutdown_connections 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3c4066cf0 0x7fa3c40691b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3e40b32f0 0x7fa3e40b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3e40ce440 0x7fa3e415bbe0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 --2- 172.21.15.53:0/2024550903 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3d00039d0 0x7fa3e41f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 >> 172.21.15.53:0/2024550903 conn(0x7fa3e4073130 msgr2=0x7fa3e415f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 shutdown_connections 2024-09-13T18:32:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.497+0000 7fa3e8dbf640 1 -- 172.21.15.53:0/2024550903 wait complete. 2024-09-13T18:32:59.516 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:32:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479bc92640 1 Processor -- start 2024-09-13T18:32:59.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479bc92640 1 -- start start 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479bc92640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47941457c0 0x7f47940b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479bc92640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47940b1a40 0x7f4794070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479bc92640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4794146180 con 0x7f4794071220 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479bc92640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47940702d0 con 0x7f47941457c0 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479bc92640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479406c4c0 con 0x7f47940b1a40 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f4799a2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47941457c0 0x7f47940b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f4799a2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47941457c0 0x7f47940b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34210/0 (socket says 172.21.15.53:34210) 2024-09-13T18:32:59.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f4799a2e640 1 -- 172.21.15.53:0/776808300 learned_addr learned my addr 172.21.15.53:0/776808300 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f479922d640 1 --2- 172.21.15.53:0/776808300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47940b1a40 0x7f4794070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f4799a2e640 1 -- 172.21.15.53:0/776808300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47940b1a40 msgr2=0x7f4794070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f4799a2e640 1 --2- 172.21.15.53:0/776808300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47940b1a40 0x7f4794070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f4799a2e640 1 -- 172.21.15.53:0/776808300 >> v1:172.21.15.87:6789/0 conn(0x7f4794071220 legacy=0x7f479406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.641+0000 7f4799a2e640 1 -- 172.21.15.53:0/776808300 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479406bf00 con 0x7f47941457c0 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.645+0000 7f4799a2e640 1 --2- 172.21.15.53:0/776808300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47941457c0 0x7f47940b1500 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f478c009e50 tx=0x7f478c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc01b738796c94d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.645+0000 7f4798a2c640 1 -- 172.21.15.53:0/776808300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0a57e0 con 0x7f47941457c0 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f4798a2c640 1 -- 172.21.15.53:0/776808300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c0a5940 con 0x7f47941457c0 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f4798a2c640 1 -- 172.21.15.53:0/776808300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0a5cd0 con 0x7f47941457c0 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- 172.21.15.53:0/776808300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47941457c0 msgr2=0x7f47940b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 --2- 172.21.15.53:0/776808300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47941457c0 0x7f47940b1500 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f478c009e50 tx=0x7f478c01ca00 comp rx=0 tx=0).stop 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- 172.21.15.53:0/776808300 shutdown_connections 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 --2- 172.21.15.53:0/776808300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47940b1a40 0x7f4794070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 --2- 172.21.15.53:0/776808300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47941457c0 0x7f47940b1500 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- 172.21.15.53:0/776808300 >> 172.21.15.53:0/776808300 conn(0x7f4794065c80 msgr2=0x7f4794066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- 172.21.15.53:0/776808300 shutdown_connections 2024-09-13T18:32:59.651 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- 172.21.15.53:0/776808300 wait complete. 2024-09-13T18:32:59.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 Processor -- start 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- start start 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4794071220 0x7f479415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47940b1a40 0x7f47940af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47941457c0 0x7f47940af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4794132420 con 0x7f47940b1a40 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479415c490 con 0x7f4794071220 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479bc92640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4794138220 con 0x7f47941457c0 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47940b1a40 0x7f47940af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47940b1a40 0x7f47940af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34216/0 (socket says 172.21.15.53:34216) 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 -- 172.21.15.53:0/2157851984 learned_addr learned my addr 172.21.15.53:0/2157851984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479a22f640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47941457c0 0x7f47940af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f4799a2e640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4794071220 0x7f479415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 -- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47941457c0 msgr2=0x7f47940af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47941457c0 0x7f47940af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 -- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4794071220 msgr2=0x7f479415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4794071220 0x7f479415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 -- 172.21.15.53:0/2157851984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009b30 con 0x7f47940b1a40 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f4799a2e640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4794071220 0x7f479415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f479922d640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47940b1a40 0x7f47940af3f0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f478400d7d0 tx=0x7f478400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f478a7fc640 1 -- 172.21.15.53:0/2157851984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400b6c0 con 0x7f47940b1a40 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f478a7fc640 1 -- 172.21.15.53:0/2157851984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400b820 con 0x7f47940b1a40 2024-09-13T18:32:59.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.649+0000 7f478a7fc640 1 -- 172.21.15.53:0/2157851984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400bbd0 con 0x7f47940b1a40 2024-09-13T18:32:59.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4794138500 con 0x7f47940b1a40 2024-09-13T18:32:59.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4794138ac0 con 0x7f47940b1a40 2024-09-13T18:32:59.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47941325d0 con 0x7f47940b1a40 2024-09-13T18:32:59.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f478a7fc640 1 -- 172.21.15.53:0/2157851984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f478400bd30 con 0x7f47940b1a40 2024-09-13T18:32:59.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f478a7fc640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4778066cf0 0x7f47780691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f478a7fc640 1 -- 172.21.15.53:0/2157851984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4784085230 con 0x7f47940b1a40 2024-09-13T18:32:59.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f4799a2e640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4778066cf0 0x7f47780691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.653+0000 7f4799a2e640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4778066cf0 0x7f47780691b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f478c0ae000 tx=0x7f478c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.657+0000 7f478a7fc640 1 -- 172.21.15.53:0/2157851984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f47941325d0 con 0x7f47940b1a40 2024-09-13T18:32:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.813+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4794070ce0 con 0x7f47940b1a40 2024-09-13T18:32:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f478a7fc640 1 -- 172.21.15.53:0/2157851984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4784051c60 con 0x7f47940b1a40 2024-09-13T18:32:59.817 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4778066cf0 msgr2=0x7f47780691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4778066cf0 0x7f47780691b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f478c0ae000 tx=0x7f478c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47940b1a40 msgr2=0x7f47940af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47940b1a40 0x7f47940af3f0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f478400d7d0 tx=0x7f478400dc90 comp rx=0 tx=0).stop 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 shutdown_connections 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4778066cf0 0x7f47780691b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47941457c0 0x7f47940af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47940b1a40 0x7f47940af3f0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 --2- 172.21.15.53:0/2157851984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4794071220 0x7f479415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 >> 172.21.15.53:0/2157851984 conn(0x7f4794065c80 msgr2=0x7f479413f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 shutdown_connections 2024-09-13T18:32:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.817+0000 7f479bc92640 1 -- 172.21.15.53:0/2157851984 wait complete. 2024-09-13T18:32:59.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:32:59.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2fdd7640 1 Processor -- start 2024-09-13T18:32:59.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2fdd7640 1 -- start start 2024-09-13T18:32:59.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2fdd7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d281582a0 0x7f8d2806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2fdd7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d2815b7c0 0x7f8d2806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2fdd7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2806d480 con 0x7f8d28070c90 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2fdd7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2815aaf0 con 0x7f8d281582a0 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2fdd7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2806d760 con 0x7f8d2815b7c0 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2e374640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d28070c90 0x7f8d2806f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52268/0 (socket says 172.21.15.53:52268) 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2e374640 1 -- 172.21.15.53:0/856216650 learned_addr learned my addr 172.21.15.53:0/856216650 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2db73640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d281582a0 0x7f8d2806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2d372640 1 --2- 172.21.15.53:0/856216650 >> v2:172.21.15.87:3300/0 conn(0x7f8d2815b7c0 0x7f8d2806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2db73640 1 -- 172.21.15.53:0/856216650 >> v2:172.21.15.87:3300/0 conn(0x7f8d2815b7c0 msgr2=0x7f8d2806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2db73640 1 --2- 172.21.15.53:0/856216650 >> v2:172.21.15.87:3300/0 conn(0x7f8d2815b7c0 0x7f8d2806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2db73640 1 -- 172.21.15.53:0/856216650 >> v1:172.21.15.53:6789/0 conn(0x7f8d28070c90 legacy=0x7f8d2806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2db73640 1 -- 172.21.15.53:0/856216650 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2815ace0 con 0x7f8d281582a0 2024-09-13T18:32:59.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.957+0000 7f8d2cb71640 1 -- 172.21.15.53:0/856216650 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932644495 0 0) 0x7f8d2806d480 con 0x7f8d28070c90 2024-09-13T18:32:59.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2db73640 1 --2- 172.21.15.53:0/856216650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d281582a0 0x7f8d2806c900 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f8d280ce220 tx=0x7f8d2401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9064bc5549800da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2cb71640 1 -- 172.21.15.53:0/856216650 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24004230 con 0x7f8d281582a0 2024-09-13T18:32:59.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2cb71640 1 -- 172.21.15.53:0/856216650 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d240a7050 con 0x7f8d281582a0 2024-09-13T18:32:59.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2cb71640 1 -- 172.21.15.53:0/856216650 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24003620 con 0x7f8d281582a0 2024-09-13T18:32:59.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/856216650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d281582a0 msgr2=0x7f8d2806c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/856216650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d281582a0 0x7f8d2806c900 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f8d280ce220 tx=0x7f8d2401c450 comp rx=0 tx=0).stop 2024-09-13T18:32:59.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/856216650 shutdown_connections 2024-09-13T18:32:59.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/856216650 >> v2:172.21.15.87:3300/0 conn(0x7f8d2815b7c0 0x7f8d2806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/856216650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d281582a0 0x7f8d2806c900 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/856216650 >> 172.21.15.53:0/856216650 conn(0x7f8d28065c80 msgr2=0x7f8d28066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:59.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/856216650 shutdown_connections 2024-09-13T18:32:59.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/856216650 wait complete. 2024-09-13T18:32:59.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 Processor -- start 2024-09-13T18:32:59.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.961+0000 7f8d2fdd7640 1 -- start start 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d28070c90 0x7f8d28137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d281582a0 0x7f8d2814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d2815b7c0 0x7f8d280af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d28157820 con 0x7f8d28070c90 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2813aae0 con 0x7f8d2815b7c0 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d28139ed0 con 0x7f8d281582a0 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d28070c90 0x7f8d28137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d28070c90 0x7f8d28137560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34224/0 (socket says 172.21.15.53:34224) 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 -- 172.21.15.53:0/2535730134 learned_addr learned my addr 172.21.15.53:0/2535730134 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2d372640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d281582a0 0x7f8d2814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2e374640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d2815b7c0 0x7f8d280af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 -- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d281582a0 msgr2=0x7f8d2814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d281582a0 0x7f8d2814eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 -- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d2815b7c0 msgr2=0x7f8d280af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d2815b7c0 0x7f8d280af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 -- 172.21.15.53:0/2535730134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24009420 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2e374640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d2815b7c0 0x7f8d280af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2db73640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d28070c90 0x7f8d28137560 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f8d24019060 tx=0x7f8d240191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d1e7fc640 1 -- 172.21.15.53:0/2535730134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24003bf0 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d1e7fc640 1 -- 172.21.15.53:0/2535730134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24003d50 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2813a1b0 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d1e7fc640 1 -- 172.21.15.53:0/2535730134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d240ab640 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2813a770 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d28067400 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d1e7fc640 1 -- 172.21.15.53:0/2535730134 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f8d240b2040 con 0x7f8d28070c90 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d1e7fc640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8d0c066cc0 0x7f8d0c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d1e7fc640 1 -- 172.21.15.53:0/2535730134 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d2411ee80 con 0x7f8d28070c90 2024-09-13T18:32:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2d372640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8d0c066cc0 0x7f8d0c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.965+0000 7f8d2d372640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8d0c066cc0 0x7f8d0c069180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d281f8cc0 tx=0x7f8d18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:32:59.969+0000 7f8d1e7fc640 1 -- 172.21.15.53:0/2535730134 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d240eb710 con 0x7f8d28070c90 2024-09-13T18:33:00.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.145+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d2806f370 con 0x7f8d28070c90 2024-09-13T18:33:00.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.145+0000 7f8d1e7fc640 1 -- 172.21.15.53:0/2535730134 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v136) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8d240b0020 con 0x7f8d28070c90 2024-09-13T18:33:00.148 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:33:00.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8d0c066cc0 msgr2=0x7f8d0c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8d0c066cc0 0x7f8d0c069180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d281f8cc0 tx=0x7f8d18008040 comp rx=0 tx=0).stop 2024-09-13T18:33:00.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d28070c90 msgr2=0x7f8d28137560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d28070c90 0x7f8d28137560 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f8d24019060 tx=0x7f8d240191f0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 shutdown_connections 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8d0c066cc0 0x7f8d0c069180 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d281582a0 0x7f8d2814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d2815b7c0 0x7f8d280af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 --2- 172.21.15.53:0/2535730134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d28070c90 0x7f8d28137560 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 >> 172.21.15.53:0/2535730134 conn(0x7f8d28065c80 msgr2=0x7f8d280cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 shutdown_connections 2024-09-13T18:33:00.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.149+0000 7f8d2fdd7640 1 -- 172.21.15.53:0/2535730134 wait complete. 2024-09-13T18:33:00.167 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:33:00.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:00.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:00.177 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[53770]: fuse finished with error 0 and tester_r 0 2024-09-13T18:33:00.179 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:33:00.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:00.179 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:33:00.323 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:00.323 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:00.330 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba70fb640 1 Processor -- start 2024-09-13T18:33:00.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba70fb640 1 -- start start 2024-09-13T18:33:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba70fb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ba015c9b0 0x7f3ba0167360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba70fb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00b3420 con 0x7f3ba0065c80 2024-09-13T18:33:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba70fb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00adb60 con 0x7f3ba006cc40 2024-09-13T18:33:00.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba70fb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba00acff0 con 0x7f3ba015c9b0 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3ba0065c80 0x7f3ba0066060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52274/0 (socket says 172.21.15.53:52274) 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 -- 172.21.15.53:0/1437239559 learned_addr learned my addr 172.21.15.53:0/1437239559 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba5698640 1 --2- 172.21.15.53:0/1437239559 >> v2:172.21.15.87:3300/0 conn(0x7f3ba015c9b0 0x7f3ba0167360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987595468 0 0) 0x7f3ba00b3420 con 0x7f3ba0065c80 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b90003530 con 0x7f3ba0065c80 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4155104406 0 0) 0x7f3b90003530 con 0x7f3ba0065c80 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 >> v2:172.21.15.87:3300/0 conn(0x7f3ba015c9b0 msgr2=0x7f3ba0167360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 --2- 172.21.15.53:0/1437239559 >> v2:172.21.15.87:3300/0 conn(0x7f3ba015c9b0 0x7f3ba0167360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 >> v1:172.21.15.87:6789/0 conn(0x7f3ba006cc40 legacy=0x7f3ba00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00ad2c0 con 0x7f3ba0065c80 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3b94001680 con 0x7f3ba0065c80 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 >> v1:172.21.15.53:6789/0 conn(0x7f3ba0065c80 legacy=0x7f3ba0066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b90003980 0x7f3b90003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b900047d0 0x7f3b90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b90005190 0x7f3b9000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00acff0 con 0x7f3b90003980 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9000c030 con 0x7f3b90005190 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9000c1f0 con 0x7f3b900047d0 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b90003980 0x7f3b90003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba5698640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b90005190 0x7f3b9000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9ffff640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b900047d0 0x7f3b90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 -- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b900047d0 msgr2=0x7f3b90004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b900047d0 0x7f3b90004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 -- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b90005190 msgr2=0x7f3b9000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b90005190 0x7f3b9000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba4e97640 1 -- 172.21.15.53:0/1437239559 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90003530 con 0x7f3b90003980 2024-09-13T18:33:00.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3b9ffff640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b900047d0 0x7f3b90004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:00.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba5698640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b90005190 0x7f3b9000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:00.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.461+0000 7f3ba5698640 1 -- 172.21.15.53:0/1437239559 reap_dead start 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba4e97640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b90003980 0x7f3b90003da0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c1c0 tx=0x7f3b9401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0a6be79a3bfd0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94005ae0 con 0x7f3b90003980 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b94005c40 con 0x7f3b90003980 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3b9f7fe640 1 -- 172.21.15.53:0/1437239559 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940a5ab0 con 0x7f3b90003980 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- 172.21.15.53:0/1437239559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b90003980 msgr2=0x7f3b90003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b90003980 0x7f3b90003da0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c1c0 tx=0x7f3b9401cbd0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- 172.21.15.53:0/1437239559 shutdown_connections 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/1437239559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b90003980 0x7f3b90003da0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- 172.21.15.53:0/1437239559 >> 172.21.15.53:0/1437239559 conn(0x7f3ba0069f50 msgr2=0x7f3ba006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- 172.21.15.53:0/1437239559 shutdown_connections 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- 172.21.15.53:0/1437239559 wait complete. 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 Processor -- start 2024-09-13T18:33:00.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- start start 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b90003980 0x7f3ba01451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0153660 0x7f3ba0151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba01520b0 0x7f3ba015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01456f0 con 0x7f3ba0153660 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01525c0 con 0x7f3ba01520b0 2024-09-13T18:33:00.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3ba70fb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01528a0 con 0x7f3b90003980 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0153660 0x7f3ba0151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0153660 0x7f3ba0151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34236/0 (socket says 172.21.15.53:34236) 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.465+0000 7f3b9ffff640 1 -- 172.21.15.53:0/3684142707 learned_addr learned my addr 172.21.15.53:0/3684142707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba4e97640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b90003980 0x7f3ba01451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba5698640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba01520b0 0x7f3ba015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9ffff640 1 -- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b90003980 msgr2=0x7f3ba01451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9ffff640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b90003980 0x7f3ba01451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9ffff640 1 -- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba01520b0 msgr2=0x7f3ba015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9ffff640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba01520b0 0x7f3ba015b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9ffff640 1 -- 172.21.15.53:0/3684142707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0152b80 con 0x7f3ba0153660 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba5698640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba01520b0 0x7f3ba015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:00.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9ffff640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0153660 0x7f3ba0151b70 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00d4a0 tx=0x7f3b8c00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9d7fa640 1 -- 172.21.15.53:0/3684142707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c005480 con 0x7f3ba0153660 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9d7fa640 1 -- 172.21.15.53:0/3684142707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c007030 con 0x7f3ba0153660 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba0152e60 con 0x7f3ba0153660 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9d7fa640 1 -- 172.21.15.53:0/3684142707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0073e0 con 0x7f3ba0153660 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba01552a0 con 0x7f3ba0153660 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba006d340 con 0x7f3ba0153660 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9d7fa640 1 -- 172.21.15.53:0/3684142707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f3b8c007540 con 0x7f3ba0153660 2024-09-13T18:33:00.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9d7fa640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3b84066cc0 0x7f3b84069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3b9d7fa640 1 -- 172.21.15.53:0/3684142707 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b8c0845e0 con 0x7f3ba0153660 2024-09-13T18:33:00.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba4e97640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3b84066cc0 0x7f3b84069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.469+0000 7f3ba4e97640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3b84066cc0 0x7f3b84069180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b940ab000 tx=0x7f3b940a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.473+0000 7f3b9d7fa640 1 -- 172.21.15.53:0/3684142707 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b8c0510c0 con 0x7f3ba0153660 2024-09-13T18:33:00.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.629+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba0070e60 con 0x7f3ba0153660 2024-09-13T18:33:00.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.629+0000 7f3b9d7fa640 1 -- 172.21.15.53:0/3684142707 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f3b8c0546e0 con 0x7f3ba0153660 2024-09-13T18:33:00.633 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:00.633 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":136,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:34.772690+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3b84066cc0 msgr2=0x7f3b84069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3b84066cc0 0x7f3b84069180 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b940ab000 tx=0x7f3b940a7070 comp rx=0 tx=0).stop 2024-09-13T18:33:00.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0153660 msgr2=0x7f3ba0151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0153660 0x7f3ba0151b70 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00d4a0 tx=0x7f3b8c00d960 comp rx=0 tx=0).stop 2024-09-13T18:33:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 shutdown_connections 2024-09-13T18:33:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3b84066cc0 0x7f3b84069180 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ba01520b0 0x7f3ba015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ba0153660 0x7f3ba0151b70 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 --2- 172.21.15.53:0/3684142707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3b90003980 0x7f3ba01451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 >> 172.21.15.53:0/3684142707 conn(0x7f3ba0069f50 msgr2=0x7f3ba00b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 shutdown_connections 2024-09-13T18:33:00.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.633+0000 7f3ba70fb640 1 -- 172.21.15.53:0/3684142707 wait complete. 2024-09-13T18:33:00.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:32:31.405006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:32:32.764715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:00.651 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:00.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99dd70f640 1 Processor -- start 2024-09-13T18:33:00.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99dd70f640 1 -- start start 2024-09-13T18:33:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99dd70f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f99d806f330 0x7f99d806f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99dd70f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d80b3620 con 0x7f99d816e030 2024-09-13T18:33:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99dd70f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d80cb130 con 0x7f99d806fc50 2024-09-13T18:33:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99dd70f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d806c400 con 0x7f99d806f330 2024-09-13T18:33:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99d77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f99d816e030 0x7f99d80cb8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52276/0 (socket says 172.21.15.53:52276) 2024-09-13T18:33:00.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99d77fe640 1 -- 172.21.15.53:0/3932365753 learned_addr learned my addr 172.21.15.53:0/3932365753 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99d6ffd640 1 --2- 172.21.15.53:0/3932365753 >> v2:172.21.15.87:3300/0 conn(0x7f99d806f330 0x7f99d806f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737739323 0 0) 0x7f99d80b3620 con 0x7f99d816e030 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.773+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c4004640 con 0x7f99d816e030 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3187646699 0 0) 0x7f99c4004640 con 0x7f99d816e030 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 >> v2:172.21.15.87:3300/0 conn(0x7f99d806f330 msgr2=0x7f99d806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 --2- 172.21.15.53:0/3932365753 >> v2:172.21.15.87:3300/0 conn(0x7f99d806f330 0x7f99d806f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 >> v1:172.21.15.87:6789/0 conn(0x7f99d806fc50 legacy=0x7f99d816d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d806c6e0 con 0x7f99d816e030 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f99d0001680 con 0x7f99d816e030 2024-09-13T18:33:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 >> v1:172.21.15.53:6789/0 conn(0x7f99d816e030 legacy=0x7f99d80cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c4004a90 0x7f99c4004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40058e0 0x7f99c4005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c40063c0 0x7f99c400caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d806c400 con 0x7f99c40063c0 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c400d290 con 0x7f99c40058e0 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c400d450 con 0x7f99c4004a90 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c40063c0 0x7f99c400caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d67fc640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40058e0 0x7f99c4005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d6ffd640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c4004a90 0x7f99c4004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 -- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c4004a90 msgr2=0x7f99c4004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c4004a90 0x7f99c4004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 -- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40058e0 msgr2=0x7f99c4005d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99c40058e0 0x7f99c4005d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 -- 172.21.15.53:0/3932365753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4004640 con 0x7f99c40063c0 2024-09-13T18:33:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 -- 172.21.15.53:0/3932365753 reap_dead start 2024-09-13T18:33:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d77fe640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c40063c0 0x7f99c400caa0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c210 tx=0x7f99d001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a4dc52b26682e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00a5b10 con 0x7f99c40063c0 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d00a5c70 con 0x7f99c40063c0 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99d5ffb640 1 -- 172.21.15.53:0/3932365753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00058e0 con 0x7f99c40063c0 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99dd70f640 1 -- 172.21.15.53:0/3932365753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c40063c0 msgr2=0x7f99c400caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c40063c0 0x7f99c400caa0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c210 tx=0x7f99d001cc10 comp rx=0 tx=0).stop 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99dd70f640 1 -- 172.21.15.53:0/3932365753 shutdown_connections 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3932365753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c40063c0 0x7f99c400caa0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99dd70f640 1 -- 172.21.15.53:0/3932365753 >> 172.21.15.53:0/3932365753 conn(0x7f99d80b0200 msgr2=0x7f99d80b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99dd70f640 1 -- 172.21.15.53:0/3932365753 shutdown_connections 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.777+0000 7f99dd70f640 1 -- 172.21.15.53:0/3932365753 wait complete. 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 Processor -- start 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 -- start start 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40063c0 0x7f99d80c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99d8160820 0x7f99d816abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815fd30 0x7f99d816cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80c9720 con 0x7f99d815fd30 2024-09-13T18:33:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d816b0f0 con 0x7f99d8160820 2024-09-13T18:33:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80ae110 con 0x7f99c40063c0 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815fd30 0x7f99d816cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815fd30 0x7f99d816cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34258/0 (socket says 172.21.15.53:34258) 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 -- 172.21.15.53:0/3162429324 learned_addr learned my addr 172.21.15.53:0/3162429324 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d6ffd640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40063c0 0x7f99d80c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d67fc640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99d8160820 0x7f99d816abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 -- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40063c0 msgr2=0x7f99d80c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40063c0 0x7f99d80c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 -- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99d8160820 msgr2=0x7f99d816abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99d8160820 0x7f99d816abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 -- 172.21.15.53:0/3162429324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d816b320 con 0x7f99d815fd30 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99d77fe640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815fd30 0x7f99d816cba0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f99d001d4b0 tx=0x7f99c4006910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99cf7fe640 1 -- 172.21.15.53:0/3162429324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0000ee0 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99cf7fe640 1 -- 172.21.15.53:0/3162429324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d00a5910 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d80ae3b0 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99cf7fe640 1 -- 172.21.15.53:0/3162429324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0001660 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d816b600 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.781+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d806d7d0 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.785+0000 7f99cf7fe640 1 -- 172.21.15.53:0/3162429324 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f99d00b4020 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.785+0000 7f99cf7fe640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f99b8066cc0 0x7f99b8069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.785+0000 7f99cf7fe640 1 -- 172.21.15.53:0/3162429324 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99d011e3f0 con 0x7f99d815fd30 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.785+0000 7f99d6ffd640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f99b8066cc0 0x7f99b8069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.785+0000 7f99d6ffd640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f99b8066cc0 0x7f99b8069180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99c0007380 tx=0x7f99c000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.789+0000 7f99cf7fe640 1 -- 172.21.15.53:0/3162429324 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99d00eae20 con 0x7f99d815fd30 2024-09-13T18:33:00.949 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99d80cc810 con 0x7f99d815fd30 2024-09-13T18:33:00.950 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99cf7fe640 1 -- 172.21.15.53:0/3162429324 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v136) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99d00ee440 con 0x7f99d815fd30 2024-09-13T18:33:00.950 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f99b8066cc0 msgr2=0x7f99b8069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f99b8066cc0 0x7f99b8069180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99c0007380 tx=0x7f99c000b040 comp rx=0 tx=0).stop 2024-09-13T18:33:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815fd30 msgr2=0x7f99d816cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815fd30 0x7f99d816cba0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f99d001d4b0 tx=0x7f99c4006910 comp rx=0 tx=0).stop 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 shutdown_connections 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f99b8066cc0 0x7f99b8069180 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d815fd30 0x7f99d816cba0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99d8160820 0x7f99d816abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 --2- 172.21.15.53:0/3162429324 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f99c40063c0 0x7f99d80c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 >> 172.21.15.53:0/3162429324 conn(0x7f99d80b0200 msgr2=0x7f99d81661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 shutdown_connections 2024-09-13T18:33:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:00.949+0000 7f99dd70f640 1 -- 172.21.15.53:0/3162429324 wait complete. 2024-09-13T18:33:00.970 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:33:01.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.089+0000 7f06bdcd9640 1 Processor -- start 2024-09-13T18:33:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.089+0000 7f06bdcd9640 1 -- start start 2024-09-13T18:33:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06bdcd9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06b80caee0 0x7f06b80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06bdcd9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b806f7a0 con 0x7f06b8143e80 2024-09-13T18:33:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06bdcd9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b806fd60 con 0x7f06b80cd320 2024-09-13T18:33:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06bdcd9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b806baa0 con 0x7f06b80caee0 2024-09-13T18:33:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06b80caee0 0x7f06b80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f06b8143e80 0x7f06b806b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52280/0 (socket says 172.21.15.53:52280) 2024-09-13T18:33:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b77fe640 1 -- 172.21.15.53:0/3075466382 learned_addr learned my addr 172.21.15.53:0/3075466382 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b6ffd640 1 -- 172.21.15.53:0/3075466382 >> v1:172.21.15.87:6789/0 conn(0x7f06b80cd320 legacy=0x7f06b80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b6ffd640 1 -- 172.21.15.53:0/3075466382 >> v1:172.21.15.53:6789/0 conn(0x7f06b8143e80 legacy=0x7f06b806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b6ffd640 1 -- 172.21.15.53:0/3075466382 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80cb960 con 0x7f06b80caee0 2024-09-13T18:33:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b67fc640 1 -- 172.21.15.53:0/3075466382 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029202892 0 0) 0x7f06b806f7a0 con 0x7f06b8143e80 2024-09-13T18:33:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b6ffd640 1 --2- 172.21.15.53:0/3075466382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80caee0 0x7f06b80cb350 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097f0 tx=0x7f06ac01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b68dc3695213f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b67fc640 1 -- 172.21.15.53:0/3075466382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0ac600 con 0x7f06b80caee0 2024-09-13T18:33:01.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b67fc640 1 -- 172.21.15.53:0/3075466382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac0a8050 con 0x7f06b80caee0 2024-09-13T18:33:01.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.093+0000 7f06b67fc640 1 -- 172.21.15.53:0/3075466382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0ac980 con 0x7f06b80caee0 2024-09-13T18:33:01.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- 172.21.15.53:0/3075466382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80caee0 msgr2=0x7f06b80cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/3075466382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80caee0 0x7f06b80cb350 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097f0 tx=0x7f06ac01c3a0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- 172.21.15.53:0/3075466382 shutdown_connections 2024-09-13T18:33:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/3075466382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80caee0 0x7f06b80cb350 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- 172.21.15.53:0/3075466382 >> 172.21.15.53:0/3075466382 conn(0x7f06b8065c80 msgr2=0x7f06b8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- 172.21.15.53:0/3075466382 shutdown_connections 2024-09-13T18:33:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- 172.21.15.53:0/3075466382 wait complete. 2024-09-13T18:33:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 Processor -- start 2024-09-13T18:33:01.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- start start 2024-09-13T18:33:01.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b80caee0 0x7f06b80ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80cd320 0x7f06b80ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06b8143e80 0x7f06b8140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80a84d0 con 0x7f06b80cd320 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80aeb50 con 0x7f06b80caee0 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80aee20 con 0x7f06b8143e80 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80cd320 0x7f06b80ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80cd320 0x7f06b80ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34268/0 (socket says 172.21.15.53:34268) 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 -- 172.21.15.53:0/2489888311 learned_addr learned my addr 172.21.15.53:0/2489888311 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b77fe640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b80caee0 0x7f06b80ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b7fff640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06b8143e80 0x7f06b8140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 -- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06b8143e80 msgr2=0x7f06b8140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06b8143e80 0x7f06b8140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 -- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b80caee0 msgr2=0x7f06b80ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b80caee0 0x7f06b80ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 -- 172.21.15.53:0/2489888311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac009420 con 0x7f06b80cd320 2024-09-13T18:33:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b77fe640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b80caee0 0x7f06b80ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06b6ffd640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80cd320 0x7f06b80ae610 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097f0 tx=0x7f06ac01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f069ffff640 1 -- 172.21.15.53:0/2489888311 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0b7620 con 0x7f06b80cd320 2024-09-13T18:33:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f069ffff640 1 -- 172.21.15.53:0/2489888311 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac0ace90 con 0x7f06b80cd320 2024-09-13T18:33:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b80af100 con 0x7f06b80cd320 2024-09-13T18:33:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f069ffff640 1 -- 172.21.15.53:0/2489888311 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0b79c0 con 0x7f06b80cd320 2024-09-13T18:33:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.097+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b80a8720 con 0x7f06b80cd320 2024-09-13T18:33:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.101+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b80cb350 con 0x7f06b80cd320 2024-09-13T18:33:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.101+0000 7f069ffff640 1 -- 172.21.15.53:0/2489888311 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f06ac0b3040 con 0x7f06b80cd320 2024-09-13T18:33:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.101+0000 7f069ffff640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06a4066cc0 0x7f06a4069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.101+0000 7f069ffff640 1 -- 172.21.15.53:0/2489888311 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06ac11f2e0 con 0x7f06b80cd320 2024-09-13T18:33:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.101+0000 7f06b77fe640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06a4066cc0 0x7f06a4069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.101+0000 7f06b77fe640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06a4066cc0 0x7f06a4069180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06a8000f70 tx=0x7f06a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.105+0000 7f069ffff640 1 -- 172.21.15.53:0/2489888311 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06ac0ebc90 con 0x7f06b80cd320 2024-09-13T18:33:01.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06b8154d60 con 0x7f06b80cd320 2024-09-13T18:33:01.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f069ffff640 1 -- 172.21.15.53:0/2489888311 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06ac0ef2b0 con 0x7f06b80cd320 2024-09-13T18:33:01.266 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:33:01.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06a4066cc0 msgr2=0x7f06a4069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06a4066cc0 0x7f06a4069180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06a8000f70 tx=0x7f06a8009040 comp rx=0 tx=0).stop 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80cd320 msgr2=0x7f06b80ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80cd320 0x7f06b80ae610 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0097f0 tx=0x7f06ac01abe0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 shutdown_connections 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06a4066cc0 0x7f06a4069180 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06b8143e80 0x7f06b8140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06b80cd320 0x7f06b80ae610 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 --2- 172.21.15.53:0/2489888311 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06b80caee0 0x7f06b80ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 >> 172.21.15.53:0/2489888311 conn(0x7f06b8065c80 msgr2=0x7f06b8156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 shutdown_connections 2024-09-13T18:33:01.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.265+0000 7f06bdcd9640 1 -- 172.21.15.53:0/2489888311 wait complete. 2024-09-13T18:33:01.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:33:01.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.413+0000 7f5125269640 1 Processor -- start 2024-09-13T18:33:01.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.413+0000 7f5125269640 1 -- start start 2024-09-13T18:33:01.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.413+0000 7f5125269640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 0x7f51200cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.413+0000 7f5125269640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f51200b1dd0 0x7f51200b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.413+0000 7f5125269640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512006bc20 con 0x7f512006ff40 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.413+0000 7f5125269640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512006c530 con 0x7f51200b1dd0 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.413+0000 7f5125269640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5120158f80 con 0x7f5120158ba0 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f512006ff40 0x7f5120070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52288/0 (socket says 172.21.15.53:52288) 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 -- 172.21.15.53:0/2721811886 learned_addr learned my addr 172.21.15.53:0/2721811886 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511e7fc640 1 --2- 172.21.15.53:0/2721811886 >> v2:172.21.15.87:3300/0 conn(0x7f51200b1dd0 0x7f51200b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511effd640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 0x7f51200cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833712121 0 0) 0x7f512006bc20 con 0x7f512006ff40 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5108003530 con 0x7f512006ff40 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222867120 0 0) 0x7f5108003530 con 0x7f512006ff40 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 msgr2=0x7f51200cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 0x7f51200cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 >> v2:172.21.15.87:3300/0 conn(0x7f51200b1dd0 msgr2=0x7f51200b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 --2- 172.21.15.53:0/2721811886 >> v2:172.21.15.87:3300/0 conn(0x7f51200b1dd0 0x7f51200b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51200b2340 con 0x7f512006ff40 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5118001a00 con 0x7f512006ff40 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 >> v1:172.21.15.53:6789/0 conn(0x7f512006ff40 legacy=0x7f5120070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5108003980 0x7f5108003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 0x7f51080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5108004d10 0x7f5108005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512006c530 con 0x7f5108004d10 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5120158f80 con 0x7f5108003980 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510800ba10 con 0x7f5120158ba0 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5108004d10 0x7f5108005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511effd640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5108003980 0x7f5108003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511e7fc640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 0x7f51080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 -- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 msgr2=0x7f51080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120158ba0 0x7f51080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 -- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5108003980 msgr2=0x7f5108003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5108003980 0x7f5108003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.417+0000 7f511f7fe640 1 -- 172.21.15.53:0/2721811886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108003530 con 0x7f5108004d10 2024-09-13T18:33:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511f7fe640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5108004d10 0x7f5108005190 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f511800a860 tx=0x7f511801d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e8d0fcd63e3b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51180ad630 con 0x7f5108004d10 2024-09-13T18:33:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51180a8070 con 0x7f5108004d10 2024-09-13T18:33:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511dffb640 1 -- 172.21.15.53:0/2721811886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51180ad9f0 con 0x7f5108004d10 2024-09-13T18:33:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- 172.21.15.53:0/2721811886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5108004d10 msgr2=0x7f5108005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 --2- 172.21.15.53:0/2721811886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5108004d10 0x7f5108005190 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f511800a860 tx=0x7f511801d350 comp rx=0 tx=0).stop 2024-09-13T18:33:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511f7fe640 1 -- 172.21.15.53:0/2721811886 reap_dead start 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- 172.21.15.53:0/2721811886 shutdown_connections 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- 172.21.15.53:0/2721811886 >> 172.21.15.53:0/2721811886 conn(0x7f5120065c80 msgr2=0x7f5120066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- 172.21.15.53:0/2721811886 shutdown_connections 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- 172.21.15.53:0/2721811886 wait complete. 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 Processor -- start 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- start start 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120146eb0 0x7f512015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51200ac8e0 0x7f51200acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51201f87c0 0x7f51201f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51200ad2a0 con 0x7f51200ac8e0 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51201f9740 con 0x7f51201f87c0 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f5125269640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51201f91b0 con 0x7f5120146eb0 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51200ac8e0 0x7f51200acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51200ac8e0 0x7f51200acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34274/0 (socket says 172.21.15.53:34274) 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511e7fc640 1 -- 172.21.15.53:0/1163225571 learned_addr learned my addr 172.21.15.53:0/1163225571 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.421+0000 7f511effd640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120146eb0 0x7f512015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511f7fe640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51201f87c0 0x7f51201f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511e7fc640 1 -- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120146eb0 msgr2=0x7f512015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511e7fc640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120146eb0 0x7f512015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511e7fc640 1 -- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51201f87c0 msgr2=0x7f51201f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511e7fc640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51201f87c0 0x7f51201f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511e7fc640 1 -- 172.21.15.53:0/1163225571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51201f9460 con 0x7f51200ac8e0 2024-09-13T18:33:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511e7fc640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51200ac8e0 0x7f51200acd60 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f5114011660 tx=0x7f5114011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f51077fe640 1 -- 172.21.15.53:0/1163225571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114015870 con 0x7f51200ac8e0 2024-09-13T18:33:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f51077fe640 1 -- 172.21.15.53:0/1163225571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140159d0 con 0x7f51200ac8e0 2024-09-13T18:33:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5120159d50 con 0x7f51200ac8e0 2024-09-13T18:33:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f51077fe640 1 -- 172.21.15.53:0/1163225571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114015d40 con 0x7f51200ac8e0 2024-09-13T18:33:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512015a310 con 0x7f51200ac8e0 2024-09-13T18:33:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512006ba50 con 0x7f51200ac8e0 2024-09-13T18:33:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f51077fe640 1 -- 172.21.15.53:0/1163225571 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f511400f480 con 0x7f51200ac8e0 2024-09-13T18:33:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f51077fe640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f510c066cf0 0x7f510c0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f51077fe640 1 -- 172.21.15.53:0/1163225571 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51140854c0 con 0x7f51200ac8e0 2024-09-13T18:33:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511effd640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f510c066cf0 0x7f510c0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.425+0000 7f511effd640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f510c066cf0 0x7f510c0691b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51200ad540 tx=0x7f511000a2a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.429+0000 7f51077fe640 1 -- 172.21.15.53:0/1163225571 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5114051f80 con 0x7f51200ac8e0 2024-09-13T18:33:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.581+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51200ade50 con 0x7f51200ac8e0 2024-09-13T18:33:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.581+0000 7f51077fe640 1 -- 172.21.15.53:0/1163225571 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51140555a0 con 0x7f51200ac8e0 2024-09-13T18:33:01.584 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:33:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f510c066cf0 msgr2=0x7f510c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f510c066cf0 0x7f510c0691b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51200ad540 tx=0x7f511000a2a0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51200ac8e0 msgr2=0x7f51200acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51200ac8e0 0x7f51200acd60 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f5114011660 tx=0x7f5114011a60 comp rx=0 tx=0).stop 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 shutdown_connections 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f510c066cf0 0x7f510c0691b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51201f87c0 0x7f51201f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51200ac8e0 0x7f51200acd60 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 --2- 172.21.15.53:0/1163225571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5120146eb0 0x7f512015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 >> 172.21.15.53:0/1163225571 conn(0x7f5120065c80 msgr2=0x7f51200ae500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 shutdown_connections 2024-09-13T18:33:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.585+0000 7f5125269640 1 -- 172.21.15.53:0/1163225571 wait complete. 2024-09-13T18:33:01.602 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:33:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a60a01640 1 Processor -- start 2024-09-13T18:33:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a60a01640 1 -- start start 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a60a01640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a5c0cd630 0x7f4a5c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a60a01640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a5c0b1af0 0x7f4a5c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a60a01640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c0cfe80 con 0x7f4a5c06a490 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a60a01640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c0d0120 con 0x7f4a5c0cd630 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a60a01640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c06ac20 con 0x7f4a5c0b1af0 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a5a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a5c0cd630 0x7f4a5c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a5a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a5c0cd630 0x7f4a5c0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34286/0 (socket says 172.21.15.53:34286) 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a5a59c640 1 -- 172.21.15.53:0/1452035381 learned_addr learned my addr 172.21.15.53:0/1452035381 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a5a59c640 1 -- 172.21.15.53:0/1452035381 >> v2:172.21.15.87:3300/0 conn(0x7f4a5c0b1af0 msgr2=0x7f4a5c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a5a59c640 1 --2- 172.21.15.53:0/1452035381 >> v2:172.21.15.87:3300/0 conn(0x7f4a5c0b1af0 0x7f4a5c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a5a59c640 1 -- 172.21.15.53:0/1452035381 >> v1:172.21.15.53:6789/0 conn(0x7f4a5c06a490 legacy=0x7f4a5c0ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.713+0000 7f4a5a59c640 1 -- 172.21.15.53:0/1452035381 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c06af00 con 0x7f4a5c0cd630 2024-09-13T18:33:01.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a5a59c640 1 --2- 172.21.15.53:0/1452035381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c0b0cf0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c06d2e0 tx=0x7f4a5401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38795a3a6c40c1a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a5959a640 1 -- 172.21.15.53:0/1452035381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540ac640 con 0x7f4a5c0cd630 2024-09-13T18:33:01.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a5959a640 1 -- 172.21.15.53:0/1452035381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a540ac7a0 con 0x7f4a5c0cd630 2024-09-13T18:33:01.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a5959a640 1 -- 172.21.15.53:0/1452035381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540acb30 con 0x7f4a5c0cd630 2024-09-13T18:33:01.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 -- 172.21.15.53:0/1452035381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 msgr2=0x7f4a5c0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 --2- 172.21.15.53:0/1452035381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c0b0cf0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c06d2e0 tx=0x7f4a5401c400 comp rx=0 tx=0).stop 2024-09-13T18:33:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 -- 172.21.15.53:0/1452035381 shutdown_connections 2024-09-13T18:33:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 --2- 172.21.15.53:0/1452035381 >> v2:172.21.15.87:3300/0 conn(0x7f4a5c0b1af0 0x7f4a5c069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 --2- 172.21.15.53:0/1452035381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c0b0cf0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 -- 172.21.15.53:0/1452035381 >> 172.21.15.53:0/1452035381 conn(0x7f4a5c0b20d0 msgr2=0x7f4a5c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 -- 172.21.15.53:0/1452035381 shutdown_connections 2024-09-13T18:33:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 -- 172.21.15.53:0/1452035381 wait complete. 2024-09-13T18:33:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 Processor -- start 2024-09-13T18:33:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.717+0000 7f4a60a01640 1 -- start start 2024-09-13T18:33:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a5c06a490 0x7f4a5c158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a5c0b1af0 0x7f4a5c15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c15ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c158dd0 con 0x7f4a5c0cd630 2024-09-13T18:33:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1577f0 con 0x7f4a5c06a490 2024-09-13T18:33:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c157ad0 con 0x7f4a5c0b1af0 2024-09-13T18:33:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c15ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c15ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34294/0 (socket says 172.21.15.53:34294) 2024-09-13T18:33:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 -- 172.21.15.53:0/784821298 learned_addr learned my addr 172.21.15.53:0/784821298 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a59d9b640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a5c0b1af0 0x7f4a5c15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5a59c640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a5c06a490 0x7f4a5c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 -- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a5c0b1af0 msgr2=0x7f4a5c15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a5c0b1af0 0x7f4a5c15f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 -- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a5c06a490 msgr2=0x7f4a5c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a5c06a490 0x7f4a5c158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 -- 172.21.15.53:0/784821298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540094d0 con 0x7f4a5c0cd630 2024-09-13T18:33:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a59d9b640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a5c0b1af0 0x7f4a5c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5ad9d640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c15ce30 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c340 tx=0x7f4a4c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a52ffd640 1 -- 172.21.15.53:0/784821298 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c005220 con 0x7f4a5c0cd630 2024-09-13T18:33:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a52ffd640 1 -- 172.21.15.53:0/784821298 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c005380 con 0x7f4a5c0cd630 2024-09-13T18:33:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c157db0 con 0x7f4a5c0cd630 2024-09-13T18:33:01.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a52ffd640 1 -- 172.21.15.53:0/784821298 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c007270 con 0x7f4a5c0cd630 2024-09-13T18:33:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c158370 con 0x7f4a5c0cd630 2024-09-13T18:33:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c158560 con 0x7f4a5c0cd630 2024-09-13T18:33:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a52ffd640 1 -- 172.21.15.53:0/784821298 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f4a4c0073d0 con 0x7f4a5c0cd630 2024-09-13T18:33:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a52ffd640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a3c066cc0 0x7f4a3c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a52ffd640 1 -- 172.21.15.53:0/784821298 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a4c084170 con 0x7f4a5c0cd630 2024-09-13T18:33:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5a59c640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a3c066cc0 0x7f4a3c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:01.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.721+0000 7f4a5a59c640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a3c066cc0 0x7f4a3c069180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4a540ae000 tx=0x7f4a54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:01.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.725+0000 7f4a52ffd640 1 -- 172.21.15.53:0/784821298 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a4c050c30 con 0x7f4a5c0cd630 2024-09-13T18:33:01.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.897+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a5c069f50 con 0x7f4a5c0cd630 2024-09-13T18:33:01.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.897+0000 7f4a52ffd640 1 -- 172.21.15.53:0/784821298 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v136) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4a4c054250 con 0x7f4a5c0cd630 2024-09-13T18:33:01.900 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:33:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a3c066cc0 msgr2=0x7f4a3c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a3c066cc0 0x7f4a3c069180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4a540ae000 tx=0x7f4a54008040 comp rx=0 tx=0).stop 2024-09-13T18:33:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 msgr2=0x7f4a5c15ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c15ce30 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c340 tx=0x7f4a4c00c800 comp rx=0 tx=0).stop 2024-09-13T18:33:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 shutdown_connections 2024-09-13T18:33:01.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a3c066cc0 0x7f4a3c069180 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a5c0b1af0 0x7f4a5c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5c0cd630 0x7f4a5c15ce30 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 --2- 172.21.15.53:0/784821298 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a5c06a490 0x7f4a5c158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:01.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 >> 172.21.15.53:0/784821298 conn(0x7f4a5c0b20d0 msgr2=0x7f4a5c06edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:01.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 shutdown_connections 2024-09-13T18:33:01.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:01.901+0000 7f4a60a01640 1 -- 172.21.15.53:0/784821298 wait complete. 2024-09-13T18:33:01.919 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:33:01.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:01.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:01.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36385]: fuse finished with error 0 and tester_r 0 2024-09-13T18:33:01.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:33:01.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:01.934 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:33:02.022 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:33:02.022 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:02.028 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:02.028 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:33:02.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:02.028 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:33:02.074 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:33:02.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:02.075 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:02.075 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:02.081 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:02.081 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:33:02.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:02.082 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:33:02.134 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:33:02.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:02.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:02.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.269+0000 7f35354a9640 1 Processor -- start 2024-09-13T18:33:02.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.269+0000 7f35354a9640 1 -- start start 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f35300af5e0 0x7f3530165320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300b0b90 con 0x7f353015db40 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300ad530 con 0x7f35300b1960 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300ae1b0 con 0x7f35300af5e0 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f35300af5e0 0x7f3530165320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f353015db40 0x7f35300afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52308/0 (socket says 172.21.15.53:52308) 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352effd640 1 -- 172.21.15.53:0/450776329 learned_addr learned my addr 172.21.15.53:0/450776329 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352f7fe640 1 -- 172.21.15.53:0/450776329 >> v1:172.21.15.87:6789/0 conn(0x7f35300b1960 legacy=0x7f35300b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352f7fe640 1 -- 172.21.15.53:0/450776329 >> v1:172.21.15.53:6789/0 conn(0x7f353015db40 legacy=0x7f35300afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352f7fe640 1 -- 172.21.15.53:0/450776329 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300ad810 con 0x7f35300af5e0 2024-09-13T18:33:02.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352dffb640 1 -- 172.21.15.53:0/450776329 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018763328 0 0) 0x7f35300b0b90 con 0x7f353015db40 2024-09-13T18:33:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352f7fe640 1 --2- 172.21.15.53:0/450776329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300af5e0 0x7f3530165320 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f3528009d90 tx=0x7f352801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62b8160cbca7f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352dffb640 1 -- 172.21.15.53:0/450776329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280a5930 con 0x7f35300af5e0 2024-09-13T18:33:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352dffb640 1 -- 172.21.15.53:0/450776329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280a5a90 con 0x7f35300af5e0 2024-09-13T18:33:02.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f352dffb640 1 -- 172.21.15.53:0/450776329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280a5e20 con 0x7f35300af5e0 2024-09-13T18:33:02.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- 172.21.15.53:0/450776329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300af5e0 msgr2=0x7f3530165320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 --2- 172.21.15.53:0/450776329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300af5e0 0x7f3530165320 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f3528009d90 tx=0x7f352801c870 comp rx=0 tx=0).stop 2024-09-13T18:33:02.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- 172.21.15.53:0/450776329 shutdown_connections 2024-09-13T18:33:02.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 --2- 172.21.15.53:0/450776329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300af5e0 0x7f3530165320 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- 172.21.15.53:0/450776329 >> 172.21.15.53:0/450776329 conn(0x7f35300b20d0 msgr2=0x7f35300b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- 172.21.15.53:0/450776329 shutdown_connections 2024-09-13T18:33:02.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.273+0000 7f35354a9640 1 -- 172.21.15.53:0/450776329 wait complete. 2024-09-13T18:33:02.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 Processor -- start 2024-09-13T18:33:02.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 -- start start 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35300af5e0 0x7f3530156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300b1960 0x7f35300c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353015db40 0x7f3530159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300b63b0 con 0x7f35300b1960 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300b60d0 con 0x7f353015db40 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3530159000 con 0x7f35300af5e0 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300b1960 0x7f35300c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300b1960 0x7f35300c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34306/0 (socket says 172.21.15.53:34306) 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 -- 172.21.15.53:0/3770736646 learned_addr learned my addr 172.21.15.53:0/3770736646 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352f7fe640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353015db40 0x7f3530159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352effd640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35300af5e0 0x7f3530156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 -- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35300af5e0 msgr2=0x7f3530156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35300af5e0 0x7f3530156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 -- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353015db40 msgr2=0x7f3530159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353015db40 0x7f3530159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 -- 172.21.15.53:0/3770736646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009a70 con 0x7f35300b1960 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f352e7fc640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300b1960 0x7f35300c66c0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f352400c450 tx=0x7f352400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35177fe640 1 -- 172.21.15.53:0/3770736646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524012830 con 0x7f35300b1960 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35177fe640 1 -- 172.21.15.53:0/3770736646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240129b0 con 0x7f35300b1960 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35301592e0 con 0x7f35300b1960 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35177fe640 1 -- 172.21.15.53:0/3770736646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524012d60 con 0x7f35300b1960 2024-09-13T18:33:02.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.277+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35300c6c00 con 0x7f35300b1960 2024-09-13T18:33:02.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.281+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3530159800 con 0x7f35300b1960 2024-09-13T18:33:02.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.281+0000 7f35177fe640 1 -- 172.21.15.53:0/3770736646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f352401c460 con 0x7f35300b1960 2024-09-13T18:33:02.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.281+0000 7f35177fe640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f351c066cc0 0x7f351c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.281+0000 7f35177fe640 1 -- 172.21.15.53:0/3770736646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3524084b40 con 0x7f35300b1960 2024-09-13T18:33:02.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.281+0000 7f352effd640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f351c066cc0 0x7f351c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.281+0000 7f352effd640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f351c066cc0 0x7f351c069180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3520000f70 tx=0x7f3520007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.285+0000 7f35177fe640 1 -- 172.21.15.53:0/3770736646 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3530159800 con 0x7f35300b1960 2024-09-13T18:33:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.481+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3530159800 con 0x7f35300b1960 2024-09-13T18:33:02.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.481+0000 7f35177fe640 1 -- 172.21.15.53:0/3770736646 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f3530159800 con 0x7f35300b1960 2024-09-13T18:33:02.485 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:02.485 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2946475465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2946475465},{"type":"v1","addr":"172.21.15.87:6833","nonce":2946475465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3953952610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3953952610},{"type":"v1","addr":"172.21.15.87:6835","nonce":3953952610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1516456617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1516456617},{"type":"v1","addr":"172.21.15.53:6833","nonce":1516456617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:32:33.769589+0000","modified":"2024-09-13T18:32:36.397069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/275376653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":275376653},{"type":"v1","addr":"172.21.15.53:6835","nonce":275376653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:33:02.485 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 80 2024-09-13T18:33:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f351c066cc0 msgr2=0x7f351c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f351c066cc0 0x7f351c069180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3520000f70 tx=0x7f3520007c10 comp rx=0 tx=0).stop 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300b1960 msgr2=0x7f35300c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300b1960 0x7f35300c66c0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f352400c450 tx=0x7f352400c910 comp rx=0 tx=0).stop 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 shutdown_connections 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f351c066cc0 0x7f351c069180 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f353015db40 0x7f3530159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300b1960 0x7f35300c66c0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 --2- 172.21.15.53:0/3770736646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35300af5e0 0x7f3530156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 >> 172.21.15.53:0/3770736646 conn(0x7f35300b20d0 msgr2=0x7f353006d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 shutdown_connections 2024-09-13T18:33:02.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.485+0000 7f35354a9640 1 -- 172.21.15.53:0/3770736646 wait complete. 2024-09-13T18:33:02.505 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:02.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.621+0000 7f1ed720e640 1 Processor -- start 2024-09-13T18:33:02.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.621+0000 7f1ed720e640 1 -- start start 2024-09-13T18:33:02.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ed720e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ed006fa80 0x7f1ed006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ed720e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed00cbb60 0x7f1ed00b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ed720e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed00b2340 con 0x7f1ed0158ba0 2024-09-13T18:33:02.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ed720e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed00b2860 con 0x7f1ed006fa80 2024-09-13T18:33:02.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ed720e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0158f80 con 0x7f1ed00cbb60 2024-09-13T18:33:02.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ed006fa80 0x7f1ed006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ed006fa80 0x7f1ed006b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34314/0 (socket says 172.21.15.53:34314) 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 -- 172.21.15.53:0/2057175909 learned_addr learned my addr 172.21.15.53:0/2057175909 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ed57ab640 1 --2- 172.21.15.53:0/2057175909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed00cbb60 0x7f1ed00b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 -- 172.21.15.53:0/2057175909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed00cbb60 msgr2=0x7f1ed00b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 --2- 172.21.15.53:0/2057175909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed00cbb60 0x7f1ed00b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 -- 172.21.15.53:0/2057175909 >> v1:172.21.15.87:6789/0 conn(0x7f1ed0158ba0 legacy=0x7f1ed006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 -- 172.21.15.53:0/2057175909 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00b2580 con 0x7f1ed006fa80 2024-09-13T18:33:02.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ed57ab640 1 --2- 172.21.15.53:0/2057175909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed00cbb60 0x7f1ed00b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:02.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecffff640 1 --2- 172.21.15.53:0/2057175909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed006fa80 0x7f1ed006b390 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009870 tx=0x7f1ec401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f98e6f940668dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecf7fe640 1 -- 172.21.15.53:0/2057175909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40ab600 con 0x7f1ed006fa80 2024-09-13T18:33:02.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecf7fe640 1 -- 172.21.15.53:0/2057175909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec40a7050 con 0x7f1ed006fa80 2024-09-13T18:33:02.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.625+0000 7f1ecf7fe640 1 -- 172.21.15.53:0/2057175909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40ab980 con 0x7f1ed006fa80 2024-09-13T18:33:02.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- 172.21.15.53:0/2057175909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed006fa80 msgr2=0x7f1ed006b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 --2- 172.21.15.53:0/2057175909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed006fa80 0x7f1ed006b390 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009870 tx=0x7f1ec401c490 comp rx=0 tx=0).stop 2024-09-13T18:33:02.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- 172.21.15.53:0/2057175909 shutdown_connections 2024-09-13T18:33:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 --2- 172.21.15.53:0/2057175909 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed00cbb60 0x7f1ed00b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 --2- 172.21.15.53:0/2057175909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed006fa80 0x7f1ed006b390 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- 172.21.15.53:0/2057175909 >> 172.21.15.53:0/2057175909 conn(0x7f1ed0065c80 msgr2=0x7f1ed0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- 172.21.15.53:0/2057175909 shutdown_connections 2024-09-13T18:33:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- 172.21.15.53:0/2057175909 wait complete. 2024-09-13T18:33:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 Processor -- start 2024-09-13T18:33:02.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- start start 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed006fa80 0x7f1ed014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed00cbb60 0x7f1ed006b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0158ba0 0x7f1ed006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00ab370 con 0x7f1ed00cbb60 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed014ee20 con 0x7f1ed0158ba0 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00a94c0 con 0x7f1ed006fa80 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed00cbb60 0x7f1ed006b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed00cbb60 0x7f1ed006b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34318/0 (socket says 172.21.15.53:34318) 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 -- 172.21.15.53:0/4194746052 learned_addr learned my addr 172.21.15.53:0/4194746052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed57ab640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0158ba0 0x7f1ed006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed4faa640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed006fa80 0x7f1ed014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 -- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed006fa80 msgr2=0x7f1ed014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed006fa80 0x7f1ed014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 -- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0158ba0 msgr2=0x7f1ed006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0158ba0 0x7f1ed006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 -- 172.21.15.53:0/4194746052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec40094d0 con 0x7f1ed00cbb60 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecffff640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed00cbb60 0x7f1ed006b370 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1ec401cd30 tx=0x7f1ec4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecd7fa640 1 -- 172.21.15.53:0/4194746052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40b6640 con 0x7f1ed00cbb60 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecd7fa640 1 -- 172.21.15.53:0/4194746052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec40b67c0 con 0x7f1ed00cbb60 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ecd7fa640 1 -- 172.21.15.53:0/4194746052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40b6b70 con 0x7f1ed00cbb60 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed00a97a0 con 0x7f1ed00cbb60 2024-09-13T18:33:02.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.629+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed00a9d60 con 0x7f1ed00cbb60 2024-09-13T18:33:02.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.633+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed0067400 con 0x7f1ed00cbb60 2024-09-13T18:33:02.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.633+0000 7f1ecd7fa640 1 -- 172.21.15.53:0/4194746052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f1ec40b2040 con 0x7f1ed00cbb60 2024-09-13T18:33:02.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.633+0000 7f1ecd7fa640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ebc066cc0 0x7f1ebc069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.633+0000 7f1ecd7fa640 1 -- 172.21.15.53:0/4194746052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ec411e9b0 con 0x7f1ed00cbb60 2024-09-13T18:33:02.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.633+0000 7f1ed4faa640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ebc066cc0 0x7f1ebc069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.633+0000 7f1ed4faa640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ebc066cc0 0x7f1ebc069180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b810 tx=0x7f1ec0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.637+0000 7f1ecd7fa640 1 -- 172.21.15.53:0/4194746052 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ec40eb470 con 0x7f1ed00cbb60 2024-09-13T18:33:02.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.793+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ed00b2340 con 0x7f1ed00cbb60 2024-09-13T18:33:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.797+0000 7f1ecd7fa640 1 -- 172.21.15.53:0/4194746052 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f1ed00b2340 con 0x7f1ed00cbb60 2024-09-13T18:33:02.800 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:02.800 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":136,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:32:34.772690+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ebc066cc0 msgr2=0x7f1ebc069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ebc066cc0 0x7f1ebc069180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b810 tx=0x7f1ec0008040 comp rx=0 tx=0).stop 2024-09-13T18:33:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed00cbb60 msgr2=0x7f1ed006b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed00cbb60 0x7f1ed006b370 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f1ec401cd30 tx=0x7f1ec4019230 comp rx=0 tx=0).stop 2024-09-13T18:33:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 shutdown_connections 2024-09-13T18:33:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ebc066cc0 0x7f1ebc069180 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ed0158ba0 0x7f1ed006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ed00cbb60 0x7f1ed006b370 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 --2- 172.21.15.53:0/4194746052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ed006fa80 0x7f1ed014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 >> 172.21.15.53:0/4194746052 conn(0x7f1ed0065c80 msgr2=0x7f1ed00cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 shutdown_connections 2024-09-13T18:33:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.801+0000 7f1ed720e640 1 -- 172.21.15.53:0/4194746052 wait complete. 2024-09-13T18:33:02.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:32:31.405006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:32:32.764715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:02.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cbb41e640 1 Processor -- start 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cbb41e640 1 -- start start 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cbb41e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb4143e80 0x7f0cb406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cbb41e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cb40caee0 0x7f0cb40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cbb41e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb406f7a0 con 0x7f0cb40cd320 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cbb41e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb406fd60 con 0x7f0cb40caee0 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cbb41e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40cb960 con 0x7f0cb4143e80 2024-09-13T18:33:02.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb89b9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cb40caee0 0x7f0cb40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb89b9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cb40caee0 0x7f0cb40cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34332/0 (socket says 172.21.15.53:34332) 2024-09-13T18:33:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb89b9640 1 -- 172.21.15.53:0/4188550068 learned_addr learned my addr 172.21.15.53:0/4188550068 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb91ba640 1 --2- 172.21.15.53:0/4188550068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb4143e80 0x7f0cb406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb89b9640 1 -- 172.21.15.53:0/4188550068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb4143e80 msgr2=0x7f0cb406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb89b9640 1 --2- 172.21.15.53:0/4188550068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb4143e80 0x7f0cb406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb89b9640 1 -- 172.21.15.53:0/4188550068 >> v1:172.21.15.87:6789/0 conn(0x7f0cb40cd320 legacy=0x7f0cb40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:02.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.933+0000 7f0cb89b9640 1 -- 172.21.15.53:0/4188550068 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40cbc40 con 0x7f0cb40caee0 2024-09-13T18:33:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cb89b9640 1 --2- 172.21.15.53:0/4188550068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb40cb320 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009870 tx=0x7f0ca401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5d099e02d361b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cabfff640 1 -- 172.21.15.53:0/4188550068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40ab600 con 0x7f0cb40caee0 2024-09-13T18:33:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cabfff640 1 -- 172.21.15.53:0/4188550068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca40ab760 con 0x7f0cb40caee0 2024-09-13T18:33:02.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cabfff640 1 -- 172.21.15.53:0/4188550068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40abaf0 con 0x7f0cb40caee0 2024-09-13T18:33:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 -- 172.21.15.53:0/4188550068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 msgr2=0x7f0cb40cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/4188550068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb40cb320 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009870 tx=0x7f0ca401c460 comp rx=0 tx=0).stop 2024-09-13T18:33:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 -- 172.21.15.53:0/4188550068 shutdown_connections 2024-09-13T18:33:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/4188550068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb40cb320 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/4188550068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb4143e80 0x7f0cb406b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 -- 172.21.15.53:0/4188550068 >> 172.21.15.53:0/4188550068 conn(0x7f0cb4065c80 msgr2=0x7f0cb4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 -- 172.21.15.53:0/4188550068 shutdown_connections 2024-09-13T18:33:02.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 -- 172.21.15.53:0/4188550068 wait complete. 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 Processor -- start 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.937+0000 7f0cbb41e640 1 -- start start 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb40cd320 0x7f0cb413b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cb4143e80 0x7f0cb41f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb413bb60 con 0x7f0cb40caee0 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b17a0 con 0x7f0cb4143e80 2024-09-13T18:33:02.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b1a80 con 0x7f0cb40cd320 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb415c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34338/0 (socket says 172.21.15.53:34338) 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 -- 172.21.15.53:0/3501416098 learned_addr learned my addr 172.21.15.53:0/3501416098 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 -- 172.21.15.53:0/3501416098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb40cd320 msgr2=0x7f0cb413b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb40cd320 0x7f0cb413b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 -- 172.21.15.53:0/3501416098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cb4143e80 msgr2=0x7f0cb41f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cb4143e80 0x7f0cb41f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 -- 172.21.15.53:0/3501416098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40094d0 con 0x7f0cb40caee0 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb91ba640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb415c450 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000ccd0 tx=0x7f0cb000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0ca9ffb640 1 -- 172.21.15.53:0/3501416098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00039a0 con 0x7f0cb40caee0 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0ca9ffb640 1 -- 172.21.15.53:0/3501416098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0003b00 con 0x7f0cb40caee0 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb40b1d60 con 0x7f0cb40caee0 2024-09-13T18:33:02.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0ca9ffb640 1 -- 172.21.15.53:0/3501416098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0004020 con 0x7f0cb40caee0 2024-09-13T18:33:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb41f4a40 con 0x7f0cb40caee0 2024-09-13T18:33:02.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb40cb320 con 0x7f0cb40caee0 2024-09-13T18:33:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0ca9ffb640 1 -- 172.21.15.53:0/3501416098 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f0cb0004180 con 0x7f0cb40caee0 2024-09-13T18:33:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0ca9ffb640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c98066cc0 0x7f0c98069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb89b9640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c98066cc0 0x7f0c98069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0ca9ffb640 1 -- 172.21.15.53:0/3501416098 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cb00851c0 con 0x7f0cb40caee0 2024-09-13T18:33:02.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.941+0000 7f0cb89b9640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c98066cc0 0x7f0c98069180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40af000 tx=0x7f0ca4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:02.945+0000 7f0ca9ffb640 1 -- 172.21.15.53:0/3501416098 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cb0051ae0 con 0x7f0cb40caee0 2024-09-13T18:33:03.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cb40b2210 con 0x7f0cb40caee0 2024-09-13T18:33:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0ca9ffb640 1 -- 172.21.15.53:0/3501416098 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cb001d0a0 con 0x7f0cb40caee0 2024-09-13T18:33:03.110 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:03.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c98066cc0 msgr2=0x7f0c98069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c98066cc0 0x7f0c98069180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40af000 tx=0x7f0ca4008040 comp rx=0 tx=0).stop 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 msgr2=0x7f0cb415c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb415c450 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000ccd0 tx=0x7f0cb000a5c0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 shutdown_connections 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0c98066cc0 0x7f0c98069180 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cb40cd320 0x7f0cb413b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cb4143e80 0x7f0cb41f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 --2- 172.21.15.53:0/3501416098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cb40caee0 0x7f0cb415c450 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 >> 172.21.15.53:0/3501416098 conn(0x7f0cb4065c80 msgr2=0x7f0cb4156520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 shutdown_connections 2024-09-13T18:33:03.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.109+0000 7f0cbb41e640 1 -- 172.21.15.53:0/3501416098 wait complete. 2024-09-13T18:33:03.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:33:03.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfdad3a640 1 Processor -- start 2024-09-13T18:33:03.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfdad3a640 1 -- start start 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfdad3a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdfd4156c40 0x7fdfd4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfdad3a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 0x7fdfd406f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfdad3a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd40b15a0 con 0x7fdfd4157020 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfdad3a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd40b1880 con 0x7fdfd4156c40 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfdad3a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40b1b60 con 0x7fdfd406d440 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdfd4157020 0x7fdfd406cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52312/0 (socket says 172.21.15.53:52312) 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd3fff640 1 -- 172.21.15.53:0/2848937962 learned_addr learned my addr 172.21.15.53:0/2848937962 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd92d7640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 0x7fdfd406f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd8ad6640 1 --2- 172.21.15.53:0/2848937962 >> v2:172.21.15.87:3300/0 conn(0x7fdfd4156c40 0x7fdfd4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600643296 0 0) 0x7fdfd40b15a0 con 0x7fdfd4157020 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfbc003530 con 0x7fdfd4157020 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3771830979 0 0) 0x7fdfbc003530 con 0x7fdfd4157020 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 msgr2=0x7fdfd406f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 0x7fdfd406f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 >> v2:172.21.15.87:3300/0 conn(0x7fdfd4156c40 msgr2=0x7fdfd4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 --2- 172.21.15.53:0/2848937962 >> v2:172.21.15.87:3300/0 conn(0x7fdfd4156c40 0x7fdfd4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40b1e40 con 0x7fdfd4157020 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdfc8001680 con 0x7fdfd4157020 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 >> v1:172.21.15.53:6789/0 conn(0x7fdfd4157020 legacy=0x7fdfd406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 0x7fdfbc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc003f00 0x7fdfbc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfbc004d10 0x7fdfbc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40b1880 con 0x7fdfbc004d10 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40b1b60 con 0x7fdfbc003f00 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc00b990 con 0x7fdfd406d440 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd92d7640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfbc004d10 0x7fdfbc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd8ad6640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 0x7fdfbc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd3fff640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc003f00 0x7fdfbc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd92d7640 1 -- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 msgr2=0x7fdfbc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd92d7640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd406d440 0x7fdfbc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd92d7640 1 -- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc003f00 msgr2=0x7fdfbc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd92d7640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc003f00 0x7fdfbc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.253+0000 7fdfd92d7640 1 -- 172.21.15.53:0/2848937962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc003530 con 0x7fdfbc004d10 2024-09-13T18:33:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfd92d7640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfbc004d10 0x7fdfbc005190 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009bd0 tx=0x7fdfcc01ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bff049d5731678 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0a7e80 con 0x7fdfbc004d10 2024-09-13T18:33:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00f040 con 0x7fdfbc004d10 2024-09-13T18:33:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfd37fe640 1 -- 172.21.15.53:0/2848937962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0af640 con 0x7fdfbc004d10 2024-09-13T18:33:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 -- 172.21.15.53:0/2848937962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfbc004d10 msgr2=0x7fdfbc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 --2- 172.21.15.53:0/2848937962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfbc004d10 0x7fdfbc005190 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009bd0 tx=0x7fdfcc01ee10 comp rx=0 tx=0).stop 2024-09-13T18:33:03.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfd92d7640 1 -- 172.21.15.53:0/2848937962 reap_dead start 2024-09-13T18:33:03.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 -- 172.21.15.53:0/2848937962 shutdown_connections 2024-09-13T18:33:03.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 -- 172.21.15.53:0/2848937962 >> 172.21.15.53:0/2848937962 conn(0x7fdfd4065c80 msgr2=0x7fdfd4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 -- 172.21.15.53:0/2848937962 shutdown_connections 2024-09-13T18:33:03.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 -- 172.21.15.53:0/2848937962 wait complete. 2024-09-13T18:33:03.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 Processor -- start 2024-09-13T18:33:03.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.257+0000 7fdfdad3a640 1 -- start start 2024-09-13T18:33:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc004d10 0x7fdfd415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd414b290 0x7fdfd415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd415c4d0 0x7fdfd41f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4148930 con 0x7fdfd414b290 2024-09-13T18:33:03.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd415c950 con 0x7fdfbc004d10 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd41f2e90 con 0x7fdfd415c4d0 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd414b290 0x7fdfd415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd414b290 0x7fdfd415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34358/0 (socket says 172.21.15.53:34358) 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 -- 172.21.15.53:0/3678544837 learned_addr learned my addr 172.21.15.53:0/3678544837 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd8ad6640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc004d10 0x7fdfd415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd92d7640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd415c4d0 0x7fdfd41f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 -- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd415c4d0 msgr2=0x7fdfd41f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd415c4d0 0x7fdfd41f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 -- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc004d10 msgr2=0x7fdfd415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc004d10 0x7fdfd415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 -- 172.21.15.53:0/3678544837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd415ab30 con 0x7fdfd414b290 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd3fff640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd414b290 0x7fdfd415bf90 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8000fc0 tx=0x7fdfc800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd17fa640 1 -- 172.21.15.53:0/3678544837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800c8a0 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd17fa640 1 -- 172.21.15.53:0/3678544837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800ca20 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd415ae10 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd17fa640 1 -- 172.21.15.53:0/3678544837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800cdd0 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd414b710 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd415a990 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd17fa640 1 -- 172.21.15.53:0/3678544837 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fdfc8013420 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd17fa640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdfc0066cf0 0x7fdfc00691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd17fa640 1 -- 172.21.15.53:0/3678544837 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdfc8084b40 con 0x7fdfd414b290 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd8ad6640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdfc0066cf0 0x7fdfc00691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.261+0000 7fdfd8ad6640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdfc0066cf0 0x7fdfc00691b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009ab0 tx=0x7fdfc4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.265+0000 7fdfd17fa640 1 -- 172.21.15.53:0/3678544837 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdfd415a990 con 0x7fdfd414b290 2024-09-13T18:33:03.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.429+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfd415a990 con 0x7fdfd414b290 2024-09-13T18:33:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.429+0000 7fdfd17fa640 1 -- 172.21.15.53:0/3678544837 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfd415a990 con 0x7fdfd414b290 2024-09-13T18:33:03.430 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:33:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.429+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdfc0066cf0 msgr2=0x7fdfc00691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.429+0000 7fdfdad3a640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdfc0066cf0 0x7fdfc00691b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009ab0 tx=0x7fdfc4008040 comp rx=0 tx=0).stop 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.429+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd414b290 msgr2=0x7fdfd415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.429+0000 7fdfdad3a640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd414b290 0x7fdfd415bf90 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8000fc0 tx=0x7fdfc800ece0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 shutdown_connections 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdfc0066cf0 0x7fdfc00691b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdfd415c4d0 0x7fdfd41f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfd414b290 0x7fdfd415bf90 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 --2- 172.21.15.53:0/3678544837 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdfbc004d10 0x7fdfd415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 >> 172.21.15.53:0/3678544837 conn(0x7fdfd4065c80 msgr2=0x7fdfd406fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 shutdown_connections 2024-09-13T18:33:03.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.433+0000 7fdfdad3a640 1 -- 172.21.15.53:0/3678544837 wait complete. 2024-09-13T18:33:03.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:33:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f2218036640 1 Processor -- start 2024-09-13T18:33:03.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f2218036640 1 -- start start 2024-09-13T18:33:03.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f2218036640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2210143f80 0x7f22100ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f2218036640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2210066390 0x7f221015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f2218036640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221006d170 con 0x7f221006c990 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f2218036640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2210144360 con 0x7f2210066390 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f2218036640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221006d450 con 0x7f2210143f80 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.565+0000 7f22165d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2210066390 0x7f221015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f22165d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2210066390 0x7f221015aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34366/0 (socket says 172.21.15.53:34366) 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f22165d3640 1 -- 172.21.15.53:0/2648298370 learned_addr learned my addr 172.21.15.53:0/2648298370 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2215dd2640 1 --2- 172.21.15.53:0/2648298370 >> v2:172.21.15.87:3300/0 conn(0x7f2210143f80 0x7f22100ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f22165d3640 1 -- 172.21.15.53:0/2648298370 >> v2:172.21.15.87:3300/0 conn(0x7f2210143f80 msgr2=0x7f22100ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f22165d3640 1 --2- 172.21.15.53:0/2648298370 >> v2:172.21.15.87:3300/0 conn(0x7f2210143f80 0x7f22100ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f22165d3640 1 -- 172.21.15.53:0/2648298370 >> v1:172.21.15.87:6789/0 conn(0x7f221006c990 legacy=0x7f2210065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f22165d3640 1 -- 172.21.15.53:0/2648298370 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221006d730 con 0x7f2210066390 2024-09-13T18:33:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f22165d3640 1 --2- 172.21.15.53:0/2648298370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210066390 0x7f221015aa90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f221006fcd0 tx=0x7f220801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c98436c2eabdfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2214dd0640 1 -- 172.21.15.53:0/2648298370 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22080aa610 con 0x7f2210066390 2024-09-13T18:33:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2214dd0640 1 -- 172.21.15.53:0/2648298370 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22080a6040 con 0x7f2210066390 2024-09-13T18:33:03.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2214dd0640 1 -- 172.21.15.53:0/2648298370 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22080aa990 con 0x7f2210066390 2024-09-13T18:33:03.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 -- 172.21.15.53:0/2648298370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210066390 msgr2=0x7f221015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 --2- 172.21.15.53:0/2648298370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210066390 0x7f221015aa90 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f221006fcd0 tx=0x7f220801c4b0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 -- 172.21.15.53:0/2648298370 shutdown_connections 2024-09-13T18:33:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 --2- 172.21.15.53:0/2648298370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210066390 0x7f221015aa90 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 --2- 172.21.15.53:0/2648298370 >> v2:172.21.15.87:3300/0 conn(0x7f2210143f80 0x7f22100ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 -- 172.21.15.53:0/2648298370 >> 172.21.15.53:0/2648298370 conn(0x7f22100b1310 msgr2=0x7f22100b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 -- 172.21.15.53:0/2648298370 shutdown_connections 2024-09-13T18:33:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.569+0000 7f2218036640 1 -- 172.21.15.53:0/2648298370 wait complete. 2024-09-13T18:33:03.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 Processor -- start 2024-09-13T18:33:03.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 -- start start 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2210066390 0x7f22100ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006c990 0x7f22100b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210143f80 0x7f22100b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221013b910 con 0x7f2210143f80 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221013bbd0 con 0x7f221006c990 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221013beb0 con 0x7f2210066390 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210143f80 0x7f22100b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210143f80 0x7f22100b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34368/0 (socket says 172.21.15.53:34368) 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 -- 172.21.15.53:0/1237762540 learned_addr learned my addr 172.21.15.53:0/1237762540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:03.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2215dd2640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2210066390 0x7f22100ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22155d1640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006c990 0x7f22100b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 -- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2210066390 msgr2=0x7f22100ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2210066390 0x7f22100ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 -- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006c990 msgr2=0x7f22100b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006c990 0x7f22100b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 -- 172.21.15.53:0/1237762540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080094d0 con 0x7f2210143f80 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22155d1640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006c990 0x7f22100b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22165d3640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210143f80 0x7f22100b3930 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f220801cd50 tx=0x7f220801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22067fc640 1 -- 172.21.15.53:0/1237762540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22080bd5f0 con 0x7f2210143f80 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22067fc640 1 -- 172.21.15.53:0/1237762540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22080bd750 con 0x7f2210143f80 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221006e390 con 0x7f2210143f80 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22067fc640 1 -- 172.21.15.53:0/1237762540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22080bdac0 con 0x7f2210143f80 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221013c470 con 0x7f2210143f80 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221015aa90 con 0x7f2210143f80 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22067fc640 1 -- 172.21.15.53:0/1237762540 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f22080b33f0 con 0x7f2210143f80 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22067fc640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21f4066cc0 0x7f21f4069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f22067fc640 1 -- 172.21.15.53:0/1237762540 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f220811f1d0 con 0x7f2210143f80 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.573+0000 7f2215dd2640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21f4066cc0 0x7f21f4069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.577+0000 7f2215dd2640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21f4066cc0 0x7f21f4069180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f220c003fd0 tx=0x7f220c0039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.577+0000 7f22067fc640 1 -- 172.21.15.53:0/1237762540 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22080ebad0 con 0x7f2210143f80 2024-09-13T18:33:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.737+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22100af060 con 0x7f2210143f80 2024-09-13T18:33:03.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.737+0000 7f22067fc640 1 -- 172.21.15.53:0/1237762540 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22080ef0f0 con 0x7f2210143f80 2024-09-13T18:33:03.741 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21f4066cc0 msgr2=0x7f21f4069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21f4066cc0 0x7f21f4069180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f220c003fd0 tx=0x7f220c0039a0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210143f80 msgr2=0x7f22100b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210143f80 0x7f22100b3930 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f220801cd50 tx=0x7f220801acf0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 shutdown_connections 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21f4066cc0 0x7f21f4069180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2210143f80 0x7f22100b3930 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f221006c990 0x7f22100b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 --2- 172.21.15.53:0/1237762540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2210066390 0x7f22100ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 >> 172.21.15.53:0/1237762540 conn(0x7f22100b1310 msgr2=0x7f22100a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 shutdown_connections 2024-09-13T18:33:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.741+0000 7f2218036640 1 -- 172.21.15.53:0/1237762540 wait complete. 2024-09-13T18:33:03.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.881+0000 7fed97a32640 1 Processor -- start 2024-09-13T18:33:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.881+0000 7fed97a32640 1 -- start start 2024-09-13T18:33:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed97a32640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed900cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed97a32640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed90142d40 0x7fed900ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed97a32640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9015dd20 con 0x7fed9015cf70 2024-09-13T18:33:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed97a32640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed90160df0 con 0x7fed90142d40 2024-09-13T18:33:03.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed97a32640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9015db10 con 0x7fed90142960 2024-09-13T18:33:03.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed957ce640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed900cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed94fcd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed90142d40 0x7fed900ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed957ce640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed900cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:43198/0 (socket says 172.21.15.53:43198) 2024-09-13T18:33:03.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed957ce640 1 -- 172.21.15.53:0/1807352133 learned_addr learned my addr 172.21.15.53:0/1807352133 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:03.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed94fcd640 1 -- 172.21.15.53:0/1807352133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 msgr2=0x7fed900cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:03.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed94fcd640 1 --2- 172.21.15.53:0/1807352133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed900cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed94fcd640 1 -- 172.21.15.53:0/1807352133 >> v1:172.21.15.87:6789/0 conn(0x7fed9015cf70 legacy=0x7fed9015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed94fcd640 1 -- 172.21.15.53:0/1807352133 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90140fe0 con 0x7fed90142d40 2024-09-13T18:33:03.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.885+0000 7fed94fcd640 1 --2- 172.21.15.53:0/1807352133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90142d40 0x7fed900ccfb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fed800097c0 tx=0x7fed8001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76ffe42557b8e5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed87fff640 1 -- 172.21.15.53:0/1807352133 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800ab670 con 0x7fed90142d40 2024-09-13T18:33:03.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed87fff640 1 -- 172.21.15.53:0/1807352133 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800ab7d0 con 0x7fed90142d40 2024-09-13T18:33:03.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed87fff640 1 -- 172.21.15.53:0/1807352133 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800abb60 con 0x7fed90142d40 2024-09-13T18:33:03.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- 172.21.15.53:0/1807352133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90142d40 msgr2=0x7fed900ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 --2- 172.21.15.53:0/1807352133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90142d40 0x7fed900ccfb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fed800097c0 tx=0x7fed8001c470 comp rx=0 tx=0).stop 2024-09-13T18:33:03.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- 172.21.15.53:0/1807352133 shutdown_connections 2024-09-13T18:33:03.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 --2- 172.21.15.53:0/1807352133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90142d40 0x7fed900ccfb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 --2- 172.21.15.53:0/1807352133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed900cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- 172.21.15.53:0/1807352133 >> 172.21.15.53:0/1807352133 conn(0x7fed900b0840 msgr2=0x7fed900b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- 172.21.15.53:0/1807352133 shutdown_connections 2024-09-13T18:33:03.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- 172.21.15.53:0/1807352133 wait complete. 2024-09-13T18:33:03.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 Processor -- start 2024-09-13T18:33:03.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- start start 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed9013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed90142d40 0x7fed90137f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9015cf70 0x7fed9013ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90144620 con 0x7fed90142d40 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90144900 con 0x7fed9015cf70 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed97a32640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed90144be0 con 0x7fed90142960 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed94fcd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed90142d40 0x7fed90137f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed94fcd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed90142d40 0x7fed90137f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34370/0 (socket says 172.21.15.53:34370) 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed94fcd640 1 -- 172.21.15.53:0/470926684 learned_addr learned my addr 172.21.15.53:0/470926684 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed957ce640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed9013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.889+0000 7fed95fcf640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9015cf70 0x7fed9013ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed94fcd640 1 -- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 msgr2=0x7fed9013ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed94fcd640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed9013ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed94fcd640 1 -- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9015cf70 msgr2=0x7fed9013ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed94fcd640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9015cf70 0x7fed9013ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed94fcd640 1 -- 172.21.15.53:0/470926684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed80009420 con 0x7fed90142d40 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed95fcf640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9015cf70 0x7fed9013ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed94fcd640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed90142d40 0x7fed90137f00 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fed800ad040 tx=0x7fed8001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed85ffb640 1 -- 172.21.15.53:0/470926684 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800bf610 con 0x7fed90142d40 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed85ffb640 1 -- 172.21.15.53:0/470926684 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800bf7b0 con 0x7fed90142d40 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed90144ec0 con 0x7fed90142d40 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed85ffb640 1 -- 172.21.15.53:0/470926684 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800bfb60 con 0x7fed90142d40 2024-09-13T18:33:03.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed901456c0 con 0x7fed90142d40 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed90140bc0 con 0x7fed90142d40 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed85ffb640 1 -- 172.21.15.53:0/470926684 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fed800b5400 con 0x7fed90142d40 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed85ffb640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066cc0 0x7fed74069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed85ffb640 1 -- 172.21.15.53:0/470926684 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fed8011fdd0 con 0x7fed90142d40 2024-09-13T18:33:03.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed957ce640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066cc0 0x7fed74069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.893+0000 7fed957ce640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066cc0 0x7fed74069180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009ae0 tx=0x7fed8c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:03.897+0000 7fed85ffb640 1 -- 172.21.15.53:0/470926684 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed800ec480 con 0x7fed90142d40 2024-09-13T18:33:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed90072e30 con 0x7fed90142d40 2024-09-13T18:33:04.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed85ffb640 1 -- 172.21.15.53:0/470926684 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4735 (secure 0 0 0) 0x7fed800efaa0 con 0x7fed90142d40 2024-09-13T18:33:04.091 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:04.091 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2946475465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2946475465},{"type":"v1","addr":"172.21.15.87:6833","nonce":2946475465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3953952610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3953952610},{"type":"v1","addr":"172.21.15.87:6835","nonce":3953952610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1516456617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1516456617},{"type":"v1","addr":"172.21.15.53:6833","nonce":1516456617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:32:33.769589+0000","modified":"2024-09-13T18:32:36.397069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/275376653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":275376653},{"type":"v1","addr":"172.21.15.53:6835","nonce":275376653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:33:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 80 2024-09-13T18:33:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066cc0 msgr2=0x7fed74069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066cc0 0x7fed74069180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009ae0 tx=0x7fed8c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed90142d40 msgr2=0x7fed90137f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed90142d40 0x7fed90137f00 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fed800ad040 tx=0x7fed8001acb0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 shutdown_connections 2024-09-13T18:33:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed74066cc0 0x7fed74069180 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed9015cf70 0x7fed9013ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed90142d40 0x7fed90137f00 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 --2- 172.21.15.53:0/470926684 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed90142960 0x7fed9013ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 >> 172.21.15.53:0/470926684 conn(0x7fed900b0840 msgr2=0x7fed90139080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 shutdown_connections 2024-09-13T18:33:04.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.089+0000 7fed97a32640 1 -- 172.21.15.53:0/470926684 wait complete. 2024-09-13T18:33:04.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:04.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3dbd44640 1 Processor -- start 2024-09-13T18:33:04.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3dbd44640 1 -- start start 2024-09-13T18:33:04.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3dbd44640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d40cf9f0 0x7ff3d406c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3dbd44640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3d406ddc0 0x7ff3d4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3dbd44640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d406e210 con 0x7ff3d41591c0 2024-09-13T18:33:04.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3dbd44640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d415d1a0 con 0x7ff3d406ddc0 2024-09-13T18:33:04.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3dbd44640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d415d480 con 0x7ff3d40cf9f0 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3da2e1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3d406ddc0 0x7ff3d4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3d92df640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d40cf9f0 0x7ff3d406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3da2e1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff3d406ddc0 0x7ff3d4159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:34210/0 (socket says 172.21.15.53:34210) 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3da2e1640 1 -- 172.21.15.53:0/4004634989 learned_addr learned my addr 172.21.15.53:0/4004634989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3d9ae0640 1 --1- 172.21.15.53:0/4004634989 >> v1:172.21.15.87:6789/0 conn(0x7ff3d41591c0 0x7ff3d40cf2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:46630/0 (socket says 172.21.15.53:46630) 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3da2e1640 1 -- 172.21.15.53:0/4004634989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d40cf9f0 msgr2=0x7ff3d406c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3da2e1640 1 --2- 172.21.15.53:0/4004634989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d40cf9f0 0x7ff3d406c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3da2e1640 1 -- 172.21.15.53:0/4004634989 >> v1:172.21.15.87:6789/0 conn(0x7ff3d41591c0 legacy=0x7ff3d40cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.233+0000 7ff3da2e1640 1 -- 172.21.15.53:0/4004634989 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d415d760 con 0x7ff3d406ddc0 2024-09-13T18:33:04.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3da2e1640 1 --2- 172.21.15.53:0/4004634989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4159b90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406e400 tx=0x7ff3cc01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4358f564fd4ae9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3d8ade640 1 -- 172.21.15.53:0/4004634989 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a57a0 con 0x7ff3d406ddc0 2024-09-13T18:33:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3d8ade640 1 -- 172.21.15.53:0/4004634989 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc0a5900 con 0x7ff3d406ddc0 2024-09-13T18:33:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3d8ade640 1 -- 172.21.15.53:0/4004634989 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a5c90 con 0x7ff3d406ddc0 2024-09-13T18:33:04.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 -- 172.21.15.53:0/4004634989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d406ddc0 msgr2=0x7ff3d4159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/4004634989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4159b90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406e400 tx=0x7ff3cc01c9e0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 -- 172.21.15.53:0/4004634989 shutdown_connections 2024-09-13T18:33:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/4004634989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4159b90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/4004634989 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d40cf9f0 0x7ff3d406c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 -- 172.21.15.53:0/4004634989 >> 172.21.15.53:0/4004634989 conn(0x7ff3d4073130 msgr2=0x7ff3d4069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 -- 172.21.15.53:0/4004634989 shutdown_connections 2024-09-13T18:33:04.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.237+0000 7ff3dbd44640 1 -- 172.21.15.53:0/4004634989 wait complete. 2024-09-13T18:33:04.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 Processor -- start 2024-09-13T18:33:04.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 -- start start 2024-09-13T18:33:04.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d40cf9f0 0x7ff3d4154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d41591c0 0x7ff3d414b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4155b70 con 0x7ff3d406ddc0 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d414a4d0 con 0x7ff3d40cf9f0 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4154f60 con 0x7ff3d41591c0 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34384/0 (socket says 172.21.15.53:34384) 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 -- 172.21.15.53:0/1820230960 learned_addr learned my addr 172.21.15.53:0/1820230960 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3da2e1640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d41591c0 0x7ff3d414b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d92df640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d40cf9f0 0x7ff3d4154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 -- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d41591c0 msgr2=0x7ff3d414b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d41591c0 0x7ff3d414b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 -- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d40cf9f0 msgr2=0x7ff3d4154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d40cf9f0 0x7ff3d4154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 -- 172.21.15.53:0/1820230960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc009b30 con 0x7ff3d406ddc0 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d92df640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d40cf9f0 0x7ff3d4154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3d9ae0640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4149f90 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000c430 tx=0x7ff3d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3ca7fc640 1 -- 172.21.15.53:0/1820230960 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00064e0 con 0x7ff3d406ddc0 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3ca7fc640 1 -- 172.21.15.53:0/1820230960 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d0006640 con 0x7ff3d406ddc0 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d4159720 con 0x7ff3d406ddc0 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3ca7fc640 1 -- 172.21.15.53:0/1820230960 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00049d0 con 0x7ff3d406ddc0 2024-09-13T18:33:04.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d4155520 con 0x7ff3d406ddc0 2024-09-13T18:33:04.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d406c3f0 con 0x7ff3d406ddc0 2024-09-13T18:33:04.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.241+0000 7ff3ca7fc640 1 -- 172.21.15.53:0/1820230960 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7ff3d0004b30 con 0x7ff3d406ddc0 2024-09-13T18:33:04.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.245+0000 7ff3ca7fc640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff3b8066cc0 0x7ff3b8069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.245+0000 7ff3d92df640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff3b8066cc0 0x7ff3b8069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.245+0000 7ff3ca7fc640 1 -- 172.21.15.53:0/1820230960 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff3d00841e0 con 0x7ff3d406ddc0 2024-09-13T18:33:04.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.245+0000 7ff3d92df640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff3b8066cc0 0x7ff3b8069180 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4164190 tx=0x7ff3c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.249+0000 7ff3ca7fc640 1 -- 172.21.15.53:0/1820230960 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3d0050c60 con 0x7ff3d406ddc0 2024-09-13T18:33:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.409+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3d4152e30 con 0x7ff3d406ddc0 2024-09-13T18:33:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.409+0000 7ff3ca7fc640 1 -- 172.21.15.53:0/1820230960 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16568 (secure 0 0 0) 0x7ff3d0054280 con 0x7ff3d406ddc0 2024-09-13T18:33:04.413 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:04.414 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":138,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:04.032437+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff3b8066cc0 msgr2=0x7ff3b8069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff3b8066cc0 0x7ff3b8069180 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4164190 tx=0x7ff3c4008040 comp rx=0 tx=0).stop 2024-09-13T18:33:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3d406ddc0 msgr2=0x7ff3d4149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4149f90 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000c430 tx=0x7ff3d000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 shutdown_connections 2024-09-13T18:33:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff3b8066cc0 0x7ff3b8069180 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3d41591c0 0x7ff3d414b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3d40cf9f0 0x7ff3d4154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 --2- 172.21.15.53:0/1820230960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3d406ddc0 0x7ff3d4149f90 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 >> 172.21.15.53:0/1820230960 conn(0x7ff3d4073130 msgr2=0x7ff3d4158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 shutdown_connections 2024-09-13T18:33:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.413+0000 7ff3dbd44640 1 -- 172.21.15.53:0/1820230960 wait complete. 2024-09-13T18:33:04.432 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:33:04.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:04.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94bb65b640 1 Processor -- start 2024-09-13T18:33:04.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94bb65b640 1 -- start start 2024-09-13T18:33:04.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94bb65b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94b40af5e0 0x7f94b4165320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94bb65b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b40b0b90 con 0x7f94b415db40 2024-09-13T18:33:04.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94bb65b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b40ad530 con 0x7f94b40b1960 2024-09-13T18:33:04.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94bb65b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40ae1b0 con 0x7f94b40af5e0 2024-09-13T18:33:04.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94b93f7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f94b415db40 0x7f94b40afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52328/0 (socket says 172.21.15.53:52328) 2024-09-13T18:33:04.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94b9bf8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94b40af5e0 0x7f94b4165320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94b93f7640 1 -- 172.21.15.53:0/3871133395 learned_addr learned my addr 172.21.15.53:0/3871133395 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:04.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94b9bf8640 1 -- 172.21.15.53:0/3871133395 >> v1:172.21.15.87:6789/0 conn(0x7f94b40b1960 legacy=0x7f94b40b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:04.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94b9bf8640 1 -- 172.21.15.53:0/3871133395 >> v1:172.21.15.53:6789/0 conn(0x7f94b415db40 legacy=0x7f94b40afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94abfff640 1 -- 172.21.15.53:0/3871133395 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849536124 0 0) 0x7f94b40b0b90 con 0x7f94b415db40 2024-09-13T18:33:04.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.549+0000 7f94b9bf8640 1 -- 172.21.15.53:0/3871133395 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40ad810 con 0x7f94b40af5e0 2024-09-13T18:33:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b9bf8640 1 --2- 172.21.15.53:0/3871133395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b4165320 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009d90 tx=0x7f94ac01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b48cb05432172f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94abfff640 1 -- 172.21.15.53:0/3871133395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0a5930 con 0x7f94b40af5e0 2024-09-13T18:33:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94abfff640 1 -- 172.21.15.53:0/3871133395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac0a5a90 con 0x7f94b40af5e0 2024-09-13T18:33:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94abfff640 1 -- 172.21.15.53:0/3871133395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0a5e20 con 0x7f94b40af5e0 2024-09-13T18:33:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- 172.21.15.53:0/3871133395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 msgr2=0x7f94b4165320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 --2- 172.21.15.53:0/3871133395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b4165320 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009d90 tx=0x7f94ac01c870 comp rx=0 tx=0).stop 2024-09-13T18:33:04.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- 172.21.15.53:0/3871133395 shutdown_connections 2024-09-13T18:33:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 --2- 172.21.15.53:0/3871133395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b4165320 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- 172.21.15.53:0/3871133395 >> 172.21.15.53:0/3871133395 conn(0x7f94b40b20d0 msgr2=0x7f94b40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- 172.21.15.53:0/3871133395 shutdown_connections 2024-09-13T18:33:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- 172.21.15.53:0/3871133395 wait complete. 2024-09-13T18:33:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 Processor -- start 2024-09-13T18:33:04.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- start start 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b40cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94b40b1960 0x7f94b4152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94b415db40 0x7f94b40b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c7650 con 0x7f94b40af5e0 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c7930 con 0x7f94b415db40 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94bb65b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c7c10 con 0x7f94b40b1960 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b40cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b40cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34402/0 (socket says 172.21.15.53:34402) 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 -- 172.21.15.53:0/2505053726 learned_addr learned my addr 172.21.15.53:0/2505053726 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b9bf8640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94b415db40 0x7f94b40b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b8bf6640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94b40b1960 0x7f94b4152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 -- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94b40b1960 msgr2=0x7f94b4152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94b40b1960 0x7f94b4152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 -- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94b415db40 msgr2=0x7f94b40b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94b415db40 0x7f94b40b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.553+0000 7f94b93f7640 1 -- 172.21.15.53:0/2505053726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac009a70 con 0x7f94b40af5e0 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94b93f7640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b40cc260 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c480 tx=0x7f94b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94a9ffb640 1 -- 172.21.15.53:0/2505053726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00074e0 con 0x7f94b40af5e0 2024-09-13T18:33:04.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94a9ffb640 1 -- 172.21.15.53:0/2505053726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0007660 con 0x7f94b40af5e0 2024-09-13T18:33:04.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b40c7ef0 con 0x7f94b40af5e0 2024-09-13T18:33:04.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94a9ffb640 1 -- 172.21.15.53:0/2505053726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0004a30 con 0x7f94b40af5e0 2024-09-13T18:33:04.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b4152f50 con 0x7f94b40af5e0 2024-09-13T18:33:04.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b40afd70 con 0x7f94b40af5e0 2024-09-13T18:33:04.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94a9ffb640 1 -- 172.21.15.53:0/2505053726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f94b0004b90 con 0x7f94b40af5e0 2024-09-13T18:33:04.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94a9ffb640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9498066cc0 0x7f9498069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94a9ffb640 1 -- 172.21.15.53:0/2505053726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f94b0083e00 con 0x7f94b40af5e0 2024-09-13T18:33:04.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94b8bf6640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9498066cc0 0x7f9498069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.557+0000 7f94b8bf6640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9498066cc0 0x7f9498069180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94b40ccd30 tx=0x7f94a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.561+0000 7f94a9ffb640 1 -- 172.21.15.53:0/2505053726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94b0054330 con 0x7f94b40af5e0 2024-09-13T18:33:04.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.749+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94b4066a70 con 0x7f94b40af5e0 2024-09-13T18:33:04.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.749+0000 7f94a9ffb640 1 -- 172.21.15.53:0/2505053726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f94b0018020 con 0x7f94b40af5e0 2024-09-13T18:33:04.752 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:04.752 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2946475465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2946475465},{"type":"v1","addr":"172.21.15.87:6833","nonce":2946475465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3953952610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3953952610},{"type":"v1","addr":"172.21.15.87:6835","nonce":3953952610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1516456617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1516456617},{"type":"v1","addr":"172.21.15.53:6833","nonce":1516456617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:32:33.769589+0000","modified":"2024-09-13T18:32:36.397069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/275376653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":275376653},{"type":"v1","addr":"172.21.15.53:6835","nonce":275376653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:33:04.752 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 80 2024-09-13T18:33:04.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9498066cc0 msgr2=0x7f9498069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9498066cc0 0x7f9498069180 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94b40ccd30 tx=0x7f94a4009040 comp rx=0 tx=0).stop 2024-09-13T18:33:04.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 msgr2=0x7f94b40cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b40cc260 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c480 tx=0x7f94b000c940 comp rx=0 tx=0).stop 2024-09-13T18:33:04.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 shutdown_connections 2024-09-13T18:33:04.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9498066cc0 0x7f9498069180 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f94b40b1960 0x7f94b4152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94b415db40 0x7f94b40b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 --2- 172.21.15.53:0/2505053726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94b40af5e0 0x7f94b40cc260 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 >> 172.21.15.53:0/2505053726 conn(0x7f94b40b20d0 msgr2=0x7f94b406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 shutdown_connections 2024-09-13T18:33:04.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.753+0000 7f94bb65b640 1 -- 172.21.15.53:0/2505053726 wait complete. 2024-09-13T18:33:04.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:04.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.877+0000 7f07056d0640 1 Processor -- start 2024-09-13T18:33:04.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.877+0000 7f07056d0640 1 -- start start 2024-09-13T18:33:04.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f07056d0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f070015b300 0x7f07000cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f07056d0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07000cc3f0 con 0x7f07000cc8f0 2024-09-13T18:33:04.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f07056d0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0700161930 con 0x7f0700161170 2024-09-13T18:33:04.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f07056d0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0700161c10 con 0x7f070015b300 2024-09-13T18:33:04.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f06feffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f070015b300 0x7f07000cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f06ff7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f07000cc8f0 0x7f0700070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52332/0 (socket says 172.21.15.53:52332) 2024-09-13T18:33:04.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f06ff7fe640 1 -- 172.21.15.53:0/24875569 learned_addr learned my addr 172.21.15.53:0/24875569 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:04.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f06feffd640 1 -- 172.21.15.53:0/24875569 >> v1:172.21.15.87:6789/0 conn(0x7f0700161170 legacy=0x7f0700162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:04.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f06feffd640 1 -- 172.21.15.53:0/24875569 >> v1:172.21.15.53:6789/0 conn(0x7f07000cc8f0 legacy=0x7f0700070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f06fdffb640 1 -- 172.21.15.53:0/24875569 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331324903 0 0) 0x7f07000cc3f0 con 0x7f07000cc8f0 2024-09-13T18:33:04.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.881+0000 7f06feffd640 1 -- 172.21.15.53:0/24875569 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700161ef0 con 0x7f070015b300 2024-09-13T18:33:04.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f06feffd640 1 --2- 172.21.15.53:0/24875569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f070015b300 0x7f07000cd780 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f06f80097c0 tx=0x7f06f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116a0cea4d440ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f06fdffb640 1 -- 172.21.15.53:0/24875569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80ab600 con 0x7f070015b300 2024-09-13T18:33:04.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f06fdffb640 1 -- 172.21.15.53:0/24875569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f80a7050 con 0x7f070015b300 2024-09-13T18:33:04.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f06fdffb640 1 -- 172.21.15.53:0/24875569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80ab980 con 0x7f070015b300 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 -- 172.21.15.53:0/24875569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f070015b300 msgr2=0x7f07000cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 --2- 172.21.15.53:0/24875569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f070015b300 0x7f07000cd780 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f06f80097c0 tx=0x7f06f801c460 comp rx=0 tx=0).stop 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 -- 172.21.15.53:0/24875569 shutdown_connections 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 --2- 172.21.15.53:0/24875569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f070015b300 0x7f07000cd780 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 -- 172.21.15.53:0/24875569 >> 172.21.15.53:0/24875569 conn(0x7f0700065c80 msgr2=0x7f0700066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 -- 172.21.15.53:0/24875569 shutdown_connections 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 -- 172.21.15.53:0/24875569 wait complete. 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 Processor -- start 2024-09-13T18:33:04.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.885+0000 7f07056d0640 1 -- start start 2024-09-13T18:33:04.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07000cc8f0 0x7f07000a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f070015b300 0x7f07000aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0700161170 0x7f0700155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700156150 con 0x7f07000cc8f0 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07000a89e0 con 0x7f070015b300 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0700155b90 con 0x7f0700161170 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07000cc8f0 0x7f07000a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07000cc8f0 0x7f07000a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34422/0 (socket says 172.21.15.53:34422) 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 -- 172.21.15.53:0/3686036448 learned_addr learned my addr 172.21.15.53:0/3686036448 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06fe7fc640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f070015b300 0x7f07000aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06ff7fe640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0700161170 0x7f0700155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 -- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0700161170 msgr2=0x7f0700155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0700161170 0x7f0700155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 -- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f070015b300 msgr2=0x7f07000aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f070015b300 0x7f07000aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 -- 172.21.15.53:0/3686036448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f8009420 con 0x7f07000cc8f0 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06feffd640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07000cc8f0 0x7f07000a8e70 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f06f8019070 tx=0x7f06f8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06e77fe640 1 -- 172.21.15.53:0/3686036448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80b4610 con 0x7f07000cc8f0 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06e77fe640 1 -- 172.21.15.53:0/3686036448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f80abe90 con 0x7f07000cc8f0 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0700155e70 con 0x7f07000cc8f0 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06e77fe640 1 -- 172.21.15.53:0/3686036448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80b49d0 con 0x7f07000cc8f0 2024-09-13T18:33:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07000a93b0 con 0x7f07000cc8f0 2024-09-13T18:33:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0700067400 con 0x7f07000cc8f0 2024-09-13T18:33:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06e77fe640 1 -- 172.21.15.53:0/3686036448 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f06f80b2040 con 0x7f07000cc8f0 2024-09-13T18:33:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06e77fe640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06ec066cc0 0x7f06ec069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06e77fe640 1 -- 172.21.15.53:0/3686036448 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f06f811ed90 con 0x7f07000cc8f0 2024-09-13T18:33:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06fe7fc640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06ec066cc0 0x7f06ec069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.889+0000 7f06fe7fc640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06ec066cc0 0x7f06ec069180 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0700161020 tx=0x7f06f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.896 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:04.893+0000 7f06e77fe640 1 -- 172.21.15.53:0/3686036448 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06f80eb7a0 con 0x7f07000cc8f0 2024-09-13T18:33:05.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.085+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0700067400 con 0x7f07000cc8f0 2024-09-13T18:33:05.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f06e77fe640 1 -- 172.21.15.53:0/3686036448 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f06f80b4b30 con 0x7f07000cc8f0 2024-09-13T18:33:05.091 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:05.091 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2946475465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2946475465},{"type":"v1","addr":"172.21.15.87:6833","nonce":2946475465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3953952610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3953952610},{"type":"v1","addr":"172.21.15.87:6835","nonce":3953952610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1516456617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1516456617},{"type":"v1","addr":"172.21.15.53:6833","nonce":1516456617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:32:33.769589+0000","modified":"2024-09-13T18:32:36.397069+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/275376653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":275376653},{"type":"v1","addr":"172.21.15.53:6835","nonce":275376653}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:33:05.091 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 80 2024-09-13T18:33:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06ec066cc0 msgr2=0x7f06ec069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06ec066cc0 0x7f06ec069180 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0700161020 tx=0x7f06f4009040 comp rx=0 tx=0).stop 2024-09-13T18:33:05.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07000cc8f0 msgr2=0x7f07000a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07000cc8f0 0x7f07000a8e70 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f06f8019070 tx=0x7f06f8019200 comp rx=0 tx=0).stop 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 shutdown_connections 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f06ec066cc0 0x7f06ec069180 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0700161170 0x7f0700155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f070015b300 0x7f07000aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 --2- 172.21.15.53:0/3686036448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07000cc8f0 0x7f07000a8e70 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 >> 172.21.15.53:0/3686036448 conn(0x7f0700065c80 msgr2=0x7f07000b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 shutdown_connections 2024-09-13T18:33:05.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.089+0000 7f07056d0640 1 -- 172.21.15.53:0/3686036448 wait complete. 2024-09-13T18:33:05.108 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:05.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8540ec8640 1 Processor -- start 2024-09-13T18:33:05.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8540ec8640 1 -- start start 2024-09-13T18:33:05.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8540ec8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c0cbb60 0x7f853c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8540ec8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c0b2860 con 0x7f853c06fa80 2024-09-13T18:33:05.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8540ec8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c158f80 con 0x7f853c158ba0 2024-09-13T18:33:05.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8540ec8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0b2580 con 0x7f853c0cbb60 2024-09-13T18:33:05.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f853c06fa80 0x7f853c0cce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52334/0 (socket says 172.21.15.53:52334) 2024-09-13T18:33:05.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 -- 172.21.15.53:0/4283206463 learned_addr learned my addr 172.21.15.53:0/4283206463 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:05.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204811577 0 0) 0x7f853c0b2860 con 0x7f853c06fa80 2024-09-13T18:33:05.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853ad9d640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c0cbb60 0x7f853c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8524005740 con 0x7f853c06fa80 2024-09-13T18:33:05.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3584424783 0 0) 0x7f8524005740 con 0x7f853c06fa80 2024-09-13T18:33:05.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c0cbb60 msgr2=0x7f853c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c0cbb60 0x7f853c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 >> v1:172.21.15.87:6789/0 conn(0x7f853c158ba0 legacy=0x7f853c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0cc3a0 con 0x7f853c06fa80 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8530001680 con 0x7f853c06fa80 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 >> v1:172.21.15.53:6789/0 conn(0x7f853c06fa80 legacy=0x7f853c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8524005bc0 0x7f8524005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85240069e0 0x7f8524006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85240074c0 0x7f852400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0b2580 con 0x7f85240069e0 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852400e2f0 con 0x7f8524005bc0 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852400e4b0 con 0x7f85240074c0 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853ad9d640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c0cbb60 0x7f853c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85240069e0 0x7f8524006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 -- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85240074c0 msgr2=0x7f852400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f853a59c640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8524005bc0 0x7f8524005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f85240074c0 0x7f852400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 -- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8524005bc0 msgr2=0x7f8524005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8524005bc0 0x7f8524005fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.229+0000 7f8539d9b640 1 -- 172.21.15.53:0/4283206463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524005740 con 0x7f85240069e0 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8539d9b640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85240069e0 0x7f8524006e60 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f853000c240 tx=0x7f853001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4feded75deb137 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530005ae0 con 0x7f85240069e0 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8530005c40 con 0x7f85240069e0 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853959a640 1 -- 172.21.15.53:0/4283206463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a5850 con 0x7f85240069e0 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- 172.21.15.53:0/4283206463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85240069e0 msgr2=0x7f8524006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 --2- 172.21.15.53:0/4283206463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85240069e0 0x7f8524006e60 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f853000c240 tx=0x7f853001cc60 comp rx=0 tx=0).stop 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 -- 172.21.15.53:0/4283206463 reap_dead start 2024-09-13T18:33:05.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- 172.21.15.53:0/4283206463 shutdown_connections 2024-09-13T18:33:05.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- 172.21.15.53:0/4283206463 >> 172.21.15.53:0/4283206463 conn(0x7f853c065c80 msgr2=0x7f853c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- 172.21.15.53:0/4283206463 shutdown_connections 2024-09-13T18:33:05.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- 172.21.15.53:0/4283206463 wait complete. 2024-09-13T18:33:05.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 Processor -- start 2024-09-13T18:33:05.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- start start 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85240069e0 0x7f853c0c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c14fe60 0x7f853c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f853c0ac8e0 0x7f853c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0ad2a0 con 0x7f853c0ac8e0 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0c3a20 con 0x7f85240069e0 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0c3d00 con 0x7f853c14fe60 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f853c0ac8e0 0x7f853c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f853c0ac8e0 0x7f853c0acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34450/0 (socket says 172.21.15.53:34450) 2024-09-13T18:33:05.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 -- 172.21.15.53:0/3065295939 learned_addr learned my addr 172.21.15.53:0/3065295939 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853a59c640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85240069e0 0x7f853c0c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8539d9b640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c14fe60 0x7f853c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 -- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c14fe60 msgr2=0x7f853c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c14fe60 0x7f853c1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 -- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85240069e0 msgr2=0x7f853c0c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85240069e0 0x7f853c0c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 -- 172.21.15.53:0/3065295939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0c3fe0 con 0x7f853c0ac8e0 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8539d9b640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c14fe60 0x7f853c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f853ad9d640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f853c0ac8e0 0x7f853c0acd60 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f853c0cc140 tx=0x7f853400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f852affd640 1 -- 172.21.15.53:0/3065295939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853400de30 con 0x7f853c0ac8e0 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f852affd640 1 -- 172.21.15.53:0/3065295939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853400f040 con 0x7f853c0ac8e0 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c0c42c0 con 0x7f853c0ac8e0 2024-09-13T18:33:05.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f852affd640 1 -- 172.21.15.53:0/3065295939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534003be0 con 0x7f853c0ac8e0 2024-09-13T18:33:05.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.233+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c155e30 con 0x7f853c0ac8e0 2024-09-13T18:33:05.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.237+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c067400 con 0x7f853c0ac8e0 2024-09-13T18:33:05.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.237+0000 7f852affd640 1 -- 172.21.15.53:0/3065295939 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f8534003d40 con 0x7f853c0ac8e0 2024-09-13T18:33:05.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.237+0000 7f852affd640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f851c066cc0 0x7f851c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.237+0000 7f853a59c640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f851c066cc0 0x7f851c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.237+0000 7f852affd640 1 -- 172.21.15.53:0/3065295939 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8534084e80 con 0x7f853c0ac8e0 2024-09-13T18:33:05.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.237+0000 7f853a59c640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f851c066cc0 0x7f851c069180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f852c000c10 tx=0x7f852c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.241+0000 7f852affd640 1 -- 172.21.15.53:0/3065295939 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8534051780 con 0x7f853c0ac8e0 2024-09-13T18:33:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.401+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f853c0cce80 con 0x7f853c0ac8e0 2024-09-13T18:33:05.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.405+0000 7f852affd640 1 -- 172.21.15.53:0/3065295939 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16568 (secure 0 0 0) 0x7f8534054da0 con 0x7f853c0ac8e0 2024-09-13T18:33:05.407 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:05.407 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":138,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:04.032437+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:32:31.405006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:32:32.764715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f851c066cc0 msgr2=0x7f851c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f851c066cc0 0x7f851c069180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f852c000c10 tx=0x7f852c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f853c0ac8e0 msgr2=0x7f853c0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f853c0ac8e0 0x7f853c0acd60 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f853c0cc140 tx=0x7f853400d4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 shutdown_connections 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f851c066cc0 0x7f851c069180 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f853c14fe60 0x7f853c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f853c0ac8e0 0x7f853c0acd60 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 --2- 172.21.15.53:0/3065295939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85240069e0 0x7f853c0c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 >> 172.21.15.53:0/3065295939 conn(0x7f853c065c80 msgr2=0x7f853c0b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 shutdown_connections 2024-09-13T18:33:05.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.409+0000 7f8540ec8640 1 -- 172.21.15.53:0/3065295939 wait complete. 2024-09-13T18:33:05.428 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:33:05.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7acb212640 1 Processor -- start 2024-09-13T18:33:05.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7acb212640 1 -- start start 2024-09-13T18:33:05.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7acb212640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7ac406fa80 0x7f7ac406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7acb212640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac40b2860 con 0x7f7ac4158ba0 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7acb212640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac4158f80 con 0x7f7ac40cbb60 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7acb212640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40b2580 con 0x7f7ac406fa80 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac8fae640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7ac4158ba0 0x7f7ac406f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52342/0 (socket says 172.21.15.53:52342) 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac8fae640 1 -- 172.21.15.53:0/307675776 learned_addr learned my addr 172.21.15.53:0/307675776 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/307675776 >> v2:172.21.15.87:3300/0 conn(0x7f7ac406fa80 0x7f7ac406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936052315 0 0) 0x7f7ac40b2860 con 0x7f7ac4158ba0 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aac005740 con 0x7f7ac4158ba0 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556184021 0 0) 0x7f7aac005740 con 0x7f7ac4158ba0 2024-09-13T18:33:05.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 >> v2:172.21.15.87:3300/0 conn(0x7f7ac406fa80 msgr2=0x7f7ac406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 --2- 172.21.15.53:0/307675776 >> v2:172.21.15.87:3300/0 conn(0x7f7ac406fa80 0x7f7ac406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 >> v1:172.21.15.87:6789/0 conn(0x7f7ac40cbb60 legacy=0x7f7ac40cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40cc3a0 con 0x7f7ac4158ba0 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7ab4001680 con 0x7f7ac4158ba0 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 >> v1:172.21.15.53:6789/0 conn(0x7f7ac4158ba0 legacy=0x7f7ac406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac005b90 0x7f7aac005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aac0069e0 0x7f7aac006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aac0073a0 0x7f7aac00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40b2580 con 0x7f7aac0069e0 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac00e340 con 0x7f7aac0073a0 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.549+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac00e500 con 0x7f7aac005b90 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aac0069e0 0x7f7aac006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac8fae640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac005b90 0x7f7aac005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac97af640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aac0073a0 0x7f7aac00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac3fff640 1 -- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac005b90 msgr2=0x7f7aac005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac005b90 0x7f7aac005fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac3fff640 1 -- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aac0073a0 msgr2=0x7f7aac00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aac0073a0 0x7f7aac00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac3fff640 1 -- 172.21.15.53:0/307675776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac005740 con 0x7f7aac0069e0 2024-09-13T18:33:05.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac97af640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7aac0073a0 0x7f7aac00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:05.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac97af640 1 -- 172.21.15.53:0/307675776 reap_dead start 2024-09-13T18:33:05.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aac0069e0 0x7f7aac006e60 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009ae0 tx=0x7f7ab801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd37c02ad9ae548 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80a5550 con 0x7f7aac0069e0 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab80a56b0 con 0x7f7aac0069e0 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7ac37fe640 1 -- 172.21.15.53:0/307675776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80a5a60 con 0x7f7aac0069e0 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7acb212640 1 -- 172.21.15.53:0/307675776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aac0069e0 msgr2=0x7f7aac006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7acb212640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aac0069e0 0x7f7aac006e60 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009ae0 tx=0x7f7ab801ca70 comp rx=0 tx=0).stop 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7acb212640 1 -- 172.21.15.53:0/307675776 shutdown_connections 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7acb212640 1 --2- 172.21.15.53:0/307675776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aac0069e0 0x7f7aac006e60 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7acb212640 1 -- 172.21.15.53:0/307675776 >> 172.21.15.53:0/307675776 conn(0x7f7ac4065c80 msgr2=0x7f7ac4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7acb212640 1 -- 172.21.15.53:0/307675776 shutdown_connections 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.553+0000 7f7acb212640 1 -- 172.21.15.53:0/307675776 wait complete. 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 Processor -- start 2024-09-13T18:33:05.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 -- start start 2024-09-13T18:33:05.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac0069e0 0x7f7ac41f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac4154ec0 0x7f7ac4155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ac415a930 0x7f7ac415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4155880 con 0x7f7ac4154ec0 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40ad450 con 0x7f7ac415a930 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40ad730 con 0x7f7aac0069e0 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac4154ec0 0x7f7ac4155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac4154ec0 0x7f7ac4155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34462/0 (socket says 172.21.15.53:34462) 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 -- 172.21.15.53:0/215782493 learned_addr learned my addr 172.21.15.53:0/215782493 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac8fae640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac0069e0 0x7f7ac41f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac97af640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ac415a930 0x7f7ac415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 -- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac0069e0 msgr2=0x7f7ac41f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac0069e0 0x7f7ac41f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 -- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ac415a930 msgr2=0x7f7ac415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ac415a930 0x7f7ac415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 -- 172.21.15.53:0/215782493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40ada10 con 0x7f7ac4154ec0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac97af640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ac415a930 0x7f7ac415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac3fff640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac4154ec0 0x7f7ac4155340 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7ab801c8a0 tx=0x7f7ab8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac17fa640 1 -- 172.21.15.53:0/215782493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80a5550 con 0x7f7ac4154ec0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac17fa640 1 -- 172.21.15.53:0/215782493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800f000 con 0x7f7ac4154ec0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac40adcf0 con 0x7f7ac4154ec0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac17fa640 1 -- 172.21.15.53:0/215782493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004260 con 0x7f7ac4154ec0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac415b2f0 con 0x7f7ac4154ec0 2024-09-13T18:33:05.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac4067400 con 0x7f7ac4154ec0 2024-09-13T18:33:05.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.557+0000 7f7ac17fa640 1 -- 172.21.15.53:0/215782493 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f7ab80b4070 con 0x7f7ac4154ec0 2024-09-13T18:33:05.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.561+0000 7f7ac17fa640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ab0066cc0 0x7f7ab0069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.561+0000 7f7ac8fae640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ab0066cc0 0x7f7ab0069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.561+0000 7f7ac17fa640 1 -- 172.21.15.53:0/215782493 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7ab811f1e0 con 0x7f7ac4154ec0 2024-09-13T18:33:05.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.561+0000 7f7ac8fae640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ab0066cc0 0x7f7ab0069180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000c10 tx=0x7f7ab4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.565+0000 7f7ac17fa640 1 -- 172.21.15.53:0/215782493 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ab80ebc80 con 0x7f7ac4154ec0 2024-09-13T18:33:05.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.753+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7ac40cce80 con 0x7f7ac4154ec0 2024-09-13T18:33:05.757 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:33:05.757+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:33:05.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7ac17fa640 1 -- 172.21.15.53:0/215782493 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7ab80ef2a0 con 0x7f7ac4154ec0 2024-09-13T18:33:05.770 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:33:05.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ab0066cc0 msgr2=0x7f7ab0069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ab0066cc0 0x7f7ab0069180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000c10 tx=0x7f7ab4009040 comp rx=0 tx=0).stop 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac4154ec0 msgr2=0x7f7ac4155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac4154ec0 0x7f7ac4155340 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7ab801c8a0 tx=0x7f7ab8019810 comp rx=0 tx=0).stop 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 shutdown_connections 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ab0066cc0 0x7f7ab0069180 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7ac415a930 0x7f7ac415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ac4154ec0 0x7f7ac4155340 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 --2- 172.21.15.53:0/215782493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7aac0069e0 0x7f7ac41f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 >> 172.21.15.53:0/215782493 conn(0x7f7ac4065c80 msgr2=0x7f7ac40ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 shutdown_connections 2024-09-13T18:33:05.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.769+0000 7f7acb212640 1 -- 172.21.15.53:0/215782493 wait complete. 2024-09-13T18:33:05.775 INFO:tasks.ceph.mds.a.smithi053.stderr: -1900> 2024-09-13T18:32:34.357+0000 7f4474eaf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:33:05.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:33:05.819 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:33:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.905+0000 7f4a754ff640 1 Processor -- start 2024-09-13T18:33:05.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.905+0000 7f4a754ff640 1 -- start start 2024-09-13T18:33:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a754ff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a70156c40 0x7f4a70070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a754ff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a70157020 0x7f4a7006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a754ff640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7006d6e0 con 0x7f4a7006d270 2024-09-13T18:33:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a754ff640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a70070340 con 0x7f4a70157020 2024-09-13T18:33:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a754ff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a700b15a0 con 0x7f4a70156c40 2024-09-13T18:33:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a70157020 0x7f4a7006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4a7006d270 0x7f4a7015cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52356/0 (socket says 172.21.15.53:52356) 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6f7fe640 1 -- 172.21.15.53:0/319784493 learned_addr learned my addr 172.21.15.53:0/319784493 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6effd640 1 --2- 172.21.15.53:0/319784493 >> v2:172.21.15.87:3300/0 conn(0x7f4a70156c40 0x7f4a70070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6e7fc640 1 -- 172.21.15.53:0/319784493 >> v2:172.21.15.87:3300/0 conn(0x7f4a70156c40 msgr2=0x7f4a70070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6e7fc640 1 --2- 172.21.15.53:0/319784493 >> v2:172.21.15.87:3300/0 conn(0x7f4a70156c40 0x7f4a70070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6e7fc640 1 -- 172.21.15.53:0/319784493 >> v1:172.21.15.53:6789/0 conn(0x7f4a7006d270 legacy=0x7f4a7015cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6dffb640 1 -- 172.21.15.53:0/319784493 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904579850 0 0) 0x7f4a7006d6e0 con 0x7f4a7006d270 2024-09-13T18:33:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6e7fc640 1 -- 172.21.15.53:0/319784493 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a700b1880 con 0x7f4a70157020 2024-09-13T18:33:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6e7fc640 1 --2- 172.21.15.53:0/319784493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70157020 0x7f4a7006cd30 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f4a70067650 tx=0x7f4a6401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a412b3c6ff6d192 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6dffb640 1 -- 172.21.15.53:0/319784493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640ab600 con 0x7f4a70157020 2024-09-13T18:33:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6dffb640 1 -- 172.21.15.53:0/319784493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a640a7050 con 0x7f4a70157020 2024-09-13T18:33:05.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.909+0000 7f4a6dffb640 1 -- 172.21.15.53:0/319784493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640ab980 con 0x7f4a70157020 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- 172.21.15.53:0/319784493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70157020 msgr2=0x7f4a7006cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 --2- 172.21.15.53:0/319784493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70157020 0x7f4a7006cd30 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f4a70067650 tx=0x7f4a6401c450 comp rx=0 tx=0).stop 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- 172.21.15.53:0/319784493 shutdown_connections 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 --2- 172.21.15.53:0/319784493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70157020 0x7f4a7006cd30 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 --2- 172.21.15.53:0/319784493 >> v2:172.21.15.87:3300/0 conn(0x7f4a70156c40 0x7f4a70070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- 172.21.15.53:0/319784493 >> 172.21.15.53:0/319784493 conn(0x7f4a70065c80 msgr2=0x7f4a70066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- 172.21.15.53:0/319784493 shutdown_connections 2024-09-13T18:33:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- 172.21.15.53:0/319784493 wait complete. 2024-09-13T18:33:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 Processor -- start 2024-09-13T18:33:05.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- start start 2024-09-13T18:33:05.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7006d270 0x7f4a7014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a70156c40 0x7f4a701505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a701f2c30 0x7f4a7014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7014cfd0 con 0x7f4a7006d270 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7014c540 con 0x7f4a701f2c30 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70154b60 con 0x7f4a70156c40 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7006d270 0x7f4a7014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7006d270 0x7f4a7014c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34494/0 (socket says 172.21.15.53:34494) 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 -- 172.21.15.53:0/237586923 learned_addr learned my addr 172.21.15.53:0/237586923 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6e7fc640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a70156c40 0x7f4a701505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6f7fe640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a701f2c30 0x7f4a7014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 -- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a70156c40 msgr2=0x7f4a701505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a70156c40 0x7f4a701505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 -- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a701f2c30 msgr2=0x7f4a7014c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:05.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a701f2c30 0x7f4a7014c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 -- 172.21.15.53:0/237586923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64009420 con 0x7f4a7006d270 2024-09-13T18:33:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a6effd640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7006d270 0x7f4a7014c730 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000d800 tx=0x7f4a6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a577fe640 1 -- 172.21.15.53:0/237586923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000b6c0 con 0x7f4a7006d270 2024-09-13T18:33:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a577fe640 1 -- 172.21.15.53:0/237586923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6000b820 con 0x7f4a7006d270 2024-09-13T18:33:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7014ece0 con 0x7f4a7006d270 2024-09-13T18:33:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a577fe640 1 -- 172.21.15.53:0/237586923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000bb90 con 0x7f4a7006d270 2024-09-13T18:33:05.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.913+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a70154e20 con 0x7f4a7006d270 2024-09-13T18:33:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.917+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a700b1040 con 0x7f4a7006d270 2024-09-13T18:33:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.917+0000 7f4a577fe640 1 -- 172.21.15.53:0/237586923 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f4a6000bcf0 con 0x7f4a7006d270 2024-09-13T18:33:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.917+0000 7f4a577fe640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a5c066cf0 0x7f4a5c0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.917+0000 7f4a577fe640 1 -- 172.21.15.53:0/237586923 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f4a600852a0 con 0x7f4a7006d270 2024-09-13T18:33:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.917+0000 7f4a6e7fc640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a5c066cf0 0x7f4a5c0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:05.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.917+0000 7f4a6e7fc640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a5c066cf0 0x7f4a5c0691b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4a640ad000 tx=0x7f4a64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:05.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:05.921+0000 7f4a577fe640 1 -- 172.21.15.53:0/237586923 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a60051c60 con 0x7f4a7006d270 2024-09-13T18:33:06.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.109+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a700b0d60 con 0x7f4a7006d270 2024-09-13T18:33:06.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.777+0000 7f4a577fe640 1 -- 172.21.15.53:0/237586923 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a60055280 con 0x7f4a7006d270 2024-09-13T18:33:06.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.777+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a5c066cf0 msgr2=0x7f4a5c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a5c066cf0 0x7f4a5c0691b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4a640ad000 tx=0x7f4a64008040 comp rx=0 tx=0).stop 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7006d270 msgr2=0x7f4a7014c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7006d270 0x7f4a7014c730 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000d800 tx=0x7f4a6000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 shutdown_connections 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a5c066cf0 0x7f4a5c0691b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a70156c40 0x7f4a701505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a701f2c30 0x7f4a7014c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 --2- 172.21.15.53:0/237586923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a7006d270 0x7f4a7014c730 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 >> 172.21.15.53:0/237586923 conn(0x7f4a70065c80 msgr2=0x7f4a7015a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 shutdown_connections 2024-09-13T18:33:06.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.781+0000 7f4a754ff640 1 -- 172.21.15.53:0/237586923 wait complete. 2024-09-13T18:33:06.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:33:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b29a1c640 1 Processor -- start 2024-09-13T18:33:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b29a1c640 1 -- start start 2024-09-13T18:33:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b29a1c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b240cd380 0x7f6b240cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b29a1c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6b2406a660 0x7f6b240b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b29a1c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2406b270 con 0x7f6b240cd760 2024-09-13T18:33:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b29a1c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240b1550 con 0x7f6b240cd380 2024-09-13T18:33:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b29a1c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240cf7d0 con 0x7f6b2406a660 2024-09-13T18:33:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b22ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b240cd380 0x7f6b240cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b22ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b240cd380 0x7f6b240cfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54950/0 (socket says 172.21.15.53:54950) 2024-09-13T18:33:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b22ffd640 1 -- 172.21.15.53:0/1967490138 learned_addr learned my addr 172.21.15.53:0/1967490138 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b237fe640 1 --2- 172.21.15.53:0/1967490138 >> v2:172.21.15.87:3300/0 conn(0x7f6b2406a660 0x7f6b240b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b22ffd640 1 -- 172.21.15.53:0/1967490138 >> v2:172.21.15.87:3300/0 conn(0x7f6b2406a660 msgr2=0x7f6b240b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b22ffd640 1 --2- 172.21.15.53:0/1967490138 >> v2:172.21.15.87:3300/0 conn(0x7f6b2406a660 0x7f6b240b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b22ffd640 1 -- 172.21.15.53:0/1967490138 >> v1:172.21.15.87:6789/0 conn(0x7f6b240cd760 legacy=0x7f6b24069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b22ffd640 1 -- 172.21.15.53:0/1967490138 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b240cf5a0 con 0x7f6b240cd380 2024-09-13T18:33:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.977+0000 7f6b237fe640 1 --2- 172.21.15.53:0/1967490138 >> v2:172.21.15.87:3300/0 conn(0x7f6b2406a660 0x7f6b240b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b22ffd640 1 --2- 172.21.15.53:0/1967490138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd380 0x7f6b240cfe90 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f6b240d1510 tx=0x7f6b1401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a89444c69a1407c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b227fc640 1 -- 172.21.15.53:0/1967490138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140ac620 con 0x7f6b240cd380 2024-09-13T18:33:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b227fc640 1 -- 172.21.15.53:0/1967490138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b140ac780 con 0x7f6b240cd380 2024-09-13T18:33:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b227fc640 1 -- 172.21.15.53:0/1967490138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140acb10 con 0x7f6b240cd380 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- 172.21.15.53:0/1967490138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd380 msgr2=0x7f6b240cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/1967490138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd380 0x7f6b240cfe90 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f6b240d1510 tx=0x7f6b1401c3c0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- 172.21.15.53:0/1967490138 shutdown_connections 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/1967490138 >> v2:172.21.15.87:3300/0 conn(0x7f6b2406a660 0x7f6b240b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/1967490138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd380 0x7f6b240cfe90 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- 172.21.15.53:0/1967490138 >> 172.21.15.53:0/1967490138 conn(0x7f6b240b2060 msgr2=0x7f6b240b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- 172.21.15.53:0/1967490138 shutdown_connections 2024-09-13T18:33:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- 172.21.15.53:0/1967490138 wait complete. 2024-09-13T18:33:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 Processor -- start 2024-09-13T18:33:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- start start 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2406a660 0x7f6b24155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b240cd380 0x7f6b241567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd760 0x7f6b240c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240c53c0 con 0x7f6b240cd760 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240c56a0 con 0x7f6b2406a660 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.981+0000 7f6b29a1c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240c5980 con 0x7f6b240cd380 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd760 0x7f6b240c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd760 0x7f6b240c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54966/0 (socket says 172.21.15.53:54966) 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 -- 172.21.15.53:0/2946829506 learned_addr learned my addr 172.21.15.53:0/2946829506 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b22ffd640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2406a660 0x7f6b24155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b1bfff640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b240cd380 0x7f6b241567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 -- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b240cd380 msgr2=0x7f6b241567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b240cd380 0x7f6b241567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 -- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2406a660 msgr2=0x7f6b24155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2406a660 0x7f6b24155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 -- 172.21.15.53:0/2946829506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140094d0 con 0x7f6b240cd760 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b237fe640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd760 0x7f6b240c6740 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00cef0 tx=0x7f6b1c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b20ff9640 1 -- 172.21.15.53:0/2946829506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00d840 con 0x7f6b240cd760 2024-09-13T18:33:06.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b20ff9640 1 -- 172.21.15.53:0/2946829506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00d9c0 con 0x7f6b240cd760 2024-09-13T18:33:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b240c5c60 con 0x7f6b240cd760 2024-09-13T18:33:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b20ff9640 1 -- 172.21.15.53:0/2946829506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00dd70 con 0x7f6b240cd760 2024-09-13T18:33:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b240c6220 con 0x7f6b240cd760 2024-09-13T18:33:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b240c6440 con 0x7f6b240cd760 2024-09-13T18:33:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b20ff9640 1 -- 172.21.15.53:0/2946829506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f6b1c01e3b0 con 0x7f6b240cd760 2024-09-13T18:33:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b20ff9640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b04066cc0 0x7f6b04069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b22ffd640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b04066cc0 0x7f6b04069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b20ff9640 1 -- 172.21.15.53:0/2946829506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f6b1c0858c0 con 0x7f6b240cd760 2024-09-13T18:33:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.985+0000 7f6b22ffd640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b04066cc0 0x7f6b04069180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6b140ae000 tx=0x7f6b14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:06.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:06.989+0000 7f6b20ff9640 1 -- 172.21.15.53:0/2946829506 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b1c0522b0 con 0x7f6b240cd760 2024-09-13T18:33:07.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:07.153+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b240b1300 con 0x7f6b240cd760 2024-09-13T18:33:08.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.061+0000 7f6b20ff9640 1 -- 172.21.15.53:0/2946829506 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v140) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6b1c01a020 con 0x7f6b240cd760 2024-09-13T18:33:08.062 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:33:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b04066cc0 msgr2=0x7f6b04069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b04066cc0 0x7f6b04069180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6b140ae000 tx=0x7f6b14008040 comp rx=0 tx=0).stop 2024-09-13T18:33:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd760 msgr2=0x7f6b240c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd760 0x7f6b240c6740 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00cef0 tx=0x7f6b1c00a710 comp rx=0 tx=0).stop 2024-09-13T18:33:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 shutdown_connections 2024-09-13T18:33:08.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6b04066cc0 0x7f6b04069180 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6b140ae000 tx=0x7f6b14008040 comp rx=0 tx=0).stop 2024-09-13T18:33:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6b240cd380 0x7f6b241567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b240cd760 0x7f6b240c6740 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 --2- 172.21.15.53:0/2946829506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6b2406a660 0x7f6b24155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 >> 172.21.15.53:0/2946829506 conn(0x7f6b240b2060 msgr2=0x7f6b2406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 shutdown_connections 2024-09-13T18:33:08.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.065+0000 7f6b29a1c640 1 -- 172.21.15.53:0/2946829506 wait complete. 2024-09-13T18:33:08.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:33:08.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd426e79640 1 Processor -- start 2024-09-13T18:33:08.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd426e79640 1 -- start start 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd426e79640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4200cd6f0 0x7fd4200b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd426e79640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4200cdad0 0x7fd420143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd426e79640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4200b3020 con 0x7fd420143d50 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd426e79640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4200b1f80 con 0x7fd4200cdad0 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd426e79640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200b2260 con 0x7fd4200cd6f0 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd41ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4200cdad0 0x7fd420143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd425416640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd420143d50 0x7fd42015dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44438/0 (socket says 172.21.15.53:44438) 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd425416640 1 -- 172.21.15.53:0/3877919546 learned_addr learned my addr 172.21.15.53:0/3877919546 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd424c15640 1 --2- 172.21.15.53:0/3877919546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4200cd6f0 0x7fd4200b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd41ffff640 1 -- 172.21.15.53:0/3877919546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4200cd6f0 msgr2=0x7fd4200b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd41ffff640 1 --2- 172.21.15.53:0/3877919546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4200cd6f0 0x7fd4200b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd41ffff640 1 -- 172.21.15.53:0/3877919546 >> v1:172.21.15.53:6789/0 conn(0x7fd420143d50 legacy=0x7fd42015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd41f7fe640 1 -- 172.21.15.53:0/3877919546 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799830014 0 0) 0x7fd4200b3020 con 0x7fd420143d50 2024-09-13T18:33:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.213+0000 7fd41ffff640 1 -- 172.21.15.53:0/3877919546 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200b2540 con 0x7fd4200cdad0 2024-09-13T18:33:08.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd41ffff640 1 --2- 172.21.15.53:0/3877919546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cdad0 0x7fd420143810 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fd4140097c0 tx=0x7fd41401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa80ff654c134c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd41f7fe640 1 -- 172.21.15.53:0/3877919546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140ad640 con 0x7fd4200cdad0 2024-09-13T18:33:08.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd41f7fe640 1 -- 172.21.15.53:0/3877919546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140ad7a0 con 0x7fd4200cdad0 2024-09-13T18:33:08.218 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd41f7fe640 1 -- 172.21.15.53:0/3877919546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140adb30 con 0x7fd4200cdad0 2024-09-13T18:33:08.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 -- 172.21.15.53:0/3877919546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cdad0 msgr2=0x7fd420143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 --2- 172.21.15.53:0/3877919546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cdad0 0x7fd420143810 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fd4140097c0 tx=0x7fd41401c470 comp rx=0 tx=0).stop 2024-09-13T18:33:08.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 -- 172.21.15.53:0/3877919546 shutdown_connections 2024-09-13T18:33:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 --2- 172.21.15.53:0/3877919546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cdad0 0x7fd420143810 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 --2- 172.21.15.53:0/3877919546 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4200cd6f0 0x7fd4200b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 -- 172.21.15.53:0/3877919546 >> 172.21.15.53:0/3877919546 conn(0x7fd420073330 msgr2=0x7fd420065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 -- 172.21.15.53:0/3877919546 shutdown_connections 2024-09-13T18:33:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 -- 172.21.15.53:0/3877919546 wait complete. 2024-09-13T18:33:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 Processor -- start 2024-09-13T18:33:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.217+0000 7fd426e79640 1 -- start start 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cd6f0 0x7fd42015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4200cdad0 0x7fd420140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd420143d50 0x7fd420141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200afed0 con 0x7fd4200cd6f0 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015dbe0 con 0x7fd4200cdad0 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd420162550 con 0x7fd420143d50 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cd6f0 0x7fd42015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cd6f0 0x7fd42015d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54986/0 (socket says 172.21.15.53:54986) 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 -- 172.21.15.53:0/1958637848 learned_addr learned my addr 172.21.15.53:0/1958637848 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd425416640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd420143d50 0x7fd420141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 -- 172.21.15.53:0/1958637848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd420143d50 msgr2=0x7fd420141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd420143d50 0x7fd420141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 -- 172.21.15.53:0/1958637848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4200cdad0 msgr2=0x7fd420140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4200cdad0 0x7fd420140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 -- 172.21.15.53:0/1958637848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414009420 con 0x7fd4200cd6f0 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd424c15640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cd6f0 0x7fd42015d6a0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d5f0 tx=0x7fd41000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd41d7fa640 1 -- 172.21.15.53:0/1958637848 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100125f0 con 0x7fd4200cd6f0 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd41d7fa640 1 -- 172.21.15.53:0/1958637848 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410012750 con 0x7fd4200cd6f0 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd41d7fa640 1 -- 172.21.15.53:0/1958637848 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410012ae0 con 0x7fd4200cd6f0 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4201610d0 con 0x7fd4200cd6f0 2024-09-13T18:33:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd420160830 con 0x7fd4200cd6f0 2024-09-13T18:33:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4200b1490 con 0x7fd4200cd6f0 2024-09-13T18:33:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd41d7fa640 1 -- 172.21.15.53:0/1958637848 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fd410012c40 con 0x7fd4200cd6f0 2024-09-13T18:33:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd41d7fa640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd40c066cc0 0x7fd40c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd41d7fa640 1 -- 172.21.15.53:0/1958637848 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5386+0+0 (secure 0 0 0) 0x7fd410085080 con 0x7fd4200cd6f0 2024-09-13T18:33:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.221+0000 7fd41ffff640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd40c066cc0 0x7fd40c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.225+0000 7fd41ffff640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd40c066cc0 0x7fd40c069180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd4140af000 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:08.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.225+0000 7fd41d7fa640 1 -- 172.21.15.53:0/1958637848 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd410051bf0 con 0x7fd4200cd6f0 2024-09-13T18:33:08.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:08.389+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4200ad5b0 con 0x7fd4200cd6f0 2024-09-13T18:33:09.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.061+0000 7fd41d7fa640 1 -- 172.21.15.53:0/1958637848 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v141) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd410055210 con 0x7fd4200cd6f0 2024-09-13T18:33:09.064 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:33:09.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd40c066cc0 msgr2=0x7fd40c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd40c066cc0 0x7fd40c069180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd4140af000 tx=0x7fd414008040 comp rx=0 tx=0).stop 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cd6f0 msgr2=0x7fd42015d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cd6f0 0x7fd42015d6a0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d5f0 tx=0x7fd41000dab0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 shutdown_connections 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd40c066cc0 0x7fd40c069180 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd420143d50 0x7fd420141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4200cdad0 0x7fd420140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 --2- 172.21.15.53:0/1958637848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4200cd6f0 0x7fd42015d6a0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.065+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 >> 172.21.15.53:0/1958637848 conn(0x7fd420073330 msgr2=0x7fd42015dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.069+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 shutdown_connections 2024-09-13T18:33:09.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.069+0000 7fd426e79640 1 -- 172.21.15.53:0/1958637848 wait complete. 2024-09-13T18:33:09.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.217+0000 7fc5e0d94640 1 Processor -- start 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.217+0000 7fc5e0d94640 1 -- start start 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5dc156c40 0x7fc5dc070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc157020 0x7fc5dc06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc06d6e0 con 0x7fc5dc06d270 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc070340 con 0x7fc5dc156c40 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0b15a0 con 0x7fc5dc157020 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5dc156c40 0x7fc5dc070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5dc156c40 0x7fc5dc070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54992/0 (socket says 172.21.15.53:54992) 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 -- 172.21.15.53:0/274053823 learned_addr learned my addr 172.21.15.53:0/274053823 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5d3fff640 1 --2- 172.21.15.53:0/274053823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc157020 0x7fc5dc06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 -- 172.21.15.53:0/274053823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc157020 msgr2=0x7fc5dc06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 --2- 172.21.15.53:0/274053823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc157020 0x7fc5dc06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 -- 172.21.15.53:0/274053823 >> v1:172.21.15.87:6789/0 conn(0x7fc5dc06d270 legacy=0x7fc5dc15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 -- 172.21.15.53:0/274053823 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0b1880 con 0x7fc5dc156c40 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5d3fff640 1 --2- 172.21.15.53:0/274053823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc157020 0x7fc5dc06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5da59c640 1 --2- 172.21.15.53:0/274053823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc156c40 0x7fc5dc070ee0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00bb10 tx=0x7fc5cc01ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ab743b0e0a1cce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5d9d9b640 1 -- 172.21.15.53:0/274053823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0a7b70 con 0x7fc5dc156c40 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5d9d9b640 1 -- 172.21.15.53:0/274053823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc0a7cd0 con 0x7fc5dc156c40 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5d9d9b640 1 -- 172.21.15.53:0/274053823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0af660 con 0x7fc5dc156c40 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 -- 172.21.15.53:0/274053823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc156c40 msgr2=0x7fc5dc070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/274053823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc156c40 0x7fc5dc070ee0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00bb10 tx=0x7fc5cc01ebc0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.221+0000 7fc5e0d94640 1 -- 172.21.15.53:0/274053823 shutdown_connections 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/274053823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc157020 0x7fc5dc06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/274053823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc156c40 0x7fc5dc070ee0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- 172.21.15.53:0/274053823 >> 172.21.15.53:0/274053823 conn(0x7fc5dc065c80 msgr2=0x7fc5dc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- 172.21.15.53:0/274053823 shutdown_connections 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- 172.21.15.53:0/274053823 wait complete. 2024-09-13T18:33:09.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 Processor -- start 2024-09-13T18:33:09.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- start start 2024-09-13T18:33:09.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc06d270 0x7fc5dc15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc156c40 0x7fc5dc142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0af210 0x7fc5dc159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc15c920 con 0x7fc5dc06d270 2024-09-13T18:33:09.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc15b020 con 0x7fc5dc0af210 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc151c70 con 0x7fc5dc156c40 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc06d270 0x7fc5dc15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc06d270 0x7fc5dc15a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55008/0 (socket says 172.21.15.53:55008) 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 -- 172.21.15.53:0/1440193566 learned_addr learned my addr 172.21.15.53:0/1440193566 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5d3fff640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc156c40 0x7fc5dc142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5dad9d640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0af210 0x7fc5dc159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 -- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc156c40 msgr2=0x7fc5dc142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc156c40 0x7fc5dc142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 -- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0af210 msgr2=0x7fc5dc159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0af210 0x7fc5dc159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 -- 172.21.15.53:0/1440193566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc00b770 con 0x7fc5dc06d270 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5da59c640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc06d270 0x7fc5dc15a990 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00b2c0 tx=0x7fc5cc01d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5d2ffd640 1 -- 172.21.15.53:0/1440193566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0a7b70 con 0x7fc5dc06d270 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5d2ffd640 1 -- 172.21.15.53:0/1440193566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc0ba480 con 0x7fc5dc06d270 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc151f50 con 0x7fc5dc06d270 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5d2ffd640 1 -- 172.21.15.53:0/1440193566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0ba850 con 0x7fc5dc06d270 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.225+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc152510 con 0x7fc5dc06d270 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.229+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc15cde0 con 0x7fc5dc06d270 2024-09-13T18:33:09.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.229+0000 7fc5d2ffd640 1 -- 172.21.15.53:0/1440193566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fc5cc0ba9b0 con 0x7fc5dc06d270 2024-09-13T18:33:09.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.229+0000 7fc5d2ffd640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5bc066cf0 0x7fc5bc0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.229+0000 7fc5d2ffd640 1 -- 172.21.15.53:0/1440193566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc5cc0a7e40 con 0x7fc5dc06d270 2024-09-13T18:33:09.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.229+0000 7fc5d3fff640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5bc066cf0 0x7fc5bc0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.229+0000 7fc5d3fff640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5bc066cf0 0x7fc5bc0691b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4006fd0 tx=0x7fc5c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.233+0000 7fc5d2ffd640 1 -- 172.21.15.53:0/1440193566 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5cc0ece50 con 0x7fc5dc06d270 2024-09-13T18:33:09.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.405+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc5dc15cde0 con 0x7fc5dc06d270 2024-09-13T18:33:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5d2ffd640 1 -- 172.21.15.53:0/1440193566 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc5cc0b40a0 con 0x7fc5dc06d270 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5bc066cf0 msgr2=0x7fc5bc0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5bc066cf0 0x7fc5bc0691b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4006fd0 tx=0x7fc5c4008040 comp rx=0 tx=0).stop 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc06d270 msgr2=0x7fc5dc15a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc06d270 0x7fc5dc15a990 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00b2c0 tx=0x7fc5cc01d400 comp rx=0 tx=0).stop 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 shutdown_connections 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5bc066cf0 0x7fc5bc0691b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5dc156c40 0x7fc5dc142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5dc0af210 0x7fc5dc159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 --2- 172.21.15.53:0/1440193566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5dc06d270 0x7fc5dc15a990 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 >> 172.21.15.53:0/1440193566 conn(0x7fc5dc065c80 msgr2=0x7fc5dc1465b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 shutdown_connections 2024-09-13T18:33:09.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.413+0000 7fc5e0d94640 1 -- 172.21.15.53:0/1440193566 wait complete. 2024-09-13T18:33:09.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-13T18:33:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f345daf8640 1 Processor -- start 2024-09-13T18:33:09.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f345daf8640 1 -- start start 2024-09-13T18:33:09.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f345daf8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f345815cab0 0x7f34580d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f345daf8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f34580cd6c0 0x7f34580cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f345daf8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580d2400 con 0x7f34580cdb30 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f345daf8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34580d1530 con 0x7f345815cab0 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f345daf8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34580d0920 con 0x7f34580cd6c0 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f34577fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f345815cab0 0x7f34580d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f34577fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f345815cab0 0x7f34580d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55014/0 (socket says 172.21.15.53:55014) 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f34577fe640 1 -- 172.21.15.53:0/3795759695 learned_addr learned my addr 172.21.15.53:0/3795759695 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f3456ffd640 1 --2- 172.21.15.53:0/3795759695 >> v2:172.21.15.87:3300/0 conn(0x7f34580cd6c0 0x7f34580cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f34577fe640 1 -- 172.21.15.53:0/3795759695 >> v2:172.21.15.87:3300/0 conn(0x7f34580cd6c0 msgr2=0x7f34580cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f34577fe640 1 --2- 172.21.15.53:0/3795759695 >> v2:172.21.15.87:3300/0 conn(0x7f34580cd6c0 0x7f34580cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f34577fe640 1 -- 172.21.15.53:0/3795759695 >> v1:172.21.15.87:6789/0 conn(0x7f34580cdb30 legacy=0x7f34580b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.557+0000 7f34577fe640 1 -- 172.21.15.53:0/3795759695 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34580d0c00 con 0x7f345815cab0 2024-09-13T18:33:09.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f34577fe640 1 --2- 172.21.15.53:0/3795759695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f34580d19c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f34580b20e0 tx=0x7f344801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8fedf6326259eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f34567fc640 1 -- 172.21.15.53:0/3795759695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34480ac620 con 0x7f345815cab0 2024-09-13T18:33:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f34567fc640 1 -- 172.21.15.53:0/3795759695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34480ac780 con 0x7f345815cab0 2024-09-13T18:33:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f34567fc640 1 -- 172.21.15.53:0/3795759695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34480acb10 con 0x7f345815cab0 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 -- 172.21.15.53:0/3795759695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 msgr2=0x7f34580d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 --2- 172.21.15.53:0/3795759695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f34580d19c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f34580b20e0 tx=0x7f344801c4b0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 -- 172.21.15.53:0/3795759695 shutdown_connections 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 --2- 172.21.15.53:0/3795759695 >> v2:172.21.15.87:3300/0 conn(0x7f34580cd6c0 0x7f34580cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 --2- 172.21.15.53:0/3795759695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f34580d19c0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 -- 172.21.15.53:0/3795759695 >> 172.21.15.53:0/3795759695 conn(0x7f3458065c80 msgr2=0x7f3458066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 -- 172.21.15.53:0/3795759695 shutdown_connections 2024-09-13T18:33:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.561+0000 7f345daf8640 1 -- 172.21.15.53:0/3795759695 wait complete. 2024-09-13T18:33:09.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 Processor -- start 2024-09-13T18:33:09.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 -- start start 2024-09-13T18:33:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34580cd6c0 0x7f3458157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34580cdb30 0x7f34581f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f3458159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580ca2c0 con 0x7f345815cab0 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3458159330 con 0x7f34580cd6c0 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34581f62a0 con 0x7f34580cdb30 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f3458159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f3458159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55020/0 (socket says 172.21.15.53:55020) 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 -- 172.21.15.53:0/629158529 learned_addr learned my addr 172.21.15.53:0/629158529 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3456ffd640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34580cdb30 0x7f34581f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f34577fe640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34580cd6c0 0x7f3458157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 -- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34580cdb30 msgr2=0x7f34581f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34580cdb30 0x7f34581f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 -- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34580cd6c0 msgr2=0x7f3458157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34580cd6c0 0x7f3458157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 -- 172.21.15.53:0/629158529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480094d0 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f3457fff640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f3458159830 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f345000b9e0 tx=0x7f345000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f343ffff640 1 -- 172.21.15.53:0/629158529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450003b80 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f343ffff640 1 -- 172.21.15.53:0/629158529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450003ce0 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34580c9920 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f343ffff640 1 -- 172.21.15.53:0/629158529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345000cb60 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34580c9ee0 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34580cf0c0 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.565+0000 7f343ffff640 1 -- 172.21.15.53:0/629158529 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f345000ccc0 con 0x7f345815cab0 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.569+0000 7f343ffff640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3444066cc0 0x7f3444069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.569+0000 7f343ffff640 1 -- 172.21.15.53:0/629158529 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3450084600 con 0x7f345815cab0 2024-09-13T18:33:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.569+0000 7f34577fe640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3444066cc0 0x7f3444069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.569+0000 7f34577fe640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3444066cc0 0x7f3444069180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f34480ae000 tx=0x7f34480a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.573+0000 7f343ffff640 1 -- 172.21.15.53:0/629158529 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3450051470 con 0x7f345815cab0 2024-09-13T18:33:09.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:09.789+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) v1 -- 0x7f345815bec0 con 0x7f345815cab0 2024-09-13T18:33:10.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.073+0000 7f343ffff640 1 -- 172.21.15.53:0/629158529 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v446) v1 ==== 151+0+0 (secure 0 0 0) 0x7f3450054a90 con 0x7f345815cab0 2024-09-13T18:33:10.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3444066cc0 msgr2=0x7f3444069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3444066cc0 0x7f3444069180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f34480ae000 tx=0x7f34480a7000 comp rx=0 tx=0).stop 2024-09-13T18:33:10.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 msgr2=0x7f3458159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f3458159830 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f345000b9e0 tx=0x7f345000bea0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 shutdown_connections 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3444066cc0 0x7f3444069180 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34580cdb30 0x7f34581f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f345815cab0 0x7f3458159830 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 --2- 172.21.15.53:0/629158529 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34580cd6c0 0x7f3458157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 >> 172.21.15.53:0/629158529 conn(0x7f3458065c80 msgr2=0x7f3458155320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 shutdown_connections 2024-09-13T18:33:10.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.077+0000 7f345daf8640 1 -- 172.21.15.53:0/629158529 wait complete. 2024-09-13T18:33:10.100 INFO:tasks.cephfs_test_runner:test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-13T18:33:10.101 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- rather than going through a full upgrade cycle, 2024-09-13T18:33:10.101 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:33:10.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:10.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f4886123640 1 Processor -- start 2024-09-13T18:33:10.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f4886123640 1 -- start start 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f4886123640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f488015a470 0x7f48800cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f4886123640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015cc60 0x7f4880071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f4886123640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488006f550 con 0x7f48800b1c10 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f4886123640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488006f880 con 0x7f488015a470 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f4886123640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488015dc40 con 0x7f488015cc60 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f48800b1c10 0x7f488006fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44452/0 (socket says 172.21.15.53:44452) 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487ffff640 1 -- 172.21.15.53:0/354373668 learned_addr learned my addr 172.21.15.53:0/354373668 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487effd640 1 --2- 172.21.15.53:0/354373668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015cc60 0x7f4880071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487f7fe640 1 --2- 172.21.15.53:0/354373668 >> v2:172.21.15.87:3300/0 conn(0x7f488015a470 0x7f48800cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487e7fc640 1 -- 172.21.15.53:0/354373668 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130631758 0 0) 0x7f488006f550 con 0x7f48800b1c10 2024-09-13T18:33:10.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487e7fc640 1 -- 172.21.15.53:0/354373668 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4868003530 con 0x7f48800b1c10 2024-09-13T18:33:10.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487effd640 1 -- 172.21.15.53:0/354373668 >> v2:172.21.15.87:3300/0 conn(0x7f488015a470 msgr2=0x7f48800cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:10.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487effd640 1 --2- 172.21.15.53:0/354373668 >> v2:172.21.15.87:3300/0 conn(0x7f488015a470 0x7f48800cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487effd640 1 -- 172.21.15.53:0/354373668 >> v1:172.21.15.53:6789/0 conn(0x7f48800b1c10 legacy=0x7f488006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.229+0000 7f487effd640 1 -- 172.21.15.53:0/354373668 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800715a0 con 0x7f488015cc60 2024-09-13T18:33:10.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f487effd640 1 --2- 172.21.15.53:0/354373668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015cc60 0x7f4880071060 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48740097c0 tx=0x7f487401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5550e0730c74ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f487e7fc640 1 -- 172.21.15.53:0/354373668 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740a6040 con 0x7f488015cc60 2024-09-13T18:33:10.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f487e7fc640 1 -- 172.21.15.53:0/354373668 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740aa600 con 0x7f488015cc60 2024-09-13T18:33:10.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f487e7fc640 1 -- 172.21.15.53:0/354373668 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740aa990 con 0x7f488015cc60 2024-09-13T18:33:10.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 -- 172.21.15.53:0/354373668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015cc60 msgr2=0x7f4880071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 --2- 172.21.15.53:0/354373668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015cc60 0x7f4880071060 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48740097c0 tx=0x7f487401c4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 -- 172.21.15.53:0/354373668 shutdown_connections 2024-09-13T18:33:10.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 --2- 172.21.15.53:0/354373668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015cc60 0x7f4880071060 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 --2- 172.21.15.53:0/354373668 >> v2:172.21.15.87:3300/0 conn(0x7f488015a470 0x7f48800cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 -- 172.21.15.53:0/354373668 >> 172.21.15.53:0/354373668 conn(0x7f4880065c80 msgr2=0x7f4880066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:10.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 -- 172.21.15.53:0/354373668 shutdown_connections 2024-09-13T18:33:10.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 -- 172.21.15.53:0/354373668 wait complete. 2024-09-13T18:33:10.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 Processor -- start 2024-09-13T18:33:10.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.233+0000 7f4886123640 1 -- start start 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48800b1c10 0x7f4880158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015a470 0x7f488015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f488015cc60 0x7f488015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4880152be0 con 0x7f488015cc60 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4880151fd0 con 0x7f48800b1c10 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48801522b0 con 0x7f488015a470 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f488015cc60 0x7f488015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f488015cc60 0x7f488015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55036/0 (socket says 172.21.15.53:55036) 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 -- 172.21.15.53:0/1965750302 learned_addr learned my addr 172.21.15.53:0/1965750302 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:10.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487f7fe640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48800b1c10 0x7f4880158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487effd640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015a470 0x7f488015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 -- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015a470 msgr2=0x7f488015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015a470 0x7f488015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 -- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48800b1c10 msgr2=0x7f4880158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48800b1c10 0x7f4880158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 -- 172.21.15.53:0/1965750302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009420 con 0x7f488015cc60 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f487ffff640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f488015cc60 0x7f488015b200 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f487800cb40 tx=0x7f487800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4867fff640 1 -- 172.21.15.53:0/1965750302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487800aca0 con 0x7f488015cc60 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4867fff640 1 -- 172.21.15.53:0/1965750302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487800ae00 con 0x7f488015cc60 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4880152590 con 0x7f488015cc60 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4867fff640 1 -- 172.21.15.53:0/1965750302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878012620 con 0x7f488015cc60 2024-09-13T18:33:10.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4880151c60 con 0x7f488015cc60 2024-09-13T18:33:10.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4880067400 con 0x7f488015cc60 2024-09-13T18:33:10.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.237+0000 7f4867fff640 1 -- 172.21.15.53:0/1965750302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f4878007070 con 0x7f488015cc60 2024-09-13T18:33:10.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.241+0000 7f4867fff640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f486c066cc0 0x7f486c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.241+0000 7f4867fff640 1 -- 172.21.15.53:0/1965750302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4878084e70 con 0x7f488015cc60 2024-09-13T18:33:10.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.241+0000 7f487f7fe640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f486c066cc0 0x7f486c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.241+0000 7f487f7fe640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f486c066cc0 0x7f486c069180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4870009af0 tx=0x7f4870008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.245+0000 7f4867fff640 1 -- 172.21.15.53:0/1965750302 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4878051c20 con 0x7f488015cc60 2024-09-13T18:33:10.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.397+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f488015a9e0 con 0x7f488015cc60 2024-09-13T18:33:10.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4867fff640 1 -- 172.21.15.53:0/1965750302 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+12934 (secure 0 0 0) 0x7f488015a9e0 con 0x7f488015cc60 2024-09-13T18:33:10.402 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:10.402 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":141,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:09.057414+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/275376653":"2024-09-14T18:33:05.759479+0000","172.21.15.53:6834/275376653":"2024-09-14T18:33:05.759479+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f486c066cc0 msgr2=0x7f486c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f486c066cc0 0x7f486c069180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4870009af0 tx=0x7f4870008040 comp rx=0 tx=0).stop 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f488015cc60 msgr2=0x7f488015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f488015cc60 0x7f488015b200 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f487800cb40 tx=0x7f487800a060 comp rx=0 tx=0).stop 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 shutdown_connections 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f486c066cc0 0x7f486c069180 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f488015a470 0x7f488015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f488015cc60 0x7f488015b200 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 --2- 172.21.15.53:0/1965750302 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48800b1c10 0x7f4880158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 >> 172.21.15.53:0/1965750302 conn(0x7f4880065c80 msgr2=0x7f48800ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 shutdown_connections 2024-09-13T18:33:10.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.401+0000 7f4886123640 1 -- 172.21.15.53:0/1965750302 wait complete. 2024-09-13T18:33:10.421 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:10.421 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba4adf7640 1 Processor -- start 2024-09-13T18:33:10.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba4adf7640 1 -- start start 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba4adf7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440ccf10 0x7fba440cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba4adf7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba440b2bf0 0x7fba440cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba4adf7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440ccd60 con 0x7fba440ced50 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba4adf7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba440cd830 con 0x7fba440b2bf0 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba4adf7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba440cc190 con 0x7fba440ccf10 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba440b2bf0 0x7fba440cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba440b2bf0 0x7fba440cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55048/0 (socket says 172.21.15.53:55048) 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 -- 172.21.15.53:0/3723080519 learned_addr learned my addr 172.21.15.53:0/3723080519 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba48b93640 1 --2- 172.21.15.53:0/3723080519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440ccf10 0x7fba440cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 -- 172.21.15.53:0/3723080519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440ccf10 msgr2=0x7fba440cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 --2- 172.21.15.53:0/3723080519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440ccf10 0x7fba440cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 -- 172.21.15.53:0/3723080519 >> v1:172.21.15.87:6789/0 conn(0x7fba440ced50 legacy=0x7fba440b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 -- 172.21.15.53:0/3723080519 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440ce270 con 0x7fba440b2bf0 2024-09-13T18:33:10.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba48b93640 1 --2- 172.21.15.53:0/3723080519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440ccf10 0x7fba440cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:10.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.541+0000 7fba43fff640 1 --2- 172.21.15.53:0/3723080519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440b2bf0 0x7fba440cd2f0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009870 tx=0x7fba2c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc9d016a1d5c21c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba437fe640 1 -- 172.21.15.53:0/3723080519 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0ab620 con 0x7fba440b2bf0 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba437fe640 1 -- 172.21.15.53:0/3723080519 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c0ab780 con 0x7fba440b2bf0 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba437fe640 1 -- 172.21.15.53:0/3723080519 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0abb10 con 0x7fba440b2bf0 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- 172.21.15.53:0/3723080519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440b2bf0 msgr2=0x7fba440cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3723080519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440b2bf0 0x7fba440cd2f0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009870 tx=0x7fba2c01c460 comp rx=0 tx=0).stop 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- 172.21.15.53:0/3723080519 shutdown_connections 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3723080519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440b2bf0 0x7fba440cd2f0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3723080519 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440ccf10 0x7fba440cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- 172.21.15.53:0/3723080519 >> 172.21.15.53:0/3723080519 conn(0x7fba440b20d0 msgr2=0x7fba440b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:10.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- 172.21.15.53:0/3723080519 shutdown_connections 2024-09-13T18:33:10.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- 172.21.15.53:0/3723080519 wait complete. 2024-09-13T18:33:10.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 Processor -- start 2024-09-13T18:33:10.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- start start 2024-09-13T18:33:10.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440b2bf0 0x7fba4415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440ccf10 0x7fba44159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba440ced50 0x7fba44069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4406b2b0 con 0x7fba440ccf10 2024-09-13T18:33:10.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4415bcc0 con 0x7fba440ced50 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba4adf7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4415bfa0 con 0x7fba440b2bf0 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440ccf10 0x7fba44159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440ccf10 0x7fba44159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55062/0 (socket says 172.21.15.53:55062) 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 -- 172.21.15.53:0/3828891825 learned_addr learned my addr 172.21.15.53:0/3828891825 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba49394640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba440ced50 0x7fba44069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba48b93640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440b2bf0 0x7fba4415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 -- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440b2bf0 msgr2=0x7fba4415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440b2bf0 0x7fba4415b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 -- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba440ced50 msgr2=0x7fba44069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba440ced50 0x7fba44069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 -- 172.21.15.53:0/3828891825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0094d0 con 0x7fba440ccf10 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba48b93640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440b2bf0 0x7fba4415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba43fff640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440ccf10 0x7fba44159000 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01ab10 tx=0x7fba2c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.545+0000 7fba417fa640 1 -- 172.21.15.53:0/3828891825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0be3f0 con 0x7fba440ccf10 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba417fa640 1 -- 172.21.15.53:0/3828891825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c0be570 con 0x7fba440ccf10 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba417fa640 1 -- 172.21.15.53:0/3828891825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0be920 con 0x7fba440ccf10 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4415c280 con 0x7fba440ccf10 2024-09-13T18:33:10.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4415c840 con 0x7fba440ccf10 2024-09-13T18:33:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4415ca30 con 0x7fba440ccf10 2024-09-13T18:33:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba417fa640 1 -- 172.21.15.53:0/3828891825 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fba2c0b43f0 con 0x7fba440ccf10 2024-09-13T18:33:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba417fa640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba24066cc0 0x7fba24069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba48b93640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba24066cc0 0x7fba24069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba417fa640 1 -- 172.21.15.53:0/3828891825 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba2c11f1d0 con 0x7fba440ccf10 2024-09-13T18:33:10.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.549+0000 7fba48b93640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba24066cc0 0x7fba24069180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fba440b5e70 tx=0x7fba34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.553+0000 7fba417fa640 1 -- 172.21.15.53:0/3828891825 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba2c0ebea0 con 0x7fba440ccf10 2024-09-13T18:33:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.713+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba440cd2f0 con 0x7fba440ccf10 2024-09-13T18:33:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.713+0000 7fba417fa640 1 -- 172.21.15.53:0/3828891825 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba2c0ef4c0 con 0x7fba440ccf10 2024-09-13T18:33:10.716 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba24066cc0 msgr2=0x7fba24069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba24066cc0 0x7fba24069180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fba440b5e70 tx=0x7fba34008040 comp rx=0 tx=0).stop 2024-09-13T18:33:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440ccf10 msgr2=0x7fba44159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440ccf10 0x7fba44159000 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01ab10 tx=0x7fba2c01aca0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 shutdown_connections 2024-09-13T18:33:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fba24066cc0 0x7fba24069180 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba440ced50 0x7fba44069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba440ccf10 0x7fba44159000 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 --2- 172.21.15.53:0/3828891825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba440b2bf0 0x7fba4415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 >> 172.21.15.53:0/3828891825 conn(0x7fba440b20d0 msgr2=0x7fba4406edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 shutdown_connections 2024-09-13T18:33:10.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.717+0000 7fba4adf7640 1 -- 172.21.15.53:0/3828891825 wait complete. 2024-09-13T18:33:10.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-13T18:33:10.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe47539c640 1 Processor -- start 2024-09-13T18:33:10.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe47539c640 1 -- start start 2024-09-13T18:33:10.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe47539c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe47015b7c0 0x7fe470070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe47539c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47006d480 con 0x7fe4700711d0 2024-09-13T18:33:10.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe47539c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47015ace0 con 0x7fe4701582a0 2024-09-13T18:33:10.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe47539c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe470071680 con 0x7fe47015b7c0 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe4700711d0 0x7fe4701640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44458/0 (socket says 172.21.15.53:44458) 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46f7fe640 1 -- 172.21.15.53:0/1833231587 learned_addr learned my addr 172.21.15.53:0/1833231587 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe467fff640 1 --2- 172.21.15.53:0/1833231587 >> v2:172.21.15.87:3300/0 conn(0x7fe47015b7c0 0x7fe470070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767761130 0 0) 0x7fe47006d480 con 0x7fe4700711d0 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe45c003530 con 0x7fe4700711d0 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15067321 0 0) 0x7fe45c003530 con 0x7fe4700711d0 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 >> v2:172.21.15.87:3300/0 conn(0x7fe47015b7c0 msgr2=0x7fe470070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 --2- 172.21.15.53:0/1833231587 >> v2:172.21.15.87:3300/0 conn(0x7fe47015b7c0 0x7fe470070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 >> v1:172.21.15.87:6789/0 conn(0x7fe4701582a0 legacy=0x7fe47006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47015afc0 con 0x7fe4700711d0 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe468001a00 con 0x7fe4700711d0 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 >> v1:172.21.15.53:6789/0 conn(0x7fe4700711d0 legacy=0x7fe4701640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c003980 0x7fe45c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0047d0 0x7fe45c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c005190 0x7fe45c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe470071680 con 0x7fe45c0047d0 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c00c030 con 0x7fe45c003980 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c00c1f0 con 0x7fe45c005190 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe467fff640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0047d0 0x7fe45c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46effd640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c003980 0x7fe45c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46f7fe640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c005190 0x7fe45c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe467fff640 1 -- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c005190 msgr2=0x7fe45c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe467fff640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c005190 0x7fe45c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe467fff640 1 -- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c003980 msgr2=0x7fe45c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe467fff640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe45c003980 0x7fe45c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe467fff640 1 -- 172.21.15.53:0/1833231587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c003530 con 0x7fe45c0047d0 2024-09-13T18:33:10.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.857+0000 7fe46f7fe640 1 -- 172.21.15.53:0/1833231587 reap_dead start 2024-09-13T18:33:10.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe467fff640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0047d0 0x7fe45c004c50 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe458009ae0 tx=0x7fe45801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e234f2347b429ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580a5570 con 0x7fe45c0047d0 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4580a56d0 con 0x7fe45c0047d0 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe46e7fc640 1 -- 172.21.15.53:0/1833231587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580a5a80 con 0x7fe45c0047d0 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 -- 172.21.15.53:0/1833231587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0047d0 msgr2=0x7fe45c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0047d0 0x7fe45c004c50 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe458009ae0 tx=0x7fe45801ca90 comp rx=0 tx=0).stop 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 -- 172.21.15.53:0/1833231587 shutdown_connections 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 --2- 172.21.15.53:0/1833231587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45c0047d0 0x7fe45c004c50 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 -- 172.21.15.53:0/1833231587 >> 172.21.15.53:0/1833231587 conn(0x7fe470065c80 msgr2=0x7fe470066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 -- 172.21.15.53:0/1833231587 shutdown_connections 2024-09-13T18:33:10.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 -- 172.21.15.53:0/1833231587 wait complete. 2024-09-13T18:33:10.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 Processor -- start 2024-09-13T18:33:10.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.861+0000 7fe47539c640 1 -- start start 2024-09-13T18:33:10.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c0047d0 0x7fe470148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4701542e0 0x7fe4700acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe470159c90 0x7fe4700cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4701597e0 con 0x7fe470159c90 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700b2f00 con 0x7fe4701542e0 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700b31a0 con 0x7fe45c0047d0 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe470159c90 0x7fe4700cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe470159c90 0x7fe4700cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55076/0 (socket says 172.21.15.53:55076) 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 -- 172.21.15.53:0/3525284564 learned_addr learned my addr 172.21.15.53:0/3525284564 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe467fff640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4701542e0 0x7fe4700acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46effd640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c0047d0 0x7fe470148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 -- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c0047d0 msgr2=0x7fe470148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c0047d0 0x7fe470148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 -- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4701542e0 msgr2=0x7fe4700acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4701542e0 0x7fe4700acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 -- 172.21.15.53:0/3525284564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700b3480 con 0x7fe470159c90 2024-09-13T18:33:10.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46effd640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c0047d0 0x7fe470148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:10.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46f7fe640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe470159c90 0x7fe4700cc270 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fe47006bdd0 tx=0x7fe468011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe4677fe640 1 -- 172.21.15.53:0/3525284564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800f8a0 con 0x7fe470159c90 2024-09-13T18:33:10.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe4677fe640 1 -- 172.21.15.53:0/3525284564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46800fa40 con 0x7fe470159c90 2024-09-13T18:33:10.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700b2b30 con 0x7fe470159c90 2024-09-13T18:33:10.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe4677fe640 1 -- 172.21.15.53:0/3525284564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800fdf0 con 0x7fe470159c90 2024-09-13T18:33:10.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47015a120 con 0x7fe470159c90 2024-09-13T18:33:10.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe470067400 con 0x7fe470159c90 2024-09-13T18:33:10.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe4677fe640 1 -- 172.21.15.53:0/3525284564 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fe46801f460 con 0x7fe470159c90 2024-09-13T18:33:10.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe4677fe640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe450066cc0 0x7fe450069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:10.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe4677fe640 1 -- 172.21.15.53:0/3525284564 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe468088280 con 0x7fe470159c90 2024-09-13T18:33:10.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46effd640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe450066cc0 0x7fe450069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:10.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.865+0000 7fe46effd640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe450066cc0 0x7fe450069180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe460000c10 tx=0x7fe460009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:10.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:10.869+0000 7fe4677fe640 1 -- 172.21.15.53:0/3525284564 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe468055140 con 0x7fe470159c90 2024-09-13T18:33:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:11.081+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) v1 -- 0x7fe47006d480 con 0x7fe470159c90 2024-09-13T18:33:12.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe4677fe640 1 -- 172.21.15.53:0/3525284564 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v448) v1 ==== 152+0+0 (secure 0 0 0) 0x7fe468058760 con 0x7fe470159c90 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe450066cc0 msgr2=0x7fe450069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe450066cc0 0x7fe450069180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe460000c10 tx=0x7fe460009040 comp rx=0 tx=0).stop 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe470159c90 msgr2=0x7fe4700cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe470159c90 0x7fe4700cc270 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fe47006bdd0 tx=0x7fe468011c20 comp rx=0 tx=0).stop 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 shutdown_connections 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe450066cc0 0x7fe450069180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe470159c90 0x7fe4700cc270 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe4701542e0 0x7fe4700acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 --2- 172.21.15.53:0/3525284564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe45c0047d0 0x7fe470148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 >> 172.21.15.53:0/3525284564 conn(0x7fe470065c80 msgr2=0x7fe4700adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 shutdown_connections 2024-09-13T18:33:12.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.085+0000 7fe47539c640 1 -- 172.21.15.53:0/3525284564 wait complete. 2024-09-13T18:33:12.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:33:12.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.241+0000 7f4226e18640 1 Processor -- start 2024-09-13T18:33:12.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.241+0000 7f4226e18640 1 -- start start 2024-09-13T18:33:12.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f4226e18640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f42200ccd10 0x7f42200cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f4226e18640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42200d2c80 0x7f42200d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f4226e18640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200b7db0 con 0x7f422015c830 2024-09-13T18:33:12.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f4226e18640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200d3650 con 0x7f42200d2c80 2024-09-13T18:33:12.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f4226e18640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200d0650 con 0x7f42200ccd10 2024-09-13T18:33:12.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f42253b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42200d2c80 0x7f42200d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f42253b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f42200d2c80 0x7f42200d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55080/0 (socket says 172.21.15.53:55080) 2024-09-13T18:33:12.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f42253b5640 1 -- 172.21.15.53:0/1859657586 learned_addr learned my addr 172.21.15.53:0/1859657586 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:12.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f421ffff640 1 --2- 172.21.15.53:0/1859657586 >> v2:172.21.15.87:3300/0 conn(0x7f42200ccd10 0x7f42200cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f42253b5640 1 -- 172.21.15.53:0/1859657586 >> v2:172.21.15.87:3300/0 conn(0x7f42200ccd10 msgr2=0x7f42200cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:12.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f42253b5640 1 --2- 172.21.15.53:0/1859657586 >> v2:172.21.15.87:3300/0 conn(0x7f42200ccd10 0x7f42200cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f42253b5640 1 -- 172.21.15.53:0/1859657586 >> v1:172.21.15.87:6789/0 conn(0x7f422015c830 legacy=0x7f42200d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.245+0000 7f42253b5640 1 -- 172.21.15.53:0/1859657586 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200d0c10 con 0x7f42200d2c80 2024-09-13T18:33:12.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f42253b5640 1 --2- 172.21.15.53:0/1859657586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200d2c80 0x7f42200d3110 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f42200b43f0 tx=0x7f421801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939a139502914b04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:12.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f421f7fe640 1 -- 172.21.15.53:0/1859657586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180a56c0 con 0x7f42200d2c80 2024-09-13T18:33:12.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f421f7fe640 1 -- 172.21.15.53:0/1859657586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180a5820 con 0x7f42200d2c80 2024-09-13T18:33:12.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f421f7fe640 1 -- 172.21.15.53:0/1859657586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180a5bb0 con 0x7f42200d2c80 2024-09-13T18:33:12.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 -- 172.21.15.53:0/1859657586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200d2c80 msgr2=0x7f42200d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 --2- 172.21.15.53:0/1859657586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200d2c80 0x7f42200d3110 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f42200b43f0 tx=0x7f421801c9f0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 -- 172.21.15.53:0/1859657586 shutdown_connections 2024-09-13T18:33:12.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 --2- 172.21.15.53:0/1859657586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200d2c80 0x7f42200d3110 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 --2- 172.21.15.53:0/1859657586 >> v2:172.21.15.87:3300/0 conn(0x7f42200ccd10 0x7f42200cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 -- 172.21.15.53:0/1859657586 >> 172.21.15.53:0/1859657586 conn(0x7f4220070970 msgr2=0x7f4220070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:12.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 -- 172.21.15.53:0/1859657586 shutdown_connections 2024-09-13T18:33:12.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 -- 172.21.15.53:0/1859657586 wait complete. 2024-09-13T18:33:12.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 Processor -- start 2024-09-13T18:33:12.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 -- start start 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200ccd10 0x7f422015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42200d2c80 0x7f422015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f422015c830 0x7f422015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.249+0000 7f4226e18640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422015b0c0 con 0x7f42200ccd10 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4226e18640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42200c9790 con 0x7f422015c830 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4226e18640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42200c9a70 con 0x7f42200d2c80 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200ccd10 0x7f422015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200ccd10 0x7f422015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55086/0 (socket says 172.21.15.53:55086) 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 -- 172.21.15.53:0/1643606449 learned_addr learned my addr 172.21.15.53:0/1643606449 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421ffff640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42200d2c80 0x7f422015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f42253b5640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f422015c830 0x7f422015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 -- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42200d2c80 msgr2=0x7f422015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42200d2c80 0x7f422015bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 -- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f422015c830 msgr2=0x7f422015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f422015c830 0x7f422015cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 -- 172.21.15.53:0/1643606449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009b30 con 0x7f42200ccd10 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4224bb4640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200ccd10 0x7f422015efa0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f421000c3c0 tx=0x7f421000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421d7fa640 1 -- 172.21.15.53:0/1643606449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42100052d0 con 0x7f42200ccd10 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421d7fa640 1 -- 172.21.15.53:0/1643606449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4210005430 con 0x7f42200ccd10 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421d7fa640 1 -- 172.21.15.53:0/1643606449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210003840 con 0x7f42200ccd10 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200c9d50 con 0x7f42200ccd10 2024-09-13T18:33:12.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42200ca310 con 0x7f42200ccd10 2024-09-13T18:33:12.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42200cd180 con 0x7f42200ccd10 2024-09-13T18:33:12.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421d7fa640 1 -- 172.21.15.53:0/1643606449 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f42100039a0 con 0x7f42200ccd10 2024-09-13T18:33:12.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421d7fa640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4200066cc0 0x7f4200069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421ffff640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4200066cc0 0x7f4200069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421d7fa640 1 -- 172.21.15.53:0/1643606449 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4210083f30 con 0x7f42200ccd10 2024-09-13T18:33:12.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.253+0000 7f421ffff640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4200066cc0 0x7f4200069180 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4220158d70 tx=0x7f4208008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:12.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.257+0000 7f421d7fa640 1 -- 172.21.15.53:0/1643606449 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4210050c60 con 0x7f42200ccd10 2024-09-13T18:33:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.417+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f42200d3330 con 0x7f42200ccd10 2024-09-13T18:33:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.421+0000 7f421d7fa640 1 -- 172.21.15.53:0/1643606449 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42100170c0 con 0x7f42200ccd10 2024-09-13T18:33:12.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4200066cc0 msgr2=0x7f4200069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4200066cc0 0x7f4200069180 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4220158d70 tx=0x7f4208008040 comp rx=0 tx=0).stop 2024-09-13T18:33:12.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200ccd10 msgr2=0x7f422015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200ccd10 0x7f422015efa0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f421000c3c0 tx=0x7f421000c880 comp rx=0 tx=0).stop 2024-09-13T18:33:12.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 shutdown_connections 2024-09-13T18:33:12.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4200066cc0 0x7f4200069180 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f42200d2c80 0x7f422015bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f422015c830 0x7f422015cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 --2- 172.21.15.53:0/1643606449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42200ccd10 0x7f422015efa0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 >> 172.21.15.53:0/1643606449 conn(0x7f4220070970 msgr2=0x7f42200b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 shutdown_connections 2024-09-13T18:33:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.425+0000 7f4226e18640 1 -- 172.21.15.53:0/1643606449 wait complete. 2024-09-13T18:33:12.443 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:33:12.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:12.514 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:12.591 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:33:12.591 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:33:12.592 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:12.598 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:12.598 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:12.598 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:12.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:12.604 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:33:12.604 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:12.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:12.650 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:12.650 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:12.657 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:12.657 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:33:12.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf9acfb640 1 Processor -- start 2024-09-13T18:33:12.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf9acfb640 1 -- start start 2024-09-13T18:33:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf9acfb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdf940b1960 0x7fdf940b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf9acfb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdf940ae5d0 0x7fdf940ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf9acfb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940ad530 con 0x7fdf9415db40 2024-09-13T18:33:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf9acfb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940ae1b0 con 0x7fdf940ae5d0 2024-09-13T18:33:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf9acfb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940ad810 con 0x7fdf940b1960 2024-09-13T18:33:12.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf99298640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdf940ae5d0 0x7fdf940ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf99298640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdf940ae5d0 0x7fdf940ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55088/0 (socket says 172.21.15.53:55088) 2024-09-13T18:33:12.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf99298640 1 -- 172.21.15.53:0/1545592015 learned_addr learned my addr 172.21.15.53:0/1545592015 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:12.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf93fff640 1 --2- 172.21.15.53:0/1545592015 >> v2:172.21.15.87:3300/0 conn(0x7fdf940b1960 0x7fdf940b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf99298640 1 -- 172.21.15.53:0/1545592015 >> v2:172.21.15.87:3300/0 conn(0x7fdf940b1960 msgr2=0x7fdf940b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:12.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf99298640 1 --2- 172.21.15.53:0/1545592015 >> v2:172.21.15.87:3300/0 conn(0x7fdf940b1960 0x7fdf940b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf99298640 1 -- 172.21.15.53:0/1545592015 >> v1:172.21.15.87:6789/0 conn(0x7fdf9415db40 legacy=0x7fdf940afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:12.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.821+0000 7fdf99298640 1 -- 172.21.15.53:0/1545592015 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940adaf0 con 0x7fdf940ae5d0 2024-09-13T18:33:12.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf99298640 1 --2- 172.21.15.53:0/1545592015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940ae5d0 0x7fdf940ae9e0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fdf940722a0 tx=0x7fdf8401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2938deba846a7efe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:12.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf937fe640 1 -- 172.21.15.53:0/1545592015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840ab600 con 0x7fdf940ae5d0 2024-09-13T18:33:12.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf937fe640 1 -- 172.21.15.53:0/1545592015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840ab760 con 0x7fdf940ae5d0 2024-09-13T18:33:12.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf937fe640 1 -- 172.21.15.53:0/1545592015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840abaf0 con 0x7fdf940ae5d0 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- 172.21.15.53:0/1545592015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940ae5d0 msgr2=0x7fdf940ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/1545592015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940ae5d0 0x7fdf940ae9e0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fdf940722a0 tx=0x7fdf8401c420 comp rx=0 tx=0).stop 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- 172.21.15.53:0/1545592015 shutdown_connections 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/1545592015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940ae5d0 0x7fdf940ae9e0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/1545592015 >> v2:172.21.15.87:3300/0 conn(0x7fdf940b1960 0x7fdf940b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- 172.21.15.53:0/1545592015 >> 172.21.15.53:0/1545592015 conn(0x7fdf940b20d0 msgr2=0x7fdf940b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- 172.21.15.53:0/1545592015 shutdown_connections 2024-09-13T18:33:12.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- 172.21.15.53:0/1545592015 wait complete. 2024-09-13T18:33:12.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 Processor -- start 2024-09-13T18:33:12.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- start start 2024-09-13T18:33:12.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf940ae5d0 0x7fdf94153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940b1960 0x7fdf941528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf9415db40 0x7fdf941556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94152e10 con 0x7fdf940b1960 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94153090 con 0x7fdf940ae5d0 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf9acfb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940b3f10 con 0x7fdf9415db40 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940b1960 0x7fdf941528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940b1960 0x7fdf941528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55100/0 (socket says 172.21.15.53:55100) 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 -- 172.21.15.53:0/2072182105 learned_addr learned my addr 172.21.15.53:0/2072182105 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:12.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf98a97640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf940ae5d0 0x7fdf94153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf99298640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf9415db40 0x7fdf941556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 -- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf9415db40 msgr2=0x7fdf941556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf9415db40 0x7fdf941556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 -- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf940ae5d0 msgr2=0x7fdf94153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf940ae5d0 0x7fdf94153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.825+0000 7fdf93fff640 1 -- 172.21.15.53:0/2072182105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf840094d0 con 0x7fdf940b1960 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf93fff640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940b1960 0x7fdf941528d0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00d800 tx=0x7fdf7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf917fa640 1 -- 172.21.15.53:0/2072182105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00b6c0 con 0x7fdf940b1960 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf917fa640 1 -- 172.21.15.53:0/2072182105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00b820 con 0x7fdf940b1960 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf940b41f0 con 0x7fdf940b1960 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf917fa640 1 -- 172.21.15.53:0/2072182105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00bb90 con 0x7fdf940b1960 2024-09-13T18:33:12.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf940b47b0 con 0x7fdf940b1960 2024-09-13T18:33:12.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf94073a10 con 0x7fdf940b1960 2024-09-13T18:33:12.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf917fa640 1 -- 172.21.15.53:0/2072182105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fdf7c00bcf0 con 0x7fdf940b1960 2024-09-13T18:33:12.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf917fa640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf74066cc0 0x7fdf74069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:12.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf98a97640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf74066cc0 0x7fdf74069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:12.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf917fa640 1 -- 172.21.15.53:0/2072182105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdf7c084ee0 con 0x7fdf940b1960 2024-09-13T18:33:12.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.829+0000 7fdf98a97640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf74066cc0 0x7fdf74069180 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009f20 tx=0x7fdf8c0094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:12.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:12.833+0000 7fdf917fa640 1 -- 172.21.15.53:0/2072182105 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf7c051ca0 con 0x7fdf940b1960 2024-09-13T18:33:13.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.029+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf940ae9e0 con 0x7fdf940b1960 2024-09-13T18:33:13.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.029+0000 7fdf917fa640 1 -- 172.21.15.53:0/2072182105 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fdf7c0552c0 con 0x7fdf940b1960 2024-09-13T18:33:13.032 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:13.032 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":82,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2946475465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2946475465},{"type":"v1","addr":"172.21.15.87:6833","nonce":2946475465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7870,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3953952610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3953952610},{"type":"v1","addr":"172.21.15.87:6835","nonce":3953952610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1516456617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1516456617},{"type":"v1","addr":"172.21.15.53:6833","nonce":1516456617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":9474,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2702129960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2702129960},{"type":"v1","addr":"172.21.15.53:6835","nonce":2702129960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[]} 2024-09-13T18:33:13.032 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 82 2024-09-13T18:33:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf74066cc0 msgr2=0x7fdf74069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf74066cc0 0x7fdf74069180 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009f20 tx=0x7fdf8c0094d0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940b1960 msgr2=0x7fdf941528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940b1960 0x7fdf941528d0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00d800 tx=0x7fdf7c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 shutdown_connections 2024-09-13T18:33:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf74066cc0 0x7fdf74069180 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf9415db40 0x7fdf941556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf940b1960 0x7fdf941528d0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 --2- 172.21.15.53:0/2072182105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf940ae5d0 0x7fdf94153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 >> 172.21.15.53:0/2072182105 conn(0x7fdf940b20d0 msgr2=0x7fdf940afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 shutdown_connections 2024-09-13T18:33:13.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.033+0000 7fdf9acfb640 1 -- 172.21.15.53:0/2072182105 wait complete. 2024-09-13T18:33:13.051 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:33:13.052 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:33:13.052 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:33:13.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:13.052 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:33:13.052 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:33:13.052 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:33:13.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:13.053 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:33:13.053 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:33:13.053 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:33:13.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:13.054 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:33:13.054 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:33:13.054 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:33:13.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:13.062 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:33:13.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:33:13.063 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:33:13.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:33:13.067 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:33:13.067 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:33:13.073 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:33:13.074 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:33:13.110 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:33:13.111 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:13.112 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:33:13.112 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:13.118 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:33:13.119 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:13.120 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:33:13.121 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:13.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:33:13.170 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:33:13.171 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:33:13.194 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:33:13.196 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:33:13.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1cea3a0640 1 Processor -- start 2024-09-13T18:33:13.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1cea3a0640 1 -- start start 2024-09-13T18:33:13.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1cea3a0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ce406bc20 0x7f1ce40cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1cea3a0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce415e0c0 con 0x7f1ce415a4f0 2024-09-13T18:33:13.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1cea3a0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce40b4b30 con 0x7f1ce40cbaa0 2024-09-13T18:33:13.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1cea3a0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce415ef90 con 0x7f1ce406bc20 2024-09-13T18:33:13.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ce406bc20 0x7f1ce40cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ce406bc20 0x7f1ce40cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55122/0 (socket says 172.21.15.53:55122) 2024-09-13T18:33:13.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce37fe640 1 -- 172.21.15.53:0/1195984558 learned_addr learned my addr 172.21.15.53:0/1195984558 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:13.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1ce415a4f0 0x7f1ce406d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44488/0 (socket says 172.21.15.53:44488) 2024-09-13T18:33:13.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce37fe640 1 -- 172.21.15.53:0/1195984558 >> v1:172.21.15.87:6789/0 conn(0x7f1ce40cbaa0 legacy=0x7f1ce40ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:13.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce37fe640 1 -- 172.21.15.53:0/1195984558 >> v1:172.21.15.53:6789/0 conn(0x7f1ce415a4f0 legacy=0x7f1ce406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce2ffd640 1 -- 172.21.15.53:0/1195984558 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000667692 0 0) 0x7f1ce415e0c0 con 0x7f1ce415a4f0 2024-09-13T18:33:13.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.245+0000 7f1ce37fe640 1 -- 172.21.15.53:0/1195984558 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce415e310 con 0x7f1ce406bc20 2024-09-13T18:33:13.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce37fe640 1 --2- 172.21.15.53:0/1195984558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce406bc20 0x7f1ce40cb560 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009870 tx=0x7f1cd801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71de16248f88d118 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce2ffd640 1 -- 172.21.15.53:0/1195984558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8004230 con 0x7f1ce406bc20 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce2ffd640 1 -- 172.21.15.53:0/1195984558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd80a7050 con 0x7f1ce406bc20 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce2ffd640 1 -- 172.21.15.53:0/1195984558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8003620 con 0x7f1ce406bc20 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/1195984558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce406bc20 msgr2=0x7f1ce40cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/1195984558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce406bc20 0x7f1ce40cb560 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009870 tx=0x7f1cd801c460 comp rx=0 tx=0).stop 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/1195984558 shutdown_connections 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/1195984558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce406bc20 0x7f1ce40cb560 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/1195984558 >> 172.21.15.53:0/1195984558 conn(0x7f1ce40b0840 msgr2=0x7f1ce40b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/1195984558 shutdown_connections 2024-09-13T18:33:13.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/1195984558 wait complete. 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 Processor -- start 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- start start 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce406bc20 0x7f1ce4152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ce40cbaa0 0x7f1ce4139630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce415a4f0 0x7f1ce40b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce415d9c0 con 0x7f1ce415a4f0 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce415af80 con 0x7f1ce406bc20 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1cea3a0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce415d370 con 0x7f1ce40cbaa0 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce893d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce415a4f0 0x7f1ce40b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce893d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce415a4f0 0x7f1ce40b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55126/0 (socket says 172.21.15.53:55126) 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce893d640 1 -- 172.21.15.53:0/3670908329 learned_addr learned my addr 172.21.15.53:0/3670908329 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce3fff640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce406bc20 0x7f1ce4152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.249+0000 7f1ce37fe640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ce40cbaa0 0x7f1ce4139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce893d640 1 -- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ce40cbaa0 msgr2=0x7f1ce4139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce893d640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ce40cbaa0 0x7f1ce4139630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce893d640 1 -- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce406bc20 msgr2=0x7f1ce4152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce893d640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce406bc20 0x7f1ce4152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce893d640 1 -- 172.21.15.53:0/3670908329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80094d0 con 0x7f1ce415a4f0 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce893d640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce415a4f0 0x7f1ce40b3af0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c3c0 tx=0x7f1cdc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce0ff9640 1 -- 172.21.15.53:0/3670908329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc011790 con 0x7f1ce415a4f0 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce0ff9640 1 -- 172.21.15.53:0/3670908329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc0118f0 con 0x7f1ce415a4f0 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce415d650 con 0x7f1ce415a4f0 2024-09-13T18:33:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce0ff9640 1 -- 172.21.15.53:0/3670908329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc011ca0 con 0x7f1ce415a4f0 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce4153040 con 0x7f1ce415a4f0 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce415db30 con 0x7f1ce415a4f0 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce0ff9640 1 -- 172.21.15.53:0/3670908329 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f1cdc01c460 con 0x7f1ce415a4f0 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce0ff9640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cd0066cc0 0x7f1cd0069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce0ff9640 1 -- 172.21.15.53:0/3670908329 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1cdc084820 con 0x7f1ce415a4f0 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce3fff640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cd0066cc0 0x7f1cd0069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.253+0000 7f1ce3fff640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cd0066cc0 0x7f1cd0069180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40012f0 tx=0x7f1cd4001690 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:13.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.257+0000 7f1ce0ff9640 1 -- 172.21.15.53:0/3670908329 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1cdc0515e0 con 0x7f1ce415a4f0 2024-09-13T18:33:13.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:13.429+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1ce406d790 con 0x7f1ce415a4f0 2024-09-13T18:33:14.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.245+0000 7f1ce0ff9640 1 -- 172.21.15.53:0/3670908329 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v146) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1cdc054c00 con 0x7f1ce415a4f0 2024-09-13T18:33:14.249 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:33:14.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cd0066cc0 msgr2=0x7f1cd0069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cd0066cc0 0x7f1cd0069180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40012f0 tx=0x7f1cd4001690 comp rx=0 tx=0).stop 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce415a4f0 msgr2=0x7f1ce40b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce415a4f0 0x7f1ce40b3af0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c3c0 tx=0x7f1cdc00c880 comp rx=0 tx=0).stop 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 shutdown_connections 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cd0066cc0 0x7f1cd0069180 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1ce40cbaa0 0x7f1ce4139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce415a4f0 0x7f1ce40b3af0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 --2- 172.21.15.53:0/3670908329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1ce406bc20 0x7f1ce4152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 >> 172.21.15.53:0/3670908329 conn(0x7f1ce40b0840 msgr2=0x7f1ce40b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 shutdown_connections 2024-09-13T18:33:14.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.249+0000 7f1cea3a0640 1 -- 172.21.15.53:0/3670908329 wait complete. 2024-09-13T18:33:14.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:33:14.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.393+0000 7fd23adec640 1 Processor -- start 2024-09-13T18:33:14.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.393+0000 7fd23adec640 1 -- start start 2024-09-13T18:33:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd23adec640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd23406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd23adec640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2340713a0 0x7fd23406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd23adec640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23406d480 con 0x7fd23415b7c0 2024-09-13T18:33:14.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd23adec640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23415aaf0 con 0x7fd2340713a0 2024-09-13T18:33:14.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd23adec640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23406d760 con 0x7fd2341582a0 2024-09-13T18:33:14.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2340713a0 0x7fd23406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2340713a0 0x7fd23406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55128/0 (socket says 172.21.15.53:55128) 2024-09-13T18:33:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 -- 172.21.15.53:0/4083965823 learned_addr learned my addr 172.21.15.53:0/4083965823 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd238b88640 1 --2- 172.21.15.53:0/4083965823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd23406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 -- 172.21.15.53:0/4083965823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 msgr2=0x7fd23406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 --2- 172.21.15.53:0/4083965823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd23406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 -- 172.21.15.53:0/4083965823 >> v1:172.21.15.87:6789/0 conn(0x7fd23415b7c0 legacy=0x7fd234070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 -- 172.21.15.53:0/4083965823 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23415ace0 con 0x7fd2340713a0 2024-09-13T18:33:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd238b88640 1 --2- 172.21.15.53:0/4083965823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd23406c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.397+0000 7fd239389640 1 --2- 172.21.15.53:0/4083965823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd23406ce40 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009e50 tx=0x7fd22c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2c5493fe1b91ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd2337fe640 1 -- 172.21.15.53:0/4083965823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0a58d0 con 0x7fd2340713a0 2024-09-13T18:33:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd2337fe640 1 -- 172.21.15.53:0/4083965823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c0a5a30 con 0x7fd2340713a0 2024-09-13T18:33:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd2337fe640 1 -- 172.21.15.53:0/4083965823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0a5dc0 con 0x7fd2340713a0 2024-09-13T18:33:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- 172.21.15.53:0/4083965823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 msgr2=0x7fd23406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 --2- 172.21.15.53:0/4083965823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd23406ce40 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009e50 tx=0x7fd22c01ca00 comp rx=0 tx=0).stop 2024-09-13T18:33:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- 172.21.15.53:0/4083965823 shutdown_connections 2024-09-13T18:33:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 --2- 172.21.15.53:0/4083965823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd23406ce40 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 --2- 172.21.15.53:0/4083965823 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd23406c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- 172.21.15.53:0/4083965823 >> 172.21.15.53:0/4083965823 conn(0x7fd234065c80 msgr2=0x7fd234066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- 172.21.15.53:0/4083965823 shutdown_connections 2024-09-13T18:33:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- 172.21.15.53:0/4083965823 wait complete. 2024-09-13T18:33:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 Processor -- start 2024-09-13T18:33:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- start start 2024-09-13T18:33:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd234150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd2341383d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23415b7c0 0x7fd234135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234138910 con 0x7fd2340713a0 2024-09-13T18:33:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234135640 con 0x7fd23415b7c0 2024-09-13T18:33:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2341512f0 con 0x7fd2341582a0 2024-09-13T18:33:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd234150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd234150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55130/0 (socket says 172.21.15.53:55130) 2024-09-13T18:33:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 -- 172.21.15.53:0/1023440174 learned_addr learned my addr 172.21.15.53:0/1023440174 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd239389640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23415b7c0 0x7fd234135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd233fff640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd2341383d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 -- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 msgr2=0x7fd2341383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd2341383d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 -- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23415b7c0 msgr2=0x7fd234135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23415b7c0 0x7fd234135100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 -- 172.21.15.53:0/1023440174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c009b30 con 0x7fd2340713a0 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd239389640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23415b7c0 0x7fd234135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd238b88640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd234150c30 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fd22400e810 tx=0x7fd22400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd2317fa640 1 -- 172.21.15.53:0/1023440174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400c8d0 con 0x7fd2340713a0 2024-09-13T18:33:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd2317fa640 1 -- 172.21.15.53:0/1023440174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22400ca30 con 0x7fd2340713a0 2024-09-13T18:33:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2341515d0 con 0x7fd2340713a0 2024-09-13T18:33:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd2317fa640 1 -- 172.21.15.53:0/1023440174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400cdc0 con 0x7fd2340713a0 2024-09-13T18:33:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.401+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd234151b90 con 0x7fd2340713a0 2024-09-13T18:33:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.405+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd234067400 con 0x7fd2340713a0 2024-09-13T18:33:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.405+0000 7fd2317fa640 1 -- 172.21.15.53:0/1023440174 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fd224013410 con 0x7fd2340713a0 2024-09-13T18:33:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.405+0000 7fd2317fa640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd214066cc0 0x7fd214069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.405+0000 7fd2317fa640 1 -- 172.21.15.53:0/1023440174 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2240849b0 con 0x7fd2340713a0 2024-09-13T18:33:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.405+0000 7fd233fff640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd214066cc0 0x7fd214069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.405+0000 7fd233fff640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd214066cc0 0x7fd214069180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd23414ee50 tx=0x7fd21c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.409+0000 7fd2317fa640 1 -- 172.21.15.53:0/1023440174 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd224051550 con 0x7fd2340713a0 2024-09-13T18:33:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.625+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd2340ca7d0 con 0x7fd2340713a0 2024-09-13T18:33:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd2317fa640 1 -- 172.21.15.53:0/1023440174 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd224021090 con 0x7fd2340713a0 2024-09-13T18:33:14.630 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:14.630 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:33:14.631 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:33:14.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.631 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:33:14.631 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:33:14.631 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:14.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:14.632 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.632 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.633 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:33:14.633 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:33:14.633 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.633 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.634 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:14.634 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:14.634 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.634 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.635 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:33:14.635 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:33:14.635 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.636 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.636 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:14.636 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:14.637 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.637 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.637 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.637 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.637 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:33:14.638 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:33:14.638 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.638 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.638 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:14.638 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:14.639 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.639 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:33:14.640 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:33:14.640 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.640 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.640 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.640 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.640 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.641 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:33:14.641 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:33:14.641 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.643 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:33:14.643 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:33:14.643 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.644 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.645 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.646 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:33:14.647 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:33:14.648 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.649 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:14.650 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.651 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:33:14.652 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:14.653 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:33:14.653 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:33:14.653 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:14.653 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.653 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:14.653 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:33:14.653 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:33:14.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd214066cc0 msgr2=0x7fd214069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd214066cc0 0x7fd214069180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd23414ee50 tx=0x7fd21c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 msgr2=0x7fd234150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd234150c30 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fd22400e810 tx=0x7fd22400ecd0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 shutdown_connections 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd214066cc0 0x7fd214069180 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd2341582a0 0x7fd2341383d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd23415b7c0 0x7fd234135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 --2- 172.21.15.53:0/1023440174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2340713a0 0x7fd234150c30 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 >> 172.21.15.53:0/1023440174 conn(0x7fd234065c80 msgr2=0x7fd234156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 shutdown_connections 2024-09-13T18:33:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.629+0000 7fd23adec640 1 -- 172.21.15.53:0/1023440174 wait complete. 2024-09-13T18:33:14.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:14.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.765+0000 7fa2d5906640 1 Processor -- start 2024-09-13T18:33:14.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.765+0000 7fa2d5906640 1 -- start start 2024-09-13T18:33:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2d5906640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2d0070b20 0x7fa2d00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2d5906640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d00b33e0 0x7fa2d00b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2d5906640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d006e2d0 con 0x7fa2d006def0 2024-09-13T18:33:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2d5906640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d015a7a0 con 0x7fa2d0070b20 2024-09-13T18:33:14.770 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2d5906640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00b4a60 con 0x7fa2d00b33e0 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d00b33e0 0x7fa2d00b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2ce7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2d0070b20 0x7fa2d00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d00b33e0 0x7fa2d00b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:54402/0 (socket says 172.21.15.53:54402) 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2ce7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa2d0070b20 0x7fa2d00b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:35804/0 (socket says 172.21.15.53:35804) 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/1795482919 learned_addr learned my addr 172.21.15.53:0/1795482919 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2ceffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa2d006def0 0x7fa2d0070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:49644/0 (socket says 172.21.15.53:49644) 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2ce7fc640 1 -- 172.21.15.53:0/1795482919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d00b33e0 msgr2=0x7fa2d00b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2ce7fc640 1 --2- 172.21.15.53:0/1795482919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d00b33e0 0x7fa2d00b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2ce7fc640 1 -- 172.21.15.53:0/1795482919 >> v1:172.21.15.87:6789/0 conn(0x7fa2d006def0 legacy=0x7fa2d0070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.769+0000 7fa2ce7fc640 1 -- 172.21.15.53:0/1795482919 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00b2620 con 0x7fa2d0070b20 2024-09-13T18:33:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2ce7fc640 1 --2- 172.21.15.53:0/1795482919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d0070b20 0x7fa2d00b3cd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009d90 tx=0x7fa2c001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f9306385cc4a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2cdffb640 1 -- 172.21.15.53:0/1795482919 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00a5a00 con 0x7fa2d0070b20 2024-09-13T18:33:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2cdffb640 1 -- 172.21.15.53:0/1795482919 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c00a5b60 con 0x7fa2d0070b20 2024-09-13T18:33:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2cdffb640 1 -- 172.21.15.53:0/1795482919 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00ad440 con 0x7fa2d0070b20 2024-09-13T18:33:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 -- 172.21.15.53:0/1795482919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d0070b20 msgr2=0x7fa2d00b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 --2- 172.21.15.53:0/1795482919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d0070b20 0x7fa2d00b3cd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009d90 tx=0x7fa2c001c940 comp rx=0 tx=0).stop 2024-09-13T18:33:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 -- 172.21.15.53:0/1795482919 shutdown_connections 2024-09-13T18:33:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 --2- 172.21.15.53:0/1795482919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d00b33e0 0x7fa2d00b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 --2- 172.21.15.53:0/1795482919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d0070b20 0x7fa2d00b3cd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 -- 172.21.15.53:0/1795482919 >> 172.21.15.53:0/1795482919 conn(0x7fa2d0073130 msgr2=0x7fa2d0069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 -- 172.21.15.53:0/1795482919 shutdown_connections 2024-09-13T18:33:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 -- 172.21.15.53:0/1795482919 wait complete. 2024-09-13T18:33:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 Processor -- start 2024-09-13T18:33:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.773+0000 7fa2d5906640 1 -- start start 2024-09-13T18:33:14.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d006def0 0x7fa2d01504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d0070b20 0x7fa2d0153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d00b33e0 0x7fa2d006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0153290 con 0x7fa2d006def0 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0150d10 con 0x7fa2d00b33e0 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d01529f0 con 0x7fa2d0070b20 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d006def0 0x7fa2d01504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d006def0 0x7fa2d01504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55142/0 (socket says 172.21.15.53:55142) 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 -- 172.21.15.53:0/2518126259 learned_addr learned my addr 172.21.15.53:0/2518126259 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2cf7fe640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d00b33e0 0x7fa2d006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ce7fc640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d0070b20 0x7fa2d0153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 -- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d0070b20 msgr2=0x7fa2d0153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d0070b20 0x7fa2d0153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 -- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d00b33e0 msgr2=0x7fa2d006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d00b33e0 0x7fa2d006c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 -- 172.21.15.53:0/2518126259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0009a70 con 0x7fa2d006def0 2024-09-13T18:33:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ceffd640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d006def0 0x7fa2d01504e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c420 tx=0x7fa2c800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2c7fff640 1 -- 172.21.15.53:0/2518126259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80074e0 con 0x7fa2d006def0 2024-09-13T18:33:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2c7fff640 1 -- 172.21.15.53:0/2518126259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8007640 con 0x7fa2d006def0 2024-09-13T18:33:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2c7fff640 1 -- 172.21.15.53:0/2518126259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8004a30 con 0x7fa2d006def0 2024-09-13T18:33:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d0152cd0 con 0x7fa2d006def0 2024-09-13T18:33:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d01609a0 con 0x7fa2d006def0 2024-09-13T18:33:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d015a500 con 0x7fa2d006def0 2024-09-13T18:33:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2c7fff640 1 -- 172.21.15.53:0/2518126259 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fa2c8004b90 con 0x7fa2d006def0 2024-09-13T18:33:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa2b0066cc0 0x7fa2b0069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:14.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2c7fff640 1 -- 172.21.15.53:0/2518126259 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa2c8084300 con 0x7fa2d006def0 2024-09-13T18:33:14.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ce7fc640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa2b0066cc0 0x7fa2b0069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:14.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.777+0000 7fa2ce7fc640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa2b0066cc0 0x7fa2b0069180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00af000 tx=0x7fa2c00a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:14.784 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.781+0000 7fa2c7fff640 1 -- 172.21.15.53:0/2518126259 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2c8051110 con 0x7fa2d006def0 2024-09-13T18:33:14.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.937+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2d015d140 con 0x7fa2d006def0 2024-09-13T18:33:14.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.937+0000 7fa2c7fff640 1 -- 172.21.15.53:0/2518126259 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+12807 (secure 0 0 0) 0x7fa2c8054730 con 0x7fa2d006def0 2024-09-13T18:33:14.940 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:14.941 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":146,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:14.237789+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:14.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa2b0066cc0 msgr2=0x7fa2b0069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa2b0066cc0 0x7fa2b0069180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00af000 tx=0x7fa2c00a7070 comp rx=0 tx=0).stop 2024-09-13T18:33:14.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d006def0 msgr2=0x7fa2d01504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:14.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d006def0 0x7fa2d01504e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c420 tx=0x7fa2c800c8e0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 shutdown_connections 2024-09-13T18:33:14.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa2b0066cc0 0x7fa2b0069180 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa2d0070b20 0x7fa2d0153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.944 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa2d00b33e0 0x7fa2d006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 --2- 172.21.15.53:0/2518126259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2d006def0 0x7fa2d01504e0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:14.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 >> 172.21.15.53:0/2518126259 conn(0x7fa2d0073130 msgr2=0x7fa2d0066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:14.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 shutdown_connections 2024-09-13T18:33:14.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:14.941+0000 7fa2d5906640 1 -- 172.21.15.53:0/2518126259 wait complete. 2024-09-13T18:33:14.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:14.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:15.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.085+0000 7fd3ebe15640 1 Processor -- start 2024-09-13T18:33:15.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.085+0000 7fd3ebe15640 1 -- start start 2024-09-13T18:33:15.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ebe15640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd3e40ccf10 0x7fd3e40cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ebe15640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 0x7fd3e40cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ebe15640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e40ccd60 con 0x7fd3e40ced50 2024-09-13T18:33:15.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ebe15640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e40cd830 con 0x7fd3e40ccf10 2024-09-13T18:33:15.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ebe15640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40cc190 con 0x7fd3e40b2bf0 2024-09-13T18:33:15.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ea3b2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd3e40ced50 0x7fd3e40b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44492/0 (socket says 172.21.15.53:44492) 2024-09-13T18:33:15.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ea3b2640 1 -- 172.21.15.53:0/1416685148 learned_addr learned my addr 172.21.15.53:0/1416685148 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:15.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/1416685148 >> v2:172.21.15.87:3300/0 conn(0x7fd3e40ccf10 0x7fd3e40cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352319353 0 0) 0x7fd3e40ccd60 con 0x7fd3e40ced50 2024-09-13T18:33:15.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e93b0640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 0x7fd3e40cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d0003530 con 0x7fd3e40ced50 2024-09-13T18:33:15.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485241881 0 0) 0x7fd3d0003530 con 0x7fd3e40ced50 2024-09-13T18:33:15.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 msgr2=0x7fd3e40cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 0x7fd3e40cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 >> v2:172.21.15.87:3300/0 conn(0x7fd3e40ccf10 msgr2=0x7fd3e40cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 --2- 172.21.15.53:0/1416685148 >> v2:172.21.15.87:3300/0 conn(0x7fd3e40ccf10 0x7fd3e40cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40ce270 con 0x7fd3e40ced50 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd3dc001a00 con 0x7fd3e40ced50 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 >> v1:172.21.15.53:6789/0 conn(0x7fd3e40ced50 legacy=0x7fd3e40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3d0003980 0x7fd3d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 0x7fd3d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0004d10 0x7fd3d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40cd830 con 0x7fd3d0003980 2024-09-13T18:33:15.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40cc190 con 0x7fd3d0004d10 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d000fdd0 con 0x7fd3e40b2bf0 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3d0003980 0x7fd3d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e93b0640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 0x7fd3d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3ea3b2640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0004d10 0x7fd3d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 -- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 msgr2=0x7fd3d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40b2bf0 0x7fd3d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 -- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0004d10 msgr2=0x7fd3d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0004d10 0x7fd3d0005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 -- 172.21.15.53:0/1416685148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0003530 con 0x7fd3d0003980 2024-09-13T18:33:15.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3d0003980 0x7fd3d0003da0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009ae0 tx=0x7fd3e001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8abf70d61241d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00a5650 con 0x7fd3d0003980 2024-09-13T18:33:15.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e00a57b0 con 0x7fd3d0003980 2024-09-13T18:33:15.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.089+0000 7fd3e8baf640 1 -- 172.21.15.53:0/1416685148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00a5b60 con 0x7fd3d0003980 2024-09-13T18:33:15.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- 172.21.15.53:0/1416685148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3d0003980 msgr2=0x7fd3d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 --2- 172.21.15.53:0/1416685148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3d0003980 0x7fd3d0003da0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009ae0 tx=0x7fd3e001ca80 comp rx=0 tx=0).stop 2024-09-13T18:33:15.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ea3b2640 1 -- 172.21.15.53:0/1416685148 reap_dead start 2024-09-13T18:33:15.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- 172.21.15.53:0/1416685148 shutdown_connections 2024-09-13T18:33:15.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- 172.21.15.53:0/1416685148 >> 172.21.15.53:0/1416685148 conn(0x7fd3e40b20d0 msgr2=0x7fd3e40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- 172.21.15.53:0/1416685148 shutdown_connections 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- 172.21.15.53:0/1416685148 wait complete. 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 Processor -- start 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- start start 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0003980 0x7fd3e415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e4158870 0x7fd3e41598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40c8430 0x7fd3e40c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e415d9b0 con 0x7fd3e4158870 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40c7670 con 0x7fd3d0003980 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40c7950 con 0x7fd3e40c8430 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e4158870 0x7fd3e41598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e4158870 0x7fd3e41598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55152/0 (socket says 172.21.15.53:55152) 2024-09-13T18:33:15.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 -- 172.21.15.53:0/937682353 learned_addr learned my addr 172.21.15.53:0/937682353 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ea3b2640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40c8430 0x7fd3e40c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0003980 0x7fd3e415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 -- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40c8430 msgr2=0x7fd3e40c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40c8430 0x7fd3e40c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 -- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0003980 msgr2=0x7fd3e415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0003980 0x7fd3e415d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 -- 172.21.15.53:0/937682353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40c7c30 con 0x7fd3e4158870 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3e93b0640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e4158870 0x7fd3e41598f0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40115e0 tx=0x7fd3d4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3da7fc640 1 -- 172.21.15.53:0/937682353 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d400f8f0 con 0x7fd3e4158870 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3da7fc640 1 -- 172.21.15.53:0/937682353 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d400fa50 con 0x7fd3e4158870 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e40c7f10 con 0x7fd3e4158870 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3da7fc640 1 -- 172.21.15.53:0/937682353 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d400fdc0 con 0x7fd3e4158870 2024-09-13T18:33:15.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.093+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e4159e30 con 0x7fd3e4158870 2024-09-13T18:33:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.097+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e40cbab0 con 0x7fd3e4158870 2024-09-13T18:33:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.097+0000 7fd3da7fc640 1 -- 172.21.15.53:0/937682353 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fd3d4015460 con 0x7fd3e4158870 2024-09-13T18:33:15.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.097+0000 7fd3da7fc640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3c8066cc0 0x7fd3c8069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.097+0000 7fd3da7fc640 1 -- 172.21.15.53:0/937682353 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3d4085300 con 0x7fd3e4158870 2024-09-13T18:33:15.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.097+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3c8066cc0 0x7fd3c8069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.101+0000 7fd3e9bb1640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3c8066cc0 0x7fd3c8069180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00af000 tx=0x7fd3e00046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.101+0000 7fd3da7fc640 1 -- 172.21.15.53:0/937682353 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3d4052080 con 0x7fd3e4158870 2024-09-13T18:33:15.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.261+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3e40c80a0 con 0x7fd3e4158870 2024-09-13T18:33:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.261+0000 7fd3da7fc640 1 -- 172.21.15.53:0/937682353 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3d4022020 con 0x7fd3e4158870 2024-09-13T18:33:15.265 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:15.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3c8066cc0 msgr2=0x7fd3c8069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3c8066cc0 0x7fd3c8069180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00af000 tx=0x7fd3e00046d0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e4158870 msgr2=0x7fd3e41598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e4158870 0x7fd3e41598f0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40115e0 tx=0x7fd3d4011aa0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 shutdown_connections 2024-09-13T18:33:15.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd3c8066cc0 0x7fd3c8069180 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd3e40c8430 0x7fd3e40c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3e4158870 0x7fd3e41598f0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 --2- 172.21.15.53:0/937682353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3d0003980 0x7fd3e415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 >> 172.21.15.53:0/937682353 conn(0x7fd3e40b20d0 msgr2=0x7fd3e40b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:15.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 shutdown_connections 2024-09-13T18:33:15.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.265+0000 7fd3ebe15640 1 -- 172.21.15.53:0/937682353 wait complete. 2024-09-13T18:33:15.283 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:33:15.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13ae1a4640 1 Processor -- start 2024-09-13T18:33:15.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13ae1a4640 1 -- start start 2024-09-13T18:33:15.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13ae1a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 0x7f13a80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13ae1a4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a815cc10 con 0x7f13a80b7b40 2024-09-13T18:33:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13ae1a4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a80b50c0 con 0x7f13a815c830 2024-09-13T18:33:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13ae1a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80b41d0 con 0x7f13a80cf800 2024-09-13T18:33:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f13a80b7b40 0x7f13a81662f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44500/0 (socket says 172.21.15.53:44500) 2024-09-13T18:33:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a7fff640 1 -- 172.21.15.53:0/2049484398 learned_addr learned my addr 172.21.15.53:0/2049484398 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:15.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 0x7f13a80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334225883 0 0) 0x7f13a00014a0 con 0x7f13a80b7b40 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1390003530 con 0x7f13a80b7b40 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4239084806 0 0) 0x7f1390003530 con 0x7f13a80b7b40 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 msgr2=0x7f13a80cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 0x7f13a80cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 >> v1:172.21.15.87:6789/0 conn(0x7f13a815c830 legacy=0x7f13a80cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80b44b0 con 0x7f13a80b7b40 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f13a0001b90 con 0x7f13a80b7b40 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 >> v1:172.21.15.53:6789/0 conn(0x7f13a80b7b40 legacy=0x7f13a81662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 0x7f13900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1390003f30 0x7f13900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1390004d10 0x7f1390005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80b41d0 con 0x7f1390003f30 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139000bb00 con 0x7f1390004d10 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139000bcc0 con 0x7f13a80cf800 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1390003f30 0x7f13900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a77fe640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 0x7f13900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a7fff640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1390004d10 0x7f1390005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a6ffd640 1 -- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 msgr2=0x7f13900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13a80cf800 0x7f13900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a6ffd640 1 -- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1390004d10 msgr2=0x7f1390005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1390004d10 0x7f1390005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.405+0000 7f13a6ffd640 1 -- 172.21.15.53:0/2049484398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390003530 con 0x7f1390003f30 2024-09-13T18:33:15.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1390003f30 0x7f13900047d0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f139c009ac0 tx=0x7f139c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc49412069b16bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0059a0 con 0x7f1390003f30 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c005b00 con 0x7f1390003f30 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13a67fc640 1 -- 172.21.15.53:0/2049484398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0a5640 con 0x7f1390003f30 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 -- 172.21.15.53:0/2049484398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1390003f30 msgr2=0x7f13900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 --2- 172.21.15.53:0/2049484398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1390003f30 0x7f13900047d0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f139c009ac0 tx=0x7f139c01ca50 comp rx=0 tx=0).stop 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13a7fff640 1 -- 172.21.15.53:0/2049484398 reap_dead start 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 -- 172.21.15.53:0/2049484398 shutdown_connections 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 -- 172.21.15.53:0/2049484398 >> 172.21.15.53:0/2049484398 conn(0x7f13a8070970 msgr2=0x7f13a8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:15.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 -- 172.21.15.53:0/2049484398 shutdown_connections 2024-09-13T18:33:15.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 -- 172.21.15.53:0/2049484398 wait complete. 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 Processor -- start 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 -- start start 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1390003f30 0x7f13a815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.409+0000 7f13ae1a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a80b0a80 0x7f13a80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13ae1a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13a80c7140 0x7f13a81e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13ae1a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a815be10 con 0x7f13a80b0a80 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13ae1a4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a815b440 con 0x7f13a80c7140 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13ae1a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a815a830 con 0x7f1390003f30 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a80b0a80 0x7f13a80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a80b0a80 0x7f13a80c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55164/0 (socket says 172.21.15.53:55164) 2024-09-13T18:33:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 -- 172.21.15.53:0/753448461 learned_addr learned my addr 172.21.15.53:0/753448461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a77fe640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1390003f30 0x7f13a815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a7fff640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13a80c7140 0x7f13a81e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 -- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1390003f30 msgr2=0x7f13a815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1390003f30 0x7f13a815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 -- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13a80c7140 msgr2=0x7f13a81e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13a80c7140 0x7f13a81e6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 -- 172.21.15.53:0/753448461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a815ab10 con 0x7f13a80b0a80 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a6ffd640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a80b0a80 0x7f13a80c6c00 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f139c0af040 tx=0x7f1390005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f138ffff640 1 -- 172.21.15.53:0/753448461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0be070 con 0x7f13a80b0a80 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f138ffff640 1 -- 172.21.15.53:0/753448461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c005c70 con 0x7f13a80b0a80 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a815adf0 con 0x7f13a80b0a80 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f138ffff640 1 -- 172.21.15.53:0/753448461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c004020 con 0x7f13a80b0a80 2024-09-13T18:33:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a815a500 con 0x7f13a80b0a80 2024-09-13T18:33:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a815b580 con 0x7f13a80b0a80 2024-09-13T18:33:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f138ffff640 1 -- 172.21.15.53:0/753448461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f139c004180 con 0x7f13a80b0a80 2024-09-13T18:33:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f138ffff640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1394066cc0 0x7f1394069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f138ffff640 1 -- 172.21.15.53:0/753448461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f139c11f200 con 0x7f13a80b0a80 2024-09-13T18:33:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a77fe640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1394066cc0 0x7f1394069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.413+0000 7f13a77fe640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1394066cc0 0x7f1394069180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1398005450 tx=0x7f1398009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.417+0000 7f138ffff640 1 -- 172.21.15.53:0/753448461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f139c0ebef0 con 0x7f13a80b0a80 2024-09-13T18:33:15.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.577+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f13a80c9550 con 0x7f13a80b0a80 2024-09-13T18:33:15.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.577+0000 7f138ffff640 1 -- 172.21.15.53:0/753448461 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v146) v1 ==== 84+0+65 (secure 0 0 0) 0x7f139c0ef510 con 0x7f13a80b0a80 2024-09-13T18:33:15.580 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:15.581 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:33:15.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:15.581 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:33:15.581 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:33:15.581 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:15.581 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:33:15.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1394066cc0 msgr2=0x7f1394069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1394066cc0 0x7f1394069180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1398005450 tx=0x7f1398009040 comp rx=0 tx=0).stop 2024-09-13T18:33:15.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a80b0a80 msgr2=0x7f13a80c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a80b0a80 0x7f13a80c6c00 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f139c0af040 tx=0x7f1390005800 comp rx=0 tx=0).stop 2024-09-13T18:33:15.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 shutdown_connections 2024-09-13T18:33:15.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1394066cc0 0x7f1394069180 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13a80c7140 0x7f13a81e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13a80b0a80 0x7f13a80c6c00 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 --2- 172.21.15.53:0/753448461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1390003f30 0x7f13a815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 >> 172.21.15.53:0/753448461 conn(0x7f13a8070970 msgr2=0x7f13a8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:15.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 shutdown_connections 2024-09-13T18:33:15.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.581+0000 7f13ae1a4640 1 -- 172.21.15.53:0/753448461 wait complete. 2024-09-13T18:33:15.598 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:33:15.598 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:33:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b8c10640 1 Processor -- start 2024-09-13T18:33:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b8c10640 1 -- start start 2024-09-13T18:33:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b8c10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3b415c6d0 0x7ff3b40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b8c10640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b4160230 con 0x7ff3b40ace20 2024-09-13T18:33:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b8c10640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b4160460 con 0x7ff3b4066390 2024-09-13T18:33:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b8c10640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b40aec00 con 0x7ff3b415c6d0 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3b415c6d0 0x7ff3b40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3b415c6d0 0x7ff3b40ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55178/0 (socket says 172.21.15.53:55178) 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff3b40ace20 0x7ff3b4065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44506/0 (socket says 172.21.15.53:44506) 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b259c640 1 -- 172.21.15.53:0/2599074284 learned_addr learned my addr 172.21.15.53:0/2599074284 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b259c640 1 -- 172.21.15.53:0/2599074284 >> v1:172.21.15.87:6789/0 conn(0x7ff3b4066390 legacy=0x7ff3b415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b259c640 1 -- 172.21.15.53:0/2599074284 >> v1:172.21.15.53:6789/0 conn(0x7ff3b40ace20 legacy=0x7ff3b4065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b259c640 1 -- 172.21.15.53:0/2599074284 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b4160740 con 0x7ff3b415c6d0 2024-09-13T18:33:15.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.713+0000 7ff3b159a640 1 -- 172.21.15.53:0/2599074284 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269667825 0 0) 0x7ff3b4160230 con 0x7ff3b40ace20 2024-09-13T18:33:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 --2- 172.21.15.53:0/2599074284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b415c6d0 0x7ff3b40ac8e0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009e50 tx=0x7ff3a401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86014d1f66d97cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b159a640 1 -- 172.21.15.53:0/2599074284 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40a57a0 con 0x7ff3b415c6d0 2024-09-13T18:33:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b159a640 1 -- 172.21.15.53:0/2599074284 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a40a5900 con 0x7ff3b415c6d0 2024-09-13T18:33:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b159a640 1 -- 172.21.15.53:0/2599074284 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40a5c90 con 0x7ff3b415c6d0 2024-09-13T18:33:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- 172.21.15.53:0/2599074284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b415c6d0 msgr2=0x7ff3b40ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/2599074284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b415c6d0 0x7ff3b40ac8e0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009e50 tx=0x7ff3a401c9f0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- 172.21.15.53:0/2599074284 shutdown_connections 2024-09-13T18:33:15.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/2599074284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b415c6d0 0x7ff3b40ac8e0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- 172.21.15.53:0/2599074284 >> 172.21.15.53:0/2599074284 conn(0x7ff3b40b11a0 msgr2=0x7ff3b40b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:15.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- 172.21.15.53:0/2599074284 shutdown_connections 2024-09-13T18:33:15.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- 172.21.15.53:0/2599074284 wait complete. 2024-09-13T18:33:15.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 Processor -- start 2024-09-13T18:33:15.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- start start 2024-09-13T18:33:15.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b4066390 0x7ff3b414ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3b40ace20 0x7ff3b415b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415c6d0 0x7ff3b414c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b415a430 con 0x7ff3b4066390 2024-09-13T18:33:15.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4158030 con 0x7ff3b415c6d0 2024-09-13T18:33:15.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b8c10640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b4155f60 con 0x7ff3b40ace20 2024-09-13T18:33:15.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b4066390 0x7ff3b414ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b4066390 0x7ff3b414ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55194/0 (socket says 172.21.15.53:55194) 2024-09-13T18:33:15.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 -- 172.21.15.53:0/3229448894 learned_addr learned my addr 172.21.15.53:0/3229448894 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:15.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b1d9b640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3b40ace20 0x7ff3b415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 -- 172.21.15.53:0/3229448894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3b40ace20 msgr2=0x7ff3b415b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3b40ace20 0x7ff3b415b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 -- 172.21.15.53:0/3229448894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415c6d0 msgr2=0x7ff3b414c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:15.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415c6d0 0x7ff3b414c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:15.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.717+0000 7ff3b259c640 1 -- 172.21.15.53:0/3229448894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4009b30 con 0x7ff3b4066390 2024-09-13T18:33:15.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3b259c640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b4066390 0x7ff3b414ccf0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40af040 tx=0x7ff3a4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3a2ffd640 1 -- 172.21.15.53:0/3229448894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40b8670 con 0x7ff3b4066390 2024-09-13T18:33:15.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3a2ffd640 1 -- 172.21.15.53:0/3229448894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a40b87d0 con 0x7ff3b4066390 2024-09-13T18:33:15.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b4159c20 con 0x7ff3b4066390 2024-09-13T18:33:15.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3a2ffd640 1 -- 172.21.15.53:0/3229448894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40b8b40 con 0x7ff3b4066390 2024-09-13T18:33:15.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b4159e70 con 0x7ff3b4066390 2024-09-13T18:33:15.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b40ac8e0 con 0x7ff3b4066390 2024-09-13T18:33:15.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3a2ffd640 1 -- 172.21.15.53:0/3229448894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7ff3a40b8ca0 con 0x7ff3b4066390 2024-09-13T18:33:15.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3a2ffd640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff394066cc0 0x7ff394069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:15.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3a2ffd640 1 -- 172.21.15.53:0/3229448894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3a4120140 con 0x7ff3b4066390 2024-09-13T18:33:15.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3b1d9b640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff394066cc0 0x7ff394069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:15.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.721+0000 7ff3b1d9b640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff394066cc0 0x7ff394069180 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff3b41f8a90 tx=0x7ff3a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:15.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.725+0000 7ff3a2ffd640 1 -- 172.21.15.53:0/3229448894 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3a40ed070 con 0x7ff3b4066390 2024-09-13T18:33:15.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:15.877+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff3b415a210 con 0x7ff3b4066390 2024-09-13T18:33:16.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.109+0000 7ff3a2ffd640 1 -- 172.21.15.53:0/3229448894 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v147) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff3a40f0690 con 0x7ff3b4066390 2024-09-13T18:33:16.114 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:33:16.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.113+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff394066cc0 msgr2=0x7ff394069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.113+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff394066cc0 0x7ff394069180 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff3b41f8a90 tx=0x7ff3a8009040 comp rx=0 tx=0).stop 2024-09-13T18:33:16.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.113+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b4066390 msgr2=0x7ff3b414ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.113+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b4066390 0x7ff3b414ccf0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40af040 tx=0x7ff3a4019790 comp rx=0 tx=0).stop 2024-09-13T18:33:16.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 shutdown_connections 2024-09-13T18:33:16.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff394066cc0 0x7ff394069180 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff3b40ace20 0x7ff3b415b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3b415c6d0 0x7ff3b414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 --2- 172.21.15.53:0/3229448894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3b4066390 0x7ff3b414ccf0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 >> 172.21.15.53:0/3229448894 conn(0x7ff3b40b11a0 msgr2=0x7ff3b4065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 shutdown_connections 2024-09-13T18:33:16.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.117+0000 7ff3b8c10640 1 -- 172.21.15.53:0/3229448894 wait complete. 2024-09-13T18:33:16.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:33:16.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.265+0000 7f6fb8536640 1 Processor -- start 2024-09-13T18:33:16.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.265+0000 7f6fb8536640 1 -- start start 2024-09-13T18:33:16.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb8536640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb0143e80 0x7f6fb006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb8536640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6fb00cda30 0x7f6fb00cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb8536640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb006f7a0 con 0x7f6fb00caee0 2024-09-13T18:33:16.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb8536640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb006fd60 con 0x7f6fb00cda30 2024-09-13T18:33:16.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb8536640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00cb960 con 0x7f6fb0143e80 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb6ad3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6fb00cda30 0x7f6fb00cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb6ad3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6fb00cda30 0x7f6fb00cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:35880/0 (socket says 172.21.15.53:35880) 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/226941825 learned_addr learned my addr 172.21.15.53:0/226941825 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb62d2640 1 --2- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb0143e80 0x7f6fb006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb0143e80 msgr2=0x7f6fb006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb6ad3640 1 --2- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb0143e80 0x7f6fb006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/226941825 >> v1:172.21.15.87:6789/0 conn(0x7f6fb00caee0 legacy=0x7f6fb00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.269+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/226941825 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00cbc40 con 0x7f6fb00cda30 2024-09-13T18:33:16.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb6ad3640 1 --2- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 0x7f6fb00cb320 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5888835df2b07495 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb52d0640 1 -- 172.21.15.53:0/226941825 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80a5810 con 0x7f6fb00cda30 2024-09-13T18:33:16.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb52d0640 1 -- 172.21.15.53:0/226941825 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80a5970 con 0x7f6fb00cda30 2024-09-13T18:33:16.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb52d0640 1 -- 172.21.15.53:0/226941825 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80a5d00 con 0x7f6fb00cda30 2024-09-13T18:33:16.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 msgr2=0x7f6fb00cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 --2- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 0x7f6fb00cb320 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa801c970 comp rx=0 tx=0).stop 2024-09-13T18:33:16.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- 172.21.15.53:0/226941825 shutdown_connections 2024-09-13T18:33:16.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 --2- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 0x7f6fb00cb320 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 --2- 172.21.15.53:0/226941825 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb0143e80 0x7f6fb006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- 172.21.15.53:0/226941825 >> 172.21.15.53:0/226941825 conn(0x7f6fb0065c80 msgr2=0x7f6fb0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:16.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- 172.21.15.53:0/226941825 shutdown_connections 2024-09-13T18:33:16.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- 172.21.15.53:0/226941825 wait complete. 2024-09-13T18:33:16.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 Processor -- start 2024-09-13T18:33:16.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- start start 2024-09-13T18:33:16.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb00caee0 0x7f6fb013cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 0x7f6fb00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fb0143e80 0x7f6fb0140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00b3690 con 0x7f6fb0143e80 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0162eb0 con 0x7f6fb00cda30 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb8536640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0163190 con 0x7f6fb00caee0 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb6ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fb0143e80 0x7f6fb0140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb6ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fb0143e80 0x7f6fb0140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55200/0 (socket says 172.21.15.53:55200) 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/617279585 learned_addr learned my addr 172.21.15.53:0/617279585 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb5ad1640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 0x7f6fb00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.273+0000 7f6fb62d2640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb00caee0 0x7f6fb013cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb00caee0 msgr2=0x7f6fb013cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb6ad3640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb00caee0 0x7f6fb013cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 msgr2=0x7f6fb00b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb6ad3640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 0x7f6fb00b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb6ad3640 1 -- 172.21.15.53:0/617279585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8009b30 con 0x7f6fb0143e80 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb62d2640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb00caee0 0x7f6fb013cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb6ad3640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fb0143e80 0x7f6fb0140500 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80af040 tx=0x7f6fa8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fa6ffd640 1 -- 172.21.15.53:0/617279585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80b8670 con 0x7f6fb0143e80 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fa6ffd640 1 -- 172.21.15.53:0/617279585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80b87d0 con 0x7f6fb0143e80 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fa6ffd640 1 -- 172.21.15.53:0/617279585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80b8b60 con 0x7f6fb0143e80 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb0163470 con 0x7f6fb0143e80 2024-09-13T18:33:16.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb0163a30 con 0x7f6fb0143e80 2024-09-13T18:33:16.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0163c20 con 0x7f6fb0143e80 2024-09-13T18:33:16.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fa6ffd640 1 -- 172.21.15.53:0/617279585 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f6fa80b8cc0 con 0x7f6fb0143e80 2024-09-13T18:33:16.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fa6ffd640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f94066cc0 0x7f6f94069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:16.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb62d2640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f94066cc0 0x7f6f94069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:16.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fa6ffd640 1 -- 172.21.15.53:0/617279585 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6fa8120610 con 0x7f6fb0143e80 2024-09-13T18:33:16.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.277+0000 7f6fb62d2640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f94066cc0 0x7f6f94069180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ca770 tx=0x7f6fac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:16.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.281+0000 7f6fa6ffd640 1 -- 172.21.15.53:0/617279585 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fa80ed380 con 0x7f6fb0143e80 2024-09-13T18:33:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:16.441+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6fb00cb320 con 0x7f6fb0143e80 2024-09-13T18:33:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.117+0000 7f6fa6ffd640 1 -- 172.21.15.53:0/617279585 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v148) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6fa80f09a0 con 0x7f6fb0143e80 2024-09-13T18:33:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:33:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f94066cc0 msgr2=0x7f6f94069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f94066cc0 0x7f6f94069180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00ca770 tx=0x7f6fac008040 comp rx=0 tx=0).stop 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fb0143e80 msgr2=0x7f6fb0140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fb0143e80 0x7f6fb0140500 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f6fa80af040 tx=0x7f6fa8019710 comp rx=0 tx=0).stop 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 shutdown_connections 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f94066cc0 0x7f6f94069180 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fb0143e80 0x7f6fb0140500 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fb00cda30 0x7f6fb00b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 --2- 172.21.15.53:0/617279585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6fb00caee0 0x7f6fb013cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.137+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 >> 172.21.15.53:0/617279585 conn(0x7f6fb0065c80 msgr2=0x7f6fb00afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:17.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.141+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 shutdown_connections 2024-09-13T18:33:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.141+0000 7f6fb8536640 1 -- 172.21.15.53:0/617279585 wait complete. 2024-09-13T18:33:17.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:33:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.289+0000 7fab91d38640 1 Processor -- start 2024-09-13T18:33:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab91d38640 1 -- start start 2024-09-13T18:33:17.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab91d38640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab8c06aa60 0x7fab8c06a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab91d38640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c06ae40 0x7fab8c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab91d38640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0d0320 con 0x7fab8c15dbe0 2024-09-13T18:33:17.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab91d38640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c06b830 con 0x7fab8c06aa60 2024-09-13T18:33:17.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab91d38640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0d13c0 con 0x7fab8c06ae40 2024-09-13T18:33:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab83fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c06ae40 0x7fab8c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab83fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c06ae40 0x7fab8c15d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:60004/0 (socket says 172.21.15.53:60004) 2024-09-13T18:33:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab83fff640 1 -- 172.21.15.53:0/2914875331 learned_addr learned my addr 172.21.15.53:0/2914875331 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/2914875331 >> v2:172.21.15.87:3300/0 conn(0x7fab8c06aa60 0x7fab8c06a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab83fff640 1 -- 172.21.15.53:0/2914875331 >> v2:172.21.15.87:3300/0 conn(0x7fab8c06aa60 msgr2=0x7fab8c06a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab83fff640 1 --2- 172.21.15.53:0/2914875331 >> v2:172.21.15.87:3300/0 conn(0x7fab8c06aa60 0x7fab8c06a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab83fff640 1 -- 172.21.15.53:0/2914875331 >> v1:172.21.15.87:6789/0 conn(0x7fab8c15dbe0 legacy=0x7fab8c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.293+0000 7fab83fff640 1 -- 172.21.15.53:0/2914875331 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0d0600 con 0x7fab8c06ae40 2024-09-13T18:33:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab83fff640 1 --2- 172.21.15.53:0/2914875331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c06ae40 0x7fab8c15d6a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec433f42b50451c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab8affd640 1 -- 172.21.15.53:0/2914875331 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab740ab600 con 0x7fab8c06ae40 2024-09-13T18:33:17.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab8affd640 1 -- 172.21.15.53:0/2914875331 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab740a7050 con 0x7fab8c06ae40 2024-09-13T18:33:17.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab8affd640 1 -- 172.21.15.53:0/2914875331 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab740ab980 con 0x7fab8c06ae40 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 -- 172.21.15.53:0/2914875331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c06ae40 msgr2=0x7fab8c15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 --2- 172.21.15.53:0/2914875331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c06ae40 0x7fab8c15d6a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7401c560 comp rx=0 tx=0).stop 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 -- 172.21.15.53:0/2914875331 shutdown_connections 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 --2- 172.21.15.53:0/2914875331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c06ae40 0x7fab8c15d6a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 --2- 172.21.15.53:0/2914875331 >> v2:172.21.15.87:3300/0 conn(0x7fab8c06aa60 0x7fab8c06a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 -- 172.21.15.53:0/2914875331 >> 172.21.15.53:0/2914875331 conn(0x7fab8c071a70 msgr2=0x7fab8c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 -- 172.21.15.53:0/2914875331 shutdown_connections 2024-09-13T18:33:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 -- 172.21.15.53:0/2914875331 wait complete. 2024-09-13T18:33:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 Processor -- start 2024-09-13T18:33:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.297+0000 7fab91d38640 1 -- start start 2024-09-13T18:33:17.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8c06aa60 0x7fab8c0aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c06ae40 0x7fab8c14ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c15dbe0 0x7fab8c0ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0af020 con 0x7fab8c06ae40 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c149f10 con 0x7fab8c06aa60 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c149690 con 0x7fab8c15dbe0 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c06ae40 0x7fab8c14ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c06ae40 0x7fab8c14ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32952/0 (socket says 172.21.15.53:32952) 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 -- 172.21.15.53:0/2849604687 learned_addr learned my addr 172.21.15.53:0/2849604687 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8c06aa60 0x7fab8c0aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab8bfff640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c15dbe0 0x7fab8c0ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 -- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c15dbe0 msgr2=0x7fab8c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c15dbe0 0x7fab8c0ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 -- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8c06aa60 msgr2=0x7fab8c0aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8c06aa60 0x7fab8c0aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 -- 172.21.15.53:0/2849604687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740094d0 con 0x7fab8c06ae40 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab83fff640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c06ae40 0x7fab8c14ade0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fab740ae040 tx=0x7fab74019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab88ff9640 1 -- 172.21.15.53:0/2849604687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab740b4420 con 0x7fab8c06ae40 2024-09-13T18:33:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab88ff9640 1 -- 172.21.15.53:0/2849604687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab740b4580 con 0x7fab8c06ae40 2024-09-13T18:33:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 -- 172.21.15.53:0/2849604687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c06b400 con 0x7fab8c06ae40 2024-09-13T18:33:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab88ff9640 1 -- 172.21.15.53:0/2849604687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab740b4930 con 0x7fab8c06ae40 2024-09-13T18:33:17.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 -- 172.21.15.53:0/2849604687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c149c30 con 0x7fab8c06ae40 2024-09-13T18:33:17.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab91d38640 1 -- 172.21.15.53:0/2849604687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c159bc0 con 0x7fab8c06ae40 2024-09-13T18:33:17.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab88ff9640 1 -- 172.21.15.53:0/2849604687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fab740b2070 con 0x7fab8c06ae40 2024-09-13T18:33:17.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab88ff9640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fab6c066cc0 0x7fab6c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab88ff9640 1 -- 172.21.15.53:0/2849604687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fab7411e070 con 0x7fab8c06ae40 2024-09-13T18:33:17.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.301+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fab6c066cc0 0x7fab6c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.305+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fab6c066cc0 0x7fab6c069180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009b60 tx=0x7fab7c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.309+0000 7fab88ff9640 1 -- 172.21.15.53:0/2849604687 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab740eac30 con 0x7fab8c06ae40 2024-09-13T18:33:17.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.501+0000 7fab91d38640 1 -- 172.21.15.53:0/2849604687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab8c159bc0 con 0x7fab8c06ae40 2024-09-13T18:33:17.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.513+0000 7fab88ff9640 1 -- 172.21.15.53:0/2849604687 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v84) v1 ==== 174+0+0 (secure 0 0 0) 0x7fab8c159bc0 con 0x7fab8c06ae40 2024-09-13T18:33:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 22 and data pool 23 2024-09-13T18:33:17.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 -- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fab6c066cc0 msgr2=0x7fab6c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fab6c066cc0 0x7fab6c069180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009b60 tx=0x7fab7c009190 comp rx=0 tx=0).stop 2024-09-13T18:33:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 -- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c06ae40 msgr2=0x7fab8c14ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c06ae40 0x7fab8c14ade0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fab740ae040 tx=0x7fab74019300 comp rx=0 tx=0).stop 2024-09-13T18:33:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 -- 172.21.15.53:0/2849604687 shutdown_connections 2024-09-13T18:33:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fab6c066cc0 0x7fab6c069180 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab8c15dbe0 0x7fab8c0ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c06ae40 0x7fab8c14ade0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 --2- 172.21.15.53:0/2849604687 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8c06aa60 0x7fab8c0aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 -- 172.21.15.53:0/2849604687 >> 172.21.15.53:0/2849604687 conn(0x7fab8c071a70 msgr2=0x7fab8c0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:17.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 -- 172.21.15.53:0/2849604687 shutdown_connections 2024-09-13T18:33:17.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.521+0000 7fab81ffb640 1 -- 172.21.15.53:0/2849604687 wait complete. 2024-09-13T18:33:17.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:17.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.665+0000 7f69b69d5640 1 Processor -- start 2024-09-13T18:33:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.665+0000 7f69b69d5640 1 -- start start 2024-09-13T18:33:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69b69d5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69b01582a0 0x7f69b006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69b69d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69b69d5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b006d480 con 0x7f69b015b7c0 2024-09-13T18:33:17.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69b69d5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b015aaf0 con 0x7f69b01582a0 2024-09-13T18:33:17.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69b69d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b006d760 con 0x7f69b00713a0 2024-09-13T18:33:17.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69affff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69b01582a0 0x7f69b006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69b4f72640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69affff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69b01582a0 0x7f69b006c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:40694/0 (socket says 172.21.15.53:40694) 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69af7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f69b015b7c0 0x7f69b0070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:41856/0 (socket says 172.21.15.53:41856) 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69affff640 1 -- 172.21.15.53:0/3804554862 learned_addr learned my addr 172.21.15.53:0/3804554862 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69affff640 1 -- 172.21.15.53:0/3804554862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 msgr2=0x7f69b006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69affff640 1 --2- 172.21.15.53:0/3804554862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69affff640 1 -- 172.21.15.53:0/3804554862 >> v1:172.21.15.87:6789/0 conn(0x7f69b015b7c0 legacy=0x7f69b0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.669+0000 7f69affff640 1 -- 172.21.15.53:0/3804554862 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b015ace0 con 0x7f69b01582a0 2024-09-13T18:33:17.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69affff640 1 --2- 172.21.15.53:0/3804554862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b01582a0 0x7f69b006c900 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6998009870 tx=0x7f699801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff9fe71d3780bf5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69aeffd640 1 -- 172.21.15.53:0/3804554862 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69980a95f0 con 0x7f69b01582a0 2024-09-13T18:33:17.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69aeffd640 1 -- 172.21.15.53:0/3804554862 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69980a9750 con 0x7f69b01582a0 2024-09-13T18:33:17.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69aeffd640 1 -- 172.21.15.53:0/3804554862 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69980a9ae0 con 0x7f69b01582a0 2024-09-13T18:33:17.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 -- 172.21.15.53:0/3804554862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b01582a0 msgr2=0x7f69b006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 --2- 172.21.15.53:0/3804554862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b01582a0 0x7f69b006c900 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6998009870 tx=0x7f699801c530 comp rx=0 tx=0).stop 2024-09-13T18:33:17.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 -- 172.21.15.53:0/3804554862 shutdown_connections 2024-09-13T18:33:17.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 --2- 172.21.15.53:0/3804554862 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 --2- 172.21.15.53:0/3804554862 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b01582a0 0x7f69b006c900 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 -- 172.21.15.53:0/3804554862 >> 172.21.15.53:0/3804554862 conn(0x7f69b0065c80 msgr2=0x7f69b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:17.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 -- 172.21.15.53:0/3804554862 shutdown_connections 2024-09-13T18:33:17.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 -- 172.21.15.53:0/3804554862 wait complete. 2024-09-13T18:33:17.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 Processor -- start 2024-09-13T18:33:17.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.673+0000 7f69b69d5640 1 -- start start 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69b01582a0 0x7f69b0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b015b7c0 0x7f69b014ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0150c00 con 0x7f69b01582a0 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0151020 con 0x7f69b015b7c0 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b015a160 con 0x7f69b00713a0 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69b01582a0 0x7f69b0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69b01582a0 0x7f69b0159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32966/0 (socket says 172.21.15.53:32966) 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 -- 172.21.15.53:0/617978995 learned_addr learned my addr 172.21.15.53:0/617978995 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b4f72640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b015b7c0 0x7f69b014ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69affff640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 -- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 msgr2=0x7f69b00cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b00cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 -- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b015b7c0 msgr2=0x7f69b014ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b015b7c0 0x7f69b014ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 -- 172.21.15.53:0/617978995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980094d0 con 0x7f69b01582a0 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69af7fe640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69b01582a0 0x7f69b0159c20 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f69a000c370 tx=0x7f69a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69acff9640 1 -- 172.21.15.53:0/617978995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a00074e0 con 0x7f69b01582a0 2024-09-13T18:33:17.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69acff9640 1 -- 172.21.15.53:0/617978995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a0007640 con 0x7f69b01582a0 2024-09-13T18:33:17.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69acff9640 1 -- 172.21.15.53:0/617978995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0004a30 con 0x7f69b01582a0 2024-09-13T18:33:17.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b015a420 con 0x7f69b01582a0 2024-09-13T18:33:17.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b0150540 con 0x7f69b01582a0 2024-09-13T18:33:17.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b0067400 con 0x7f69b01582a0 2024-09-13T18:33:17.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.677+0000 7f69acff9640 1 -- 172.21.15.53:0/617978995 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f69a0004b90 con 0x7f69b01582a0 2024-09-13T18:33:17.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.681+0000 7f69acff9640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6990066cc0 0x7f6990069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.681+0000 7f69acff9640 1 -- 172.21.15.53:0/617978995 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69a0084550 con 0x7f69b01582a0 2024-09-13T18:33:17.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.681+0000 7f69affff640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6990066cc0 0x7f6990069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.681+0000 7f69affff640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6990066cc0 0x7f6990069180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f69980ae000 tx=0x7f69980b3040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.685+0000 7f69acff9640 1 -- 172.21.15.53:0/617978995 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69a0051010 con 0x7f69b01582a0 2024-09-13T18:33:17.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.845+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69b0150d40 con 0x7f69b01582a0 2024-09-13T18:33:17.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69acff9640 1 -- 172.21.15.53:0/617978995 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16524 (secure 0 0 0) 0x7f69b0150d40 con 0x7f69b01582a0 2024-09-13T18:33:17.849 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:17.849 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":149,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:17.507234+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:17.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6990066cc0 msgr2=0x7f6990069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6990066cc0 0x7f6990069180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f69980ae000 tx=0x7f69980b3040 comp rx=0 tx=0).stop 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69b01582a0 msgr2=0x7f69b0159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69b01582a0 0x7f69b0159c20 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f69a000c370 tx=0x7f69a000c830 comp rx=0 tx=0).stop 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 shutdown_connections 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6990066cc0 0x7f6990069180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b015b7c0 0x7f69b014ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69b01582a0 0x7f69b0159c20 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 --2- 172.21.15.53:0/617978995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69b00713a0 0x7f69b00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 >> 172.21.15.53:0/617978995 conn(0x7f69b0065c80 msgr2=0x7f69b0156fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 shutdown_connections 2024-09-13T18:33:17.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.849+0000 7f69b69d5640 1 -- 172.21.15.53:0/617978995 wait complete. 2024-09-13T18:33:17.870 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:17.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed271cb640 1 Processor -- start 2024-09-13T18:33:17.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed271cb640 1 -- start start 2024-09-13T18:33:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed271cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed200d19c0 0x7fed200cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed271cb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed200cf600 0x7fed200b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed271cb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed200d2400 con 0x7fed2015cab0 2024-09-13T18:33:17.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed271cb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200cfa90 con 0x7fed200d19c0 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed271cb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed200d1530 con 0x7fed200cf600 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed1ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed200d19c0 0x7fed200cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed1ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed200d19c0 0x7fed200cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32982/0 (socket says 172.21.15.53:32982) 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed1ffff640 1 -- 172.21.15.53:0/1983224495 learned_addr learned my addr 172.21.15.53:0/1983224495 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed25768640 1 --2- 172.21.15.53:0/1983224495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed200cf600 0x7fed200b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed1ffff640 1 -- 172.21.15.53:0/1983224495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed200cf600 msgr2=0x7fed200b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed1ffff640 1 --2- 172.21.15.53:0/1983224495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed200cf600 0x7fed200b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed1ffff640 1 -- 172.21.15.53:0/1983224495 >> v1:172.21.15.87:6789/0 conn(0x7fed2015cab0 legacy=0x7fed200cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:17.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.989+0000 7fed1ffff640 1 -- 172.21.15.53:0/1983224495 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200cddd0 con 0x7fed200d19c0 2024-09-13T18:33:17.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed1ffff640 1 --2- 172.21.15.53:0/1983224495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200d19c0 0x7fed200cf0c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fed08009e50 tx=0x7fed0801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7647702c3f0ef3ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed1f7fe640 1 -- 172.21.15.53:0/1983224495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080a5760 con 0x7fed200d19c0 2024-09-13T18:33:17.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed1f7fe640 1 -- 172.21.15.53:0/1983224495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080a58c0 con 0x7fed200d19c0 2024-09-13T18:33:17.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed1f7fe640 1 -- 172.21.15.53:0/1983224495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080a5c50 con 0x7fed200d19c0 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- 172.21.15.53:0/1983224495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200d19c0 msgr2=0x7fed200cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 --2- 172.21.15.53:0/1983224495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200d19c0 0x7fed200cf0c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fed08009e50 tx=0x7fed0801c9f0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- 172.21.15.53:0/1983224495 shutdown_connections 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 --2- 172.21.15.53:0/1983224495 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed200cf600 0x7fed200b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 --2- 172.21.15.53:0/1983224495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200d19c0 0x7fed200cf0c0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- 172.21.15.53:0/1983224495 >> 172.21.15.53:0/1983224495 conn(0x7fed20065c80 msgr2=0x7fed20066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- 172.21.15.53:0/1983224495 shutdown_connections 2024-09-13T18:33:17.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- 172.21.15.53:0/1983224495 wait complete. 2024-09-13T18:33:17.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 Processor -- start 2024-09-13T18:33:17.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- start start 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200cf600 0x7fed20152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed200d19c0 0x7fed200cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed2015cab0 0x7fed200ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200cd390 con 0x7fed200cf600 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20155390 con 0x7fed200d19c0 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed271cb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed20155670 con 0x7fed2015cab0 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed24f67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200cf600 0x7fed20152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed24f67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200cf600 0x7fed20152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32996/0 (socket says 172.21.15.53:32996) 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed24f67640 1 -- 172.21.15.53:0/2711715866 learned_addr learned my addr 172.21.15.53:0/2711715866 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.993+0000 7fed1ffff640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed200d19c0 0x7fed200cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed25768640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed2015cab0 0x7fed200ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:17.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed24f67640 1 -- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed2015cab0 msgr2=0x7fed200ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed24f67640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed2015cab0 0x7fed200ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed24f67640 1 -- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed200d19c0 msgr2=0x7fed200cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed24f67640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed200d19c0 0x7fed200cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed24f67640 1 -- 172.21.15.53:0/2711715866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08009b30 con 0x7fed200cf600 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed25768640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed2015cab0 0x7fed200ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1ffff640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed200d19c0 0x7fed200cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed24f67640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200cf600 0x7fed20152c20 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fed1000b410 tx=0x7fed1000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1d7fa640 1 -- 172.21.15.53:0/2711715866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10004020 con 0x7fed200cf600 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1d7fa640 1 -- 172.21.15.53:0/2711715866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10004180 con 0x7fed200cf600 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1d7fa640 1 -- 172.21.15.53:0/2711715866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10011630 con 0x7fed200cf600 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed20155950 con 0x7fed200cf600 2024-09-13T18:33:17.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed20155f10 con 0x7fed200cf600 2024-09-13T18:33:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed200b5870 con 0x7fed200cf600 2024-09-13T18:33:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1d7fa640 1 -- 172.21.15.53:0/2711715866 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fed10011790 con 0x7fed200cf600 2024-09-13T18:33:18.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1d7fa640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed00066cf0 0x7fed000691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1d7fa640 1 -- 172.21.15.53:0/2711715866 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed10084a00 con 0x7fed200cf600 2024-09-13T18:33:18.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1ffff640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed00066cf0 0x7fed000691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:17.997+0000 7fed1ffff640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed00066cf0 0x7fed000691b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fed080ae000 tx=0x7fed080a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:18.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.001+0000 7fed1d7fa640 1 -- 172.21.15.53:0/2711715866 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fed10051430 con 0x7fed200cf600 2024-09-13T18:33:18.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.165+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed200b4e10 con 0x7fed200cf600 2024-09-13T18:33:18.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed1d7fa640 1 -- 172.21.15.53:0/2711715866 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16524 (secure 0 0 0) 0x7fed10054a50 con 0x7fed200cf600 2024-09-13T18:33:18.294 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:18.295 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":149,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:17.507234+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed00066cf0 msgr2=0x7fed000691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed00066cf0 0x7fed000691b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fed080ae000 tx=0x7fed080a7070 comp rx=0 tx=0).stop 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200cf600 msgr2=0x7fed20152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200cf600 0x7fed20152c20 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fed1000b410 tx=0x7fed1000b8d0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 shutdown_connections 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fed00066cf0 0x7fed000691b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed2015cab0 0x7fed200ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed200d19c0 0x7fed200cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 --2- 172.21.15.53:0/2711715866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed200cf600 0x7fed20152c20 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 >> 172.21.15.53:0/2711715866 conn(0x7fed20065c80 msgr2=0x7fed200b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 shutdown_connections 2024-09-13T18:33:18.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.169+0000 7fed271cb640 1 -- 172.21.15.53:0/2711715866 wait complete. 2024-09-13T18:33:18.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:33:18.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.429+0000 7f67dde33640 1 Processor -- start 2024-09-13T18:33:18.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67dde33640 1 -- start start 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67dde33640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f67d8157020 0x7f67d806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67dde33640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d806d6e0 con 0x7f67d806d270 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67dde33640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d80715f0 con 0x7f67d8156c40 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67dde33640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d80b15a0 con 0x7f67d8157020 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f67d806d270 0x7f67d806f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39826/0 (socket says 172.21.15.53:39826) 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d7fff640 1 -- 172.21.15.53:0/2629994749 learned_addr learned my addr 172.21.15.53:0/2629994749 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d6ffd640 1 --2- 172.21.15.53:0/2629994749 >> v2:172.21.15.87:3300/0 conn(0x7f67d8157020 0x7f67d806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952998392 0 0) 0x7f67d806d6e0 con 0x7f67d806d270 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c0003530 con 0x7f67d806d270 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4262629093 0 0) 0x7f67c0003530 con 0x7f67d806d270 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 >> v2:172.21.15.87:3300/0 conn(0x7f67d8157020 msgr2=0x7f67d806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 --2- 172.21.15.53:0/2629994749 >> v2:172.21.15.87:3300/0 conn(0x7f67d8157020 0x7f67d806cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 >> v1:172.21.15.87:6789/0 conn(0x7f67d8156c40 legacy=0x7f67d8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d80b1880 con 0x7f67d806d270 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f67d0001a00 con 0x7f67d806d270 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 >> v1:172.21.15.53:6789/0 conn(0x7f67d806d270 legacy=0x7f67d806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67c00047d0 0x7f67c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67c0005190 0x7f67c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80b15a0 con 0x7f67c0003980 2024-09-13T18:33:18.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c000c030 con 0x7f67c00047d0 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c000c1f0 con 0x7f67c0005190 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d77fe640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d6ffd640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67c00047d0 0x7f67c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d7fff640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67c0005190 0x7f67c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d77fe640 1 -- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67c0005190 msgr2=0x7f67c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d77fe640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67c0005190 0x7f67c000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d77fe640 1 -- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67c00047d0 msgr2=0x7f67c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d77fe640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67c00047d0 0x7f67c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d77fe640 1 -- 172.21.15.53:0/2629994749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0003530 con 0x7f67c0003980 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d7fff640 1 -- 172.21.15.53:0/2629994749 reap_dead start 2024-09-13T18:33:18.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.433+0000 7f67d6ffd640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67c00047d0 0x7f67c0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67d77fe640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67c0003da0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001780 tx=0x7f67c801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2021fb0c2d4a59ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c80052d0 con 0x7f67c0003980 2024-09-13T18:33:18.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c80a7050 con 0x7f67c0003980 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67d67fc640 1 -- 172.21.15.53:0/2629994749 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8003600 con 0x7f67c0003980 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 -- 172.21.15.53:0/2629994749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 msgr2=0x7f67c0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67c0003da0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f67c8001780 tx=0x7f67c801c3d0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 -- 172.21.15.53:0/2629994749 shutdown_connections 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 --2- 172.21.15.53:0/2629994749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67c0003da0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 -- 172.21.15.53:0/2629994749 >> 172.21.15.53:0/2629994749 conn(0x7f67d8065c80 msgr2=0x7f67d8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 -- 172.21.15.53:0/2629994749 shutdown_connections 2024-09-13T18:33:18.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 -- 172.21.15.53:0/2629994749 wait complete. 2024-09-13T18:33:18.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 Processor -- start 2024-09-13T18:33:18.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.437+0000 7f67dde33640 1 -- start start 2024-09-13T18:33:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67d815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67d81f61a0 0x7f67d814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67d80acb40 0x7f67d8151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d814d580 con 0x7f67c0003980 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d815b3f0 con 0x7f67d80acb40 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d815b6d0 con 0x7f67d81f61a0 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67d815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67d815adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33014/0 (socket says 172.21.15.53:33014) 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 -- 172.21.15.53:0/3054955639 learned_addr learned my addr 172.21.15.53:0/3054955639 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d7fff640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67d80acb40 0x7f67d8151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 -- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67d81f61a0 msgr2=0x7f67d814d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67d81f61a0 0x7f67d814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 -- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67d80acb40 msgr2=0x7f67d8151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67d80acb40 0x7f67d8151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 -- 172.21.15.53:0/3054955639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d815b9b0 con 0x7f67c0003980 2024-09-13T18:33:18.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d7fff640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67d80acb40 0x7f67d8151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d77fe640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67d815adc0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f67c8005040 tx=0x7f67c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67bffff640 1 -- 172.21.15.53:0/3054955639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8007140 con 0x7f67c0003980 2024-09-13T18:33:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67bffff640 1 -- 172.21.15.53:0/3054955639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c80072a0 con 0x7f67c0003980 2024-09-13T18:33:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d81514f0 con 0x7f67c0003980 2024-09-13T18:33:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67bffff640 1 -- 172.21.15.53:0/3054955639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8007650 con 0x7f67c0003980 2024-09-13T18:33:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d815bc90 con 0x7f67c0003980 2024-09-13T18:33:18.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d8070870 con 0x7f67c0003980 2024-09-13T18:33:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67bffff640 1 -- 172.21.15.53:0/3054955639 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f67c80067e0 con 0x7f67c0003980 2024-09-13T18:33:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67bffff640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67c4066cc0 0x7f67c4069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67bffff640 1 -- 172.21.15.53:0/3054955639 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67c811f050 con 0x7f67c0003980 2024-09-13T18:33:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.441+0000 7f67d6ffd640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67c4066cc0 0x7f67c4069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:18.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.445+0000 7f67d6ffd640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67c4066cc0 0x7f67c4069180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f67d8070bb0 tx=0x7f67cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:18.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.445+0000 7f67bffff640 1 -- 172.21.15.53:0/3054955639 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f67c80ef520 con 0x7f67c0003980 2024-09-13T18:33:18.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:18.637+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f67d815b810 con 0x7f67c0003980 2024-09-13T18:33:19.106 INFO:tasks.ceph.mds.c.smithi053.stderr:2024-09-13T18:33:19.105+0000 7fe98b7f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:33:19.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.529+0000 7f67bffff640 1 -- 172.21.15.53:0/3054955639 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) v1 ==== 118+0+0 (secure 0 0 0) 0x7f67d815b810 con 0x7f67c0003980 2024-09-13T18:33:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67c4066cc0 msgr2=0x7f67c4069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67c4066cc0 0x7f67c4069180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f67d8070bb0 tx=0x7f67cc008040 comp rx=0 tx=0).stop 2024-09-13T18:33:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 msgr2=0x7f67d815adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67d815adc0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f67c8005040 tx=0x7f67c0005800 comp rx=0 tx=0).stop 2024-09-13T18:33:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 shutdown_connections 2024-09-13T18:33:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f67c4066cc0 0x7f67c4069180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f67d81f61a0 0x7f67d814d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67d80acb40 0x7f67d8151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 --2- 172.21.15.53:0/3054955639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67c0003980 0x7f67d815adc0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 >> 172.21.15.53:0/3054955639 conn(0x7f67d8065c80 msgr2=0x7f67d806fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 shutdown_connections 2024-09-13T18:33:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.533+0000 7f67dde33640 1 -- 172.21.15.53:0/3054955639 wait complete. 2024-09-13T18:33:19.559 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:33:19.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:33:19.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc4182f640 1 Processor -- start 2024-09-13T18:33:19.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc4182f640 1 -- start start 2024-09-13T18:33:19.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc4182f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc4182f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbc3c0b1d80 0x7fbc3c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc4182f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c15cd20 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc4182f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0d02b0 con 0x7fbc3c0b1d80 2024-09-13T18:33:19.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc4182f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0c9be0 con 0x7fbc3c15c940 2024-09-13T18:33:19.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3affd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3a7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbc3c0b1d80 0x7fbc3c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbc3c0b2d00 0x7fbc3c0b0050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:41886/0 (socket says 172.21.15.53:41886) 2024-09-13T18:33:19.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3b7fe640 1 -- 172.21.15.53:0/1275662558 learned_addr learned my addr 172.21.15.53:0/1275662558 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:19.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3affd640 1 -- 172.21.15.53:0/1275662558 >> v2:172.21.15.87:3300/0 conn(0x7fbc3c0b1d80 msgr2=0x7fbc3c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:19.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3affd640 1 --2- 172.21.15.53:0/1275662558 >> v2:172.21.15.87:3300/0 conn(0x7fbc3c0b1d80 0x7fbc3c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3affd640 1 -- 172.21.15.53:0/1275662558 >> v1:172.21.15.87:6789/0 conn(0x7fbc3c0b2d00 legacy=0x7fbc3c0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.693+0000 7fbc3affd640 1 -- 172.21.15.53:0/1275662558 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0c9ec0 con 0x7fbc3c15c940 2024-09-13T18:33:19.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc3affd640 1 --2- 172.21.15.53:0/1275662558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c0cf830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009d90 tx=0x7fbc2c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33c1e042abcd931c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc39ffb640 1 -- 172.21.15.53:0/1275662558 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0a5a00 con 0x7fbc3c15c940 2024-09-13T18:33:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc39ffb640 1 -- 172.21.15.53:0/1275662558 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c0a5b60 con 0x7fbc3c15c940 2024-09-13T18:33:19.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc39ffb640 1 -- 172.21.15.53:0/1275662558 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0ad440 con 0x7fbc3c15c940 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- 172.21.15.53:0/1275662558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 msgr2=0x7fbc3c0cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 --2- 172.21.15.53:0/1275662558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c0cf830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009d90 tx=0x7fbc2c01c940 comp rx=0 tx=0).stop 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- 172.21.15.53:0/1275662558 shutdown_connections 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 --2- 172.21.15.53:0/1275662558 >> v2:172.21.15.87:3300/0 conn(0x7fbc3c0b1d80 0x7fbc3c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 --2- 172.21.15.53:0/1275662558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c0cf830 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- 172.21.15.53:0/1275662558 >> 172.21.15.53:0/1275662558 conn(0x7fbc3c0b21e0 msgr2=0x7fbc3c0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- 172.21.15.53:0/1275662558 shutdown_connections 2024-09-13T18:33:19.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- 172.21.15.53:0/1275662558 wait complete. 2024-09-13T18:33:19.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 Processor -- start 2024-09-13T18:33:19.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- start start 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc3c0b1d80 0x7fbc3c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3c0b2d00 0x7fbc3c152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ad4c0 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0af120 con 0x7fbc3c0b1d80 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.697+0000 7fbc4182f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ad710 con 0x7fbc3c15c940 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3c0b2d00 0x7fbc3c152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3c0b2d00 0x7fbc3c152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33024/0 (socket says 172.21.15.53:33024) 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 -- 172.21.15.53:0/846376871 learned_addr learned my addr 172.21.15.53:0/846376871 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3affd640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc3c0b1d80 0x7fbc3c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3b7fe640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 -- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 msgr2=0x7fbc3c152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 -- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc3c0b1d80 msgr2=0x7fbc3c0aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc3c0b1d80 0x7fbc3c0aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 -- 172.21.15.53:0/846376871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009a70 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3b7fe640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3a7fc640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3c0b2d00 0x7fbc3c152240 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400e870 tx=0x7fbc2400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc33fff640 1 -- 172.21.15.53:0/846376871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400ee60 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc33fff640 1 -- 172.21.15.53:0/846376871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2400c940 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c0ad9f0 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc33fff640 1 -- 172.21.15.53:0/846376871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400ccb0 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c0adfb0 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c0ae140 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc33fff640 1 -- 172.21.15.53:0/846376871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fbc24013470 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc33fff640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc1c066cc0 0x7fbc1c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc33fff640 1 -- 172.21.15.53:0/846376871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc24084cf0 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3affd640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc1c066cc0 0x7fbc1c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.701+0000 7fbc3affd640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc1c066cc0 0x7fbc1c069180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0af000 tx=0x7fbc2c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.709+0000 7fbc33fff640 1 -- 172.21.15.53:0/846376871 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc240517d0 con 0x7fbc3c0b2d00 2024-09-13T18:33:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:19.897+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbc3c153990 con 0x7fbc3c0b2d00 2024-09-13T18:33:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.537+0000 7fbc33fff640 1 -- 172.21.15.53:0/846376871 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbc240170c0 con 0x7fbc3c0b2d00 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc1c066cc0 msgr2=0x7fbc1c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc1c066cc0 0x7fbc1c069180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0af000 tx=0x7fbc2c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3c0b2d00 msgr2=0x7fbc3c152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3c0b2d00 0x7fbc3c152240 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400e870 tx=0x7fbc2400ed30 comp rx=0 tx=0).stop 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 shutdown_connections 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc1c066cc0 0x7fbc1c069180 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc3c15c940 0x7fbc3c152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3c0b2d00 0x7fbc3c152240 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 --2- 172.21.15.53:0/846376871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc3c0b1d80 0x7fbc3c0aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 >> 172.21.15.53:0/846376871 conn(0x7fbc3c0b21e0 msgr2=0x7fbc3c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 shutdown_connections 2024-09-13T18:33:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.541+0000 7fbc4182f640 1 -- 172.21.15.53:0/846376871 wait complete. 2024-09-13T18:33:20.566 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:33:20.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:20.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.689+0000 7f1c7bfad640 1 Processor -- start 2024-09-13T18:33:20.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.689+0000 7f1c7bfad640 1 -- start start 2024-09-13T18:33:20.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7bfad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 0x7f1c740b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7bfad640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1c740cbd60 0x7f1c740cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7bfad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c740b1ac0 con 0x7f1c740cb980 2024-09-13T18:33:20.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7bfad640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c740b3010 con 0x7f1c740cbd60 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7bfad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c74159ac0 con 0x7f1c7406b850 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79d49640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1c740cb980 0x7f1c7406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39840/0 (socket says 172.21.15.53:39840) 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79d49640 1 -- 172.21.15.53:0/3171965686 learned_addr learned my addr 172.21.15.53:0/3171965686 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7a54a640 1 --2- 172.21.15.53:0/3171965686 >> v2:172.21.15.87:3300/0 conn(0x7f1c740cbd60 0x7f1c740cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686982693 0 0) 0x7f1c740b1ac0 con 0x7f1c740cb980 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79548640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 0x7f1c740b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c60003530 con 0x7f1c740cb980 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586848907 0 0) 0x7f1c60003530 con 0x7f1c740cb980 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 msgr2=0x7f1c740b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 0x7f1c740b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 >> v2:172.21.15.87:3300/0 conn(0x7f1c740cbd60 msgr2=0x7f1c740cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 --2- 172.21.15.53:0/3171965686 >> v2:172.21.15.87:3300/0 conn(0x7f1c740cbd60 0x7f1c740cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74159da0 con 0x7f1c740cb980 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f1c70001680 con 0x7f1c740cb980 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 >> v1:172.21.15.53:6789/0 conn(0x7f1c740cb980 legacy=0x7f1c7406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c60003980 0x7f1c60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c600047d0 0x7f1c60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 0x7f1c60005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740b3010 con 0x7f1c600047d0 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c74159ac0 con 0x7f1c60003980 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6000b990 con 0x7f1c7406b850 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79548640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c600047d0 0x7f1c60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7a54a640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 0x7f1c60005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79d49640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c60003980 0x7f1c60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79548640 1 -- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 msgr2=0x7f1c60005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79548640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 0x7f1c60005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79548640 1 -- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c60003980 msgr2=0x7f1c60003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:20.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79548640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c60003980 0x7f1c60003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c79548640 1 -- 172.21.15.53:0/3171965686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60003530 con 0x7f1c600047d0 2024-09-13T18:33:20.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.693+0000 7f1c7a54a640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c7406b850 0x7f1c60005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c600047d0 0x7f1c60004c50 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009ae0 tx=0x7f1c6401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0fad97ce60c893 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640a6500 con 0x7f1c600047d0 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640a6660 con 0x7f1c600047d0 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c78d47640 1 -- 172.21.15.53:0/3171965686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640a6a10 con 0x7f1c600047d0 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- 172.21.15.53:0/3171965686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c600047d0 msgr2=0x7f1c60004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 --2- 172.21.15.53:0/3171965686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c600047d0 0x7f1c60004c50 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009ae0 tx=0x7f1c6401ca00 comp rx=0 tx=0).stop 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7a54a640 1 -- 172.21.15.53:0/3171965686 reap_dead start 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- 172.21.15.53:0/3171965686 shutdown_connections 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- 172.21.15.53:0/3171965686 >> 172.21.15.53:0/3171965686 conn(0x7f1c74065c80 msgr2=0x7f1c74066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- 172.21.15.53:0/3171965686 shutdown_connections 2024-09-13T18:33:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- 172.21.15.53:0/3171965686 wait complete. 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 Processor -- start 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- start start 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c600047d0 0x7f1c741f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7414c410 0x7f1c7414d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c74144b10 0x7f1c7415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c741463e0 con 0x7f1c7414c410 2024-09-13T18:33:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7414d870 con 0x7f1c600047d0 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7bfad640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7414daa0 con 0x7f1c74144b10 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7414c410 0x7f1c7414d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7414c410 0x7f1c7414d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33036/0 (socket says 172.21.15.53:33036) 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 -- 172.21.15.53:0/2398260392 learned_addr learned my addr 172.21.15.53:0/2398260392 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79d49640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c600047d0 0x7f1c741f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7a54a640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c74144b10 0x7f1c7415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 -- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c74144b10 msgr2=0x7f1c7415bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c74144b10 0x7f1c7415bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 -- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c600047d0 msgr2=0x7f1c741f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c600047d0 0x7f1c741f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c79548640 1 -- 172.21.15.53:0/2398260392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74145a40 con 0x7f1c7414c410 2024-09-13T18:33:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.697+0000 7f1c7a54a640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c74144b10 0x7f1c7415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c79548640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7414c410 0x7f1c7414d330 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f1c6401c830 tx=0x7f1c60005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c6a7fc640 1 -- 172.21.15.53:0/2398260392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640a69d0 con 0x7f1c7414c410 2024-09-13T18:33:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c6a7fc640 1 -- 172.21.15.53:0/2398260392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640a6b50 con 0x7f1c7414c410 2024-09-13T18:33:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c74145d20 con 0x7f1c7414c410 2024-09-13T18:33:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c6a7fc640 1 -- 172.21.15.53:0/2398260392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400f0c0 con 0x7f1c7414c410 2024-09-13T18:33:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c74144f90 con 0x7f1c7414c410 2024-09-13T18:33:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c74067400 con 0x7f1c7414c410 2024-09-13T18:33:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c6a7fc640 1 -- 172.21.15.53:0/2398260392 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f1c64006040 con 0x7f1c7414c410 2024-09-13T18:33:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c6a7fc640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1c58066cf0 0x7f1c580691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c6a7fc640 1 -- 172.21.15.53:0/2398260392 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c640aa070 con 0x7f1c7414c410 2024-09-13T18:33:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c79d49640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1c58066cf0 0x7f1c580691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.701+0000 7f1c79d49640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1c58066cf0 0x7f1c580691b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c70000fc0 tx=0x7f1c70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:20.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.705+0000 7f1c6a7fc640 1 -- 172.21.15.53:0/2398260392 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c640ec590 con 0x7f1c7414c410 2024-09-13T18:33:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.901+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c740cdd40 con 0x7f1c7414c410 2024-09-13T18:33:20.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.901+0000 7f1c6a7fc640 1 -- 172.21.15.53:0/2398260392 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f1c640efbb0 con 0x7f1c7414c410 2024-09-13T18:33:20.904 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:20.904 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/234820268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":234820268},{"type":"v1","addr":"172.21.15.87:6835","nonce":234820268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2552754296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2552754296},{"type":"v1","addr":"172.21.15.87:6833","nonce":2552754296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1877336010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1877336010},{"type":"v1","addr":"172.21.15.53:6833","nonce":1877336010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:17.507989+0000","modified":"2024-09-13T18:33:20.527909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9555},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9555":{"gid":9555,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1614413719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1614413719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1614413719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:33:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 88 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1c58066cf0 msgr2=0x7f1c580691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1c58066cf0 0x7f1c580691b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c70000fc0 tx=0x7f1c70009040 comp rx=0 tx=0).stop 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7414c410 msgr2=0x7f1c7414d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7414c410 0x7f1c7414d330 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f1c6401c830 tx=0x7f1c60005800 comp rx=0 tx=0).stop 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 shutdown_connections 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1c58066cf0 0x7f1c580691b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1c74144b10 0x7f1c7415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c7414c410 0x7f1c7414d330 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 --2- 172.21.15.53:0/2398260392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c600047d0 0x7f1c741f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 >> 172.21.15.53:0/2398260392 conn(0x7f1c74065c80 msgr2=0x7f1c740cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 shutdown_connections 2024-09-13T18:33:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:20.905+0000 7f1c7bfad640 1 -- 172.21.15.53:0/2398260392 wait complete. 2024-09-13T18:33:20.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81e46c640 1 Processor -- start 2024-09-13T18:33:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81e46c640 1 -- start start 2024-09-13T18:33:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81e46c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe81815b7c0 0x7fe818070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81e46c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81806d480 con 0x7fe8181582a0 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81e46c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81815ace0 con 0x7fe8180711d0 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81e46c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe818071680 con 0x7fe81815b7c0 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe817fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe8181582a0 0x7fe81806c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39842/0 (socket says 172.21.15.53:39842) 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe817fff640 1 -- 172.21.15.53:0/874145476 learned_addr learned my addr 172.21.15.53:0/874145476 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe8177fe640 1 --2- 172.21.15.53:0/874145476 >> v2:172.21.15.87:3300/0 conn(0x7fe81815b7c0 0x7fe818070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088131647 0 0) 0x7fe81806d480 con 0x7fe8181582a0 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe800003530 con 0x7fe8181582a0 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341000151 0 0) 0x7fe800003530 con 0x7fe8181582a0 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 >> v2:172.21.15.87:3300/0 conn(0x7fe81815b7c0 msgr2=0x7fe818070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 --2- 172.21.15.53:0/874145476 >> v2:172.21.15.87:3300/0 conn(0x7fe81815b7c0 0x7fe818070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 >> v1:172.21.15.87:6789/0 conn(0x7fe8180711d0 legacy=0x7fe8181640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81815afc0 con 0x7fe8181582a0 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe808001680 con 0x7fe8181582a0 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 >> v1:172.21.15.53:6789/0 conn(0x7fe8181582a0 legacy=0x7fe81806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe800003980 0x7fe800003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8000047d0 0x7fe800004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe80000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818071680 con 0x7fe800005190 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80000c030 con 0x7fe800003980 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80000c1f0 con 0x7fe8000047d0 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81ca09640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe80000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe8177fe640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8000047d0 0x7fe800004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81ca09640 1 -- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8000047d0 msgr2=0x7fe800004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81ca09640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8000047d0 0x7fe800004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81ca09640 1 -- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe800003980 msgr2=0x7fe800003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81ca09640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe800003980 0x7fe800003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe81ca09640 1 -- 172.21.15.53:0/874145476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800003530 con 0x7fe800005190 2024-09-13T18:33:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.049+0000 7fe8177fe640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8000047d0 0x7fe800004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81ca09640 1 -- 172.21.15.53:0/874145476 reap_dead start 2024-09-13T18:33:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81ca09640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe80000b990 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fe810001e70 tx=0x7fe81001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea820b1a558a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810003b80 con 0x7fe800005190 2024-09-13T18:33:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe810003d20 con 0x7fe800005190 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe816ffd640 1 -- 172.21.15.53:0/874145476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810005260 con 0x7fe800005190 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 -- 172.21.15.53:0/874145476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 msgr2=0x7fe80000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe80000b990 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fe810001e70 tx=0x7fe81001c780 comp rx=0 tx=0).stop 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 -- 172.21.15.53:0/874145476 shutdown_connections 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 --2- 172.21.15.53:0/874145476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe80000b990 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 -- 172.21.15.53:0/874145476 >> 172.21.15.53:0/874145476 conn(0x7fe818065c80 msgr2=0x7fe818066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 -- 172.21.15.53:0/874145476 shutdown_connections 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 -- 172.21.15.53:0/874145476 wait complete. 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 Processor -- start 2024-09-13T18:33:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.053+0000 7fe81e46c640 1 -- start start 2024-09-13T18:33:21.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe8180c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe818152e70 0x7fe8181599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8180c4da0 0x7fe818152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180c3d00 con 0x7fe800005190 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180c3fe0 con 0x7fe8180c4da0 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180c42c0 con 0x7fe818152e70 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe8180c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe8180c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33056/0 (socket says 172.21.15.53:33056) 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 -- 172.21.15.53:0/1083789380 learned_addr learned my addr 172.21.15.53:0/1083789380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe8177fe640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe818152e70 0x7fe8181599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81ca09640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8180c4da0 0x7fe818152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 -- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe818152e70 msgr2=0x7fe8181599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe818152e70 0x7fe8181599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 -- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8180c4da0 msgr2=0x7fe818152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8180c4da0 0x7fe818152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 -- 172.21.15.53:0/1083789380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180c45a0 con 0x7fe800005190 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe8177fe640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe818152e70 0x7fe8181599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81ca09640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8180c4da0 0x7fe818152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe817fff640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe8180c3390 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c730 tx=0x7fe80800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe814ff9640 1 -- 172.21.15.53:0/1083789380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080072d0 con 0x7fe800005190 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe814ff9640 1 -- 172.21.15.53:0/1083789380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe808007450 con 0x7fe800005190 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe814ff9640 1 -- 172.21.15.53:0/1083789380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080047f0 con 0x7fe800005190 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8180c4880 con 0x7fe800005190 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8180c3aa0 con 0x7fe800005190 2024-09-13T18:33:21.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe818067400 con 0x7fe800005190 2024-09-13T18:33:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe814ff9640 1 -- 172.21.15.53:0/1083789380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fe808004b60 con 0x7fe800005190 2024-09-13T18:33:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe814ff9640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe804066cc0 0x7fe804069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe814ff9640 1 -- 172.21.15.53:0/1083789380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe808084240 con 0x7fe800005190 2024-09-13T18:33:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.057+0000 7fe8177fe640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe804066cc0 0x7fe804069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.061+0000 7fe8177fe640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe804066cc0 0x7fe804069180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe818153290 tx=0x7fe80c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.065+0000 7fe814ff9640 1 -- 172.21.15.53:0/1083789380 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe808050d20 con 0x7fe800005190 2024-09-13T18:33:21.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.217+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe81806c900 con 0x7fe800005190 2024-09-13T18:33:21.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe814ff9640 1 -- 172.21.15.53:0/1083789380 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16511 (secure 0 0 0) 0x7fe808018090 con 0x7fe800005190 2024-09-13T18:33:21.223 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:21.223 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":150,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:18.511005+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe804066cc0 msgr2=0x7fe804069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe804066cc0 0x7fe804069180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe818153290 tx=0x7fe80c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 msgr2=0x7fe8180c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe8180c3390 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c730 tx=0x7fe80800cbf0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 shutdown_connections 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe804066cc0 0x7fe804069180 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe818152e70 0x7fe8181599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8180c4da0 0x7fe818152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 --2- 172.21.15.53:0/1083789380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe800005190 0x7fe8180c3390 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 >> 172.21.15.53:0/1083789380 conn(0x7fe818065c80 msgr2=0x7fe8180cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.221+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 shutdown_connections 2024-09-13T18:33:21.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.225+0000 7fe81e46c640 1 -- 172.21.15.53:0/1083789380 wait complete. 2024-09-13T18:33:21.240 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:33:21.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:33:21.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f8c59640 1 Processor -- start 2024-09-13T18:33:21.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f8c59640 1 -- start start 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f8c59640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47f40cd630 0x7f47f40b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f8c59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f8c59640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f40cfe80 con 0x7f47f40b1af0 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f8c59640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40d0120 con 0x7f47f40cd630 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f8c59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f406ac20 con 0x7f47f406a660 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47f40cd630 0x7f47f40b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f47f40b1af0 0x7f47f4069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39856/0 (socket says 172.21.15.53:39856) 2024-09-13T18:33:21.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f1d9b640 1 -- 172.21.15.53:0/3010947221 learned_addr learned my addr 172.21.15.53:0/3010947221 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:21.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f2d9d640 1 --2- 172.21.15.53:0/3010947221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f259c640 1 -- 172.21.15.53:0/3010947221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 msgr2=0x7f47f40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:21.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f259c640 1 --2- 172.21.15.53:0/3010947221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f40cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f259c640 1 -- 172.21.15.53:0/3010947221 >> v1:172.21.15.53:6789/0 conn(0x7f47f40b1af0 legacy=0x7f47f4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f159a640 1 -- 172.21.15.53:0/3010947221 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419499858 0 0) 0x7f47f40cfe80 con 0x7f47f40b1af0 2024-09-13T18:33:21.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f259c640 1 -- 172.21.15.53:0/3010947221 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f406af00 con 0x7f47f40cd630 2024-09-13T18:33:21.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.361+0000 7f47f2d9d640 1 --2- 172.21.15.53:0/3010947221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f40cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:21.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f259c640 1 --2- 172.21.15.53:0/3010947221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f40b0cf0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097c0 tx=0x7f47e801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476cba5f48cdcc52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f159a640 1 -- 172.21.15.53:0/3010947221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e80ab600 con 0x7f47f40cd630 2024-09-13T18:33:21.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f159a640 1 -- 172.21.15.53:0/3010947221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e80a7050 con 0x7f47f40cd630 2024-09-13T18:33:21.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f159a640 1 -- 172.21.15.53:0/3010947221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e80ab980 con 0x7f47f40cd630 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- 172.21.15.53:0/3010947221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 msgr2=0x7f47f40b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3010947221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f40b0cf0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097c0 tx=0x7f47e801c380 comp rx=0 tx=0).stop 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- 172.21.15.53:0/3010947221 shutdown_connections 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3010947221 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f40cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3010947221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f40b0cf0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- 172.21.15.53:0/3010947221 >> 172.21.15.53:0/3010947221 conn(0x7f47f40b20d0 msgr2=0x7f47f40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- 172.21.15.53:0/3010947221 shutdown_connections 2024-09-13T18:33:21.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- 172.21.15.53:0/3010947221 wait complete. 2024-09-13T18:33:21.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 Processor -- start 2024-09-13T18:33:21.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- start start 2024-09-13T18:33:21.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f40b1af0 0x7f47f40ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f4151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40cb160 con 0x7f47f40cd630 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40cb440 con 0x7f47f40b1af0 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f8c59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40cb720 con 0x7f47f406a660 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f4151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f4151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33074/0 (socket says 172.21.15.53:33074) 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 -- 172.21.15.53:0/3573155632 learned_addr learned my addr 172.21.15.53:0/3573155632 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f259c640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f1d9b640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f40b1af0 0x7f47f40ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 -- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 msgr2=0x7f47f4153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f4153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 -- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f40b1af0 msgr2=0x7f47f40ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f40b1af0 0x7f47f40ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 -- 172.21.15.53:0/3573155632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8009420 con 0x7f47f40cd630 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f1d9b640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f40b1af0 0x7f47f40ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.365+0000 7f47f2d9d640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f4151f90 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00cd50 tx=0x7f47ec00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47e2ffd640 1 -- 172.21.15.53:0/3573155632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00f680 con 0x7f47f40cd630 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47e2ffd640 1 -- 172.21.15.53:0/3573155632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00f800 con 0x7f47f40cd630 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f40cba00 con 0x7f47f40cd630 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47e2ffd640 1 -- 172.21.15.53:0/3573155632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00fbb0 con 0x7f47f40cd630 2024-09-13T18:33:21.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f40cc200 con 0x7f47f40cd630 2024-09-13T18:33:21.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f40cbf20 con 0x7f47f40cd630 2024-09-13T18:33:21.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47e2ffd640 1 -- 172.21.15.53:0/3573155632 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f47ec00b040 con 0x7f47f40cd630 2024-09-13T18:33:21.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47e2ffd640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f47d4066cc0 0x7f47d4069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47e2ffd640 1 -- 172.21.15.53:0/3573155632 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47ec0857b0 con 0x7f47f40cd630 2024-09-13T18:33:21.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47f259c640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f47d4066cc0 0x7f47d4069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.369+0000 7f47f259c640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f47d4066cc0 0x7f47d4069180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f47e80ad000 tx=0x7f47e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.373+0000 7f47e2ffd640 1 -- 172.21.15.53:0/3573155632 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f47ec052160 con 0x7f47f40cd630 2024-09-13T18:33:21.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.529+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47f40cb5b0 con 0x7f47d4066cc0 2024-09-13T18:33:21.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.545+0000 7f47e2ffd640 1 -- 172.21.15.53:0/3573155632 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288312 (secure 0 0 0) 0x7f47f40cb5b0 con 0x7f47d4066cc0 2024-09-13T18:33:21.551 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:21.553 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:33:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f47d4066cc0 msgr2=0x7f47d4069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f47d4066cc0 0x7f47d4069180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f47e80ad000 tx=0x7f47e8008040 comp rx=0 tx=0).stop 2024-09-13T18:33:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 msgr2=0x7f47f4151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f4151f90 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00cd50 tx=0x7f47ec00a650 comp rx=0 tx=0).stop 2024-09-13T18:33:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 shutdown_connections 2024-09-13T18:33:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f47d4066cc0 0x7f47d4069180 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f40cd630 0x7f47f4151f90 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f47f40b1af0 0x7f47f40ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 --2- 172.21.15.53:0/3573155632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f47f406a660 0x7f47f4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 >> 172.21.15.53:0/3573155632 conn(0x7f47f40b20d0 msgr2=0x7f47f406db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 shutdown_connections 2024-09-13T18:33:21.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.549+0000 7f47f8c59640 1 -- 172.21.15.53:0/3573155632 wait complete. 2024-09-13T18:33:21.571 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-13T18:33:19.878445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289264,"kb_used_data":15724,"kb_used_omap":12,"kb_used_meta":273395,"kb_avail":754685456,"statfs":{"total":773094113280,"available":772797906944,"internally_reserved":0,"allocated":16101376,"data_stored":7759491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":279957048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000987"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.574202+0000","last_change":"2024-09-13T18:33:17.572557+0000","last_active":"2024-09-13T18:33:17.574202+0000","last_peered":"2024-09-13T18:33:17.574202+0000","last_clean":"2024-09-13T18:33:17.574202+0000","last_became_active":"2024-09-13T18:33:17.571907+0000","last_became_peered":"2024-09-13T18:33:17.571907+0000","last_unstale":"2024-09-13T18:33:17.574202+0000","last_undegraded":"2024-09-13T18:33:17.574202+0000","last_fullsized":"2024-09-13T18:33:17.574202+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:30.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575647+0000","last_change":"2024-09-13T18:33:17.563203+0000","last_active":"2024-09-13T18:33:17.575647+0000","last_peered":"2024-09-13T18:33:17.575647+0000","last_clean":"2024-09-13T18:33:17.575647+0000","last_became_active":"2024-09-13T18:33:17.562672+0000","last_became_peered":"2024-09-13T18:33:17.562672+0000","last_unstale":"2024-09-13T18:33:17.575647+0000","last_undegraded":"2024-09-13T18:33:17.575647+0000","last_fullsized":"2024-09-13T18:33:17.575647+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:40.029713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571777+0000","last_change":"2024-09-13T18:33:17.564753+0000","last_active":"2024-09-13T18:33:17.571777+0000","last_peered":"2024-09-13T18:33:17.571777+0000","last_clean":"2024-09-13T18:33:17.571777+0000","last_became_active":"2024-09-13T18:33:17.563649+0000","last_became_peered":"2024-09-13T18:33:17.563649+0000","last_unstale":"2024-09-13T18:33:17.571777+0000","last_undegraded":"2024-09-13T18:33:17.571777+0000","last_fullsized":"2024-09-13T18:33:17.571777+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:40.029713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.538489+0000","last_change":"2024-09-13T18:33:17.538166+0000","last_active":"2024-09-13T18:33:17.538489+0000","last_peered":"2024-09-13T18:33:17.538489+0000","last_clean":"2024-09-13T18:33:17.538489+0000","last_became_active":"2024-09-13T18:33:17.537769+0000","last_became_peered":"2024-09-13T18:33:17.537769+0000","last_unstale":"2024-09-13T18:33:17.538489+0000","last_undegraded":"2024-09-13T18:33:17.538489+0000","last_fullsized":"2024-09-13T18:33:17.538489+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:17.679868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575861+0000","last_change":"2024-09-13T18:33:17.565813+0000","last_active":"2024-09-13T18:33:17.575861+0000","last_peered":"2024-09-13T18:33:17.575861+0000","last_clean":"2024-09-13T18:33:17.575861+0000","last_became_active":"2024-09-13T18:33:17.561799+0000","last_became_peered":"2024-09-13T18:33:17.561799+0000","last_unstale":"2024-09-13T18:33:17.575861+0000","last_undegraded":"2024-09-13T18:33:17.575861+0000","last_fullsized":"2024-09-13T18:33:17.575861+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.534595+0000","last_change":"2024-09-13T18:33:17.534094+0000","last_active":"2024-09-13T18:33:17.534595+0000","last_peered":"2024-09-13T18:33:17.534595+0000","last_clean":"2024-09-13T18:33:17.534595+0000","last_became_active":"2024-09-13T18:33:17.533727+0000","last_became_peered":"2024-09-13T18:33:17.533727+0000","last_unstale":"2024-09-13T18:33:17.534595+0000","last_undegraded":"2024-09-13T18:33:17.534595+0000","last_fullsized":"2024-09-13T18:33:17.534595+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:24.977052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.544002+0000","last_change":"2024-09-13T18:33:17.543592+0000","last_active":"2024-09-13T18:33:17.544002+0000","last_peered":"2024-09-13T18:33:17.544002+0000","last_clean":"2024-09-13T18:33:17.544002+0000","last_became_active":"2024-09-13T18:33:17.543339+0000","last_became_peered":"2024-09-13T18:33:17.543339+0000","last_unstale":"2024-09-13T18:33:17.544002+0000","last_undegraded":"2024-09-13T18:33:17.544002+0000","last_fullsized":"2024-09-13T18:33:17.544002+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:07.111779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575778+0000","last_change":"2024-09-13T18:33:17.565367+0000","last_active":"2024-09-13T18:33:17.575778+0000","last_peered":"2024-09-13T18:33:17.575778+0000","last_clean":"2024-09-13T18:33:17.575778+0000","last_became_active":"2024-09-13T18:33:17.564825+0000","last_became_peered":"2024-09-13T18:33:17.564825+0000","last_unstale":"2024-09-13T18:33:17.575778+0000","last_undegraded":"2024-09-13T18:33:17.575778+0000","last_fullsized":"2024-09-13T18:33:17.575778+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:52.070012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575661+0000","last_change":"2024-09-13T18:33:17.563364+0000","last_active":"2024-09-13T18:33:17.575661+0000","last_peered":"2024-09-13T18:33:17.575661+0000","last_clean":"2024-09-13T18:33:17.575661+0000","last_became_active":"2024-09-13T18:33:17.562626+0000","last_became_peered":"2024-09-13T18:33:17.562626+0000","last_unstale":"2024-09-13T18:33:17.575661+0000","last_undegraded":"2024-09-13T18:33:17.575661+0000","last_fullsized":"2024-09-13T18:33:17.575661+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:41.329165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575566+0000","last_change":"2024-09-13T18:33:17.561925+0000","last_active":"2024-09-13T18:33:17.575566+0000","last_peered":"2024-09-13T18:33:17.575566+0000","last_clean":"2024-09-13T18:33:17.575566+0000","last_became_active":"2024-09-13T18:33:17.561264+0000","last_became_peered":"2024-09-13T18:33:17.561264+0000","last_unstale":"2024-09-13T18:33:17.575566+0000","last_undegraded":"2024-09-13T18:33:17.575566+0000","last_fullsized":"2024-09-13T18:33:17.575566+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:53.007791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575843+0000","last_change":"2024-09-13T18:33:17.565440+0000","last_active":"2024-09-13T18:33:17.575843+0000","last_peered":"2024-09-13T18:33:17.575843+0000","last_clean":"2024-09-13T18:33:17.575843+0000","last_became_active":"2024-09-13T18:33:17.564868+0000","last_became_peered":"2024-09-13T18:33:17.564868+0000","last_unstale":"2024-09-13T18:33:17.575843+0000","last_undegraded":"2024-09-13T18:33:17.575843+0000","last_fullsized":"2024-09-13T18:33:17.575843+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:15.017647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575608+0000","last_change":"2024-09-13T18:33:17.562287+0000","last_active":"2024-09-13T18:33:17.575608+0000","last_peered":"2024-09-13T18:33:17.575608+0000","last_clean":"2024-09-13T18:33:17.575608+0000","last_became_active":"2024-09-13T18:33:17.561472+0000","last_became_peered":"2024-09-13T18:33:17.561472+0000","last_unstale":"2024-09-13T18:33:17.575608+0000","last_undegraded":"2024-09-13T18:33:17.575608+0000","last_fullsized":"2024-09-13T18:33:17.575608+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:19.575272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.570740+0000","last_change":"2024-09-13T18:33:17.565204+0000","last_active":"2024-09-13T18:33:17.570740+0000","last_peered":"2024-09-13T18:33:17.570740+0000","last_clean":"2024-09-13T18:33:17.570740+0000","last_became_active":"2024-09-13T18:33:17.558240+0000","last_became_peered":"2024-09-13T18:33:17.558240+0000","last_unstale":"2024-09-13T18:33:17.570740+0000","last_undegraded":"2024-09-13T18:33:17.570740+0000","last_fullsized":"2024-09-13T18:33:17.570740+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569817+0000","last_change":"2024-09-13T18:33:17.563081+0000","last_active":"2024-09-13T18:33:17.569817+0000","last_peered":"2024-09-13T18:33:17.569817+0000","last_clean":"2024-09-13T18:33:17.569817+0000","last_became_active":"2024-09-13T18:33:17.559701+0000","last_became_peered":"2024-09-13T18:33:17.559701+0000","last_unstale":"2024-09-13T18:33:17.569817+0000","last_undegraded":"2024-09-13T18:33:17.569817+0000","last_fullsized":"2024-09-13T18:33:17.569817+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:52.070012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.556594+0000","last_change":"2024-09-13T18:33:17.549419+0000","last_active":"2024-09-13T18:33:17.556594+0000","last_peered":"2024-09-13T18:33:17.556594+0000","last_clean":"2024-09-13T18:33:17.556594+0000","last_became_active":"2024-09-13T18:33:17.548590+0000","last_became_peered":"2024-09-13T18:33:17.548590+0000","last_unstale":"2024-09-13T18:33:17.556594+0000","last_undegraded":"2024-09-13T18:33:17.556594+0000","last_fullsized":"2024-09-13T18:33:17.556594+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:13.199266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535925+0000","last_change":"2024-09-13T18:33:17.531543+0000","last_active":"2024-09-13T18:33:17.535925+0000","last_peered":"2024-09-13T18:33:17.535925+0000","last_clean":"2024-09-13T18:33:17.535925+0000","last_became_active":"2024-09-13T18:33:17.531209+0000","last_became_peered":"2024-09-13T18:33:17.531209+0000","last_unstale":"2024-09-13T18:33:17.535925+0000","last_undegraded":"2024-09-13T18:33:17.535925+0000","last_fullsized":"2024-09-13T18:33:17.535925+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:04.645546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571123+0000","last_change":"2024-09-13T18:33:17.570512+0000","last_active":"2024-09-13T18:33:17.571123+0000","last_peered":"2024-09-13T18:33:17.571123+0000","last_clean":"2024-09-13T18:33:17.571123+0000","last_became_active":"2024-09-13T18:33:17.570205+0000","last_became_peered":"2024-09-13T18:33:17.570205+0000","last_unstale":"2024-09-13T18:33:17.571123+0000","last_undegraded":"2024-09-13T18:33:17.571123+0000","last_fullsized":"2024-09-13T18:33:17.571123+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:45.367093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537174+0000","last_change":"2024-09-13T18:33:17.524732+0000","last_active":"2024-09-13T18:33:17.537174+0000","last_peered":"2024-09-13T18:33:17.537174+0000","last_clean":"2024-09-13T18:33:17.537174+0000","last_became_active":"2024-09-13T18:33:17.524477+0000","last_became_peered":"2024-09-13T18:33:17.524477+0000","last_unstale":"2024-09-13T18:33:17.537174+0000","last_undegraded":"2024-09-13T18:33:17.537174+0000","last_fullsized":"2024-09-13T18:33:17.537174+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:46.879049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.528041+0000","last_change":"2024-09-13T18:33:17.523984+0000","last_active":"2024-09-13T18:33:17.528041+0000","last_peered":"2024-09-13T18:33:17.528041+0000","last_clean":"2024-09-13T18:33:17.528041+0000","last_became_active":"2024-09-13T18:33:17.523247+0000","last_became_peered":"2024-09-13T18:33:17.523247+0000","last_unstale":"2024-09-13T18:33:17.528041+0000","last_undegraded":"2024-09-13T18:33:17.528041+0000","last_fullsized":"2024-09-13T18:33:17.528041+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:55.968265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569843+0000","last_change":"2024-09-13T18:33:17.563459+0000","last_active":"2024-09-13T18:33:17.569843+0000","last_peered":"2024-09-13T18:33:17.569843+0000","last_clean":"2024-09-13T18:33:17.569843+0000","last_became_active":"2024-09-13T18:33:17.562820+0000","last_became_peered":"2024-09-13T18:33:17.562820+0000","last_unstale":"2024-09-13T18:33:17.569843+0000","last_undegraded":"2024-09-13T18:33:17.569843+0000","last_fullsized":"2024-09-13T18:33:17.569843+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:19.575272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.558722+0000","last_change":"2024-09-13T18:33:17.558396+0000","last_active":"2024-09-13T18:33:17.558722+0000","last_peered":"2024-09-13T18:33:17.558722+0000","last_clean":"2024-09-13T18:33:17.558722+0000","last_became_active":"2024-09-13T18:33:17.558192+0000","last_became_peered":"2024-09-13T18:33:17.558192+0000","last_unstale":"2024-09-13T18:33:17.558722+0000","last_undegraded":"2024-09-13T18:33:17.558722+0000","last_fullsized":"2024-09-13T18:33:17.558722+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:06.665966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575623+0000","last_change":"2024-09-13T18:33:17.561988+0000","last_active":"2024-09-13T18:33:17.575623+0000","last_peered":"2024-09-13T18:33:17.575623+0000","last_clean":"2024-09-13T18:33:17.575623+0000","last_became_active":"2024-09-13T18:33:17.561421+0000","last_became_peered":"2024-09-13T18:33:17.561421+0000","last_unstale":"2024-09-13T18:33:17.575623+0000","last_undegraded":"2024-09-13T18:33:17.575623+0000","last_fullsized":"2024-09-13T18:33:17.575623+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.220994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.567894+0000","last_change":"2024-09-13T18:33:17.567369+0000","last_active":"2024-09-13T18:33:17.567894+0000","last_peered":"2024-09-13T18:33:17.567894+0000","last_clean":"2024-09-13T18:33:17.567894+0000","last_became_active":"2024-09-13T18:33:17.567081+0000","last_became_peered":"2024-09-13T18:33:17.567081+0000","last_unstale":"2024-09-13T18:33:17.567894+0000","last_undegraded":"2024-09-13T18:33:17.567894+0000","last_fullsized":"2024-09-13T18:33:17.567894+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:05.478542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.576026+0000","last_change":"2024-09-13T18:33:17.572734+0000","last_active":"2024-09-13T18:33:17.576026+0000","last_peered":"2024-09-13T18:33:17.576026+0000","last_clean":"2024-09-13T18:33:17.576026+0000","last_became_active":"2024-09-13T18:33:17.572148+0000","last_became_peered":"2024-09-13T18:33:17.572148+0000","last_unstale":"2024-09-13T18:33:17.576026+0000","last_undegraded":"2024-09-13T18:33:17.576026+0000","last_fullsized":"2024-09-13T18:33:17.576026+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:40.089008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.570046+0000","last_change":"2024-09-13T18:33:17.563842+0000","last_active":"2024-09-13T18:33:17.570046+0000","last_peered":"2024-09-13T18:33:17.570046+0000","last_clean":"2024-09-13T18:33:17.570046+0000","last_became_active":"2024-09-13T18:33:17.558860+0000","last_became_peered":"2024-09-13T18:33:17.558860+0000","last_unstale":"2024-09-13T18:33:17.570046+0000","last_undegraded":"2024-09-13T18:33:17.570046+0000","last_fullsized":"2024-09-13T18:33:17.570046+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:15.017647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535897+0000","last_change":"2024-09-13T18:33:17.532705+0000","last_active":"2024-09-13T18:33:17.535897+0000","last_peered":"2024-09-13T18:33:17.535897+0000","last_clean":"2024-09-13T18:33:17.535897+0000","last_became_active":"2024-09-13T18:33:17.532345+0000","last_became_peered":"2024-09-13T18:33:17.532345+0000","last_unstale":"2024-09-13T18:33:17.535897+0000","last_undegraded":"2024-09-13T18:33:17.535897+0000","last_fullsized":"2024-09-13T18:33:17.535897+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:22.223736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573363+0000","last_change":"2024-09-13T18:33:17.569290+0000","last_active":"2024-09-13T18:33:17.573363+0000","last_peered":"2024-09-13T18:33:17.573363+0000","last_clean":"2024-09-13T18:33:17.573363+0000","last_became_active":"2024-09-13T18:33:17.562926+0000","last_became_peered":"2024-09-13T18:33:17.562926+0000","last_unstale":"2024-09-13T18:33:17.573363+0000","last_undegraded":"2024-09-13T18:33:17.573363+0000","last_fullsized":"2024-09-13T18:33:17.573363+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:50.918958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.550234+0000","last_change":"2024-09-13T18:33:17.549654+0000","last_active":"2024-09-13T18:33:17.550234+0000","last_peered":"2024-09-13T18:33:17.550234+0000","last_clean":"2024-09-13T18:33:17.550234+0000","last_became_active":"2024-09-13T18:33:17.549391+0000","last_became_peered":"2024-09-13T18:33:17.549391+0000","last_unstale":"2024-09-13T18:33:17.550234+0000","last_undegraded":"2024-09-13T18:33:17.550234+0000","last_fullsized":"2024-09-13T18:33:17.550234+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:50.918958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569875+0000","last_change":"2024-09-13T18:33:17.558422+0000","last_active":"2024-09-13T18:33:17.569875+0000","last_peered":"2024-09-13T18:33:17.569875+0000","last_clean":"2024-09-13T18:33:17.569875+0000","last_became_active":"2024-09-13T18:33:17.557617+0000","last_became_peered":"2024-09-13T18:33:17.557617+0000","last_unstale":"2024-09-13T18:33:17.569875+0000","last_undegraded":"2024-09-13T18:33:17.569875+0000","last_fullsized":"2024-09-13T18:33:17.569875+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:35.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.549856+0000","last_change":"2024-09-13T18:33:17.536076+0000","last_active":"2024-09-13T18:33:17.549856+0000","last_peered":"2024-09-13T18:33:17.549856+0000","last_clean":"2024-09-13T18:33:17.549856+0000","last_became_active":"2024-09-13T18:33:17.535390+0000","last_became_peered":"2024-09-13T18:33:17.535390+0000","last_unstale":"2024-09-13T18:33:17.549856+0000","last_undegraded":"2024-09-13T18:33:17.549856+0000","last_fullsized":"2024-09-13T18:33:17.549856+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:09.048275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.548998+0000","last_change":"2024-09-13T18:33:17.535002+0000","last_active":"2024-09-13T18:33:17.548998+0000","last_peered":"2024-09-13T18:33:17.548998+0000","last_clean":"2024-09-13T18:33:17.548998+0000","last_became_active":"2024-09-13T18:33:17.534224+0000","last_became_peered":"2024-09-13T18:33:17.534224+0000","last_unstale":"2024-09-13T18:33:17.548998+0000","last_undegraded":"2024-09-13T18:33:17.548998+0000","last_fullsized":"2024-09-13T18:33:17.548998+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:03.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536041+0000","last_change":"2024-09-13T18:33:17.524190+0000","last_active":"2024-09-13T18:33:17.536041+0000","last_peered":"2024-09-13T18:33:17.536041+0000","last_clean":"2024-09-13T18:33:17.536041+0000","last_became_active":"2024-09-13T18:33:17.523908+0000","last_became_peered":"2024-09-13T18:33:17.523908+0000","last_unstale":"2024-09-13T18:33:17.536041+0000","last_undegraded":"2024-09-13T18:33:17.536041+0000","last_fullsized":"2024-09-13T18:33:17.536041+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:05.309503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535168+0000","last_change":"2024-09-13T18:33:17.529822+0000","last_active":"2024-09-13T18:33:17.535168+0000","last_peered":"2024-09-13T18:33:17.535168+0000","last_clean":"2024-09-13T18:33:17.535168+0000","last_became_active":"2024-09-13T18:33:17.529549+0000","last_became_peered":"2024-09-13T18:33:17.529549+0000","last_unstale":"2024-09-13T18:33:17.535168+0000","last_undegraded":"2024-09-13T18:33:17.535168+0000","last_fullsized":"2024-09-13T18:33:17.535168+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:29.198280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"149'4","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573304+0000","last_change":"2024-09-13T18:33:17.162782+0000","last_active":"2024-09-13T18:33:17.573304+0000","last_peered":"2024-09-13T18:33:17.573304+0000","last_clean":"2024-09-13T18:33:17.573304+0000","last_became_active":"2024-09-13T18:33:17.162209+0000","last_became_peered":"2024-09-13T18:33:17.162209+0000","last_unstale":"2024-09-13T18:33:17.573304+0000","last_undegraded":"2024-09-13T18:33:17.573304+0000","last_fullsized":"2024-09-13T18:33:17.573304+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:08.039234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.549548+0000","last_change":"2024-09-13T18:33:17.539720+0000","last_active":"2024-09-13T18:33:17.549548+0000","last_peered":"2024-09-13T18:33:17.549548+0000","last_clean":"2024-09-13T18:33:17.549548+0000","last_became_active":"2024-09-13T18:33:17.539005+0000","last_became_peered":"2024-09-13T18:33:17.539005+0000","last_unstale":"2024-09-13T18:33:17.549548+0000","last_undegraded":"2024-09-13T18:33:17.549548+0000","last_fullsized":"2024-09-13T18:33:17.549548+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:04.573467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.567801+0000","last_change":"2024-09-13T18:33:17.136603+0000","last_active":"2024-09-13T18:33:17.567801+0000","last_peered":"2024-09-13T18:33:17.567801+0000","last_clean":"2024-09-13T18:33:17.567801+0000","last_became_active":"2024-09-13T18:33:17.135793+0000","last_became_peered":"2024-09-13T18:33:17.135793+0000","last_unstale":"2024-09-13T18:33:17.567801+0000","last_undegraded":"2024-09-13T18:33:17.567801+0000","last_fullsized":"2024-09-13T18:33:17.567801+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:51.998749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.552736+0000","last_change":"2024-09-13T18:33:17.552108+0000","last_active":"2024-09-13T18:33:17.552736+0000","last_peered":"2024-09-13T18:33:17.552736+0000","last_clean":"2024-09-13T18:33:17.552736+0000","last_became_active":"2024-09-13T18:33:17.551866+0000","last_became_peered":"2024-09-13T18:33:17.551866+0000","last_unstale":"2024-09-13T18:33:17.552736+0000","last_undegraded":"2024-09-13T18:33:17.552736+0000","last_fullsized":"2024-09-13T18:33:17.552736+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:20.648903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.545734+0000","last_change":"2024-09-13T18:33:17.147477+0000","last_active":"2024-09-13T18:33:17.545734+0000","last_peered":"2024-09-13T18:33:17.545734+0000","last_clean":"2024-09-13T18:33:17.545734+0000","last_became_active":"2024-09-13T18:33:17.147140+0000","last_became_peered":"2024-09-13T18:33:17.147140+0000","last_unstale":"2024-09-13T18:33:17.545734+0000","last_undegraded":"2024-09-13T18:33:17.545734+0000","last_fullsized":"2024-09-13T18:33:17.545734+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:44.358052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571732+0000","last_change":"2024-09-13T18:33:17.564343+0000","last_active":"2024-09-13T18:33:17.571732+0000","last_peered":"2024-09-13T18:33:17.571732+0000","last_clean":"2024-09-13T18:33:17.571732+0000","last_became_active":"2024-09-13T18:33:17.559173+0000","last_became_peered":"2024-09-13T18:33:17.559173+0000","last_unstale":"2024-09-13T18:33:17.571732+0000","last_undegraded":"2024-09-13T18:33:17.571732+0000","last_fullsized":"2024-09-13T18:33:17.571732+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:17.679868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.556112+0000","last_change":"2024-09-13T18:33:17.150026+0000","last_active":"2024-09-13T18:33:17.556112+0000","last_peered":"2024-09-13T18:33:17.556112+0000","last_clean":"2024-09-13T18:33:17.556112+0000","last_became_active":"2024-09-13T18:33:17.149581+0000","last_became_peered":"2024-09-13T18:33:17.149581+0000","last_unstale":"2024-09-13T18:33:17.556112+0000","last_undegraded":"2024-09-13T18:33:17.556112+0000","last_fullsized":"2024-09-13T18:33:17.556112+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:49.863606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536682+0000","last_change":"2024-09-13T18:33:17.530517+0000","last_active":"2024-09-13T18:33:17.536682+0000","last_peered":"2024-09-13T18:33:17.536682+0000","last_clean":"2024-09-13T18:33:17.536682+0000","last_became_active":"2024-09-13T18:33:17.530266+0000","last_became_peered":"2024-09-13T18:33:17.530266+0000","last_unstale":"2024-09-13T18:33:17.536682+0000","last_undegraded":"2024-09-13T18:33:17.536682+0000","last_fullsized":"2024-09-13T18:33:17.536682+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:03.218111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569722+0000","last_change":"2024-09-13T18:33:17.161467+0000","last_active":"2024-09-13T18:33:17.569722+0000","last_peered":"2024-09-13T18:33:17.569722+0000","last_clean":"2024-09-13T18:33:17.569722+0000","last_became_active":"2024-09-13T18:33:17.160701+0000","last_became_peered":"2024-09-13T18:33:17.160701+0000","last_unstale":"2024-09-13T18:33:17.569722+0000","last_undegraded":"2024-09-13T18:33:17.569722+0000","last_fullsized":"2024-09-13T18:33:17.569722+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:19.639862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.532516+0000","last_change":"2024-09-13T18:33:17.531810+0000","last_active":"2024-09-13T18:33:17.532516+0000","last_peered":"2024-09-13T18:33:17.532516+0000","last_clean":"2024-09-13T18:33:17.532516+0000","last_became_active":"2024-09-13T18:33:17.531555+0000","last_became_peered":"2024-09-13T18:33:17.531555+0000","last_unstale":"2024-09-13T18:33:17.532516+0000","last_undegraded":"2024-09-13T18:33:17.532516+0000","last_fullsized":"2024-09-13T18:33:17.532516+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:49.305324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.530318+0000","last_change":"2024-09-13T18:33:17.143694+0000","last_active":"2024-09-13T18:33:17.530318+0000","last_peered":"2024-09-13T18:33:17.530318+0000","last_clean":"2024-09-13T18:33:17.530318+0000","last_became_active":"2024-09-13T18:33:17.143281+0000","last_became_peered":"2024-09-13T18:33:17.143281+0000","last_unstale":"2024-09-13T18:33:17.530318+0000","last_undegraded":"2024-09-13T18:33:17.530318+0000","last_fullsized":"2024-09-13T18:33:17.530318+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:54.959224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.554633+0000","last_change":"2024-09-13T18:33:17.554175+0000","last_active":"2024-09-13T18:33:17.554633+0000","last_peered":"2024-09-13T18:33:17.554633+0000","last_clean":"2024-09-13T18:33:17.554633+0000","last_became_active":"2024-09-13T18:33:17.553836+0000","last_became_peered":"2024-09-13T18:33:17.553836+0000","last_unstale":"2024-09-13T18:33:17.554633+0000","last_undegraded":"2024-09-13T18:33:17.554633+0000","last_fullsized":"2024-09-13T18:33:17.554633+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:35.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.540947+0000","last_change":"2024-09-13T18:33:17.145133+0000","last_active":"2024-09-13T18:33:17.540947+0000","last_peered":"2024-09-13T18:33:17.540947+0000","last_clean":"2024-09-13T18:33:17.540947+0000","last_became_active":"2024-09-13T18:33:17.143391+0000","last_became_peered":"2024-09-13T18:33:17.143391+0000","last_unstale":"2024-09-13T18:33:17.540947+0000","last_undegraded":"2024-09-13T18:33:17.540947+0000","last_fullsized":"2024-09-13T18:33:17.540947+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:25.318564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.533963+0000","last_change":"2024-09-13T18:33:17.531440+0000","last_active":"2024-09-13T18:33:17.533963+0000","last_peered":"2024-09-13T18:33:17.533963+0000","last_clean":"2024-09-13T18:33:17.533963+0000","last_became_active":"2024-09-13T18:33:17.531189+0000","last_became_peered":"2024-09-13T18:33:17.531189+0000","last_unstale":"2024-09-13T18:33:17.533963+0000","last_undegraded":"2024-09-13T18:33:17.533963+0000","last_fullsized":"2024-09-13T18:33:17.533963+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:30.087136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.519012+0000","last_change":"2024-09-13T18:33:17.137203+0000","last_active":"2024-09-13T18:33:17.519012+0000","last_peered":"2024-09-13T18:33:17.519012+0000","last_clean":"2024-09-13T18:33:17.519012+0000","last_became_active":"2024-09-13T18:33:17.136601+0000","last_became_peered":"2024-09-13T18:33:17.136601+0000","last_unstale":"2024-09-13T18:33:17.519012+0000","last_undegraded":"2024-09-13T18:33:17.519012+0000","last_fullsized":"2024-09-13T18:33:17.519012+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:07.218627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536745+0000","last_change":"2024-09-13T18:33:17.530197+0000","last_active":"2024-09-13T18:33:17.536745+0000","last_peered":"2024-09-13T18:33:17.536745+0000","last_clean":"2024-09-13T18:33:17.536745+0000","last_became_active":"2024-09-13T18:33:17.525097+0000","last_became_peered":"2024-09-13T18:33:17.525097+0000","last_unstale":"2024-09-13T18:33:17.536745+0000","last_undegraded":"2024-09-13T18:33:17.536745+0000","last_fullsized":"2024-09-13T18:33:17.536745+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:22.223736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.521353+0000","last_change":"2024-09-13T18:33:17.158517+0000","last_active":"2024-09-13T18:33:17.521353+0000","last_peered":"2024-09-13T18:33:17.521353+0000","last_clean":"2024-09-13T18:33:17.521353+0000","last_became_active":"2024-09-13T18:33:17.158020+0000","last_became_peered":"2024-09-13T18:33:17.158020+0000","last_unstale":"2024-09-13T18:33:17.521353+0000","last_undegraded":"2024-09-13T18:33:17.521353+0000","last_fullsized":"2024-09-13T18:33:17.521353+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:45.160726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536603+0000","last_change":"2024-09-13T18:33:17.530604+0000","last_active":"2024-09-13T18:33:17.536603+0000","last_peered":"2024-09-13T18:33:17.536603+0000","last_clean":"2024-09-13T18:33:17.536603+0000","last_became_active":"2024-09-13T18:33:17.525088+0000","last_became_peered":"2024-09-13T18:33:17.525088+0000","last_unstale":"2024-09-13T18:33:17.536603+0000","last_undegraded":"2024-09-13T18:33:17.536603+0000","last_fullsized":"2024-09-13T18:33:17.536603+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:07.111779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"149'3","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.533367+0000","last_change":"2024-09-13T18:33:17.139801+0000","last_active":"2024-09-13T18:33:17.533367+0000","last_peered":"2024-09-13T18:33:17.533367+0000","last_clean":"2024-09-13T18:33:17.533367+0000","last_became_active":"2024-09-13T18:33:17.139363+0000","last_became_peered":"2024-09-13T18:33:17.139363+0000","last_unstale":"2024-09-13T18:33:17.533367+0000","last_undegraded":"2024-09-13T18:33:17.533367+0000","last_fullsized":"2024-09-13T18:33:17.533367+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:30.061986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573784+0000","last_change":"2024-09-13T18:33:17.570941+0000","last_active":"2024-09-13T18:33:17.573784+0000","last_peered":"2024-09-13T18:33:17.573784+0000","last_clean":"2024-09-13T18:33:17.573784+0000","last_became_active":"2024-09-13T18:33:17.570273+0000","last_became_peered":"2024-09-13T18:33:17.570273+0000","last_unstale":"2024-09-13T18:33:17.573784+0000","last_undegraded":"2024-09-13T18:33:17.573784+0000","last_fullsized":"2024-09-13T18:33:17.573784+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:55.843882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"149'6","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575122+0000","last_change":"2024-09-13T18:33:17.141557+0000","last_active":"2024-09-13T18:33:17.575122+0000","last_peered":"2024-09-13T18:33:17.575122+0000","last_clean":"2024-09-13T18:33:17.575122+0000","last_became_active":"2024-09-13T18:33:17.140898+0000","last_became_peered":"2024-09-13T18:33:17.140898+0000","last_unstale":"2024-09-13T18:33:17.575122+0000","last_undegraded":"2024-09-13T18:33:17.575122+0000","last_fullsized":"2024-09-13T18:33:17.575122+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.538614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.566123+0000","last_change":"2024-09-13T18:33:17.565808+0000","last_active":"2024-09-13T18:33:17.566123+0000","last_peered":"2024-09-13T18:33:17.566123+0000","last_clean":"2024-09-13T18:33:17.566123+0000","last_became_active":"2024-09-13T18:33:17.565473+0000","last_became_peered":"2024-09-13T18:33:17.565473+0000","last_unstale":"2024-09-13T18:33:17.566123+0000","last_undegraded":"2024-09-13T18:33:17.566123+0000","last_fullsized":"2024-09-13T18:33:17.566123+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:03.218111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537594+0000","last_change":"2024-09-13T18:33:17.142768+0000","last_active":"2024-09-13T18:33:17.537594+0000","last_peered":"2024-09-13T18:33:17.537594+0000","last_clean":"2024-09-13T18:33:17.537594+0000","last_became_active":"2024-09-13T18:33:17.142436+0000","last_became_peered":"2024-09-13T18:33:17.142436+0000","last_unstale":"2024-09-13T18:33:17.537594+0000","last_undegraded":"2024-09-13T18:33:17.537594+0000","last_fullsized":"2024-09-13T18:33:17.537594+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:19.639862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571415+0000","last_change":"2024-09-13T18:33:17.571051+0000","last_active":"2024-09-13T18:33:17.571415+0000","last_peered":"2024-09-13T18:33:17.571415+0000","last_clean":"2024-09-13T18:33:17.571415+0000","last_became_active":"2024-09-13T18:33:17.570698+0000","last_became_peered":"2024-09-13T18:33:17.570698+0000","last_unstale":"2024-09-13T18:33:17.571415+0000","last_undegraded":"2024-09-13T18:33:17.571415+0000","last_fullsized":"2024-09-13T18:33:17.571415+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:27.438218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.513732+0000","last_change":"2024-09-13T18:33:17.141458+0000","last_active":"2024-09-13T18:33:17.513732+0000","last_peered":"2024-09-13T18:33:17.513732+0000","last_clean":"2024-09-13T18:33:17.513732+0000","last_became_active":"2024-09-13T18:33:17.140972+0000","last_became_peered":"2024-09-13T18:33:17.140972+0000","last_unstale":"2024-09-13T18:33:17.513732+0000","last_undegraded":"2024-09-13T18:33:17.513732+0000","last_fullsized":"2024-09-13T18:33:17.513732+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:23.796689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.560280+0000","last_change":"2024-09-13T18:33:17.559888+0000","last_active":"2024-09-13T18:33:17.560280+0000","last_peered":"2024-09-13T18:33:17.560280+0000","last_clean":"2024-09-13T18:33:17.560280+0000","last_became_active":"2024-09-13T18:33:17.559533+0000","last_became_peered":"2024-09-13T18:33:17.559533+0000","last_unstale":"2024-09-13T18:33:17.560280+0000","last_undegraded":"2024-09-13T18:33:17.560280+0000","last_fullsized":"2024-09-13T18:33:17.560280+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.519700+0000","last_change":"2024-09-13T18:33:17.141752+0000","last_active":"2024-09-13T18:33:17.519700+0000","last_peered":"2024-09-13T18:33:17.519700+0000","last_clean":"2024-09-13T18:33:17.519700+0000","last_became_active":"2024-09-13T18:33:17.141365+0000","last_became_peered":"2024-09-13T18:33:17.141365+0000","last_unstale":"2024-09-13T18:33:17.519700+0000","last_undegraded":"2024-09-13T18:33:17.519700+0000","last_fullsized":"2024-09-13T18:33:17.519700+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:05.656925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.562369+0000","last_change":"2024-09-13T18:33:17.534156+0000","last_active":"2024-09-13T18:33:17.562369+0000","last_peered":"2024-09-13T18:33:17.562369+0000","last_clean":"2024-09-13T18:33:17.562369+0000","last_became_active":"2024-09-13T18:33:17.533469+0000","last_became_peered":"2024-09-13T18:33:17.533469+0000","last_unstale":"2024-09-13T18:33:17.562369+0000","last_undegraded":"2024-09-13T18:33:17.562369+0000","last_fullsized":"2024-09-13T18:33:17.562369+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:12.203550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"149'8","reported_seq":18,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.558786+0000","last_change":"2024-09-13T18:33:17.142722+0000","last_active":"2024-09-13T18:33:17.558786+0000","last_peered":"2024-09-13T18:33:17.558786+0000","last_clean":"2024-09-13T18:33:17.558786+0000","last_became_active":"2024-09-13T18:33:17.141516+0000","last_became_peered":"2024-09-13T18:33:17.141516+0000","last_unstale":"2024-09-13T18:33:17.558786+0000","last_undegraded":"2024-09-13T18:33:17.558786+0000","last_fullsized":"2024-09-13T18:33:17.558786+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:27.449470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535996+0000","last_change":"2024-09-13T18:33:17.535297+0000","last_active":"2024-09-13T18:33:17.535996+0000","last_peered":"2024-09-13T18:33:17.535996+0000","last_clean":"2024-09-13T18:33:17.535996+0000","last_became_active":"2024-09-13T18:33:17.534982+0000","last_became_peered":"2024-09-13T18:33:17.534982+0000","last_unstale":"2024-09-13T18:33:17.535996+0000","last_undegraded":"2024-09-13T18:33:17.535996+0000","last_fullsized":"2024-09-13T18:33:17.535996+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:07.573395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.574584+0000","last_change":"2024-09-13T18:33:17.160098+0000","last_active":"2024-09-13T18:33:17.574584+0000","last_peered":"2024-09-13T18:33:17.574584+0000","last_clean":"2024-09-13T18:33:17.574584+0000","last_became_active":"2024-09-13T18:33:17.158256+0000","last_became_peered":"2024-09-13T18:33:17.158256+0000","last_unstale":"2024-09-13T18:33:17.574584+0000","last_undegraded":"2024-09-13T18:33:17.574584+0000","last_fullsized":"2024-09-13T18:33:17.574584+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:54.959224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537203+0000","last_change":"2024-09-13T18:33:17.535387+0000","last_active":"2024-09-13T18:33:17.537203+0000","last_peered":"2024-09-13T18:33:17.537203+0000","last_clean":"2024-09-13T18:33:17.537203+0000","last_became_active":"2024-09-13T18:33:17.532650+0000","last_became_peered":"2024-09-13T18:33:17.532650+0000","last_unstale":"2024-09-13T18:33:17.537203+0000","last_undegraded":"2024-09-13T18:33:17.537203+0000","last_fullsized":"2024-09-13T18:33:17.537203+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:27.438218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.570851+0000","last_change":"2024-09-13T18:33:17.158824+0000","last_active":"2024-09-13T18:33:17.570851+0000","last_peered":"2024-09-13T18:33:17.570851+0000","last_clean":"2024-09-13T18:33:17.570851+0000","last_became_active":"2024-09-13T18:33:17.158097+0000","last_became_peered":"2024-09-13T18:33:17.158097+0000","last_unstale":"2024-09-13T18:33:17.570851+0000","last_undegraded":"2024-09-13T18:33:17.570851+0000","last_fullsized":"2024-09-13T18:33:17.570851+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:23.968010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.532195+0000","last_change":"2024-09-13T18:33:17.529882+0000","last_active":"2024-09-13T18:33:17.532195+0000","last_peered":"2024-09-13T18:33:17.532195+0000","last_clean":"2024-09-13T18:33:17.532195+0000","last_became_active":"2024-09-13T18:33:17.529615+0000","last_became_peered":"2024-09-13T18:33:17.529615+0000","last_unstale":"2024-09-13T18:33:17.532195+0000","last_undegraded":"2024-09-13T18:33:17.532195+0000","last_fullsized":"2024-09-13T18:33:17.532195+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:26.165538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.554602+0000","last_change":"2024-09-13T18:33:17.153049+0000","last_active":"2024-09-13T18:33:17.554602+0000","last_peered":"2024-09-13T18:33:17.554602+0000","last_clean":"2024-09-13T18:33:17.554602+0000","last_became_active":"2024-09-13T18:33:17.152217+0000","last_became_peered":"2024-09-13T18:33:17.152217+0000","last_unstale":"2024-09-13T18:33:17.554602+0000","last_undegraded":"2024-09-13T18:33:17.554602+0000","last_fullsized":"2024-09-13T18:33:17.554602+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:33.431213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.550304+0000","last_change":"2024-09-13T18:33:17.549793+0000","last_active":"2024-09-13T18:33:17.550304+0000","last_peered":"2024-09-13T18:33:17.550304+0000","last_clean":"2024-09-13T18:33:17.550304+0000","last_became_active":"2024-09-13T18:33:17.549465+0000","last_became_peered":"2024-09-13T18:33:17.549465+0000","last_unstale":"2024-09-13T18:33:17.550304+0000","last_undegraded":"2024-09-13T18:33:17.550304+0000","last_fullsized":"2024-09-13T18:33:17.550304+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.277605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.531616+0000","last_change":"2024-09-13T18:33:17.147329+0000","last_active":"2024-09-13T18:33:17.531616+0000","last_peered":"2024-09-13T18:33:17.531616+0000","last_clean":"2024-09-13T18:33:17.531616+0000","last_became_active":"2024-09-13T18:33:17.146423+0000","last_became_peered":"2024-09-13T18:33:17.146423+0000","last_unstale":"2024-09-13T18:33:17.531616+0000","last_undegraded":"2024-09-13T18:33:17.531616+0000","last_fullsized":"2024-09-13T18:33:17.531616+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.615269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.565522+0000","last_change":"2024-09-13T18:33:17.552113+0000","last_active":"2024-09-13T18:33:17.565522+0000","last_peered":"2024-09-13T18:33:17.565522+0000","last_clean":"2024-09-13T18:33:17.565522+0000","last_became_active":"2024-09-13T18:33:17.551362+0000","last_became_peered":"2024-09-13T18:33:17.551362+0000","last_unstale":"2024-09-13T18:33:17.565522+0000","last_undegraded":"2024-09-13T18:33:17.565522+0000","last_fullsized":"2024-09-13T18:33:17.565522+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:26.165538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.561486+0000","last_change":"2024-09-13T18:33:17.146977+0000","last_active":"2024-09-13T18:33:17.561486+0000","last_peered":"2024-09-13T18:33:17.561486+0000","last_clean":"2024-09-13T18:33:17.561486+0000","last_became_active":"2024-09-13T18:33:17.146525+0000","last_became_peered":"2024-09-13T18:33:17.146525+0000","last_unstale":"2024-09-13T18:33:17.561486+0000","last_undegraded":"2024-09-13T18:33:17.561486+0000","last_fullsized":"2024-09-13T18:33:17.561486+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:16.144502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536870+0000","last_change":"2024-09-13T18:33:17.534094+0000","last_active":"2024-09-13T18:33:17.536870+0000","last_peered":"2024-09-13T18:33:17.536870+0000","last_clean":"2024-09-13T18:33:17.536870+0000","last_became_active":"2024-09-13T18:33:17.533443+0000","last_became_peered":"2024-09-13T18:33:17.533443+0000","last_unstale":"2024-09-13T18:33:17.536870+0000","last_undegraded":"2024-09-13T18:33:17.536870+0000","last_fullsized":"2024-09-13T18:33:17.536870+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:46.879049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.525634+0000","last_change":"2024-09-13T18:33:17.145283+0000","last_active":"2024-09-13T18:33:17.525634+0000","last_peered":"2024-09-13T18:33:17.525634+0000","last_clean":"2024-09-13T18:33:17.525634+0000","last_became_active":"2024-09-13T18:33:17.144586+0000","last_became_peered":"2024-09-13T18:33:17.144586+0000","last_unstale":"2024-09-13T18:33:17.525634+0000","last_undegraded":"2024-09-13T18:33:17.525634+0000","last_fullsized":"2024-09-13T18:33:17.525634+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.205991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573531+0000","last_change":"2024-09-13T18:33:17.568282+0000","last_active":"2024-09-13T18:33:17.573531+0000","last_peered":"2024-09-13T18:33:17.573531+0000","last_clean":"2024-09-13T18:33:17.573531+0000","last_became_active":"2024-09-13T18:33:17.567762+0000","last_became_peered":"2024-09-13T18:33:17.567762+0000","last_unstale":"2024-09-13T18:33:17.573531+0000","last_undegraded":"2024-09-13T18:33:17.573531+0000","last_fullsized":"2024-09-13T18:33:17.573531+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:46.308239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.521886+0000","last_change":"2024-09-13T18:33:17.162175+0000","last_active":"2024-09-13T18:33:17.521886+0000","last_peered":"2024-09-13T18:33:17.521886+0000","last_clean":"2024-09-13T18:33:17.521886+0000","last_became_active":"2024-09-13T18:33:17.161692+0000","last_became_peered":"2024-09-13T18:33:17.161692+0000","last_unstale":"2024-09-13T18:33:17.521886+0000","last_undegraded":"2024-09-13T18:33:17.521886+0000","last_fullsized":"2024-09-13T18:33:17.521886+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:23.968010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.567911+0000","last_change":"2024-09-13T18:33:17.567419+0000","last_active":"2024-09-13T18:33:17.567911+0000","last_peered":"2024-09-13T18:33:17.567911+0000","last_clean":"2024-09-13T18:33:17.567911+0000","last_became_active":"2024-09-13T18:33:17.567092+0000","last_became_peered":"2024-09-13T18:33:17.567092+0000","last_unstale":"2024-09-13T18:33:17.567911+0000","last_undegraded":"2024-09-13T18:33:17.567911+0000","last_fullsized":"2024-09-13T18:33:17.567911+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:43.420536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.525364+0000","last_change":"2024-09-13T18:33:17.138245+0000","last_active":"2024-09-13T18:33:17.525364+0000","last_peered":"2024-09-13T18:33:17.525364+0000","last_clean":"2024-09-13T18:33:17.525364+0000","last_became_active":"2024-09-13T18:33:17.137570+0000","last_became_peered":"2024-09-13T18:33:17.137570+0000","last_unstale":"2024-09-13T18:33:17.525364+0000","last_undegraded":"2024-09-13T18:33:17.525364+0000","last_fullsized":"2024-09-13T18:33:17.525364+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:07.218627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537217+0000","last_change":"2024-09-13T18:33:17.531358+0000","last_active":"2024-09-13T18:33:17.537217+0000","last_peered":"2024-09-13T18:33:17.537217+0000","last_clean":"2024-09-13T18:33:17.537217+0000","last_became_active":"2024-09-13T18:33:17.531100+0000","last_became_peered":"2024-09-13T18:33:17.531100+0000","last_unstale":"2024-09-13T18:33:17.537217+0000","last_undegraded":"2024-09-13T18:33:17.537217+0000","last_fullsized":"2024-09-13T18:33:17.537217+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.277605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.562427+0000","last_change":"2024-09-13T18:33:17.147231+0000","last_active":"2024-09-13T18:33:17.562427+0000","last_peered":"2024-09-13T18:33:17.562427+0000","last_clean":"2024-09-13T18:33:17.562427+0000","last_became_active":"2024-09-13T18:33:17.146889+0000","last_became_peered":"2024-09-13T18:33:17.146889+0000","last_unstale":"2024-09-13T18:33:17.562427+0000","last_undegraded":"2024-09-13T18:33:17.562427+0000","last_fullsized":"2024-09-13T18:33:17.562427+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:17.006398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.564059+0000","last_change":"2024-09-13T18:33:17.563648+0000","last_active":"2024-09-13T18:33:17.564059+0000","last_peered":"2024-09-13T18:33:17.564059+0000","last_clean":"2024-09-13T18:33:17.564059+0000","last_became_active":"2024-09-13T18:33:17.563342+0000","last_became_peered":"2024-09-13T18:33:17.563342+0000","last_unstale":"2024-09-13T18:33:17.564059+0000","last_undegraded":"2024-09-13T18:33:17.564059+0000","last_fullsized":"2024-09-13T18:33:17.564059+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:05.309503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.550946+0000","last_change":"2024-09-13T18:33:17.162652+0000","last_active":"2024-09-13T18:33:17.550946+0000","last_peered":"2024-09-13T18:33:17.550946+0000","last_clean":"2024-09-13T18:33:17.550946+0000","last_became_active":"2024-09-13T18:33:17.161030+0000","last_became_peered":"2024-09-13T18:33:17.161030+0000","last_unstale":"2024-09-13T18:33:17.550946+0000","last_undegraded":"2024-09-13T18:33:17.550946+0000","last_fullsized":"2024-09-13T18:33:17.550946+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:04.469501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.534225+0000","last_change":"2024-09-13T18:33:17.528943+0000","last_active":"2024-09-13T18:33:17.534225+0000","last_peered":"2024-09-13T18:33:17.534225+0000","last_clean":"2024-09-13T18:33:17.534225+0000","last_became_active":"2024-09-13T18:33:17.528560+0000","last_became_peered":"2024-09-13T18:33:17.528560+0000","last_unstale":"2024-09-13T18:33:17.534225+0000","last_undegraded":"2024-09-13T18:33:17.534225+0000","last_fullsized":"2024-09-13T18:33:17.534225+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:17.153543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.545286+0000","last_change":"2024-09-13T18:33:17.141678+0000","last_active":"2024-09-13T18:33:17.545286+0000","last_peered":"2024-09-13T18:33:17.545286+0000","last_clean":"2024-09-13T18:33:17.545286+0000","last_became_active":"2024-09-13T18:33:17.139711+0000","last_became_peered":"2024-09-13T18:33:17.139711+0000","last_unstale":"2024-09-13T18:33:17.545286+0000","last_undegraded":"2024-09-13T18:33:17.545286+0000","last_fullsized":"2024-09-13T18:33:17.545286+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:42.312583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.554737+0000","last_change":"2024-09-13T18:33:17.554140+0000","last_active":"2024-09-13T18:33:17.554737+0000","last_peered":"2024-09-13T18:33:17.554737+0000","last_clean":"2024-09-13T18:33:17.554737+0000","last_became_active":"2024-09-13T18:33:17.553830+0000","last_became_peered":"2024-09-13T18:33:17.553830+0000","last_unstale":"2024-09-13T18:33:17.554737+0000","last_undegraded":"2024-09-13T18:33:17.554737+0000","last_fullsized":"2024-09-13T18:33:17.554737+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.316651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.513777+0000","last_change":"2024-09-13T18:33:17.165856+0000","last_active":"2024-09-13T18:33:17.513777+0000","last_peered":"2024-09-13T18:33:17.513777+0000","last_clean":"2024-09-13T18:33:17.513777+0000","last_became_active":"2024-09-13T18:33:17.165540+0000","last_became_peered":"2024-09-13T18:33:17.165540+0000","last_unstale":"2024-09-13T18:33:17.513777+0000","last_undegraded":"2024-09-13T18:33:17.513777+0000","last_fullsized":"2024-09-13T18:33:17.513777+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:52.987424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536783+0000","last_change":"2024-09-13T18:33:17.524172+0000","last_active":"2024-09-13T18:33:17.536783+0000","last_peered":"2024-09-13T18:33:17.536783+0000","last_clean":"2024-09-13T18:33:17.536783+0000","last_became_active":"2024-09-13T18:33:17.523923+0000","last_became_peered":"2024-09-13T18:33:17.523923+0000","last_unstale":"2024-09-13T18:33:17.536783+0000","last_undegraded":"2024-09-13T18:33:17.536783+0000","last_fullsized":"2024-09-13T18:33:17.536783+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:04.645546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.519447+0000","last_change":"2024-09-13T18:33:17.150635+0000","last_active":"2024-09-13T18:33:17.519447+0000","last_peered":"2024-09-13T18:33:17.519447+0000","last_clean":"2024-09-13T18:33:17.519447+0000","last_became_active":"2024-09-13T18:33:17.149917+0000","last_became_peered":"2024-09-13T18:33:17.149917+0000","last_unstale":"2024-09-13T18:33:17.519447+0000","last_undegraded":"2024-09-13T18:33:17.519447+0000","last_fullsized":"2024-09-13T18:33:17.519447+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:39.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.548870+0000","last_change":"2024-09-13T18:33:17.534525+0000","last_active":"2024-09-13T18:33:17.548870+0000","last_peered":"2024-09-13T18:33:17.548870+0000","last_clean":"2024-09-13T18:33:17.548870+0000","last_became_active":"2024-09-13T18:33:17.533836+0000","last_became_peered":"2024-09-13T18:33:17.533836+0000","last_unstale":"2024-09-13T18:33:17.548870+0000","last_undegraded":"2024-09-13T18:33:17.548870+0000","last_fullsized":"2024-09-13T18:33:17.548870+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:34.440254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.522010+0000","last_change":"2024-09-13T18:33:17.153560+0000","last_active":"2024-09-13T18:33:17.522010+0000","last_peered":"2024-09-13T18:33:17.522010+0000","last_clean":"2024-09-13T18:33:17.522010+0000","last_became_active":"2024-09-13T18:33:17.153235+0000","last_became_peered":"2024-09-13T18:33:17.153235+0000","last_unstale":"2024-09-13T18:33:17.522010+0000","last_undegraded":"2024-09-13T18:33:17.522010+0000","last_fullsized":"2024-09-13T18:33:17.522010+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:04.469501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.549308+0000","last_change":"2024-09-13T18:33:17.548822+0000","last_active":"2024-09-13T18:33:17.549308+0000","last_peered":"2024-09-13T18:33:17.549308+0000","last_clean":"2024-09-13T18:33:17.549308+0000","last_became_active":"2024-09-13T18:33:17.548420+0000","last_became_peered":"2024-09-13T18:33:17.548420+0000","last_unstale":"2024-09-13T18:33:17.549308+0000","last_undegraded":"2024-09-13T18:33:17.549308+0000","last_fullsized":"2024-09-13T18:33:17.549308+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.316651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.541199+0000","last_change":"2024-09-13T18:33:17.144157+0000","last_active":"2024-09-13T18:33:17.541199+0000","last_peered":"2024-09-13T18:33:17.541199+0000","last_clean":"2024-09-13T18:33:17.541199+0000","last_became_active":"2024-09-13T18:33:17.142444+0000","last_became_peered":"2024-09-13T18:33:17.142444+0000","last_unstale":"2024-09-13T18:33:17.541199+0000","last_undegraded":"2024-09-13T18:33:17.541199+0000","last_fullsized":"2024-09-13T18:33:17.541199+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:17.708868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.564199+0000","last_change":"2024-09-13T18:33:17.551819+0000","last_active":"2024-09-13T18:33:17.564199+0000","last_peered":"2024-09-13T18:33:17.564199+0000","last_clean":"2024-09-13T18:33:17.564199+0000","last_became_active":"2024-09-13T18:33:17.551116+0000","last_became_peered":"2024-09-13T18:33:17.551116+0000","last_unstale":"2024-09-13T18:33:17.564199+0000","last_undegraded":"2024-09-13T18:33:17.564199+0000","last_fullsized":"2024-09-13T18:33:17.564199+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:18.467452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.518830+0000","last_change":"2024-09-13T18:33:17.134351+0000","last_active":"2024-09-13T18:33:17.518830+0000","last_peered":"2024-09-13T18:33:17.518830+0000","last_clean":"2024-09-13T18:33:17.518830+0000","last_became_active":"2024-09-13T18:33:17.133584+0000","last_became_peered":"2024-09-13T18:33:17.133584+0000","last_unstale":"2024-09-13T18:33:17.518830+0000","last_undegraded":"2024-09-13T18:33:17.518830+0000","last_fullsized":"2024-09-13T18:33:17.518830+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:19.179351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537235+0000","last_change":"2024-09-13T18:33:17.531428+0000","last_active":"2024-09-13T18:33:17.537235+0000","last_peered":"2024-09-13T18:33:17.537235+0000","last_clean":"2024-09-13T18:33:17.537235+0000","last_became_active":"2024-09-13T18:33:17.531194+0000","last_became_peered":"2024-09-13T18:33:17.531194+0000","last_unstale":"2024-09-13T18:33:17.537235+0000","last_undegraded":"2024-09-13T18:33:17.537235+0000","last_fullsized":"2024-09-13T18:33:17.537235+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:29.198280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.518592+0000","last_change":"2024-09-13T18:33:17.152052+0000","last_active":"2024-09-13T18:33:17.518592+0000","last_peered":"2024-09-13T18:33:17.518592+0000","last_clean":"2024-09-13T18:33:17.518592+0000","last_became_active":"2024-09-13T18:33:17.151372+0000","last_became_peered":"2024-09-13T18:33:17.151372+0000","last_unstale":"2024-09-13T18:33:17.518592+0000","last_undegraded":"2024-09-13T18:33:17.518592+0000","last_fullsized":"2024-09-13T18:33:17.518592+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:40.320124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.128956+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:33:17.128956+0000","last_peered":"2024-09-13T18:33:17.128956+0000","last_clean":"2024-09-13T18:33:17.128956+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:33:17.128956+0000","last_undegraded":"2024-09-13T18:33:17.128956+0000","last_fullsized":"2024-09-13T18:33:17.128956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33548,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338292,"statfs":{"total":96636764160,"available":96602411008,"internally_reserved":0,"allocated":2482176,"data_stored":1419228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.6439999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93300000000000005,"15min":0.90000000000000002},"min":{"1min":0.57499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":1.333,"15min":1.4410000000000001},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.218,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.93200000000000005},"min":{"1min":0.54400000000000004,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.2490000000000001,"5min":1.4890000000000001,"15min":1.6060000000000001},"last":1.173}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80900000000000005,"15min":0.80400000000000005},"min":{"1min":0.53700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":1.276,"15min":1.276},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.165,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":1.046}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1339999999999999,"5min":1.349,"15min":1.448},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.238,"5min":1.395,"15min":1.397},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.873,"15min":0.88800000000000001},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.218,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.93999999999999995},"min":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.127}]},{"osd":5,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95499999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.877},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.70299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":1.409,"15min":1.409},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.85499999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":1.476,"15min":1.476},"last":1.093},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.02,"15min":1.006},"min":{"1min":0.65000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2689999999999999,"5min":1.361,"15min":1.506},"last":1.2969999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1847296,"data_stored":814978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.82699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.0820000000000001,"5min":1.47,"15min":2.9990000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.3480000000000001,"15min":1.577},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":0.91600000000000004},"min":{"1min":0.71899999999999997,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.069,"5min":1.218,"15min":1.464},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.95799999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.319,"5min":1.673,"15min":2.4220000000000002},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.516,"15min":1.516},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.61899999999999999,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.2669999999999999,"15min":1.306},"last":0.96099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.97099999999999997},"min":{"1min":0.72799999999999998,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.2350000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.745},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.014},"min":{"1min":0.79200000000000004,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.2589999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.69399999999999995,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.88},{"interface":"front","average":{"1min":1.01,"5min":1.024,"15min":1.0800000000000001},"min":{"1min":0.67200000000000004,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":2.762},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.0369999999999999},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.22,"5min":1.5,"15min":1.9299999999999999},"last":1.077},{"interface":"front","average":{"1min":1.024,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.2470000000000001,"5min":1.357,"15min":1.72},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1859584,"data_stored":821253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":0.83899999999999997},"min":{"1min":0.47899999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":1.145},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.88700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.437},"max":{"1min":1.089,"5min":1.264,"15min":2.1840000000000002},"last":1.1759999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1719999999999999,"5min":1.603,"15min":1.603},"last":1.208},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92800000000000005,"15min":0.95099999999999996},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.21,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.64800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0760000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95299999999999996,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.46,"5min":3.46,"15min":3.46},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.306,"5min":1.492,"15min":1.5049999999999999},"last":1.091}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0109999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.376,"15min":0.376},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.97499999999999998,"15min":1.014},"min":{"1min":0.63100000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.0960000000000001},"min":{"1min":0.65800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.246},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.76000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":1.006}]}]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1859584,"data_stored":821253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93200000000000005,"15min":0.84499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2649999999999999,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.91000000000000003,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.242,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.872}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.216,"5min":1.536,"15min":1.536},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.89200000000000002},"min":{"1min":0.52600000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3660000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.367,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.92300000000000004,"15min":0.90500000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4490000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":10.44,"15min":10.44},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.286,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":0.97199999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.363,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1259999999999999,"15min":1.0309999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.222,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.504,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.0660000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.1819999999999999,"15min":1.091},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.573,"5min":15.593,"15min":15.593},"last":1.095},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.077},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4119999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.127}]}]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1847296,"data_stored":814978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63100000000000001},"min":{"1min":0.309,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.444,"5min":2.113,"15min":2.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.75,"15min":0.72199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0940000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68300000000000005,"15min":0.67400000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66800000000000004,"15min":0.626},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.1879999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.439}]},{"osd":2,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.4850000000000001,"5min":1.742,"15min":1.742},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.746},"min":{"1min":0.39700000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.0089999999999999,"5min":1.222,"15min":1.399},"last":0.69599999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3280000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.024,"5min":0.97699999999999998,"15min":1.077},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1539999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":0.746},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.94499999999999995,"15min":0.93600000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7669999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.052},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.623},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0309999999999999,"15min":1.0449999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.208,"5min":1.6890000000000001,"15min":1.96},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.0609999999999999,"15min":1.091},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0229999999999999,"15min":1.004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"max":{"1min":1.3460000000000001,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.81100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1875968,"data_stored":828118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.024,"5min":1.024,"15min":1.0309999999999999},"last":0.623},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67600000000000005,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.01,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65700000000000003,"15min":0.70499999999999996},"min":{"1min":0.32000000000000001,"5min":0.318,"15min":0.307},"max":{"1min":0.98599999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.71899999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0760000000000001,"5min":1.161,"15min":1.1859999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.264,"5min":1.405,"15min":1.405},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90900000000000003,"15min":0.91400000000000003},"min":{"1min":0.61899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.339,"5min":1.367,"15min":1.611},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88600000000000001,"15min":0.91200000000000003},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2649999999999999,"5min":1.587,"15min":1.587},"last":0.98099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.72399999999999998,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.9179999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.456,"5min":1.552,"15min":1.702},"last":1.026}]},{"osd":6,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":0.95799999999999996},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.3819999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.58799999999999997},"max":{"1min":1.5409999999999999,"5min":1.645,"15min":1.645},"last":0.879}]},{"osd":7,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.70199999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.3009999999999999,"5min":1.843,"15min":1.843},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.0369999999999999,"15min":1.0740000000000001},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4219999999999999,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":1.004}]}]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41140,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330700,"statfs":{"total":96636764160,"available":96594636800,"internally_reserved":0,"allocated":1875968,"data_stored":828062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89600000000000002,"5min":1.077,"15min":1.077},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":1.042,"15min":1.177},"last":1.4650000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":1.077,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.70699999999999996},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.27800000000000002},"max":{"1min":1.048,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.317},"max":{"1min":1.125,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.876},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":1.423,"15min":1.423},"last":1.0509999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92300000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.42899999999999999},"max":{"1min":1.1499999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2589999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.367},{"interface":"front","average":{"1min":0.995,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.484,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.226}]},{"osd":6,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98499999999999999,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1859999999999999,"5min":1.5900000000000001,"15min":1.653},"last":1.335},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":0.98799999999999999},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.262,"5min":1.425,"15min":1.5740000000000001},"last":1.1739999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.52500000000000002},"max":{"1min":1.5329999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.0209999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.546}]}]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41704,"kb_used_data":2396,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330136,"statfs":{"total":96636764160,"available":96594059264,"internally_reserved":0,"allocated":2453504,"data_stored":1411621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.018,"5min":1.244,"15min":1.4359999999999999},"last":1.151}]},{"osd":2,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94499999999999995,"5min":1.333,"15min":1.333},"last":1.5960000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0920000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.002,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":1.101},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.171,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":1.375}]},{"osd":4,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.87,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.3879999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.294,"5min":1.5069999999999999,"15min":1.986},"last":1.333}]},{"osd":5,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4379999999999999,"5min":1.8799999999999999,"15min":2.641},"last":1.4470000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58499999999999996},"max":{"1min":1.395,"5min":1.395,"15min":1.6699999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.60499999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.333,"5min":1.466,"15min":1.891},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.218}]},{"osd":7,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.0229999999999999},"min":{"1min":0.63400000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.363,"5min":1.669,"15min":2.2949999999999999},"last":1.024},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0980000000000001},"min":{"1min":0.68000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4530000000000001,"5min":1.724,"15min":2.2480000000000002},"last":1.53}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:33:21.576 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:33:21.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 Processor -- start 2024-09-13T18:33:21.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 -- start start 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2901582a0 0x7ff29006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff29015b7c0 0x7ff29006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff290070c90 0x7ff290071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29015aaf0 con 0x7ff290070c90 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29006d760 con 0x7ff29015b7c0 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff295129640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290071640 con 0x7ff2901582a0 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff290070c90 0x7ff290071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff290070c90 0x7ff290071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33078/0 (socket says 172.21.15.53:33078) 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 -- 172.21.15.53:0/2651150321 learned_addr learned my addr 172.21.15.53:0/2651150321 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:21.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28659c640 1 --2- 172.21.15.53:0/2651150321 >> v2:172.21.15.87:3300/0 conn(0x7ff29015b7c0 0x7ff29006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28ed9d640 1 --2- 172.21.15.53:0/2651150321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2901582a0 0x7ff29006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 -- 172.21.15.53:0/2651150321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2901582a0 msgr2=0x7ff29006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:21.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 --2- 172.21.15.53:0/2651150321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2901582a0 0x7ff29006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 -- 172.21.15.53:0/2651150321 >> v2:172.21.15.87:3300/0 conn(0x7ff29015b7c0 msgr2=0x7ff29006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:21.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 --2- 172.21.15.53:0/2651150321 >> v2:172.21.15.87:3300/0 conn(0x7ff29015b7c0 0x7ff29006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.741+0000 7ff28f59e640 1 -- 172.21.15.53:0/2651150321 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29006d480 con 0x7ff290070c90 2024-09-13T18:33:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28f59e640 1 --2- 172.21.15.53:0/2651150321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff290071100 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff290071ba0 tx=0x7ff28801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c1e48f9006b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28e59c640 1 -- 172.21.15.53:0/2651150321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880a5840 con 0x7ff290070c90 2024-09-13T18:33:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28e59c640 1 -- 172.21.15.53:0/2651150321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2880a59a0 con 0x7ff290070c90 2024-09-13T18:33:21.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28e59c640 1 -- 172.21.15.53:0/2651150321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880a5d30 con 0x7ff290070c90 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- 172.21.15.53:0/2651150321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 msgr2=0x7ff290071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 --2- 172.21.15.53:0/2651150321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff290071100 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff290071ba0 tx=0x7ff28801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- 172.21.15.53:0/2651150321 shutdown_connections 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 --2- 172.21.15.53:0/2651150321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff290071100 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 --2- 172.21.15.53:0/2651150321 >> v2:172.21.15.87:3300/0 conn(0x7ff29015b7c0 0x7ff29006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 --2- 172.21.15.53:0/2651150321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2901582a0 0x7ff29006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- 172.21.15.53:0/2651150321 >> 172.21.15.53:0/2651150321 conn(0x7ff290065c80 msgr2=0x7ff290066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- 172.21.15.53:0/2651150321 shutdown_connections 2024-09-13T18:33:21.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- 172.21.15.53:0/2651150321 wait complete. 2024-09-13T18:33:21.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 Processor -- start 2024-09-13T18:33:21.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- start start 2024-09-13T18:33:21.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff29014b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2901582a0 0x7ff29014abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff29015b7c0 0x7ff290155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29014bbd0 con 0x7ff290070c90 2024-09-13T18:33:21.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29014c8f0 con 0x7ff2901582a0 2024-09-13T18:33:21.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff295129640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29014b100 con 0x7ff29015b7c0 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff29014b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff29014b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33090/0 (socket says 172.21.15.53:33090) 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 -- 172.21.15.53:0/2571468895 learned_addr learned my addr 172.21.15.53:0/2571468895 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28659c640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2901582a0 0x7ff29014abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28f59e640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff29015b7c0 0x7ff290155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 -- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff29015b7c0 msgr2=0x7ff290155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff29015b7c0 0x7ff290155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 -- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2901582a0 msgr2=0x7ff29014abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2901582a0 0x7ff29014abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 -- 172.21.15.53:0/2571468895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288009b30 con 0x7ff290070c90 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff28ed9d640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff29014b690 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7ff28000d800 tx=0x7ff28000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.745+0000 7ff287fff640 1 -- 172.21.15.53:0/2571468895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2800096a0 con 0x7ff290070c90 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff287fff640 1 -- 172.21.15.53:0/2571468895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280009800 con 0x7ff290070c90 2024-09-13T18:33:21.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2900ad520 con 0x7ff290070c90 2024-09-13T18:33:21.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff287fff640 1 -- 172.21.15.53:0/2571468895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280009b70 con 0x7ff290070c90 2024-09-13T18:33:21.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29014c580 con 0x7ff290070c90 2024-09-13T18:33:21.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff290067400 con 0x7ff290070c90 2024-09-13T18:33:21.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff287fff640 1 -- 172.21.15.53:0/2571468895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7ff280009cd0 con 0x7ff290070c90 2024-09-13T18:33:21.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff287fff640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff270066cc0 0x7ff270069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:21.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff287fff640 1 -- 172.21.15.53:0/2571468895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2800852e0 con 0x7ff290070c90 2024-09-13T18:33:21.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff28659c640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff270066cc0 0x7ff270069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:21.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.749+0000 7ff28659c640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff270066cc0 0x7ff270069180 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff29014c2a0 tx=0x7ff278008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:21.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.753+0000 7ff287fff640 1 -- 172.21.15.53:0/2571468895 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff280051da0 con 0x7ff290070c90 2024-09-13T18:33:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.909+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2900cde10 con 0x7ff270066cc0 2024-09-13T18:33:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.921+0000 7ff287fff640 1 -- 172.21.15.53:0/2571468895 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288312 (secure 0 0 0) 0x7ff2780108a0 con 0x7ff270066cc0 2024-09-13T18:33:21.925 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:33:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff270066cc0 msgr2=0x7ff270069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff270066cc0 0x7ff270069180 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff29014c2a0 tx=0x7ff278008040 comp rx=0 tx=0).stop 2024-09-13T18:33:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 msgr2=0x7ff29014b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff29014b690 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7ff28000d800 tx=0x7ff28000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 shutdown_connections 2024-09-13T18:33:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff270066cc0 0x7ff270069180 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff29015b7c0 0x7ff290155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2901582a0 0x7ff29014abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 --2- 172.21.15.53:0/2571468895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff290070c90 0x7ff29014b690 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 >> 172.21.15.53:0/2571468895 conn(0x7ff290065c80 msgr2=0x7ff2900af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 shutdown_connections 2024-09-13T18:33:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:21.925+0000 7ff295129640 1 -- 172.21.15.53:0/2571468895 wait complete. 2024-09-13T18:33:21.943 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-13T18:33:21.878869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289264,"kb_used_data":15724,"kb_used_omap":12,"kb_used_meta":273395,"kb_avail":754685456,"statfs":{"total":773094113280,"available":772797906944,"internally_reserved":0,"allocated":16101376,"data_stored":7759491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":279957048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.768221"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.574202+0000","last_change":"2024-09-13T18:33:17.572557+0000","last_active":"2024-09-13T18:33:17.574202+0000","last_peered":"2024-09-13T18:33:17.574202+0000","last_clean":"2024-09-13T18:33:17.574202+0000","last_became_active":"2024-09-13T18:33:17.571907+0000","last_became_peered":"2024-09-13T18:33:17.571907+0000","last_unstale":"2024-09-13T18:33:17.574202+0000","last_undegraded":"2024-09-13T18:33:17.574202+0000","last_fullsized":"2024-09-13T18:33:17.574202+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:53:30.835646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575647+0000","last_change":"2024-09-13T18:33:17.563203+0000","last_active":"2024-09-13T18:33:17.575647+0000","last_peered":"2024-09-13T18:33:17.575647+0000","last_clean":"2024-09-13T18:33:17.575647+0000","last_became_active":"2024-09-13T18:33:17.562672+0000","last_became_peered":"2024-09-13T18:33:17.562672+0000","last_unstale":"2024-09-13T18:33:17.575647+0000","last_undegraded":"2024-09-13T18:33:17.575647+0000","last_fullsized":"2024-09-13T18:33:17.575647+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:40.029713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571777+0000","last_change":"2024-09-13T18:33:17.564753+0000","last_active":"2024-09-13T18:33:17.571777+0000","last_peered":"2024-09-13T18:33:17.571777+0000","last_clean":"2024-09-13T18:33:17.571777+0000","last_became_active":"2024-09-13T18:33:17.563649+0000","last_became_peered":"2024-09-13T18:33:17.563649+0000","last_unstale":"2024-09-13T18:33:17.571777+0000","last_undegraded":"2024-09-13T18:33:17.571777+0000","last_fullsized":"2024-09-13T18:33:17.571777+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:40.029713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.538489+0000","last_change":"2024-09-13T18:33:17.538166+0000","last_active":"2024-09-13T18:33:17.538489+0000","last_peered":"2024-09-13T18:33:17.538489+0000","last_clean":"2024-09-13T18:33:17.538489+0000","last_became_active":"2024-09-13T18:33:17.537769+0000","last_became_peered":"2024-09-13T18:33:17.537769+0000","last_unstale":"2024-09-13T18:33:17.538489+0000","last_undegraded":"2024-09-13T18:33:17.538489+0000","last_fullsized":"2024-09-13T18:33:17.538489+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:17.679868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575861+0000","last_change":"2024-09-13T18:33:17.565813+0000","last_active":"2024-09-13T18:33:17.575861+0000","last_peered":"2024-09-13T18:33:17.575861+0000","last_clean":"2024-09-13T18:33:17.575861+0000","last_became_active":"2024-09-13T18:33:17.561799+0000","last_became_peered":"2024-09-13T18:33:17.561799+0000","last_unstale":"2024-09-13T18:33:17.575861+0000","last_undegraded":"2024-09-13T18:33:17.575861+0000","last_fullsized":"2024-09-13T18:33:17.575861+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.534595+0000","last_change":"2024-09-13T18:33:17.534094+0000","last_active":"2024-09-13T18:33:17.534595+0000","last_peered":"2024-09-13T18:33:17.534595+0000","last_clean":"2024-09-13T18:33:17.534595+0000","last_became_active":"2024-09-13T18:33:17.533727+0000","last_became_peered":"2024-09-13T18:33:17.533727+0000","last_unstale":"2024-09-13T18:33:17.534595+0000","last_undegraded":"2024-09-13T18:33:17.534595+0000","last_fullsized":"2024-09-13T18:33:17.534595+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:24.977052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.544002+0000","last_change":"2024-09-13T18:33:17.543592+0000","last_active":"2024-09-13T18:33:17.544002+0000","last_peered":"2024-09-13T18:33:17.544002+0000","last_clean":"2024-09-13T18:33:17.544002+0000","last_became_active":"2024-09-13T18:33:17.543339+0000","last_became_peered":"2024-09-13T18:33:17.543339+0000","last_unstale":"2024-09-13T18:33:17.544002+0000","last_undegraded":"2024-09-13T18:33:17.544002+0000","last_fullsized":"2024-09-13T18:33:17.544002+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:07.111779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575778+0000","last_change":"2024-09-13T18:33:17.565367+0000","last_active":"2024-09-13T18:33:17.575778+0000","last_peered":"2024-09-13T18:33:17.575778+0000","last_clean":"2024-09-13T18:33:17.575778+0000","last_became_active":"2024-09-13T18:33:17.564825+0000","last_became_peered":"2024-09-13T18:33:17.564825+0000","last_unstale":"2024-09-13T18:33:17.575778+0000","last_undegraded":"2024-09-13T18:33:17.575778+0000","last_fullsized":"2024-09-13T18:33:17.575778+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:52.070012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575661+0000","last_change":"2024-09-13T18:33:17.563364+0000","last_active":"2024-09-13T18:33:17.575661+0000","last_peered":"2024-09-13T18:33:17.575661+0000","last_clean":"2024-09-13T18:33:17.575661+0000","last_became_active":"2024-09-13T18:33:17.562626+0000","last_became_peered":"2024-09-13T18:33:17.562626+0000","last_unstale":"2024-09-13T18:33:17.575661+0000","last_undegraded":"2024-09-13T18:33:17.575661+0000","last_fullsized":"2024-09-13T18:33:17.575661+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:41.329165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575566+0000","last_change":"2024-09-13T18:33:17.561925+0000","last_active":"2024-09-13T18:33:17.575566+0000","last_peered":"2024-09-13T18:33:17.575566+0000","last_clean":"2024-09-13T18:33:17.575566+0000","last_became_active":"2024-09-13T18:33:17.561264+0000","last_became_peered":"2024-09-13T18:33:17.561264+0000","last_unstale":"2024-09-13T18:33:17.575566+0000","last_undegraded":"2024-09-13T18:33:17.575566+0000","last_fullsized":"2024-09-13T18:33:17.575566+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:53.007791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575843+0000","last_change":"2024-09-13T18:33:17.565440+0000","last_active":"2024-09-13T18:33:17.575843+0000","last_peered":"2024-09-13T18:33:17.575843+0000","last_clean":"2024-09-13T18:33:17.575843+0000","last_became_active":"2024-09-13T18:33:17.564868+0000","last_became_peered":"2024-09-13T18:33:17.564868+0000","last_unstale":"2024-09-13T18:33:17.575843+0000","last_undegraded":"2024-09-13T18:33:17.575843+0000","last_fullsized":"2024-09-13T18:33:17.575843+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:15.017647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575608+0000","last_change":"2024-09-13T18:33:17.562287+0000","last_active":"2024-09-13T18:33:17.575608+0000","last_peered":"2024-09-13T18:33:17.575608+0000","last_clean":"2024-09-13T18:33:17.575608+0000","last_became_active":"2024-09-13T18:33:17.561472+0000","last_became_peered":"2024-09-13T18:33:17.561472+0000","last_unstale":"2024-09-13T18:33:17.575608+0000","last_undegraded":"2024-09-13T18:33:17.575608+0000","last_fullsized":"2024-09-13T18:33:17.575608+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:19.575272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.570740+0000","last_change":"2024-09-13T18:33:17.565204+0000","last_active":"2024-09-13T18:33:17.570740+0000","last_peered":"2024-09-13T18:33:17.570740+0000","last_clean":"2024-09-13T18:33:17.570740+0000","last_became_active":"2024-09-13T18:33:17.558240+0000","last_became_peered":"2024-09-13T18:33:17.558240+0000","last_unstale":"2024-09-13T18:33:17.570740+0000","last_undegraded":"2024-09-13T18:33:17.570740+0000","last_fullsized":"2024-09-13T18:33:17.570740+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569817+0000","last_change":"2024-09-13T18:33:17.563081+0000","last_active":"2024-09-13T18:33:17.569817+0000","last_peered":"2024-09-13T18:33:17.569817+0000","last_clean":"2024-09-13T18:33:17.569817+0000","last_became_active":"2024-09-13T18:33:17.559701+0000","last_became_peered":"2024-09-13T18:33:17.559701+0000","last_unstale":"2024-09-13T18:33:17.569817+0000","last_undegraded":"2024-09-13T18:33:17.569817+0000","last_fullsized":"2024-09-13T18:33:17.569817+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:52.070012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.556594+0000","last_change":"2024-09-13T18:33:17.549419+0000","last_active":"2024-09-13T18:33:17.556594+0000","last_peered":"2024-09-13T18:33:17.556594+0000","last_clean":"2024-09-13T18:33:17.556594+0000","last_became_active":"2024-09-13T18:33:17.548590+0000","last_became_peered":"2024-09-13T18:33:17.548590+0000","last_unstale":"2024-09-13T18:33:17.556594+0000","last_undegraded":"2024-09-13T18:33:17.556594+0000","last_fullsized":"2024-09-13T18:33:17.556594+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:13.199266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535925+0000","last_change":"2024-09-13T18:33:17.531543+0000","last_active":"2024-09-13T18:33:17.535925+0000","last_peered":"2024-09-13T18:33:17.535925+0000","last_clean":"2024-09-13T18:33:17.535925+0000","last_became_active":"2024-09-13T18:33:17.531209+0000","last_became_peered":"2024-09-13T18:33:17.531209+0000","last_unstale":"2024-09-13T18:33:17.535925+0000","last_undegraded":"2024-09-13T18:33:17.535925+0000","last_fullsized":"2024-09-13T18:33:17.535925+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:04.645546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571123+0000","last_change":"2024-09-13T18:33:17.570512+0000","last_active":"2024-09-13T18:33:17.571123+0000","last_peered":"2024-09-13T18:33:17.571123+0000","last_clean":"2024-09-13T18:33:17.571123+0000","last_became_active":"2024-09-13T18:33:17.570205+0000","last_became_peered":"2024-09-13T18:33:17.570205+0000","last_unstale":"2024-09-13T18:33:17.571123+0000","last_undegraded":"2024-09-13T18:33:17.571123+0000","last_fullsized":"2024-09-13T18:33:17.571123+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:45.367093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537174+0000","last_change":"2024-09-13T18:33:17.524732+0000","last_active":"2024-09-13T18:33:17.537174+0000","last_peered":"2024-09-13T18:33:17.537174+0000","last_clean":"2024-09-13T18:33:17.537174+0000","last_became_active":"2024-09-13T18:33:17.524477+0000","last_became_peered":"2024-09-13T18:33:17.524477+0000","last_unstale":"2024-09-13T18:33:17.537174+0000","last_undegraded":"2024-09-13T18:33:17.537174+0000","last_fullsized":"2024-09-13T18:33:17.537174+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:46.879049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.528041+0000","last_change":"2024-09-13T18:33:17.523984+0000","last_active":"2024-09-13T18:33:17.528041+0000","last_peered":"2024-09-13T18:33:17.528041+0000","last_clean":"2024-09-13T18:33:17.528041+0000","last_became_active":"2024-09-13T18:33:17.523247+0000","last_became_peered":"2024-09-13T18:33:17.523247+0000","last_unstale":"2024-09-13T18:33:17.528041+0000","last_undegraded":"2024-09-13T18:33:17.528041+0000","last_fullsized":"2024-09-13T18:33:17.528041+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:55.968265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569843+0000","last_change":"2024-09-13T18:33:17.563459+0000","last_active":"2024-09-13T18:33:17.569843+0000","last_peered":"2024-09-13T18:33:17.569843+0000","last_clean":"2024-09-13T18:33:17.569843+0000","last_became_active":"2024-09-13T18:33:17.562820+0000","last_became_peered":"2024-09-13T18:33:17.562820+0000","last_unstale":"2024-09-13T18:33:17.569843+0000","last_undegraded":"2024-09-13T18:33:17.569843+0000","last_fullsized":"2024-09-13T18:33:17.569843+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:19.575272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.558722+0000","last_change":"2024-09-13T18:33:17.558396+0000","last_active":"2024-09-13T18:33:17.558722+0000","last_peered":"2024-09-13T18:33:17.558722+0000","last_clean":"2024-09-13T18:33:17.558722+0000","last_became_active":"2024-09-13T18:33:17.558192+0000","last_became_peered":"2024-09-13T18:33:17.558192+0000","last_unstale":"2024-09-13T18:33:17.558722+0000","last_undegraded":"2024-09-13T18:33:17.558722+0000","last_fullsized":"2024-09-13T18:33:17.558722+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:06.665966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575623+0000","last_change":"2024-09-13T18:33:17.561988+0000","last_active":"2024-09-13T18:33:17.575623+0000","last_peered":"2024-09-13T18:33:17.575623+0000","last_clean":"2024-09-13T18:33:17.575623+0000","last_became_active":"2024-09-13T18:33:17.561421+0000","last_became_peered":"2024-09-13T18:33:17.561421+0000","last_unstale":"2024-09-13T18:33:17.575623+0000","last_undegraded":"2024-09-13T18:33:17.575623+0000","last_fullsized":"2024-09-13T18:33:17.575623+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:32.220994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.567894+0000","last_change":"2024-09-13T18:33:17.567369+0000","last_active":"2024-09-13T18:33:17.567894+0000","last_peered":"2024-09-13T18:33:17.567894+0000","last_clean":"2024-09-13T18:33:17.567894+0000","last_became_active":"2024-09-13T18:33:17.567081+0000","last_became_peered":"2024-09-13T18:33:17.567081+0000","last_unstale":"2024-09-13T18:33:17.567894+0000","last_undegraded":"2024-09-13T18:33:17.567894+0000","last_fullsized":"2024-09-13T18:33:17.567894+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:05.478542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.576026+0000","last_change":"2024-09-13T18:33:17.572734+0000","last_active":"2024-09-13T18:33:17.576026+0000","last_peered":"2024-09-13T18:33:17.576026+0000","last_clean":"2024-09-13T18:33:17.576026+0000","last_became_active":"2024-09-13T18:33:17.572148+0000","last_became_peered":"2024-09-13T18:33:17.572148+0000","last_unstale":"2024-09-13T18:33:17.576026+0000","last_undegraded":"2024-09-13T18:33:17.576026+0000","last_fullsized":"2024-09-13T18:33:17.576026+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:40.089008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.570046+0000","last_change":"2024-09-13T18:33:17.563842+0000","last_active":"2024-09-13T18:33:17.570046+0000","last_peered":"2024-09-13T18:33:17.570046+0000","last_clean":"2024-09-13T18:33:17.570046+0000","last_became_active":"2024-09-13T18:33:17.558860+0000","last_became_peered":"2024-09-13T18:33:17.558860+0000","last_unstale":"2024-09-13T18:33:17.570046+0000","last_undegraded":"2024-09-13T18:33:17.570046+0000","last_fullsized":"2024-09-13T18:33:17.570046+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:15.017647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535897+0000","last_change":"2024-09-13T18:33:17.532705+0000","last_active":"2024-09-13T18:33:17.535897+0000","last_peered":"2024-09-13T18:33:17.535897+0000","last_clean":"2024-09-13T18:33:17.535897+0000","last_became_active":"2024-09-13T18:33:17.532345+0000","last_became_peered":"2024-09-13T18:33:17.532345+0000","last_unstale":"2024-09-13T18:33:17.535897+0000","last_undegraded":"2024-09-13T18:33:17.535897+0000","last_fullsized":"2024-09-13T18:33:17.535897+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:22.223736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573363+0000","last_change":"2024-09-13T18:33:17.569290+0000","last_active":"2024-09-13T18:33:17.573363+0000","last_peered":"2024-09-13T18:33:17.573363+0000","last_clean":"2024-09-13T18:33:17.573363+0000","last_became_active":"2024-09-13T18:33:17.562926+0000","last_became_peered":"2024-09-13T18:33:17.562926+0000","last_unstale":"2024-09-13T18:33:17.573363+0000","last_undegraded":"2024-09-13T18:33:17.573363+0000","last_fullsized":"2024-09-13T18:33:17.573363+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:50.918958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.550234+0000","last_change":"2024-09-13T18:33:17.549654+0000","last_active":"2024-09-13T18:33:17.550234+0000","last_peered":"2024-09-13T18:33:17.550234+0000","last_clean":"2024-09-13T18:33:17.550234+0000","last_became_active":"2024-09-13T18:33:17.549391+0000","last_became_peered":"2024-09-13T18:33:17.549391+0000","last_unstale":"2024-09-13T18:33:17.550234+0000","last_undegraded":"2024-09-13T18:33:17.550234+0000","last_fullsized":"2024-09-13T18:33:17.550234+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:50.918958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569875+0000","last_change":"2024-09-13T18:33:17.558422+0000","last_active":"2024-09-13T18:33:17.569875+0000","last_peered":"2024-09-13T18:33:17.569875+0000","last_clean":"2024-09-13T18:33:17.569875+0000","last_became_active":"2024-09-13T18:33:17.557617+0000","last_became_peered":"2024-09-13T18:33:17.557617+0000","last_unstale":"2024-09-13T18:33:17.569875+0000","last_undegraded":"2024-09-13T18:33:17.569875+0000","last_fullsized":"2024-09-13T18:33:17.569875+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:35.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.549856+0000","last_change":"2024-09-13T18:33:17.536076+0000","last_active":"2024-09-13T18:33:17.549856+0000","last_peered":"2024-09-13T18:33:17.549856+0000","last_clean":"2024-09-13T18:33:17.549856+0000","last_became_active":"2024-09-13T18:33:17.535390+0000","last_became_peered":"2024-09-13T18:33:17.535390+0000","last_unstale":"2024-09-13T18:33:17.549856+0000","last_undegraded":"2024-09-13T18:33:17.549856+0000","last_fullsized":"2024-09-13T18:33:17.549856+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:09.048275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.548998+0000","last_change":"2024-09-13T18:33:17.535002+0000","last_active":"2024-09-13T18:33:17.548998+0000","last_peered":"2024-09-13T18:33:17.548998+0000","last_clean":"2024-09-13T18:33:17.548998+0000","last_became_active":"2024-09-13T18:33:17.534224+0000","last_became_peered":"2024-09-13T18:33:17.534224+0000","last_unstale":"2024-09-13T18:33:17.548998+0000","last_undegraded":"2024-09-13T18:33:17.548998+0000","last_fullsized":"2024-09-13T18:33:17.548998+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:03.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536041+0000","last_change":"2024-09-13T18:33:17.524190+0000","last_active":"2024-09-13T18:33:17.536041+0000","last_peered":"2024-09-13T18:33:17.536041+0000","last_clean":"2024-09-13T18:33:17.536041+0000","last_became_active":"2024-09-13T18:33:17.523908+0000","last_became_peered":"2024-09-13T18:33:17.523908+0000","last_unstale":"2024-09-13T18:33:17.536041+0000","last_undegraded":"2024-09-13T18:33:17.536041+0000","last_fullsized":"2024-09-13T18:33:17.536041+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:05.309503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535168+0000","last_change":"2024-09-13T18:33:17.529822+0000","last_active":"2024-09-13T18:33:17.535168+0000","last_peered":"2024-09-13T18:33:17.535168+0000","last_clean":"2024-09-13T18:33:17.535168+0000","last_became_active":"2024-09-13T18:33:17.529549+0000","last_became_peered":"2024-09-13T18:33:17.529549+0000","last_unstale":"2024-09-13T18:33:17.535168+0000","last_undegraded":"2024-09-13T18:33:17.535168+0000","last_fullsized":"2024-09-13T18:33:17.535168+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:29.198280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"149'4","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573304+0000","last_change":"2024-09-13T18:33:17.162782+0000","last_active":"2024-09-13T18:33:17.573304+0000","last_peered":"2024-09-13T18:33:17.573304+0000","last_clean":"2024-09-13T18:33:17.573304+0000","last_became_active":"2024-09-13T18:33:17.162209+0000","last_became_peered":"2024-09-13T18:33:17.162209+0000","last_unstale":"2024-09-13T18:33:17.573304+0000","last_undegraded":"2024-09-13T18:33:17.573304+0000","last_fullsized":"2024-09-13T18:33:17.573304+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:08.039234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.549548+0000","last_change":"2024-09-13T18:33:17.539720+0000","last_active":"2024-09-13T18:33:17.549548+0000","last_peered":"2024-09-13T18:33:17.549548+0000","last_clean":"2024-09-13T18:33:17.549548+0000","last_became_active":"2024-09-13T18:33:17.539005+0000","last_became_peered":"2024-09-13T18:33:17.539005+0000","last_unstale":"2024-09-13T18:33:17.549548+0000","last_undegraded":"2024-09-13T18:33:17.549548+0000","last_fullsized":"2024-09-13T18:33:17.549548+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:04.573467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.567801+0000","last_change":"2024-09-13T18:33:17.136603+0000","last_active":"2024-09-13T18:33:17.567801+0000","last_peered":"2024-09-13T18:33:17.567801+0000","last_clean":"2024-09-13T18:33:17.567801+0000","last_became_active":"2024-09-13T18:33:17.135793+0000","last_became_peered":"2024-09-13T18:33:17.135793+0000","last_unstale":"2024-09-13T18:33:17.567801+0000","last_undegraded":"2024-09-13T18:33:17.567801+0000","last_fullsized":"2024-09-13T18:33:17.567801+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:51.998749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.552736+0000","last_change":"2024-09-13T18:33:17.552108+0000","last_active":"2024-09-13T18:33:17.552736+0000","last_peered":"2024-09-13T18:33:17.552736+0000","last_clean":"2024-09-13T18:33:17.552736+0000","last_became_active":"2024-09-13T18:33:17.551866+0000","last_became_peered":"2024-09-13T18:33:17.551866+0000","last_unstale":"2024-09-13T18:33:17.552736+0000","last_undegraded":"2024-09-13T18:33:17.552736+0000","last_fullsized":"2024-09-13T18:33:17.552736+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:20.648903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.545734+0000","last_change":"2024-09-13T18:33:17.147477+0000","last_active":"2024-09-13T18:33:17.545734+0000","last_peered":"2024-09-13T18:33:17.545734+0000","last_clean":"2024-09-13T18:33:17.545734+0000","last_became_active":"2024-09-13T18:33:17.147140+0000","last_became_peered":"2024-09-13T18:33:17.147140+0000","last_unstale":"2024-09-13T18:33:17.545734+0000","last_undegraded":"2024-09-13T18:33:17.545734+0000","last_fullsized":"2024-09-13T18:33:17.545734+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:44.358052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571732+0000","last_change":"2024-09-13T18:33:17.564343+0000","last_active":"2024-09-13T18:33:17.571732+0000","last_peered":"2024-09-13T18:33:17.571732+0000","last_clean":"2024-09-13T18:33:17.571732+0000","last_became_active":"2024-09-13T18:33:17.559173+0000","last_became_peered":"2024-09-13T18:33:17.559173+0000","last_unstale":"2024-09-13T18:33:17.571732+0000","last_undegraded":"2024-09-13T18:33:17.571732+0000","last_fullsized":"2024-09-13T18:33:17.571732+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:17.679868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.556112+0000","last_change":"2024-09-13T18:33:17.150026+0000","last_active":"2024-09-13T18:33:17.556112+0000","last_peered":"2024-09-13T18:33:17.556112+0000","last_clean":"2024-09-13T18:33:17.556112+0000","last_became_active":"2024-09-13T18:33:17.149581+0000","last_became_peered":"2024-09-13T18:33:17.149581+0000","last_unstale":"2024-09-13T18:33:17.556112+0000","last_undegraded":"2024-09-13T18:33:17.556112+0000","last_fullsized":"2024-09-13T18:33:17.556112+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:49.863606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536682+0000","last_change":"2024-09-13T18:33:17.530517+0000","last_active":"2024-09-13T18:33:17.536682+0000","last_peered":"2024-09-13T18:33:17.536682+0000","last_clean":"2024-09-13T18:33:17.536682+0000","last_became_active":"2024-09-13T18:33:17.530266+0000","last_became_peered":"2024-09-13T18:33:17.530266+0000","last_unstale":"2024-09-13T18:33:17.536682+0000","last_undegraded":"2024-09-13T18:33:17.536682+0000","last_fullsized":"2024-09-13T18:33:17.536682+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:03.218111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.569722+0000","last_change":"2024-09-13T18:33:17.161467+0000","last_active":"2024-09-13T18:33:17.569722+0000","last_peered":"2024-09-13T18:33:17.569722+0000","last_clean":"2024-09-13T18:33:17.569722+0000","last_became_active":"2024-09-13T18:33:17.160701+0000","last_became_peered":"2024-09-13T18:33:17.160701+0000","last_unstale":"2024-09-13T18:33:17.569722+0000","last_undegraded":"2024-09-13T18:33:17.569722+0000","last_fullsized":"2024-09-13T18:33:17.569722+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:19.639862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.532516+0000","last_change":"2024-09-13T18:33:17.531810+0000","last_active":"2024-09-13T18:33:17.532516+0000","last_peered":"2024-09-13T18:33:17.532516+0000","last_clean":"2024-09-13T18:33:17.532516+0000","last_became_active":"2024-09-13T18:33:17.531555+0000","last_became_peered":"2024-09-13T18:33:17.531555+0000","last_unstale":"2024-09-13T18:33:17.532516+0000","last_undegraded":"2024-09-13T18:33:17.532516+0000","last_fullsized":"2024-09-13T18:33:17.532516+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:49.305324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.530318+0000","last_change":"2024-09-13T18:33:17.143694+0000","last_active":"2024-09-13T18:33:17.530318+0000","last_peered":"2024-09-13T18:33:17.530318+0000","last_clean":"2024-09-13T18:33:17.530318+0000","last_became_active":"2024-09-13T18:33:17.143281+0000","last_became_peered":"2024-09-13T18:33:17.143281+0000","last_unstale":"2024-09-13T18:33:17.530318+0000","last_undegraded":"2024-09-13T18:33:17.530318+0000","last_fullsized":"2024-09-13T18:33:17.530318+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:54.959224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.554633+0000","last_change":"2024-09-13T18:33:17.554175+0000","last_active":"2024-09-13T18:33:17.554633+0000","last_peered":"2024-09-13T18:33:17.554633+0000","last_clean":"2024-09-13T18:33:17.554633+0000","last_became_active":"2024-09-13T18:33:17.553836+0000","last_became_peered":"2024-09-13T18:33:17.553836+0000","last_unstale":"2024-09-13T18:33:17.554633+0000","last_undegraded":"2024-09-13T18:33:17.554633+0000","last_fullsized":"2024-09-13T18:33:17.554633+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:35.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.540947+0000","last_change":"2024-09-13T18:33:17.145133+0000","last_active":"2024-09-13T18:33:17.540947+0000","last_peered":"2024-09-13T18:33:17.540947+0000","last_clean":"2024-09-13T18:33:17.540947+0000","last_became_active":"2024-09-13T18:33:17.143391+0000","last_became_peered":"2024-09-13T18:33:17.143391+0000","last_unstale":"2024-09-13T18:33:17.540947+0000","last_undegraded":"2024-09-13T18:33:17.540947+0000","last_fullsized":"2024-09-13T18:33:17.540947+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:25.318564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.533963+0000","last_change":"2024-09-13T18:33:17.531440+0000","last_active":"2024-09-13T18:33:17.533963+0000","last_peered":"2024-09-13T18:33:17.533963+0000","last_clean":"2024-09-13T18:33:17.533963+0000","last_became_active":"2024-09-13T18:33:17.531189+0000","last_became_peered":"2024-09-13T18:33:17.531189+0000","last_unstale":"2024-09-13T18:33:17.533963+0000","last_undegraded":"2024-09-13T18:33:17.533963+0000","last_fullsized":"2024-09-13T18:33:17.533963+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:30.087136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.519012+0000","last_change":"2024-09-13T18:33:17.137203+0000","last_active":"2024-09-13T18:33:17.519012+0000","last_peered":"2024-09-13T18:33:17.519012+0000","last_clean":"2024-09-13T18:33:17.519012+0000","last_became_active":"2024-09-13T18:33:17.136601+0000","last_became_peered":"2024-09-13T18:33:17.136601+0000","last_unstale":"2024-09-13T18:33:17.519012+0000","last_undegraded":"2024-09-13T18:33:17.519012+0000","last_fullsized":"2024-09-13T18:33:17.519012+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:07.218627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536745+0000","last_change":"2024-09-13T18:33:17.530197+0000","last_active":"2024-09-13T18:33:17.536745+0000","last_peered":"2024-09-13T18:33:17.536745+0000","last_clean":"2024-09-13T18:33:17.536745+0000","last_became_active":"2024-09-13T18:33:17.525097+0000","last_became_peered":"2024-09-13T18:33:17.525097+0000","last_unstale":"2024-09-13T18:33:17.536745+0000","last_undegraded":"2024-09-13T18:33:17.536745+0000","last_fullsized":"2024-09-13T18:33:17.536745+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:22.223736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.521353+0000","last_change":"2024-09-13T18:33:17.158517+0000","last_active":"2024-09-13T18:33:17.521353+0000","last_peered":"2024-09-13T18:33:17.521353+0000","last_clean":"2024-09-13T18:33:17.521353+0000","last_became_active":"2024-09-13T18:33:17.158020+0000","last_became_peered":"2024-09-13T18:33:17.158020+0000","last_unstale":"2024-09-13T18:33:17.521353+0000","last_undegraded":"2024-09-13T18:33:17.521353+0000","last_fullsized":"2024-09-13T18:33:17.521353+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:45.160726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536603+0000","last_change":"2024-09-13T18:33:17.530604+0000","last_active":"2024-09-13T18:33:17.536603+0000","last_peered":"2024-09-13T18:33:17.536603+0000","last_clean":"2024-09-13T18:33:17.536603+0000","last_became_active":"2024-09-13T18:33:17.525088+0000","last_became_peered":"2024-09-13T18:33:17.525088+0000","last_unstale":"2024-09-13T18:33:17.536603+0000","last_undegraded":"2024-09-13T18:33:17.536603+0000","last_fullsized":"2024-09-13T18:33:17.536603+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:07.111779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"149'3","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.533367+0000","last_change":"2024-09-13T18:33:17.139801+0000","last_active":"2024-09-13T18:33:17.533367+0000","last_peered":"2024-09-13T18:33:17.533367+0000","last_clean":"2024-09-13T18:33:17.533367+0000","last_became_active":"2024-09-13T18:33:17.139363+0000","last_became_peered":"2024-09-13T18:33:17.139363+0000","last_unstale":"2024-09-13T18:33:17.533367+0000","last_undegraded":"2024-09-13T18:33:17.533367+0000","last_fullsized":"2024-09-13T18:33:17.533367+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:30.061986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573784+0000","last_change":"2024-09-13T18:33:17.570941+0000","last_active":"2024-09-13T18:33:17.573784+0000","last_peered":"2024-09-13T18:33:17.573784+0000","last_clean":"2024-09-13T18:33:17.573784+0000","last_became_active":"2024-09-13T18:33:17.570273+0000","last_became_peered":"2024-09-13T18:33:17.570273+0000","last_unstale":"2024-09-13T18:33:17.573784+0000","last_undegraded":"2024-09-13T18:33:17.573784+0000","last_fullsized":"2024-09-13T18:33:17.573784+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:55.843882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"149'6","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.575122+0000","last_change":"2024-09-13T18:33:17.141557+0000","last_active":"2024-09-13T18:33:17.575122+0000","last_peered":"2024-09-13T18:33:17.575122+0000","last_clean":"2024-09-13T18:33:17.575122+0000","last_became_active":"2024-09-13T18:33:17.140898+0000","last_became_peered":"2024-09-13T18:33:17.140898+0000","last_unstale":"2024-09-13T18:33:17.575122+0000","last_undegraded":"2024-09-13T18:33:17.575122+0000","last_fullsized":"2024-09-13T18:33:17.575122+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:55.538614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.566123+0000","last_change":"2024-09-13T18:33:17.565808+0000","last_active":"2024-09-13T18:33:17.566123+0000","last_peered":"2024-09-13T18:33:17.566123+0000","last_clean":"2024-09-13T18:33:17.566123+0000","last_became_active":"2024-09-13T18:33:17.565473+0000","last_became_peered":"2024-09-13T18:33:17.565473+0000","last_unstale":"2024-09-13T18:33:17.566123+0000","last_undegraded":"2024-09-13T18:33:17.566123+0000","last_fullsized":"2024-09-13T18:33:17.566123+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:03.218111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537594+0000","last_change":"2024-09-13T18:33:17.142768+0000","last_active":"2024-09-13T18:33:17.537594+0000","last_peered":"2024-09-13T18:33:17.537594+0000","last_clean":"2024-09-13T18:33:17.537594+0000","last_became_active":"2024-09-13T18:33:17.142436+0000","last_became_peered":"2024-09-13T18:33:17.142436+0000","last_unstale":"2024-09-13T18:33:17.537594+0000","last_undegraded":"2024-09-13T18:33:17.537594+0000","last_fullsized":"2024-09-13T18:33:17.537594+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:19.639862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.571415+0000","last_change":"2024-09-13T18:33:17.571051+0000","last_active":"2024-09-13T18:33:17.571415+0000","last_peered":"2024-09-13T18:33:17.571415+0000","last_clean":"2024-09-13T18:33:17.571415+0000","last_became_active":"2024-09-13T18:33:17.570698+0000","last_became_peered":"2024-09-13T18:33:17.570698+0000","last_unstale":"2024-09-13T18:33:17.571415+0000","last_undegraded":"2024-09-13T18:33:17.571415+0000","last_fullsized":"2024-09-13T18:33:17.571415+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:27.438218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.513732+0000","last_change":"2024-09-13T18:33:17.141458+0000","last_active":"2024-09-13T18:33:17.513732+0000","last_peered":"2024-09-13T18:33:17.513732+0000","last_clean":"2024-09-13T18:33:17.513732+0000","last_became_active":"2024-09-13T18:33:17.140972+0000","last_became_peered":"2024-09-13T18:33:17.140972+0000","last_unstale":"2024-09-13T18:33:17.513732+0000","last_undegraded":"2024-09-13T18:33:17.513732+0000","last_fullsized":"2024-09-13T18:33:17.513732+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:23.796689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.560280+0000","last_change":"2024-09-13T18:33:17.559888+0000","last_active":"2024-09-13T18:33:17.560280+0000","last_peered":"2024-09-13T18:33:17.560280+0000","last_clean":"2024-09-13T18:33:17.560280+0000","last_became_active":"2024-09-13T18:33:17.559533+0000","last_became_peered":"2024-09-13T18:33:17.559533+0000","last_unstale":"2024-09-13T18:33:17.560280+0000","last_undegraded":"2024-09-13T18:33:17.560280+0000","last_fullsized":"2024-09-13T18:33:17.560280+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.519700+0000","last_change":"2024-09-13T18:33:17.141752+0000","last_active":"2024-09-13T18:33:17.519700+0000","last_peered":"2024-09-13T18:33:17.519700+0000","last_clean":"2024-09-13T18:33:17.519700+0000","last_became_active":"2024-09-13T18:33:17.141365+0000","last_became_peered":"2024-09-13T18:33:17.141365+0000","last_unstale":"2024-09-13T18:33:17.519700+0000","last_undegraded":"2024-09-13T18:33:17.519700+0000","last_fullsized":"2024-09-13T18:33:17.519700+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:05.656925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.562369+0000","last_change":"2024-09-13T18:33:17.534156+0000","last_active":"2024-09-13T18:33:17.562369+0000","last_peered":"2024-09-13T18:33:17.562369+0000","last_clean":"2024-09-13T18:33:17.562369+0000","last_became_active":"2024-09-13T18:33:17.533469+0000","last_became_peered":"2024-09-13T18:33:17.533469+0000","last_unstale":"2024-09-13T18:33:17.562369+0000","last_undegraded":"2024-09-13T18:33:17.562369+0000","last_fullsized":"2024-09-13T18:33:17.562369+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:12.203550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"149'8","reported_seq":18,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.558786+0000","last_change":"2024-09-13T18:33:17.142722+0000","last_active":"2024-09-13T18:33:17.558786+0000","last_peered":"2024-09-13T18:33:17.558786+0000","last_clean":"2024-09-13T18:33:17.558786+0000","last_became_active":"2024-09-13T18:33:17.141516+0000","last_became_peered":"2024-09-13T18:33:17.141516+0000","last_unstale":"2024-09-13T18:33:17.558786+0000","last_undegraded":"2024-09-13T18:33:17.558786+0000","last_fullsized":"2024-09-13T18:33:17.558786+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:27.449470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.535996+0000","last_change":"2024-09-13T18:33:17.535297+0000","last_active":"2024-09-13T18:33:17.535996+0000","last_peered":"2024-09-13T18:33:17.535996+0000","last_clean":"2024-09-13T18:33:17.535996+0000","last_became_active":"2024-09-13T18:33:17.534982+0000","last_became_peered":"2024-09-13T18:33:17.534982+0000","last_unstale":"2024-09-13T18:33:17.535996+0000","last_undegraded":"2024-09-13T18:33:17.535996+0000","last_fullsized":"2024-09-13T18:33:17.535996+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:07.573395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.574584+0000","last_change":"2024-09-13T18:33:17.160098+0000","last_active":"2024-09-13T18:33:17.574584+0000","last_peered":"2024-09-13T18:33:17.574584+0000","last_clean":"2024-09-13T18:33:17.574584+0000","last_became_active":"2024-09-13T18:33:17.158256+0000","last_became_peered":"2024-09-13T18:33:17.158256+0000","last_unstale":"2024-09-13T18:33:17.574584+0000","last_undegraded":"2024-09-13T18:33:17.574584+0000","last_fullsized":"2024-09-13T18:33:17.574584+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:54.959224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537203+0000","last_change":"2024-09-13T18:33:17.535387+0000","last_active":"2024-09-13T18:33:17.537203+0000","last_peered":"2024-09-13T18:33:17.537203+0000","last_clean":"2024-09-13T18:33:17.537203+0000","last_became_active":"2024-09-13T18:33:17.532650+0000","last_became_peered":"2024-09-13T18:33:17.532650+0000","last_unstale":"2024-09-13T18:33:17.537203+0000","last_undegraded":"2024-09-13T18:33:17.537203+0000","last_fullsized":"2024-09-13T18:33:17.537203+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:27.438218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.570851+0000","last_change":"2024-09-13T18:33:17.158824+0000","last_active":"2024-09-13T18:33:17.570851+0000","last_peered":"2024-09-13T18:33:17.570851+0000","last_clean":"2024-09-13T18:33:17.570851+0000","last_became_active":"2024-09-13T18:33:17.158097+0000","last_became_peered":"2024-09-13T18:33:17.158097+0000","last_unstale":"2024-09-13T18:33:17.570851+0000","last_undegraded":"2024-09-13T18:33:17.570851+0000","last_fullsized":"2024-09-13T18:33:17.570851+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:23.968010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.532195+0000","last_change":"2024-09-13T18:33:17.529882+0000","last_active":"2024-09-13T18:33:17.532195+0000","last_peered":"2024-09-13T18:33:17.532195+0000","last_clean":"2024-09-13T18:33:17.532195+0000","last_became_active":"2024-09-13T18:33:17.529615+0000","last_became_peered":"2024-09-13T18:33:17.529615+0000","last_unstale":"2024-09-13T18:33:17.532195+0000","last_undegraded":"2024-09-13T18:33:17.532195+0000","last_fullsized":"2024-09-13T18:33:17.532195+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:26.165538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"149'1","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.554602+0000","last_change":"2024-09-13T18:33:17.153049+0000","last_active":"2024-09-13T18:33:17.554602+0000","last_peered":"2024-09-13T18:33:17.554602+0000","last_clean":"2024-09-13T18:33:17.554602+0000","last_became_active":"2024-09-13T18:33:17.152217+0000","last_became_peered":"2024-09-13T18:33:17.152217+0000","last_unstale":"2024-09-13T18:33:17.554602+0000","last_undegraded":"2024-09-13T18:33:17.554602+0000","last_fullsized":"2024-09-13T18:33:17.554602+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:33.431213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.550304+0000","last_change":"2024-09-13T18:33:17.549793+0000","last_active":"2024-09-13T18:33:17.550304+0000","last_peered":"2024-09-13T18:33:17.550304+0000","last_clean":"2024-09-13T18:33:17.550304+0000","last_became_active":"2024-09-13T18:33:17.549465+0000","last_became_peered":"2024-09-13T18:33:17.549465+0000","last_unstale":"2024-09-13T18:33:17.550304+0000","last_undegraded":"2024-09-13T18:33:17.550304+0000","last_fullsized":"2024-09-13T18:33:17.550304+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.277605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.531616+0000","last_change":"2024-09-13T18:33:17.147329+0000","last_active":"2024-09-13T18:33:17.531616+0000","last_peered":"2024-09-13T18:33:17.531616+0000","last_clean":"2024-09-13T18:33:17.531616+0000","last_became_active":"2024-09-13T18:33:17.146423+0000","last_became_peered":"2024-09-13T18:33:17.146423+0000","last_unstale":"2024-09-13T18:33:17.531616+0000","last_undegraded":"2024-09-13T18:33:17.531616+0000","last_fullsized":"2024-09-13T18:33:17.531616+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:18.615269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.565522+0000","last_change":"2024-09-13T18:33:17.552113+0000","last_active":"2024-09-13T18:33:17.565522+0000","last_peered":"2024-09-13T18:33:17.565522+0000","last_clean":"2024-09-13T18:33:17.565522+0000","last_became_active":"2024-09-13T18:33:17.551362+0000","last_became_peered":"2024-09-13T18:33:17.551362+0000","last_unstale":"2024-09-13T18:33:17.565522+0000","last_undegraded":"2024-09-13T18:33:17.565522+0000","last_fullsized":"2024-09-13T18:33:17.565522+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:26.165538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.561486+0000","last_change":"2024-09-13T18:33:17.146977+0000","last_active":"2024-09-13T18:33:17.561486+0000","last_peered":"2024-09-13T18:33:17.561486+0000","last_clean":"2024-09-13T18:33:17.561486+0000","last_became_active":"2024-09-13T18:33:17.146525+0000","last_became_peered":"2024-09-13T18:33:17.146525+0000","last_unstale":"2024-09-13T18:33:17.561486+0000","last_undegraded":"2024-09-13T18:33:17.561486+0000","last_fullsized":"2024-09-13T18:33:17.561486+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:16.144502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536870+0000","last_change":"2024-09-13T18:33:17.534094+0000","last_active":"2024-09-13T18:33:17.536870+0000","last_peered":"2024-09-13T18:33:17.536870+0000","last_clean":"2024-09-13T18:33:17.536870+0000","last_became_active":"2024-09-13T18:33:17.533443+0000","last_became_peered":"2024-09-13T18:33:17.533443+0000","last_unstale":"2024-09-13T18:33:17.536870+0000","last_undegraded":"2024-09-13T18:33:17.536870+0000","last_fullsized":"2024-09-13T18:33:17.536870+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:46.879049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.525634+0000","last_change":"2024-09-13T18:33:17.145283+0000","last_active":"2024-09-13T18:33:17.525634+0000","last_peered":"2024-09-13T18:33:17.525634+0000","last_clean":"2024-09-13T18:33:17.525634+0000","last_became_active":"2024-09-13T18:33:17.144586+0000","last_became_peered":"2024-09-13T18:33:17.144586+0000","last_unstale":"2024-09-13T18:33:17.525634+0000","last_undegraded":"2024-09-13T18:33:17.525634+0000","last_fullsized":"2024-09-13T18:33:17.525634+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:02.205991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.573531+0000","last_change":"2024-09-13T18:33:17.568282+0000","last_active":"2024-09-13T18:33:17.573531+0000","last_peered":"2024-09-13T18:33:17.573531+0000","last_clean":"2024-09-13T18:33:17.573531+0000","last_became_active":"2024-09-13T18:33:17.567762+0000","last_became_peered":"2024-09-13T18:33:17.567762+0000","last_unstale":"2024-09-13T18:33:17.573531+0000","last_undegraded":"2024-09-13T18:33:17.573531+0000","last_fullsized":"2024-09-13T18:33:17.573531+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:46.308239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.521886+0000","last_change":"2024-09-13T18:33:17.162175+0000","last_active":"2024-09-13T18:33:17.521886+0000","last_peered":"2024-09-13T18:33:17.521886+0000","last_clean":"2024-09-13T18:33:17.521886+0000","last_became_active":"2024-09-13T18:33:17.161692+0000","last_became_peered":"2024-09-13T18:33:17.161692+0000","last_unstale":"2024-09-13T18:33:17.521886+0000","last_undegraded":"2024-09-13T18:33:17.521886+0000","last_fullsized":"2024-09-13T18:33:17.521886+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:23.968010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.567911+0000","last_change":"2024-09-13T18:33:17.567419+0000","last_active":"2024-09-13T18:33:17.567911+0000","last_peered":"2024-09-13T18:33:17.567911+0000","last_clean":"2024-09-13T18:33:17.567911+0000","last_became_active":"2024-09-13T18:33:17.567092+0000","last_became_peered":"2024-09-13T18:33:17.567092+0000","last_unstale":"2024-09-13T18:33:17.567911+0000","last_undegraded":"2024-09-13T18:33:17.567911+0000","last_fullsized":"2024-09-13T18:33:17.567911+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:43.420536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.525364+0000","last_change":"2024-09-13T18:33:17.138245+0000","last_active":"2024-09-13T18:33:17.525364+0000","last_peered":"2024-09-13T18:33:17.525364+0000","last_clean":"2024-09-13T18:33:17.525364+0000","last_became_active":"2024-09-13T18:33:17.137570+0000","last_became_peered":"2024-09-13T18:33:17.137570+0000","last_unstale":"2024-09-13T18:33:17.525364+0000","last_undegraded":"2024-09-13T18:33:17.525364+0000","last_fullsized":"2024-09-13T18:33:17.525364+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:07.218627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537217+0000","last_change":"2024-09-13T18:33:17.531358+0000","last_active":"2024-09-13T18:33:17.537217+0000","last_peered":"2024-09-13T18:33:17.537217+0000","last_clean":"2024-09-13T18:33:17.537217+0000","last_became_active":"2024-09-13T18:33:17.531100+0000","last_became_peered":"2024-09-13T18:33:17.531100+0000","last_unstale":"2024-09-13T18:33:17.537217+0000","last_undegraded":"2024-09-13T18:33:17.537217+0000","last_fullsized":"2024-09-13T18:33:17.537217+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:06.277605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"149'2","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.562427+0000","last_change":"2024-09-13T18:33:17.147231+0000","last_active":"2024-09-13T18:33:17.562427+0000","last_peered":"2024-09-13T18:33:17.562427+0000","last_clean":"2024-09-13T18:33:17.562427+0000","last_became_active":"2024-09-13T18:33:17.146889+0000","last_became_peered":"2024-09-13T18:33:17.146889+0000","last_unstale":"2024-09-13T18:33:17.562427+0000","last_undegraded":"2024-09-13T18:33:17.562427+0000","last_fullsized":"2024-09-13T18:33:17.562427+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:17.006398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.564059+0000","last_change":"2024-09-13T18:33:17.563648+0000","last_active":"2024-09-13T18:33:17.564059+0000","last_peered":"2024-09-13T18:33:17.564059+0000","last_clean":"2024-09-13T18:33:17.564059+0000","last_became_active":"2024-09-13T18:33:17.563342+0000","last_became_peered":"2024-09-13T18:33:17.563342+0000","last_unstale":"2024-09-13T18:33:17.564059+0000","last_undegraded":"2024-09-13T18:33:17.564059+0000","last_fullsized":"2024-09-13T18:33:17.564059+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:05.309503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.550946+0000","last_change":"2024-09-13T18:33:17.162652+0000","last_active":"2024-09-13T18:33:17.550946+0000","last_peered":"2024-09-13T18:33:17.550946+0000","last_clean":"2024-09-13T18:33:17.550946+0000","last_became_active":"2024-09-13T18:33:17.161030+0000","last_became_peered":"2024-09-13T18:33:17.161030+0000","last_unstale":"2024-09-13T18:33:17.550946+0000","last_undegraded":"2024-09-13T18:33:17.550946+0000","last_fullsized":"2024-09-13T18:33:17.550946+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:04.469501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.534225+0000","last_change":"2024-09-13T18:33:17.528943+0000","last_active":"2024-09-13T18:33:17.534225+0000","last_peered":"2024-09-13T18:33:17.534225+0000","last_clean":"2024-09-13T18:33:17.534225+0000","last_became_active":"2024-09-13T18:33:17.528560+0000","last_became_peered":"2024-09-13T18:33:17.528560+0000","last_unstale":"2024-09-13T18:33:17.534225+0000","last_undegraded":"2024-09-13T18:33:17.534225+0000","last_fullsized":"2024-09-13T18:33:17.534225+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:17.153543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.545286+0000","last_change":"2024-09-13T18:33:17.141678+0000","last_active":"2024-09-13T18:33:17.545286+0000","last_peered":"2024-09-13T18:33:17.545286+0000","last_clean":"2024-09-13T18:33:17.545286+0000","last_became_active":"2024-09-13T18:33:17.139711+0000","last_became_peered":"2024-09-13T18:33:17.139711+0000","last_unstale":"2024-09-13T18:33:17.545286+0000","last_undegraded":"2024-09-13T18:33:17.545286+0000","last_fullsized":"2024-09-13T18:33:17.545286+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:42.312583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.554737+0000","last_change":"2024-09-13T18:33:17.554140+0000","last_active":"2024-09-13T18:33:17.554737+0000","last_peered":"2024-09-13T18:33:17.554737+0000","last_clean":"2024-09-13T18:33:17.554737+0000","last_became_active":"2024-09-13T18:33:17.553830+0000","last_became_peered":"2024-09-13T18:33:17.553830+0000","last_unstale":"2024-09-13T18:33:17.554737+0000","last_undegraded":"2024-09-13T18:33:17.554737+0000","last_fullsized":"2024-09-13T18:33:17.554737+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.316651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.513777+0000","last_change":"2024-09-13T18:33:17.165856+0000","last_active":"2024-09-13T18:33:17.513777+0000","last_peered":"2024-09-13T18:33:17.513777+0000","last_clean":"2024-09-13T18:33:17.513777+0000","last_became_active":"2024-09-13T18:33:17.165540+0000","last_became_peered":"2024-09-13T18:33:17.165540+0000","last_unstale":"2024-09-13T18:33:17.513777+0000","last_undegraded":"2024-09-13T18:33:17.513777+0000","last_fullsized":"2024-09-13T18:33:17.513777+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:52.987424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.536783+0000","last_change":"2024-09-13T18:33:17.524172+0000","last_active":"2024-09-13T18:33:17.536783+0000","last_peered":"2024-09-13T18:33:17.536783+0000","last_clean":"2024-09-13T18:33:17.536783+0000","last_became_active":"2024-09-13T18:33:17.523923+0000","last_became_peered":"2024-09-13T18:33:17.523923+0000","last_unstale":"2024-09-13T18:33:17.536783+0000","last_undegraded":"2024-09-13T18:33:17.536783+0000","last_fullsized":"2024-09-13T18:33:17.536783+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:04.645546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.519447+0000","last_change":"2024-09-13T18:33:17.150635+0000","last_active":"2024-09-13T18:33:17.519447+0000","last_peered":"2024-09-13T18:33:17.519447+0000","last_clean":"2024-09-13T18:33:17.519447+0000","last_became_active":"2024-09-13T18:33:17.149917+0000","last_became_peered":"2024-09-13T18:33:17.149917+0000","last_unstale":"2024-09-13T18:33:17.519447+0000","last_undegraded":"2024-09-13T18:33:17.519447+0000","last_fullsized":"2024-09-13T18:33:17.519447+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:39.020672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.548870+0000","last_change":"2024-09-13T18:33:17.534525+0000","last_active":"2024-09-13T18:33:17.548870+0000","last_peered":"2024-09-13T18:33:17.548870+0000","last_clean":"2024-09-13T18:33:17.548870+0000","last_became_active":"2024-09-13T18:33:17.533836+0000","last_became_peered":"2024-09-13T18:33:17.533836+0000","last_unstale":"2024-09-13T18:33:17.548870+0000","last_undegraded":"2024-09-13T18:33:17.548870+0000","last_fullsized":"2024-09-13T18:33:17.548870+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:34.440254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.522010+0000","last_change":"2024-09-13T18:33:17.153560+0000","last_active":"2024-09-13T18:33:17.522010+0000","last_peered":"2024-09-13T18:33:17.522010+0000","last_clean":"2024-09-13T18:33:17.522010+0000","last_became_active":"2024-09-13T18:33:17.153235+0000","last_became_peered":"2024-09-13T18:33:17.153235+0000","last_unstale":"2024-09-13T18:33:17.522010+0000","last_undegraded":"2024-09-13T18:33:17.522010+0000","last_fullsized":"2024-09-13T18:33:17.522010+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:04.469501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.549308+0000","last_change":"2024-09-13T18:33:17.548822+0000","last_active":"2024-09-13T18:33:17.549308+0000","last_peered":"2024-09-13T18:33:17.549308+0000","last_clean":"2024-09-13T18:33:17.549308+0000","last_became_active":"2024-09-13T18:33:17.548420+0000","last_became_peered":"2024-09-13T18:33:17.548420+0000","last_unstale":"2024-09-13T18:33:17.549308+0000","last_undegraded":"2024-09-13T18:33:17.549308+0000","last_fullsized":"2024-09-13T18:33:17.549308+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:31.316651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.541199+0000","last_change":"2024-09-13T18:33:17.144157+0000","last_active":"2024-09-13T18:33:17.541199+0000","last_peered":"2024-09-13T18:33:17.541199+0000","last_clean":"2024-09-13T18:33:17.541199+0000","last_became_active":"2024-09-13T18:33:17.142444+0000","last_became_peered":"2024-09-13T18:33:17.142444+0000","last_unstale":"2024-09-13T18:33:17.541199+0000","last_undegraded":"2024-09-13T18:33:17.541199+0000","last_fullsized":"2024-09-13T18:33:17.541199+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:17.708868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.564199+0000","last_change":"2024-09-13T18:33:17.551819+0000","last_active":"2024-09-13T18:33:17.564199+0000","last_peered":"2024-09-13T18:33:17.564199+0000","last_clean":"2024-09-13T18:33:17.564199+0000","last_became_active":"2024-09-13T18:33:17.551116+0000","last_became_peered":"2024-09-13T18:33:17.551116+0000","last_unstale":"2024-09-13T18:33:17.564199+0000","last_undegraded":"2024-09-13T18:33:17.564199+0000","last_fullsized":"2024-09-13T18:33:17.564199+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:18.467452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.518830+0000","last_change":"2024-09-13T18:33:17.134351+0000","last_active":"2024-09-13T18:33:17.518830+0000","last_peered":"2024-09-13T18:33:17.518830+0000","last_clean":"2024-09-13T18:33:17.518830+0000","last_became_active":"2024-09-13T18:33:17.133584+0000","last_became_peered":"2024-09-13T18:33:17.133584+0000","last_unstale":"2024-09-13T18:33:17.518830+0000","last_undegraded":"2024-09-13T18:33:17.518830+0000","last_fullsized":"2024-09-13T18:33:17.518830+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:19.179351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.537235+0000","last_change":"2024-09-13T18:33:17.531428+0000","last_active":"2024-09-13T18:33:17.537235+0000","last_peered":"2024-09-13T18:33:17.537235+0000","last_clean":"2024-09-13T18:33:17.537235+0000","last_became_active":"2024-09-13T18:33:17.531194+0000","last_became_peered":"2024-09-13T18:33:17.531194+0000","last_unstale":"2024-09-13T18:33:17.537235+0000","last_undegraded":"2024-09-13T18:33:17.537235+0000","last_fullsized":"2024-09-13T18:33:17.537235+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:17.109038+0000","last_clean_scrub_stamp":"2024-09-13T18:33:17.109038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:29.198280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.518592+0000","last_change":"2024-09-13T18:33:17.152052+0000","last_active":"2024-09-13T18:33:17.518592+0000","last_peered":"2024-09-13T18:33:17.518592+0000","last_clean":"2024-09-13T18:33:17.518592+0000","last_became_active":"2024-09-13T18:33:17.151372+0000","last_became_peered":"2024-09-13T18:33:17.151372+0000","last_unstale":"2024-09-13T18:33:17.518592+0000","last_undegraded":"2024-09-13T18:33:17.518592+0000","last_fullsized":"2024-09-13T18:33:17.518592+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:16.099997+0000","last_clean_scrub_stamp":"2024-09-13T18:33:16.099997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:40.320124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-13T18:33:17.128956+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:33:17.128956+0000","last_peered":"2024-09-13T18:33:17.128956+0000","last_clean":"2024-09-13T18:33:17.128956+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:33:17.128956+0000","last_undegraded":"2024-09-13T18:33:17.128956+0000","last_fullsized":"2024-09-13T18:33:17.128956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33548,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338292,"statfs":{"total":96636764160,"available":96602411008,"internally_reserved":0,"allocated":2482176,"data_stored":1419228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.6439999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93300000000000005,"15min":0.90000000000000002},"min":{"1min":0.57499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":1.333,"15min":1.4410000000000001},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.218,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.93200000000000005},"min":{"1min":0.54400000000000004,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.2490000000000001,"5min":1.4890000000000001,"15min":1.6060000000000001},"last":1.173}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80900000000000005,"15min":0.80400000000000005},"min":{"1min":0.53700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":1.276,"15min":1.276},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.165,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":1.046}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1339999999999999,"5min":1.349,"15min":1.448},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.238,"5min":1.395,"15min":1.397},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.873,"15min":0.88800000000000001},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.218,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.93999999999999995},"min":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.127}]},{"osd":5,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95499999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.877},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.70299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":1.409,"15min":1.409},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.85499999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":1.476,"15min":1.476},"last":1.093},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.02,"15min":1.006},"min":{"1min":0.65000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2689999999999999,"5min":1.361,"15min":1.506},"last":1.2969999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1847296,"data_stored":814978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.82699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.0820000000000001,"5min":1.47,"15min":2.9990000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.3480000000000001,"15min":1.577},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":0.91600000000000004},"min":{"1min":0.71899999999999997,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.069,"5min":1.218,"15min":1.464},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.95799999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.319,"5min":1.673,"15min":2.4220000000000002},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.516,"15min":1.516},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.61899999999999999,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.2669999999999999,"15min":1.306},"last":0.96099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.97099999999999997},"min":{"1min":0.72799999999999998,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.2350000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.745},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.014},"min":{"1min":0.79200000000000004,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.2589999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.69399999999999995,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.88},{"interface":"front","average":{"1min":1.01,"5min":1.024,"15min":1.0800000000000001},"min":{"1min":0.67200000000000004,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":2.762},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.0369999999999999},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.22,"5min":1.5,"15min":1.9299999999999999},"last":1.077},{"interface":"front","average":{"1min":1.024,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.2470000000000001,"5min":1.357,"15min":1.72},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1859584,"data_stored":821253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":0.83899999999999997},"min":{"1min":0.47899999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":1.145},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.88700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.437},"max":{"1min":1.089,"5min":1.264,"15min":2.1840000000000002},"last":1.1759999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1719999999999999,"5min":1.603,"15min":1.603},"last":1.208},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92800000000000005,"15min":0.95099999999999996},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.21,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.64800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.0760000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95299999999999996,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.46,"5min":3.46,"15min":3.46},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.306,"5min":1.492,"15min":1.5049999999999999},"last":1.091}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0109999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.376,"15min":0.376},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.97499999999999998,"15min":1.014},"min":{"1min":0.63100000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.0960000000000001},"min":{"1min":0.65800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.246},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.76000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":1.006}]}]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1859584,"data_stored":821253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93200000000000005,"15min":0.84499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2649999999999999,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.91000000000000003,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.242,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.872}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.216,"5min":1.536,"15min":1.536},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.89200000000000002},"min":{"1min":0.52600000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3660000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.367,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.92300000000000004,"15min":0.90500000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4490000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":10.44,"15min":10.44},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.286,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":0.97199999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.363,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1259999999999999,"15min":1.0309999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.222,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.504,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.0660000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.1819999999999999,"15min":1.091},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.573,"5min":15.593,"15min":15.593},"last":1.095},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.077},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4119999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.127}]}]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1847296,"data_stored":814978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65700000000000003,"15min":0.63100000000000001},"min":{"1min":0.309,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.444,"5min":2.113,"15min":2.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.75,"15min":0.72199999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0940000000000001,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68300000000000005,"15min":0.67400000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66800000000000004,"15min":0.626},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1.1879999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.439}]},{"osd":2,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.4850000000000001,"5min":1.742,"15min":1.742},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.746},"min":{"1min":0.39700000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.0089999999999999,"5min":1.222,"15min":1.399},"last":0.69599999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.94299999999999995,"15min":0.94699999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3280000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.024,"5min":0.97699999999999998,"15min":1.077},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1539999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":0.746},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.94499999999999995,"15min":0.93600000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.7669999999999999,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.052},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.623},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0309999999999999,"15min":1.0449999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.53400000000000003},"max":{"1min":1.208,"5min":1.6890000000000001,"15min":1.96},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:32:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.0609999999999999,"15min":1.091},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0229999999999999,"15min":1.004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"max":{"1min":1.3460000000000001,"5min":2.9220000000000002,"15min":2.9220000000000002},"last":0.81100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1875968,"data_stored":828118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.024,"5min":1.024,"15min":1.0309999999999999},"last":0.623},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67600000000000005,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.01,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65700000000000003,"15min":0.70499999999999996},"min":{"1min":0.32000000000000001,"5min":0.318,"15min":0.307},"max":{"1min":0.98599999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.71899999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0760000000000001,"5min":1.161,"15min":1.1859999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.264,"5min":1.405,"15min":1.405},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90900000000000003,"15min":0.91400000000000003},"min":{"1min":0.61899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.339,"5min":1.367,"15min":1.611},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88600000000000001,"15min":0.91200000000000003},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2649999999999999,"5min":1.587,"15min":1.587},"last":0.98099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.72399999999999998,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.9179999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.456,"5min":1.552,"15min":1.702},"last":1.026}]},{"osd":6,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":0.95799999999999996},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.3819999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.58799999999999997},"max":{"1min":1.5409999999999999,"5min":1.645,"15min":1.645},"last":0.879}]},{"osd":7,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.70199999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.3009999999999999,"5min":1.843,"15min":1.843},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.0369999999999999,"15min":1.0740000000000001},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4219999999999999,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":1.004}]}]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41140,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330700,"statfs":{"total":96636764160,"available":96594636800,"internally_reserved":0,"allocated":1875968,"data_stored":828062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89600000000000002,"5min":1.077,"15min":1.077},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":1.042,"15min":1.177},"last":1.4650000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":1.077,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.70699999999999996},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.27800000000000002},"max":{"1min":1.048,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.317},"max":{"1min":1.125,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.876},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":1.423,"15min":1.423},"last":1.0509999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92300000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.42899999999999999},"max":{"1min":1.1499999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2589999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.367},{"interface":"front","average":{"1min":0.995,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.484,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.226}]},{"osd":6,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98499999999999999,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1859999999999999,"5min":1.5900000000000001,"15min":1.653},"last":1.335},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":0.98799999999999999},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.262,"5min":1.425,"15min":1.5740000000000001},"last":1.1739999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.52500000000000002},"max":{"1min":1.5329999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.0209999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.546}]}]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41704,"kb_used_data":2396,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330136,"statfs":{"total":96636764160,"available":96594059264,"internally_reserved":0,"allocated":2453504,"data_stored":1411621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.018,"5min":1.244,"15min":1.4359999999999999},"last":1.151}]},{"osd":2,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94499999999999995,"5min":1.333,"15min":1.333},"last":1.5960000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0920000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.002,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":1.101},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.171,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":1.375}]},{"osd":4,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.87,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.3879999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.294,"5min":1.5069999999999999,"15min":1.986},"last":1.333}]},{"osd":5,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4379999999999999,"5min":1.8799999999999999,"15min":2.641},"last":1.4470000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58499999999999996},"max":{"1min":1.395,"5min":1.395,"15min":1.6699999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.60499999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.333,"5min":1.466,"15min":1.891},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.218}]},{"osd":7,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.0229999999999999},"min":{"1min":0.63400000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.363,"5min":1.669,"15min":2.2949999999999999},"last":1.024},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0980000000000001},"min":{"1min":0.68000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4530000000000001,"5min":1.724,"15min":2.2480000000000002},"last":1.53}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:33:21.948 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:33:21.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:33:22.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3fba7640 1 Processor -- start 2024-09-13T18:33:22.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3fba7640 1 -- start start 2024-09-13T18:33:22.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3fba7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f38143e80 0x7f2f3806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3fba7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f380caee0 0x7f2f380cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3fba7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3806f7a0 con 0x7f2f380cd320 2024-09-13T18:33:22.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3fba7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3806fd60 con 0x7f2f38143e80 2024-09-13T18:33:22.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3fba7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380cb960 con 0x7f2f380caee0 2024-09-13T18:33:22.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3d142640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f380caee0 0x7f2f380cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3d943640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f38143e80 0x7f2f3806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3e144640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2f380cd320 0x7f2f380cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:41902/0 (socket says 172.21.15.53:41902) 2024-09-13T18:33:22.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3e144640 1 -- 172.21.15.53:0/2589229239 learned_addr learned my addr 172.21.15.53:0/2589229239 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:22.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.117+0000 7f2f3c941640 1 -- 172.21.15.53:0/2589229239 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191825664 0 0) 0x7f2f3806f7a0 con 0x7f2f380cd320 2024-09-13T18:33:22.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.121+0000 7f2f3c941640 1 -- 172.21.15.53:0/2589229239 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f24003530 con 0x7f2f380cd320 2024-09-13T18:33:22.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.121+0000 7f2f3d943640 1 -- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f380caee0 msgr2=0x7f2f380cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.121+0000 7f2f3d943640 1 --2- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f380caee0 0x7f2f380cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.121+0000 7f2f3d943640 1 -- 172.21.15.53:0/2589229239 >> v1:172.21.15.87:6789/0 conn(0x7f2f380cd320 legacy=0x7f2f380cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.121+0000 7f2f3d943640 1 -- 172.21.15.53:0/2589229239 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380cbc40 con 0x7f2f38143e80 2024-09-13T18:33:22.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.121+0000 7f2f3d142640 1 --2- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f380caee0 0x7f2f380cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:22.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d943640 1 --2- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f38143e80 0x7f2f3806b390 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2f340097c0 tx=0x7f2f3401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2158af1c05767f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3c941640 1 -- 172.21.15.53:0/2589229239 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340ac620 con 0x7f2f38143e80 2024-09-13T18:33:22.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3c941640 1 -- 172.21.15.53:0/2589229239 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f340ac780 con 0x7f2f38143e80 2024-09-13T18:33:22.126 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3c941640 1 -- 172.21.15.53:0/2589229239 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340acb10 con 0x7f2f38143e80 2024-09-13T18:33:22.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f38143e80 msgr2=0x7f2f3806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f38143e80 0x7f2f3806b390 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2f340097c0 tx=0x7f2f3401c3e0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- 172.21.15.53:0/2589229239 shutdown_connections 2024-09-13T18:33:22.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f380caee0 0x7f2f380cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/2589229239 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f38143e80 0x7f2f3806b390 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- 172.21.15.53:0/2589229239 >> 172.21.15.53:0/2589229239 conn(0x7f2f38065c80 msgr2=0x7f2f38066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- 172.21.15.53:0/2589229239 shutdown_connections 2024-09-13T18:33:22.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- 172.21.15.53:0/2589229239 wait complete. 2024-09-13T18:33:22.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 Processor -- start 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- start start 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f380caee0 0x7f2f3813af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f380cd320 0x7f2f3813f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f38143e80 0x7f2f3813fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f381399f0 con 0x7f2f380cd320 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38140400 con 0x7f2f380caee0 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3fba7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380a84d0 con 0x7f2f38143e80 2024-09-13T18:33:22.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f380cd320 0x7f2f3813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f380cd320 0x7f2f3813f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33092/0 (socket says 172.21.15.53:33092) 2024-09-13T18:33:22.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 -- 172.21.15.53:0/3926466900 learned_addr learned my addr 172.21.15.53:0/3926466900 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:22.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d943640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f380caee0 0x7f2f3813af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3e144640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f38143e80 0x7f2f3813fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 -- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f38143e80 msgr2=0x7f2f3813fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f38143e80 0x7f2f3813fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 -- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f380caee0 msgr2=0x7f2f3813af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f380caee0 0x7f2f3813af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 -- 172.21.15.53:0/3926466900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f28009420 con 0x7f2f380cd320 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.125+0000 7f2f3d142640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f380cd320 0x7f2f3813f980 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800e980 tx=0x7f2f2800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f2e7fc640 1 -- 172.21.15.53:0/3926466900 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800ca00 con 0x7f2f380cd320 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f2e7fc640 1 -- 172.21.15.53:0/3926466900 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800cb60 con 0x7f2f380cd320 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f2e7fc640 1 -- 172.21.15.53:0/3926466900 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28013470 con 0x7f2f380cd320 2024-09-13T18:33:22.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f34009420 con 0x7f2f380cd320 2024-09-13T18:33:22.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f380a8c00 con 0x7f2f380cd320 2024-09-13T18:33:22.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380cb320 con 0x7f2f380cd320 2024-09-13T18:33:22.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f2e7fc640 1 -- 172.21.15.53:0/3926466900 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f2f280135d0 con 0x7f2f380cd320 2024-09-13T18:33:22.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f2e7fc640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2f1c066cc0 0x7f2f1c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f2e7fc640 1 -- 172.21.15.53:0/3926466900 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f28084ed0 con 0x7f2f380cd320 2024-09-13T18:33:22.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f3d943640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2f1c066cc0 0x7f2f1c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.129+0000 7f2f3d943640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2f1c066cc0 0x7f2f1c069180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f340ae000 tx=0x7f2f34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.133+0000 7f2f2e7fc640 1 -- 172.21.15.53:0/3926466900 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f28089070 con 0x7f2f380cd320 2024-09-13T18:33:22.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.345+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2f380cdf20 con 0x7f2f380cd320 2024-09-13T18:33:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f2e7fc640 1 -- 172.21.15.53:0/3926466900 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2f28051a00 con 0x7f2f380cd320 2024-09-13T18:33:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2f1c066cc0 msgr2=0x7f2f1c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2f1c066cc0 0x7f2f1c069180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f340ae000 tx=0x7f2f34008040 comp rx=0 tx=0).stop 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f380cd320 msgr2=0x7f2f3813f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f380cd320 0x7f2f3813f980 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800e980 tx=0x7f2f2800ee40 comp rx=0 tx=0).stop 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 shutdown_connections 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2f1c066cc0 0x7f2f1c069180 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f38143e80 0x7f2f3813fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f380cd320 0x7f2f3813f980 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 --2- 172.21.15.53:0/3926466900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f380caee0 0x7f2f3813af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.353+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 >> 172.21.15.53:0/3926466900 conn(0x7f2f38065c80 msgr2=0x7f2f380af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.357+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 shutdown_connections 2024-09-13T18:33:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.357+0000 7f2f3fba7640 1 -- 172.21.15.53:0/3926466900 wait complete. 2024-09-13T18:33:22.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.493+0000 7f1cf6b80640 1 Processor -- start 2024-09-13T18:33:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.493+0000 7f1cf6b80640 1 -- start start 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf6b80640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1cf015b300 0x7f1cf00cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf6b80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 0x7f1cf00ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf6b80640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf00cc3f0 con 0x7f1cf0161170 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf6b80640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf0161930 con 0x7f1cf015b300 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf6b80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0161c10 con 0x7f1cf00cc8f0 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1cf0161170 0x7f1cf0162310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39868/0 (socket says 172.21.15.53:39868) 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce7fff640 1 -- 172.21.15.53:0/24073492 learned_addr learned my addr 172.21.15.53:0/24073492 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 --2- 172.21.15.53:0/24073492 >> v2:172.21.15.87:3300/0 conn(0x7f1cf015b300 0x7f1cf00cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf511d640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 0x7f1cf00ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90348535 0 0) 0x7f1cf00cc3f0 con 0x7f1cf0161170 2024-09-13T18:33:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd8003530 con 0x7f1cf0161170 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276059701 0 0) 0x7f1cd8003530 con 0x7f1cf0161170 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 msgr2=0x7f1cf00ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 0x7f1cf00ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 >> v2:172.21.15.87:3300/0 conn(0x7f1cf015b300 msgr2=0x7f1cf00cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 --2- 172.21.15.53:0/24073492 >> v2:172.21.15.87:3300/0 conn(0x7f1cf015b300 0x7f1cf00cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0161ef0 con 0x7f1cf0161170 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f1ce0001680 con 0x7f1cf0161170 2024-09-13T18:33:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 --2- 172.21.15.53:0/24073492 >> v2:172.21.15.87:3300/0 conn(0x7f1cf015b300 0x7f1cf00cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 >> v1:172.21.15.53:6789/0 conn(0x7f1cf0161170 legacy=0x7f1cf0162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd8003980 0x7f1cd8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cd80047d0 0x7f1cd8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 0x7f1cd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0161930 con 0x7f1cd8003980 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0161c10 con 0x7f1cd80047d0 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd800b990 con 0x7f1cf00cc8f0 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd8003980 0x7f1cd8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce7fff640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cd80047d0 0x7f1cd8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 -- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 msgr2=0x7f1cd8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf511d640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 0x7f1cd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 0x7f1cd8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 -- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cd80047d0 msgr2=0x7f1cd8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cd80047d0 0x7f1cd8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf491c640 1 -- 172.21.15.53:0/24073492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8003530 con 0x7f1cd8003980 2024-09-13T18:33:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1ce7fff640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cd80047d0 0x7f1cd8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.497+0000 7f1cf511d640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cf00cc8f0 0x7f1cd8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf491c640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd8003980 0x7f1cd8003da0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009cb0 tx=0x7f1cec01cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd93562db1e8db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec0a5760 con 0x7f1cd8003980 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec0a58c0 con 0x7f1cd8003980 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1ce77fe640 1 -- 172.21.15.53:0/24073492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec0a5c70 con 0x7f1cd8003980 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- 172.21.15.53:0/24073492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd8003980 msgr2=0x7f1cd8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 --2- 172.21.15.53:0/24073492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd8003980 0x7f1cd8003da0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009cb0 tx=0x7f1cec01cc90 comp rx=0 tx=0).stop 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 -- 172.21.15.53:0/24073492 reap_dead start 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- 172.21.15.53:0/24073492 shutdown_connections 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- 172.21.15.53:0/24073492 >> 172.21.15.53:0/24073492 conn(0x7f1cf0065c80 msgr2=0x7f1cf0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- 172.21.15.53:0/24073492 shutdown_connections 2024-09-13T18:33:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- 172.21.15.53:0/24073492 wait complete. 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 Processor -- start 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- start start 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cd8003980 0x7f1cf0158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00ab820 0x7f1cf00abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf015f840 0x7f1cf015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0146a90 con 0x7f1cf015f840 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00ac1e0 con 0x7f1cf00ab820 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf6b80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01460f0 con 0x7f1cd8003980 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf015f840 0x7f1cf015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf015f840 0x7f1cf015fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33114/0 (socket says 172.21.15.53:33114) 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 -- 172.21.15.53:0/264068194 learned_addr learned my addr 172.21.15.53:0/264068194 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1ce7fff640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00ab820 0x7f1cf00abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf491c640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cd8003980 0x7f1cf0158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 -- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cd8003980 msgr2=0x7f1cf0158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cd8003980 0x7f1cf0158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 -- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00ab820 msgr2=0x7f1cf00abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.501+0000 7f1cf511d640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00ab820 0x7f1cf00abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf511d640 1 -- 172.21.15.53:0/264068194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf01463d0 con 0x7f1cf015f840 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf491c640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cd8003980 0x7f1cf0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1ce7fff640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00ab820 0x7f1cf00abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf511d640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf015f840 0x7f1cf015fcf0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0161550 tx=0x7f1ce800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1ce57fa640 1 -- 172.21.15.53:0/264068194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8017400 con 0x7f1cf015f840 2024-09-13T18:33:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1ce57fa640 1 -- 172.21.15.53:0/264068194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8011040 con 0x7f1cf015f840 2024-09-13T18:33:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1ce57fa640 1 -- 172.21.15.53:0/264068194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8017780 con 0x7f1cf015f840 2024-09-13T18:33:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf01466b0 con 0x7f1cf015f840 2024-09-13T18:33:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf00a8e80 con 0x7f1cf015f840 2024-09-13T18:33:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf0067400 con 0x7f1cf015f840 2024-09-13T18:33:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1ce57fa640 1 -- 172.21.15.53:0/264068194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f1ce80203b0 con 0x7f1cf015f840 2024-09-13T18:33:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1ce57fa640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cdc066cf0 0x7f1cdc0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1ce57fa640 1 -- 172.21.15.53:0/264068194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ce8085140 con 0x7f1cf015f840 2024-09-13T18:33:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf491c640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cdc066cf0 0x7f1cdc0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.505+0000 7f1cf491c640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cdc066cf0 0x7f1cdc0691b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0af000 tx=0x7f1cec0046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.509+0000 7f1ce57fa640 1 -- 172.21.15.53:0/264068194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ce8051af0 con 0x7f1cf015f840 2024-09-13T18:33:22.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cf0146bd0 con 0x7f1cf015f840 2024-09-13T18:33:22.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1ce57fa640 1 -- 172.21.15.53:0/264068194 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f1cf0146bd0 con 0x7f1cf015f840 2024-09-13T18:33:22.710 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:22.710 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/234820268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":234820268},{"type":"v1","addr":"172.21.15.87:6835","nonce":234820268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2552754296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2552754296},{"type":"v1","addr":"172.21.15.87:6833","nonce":2552754296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1877336010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1877336010},{"type":"v1","addr":"172.21.15.53:6833","nonce":1877336010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:17.507989+0000","modified":"2024-09-13T18:33:20.527909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9555},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9555":{"gid":9555,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1614413719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1614413719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1614413719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:33:22.711 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 88 2024-09-13T18:33:22.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cdc066cf0 msgr2=0x7f1cdc0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cdc066cf0 0x7f1cdc0691b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0af000 tx=0x7f1cec0046d0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf015f840 msgr2=0x7f1cf015fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf015f840 0x7f1cf015fcf0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0161550 tx=0x7f1ce800f4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 shutdown_connections 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1cdc066cf0 0x7f1cdc0691b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cf015f840 0x7f1cf015fcf0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cf00ab820 0x7f1cf00abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 --2- 172.21.15.53:0/264068194 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cd8003980 0x7f1cf0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:22.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 >> 172.21.15.53:0/264068194 conn(0x7f1cf0065c80 msgr2=0x7f1cf00b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:22.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 shutdown_connections 2024-09-13T18:33:22.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:22.709+0000 7f1cf6b80640 1 -- 172.21.15.53:0/264068194 wait complete. 2024-09-13T18:33:23.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:33:17.507989+0000', 'modified': '2024-09-13T18:33:20.527909+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9555}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9555': {'gid': 9555, 'name': 'c', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/1614413719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 1614413719}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 1614413719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:33:23.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:33:23.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:33:23.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.265+0000 7f3a14cd7640 1 Processor -- start 2024-09-13T18:33:23.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.265+0000 7f3a14cd7640 1 -- start start 2024-09-13T18:33:23.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a1006fa80 0x7f3a1006b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a100cbb60 0x7f3a100b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a100b2340 con 0x7f3a10158ba0 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a100b2860 con 0x7f3a100cbb60 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a10158f80 con 0x7f3a1006fa80 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3a10158ba0 0x7f3a1006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39878/0 (socket says 172.21.15.53:39878) 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a100cbb60 0x7f3a100b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0e59c640 1 -- 172.21.15.53:0/1075775646 learned_addr learned my addr 172.21.15.53:0/1075775646 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/1075775646 >> v2:172.21.15.87:3300/0 conn(0x7f3a1006fa80 0x7f3a1006b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0ed9d640 1 -- 172.21.15.53:0/1075775646 >> v2:172.21.15.87:3300/0 conn(0x7f3a1006fa80 msgr2=0x7f3a1006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/1075775646 >> v2:172.21.15.87:3300/0 conn(0x7f3a1006fa80 0x7f3a1006b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0ed9d640 1 -- 172.21.15.53:0/1075775646 >> v1:172.21.15.53:6789/0 conn(0x7f3a10158ba0 legacy=0x7f3a1006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0ed9d640 1 -- 172.21.15.53:0/1075775646 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a100b2580 con 0x7f3a100cbb60 2024-09-13T18:33:23.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0d59a640 1 -- 172.21.15.53:0/1075775646 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000262063 0 0) 0x7f3a00001120 con 0x7f3a10158ba0 2024-09-13T18:33:23.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/1075775646 >> v2:172.21.15.87:3300/0 conn(0x7f3a1006fa80 0x7f3a1006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:23.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/1075775646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a100cbb60 0x7f3a100b1e00 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f3a10070ed0 tx=0x7f3a0801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad15629ff9d228c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0d59a640 1 -- 172.21.15.53:0/1075775646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080a58f0 con 0x7f3a100cbb60 2024-09-13T18:33:23.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0d59a640 1 -- 172.21.15.53:0/1075775646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a080a5a50 con 0x7f3a100cbb60 2024-09-13T18:33:23.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a0d59a640 1 -- 172.21.15.53:0/1075775646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080a5de0 con 0x7f3a100cbb60 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- 172.21.15.53:0/1075775646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a100cbb60 msgr2=0x7f3a100b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/1075775646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a100cbb60 0x7f3a100b1e00 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f3a10070ed0 tx=0x7f3a0801c8b0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- 172.21.15.53:0/1075775646 shutdown_connections 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/1075775646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a100cbb60 0x7f3a100b1e00 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/1075775646 >> v2:172.21.15.87:3300/0 conn(0x7f3a1006fa80 0x7f3a1006b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- 172.21.15.53:0/1075775646 >> 172.21.15.53:0/1075775646 conn(0x7f3a10065c80 msgr2=0x7f3a10066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- 172.21.15.53:0/1075775646 shutdown_connections 2024-09-13T18:33:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.269+0000 7f3a14cd7640 1 -- 172.21.15.53:0/1075775646 wait complete. 2024-09-13T18:33:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 Processor -- start 2024-09-13T18:33:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 -- start start 2024-09-13T18:33:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a1006fa80 0x7f3a1014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a100cbb60 0x7f3a10153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a10158ba0 0x7f3a100adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a10159c90 con 0x7f3a1006fa80 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a101592f0 con 0x7f3a10158ba0 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a101595d0 con 0x7f3a100cbb60 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a1006fa80 0x7f3a1014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a1006fa80 0x7f3a1014bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33122/0 (socket says 172.21.15.53:33122) 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 -- 172.21.15.53:0/105971429 learned_addr learned my addr 172.21.15.53:0/105971429 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a10158ba0 0x7f3a100adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a100cbb60 0x7f3a10153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 -- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a100cbb60 msgr2=0x7f3a10153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a100cbb60 0x7f3a10153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 -- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a10158ba0 msgr2=0x7f3a100adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a10158ba0 0x7f3a100adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 -- 172.21.15.53:0/105971429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0800d040 con 0x7f3a1006fa80 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a100cbb60 0x7f3a10153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a1006fa80 0x7f3a1014bd20 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c480 tx=0x7f3a0000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f39feffd640 1 -- 172.21.15.53:0/105971429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000074e0 con 0x7f3a1006fa80 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f39feffd640 1 -- 172.21.15.53:0/105971429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00007660 con 0x7f3a1006fa80 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a101598b0 con 0x7f3a1006fa80 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f39feffd640 1 -- 172.21.15.53:0/105971429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00004a30 con 0x7f3a1006fa80 2024-09-13T18:33:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.273+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a10154240 con 0x7f3a1006fa80 2024-09-13T18:33:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f39feffd640 1 -- 172.21.15.53:0/105971429 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f3a00004b90 con 0x7f3a1006fa80 2024-09-13T18:33:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f39feffd640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39f0066cc0 0x7f39f0069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f39feffd640 1 -- 172.21.15.53:0/105971429 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a00083fd0 con 0x7f3a1006fa80 2024-09-13T18:33:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39f0066cc0 0x7f39f0069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39f0066cc0 0x7f39f0069180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3a04006e90 tx=0x7f3a04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 Processor -- start 2024-09-13T18:33:23.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 -- start start 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f3f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3fb10 0x55f2c8ef5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8ef5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8dbde80 con 0x55f2c8f3fb10 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8d4baf0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8d490c0 con 0x55f2c8ef5740 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3fb10 0x55f2c8ef5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3fb10 0x55f2c8ef5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33126/0 (socket says 172.21.15.53:33126) 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/408690890 learned_addr learned my addr 172.21.15.53:0/408690890 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f3f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8ef5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 msgr2=0x55f2c8ef5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8ef5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3f1f0 msgr2=0x55f2c8f3f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f3f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/408690890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c8a40890 con 0x55f2c8f3fb10 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3fb10 0x55f2c8ef5200 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400ed20 tx=0x7f3a04011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6428c8bd52846c9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f39effff640 1 -- 172.21.15.53:0/408690890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04025660 con 0x55f2c8f3fb10 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f39effff640 1 -- 172.21.15.53:0/408690890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a040257c0 con 0x55f2c8f3fb10 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.277+0000 7f39effff640 1 -- 172.21.15.53:0/408690890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04025b30 con 0x55f2c8f3fb10 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/408690890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3fb10 msgr2=0x55f2c8ef5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3fb10 0x55f2c8ef5200 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400ed20 tx=0x7f3a04011000 comp rx=0 tx=0).stop 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/408690890 shutdown_connections 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8ef5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3fb10 0x55f2c8ef5200 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- 172.21.15.53:0/408690890 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f3f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/408690890 >> 172.21.15.53:0/408690890 conn(0x55f2c8efbfb0 msgr2=0x55f2c8efc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/408690890 shutdown_connections 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/408690890 wait complete. 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- start start 2024-09-13T18:33:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 Processor -- start 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8f00fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f014f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f01a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8d449b0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8ce3c00 con 0x55f2c8f3fb10 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8d02070 con 0x55f2c8ef5740 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 10 client.0 _ll_register_callbacks cb 0x55f2c8ee1ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f014f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33130/0 (socket says 172.21.15.53:33130) 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2373859004 learned_addr learned my addr 172.21.15.53:0/2373859004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:23.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f01a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8f00fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 msgr2=0x55f2c8f00fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8f00fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 msgr2=0x55f2c8f01a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f01a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2373859004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0400e9d0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8f00fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f01a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f014f0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f3a04010ca0 tx=0x7f3a04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373b319fc181f434 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f39ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:33:23.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f39ed7fa640 1 -- 172.21.15.53:0/2373859004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04025cd0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f39ed7fa640 1 -- 172.21.15.53:0/2373859004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a0402a070 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2c8d015f0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f39ed7fa640 1 -- 172.21.15.53:0/2373859004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a04025e30 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 10 client.9681 fetch_fsmap learned FSMap version 88 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55f2c8d09ab0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f39ed7fa640 1 -- 172.21.15.53:0/2373859004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2c8d015f0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f39ed7fa640 1 -- 172.21.15.53:0/2373859004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 88) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3a04018070 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 10 client.9681 fetch_fsmap finished waiting for FSMap version 88 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 10 client.9681 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 20 client.9681 populate_metadata read hostname 'smithi053' 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f02440 0x55f2c8f512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 4 client.9681 mds_command: new command op to 9555 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 --> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2c8d41790 con 0x55f2c8f02440 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f02440 0x55f2c8f512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f02440 0x55f2c8f512a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d70202b63137a5 server_cookie=7633cd672d1717e9 in_seq=0 out_seq=0 2024-09-13T18:33:23.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.281+0000 7f39ed7fa640 10 client.9681 ms_handle_connect on v2:172.21.15.53:6834/1614413719 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f39ed7fa640 1 -- 172.21.15.53:0/2373859004 <== mds.0 v2:172.21.15.53:6834/1614413719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f2c8d41790 con 0x55f2c8f02440 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f39ed7fa640 10 client.9681 handle_command_reply: tid=0 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 client.9681 shutdown 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 msgr2=0x55f2c8f014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f014f0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f3a04010ca0 tx=0x7f3a04016000 comp rx=0 tx=0).stop 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 shutdown_connections 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f02440 0x55f2c8f512a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f01a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f014f0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2373859004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8ef5740 0x55f2c8f00fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f39ed7fa640 0 client.9681 ms_handle_reset on v2:172.21.15.53:6834/1614413719 2024-09-13T18:33:23.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 >> 172.21.15.53:0/2373859004 conn(0x55f2c8efbfb0 msgr2=0x55f2c8ef41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 shutdown_connections 2024-09-13T18:33:23.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 1 -- 172.21.15.53:0/2373859004 wait complete. 2024-09-13T18:33:23.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.285+0000 7f3a17e20000 20 client.9681 trim_cache size 0 max 16384 2024-09-13T18:33:23.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.297+0000 7f3a17e20000 1 Processor -- start 2024-09-13T18:33:23.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- start start 2024-09-13T18:33:23.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8ef5740 0x55f2c8f9b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f9ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3fb10 0x55f2c8f9bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8a01940 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8ef8360 con 0x55f2c8ef5740 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8eed6d0 con 0x55f2c8f3fb10 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f9ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f9ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33142/0 (socket says 172.21.15.53:33142) 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2783535458 learned_addr learned my addr 172.21.15.53:0/2783535458 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2783535458 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3fb10 msgr2=0x55f2c8f9bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/2783535458 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3fb10 0x55f2c8f9bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2783535458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8ef5740 msgr2=0x55f2c8f9b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/2783535458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8ef5740 0x55f2c8f9b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 -- 172.21.15.53:0/2783535458 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2c8cefc00 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/2783535458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f9ba80 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400b8c0 tx=0x7f3a04018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fd8046cbee7f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f39fcff9640 1 -- 172.21.15.53:0/2783535458 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400ebf0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f39fcff9640 1 -- 172.21.15.53:0/2783535458 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a04025cd0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f39fcff9640 1 -- 172.21.15.53:0/2783535458 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04030790 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- 172.21.15.53:0/2783535458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 msgr2=0x55f2c8f9ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2783535458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f9ba80 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400b8c0 tx=0x7f3a04018000 comp rx=0 tx=0).stop 2024-09-13T18:33:23.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- 172.21.15.53:0/2783535458 shutdown_connections 2024-09-13T18:33:23.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2783535458 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3fb10 0x55f2c8f9bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2783535458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8f3f1f0 0x55f2c8f9ba80 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- 172.21.15.53:0/2783535458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8ef5740 0x55f2c8f9b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- 172.21.15.53:0/2783535458 >> 172.21.15.53:0/2783535458 conn(0x55f2c8efbfb0 msgr2=0x55f2c8ef39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- 172.21.15.53:0/2783535458 shutdown_connections 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- 172.21.15.53:0/2783535458 wait complete. 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- start start 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 Processor -- start 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8ef5740 0x55f2c8f84190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3f1f0 0x55f2c8f84cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f85230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8ce1c10 con 0x55f2c8ef5740 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8d394d0 con 0x55f2c8f3fb10 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f2c8d421c0 con 0x55f2c8f3f1f0 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a17e20000 10 client.0 _ll_register_callbacks cb 0x7f3a04014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:33:23.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8ef5740 0x55f2c8f84190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8ef5740 0x55f2c8f84190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33152/0 (socket says 172.21.15.53:33152) 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 -- 172.21.15.53:0/679836233 learned_addr learned my addr 172.21.15.53:0/679836233 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3f1f0 0x55f2c8f84cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f85230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 -- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3f1f0 msgr2=0x55f2c8f84cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3f1f0 0x55f2c8f84cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 -- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 msgr2=0x55f2c8f85230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f85230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0e59c640 1 -- 172.21.15.53:0/679836233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2c8d09ab0 con 0x55f2c8ef5740 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0ed9d640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f85230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.301+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3f1f0 0x55f2c8f84cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a0e59c640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8ef5740 0x55f2c8f84190 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3a000546e0 tx=0x7f3a00004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a3e6318a68083 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:33:23.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 1 -- 172.21.15.53:0/679836233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00001150 con 0x55f2c8ef5740 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 1 -- 172.21.15.53:0/679836233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a0005c6b0 con 0x55f2c8ef5740 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2c8d14460 con 0x55f2c8ef5740 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 1 -- 172.21.15.53:0/679836233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a0005c870 con 0x55f2c8ef5740 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 10 client.9687 fetch_fsmap learned FSMap version 88 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55f2c8a40cc0 con 0x55f2c8ef5740 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 1 -- 172.21.15.53:0/679836233 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f2c8d14460 con 0x55f2c8ef5740 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 1 -- 172.21.15.53:0/679836233 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 88) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3a000580c0 con 0x55f2c8ef5740 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 10 client.9687 fetch_fsmap finished waiting for FSMap version 88 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 10 client.9687 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 20 client.9687 populate_metadata read hostname 'smithi053' 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f846d0 0x55f2c8f85770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 4 client.9687 mds_command: new command op to 9555 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:33:23.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 --> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f2c8d0d9c0 con 0x55f2c8f846d0 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f846d0 0x55f2c8f85770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a0dd9b640 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f846d0 0x55f2c8f85770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa178975364cc73 server_cookie=f002ce9050876f99 in_seq=0 out_seq=0 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 10 client.9687 ms_handle_connect on v2:172.21.15.53:6834/1614413719 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 1 -- 172.21.15.53:0/679836233 <== mds.0 v2:172.21.15.53:6834/1614413719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55f2c8d0d9c0 con 0x55f2c8f846d0 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 10 client.9687 handle_command_reply: tid=0 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 client.9687 shutdown 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8ef5740 msgr2=0x55f2c8f84190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8ef5740 0x55f2c8f84190 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3a000546e0 tx=0x7f3a00004f80 comp rx=0 tx=0).stop 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 shutdown_connections 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:6834/1614413719,v1:172.21.15.53:6835/1614413719] conn(0x55f2c8f846d0 0x55f2c8f85770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55f2c8f3f1f0 0x55f2c8f84cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f39ed7fa640 0 client.9687 ms_handle_reset on v2:172.21.15.53:6834/1614413719 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55f2c8f3fb10 0x55f2c8f85230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 --2- 172.21.15.53:0/679836233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f2c8ef5740 0x55f2c8f84190 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 >> 172.21.15.53:0/679836233 conn(0x55f2c8efbfb0 msgr2=0x55f2c8ef41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 shutdown_connections 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 1 -- 172.21.15.53:0/679836233 wait complete. 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a17e20000 20 client.9687 trim_cache size 0 max 16384 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9555, 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:33:23.313 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:33:23.314 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 5.7978579549999996, 2024-09-13T18:33:23.314 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 88, 2024-09-13T18:33:23.314 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 150, 2024-09-13T18:33:23.314 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 150, 2024-09-13T18:33:23.314 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 10.13303382 2024-09-13T18:33:23.314 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39f0066cc0 msgr2=0x7f39f0069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39f0066cc0 0x7f39f0069180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3a04006e90 tx=0x7f3a04008040 comp rx=0 tx=0).stop 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a1006fa80 msgr2=0x7f3a1014bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a1006fa80 0x7f3a1014bd20 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c480 tx=0x7f3a0000c940 comp rx=0 tx=0).stop 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 shutdown_connections 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39f0066cc0 0x7f39f0069180 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a100cbb60 0x7f3a10153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a10158ba0 0x7f3a100adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 --2- 172.21.15.53:0/105971429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a1006fa80 0x7f3a1014bd20 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 >> 172.21.15.53:0/105971429 conn(0x7f3a10065c80 msgr2=0x7f3a1006c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 shutdown_connections 2024-09-13T18:33:23.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.305+0000 7f3a14cd7640 1 -- 172.21.15.53:0/105971429 wait complete. 2024-09-13T18:33:23.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:33:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.429+0000 7f2a7b322640 1 Processor -- start 2024-09-13T18:33:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a7b322640 1 -- start start 2024-09-13T18:33:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a7b322640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7415b7c0 0x7f2a74070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a7b322640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a740711d0 0x7f2a741640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a7b322640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7406d480 con 0x7f2a741582a0 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a7b322640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7415aaf0 con 0x7f2a740711d0 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a7b322640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7406d760 con 0x7f2a7415b7c0 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a740711d0 0x7f2a741640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a740711d0 0x7f2a741640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33160/0 (socket says 172.21.15.53:33160) 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 -- 172.21.15.53:0/557679695 learned_addr learned my addr 172.21.15.53:0/557679695 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a788bd640 1 --2- 172.21.15.53:0/557679695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7415b7c0 0x7f2a74070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 -- 172.21.15.53:0/557679695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7415b7c0 msgr2=0x7f2a74070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 --2- 172.21.15.53:0/557679695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7415b7c0 0x7f2a74070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 -- 172.21.15.53:0/557679695 >> v1:172.21.15.87:6789/0 conn(0x7f2a741582a0 legacy=0x7f2a7406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 -- 172.21.15.53:0/557679695 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7415ace0 con 0x7f2a740711d0 2024-09-13T18:33:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a788bd640 1 --2- 172.21.15.53:0/557679695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7415b7c0 0x7f2a74070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:23.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a798bf640 1 --2- 172.21.15.53:0/557679695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a740711d0 0x7f2a741640f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009e50 tx=0x7f2a6c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b719b54115446ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.433+0000 7f2a6bfff640 1 -- 172.21.15.53:0/557679695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0a5760 con 0x7f2a740711d0 2024-09-13T18:33:23.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a6bfff640 1 -- 172.21.15.53:0/557679695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c0a58c0 con 0x7f2a740711d0 2024-09-13T18:33:23.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a6bfff640 1 -- 172.21.15.53:0/557679695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0a5c50 con 0x7f2a740711d0 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- 172.21.15.53:0/557679695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a740711d0 msgr2=0x7f2a741640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 --2- 172.21.15.53:0/557679695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a740711d0 0x7f2a741640f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009e50 tx=0x7f2a6c01c9f0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- 172.21.15.53:0/557679695 shutdown_connections 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 --2- 172.21.15.53:0/557679695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a740711d0 0x7f2a741640f0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 --2- 172.21.15.53:0/557679695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a7415b7c0 0x7f2a74070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- 172.21.15.53:0/557679695 >> 172.21.15.53:0/557679695 conn(0x7f2a74065c80 msgr2=0x7f2a74066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- 172.21.15.53:0/557679695 shutdown_connections 2024-09-13T18:33:23.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- 172.21.15.53:0/557679695 wait complete. 2024-09-13T18:33:23.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 Processor -- start 2024-09-13T18:33:23.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- start start 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a740711d0 0x7f2a74156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a741582a0 0x7f2a740abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7415b7c0 0x7f2a740ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7413c730 con 0x7f2a741582a0 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74155c40 con 0x7f2a7415b7c0 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a74155f20 con 0x7f2a740711d0 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a741582a0 0x7f2a740abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a741582a0 0x7f2a740abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33172/0 (socket says 172.21.15.53:33172) 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 -- 172.21.15.53:0/2004125987 learned_addr learned my addr 172.21.15.53:0/2004125987 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a798bf640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7415b7c0 0x7f2a740ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a790be640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a740711d0 0x7f2a74156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 -- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a740711d0 msgr2=0x7f2a74156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a740711d0 0x7f2a74156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 -- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7415b7c0 msgr2=0x7f2a740ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7415b7c0 0x7f2a740ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 -- 172.21.15.53:0/2004125987 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c009b30 con 0x7f2a741582a0 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a788bd640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a741582a0 0x7f2a740abb50 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c7c0 tx=0x7f2a7000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a69ffb640 1 -- 172.21.15.53:0/2004125987 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70007a30 con 0x7f2a741582a0 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a69ffb640 1 -- 172.21.15.53:0/2004125987 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a70007b90 con 0x7f2a741582a0 2024-09-13T18:33:23.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a69ffb640 1 -- 172.21.15.53:0/2004125987 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000ce70 con 0x7f2a741582a0 2024-09-13T18:33:23.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a74156200 con 0x7f2a741582a0 2024-09-13T18:33:23.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.437+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a741567c0 con 0x7f2a741582a0 2024-09-13T18:33:23.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.441+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a74067400 con 0x7f2a741582a0 2024-09-13T18:33:23.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.441+0000 7f2a69ffb640 1 -- 172.21.15.53:0/2004125987 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f2a700113f0 con 0x7f2a741582a0 2024-09-13T18:33:23.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.441+0000 7f2a69ffb640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a58066cc0 0x7f2a58069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:23.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.441+0000 7f2a69ffb640 1 -- 172.21.15.53:0/2004125987 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a70085260 con 0x7f2a741582a0 2024-09-13T18:33:23.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.441+0000 7f2a790be640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a58066cc0 0x7f2a58069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:23.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.441+0000 7f2a790be640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a58066cc0 0x7f2a58069180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007fd0 tx=0x7f2a64007e40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:23.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.445+0000 7f2a69ffb640 1 -- 172.21.15.53:0/2004125987 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a70051c30 con 0x7f2a741582a0 2024-09-13T18:33:23.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2a741569e0 con 0x7f2a741582a0 2024-09-13T18:33:23.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a69ffb640 1 -- 172.21.15.53:0/2004125987 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2a70055250 con 0x7f2a741582a0 2024-09-13T18:33:23.639 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:33:23.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a58066cc0 msgr2=0x7f2a58069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a58066cc0 0x7f2a58069180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007fd0 tx=0x7f2a64007e40 comp rx=0 tx=0).stop 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a741582a0 msgr2=0x7f2a740abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a741582a0 0x7f2a740abb50 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c7c0 tx=0x7f2a7000cc80 comp rx=0 tx=0).stop 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 shutdown_connections 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2a58066cc0 0x7f2a58069180 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2a7415b7c0 0x7f2a740ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a741582a0 0x7f2a740abb50 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 --2- 172.21.15.53:0/2004125987 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2a740711d0 0x7f2a74156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 >> 172.21.15.53:0/2004125987 conn(0x7f2a74065c80 msgr2=0x7f2a740aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 shutdown_connections 2024-09-13T18:33:23.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:23.637+0000 7f2a7b322640 1 -- 172.21.15.53:0/2004125987 wait complete. 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:33:23.656 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:33:23.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:23.657 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:33:23.663 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:33:23.663 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:33:23.663 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:33:23.663 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:33:23.664 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41993sec preferred_lft 41993sec 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.665 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:33:23.666 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:23.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:23.667 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:33:23.720 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:33:23.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:23.721 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:33:23.771 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:33:23.771 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:33:23.772 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:33:23.772 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:33:23.772 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:33:23.772 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:33:23.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:23.772 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:33:23.772 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:33:23.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:33:23.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:33:23.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:33:23.773 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:33:23.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:23.849 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:33:23.905 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:33:23.906 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:33:23.906 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:33:23.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:23.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:33:23.963 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:33:23.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:33:23.964 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:24.011 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:33:24.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:33:24.011 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:24.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:33:24.115 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:24.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:24.169 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:24.170 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:24.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:24.171 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:33:24.218 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:33:24.218 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:33:24.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:33:24.278 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:24.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:24.334 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:24.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:24.335 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:33:24.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:33:24.349+0000 7f83721c9580 -1 init, newargv = 0x55a4f1cc9b00 newargc=15 2024-09-13T18:33:24.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[55996]: starting ceph client 2024-09-13T18:33:24.357 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[55996]: starting fuse 2024-09-13T18:33:25.457 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:33:25.474 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:25.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:25.530 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:25.532 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:25.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:25.532 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:33:25.578 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:33:25.578 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:33:25.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:33:25.579 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:33:25.580 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:33:25.581 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:33:25.581 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:33:25.581 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:33:25.581 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:33:25.702 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.55996.asok 2024-09-13T18:33:25.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:33:25.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:33:25.884 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55996.asok 2024-09-13T18:33:25.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:25.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55996.asok status 2024-09-13T18:33:26.046 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:33:26.046 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:33:26.046 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:33:26.046 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:33:26.046 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "55996", 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9699, 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 9699 2024-09-13T18:33:26.047 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3904638273 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3904638273 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.9699 192.168.0.1:0/3904638273", 2024-09-13T18:33:26.048 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3904638273", 2024-09-13T18:33:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:33:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 88, 2024-09-13T18:33:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 150, 2024-09-13T18:33:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:33:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:33:26.049 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:33:26.049 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:33:26.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.061 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:33:26.061 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:26.068 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:33:26.068 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:26.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.068 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:26.120 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:33:26.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.289+0000 7f134c9bc640 1 Processor -- start 2024-09-13T18:33:26.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.289+0000 7f134c9bc640 1 -- start start 2024-09-13T18:33:26.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.289+0000 7f134c9bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13480cb980 0x7f13480b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:26.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.289+0000 7f134c9bc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13480b1ac0 con 0x7f134806b850 2024-09-13T18:33:26.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.289+0000 7f134c9bc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1348159ac0 con 0x7f13480cbd60 2024-09-13T18:33:26.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.289+0000 7f134c9bc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1348159da0 con 0x7f13480cb980 2024-09-13T18:33:26.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13480cb980 0x7f13480b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:26.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13480cb980 0x7f13480b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33188/0 (socket says 172.21.15.53:33188) 2024-09-13T18:33:26.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134659c640 1 -- 172.21.15.53:0/3617173340 learned_addr learned my addr 172.21.15.53:0/3617173340 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:26.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134659c640 1 -- 172.21.15.53:0/3617173340 >> v1:172.21.15.87:6789/0 conn(0x7f13480cbd60 legacy=0x7f13480b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:26.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134659c640 1 -- 172.21.15.53:0/3617173340 >> v1:172.21.15.53:6789/0 conn(0x7f134806b850 legacy=0x7f134806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:26.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134659c640 1 -- 172.21.15.53:0/3617173340 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134815a080 con 0x7f13480cb980 2024-09-13T18:33:26.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f1345d9b640 1 -- 172.21.15.53:0/3617173340 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762776210 0 0) 0x7f13480b1ac0 con 0x7f134806b850 2024-09-13T18:33:26.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134659c640 1 --2- 172.21.15.53:0/3617173340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f13480b33b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1338009870 tx=0x7f133801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742fd72310ecd88a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:26.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f1345d9b640 1 -- 172.21.15.53:0/3617173340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380a6040 con 0x7f13480cb980 2024-09-13T18:33:26.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f1345d9b640 1 -- 172.21.15.53:0/3617173340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13380aa600 con 0x7f13480cb980 2024-09-13T18:33:26.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f1345d9b640 1 -- 172.21.15.53:0/3617173340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380aa990 con 0x7f13480cb980 2024-09-13T18:33:26.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134c9bc640 1 -- 172.21.15.53:0/3617173340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 msgr2=0x7f13480b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:26.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134c9bc640 1 --2- 172.21.15.53:0/3617173340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f13480b33b0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1338009870 tx=0x7f133801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134c9bc640 1 -- 172.21.15.53:0/3617173340 shutdown_connections 2024-09-13T18:33:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134c9bc640 1 --2- 172.21.15.53:0/3617173340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f13480b33b0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134c9bc640 1 -- 172.21.15.53:0/3617173340 >> 172.21.15.53:0/3617173340 conn(0x7f1348065c80 msgr2=0x7f1348066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134c9bc640 1 -- 172.21.15.53:0/3617173340 shutdown_connections 2024-09-13T18:33:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.293+0000 7f134c9bc640 1 -- 172.21.15.53:0/3617173340 wait complete. 2024-09-13T18:33:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 Processor -- start 2024-09-13T18:33:26.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 -- start start 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f134806b850 0x7f1348134dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f134814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13480cbd60 0x7f134814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348135310 con 0x7f13480cb980 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134814b190 con 0x7f13480cbd60 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134814b470 con 0x7f134806b850 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f134814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f134814ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33204/0 (socket says 172.21.15.53:33204) 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 -- 172.21.15.53:0/4259669506 learned_addr learned my addr 172.21.15.53:0/4259669506 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f1346d9d640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13480cbd60 0x7f134814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134659c640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f134806b850 0x7f1348134dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:26.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 -- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f134806b850 msgr2=0x7f1348134dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f134806b850 0x7f1348134dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 -- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13480cbd60 msgr2=0x7f134814e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13480cbd60 0x7f134814e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 -- 172.21.15.53:0/4259669506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380094d0 con 0x7f13480cb980 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f1346d9d640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13480cbd60 0x7f134814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133dd9b640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f134814ddc0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f133000c410 tx=0x7f133000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133f7fe640 1 -- 172.21.15.53:0/4259669506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300054e0 con 0x7f13480cb980 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133f7fe640 1 -- 172.21.15.53:0/4259669506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330003600 con 0x7f13480cb980 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134815ac80 con 0x7f13480cb980 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f133f7fe640 1 -- 172.21.15.53:0/4259669506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300039b0 con 0x7f13480cb980 2024-09-13T18:33:26.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1348138a90 con 0x7f13480cb980 2024-09-13T18:33:26.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.297+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1348067400 con 0x7f13480cb980 2024-09-13T18:33:26.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.301+0000 7f133f7fe640 1 -- 172.21.15.53:0/4259669506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f1330003b10 con 0x7f13480cb980 2024-09-13T18:33:26.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.301+0000 7f133f7fe640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1328066cc0 0x7f1328069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:26.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.301+0000 7f133f7fe640 1 -- 172.21.15.53:0/4259669506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1330084250 con 0x7f13480cb980 2024-09-13T18:33:26.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.301+0000 7f134659c640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1328066cc0 0x7f1328069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:26.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.301+0000 7f134659c640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1328066cc0 0x7f1328069180 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13380ae000 tx=0x7f13380b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.305+0000 7f133f7fe640 1 -- 172.21.15.53:0/4259669506 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f13300547c0 con 0x7f13480cb980 2024-09-13T18:33:26.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f134815aae0 con 0x7f13480cb980 2024-09-13T18:33:26.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f133f7fe640 1 -- 172.21.15.53:0/4259669506 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7f134815aae0 con 0x7f13480cb980 2024-09-13T18:33:26.502 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1328066cc0 msgr2=0x7f1328069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1328066cc0 0x7f1328069180 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13380ae000 tx=0x7f13380b5040 comp rx=0 tx=0).stop 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 msgr2=0x7f134814ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f134814ddc0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f133000c410 tx=0x7f133000c8d0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 shutdown_connections 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1328066cc0 0x7f1328069180 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13480cbd60 0x7f134814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13480cb980 0x7f134814ddc0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 --2- 172.21.15.53:0/4259669506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f134806b850 0x7f1348134dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:26.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 >> 172.21.15.53:0/4259669506 conn(0x7f1348065c80 msgr2=0x7f13480ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:26.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 shutdown_connections 2024-09-13T18:33:26.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:26.501+0000 7f134c9bc640 1 -- 172.21.15.53:0/4259669506 wait complete. 2024-09-13T18:33:26.521 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:33:26.521 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:33:26.521 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:33:26.521 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:33:26.521 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:26.522 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:33:26.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:33:26.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:33:26.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:33:26.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.522 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:26.530 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 41996sec preferred_lft 41996sec 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:33:26.531 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.532 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:33:26.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.533 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:33:26.586 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:33:26.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.588 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:33:26.639 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:33:26.639 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:33:26.639 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:33:26.639 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:33:26.639 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:33:26.639 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:33:26.640 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:33:26.640 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:33:26.640 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:33:26.640 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:33:26.640 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:33:26.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.641 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:33:26.641 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:33:26.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:33:26.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:33:26.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:33:26.641 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:33:26.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.717 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:33:26.768 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:33:26.769 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:33:26.769 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:33:26.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:26.770 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:33:26.828 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:33:26.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:33:26.828 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:26.874 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:33:26.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:33:26.874 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:26.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:33:26.979 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:26.979 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:27.033 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:27.034 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:27.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:27.035 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:33:27.086 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:33:27.086 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:33:27.131 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:33:27.146 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:27.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:27.199 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:27.199 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:27.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:27.200 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:33:27.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:33:27.204+0000 7fe83f922580 -1 init, newargv = 0x560b44df7630 newargc=15 2024-09-13T18:33:27.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36540]: starting ceph client 2024-09-13T18:33:27.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36540]: starting fuse 2024-09-13T18:33:28.313 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:33:28.328 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:33:28.328 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:33:28.380 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:33:28.381 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:33:28.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:28.382 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:33:28.438 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:33:28.439 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:33:28.439 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:33:28.440 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:33:28.441 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:33:28.441 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:33:28.441 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:33:28.441 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:33:28.441 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:33:28.441 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:33:28.562 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.36540.asok 2024-09-13T18:33:28.745 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.36540.asok 2024-09-13T18:33:28.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:28.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.36540.asok status 2024-09-13T18:33:28.902 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "36540", 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:33:28.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 7370, 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 7370 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:33:28.904 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3202739768 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3202739768 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.7370 192.168.0.1:0/3202739768", 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/3202739768", 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:33:28.905 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 88, 2024-09-13T18:33:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 150, 2024-09-13T18:33:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:33:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:33:28.906 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:33:28.906 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:33:28.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:28.916 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:33:28.917 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:28.922 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:33:28.923 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:28.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:28.923 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:28.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:33:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6bcd0640 1 Processor -- start 2024-09-13T18:33:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6bcd0640 1 -- start start 2024-09-13T18:33:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6bcd0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d64145400 0x7f0d640ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6bcd0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640706a0 con 0x7f0d64145e50 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6bcd0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d64070190 con 0x7f0d64145900 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6bcd0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640b26d0 con 0x7f0d64145400 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d69a6c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d64145400 0x7f0d640ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6a26d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0d64145e50 0x7f0d6406fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51232/0 (socket says 172.21.15.53:51232) 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d69a6c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d64145400 0x7f0d640ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50426/0 (socket says 172.21.15.53:50426) 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d6a26d640 1 -- 172.21.15.53:0/2582294875 learned_addr learned my addr 172.21.15.53:0/2582294875 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.117+0000 7f0d69a6c640 1 -- 172.21.15.53:0/2582294875 >> v1:172.21.15.87:6789/0 conn(0x7f0d64145900 legacy=0x7f0d6406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d69a6c640 1 -- 172.21.15.53:0/2582294875 >> v1:172.21.15.53:6789/0 conn(0x7f0d64145e50 legacy=0x7f0d6406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d69a6c640 1 -- 172.21.15.53:0/2582294875 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640b3920 con 0x7f0d64145400 2024-09-13T18:33:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d68a6a640 1 -- 172.21.15.53:0/2582294875 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036376491 0 0) 0x7f0d5c0014a0 con 0x7f0d64145e50 2024-09-13T18:33:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d69a6c640 1 --2- 172.21.15.53:0/2582294875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145400 0x7f0d640ac8e0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f0d580097c0 tx=0x7f0d5801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332ce522443b9b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d68a6a640 1 -- 172.21.15.53:0/2582294875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580aa5f0 con 0x7f0d64145400 2024-09-13T18:33:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d68a6a640 1 -- 172.21.15.53:0/2582294875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d580aa750 con 0x7f0d64145400 2024-09-13T18:33:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d68a6a640 1 -- 172.21.15.53:0/2582294875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580aaae0 con 0x7f0d64145400 2024-09-13T18:33:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/2582294875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145400 msgr2=0x7f0d640ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/2582294875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145400 0x7f0d640ac8e0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f0d580097c0 tx=0x7f0d5801c470 comp rx=0 tx=0).stop 2024-09-13T18:33:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/2582294875 shutdown_connections 2024-09-13T18:33:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/2582294875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145400 0x7f0d640ac8e0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/2582294875 >> 172.21.15.53:0/2582294875 conn(0x7f0d64073330 msgr2=0x7f0d64065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/2582294875 shutdown_connections 2024-09-13T18:33:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.121+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/2582294875 wait complete. 2024-09-13T18:33:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 Processor -- start 2024-09-13T18:33:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 -- start start 2024-09-13T18:33:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d64145400 0x7f0d6413e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d64145900 0x7f0d640cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145e50 0x7f0d640cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d641443f0 con 0x7f0d64145e50 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d64167510 con 0x7f0d64145900 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d64144110 con 0x7f0d64145400 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145e50 0x7f0d640cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145e50 0x7f0d640cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50440/0 (socket says 172.21.15.53:50440) 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 -- 172.21.15.53:0/9742628 learned_addr learned my addr 172.21.15.53:0/9742628 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6926b640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d64145900 0x7f0d640cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d69a6c640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d64145400 0x7f0d6413e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 -- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d64145400 msgr2=0x7f0d6413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d64145400 0x7f0d6413e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 -- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d64145900 msgr2=0x7f0d640cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d64145900 0x7f0d640cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 -- 172.21.15.53:0/9742628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009420 con 0x7f0d64145e50 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6926b640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d64145900 0x7f0d640cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6a26d640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145e50 0x7f0d640cc890 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c780 tx=0x7f0d5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d567fc640 1 -- 172.21.15.53:0/9742628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00ce90 con 0x7f0d64145e50 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d567fc640 1 -- 172.21.15.53:0/9742628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c00a640 con 0x7f0d64145e50 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d640cb870 con 0x7f0d64145e50 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d567fc640 1 -- 172.21.15.53:0/9742628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00a9d0 con 0x7f0d64145e50 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640cbe30 con 0x7f0d64145e50 2024-09-13T18:33:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d640cace0 con 0x7f0d64145e50 2024-09-13T18:33:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d567fc640 1 -- 172.21.15.53:0/9742628 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f0d5c00ab30 con 0x7f0d64145e50 2024-09-13T18:33:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.125+0000 7f0d567fc640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d48066cc0 0x7f0d48069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.129+0000 7f0d567fc640 1 -- 172.21.15.53:0/9742628 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d5c084240 con 0x7f0d64145e50 2024-09-13T18:33:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.129+0000 7f0d69a6c640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d48066cc0 0x7f0d48069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.129+0000 7f0d69a6c640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d48066cc0 0x7f0d48069180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d580ae000 tx=0x7f0d580a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:29.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.133+0000 7f0d567fc640 1 -- 172.21.15.53:0/9742628 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d5c050d00 con 0x7f0d64145e50 2024-09-13T18:33:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.325+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0d640cb6d0 con 0x7f0d64145e50 2024-09-13T18:33:29.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.961+0000 7f0d567fc640 1 -- 172.21.15.53:0/9742628 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v89) v1 ==== 136+0+0 (secure 0 0 0) 0x7f0d640cb6d0 con 0x7f0d64145e50 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d48066cc0 msgr2=0x7f0d48069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d48066cc0 0x7f0d48069180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d580ae000 tx=0x7f0d580a7000 comp rx=0 tx=0).stop 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145e50 msgr2=0x7f0d640cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145e50 0x7f0d640cc890 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c780 tx=0x7f0d5c00cc40 comp rx=0 tx=0).stop 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 shutdown_connections 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0d48066cc0 0x7f0d48069180 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d64145e50 0x7f0d640cc890 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d64145900 0x7f0d640cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 --2- 172.21.15.53:0/9742628 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d64145400 0x7f0d6413e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:29.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 >> 172.21.15.53:0/9742628 conn(0x7f0d64073330 msgr2=0x7f0d6415e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:29.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 shutdown_connections 2024-09-13T18:33:29.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:29.965+0000 7f0d6bcd0640 1 -- 172.21.15.53:0/9742628 wait complete. 2024-09-13T18:33:29.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:33:30.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d70e2e640 1 Processor -- start 2024-09-13T18:33:30.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d70e2e640 1 -- start start 2024-09-13T18:33:30.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d70e2e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6c15b7c0 0x7f3d6c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d70e2e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c06d480 con 0x7f3d6c0711d0 2024-09-13T18:33:30.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d70e2e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c15ace0 con 0x7f3d6c1582a0 2024-09-13T18:33:30.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d70e2e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c071680 con 0x7f3d6c15b7c0 2024-09-13T18:33:30.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d69d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6c15b7c0 0x7f3d6c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d6ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3d6c0711d0 0x7f3d6c1640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51248/0 (socket says 172.21.15.53:51248) 2024-09-13T18:33:30.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d6ad9d640 1 -- 172.21.15.53:0/1970223423 learned_addr learned my addr 172.21.15.53:0/1970223423 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:30.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d69d9b640 1 -- 172.21.15.53:0/1970223423 >> v1:172.21.15.87:6789/0 conn(0x7f3d6c1582a0 legacy=0x7f3d6c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:30.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d6959a640 1 -- 172.21.15.53:0/1970223423 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400948924 0 0) 0x7f3d6c06d480 con 0x7f3d6c0711d0 2024-09-13T18:33:30.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d69d9b640 1 -- 172.21.15.53:0/1970223423 >> v1:172.21.15.53:6789/0 conn(0x7f3d6c0711d0 legacy=0x7f3d6c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.109+0000 7f3d69d9b640 1 -- 172.21.15.53:0/1970223423 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c15afc0 con 0x7f3d6c15b7c0 2024-09-13T18:33:30.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/1970223423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c15b7c0 0x7f3d6c070c90 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097c0 tx=0x7f3d6001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5678640899fea340 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6959a640 1 -- 172.21.15.53:0/1970223423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ab600 con 0x7f3d6c15b7c0 2024-09-13T18:33:30.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6959a640 1 -- 172.21.15.53:0/1970223423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600a7050 con 0x7f3d6c15b7c0 2024-09-13T18:33:30.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6959a640 1 -- 172.21.15.53:0/1970223423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ab980 con 0x7f3d6c15b7c0 2024-09-13T18:33:30.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- 172.21.15.53:0/1970223423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c15b7c0 msgr2=0x7f3d6c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/1970223423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c15b7c0 0x7f3d6c070c90 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097c0 tx=0x7f3d6001c4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- 172.21.15.53:0/1970223423 shutdown_connections 2024-09-13T18:33:30.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/1970223423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c15b7c0 0x7f3d6c070c90 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- 172.21.15.53:0/1970223423 >> 172.21.15.53:0/1970223423 conn(0x7f3d6c065c80 msgr2=0x7f3d6c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:30.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- 172.21.15.53:0/1970223423 shutdown_connections 2024-09-13T18:33:30.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- 172.21.15.53:0/1970223423 wait complete. 2024-09-13T18:33:30.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 Processor -- start 2024-09-13T18:33:30.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- start start 2024-09-13T18:33:30.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d6c0711d0 0x7f3d6c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d6c1582a0 0x7f3d6c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c153270 0x7f3d6c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c153c40 con 0x7f3d6c153270 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c14eca0 con 0x7f3d6c1582a0 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d70e2e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c14a560 con 0x7f3d6c0711d0 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c153270 0x7f3d6c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c153270 0x7f3d6c153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50466/0 (socket says 172.21.15.53:50466) 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 -- 172.21.15.53:0/92081924 learned_addr learned my addr 172.21.15.53:0/92081924 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 -- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d6c0711d0 msgr2=0x7f3d6c14a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d6c1582a0 0x7f3d6c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6a59c640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d6c0711d0 0x7f3d6c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d6c0711d0 0x7f3d6c14a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 -- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d6c1582a0 msgr2=0x7f3d6c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d6c1582a0 0x7f3d6c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d6ad9d640 1 -- 172.21.15.53:0/92081924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60009420 con 0x7f3d6c153270 2024-09-13T18:33:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.113+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d6c1582a0 0x7f3d6c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d6ad9d640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c153270 0x7f3d6c153700 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400c810 tx=0x7f3d6400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d5affd640 1 -- 172.21.15.53:0/92081924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400a640 con 0x7f3d6c153270 2024-09-13T18:33:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d5affd640 1 -- 172.21.15.53:0/92081924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6400a7c0 con 0x7f3d6c153270 2024-09-13T18:33:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c14e090 con 0x7f3d6c153270 2024-09-13T18:33:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d5affd640 1 -- 172.21.15.53:0/92081924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400ab70 con 0x7f3d6c153270 2024-09-13T18:33:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c14e650 con 0x7f3d6c153270 2024-09-13T18:33:30.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c067400 con 0x7f3d6c153270 2024-09-13T18:33:30.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d5affd640 1 -- 172.21.15.53:0/92081924 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f3d6400acd0 con 0x7f3d6c153270 2024-09-13T18:33:30.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d5affd640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3d4c066cf0 0x7f3d4c0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d5affd640 1 -- 172.21.15.53:0/92081924 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d64084560 con 0x7f3d6c153270 2024-09-13T18:33:30.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d6a59c640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3d4c066cf0 0x7f3d4c0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.117+0000 7f3d6a59c640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3d4c066cf0 0x7f3d4c0691b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000f70 tx=0x7f3d5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.121+0000 7f3d5affd640 1 -- 172.21.15.53:0/92081924 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d64050f90 con 0x7f3d6c153270 2024-09-13T18:33:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.301+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d6c14b790 con 0x7f3d4c066cf0 2024-09-13T18:33:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.301+0000 7f3d5affd640 1 -- 172.21.15.53:0/92081924 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3d6c14b790 con 0x7f3d4c066cf0 2024-09-13T18:33:30.304 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:33:30.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:30.304 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:33:30.304 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:30.304 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3d4c066cf0 msgr2=0x7f3d4c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3d4c066cf0 0x7f3d4c0691b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000f70 tx=0x7f3d5c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c153270 msgr2=0x7f3d6c153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c153270 0x7f3d6c153700 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400c810 tx=0x7f3d6400ccd0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 shutdown_connections 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3d4c066cf0 0x7f3d4c0691b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c153270 0x7f3d6c153700 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d6c1582a0 0x7f3d6c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 --2- 172.21.15.53:0/92081924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3d6c0711d0 0x7f3d6c14a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 >> 172.21.15.53:0/92081924 conn(0x7f3d6c065c80 msgr2=0x7f3d6c0ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 shutdown_connections 2024-09-13T18:33:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.305+0000 7f3d70e2e640 1 -- 172.21.15.53:0/92081924 wait complete. 2024-09-13T18:33:30.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:33:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45ca5b640 1 Processor -- start 2024-09-13T18:33:30.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45ca5b640 1 -- start start 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45ca5b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 0x7fc4580cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45ca5b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4580b2bf0 0x7fc4580cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45ca5b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580ccd60 con 0x7fc4580ced50 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45ca5b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4580cd830 con 0x7fc4580b2bf0 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45ca5b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580cc190 con 0x7fc4580ccf10 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc4580ced50 0x7fc4580b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51250/0 (socket says 172.21.15.53:51250) 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 -- 172.21.15.53:0/778522769 learned_addr learned my addr 172.21.15.53:0/778522769 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc455d9b640 1 --2- 172.21.15.53:0/778522769 >> v2:172.21.15.87:3300/0 conn(0x7fc4580b2bf0 0x7fc4580cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45659c640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 0x7fc4580cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38654312 0 0) 0x7fc4580ccd60 con 0x7fc4580ced50 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc440003530 con 0x7fc4580ced50 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853450240 0 0) 0x7fc440003530 con 0x7fc4580ced50 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 msgr2=0x7fc4580cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 0x7fc4580cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 >> v2:172.21.15.87:3300/0 conn(0x7fc4580b2bf0 msgr2=0x7fc4580cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 --2- 172.21.15.53:0/778522769 >> v2:172.21.15.87:3300/0 conn(0x7fc4580b2bf0 0x7fc4580cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580ce270 con 0x7fc4580ced50 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc450001a00 con 0x7fc4580ced50 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 >> v1:172.21.15.53:6789/0 conn(0x7fc4580ced50 legacy=0x7fc4580b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 0x7fc440003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440003f00 0x7fc4400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580cd830 con 0x7fc440004d10 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580cc190 con 0x7fc440003f00 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44000b9e0 con 0x7fc4580ccf10 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc455d9b640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440003f00 0x7fc4400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45659c640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 0x7fc440003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 -- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 msgr2=0x7fc440003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 0x7fc440003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 -- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440003f00 msgr2=0x7fc4400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440003f00 0x7fc4400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc456d9d640 1 -- 172.21.15.53:0/778522769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc440003530 con 0x7fc440004d10 2024-09-13T18:33:30.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.445+0000 7fc45659c640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4580ccf10 0x7fc440003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc456d9d640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005190 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a900 tx=0x7fc45001fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbc7b1ebf7ef3c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500aa6e0 con 0x7fc440004d10 2024-09-13T18:33:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4500aa840 con 0x7fc440004d10 2024-09-13T18:33:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45559a640 1 -- 172.21.15.53:0/778522769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500aabf0 con 0x7fc440004d10 2024-09-13T18:33:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45ca5b640 1 -- 172.21.15.53:0/778522769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 msgr2=0x7fc440005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45ca5b640 1 --2- 172.21.15.53:0/778522769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005190 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a900 tx=0x7fc45001fb40 comp rx=0 tx=0).stop 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc456d9d640 1 -- 172.21.15.53:0/778522769 reap_dead start 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45ca5b640 1 -- 172.21.15.53:0/778522769 shutdown_connections 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45ca5b640 1 -- 172.21.15.53:0/778522769 >> 172.21.15.53:0/778522769 conn(0x7fc4580b20d0 msgr2=0x7fc4580b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45ca5b640 1 -- 172.21.15.53:0/778522769 shutdown_connections 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.449+0000 7fc45ca5b640 1 -- 172.21.15.53:0/778522769 wait complete. 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 Processor -- start 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 -- start start 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440004d10 0x7fc458156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458155250 0x7fc4581f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4581f0eb0 0x7fc4581f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458156780 con 0x7fc458155250 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45814f4f0 con 0x7fc440004d10 2024-09-13T18:33:30.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815b0b0 con 0x7fc4581f0eb0 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458155250 0x7fc4581f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458155250 0x7fc4581f2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50472/0 (socket says 172.21.15.53:50472) 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 -- 172.21.15.53:0/1797589635 learned_addr learned my addr 172.21.15.53:0/1797589635 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45659c640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440004d10 0x7fc458156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc456d9d640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4581f0eb0 0x7fc4581f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 -- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4581f0eb0 msgr2=0x7fc4581f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4581f0eb0 0x7fc4581f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 -- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440004d10 msgr2=0x7fc458156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440004d10 0x7fc458156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 -- 172.21.15.53:0/1797589635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45815aa80 con 0x7fc458155250 2024-09-13T18:33:30.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45659c640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440004d10 0x7fc458156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc455d9b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458155250 0x7fc4581f2310 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fc44c011560 tx=0x7fc44c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc446ffd640 1 -- 172.21.15.53:0/1797589635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c015870 con 0x7fc458155250 2024-09-13T18:33:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc446ffd640 1 -- 172.21.15.53:0/1797589635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c0159d0 con 0x7fc458155250 2024-09-13T18:33:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc458155730 con 0x7fc458155250 2024-09-13T18:33:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc446ffd640 1 -- 172.21.15.53:0/1797589635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c015d60 con 0x7fc458155250 2024-09-13T18:33:30.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45815ad40 con 0x7fc458155250 2024-09-13T18:33:30.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45815b220 con 0x7fc458155250 2024-09-13T18:33:30.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.453+0000 7fc446ffd640 1 -- 172.21.15.53:0/1797589635 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fc44c01d400 con 0x7fc458155250 2024-09-13T18:33:30.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.457+0000 7fc446ffd640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc438066cf0 0x7fc4380691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.457+0000 7fc446ffd640 1 -- 172.21.15.53:0/1797589635 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc44c085450 con 0x7fc458155250 2024-09-13T18:33:30.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.457+0000 7fc45659c640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc438066cf0 0x7fc4380691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.457+0000 7fc45659c640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc438066cf0 0x7fc4380691b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc448009b60 tx=0x7fc448008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.461+0000 7fc446ffd640 1 -- 172.21.15.53:0/1797589635 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc44c051e80 con 0x7fc458155250 2024-09-13T18:33:30.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc4580cd2f0 con 0x7fc458155250 2024-09-13T18:33:30.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc446ffd640 1 -- 172.21.15.53:0/1797589635 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc44c0554a0 con 0x7fc458155250 2024-09-13T18:33:30.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc438066cf0 msgr2=0x7fc4380691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc438066cf0 0x7fc4380691b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc448009b60 tx=0x7fc448008040 comp rx=0 tx=0).stop 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458155250 msgr2=0x7fc4581f2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458155250 0x7fc4581f2310 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fc44c011560 tx=0x7fc44c009f90 comp rx=0 tx=0).stop 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 shutdown_connections 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc438066cf0 0x7fc4380691b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc4581f0eb0 0x7fc4581f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458155250 0x7fc4581f2310 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 --2- 172.21.15.53:0/1797589635 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc440004d10 0x7fc458156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 >> 172.21.15.53:0/1797589635 conn(0x7fc4580b20d0 msgr2=0x7fc4580c7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 shutdown_connections 2024-09-13T18:33:30.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.621+0000 7fc45ca5b640 1 -- 172.21.15.53:0/1797589635 wait complete. 2024-09-13T18:33:30.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:30.642 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol43630) 2024-09-13T18:33:30.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:30.665 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp47980/subvol26691) 2024-09-13T18:33:30.727 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol43630 2024-09-13T18:33:30.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.897+0000 7f530049d640 1 Processor -- start 2024-09-13T18:33:30.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.897+0000 7f530049d640 1 -- start start 2024-09-13T18:33:30.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f530049d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f815c830 0x7f52f80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f530049d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52f80ccd10 0x7f52f80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f530049d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f80b7db0 con 0x7f52f80d2c80 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f530049d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f80d0650 con 0x7f52f80ccd10 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f530049d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80d0c10 con 0x7f52f815c830 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fea3a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f52f80d2c80 0x7f52f80b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51266/0 (socket says 172.21.15.53:51266) 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fea3a640 1 -- 172.21.15.53:0/1864138911 learned_addr learned my addr 172.21.15.53:0/1864138911 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fda38640 1 --2- 172.21.15.53:0/1864138911 >> v2:172.21.15.53:3300/0 conn(0x7f52f80ccd10 0x7f52f80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fe239640 1 --2- 172.21.15.53:0/1864138911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f815c830 0x7f52f80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fd237640 1 -- 172.21.15.53:0/1864138911 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332170275 0 0) 0x7f52f80b7db0 con 0x7f52f80d2c80 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fd237640 1 -- 172.21.15.53:0/1864138911 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e4003530 con 0x7f52f80d2c80 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fda38640 1 -- 172.21.15.53:0/1864138911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f815c830 msgr2=0x7f52f80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fda38640 1 --2- 172.21.15.53:0/1864138911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f815c830 0x7f52f80d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fda38640 1 -- 172.21.15.53:0/1864138911 >> v1:172.21.15.53:6789/0 conn(0x7f52f80d2c80 legacy=0x7f52f80b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.901+0000 7f52fda38640 1 -- 172.21.15.53:0/1864138911 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f80cd7d0 con 0x7f52f80ccd10 2024-09-13T18:33:30.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fda38640 1 --2- 172.21.15.53:0/1864138911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f80cd150 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097c0 tx=0x7f52e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d217bea5e16f75fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fd237640 1 -- 172.21.15.53:0/1864138911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e80ab600 con 0x7f52f80ccd10 2024-09-13T18:33:30.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fd237640 1 -- 172.21.15.53:0/1864138911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e80a7050 con 0x7f52f80ccd10 2024-09-13T18:33:30.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fd237640 1 -- 172.21.15.53:0/1864138911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e80ab980 con 0x7f52f80ccd10 2024-09-13T18:33:30.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- 172.21.15.53:0/1864138911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 msgr2=0x7f52f80cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 --2- 172.21.15.53:0/1864138911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f80cd150 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097c0 tx=0x7f52e801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- 172.21.15.53:0/1864138911 shutdown_connections 2024-09-13T18:33:30.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 --2- 172.21.15.53:0/1864138911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f80cd150 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 --2- 172.21.15.53:0/1864138911 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f815c830 0x7f52f80d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- 172.21.15.53:0/1864138911 >> 172.21.15.53:0/1864138911 conn(0x7f52f8070970 msgr2=0x7f52f8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:30.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- 172.21.15.53:0/1864138911 shutdown_connections 2024-09-13T18:33:30.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- 172.21.15.53:0/1864138911 wait complete. 2024-09-13T18:33:30.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 Processor -- start 2024-09-13T18:33:30.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- start start 2024-09-13T18:33:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f80d2c80 0x7f52f814bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f815c830 0x7f52f81587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f815cea0 con 0x7f52f80ccd10 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f815d180 con 0x7f52f815c830 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f815d460 con 0x7f52f80d2c80 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f815dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50484/0 (socket says 172.21.15.53:50484) 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 -- 172.21.15.53:0/1994628849 learned_addr learned my addr 172.21.15.53:0/1994628849 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fda38640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f80d2c80 0x7f52f814bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fea3a640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f815c830 0x7f52f81587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 -- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f80d2c80 msgr2=0x7f52f814bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f80d2c80 0x7f52f814bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 -- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f815c830 msgr2=0x7f52f81587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f815c830 0x7f52f81587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 -- 172.21.15.53:0/1994628849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8009420 con 0x7f52f80ccd10 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fea3a640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f815c830 0x7f52f81587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fda38640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f80d2c80 0x7f52f814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52fe239640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f815dc60 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f52f400e930 tx=0x7f52f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52eeffd640 1 -- 172.21.15.53:0/1994628849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4009690 con 0x7f52f80ccd10 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52eeffd640 1 -- 172.21.15.53:0/1994628849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f400ca00 con 0x7f52f80ccd10 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f815d740 con 0x7f52f80ccd10 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.905+0000 7f52eeffd640 1 -- 172.21.15.53:0/1994628849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f400cd70 con 0x7f52f80ccd10 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.909+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f8158d30 con 0x7f52f80ccd10 2024-09-13T18:33:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.909+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f80b39a0 con 0x7f52f80ccd10 2024-09-13T18:33:30.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.909+0000 7f52eeffd640 1 -- 172.21.15.53:0/1994628849 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7f52f4013470 con 0x7f52f80ccd10 2024-09-13T18:33:30.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.909+0000 7f52eeffd640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f52dc066cf0 0x7f52dc0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:30.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.909+0000 7f52eeffd640 1 -- 172.21.15.53:0/1994628849 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52f4084f80 con 0x7f52f80ccd10 2024-09-13T18:33:30.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.909+0000 7f52fda38640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f52dc066cf0 0x7f52dc0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:30.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.909+0000 7f52fda38640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f52dc066cf0 0x7f52dc0691b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52e80ad000 tx=0x7f52e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:30.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:30.913+0000 7f52eeffd640 1 -- 172.21.15.53:0/1994628849 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52f4051a70 con 0x7f52f80ccd10 2024-09-13T18:33:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.101+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol43630", "target": ["mon-mgr", ""]}) v1 -- 0x7f52f815d2f0 con 0x7f52dc066cf0 2024-09-13T18:33:31.109 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:31.109+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:31.109 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:31.109+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:31.110 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:31.109+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:31.110 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:31.109+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:31.110 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:31.109+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:31.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f52eeffd640 1 -- 172.21.15.53:0/1994628849 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7f52f815d2f0 con 0x7f52dc066cf0 2024-09-13T18:33:31.142 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol43630 2024-09-13T18:33:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f52dc066cf0 msgr2=0x7f52dc0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f52dc066cf0 0x7f52dc0691b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52e80ad000 tx=0x7f52e8008040 comp rx=0 tx=0).stop 2024-09-13T18:33:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 msgr2=0x7f52f815dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f815dc60 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f52f400e930 tx=0x7f52f400edf0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 shutdown_connections 2024-09-13T18:33:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f52dc066cf0 0x7f52dc0691b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52f80d2c80 0x7f52f814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52f815c830 0x7f52f81587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 --2- 172.21.15.53:0/1994628849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52f80ccd10 0x7f52f815dc60 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 >> 172.21.15.53:0/1994628849 conn(0x7f52f8070970 msgr2=0x7f52f80b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 shutdown_connections 2024-09-13T18:33:31.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.141+0000 7f530049d640 1 -- 172.21.15.53:0/1994628849 wait complete. 2024-09-13T18:33:31.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol26691 subvol_grp47980 2024-09-13T18:33:31.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3f552d640 1 Processor -- start 2024-09-13T18:33:31.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3f552d640 1 -- start start 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3f552d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3f552d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3f0071130 0x7fa3f006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3f552d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00b1c60 con 0x7fa3f014f4f0 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3f552d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00b1f40 con 0x7fa3f0071130 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3f552d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00b2220 con 0x7fa3f015d150 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3ef7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3f0071130 0x7fa3f006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.285+0000 7fa3eeffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa3f014f4f0 0x7fa3f014f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:52236/0 (socket says 172.21.15.53:52236) 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3eeffd640 1 -- 172.21.15.53:0/3894655928 learned_addr learned my addr 172.21.15.53:0/3894655928 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:31.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3ee7fc640 1 --2- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3ef7fe640 1 -- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 msgr2=0x7fa3f00b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:31.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3ef7fe640 1 --2- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3ef7fe640 1 -- 172.21.15.53:0/3894655928 >> v1:172.21.15.87:6789/0 conn(0x7fa3f014f4f0 legacy=0x7fa3f014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3ef7fe640 1 -- 172.21.15.53:0/3894655928 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00b2500 con 0x7fa3f0071130 2024-09-13T18:33:31.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3ef7fe640 1 --2- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f0071130 0x7fa3f006b320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009d90 tx=0x7fa3e001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d525e31c0044730 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:31.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3edffb640 1 -- 172.21.15.53:0/3894655928 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00a5a20 con 0x7fa3f0071130 2024-09-13T18:33:31.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3edffb640 1 -- 172.21.15.53:0/3894655928 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e00a5b80 con 0x7fa3f0071130 2024-09-13T18:33:31.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3edffb640 1 -- 172.21.15.53:0/3894655928 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00ad440 con 0x7fa3f0071130 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 -- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f0071130 msgr2=0x7fa3f006b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 --2- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f0071130 0x7fa3f006b320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009d90 tx=0x7fa3e001c940 comp rx=0 tx=0).stop 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 -- 172.21.15.53:0/3894655928 shutdown_connections 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 --2- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f0071130 0x7fa3f006b320 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 --2- 172.21.15.53:0/3894655928 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 -- 172.21.15.53:0/3894655928 >> 172.21.15.53:0/3894655928 conn(0x7fa3f0073330 msgr2=0x7fa3f0065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 -- 172.21.15.53:0/3894655928 shutdown_connections 2024-09-13T18:33:31.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.289+0000 7fa3f552d640 1 -- 172.21.15.53:0/3894655928 wait complete. 2024-09-13T18:33:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 Processor -- start 2024-09-13T18:33:31.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 -- start start 2024-09-13T18:33:31.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f0071130 0x7fa3f006d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f014f4f0 0x7fa3f0150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f006d550 con 0x7fa3f0071130 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00ae780 con 0x7fa3f014f4f0 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0148330 con 0x7fa3f015d150 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f0071130 0x7fa3f006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f0071130 0x7fa3f006d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50506/0 (socket says 172.21.15.53:50506) 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 -- 172.21.15.53:0/2728149383 learned_addr learned my addr 172.21.15.53:0/2728149383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3ee7fc640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f014f4f0 0x7fa3f0150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3ef7fe640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 -- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 msgr2=0x7fa3f00afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 -- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f014f4f0 msgr2=0x7fa3f0150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f014f4f0 0x7fa3f0150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 -- 172.21.15.53:0/2728149383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0009a70 con 0x7fa3f0071130 2024-09-13T18:33:31.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3ee7fc640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f014f4f0 0x7fa3f0150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:31.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3eeffd640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f0071130 0x7fa3f006d010 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800c500 tx=0x7fa3e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:31.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3d77fe640 1 -- 172.21.15.53:0/2728149383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8005cf0 con 0x7fa3f0071130 2024-09-13T18:33:31.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3d77fe640 1 -- 172.21.15.53:0/2728149383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e8005e50 con 0x7fa3f0071130 2024-09-13T18:33:31.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f00ae9d0 con 0x7fa3f0071130 2024-09-13T18:33:31.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3d77fe640 1 -- 172.21.15.53:0/2728149383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80072f0 con 0x7fa3f0071130 2024-09-13T18:33:31.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.293+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f00aef90 con 0x7fa3f0071130 2024-09-13T18:33:31.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.297+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f006b320 con 0x7fa3f0071130 2024-09-13T18:33:31.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.297+0000 7fa3d77fe640 1 -- 172.21.15.53:0/2728149383 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fa3e8007450 con 0x7fa3f0071130 2024-09-13T18:33:31.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.297+0000 7fa3d77fe640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3dc066cc0 0x7fa3dc069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.297+0000 7fa3d77fe640 1 -- 172.21.15.53:0/2728149383 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3e80841a0 con 0x7fa3f0071130 2024-09-13T18:33:31.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.297+0000 7fa3ee7fc640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3dc066cc0 0x7fa3dc069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.297+0000 7fa3ee7fc640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3dc066cc0 0x7fa3dc069180 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009bb0 tx=0x7fa3e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:31.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.301+0000 7fa3d77fe640 1 -- 172.21.15.53:0/2728149383 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3e8050d10 con 0x7fa3f0071130 2024-09-13T18:33:31.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.489+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol26691", "group_name": "subvol_grp47980", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3f00cbd70 con 0x7fa3dc066cc0 2024-09-13T18:33:31.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3d77fe640 1 -- 172.21.15.53:0/2728149383 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa3f00cbd70 con 0x7fa3dc066cc0 2024-09-13T18:33:31.519 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp47980/subvol26691 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3dc066cc0 msgr2=0x7fa3dc069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3dc066cc0 0x7fa3dc069180 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009bb0 tx=0x7fa3e4008040 comp rx=0 tx=0).stop 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f0071130 msgr2=0x7fa3f006d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f0071130 0x7fa3f006d010 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800c500 tx=0x7fa3e800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 shutdown_connections 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa3dc066cc0 0x7fa3dc069180 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3f015d150 0x7fa3f00afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3f014f4f0 0x7fa3f0150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 --2- 172.21.15.53:0/2728149383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f0071130 0x7fa3f006d010 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 >> 172.21.15.53:0/2728149383 conn(0x7fa3f0073330 msgr2=0x7fa3f00cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 shutdown_connections 2024-09-13T18:33:31.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.517+0000 7fa3f552d640 1 -- 172.21.15.53:0/2728149383 wait complete. 2024-09-13T18:33:31.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol43630 2024-09-13T18:33:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe222f11640 1 Processor -- start 2024-09-13T18:33:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe222f11640 1 -- start start 2024-09-13T18:33:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe222f11640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c15b470 0x7fe21c0abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe222f11640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe21c0ac2e0 0x7fe21c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe222f11640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c06c980 con 0x7fe21c154a50 2024-09-13T18:33:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe222f11640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c0ac790 con 0x7fe21c0ac2e0 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe222f11640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c06bd70 con 0x7fe21c15b470 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe220cad640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe21c154a50 0x7fe21c06ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51268/0 (socket says 172.21.15.53:51268) 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe220cad640 1 -- 172.21.15.53:0/987186167 learned_addr learned my addr 172.21.15.53:0/987186167 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe2214ae640 1 --2- 172.21.15.53:0/987186167 >> v2:172.21.15.53:3300/0 conn(0x7fe21c0ac2e0 0x7fe21c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe21bfff640 1 --2- 172.21.15.53:0/987186167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c15b470 0x7fe21c0abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe21b7fe640 1 -- 172.21.15.53:0/987186167 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023393722 0 0) 0x7fe21c06c980 con 0x7fe21c154a50 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe21b7fe640 1 -- 172.21.15.53:0/987186167 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe208003530 con 0x7fe21c154a50 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe2214ae640 1 -- 172.21.15.53:0/987186167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c15b470 msgr2=0x7fe21c0abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe2214ae640 1 --2- 172.21.15.53:0/987186167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c15b470 0x7fe21c0abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe2214ae640 1 -- 172.21.15.53:0/987186167 >> v1:172.21.15.53:6789/0 conn(0x7fe21c154a50 legacy=0x7fe21c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.653+0000 7fe2214ae640 1 -- 172.21.15.53:0/987186167 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c06c050 con 0x7fe21c0ac2e0 2024-09-13T18:33:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 --2- 172.21.15.53:0/987186167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c0ac2e0 0x7fe21c0b20e0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097c0 tx=0x7fe21401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f05259e99bd9e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe21b7fe640 1 -- 172.21.15.53:0/987186167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140a7070 con 0x7fe21c0ac2e0 2024-09-13T18:33:31.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe21b7fe640 1 -- 172.21.15.53:0/987186167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2140ab430 con 0x7fe21c0ac2e0 2024-09-13T18:33:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe21b7fe640 1 -- 172.21.15.53:0/987186167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140ab7c0 con 0x7fe21c0ac2e0 2024-09-13T18:33:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- 172.21.15.53:0/987186167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c0ac2e0 msgr2=0x7fe21c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 --2- 172.21.15.53:0/987186167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c0ac2e0 0x7fe21c0b20e0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097c0 tx=0x7fe21401c470 comp rx=0 tx=0).stop 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- 172.21.15.53:0/987186167 shutdown_connections 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 --2- 172.21.15.53:0/987186167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c0ac2e0 0x7fe21c0b20e0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 --2- 172.21.15.53:0/987186167 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c15b470 0x7fe21c0abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- 172.21.15.53:0/987186167 >> 172.21.15.53:0/987186167 conn(0x7fe21c069f50 msgr2=0x7fe21c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- 172.21.15.53:0/987186167 shutdown_connections 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- 172.21.15.53:0/987186167 wait complete. 2024-09-13T18:33:31.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 Processor -- start 2024-09-13T18:33:31.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- start start 2024-09-13T18:33:31.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c0ac2e0 0x7fe21c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe21c154a50 0x7fe21c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c15b470 0x7fe21c14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c156a50 con 0x7fe21c15b470 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c156460 con 0x7fe21c154a50 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe222f11640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c1503a0 con 0x7fe21c0ac2e0 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c15b470 0x7fe21c14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c15b470 0x7fe21c14cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50526/0 (socket says 172.21.15.53:50526) 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 -- 172.21.15.53:0/1059305637 learned_addr learned my addr 172.21.15.53:0/1059305637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe21bfff640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe21c154a50 0x7fe21c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 -- 172.21.15.53:0/1059305637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c0ac2e0 msgr2=0x7fe21c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c0ac2e0 0x7fe21c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 -- 172.21.15.53:0/1059305637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe21c154a50 msgr2=0x7fe21c14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe21c154a50 0x7fe21c14fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.657+0000 7fe2214ae640 1 -- 172.21.15.53:0/1059305637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe214009420 con 0x7fe21c15b470 2024-09-13T18:33:31.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe2214ae640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c15b470 0x7fe21c14cd40 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097c0 tx=0x7fe214019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:31.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe2197fa640 1 -- 172.21.15.53:0/1059305637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140b45f0 con 0x7fe21c15b470 2024-09-13T18:33:31.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe2197fa640 1 -- 172.21.15.53:0/1059305637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2140b4750 con 0x7fe21c15b470 2024-09-13T18:33:31.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c150670 con 0x7fe21c15b470 2024-09-13T18:33:31.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe2197fa640 1 -- 172.21.15.53:0/1059305637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140b4ae0 con 0x7fe21c15b470 2024-09-13T18:33:31.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c1566e0 con 0x7fe21c15b470 2024-09-13T18:33:31.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21c150b90 con 0x7fe21c15b470 2024-09-13T18:33:31.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe2197fa640 1 -- 172.21.15.53:0/1059305637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 22) v1 ==== 86653+0+0 (secure 0 0 0) 0x7fe2140b4c40 con 0x7fe21c15b470 2024-09-13T18:33:31.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe2197fa640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1fc066cc0 0x7fe1fc069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:31.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe2197fa640 1 -- 172.21.15.53:0/1059305637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe21411f170 con 0x7fe21c15b470 2024-09-13T18:33:31.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe220cad640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1fc066cc0 0x7fe1fc069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:31.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.661+0000 7fe220cad640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1fc066cc0 0x7fe1fc069180 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0020b0 tx=0x7fe20c0016a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:31.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.665+0000 7fe2197fa640 1 -- 172.21.15.53:0/1059305637 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe21c150b90 con 0x7fe21c15b470 2024-09-13T18:33:31.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.849+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol43630", "target": ["mon-mgr", ""]}) v1 -- 0x7fe21c0677b0 con 0x7fe1fc066cc0 2024-09-13T18:33:31.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.857+0000 7fe2197fa640 1 -- 172.21.15.53:0/1059305637 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7fe21c0677b0 con 0x7fe1fc066cc0 2024-09-13T18:33:31.861 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol43630 2024-09-13T18:33:31.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1fc066cc0 msgr2=0x7fe1fc069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1fc066cc0 0x7fe1fc069180 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0020b0 tx=0x7fe20c0016a0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c15b470 msgr2=0x7fe21c14cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:31.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c15b470 0x7fe21c14cd40 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fe2140097c0 tx=0x7fe214019210 comp rx=0 tx=0).stop 2024-09-13T18:33:31.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 shutdown_connections 2024-09-13T18:33:31.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe1fc066cc0 0x7fe1fc069180 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe21c15b470 0x7fe21c14cd40 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe21c154a50 0x7fe21c14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 --2- 172.21.15.53:0/1059305637 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe21c0ac2e0 0x7fe21c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 >> 172.21.15.53:0/1059305637 conn(0x7fe21c069f50 msgr2=0x7fe21c164990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 shutdown_connections 2024-09-13T18:33:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:31.861+0000 7fe222f11640 1 -- 172.21.15.53:0/1059305637 wait complete. 2024-09-13T18:33:31.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:31.880 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/7ce9d906059bc5635c28aba080b61c95.meta) 2024-09-13T18:33:33.188 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:33:33.188 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:33:33.188 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:33:33.189 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol43630 2024-09-13T18:33:33.189 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:33:33.189 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:33.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol26691 subvol_grp47980 2024-09-13T18:33:33.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 Processor -- start 2024-09-13T18:33:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 -- start start 2024-09-13T18:33:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f849806ccc0 0x7f849806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f849806f370 0x7f849806f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498070fb0 con 0x7f849806f370 2024-09-13T18:33:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849806d620 con 0x7f849806ccc0 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.325+0000 7f849dca8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849815dd30 con 0x7f849815c5e0 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f849806f370 0x7f849806f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8496ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f849806ccc0 0x7f849806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f84977fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f849806f370 0x7f849806f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50532/0 (socket says 172.21.15.53:50532) 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 -- 172.21.15.53:0/575229325 learned_addr learned my addr 172.21.15.53:0/575229325 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 -- 172.21.15.53:0/575229325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 msgr2=0x7f849815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 --2- 172.21.15.53:0/575229325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 -- 172.21.15.53:0/575229325 >> v2:172.21.15.87:3300/0 conn(0x7f849806ccc0 msgr2=0x7f849806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 --2- 172.21.15.53:0/575229325 >> v2:172.21.15.87:3300/0 conn(0x7f849806ccc0 0x7f849806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 -- 172.21.15.53:0/575229325 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498070a10 con 0x7f849806f370 2024-09-13T18:33:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f8497fff640 1 --2- 172.21.15.53:0/575229325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806f370 0x7f849806f820 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f8498066a90 tx=0x7f849001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43a3870a3b94c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f84967fc640 1 -- 172.21.15.53:0/575229325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900aa430 con 0x7f849806f370 2024-09-13T18:33:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f84967fc640 1 -- 172.21.15.53:0/575229325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84900aa590 con 0x7f849806f370 2024-09-13T18:33:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f84967fc640 1 -- 172.21.15.53:0/575229325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900aa920 con 0x7f849806f370 2024-09-13T18:33:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 -- 172.21.15.53:0/575229325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806f370 msgr2=0x7f849806f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 --2- 172.21.15.53:0/575229325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806f370 0x7f849806f820 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f8498066a90 tx=0x7f849001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 -- 172.21.15.53:0/575229325 shutdown_connections 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 --2- 172.21.15.53:0/575229325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806f370 0x7f849806f820 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 --2- 172.21.15.53:0/575229325 >> v2:172.21.15.87:3300/0 conn(0x7f849806ccc0 0x7f849806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 --2- 172.21.15.53:0/575229325 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 -- 172.21.15.53:0/575229325 >> 172.21.15.53:0/575229325 conn(0x7f8498073330 msgr2=0x7f8498065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 -- 172.21.15.53:0/575229325 shutdown_connections 2024-09-13T18:33:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.329+0000 7f849dca8640 1 -- 172.21.15.53:0/575229325 wait complete. 2024-09-13T18:33:33.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 Processor -- start 2024-09-13T18:33:33.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 -- start start 2024-09-13T18:33:33.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806ccc0 0x7f84981496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f849806f370 0x7f8498158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498149c30 con 0x7f849806ccc0 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849814a0f0 con 0x7f849806f370 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849814dd00 con 0x7f849815c5e0 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806ccc0 0x7f84981496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806ccc0 0x7f84981496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50538/0 (socket says 172.21.15.53:50538) 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 -- 172.21.15.53:0/873040931 learned_addr learned my addr 172.21.15.53:0/873040931 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f8496ffd640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f849806f370 0x7f8498158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f8497fff640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 -- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 msgr2=0x7f849814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 -- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f849806f370 msgr2=0x7f8498158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f849806f370 0x7f8498158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 -- 172.21.15.53:0/873040931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900094d0 con 0x7f849806ccc0 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f8497fff640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f84977fe640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806ccc0 0x7f84981496f0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f8488009db0 tx=0x7f848800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f847ffff640 1 -- 172.21.15.53:0/873040931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488014480 con 0x7f849806ccc0 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f847ffff640 1 -- 172.21.15.53:0/873040931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800f040 con 0x7f849806ccc0 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849814df50 con 0x7f849806ccc0 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f847ffff640 1 -- 172.21.15.53:0/873040931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488014800 con 0x7f849806ccc0 2024-09-13T18:33:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849814e510 con 0x7f849806ccc0 2024-09-13T18:33:33.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.333+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84980b1490 con 0x7f849806ccc0 2024-09-13T18:33:33.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.337+0000 7f847ffff640 1 -- 172.21.15.53:0/873040931 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7f8488014960 con 0x7f849806ccc0 2024-09-13T18:33:33.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.337+0000 7f847ffff640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8484066d50 0x7f8484069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:33.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.337+0000 7f847ffff640 1 -- 172.21.15.53:0/873040931 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8488085ac0 con 0x7f849806ccc0 2024-09-13T18:33:33.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.337+0000 7f8496ffd640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8484066d50 0x7f8484069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:33.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.337+0000 7f8496ffd640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8484066d50 0x7f8484069210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f84980add30 tx=0x7f848c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.341+0000 7f847ffff640 1 -- 172.21.15.53:0/873040931 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8488052520 con 0x7f849806ccc0 2024-09-13T18:33:33.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.529+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol26691", "group_name": "subvol_grp47980", "target": ["mon-mgr", ""]}) v1 -- 0x7f84980cdc40 con 0x7f8484066d50 2024-09-13T18:33:33.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.537+0000 7f847ffff640 1 -- 172.21.15.53:0/873040931 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f848c0096a0 con 0x7f8484066d50 2024-09-13T18:33:33.540 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp47980/subvol26691 2024-09-13T18:33:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8484066d50 msgr2=0x7f8484069210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8484066d50 0x7f8484069210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f84980add30 tx=0x7f848c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806ccc0 msgr2=0x7f84981496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806ccc0 0x7f84981496f0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f8488009db0 tx=0x7f848800c490 comp rx=0 tx=0).stop 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 shutdown_connections 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8484066d50 0x7f8484069210 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f849815c5e0 0x7f849814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f849806f370 0x7f8498158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 --2- 172.21.15.53:0/873040931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f849806ccc0 0x7f84981496f0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 >> 172.21.15.53:0/873040931 conn(0x7f8498073330 msgr2=0x7f8498154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 shutdown_connections 2024-09-13T18:33:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:33.541+0000 7f849dca8640 1 -- 172.21.15.53:0/873040931 wait complete. 2024-09-13T18:33:33.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:33.560 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/ec4b8ceab3970132e7dc2085f9dd0f4a.meta) 2024-09-13T18:33:38.186 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:33:38.186 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:33:38.186 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:33:38.186 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/subvol_grp47980/subvol26691 2024-09-13T18:33:38.186 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:33:38.186 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:38.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol43630 2024-09-13T18:33:38.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 Processor -- start 2024-09-13T18:33:38.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 -- start start 2024-09-13T18:33:38.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f366c156c40 0x7f366c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c157020 0x7f366c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f366c06d270 0x7f366c15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c06d6e0 con 0x7f366c06d270 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0b15a0 con 0x7f366c156c40 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f36745cc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0b1880 con 0x7f366c157020 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f366c06d270 0x7f366c15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f366c06d270 0x7f366c15cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49736/0 (socket says 172.21.15.53:49736) 2024-09-13T18:33:38.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 -- 172.21.15.53:0/939546604 learned_addr learned my addr 172.21.15.53:0/939546604 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672368640 1 --2- 172.21.15.53:0/939546604 >> v2:172.21.15.87:3300/0 conn(0x7f366c156c40 0x7f366c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3671b67640 1 --2- 172.21.15.53:0/939546604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c157020 0x7f366c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 -- 172.21.15.53:0/939546604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c157020 msgr2=0x7f366c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 --2- 172.21.15.53:0/939546604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c157020 0x7f366c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 -- 172.21.15.53:0/939546604 >> v2:172.21.15.87:3300/0 conn(0x7f366c156c40 msgr2=0x7f366c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 --2- 172.21.15.53:0/939546604 >> v2:172.21.15.87:3300/0 conn(0x7f366c156c40 0x7f366c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.324+0000 7f3672b69640 1 -- 172.21.15.53:0/939546604 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0b1b60 con 0x7f366c06d270 2024-09-13T18:33:38.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f3672b69640 1 --2- 172.21.15.53:0/939546604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c15cde0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f366c067650 tx=0x7f366401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f4a5ed49a346fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:38.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f3671366640 1 -- 172.21.15.53:0/939546604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640a5580 con 0x7f366c06d270 2024-09-13T18:33:38.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f3671366640 1 -- 172.21.15.53:0/939546604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640a56e0 con 0x7f366c06d270 2024-09-13T18:33:38.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f3671366640 1 -- 172.21.15.53:0/939546604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640a5a70 con 0x7f366c06d270 2024-09-13T18:33:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 -- 172.21.15.53:0/939546604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 msgr2=0x7f366c15cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 --2- 172.21.15.53:0/939546604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c15cde0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f366c067650 tx=0x7f366401c700 comp rx=0 tx=0).stop 2024-09-13T18:33:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 -- 172.21.15.53:0/939546604 shutdown_connections 2024-09-13T18:33:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 --2- 172.21.15.53:0/939546604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c157020 0x7f366c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 --2- 172.21.15.53:0/939546604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c15cde0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 --2- 172.21.15.53:0/939546604 >> v2:172.21.15.87:3300/0 conn(0x7f366c156c40 0x7f366c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 -- 172.21.15.53:0/939546604 >> 172.21.15.53:0/939546604 conn(0x7f366c065c80 msgr2=0x7f366c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 -- 172.21.15.53:0/939546604 shutdown_connections 2024-09-13T18:33:38.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 -- 172.21.15.53:0/939546604 wait complete. 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.328+0000 7f36745cc640 1 Processor -- start 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 -- start start 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c156c40 0x7f366c1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366c14c2b0 0x7f366c14c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15b8b0 con 0x7f366c06d270 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c144fb0 con 0x7f366c14c2b0 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c1446e0 con 0x7f366c156c40 2024-09-13T18:33:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49750/0 (socket says 172.21.15.53:49750) 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 -- 172.21.15.53:0/655826400 learned_addr learned my addr 172.21.15.53:0/655826400 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672b69640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366c14c2b0 0x7f366c14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3671b67640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c156c40 0x7f366c1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 -- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c156c40 msgr2=0x7f366c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c156c40 0x7f366c1441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 -- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366c14c2b0 msgr2=0x7f366c14c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366c14c2b0 0x7f366c14c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 -- 172.21.15.53:0/655826400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009b30 con 0x7f366c06d270 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672b69640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366c14c2b0 0x7f366c14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3672368640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c144a70 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f366800d830 tx=0x7f366800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3662ffd640 1 -- 172.21.15.53:0/655826400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800b6c0 con 0x7f366c06d270 2024-09-13T18:33:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3662ffd640 1 -- 172.21.15.53:0/655826400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800b820 con 0x7f366c06d270 2024-09-13T18:33:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c15aca0 con 0x7f366c06d270 2024-09-13T18:33:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3662ffd640 1 -- 172.21.15.53:0/655826400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366800bb90 con 0x7f366c06d270 2024-09-13T18:33:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c15b260 con 0x7f366c06d270 2024-09-13T18:33:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c070ee0 con 0x7f366c06d270 2024-09-13T18:33:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3662ffd640 1 -- 172.21.15.53:0/655826400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7f366801e460 con 0x7f366c06d270 2024-09-13T18:33:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3662ffd640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3650066d80 0x7f3650069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3662ffd640 1 -- 172.21.15.53:0/655826400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3668085410 con 0x7f366c06d270 2024-09-13T18:33:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.332+0000 7f3671b67640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3650066d80 0x7f3650069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.336+0000 7f3671b67640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3650066d80 0x7f3650069240 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f366c144a20 tx=0x7f365c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:38.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.340+0000 7f3662ffd640 1 -- 172.21.15.53:0/655826400 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3668051ef0 con 0x7f366c06d270 2024-09-13T18:33:38.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.524+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol43630", "target": ["mon-mgr", ""]}) v1 -- 0x7f366c071420 con 0x7f3650066d80 2024-09-13T18:33:38.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.540+0000 7f3662ffd640 1 -- 172.21.15.53:0/655826400 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f365c00b5e0 con 0x7f3650066d80 2024-09-13T18:33:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3650066d80 msgr2=0x7f3650069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3650066d80 0x7f3650069240 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f366c144a20 tx=0x7f365c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 msgr2=0x7f366c144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c144a70 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f366800d830 tx=0x7f366800dcf0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 shutdown_connections 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3650066d80 0x7f3650069240 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f366c156c40 0x7f366c1441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f366c14c2b0 0x7f366c14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 --2- 172.21.15.53:0/655826400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366c06d270 0x7f366c144a70 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 >> 172.21.15.53:0/655826400 conn(0x7f366c065c80 msgr2=0x7f366c0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 shutdown_connections 2024-09-13T18:33:38.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f36745cc640 1 -- 172.21.15.53:0/655826400 wait complete. 2024-09-13T18:33:38.549 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f26186b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.549 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f26186b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.549 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f26186b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.549 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f26186b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.549 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.544+0000 7f26186b0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.564 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.560+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.564 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.560+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.564 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.560+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.564 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.560+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.564 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:33:38.560+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:33:38.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol26691 subvol_grp47980 2024-09-13T18:33:38.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd817dea640 1 Processor -- start 2024-09-13T18:33:38.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd817dea640 1 -- start start 2024-09-13T18:33:38.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd817dea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd810143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd817dea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd810143d50 0x7fd81006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd817dea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100b1ba0 con 0x7fd8100cd6f0 2024-09-13T18:33:38.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd817dea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100b3020 con 0x7fd810143d50 2024-09-13T18:33:38.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd817dea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100b1f80 con 0x7fd8100cdad0 2024-09-13T18:33:38.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd816387640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd810143d50 0x7fd81006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd816387640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd810143d50 0x7fd81006b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49796/0 (socket says 172.21.15.53:49796) 2024-09-13T18:33:38.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd816387640 1 -- 172.21.15.53:0/1230737586 learned_addr learned my addr 172.21.15.53:0/1230737586 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:38.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd815385640 1 --2- 172.21.15.53:0/1230737586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd810143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd816387640 1 -- 172.21.15.53:0/1230737586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 msgr2=0x7fd810143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:38.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd816387640 1 --2- 172.21.15.53:0/1230737586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd810143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd816387640 1 -- 172.21.15.53:0/1230737586 >> v1:172.21.15.87:6789/0 conn(0x7fd8100cd6f0 legacy=0x7fd8100b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.680+0000 7fd816387640 1 -- 172.21.15.53:0/1230737586 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100b2260 con 0x7fd810143d50 2024-09-13T18:33:38.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd816387640 1 --2- 172.21.15.53:0/1230737586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd810143d50 0x7fd81006b320 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fd808009870 tx=0x7fd80801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9463f8c80d36a591 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:38.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd814b84640 1 -- 172.21.15.53:0/1230737586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080ab640 con 0x7fd810143d50 2024-09-13T18:33:38.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd814b84640 1 -- 172.21.15.53:0/1230737586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8080a7070 con 0x7fd810143d50 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd814b84640 1 -- 172.21.15.53:0/1230737586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080ab9c0 con 0x7fd810143d50 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 -- 172.21.15.53:0/1230737586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd810143d50 msgr2=0x7fd81006b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 --2- 172.21.15.53:0/1230737586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd810143d50 0x7fd81006b320 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fd808009870 tx=0x7fd80801c530 comp rx=0 tx=0).stop 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 -- 172.21.15.53:0/1230737586 shutdown_connections 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 --2- 172.21.15.53:0/1230737586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd810143d50 0x7fd81006b320 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 --2- 172.21.15.53:0/1230737586 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd810143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 -- 172.21.15.53:0/1230737586 >> 172.21.15.53:0/1230737586 conn(0x7fd810073330 msgr2=0x7fd810065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 -- 172.21.15.53:0/1230737586 shutdown_connections 2024-09-13T18:33:38.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 -- 172.21.15.53:0/1230737586 wait complete. 2024-09-13T18:33:38.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 Processor -- start 2024-09-13T18:33:38.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.684+0000 7fd817dea640 1 -- start start 2024-09-13T18:33:38.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8100cd6f0 0x7fd81015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd81013d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810143d50 0x7fd8100abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100ad0e0 con 0x7fd8100cd6f0 2024-09-13T18:33:38.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81013e650 con 0x7fd810143d50 2024-09-13T18:33:38.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81013e8a0 con 0x7fd8100cdad0 2024-09-13T18:33:38.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8100cd6f0 0x7fd81015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8100cd6f0 0x7fd81015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49806/0 (socket says 172.21.15.53:49806) 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 -- 172.21.15.53:0/2387669855 learned_addr learned my addr 172.21.15.53:0/2387669855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd816387640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810143d50 0x7fd8100abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815385640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd81013d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 -- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 msgr2=0x7fd81013d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd81013d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 -- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810143d50 msgr2=0x7fd8100abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810143d50 0x7fd8100abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 -- 172.21.15.53:0/2387669855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080094d0 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815b86640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8100cd6f0 0x7fd81015ca70 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c820 tx=0x7fd80000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd80e7fc640 1 -- 172.21.15.53:0/2387669855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800003b80 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd80e7fc640 1 -- 172.21.15.53:0/2387669855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800003ce0 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd80e7fc640 1 -- 172.21.15.53:0/2387669855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000aa90 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81013eb80 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81013f140 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81013f360 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd80e7fc640 1 -- 172.21.15.53:0/2387669855 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7fd80000abf0 con 0x7fd8100cd6f0 2024-09-13T18:33:38.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd80e7fc640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7fc066d50 0x7fd7fc069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:38.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd80e7fc640 1 -- 172.21.15.53:0/2387669855 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd800084b90 con 0x7fd8100cd6f0 2024-09-13T18:33:38.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815385640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7fc066d50 0x7fd7fc069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:38.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.688+0000 7fd815385640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7fc066d50 0x7fd7fc069210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd8100cabf0 tx=0x7fd804008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:38.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.692+0000 7fd80e7fc640 1 -- 172.21.15.53:0/2387669855 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd800051700 con 0x7fd8100cd6f0 2024-09-13T18:33:38.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.876+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol26691", "group_name": "subvol_grp47980", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8100cbdd0 con 0x7fd7fc066d50 2024-09-13T18:33:38.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd80e7fc640 1 -- 172.21.15.53:0/2387669855 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd80400e510 con 0x7fd7fc066d50 2024-09-13T18:33:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7fc066d50 msgr2=0x7fd7fc069210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7fc066d50 0x7fd7fc069210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd8100cabf0 tx=0x7fd804008040 comp rx=0 tx=0).stop 2024-09-13T18:33:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8100cd6f0 msgr2=0x7fd81015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8100cd6f0 0x7fd81015ca70 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c820 tx=0x7fd80000cce0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 shutdown_connections 2024-09-13T18:33:38.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd7fc066d50 0x7fd7fc069210 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8100cdad0 0x7fd81013d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd810143d50 0x7fd8100abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 --2- 172.21.15.53:0/2387669855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8100cd6f0 0x7fd81015ca70 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 >> 172.21.15.53:0/2387669855 conn(0x7fd810073330 msgr2=0x7fd8100b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 shutdown_connections 2024-09-13T18:33:38.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:38.904+0000 7fd817dea640 1 -- 172.21.15.53:0/2387669855 wait complete. 2024-09-13T18:33:38.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:38.927 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:33:38.944 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-09-13T18:33:38.946 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp47980 2024-09-13T18:33:39.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd901ccd640 1 Processor -- start 2024-09-13T18:33:39.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd901ccd640 1 -- start start 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd901ccd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8fc158a00 0x7fd8fc15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd901ccd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8fc158de0 0x7fd8fc0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd901ccd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc15d6f0 con 0x7fd8fc0b2ff0 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd901ccd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cd1c0 con 0x7fd8fc158a00 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd901ccd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0cd4a0 con 0x7fd8fc158de0 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8fc158a00 0x7fd8fc15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd8fc0b2ff0 0x7fd8fc06d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50568/0 (socket says 172.21.15.53:50568) 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fbfff640 1 -- 172.21.15.53:0/4082412391 learned_addr learned my addr 172.21.15.53:0/4082412391 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8faffd640 1 --2- 172.21.15.53:0/4082412391 >> v2:172.21.15.87:3300/0 conn(0x7fd8fc158de0 0x7fd8fc0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fb7fe640 1 -- 172.21.15.53:0/4082412391 >> v2:172.21.15.87:3300/0 conn(0x7fd8fc158de0 msgr2=0x7fd8fc0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fb7fe640 1 --2- 172.21.15.53:0/4082412391 >> v2:172.21.15.87:3300/0 conn(0x7fd8fc158de0 0x7fd8fc0b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fb7fe640 1 -- 172.21.15.53:0/4082412391 >> v1:172.21.15.53:6789/0 conn(0x7fd8fc0b2ff0 legacy=0x7fd8fc06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fa7fc640 1 -- 172.21.15.53:0/4082412391 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139134678 0 0) 0x7fd8fc15d6f0 con 0x7fd8fc0b2ff0 2024-09-13T18:33:39.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8fb7fe640 1 -- 172.21.15.53:0/4082412391 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0cd780 con 0x7fd8fc158a00 2024-09-13T18:33:39.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.112+0000 7fd8faffd640 1 --2- 172.21.15.53:0/4082412391 >> v2:172.21.15.87:3300/0 conn(0x7fd8fc158de0 0x7fd8fc0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:39.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8fb7fe640 1 --2- 172.21.15.53:0/4082412391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc15d1b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0b25f0 tx=0x7fd8ec01d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d60905ea7f1506 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:39.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8fa7fc640 1 -- 172.21.15.53:0/4082412391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0a6840 con 0x7fd8fc158a00 2024-09-13T18:33:39.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8fa7fc640 1 -- 172.21.15.53:0/4082412391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0a69a0 con 0x7fd8fc158a00 2024-09-13T18:33:39.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8fa7fc640 1 -- 172.21.15.53:0/4082412391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0a6d30 con 0x7fd8fc158a00 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- 172.21.15.53:0/4082412391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 msgr2=0x7fd8fc15d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 --2- 172.21.15.53:0/4082412391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc15d1b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0b25f0 tx=0x7fd8ec01d790 comp rx=0 tx=0).stop 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- 172.21.15.53:0/4082412391 shutdown_connections 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 --2- 172.21.15.53:0/4082412391 >> v2:172.21.15.87:3300/0 conn(0x7fd8fc158de0 0x7fd8fc0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 --2- 172.21.15.53:0/4082412391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc15d1b0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- 172.21.15.53:0/4082412391 >> 172.21.15.53:0/4082412391 conn(0x7fd8fc0b0cd0 msgr2=0x7fd8fc0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- 172.21.15.53:0/4082412391 shutdown_connections 2024-09-13T18:33:39.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- 172.21.15.53:0/4082412391 wait complete. 2024-09-13T18:33:39.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 Processor -- start 2024-09-13T18:33:39.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- start start 2024-09-13T18:33:39.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8fc0b2ff0 0x7fd8fc159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8fc158de0 0x7fd8fc15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc1f0c80 con 0x7fd8fc158a00 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc152d00 con 0x7fd8fc0b2ff0 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc152fe0 con 0x7fd8fc158de0 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc1505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49828/0 (socket says 172.21.15.53:49828) 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 -- 172.21.15.53:0/1504250304 learned_addr learned my addr 172.21.15.53:0/1504250304 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8fb7fe640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8fc0b2ff0 0x7fd8fc159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 -- 172.21.15.53:0/1504250304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8fc158de0 msgr2=0x7fd8fc15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8fc158de0 0x7fd8fc15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 -- 172.21.15.53:0/1504250304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8fc0b2ff0 msgr2=0x7fd8fc159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8fc0b2ff0 0x7fd8fc159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 -- 172.21.15.53:0/1504250304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec00a5c0 con 0x7fd8fc158a00 2024-09-13T18:33:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8faffd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc1505e0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c7f0 tx=0x7fd8f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8e3fff640 1 -- 172.21.15.53:0/1504250304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004220 con 0x7fd8fc158a00 2024-09-13T18:33:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8e3fff640 1 -- 172.21.15.53:0/1504250304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0004380 con 0x7fd8fc158a00 2024-09-13T18:33:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd8e3fff640 1 -- 172.21.15.53:0/1504250304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0003840 con 0x7fd8fc158a00 2024-09-13T18:33:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc1532c0 con 0x7fd8fc158a00 2024-09-13T18:33:39.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.116+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc152910 con 0x7fd8fc158a00 2024-09-13T18:33:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.120+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc1f0dc0 con 0x7fd8fc158a00 2024-09-13T18:33:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.120+0000 7fd8e3fff640 1 -- 172.21.15.53:0/1504250304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7fd8f0003bb0 con 0x7fd8fc158a00 2024-09-13T18:33:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.120+0000 7fd8e3fff640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8e8066d80 0x7fd8e8069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.120+0000 7fd8e3fff640 1 -- 172.21.15.53:0/1504250304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8f0084be0 con 0x7fd8fc158a00 2024-09-13T18:33:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.120+0000 7fd8fb7fe640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8e8066d80 0x7fd8e8069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.120+0000 7fd8fb7fe640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8e8066d80 0x7fd8e8069240 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0b0000 tx=0x7fd8ec0a8070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:39.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.124+0000 7fd8e3fff640 1 -- 172.21.15.53:0/1504250304 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8f0051640 con 0x7fd8fc158a00 2024-09-13T18:33:39.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.308+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp47980", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8fc1543f0 con 0x7fd8e8066d80 2024-09-13T18:33:39.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.316+0000 7fd8e3fff640 1 -- 172.21.15.53:0/1504250304 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd8fc1543f0 con 0x7fd8e8066d80 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8e8066d80 msgr2=0x7fd8e8069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8e8066d80 0x7fd8e8069240 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0b0000 tx=0x7fd8ec0a8070 comp rx=0 tx=0).stop 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 msgr2=0x7fd8fc1505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc1505e0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c7f0 tx=0x7fd8f000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 shutdown_connections 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd8e8066d80 0x7fd8e8069240 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd8fc158de0 0x7fd8fc15c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8fc158a00 0x7fd8fc1505e0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 --2- 172.21.15.53:0/1504250304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8fc0b2ff0 0x7fd8fc159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 >> 172.21.15.53:0/1504250304 conn(0x7fd8fc0b0cd0 msgr2=0x7fd8fc0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 shutdown_connections 2024-09-13T18:33:39.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.320+0000 7fd901ccd640 1 -- 172.21.15.53:0/1504250304 wait complete. 2024-09-13T18:33:39.338 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:33:39.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:39.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:39.490 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:33:39.490 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:33:39.490 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:39.497 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:39.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e33d46640 1 Processor -- start 2024-09-13T18:33:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e33d46640 1 -- start start 2024-09-13T18:33:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e33d46640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 0x7f6e2c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e33d46640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e2c15b7c0 0x7f6e2c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e33d46640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c06d480 con 0x7f6e2c070c90 2024-09-13T18:33:39.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e33d46640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c15aaf0 con 0x7f6e2c15b7c0 2024-09-13T18:33:39.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e33d46640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c06d760 con 0x7f6e2c1582a0 2024-09-13T18:33:39.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e322e3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6e2c070c90 0x7f6e2c06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50572/0 (socket says 172.21.15.53:50572) 2024-09-13T18:33:39.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e322e3640 1 -- 172.21.15.53:0/4201337927 learned_addr learned my addr 172.21.15.53:0/4201337927 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e31ae2640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 0x7f6e2c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4201337927 >> v2:172.21.15.87:3300/0 conn(0x7f6e2c15b7c0 0x7f6e2c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397656021 0 0) 0x7f6e2c06d480 con 0x7f6e2c070c90 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e18003530 con 0x7f6e2c070c90 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600032216 0 0) 0x7f6e18003530 con 0x7f6e2c070c90 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 msgr2=0x7f6e2c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 0x7f6e2c06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 >> v2:172.21.15.87:3300/0 conn(0x7f6e2c15b7c0 msgr2=0x7f6e2c06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 --2- 172.21.15.53:0/4201337927 >> v2:172.21.15.87:3300/0 conn(0x7f6e2c15b7c0 0x7f6e2c06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c15ace0 con 0x7f6e2c070c90 2024-09-13T18:33:39.674 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6e24001a00 con 0x7f6e2c070c90 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 >> v1:172.21.15.53:6789/0 conn(0x7f6e2c070c90 legacy=0x7f6e2c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e18003980 0x7f6e18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 0x7f6e18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e18004620 con 0x7f6e180047d0 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1800b9c0 con 0x7f6e18003980 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1800bb80 con 0x7f6e2c1582a0 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.668+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e322e3640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 0x7f6e18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e31ae2640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e18003980 0x7f6e18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e312e1640 1 -- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 msgr2=0x7f6e18005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 0x7f6e18005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e312e1640 1 -- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e18003980 msgr2=0x7f6e18003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:39.675 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e18003980 0x7f6e18003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e312e1640 1 -- 172.21.15.53:0/4201337927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e18003530 con 0x7f6e180047d0 2024-09-13T18:33:39.676 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e322e3640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c1582a0 0x7f6e18005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e18004c50 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009ae0 tx=0x7f6e2801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2501c4bc9a2ffd3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280a55c0 con 0x7f6e180047d0 2024-09-13T18:33:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e280a5720 con 0x7f6e180047d0 2024-09-13T18:33:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e30ae0640 1 -- 172.21.15.53:0/4201337927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280a5ad0 con 0x7f6e180047d0 2024-09-13T18:33:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e33d46640 1 -- 172.21.15.53:0/4201337927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 msgr2=0x7f6e18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e33d46640 1 --2- 172.21.15.53:0/4201337927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e18004c50 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009ae0 tx=0x7f6e2801cab0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.677 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e322e3640 1 -- 172.21.15.53:0/4201337927 reap_dead start 2024-09-13T18:33:39.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e33d46640 1 -- 172.21.15.53:0/4201337927 shutdown_connections 2024-09-13T18:33:39.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e33d46640 1 -- 172.21.15.53:0/4201337927 >> 172.21.15.53:0/4201337927 conn(0x7f6e2c065c80 msgr2=0x7f6e2c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:39.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e33d46640 1 -- 172.21.15.53:0/4201337927 shutdown_connections 2024-09-13T18:33:39.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.672+0000 7f6e33d46640 1 -- 172.21.15.53:0/4201337927 wait complete. 2024-09-13T18:33:39.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 Processor -- start 2024-09-13T18:33:39.678 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 -- start start 2024-09-13T18:33:39.679 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e2c0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c150900 0x7f6e2c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e2c0ae370 0x7f6e2c0ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0aed30 con 0x7f6e180047d0 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0acb20 con 0x7f6e2c0ae370 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0ace00 con 0x7f6e2c150900 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e2c0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e2c0ac530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49856/0 (socket says 172.21.15.53:49856) 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 -- 172.21.15.53:0/4061670771 learned_addr learned my addr 172.21.15.53:0/4061670771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c150900 0x7f6e2c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e322e3640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e2c0ae370 0x7f6e2c0ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 -- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c150900 msgr2=0x7f6e2c156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c150900 0x7f6e2c156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 -- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e2c0ae370 msgr2=0x7f6e2c0ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e2c0ae370 0x7f6e2c0ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 -- 172.21.15.53:0/4061670771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0ad0e0 con 0x7f6e180047d0 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e31ae2640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e2c0ac530 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6e20010890 tx=0x7f6e20010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e1e7fc640 1 -- 172.21.15.53:0/4061670771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20009630 con 0x7f6e180047d0 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e1e7fc640 1 -- 172.21.15.53:0/4061670771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2000eb60 con 0x7f6e180047d0 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c0ad3c0 con 0x7f6e180047d0 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e1e7fc640 1 -- 172.21.15.53:0/4061670771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001c400 con 0x7f6e180047d0 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c0a84d0 con 0x7f6e180047d0 2024-09-13T18:33:39.681 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.676+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c067400 con 0x7f6e180047d0 2024-09-13T18:33:39.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.680+0000 7f6e1e7fc640 1 -- 172.21.15.53:0/4061670771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7f6e2001c560 con 0x7f6e180047d0 2024-09-13T18:33:39.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.680+0000 7f6e1e7fc640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e10066d80 0x7f6e10069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.680+0000 7f6e1e7fc640 1 -- 172.21.15.53:0/4061670771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e20085240 con 0x7f6e180047d0 2024-09-13T18:33:39.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.680+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e10066d80 0x7f6e10069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.680+0000 7f6e312e1640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e10066d80 0x7f6e10069240 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6e280af000 tx=0x7f6e280046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:39.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.684+0000 7f6e1e7fc640 1 -- 172.21.15.53:0/4061670771 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e20051ed0 con 0x7f6e180047d0 2024-09-13T18:33:39.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.844+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e2c06d480 con 0x7f6e180047d0 2024-09-13T18:33:39.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e1e7fc640 1 -- 172.21.15.53:0/4061670771 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16511 (secure 0 0 0) 0x7f6e200554f0 con 0x7f6e180047d0 2024-09-13T18:33:39.849 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:39.849 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":150,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:18.511005+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e10066d80 msgr2=0x7f6e10069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e10066d80 0x7f6e10069240 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6e280af000 tx=0x7f6e280046d0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 msgr2=0x7f6e2c0ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e2c0ac530 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6e20010890 tx=0x7f6e20010d50 comp rx=0 tx=0).stop 2024-09-13T18:33:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 shutdown_connections 2024-09-13T18:33:39.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6e10066d80 0x7f6e10069240 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e2c150900 0x7f6e2c156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e2c0ae370 0x7f6e2c0ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 --2- 172.21.15.53:0/4061670771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e180047d0 0x7f6e2c0ac530 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 >> 172.21.15.53:0/4061670771 conn(0x7f6e2c065c80 msgr2=0x7f6e2c157350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:39.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 shutdown_connections 2024-09-13T18:33:39.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.848+0000 7f6e33d46640 1 -- 172.21.15.53:0/4061670771 wait complete. 2024-09-13T18:33:39.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:15.920553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:16.488705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:39.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:39.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 Processor -- start 2024-09-13T18:33:39.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 -- start start 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f338c0cdcc0 0x7f338c06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f338c15cda0 0x7f338c0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c0ce920 0x7f338c0ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0ce0a0 con 0x7f338c0cdcc0 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c1596d0 con 0x7f338c15cda0 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3392600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c142cd0 con 0x7f338c0ce920 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f338c0cdcc0 0x7f338c06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f338c0cdcc0 0x7f338c06cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49858/0 (socket says 172.21.15.53:49858) 2024-09-13T18:33:39.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 -- 172.21.15.53:0/1090119009 learned_addr learned my addr 172.21.15.53:0/1090119009 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:39.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f3390b9d640 1 --2- 172.21.15.53:0/1090119009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c0ce920 0x7f338c0ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338b7fe640 1 --2- 172.21.15.53:0/1090119009 >> v2:172.21.15.87:3300/0 conn(0x7f338c15cda0 0x7f338c0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 -- 172.21.15.53:0/1090119009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c0ce920 msgr2=0x7f338c0ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:39.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 --2- 172.21.15.53:0/1090119009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c0ce920 0x7f338c0ab1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 -- 172.21.15.53:0/1090119009 >> v2:172.21.15.87:3300/0 conn(0x7f338c15cda0 msgr2=0x7f338c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:39.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 --2- 172.21.15.53:0/1090119009 >> v2:172.21.15.87:3300/0 conn(0x7f338c15cda0 0x7f338c0ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.988+0000 7f338bfff640 1 -- 172.21.15.53:0/1090119009 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0ced70 con 0x7f338c0cdcc0 2024-09-13T18:33:39.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f338bfff640 1 --2- 172.21.15.53:0/1090119009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0cdcc0 0x7f338c06cde0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f338c0ca8d0 tx=0x7f338401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca499280221c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:39.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f338affd640 1 -- 172.21.15.53:0/1090119009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840a8420 con 0x7f338c0cdcc0 2024-09-13T18:33:39.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f338affd640 1 -- 172.21.15.53:0/1090119009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840a8580 con 0x7f338c0cdcc0 2024-09-13T18:33:39.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f338affd640 1 -- 172.21.15.53:0/1090119009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840a8910 con 0x7f338c0cdcc0 2024-09-13T18:33:39.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 -- 172.21.15.53:0/1090119009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0cdcc0 msgr2=0x7f338c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 --2- 172.21.15.53:0/1090119009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0cdcc0 0x7f338c06cde0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f338c0ca8d0 tx=0x7f338401c730 comp rx=0 tx=0).stop 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 -- 172.21.15.53:0/1090119009 shutdown_connections 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 --2- 172.21.15.53:0/1090119009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c0ce920 0x7f338c0ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 --2- 172.21.15.53:0/1090119009 >> v2:172.21.15.87:3300/0 conn(0x7f338c15cda0 0x7f338c0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 --2- 172.21.15.53:0/1090119009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0cdcc0 0x7f338c06cde0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 -- 172.21.15.53:0/1090119009 >> 172.21.15.53:0/1090119009 conn(0x7f338c065e50 msgr2=0x7f338c066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 -- 172.21.15.53:0/1090119009 shutdown_connections 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 -- 172.21.15.53:0/1090119009 wait complete. 2024-09-13T18:33:39.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 Processor -- start 2024-09-13T18:33:39.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.992+0000 7f3392600640 1 -- start start 2024-09-13T18:33:39.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0cdcc0 0x7f338c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0ce920 0x7f338c15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c15cda0 0x7f338c097510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:39.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0cd3b0 con 0x7f338c0ce920 2024-09-13T18:33:39.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0cd0d0 con 0x7f338c0cdcc0 2024-09-13T18:33:39.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c162dd0 con 0x7f338c15cda0 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0ce920 0x7f338c15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0ce920 0x7f338c15a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49872/0 (socket says 172.21.15.53:49872) 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 -- 172.21.15.53:0/961859679 learned_addr learned my addr 172.21.15.53:0/961859679 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338bfff640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0cdcc0 0x7f338c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3390b9d640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c15cda0 0x7f338c097510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 -- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c15cda0 msgr2=0x7f338c097510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c15cda0 0x7f338c097510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 -- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0cdcc0 msgr2=0x7f338c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0cdcc0 0x7f338c15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 -- 172.21.15.53:0/961859679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009b30 con 0x7f338c0ce920 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3390b9d640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c15cda0 0x7f338c097510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:39.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f338b7fe640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0ce920 0x7f338c15a100 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f338000d5f0 tx=0x7f338000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3388ff9640 1 -- 172.21.15.53:0/961859679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800125f0 con 0x7f338c0ce920 2024-09-13T18:33:40.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3388ff9640 1 -- 172.21.15.53:0/961859679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380012750 con 0x7f338c0ce920 2024-09-13T18:33:40.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c1630b0 con 0x7f338c0ce920 2024-09-13T18:33:40.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3388ff9640 1 -- 172.21.15.53:0/961859679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380012b00 con 0x7f338c0ce920 2024-09-13T18:33:40.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:39.996+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c15c740 con 0x7f338c0ce920 2024-09-13T18:33:40.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.000+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0ab1d0 con 0x7f338c0ce920 2024-09-13T18:33:40.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.000+0000 7f3388ff9640 1 -- 172.21.15.53:0/961859679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7f3380012c60 con 0x7f338c0ce920 2024-09-13T18:33:40.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.000+0000 7f3388ff9640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3378066d80 0x7f3378069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.000+0000 7f3388ff9640 1 -- 172.21.15.53:0/961859679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3380085160 con 0x7f338c0ce920 2024-09-13T18:33:40.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.000+0000 7f338bfff640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3378066d80 0x7f3378069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.000+0000 7f338bfff640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3378066d80 0x7f3378069240 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33840ae000 tx=0x7f33840b3040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.004+0000 7f3388ff9640 1 -- 172.21.15.53:0/961859679 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3380051bb0 con 0x7f338c0ce920 2024-09-13T18:33:40.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.164+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f338c163560 con 0x7f338c0ce920 2024-09-13T18:33:40.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.164+0000 7f3388ff9640 1 -- 172.21.15.53:0/961859679 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33800551d0 con 0x7f338c0ce920 2024-09-13T18:33:40.169 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3378066d80 msgr2=0x7f3378069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3378066d80 0x7f3378069240 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33840ae000 tx=0x7f33840b3040 comp rx=0 tx=0).stop 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0ce920 msgr2=0x7f338c15a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0ce920 0x7f338c15a100 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f338000d5f0 tx=0x7f338000dab0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 shutdown_connections 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3378066d80 0x7f3378069240 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f338c15cda0 0x7f338c097510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f338c0ce920 0x7f338c15a100 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 --2- 172.21.15.53:0/961859679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0cdcc0 0x7f338c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 >> 172.21.15.53:0/961859679 conn(0x7f338c065e50 msgr2=0x7f338c158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:40.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 shutdown_connections 2024-09-13T18:33:40.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.168+0000 7f3392600640 1 -- 172.21.15.53:0/961859679 wait complete. 2024-09-13T18:33:40.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:33:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced2834640 1 Processor -- start 2024-09-13T18:33:40.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced2834640 1 -- start start 2024-09-13T18:33:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced2834640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 0x7fcecc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced2834640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc06f7a0 con 0x7fcecc0caee0 2024-09-13T18:33:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced2834640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc06fd60 con 0x7fcecc143e80 2024-09-13T18:33:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced2834640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc06baa0 con 0x7fcecc0cda30 2024-09-13T18:33:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcecc0caee0 0x7fcecc0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50582/0 (socket says 172.21.15.53:50582) 2024-09-13T18:33:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 -- 172.21.15.53:0/830447963 learned_addr learned my addr 172.21.15.53:0/830447963 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:40.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced0dd1640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 0x7fcecc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581692669 0 0) 0x7fcecc06f7a0 con 0x7fcecc0caee0 2024-09-13T18:33:40.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb4003530 con 0x7fcecc0caee0 2024-09-13T18:33:40.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 294416194 0 0) 0x7fceb4003530 con 0x7fcecc0caee0 2024-09-13T18:33:40.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 msgr2=0x7fcecc0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 0x7fcecc0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 >> v1:172.21.15.87:6789/0 conn(0x7fcecc143e80 legacy=0x7fcecc06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0cb960 con 0x7fcecc0caee0 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fcec0001680 con 0x7fcecc0caee0 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 >> v1:172.21.15.53:6789/0 conn(0x7fcecc0caee0 legacy=0x7fcecc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 0x7fceb40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb4003ef0 0x7fceb40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4004d10 0x7fceb4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc06baa0 con 0x7fceb4003ef0 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb400bb50 con 0x7fceb4004d10 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb400bd10 con 0x7fcecc0cda30 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb4003ef0 0x7fceb40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fced0dd1640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4004d10 0x7fceb4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecbfff640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 0x7fceb40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 -- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 msgr2=0x7fceb40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc0cda30 0x7fceb40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 -- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4004d10 msgr2=0x7fceb4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4004d10 0x7fceb4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.300+0000 7fcecb7fe640 1 -- 172.21.15.53:0/830447963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4003530 con 0x7fceb4003ef0 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fcecb7fe640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb4003ef0 0x7fceb40047d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c210 tx=0x7fcec001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5241b9336c5c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0005ae0 con 0x7fceb4003ef0 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0005c60 con 0x7fceb4003ef0 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fcecaffd640 1 -- 172.21.15.53:0/830447963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00a5a60 con 0x7fceb4003ef0 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 -- 172.21.15.53:0/830447963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb4003ef0 msgr2=0x7fceb40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 --2- 172.21.15.53:0/830447963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fceb4003ef0 0x7fceb40047d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c210 tx=0x7fcec001cc30 comp rx=0 tx=0).stop 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced0dd1640 1 -- 172.21.15.53:0/830447963 reap_dead start 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 -- 172.21.15.53:0/830447963 shutdown_connections 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 -- 172.21.15.53:0/830447963 >> 172.21.15.53:0/830447963 conn(0x7fcecc065c80 msgr2=0x7fcecc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:40.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 -- 172.21.15.53:0/830447963 shutdown_connections 2024-09-13T18:33:40.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 -- 172.21.15.53:0/830447963 wait complete. 2024-09-13T18:33:40.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 Processor -- start 2024-09-13T18:33:40.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.304+0000 7fced2834640 1 -- start start 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4003ef0 0x7fcecc156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc1564b0 0x7fcecc15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc1568b0 0x7fcecc15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc15b1a0 con 0x7fcecc1568b0 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc15a590 con 0x7fceb4003ef0 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc15a870 con 0x7fcecc1564b0 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc1568b0 0x7fcecc15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc1568b0 0x7fcecc15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49892/0 (socket says 172.21.15.53:49892) 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 -- 172.21.15.53:0/2346707451 learned_addr learned my addr 172.21.15.53:0/2346707451 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcecbfff640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4003ef0 0x7fcecc156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcecb7fe640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc1564b0 0x7fcecc15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 -- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc1564b0 msgr2=0x7fcecc15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc1564b0 0x7fcecc15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 -- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4003ef0 msgr2=0x7fcecc156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4003ef0 0x7fcecc156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 -- 172.21.15.53:0/2346707451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc15ab50 con 0x7fcecc1568b0 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced0dd1640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc1568b0 0x7fcecc15d000 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0cc510 tx=0x7fcec400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcec8ff9640 1 -- 172.21.15.53:0/2346707451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400e040 con 0x7fcecc1568b0 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcec8ff9640 1 -- 172.21.15.53:0/2346707451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec400f040 con 0x7fcecc1568b0 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc15ae30 con 0x7fcecc1568b0 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcec8ff9640 1 -- 172.21.15.53:0/2346707451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4003c00 con 0x7fcecc1568b0 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc163fa0 con 0x7fcecc1568b0 2024-09-13T18:33:40.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc15b310 con 0x7fcecc1568b0 2024-09-13T18:33:40.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcec8ff9640 1 -- 172.21.15.53:0/2346707451 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7fcec4004030 con 0x7fcecc1568b0 2024-09-13T18:33:40.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcec8ff9640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fceb8066d50 0x7fceb8069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcec8ff9640 1 -- 172.21.15.53:0/2346707451 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcec40853a0 con 0x7fcecc1568b0 2024-09-13T18:33:40.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcecbfff640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fceb8066d50 0x7fceb8069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.308+0000 7fcecbfff640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fceb8066d50 0x7fceb8069210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0cacd0 tx=0x7fcebc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.312+0000 7fcec8ff9640 1 -- 172.21.15.53:0/2346707451 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcec4051d30 con 0x7fcecc1568b0 2024-09-13T18:33:40.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.464+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcecc163fa0 con 0x7fcecc1568b0 2024-09-13T18:33:40.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.464+0000 7fcec8ff9640 1 -- 172.21.15.53:0/2346707451 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcecc163fa0 con 0x7fcecc1568b0 2024-09-13T18:33:40.468 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:33:40.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fceb8066d50 msgr2=0x7fceb8069210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fceb8066d50 0x7fceb8069210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0cacd0 tx=0x7fcebc009040 comp rx=0 tx=0).stop 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc1568b0 msgr2=0x7fcecc15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc1568b0 0x7fcecc15d000 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0cc510 tx=0x7fcec400f580 comp rx=0 tx=0).stop 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 shutdown_connections 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fceb8066d50 0x7fceb8069210 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcecc1564b0 0x7fcecc15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc1568b0 0x7fcecc15d000 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 --2- 172.21.15.53:0/2346707451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb4003ef0 0x7fcecc156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 >> 172.21.15.53:0/2346707451 conn(0x7fcecc065c80 msgr2=0x7fcecc06b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 shutdown_connections 2024-09-13T18:33:40.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.468+0000 7fced2834640 1 -- 172.21.15.53:0/2346707451 wait complete. 2024-09-13T18:33:40.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:33:40.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39f047a640 1 Processor -- start 2024-09-13T18:33:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39f047a640 1 -- start start 2024-09-13T18:33:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39f047a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39e8156c40 0x7f39e8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39f047a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39e806d440 0x7f39e806f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39f047a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e80b15a0 con 0x7f39e8157020 2024-09-13T18:33:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39f047a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e80b1880 con 0x7f39e806d440 2024-09-13T18:33:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39f047a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e80b1b60 con 0x7f39e8156c40 2024-09-13T18:33:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39eea17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39e806d440 0x7f39e806f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39eea17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39e806d440 0x7f39e806f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49896/0 (socket says 172.21.15.53:49896) 2024-09-13T18:33:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39eea17640 1 -- 172.21.15.53:0/216700787 learned_addr learned my addr 172.21.15.53:0/216700787 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39ee216640 1 --2- 172.21.15.53:0/216700787 >> v2:172.21.15.87:3300/0 conn(0x7f39e8156c40 0x7f39e8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39eea17640 1 -- 172.21.15.53:0/216700787 >> v2:172.21.15.87:3300/0 conn(0x7f39e8156c40 msgr2=0x7f39e8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39eea17640 1 --2- 172.21.15.53:0/216700787 >> v2:172.21.15.87:3300/0 conn(0x7f39e8156c40 0x7f39e8070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39eea17640 1 -- 172.21.15.53:0/216700787 >> v1:172.21.15.87:6789/0 conn(0x7f39e8157020 legacy=0x7f39e806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39eea17640 1 -- 172.21.15.53:0/216700787 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80b1e40 con 0x7f39e806d440 2024-09-13T18:33:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.604+0000 7f39ee216640 1 --2- 172.21.15.53:0/216700787 >> v2:172.21.15.87:3300/0 conn(0x7f39e8156c40 0x7f39e8070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39eea17640 1 --2- 172.21.15.53:0/216700787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e806d440 0x7f39e806f330 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009e50 tx=0x7f39e001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29da282cbb9f1097 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39ed214640 1 -- 172.21.15.53:0/216700787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a58a0 con 0x7f39e806d440 2024-09-13T18:33:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39ed214640 1 -- 172.21.15.53:0/216700787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e00a5a00 con 0x7f39e806d440 2024-09-13T18:33:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39ed214640 1 -- 172.21.15.53:0/216700787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00a5d90 con 0x7f39e806d440 2024-09-13T18:33:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 -- 172.21.15.53:0/216700787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e806d440 msgr2=0x7f39e806f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 --2- 172.21.15.53:0/216700787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e806d440 0x7f39e806f330 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009e50 tx=0x7f39e001c9c0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 -- 172.21.15.53:0/216700787 shutdown_connections 2024-09-13T18:33:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 --2- 172.21.15.53:0/216700787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e806d440 0x7f39e806f330 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 --2- 172.21.15.53:0/216700787 >> v2:172.21.15.87:3300/0 conn(0x7f39e8156c40 0x7f39e8070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 -- 172.21.15.53:0/216700787 >> 172.21.15.53:0/216700787 conn(0x7f39e8065c80 msgr2=0x7f39e8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 -- 172.21.15.53:0/216700787 shutdown_connections 2024-09-13T18:33:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 -- 172.21.15.53:0/216700787 wait complete. 2024-09-13T18:33:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 Processor -- start 2024-09-13T18:33:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.608+0000 7f39f047a640 1 -- start start 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e806d440 0x7f39e813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e8156c40 0x7f39e8144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e814d740 0x7f39e813d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e814ef90 con 0x7f39e8156c40 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e814f810 con 0x7f39e806d440 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e813f160 con 0x7f39e814d740 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e8156c40 0x7f39e8144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e8156c40 0x7f39e8144c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49902/0 (socket says 172.21.15.53:49902) 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 -- 172.21.15.53:0/3089003817 learned_addr learned my addr 172.21.15.53:0/3089003817 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39ee216640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e806d440 0x7f39e813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eea17640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e814d740 0x7f39e813d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 -- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e814d740 msgr2=0x7f39e813d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e814d740 0x7f39e813d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 -- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e806d440 msgr2=0x7f39e813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e806d440 0x7f39e813e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 -- 172.21.15.53:0/3089003817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0009b30 con 0x7f39e8156c40 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eea17640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e814d740 0x7f39e813d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39eda15640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e8156c40 0x7f39e8144c90 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c3c0 tx=0x7f39d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39deffd640 1 -- 172.21.15.53:0/3089003817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80052d0 con 0x7f39e8156c40 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39deffd640 1 -- 172.21.15.53:0/3089003817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8005430 con 0x7f39e8156c40 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e81588f0 con 0x7f39e8156c40 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39deffd640 1 -- 172.21.15.53:0/3089003817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8003840 con 0x7f39e8156c40 2024-09-13T18:33:40.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e814f1c0 con 0x7f39e8156c40 2024-09-13T18:33:40.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e814f9c0 con 0x7f39e8156c40 2024-09-13T18:33:40.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39deffd640 1 -- 172.21.15.53:0/3089003817 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7f39d80039a0 con 0x7f39e8156c40 2024-09-13T18:33:40.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39deffd640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39cc066d80 0x7f39cc069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39deffd640 1 -- 172.21.15.53:0/3089003817 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39d8084190 con 0x7f39e8156c40 2024-09-13T18:33:40.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.612+0000 7f39ee216640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39cc066d80 0x7f39cc069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.616+0000 7f39ee216640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39cc066d80 0x7f39cc069240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f39e40098b0 tx=0x7f39e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.616+0000 7f39deffd640 1 -- 172.21.15.53:0/3089003817 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f39d80b5db0 con 0x7f39e8156c40 2024-09-13T18:33:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39e806b810 con 0x7f39e8156c40 2024-09-13T18:33:40.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39deffd640 1 -- 172.21.15.53:0/3089003817 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39e814f9c0 con 0x7f39e8156c40 2024-09-13T18:33:40.775 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:33:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39cc066d80 msgr2=0x7f39cc069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39cc066d80 0x7f39cc069240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f39e40098b0 tx=0x7f39e4008040 comp rx=0 tx=0).stop 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e8156c40 msgr2=0x7f39e8144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e8156c40 0x7f39e8144c90 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c3c0 tx=0x7f39d800c880 comp rx=0 tx=0).stop 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 shutdown_connections 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f39cc066d80 0x7f39cc069240 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39e814d740 0x7f39e813d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e8156c40 0x7f39e8144c90 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 --2- 172.21.15.53:0/3089003817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39e806d440 0x7f39e813e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.772+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 >> 172.21.15.53:0/3089003817 conn(0x7f39e8065c80 msgr2=0x7f39e80ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.776+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 shutdown_connections 2024-09-13T18:33:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.776+0000 7f39f047a640 1 -- 172.21.15.53:0/3089003817 wait complete. 2024-09-13T18:33:40.793 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:33:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8da19b640 1 Processor -- start 2024-09-13T18:33:40.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8da19b640 1 -- start start 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8da19b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 0x7ff8d40d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8da19b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff8d40cf7d0 0x7ff8d40b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8da19b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d40d2400 con 0x7ff8d40cd6c0 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8da19b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d40d1530 con 0x7ff8d40cf7d0 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8da19b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40d0920 con 0x7ff8d415cab0 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.912+0000 7ff8d2ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff8d40cd6c0 0x7ff8d40cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50598/0 (socket says 172.21.15.53:50598) 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/3813810990 learned_addr learned my addr 172.21.15.53:0/3813810990 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:40.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d3fff640 1 --2- 172.21.15.53:0/3813810990 >> v2:172.21.15.87:3300/0 conn(0x7ff8d40cf7d0 0x7ff8d40b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d37fe640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 0x7ff8d40d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464533099 0 0) 0x7ff8d40d2400 con 0x7ff8d40cd6c0 2024-09-13T18:33:40.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8bc003530 con 0x7ff8d40cd6c0 2024-09-13T18:33:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1167312174 0 0) 0x7ff8bc003530 con 0x7ff8d40cd6c0 2024-09-13T18:33:40.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 msgr2=0x7ff8d40d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 0x7ff8d40d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 >> v2:172.21.15.87:3300/0 conn(0x7ff8d40cf7d0 msgr2=0x7ff8d40b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 --2- 172.21.15.53:0/3813810990 >> v2:172.21.15.87:3300/0 conn(0x7ff8d40cf7d0 0x7ff8d40b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d40d0c00 con 0x7ff8d40cd6c0 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ff8c8001680 con 0x7ff8d40cd6c0 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 >> v1:172.21.15.53:6789/0 conn(0x7ff8d40cd6c0 legacy=0x7ff8d40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc003980 0x7ff8bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8bc0047d0 0x7ff8bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 0x7ff8bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40d1530 con 0x7ff8bc0047d0 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40d0920 con 0x7ff8bc003980 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc00b990 con 0x7ff8d415cab0 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8bc0047d0 0x7ff8bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d37fe640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc003980 0x7ff8bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d3fff640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 0x7ff8bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 msgr2=0x7ff8bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d415cab0 0x7ff8bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc003980 msgr2=0x7ff8bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc003980 0x7ff8bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/3813810990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc003530 con 0x7ff8bc0047d0 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d2ffd640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8bc0047d0 0x7ff8bc004c50 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c210 tx=0x7ff8c801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7e307cc34c1731 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80a8ce0 con 0x7ff8bc0047d0 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80a8e40 con 0x7ff8bc0047d0 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.916+0000 7ff8d27fc640 1 -- 172.21.15.53:0/3813810990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8005b00 con 0x7ff8bc0047d0 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- 172.21.15.53:0/3813810990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8bc0047d0 msgr2=0x7ff8bc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 --2- 172.21.15.53:0/3813810990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8bc0047d0 0x7ff8bc004c50 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c210 tx=0x7ff8c801f3b0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d3fff640 1 -- 172.21.15.53:0/3813810990 reap_dead start 2024-09-13T18:33:40.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- 172.21.15.53:0/3813810990 shutdown_connections 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- 172.21.15.53:0/3813810990 >> 172.21.15.53:0/3813810990 conn(0x7ff8d4065c80 msgr2=0x7ff8d4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- 172.21.15.53:0/3813810990 shutdown_connections 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- 172.21.15.53:0/3813810990 wait complete. 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 Processor -- start 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- start start 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc0047d0 0x7ff8d4155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d4157fc0 0x7ff8d40cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d40ccc40 0x7ff8d415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d41564c0 con 0x7ff8d4157fc0 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4156120 con 0x7ff8bc0047d0 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4156710 con 0x7ff8d40ccc40 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d4157fc0 0x7ff8d40cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d4157fc0 0x7ff8d40cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49928/0 (socket says 172.21.15.53:49928) 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/1241782649 learned_addr learned my addr 172.21.15.53:0/1241782649 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d37fe640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc0047d0 0x7ff8d4155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d3fff640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d40ccc40 0x7ff8d415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d40ccc40 msgr2=0x7ff8d415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d40ccc40 0x7ff8d415f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc0047d0 msgr2=0x7ff8d4155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc0047d0 0x7ff8d4155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 -- 172.21.15.53:0/1241782649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d41569f0 con 0x7ff8d4157fc0 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d37fe640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc0047d0 0x7ff8d4155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8d2ffd640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d4157fc0 0x7ff8d40cc700 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c210 tx=0x7ff8bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8004ab0 con 0x7ff8d4157fc0 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80b6070 con 0x7ff8d4157fc0 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d4156cd0 con 0x7ff8d4157fc0 2024-09-13T18:33:40.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8004e30 con 0x7ff8d4157fc0 2024-09-13T18:33:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.920+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d4157290 con 0x7ff8d4157fc0 2024-09-13T18:33:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.924+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d40cd050 con 0x7ff8d4157fc0 2024-09-13T18:33:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.924+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 23) v1 ==== 86704+0+0 (secure 0 0 0) 0x7ff8c8007070 con 0x7ff8d4157fc0 2024-09-13T18:33:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.924+0000 7ff8bbfff640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8c0066d80 0x7ff8c0069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:40.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.924+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8c80b8070 con 0x7ff8d4157fc0 2024-09-13T18:33:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.924+0000 7ff8d37fe640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8c0066d80 0x7ff8c0069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:40.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.924+0000 7ff8d37fe640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8c0066d80 0x7ff8c0069240 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009f60 tx=0x7ff8c400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:40.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:40.928+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8c80eeae0 con 0x7ff8d4157fc0 2024-09-13T18:33:41.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.024+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7ff8c80eeeb0 con 0x7ff8d4157fc0 2024-09-13T18:33:41.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.100+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff8d40d19c0 con 0x7ff8d4157fc0 2024-09-13T18:33:41.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.100+0000 7ff8bbfff640 1 -- 172.21.15.53:0/1241782649 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v150) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff8c80f2570 con 0x7ff8d4157fc0 2024-09-13T18:33:41.102 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:33:41.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8c0066d80 msgr2=0x7ff8c0069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8c0066d80 0x7ff8c0069240 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009f60 tx=0x7ff8c400b040 comp rx=0 tx=0).stop 2024-09-13T18:33:41.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d4157fc0 msgr2=0x7ff8d40cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d4157fc0 0x7ff8d40cc700 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c210 tx=0x7ff8bc005800 comp rx=0 tx=0).stop 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 shutdown_connections 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff8c0066d80 0x7ff8c0069240 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8d40ccc40 0x7ff8d415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d4157fc0 0x7ff8d40cc700 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 --2- 172.21.15.53:0/1241782649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8bc0047d0 0x7ff8d4155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 >> 172.21.15.53:0/1241782649 conn(0x7ff8d4065c80 msgr2=0x7ff8d40b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 shutdown_connections 2024-09-13T18:33:41.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.104+0000 7ff8da19b640 1 -- 172.21.15.53:0/1241782649 wait complete. 2024-09-13T18:33:41.121 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:33:41.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:41.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:33:41.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[55996]: fuse finished with error 0 and tester_r 0 2024-09-13T18:33:41.133 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:33:41.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:41.136 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:33:41.205 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:41.205 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:41.212 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:41.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bceb78640 1 Processor -- start 2024-09-13T18:33:41.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bceb78640 1 -- start start 2024-09-13T18:33:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bceb78640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 0x7f2bc8165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bceb78640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc806d480 con 0x7f2bc81582a0 2024-09-13T18:33:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bceb78640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc815ace0 con 0x7f2bc815b7c0 2024-09-13T18:33:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bceb78640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc815aaf0 con 0x7f2bc80713a0 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcc914640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2bc81582a0 0x7f2bc806c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50608/0 (socket says 172.21.15.53:50608) 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcc914640 1 -- 172.21.15.53:0/802858168 learned_addr learned my addr 172.21.15.53:0/802858168 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcd115640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 0x7f2bc8165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626905637 0 0) 0x7f2bc806d480 con 0x7f2bc81582a0 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb0003530 con 0x7f2bc81582a0 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1138988332 0 0) 0x7f2bb0003530 con 0x7f2bc81582a0 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 msgr2=0x7f2bc8165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 0x7f2bc8165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 >> v1:172.21.15.87:6789/0 conn(0x7f2bc815b7c0 legacy=0x7f2bc8070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc815afc0 con 0x7f2bc81582a0 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f2bb8001680 con 0x7f2bc81582a0 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 >> v1:172.21.15.53:6789/0 conn(0x7f2bc81582a0 legacy=0x7f2bc806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb00039b0 0x7f2bb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 0x7f2bb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb0004d10 0x7f2bb0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb000ba40 con 0x7f2bb0004d10 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb000bb80 con 0x7f2bb00039b0 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb000bd40 con 0x7f2bc80713a0 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcd115640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb0004d10 0x7f2bb0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcc914640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb00039b0 0x7f2bb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bc7fff640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 0x7f2bb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcd115640 1 -- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 msgr2=0x7f2bb00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcd115640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80713a0 0x7f2bb00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcd115640 1 -- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb00039b0 msgr2=0x7f2bb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcd115640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb00039b0 0x7f2bb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.372+0000 7f2bcd115640 1 -- 172.21.15.53:0/802858168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb0003530 con 0x7f2bb0004d10 2024-09-13T18:33:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bcd115640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb0004d10 0x7f2bb0005190 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f2bc81586c0 tx=0x7f2bc001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427279a94959f09b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00a5c30 con 0x7f2bb0004d10 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc000f040 con 0x7f2bb0004d10 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bc77fe640 1 -- 172.21.15.53:0/802858168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00ad440 con 0x7f2bb0004d10 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 -- 172.21.15.53:0/802858168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb0004d10 msgr2=0x7f2bb0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 --2- 172.21.15.53:0/802858168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bb0004d10 0x7f2bb0005190 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f2bc81586c0 tx=0x7f2bc001cc20 comp rx=0 tx=0).stop 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bcd115640 1 -- 172.21.15.53:0/802858168 reap_dead start 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 -- 172.21.15.53:0/802858168 shutdown_connections 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 -- 172.21.15.53:0/802858168 >> 172.21.15.53:0/802858168 conn(0x7f2bc8065c80 msgr2=0x7f2bc8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 -- 172.21.15.53:0/802858168 shutdown_connections 2024-09-13T18:33:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 -- 172.21.15.53:0/802858168 wait complete. 2024-09-13T18:33:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 Processor -- start 2024-09-13T18:33:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.376+0000 7f2bceb78640 1 -- start start 2024-09-13T18:33:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb0004d10 0x7f2bc814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc80b0450 0x7f2bc80b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80a9100 0x7f2bc80a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80ad3b0 con 0x7f2bc80b0450 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80a9d80 con 0x7f2bb0004d10 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80b0e10 con 0x7f2bc80a9100 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc80b0450 0x7f2bc80b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc80b0450 0x7f2bc80b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49948/0 (socket says 172.21.15.53:49948) 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 -- 172.21.15.53:0/279343830 learned_addr learned my addr 172.21.15.53:0/279343830 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bcd115640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80a9100 0x7f2bc80a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bcc914640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb0004d10 0x7f2bc814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 -- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80a9100 msgr2=0x7f2bc80a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80a9100 0x7f2bc80a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 -- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb0004d10 msgr2=0x7f2bc814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb0004d10 0x7f2bc814fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 -- 172.21.15.53:0/279343830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc81efb60 con 0x7f2bc80b0450 2024-09-13T18:33:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc7fff640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc80b0450 0x7f2bc80b08d0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00e550 tx=0x7f2bbc00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc57fa640 1 -- 172.21.15.53:0/279343830 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0052e0 con 0x7f2bc80b0450 2024-09-13T18:33:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc57fa640 1 -- 172.21.15.53:0/279343830 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc005440 con 0x7f2bc80b0450 2024-09-13T18:33:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc80a9af0 con 0x7f2bc80b0450 2024-09-13T18:33:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc57fa640 1 -- 172.21.15.53:0/279343830 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc003820 con 0x7f2bc80b0450 2024-09-13T18:33:41.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc81f00c0 con 0x7f2bc80b0450 2024-09-13T18:33:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc8067400 con 0x7f2bc80b0450 2024-09-13T18:33:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc57fa640 1 -- 172.21.15.53:0/279343830 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f2bbc003980 con 0x7f2bc80b0450 2024-09-13T18:33:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc57fa640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bb4066ea0 0x7f2bb4069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bc57fa640 1 -- 172.21.15.53:0/279343830 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bbc082100 con 0x7f2bc80b0450 2024-09-13T18:33:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bcc914640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bb4066ea0 0x7f2bb4069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.380+0000 7f2bcc914640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bb4066ea0 0x7f2bb4069360 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8005a80 tx=0x7f2bb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:41.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.384+0000 7f2bc57fa640 1 -- 172.21.15.53:0/279343830 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2bbc051070 con 0x7f2bc80b0450 2024-09-13T18:33:41.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.548+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bc806c900 con 0x7f2bc80b0450 2024-09-13T18:33:41.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bc57fa640 1 -- 172.21.15.53:0/279343830 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16511 (secure 0 0 0) 0x7f2bbc054690 con 0x7f2bc80b0450 2024-09-13T18:33:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:41.554 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":150,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:18.511005+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:41.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bb4066ea0 msgr2=0x7f2bb4069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bb4066ea0 0x7f2bb4069360 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8005a80 tx=0x7f2bb8009040 comp rx=0 tx=0).stop 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc80b0450 msgr2=0x7f2bc80b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc80b0450 0x7f2bc80b08d0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00e550 tx=0x7f2bbc00ea10 comp rx=0 tx=0).stop 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 shutdown_connections 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2bb4066ea0 0x7f2bb4069360 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2bc80a9100 0x7f2bc80a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc80b0450 0x7f2bc80b08d0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 --2- 172.21.15.53:0/279343830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bb0004d10 0x7f2bc814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 >> 172.21.15.53:0/279343830 conn(0x7f2bc8065c80 msgr2=0x7f2bc8158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 shutdown_connections 2024-09-13T18:33:41.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.552+0000 7f2bceb78640 1 -- 172.21.15.53:0/279343830 wait complete. 2024-09-13T18:33:41.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:15.920553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:16.488705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:41.575 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:41.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00d0425640 1 Processor -- start 2024-09-13T18:33:41.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00d0425640 1 -- start start 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00d0425640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00c8143e80 0x7f00c806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00d0425640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f00c80cda30 0x7f00c80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00d0425640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c806f7a0 con 0x7f00c80caee0 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00d0425640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c806fd60 con 0x7f00c8143e80 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00d0425640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c80cb960 con 0x7f00c80cda30 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00ce1c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00c8143e80 0x7f00c806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00cd9c0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f00c80caee0 0x7f00c80cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50614/0 (socket says 172.21.15.53:50614) 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00cd9c0640 1 -- 172.21.15.53:0/4135700445 learned_addr learned my addr 172.21.15.53:0/4135700445 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00ce9c2640 1 --2- 172.21.15.53:0/4135700445 >> v2:172.21.15.87:3300/0 conn(0x7f00c80cda30 0x7f00c80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00cd1bf640 1 -- 172.21.15.53:0/4135700445 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160371285 0 0) 0x7f00c806f7a0 con 0x7f00c80caee0 2024-09-13T18:33:41.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00cd1bf640 1 -- 172.21.15.53:0/4135700445 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b0003530 con 0x7f00c80caee0 2024-09-13T18:33:41.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00ce1c1640 1 -- 172.21.15.53:0/4135700445 >> v2:172.21.15.87:3300/0 conn(0x7f00c80cda30 msgr2=0x7f00c80cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:41.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00ce1c1640 1 --2- 172.21.15.53:0/4135700445 >> v2:172.21.15.87:3300/0 conn(0x7f00c80cda30 0x7f00c80cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00ce1c1640 1 -- 172.21.15.53:0/4135700445 >> v1:172.21.15.53:6789/0 conn(0x7f00c80caee0 legacy=0x7f00c80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00ce1c1640 1 -- 172.21.15.53:0/4135700445 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80cbc40 con 0x7f00c8143e80 2024-09-13T18:33:41.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.700+0000 7f00ce1c1640 1 --2- 172.21.15.53:0/4135700445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c8143e80 0x7f00c806b390 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f00c806d370 tx=0x7f00c001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f87586c3f602b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:41.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00cd1bf640 1 -- 172.21.15.53:0/4135700445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00ac640 con 0x7f00c8143e80 2024-09-13T18:33:41.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00cd1bf640 1 -- 172.21.15.53:0/4135700445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c00ac7a0 con 0x7f00c8143e80 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00cd1bf640 1 -- 172.21.15.53:0/4135700445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00acb10 con 0x7f00c8143e80 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- 172.21.15.53:0/4135700445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c8143e80 msgr2=0x7f00c806b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 --2- 172.21.15.53:0/4135700445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c8143e80 0x7f00c806b390 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f00c806d370 tx=0x7f00c001c330 comp rx=0 tx=0).stop 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- 172.21.15.53:0/4135700445 shutdown_connections 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 --2- 172.21.15.53:0/4135700445 >> v2:172.21.15.87:3300/0 conn(0x7f00c80cda30 0x7f00c80cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 --2- 172.21.15.53:0/4135700445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c8143e80 0x7f00c806b390 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- 172.21.15.53:0/4135700445 >> 172.21.15.53:0/4135700445 conn(0x7f00c8065c80 msgr2=0x7f00c8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- 172.21.15.53:0/4135700445 shutdown_connections 2024-09-13T18:33:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- 172.21.15.53:0/4135700445 wait complete. 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 Processor -- start 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- start start 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c80caee0 0x7f00c815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00c80cda30 0x7f00c815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00c8143e80 0x7f00c813ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c815ed70 con 0x7f00c80caee0 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c815c3d0 con 0x7f00c80cda30 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c815b880 con 0x7f00c8143e80 2024-09-13T18:33:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c80caee0 0x7f00c815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c80caee0 0x7f00c815e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49968/0 (socket says 172.21.15.53:49968) 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 -- 172.21.15.53:0/1959122419 learned_addr learned my addr 172.21.15.53:0/1959122419 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00cd9c0640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00c80cda30 0x7f00c815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce9c2640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00c8143e80 0x7f00c813ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 -- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00c8143e80 msgr2=0x7f00c813ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00c8143e80 0x7f00c813ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 -- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00c80cda30 msgr2=0x7f00c815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00c80cda30 0x7f00c815b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 -- 172.21.15.53:0/1959122419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0009420 con 0x7f00c80caee0 2024-09-13T18:33:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00ce1c1640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c80caee0 0x7f00c815e5b0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c10 tx=0x7f00c00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00c6ffd640 1 -- 172.21.15.53:0/1959122419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00b5600 con 0x7f00c80caee0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00c6ffd640 1 -- 172.21.15.53:0/1959122419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c00b5760 con 0x7f00c80caee0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c815bb30 con 0x7f00c80caee0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00c6ffd640 1 -- 172.21.15.53:0/1959122419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c00b5b10 con 0x7f00c80caee0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.704+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c815c0f0 con 0x7f00c80caee0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.708+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c80cb350 con 0x7f00c80caee0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.708+0000 7f00c6ffd640 1 -- 172.21.15.53:0/1959122419 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f00c00b3040 con 0x7f00c80caee0 2024-09-13T18:33:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.708+0000 7f00c6ffd640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00b4066e70 0x7f00b4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:41.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.708+0000 7f00c6ffd640 1 -- 172.21.15.53:0/1959122419 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00c011ca90 con 0x7f00c80caee0 2024-09-13T18:33:41.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.708+0000 7f00cd9c0640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00b4066e70 0x7f00b4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:41.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.708+0000 7f00cd9c0640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00b4066e70 0x7f00b4069330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f00c815eaf0 tx=0x7f00bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:41.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.712+0000 7f00c6ffd640 1 -- 172.21.15.53:0/1959122419 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00c00eba00 con 0x7f00c80caee0 2024-09-13T18:33:41.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.872+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00c815a410 con 0x7f00c80caee0 2024-09-13T18:33:41.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00c6ffd640 1 -- 172.21.15.53:0/1959122419 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00c00b1020 con 0x7f00c80caee0 2024-09-13T18:33:41.878 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:41.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00b4066e70 msgr2=0x7f00b4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00b4066e70 0x7f00b4069330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f00c815eaf0 tx=0x7f00bc009040 comp rx=0 tx=0).stop 2024-09-13T18:33:41.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c80caee0 msgr2=0x7f00c815e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:41.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c80caee0 0x7f00c815e5b0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f00c0000c10 tx=0x7f00c00190d0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 shutdown_connections 2024-09-13T18:33:41.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00b4066e70 0x7f00b4069330 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00c8143e80 0x7f00c813ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00c80cda30 0x7f00c815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 --2- 172.21.15.53:0/1959122419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00c80caee0 0x7f00c815e5b0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:41.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 >> 172.21.15.53:0/1959122419 conn(0x7f00c8065c80 msgr2=0x7f00c8158800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:41.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 shutdown_connections 2024-09-13T18:33:41.881 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:41.876+0000 7f00d0425640 1 -- 172.21.15.53:0/1959122419 wait complete. 2024-09-13T18:33:41.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:33:42.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.028+0000 7f74699fe640 1 Processor -- start 2024-09-13T18:33:42.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.028+0000 7f74699fe640 1 -- start start 2024-09-13T18:33:42.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74699fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 0x7f74640cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74699fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f74640d2c80 0x7f74640d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74699fe640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74640b7db0 con 0x7f746415c830 2024-09-13T18:33:42.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74699fe640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74640d3670 con 0x7f74640d2c80 2024-09-13T18:33:42.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74699fe640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640d0650 con 0x7f74640ccd10 2024-09-13T18:33:42.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7462ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f746415c830 0x7f74640d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50622/0 (socket says 172.21.15.53:50622) 2024-09-13T18:33:42.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7462ffd640 1 -- 172.21.15.53:0/2113287695 learned_addr learned my addr 172.21.15.53:0/2113287695 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:42.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74627fc640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 0x7f74640cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74637fe640 1 --2- 172.21.15.53:0/2113287695 >> v2:172.21.15.87:3300/0 conn(0x7f74640d2c80 0x7f74640d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144250704 0 0) 0x7f74640b7db0 con 0x7f746415c830 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744c003530 con 0x7f746415c830 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2607283089 0 0) 0x7f744c003530 con 0x7f746415c830 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 msgr2=0x7f74640cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 0x7f74640cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 >> v2:172.21.15.87:3300/0 conn(0x7f74640d2c80 msgr2=0x7f74640d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 --2- 172.21.15.53:0/2113287695 >> v2:172.21.15.87:3300/0 conn(0x7f74640d2c80 0x7f74640d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640d0c10 con 0x7f746415c830 2024-09-13T18:33:42.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f745c001a00 con 0x7f746415c830 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 >> v1:172.21.15.53:6789/0 conn(0x7f746415c830 legacy=0x7f74640d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 0x7f744c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f744c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f744c004d10 0x7f744c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640d3670 con 0x7f744c003f00 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640d0650 con 0x7f744c004d10 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c00b990 con 0x7f74640ccd10 2024-09-13T18:33:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74627fc640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f744c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f7462ffd640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 0x7f744c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74627fc640 1 -- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 msgr2=0x7f744c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:42.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74627fc640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74640ccd10 0x7f744c003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74627fc640 1 -- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f744c004d10 msgr2=0x7f744c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:42.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74627fc640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f744c004d10 0x7f744c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.032+0000 7f74627fc640 1 -- 172.21.15.53:0/2113287695 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c003530 con 0x7f744c003f00 2024-09-13T18:33:42.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74627fc640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f744c0047d0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f7458009ab0 tx=0x7f745801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e55e339781be4f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580a5640 con 0x7f744c003f00 2024-09-13T18:33:42.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74580a57a0 con 0x7f744c003f00 2024-09-13T18:33:42.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f7461ffb640 1 -- 172.21.15.53:0/2113287695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580a5b50 con 0x7f744c003f00 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 -- 172.21.15.53:0/2113287695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 msgr2=0x7f744c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 --2- 172.21.15.53:0/2113287695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f744c0047d0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f7458009ab0 tx=0x7f745801c9f0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74637fe640 1 -- 172.21.15.53:0/2113287695 reap_dead start 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 -- 172.21.15.53:0/2113287695 shutdown_connections 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 -- 172.21.15.53:0/2113287695 >> 172.21.15.53:0/2113287695 conn(0x7f7464070970 msgr2=0x7f7464070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 -- 172.21.15.53:0/2113287695 shutdown_connections 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 -- 172.21.15.53:0/2113287695 wait complete. 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 Processor -- start 2024-09-13T18:33:42.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.036+0000 7f74699fe640 1 -- start start 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f74641f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74641567d0 0x7f7464156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74641587f0 0x7f7464158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7464154380 con 0x7f744c003f00 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7464157190 con 0x7f74641587f0 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7464159a00 con 0x7f74641567d0 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f74641f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f74641f16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49988/0 (socket says 172.21.15.53:49988) 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 -- 172.21.15.53:0/3853892386 learned_addr learned my addr 172.21.15.53:0/3853892386 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74627fc640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74641567d0 0x7f7464156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74637fe640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74641587f0 0x7f7464158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 -- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74641567d0 msgr2=0x7f7464156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74641567d0 0x7f7464156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 -- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74641587f0 msgr2=0x7f7464158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74641587f0 0x7f7464158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 -- 172.21.15.53:0/3853892386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74641591b0 con 0x7f744c003f00 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f7462ffd640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f74641f16e0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f745c010c30 tx=0x7f745c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f744bfff640 1 -- 172.21.15.53:0/3853892386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c010e40 con 0x7f744c003f00 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f744bfff640 1 -- 172.21.15.53:0/3853892386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c0143a0 con 0x7f744c003f00 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746415dfd0 con 0x7f744c003f00 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f744bfff640 1 -- 172.21.15.53:0/3853892386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c014750 con 0x7f744c003f00 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7464159720 con 0x7f744c003f00 2024-09-13T18:33:42.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74641544c0 con 0x7f744c003f00 2024-09-13T18:33:42.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f744bfff640 1 -- 172.21.15.53:0/3853892386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f745c0148b0 con 0x7f744c003f00 2024-09-13T18:33:42.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f744bfff640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7450066e70 0x7f7450069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f74627fc640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7450066e70 0x7f7450069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.040+0000 7f744bfff640 1 -- 172.21.15.53:0/3853892386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f745c085810 con 0x7f744c003f00 2024-09-13T18:33:42.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.044+0000 7f74627fc640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7450066e70 0x7f7450069330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f74580af000 tx=0x7f74580046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.044+0000 7f744bfff640 1 -- 172.21.15.53:0/3853892386 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f745c0b9db0 con 0x7f744c003f00 2024-09-13T18:33:42.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.204+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74640b1940 con 0x7f744c003f00 2024-09-13T18:33:42.208 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.204+0000 7f744bfff640 1 -- 172.21.15.53:0/3853892386 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7f745c01b020 con 0x7f744c003f00 2024-09-13T18:33:42.208 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:33:42.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7450066e70 msgr2=0x7f7450069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7450066e70 0x7f7450069330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f74580af000 tx=0x7f74580046d0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 msgr2=0x7f74641f16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f74641f16e0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f745c010c30 tx=0x7f745c00e4d0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 shutdown_connections 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7450066e70 0x7f7450069330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74641567d0 0x7f7464156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74641587f0 0x7f7464158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 --2- 172.21.15.53:0/3853892386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f744c003f00 0x7f74641f16e0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 >> 172.21.15.53:0/3853892386 conn(0x7f7464070970 msgr2=0x7f74640b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 shutdown_connections 2024-09-13T18:33:42.211 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.208+0000 7f74699fe640 1 -- 172.21.15.53:0/3853892386 wait complete. 2024-09-13T18:33:42.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:33:42.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7afa42640 1 Processor -- start 2024-09-13T18:33:42.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7afa42640 1 -- start start 2024-09-13T18:33:42.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7afa42640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7a80ccd10 0x7fe7a80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7afa42640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a80d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7afa42640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80b7db0 con 0x7fe7a815c830 2024-09-13T18:33:42.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7afa42640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a80d3650 con 0x7fe7a80ccd10 2024-09-13T18:33:42.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7afa42640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80d0650 con 0x7fe7a80d2c80 2024-09-13T18:33:42.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7acfdd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7a80ccd10 0x7fe7a80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7ad7de640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe7a815c830 0x7fe7a80d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50634/0 (socket says 172.21.15.53:50634) 2024-09-13T18:33:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7ad7de640 1 -- 172.21.15.53:0/3468044415 learned_addr learned my addr 172.21.15.53:0/3468044415 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7adfdf640 1 --2- 172.21.15.53:0/3468044415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a80d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7acfdd640 1 -- 172.21.15.53:0/3468044415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 msgr2=0x7fe7a80d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7acfdd640 1 --2- 172.21.15.53:0/3468044415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a80d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7acfdd640 1 -- 172.21.15.53:0/3468044415 >> v1:172.21.15.53:6789/0 conn(0x7fe7a815c830 legacy=0x7fe7a80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7acfdd640 1 -- 172.21.15.53:0/3468044415 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80d0c10 con 0x7fe7a80ccd10 2024-09-13T18:33:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.356+0000 7fe7adfdf640 1 --2- 172.21.15.53:0/3468044415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a80d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:42.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7acfdd640 1 --2- 172.21.15.53:0/3468044415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a80cd180 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fe7980097c0 tx=0x7fe79801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811024789158918 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe79ffff640 1 -- 172.21.15.53:0/3468044415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980ab600 con 0x7fe7a80ccd10 2024-09-13T18:33:42.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe79ffff640 1 -- 172.21.15.53:0/3468044415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980a7050 con 0x7fe7a80ccd10 2024-09-13T18:33:42.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe79ffff640 1 -- 172.21.15.53:0/3468044415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980ab980 con 0x7fe7a80ccd10 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 -- 172.21.15.53:0/3468044415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 msgr2=0x7fe7a80cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 --2- 172.21.15.53:0/3468044415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a80cd180 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fe7980097c0 tx=0x7fe79801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 -- 172.21.15.53:0/3468044415 shutdown_connections 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 --2- 172.21.15.53:0/3468044415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a80d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 --2- 172.21.15.53:0/3468044415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a80cd180 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 -- 172.21.15.53:0/3468044415 >> 172.21.15.53:0/3468044415 conn(0x7fe7a8070970 msgr2=0x7fe7a8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 -- 172.21.15.53:0/3468044415 shutdown_connections 2024-09-13T18:33:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 -- 172.21.15.53:0/3468044415 wait complete. 2024-09-13T18:33:42.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 Processor -- start 2024-09-13T18:33:42.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.360+0000 7fe7afa42640 1 -- start start 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a814c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7a815c830 0x7fe7a815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a815e010 con 0x7fe7a80ccd10 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a815e2f0 con 0x7fe7a815c830 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a815e5d0 con 0x7fe7a80d2c80 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a814c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49998/0 (socket says 172.21.15.53:49998) 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 -- 172.21.15.53:0/678485772 learned_addr learned my addr 172.21.15.53:0/678485772 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:42.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7adfdf640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7a815c830 0x7fe7a815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 -- 172.21.15.53:0/678485772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 msgr2=0x7fe7a815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 -- 172.21.15.53:0/678485772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7a815c830 msgr2=0x7fe7a815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7a815c830 0x7fe7a815f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 -- 172.21.15.53:0/678485772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798009420 con 0x7fe7a80ccd10 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7ad7de640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a814c470 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400c400 tx=0x7fe7a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe79dffb640 1 -- 172.21.15.53:0/678485772 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4005cf0 con 0x7fe7a80ccd10 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe79dffb640 1 -- 172.21.15.53:0/678485772 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a4005e50 con 0x7fe7a80ccd10 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a815e8b0 con 0x7fe7a80ccd10 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe79dffb640 1 -- 172.21.15.53:0/678485772 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40072d0 con 0x7fe7a80ccd10 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a814c9b0 con 0x7fe7a80ccd10 2024-09-13T18:33:42.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a80cd180 con 0x7fe7a80ccd10 2024-09-13T18:33:42.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe79dffb640 1 -- 172.21.15.53:0/678485772 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fe7a4007430 con 0x7fe7a80ccd10 2024-09-13T18:33:42.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe79dffb640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe78c066e70 0x7fe78c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe79dffb640 1 -- 172.21.15.53:0/678485772 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7a4081d40 con 0x7fe7a80ccd10 2024-09-13T18:33:42.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.364+0000 7fe7acfdd640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe78c066e70 0x7fe78c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.368+0000 7fe7acfdd640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe78c066e70 0x7fe78c069330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe7980ad000 tx=0x7fe798004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.368+0000 7fe79dffb640 1 -- 172.21.15.53:0/678485772 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7a4050d60 con 0x7fe7a80ccd10 2024-09-13T18:33:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.540+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7a815ed60 con 0x7fe7a80ccd10 2024-09-13T18:33:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe79dffb640 1 -- 172.21.15.53:0/678485772 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7a40170a0 con 0x7fe7a80ccd10 2024-09-13T18:33:42.545 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:33:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe78c066e70 msgr2=0x7fe78c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe78c066e70 0x7fe78c069330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe7980ad000 tx=0x7fe798004740 comp rx=0 tx=0).stop 2024-09-13T18:33:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 msgr2=0x7fe7a814c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a814c470 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400c400 tx=0x7fe7a400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 shutdown_connections 2024-09-13T18:33:42.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe78c066e70 0x7fe78c069330 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7a80d2c80 0x7fe7a815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7a815c830 0x7fe7a815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 --2- 172.21.15.53:0/678485772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7a80ccd10 0x7fe7a814c470 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 >> 172.21.15.53:0/678485772 conn(0x7fe7a8070970 msgr2=0x7fe7a80b8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 shutdown_connections 2024-09-13T18:33:42.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.544+0000 7fe7afa42640 1 -- 172.21.15.53:0/678485772 wait complete. 2024-09-13T18:33:42.568 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:33:42.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 Processor -- start 2024-09-13T18:33:42.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 -- start start 2024-09-13T18:33:42.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f069c06b850 0x7f069c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f069c0cbd60 0x7f069c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c0b1ac0 con 0x7f069c0cbd60 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c159ac0 con 0x7f069c06b850 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a3a0d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c159da0 con 0x7f069c0cb980 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f069c0cbd60 0x7f069c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f069c0cbd60 0x7f069c06fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50008/0 (socket says 172.21.15.53:50008) 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 -- 172.21.15.53:0/3526558652 learned_addr learned my addr 172.21.15.53:0/3526558652 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a0fa8640 1 --2- 172.21.15.53:0/3526558652 >> v2:172.21.15.87:3300/0 conn(0x7f069c06b850 0x7f069c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a17a9640 1 --2- 172.21.15.53:0/3526558652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 -- 172.21.15.53:0/3526558652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 msgr2=0x7f069c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:42.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 --2- 172.21.15.53:0/3526558652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 -- 172.21.15.53:0/3526558652 >> v2:172.21.15.87:3300/0 conn(0x7f069c06b850 msgr2=0x7f069c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:42.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 --2- 172.21.15.53:0/3526558652 >> v2:172.21.15.87:3300/0 conn(0x7f069c06b850 0x7f069c0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.684+0000 7f06a1faa640 1 -- 172.21.15.53:0/3526558652 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c15a080 con 0x7f069c0cbd60 2024-09-13T18:33:42.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a1faa640 1 --2- 172.21.15.53:0/3526558652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c0cbd60 0x7f069c06fcd0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f0694009e50 tx=0x7f069401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991d6847cedf656a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f0693fff640 1 -- 172.21.15.53:0/3526558652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940a56c0 con 0x7f069c0cbd60 2024-09-13T18:33:42.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f0693fff640 1 -- 172.21.15.53:0/3526558652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06940a5820 con 0x7f069c0cbd60 2024-09-13T18:33:42.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f0693fff640 1 -- 172.21.15.53:0/3526558652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940a5bb0 con 0x7f069c0cbd60 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3526558652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c0cbd60 msgr2=0x7f069c06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3526558652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c0cbd60 0x7f069c06fcd0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f0694009e50 tx=0x7f069401c930 comp rx=0 tx=0).stop 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3526558652 shutdown_connections 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3526558652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c0cbd60 0x7f069c06fcd0 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3526558652 >> v2:172.21.15.87:3300/0 conn(0x7f069c06b850 0x7f069c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3526558652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3526558652 >> 172.21.15.53:0/3526558652 conn(0x7f069c065c80 msgr2=0x7f069c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3526558652 shutdown_connections 2024-09-13T18:33:42.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.688+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3526558652 wait complete. 2024-09-13T18:33:42.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 Processor -- start 2024-09-13T18:33:42.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 -- start start 2024-09-13T18:33:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c06b850 0x7f069c160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f069c0cbd60 0x7f069c161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c161380 con 0x7f069c06b850 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0cce80 con 0x7f069c0cbd60 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0ccba0 con 0x7f069c0cb980 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c06b850 0x7f069c160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c06b850 0x7f069c160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50018/0 (socket says 172.21.15.53:50018) 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 -- 172.21.15.53:0/3009526606 learned_addr learned my addr 172.21.15.53:0/3009526606 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a0fa8640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a1faa640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f069c0cbd60 0x7f069c161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 -- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 msgr2=0x7f069c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 -- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f069c0cbd60 msgr2=0x7f069c161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f069c0cbd60 0x7f069c161ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 -- 172.21.15.53:0/3009526606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694009b30 con 0x7f069c06b850 2024-09-13T18:33:42.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a0fa8640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:42.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a17a9640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c06b850 0x7f069c160e40 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f069800d800 tx=0x7f069800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f0691ffb640 1 -- 172.21.15.53:0/3009526606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069800b6c0 con 0x7f069c06b850 2024-09-13T18:33:42.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f0691ffb640 1 -- 172.21.15.53:0/3009526606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069800b820 con 0x7f069c06b850 2024-09-13T18:33:42.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f0691ffb640 1 -- 172.21.15.53:0/3009526606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069800bb90 con 0x7f069c06b850 2024-09-13T18:33:42.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c160360 con 0x7f069c06b850 2024-09-13T18:33:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c160920 con 0x7f069c06b850 2024-09-13T18:33:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.692+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c067400 con 0x7f069c06b850 2024-09-13T18:33:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.696+0000 7f0691ffb640 1 -- 172.21.15.53:0/3009526606 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f069800bcf0 con 0x7f069c06b850 2024-09-13T18:33:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.696+0000 7f0691ffb640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0680066e70 0x7f0680069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.696+0000 7f0691ffb640 1 -- 172.21.15.53:0/3009526606 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0698082d50 con 0x7f069c06b850 2024-09-13T18:33:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.696+0000 7f06a0fa8640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0680066e70 0x7f0680069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.696+0000 7f06a0fa8640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0680066e70 0x7f0680069330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f069c0add80 tx=0x7f068c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.700+0000 7f0691ffb640 1 -- 172.21.15.53:0/3009526606 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0698051cc0 con 0x7f069c06b850 2024-09-13T18:33:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.868+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f069c0b33b0 con 0x7f069c06b850 2024-09-13T18:33:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.868+0000 7f0691ffb640 1 -- 172.21.15.53:0/3009526606 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v150) v1 ==== 80+0+0 (secure 0 0 0) 0x7f06980552e0 con 0x7f069c06b850 2024-09-13T18:33:42.871 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:33:42.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0680066e70 msgr2=0x7f0680069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0680066e70 0x7f0680069330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f069c0add80 tx=0x7f068c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:42.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c06b850 msgr2=0x7f069c160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:42.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c06b850 0x7f069c160e40 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f069800d800 tx=0x7f069800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 shutdown_connections 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0680066e70 0x7f0680069330 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f069c0cb980 0x7f069c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f069c0cbd60 0x7f069c161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 --2- 172.21.15.53:0/3009526606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f069c06b850 0x7f069c160e40 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 >> 172.21.15.53:0/3009526606 conn(0x7f069c065c80 msgr2=0x7f069c163390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 shutdown_connections 2024-09-13T18:33:42.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:42.872+0000 7f06a3a0d640 1 -- 172.21.15.53:0/3009526606 wait complete. 2024-09-13T18:33:42.890 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:33:42.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:42.890 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:33:42.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36540]: fuse finished with error 0 and tester_r 0 2024-09-13T18:33:42.905 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:33:42.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:42.905 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:33:43.017 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:33:43.017 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:43.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:43.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:33:43.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:43.023 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:33:43.069 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:33:43.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:43.070 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:43.070 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:43.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:43.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:33:43.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:33:43.078 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:33:43.125 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:33:43.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:33:43.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.252+0000 7f5d04ae4640 1 Processor -- start 2024-09-13T18:33:43.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.252+0000 7f5d04ae4640 1 -- start start 2024-09-13T18:33:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5d04ae4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d0015a470 0x7f5d000cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5d04ae4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d0015cc60 0x7f5d00071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5d04ae4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0006f550 con 0x7f5d000b1c10 2024-09-13T18:33:43.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5d04ae4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0006f880 con 0x7f5d0015cc60 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5d04ae4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0015dc40 con 0x7f5d0015a470 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d0015cc60 0x7f5d00071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d0015cc60 0x7f5d00071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50020/0 (socket says 172.21.15.53:50020) 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 -- 172.21.15.53:0/4180704859 learned_addr learned my addr 172.21.15.53:0/4180704859 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cfe59c640 1 --2- 172.21.15.53:0/4180704859 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d0015a470 0x7f5d000cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 -- 172.21.15.53:0/4180704859 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d0015a470 msgr2=0x7f5d000cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 --2- 172.21.15.53:0/4180704859 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d0015a470 0x7f5d000cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 -- 172.21.15.53:0/4180704859 >> v1:172.21.15.87:6789/0 conn(0x7f5d000b1c10 legacy=0x7f5d0006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 -- 172.21.15.53:0/4180704859 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000715a0 con 0x7f5d0015cc60 2024-09-13T18:33:43.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cfe59c640 1 --2- 172.21.15.53:0/4180704859 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d0015a470 0x7f5d000cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cf7fff640 1 --2- 172.21.15.53:0/4180704859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015cc60 0x7f5d00071060 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009870 tx=0x7f5ce801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b976930d4ae119 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.256+0000 7f5cfdd9b640 1 -- 172.21.15.53:0/4180704859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80aa640 con 0x7f5d0015cc60 2024-09-13T18:33:43.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cfdd9b640 1 -- 172.21.15.53:0/4180704859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce80aa7a0 con 0x7f5d0015cc60 2024-09-13T18:33:43.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cfdd9b640 1 -- 172.21.15.53:0/4180704859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80aab30 con 0x7f5d0015cc60 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- 172.21.15.53:0/4180704859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015cc60 msgr2=0x7f5d00071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/4180704859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015cc60 0x7f5d00071060 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009870 tx=0x7f5ce801c520 comp rx=0 tx=0).stop 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- 172.21.15.53:0/4180704859 shutdown_connections 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/4180704859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015cc60 0x7f5d00071060 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/4180704859 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d0015a470 0x7f5d000cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- 172.21.15.53:0/4180704859 >> 172.21.15.53:0/4180704859 conn(0x7f5d00065c80 msgr2=0x7f5d00066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- 172.21.15.53:0/4180704859 shutdown_connections 2024-09-13T18:33:43.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- 172.21.15.53:0/4180704859 wait complete. 2024-09-13T18:33:43.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 Processor -- start 2024-09-13T18:33:43.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- start start 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d000b1c10 0x7f5d000c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015a470 0x7f5d0015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d0015cc60 0x7f5d0015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c4670 con 0x7f5d0015a470 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c3dd0 con 0x7f5d0015cc60 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c40b0 con 0x7f5d000b1c10 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015a470 0x7f5d0015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015a470 0x7f5d0015aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50022/0 (socket says 172.21.15.53:50022) 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 -- 172.21.15.53:0/3523562506 learned_addr learned my addr 172.21.15.53:0/3523562506 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cfe59c640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d000b1c10 0x7f5d000c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cfed9d640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d0015cc60 0x7f5d0015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 -- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d000b1c10 msgr2=0x7f5d000c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d000b1c10 0x7f5d000c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 -- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d0015cc60 msgr2=0x7f5d0015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d0015cc60 0x7f5d0015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 -- 172.21.15.53:0/3523562506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80094d0 con 0x7f5d0015a470 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf7fff640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015a470 0x7f5d0015aeb0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f5ce801abd0 tx=0x7f5ce801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf6ffd640 1 -- 172.21.15.53:0/3523562506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80bd5f0 con 0x7f5d0015a470 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf6ffd640 1 -- 172.21.15.53:0/3523562506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce80bd770 con 0x7f5d0015a470 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5cf6ffd640 1 -- 172.21.15.53:0/3523562506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80bdb20 con 0x7f5d0015a470 2024-09-13T18:33:43.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d000c4390 con 0x7f5d0015a470 2024-09-13T18:33:43.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.260+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d001530a0 con 0x7f5d0015a470 2024-09-13T18:33:43.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.264+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d00067400 con 0x7f5d0015a470 2024-09-13T18:33:43.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.264+0000 7f5cf6ffd640 1 -- 172.21.15.53:0/3523562506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f5ce80a8050 con 0x7f5d0015a470 2024-09-13T18:33:43.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.264+0000 7f5cf6ffd640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5ce0066e70 0x7f5ce0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.264+0000 7f5cfe59c640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5ce0066e70 0x7f5ce0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.264+0000 7f5cf6ffd640 1 -- 172.21.15.53:0/3523562506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ce811d030 con 0x7f5d0015a470 2024-09-13T18:33:43.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.264+0000 7f5cfe59c640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5ce0066e70 0x7f5ce0069330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000ab60 tx=0x7f5cf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.268+0000 7f5cf6ffd640 1 -- 172.21.15.53:0/3523562506 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ce80ec170 con 0x7f5d0015a470 2024-09-13T18:33:43.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.464+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d000c41f0 con 0x7f5d0015a470 2024-09-13T18:33:43.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.464+0000 7f5cf6ffd640 1 -- 172.21.15.53:0/3523562506 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4735 (secure 0 0 0) 0x7f5d000c41f0 con 0x7f5d0015a470 2024-09-13T18:33:43.467 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:43.467 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/234820268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":234820268},{"type":"v1","addr":"172.21.15.87:6835","nonce":234820268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2552754296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2552754296},{"type":"v1","addr":"172.21.15.87:6833","nonce":2552754296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1877336010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1877336010},{"type":"v1","addr":"172.21.15.53:6833","nonce":1877336010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:17.507989+0000","modified":"2024-09-13T18:33:20.527909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9555},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9555":{"gid":9555,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1614413719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1614413719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1614413719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:33:43.468 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2024-09-13T18:33:43.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5ce0066e70 msgr2=0x7f5ce0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5ce0066e70 0x7f5ce0069330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000ab60 tx=0x7f5cf0008040 comp rx=0 tx=0).stop 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015a470 msgr2=0x7f5d0015aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015a470 0x7f5d0015aeb0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f5ce801abd0 tx=0x7f5ce801ad60 comp rx=0 tx=0).stop 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 shutdown_connections 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5ce0066e70 0x7f5ce0069330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d0015cc60 0x7f5d0015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d0015a470 0x7f5d0015aeb0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 --2- 172.21.15.53:0/3523562506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5d000b1c10 0x7f5d000c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 >> 172.21.15.53:0/3523562506 conn(0x7f5d00065c80 msgr2=0x7f5d00066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:43.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 shutdown_connections 2024-09-13T18:33:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.468+0000 7f5d04ae4640 1 -- 172.21.15.53:0/3523562506 wait complete. 2024-09-13T18:33:43.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:43.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f4051639640 1 Processor -- start 2024-09-13T18:33:43.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f4051639640 1 -- start start 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f4051639640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c158ba0 0x7f404c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f4051639640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f404c0cbb60 0x7f404c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f4051639640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404c0b2340 con 0x7f404c06f370 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f4051639640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c0b2860 con 0x7f404c0cbb60 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f4051639640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c158f80 con 0x7f404c158ba0 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f404c0cbb60 0x7f404c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f404c0cbb60 0x7f404c0b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50034/0 (socket says 172.21.15.53:50034) 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404a7fc640 1 -- 172.21.15.53:0/63118353 learned_addr learned my addr 172.21.15.53:0/63118353 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:43.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404affd640 1 --2- 172.21.15.53:0/63118353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c158ba0 0x7f404c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404a7fc640 1 -- 172.21.15.53:0/63118353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c158ba0 msgr2=0x7f404c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:43.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404a7fc640 1 --2- 172.21.15.53:0/63118353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c158ba0 0x7f404c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404a7fc640 1 -- 172.21.15.53:0/63118353 >> v1:172.21.15.87:6789/0 conn(0x7f404c06f370 legacy=0x7f404c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.612+0000 7f404a7fc640 1 -- 172.21.15.53:0/63118353 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0b2580 con 0x7f404c0cbb60 2024-09-13T18:33:43.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f404a7fc640 1 --2- 172.21.15.53:0/63118353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0cbb60 0x7f404c0b1e00 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f403c00aa10 tx=0x7f403c01d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ecf9ba864bfc18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4049ffb640 1 -- 172.21.15.53:0/63118353 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a6950 con 0x7f404c0cbb60 2024-09-13T18:33:43.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4049ffb640 1 -- 172.21.15.53:0/63118353 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c0a6ab0 con 0x7f404c0cbb60 2024-09-13T18:33:43.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4049ffb640 1 -- 172.21.15.53:0/63118353 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a6e40 con 0x7f404c0cbb60 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 -- 172.21.15.53:0/63118353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0cbb60 msgr2=0x7f404c0b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 --2- 172.21.15.53:0/63118353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0cbb60 0x7f404c0b1e00 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f403c00aa10 tx=0x7f403c01d8a0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 -- 172.21.15.53:0/63118353 shutdown_connections 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 --2- 172.21.15.53:0/63118353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0cbb60 0x7f404c0b1e00 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 --2- 172.21.15.53:0/63118353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c158ba0 0x7f404c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 -- 172.21.15.53:0/63118353 >> 172.21.15.53:0/63118353 conn(0x7f404c065c80 msgr2=0x7f404c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 -- 172.21.15.53:0/63118353 shutdown_connections 2024-09-13T18:33:43.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.616+0000 7f4051639640 1 -- 172.21.15.53:0/63118353 wait complete. 2024-09-13T18:33:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 Processor -- start 2024-09-13T18:33:43.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 -- start start 2024-09-13T18:33:43.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c06f370 0x7f404c0a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c0cbb60 0x7f404c0aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c158ba0 0x7f404c0aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0ac100 con 0x7f404c158ba0 2024-09-13T18:33:43.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0c8600 con 0x7f404c06f370 2024-09-13T18:33:43.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0c88a0 con 0x7f404c0cbb60 2024-09-13T18:33:43.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c158ba0 0x7f404c0aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c158ba0 0x7f404c0aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50040/0 (socket says 172.21.15.53:50040) 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 -- 172.21.15.53:0/2026739663 learned_addr learned my addr 172.21.15.53:0/2026739663 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404a7fc640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c0cbb60 0x7f404c0aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404affd640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c06f370 0x7f404c0a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 -- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c0cbb60 msgr2=0x7f404c0aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c0cbb60 0x7f404c0aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 -- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c06f370 msgr2=0x7f404c0a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c06f370 0x7f404c0a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 -- 172.21.15.53:0/2026739663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c00a670 con 0x7f404c158ba0 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f404b7fe640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c158ba0 0x7f404c0aac60 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f404400c730 tx=0x7f404400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f40337fe640 1 -- 172.21.15.53:0/2026739663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044003b80 con 0x7f404c158ba0 2024-09-13T18:33:43.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f40337fe640 1 -- 172.21.15.53:0/2026739663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4044003ce0 con 0x7f404c158ba0 2024-09-13T18:33:43.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c0ad4d0 con 0x7f404c158ba0 2024-09-13T18:33:43.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f40337fe640 1 -- 172.21.15.53:0/2026739663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404400aa30 con 0x7f404c158ba0 2024-09-13T18:33:43.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c0abb40 con 0x7f404c158ba0 2024-09-13T18:33:43.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.620+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c067400 con 0x7f404c158ba0 2024-09-13T18:33:43.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.624+0000 7f40337fe640 1 -- 172.21.15.53:0/2026739663 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f404400ab90 con 0x7f404c158ba0 2024-09-13T18:33:43.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.624+0000 7f40337fe640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4038066e70 0x7f4038069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.624+0000 7f40337fe640 1 -- 172.21.15.53:0/2026739663 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40440824a0 con 0x7f404c158ba0 2024-09-13T18:33:43.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.624+0000 7f404affd640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4038066e70 0x7f4038069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.624+0000 7f404affd640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4038066e70 0x7f4038069330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4040009af0 tx=0x7f4040008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.628+0000 7f40337fe640 1 -- 172.21.15.53:0/2026739663 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f404408a020 con 0x7f404c158ba0 2024-09-13T18:33:43.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.788+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f404c0b2340 con 0x7f404c158ba0 2024-09-13T18:33:43.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.788+0000 7f40337fe640 1 -- 172.21.15.53:0/2026739663 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16511 (secure 0 0 0) 0x7f404c0b2340 con 0x7f404c158ba0 2024-09-13T18:33:43.793 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:43.794 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":150,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:18.511005+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4038066e70 msgr2=0x7f4038069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4038066e70 0x7f4038069330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4040009af0 tx=0x7f4040008040 comp rx=0 tx=0).stop 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c158ba0 msgr2=0x7f404c0aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c158ba0 0x7f404c0aac60 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f404400c730 tx=0x7f404400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 shutdown_connections 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4038066e70 0x7f4038069330 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f404c0cbb60 0x7f404c0aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c158ba0 0x7f404c0aac60 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 --2- 172.21.15.53:0/2026739663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f404c06f370 0x7f404c0a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 >> 172.21.15.53:0/2026739663 conn(0x7f404c065c80 msgr2=0x7f404c0b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 shutdown_connections 2024-09-13T18:33:43.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.792+0000 7f4051639640 1 -- 172.21.15.53:0/2026739663 wait complete. 2024-09-13T18:33:43.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:15.920553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:16.488705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:43.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:43.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd026a1640 1 Processor -- start 2024-09-13T18:33:43.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd026a1640 1 -- start start 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd026a1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fccfc157020 0x7fccfc06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd026a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fccfc06d270 0x7fccfc06f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd026a1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc06d6e0 con 0x7fccfc156c40 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd026a1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc0715f0 con 0x7fccfc06d270 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd026a1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc0b15a0 con 0x7fccfc157020 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd00c3e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fccfc06d270 0x7fccfc06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd00c3e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fccfc06d270 0x7fccfc06f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50050/0 (socket says 172.21.15.53:50050) 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd00c3e640 1 -- 172.21.15.53:0/411210967 learned_addr learned my addr 172.21.15.53:0/411210967 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fccfb7fe640 1 --2- 172.21.15.53:0/411210967 >> v2:172.21.15.87:3300/0 conn(0x7fccfc157020 0x7fccfc06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd00c3e640 1 -- 172.21.15.53:0/411210967 >> v2:172.21.15.87:3300/0 conn(0x7fccfc157020 msgr2=0x7fccfc06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd00c3e640 1 --2- 172.21.15.53:0/411210967 >> v2:172.21.15.87:3300/0 conn(0x7fccfc157020 0x7fccfc06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd00c3e640 1 -- 172.21.15.53:0/411210967 >> v1:172.21.15.87:6789/0 conn(0x7fccfc156c40 legacy=0x7fccfc070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.936+0000 7fcd00c3e640 1 -- 172.21.15.53:0/411210967 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0b1880 con 0x7fccfc06d270 2024-09-13T18:33:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 --2- 172.21.15.53:0/411210967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc06d270 0x7fccfc06f330 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0cae90 tx=0x7fccf401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdb502151681680 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fccfaffd640 1 -- 172.21.15.53:0/411210967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40a5880 con 0x7fccfc06d270 2024-09-13T18:33:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fccfaffd640 1 -- 172.21.15.53:0/411210967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf40a59e0 con 0x7fccfc06d270 2024-09-13T18:33:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fccfaffd640 1 -- 172.21.15.53:0/411210967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40a5d70 con 0x7fccfc06d270 2024-09-13T18:33:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- 172.21.15.53:0/411210967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc06d270 msgr2=0x7fccfc06f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 --2- 172.21.15.53:0/411210967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc06d270 0x7fccfc06f330 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0cae90 tx=0x7fccf401c9c0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- 172.21.15.53:0/411210967 shutdown_connections 2024-09-13T18:33:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 --2- 172.21.15.53:0/411210967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc06d270 0x7fccfc06f330 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 --2- 172.21.15.53:0/411210967 >> v2:172.21.15.87:3300/0 conn(0x7fccfc157020 0x7fccfc06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- 172.21.15.53:0/411210967 >> 172.21.15.53:0/411210967 conn(0x7fccfc065c80 msgr2=0x7fccfc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- 172.21.15.53:0/411210967 shutdown_connections 2024-09-13T18:33:43.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- 172.21.15.53:0/411210967 wait complete. 2024-09-13T18:33:43.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 Processor -- start 2024-09-13T18:33:43.943 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- start start 2024-09-13T18:33:43.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccfc06d270 0x7fccfc142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccfc156c40 0x7fccfc143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc1f70b0 0x7fccfc1f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0af240 con 0x7fccfc1f70b0 2024-09-13T18:33:43.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0ae950 con 0x7fccfc06d270 2024-09-13T18:33:43.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd026a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc13f2f0 con 0x7fccfc156c40 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc1f70b0 0x7fccfc1f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc1f70b0 0x7fccfc1f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50054/0 (socket says 172.21.15.53:50054) 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 -- 172.21.15.53:0/3056804168 learned_addr learned my addr 172.21.15.53:0/3056804168 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fccfbfff640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccfc06d270 0x7fccfc142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fccfb7fe640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccfc156c40 0x7fccfc143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 -- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccfc156c40 msgr2=0x7fccfc143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccfc156c40 0x7fccfc143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 -- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccfc06d270 msgr2=0x7fccfc142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccfc06d270 0x7fccfc142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.940+0000 7fcd00c3e640 1 -- 172.21.15.53:0/3056804168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4009b30 con 0x7fccfc1f70b0 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fcd00c3e640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc1f70b0 0x7fccfc1f7560 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fccf40af040 tx=0x7fccf4019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccf8ff9640 1 -- 172.21.15.53:0/3056804168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40b8670 con 0x7fccfc1f70b0 2024-09-13T18:33:43.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccf8ff9640 1 -- 172.21.15.53:0/3056804168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf40b87f0 con 0x7fccfc1f70b0 2024-09-13T18:33:43.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc0aebf0 con 0x7fccfc1f70b0 2024-09-13T18:33:43.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccf8ff9640 1 -- 172.21.15.53:0/3056804168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40b8ba0 con 0x7fccfc1f70b0 2024-09-13T18:33:43.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc143430 con 0x7fccfc1f70b0 2024-09-13T18:33:43.947 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc06f330 con 0x7fccfc1f70b0 2024-09-13T18:33:43.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccf8ff9640 1 -- 172.21.15.53:0/3056804168 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fccf40b8d00 con 0x7fccfc1f70b0 2024-09-13T18:33:43.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccf8ff9640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcce8066e70 0x7fcce8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:43.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccf8ff9640 1 -- 172.21.15.53:0/3056804168 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccf411e040 con 0x7fccfc1f70b0 2024-09-13T18:33:43.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccfbfff640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcce8066e70 0x7fcce8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:43.948 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.944+0000 7fccfbfff640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcce8066e70 0x7fcce8069330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fccec007fd0 tx=0x7fccec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:43.951 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:43.948+0000 7fccf8ff9640 1 -- 172.21.15.53:0/3056804168 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fccf40ed050 con 0x7fccfc1f70b0 2024-09-13T18:33:44.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.112+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccfc0aff70 con 0x7fccfc1f70b0 2024-09-13T18:33:44.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.112+0000 7fccf8ff9640 1 -- 172.21.15.53:0/3056804168 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccf40f0670 con 0x7fccfc1f70b0 2024-09-13T18:33:44.116 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcce8066e70 msgr2=0x7fcce8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcce8066e70 0x7fcce8069330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fccec007fd0 tx=0x7fccec009040 comp rx=0 tx=0).stop 2024-09-13T18:33:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc1f70b0 msgr2=0x7fccfc1f7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc1f70b0 0x7fccfc1f7560 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fccf40af040 tx=0x7fccf4019760 comp rx=0 tx=0).stop 2024-09-13T18:33:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 shutdown_connections 2024-09-13T18:33:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcce8066e70 0x7fcce8069330 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fccfc156c40 0x7fccfc143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccfc1f70b0 0x7fccfc1f7560 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 --2- 172.21.15.53:0/3056804168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccfc06d270 0x7fccfc142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 >> 172.21.15.53:0/3056804168 conn(0x7fccfc065c80 msgr2=0x7fccfc148340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 shutdown_connections 2024-09-13T18:33:44.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.116+0000 7fcd026a1640 1 -- 172.21.15.53:0/3056804168 wait complete. 2024-09-13T18:33:44.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:33:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f302236c640 1 Processor -- start 2024-09-13T18:33:44.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f302236c640 1 -- start start 2024-09-13T18:33:44.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f302236c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f301c066390 0x7f301c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f302236c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f301c0cf1f0 0x7f301c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f302236c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301c06d080 con 0x7f301c15a4a0 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f302236c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301c0ccd20 con 0x7f301c066390 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f302236c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301c06d2b0 con 0x7f301c0cf1f0 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f301c15a4a0 0x7f301c065c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50648/0 (socket says 172.21.15.53:50648) 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301bfff640 1 -- 172.21.15.53:0/4263509623 learned_addr learned my addr 172.21.15.53:0/4263509623 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301b7fe640 1 --2- 172.21.15.53:0/4263509623 >> v2:172.21.15.53:3300/0 conn(0x7f301c066390 0x7f301c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301affd640 1 -- 172.21.15.53:0/4263509623 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966981447 0 0) 0x7f301c06d080 con 0x7f301c15a4a0 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301affd640 1 -- 172.21.15.53:0/4263509623 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3008003530 con 0x7f301c15a4a0 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f3020909640 1 --2- 172.21.15.53:0/4263509623 >> v2:172.21.15.87:3300/0 conn(0x7f301c0cf1f0 0x7f301c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301b7fe640 1 -- 172.21.15.53:0/4263509623 >> v2:172.21.15.87:3300/0 conn(0x7f301c0cf1f0 msgr2=0x7f301c15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:44.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301b7fe640 1 --2- 172.21.15.53:0/4263509623 >> v2:172.21.15.87:3300/0 conn(0x7f301c0cf1f0 0x7f301c15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301b7fe640 1 -- 172.21.15.53:0/4263509623 >> v1:172.21.15.53:6789/0 conn(0x7f301c15a4a0 legacy=0x7f301c065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.248+0000 7f301b7fe640 1 -- 172.21.15.53:0/4263509623 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c06d590 con 0x7f301c066390 2024-09-13T18:33:44.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f301b7fe640 1 --2- 172.21.15.53:0/4263509623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c066390 0x7f301c06cb40 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f301c0cdc60 tx=0x7f300401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4dcb131d6b3104 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f301affd640 1 -- 172.21.15.53:0/4263509623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30040ac620 con 0x7f301c066390 2024-09-13T18:33:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f301affd640 1 -- 172.21.15.53:0/4263509623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30040ac780 con 0x7f301c066390 2024-09-13T18:33:44.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f301affd640 1 -- 172.21.15.53:0/4263509623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30040acaf0 con 0x7f301c066390 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- 172.21.15.53:0/4263509623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c066390 msgr2=0x7f301c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 --2- 172.21.15.53:0/4263509623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c066390 0x7f301c06cb40 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f301c0cdc60 tx=0x7f300401c3c0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- 172.21.15.53:0/4263509623 shutdown_connections 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 --2- 172.21.15.53:0/4263509623 >> v2:172.21.15.87:3300/0 conn(0x7f301c0cf1f0 0x7f301c15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 --2- 172.21.15.53:0/4263509623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c066390 0x7f301c06cb40 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- 172.21.15.53:0/4263509623 >> 172.21.15.53:0/4263509623 conn(0x7f301c069f50 msgr2=0x7f301c06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- 172.21.15.53:0/4263509623 shutdown_connections 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- 172.21.15.53:0/4263509623 wait complete. 2024-09-13T18:33:44.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 Processor -- start 2024-09-13T18:33:44.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- start start 2024-09-13T18:33:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f301c066390 0x7f301c0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c0cf1f0 0x7f301c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f301c15a4a0 0x7f301c1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c148120 con 0x7f301c0cf1f0 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c155ab0 con 0x7f301c066390 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.252+0000 7f302236c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301c150a30 con 0x7f301c15a4a0 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c0cf1f0 0x7f301c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c0cf1f0 0x7f301c155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50072/0 (socket says 172.21.15.53:50072) 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 -- 172.21.15.53:0/170300594 learned_addr learned my addr 172.21.15.53:0/170300594 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f3020909640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f301c15a4a0 0x7f301c1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 -- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f301c15a4a0 msgr2=0x7f301c1504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f301c15a4a0 0x7f301c1504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301bfff640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f301c066390 0x7f301c0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 -- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f301c066390 msgr2=0x7f301c0b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f301c066390 0x7f301c0b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 -- 172.21.15.53:0/170300594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004009420 con 0x7f301c0cf1f0 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301bfff640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f301c066390 0x7f301c0b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301b7fe640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c0cf1f0 0x7f301c155570 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3004000c10 tx=0x7f3004019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f3018ff9640 1 -- 172.21.15.53:0/170300594 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30040ac8f0 con 0x7f301c0cf1f0 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f3018ff9640 1 -- 172.21.15.53:0/170300594 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30040aca50 con 0x7f301c0cf1f0 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301c0b0a10 con 0x7f301c0cf1f0 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f3018ff9640 1 -- 172.21.15.53:0/170300594 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30040acdc0 con 0x7f301c0cf1f0 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301c14ec60 con 0x7f301c0cf1f0 2024-09-13T18:33:44.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301c15b990 con 0x7f301c0cf1f0 2024-09-13T18:33:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f3018ff9640 1 -- 172.21.15.53:0/170300594 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f30040b3040 con 0x7f301c0cf1f0 2024-09-13T18:33:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f3018ff9640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ffc066ea0 0x7f2ffc069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301bfff640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ffc066ea0 0x7f2ffc069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f3018ff9640 1 -- 172.21.15.53:0/170300594 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f300411c810 con 0x7f301c0cf1f0 2024-09-13T18:33:44.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.256+0000 7f301bfff640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ffc066ea0 0x7f2ffc069360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f300c005c10 tx=0x7f300c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.260+0000 7f3018ff9640 1 -- 172.21.15.53:0/170300594 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f30040eb780 con 0x7f301c0cf1f0 2024-09-13T18:33:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.412+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f301c154f00 con 0x7f301c0cf1f0 2024-09-13T18:33:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f3018ff9640 1 -- 172.21.15.53:0/170300594 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v150) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30040eeda0 con 0x7f301c0cf1f0 2024-09-13T18:33:44.417 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ffc066ea0 msgr2=0x7f2ffc069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ffc066ea0 0x7f2ffc069360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f300c005c10 tx=0x7f300c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c0cf1f0 msgr2=0x7f301c155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c0cf1f0 0x7f301c155570 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3004000c10 tx=0x7f3004019160 comp rx=0 tx=0).stop 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 shutdown_connections 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2ffc066ea0 0x7f2ffc069360 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f301c15a4a0 0x7f301c1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f301c0cf1f0 0x7f301c155570 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 --2- 172.21.15.53:0/170300594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f301c066390 0x7f301c0b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 >> 172.21.15.53:0/170300594 conn(0x7f301c069f50 msgr2=0x7f301c0cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 shutdown_connections 2024-09-13T18:33:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.416+0000 7f302236c640 1 -- 172.21.15.53:0/170300594 wait complete. 2024-09-13T18:33:44.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:33:44.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.548+0000 7f6f6b1ab640 1 Processor -- start 2024-09-13T18:33:44.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.548+0000 7f6f6b1ab640 1 -- start start 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f6b1ab640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f64156c40 0x7f6f64070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f6b1ab640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64157020 0x7f6f6406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f6b1ab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6f6406d270 0x7f6f6415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f6b1ab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6406d6e0 con 0x7f6f6406d270 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f6b1ab640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f640b15a0 con 0x7f6f64156c40 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f6b1ab640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640b1880 con 0x7f6f64157020 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6f6406d270 0x7f6f6415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6f6406d270 0x7f6f6415cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50074/0 (socket says 172.21.15.53:50074) 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 -- 172.21.15.53:0/541166615 learned_addr learned my addr 172.21.15.53:0/541166615 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f68f47640 1 --2- 172.21.15.53:0/541166615 >> v2:172.21.15.87:3300/0 conn(0x7f6f64156c40 0x7f6f64070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f63fff640 1 --2- 172.21.15.53:0/541166615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64157020 0x7f6f6406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 -- 172.21.15.53:0/541166615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64157020 msgr2=0x7f6f6406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:44.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 --2- 172.21.15.53:0/541166615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64157020 0x7f6f6406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 -- 172.21.15.53:0/541166615 >> v2:172.21.15.87:3300/0 conn(0x7f6f64156c40 msgr2=0x7f6f64070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:44.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 --2- 172.21.15.53:0/541166615 >> v2:172.21.15.87:3300/0 conn(0x7f6f64156c40 0x7f6f64070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 -- 172.21.15.53:0/541166615 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640b1b60 con 0x7f6f6406d270 2024-09-13T18:33:44.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f68f47640 1 --2- 172.21.15.53:0/541166615 >> v2:172.21.15.87:3300/0 conn(0x7f6f64156c40 0x7f6f64070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:44.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f69748640 1 --2- 172.21.15.53:0/541166615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f6415cde0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f6f64067650 tx=0x7f6f5c01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e0e11c4633b45e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f637fe640 1 -- 172.21.15.53:0/541166615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0a5580 con 0x7f6f6406d270 2024-09-13T18:33:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f637fe640 1 -- 172.21.15.53:0/541166615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0a56e0 con 0x7f6f6406d270 2024-09-13T18:33:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.552+0000 7f6f637fe640 1 -- 172.21.15.53:0/541166615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0a5a70 con 0x7f6f6406d270 2024-09-13T18:33:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/541166615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 msgr2=0x7f6f6415cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/541166615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f6415cde0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f6f64067650 tx=0x7f6f5c01c700 comp rx=0 tx=0).stop 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/541166615 shutdown_connections 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/541166615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64157020 0x7f6f6406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/541166615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f6415cde0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/541166615 >> v2:172.21.15.87:3300/0 conn(0x7f6f64156c40 0x7f6f64070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/541166615 >> 172.21.15.53:0/541166615 conn(0x7f6f64065c80 msgr2=0x7f6f64066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/541166615 shutdown_connections 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/541166615 wait complete. 2024-09-13T18:33:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 Processor -- start 2024-09-13T18:33:44.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- start start 2024-09-13T18:33:44.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f64149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f64156c40 0x7f6f64158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64149a10 0x7f6f64155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f64157410 con 0x7f6f6406d270 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641576f0 con 0x7f6f64156c40 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641579d0 con 0x7f6f64149a10 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f64149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f64149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50088/0 (socket says 172.21.15.53:50088) 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 -- 172.21.15.53:0/4283163982 learned_addr learned my addr 172.21.15.53:0/4283163982 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f63fff640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f64156c40 0x7f6f64158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f69748640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64149a10 0x7f6f64155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 -- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64149a10 msgr2=0x7f6f64155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64149a10 0x7f6f64155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 -- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f64156c40 msgr2=0x7f6f64158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f64156c40 0x7f6f64158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 -- 172.21.15.53:0/4283163982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c009b30 con 0x7f6f6406d270 2024-09-13T18:33:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f68f47640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f64149470 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800e810 tx=0x7f6f5800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f617fa640 1 -- 172.21.15.53:0/4283163982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800c8d0 con 0x7f6f6406d270 2024-09-13T18:33:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f617fa640 1 -- 172.21.15.53:0/4283163982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5800ca30 con 0x7f6f6406d270 2024-09-13T18:33:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f64157cb0 con 0x7f6f6406d270 2024-09-13T18:33:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f617fa640 1 -- 172.21.15.53:0/4283163982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800cde0 con 0x7f6f6406d270 2024-09-13T18:33:44.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.556+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f64158270 con 0x7f6f6406d270 2024-09-13T18:33:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.560+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f64070ee0 con 0x7f6f6406d270 2024-09-13T18:33:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.560+0000 7f6f617fa640 1 -- 172.21.15.53:0/4283163982 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f6f58013410 con 0x7f6f6406d270 2024-09-13T18:33:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.560+0000 7f6f617fa640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f48066ea0 0x7f6f48069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.560+0000 7f6f617fa640 1 -- 172.21.15.53:0/4283163982 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f580825e0 con 0x7f6f6406d270 2024-09-13T18:33:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.560+0000 7f6f63fff640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f48066ea0 0x7f6f48069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.560+0000 7f6f63fff640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f48066ea0 0x7f6f48069360 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f641489f0 tx=0x7f6f50008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.564+0000 7f6f617fa640 1 -- 172.21.15.53:0/4283163982 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f58051550 con 0x7f6f6406d270 2024-09-13T18:33:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f6414adc0 con 0x7f6f6406d270 2024-09-13T18:33:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f617fa640 1 -- 172.21.15.53:0/4283163982 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v150) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f58054b70 con 0x7f6f6406d270 2024-09-13T18:33:44.726 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:33:44.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f48066ea0 msgr2=0x7f6f48069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f48066ea0 0x7f6f48069360 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f641489f0 tx=0x7f6f50008040 comp rx=0 tx=0).stop 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 msgr2=0x7f6f64149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f64149470 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800e810 tx=0x7f6f5800ecd0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 shutdown_connections 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6f48066ea0 0x7f6f48069360 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6f64149a10 0x7f6f64155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f64156c40 0x7f6f64158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 --2- 172.21.15.53:0/4283163982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f6406d270 0x7f6f64149470 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 >> 172.21.15.53:0/4283163982 conn(0x7f6f64065c80 msgr2=0x7f6f640cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 shutdown_connections 2024-09-13T18:33:44.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.724+0000 7f6f6b1ab640 1 -- 172.21.15.53:0/4283163982 wait complete. 2024-09-13T18:33:44.744 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:44.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.852+0000 7fac4bfe0640 1 Processor -- start 2024-09-13T18:33:44.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.852+0000 7fac4bfe0640 1 -- start start 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac4415cab0 0x7fac440d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cd6c0 0x7fac440cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac440cdb00 0x7fac440cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440d2400 con 0x7fac440cdb00 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440d1530 con 0x7fac4415cab0 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440d0920 con 0x7fac440cd6c0 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac440cdb00 0x7fac440cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac440cdb00 0x7fac440cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50096/0 (socket says 172.21.15.53:50096) 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 -- 172.21.15.53:0/1232640760 learned_addr learned my addr 172.21.15.53:0/1232640760 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 -- 172.21.15.53:0/1232640760 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cd6c0 msgr2=0x7fac440cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 --2- 172.21.15.53:0/1232640760 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cd6c0 0x7fac440cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac49d7c640 1 --2- 172.21.15.53:0/1232640760 >> v2:172.21.15.87:3300/0 conn(0x7fac4415cab0 0x7fac440d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 -- 172.21.15.53:0/1232640760 >> v2:172.21.15.87:3300/0 conn(0x7fac4415cab0 msgr2=0x7fac440d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 --2- 172.21.15.53:0/1232640760 >> v2:172.21.15.87:3300/0 conn(0x7fac4415cab0 0x7fac440d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 -- 172.21.15.53:0/1232640760 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440d0c00 con 0x7fac440cdb00 2024-09-13T18:33:44.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac49d7c640 1 --2- 172.21.15.53:0/1232640760 >> v2:172.21.15.87:3300/0 conn(0x7fac4415cab0 0x7fac440d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:44.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4a57d640 1 --2- 172.21.15.53:0/1232640760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cdb00 0x7fac440cf600 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fac44066930 tx=0x7fac3c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1245ee4891264eda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac48d7a640 1 -- 172.21.15.53:0/1232640760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0a5840 con 0x7fac440cdb00 2024-09-13T18:33:44.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac48d7a640 1 -- 172.21.15.53:0/1232640760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c0a59a0 con 0x7fac440cdb00 2024-09-13T18:33:44.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac48d7a640 1 -- 172.21.15.53:0/1232640760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0a5d30 con 0x7fac440cdb00 2024-09-13T18:33:44.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- 172.21.15.53:0/1232640760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cdb00 msgr2=0x7fac440cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/1232640760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cdb00 0x7fac440cf600 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fac44066930 tx=0x7fac3c01c9c0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- 172.21.15.53:0/1232640760 shutdown_connections 2024-09-13T18:33:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/1232640760 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cd6c0 0x7fac440cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/1232640760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cdb00 0x7fac440cf600 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/1232640760 >> v2:172.21.15.87:3300/0 conn(0x7fac4415cab0 0x7fac440d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- 172.21.15.53:0/1232640760 >> 172.21.15.53:0/1232640760 conn(0x7fac44065c80 msgr2=0x7fac44066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- 172.21.15.53:0/1232640760 shutdown_connections 2024-09-13T18:33:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.856+0000 7fac4bfe0640 1 -- 172.21.15.53:0/1232640760 wait complete. 2024-09-13T18:33:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 Processor -- start 2024-09-13T18:33:44.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 -- start start 2024-09-13T18:33:44.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cd6c0 0x7fac4414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cdb00 0x7fac440c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4415cab0 0x7fac440c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac441544c0 con 0x7fac440cd6c0 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac44150ee0 con 0x7fac4415cab0 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac441511c0 con 0x7fac440cdb00 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cd6c0 0x7fac4414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cd6c0 0x7fac4414fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50104/0 (socket says 172.21.15.53:50104) 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 -- 172.21.15.53:0/165138686 learned_addr learned my addr 172.21.15.53:0/165138686 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4a57d640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4415cab0 0x7fac440c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4957b640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cdb00 0x7fac440c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 -- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cdb00 msgr2=0x7fac440c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cdb00 0x7fac440c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 -- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4415cab0 msgr2=0x7fac440c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4415cab0 0x7fac440c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 -- 172.21.15.53:0/165138686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c009b30 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4957b640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cdb00 0x7fac440c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac49d7c640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cd6c0 0x7fac4414fc30 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c7f0 tx=0x7fac4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac3a7fc640 1 -- 172.21.15.53:0/165138686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40007820 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac3a7fc640 1 -- 172.21.15.53:0/165138686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40007980 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac441514a0 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac3a7fc640 1 -- 172.21.15.53:0/165138686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40007d30 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac44150170 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac440d19a0 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac3a7fc640 1 -- 172.21.15.53:0/165138686 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fac400113f0 con 0x7fac440cd6c0 2024-09-13T18:33:44.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.860+0000 7fac3a7fc640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac28066e70 0x7fac28069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:44.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.864+0000 7fac3a7fc640 1 -- 172.21.15.53:0/165138686 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac400829c0 con 0x7fac440cd6c0 2024-09-13T18:33:44.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.864+0000 7fac4957b640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac28066e70 0x7fac28069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:44.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.864+0000 7fac4957b640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac28066e70 0x7fac28069330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fac4415ad70 tx=0x7fac34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:44.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:44.868+0000 7fac3a7fc640 1 -- 172.21.15.53:0/165138686 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac40051930 con 0x7fac440cd6c0 2024-09-13T18:33:45.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.056+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac440ce910 con 0x7fac440cd6c0 2024-09-13T18:33:45.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.056+0000 7fac3a7fc640 1 -- 172.21.15.53:0/165138686 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4735 (secure 0 0 0) 0x7fac40054f50 con 0x7fac440cd6c0 2024-09-13T18:33:45.062 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:45.062 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/234820268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":234820268},{"type":"v1","addr":"172.21.15.87:6835","nonce":234820268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2552754296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2552754296},{"type":"v1","addr":"172.21.15.87:6833","nonce":2552754296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1877336010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1877336010},{"type":"v1","addr":"172.21.15.53:6833","nonce":1877336010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:17.507989+0000","modified":"2024-09-13T18:33:20.527909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9555},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9555":{"gid":9555,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1614413719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1614413719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1614413719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:33:45.063 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2024-09-13T18:33:45.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac28066e70 msgr2=0x7fac28069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac28066e70 0x7fac28069330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fac4415ad70 tx=0x7fac34008040 comp rx=0 tx=0).stop 2024-09-13T18:33:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cd6c0 msgr2=0x7fac4414fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cd6c0 0x7fac4414fc30 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c7f0 tx=0x7fac4000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 shutdown_connections 2024-09-13T18:33:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac28066e70 0x7fac28069330 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac440cdb00 0x7fac440c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4415cab0 0x7fac440c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 --2- 172.21.15.53:0/165138686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac440cd6c0 0x7fac4414fc30 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 >> 172.21.15.53:0/165138686 conn(0x7fac44065c80 msgr2=0x7fac440cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 shutdown_connections 2024-09-13T18:33:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.060+0000 7fac4bfe0640 1 -- 172.21.15.53:0/165138686 wait complete. 2024-09-13T18:33:45.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:45.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f00990f4640 1 Processor -- start 2024-09-13T18:33:45.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f00990f4640 1 -- start start 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f00990f4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 0x7f0094158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f00990f4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940b2860 con 0x7f00940b1e00 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f00990f4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009406b7d0 con 0x7f009406b390 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f00990f4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00940cb540 con 0x7f00940cbb60 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f009359e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f00940b1e00 0x7f009406f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50662/0 (socket says 172.21.15.53:50662) 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f009359e640 1 -- 172.21.15.53:0/3771932922 learned_addr learned my addr 172.21.15.53:0/3771932922 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0092d9d640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 0x7f0094158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557925079 0 0) 0x7f00940b2860 con 0x7f00940b1e00 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0080003530 con 0x7f00940b1e00 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2016217821 0 0) 0x7f0080003530 con 0x7f00940b1e00 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 msgr2=0x7f0094158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 0x7f0094158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 >> v1:172.21.15.87:6789/0 conn(0x7f009406b390 legacy=0x7f00940cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940b2580 con 0x7f00940b1e00 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.188+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f008c001680 con 0x7f00940b1e00 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 >> v1:172.21.15.53:6789/0 conn(0x7f00940b1e00 legacy=0x7f009406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 0x7f00800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0080003f30 0x7f00800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0080004d10 0x7f0080005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00940cb540 con 0x7f0080004d10 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008000bb20 con 0x7f0080003f30 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008000def0 con 0x7f00940cbb60 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0080004d10 0x7f0080005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0092d9d640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 0x7f00800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009259c640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0080003f30 0x7f00800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 -- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 msgr2=0x7f00800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:45.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00940cbb60 0x7f00800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 -- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0080003f30 msgr2=0x7f00800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0080003f30 0x7f00800047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 -- 172.21.15.53:0/3771932922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080003530 con 0x7f0080004d10 2024-09-13T18:33:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0080004d10 0x7f0080005190 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c1c0 tx=0x7f008c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3550812d9ead52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c005ae0 con 0x7f0080004d10 2024-09-13T18:33:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c0ab070 con 0x7f0080004d10 2024-09-13T18:33:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f0091d9b640 1 -- 172.21.15.53:0/3771932922 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c005ea0 con 0x7f0080004d10 2024-09-13T18:33:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f00990f4640 1 -- 172.21.15.53:0/3771932922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0080004d10 msgr2=0x7f0080005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f00990f4640 1 --2- 172.21.15.53:0/3771932922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0080004d10 0x7f0080005190 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c1c0 tx=0x7f008c01f3b0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f009359e640 1 -- 172.21.15.53:0/3771932922 reap_dead start 2024-09-13T18:33:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f00990f4640 1 -- 172.21.15.53:0/3771932922 shutdown_connections 2024-09-13T18:33:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f00990f4640 1 -- 172.21.15.53:0/3771932922 >> 172.21.15.53:0/3771932922 conn(0x7f0094065c80 msgr2=0x7f0094066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f00990f4640 1 -- 172.21.15.53:0/3771932922 shutdown_connections 2024-09-13T18:33:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.192+0000 7f00990f4640 1 -- 172.21.15.53:0/3771932922 wait complete. 2024-09-13T18:33:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 Processor -- start 2024-09-13T18:33:45.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 -- start start 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0094146cd0 0x7f0094151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00941f3490 0x7f009406f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f009406f8b0 0x7f0094152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941f3260 con 0x7f009406f8b0 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009406fd60 con 0x7f00941f3490 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00941f25e0 con 0x7f0094146cd0 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f009406f8b0 0x7f0094152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f009406f8b0 0x7f0094152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50124/0 (socket says 172.21.15.53:50124) 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 -- 172.21.15.53:0/3824712535 learned_addr learned my addr 172.21.15.53:0/3824712535 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009259c640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00941f3490 0x7f009406f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f0092d9d640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0094146cd0 0x7f0094151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 -- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0094146cd0 msgr2=0x7f0094151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0094146cd0 0x7f0094151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 -- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00941f3490 msgr2=0x7f009406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00941f3490 0x7f009406f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 -- 172.21.15.53:0/3824712535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00941f28c0 con 0x7f009406f8b0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f009359e640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f009406f8b0 0x7f0094152290 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f008c001940 tx=0x7f0080005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f008b7fe640 1 -- 172.21.15.53:0/3824712535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c0048b0 con 0x7f009406f8b0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f008b7fe640 1 -- 172.21.15.53:0/3824712535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c004a10 con 0x7f009406f8b0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00941f2ba0 con 0x7f009406f8b0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f008b7fe640 1 -- 172.21.15.53:0/3824712535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c004d80 con 0x7f009406f8b0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00941f22d0 con 0x7f009406f8b0 2024-09-13T18:33:45.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0094067400 con 0x7f009406f8b0 2024-09-13T18:33:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f008b7fe640 1 -- 172.21.15.53:0/3824712535 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f008c0b9030 con 0x7f009406f8b0 2024-09-13T18:33:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.196+0000 7f008b7fe640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0074066ea0 0x7f0074069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.200+0000 7f008b7fe640 1 -- 172.21.15.53:0/3824712535 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f008c0b7070 con 0x7f009406f8b0 2024-09-13T18:33:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.200+0000 7f0092d9d640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0074066ea0 0x7f0074069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.200+0000 7f0092d9d640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0074066ea0 0x7f0074069360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f00941f3440 tx=0x7f008400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.205 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.204+0000 7f008b7fe640 1 -- 172.21.15.53:0/3824712535 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f008c0ee1b0 con 0x7f009406f8b0 2024-09-13T18:33:45.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.360+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0094158ba0 con 0x7f009406f8b0 2024-09-13T18:33:45.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.360+0000 7f008b7fe640 1 -- 172.21.15.53:0/3824712535 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16511 (secure 0 0 0) 0x7f008c0c1070 con 0x7f009406f8b0 2024-09-13T18:33:45.365 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:45.365 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":150,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:18.511005+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0074066ea0 msgr2=0x7f0074069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0074066ea0 0x7f0074069360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f00941f3440 tx=0x7f008400b040 comp rx=0 tx=0).stop 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f009406f8b0 msgr2=0x7f0094152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f009406f8b0 0x7f0094152290 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f008c001940 tx=0x7f0080005800 comp rx=0 tx=0).stop 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 shutdown_connections 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0074066ea0 0x7f0074069360 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f009406f8b0 0x7f0094152290 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00941f3490 0x7f009406f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 --2- 172.21.15.53:0/3824712535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0094146cd0 0x7f0094151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 >> 172.21.15.53:0/3824712535 conn(0x7f0094065c80 msgr2=0x7f009415a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:45.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 shutdown_connections 2024-09-13T18:33:45.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.364+0000 7f00990f4640 1 -- 172.21.15.53:0/3824712535 wait complete. 2024-09-13T18:33:45.383 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:33:45.383 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.488+0000 7fbc607b6640 1 Processor -- start 2024-09-13T18:33:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.488+0000 7fbc607b6640 1 -- start start 2024-09-13T18:33:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.488+0000 7fbc607b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc580cf7d0 0x7fbc580b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.488+0000 7fbc607b6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc580d2400 con 0x7fbc580d19c0 2024-09-13T18:33:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.488+0000 7fbc607b6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc580d1530 con 0x7fbc5815cab0 2024-09-13T18:33:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.488+0000 7fbc607b6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc580cddd0 con 0x7fbc580cf7d0 2024-09-13T18:33:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5ed53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc580cf7d0 0x7fbc580b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5dd51640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbc580d19c0 0x7fbc580cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50678/0 (socket says 172.21.15.53:50678) 2024-09-13T18:33:45.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5dd51640 1 -- 172.21.15.53:0/2636729888 learned_addr learned my addr 172.21.15.53:0/2636729888 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:45.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5ed53640 1 -- 172.21.15.53:0/2636729888 >> v1:172.21.15.87:6789/0 conn(0x7fbc5815cab0 legacy=0x7fbc580cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5ed53640 1 -- 172.21.15.53:0/2636729888 >> v1:172.21.15.53:6789/0 conn(0x7fbc580d19c0 legacy=0x7fbc580cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5ed53640 1 -- 172.21.15.53:0/2636729888 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc580d1e30 con 0x7fbc580cf7d0 2024-09-13T18:33:45.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5ed53640 1 --2- 172.21.15.53:0/2636729888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc580b5870 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009d90 tx=0x7fbc5001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b376a82318594864 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5d550640 1 -- 172.21.15.53:0/2636729888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc500a5a00 con 0x7fbc580cf7d0 2024-09-13T18:33:45.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5d550640 1 -- 172.21.15.53:0/2636729888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc500a5b60 con 0x7fbc580cf7d0 2024-09-13T18:33:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc5d550640 1 -- 172.21.15.53:0/2636729888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc500ad440 con 0x7fbc580cf7d0 2024-09-13T18:33:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc607b6640 1 -- 172.21.15.53:0/2636729888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 msgr2=0x7fbc580b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc607b6640 1 --2- 172.21.15.53:0/2636729888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc580b5870 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009d90 tx=0x7fbc5001c940 comp rx=0 tx=0).stop 2024-09-13T18:33:45.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc607b6640 1 -- 172.21.15.53:0/2636729888 shutdown_connections 2024-09-13T18:33:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc607b6640 1 --2- 172.21.15.53:0/2636729888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc580b5870 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc607b6640 1 -- 172.21.15.53:0/2636729888 >> 172.21.15.53:0/2636729888 conn(0x7fbc58065c80 msgr2=0x7fbc58066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc607b6640 1 -- 172.21.15.53:0/2636729888 shutdown_connections 2024-09-13T18:33:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.492+0000 7fbc607b6640 1 -- 172.21.15.53:0/2636729888 wait complete. 2024-09-13T18:33:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 Processor -- start 2024-09-13T18:33:45.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 -- start start 2024-09-13T18:33:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc58156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc580d19c0 0x7fbc58156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc5815cab0 0x7fbc5814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58158120 con 0x7fbc580cf7d0 2024-09-13T18:33:45.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58157c90 con 0x7fbc580d19c0 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc581573f0 con 0x7fbc5815cab0 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc58156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc58156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50142/0 (socket says 172.21.15.53:50142) 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 -- 172.21.15.53:0/589004569 learned_addr learned my addr 172.21.15.53:0/589004569 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5dd51640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc580d19c0 0x7fbc58156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 -- 172.21.15.53:0/589004569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc5815cab0 msgr2=0x7fbc5814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc5815cab0 0x7fbc5814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 -- 172.21.15.53:0/589004569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc580d19c0 msgr2=0x7fbc58156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc580d19c0 0x7fbc58156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 -- 172.21.15.53:0/589004569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50009a70 con 0x7fbc580cf7d0 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc5e552640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc58156970 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c420 tx=0x7fbc5400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc4effd640 1 -- 172.21.15.53:0/589004569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540052d0 con 0x7fbc580cf7d0 2024-09-13T18:33:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc4effd640 1 -- 172.21.15.53:0/589004569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54005430 con 0x7fbc580cf7d0 2024-09-13T18:33:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc580b3800 con 0x7fbc580cf7d0 2024-09-13T18:33:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc4effd640 1 -- 172.21.15.53:0/589004569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54007260 con 0x7fbc580cf7d0 2024-09-13T18:33:45.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc58157920 con 0x7fbc580cf7d0 2024-09-13T18:33:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc580b5870 con 0x7fbc580cf7d0 2024-09-13T18:33:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.496+0000 7fbc4effd640 1 -- 172.21.15.53:0/589004569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fbc540073c0 con 0x7fbc580cf7d0 2024-09-13T18:33:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.500+0000 7fbc4effd640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc3c066ea0 0x7fbc3c069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.500+0000 7fbc4effd640 1 -- 172.21.15.53:0/589004569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc54081c50 con 0x7fbc580cf7d0 2024-09-13T18:33:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.500+0000 7fbc5dd51640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc3c066ea0 0x7fbc3c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.500+0000 7fbc5dd51640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc3c066ea0 0x7fbc3c069360 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbc580b3e40 tx=0x7fbc48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.504+0000 7fbc4effd640 1 -- 172.21.15.53:0/589004569 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc54050b40 con 0x7fbc580cf7d0 2024-09-13T18:33:45.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.696+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc580b8270 con 0x7fbc580cf7d0 2024-09-13T18:33:45.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.696+0000 7fbc4effd640 1 -- 172.21.15.53:0/589004569 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4735 (secure 0 0 0) 0x7fbc54054160 con 0x7fbc580cf7d0 2024-09-13T18:33:45.699 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:45.699 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/234820268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":234820268},{"type":"v1","addr":"172.21.15.87:6835","nonce":234820268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2552754296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2552754296},{"type":"v1","addr":"172.21.15.87:6833","nonce":2552754296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1877336010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1877336010},{"type":"v1","addr":"172.21.15.53:6833","nonce":1877336010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:17.507989+0000","modified":"2024-09-13T18:33:20.527909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9555},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9555":{"gid":9555,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1614413719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1614413719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1614413719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:33:45.699 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.696+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc3c066ea0 msgr2=0x7fbc3c069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.696+0000 7fbc607b6640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc3c066ea0 0x7fbc3c069360 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbc580b3e40 tx=0x7fbc48009040 comp rx=0 tx=0).stop 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 msgr2=0x7fbc58156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc58156970 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c420 tx=0x7fbc5400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 shutdown_connections 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbc3c066ea0 0x7fbc3c069360 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbc5815cab0 0x7fbc5814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbc580d19c0 0x7fbc58156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 --2- 172.21.15.53:0/589004569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc580cf7d0 0x7fbc58156970 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 >> 172.21.15.53:0/589004569 conn(0x7fbc58065c80 msgr2=0x7fbc5815cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:45.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 shutdown_connections 2024-09-13T18:33:45.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.700+0000 7fbc607b6640 1 -- 172.21.15.53:0/589004569 wait complete. 2024-09-13T18:33:45.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:45.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.832+0000 7efe463ee640 1 Processor -- start 2024-09-13T18:33:45.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.832+0000 7efe463ee640 1 -- start start 2024-09-13T18:33:45.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe4006b850 0x7efe400b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe400b1ac0 con 0x7efe400cb980 2024-09-13T18:33:45.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe40159ac0 con 0x7efe400cbd60 2024-09-13T18:33:45.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe40159da0 con 0x7efe4006b850 2024-09-13T18:33:45.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe4006b850 0x7efe400b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe4006b850 0x7efe400b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50146/0 (socket says 172.21.15.53:50146) 2024-09-13T18:33:45.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3f7fe640 1 -- 172.21.15.53:0/1491615868 learned_addr learned my addr 172.21.15.53:0/1491615868 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:45.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3ffff640 1 --1- 172.21.15.53:0/1491615868 >> v1:172.21.15.53:6789/0 conn(0x7efe400cb980 0x7efe4006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50682/0 (socket says 172.21.15.53:50682) 2024-09-13T18:33:45.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3f7fe640 1 -- 172.21.15.53:0/1491615868 >> v1:172.21.15.87:6789/0 conn(0x7efe400cbd60 legacy=0x7efe400b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:45.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3f7fe640 1 -- 172.21.15.53:0/1491615868 >> v1:172.21.15.53:6789/0 conn(0x7efe400cb980 legacy=0x7efe4006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3f7fe640 1 -- 172.21.15.53:0/1491615868 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4015a080 con 0x7efe4006b850 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3f7fe640 1 --2- 172.21.15.53:0/1491615868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe4006b850 0x7efe400b33b0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7efe3400bb10 tx=0x7efe3401eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554ec4cdf77baba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3effd640 1 -- 172.21.15.53:0/1491615868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340a7b70 con 0x7efe4006b850 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3effd640 1 -- 172.21.15.53:0/1491615868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe340a7cd0 con 0x7efe4006b850 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe3effd640 1 -- 172.21.15.53:0/1491615868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe340af660 con 0x7efe4006b850 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- 172.21.15.53:0/1491615868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe4006b850 msgr2=0x7efe400b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 --2- 172.21.15.53:0/1491615868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe4006b850 0x7efe400b33b0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7efe3400bb10 tx=0x7efe3401eaa0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- 172.21.15.53:0/1491615868 shutdown_connections 2024-09-13T18:33:45.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 --2- 172.21.15.53:0/1491615868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe4006b850 0x7efe400b33b0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- 172.21.15.53:0/1491615868 >> 172.21.15.53:0/1491615868 conn(0x7efe40065c80 msgr2=0x7efe40066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- 172.21.15.53:0/1491615868 shutdown_connections 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.836+0000 7efe463ee640 1 -- 172.21.15.53:0/1491615868 wait complete. 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 Processor -- start 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 -- start start 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe4006b850 0x7efe4014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe400cb980 0x7efe400ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe400cbd60 0x7efe400ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400ad830 con 0x7efe400cbd60 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400aff00 con 0x7efe400cb980 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe401502f0 con 0x7efe4006b850 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe400cbd60 0x7efe400ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe400cbd60 0x7efe400ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50156/0 (socket says 172.21.15.53:50156) 2024-09-13T18:33:45.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 -- 172.21.15.53:0/1243503489 learned_addr learned my addr 172.21.15.53:0/1243503489 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe3f7fe640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe400cb980 0x7efe400ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe3ffff640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe4006b850 0x7efe4014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 -- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe4006b850 msgr2=0x7efe4014fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe4006b850 0x7efe4014fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 -- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe400cb980 msgr2=0x7efe400ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe400cb980 0x7efe400ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 -- 172.21.15.53:0/1243503489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3400b770 con 0x7efe400cbd60 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe3ffff640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe4006b850 0x7efe4014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe3f7fe640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe400cb980 0x7efe400ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe4498b640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe400cbd60 0x7efe400ace20 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7efe3800c780 tx=0x7efe3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe3cff9640 1 -- 172.21.15.53:0/1243503489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38004b70 con 0x7efe400cbd60 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe3cff9640 1 -- 172.21.15.53:0/1243503489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3800ce90 con 0x7efe400cbd60 2024-09-13T18:33:45.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe400af940 con 0x7efe400cbd60 2024-09-13T18:33:45.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe3cff9640 1 -- 172.21.15.53:0/1243503489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800a850 con 0x7efe400cbd60 2024-09-13T18:33:45.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe40154b20 con 0x7efe400cbd60 2024-09-13T18:33:45.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.840+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe40067400 con 0x7efe400cbd60 2024-09-13T18:33:45.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.844+0000 7efe3cff9640 1 -- 172.21.15.53:0/1243503489 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7efe38006b60 con 0x7efe400cbd60 2024-09-13T18:33:45.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.844+0000 7efe3cff9640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efe2c066e70 0x7efe2c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:45.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.844+0000 7efe3cff9640 1 -- 172.21.15.53:0/1243503489 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe380831a0 con 0x7efe400cbd60 2024-09-13T18:33:45.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.844+0000 7efe3ffff640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efe2c066e70 0x7efe2c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:45.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.844+0000 7efe3ffff640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efe2c066e70 0x7efe2c069330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efe30000f70 tx=0x7efe30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:45.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:45.848+0000 7efe3cff9640 1 -- 172.21.15.53:0/1243503489 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe38052110 con 0x7efe400cbd60 2024-09-13T18:33:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe400ce0d0 con 0x7efe400cbd60 2024-09-13T18:33:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe3cff9640 1 -- 172.21.15.53:0/1243503489 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4735 (secure 0 0 0) 0x7efe38055730 con 0x7efe400cbd60 2024-09-13T18:33:46.038 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:46.038 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/234820268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":234820268},{"type":"v1","addr":"172.21.15.87:6835","nonce":234820268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2552754296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2552754296},{"type":"v1","addr":"172.21.15.87:6833","nonce":2552754296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1877336010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1877336010},{"type":"v1","addr":"172.21.15.53:6833","nonce":1877336010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:17.507989+0000","modified":"2024-09-13T18:33:20.527909+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9555},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9555":{"gid":9555,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1614413719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1614413719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1614413719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:33:46.039 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efe2c066e70 msgr2=0x7efe2c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efe2c066e70 0x7efe2c069330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efe30000f70 tx=0x7efe30009040 comp rx=0 tx=0).stop 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe400cbd60 msgr2=0x7efe400ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe400cbd60 0x7efe400ace20 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7efe3800c780 tx=0x7efe3800cc40 comp rx=0 tx=0).stop 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 shutdown_connections 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efe2c066e70 0x7efe2c069330 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe400cbd60 0x7efe400ace20 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe400cb980 0x7efe400ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 --2- 172.21.15.53:0/1243503489 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe4006b850 0x7efe4014fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.036+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 >> 172.21.15.53:0/1243503489 conn(0x7efe40065c80 msgr2=0x7efe40066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.040+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 shutdown_connections 2024-09-13T18:33:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.040+0000 7efe463ee640 1 -- 172.21.15.53:0/1243503489 wait complete. 2024-09-13T18:33:46.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:46.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.176+0000 7fa486b23640 1 Processor -- start 2024-09-13T18:33:46.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.176+0000 7fa486b23640 1 -- start start 2024-09-13T18:33:46.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa486b23640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa4800cf800 0x7fa4800cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa486b23640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 0x7fa4801662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa486b23640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48015cc10 con 0x7fa48015c830 2024-09-13T18:33:46.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa486b23640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4800b50c0 con 0x7fa4800cf800 2024-09-13T18:33:46.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa486b23640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800b41d0 con 0x7fa4800b7b40 2024-09-13T18:33:46.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa48015c830 0x7fa4800cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50694/0 (socket says 172.21.15.53:50694) 2024-09-13T18:33:46.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 -- 172.21.15.53:0/2163357422 learned_addr learned my addr 172.21.15.53:0/2163357422 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:46.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47ffff640 1 --2- 172.21.15.53:0/2163357422 >> v2:172.21.15.87:3300/0 conn(0x7fa4800cf800 0x7fa4800cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4850c0640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 0x7fa4801662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122782409 0 0) 0x7fa470001120 con 0x7fa48015c830 2024-09-13T18:33:46.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa468003530 con 0x7fa48015c830 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3492207674 0 0) 0x7fa468003530 con 0x7fa48015c830 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 msgr2=0x7fa4801662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 0x7fa4801662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 >> v2:172.21.15.87:3300/0 conn(0x7fa4800cf800 msgr2=0x7fa4800cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/2163357422 >> v2:172.21.15.87:3300/0 conn(0x7fa4800cf800 0x7fa4800cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800b44b0 con 0x7fa48015c830 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa470001810 con 0x7fa48015c830 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 >> v1:172.21.15.53:6789/0 conn(0x7fa48015c830 legacy=0x7fa4800cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468003980 0x7fa468003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 0x7fa4680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468004d10 0x7fa468005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800b50c0 con 0x7fa468003980 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800b41d0 con 0x7fa468004d10 2024-09-13T18:33:46.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800b990 con 0x7fa4800b7b40 2024-09-13T18:33:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468003980 0x7fa468003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa47ffff640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 0x7fa4680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 -- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 msgr2=0x7fa4680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b7b40 0x7fa4680047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 -- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468004d10 msgr2=0x7fa468005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468004d10 0x7fa468005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.180+0000 7fa4848bf640 1 -- 172.21.15.53:0/2163357422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468003530 con 0x7fa468003980 2024-09-13T18:33:46.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4848bf640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468003980 0x7fa468003da0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c210 tx=0x7fa47001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b990dda4c638af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470005ae0 con 0x7fa468003980 2024-09-13T18:33:46.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700ab070 con 0x7fa468003980 2024-09-13T18:33:46.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa47f7fe640 1 -- 172.21.15.53:0/2163357422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470005e80 con 0x7fa468003980 2024-09-13T18:33:46.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- 172.21.15.53:0/2163357422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468003980 msgr2=0x7fa468003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 --2- 172.21.15.53:0/2163357422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa468003980 0x7fa468003da0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c210 tx=0x7fa47001f3b0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 -- 172.21.15.53:0/2163357422 reap_dead start 2024-09-13T18:33:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- 172.21.15.53:0/2163357422 shutdown_connections 2024-09-13T18:33:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- 172.21.15.53:0/2163357422 >> 172.21.15.53:0/2163357422 conn(0x7fa480070970 msgr2=0x7fa480070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- 172.21.15.53:0/2163357422 shutdown_connections 2024-09-13T18:33:46.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- 172.21.15.53:0/2163357422 wait complete. 2024-09-13T18:33:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 Processor -- start 2024-09-13T18:33:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- start start 2024-09-13T18:33:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 0x7fa4800b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b2a30 0x7fa480155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c7ca0 0x7fa480155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801f6300 con 0x7fa4800c7ca0 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801f56f0 con 0x7fa468003980 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa486b23640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801f59d0 con 0x7fa4800b2a30 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c7ca0 0x7fa480155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c7ca0 0x7fa480155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50176/0 (socket says 172.21.15.53:50176) 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 -- 172.21.15.53:0/3305506984 learned_addr learned my addr 172.21.15.53:0/3305506984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa47ffff640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b2a30 0x7fa480155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4848bf640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 0x7fa4800b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 -- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b2a30 msgr2=0x7fa480155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b2a30 0x7fa480155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 -- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 msgr2=0x7fa4800b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 0x7fa4800b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 -- 172.21.15.53:0/3305506984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4801f5cb0 con 0x7fa4800c7ca0 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa4850c0640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c7ca0 0x7fa480155f80 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fa4800b2180 tx=0x7fa47800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.184+0000 7fa47d7fa640 1 -- 172.21.15.53:0/3305506984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478010040 con 0x7fa4800c7ca0 2024-09-13T18:33:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa47d7fa640 1 -- 172.21.15.53:0/3305506984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47800bce0 con 0x7fa4800c7ca0 2024-09-13T18:33:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4801f5f90 con 0x7fa4800c7ca0 2024-09-13T18:33:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa47d7fa640 1 -- 172.21.15.53:0/3305506984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478014640 con 0x7fa4800c7ca0 2024-09-13T18:33:46.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4801f5310 con 0x7fa4800c7ca0 2024-09-13T18:33:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4800ca850 con 0x7fa4800c7ca0 2024-09-13T18:33:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa47d7fa640 1 -- 172.21.15.53:0/3305506984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fa4780147a0 con 0x7fa4800c7ca0 2024-09-13T18:33:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa47d7fa640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa46c066e70 0x7fa46c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa47d7fa640 1 -- 172.21.15.53:0/3305506984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4780830d0 con 0x7fa4800c7ca0 2024-09-13T18:33:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa4848bf640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa46c066e70 0x7fa46c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.188+0000 7fa4848bf640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa46c066e70 0x7fa46c069330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ae000 tx=0x7fa470001ba0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.192+0000 7fa47d7fa640 1 -- 172.21.15.53:0/3305506984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4800ca850 con 0x7fa4800c7ca0 2024-09-13T18:33:46.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.348+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4800ca850 con 0x7fa4800c7ca0 2024-09-13T18:33:46.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.348+0000 7fa47d7fa640 1 -- 172.21.15.53:0/3305506984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16511 (secure 0 0 0) 0x7fa4800ca850 con 0x7fa4800c7ca0 2024-09-13T18:33:46.351 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:46.351 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":150,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:18.511005+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:15.920553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:16.488705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.348+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa46c066e70 msgr2=0x7fa46c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.348+0000 7fa486b23640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa46c066e70 0x7fa46c069330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ae000 tx=0x7fa470001ba0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c7ca0 msgr2=0x7fa480155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c7ca0 0x7fa480155f80 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fa4800b2180 tx=0x7fa47800b480 comp rx=0 tx=0).stop 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 shutdown_connections 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa46c066e70 0x7fa46c069330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4800b2a30 0x7fa480155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4800c7ca0 0x7fa480155f80 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 --2- 172.21.15.53:0/3305506984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa468003980 0x7fa4800b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 >> 172.21.15.53:0/3305506984 conn(0x7fa480070970 msgr2=0x7fa48015eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 shutdown_connections 2024-09-13T18:33:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.352+0000 7fa486b23640 1 -- 172.21.15.53:0/3305506984 wait complete. 2024-09-13T18:33:46.369 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:33:46.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b4538640 1 Processor -- start 2024-09-13T18:33:46.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b4538640 1 -- start start 2024-09-13T18:33:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b4538640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7ac0cb980 0x7fc7ac0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b4538640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0cbd60 0x7fc7ac0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b4538640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac0b1ac0 con 0x7fc7ac06b850 2024-09-13T18:33:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b4538640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac0b3010 con 0x7fc7ac0cb980 2024-09-13T18:33:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b4538640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac159ac0 con 0x7fc7ac0cbd60 2024-09-13T18:33:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b22d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7ac0cb980 0x7fc7ac0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b22d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7ac0cb980 0x7fc7ac0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50182/0 (socket says 172.21.15.53:50182) 2024-09-13T18:33:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b22d4640 1 -- 172.21.15.53:0/4190808979 learned_addr learned my addr 172.21.15.53:0/4190808979 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b22d4640 1 -- 172.21.15.53:0/4190808979 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0cbd60 msgr2=0x7fc7ac0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b22d4640 1 --2- 172.21.15.53:0/4190808979 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0cbd60 0x7fc7ac0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b22d4640 1 -- 172.21.15.53:0/4190808979 >> v1:172.21.15.87:6789/0 conn(0x7fc7ac06b850 legacy=0x7fc7ac06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.484+0000 7fc7b22d4640 1 -- 172.21.15.53:0/4190808979 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac159da0 con 0x7fc7ac0cb980 2024-09-13T18:33:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b22d4640 1 --2- 172.21.15.53:0/4190808979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac0b33b0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0709a0 tx=0x7fc7a401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79459bf22cedf03d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b12d2640 1 -- 172.21.15.53:0/4190808979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40a57b0 con 0x7fc7ac0cb980 2024-09-13T18:33:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b12d2640 1 -- 172.21.15.53:0/4190808979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a40a5910 con 0x7fc7ac0cb980 2024-09-13T18:33:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b12d2640 1 -- 172.21.15.53:0/4190808979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40a5ca0 con 0x7fc7ac0cb980 2024-09-13T18:33:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- 172.21.15.53:0/4190808979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 msgr2=0x7fc7ac0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 --2- 172.21.15.53:0/4190808979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac0b33b0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0709a0 tx=0x7fc7a401c8f0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- 172.21.15.53:0/4190808979 shutdown_connections 2024-09-13T18:33:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 --2- 172.21.15.53:0/4190808979 >> v2:172.21.15.87:3300/0 conn(0x7fc7ac0cbd60 0x7fc7ac0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 --2- 172.21.15.53:0/4190808979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac0b33b0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- 172.21.15.53:0/4190808979 >> 172.21.15.53:0/4190808979 conn(0x7fc7ac065c80 msgr2=0x7fc7ac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:46.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- 172.21.15.53:0/4190808979 shutdown_connections 2024-09-13T18:33:46.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- 172.21.15.53:0/4190808979 wait complete. 2024-09-13T18:33:46.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 Processor -- start 2024-09-13T18:33:46.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- start start 2024-09-13T18:33:46.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac06b850 0x7fc7ac14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0cbd60 0x7fc7ac150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac153810 con 0x7fc7ac0cb980 2024-09-13T18:33:46.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac152ee0 con 0x7fc7ac06b850 2024-09-13T18:33:46.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b4538640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac153150 con 0x7fc7ac0cbd60 2024-09-13T18:33:46.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b1ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b1ad3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac14b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50198/0 (socket says 172.21.15.53:50198) 2024-09-13T18:33:46.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b1ad3640 1 -- 172.21.15.53:0/1745285622 learned_addr learned my addr 172.21.15.53:0/1745285622 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:46.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.488+0000 7fc7b22d4640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac06b850 0x7fc7ac14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b1ad3640 1 -- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0cbd60 msgr2=0x7fc7ac150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b2ad5640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0cbd60 0x7fc7ac150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b1ad3640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0cbd60 0x7fc7ac150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b1ad3640 1 -- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac06b850 msgr2=0x7fc7ac14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b1ad3640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac06b850 0x7fc7ac14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b1ad3640 1 -- 172.21.15.53:0/1745285622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009b30 con 0x7fc7ac0cb980 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b22d4640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac06b850 0x7fc7ac14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b2ad5640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0cbd60 0x7fc7ac150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b1ad3640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac14b640 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00b440 tx=0x7fc79c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7a2ffd640 1 -- 172.21.15.53:0/1745285622 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c011890 con 0x7fc7ac0cb980 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7a2ffd640 1 -- 172.21.15.53:0/1745285622 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c0119f0 con 0x7fc7ac0cb980 2024-09-13T18:33:46.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ac153430 con 0x7fc7ac0cb980 2024-09-13T18:33:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7a2ffd640 1 -- 172.21.15.53:0/1745285622 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c011da0 con 0x7fc7ac0cb980 2024-09-13T18:33:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac146130 con 0x7fc7ac0cb980 2024-09-13T18:33:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac067400 con 0x7fc7ac0cb980 2024-09-13T18:33:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7a2ffd640 1 -- 172.21.15.53:0/1745285622 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fc79c01a400 con 0x7fc7ac0cb980 2024-09-13T18:33:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7a2ffd640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc790066ea0 0x7fc790069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7a2ffd640 1 -- 172.21.15.53:0/1745285622 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc79c082860 con 0x7fc7ac0cb980 2024-09-13T18:33:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b22d4640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc790066ea0 0x7fc790069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.492+0000 7fc7b22d4640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc790066ea0 0x7fc790069360 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40ae000 tx=0x7fc7a40a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.496+0000 7fc7a2ffd640 1 -- 172.21.15.53:0/1745285622 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc79c0517d0 con 0x7fc7ac0cb980 2024-09-13T18:33:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.684+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7ac0b2c20 con 0x7fc7ac0cb980 2024-09-13T18:33:46.687 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:33:46.684+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:33:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.700+0000 7fc7a2ffd640 1 -- 172.21.15.53:0/1745285622 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc79c015020 con 0x7fc7ac0cb980 2024-09-13T18:33:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc790066ea0 msgr2=0x7fc790069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc790066ea0 0x7fc790069360 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40ae000 tx=0x7fc7a40a7070 comp rx=0 tx=0).stop 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 msgr2=0x7fc7ac14b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac14b640 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00b440 tx=0x7fc79c00b900 comp rx=0 tx=0).stop 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 shutdown_connections 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc790066ea0 0x7fc790069360 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc7ac0cbd60 0x7fc7ac150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7ac0cb980 0x7fc7ac14b640 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 --2- 172.21.15.53:0/1745285622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc7ac06b850 0x7fc7ac14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 >> 172.21.15.53:0/1745285622 conn(0x7fc7ac065c80 msgr2=0x7fc7ac0ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 shutdown_connections 2024-09-13T18:33:46.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.704+0000 7fc7b4538640 1 -- 172.21.15.53:0/1745285622 wait complete. 2024-09-13T18:33:46.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:33:46.739 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:33:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.836+0000 7f953e3be640 1 Processor -- start 2024-09-13T18:33:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.836+0000 7f953e3be640 1 -- start start 2024-09-13T18:33:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f953e3be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f953815c830 0x7f95380d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f953e3be640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ccd10 0x7f95380cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f953e3be640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95380b7db0 con 0x7f95380d2c80 2024-09-13T18:33:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f953e3be640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380d0650 con 0x7f953815c830 2024-09-13T18:33:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f953e3be640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95380d0c10 con 0x7f95380ccd10 2024-09-13T18:33:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f953c95b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f95380d2c80 0x7f95380b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34208/0 (socket says 172.21.15.53:34208) 2024-09-13T18:33:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f953c95b640 1 -- 172.21.15.53:0/4121086690 learned_addr learned my addr 172.21.15.53:0/4121086690 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f9537fff640 1 --2- 172.21.15.53:0/4121086690 >> v2:172.21.15.53:3300/0 conn(0x7f953815c830 0x7f95380d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f952f7fe640 1 --2- 172.21.15.53:0/4121086690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ccd10 0x7f95380cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f9537fff640 1 -- 172.21.15.53:0/4121086690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ccd10 msgr2=0x7f95380cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f9537fff640 1 --2- 172.21.15.53:0/4121086690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ccd10 0x7f95380cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f9537fff640 1 -- 172.21.15.53:0/4121086690 >> v1:172.21.15.53:6789/0 conn(0x7f95380d2c80 legacy=0x7f95380b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f9537fff640 1 -- 172.21.15.53:0/4121086690 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380cd7d0 con 0x7f953815c830 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f95377fe640 1 -- 172.21.15.53:0/4121086690 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315520250 0 0) 0x7f95380b7db0 con 0x7f95380d2c80 2024-09-13T18:33:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f952f7fe640 1 --2- 172.21.15.53:0/4121086690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ccd10 0x7f95380cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:46.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.840+0000 7f9537fff640 1 --2- 172.21.15.53:0/4121086690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f953815c830 0x7f95380d10a0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f95280097c0 tx=0x7f952801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560eec4c033c90d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f95377fe640 1 -- 172.21.15.53:0/4121086690 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280ab600 con 0x7f953815c830 2024-09-13T18:33:46.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f95377fe640 1 -- 172.21.15.53:0/4121086690 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95280a7050 con 0x7f953815c830 2024-09-13T18:33:46.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f95377fe640 1 -- 172.21.15.53:0/4121086690 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280ab980 con 0x7f953815c830 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- 172.21.15.53:0/4121086690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f953815c830 msgr2=0x7f95380d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 --2- 172.21.15.53:0/4121086690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f953815c830 0x7f95380d10a0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f95280097c0 tx=0x7f952801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- 172.21.15.53:0/4121086690 shutdown_connections 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 --2- 172.21.15.53:0/4121086690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380ccd10 0x7f95380cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 --2- 172.21.15.53:0/4121086690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f953815c830 0x7f95380d10a0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- 172.21.15.53:0/4121086690 >> 172.21.15.53:0/4121086690 conn(0x7f9538070970 msgr2=0x7f9538070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- 172.21.15.53:0/4121086690 shutdown_connections 2024-09-13T18:33:46.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- 172.21.15.53:0/4121086690 wait complete. 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 Processor -- start 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- start start 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95380ccd10 0x7f9538156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380d2c80 0x7f953815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953815c830 0x7f953815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953815d160 con 0x7f95380ccd10 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953815cdc0 con 0x7f953815c830 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95380cb920 con 0x7f95380d2c80 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95380ccd10 0x7f9538156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95380ccd10 0x7f9538156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52252/0 (socket says 172.21.15.53:52252) 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 -- 172.21.15.53:0/1984912811 learned_addr learned my addr 172.21.15.53:0/1984912811 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953c95b640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953815c830 0x7f953815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f952f7fe640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380d2c80 0x7f953815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 -- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380d2c80 msgr2=0x7f953815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380d2c80 0x7f953815a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 -- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953815c830 msgr2=0x7f953815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953815c830 0x7f953815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 -- 172.21.15.53:0/1984912811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009420 con 0x7f95380ccd10 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f952f7fe640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380d2c80 0x7f953815a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953c95b640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953815c830 0x7f953815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f9537fff640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95380ccd10 0x7f9538156210 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f952801a0d0 tx=0x7f952801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f95357fa640 1 -- 172.21.15.53:0/1984912811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528004230 con 0x7f95380ccd10 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f95357fa640 1 -- 172.21.15.53:0/1984912811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9528004390 con 0x7f95380ccd10 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f95357fa640 1 -- 172.21.15.53:0/1984912811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528003820 con 0x7f95380ccd10 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95380cbc00 con 0x7f95380ccd10 2024-09-13T18:33:46.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.844+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380cb500 con 0x7f95380ccd10 2024-09-13T18:33:46.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.848+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953815d2a0 con 0x7f95380ccd10 2024-09-13T18:33:46.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.848+0000 7f95357fa640 1 -- 172.21.15.53:0/1984912811 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f9528003980 con 0x7f95380ccd10 2024-09-13T18:33:46.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.848+0000 7f95357fa640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9518066e70 0x7f9518069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:46.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.848+0000 7f95357fa640 1 -- 172.21.15.53:0/1984912811 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f952811d170 con 0x7f95380ccd10 2024-09-13T18:33:46.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.848+0000 7f952f7fe640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9518066e70 0x7f9518069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:46.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.848+0000 7f952f7fe640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9518066e70 0x7f9518069330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9538152fe0 tx=0x7f9520008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:46.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:46.852+0000 7f95357fa640 1 -- 172.21.15.53:0/1984912811 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95280ec200 con 0x7f95380ccd10 2024-09-13T18:33:47.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.040+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f95380d10a0 con 0x7f95380ccd10 2024-09-13T18:33:47.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.700+0000 7f95357fa640 1 -- 172.21.15.53:0/1984912811 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) v1 ==== 104+0+0 (secure 0 0 0) 0x7f95280ba0a0 con 0x7f95380ccd10 2024-09-13T18:33:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9518066e70 msgr2=0x7f9518069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9518066e70 0x7f9518069330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9538152fe0 tx=0x7f9520008040 comp rx=0 tx=0).stop 2024-09-13T18:33:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95380ccd10 msgr2=0x7f9538156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:47.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95380ccd10 0x7f9538156210 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f952801a0d0 tx=0x7f952801ace0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 shutdown_connections 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9518066e70 0x7f9518069330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95380d2c80 0x7f953815a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f953815c830 0x7f953815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 --2- 172.21.15.53:0/1984912811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95380ccd10 0x7f9538156210 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 >> 172.21.15.53:0/1984912811 conn(0x7f9538070970 msgr2=0x7f95380b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 shutdown_connections 2024-09-13T18:33:47.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.704+0000 7f953e3be640 1 -- 172.21.15.53:0/1984912811 wait complete. 2024-09-13T18:33:47.728 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:33:47.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.900+0000 7f16505bb640 1 Processor -- start 2024-09-13T18:33:47.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.900+0000 7f16505bb640 1 -- start start 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.900+0000 7f16505bb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.900+0000 7f16505bb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16480cf7a0 0x7f16480b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.900+0000 7f16505bb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16480b5bc0 con 0x7f164815c860 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.900+0000 7f16505bb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16480cfc50 con 0x7f16480cf7a0 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.900+0000 7f16505bb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164815cc40 con 0x7f16480d3220 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164eb58640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f16480cf7a0 0x7f16480b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164db56640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164e357640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f164815c860 0x7f16480cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:35376/0 (socket says 172.21.15.53:35376) 2024-09-13T18:33:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164e357640 1 -- 172.21.15.53:0/4041748369 learned_addr learned my addr 172.21.15.53:0/4041748369 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:47.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164eb58640 1 -- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 msgr2=0x7f16480cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:47.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164eb58640 1 --2- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164eb58640 1 -- 172.21.15.53:0/4041748369 >> v1:172.21.15.87:6789/0 conn(0x7f164815c860 legacy=0x7f16480cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:47.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164eb58640 1 -- 172.21.15.53:0/4041748369 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480ccd40 con 0x7f16480cf7a0 2024-09-13T18:33:47.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164db56640 1 --2- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:47.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164eb58640 1 --2- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 0x7f16480b6050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f16380097c0 tx=0x7f163801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52bcdecf909df1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:47.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164d355640 1 -- 172.21.15.53:0/4041748369 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380a8990 con 0x7f16480cf7a0 2024-09-13T18:33:47.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164d355640 1 -- 172.21.15.53:0/4041748369 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380a8af0 con 0x7f16480cf7a0 2024-09-13T18:33:47.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f164d355640 1 -- 172.21.15.53:0/4041748369 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380a8e80 con 0x7f16480cf7a0 2024-09-13T18:33:47.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f16505bb640 1 -- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 msgr2=0x7f16480b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:47.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f16505bb640 1 --2- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 0x7f16480b6050 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f16380097c0 tx=0x7f163801ec90 comp rx=0 tx=0).stop 2024-09-13T18:33:47.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f16505bb640 1 -- 172.21.15.53:0/4041748369 shutdown_connections 2024-09-13T18:33:47.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f16505bb640 1 --2- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 0x7f16480b6050 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f16505bb640 1 --2- 172.21.15.53:0/4041748369 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f16505bb640 1 -- 172.21.15.53:0/4041748369 >> 172.21.15.53:0/4041748369 conn(0x7f1648070570 msgr2=0x7f1648070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:47.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.904+0000 7f16505bb640 1 -- 172.21.15.53:0/4041748369 shutdown_connections 2024-09-13T18:33:47.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- 172.21.15.53:0/4041748369 wait complete. 2024-09-13T18:33:47.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 Processor -- start 2024-09-13T18:33:47.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- start start 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 0x7f16480b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f164815c860 0x7f16480ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480cc070 con 0x7f164815c860 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16481f27e0 con 0x7f16480cf7a0 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16480cb3f0 con 0x7f16480d3220 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f164815c860 0x7f16480ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f164815c860 0x7f16480ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52264/0 (socket says 172.21.15.53:52264) 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 -- 172.21.15.53:0/3317115920 learned_addr learned my addr 172.21.15.53:0/3317115920 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164e357640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 0x7f16480b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164db56640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 -- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 msgr2=0x7f16480b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 -- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 msgr2=0x7f16480b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 0x7f16480b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 -- 172.21.15.53:0/3317115920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c009420 con 0x7f164815c860 2024-09-13T18:33:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164db56640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f164eb58640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f164815c860 0x7f16480ca810 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f163801c8c0 tx=0x7f163801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f1646ffd640 1 -- 172.21.15.53:0/3317115920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380b0d70 con 0x7f164815c860 2024-09-13T18:33:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f1646ffd640 1 -- 172.21.15.53:0/3317115920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380b9430 con 0x7f164815c860 2024-09-13T18:33:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638009420 con 0x7f164815c860 2024-09-13T18:33:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f1646ffd640 1 -- 172.21.15.53:0/3317115920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380b97e0 con 0x7f164815c860 2024-09-13T18:33:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16480cb9b0 con 0x7f164815c860 2024-09-13T18:33:47.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.908+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16480b6050 con 0x7f164815c860 2024-09-13T18:33:47.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.912+0000 7f1646ffd640 1 -- 172.21.15.53:0/3317115920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f16380b7040 con 0x7f164815c860 2024-09-13T18:33:47.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.912+0000 7f1646ffd640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1634066e70 0x7f1634069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:47.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.912+0000 7f1646ffd640 1 -- 172.21.15.53:0/3317115920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1638120ee0 con 0x7f164815c860 2024-09-13T18:33:47.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.912+0000 7f164e357640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1634066e70 0x7f1634069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:47.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.912+0000 7f164e357640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1634066e70 0x7f1634069330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1640005c10 tx=0x7f1640009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:47.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:47.916+0000 7f1646ffd640 1 -- 172.21.15.53:0/3317115920 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16380eff70 con 0x7f164815c860 2024-09-13T18:33:48.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:48.072+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f16480b7850 con 0x7f164815c860 2024-09-13T18:33:49.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.064+0000 7f1646ffd640 1 -- 172.21.15.53:0/3317115920 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v152) v1 ==== 181+0+0 (secure 0 0 0) 0x7f16380b5070 con 0x7f164815c860 2024-09-13T18:33:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:33:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1634066e70 msgr2=0x7f1634069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1634066e70 0x7f1634069330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1640005c10 tx=0x7f1640009040 comp rx=0 tx=0).stop 2024-09-13T18:33:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f164815c860 msgr2=0x7f16480ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f164815c860 0x7f16480ca810 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f163801c8c0 tx=0x7f163801ba30 comp rx=0 tx=0).stop 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 shutdown_connections 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1634066e70 0x7f1634069330 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16480d3220 0x7f16480b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f164815c860 0x7f16480ca810 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 --2- 172.21.15.53:0/3317115920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16480cf7a0 0x7f16480b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 >> 172.21.15.53:0/3317115920 conn(0x7f1648070570 msgr2=0x7f16480b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 shutdown_connections 2024-09-13T18:33:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.068+0000 7f16505bb640 1 -- 172.21.15.53:0/3317115920 wait complete. 2024-09-13T18:33:49.466 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:33:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c31355640 1 Processor -- start 2024-09-13T18:33:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c31355640 1 -- start start 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c31355640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cd6f0 0x7f7c2c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c31355640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c2c143f20 0x7f7c2c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c31355640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0b3020 con 0x7f7c2c0cdad0 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c31355640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c0b1f80 con 0x7f7c2c143f20 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c31355640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0b2260 con 0x7f7c2c0cd6f0 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c2c143f20 0x7f7c2c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7c2c143f20 0x7f7c2c06b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52270/0 (socket says 172.21.15.53:52270) 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/4227435608 learned_addr learned my addr 172.21.15.53:0/4227435608 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2affd640 1 --2- 172.21.15.53:0/4227435608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cd6f0 0x7f7c2c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/4227435608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cd6f0 msgr2=0x7f7c2c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2b7fe640 1 --2- 172.21.15.53:0/4227435608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cd6f0 0x7f7c2c0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/4227435608 >> v1:172.21.15.87:6789/0 conn(0x7f7c2c0cdad0 legacy=0x7f7c2c143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:49.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.612+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/4227435608 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0b2540 con 0x7f7c2c143f20 2024-09-13T18:33:49.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c2b7fe640 1 --2- 172.21.15.53:0/4227435608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c06b320 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009e50 tx=0x7f7c2401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c593e853ccbb81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:49.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c29ffb640 1 -- 172.21.15.53:0/4227435608 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240a5840 con 0x7f7c2c143f20 2024-09-13T18:33:49.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c29ffb640 1 -- 172.21.15.53:0/4227435608 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c240a59a0 con 0x7f7c2c143f20 2024-09-13T18:33:49.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c29ffb640 1 -- 172.21.15.53:0/4227435608 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240a5d30 con 0x7f7c2c143f20 2024-09-13T18:33:49.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 -- 172.21.15.53:0/4227435608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 msgr2=0x7f7c2c06b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:49.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 --2- 172.21.15.53:0/4227435608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c06b320 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009e50 tx=0x7f7c2401c9c0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 -- 172.21.15.53:0/4227435608 shutdown_connections 2024-09-13T18:33:49.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 --2- 172.21.15.53:0/4227435608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c06b320 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 --2- 172.21.15.53:0/4227435608 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cd6f0 0x7f7c2c0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 -- 172.21.15.53:0/4227435608 >> 172.21.15.53:0/4227435608 conn(0x7f7c2c073330 msgr2=0x7f7c2c065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:49.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 -- 172.21.15.53:0/4227435608 shutdown_connections 2024-09-13T18:33:49.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.616+0000 7f7c31355640 1 -- 172.21.15.53:0/4227435608 wait complete. 2024-09-13T18:33:49.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 Processor -- start 2024-09-13T18:33:49.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 -- start start 2024-09-13T18:33:49.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c2c0cd6f0 0x7f7c2c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:49.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cdad0 0x7f7c2c0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:49.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:49.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c070090 con 0x7f7c2c143f20 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c143280 con 0x7f7c2c0cd6f0 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c06f410 con 0x7f7c2c0cdad0 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c15d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52280/0 (socket says 172.21.15.53:52280) 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/3905815528 learned_addr learned my addr 172.21.15.53:0/3905815528 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2affd640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c2c0cd6f0 0x7f7c2c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2a7fc640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cdad0 0x7f7c2c0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cdad0 msgr2=0x7f7c2c0aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cdad0 0x7f7c2c0aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c2c0cd6f0 msgr2=0x7f7c2c070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c2c0cd6f0 0x7f7c2c070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 -- 172.21.15.53:0/3905815528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24009b30 con 0x7f7c2c143f20 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2a7fc640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cdad0 0x7f7c2c0aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c2b7fe640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c15d720 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7c240af040 tx=0x7f7c24019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c137fe640 1 -- 172.21.15.53:0/3905815528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240b8640 con 0x7f7c2c143f20 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c137fe640 1 -- 172.21.15.53:0/3905815528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c240b87a0 con 0x7f7c2c143f20 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c06f6f0 con 0x7f7c2c143f20 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c137fe640 1 -- 172.21.15.53:0/3905815528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240b8b10 con 0x7f7c2c143f20 2024-09-13T18:33:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.620+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c06fcb0 con 0x7f7c2c143f20 2024-09-13T18:33:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.624+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c0aa7a0 con 0x7f7c2c143f20 2024-09-13T18:33:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.624+0000 7f7c137fe640 1 -- 172.21.15.53:0/3905815528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f7c240b8c70 con 0x7f7c2c143f20 2024-09-13T18:33:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.624+0000 7f7c137fe640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c18066e70 0x7f7c18069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.624+0000 7f7c137fe640 1 -- 172.21.15.53:0/3905815528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f7c2411def0 con 0x7f7c2c143f20 2024-09-13T18:33:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.624+0000 7f7c2affd640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c18066e70 0x7f7c18069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.624+0000 7f7c2affd640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c18066e70 0x7f7c18069330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c142380 tx=0x7f7c1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.628+0000 7f7c137fe640 1 -- 172.21.15.53:0/3905815528 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c240ecf80 con 0x7f7c2c143f20 2024-09-13T18:33:49.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:49.792+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c2c0b1490 con 0x7f7c2c143f20 2024-09-13T18:33:50.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.076+0000 7f7c137fe640 1 -- 172.21.15.53:0/3905815528 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v153) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c240f05a0 con 0x7f7c2c143f20 2024-09-13T18:33:50.080 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:33:50.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c18066e70 msgr2=0x7f7c18069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c18066e70 0x7f7c18069330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c142380 tx=0x7f7c1c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 msgr2=0x7f7c2c15d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c15d720 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7c240af040 tx=0x7f7c24019760 comp rx=0 tx=0).stop 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 shutdown_connections 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7c18066e70 0x7f7c18069330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7c2c0cdad0 0x7f7c2c0aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c2c143f20 0x7f7c2c15d720 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 --2- 172.21.15.53:0/3905815528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c2c0cd6f0 0x7f7c2c070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.080+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 >> 172.21.15.53:0/3905815528 conn(0x7f7c2c073330 msgr2=0x7f7c2c0a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:50.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.084+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 shutdown_connections 2024-09-13T18:33:50.086 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.084+0000 7f7c31355640 1 -- 172.21.15.53:0/3905815528 wait complete. 2024-09-13T18:33:50.108 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:33:50.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534ec01640 1 Processor -- start 2024-09-13T18:33:50.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534ec01640 1 -- start start 2024-09-13T18:33:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534ec01640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53480caee0 0x7f53480cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534ec01640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53480cd320 0x7f53480cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534ec01640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534806f7a0 con 0x7f5348143e80 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534ec01640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534806baa0 con 0x7f53480caee0 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534ec01640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534806fd60 con 0x7f53480cd320 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534d19e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53480cd320 0x7f53480cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f5347fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53480caee0 0x7f53480cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534d19e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53480cd320 0x7f53480cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:43076/0 (socket says 172.21.15.53:43076) 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f534d19e640 1 -- 172.21.15.53:0/2402048040 learned_addr learned my addr 172.21.15.53:0/2402048040 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f5347fff640 1 -- 172.21.15.53:0/2402048040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53480cd320 msgr2=0x7f53480cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f5347fff640 1 --2- 172.21.15.53:0/2402048040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53480cd320 0x7f53480cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f5347fff640 1 -- 172.21.15.53:0/2402048040 >> v1:172.21.15.87:6789/0 conn(0x7f5348143e80 legacy=0x7f534806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.236+0000 7f5347fff640 1 -- 172.21.15.53:0/2402048040 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480cdd10 con 0x7f53480caee0 2024-09-13T18:33:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f5347fff640 1 --2- 172.21.15.53:0/2402048040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480caee0 0x7f53480cb350 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f533c0097f0 tx=0x7f533c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0afc860e68a282 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f53477fe640 1 -- 172.21.15.53:0/2402048040 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0ac640 con 0x7f53480caee0 2024-09-13T18:33:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f53477fe640 1 -- 172.21.15.53:0/2402048040 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0ac7a0 con 0x7f53480caee0 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f53477fe640 1 -- 172.21.15.53:0/2402048040 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0acb30 con 0x7f53480caee0 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- 172.21.15.53:0/2402048040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480caee0 msgr2=0x7f53480cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 --2- 172.21.15.53:0/2402048040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480caee0 0x7f53480cb350 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f533c0097f0 tx=0x7f533c01c3e0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- 172.21.15.53:0/2402048040 shutdown_connections 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 --2- 172.21.15.53:0/2402048040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53480cd320 0x7f53480cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 --2- 172.21.15.53:0/2402048040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480caee0 0x7f53480cb350 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- 172.21.15.53:0/2402048040 >> 172.21.15.53:0/2402048040 conn(0x7f5348065c80 msgr2=0x7f5348066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- 172.21.15.53:0/2402048040 shutdown_connections 2024-09-13T18:33:50.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- 172.21.15.53:0/2402048040 wait complete. 2024-09-13T18:33:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 Processor -- start 2024-09-13T18:33:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- start start 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53480caee0 0x7f534813aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480cd320 0x7f534815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5348143e80 0x7f53480acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534813b5a0 con 0x7f53480caee0 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480adeb0 con 0x7f53480cd320 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534ec01640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534815acb0 con 0x7f5348143e80 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534c99d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53480caee0 0x7f534813aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534c99d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53480caee0 0x7f534813aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52288/0 (socket says 172.21.15.53:52288) 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.240+0000 7f534c99d640 1 -- 172.21.15.53:0/1890836845 learned_addr learned my addr 172.21.15.53:0/1890836845 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f5347fff640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480cd320 0x7f534815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534d19e640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5348143e80 0x7f53480acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534c99d640 1 -- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5348143e80 msgr2=0x7f53480acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534c99d640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5348143e80 0x7f53480acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534c99d640 1 -- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480cd320 msgr2=0x7f534815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534c99d640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480cd320 0x7f534815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534c99d640 1 -- 172.21.15.53:0/1890836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009420 con 0x7f53480caee0 2024-09-13T18:33:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534c99d640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53480caee0 0x7f534813aca0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f533800c370 tx=0x7f533800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f53457fa640 1 -- 172.21.15.53:0/1890836845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380052d0 con 0x7f53480caee0 2024-09-13T18:33:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f53457fa640 1 -- 172.21.15.53:0/1890836845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338005430 con 0x7f53480caee0 2024-09-13T18:33:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534815af90 con 0x7f53480caee0 2024-09-13T18:33:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f53457fa640 1 -- 172.21.15.53:0/1890836845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338007260 con 0x7f53480caee0 2024-09-13T18:33:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534815b550 con 0x7f53480caee0 2024-09-13T18:33:50.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53480ae070 con 0x7f53480caee0 2024-09-13T18:33:50.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f53457fa640 1 -- 172.21.15.53:0/1890836845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f53380073c0 con 0x7f53480caee0 2024-09-13T18:33:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f53457fa640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5334066e70 0x7f5334069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f53457fa640 1 -- 172.21.15.53:0/1890836845 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5338081b30 con 0x7f53480caee0 2024-09-13T18:33:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f5347fff640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5334066e70 0x7f5334069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.244+0000 7f5347fff640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5334066e70 0x7f5334069330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ae000 tx=0x7f533c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.248+0000 7f53457fa640 1 -- 172.21.15.53:0/1890836845 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5338050b50 con 0x7f53480caee0 2024-09-13T18:33:50.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.416+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f53480cb350 con 0x7f53480caee0 2024-09-13T18:33:50.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.420+0000 7f53457fa640 1 -- 172.21.15.53:0/1890836845 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5338054170 con 0x7f53480caee0 2024-09-13T18:33:50.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.420+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5334066e70 msgr2=0x7f5334069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.420+0000 7f534ec01640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5334066e70 0x7f5334069330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ae000 tx=0x7f533c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:50.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53480caee0 msgr2=0x7f534813aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53480caee0 0x7f534813aca0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f533800c370 tx=0x7f533800c830 comp rx=0 tx=0).stop 2024-09-13T18:33:50.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 shutdown_connections 2024-09-13T18:33:50.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5334066e70 0x7f5334069330 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5348143e80 0x7f53480acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480cd320 0x7f534815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 --2- 172.21.15.53:0/1890836845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53480caee0 0x7f534813aca0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 >> 172.21.15.53:0/1890836845 conn(0x7f5348065c80 msgr2=0x7f5348155600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 shutdown_connections 2024-09-13T18:33:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.424+0000 7f534ec01640 1 -- 172.21.15.53:0/1890836845 wait complete. 2024-09-13T18:33:50.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-13T18:33:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f391a7a4640 1 Processor -- start 2024-09-13T18:33:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f391a7a4640 1 -- start start 2024-09-13T18:33:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f391a7a4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f391406fa80 0x7f391406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f391a7a4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140b2860 con 0x7f3914158ba0 2024-09-13T18:33:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f391a7a4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3914158f80 con 0x7f39140cbb60 2024-09-13T18:33:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f391a7a4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39140b2580 con 0x7f391406fa80 2024-09-13T18:33:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f3913fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3914158ba0 0x7f391406f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34222/0 (socket says 172.21.15.53:34222) 2024-09-13T18:33:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.560+0000 7f3913fff640 1 -- 172.21.15.53:0/3504325442 learned_addr learned my addr 172.21.15.53:0/3504325442 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f39137fe640 1 --2- 172.21.15.53:0/3504325442 >> v2:172.21.15.87:3300/0 conn(0x7f391406fa80 0x7f391406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390622907 0 0) 0x7f39140b2860 con 0x7f3914158ba0 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3900003530 con 0x7f3914158ba0 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2367940792 0 0) 0x7f3900003530 con 0x7f3914158ba0 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 >> v2:172.21.15.87:3300/0 conn(0x7f391406fa80 msgr2=0x7f391406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 --2- 172.21.15.53:0/3504325442 >> v2:172.21.15.87:3300/0 conn(0x7f391406fa80 0x7f391406b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 >> v1:172.21.15.87:6789/0 conn(0x7f39140cbb60 legacy=0x7f39140cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140cc3a0 con 0x7f3914158ba0 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3904001a00 con 0x7f3914158ba0 2024-09-13T18:33:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 >> v1:172.21.15.53:6789/0 conn(0x7f3914158ba0 legacy=0x7f391406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3900003980 0x7f3900003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000047d0 0x7f3900004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f390000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39140b2580 con 0x7f3900005190 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390000c130 con 0x7f39000047d0 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390000c2f0 con 0x7f3900003980 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f390000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3913fff640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3900003980 0x7f3900003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f39137fe640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000047d0 0x7f3900004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 -- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3900003980 msgr2=0x7f3900003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3900003980 0x7f3900003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 -- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000047d0 msgr2=0x7f3900004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39000047d0 0x7f3900004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 -- 172.21.15.53:0/3504325442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900003530 con 0x7f3900005190 2024-09-13T18:33:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3913fff640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3900003980 0x7f3900003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 -- 172.21.15.53:0/3504325442 reap_dead start 2024-09-13T18:33:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3918d41640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f390000b990 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f390c001750 tx=0x7f390c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfddc321f0fece0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0052d0 con 0x7f3900005190 2024-09-13T18:33:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c0a7050 con 0x7f3900005190 2024-09-13T18:33:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f3912ffd640 1 -- 172.21.15.53:0/3504325442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c003600 con 0x7f3900005190 2024-09-13T18:33:50.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f391a7a4640 1 -- 172.21.15.53:0/3504325442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 msgr2=0x7f390000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f391a7a4640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f390000b990 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f390c001750 tx=0x7f390c01c3e0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f391a7a4640 1 -- 172.21.15.53:0/3504325442 shutdown_connections 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f391a7a4640 1 --2- 172.21.15.53:0/3504325442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f390000b990 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.564+0000 7f391a7a4640 1 -- 172.21.15.53:0/3504325442 >> 172.21.15.53:0/3504325442 conn(0x7f3914065c80 msgr2=0x7f3914066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- 172.21.15.53:0/3504325442 shutdown_connections 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- 172.21.15.53:0/3504325442 wait complete. 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 Processor -- start 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- start start 2024-09-13T18:33:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f391414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39141525a0 0x7f39140ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39140cd180 0x7f39140ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39140cd600 con 0x7f3900005190 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39141e1ad0 con 0x7f39140cd180 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3914159890 con 0x7f39141525a0 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f391414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f391414ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52304/0 (socket says 172.21.15.53:52304) 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 -- 172.21.15.53:0/2424975330 learned_addr learned my addr 172.21.15.53:0/2424975330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f39137fe640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39141525a0 0x7f39140ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3918d41640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39140cd180 0x7f39140ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 -- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39141525a0 msgr2=0x7f39140ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39141525a0 0x7f39140ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 -- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39140cd180 msgr2=0x7f39140ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39140cd180 0x7f39140ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 -- 172.21.15.53:0/2424975330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914152a20 con 0x7f3900005190 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f39137fe640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39141525a0 0x7f39140ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3913fff640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f391414ef70 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f3904011810 tx=0x7f3904011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3910ff9640 1 -- 172.21.15.53:0/2424975330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400fb60 con 0x7f3900005190 2024-09-13T18:33:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3910ff9640 1 -- 172.21.15.53:0/2424975330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390400fcc0 con 0x7f3900005190 2024-09-13T18:33:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39141e15a0 con 0x7f3900005190 2024-09-13T18:33:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f3910ff9640 1 -- 172.21.15.53:0/2424975330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904015610 con 0x7f3900005190 2024-09-13T18:33:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39141e2000 con 0x7f3900005190 2024-09-13T18:33:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.568+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3914067400 con 0x7f3900005190 2024-09-13T18:33:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.572+0000 7f3910ff9640 1 -- 172.21.15.53:0/2424975330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f3904015770 con 0x7f3900005190 2024-09-13T18:33:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.572+0000 7f3910ff9640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f38f4066ea0 0x7f38f4069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.572+0000 7f3910ff9640 1 -- 172.21.15.53:0/2424975330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3904085b20 con 0x7f3900005190 2024-09-13T18:33:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.572+0000 7f39137fe640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f38f4066ea0 0x7f38f4069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.572+0000 7f39137fe640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f38f4066ea0 0x7f38f4069360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3914151e10 tx=0x7f38fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.576+0000 7f3910ff9640 1 -- 172.21.15.53:0/2424975330 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3904054a90 con 0x7f3900005190 2024-09-13T18:33:50.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:50.788+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) v1 -- 0x7f391406f370 con 0x7f3900005190 2024-09-13T18:33:51.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f3910ff9640 1 -- 172.21.15.53:0/2424975330 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v482) v1 ==== 149+0+0 (secure 0 0 0) 0x7f39040018b0 con 0x7f3900005190 2024-09-13T18:33:51.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f38f4066ea0 msgr2=0x7f38f4069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f38f4066ea0 0x7f38f4069360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3914151e10 tx=0x7f38fc008040 comp rx=0 tx=0).stop 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 msgr2=0x7f391414ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f391414ef70 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f3904011810 tx=0x7f3904011cd0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 shutdown_connections 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f38f4066ea0 0x7f38f4069360 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39141525a0 0x7f39140ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39140cd180 0x7f39140ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 --2- 172.21.15.53:0/2424975330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3900005190 0x7f391414ef70 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 >> 172.21.15.53:0/2424975330 conn(0x7f3914065c80 msgr2=0x7f391406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 shutdown_connections 2024-09-13T18:33:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.076+0000 7f391a7a4640 1 -- 172.21.15.53:0/2424975330 wait complete. 2024-09-13T18:33:51.098 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- rather than going through a full upgrade cycle, ... ok 2024-09-13T18:33:51.098 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-13T18:33:51.099 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:33:51.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:51.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f13174bb640 1 Processor -- start 2024-09-13T18:33:51.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f13174bb640 1 -- start start 2024-09-13T18:33:51.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f13174bb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13100b1650 0x7f13100b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f13174bb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100b5060 con 0x7f131015c840 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f13174bb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1310160a70 con 0x7f13100b4c80 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f13174bb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100cdd80 con 0x7f13100b1650 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f1314a56640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13100b1650 0x7f13100b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f1315257640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f131015c840 0x7f1310160220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34224/0 (socket says 172.21.15.53:34224) 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f1315257640 1 -- 172.21.15.53:0/395379420 learned_addr learned my addr 172.21.15.53:0/395379420 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f1314a56640 1 -- 172.21.15.53:0/395379420 >> v1:172.21.15.87:6789/0 conn(0x7f13100b4c80 legacy=0x7f13100d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f1314a56640 1 -- 172.21.15.53:0/395379420 >> v1:172.21.15.53:6789/0 conn(0x7f131015c840 legacy=0x7f1310160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.224+0000 7f1314a56640 1 -- 172.21.15.53:0/395379420 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310160d50 con 0x7f13100b1650 2024-09-13T18:33:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f1314a56640 1 --2- 172.21.15.53:0/395379420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13100b1650 0x7f13100b4740 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f13000097c0 tx=0x7f130001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d1015dd620ed09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f1307fff640 1 -- 172.21.15.53:0/395379420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000a7070 con 0x7f13100b1650 2024-09-13T18:33:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f1307fff640 1 -- 172.21.15.53:0/395379420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13000ab430 con 0x7f13100b1650 2024-09-13T18:33:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f1307fff640 1 -- 172.21.15.53:0/395379420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000ab7c0 con 0x7f13100b1650 2024-09-13T18:33:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f13174bb640 1 -- 172.21.15.53:0/395379420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13100b1650 msgr2=0x7f13100b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f13174bb640 1 --2- 172.21.15.53:0/395379420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13100b1650 0x7f13100b4740 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f13000097c0 tx=0x7f130001c430 comp rx=0 tx=0).stop 2024-09-13T18:33:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f13174bb640 1 -- 172.21.15.53:0/395379420 shutdown_connections 2024-09-13T18:33:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f13174bb640 1 --2- 172.21.15.53:0/395379420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13100b1650 0x7f13100b4740 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f13174bb640 1 -- 172.21.15.53:0/395379420 >> 172.21.15.53:0/395379420 conn(0x7f1310066080 msgr2=0x7f1310066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f13174bb640 1 -- 172.21.15.53:0/395379420 shutdown_connections 2024-09-13T18:33:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.228+0000 7f13174bb640 1 -- 172.21.15.53:0/395379420 wait complete. 2024-09-13T18:33:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 Processor -- start 2024-09-13T18:33:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 -- start start 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13100b1650 0x7f13101519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13100b4c80 0x7f131015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131015c840 0x7f1310157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100c9120 con 0x7f131015c840 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131015ed10 con 0x7f13100b1650 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13100c84a0 con 0x7f13100b4c80 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131015c840 0x7f1310157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131015c840 0x7f1310157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52320/0 (socket says 172.21.15.53:52320) 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 -- 172.21.15.53:0/462817473 learned_addr learned my addr 172.21.15.53:0/462817473 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 -- 172.21.15.53:0/462817473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13100b4c80 msgr2=0x7f131015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13100b4c80 0x7f131015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 -- 172.21.15.53:0/462817473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13100b1650 msgr2=0x7f13101519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13100b1650 0x7f13101519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 -- 172.21.15.53:0/462817473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300009420 con 0x7f131015c840 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1315a58640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131015c840 0x7f1310157d70 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f130800b970 tx=0x7f130800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1305ffb640 1 -- 172.21.15.53:0/462817473 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130800cb40 con 0x7f131015c840 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1305ffb640 1 -- 172.21.15.53:0/462817473 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130800cca0 con 0x7f131015c840 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13100c8780 con 0x7f131015c840 2024-09-13T18:33:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1305ffb640 1 -- 172.21.15.53:0/462817473 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308014680 con 0x7f131015c840 2024-09-13T18:33:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13100c8d40 con 0x7f131015c840 2024-09-13T18:33:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13100b4740 con 0x7f131015c840 2024-09-13T18:33:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1305ffb640 1 -- 172.21.15.53:0/462817473 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f130801d3b0 con 0x7f131015c840 2024-09-13T18:33:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.232+0000 7f1305ffb640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12f4066e70 0x7f12f4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.236+0000 7f1305ffb640 1 -- 172.21.15.53:0/462817473 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1308082780 con 0x7f131015c840 2024-09-13T18:33:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.236+0000 7f1315257640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12f4066e70 0x7f12f4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.236+0000 7f1315257640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12f4066e70 0x7f12f4069330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f130c001560 tx=0x7f130c007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.240+0000 7f1305ffb640 1 -- 172.21.15.53:0/462817473 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f13080516f0 con 0x7f131015c840 2024-09-13T18:33:51.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.400+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13100b86e0 con 0x7f131015c840 2024-09-13T18:33:51.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.400+0000 7f1305ffb640 1 -- 172.21.15.53:0/462817473 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+12936 (secure 0 0 0) 0x7f1308019020 con 0x7f131015c840 2024-09-13T18:33:51.404 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:51.404 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":153,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:50.065865+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1614413719":"2024-09-14T18:33:46.690051+0000","172.21.15.53:6834/1614413719":"2024-09-14T18:33:46.690051+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:51.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12f4066e70 msgr2=0x7f12f4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12f4066e70 0x7f12f4069330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f130c001560 tx=0x7f130c007a50 comp rx=0 tx=0).stop 2024-09-13T18:33:51.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131015c840 msgr2=0x7f1310157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131015c840 0x7f1310157d70 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f130800b970 tx=0x7f130800be30 comp rx=0 tx=0).stop 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 shutdown_connections 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f12f4066e70 0x7f12f4069330 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13100b4c80 0x7f131015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f131015c840 0x7f1310157d70 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 --2- 172.21.15.53:0/462817473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13100b1650 0x7f13101519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 >> 172.21.15.53:0/462817473 conn(0x7f1310066080 msgr2=0x7f13100cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 shutdown_connections 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.404+0000 7f13174bb640 1 -- 172.21.15.53:0/462817473 wait complete. 2024-09-13T18:33:51.424 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:51.425 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:51.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.544+0000 7fd462c94640 1 Processor -- start 2024-09-13T18:33:51.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd462c94640 1 -- start start 2024-09-13T18:33:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd462c94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 0x7fd45c167910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd462c94640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45c0d0320 con 0x7fd45c06a4f0 2024-09-13T18:33:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd462c94640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45c0d0600 con 0x7fd45c06aa60 2024-09-13T18:33:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd462c94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c06b830 con 0x7fd45c165520 2024-09-13T18:33:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd45c06a4f0 0x7fd45c15d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34230/0 (socket says 172.21.15.53:34230) 2024-09-13T18:33:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45bfff640 1 -- 172.21.15.53:0/3625620199 learned_addr learned my addr 172.21.15.53:0/3625620199 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd461231640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 0x7fd45c167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032598754 0 0) 0x7fd45c0d0320 con 0x7fd45c06a4f0 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd444003530 con 0x7fd45c06a4f0 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122516171 0 0) 0x7fd45c0d0600 con 0x7fd45c06aa60 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd45c0d0320 con 0x7fd45c06aa60 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518855224 0 0) 0x7fd444003530 con 0x7fd45c06a4f0 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 msgr2=0x7fd45c167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 0x7fd45c167910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 >> v1:172.21.15.87:6789/0 conn(0x7fd45c06aa60 legacy=0x7fd45c06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0d08e0 con 0x7fd45c06a4f0 2024-09-13T18:33:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd450001680 con 0x7fd45c06a4f0 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 >> v1:172.21.15.53:6789/0 conn(0x7fd45c06a4f0 legacy=0x7fd45c15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd444003b40 0x7fd444003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 0x7fd4440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd444004d10 0x7fd444005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c06b830 con 0x7fd444003b40 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44400ba40 con 0x7fd444004d10 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44400bc00 con 0x7fd45c165520 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd460a30640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd444003b40 0x7fd444003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd45bfff640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 0x7fd4440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd461231640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd444004d10 0x7fd444005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd460a30640 1 -- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 msgr2=0x7fd4440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd460a30640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45c165520 0x7fd4440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd460a30640 1 -- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd444004d10 msgr2=0x7fd444005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd460a30640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd444004d10 0x7fd444005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.548+0000 7fd460a30640 1 -- 172.21.15.53:0/3625620199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444003530 con 0x7fd444003b40 2024-09-13T18:33:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd460a30640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd444003b40 0x7fd444003f40 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0018d0 tx=0x7fd44c01c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbef61a9922fab3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0052d0 con 0x7fd444003b40 2024-09-13T18:33:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c0a7050 con 0x7fd444003b40 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd45b7fe640 1 -- 172.21.15.53:0/3625620199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c003600 con 0x7fd444003b40 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 -- 172.21.15.53:0/3625620199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd444003b40 msgr2=0x7fd444003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 --2- 172.21.15.53:0/3625620199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd444003b40 0x7fd444003f40 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0018d0 tx=0x7fd44c01c580 comp rx=0 tx=0).stop 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd461231640 1 -- 172.21.15.53:0/3625620199 reap_dead start 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 -- 172.21.15.53:0/3625620199 shutdown_connections 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 -- 172.21.15.53:0/3625620199 >> 172.21.15.53:0/3625620199 conn(0x7fd45c071a70 msgr2=0x7fd45c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 -- 172.21.15.53:0/3625620199 shutdown_connections 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 -- 172.21.15.53:0/3625620199 wait complete. 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 Processor -- start 2024-09-13T18:33:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.552+0000 7fd462c94640 1 -- start start 2024-09-13T18:33:51.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd444003b40 0x7fd45c14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c1498f0 0x7fd45c0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45c0ae530 0x7fd45c0ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c14de60 con 0x7fd45c1498f0 2024-09-13T18:33:51.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0aef20 con 0x7fd45c0ae530 2024-09-13T18:33:51.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c0b1500 con 0x7fd444003b40 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c1498f0 0x7fd45c0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c1498f0 0x7fd45c0b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52346/0 (socket says 172.21.15.53:52346) 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 -- 172.21.15.53:0/2910698306 learned_addr learned my addr 172.21.15.53:0/2910698306 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd460a30640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd444003b40 0x7fd45c14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd461231640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45c0ae530 0x7fd45c0ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 -- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd444003b40 msgr2=0x7fd45c14b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd444003b40 0x7fd45c14b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 -- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45c0ae530 msgr2=0x7fd45c0ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45c0ae530 0x7fd45c0ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 -- 172.21.15.53:0/2910698306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c14bac0 con 0x7fd45c1498f0 2024-09-13T18:33:51.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd45bfff640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c1498f0 0x7fd45c0b2140 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fd45000e7b0 tx=0x7fd45000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd4597fa640 1 -- 172.21.15.53:0/2910698306 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45000ee60 con 0x7fd45c1498f0 2024-09-13T18:33:51.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd4597fa640 1 -- 172.21.15.53:0/2910698306 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45000c8d0 con 0x7fd45c1498f0 2024-09-13T18:33:51.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c14d1e0 con 0x7fd45c1498f0 2024-09-13T18:33:51.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd4597fa640 1 -- 172.21.15.53:0/2910698306 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45000cc60 con 0x7fd45c1498f0 2024-09-13T18:33:51.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c14d7a0 con 0x7fd45c1498f0 2024-09-13T18:33:51.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c14dfa0 con 0x7fd45c1498f0 2024-09-13T18:33:51.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd4597fa640 1 -- 172.21.15.53:0/2910698306 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fd45001d460 con 0x7fd45c1498f0 2024-09-13T18:33:51.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd4597fa640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd448066e70 0x7fd448069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd4597fa640 1 -- 172.21.15.53:0/2910698306 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd450083160 con 0x7fd45c1498f0 2024-09-13T18:33:51.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.556+0000 7fd460a30640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd448066e70 0x7fd448069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.560+0000 7fd460a30640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd448066e70 0x7fd448069330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0ac000 tx=0x7fd44c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.560+0000 7fd4597fa640 1 -- 172.21.15.53:0/2910698306 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd450055c10 con 0x7fd45c1498f0 2024-09-13T18:33:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.720+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd45c14dfa0 con 0x7fd45c1498f0 2024-09-13T18:33:51.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.720+0000 7fd4597fa640 1 -- 172.21.15.53:0/2910698306 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd45c14dfa0 con 0x7fd45c1498f0 2024-09-13T18:33:51.724 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd448066e70 msgr2=0x7fd448069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd448066e70 0x7fd448069330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0ac000 tx=0x7fd44c0a6000 comp rx=0 tx=0).stop 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c1498f0 msgr2=0x7fd45c0b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c1498f0 0x7fd45c0b2140 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fd45000e7b0 tx=0x7fd45000ec70 comp rx=0 tx=0).stop 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 shutdown_connections 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd448066e70 0x7fd448069330 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45c0ae530 0x7fd45c0ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c1498f0 0x7fd45c0b2140 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 --2- 172.21.15.53:0/2910698306 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd444003b40 0x7fd45c14b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 >> 172.21.15.53:0/2910698306 conn(0x7fd45c071a70 msgr2=0x7fd45c159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 shutdown_connections 2024-09-13T18:33:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.724+0000 7fd462c94640 1 -- 172.21.15.53:0/2910698306 wait complete. 2024-09-13T18:33:51.743 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-13T18:33:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.864+0000 7fe121ab6640 1 Processor -- start 2024-09-13T18:33:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.864+0000 7fe121ab6640 1 -- start start 2024-09-13T18:33:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe121ab6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe11c15db40 0x7fe11c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe121ab6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c0ae5d0 0x7fe11c0ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe121ab6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0ad530 con 0x7fe11c0b1960 2024-09-13T18:33:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe121ab6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0ae1b0 con 0x7fe11c15db40 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe121ab6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0ad810 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe11c0b1960 0x7fe11c0b02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34238/0 (socket says 172.21.15.53:34238) 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11affd640 1 -- 172.21.15.53:0/4232341809 learned_addr learned my addr 172.21.15.53:0/4232341809 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11b7fe640 1 --2- 172.21.15.53:0/4232341809 >> v2:172.21.15.87:3300/0 conn(0x7fe11c15db40 0x7fe11c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11bfff640 1 --2- 172.21.15.53:0/4232341809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c0ae5d0 0x7fe11c0ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11a7fc640 1 -- 172.21.15.53:0/4232341809 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397932381 0 0) 0x7fe11c0ad530 con 0x7fe11c0b1960 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11a7fc640 1 -- 172.21.15.53:0/4232341809 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe108003530 con 0x7fe11c0b1960 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11bfff640 1 -- 172.21.15.53:0/4232341809 >> v2:172.21.15.87:3300/0 conn(0x7fe11c15db40 msgr2=0x7fe11c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11bfff640 1 --2- 172.21.15.53:0/4232341809 >> v2:172.21.15.87:3300/0 conn(0x7fe11c15db40 0x7fe11c0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11bfff640 1 -- 172.21.15.53:0/4232341809 >> v1:172.21.15.53:6789/0 conn(0x7fe11c0b1960 legacy=0x7fe11c0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11bfff640 1 -- 172.21.15.53:0/4232341809 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0adaf0 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11bfff640 1 --2- 172.21.15.53:0/4232341809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c0ae5d0 0x7fe11c0ae9e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe114009d90 tx=0x7fe11401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3189f70feb52e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11a7fc640 1 -- 172.21.15.53:0/4232341809 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5950 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11a7fc640 1 -- 172.21.15.53:0/4232341809 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140a5ab0 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.868+0000 7fe11a7fc640 1 -- 172.21.15.53:0/4232341809 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5e20 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- 172.21.15.53:0/4232341809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c0ae5d0 msgr2=0x7fe11c0ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 --2- 172.21.15.53:0/4232341809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c0ae5d0 0x7fe11c0ae9e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe114009d90 tx=0x7fe11401c8b0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- 172.21.15.53:0/4232341809 shutdown_connections 2024-09-13T18:33:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 --2- 172.21.15.53:0/4232341809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c0ae5d0 0x7fe11c0ae9e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 --2- 172.21.15.53:0/4232341809 >> v2:172.21.15.87:3300/0 conn(0x7fe11c15db40 0x7fe11c0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- 172.21.15.53:0/4232341809 >> 172.21.15.53:0/4232341809 conn(0x7fe11c0b20d0 msgr2=0x7fe11c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- 172.21.15.53:0/4232341809 shutdown_connections 2024-09-13T18:33:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- 172.21.15.53:0/4232341809 wait complete. 2024-09-13T18:33:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 Processor -- start 2024-09-13T18:33:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- start start 2024-09-13T18:33:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c0ae5d0 0x7fe11c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe11c0b1960 0x7fe11c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c15db40 0x7fe11c0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1566c0 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1569a0 con 0x7fe11c0b1960 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c156c80 con 0x7fe11c15db40 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c0ae5d0 0x7fe11c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c0ae5d0 0x7fe11c155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52348/0 (socket says 172.21.15.53:52348) 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 -- 172.21.15.53:0/1805340025 learned_addr learned my addr 172.21.15.53:0/1805340025 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 -- 172.21.15.53:0/1805340025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c15db40 msgr2=0x7fe11c0cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c15db40 0x7fe11c0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 -- 172.21.15.53:0/1805340025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe11c0b1960 msgr2=0x7fe11c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe11c0b1960 0x7fe11c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 -- 172.21.15.53:0/1805340025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114009a70 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe11b7fe640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c0ae5d0 0x7fe11c155ce0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e870 tx=0x7fe10c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe113fff640 1 -- 172.21.15.53:0/1805340025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00eec0 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe113fff640 1 -- 172.21.15.53:0/1805340025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c00c940 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c156f60 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe113fff640 1 -- 172.21.15.53:0/1805340025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00ccb0 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.872+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c156220 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.876+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c073a10 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.876+0000 7fe113fff640 1 -- 172.21.15.53:0/1805340025 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fe10c013470 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.876+0000 7fe113fff640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe0fc066e70 0x7fe0fc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.876+0000 7fe113fff640 1 -- 172.21.15.53:0/1805340025 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe10c0829c0 con 0x7fe11c0ae5d0 2024-09-13T18:33:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.876+0000 7fe11affd640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe0fc066e70 0x7fe0fc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.876+0000 7fe11affd640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe0fc066e70 0x7fe0fc069330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe104007fd0 tx=0x7fe104007940 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:51.880+0000 7fe113fff640 1 -- 172.21.15.53:0/1805340025 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe10c0518b0 con 0x7fe11c0ae5d0 2024-09-13T18:33:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:52.100+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) v1 -- 0x7fe11c0ae9e0 con 0x7fe11c0ae5d0 2024-09-13T18:33:53.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.084+0000 7fe113fff640 1 -- 172.21.15.53:0/1805340025 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v484) v1 ==== 148+0+0 (secure 0 0 0) 0x7fe10c0170d0 con 0x7fe11c0ae5d0 2024-09-13T18:33:53.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe0fc066e70 msgr2=0x7fe0fc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe0fc066e70 0x7fe0fc069330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe104007fd0 tx=0x7fe104007940 comp rx=0 tx=0).stop 2024-09-13T18:33:53.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c0ae5d0 msgr2=0x7fe11c155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c0ae5d0 0x7fe11c155ce0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e870 tx=0x7fe10c00ec70 comp rx=0 tx=0).stop 2024-09-13T18:33:53.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 shutdown_connections 2024-09-13T18:33:53.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe0fc066e70 0x7fe0fc069330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe11c15db40 0x7fe11c0cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe11c0b1960 0x7fe11c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 --2- 172.21.15.53:0/1805340025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c0ae5d0 0x7fe11c155ce0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 >> 172.21.15.53:0/1805340025 conn(0x7fe11c0b20d0 msgr2=0x7fe11c0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:53.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 shutdown_connections 2024-09-13T18:33:53.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.088+0000 7fe121ab6640 1 -- 172.21.15.53:0/1805340025 wait complete. 2024-09-13T18:33:53.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:33:53.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 Processor -- start 2024-09-13T18:33:53.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 -- start start 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fafec160320 0x7fafec160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafec160f30 0x7fafec072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ccb80 0x7fafec0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec0b2e90 con 0x7fafec160f30 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec06bc90 con 0x7fafec160320 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff23c4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec160c40 con 0x7fafec0ccb80 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafec160f30 0x7fafec072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fafec160f30 0x7fafec072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52350/0 (socket says 172.21.15.53:52350) 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 -- 172.21.15.53:0/1204834288 learned_addr learned my addr 172.21.15.53:0/1204834288 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafebfff640 1 --2- 172.21.15.53:0/1204834288 >> v2:172.21.15.87:3300/0 conn(0x7fafec160320 0x7fafec160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7faff0961640 1 --2- 172.21.15.53:0/1204834288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ccb80 0x7fafec0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 -- 172.21.15.53:0/1204834288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ccb80 msgr2=0x7fafec0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:53.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 --2- 172.21.15.53:0/1204834288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ccb80 0x7fafec0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 -- 172.21.15.53:0/1204834288 >> v2:172.21.15.87:3300/0 conn(0x7fafec160320 msgr2=0x7fafec160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:53.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 --2- 172.21.15.53:0/1204834288 >> v2:172.21.15.87:3300/0 conn(0x7fafec160320 0x7fafec160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.244+0000 7fafeb7fe640 1 -- 172.21.15.53:0/1204834288 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec0b3080 con 0x7fafec160f30 2024-09-13T18:33:53.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7fafeb7fe640 1 --2- 172.21.15.53:0/1204834288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec072ff0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fafec06af60 tx=0x7fafdc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a693135ee96fee84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:53.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7fafeaffd640 1 -- 172.21.15.53:0/1204834288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0aa610 con 0x7fafec160f30 2024-09-13T18:33:53.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7fafeaffd640 1 -- 172.21.15.53:0/1204834288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc0a6040 con 0x7fafec160f30 2024-09-13T18:33:53.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7fafeaffd640 1 -- 172.21.15.53:0/1204834288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0aa990 con 0x7fafec160f30 2024-09-13T18:33:53.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 -- 172.21.15.53:0/1204834288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 msgr2=0x7fafec072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 --2- 172.21.15.53:0/1204834288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec072ff0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fafec06af60 tx=0x7fafdc01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 -- 172.21.15.53:0/1204834288 shutdown_connections 2024-09-13T18:33:53.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 --2- 172.21.15.53:0/1204834288 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec0ccb80 0x7fafec0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 --2- 172.21.15.53:0/1204834288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec072ff0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 --2- 172.21.15.53:0/1204834288 >> v2:172.21.15.87:3300/0 conn(0x7fafec160320 0x7fafec160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 -- 172.21.15.53:0/1204834288 >> 172.21.15.53:0/1204834288 conn(0x7fafec0b0a30 msgr2=0x7fafec0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:53.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 -- 172.21.15.53:0/1204834288 shutdown_connections 2024-09-13T18:33:53.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 -- 172.21.15.53:0/1204834288 wait complete. 2024-09-13T18:33:53.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 Processor -- start 2024-09-13T18:33:53.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.248+0000 7faff23c4640 1 -- start start 2024-09-13T18:33:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0ccb80 0x7fafec156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec160320 0x7fafec071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec157ae0 con 0x7fafec160f30 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec09bf10 con 0x7fafec0ccb80 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec1571b0 con 0x7fafec160320 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52366/0 (socket says 172.21.15.53:52366) 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 -- 172.21.15.53:0/2285362651 learned_addr learned my addr 172.21.15.53:0/2285362651 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafeb7fe640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec160320 0x7fafec071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafebfff640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0ccb80 0x7fafec156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 -- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec160320 msgr2=0x7fafec071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec160320 0x7fafec071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 -- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0ccb80 msgr2=0x7fafec156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0ccb80 0x7fafec156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 -- 172.21.15.53:0/2285362651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc0094d0 con 0x7fafec160f30 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff0961640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec071760 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fafe4007e60 tx=0x7fafe400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafe8ff9640 1 -- 172.21.15.53:0/2285362651 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4014420 con 0x7fafec160f30 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafe8ff9640 1 -- 172.21.15.53:0/2285362651 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe40145a0 con 0x7fafec160f30 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec157490 con 0x7fafec160f30 2024-09-13T18:33:53.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafe8ff9640 1 -- 172.21.15.53:0/2285362651 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4014950 con 0x7fafec160f30 2024-09-13T18:33:53.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec157f70 con 0x7fafec160f30 2024-09-13T18:33:53.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec160700 con 0x7fafec160f30 2024-09-13T18:33:53.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafe8ff9640 1 -- 172.21.15.53:0/2285362651 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fafe4014ab0 con 0x7fafec160f30 2024-09-13T18:33:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafe8ff9640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafd8066e70 0x7fafd8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafe8ff9640 1 -- 172.21.15.53:0/2285362651 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fafe4083110 con 0x7fafec160f30 2024-09-13T18:33:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.252+0000 7fafebfff640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafd8066e70 0x7fafd8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.256+0000 7fafebfff640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafd8066e70 0x7fafd8069330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fafec1f8940 tx=0x7fafe0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:53.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.256+0000 7fafe8ff9640 1 -- 172.21.15.53:0/2285362651 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafe4052080 con 0x7fafec160f30 2024-09-13T18:33:53.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.420+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fafec157c20 con 0x7fafec160f30 2024-09-13T18:33:53.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7fafe8ff9640 1 -- 172.21.15.53:0/2285362651 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fafe40556a0 con 0x7fafec160f30 2024-09-13T18:33:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafd8066e70 msgr2=0x7fafd8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafd8066e70 0x7fafd8069330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fafec1f8940 tx=0x7fafe0008040 comp rx=0 tx=0).stop 2024-09-13T18:33:53.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 msgr2=0x7fafec071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec071760 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fafe4007e60 tx=0x7fafe400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 shutdown_connections 2024-09-13T18:33:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafd8066e70 0x7fafd8069330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafec160320 0x7fafec071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafec160f30 0x7fafec071760 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 --2- 172.21.15.53:0/2285362651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafec0ccb80 0x7fafec156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 >> 172.21.15.53:0/2285362651 conn(0x7fafec0b0a30 msgr2=0x7fafec06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 shutdown_connections 2024-09-13T18:33:53.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.428+0000 7faff23c4640 1 -- 172.21.15.53:0/2285362651 wait complete. 2024-09-13T18:33:53.449 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:33:53.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:53.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:33:53.582 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:33:53.583 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:33:53.583 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:53.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:53.589 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:53.589 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:53.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:53.595 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:33:53.595 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:53.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:33:53.640 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:33:53.640 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:33:53.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:33:53.646 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:33:53.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:33:53.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f9bfb640 1 Processor -- start 2024-09-13T18:33:53.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f9bfb640 1 -- start start 2024-09-13T18:33:53.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f9bfb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f76f41582a0 0x7f76f406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f9bfb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 0x7f76f406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f9bfb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f406d480 con 0x7f76f4070c90 2024-09-13T18:33:53.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f9bfb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f415aaf0 con 0x7f76f41582a0 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f9bfb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f406d760 con 0x7f76f415b7c0 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f76f4070c90 0x7f76f406f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34254/0 (socket says 172.21.15.53:34254) 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f3fff640 1 -- 172.21.15.53:0/3980174432 learned_addr learned my addr 172.21.15.53:0/3980174432 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f37fe640 1 --2- 172.21.15.53:0/3980174432 >> v2:172.21.15.87:3300/0 conn(0x7f76f41582a0 0x7f76f406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f2ffd640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 0x7f76f406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627479228 0 0) 0x7f76f406d480 con 0x7f76f4070c90 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76dc003530 con 0x7f76f4070c90 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196369730 0 0) 0x7f76dc003530 con 0x7f76f4070c90 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 msgr2=0x7f76f406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 0x7f76f406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 >> v2:172.21.15.87:3300/0 conn(0x7f76f41582a0 msgr2=0x7f76f406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 --2- 172.21.15.53:0/3980174432 >> v2:172.21.15.87:3300/0 conn(0x7f76f41582a0 0x7f76f406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f415ace0 con 0x7f76f4070c90 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f76ec001a00 con 0x7f76f4070c90 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 >> v1:172.21.15.53:6789/0 conn(0x7f76f4070c90 legacy=0x7f76f406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc003980 0x7f76dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc0047d0 0x7f76dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 0x7f76dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc00b990 con 0x7f76dc003980 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc00bad0 con 0x7f76dc0047d0 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc00bc10 con 0x7f76f415b7c0 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f37fe640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc003980 0x7f76dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f2ffd640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc0047d0 0x7f76dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f3fff640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 0x7f76dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f37fe640 1 -- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 msgr2=0x7f76dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f37fe640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f415b7c0 0x7f76dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f37fe640 1 -- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc0047d0 msgr2=0x7f76dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f37fe640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc0047d0 0x7f76dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.812+0000 7f76f37fe640 1 -- 172.21.15.53:0/3980174432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc003530 con 0x7f76dc003980 2024-09-13T18:33:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f37fe640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc003980 0x7f76dc003da0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009ae0 tx=0x7f76e401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd71ff94b8f0b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40a6490 con 0x7f76dc003980 2024-09-13T18:33:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e40a65f0 con 0x7f76dc003980 2024-09-13T18:33:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f27fc640 1 -- 172.21.15.53:0/3980174432 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40a69a0 con 0x7f76dc003980 2024-09-13T18:33:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f9bfb640 1 -- 172.21.15.53:0/3980174432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc003980 msgr2=0x7f76dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f9bfb640 1 --2- 172.21.15.53:0/3980174432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc003980 0x7f76dc003da0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009ae0 tx=0x7f76e401ca80 comp rx=0 tx=0).stop 2024-09-13T18:33:53.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f3fff640 1 -- 172.21.15.53:0/3980174432 reap_dead start 2024-09-13T18:33:53.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f9bfb640 1 -- 172.21.15.53:0/3980174432 shutdown_connections 2024-09-13T18:33:53.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f9bfb640 1 -- 172.21.15.53:0/3980174432 >> 172.21.15.53:0/3980174432 conn(0x7f76f4065c80 msgr2=0x7f76f4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:53.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f9bfb640 1 -- 172.21.15.53:0/3980174432 shutdown_connections 2024-09-13T18:33:53.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f9bfb640 1 -- 172.21.15.53:0/3980174432 wait complete. 2024-09-13T18:33:53.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.816+0000 7f76f9bfb640 1 Processor -- start 2024-09-13T18:33:53.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 -- start start 2024-09-13T18:33:53.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc003980 0x7f76f41620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76f40cd200 0x7f76f40cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f413a810 0x7f76f413ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f413b1d0 con 0x7f76f40cd200 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4163380 con 0x7f76dc003980 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f414fb30 con 0x7f76f413a810 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76f40cd200 0x7f76f40cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76f40cd200 0x7f76f40cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52372/0 (socket says 172.21.15.53:52372) 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 -- 172.21.15.53:0/35496845 learned_addr learned my addr 172.21.15.53:0/35496845 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f37fe640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc003980 0x7f76f41620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f3fff640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f413a810 0x7f76f413ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 -- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f413a810 msgr2=0x7f76f413ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f413a810 0x7f76f413ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 -- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc003980 msgr2=0x7f76f41620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:53.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc003980 0x7f76f41620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:53.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 -- 172.21.15.53:0/35496845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4162770 con 0x7f76f40cd200 2024-09-13T18:33:53.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f2ffd640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76f40cd200 0x7f76f40cc4d0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011610 tx=0x7f76e8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:53.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76dbfff640 1 -- 172.21.15.53:0/35496845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800f8f0 con 0x7f76f40cd200 2024-09-13T18:33:53.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76dbfff640 1 -- 172.21.15.53:0/35496845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e800fa50 con 0x7f76f40cd200 2024-09-13T18:33:53.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f4162a50 con 0x7f76f40cd200 2024-09-13T18:33:53.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76dbfff640 1 -- 172.21.15.53:0/35496845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800fdc0 con 0x7f76f40cd200 2024-09-13T18:33:53.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f4163010 con 0x7f76f40cd200 2024-09-13T18:33:53.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f4067400 con 0x7f76f40cd200 2024-09-13T18:33:53.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.820+0000 7f76dbfff640 1 -- 172.21.15.53:0/35496845 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f76e8015460 con 0x7f76f40cd200 2024-09-13T18:33:53.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.824+0000 7f76dbfff640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f76e0066e70 0x7f76e0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:53.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.824+0000 7f76f37fe640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f76e0066e70 0x7f76e0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:53.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.824+0000 7f76dbfff640 1 -- 172.21.15.53:0/35496845 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f76e8082d00 con 0x7f76f40cd200 2024-09-13T18:33:53.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.824+0000 7f76f37fe640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f76e0066e70 0x7f76e0069330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f76e40ad000 tx=0x7f76e40046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:53.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:53.828+0000 7f76dbfff640 1 -- 172.21.15.53:0/35496845 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f76e8051be0 con 0x7f76f40cd200 2024-09-13T18:33:54.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.024+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76f406c900 con 0x7f76f40cd200 2024-09-13T18:33:54.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.024+0000 7f76dbfff640 1 -- 172.21.15.53:0/35496845 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f76e8022070 con 0x7f76f40cd200 2024-09-13T18:33:54.027 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:54.028 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/234820268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":234820268},{"type":"v1","addr":"172.21.15.87:6835","nonce":234820268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/2552754296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":2552754296},{"type":"v1","addr":"172.21.15.87:6833","nonce":2552754296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9552,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1877336010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1877336010},{"type":"v1","addr":"172.21.15.53:6833","nonce":1877336010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/171071471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":171071471},{"type":"v1","addr":"172.21.15.53:6835","nonce":171071471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[]} 2024-09-13T18:33:54.028 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 91 2024-09-13T18:33:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f76e0066e70 msgr2=0x7f76e0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:54.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f76e0066e70 0x7f76e0069330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f76e40ad000 tx=0x7f76e40046d0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76f40cd200 msgr2=0x7f76f40cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76f40cd200 0x7f76f40cc4d0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011610 tx=0x7f76e8011ad0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 shutdown_connections 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f76e0066e70 0x7f76e0069330 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76f413a810 0x7f76f413ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76f40cd200 0x7f76f40cc4d0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 --2- 172.21.15.53:0/35496845 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76dc003980 0x7f76f41620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 >> 172.21.15.53:0/35496845 conn(0x7f76f4065c80 msgr2=0x7f76f406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 shutdown_connections 2024-09-13T18:33:54.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.028+0000 7f76f9bfb640 1 -- 172.21.15.53:0/35496845 wait complete. 2024-09-13T18:33:54.046 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:33:54.046 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:33:54.047 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:33:54.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:54.047 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:33:54.047 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:33:54.047 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:33:54.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:54.048 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:33:54.048 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:33:54.048 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:33:54.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:54.048 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:33:54.049 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:33:54.049 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:33:54.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:33:54.058 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:33:54.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:33:54.059 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:33:54.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:33:54.062 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:33:54.062 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:33:54.065 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:33:54.065 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:33:54.106 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:33:54.107 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:54.108 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:33:54.108 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:54.109 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:33:54.110 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:54.111 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:33:54.111 DEBUG:teuthology.parallel:result is None 2024-09-13T18:33:54.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:33:54.174 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:33:54.175 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:33:54.180 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:33:54.184 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:33:54.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5d00efa640 1 Processor -- start 2024-09-13T18:33:54.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5d00efa640 1 -- start start 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5d00efa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5cfc072d30 0x7f5cfc06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5d00efa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc0cd6c0 con 0x7f5cfc15a800 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5d00efa640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc0734e0 con 0x7f5cfc0cb220 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5d00efa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc073200 con 0x7f5cfc072d30 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cf9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5cfc072d30 0x7f5cfc06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cf9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5cfc072d30 0x7f5cfc06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52390/0 (socket says 172.21.15.53:52390) 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cf9d9b640 1 -- 172.21.15.53:0/3873655568 learned_addr learned my addr 172.21.15.53:0/3873655568 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cfa59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5cfc15a800 0x7f5cfc0711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34262/0 (socket says 172.21.15.53:34262) 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cf9d9b640 1 -- 172.21.15.53:0/3873655568 >> v1:172.21.15.87:6789/0 conn(0x7f5cfc0cb220 legacy=0x7f5cfc06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cf9d9b640 1 -- 172.21.15.53:0/3873655568 >> v1:172.21.15.53:6789/0 conn(0x7f5cfc15a800 legacy=0x7f5cfc0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:54.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cf9d9b640 1 -- 172.21.15.53:0/3873655568 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0ce420 con 0x7f5cfc072d30 2024-09-13T18:33:54.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.224+0000 7f5cf959a640 1 -- 172.21.15.53:0/3873655568 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511165608 0 0) 0x7f5cfc0cd6c0 con 0x7f5cfc15a800 2024-09-13T18:33:54.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5cf9d9b640 1 --2- 172.21.15.53:0/3873655568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc072d30 0x7f5cfc06bc90 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009870 tx=0x7f5cf001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5172fab361b5105 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:54.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5cf959a640 1 -- 172.21.15.53:0/3873655568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00ad660 con 0x7f5cfc072d30 2024-09-13T18:33:54.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5cf959a640 1 -- 172.21.15.53:0/3873655568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf00ad7c0 con 0x7f5cfc072d30 2024-09-13T18:33:54.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5cf959a640 1 -- 172.21.15.53:0/3873655568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00adb50 con 0x7f5cfc072d30 2024-09-13T18:33:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 -- 172.21.15.53:0/3873655568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc072d30 msgr2=0x7f5cfc06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:54.236 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 --2- 172.21.15.53:0/3873655568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc072d30 0x7f5cfc06bc90 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009870 tx=0x7f5cf001c560 comp rx=0 tx=0).stop 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 -- 172.21.15.53:0/3873655568 shutdown_connections 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 --2- 172.21.15.53:0/3873655568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc072d30 0x7f5cfc06bc90 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 -- 172.21.15.53:0/3873655568 >> 172.21.15.53:0/3873655568 conn(0x7f5cfc069f50 msgr2=0x7f5cfc06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 -- 172.21.15.53:0/3873655568 shutdown_connections 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 -- 172.21.15.53:0/3873655568 wait complete. 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 Processor -- start 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.228+0000 7f5d00efa640 1 -- start start 2024-09-13T18:33:54.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cfc072d30 0x7f5cfc09b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cfc0cb220 0x7f5cfc151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc15a800 0x7f5cfc1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc158490 con 0x7f5cfc15a800 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc09b9b0 con 0x7f5cfc072d30 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc157880 con 0x7f5cfc0cb220 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc15a800 0x7f5cfc1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc15a800 0x7f5cfc1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52392/0 (socket says 172.21.15.53:52392) 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 -- 172.21.15.53:0/2667147180 learned_addr learned my addr 172.21.15.53:0/2667147180 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cf9d9b640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cfc0cb220 0x7f5cfc151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:54.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfa59c640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cfc072d30 0x7f5cfc09b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 -- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cfc0cb220 msgr2=0x7f5cfc151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cfc0cb220 0x7f5cfc151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 -- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cfc072d30 msgr2=0x7f5cfc09b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cfc072d30 0x7f5cfc09b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 -- 172.21.15.53:0/2667147180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00094d0 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfa59c640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cfc072d30 0x7f5cfc09b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfad9d640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc15a800 0x7f5cfc1517d0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c7a0 tx=0x7f5cf400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5ceaffd640 1 -- 172.21.15.53:0/2667147180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4003b80 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5ceaffd640 1 -- 172.21.15.53:0/2667147180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf4003ce0 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc0cdcd0 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5ceaffd640 1 -- 172.21.15.53:0/2667147180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400aa30 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc157e40 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc0cdb30 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5ceaffd640 1 -- 172.21.15.53:0/2667147180 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f5cf400ab90 con 0x7f5cfc15a800 2024-09-13T18:33:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5ceaffd640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cdc066e70 0x7f5cdc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfa59c640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cdc066e70 0x7f5cdc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5ceaffd640 1 -- 172.21.15.53:0/2667147180 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5cf40825e0 con 0x7f5cfc15a800 2024-09-13T18:33:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.232+0000 7f5cfa59c640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cdc066e70 0x7f5cdc069330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000f70 tx=0x7f5cec007c60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.236+0000 7f5ceaffd640 1 -- 172.21.15.53:0/2667147180 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5cfc0cdb30 con 0x7f5cfc15a800 2024-09-13T18:33:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:54.404+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5cfc0cdb30 con 0x7f5cfc15a800 2024-09-13T18:33:55.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.228+0000 7f5ceaffd640 1 -- 172.21.15.53:0/2667147180 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v158) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5cfc0cdb30 con 0x7f5cfc15a800 2024-09-13T18:33:55.231 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:33:55.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cdc066e70 msgr2=0x7f5cdc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cdc066e70 0x7f5cdc069330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000f70 tx=0x7f5cec007c60 comp rx=0 tx=0).stop 2024-09-13T18:33:55.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc15a800 msgr2=0x7f5cfc1517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc15a800 0x7f5cfc1517d0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c7a0 tx=0x7f5cf400cc60 comp rx=0 tx=0).stop 2024-09-13T18:33:55.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 shutdown_connections 2024-09-13T18:33:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cdc066e70 0x7f5cdc069330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cfc0cb220 0x7f5cfc151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cfc15a800 0x7f5cfc1517d0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 --2- 172.21.15.53:0/2667147180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cfc072d30 0x7f5cfc09b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 >> 172.21.15.53:0/2667147180 conn(0x7f5cfc069f50 msgr2=0x7f5cfc0af350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 shutdown_connections 2024-09-13T18:33:55.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.232+0000 7f5d00efa640 1 -- 172.21.15.53:0/2667147180 wait complete. 2024-09-13T18:33:55.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:33:55.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda23ebb640 1 Processor -- start 2024-09-13T18:33:55.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda23ebb640 1 -- start start 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda23ebb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda1c06fa80 0x7fda1c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda23ebb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda23ebb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c0b2340 con 0x7fda1c158ba0 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda23ebb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0b2860 con 0x7fda1c06fa80 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda23ebb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c158f80 con 0x7fda1c0cbb60 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda21c57640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fda1c158ba0 0x7fda1c06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34278/0 (socket says 172.21.15.53:34278) 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda21456640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda1c06fa80 0x7fda1c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda21c57640 1 -- 172.21.15.53:0/1984734025 learned_addr learned my addr 172.21.15.53:0/1984734025 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda22458640 1 --2- 172.21.15.53:0/1984734025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda21456640 1 -- 172.21.15.53:0/1984734025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 msgr2=0x7fda1c0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda21456640 1 --2- 172.21.15.53:0/1984734025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c0b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda21456640 1 -- 172.21.15.53:0/1984734025 >> v1:172.21.15.53:6789/0 conn(0x7fda1c158ba0 legacy=0x7fda1c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda20c55640 1 -- 172.21.15.53:0/1984734025 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761523321 0 0) 0x7fda18001120 con 0x7fda1c158ba0 2024-09-13T18:33:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda21456640 1 -- 172.21.15.53:0/1984734025 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0b2580 con 0x7fda1c06fa80 2024-09-13T18:33:55.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.384+0000 7fda22458640 1 --2- 172.21.15.53:0/1984734025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda21456640 1 --2- 172.21.15.53:0/1984734025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c06b390 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097c0 tx=0x7fda0c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e125e41578c8cff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda20c55640 1 -- 172.21.15.53:0/1984734025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0ad640 con 0x7fda1c06fa80 2024-09-13T18:33:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda20c55640 1 -- 172.21.15.53:0/1984734025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0ad7a0 con 0x7fda1c06fa80 2024-09-13T18:33:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda20c55640 1 -- 172.21.15.53:0/1984734025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0adb30 con 0x7fda1c06fa80 2024-09-13T18:33:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 -- 172.21.15.53:0/1984734025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 msgr2=0x7fda1c06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1984734025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c06b390 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097c0 tx=0x7fda0c01c410 comp rx=0 tx=0).stop 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 -- 172.21.15.53:0/1984734025 shutdown_connections 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1984734025 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1984734025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c06b390 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 -- 172.21.15.53:0/1984734025 >> 172.21.15.53:0/1984734025 conn(0x7fda1c065c80 msgr2=0x7fda1c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 -- 172.21.15.53:0/1984734025 shutdown_connections 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 -- 172.21.15.53:0/1984734025 wait complete. 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 Processor -- start 2024-09-13T18:33:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.388+0000 7fda23ebb640 1 -- start start 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c158ba0 0x7fda1c152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c14a780 con 0x7fda1c06fa80 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0ad600 con 0x7fda1c158ba0 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0ac9f0 con 0x7fda1c0cbb60 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52410/0 (socket says 172.21.15.53:52410) 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 -- 172.21.15.53:0/1976456960 learned_addr learned my addr 172.21.15.53:0/1976456960 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda22458640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c158ba0 0x7fda1c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 -- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 msgr2=0x7fda1c14a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21456640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c14a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 -- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c158ba0 msgr2=0x7fda1c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c158ba0 0x7fda1c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 -- 172.21.15.53:0/1976456960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009420 con 0x7fda1c06fa80 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda22458640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c158ba0 0x7fda1c152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21456640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21c57640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c149470 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c480 tx=0x7fda1800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda127fc640 1 -- 172.21.15.53:0/1976456960 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180074e0 con 0x7fda1c06fa80 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda127fc640 1 -- 172.21.15.53:0/1976456960 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18007660 con 0x7fda1c06fa80 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c0accd0 con 0x7fda1c06fa80 2024-09-13T18:33:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda127fc640 1 -- 172.21.15.53:0/1976456960 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18004a30 con 0x7fda1c06fa80 2024-09-13T18:33:55.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c0ad290 con 0x7fda1c06fa80 2024-09-13T18:33:55.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c067400 con 0x7fda1c06fa80 2024-09-13T18:33:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda127fc640 1 -- 172.21.15.53:0/1976456960 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fda18004b90 con 0x7fda1c06fa80 2024-09-13T18:33:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda127fc640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda00066e70 0x7fda00069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda127fc640 1 -- 172.21.15.53:0/1976456960 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda18081c20 con 0x7fda1c06fa80 2024-09-13T18:33:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21456640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda00066e70 0x7fda00069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.392+0000 7fda21456640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda00066e70 0x7fda00069330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0af000 tx=0x7fda0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:55.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.396+0000 7fda127fc640 1 -- 172.21.15.53:0/1976456960 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda18054620 con 0x7fda1c06fa80 2024-09-13T18:33:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.616+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fda1c0b2340 con 0x7fda1c06fa80 2024-09-13T18:33:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.616+0000 7fda127fc640 1 -- 172.21.15.53:0/1976456960 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fda1c0b2340 con 0x7fda1c06fa80 2024-09-13T18:33:55.618 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:55.618 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.619 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.620 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:55.621 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.623 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.627 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:33:55.629 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:33:55.630 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:55.631 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:33:55.632 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.616+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda00066e70 msgr2=0x7fda00069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.616+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda00066e70 0x7fda00069330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0af000 tx=0x7fda0c008040 comp rx=0 tx=0).stop 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.616+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 msgr2=0x7fda1c149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.616+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c149470 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c480 tx=0x7fda1800c940 comp rx=0 tx=0).stop 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 shutdown_connections 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fda00066e70 0x7fda00069330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda1c0cbb60 0x7fda1c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda1c158ba0 0x7fda1c152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 --2- 172.21.15.53:0/1976456960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c06fa80 0x7fda1c149470 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 >> 172.21.15.53:0/1976456960 conn(0x7fda1c065c80 msgr2=0x7fda1c06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:55.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 shutdown_connections 2024-09-13T18:33:55.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.620+0000 7fda23ebb640 1 -- 172.21.15.53:0/1976456960 wait complete. 2024-09-13T18:33:55.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9829f640 1 Processor -- start 2024-09-13T18:33:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9829f640 1 -- start start 2024-09-13T18:33:55.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9829f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdf9015cab0 0x7fdf900d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9829f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900d2400 con 0x7fdf900cf7d0 2024-09-13T18:33:55.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9829f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf900d1530 con 0x7fdf900cd6c0 2024-09-13T18:33:55.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9829f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900d0920 con 0x7fdf9015cab0 2024-09-13T18:33:55.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9683c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdf900cf7d0 0x7fdf900b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34288/0 (socket says 172.21.15.53:34288) 2024-09-13T18:33:55.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9683c640 1 -- 172.21.15.53:0/2709950944 learned_addr learned my addr 172.21.15.53:0/2709950944 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:55.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9603b640 1 --2- 172.21.15.53:0/2709950944 >> v2:172.21.15.87:3300/0 conn(0x7fdf9015cab0 0x7fdf900d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274807877 0 0) 0x7fdf900d2400 con 0x7fdf900cf7d0 2024-09-13T18:33:55.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf78003530 con 0x7fdf900cf7d0 2024-09-13T18:33:55.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165270279 0 0) 0x7fdf78003530 con 0x7fdf900cf7d0 2024-09-13T18:33:55.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 >> v2:172.21.15.87:3300/0 conn(0x7fdf9015cab0 msgr2=0x7fdf900d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:55.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 --2- 172.21.15.53:0/2709950944 >> v2:172.21.15.87:3300/0 conn(0x7fdf9015cab0 0x7fdf900d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 >> v1:172.21.15.87:6789/0 conn(0x7fdf900cd6c0 legacy=0x7fdf900cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.757 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900d0c00 con 0x7fdf900cf7d0 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdf88001680 con 0x7fdf900cf7d0 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 >> v1:172.21.15.53:6789/0 conn(0x7fdf900cf7d0 legacy=0x7fdf900b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf78003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf780047d0 0x7fdf78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf78005190 0x7fdf7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900d0920 con 0x7fdf78003980 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7800c030 con 0x7fdf78005190 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7800c1f0 con 0x7fdf780047d0 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9603b640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf78003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9583a640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf780047d0 0x7fdf78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9683c640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf78005190 0x7fdf7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9603b640 1 -- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf780047d0 msgr2=0x7fdf78004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9603b640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf780047d0 0x7fdf78004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9603b640 1 -- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf78005190 msgr2=0x7fdf7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:55.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9603b640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf78005190 0x7fdf7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9603b640 1 -- 172.21.15.53:0/2709950944 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78003530 con 0x7fdf78003980 2024-09-13T18:33:55.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.752+0000 7fdf9683c640 1 -- 172.21.15.53:0/2709950944 reap_dead start 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9603b640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf78003da0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009fc0 tx=0x7fdf8001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bacc04886566526 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800a5c40 con 0x7fdf78003980 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8000f040 con 0x7fdf78003980 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf95039640 1 -- 172.21.15.53:0/2709950944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800ad440 con 0x7fdf78003980 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 -- 172.21.15.53:0/2709950944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 msgr2=0x7fdf78003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf78003da0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009fc0 tx=0x7fdf8001cc50 comp rx=0 tx=0).stop 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 -- 172.21.15.53:0/2709950944 shutdown_connections 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 --2- 172.21.15.53:0/2709950944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf78003da0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 -- 172.21.15.53:0/2709950944 >> 172.21.15.53:0/2709950944 conn(0x7fdf90065c80 msgr2=0x7fdf90066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 -- 172.21.15.53:0/2709950944 shutdown_connections 2024-09-13T18:33:55.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 -- 172.21.15.53:0/2709950944 wait complete. 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 Processor -- start 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.756+0000 7fdf9829f640 1 -- start start 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf900a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf900cc310 0x7fdf901e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf901ea180 0x7fdf901ea600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf901eab40 con 0x7fdf78003980 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900a96e0 con 0x7fdf900cc310 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9015c170 con 0x7fdf901ea180 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf900a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf900a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52424/0 (socket says 172.21.15.53:52424) 2024-09-13T18:33:55.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 -- 172.21.15.53:0/1278568689 learned_addr learned my addr 172.21.15.53:0/1278568689 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9583a640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf900cc310 0x7fdf901e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9683c640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf901ea180 0x7fdf901ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 -- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf901ea180 msgr2=0x7fdf901ea600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf901ea180 0x7fdf901ea600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 -- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf900cc310 msgr2=0x7fdf901e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf900cc310 0x7fdf901e9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 -- 172.21.15.53:0/1278568689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900aabc0 con 0x7fdf78003980 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9683c640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf901ea180 0x7fdf901ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9603b640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf900a91a0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fdf8001c6c0 tx=0x7fdf80009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf8effd640 1 -- 172.21.15.53:0/1278568689 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800bd070 con 0x7fdf78003980 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf8effd640 1 -- 172.21.15.53:0/1278568689 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf800039a0 con 0x7fdf78003980 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf900cc840 con 0x7fdf78003980 2024-09-13T18:33:55.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf8effd640 1 -- 172.21.15.53:0/1278568689 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80003d30 con 0x7fdf78003980 2024-09-13T18:33:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf900cce00 con 0x7fdf78003980 2024-09-13T18:33:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf900cf0c0 con 0x7fdf78003980 2024-09-13T18:33:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf8effd640 1 -- 172.21.15.53:0/1278568689 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fdf800b4040 con 0x7fdf78003980 2024-09-13T18:33:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf8effd640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf7c066ea0 0x7fdf7c069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf8effd640 1 -- 172.21.15.53:0/1278568689 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf8011c9c0 con 0x7fdf78003980 2024-09-13T18:33:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.760+0000 7fdf9583a640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf7c066ea0 0x7fdf7c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.764+0000 7fdf9583a640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf7c066ea0 0x7fdf7c069360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdf90074340 tx=0x7fdf84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:55.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.764+0000 7fdf8effd640 1 -- 172.21.15.53:0/1278568689 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf800eb930 con 0x7fdf78003980 2024-09-13T18:33:55.876 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:33:55.880 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:33:55.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf9015ddd0 con 0x7fdf78003980 2024-09-13T18:33:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf8effd640 1 -- 172.21.15.53:0/1278568689 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+12807 (secure 0 0 0) 0x7fdf800b2070 con 0x7fdf78003980 2024-09-13T18:33:55.930 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:55.930 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":158,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:55.225683+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf7c066ea0 msgr2=0x7fdf7c069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf7c066ea0 0x7fdf7c069360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdf90074340 tx=0x7fdf84009040 comp rx=0 tx=0).stop 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 msgr2=0x7fdf900a91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf900a91a0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fdf8001c6c0 tx=0x7fdf80009750 comp rx=0 tx=0).stop 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 shutdown_connections 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdf7c066ea0 0x7fdf7c069360 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf901ea180 0x7fdf901ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf900cc310 0x7fdf901e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 --2- 172.21.15.53:0/1278568689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf78003980 0x7fdf900a91a0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 >> 172.21.15.53:0/1278568689 conn(0x7fdf90065c80 msgr2=0x7fdf900b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 shutdown_connections 2024-09-13T18:33:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:55.928+0000 7fdf9829f640 1 -- 172.21.15.53:0/1278568689 wait complete. 2024-09-13T18:33:55.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:33:55.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:33:56.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce3f0a640 1 Processor -- start 2024-09-13T18:33:56.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce3f0a640 1 -- start start 2024-09-13T18:33:56.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce3f0a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5cdc157020 0x7f5cdc06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce3f0a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc06d270 0x7f5cdc06f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce3f0a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc06d6e0 con 0x7f5cdc156c40 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce3f0a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0715f0 con 0x7f5cdc157020 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce3f0a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b15a0 con 0x7f5cdc06d270 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce24a7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc06d270 0x7f5cdc06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce14a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5cdc157020 0x7f5cdc06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce14a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5cdc157020 0x7f5cdc06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:33456/0 (socket says 172.21.15.53:33456) 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce14a5640 1 -- 172.21.15.53:0/996455900 learned_addr learned my addr 172.21.15.53:0/996455900 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce24a7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc06d270 0x7f5cdc06f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:43276/0 (socket says 172.21.15.53:43276) 2024-09-13T18:33:56.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce1ca6640 1 --1- 172.21.15.53:0/996455900 >> v1:172.21.15.87:6789/0 conn(0x7f5cdc156c40 0x7f5cdc070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:35458/0 (socket says 172.21.15.53:35458) 2024-09-13T18:33:56.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce14a5640 1 -- 172.21.15.53:0/996455900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc06d270 msgr2=0x7f5cdc06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:56.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce14a5640 1 --2- 172.21.15.53:0/996455900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc06d270 0x7f5cdc06f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce14a5640 1 -- 172.21.15.53:0/996455900 >> v1:172.21.15.87:6789/0 conn(0x7f5cdc156c40 legacy=0x7f5cdc070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.120+0000 7f5ce14a5640 1 -- 172.21.15.53:0/996455900 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0b1880 con 0x7f5cdc157020 2024-09-13T18:33:56.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce14a5640 1 --2- 172.21.15.53:0/996455900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc157020 0x7f5cdc06cd30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009870 tx=0x7f5ccc01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f732dad8fab41d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce0ca4640 1 -- 172.21.15.53:0/996455900 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0a95f0 con 0x7f5cdc157020 2024-09-13T18:33:56.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce0ca4640 1 -- 172.21.15.53:0/996455900 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0a9750 con 0x7f5cdc157020 2024-09-13T18:33:56.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce0ca4640 1 -- 172.21.15.53:0/996455900 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0a9ae0 con 0x7f5cdc157020 2024-09-13T18:33:56.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/996455900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc157020 msgr2=0x7f5cdc06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/996455900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc157020 0x7f5cdc06cd30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009870 tx=0x7f5ccc01c530 comp rx=0 tx=0).stop 2024-09-13T18:33:56.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/996455900 shutdown_connections 2024-09-13T18:33:56.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/996455900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc06d270 0x7f5cdc06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/996455900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc157020 0x7f5cdc06cd30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/996455900 >> 172.21.15.53:0/996455900 conn(0x7f5cdc065c80 msgr2=0x7f5cdc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:56.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/996455900 shutdown_connections 2024-09-13T18:33:56.128 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/996455900 wait complete. 2024-09-13T18:33:56.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 Processor -- start 2024-09-13T18:33:56.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- start start 2024-09-13T18:33:56.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc06d270 0x7f5cdc140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cdc156c40 0x7f5cdc155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc155dd0 0x7f5cdc0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc154460 con 0x7f5cdc156c40 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc1f6490 con 0x7f5cdc06d270 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce3f0a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc1f5880 con 0x7f5cdc155dd0 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce14a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cdc156c40 0x7f5cdc155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce14a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cdc156c40 0x7f5cdc155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52426/0 (socket says 172.21.15.53:52426) 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce14a5640 1 -- 172.21.15.53:0/1705461295 learned_addr learned my addr 172.21.15.53:0/1705461295 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce1ca6640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc06d270 0x7f5cdc140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.124+0000 7f5ce24a7640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc155dd0 0x7f5cdc0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce14a5640 1 -- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc155dd0 msgr2=0x7f5cdc0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce14a5640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc155dd0 0x7f5cdc0cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce14a5640 1 -- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc06d270 msgr2=0x7f5cdc140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce14a5640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc06d270 0x7f5cdc140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce14a5640 1 -- 172.21.15.53:0/1705461295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0094d0 con 0x7f5cdc156c40 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce1ca6640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc06d270 0x7f5cdc140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce14a5640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cdc156c40 0x7f5cdc155890 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc01abe0 tx=0x7f5ccc0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5cd27fc640 1 -- 172.21.15.53:0/1705461295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0bb5f0 con 0x7f5cdc156c40 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5cd27fc640 1 -- 172.21.15.53:0/1705461295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0bb770 con 0x7f5cdc156c40 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc1f5b60 con 0x7f5cdc156c40 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5cd27fc640 1 -- 172.21.15.53:0/1705461295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0bbb20 con 0x7f5cdc156c40 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc1f6120 con 0x7f5cdc156c40 2024-09-13T18:33:56.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc1f65d0 con 0x7f5cdc156c40 2024-09-13T18:33:56.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5cd27fc640 1 -- 172.21.15.53:0/1705461295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f5ccc0b1600 con 0x7f5cdc156c40 2024-09-13T18:33:56.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5cd27fc640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cc0066ea0 0x7f5cc0069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5cd27fc640 1 -- 172.21.15.53:0/1705461295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ccc11d490 con 0x7f5cdc156c40 2024-09-13T18:33:56.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce1ca6640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cc0066ea0 0x7f5cc0069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.128+0000 7f5ce1ca6640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cc0066ea0 0x7f5cc0069360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc156410 tx=0x7f5cd8007d90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.132+0000 7f5cd27fc640 1 -- 172.21.15.53:0/1705461295 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5cdc1f65d0 con 0x7f5cdc156c40 2024-09-13T18:33:56.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cdc1f65d0 con 0x7f5cdc156c40 2024-09-13T18:33:56.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5cd27fc640 1 -- 172.21.15.53:0/1705461295 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cdc1f65d0 con 0x7f5cdc156c40 2024-09-13T18:33:56.294 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:33:56.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cc0066ea0 msgr2=0x7f5cc0069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cc0066ea0 0x7f5cc0069360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc156410 tx=0x7f5cd8007d90 comp rx=0 tx=0).stop 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cdc156c40 msgr2=0x7f5cdc155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cdc156c40 0x7f5cdc155890 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc01abe0 tx=0x7f5ccc0192d0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 shutdown_connections 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5cc0066ea0 0x7f5cc0069360 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5cdc155dd0 0x7f5cdc0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5cdc156c40 0x7f5cdc155890 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 --2- 172.21.15.53:0/1705461295 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cdc06d270 0x7f5cdc140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 >> 172.21.15.53:0/1705461295 conn(0x7f5cdc065c80 msgr2=0x7f5cdc0b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 shutdown_connections 2024-09-13T18:33:56.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.292+0000 7f5ce3f0a640 1 -- 172.21.15.53:0/1705461295 wait complete. 2024-09-13T18:33:56.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:33:56.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f5818332640 1 Processor -- start 2024-09-13T18:33:56.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f5818332640 1 -- start start 2024-09-13T18:33:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f5818332640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58100cc270 0x7f581015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f5818332640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58100b1c10 0x7f58100b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f5818332640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581006f550 con 0x7f581015a470 2024-09-13T18:33:56.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f5818332640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581006f880 con 0x7f58100b1c10 2024-09-13T18:33:56.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f5818332640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58100b2600 con 0x7f58100cc270 2024-09-13T18:33:56.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58158cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58100cc270 0x7f581015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58168cf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58100b1c10 0x7f58100b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58160ce640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f581015a470 0x7f5810071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:35468/0 (socket says 172.21.15.53:35468) 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58160ce640 1 -- 172.21.15.53:0/2915537505 learned_addr learned my addr 172.21.15.53:0/2915537505 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58150cc640 1 -- 172.21.15.53:0/2915537505 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545666029 0 0) 0x7f581006f550 con 0x7f581015a470 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58150cc640 1 -- 172.21.15.53:0/2915537505 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57fc003530 con 0x7f581015a470 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58168cf640 1 -- 172.21.15.53:0/2915537505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58100cc270 msgr2=0x7f581015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58168cf640 1 --2- 172.21.15.53:0/2915537505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58100cc270 0x7f581015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58168cf640 1 -- 172.21.15.53:0/2915537505 >> v1:172.21.15.87:6789/0 conn(0x7f581015a470 legacy=0x7f5810071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.436+0000 7f58168cf640 1 -- 172.21.15.53:0/2915537505 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581015dc40 con 0x7f58100b1c10 2024-09-13T18:33:56.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f58168cf640 1 --2- 172.21.15.53:0/2915537505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 0x7f58100b20c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5808009d90 tx=0x7f580801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6989e8a013eba4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f58150cc640 1 -- 172.21.15.53:0/2915537505 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080a5920 con 0x7f58100b1c10 2024-09-13T18:33:56.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f58150cc640 1 -- 172.21.15.53:0/2915537505 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58080a5a80 con 0x7f58100b1c10 2024-09-13T18:33:56.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f58150cc640 1 -- 172.21.15.53:0/2915537505 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080a5e10 con 0x7f58100b1c10 2024-09-13T18:33:56.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 -- 172.21.15.53:0/2915537505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 msgr2=0x7f58100b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 --2- 172.21.15.53:0/2915537505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 0x7f58100b20c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5808009d90 tx=0x7f580801c970 comp rx=0 tx=0).stop 2024-09-13T18:33:56.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 -- 172.21.15.53:0/2915537505 shutdown_connections 2024-09-13T18:33:56.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 --2- 172.21.15.53:0/2915537505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 0x7f58100b20c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 --2- 172.21.15.53:0/2915537505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58100cc270 0x7f581015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 -- 172.21.15.53:0/2915537505 >> 172.21.15.53:0/2915537505 conn(0x7f5810065c80 msgr2=0x7f5810066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:56.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 -- 172.21.15.53:0/2915537505 shutdown_connections 2024-09-13T18:33:56.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 -- 172.21.15.53:0/2915537505 wait complete. 2024-09-13T18:33:56.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 Processor -- start 2024-09-13T18:33:56.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.440+0000 7f5818332640 1 -- start start 2024-09-13T18:33:56.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 0x7f5810147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58100cc270 0x7f5810152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f581015a470 0x7f5810154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58101481b0 con 0x7f58100cc270 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810154770 con 0x7f58100b1c10 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58101555f0 con 0x7f581015a470 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58100cc270 0x7f5810152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58100cc270 0x7f5810152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52430/0 (socket says 172.21.15.53:52430) 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 -- 172.21.15.53:0/1701635392 learned_addr learned my addr 172.21.15.53:0/1701635392 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58160ce640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 0x7f5810147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58168cf640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f581015a470 0x7f5810154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 -- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f581015a470 msgr2=0x7f5810154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f581015a470 0x7f5810154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 -- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 msgr2=0x7f5810147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 0x7f5810147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 -- 172.21.15.53:0/1701635392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808009a70 con 0x7f58100cc270 2024-09-13T18:33:56.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58158cd640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58100cc270 0x7f5810152be0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f580000e900 tx=0x7f580000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5806ffd640 1 -- 172.21.15.53:0/1701635392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800009690 con 0x7f58100cc270 2024-09-13T18:33:56.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5806ffd640 1 -- 172.21.15.53:0/1701635392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580000c9a0 con 0x7f58100cc270 2024-09-13T18:33:56.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58101558d0 con 0x7f58100cc270 2024-09-13T18:33:56.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5806ffd640 1 -- 172.21.15.53:0/1701635392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000cd30 con 0x7f58100cc270 2024-09-13T18:33:56.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5810155e90 con 0x7f58100cc270 2024-09-13T18:33:56.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5810067400 con 0x7f58100cc270 2024-09-13T18:33:56.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5806ffd640 1 -- 172.21.15.53:0/1701635392 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f5800013470 con 0x7f58100cc270 2024-09-13T18:33:56.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5806ffd640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57f4066e70 0x7f57f4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f5806ffd640 1 -- 172.21.15.53:0/1701635392 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5800082d40 con 0x7f58100cc270 2024-09-13T18:33:56.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58160ce640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57f4066e70 0x7f57f4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.444+0000 7f58160ce640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57f4066e70 0x7f57f4069330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f580c007fd0 tx=0x7f580c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.448+0000 7f5806ffd640 1 -- 172.21.15.53:0/1701635392 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5800051d60 con 0x7f58100cc270 2024-09-13T18:33:56.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.604+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58101560b0 con 0x7f58100cc270 2024-09-13T18:33:56.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5806ffd640 1 -- 172.21.15.53:0/1701635392 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v158) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5800017090 con 0x7f58100cc270 2024-09-13T18:33:56.610 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:33:56.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:33:56.610 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:33:56.610 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:33:56.610 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:33:56.610 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:33:56.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57f4066e70 msgr2=0x7f57f4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57f4066e70 0x7f57f4069330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f580c007fd0 tx=0x7f580c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58100cc270 msgr2=0x7f5810152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58100cc270 0x7f5810152be0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f580000e900 tx=0x7f580000edc0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 shutdown_connections 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f57f4066e70 0x7f57f4069330 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f581015a470 0x7f5810154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58100cc270 0x7f5810152be0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 --2- 172.21.15.53:0/1701635392 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58100b1c10 0x7f5810147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 >> 172.21.15.53:0/1701635392 conn(0x7f5810065c80 msgr2=0x7f58100b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 shutdown_connections 2024-09-13T18:33:56.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.608+0000 7f5818332640 1 -- 172.21.15.53:0/1701635392 wait complete. 2024-09-13T18:33:56.627 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:33:56.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:33:56.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90eb437640 1 Processor -- start 2024-09-13T18:33:56.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90eb437640 1 -- start start 2024-09-13T18:33:56.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90eb437640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e4143d30 0x7f90e406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90eb437640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f90e406e050 0x7f90e4065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90eb437640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e406cd80 con 0x7f90e40cf050 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90eb437640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e406cfb0 con 0x7f90e406e050 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90eb437640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e406d290 con 0x7f90e4143d30 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e89d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f90e406e050 0x7f90e4065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e99d4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f90e40cf050 0x7f90e4070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50478/0 (socket says 172.21.15.53:50478) 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e89d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f90e406e050 0x7f90e4065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50534/0 (socket says 172.21.15.53:50534) 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e99d4640 1 -- 172.21.15.53:0/3775109658 learned_addr learned my addr 172.21.15.53:0/3775109658 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e91d3640 1 --2- 172.21.15.53:0/3775109658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e4143d30 0x7f90e406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e89d2640 1 -- 172.21.15.53:0/3775109658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e4143d30 msgr2=0x7f90e406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e89d2640 1 --2- 172.21.15.53:0/3775109658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e4143d30 0x7f90e406c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e89d2640 1 -- 172.21.15.53:0/3775109658 >> v1:172.21.15.53:6789/0 conn(0x7f90e40cf050 legacy=0x7f90e4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90e89d2640 1 -- 172.21.15.53:0/3775109658 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e406d570 con 0x7f90e406e050 2024-09-13T18:33:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.748+0000 7f90dbfff640 1 -- 172.21.15.53:0/3775109658 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801401982 0 0) 0x7f90e406cd80 con 0x7f90e40cf050 2024-09-13T18:33:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90e89d2640 1 --2- 172.21.15.53:0/3775109658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e406e050 0x7f90e4065c80 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f90d40097c0 tx=0x7f90d401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeda7334d41c2cde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90dbfff640 1 -- 172.21.15.53:0/3775109658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40ad680 con 0x7f90e406e050 2024-09-13T18:33:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90dbfff640 1 -- 172.21.15.53:0/3775109658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40ad7e0 con 0x7f90e406e050 2024-09-13T18:33:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90dbfff640 1 -- 172.21.15.53:0/3775109658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40adb70 con 0x7f90e406e050 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 -- 172.21.15.53:0/3775109658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e406e050 msgr2=0x7f90e4065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 --2- 172.21.15.53:0/3775109658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e406e050 0x7f90e4065c80 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f90d40097c0 tx=0x7f90d401c470 comp rx=0 tx=0).stop 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 -- 172.21.15.53:0/3775109658 shutdown_connections 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 --2- 172.21.15.53:0/3775109658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e406e050 0x7f90e4065c80 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 --2- 172.21.15.53:0/3775109658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e4143d30 0x7f90e406c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 -- 172.21.15.53:0/3775109658 >> 172.21.15.53:0/3775109658 conn(0x7f90e40b1310 msgr2=0x7f90e40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 -- 172.21.15.53:0/3775109658 shutdown_connections 2024-09-13T18:33:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 -- 172.21.15.53:0/3775109658 wait complete. 2024-09-13T18:33:56.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 Processor -- start 2024-09-13T18:33:56.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.752+0000 7f90eb437640 1 -- start start 2024-09-13T18:33:56.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e406e050 0x7f90e4134690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90e40cf050 0x7f90e4159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e4143d30 0x7f90e4159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4134bd0 con 0x7f90e4143d30 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4134ea0 con 0x7f90e40cf050 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4135180 con 0x7f90e406e050 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e4143d30 0x7f90e4159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e4143d30 0x7f90e4159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50542/0 (socket says 172.21.15.53:50542) 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 -- 172.21.15.53:0/1924968169 learned_addr learned my addr 172.21.15.53:0/1924968169 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e89d2640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90e40cf050 0x7f90e4159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e91d3640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e406e050 0x7f90e4134690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 -- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e406e050 msgr2=0x7f90e4134690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.759 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e406e050 0x7f90e4134690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 -- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90e40cf050 msgr2=0x7f90e4159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90e40cf050 0x7f90e4159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 -- 172.21.15.53:0/1924968169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d4009420 con 0x7f90e4143d30 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e89d2640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90e40cf050 0x7f90e4159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e99d4640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e4143d30 0x7f90e4159ff0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f90dc001570 tx=0x7f90dc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90d9ffb640 1 -- 172.21.15.53:0/1924968169 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00a640 con 0x7f90e4143d30 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90d9ffb640 1 -- 172.21.15.53:0/1924968169 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc00a7c0 con 0x7f90e4143d30 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90d9ffb640 1 -- 172.21.15.53:0/1924968169 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00ab70 con 0x7f90e4143d30 2024-09-13T18:33:56.760 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e4135460 con 0x7f90e4143d30 2024-09-13T18:33:56.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e4135a20 con 0x7f90e4143d30 2024-09-13T18:33:56.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e4135c10 con 0x7f90e4143d30 2024-09-13T18:33:56.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90d9ffb640 1 -- 172.21.15.53:0/1924968169 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f90dc00acd0 con 0x7f90e4143d30 2024-09-13T18:33:56.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90d9ffb640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90c8066e70 0x7f90c8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:56.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90d9ffb640 1 -- 172.21.15.53:0/1924968169 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90dc081e30 con 0x7f90e4143d30 2024-09-13T18:33:56.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.756+0000 7f90e91d3640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90c8066e70 0x7f90c8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:56.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.760+0000 7f90e91d3640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90c8066e70 0x7f90c8069330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f90e000b7c0 tx=0x7f90e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:56.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.760+0000 7f90d9ffb640 1 -- 172.21.15.53:0/1924968169 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90dc050da0 con 0x7f90e4143d30 2024-09-13T18:33:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:56.920+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f90e4065c80 con 0x7f90e4143d30 2024-09-13T18:33:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.240+0000 7f90d9ffb640 1 -- 172.21.15.53:0/1924968169 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v159) v1 ==== 138+0+0 (secure 0 0 0) 0x7f90dc018070 con 0x7f90e4143d30 2024-09-13T18:33:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:33:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90c8066e70 msgr2=0x7f90c8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90c8066e70 0x7f90c8069330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f90e000b7c0 tx=0x7f90e0008040 comp rx=0 tx=0).stop 2024-09-13T18:33:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e4143d30 msgr2=0x7f90e4159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:57.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e4143d30 0x7f90e4159ff0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f90dc001570 tx=0x7f90dc00cca0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 shutdown_connections 2024-09-13T18:33:57.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f90c8066e70 0x7f90c8069330 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90e4143d30 0x7f90e4159ff0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90e40cf050 0x7f90e4159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 --2- 172.21.15.53:0/1924968169 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90e406e050 0x7f90e4134690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.244+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 >> 172.21.15.53:0/1924968169 conn(0x7f90e40b1310 msgr2=0x7f90e40add90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:57.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.248+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 shutdown_connections 2024-09-13T18:33:57.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.248+0000 7f90eb437640 1 -- 172.21.15.53:0/1924968169 wait complete. 2024-09-13T18:33:57.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:33:57.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba209af640 1 Processor -- start 2024-09-13T18:33:57.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba209af640 1 -- start start 2024-09-13T18:33:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba209af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 0x7fba1c163e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba209af640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c0715f0 con 0x7fba1c156c40 2024-09-13T18:33:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba209af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c0b15a0 con 0x7fba1c157020 2024-09-13T18:33:57.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba209af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c070340 con 0x7fba1c06d440 2024-09-13T18:33:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba1a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fba1c156c40 0x7fba1c070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50494/0 (socket says 172.21.15.53:50494) 2024-09-13T18:33:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba1a59c640 1 -- 172.21.15.53:0/2570701554 learned_addr learned my addr 172.21.15.53:0/2570701554 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba1ad9d640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 0x7fba1c163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011483898 0 0) 0x7fba1c0715f0 con 0x7fba1c156c40 2024-09-13T18:33:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.400+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba04003530 con 0x7fba1c156c40 2024-09-13T18:33:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736097166 0 0) 0x7fba1c0b15a0 con 0x7fba1c157020 2024-09-13T18:33:57.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba1c0715f0 con 0x7fba1c157020 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2272443381 0 0) 0x7fba04003530 con 0x7fba1c156c40 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 msgr2=0x7fba1c163e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 0x7fba1c163e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 >> v1:172.21.15.87:6789/0 conn(0x7fba1c157020 legacy=0x7fba1c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0b1880 con 0x7fba1c156c40 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fba0c001680 con 0x7fba1c156c40 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 >> v1:172.21.15.53:6789/0 conn(0x7fba1c156c40 legacy=0x7fba1c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba04003b40 0x7fba04003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba040047d0 0x7fba04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 0x7fba04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0400ba40 con 0x7fba040047d0 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0400bb80 con 0x7fba04003b40 2024-09-13T18:33:57.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0400bd10 con 0x7fba1c06d440 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba19d9b640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba040047d0 0x7fba04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1a59c640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba04003b40 0x7fba04003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1ad9d640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 0x7fba04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba19d9b640 1 -- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 msgr2=0x7fba04005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba19d9b640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c06d440 0x7fba04005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba19d9b640 1 -- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba04003b40 msgr2=0x7fba04003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba19d9b640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba04003b40 0x7fba04003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba19d9b640 1 -- 172.21.15.53:0/2570701554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04003530 con 0x7fba040047d0 2024-09-13T18:33:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba19d9b640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba040047d0 0x7fba04004c50 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fba100018d0 tx=0x7fba1001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba91e156947d3311 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba100052d0 con 0x7fba040047d0 2024-09-13T18:33:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10005450 con 0x7fba040047d0 2024-09-13T18:33:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1959a640 1 -- 172.21.15.53:0/2570701554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba100a88f0 con 0x7fba040047d0 2024-09-13T18:33:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba209af640 1 -- 172.21.15.53:0/2570701554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba040047d0 msgr2=0x7fba04004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:57.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba209af640 1 --2- 172.21.15.53:0/2570701554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba040047d0 0x7fba04004c50 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fba100018d0 tx=0x7fba1001ec90 comp rx=0 tx=0).stop 2024-09-13T18:33:57.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba1ad9d640 1 -- 172.21.15.53:0/2570701554 reap_dead start 2024-09-13T18:33:57.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba209af640 1 -- 172.21.15.53:0/2570701554 shutdown_connections 2024-09-13T18:33:57.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.404+0000 7fba209af640 1 -- 172.21.15.53:0/2570701554 >> 172.21.15.53:0/2570701554 conn(0x7fba1c065c80 msgr2=0x7fba1c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:57.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- 172.21.15.53:0/2570701554 shutdown_connections 2024-09-13T18:33:57.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- 172.21.15.53:0/2570701554 wait complete. 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 Processor -- start 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- start start 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba040047d0 0x7fba1c13e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba1c158460 0x7fba1c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c154c10 0x7fba1c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c158de0 con 0x7fba1c158460 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c159860 con 0x7fba040047d0 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c1555d0 con 0x7fba1c154c10 2024-09-13T18:33:57.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba1c158460 0x7fba1c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba1c158460 0x7fba1c1588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50546/0 (socket says 172.21.15.53:50546) 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 -- 172.21.15.53:0/953076170 learned_addr learned my addr 172.21.15.53:0/953076170 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba1a59c640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba040047d0 0x7fba1c13e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba1ad9d640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c154c10 0x7fba1c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 -- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c154c10 msgr2=0x7fba1c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c154c10 0x7fba1c155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 -- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba040047d0 msgr2=0x7fba1c13e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba040047d0 0x7fba1c13e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 -- 172.21.15.53:0/953076170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c155890 con 0x7fba1c158460 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba19d9b640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba1c158460 0x7fba1c1588a0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fba100018d0 tx=0x7fba04005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba0affd640 1 -- 172.21.15.53:0/953076170 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba100a8dd0 con 0x7fba1c158460 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba0affd640 1 -- 172.21.15.53:0/953076170 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba100050d0 con 0x7fba1c158460 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba0affd640 1 -- 172.21.15.53:0/953076170 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10003600 con 0x7fba1c158460 2024-09-13T18:33:57.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c155b70 con 0x7fba1c158460 2024-09-13T18:33:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.408+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c156130 con 0x7fba1c158460 2024-09-13T18:33:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.412+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c070870 con 0x7fba1c158460 2024-09-13T18:33:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.412+0000 7fba0affd640 1 -- 172.21.15.53:0/953076170 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fba10003760 con 0x7fba1c158460 2024-09-13T18:33:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.412+0000 7fba0affd640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9fc066ea0 0x7fb9fc069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:57.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.412+0000 7fba0affd640 1 -- 172.21.15.53:0/953076170 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fba1011f7f0 con 0x7fba1c158460 2024-09-13T18:33:57.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.412+0000 7fba1a59c640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9fc066ea0 0x7fb9fc069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:57.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.412+0000 7fba1a59c640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9fc066ea0 0x7fb9fc069360 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001ec0 tx=0x7fba0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:57.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.416+0000 7fba0affd640 1 -- 172.21.15.53:0/953076170 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba100ee880 con 0x7fba1c158460 2024-09-13T18:33:57.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:57.576+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fba1c070870 con 0x7fba1c158460 2024-09-13T18:33:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.256+0000 7fba0affd640 1 -- 172.21.15.53:0/953076170 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v160) v1 ==== 170+0+0 (secure 0 0 0) 0x7fba100c0070 con 0x7fba1c158460 2024-09-13T18:33:58.261 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:33:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9fc066ea0 msgr2=0x7fb9fc069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9fc066ea0 0x7fb9fc069360 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001ec0 tx=0x7fba0c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba1c158460 msgr2=0x7fba1c1588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba1c158460 0x7fba1c1588a0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fba100018d0 tx=0x7fba04005800 comp rx=0 tx=0).stop 2024-09-13T18:33:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 shutdown_connections 2024-09-13T18:33:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9fc066ea0 0x7fb9fc069360 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba1c154c10 0x7fba1c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba1c158460 0x7fba1c1588a0 secure :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fba100018d0 tx=0x7fba04005800 comp rx=0 tx=0).stop 2024-09-13T18:33:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 --2- 172.21.15.53:0/953076170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba040047d0 0x7fba1c13e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.264+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 >> 172.21.15.53:0/953076170 conn(0x7fba1c065c80 msgr2=0x7fba1c0cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.272+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 shutdown_connections 2024-09-13T18:33:58.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.272+0000 7fba209af640 1 -- 172.21.15.53:0/953076170 wait complete. 2024-09-13T18:33:58.304 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:33:58.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4049868640 1 Processor -- start 2024-09-13T18:33:58.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4049868640 1 -- start start 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4049868640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40440cda30 0x7f40440cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4049868640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404406f7a0 con 0x7f4044143e80 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4049868640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404406fd60 con 0x7f40440caee0 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4049868640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404406baa0 con 0x7f40440cda30 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4042ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4044143e80 0x7f404406b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50496/0 (socket says 172.21.15.53:50496) 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f4042ffd640 1 -- 172.21.15.53:0/3515256055 learned_addr learned my addr 172.21.15.53:0/3515256055 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f40437fe640 1 --2- 172.21.15.53:0/3515256055 >> v2:172.21.15.53:3300/0 conn(0x7f40440cda30 0x7f40440cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f40427fc640 1 -- 172.21.15.53:0/3515256055 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323233660 0 0) 0x7f404406f7a0 con 0x7f4044143e80 2024-09-13T18:33:58.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f40427fc640 1 -- 172.21.15.53:0/3515256055 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4030003530 con 0x7f4044143e80 2024-09-13T18:33:58.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f40437fe640 1 -- 172.21.15.53:0/3515256055 >> v1:172.21.15.87:6789/0 conn(0x7f40440caee0 legacy=0x7f40440cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f40437fe640 1 -- 172.21.15.53:0/3515256055 >> v1:172.21.15.53:6789/0 conn(0x7f4044143e80 legacy=0x7f404406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.428+0000 7f40437fe640 1 -- 172.21.15.53:0/3515256055 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440cb960 con 0x7f40440cda30 2024-09-13T18:33:58.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f40437fe640 1 --2- 172.21.15.53:0/3515256055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440cda30 0x7f40440cb350 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f403c009d90 tx=0x7f403c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c718a4632bb134 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:58.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f40427fc640 1 -- 172.21.15.53:0/3515256055 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a58e0 con 0x7f40440cda30 2024-09-13T18:33:58.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f40427fc640 1 -- 172.21.15.53:0/3515256055 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c0a5a40 con 0x7f40440cda30 2024-09-13T18:33:58.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f40427fc640 1 -- 172.21.15.53:0/3515256055 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a5db0 con 0x7f40440cda30 2024-09-13T18:33:58.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- 172.21.15.53:0/3515256055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440cda30 msgr2=0x7f40440cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 --2- 172.21.15.53:0/3515256055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440cda30 0x7f40440cb350 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f403c009d90 tx=0x7f403c01c820 comp rx=0 tx=0).stop 2024-09-13T18:33:58.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- 172.21.15.53:0/3515256055 shutdown_connections 2024-09-13T18:33:58.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 --2- 172.21.15.53:0/3515256055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440cda30 0x7f40440cb350 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- 172.21.15.53:0/3515256055 >> 172.21.15.53:0/3515256055 conn(0x7f4044065c80 msgr2=0x7f4044066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:58.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- 172.21.15.53:0/3515256055 shutdown_connections 2024-09-13T18:33:58.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- 172.21.15.53:0/3515256055 wait complete. 2024-09-13T18:33:58.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 Processor -- start 2024-09-13T18:33:58.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- start start 2024-09-13T18:33:58.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440caee0 0x7f404413fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40440cda30 0x7f40441416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4044143e80 0x7f404413b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404413f0f0 con 0x7f40440caee0 2024-09-13T18:33:58.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404413db30 con 0x7f4044143e80 2024-09-13T18:33:58.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4049868640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404413de10 con 0x7f40440cda30 2024-09-13T18:33:58.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440caee0 0x7f404413fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440caee0 0x7f404413fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50554/0 (socket says 172.21.15.53:50554) 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 -- 172.21.15.53:0/1079506769 learned_addr learned my addr 172.21.15.53:0/1079506769 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f40437fe640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4044143e80 0x7f404413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f403bfff640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40440cda30 0x7f40441416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 -- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40440cda30 msgr2=0x7f40441416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40440cda30 0x7f40441416e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 -- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4044143e80 msgr2=0x7f404413b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4044143e80 0x7f404413b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.432+0000 7f4042ffd640 1 -- 172.21.15.53:0/1079506769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c009a70 con 0x7f40440caee0 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4042ffd640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440caee0 0x7f404413fb30 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f403400c420 tx=0x7f403400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4040ff9640 1 -- 172.21.15.53:0/1079506769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034005cf0 con 0x7f40440caee0 2024-09-13T18:33:58.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4040ff9640 1 -- 172.21.15.53:0/1079506769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4034005e50 con 0x7f40440caee0 2024-09-13T18:33:58.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4040ff9640 1 -- 172.21.15.53:0/1079506769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340072d0 con 0x7f40440caee0 2024-09-13T18:33:58.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404413eaa0 con 0x7f40440caee0 2024-09-13T18:33:58.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404413d750 con 0x7f40440caee0 2024-09-13T18:33:58.439 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40440cb350 con 0x7f40440caee0 2024-09-13T18:33:58.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4040ff9640 1 -- 172.21.15.53:0/1079506769 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f4034007430 con 0x7f40440caee0 2024-09-13T18:33:58.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4040ff9640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4024066e70 0x7f4024069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f4040ff9640 1 -- 172.21.15.53:0/1079506769 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4034082260 con 0x7f40440caee0 2024-09-13T18:33:58.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f403bfff640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4024066e70 0x7f4024069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.436+0000 7f403bfff640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4024066e70 0x7f4024069330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f404413e500 tx=0x7f402c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:58.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.440+0000 7f4040ff9640 1 -- 172.21.15.53:0/1079506769 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4034054d10 con 0x7f40440caee0 2024-09-13T18:33:58.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.636+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f40440ccc40 con 0x7f40440caee0 2024-09-13T18:33:58.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.644+0000 7f4040ff9640 1 -- 172.21.15.53:0/1079506769 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v93) v1 ==== 174+0+0 (secure 0 0 0) 0x7f40340210c0 con 0x7f40440caee0 2024-09-13T18:33:58.655 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 24 and data pool 25 2024-09-13T18:33:58.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4024066e70 msgr2=0x7f4024069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4024066e70 0x7f4024069330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f404413e500 tx=0x7f402c009040 comp rx=0 tx=0).stop 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440caee0 msgr2=0x7f404413fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440caee0 0x7f404413fb30 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f403400c420 tx=0x7f403400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 shutdown_connections 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4024066e70 0x7f4024069330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40440cda30 0x7f40441416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4044143e80 0x7f404413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 --2- 172.21.15.53:0/1079506769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440caee0 0x7f404413fb30 secure :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f403400c420 tx=0x7f403400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.652+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 >> 172.21.15.53:0/1079506769 conn(0x7f4044065c80 msgr2=0x7f40440b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:58.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.664+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 shutdown_connections 2024-09-13T18:33:58.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.664+0000 7f4049868640 1 -- 172.21.15.53:0/1079506769 wait complete. 2024-09-13T18:33:58.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:58.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.804+0000 7fb19c73a640 1 Processor -- start 2024-09-13T18:33:58.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.804+0000 7fb19c73a640 1 -- start start 2024-09-13T18:33:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19c73a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 0x7fb1940cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19c73a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb1940b7b40 0x7fb1941662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19c73a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19415cc10 con 0x7fb19415c830 2024-09-13T18:33:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19c73a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1940b50c0 con 0x7fb1940b7b40 2024-09-13T18:33:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19c73a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b41d0 con 0x7fb1940cf800 2024-09-13T18:33:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19a4d6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb19415c830 0x7fb1940cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50506/0 (socket says 172.21.15.53:50506) 2024-09-13T18:33:58.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19a4d6640 1 -- 172.21.15.53:0/2292288451 learned_addr learned my addr 172.21.15.53:0/2292288451 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:33:58.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb199cd5640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 0x7fb1940cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19acd7640 1 --2- 172.21.15.53:0/2292288451 >> v2:172.21.15.87:3300/0 conn(0x7fb1940b7b40 0x7fb1941662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849552553 0 0) 0x7fb190001120 con 0x7fb19415c830 2024-09-13T18:33:58.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb180003530 con 0x7fb19415c830 2024-09-13T18:33:58.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992170869 0 0) 0x7fb180003530 con 0x7fb19415c830 2024-09-13T18:33:58.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 msgr2=0x7fb1940cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:58.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 0x7fb1940cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 >> v2:172.21.15.87:3300/0 conn(0x7fb1940b7b40 msgr2=0x7fb1941662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 --2- 172.21.15.53:0/2292288451 >> v2:172.21.15.87:3300/0 conn(0x7fb1940b7b40 0x7fb1941662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940b44b0 con 0x7fb19415c830 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb190001810 con 0x7fb19415c830 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 >> v1:172.21.15.53:6789/0 conn(0x7fb19415c830 legacy=0x7fb1940cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 0x7fb180003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb180003f00 0x7fb1800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb180004d10 0x7fb180005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b50c0 con 0x7fb180004d10 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b41d0 con 0x7fb180003f00 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18000b9c0 con 0x7fb1940cf800 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19acd7640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb180004d10 0x7fb180005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb199cd5640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb180003f00 0x7fb1800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19a4d6640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 0x7fb180003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19acd7640 1 -- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 msgr2=0x7fb180003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19acd7640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb1940cf800 0x7fb180003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19acd7640 1 -- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb180003f00 msgr2=0x7fb1800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19acd7640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb180003f00 0x7fb1800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.808+0000 7fb19acd7640 1 -- 172.21.15.53:0/2292288451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180003530 con 0x7fb180004d10 2024-09-13T18:33:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19acd7640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb180004d10 0x7fb180005190 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009fc0 tx=0x7fb18c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7caf209fa88e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0a5cd0 con 0x7fb180004d10 2024-09-13T18:33:58.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00f040 con 0x7fb180004d10 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb1994d4640 1 -- 172.21.15.53:0/2292288451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0ad680 con 0x7fb180004d10 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- 172.21.15.53:0/2292288451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb180004d10 msgr2=0x7fb180005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 --2- 172.21.15.53:0/2292288451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb180004d10 0x7fb180005190 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009fc0 tx=0x7fb18c01ccc0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19acd7640 1 -- 172.21.15.53:0/2292288451 reap_dead start 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- 172.21.15.53:0/2292288451 shutdown_connections 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- 172.21.15.53:0/2292288451 >> 172.21.15.53:0/2292288451 conn(0x7fb194070970 msgr2=0x7fb194070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- 172.21.15.53:0/2292288451 shutdown_connections 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- 172.21.15.53:0/2292288451 wait complete. 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 Processor -- start 2024-09-13T18:33:58.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- start start 2024-09-13T18:33:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb194149be0 0x7fb194156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb194158640 0x7fb1940c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb194158ac0 0x7fb1940c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb194159c10 con 0x7fb194158ac0 2024-09-13T18:33:58.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb194158f90 con 0x7fb194158640 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19c73a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb194159270 con 0x7fb194149be0 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19acd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb194158ac0 0x7fb1940c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19acd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb194158ac0 0x7fb1940c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50584/0 (socket says 172.21.15.53:50584) 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19acd7640 1 -- 172.21.15.53:0/580142912 learned_addr learned my addr 172.21.15.53:0/580142912 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb199cd5640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb194158640 0x7fb1940c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19a4d6640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb194149be0 0x7fb194156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19acd7640 1 -- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb194149be0 msgr2=0x7fb194156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.812+0000 7fb19acd7640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb194149be0 0x7fb194156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19acd7640 1 -- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb194158640 msgr2=0x7fb1940c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19acd7640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb194158640 0x7fb1940c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19acd7640 1 -- 172.21.15.53:0/580142912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194159550 con 0x7fb194158ac0 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19acd7640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb194158ac0 0x7fb1940c8740 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0b0040 tx=0x7fb18c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:58.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb18affd640 1 -- 172.21.15.53:0/580142912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0039a0 con 0x7fb194158ac0 2024-09-13T18:33:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb18affd640 1 -- 172.21.15.53:0/580142912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c003b20 con 0x7fb194158ac0 2024-09-13T18:33:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb194159830 con 0x7fb194158ac0 2024-09-13T18:33:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb18affd640 1 -- 172.21.15.53:0/580142912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0ae890 con 0x7fb194158ac0 2024-09-13T18:33:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb194149fc0 con 0x7fb194158ac0 2024-09-13T18:33:58.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb194159d50 con 0x7fb194158ac0 2024-09-13T18:33:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb18affd640 1 -- 172.21.15.53:0/580142912 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7fb18c0b4040 con 0x7fb194158ac0 2024-09-13T18:33:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb18affd640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb178066e70 0x7fb178069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb18affd640 1 -- 172.21.15.53:0/580142912 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb18c11c620 con 0x7fb194158ac0 2024-09-13T18:33:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19a4d6640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb178066e70 0x7fb178069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:58.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.816+0000 7fb19a4d6640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb178066e70 0x7fb178069330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb190000c10 tx=0x7fb190009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:58.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.820+0000 7fb18affd640 1 -- 172.21.15.53:0/580142912 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb194159d50 con 0x7fb194158ac0 2024-09-13T18:33:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.984+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb194159d50 con 0x7fb194158ac0 2024-09-13T18:33:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.984+0000 7fb18affd640 1 -- 172.21.15.53:0/580142912 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16532 (secure 0 0 0) 0x7fb194159d50 con 0x7fb194158ac0 2024-09-13T18:33:58.987 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:58.987 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":161,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:58.641985+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:58.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb178066e70 msgr2=0x7fb178069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb178066e70 0x7fb178069330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb190000c10 tx=0x7fb190009040 comp rx=0 tx=0).stop 2024-09-13T18:33:58.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb194158ac0 msgr2=0x7fb1940c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:58.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb194158ac0 0x7fb1940c8740 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0b0040 tx=0x7fb18c009750 comp rx=0 tx=0).stop 2024-09-13T18:33:58.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 shutdown_connections 2024-09-13T18:33:58.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb178066e70 0x7fb178069330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb194158ac0 0x7fb1940c8740 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb194158640 0x7fb1940c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 --2- 172.21.15.53:0/580142912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb194149be0 0x7fb194156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:58.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 >> 172.21.15.53:0/580142912 conn(0x7fb194070970 msgr2=0x7fb194070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:58.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 shutdown_connections 2024-09-13T18:33:58.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:58.988+0000 7fb19c73a640 1 -- 172.21.15.53:0/580142912 wait complete. 2024-09-13T18:33:59.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:33:59.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.128+0000 7f7888553640 1 Processor -- start 2024-09-13T18:33:59.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.128+0000 7f7888553640 1 -- start start 2024-09-13T18:33:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f7888553640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801582a0 0x7f788006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f7888553640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f78800713a0 0x7f788006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f7888553640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788006d480 con 0x7f788015b7c0 2024-09-13T18:33:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f7888553640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788015aaf0 con 0x7f78800713a0 2024-09-13T18:33:59.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f7888553640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788006d760 con 0x7f78801582a0 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801582a0 0x7f788006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801582a0 0x7f788006c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:47940/0 (socket says 172.21.15.53:47940) 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 -- 172.21.15.53:0/3505077259 learned_addr learned my addr 172.21.15.53:0/3505077259 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f7886af0640 1 --2- 172.21.15.53:0/3505077259 >> v2:172.21.15.87:3300/0 conn(0x7f78800713a0 0x7f788006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 -- 172.21.15.53:0/3505077259 >> v2:172.21.15.87:3300/0 conn(0x7f78800713a0 msgr2=0x7f788006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 --2- 172.21.15.53:0/3505077259 >> v2:172.21.15.87:3300/0 conn(0x7f78800713a0 0x7f788006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 -- 172.21.15.53:0/3505077259 >> v1:172.21.15.87:6789/0 conn(0x7f788015b7c0 legacy=0x7f7880070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 -- 172.21.15.53:0/3505077259 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788015ace0 con 0x7f78801582a0 2024-09-13T18:33:59.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.132+0000 7f78862ef640 1 --2- 172.21.15.53:0/3505077259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801582a0 0x7f788006c900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7870009e50 tx=0x7f787001ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3e55f9260498c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:59.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f78852ed640 1 -- 172.21.15.53:0/3505077259 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700a58d0 con 0x7f78801582a0 2024-09-13T18:33:59.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f78852ed640 1 -- 172.21.15.53:0/3505077259 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78700a5a30 con 0x7f78801582a0 2024-09-13T18:33:59.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f78852ed640 1 -- 172.21.15.53:0/3505077259 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700a5dc0 con 0x7f78801582a0 2024-09-13T18:33:59.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- 172.21.15.53:0/3505077259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801582a0 msgr2=0x7f788006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 --2- 172.21.15.53:0/3505077259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801582a0 0x7f788006c900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7870009e50 tx=0x7f787001ca00 comp rx=0 tx=0).stop 2024-09-13T18:33:59.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- 172.21.15.53:0/3505077259 shutdown_connections 2024-09-13T18:33:59.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 --2- 172.21.15.53:0/3505077259 >> v2:172.21.15.87:3300/0 conn(0x7f78800713a0 0x7f788006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 --2- 172.21.15.53:0/3505077259 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801582a0 0x7f788006c900 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- 172.21.15.53:0/3505077259 >> 172.21.15.53:0/3505077259 conn(0x7f7880065c80 msgr2=0x7f7880066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- 172.21.15.53:0/3505077259 shutdown_connections 2024-09-13T18:33:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- 172.21.15.53:0/3505077259 wait complete. 2024-09-13T18:33:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 Processor -- start 2024-09-13T18:33:59.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- start start 2024-09-13T18:33:59.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78800713a0 0x7f7880145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788015b7c0 0x7f7880148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801492f0 0x7f788014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b20b0 con 0x7f788015b7c0 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880149850 con 0x7f78800713a0 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7888553640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b1780 con 0x7f78801492f0 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7885aee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788015b7c0 0x7f7880148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7885aee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788015b7c0 0x7f7880148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50596/0 (socket says 172.21.15.53:50596) 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7885aee640 1 -- 172.21.15.53:0/1278497160 learned_addr learned my addr 172.21.15.53:0/1278497160 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f7886af0640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801492f0 0x7f788014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.136+0000 7f78862ef640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78800713a0 0x7f7880145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7885aee640 1 -- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801492f0 msgr2=0x7f788014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7885aee640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801492f0 0x7f788014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7885aee640 1 -- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78800713a0 msgr2=0x7f7880145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7885aee640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78800713a0 0x7f7880145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7885aee640 1 -- 172.21.15.53:0/1278497160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870009b30 con 0x7f788015b7c0 2024-09-13T18:33:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7885aee640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788015b7c0 0x7f7880148db0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c500 tx=0x7f786c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f787effd640 1 -- 172.21.15.53:0/1278497160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c005220 con 0x7f788015b7c0 2024-09-13T18:33:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f787effd640 1 -- 172.21.15.53:0/1278497160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c005380 con 0x7f788015b7c0 2024-09-13T18:33:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78800b1a60 con 0x7f788015b7c0 2024-09-13T18:33:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f787effd640 1 -- 172.21.15.53:0/1278497160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c007270 con 0x7f788015b7c0 2024-09-13T18:33:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880155600 con 0x7f788015b7c0 2024-09-13T18:33:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7880067400 con 0x7f788015b7c0 2024-09-13T18:33:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f787effd640 1 -- 172.21.15.53:0/1278497160 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f786c0073d0 con 0x7f788015b7c0 2024-09-13T18:33:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f787effd640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7868066ea0 0x7f7868069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f787effd640 1 -- 172.21.15.53:0/1278497160 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f786c082040 con 0x7f788015b7c0 2024-09-13T18:33:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f78862ef640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7868066ea0 0x7f7868069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.140+0000 7f78862ef640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7868066ea0 0x7f7868069360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78700ae000 tx=0x7f78700a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.144+0000 7f787effd640 1 -- 172.21.15.53:0/1278497160 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f786c050fe0 con 0x7f788015b7c0 2024-09-13T18:33:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.308+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78800b21f0 con 0x7f788015b7c0 2024-09-13T18:33:59.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f787effd640 1 -- 172.21.15.53:0/1278497160 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16532 (secure 0 0 0) 0x7f786c054600 con 0x7f788015b7c0 2024-09-13T18:33:59.314 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:33:59.314 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":161,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:58.641985+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:33:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7868066ea0 msgr2=0x7f7868069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7868066ea0 0x7f7868069360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78700ae000 tx=0x7f78700a7070 comp rx=0 tx=0).stop 2024-09-13T18:33:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788015b7c0 msgr2=0x7f7880148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788015b7c0 0x7f7880148db0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c500 tx=0x7f786c00c9c0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 shutdown_connections 2024-09-13T18:33:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7868066ea0 0x7f7868069360 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f78801492f0 0x7f788014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788015b7c0 0x7f7880148db0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 --2- 172.21.15.53:0/1278497160 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78800713a0 0x7f7880145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 >> 172.21.15.53:0/1278497160 conn(0x7f7880065c80 msgr2=0x7f7880157190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 shutdown_connections 2024-09-13T18:33:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.312+0000 7f7888553640 1 -- 172.21.15.53:0/1278497160 wait complete. 2024-09-13T18:33:59.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:33:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b19663640 1 Processor -- start 2024-09-13T18:33:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b19663640 1 -- start start 2024-09-13T18:33:59.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b19663640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1406a4f0 0x7f7b1415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b19663640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b1415dbe0 0x7f7b14166520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b19663640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b140d0320 con 0x7f7b1406aa60 2024-09-13T18:33:59.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b19663640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1406b830 con 0x7f7b1415dbe0 2024-09-13T18:33:59.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b19663640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140d13c0 con 0x7f7b1406a4f0 2024-09-13T18:33:59.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1406a4f0 0x7f7b1415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1406a4f0 0x7f7b1415d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:47950/0 (socket says 172.21.15.53:47950) 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b127fc640 1 -- 172.21.15.53:0/227627443 learned_addr learned my addr 172.21.15.53:0/227627443 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b137fe640 1 --2- 172.21.15.53:0/227627443 >> v2:172.21.15.87:3300/0 conn(0x7f7b1415dbe0 0x7f7b14166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b137fe640 1 -- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1406a4f0 msgr2=0x7f7b1415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b137fe640 1 --2- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1406a4f0 0x7f7b1415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b137fe640 1 -- 172.21.15.53:0/227627443 >> v1:172.21.15.87:6789/0 conn(0x7f7b1406aa60 legacy=0x7f7b1406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b137fe640 1 -- 172.21.15.53:0/227627443 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b140d0600 con 0x7f7b1415dbe0 2024-09-13T18:33:59.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.456+0000 7f7b127fc640 1 --2- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1406a4f0 0x7f7b1415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:33:59.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b137fe640 1 --2- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1415dbe0 0x7f7b14166520 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009d90 tx=0x7f7b0c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b12c08bebf5b714 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:59.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b11ffb640 1 -- 172.21.15.53:0/227627443 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0a6710 con 0x7f7b1415dbe0 2024-09-13T18:33:59.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b11ffb640 1 -- 172.21.15.53:0/227627443 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0a6870 con 0x7f7b1415dbe0 2024-09-13T18:33:59.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b11ffb640 1 -- 172.21.15.53:0/227627443 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0a6c00 con 0x7f7b1415dbe0 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 -- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1415dbe0 msgr2=0x7f7b14166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 --2- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1415dbe0 0x7f7b14166520 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009d90 tx=0x7f7b0c01c970 comp rx=0 tx=0).stop 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 -- 172.21.15.53:0/227627443 shutdown_connections 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 --2- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1415dbe0 0x7f7b14166520 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 --2- 172.21.15.53:0/227627443 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1406a4f0 0x7f7b1415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 -- 172.21.15.53:0/227627443 >> 172.21.15.53:0/227627443 conn(0x7f7b14071a70 msgr2=0x7f7b14099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 -- 172.21.15.53:0/227627443 shutdown_connections 2024-09-13T18:33:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 -- 172.21.15.53:0/227627443 wait complete. 2024-09-13T18:33:59.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.460+0000 7f7b19663640 1 Processor -- start 2024-09-13T18:33:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 -- start start 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1406a4f0 0x7f7b1414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1406aa60 0x7f7b14158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1415dbe0 0x7f7b14158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b141597d0 con 0x7f7b1406aa60 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b141594f0 con 0x7f7b1406a4f0 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14157850 con 0x7f7b1415dbe0 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1406aa60 0x7f7b14158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1406aa60 0x7f7b14158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50606/0 (socket says 172.21.15.53:50606) 2024-09-13T18:33:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 -- 172.21.15.53:0/3237470540 learned_addr learned my addr 172.21.15.53:0/3237470540 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b137fe640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1415dbe0 0x7f7b14158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b12ffd640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1406a4f0 0x7f7b1414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 -- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1415dbe0 msgr2=0x7f7b14158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1415dbe0 0x7f7b14158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 -- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1406a4f0 msgr2=0x7f7b1414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1406a4f0 0x7f7b1414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 -- 172.21.15.53:0/3237470540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b080094d0 con 0x7f7b1406aa60 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b127fc640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1406aa60 0x7f7b14158ca0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800e9d0 tx=0x7f7b0800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7afb7fe640 1 -- 172.21.15.53:0/3237470540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0800ca60 con 0x7f7b1406aa60 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7afb7fe640 1 -- 172.21.15.53:0/3237470540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0800cbc0 con 0x7f7b1406aa60 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c009a70 con 0x7f7b1406aa60 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7afb7fe640 1 -- 172.21.15.53:0/3237470540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08013470 con 0x7f7b1406aa60 2024-09-13T18:33:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b14157e10 con 0x7f7b1406aa60 2024-09-13T18:33:59.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b140d1540 con 0x7f7b1406aa60 2024-09-13T18:33:59.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.464+0000 7f7afb7fe640 1 -- 172.21.15.53:0/3237470540 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f7b080135d0 con 0x7f7b1406aa60 2024-09-13T18:33:59.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.468+0000 7f7afb7fe640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b00066ea0 0x7f7b00069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:59.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.468+0000 7f7afb7fe640 1 -- 172.21.15.53:0/3237470540 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b08083290 con 0x7f7b1406aa60 2024-09-13T18:33:59.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.468+0000 7f7b12ffd640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b00066ea0 0x7f7b00069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:59.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.468+0000 7f7b12ffd640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b00066ea0 0x7f7b00069360 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7b1415c7a0 tx=0x7f7b04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:59.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.472+0000 7f7afb7fe640 1 -- 172.21.15.53:0/3237470540 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b080522b0 con 0x7f7b1406aa60 2024-09-13T18:33:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:33:59.668+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7b1409a180 con 0x7f7b1406aa60 2024-09-13T18:34:00.107 INFO:tasks.ceph.mds.c.smithi053.stderr:2024-09-13T18:34:00.104+0000 7f1b863db640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:34:00.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7afb7fe640 1 -- 172.21.15.53:0/3237470540 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v95) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b080170b0 con 0x7f7b1406aa60 2024-09-13T18:34:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b00066ea0 msgr2=0x7f7b00069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b00066ea0 0x7f7b00069360 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7b1415c7a0 tx=0x7f7b04009040 comp rx=0 tx=0).stop 2024-09-13T18:34:00.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1406aa60 msgr2=0x7f7b14158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1406aa60 0x7f7b14158ca0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800e9d0 tx=0x7f7b0800ee90 comp rx=0 tx=0).stop 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 shutdown_connections 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7b00066ea0 0x7f7b00069360 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b1415dbe0 0x7f7b14158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b1406aa60 0x7f7b14158ca0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 --2- 172.21.15.53:0/3237470540 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b1406a4f0 0x7f7b1414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 >> 172.21.15.53:0/3237470540 conn(0x7f7b14071a70 msgr2=0x7f7b1406ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 shutdown_connections 2024-09-13T18:34:00.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.656+0000 7f7b19663640 1 -- 172.21.15.53:0/3237470540 wait complete. 2024-09-13T18:34:00.681 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:34:00.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:34:00.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d6abe640 1 Processor -- start 2024-09-13T18:34:00.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d6abe640 1 -- start start 2024-09-13T18:34:00.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d6abe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f43d006d440 0x7f43d0163e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d6abe640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00715f0 con 0x7f43d0156c40 2024-09-13T18:34:00.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d6abe640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00b15a0 con 0x7f43d0157020 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d6abe640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d0070340 con 0x7f43d006d440 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d485a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f43d0156c40 0x7f43d0070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50518/0 (socket says 172.21.15.53:50518) 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d485a640 1 -- 172.21.15.53:0/1559509954 learned_addr learned my addr 172.21.15.53:0/1559509954 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d505b640 1 --2- 172.21.15.53:0/1559509954 >> v2:172.21.15.87:3300/0 conn(0x7f43d006d440 0x7f43d0163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893810896 0 0) 0x7f43d00715f0 con 0x7f43d0156c40 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b8003530 con 0x7f43d0156c40 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2396271552 0 0) 0x7f43b8003530 con 0x7f43d0156c40 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 >> v2:172.21.15.87:3300/0 conn(0x7f43d006d440 msgr2=0x7f43d0163e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 --2- 172.21.15.53:0/1559509954 >> v2:172.21.15.87:3300/0 conn(0x7f43d006d440 0x7f43d0163e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 >> v1:172.21.15.87:6789/0 conn(0x7f43d0157020 legacy=0x7f43d006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:00.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00b1880 con 0x7f43d0156c40 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f43c0001680 con 0x7f43d0156c40 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d505b640 1 --2- 172.21.15.53:0/1559509954 >> v2:172.21.15.87:3300/0 conn(0x7f43d006d440 0x7f43d0163e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 >> v1:172.21.15.53:6789/0 conn(0x7f43d0156c40 legacy=0x7f43d0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b80039b0 0x7f43b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b80047d0 0x7f43b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b8005190 0x7f43b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b800c060 con 0x7f43b80047d0 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b800c1a0 con 0x7f43b8005190 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b800c360 con 0x7f43b80039b0 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cffff640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b80047d0 0x7f43b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d505b640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b8005190 0x7f43b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d485a640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b80039b0 0x7f43b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cffff640 1 -- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b80039b0 msgr2=0x7f43b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:00.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cffff640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43b80039b0 0x7f43b8003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cffff640 1 -- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b8005190 msgr2=0x7f43b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:00.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cffff640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b8005190 0x7f43b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43cffff640 1 -- 172.21.15.53:0/1559509954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8003530 con 0x7f43b80047d0 2024-09-13T18:34:00.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.808+0000 7f43d505b640 1 -- 172.21.15.53:0/1559509954 reap_dead start 2024-09-13T18:34:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43cffff640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b80047d0 0x7f43b8004c50 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f43c4001780 tx=0x7f43c401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41988eaa071b8506 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:00.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40052d0 con 0x7f43b80047d0 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40a7050 con 0x7f43b80047d0 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43cf7fe640 1 -- 172.21.15.53:0/1559509954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4003600 con 0x7f43b80047d0 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 -- 172.21.15.53:0/1559509954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b80047d0 msgr2=0x7f43b8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b80047d0 0x7f43b8004c50 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f43c4001780 tx=0x7f43c401c400 comp rx=0 tx=0).stop 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 -- 172.21.15.53:0/1559509954 shutdown_connections 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1559509954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43b80047d0 0x7f43b8004c50 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 -- 172.21.15.53:0/1559509954 >> 172.21.15.53:0/1559509954 conn(0x7f43d0065c80 msgr2=0x7f43d0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 -- 172.21.15.53:0/1559509954 shutdown_connections 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 -- 172.21.15.53:0/1559509954 wait complete. 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 Processor -- start 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.812+0000 7f43d6abe640 1 -- start start 2024-09-13T18:34:00.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b80047d0 0x7f43d0148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43d0147bb0 0x7f43d013abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43d0155870 0x7f43d0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d014a740 con 0x7f43d0147bb0 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0148640 con 0x7f43b80047d0 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0156230 con 0x7f43d0155870 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43d0147bb0 0x7f43d013abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43d0147bb0 0x7f43d013abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50616/0 (socket says 172.21.15.53:50616) 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 -- 172.21.15.53:0/1508560506 learned_addr learned my addr 172.21.15.53:0/1508560506 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d485a640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b80047d0 0x7f43d0148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d505b640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43d0155870 0x7f43d0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 -- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43d0155870 msgr2=0x7f43d0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43d0155870 0x7f43d0155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 -- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b80047d0 msgr2=0x7f43d0148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b80047d0 0x7f43d0148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 -- 172.21.15.53:0/1508560506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d014a9f0 con 0x7f43d0147bb0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d485a640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b80047d0 0x7f43d0148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cffff640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43d0147bb0 0x7f43d013abc0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f43c401c230 tx=0x7f43b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cd7fa640 1 -- 172.21.15.53:0/1508560506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4007500 con 0x7f43d0147bb0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cd7fa640 1 -- 172.21.15.53:0/1508560506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4007660 con 0x7f43d0147bb0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d0148850 con 0x7f43d0147bb0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cd7fa640 1 -- 172.21.15.53:0/1508560506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4006a20 con 0x7f43d0147bb0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d0148e10 con 0x7f43d0147bb0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d0070870 con 0x7f43d0147bb0 2024-09-13T18:34:00.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cd7fa640 1 -- 172.21.15.53:0/1508560506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f43c4006b80 con 0x7f43d0147bb0 2024-09-13T18:34:00.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cd7fa640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43bc066ea0 0x7f43bc069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:00.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43cd7fa640 1 -- 172.21.15.53:0/1508560506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c411ca50 con 0x7f43d0147bb0 2024-09-13T18:34:00.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d485a640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43bc066ea0 0x7f43bc069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:00.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.816+0000 7f43d485a640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43bc066ea0 0x7f43bc069360 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000c10 tx=0x7f43c00014c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:00.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:00.820+0000 7f43cd7fa640 1 -- 172.21.15.53:0/1508560506 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43c40ef3c0 con 0x7f43d0147bb0 2024-09-13T18:34:01.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.016+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f43d013b100 con 0x7f43d0147bb0 2024-09-13T18:34:01.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.656+0000 7f43cd7fa640 1 -- 172.21.15.53:0/1508560506 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v96) v1 ==== 122+0+0 (secure 0 0 0) 0x7f43c40eef50 con 0x7f43d0147bb0 2024-09-13T18:34:01.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43bc066ea0 msgr2=0x7f43bc069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:01.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43bc066ea0 0x7f43bc069360 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000c10 tx=0x7f43c00014c0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43d0147bb0 msgr2=0x7f43d013abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:01.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43d0147bb0 0x7f43d013abc0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f43c401c230 tx=0x7f43b8005800 comp rx=0 tx=0).stop 2024-09-13T18:34:01.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 shutdown_connections 2024-09-13T18:34:01.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f43bc066ea0 0x7f43bc069360 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f43d0155870 0x7f43d0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43d0147bb0 0x7f43d013abc0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 --2- 172.21.15.53:0/1508560506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f43b80047d0 0x7f43d0148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 >> 172.21.15.53:0/1508560506 conn(0x7f43d0065c80 msgr2=0x7f43d0152810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:01.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 shutdown_connections 2024-09-13T18:34:01.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.660+0000 7f43d6abe640 1 -- 172.21.15.53:0/1508560506 wait complete. 2024-09-13T18:34:01.685 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:34:01.685 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff0a42a640 1 Processor -- start 2024-09-13T18:34:01.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff0a42a640 1 -- start start 2024-09-13T18:34:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff0a42a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff0406b850 0x7eff040b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff0a42a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040b1ac0 con 0x7eff040cbd60 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff0a42a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff04159ac0 con 0x7eff040cb980 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff0a42a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff04159da0 con 0x7eff0406b850 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff089c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7eff040cbd60 0x7eff040b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50528/0 (socket says 172.21.15.53:50528) 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff089c7640 1 -- 172.21.15.53:0/3299198493 learned_addr learned my addr 172.21.15.53:0/3299198493 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff037fe640 1 --2- 172.21.15.53:0/3299198493 >> v2:172.21.15.87:3300/0 conn(0x7eff0406b850 0x7eff040b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078253062 0 0) 0x7eff040b1ac0 con 0x7eff040cbd60 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeec003530 con 0x7eff040cbd60 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956633962 0 0) 0x7efeec003530 con 0x7eff040cbd60 2024-09-13T18:34:01.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 >> v2:172.21.15.87:3300/0 conn(0x7eff0406b850 msgr2=0x7eff040b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 --2- 172.21.15.53:0/3299198493 >> v2:172.21.15.87:3300/0 conn(0x7eff0406b850 0x7eff040b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 >> v1:172.21.15.87:6789/0 conn(0x7eff040cb980 legacy=0x7eff0406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:01.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0415a080 con 0x7eff040cbd60 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7efefc001a20 con 0x7eff040cbd60 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 >> v1:172.21.15.53:6789/0 conn(0x7eff040cbd60 legacy=0x7eff040b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec003980 0x7efeec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efeec0047d0 0x7efeec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efeec0052b0 0x7efeec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04159da0 con 0x7efeec0047d0 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec00c180 con 0x7efeec003980 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec00c340 con 0x7efeec0052b0 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff037fe640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efeec0047d0 0x7efeec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff03fff640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec003980 0x7efeec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff089c7640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efeec0052b0 0x7efeec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:01.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff037fe640 1 -- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efeec0052b0 msgr2=0x7efeec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff037fe640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efeec0052b0 0x7efeec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff037fe640 1 -- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec003980 msgr2=0x7efeec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff037fe640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec003980 0x7efeec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff037fe640 1 -- 172.21.15.53:0/3299198493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec003530 con 0x7efeec0047d0 2024-09-13T18:34:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff089c7640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efeec0052b0 0x7efeec00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff03fff640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec003980 0x7efeec003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:01.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.812+0000 7eff089c7640 1 -- 172.21.15.53:0/3299198493 reap_dead start 2024-09-13T18:34:01.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff037fe640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efeec0047d0 0x7efeec004c50 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7eff0406f1e0 tx=0x7efef801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18ffe8a02e3fbcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:01.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80a6490 con 0x7efeec0047d0 2024-09-13T18:34:01.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef80a65f0 con 0x7efeec0047d0 2024-09-13T18:34:01.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff02ffd640 1 -- 172.21.15.53:0/3299198493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80a69a0 con 0x7efeec0047d0 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 -- 172.21.15.53:0/3299198493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efeec0047d0 msgr2=0x7efeec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efeec0047d0 0x7efeec004c50 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7eff0406f1e0 tx=0x7efef801c9a0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 -- 172.21.15.53:0/3299198493 shutdown_connections 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 --2- 172.21.15.53:0/3299198493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efeec0047d0 0x7efeec004c50 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 -- 172.21.15.53:0/3299198493 >> 172.21.15.53:0/3299198493 conn(0x7eff04065c80 msgr2=0x7eff04066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 -- 172.21.15.53:0/3299198493 shutdown_connections 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 -- 172.21.15.53:0/3299198493 wait complete. 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 Processor -- start 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.816+0000 7eff0a42a640 1 -- start start 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec0047d0 0x7eff041397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0415aae0 0x7eff040aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff0415af60 0x7eff040aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0415c1b0 con 0x7eff0415af60 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04139cf0 con 0x7efeec0047d0 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0415b530 con 0x7eff0415aae0 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff0415af60 0x7eff040aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff0415af60 0x7eff040aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50630/0 (socket says 172.21.15.53:50630) 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 -- 172.21.15.53:0/2999594568 learned_addr learned my addr 172.21.15.53:0/2999594568 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff03fff640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec0047d0 0x7eff041397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 -- 172.21.15.53:0/2999594568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0415aae0 msgr2=0x7eff040aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0415aae0 0x7eff040aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 -- 172.21.15.53:0/2999594568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec0047d0 msgr2=0x7eff041397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec0047d0 0x7eff041397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 -- 172.21.15.53:0/2999594568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0415b810 con 0x7eff0415af60 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff089c7640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff0415af60 0x7eff040aac20 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7eff040717f0 tx=0x7efefc00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:01.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff00ff9640 1 -- 172.21.15.53:0/2999594568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc004d70 con 0x7eff0415af60 2024-09-13T18:34:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff00ff9640 1 -- 172.21.15.53:0/2999594568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00baa0 con 0x7eff0415af60 2024-09-13T18:34:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0415baf0 con 0x7eff0415af60 2024-09-13T18:34:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff00ff9640 1 -- 172.21.15.53:0/2999594568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00be50 con 0x7eff0415af60 2024-09-13T18:34:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff040ac950 con 0x7eff0415af60 2024-09-13T18:34:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff04067400 con 0x7eff0415af60 2024-09-13T18:34:01.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff00ff9640 1 -- 172.21.15.53:0/2999594568 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7efefc007070 con 0x7eff0415af60 2024-09-13T18:34:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff00ff9640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efef0066ea0 0x7efef0069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff00ff9640 1 -- 172.21.15.53:0/2999594568 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efefc082b70 con 0x7eff0415af60 2024-09-13T18:34:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff03fff640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efef0066ea0 0x7efef0069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.820+0000 7eff03fff640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efef0066ea0 0x7efef0069360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efef4000c10 tx=0x7efef4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:01.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:01.824+0000 7eff00ff9640 1 -- 172.21.15.53:0/2999594568 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efefc051a50 con 0x7eff0415af60 2024-09-13T18:34:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.016+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff0415c2f0 con 0x7eff0415af60 2024-09-13T18:34:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.016+0000 7eff00ff9640 1 -- 172.21.15.53:0/2999594568 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4742 (secure 0 0 0) 0x7eff0415c2f0 con 0x7eff0415af60 2024-09-13T18:34:02.020 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:02.020 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3371404154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3371404154},{"type":"v1","addr":"172.21.15.87:6833","nonce":3371404154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8665,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1374144604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1374144604},{"type":"v1","addr":"172.21.15.87:6835","nonce":1374144604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2656917860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656917860},{"type":"v1","addr":"172.21.15.53:6834","nonce":2656917860}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:58.642385+0000","modified":"2024-09-13T18:34:01.656052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10023},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10023":{"gid":10023,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3514602173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3514602173},{"type":"v1","addr":"172.21.15.53:6835","nonce":3514602173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2024-09-13T18:34:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2024-09-13T18:34:02.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efef0066ea0 msgr2=0x7efef0069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efef0066ea0 0x7efef0069360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efef4000c10 tx=0x7efef4009040 comp rx=0 tx=0).stop 2024-09-13T18:34:02.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff0415af60 msgr2=0x7eff040aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff0415af60 0x7eff040aac20 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7eff040717f0 tx=0x7efefc00b4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 shutdown_connections 2024-09-13T18:34:02.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efef0066ea0 0x7efef0069360 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0415aae0 0x7eff040aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7eff0415af60 0x7eff040aac20 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 --2- 172.21.15.53:0/2999594568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeec0047d0 0x7eff041397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 >> 172.21.15.53:0/2999594568 conn(0x7eff04065c80 msgr2=0x7eff040ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:02.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 shutdown_connections 2024-09-13T18:34:02.024 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.020+0000 7eff0a42a640 1 -- 172.21.15.53:0/2999594568 wait complete. 2024-09-13T18:34:02.038 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:02.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efee07c4640 1 Processor -- start 2024-09-13T18:34:02.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efee07c4640 1 -- start start 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efee07c4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 0x7efed806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efee07c4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed806d480 con 0x7efed80713a0 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efee07c4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed815ace0 con 0x7efed815b7c0 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efee07c4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed815aaf0 con 0x7efed81582a0 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeded61640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efed80713a0 0x7efed81640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50532/0 (socket says 172.21.15.53:50532) 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeded61640 1 -- 172.21.15.53:0/3749027844 learned_addr learned my addr 172.21.15.53:0/3749027844 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efede560640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 0x7efed806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038039864 0 0) 0x7efed806d480 con 0x7efed80713a0 2024-09-13T18:34:02.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec4003530 con 0x7efed80713a0 2024-09-13T18:34:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3644228639 0 0) 0x7efec4003530 con 0x7efed80713a0 2024-09-13T18:34:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 msgr2=0x7efed806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 0x7efed806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 >> v1:172.21.15.87:6789/0 conn(0x7efed815b7c0 legacy=0x7efed8070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed815afc0 con 0x7efed80713a0 2024-09-13T18:34:02.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7efed0001680 con 0x7efed80713a0 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 >> v1:172.21.15.53:6789/0 conn(0x7efed80713a0 legacy=0x7efed81640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec40039b0 0x7efec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec4004360 0x7efec4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 0x7efec4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec400b990 con 0x7efec4004360 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec400bad0 con 0x7efec40039b0 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec400bc90 con 0x7efed81582a0 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeddd5f640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec4004360 0x7efec4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efede560640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec40039b0 0x7efec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeded61640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 0x7efec4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeddd5f640 1 -- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 msgr2=0x7efec4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeddd5f640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 0x7efec4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeddd5f640 1 -- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec40039b0 msgr2=0x7efec4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeddd5f640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec40039b0 0x7efec4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeddd5f640 1 -- 172.21.15.53:0/3749027844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4003530 con 0x7efec4004360 2024-09-13T18:34:02.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.160+0000 7efeded61640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed81582a0 0x7efec4005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efeddd5f640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec4004360 0x7efec4004830 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7efec8001860 tx=0x7efec801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394d8d2ebfaa9aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80ab600 con 0x7efec4004360 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80a7050 con 0x7efec4004360 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efedd55e640 1 -- 172.21.15.53:0/3749027844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80ab9a0 con 0x7efec4004360 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- 172.21.15.53:0/3749027844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec4004360 msgr2=0x7efec4004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 --2- 172.21.15.53:0/3749027844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec4004360 0x7efec4004830 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7efec8001860 tx=0x7efec801c500 comp rx=0 tx=0).stop 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efeded61640 1 -- 172.21.15.53:0/3749027844 reap_dead start 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- 172.21.15.53:0/3749027844 shutdown_connections 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- 172.21.15.53:0/3749027844 >> 172.21.15.53:0/3749027844 conn(0x7efed8065c80 msgr2=0x7efed8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:02.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- 172.21.15.53:0/3749027844 shutdown_connections 2024-09-13T18:34:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- 172.21.15.53:0/3749027844 wait complete. 2024-09-13T18:34:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 Processor -- start 2024-09-13T18:34:02.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- start start 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec4004360 0x7efed8154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed814fae0 0x7efed806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efed81415d0 0x7efed8141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81541f0 con 0x7efed81415d0 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed8154bc0 con 0x7efec4004360 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.164+0000 7efee07c4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed81535e0 con 0x7efed814fae0 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efed81415d0 0x7efed8141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efed81415d0 0x7efed8141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50646/0 (socket says 172.21.15.53:50646) 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 -- 172.21.15.53:0/1539648711 learned_addr learned my addr 172.21.15.53:0/1539648711 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeddd5f640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed814fae0 0x7efed806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efede560640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec4004360 0x7efed8154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 -- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed814fae0 msgr2=0x7efed806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed814fae0 0x7efed806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 -- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec4004360 msgr2=0x7efed8154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec4004360 0x7efed8154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 -- 172.21.15.53:0/1539648711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed81538c0 con 0x7efed81415d0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeddd5f640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed814fae0 0x7efed806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeded61640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efed81415d0 0x7efed8141a30 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7efed0000c10 tx=0x7efed000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeceffd640 1 -- 172.21.15.53:0/1539648711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0007230 con 0x7efed81415d0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeceffd640 1 -- 172.21.15.53:0/1539648711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed0007390 con 0x7efed81415d0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed8153ba0 con 0x7efed81415d0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeceffd640 1 -- 172.21.15.53:0/1539648711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00047f0 con 0x7efed81415d0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed8141f70 con 0x7efed81415d0 2024-09-13T18:34:02.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed8067400 con 0x7efed81415d0 2024-09-13T18:34:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeceffd640 1 -- 172.21.15.53:0/1539648711 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7efed0004950 con 0x7efed81415d0 2024-09-13T18:34:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeceffd640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efebc066e70 0x7efebc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efeceffd640 1 -- 172.21.15.53:0/1539648711 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efed00823c0 con 0x7efed81415d0 2024-09-13T18:34:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efede560640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efebc066e70 0x7efebc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.168+0000 7efede560640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efebc066e70 0x7efebc069330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efed4007520 tx=0x7efed400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.172+0000 7efeceffd640 1 -- 172.21.15.53:0/1539648711 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efed0051330 con 0x7efed81415d0 2024-09-13T18:34:02.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.332+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efed81576a0 con 0x7efed81415d0 2024-09-13T18:34:02.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.336+0000 7efeceffd640 1 -- 172.21.15.53:0/1539648711 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16519 (secure 0 0 0) 0x7efed0054950 con 0x7efed81415d0 2024-09-13T18:34:02.339 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:02.339 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":162,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:59.644771+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:02.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efebc066e70 msgr2=0x7efebc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efebc066e70 0x7efebc069330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efed4007520 tx=0x7efed400b040 comp rx=0 tx=0).stop 2024-09-13T18:34:02.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efed81415d0 msgr2=0x7efed8141a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efed81415d0 0x7efed8141a30 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7efed0000c10 tx=0x7efed000dc00 comp rx=0 tx=0).stop 2024-09-13T18:34:02.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 shutdown_connections 2024-09-13T18:34:02.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7efebc066e70 0x7efebc069330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efed814fae0 0x7efed806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efed81415d0 0x7efed8141a30 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 --2- 172.21.15.53:0/1539648711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efec4004360 0x7efed8154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 >> 172.21.15.53:0/1539648711 conn(0x7efed8065c80 msgr2=0x7efed815c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:02.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 shutdown_connections 2024-09-13T18:34:02.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.340+0000 7efee07c4640 1 -- 172.21.15.53:0/1539648711 wait complete. 2024-09-13T18:34:02.357 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:34:02.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:34:02.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bbb5e4640 1 Processor -- start 2024-09-13T18:34:02.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bbb5e4640 1 -- start start 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bbb5e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0bb4158ba0 0x7f0bb406b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bbb5e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb406fa80 0x7f0bb40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bbb5e4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb40b2340 con 0x7f0bb40cbb60 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bbb5e4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb40b2860 con 0x7f0bb4158ba0 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bbb5e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4158f80 con 0x7f0bb406fa80 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9380640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0bb4158ba0 0x7f0bb406b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9380640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0bb4158ba0 0x7f0bb406b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50658/0 (socket says 172.21.15.53:50658) 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9380640 1 -- 172.21.15.53:0/2537824770 learned_addr learned my addr 172.21.15.53:0/2537824770 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9b81640 1 --2- 172.21.15.53:0/2537824770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb406fa80 0x7f0bb40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9380640 1 -- 172.21.15.53:0/2537824770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb406fa80 msgr2=0x7f0bb40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9380640 1 --2- 172.21.15.53:0/2537824770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb406fa80 0x7f0bb40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9380640 1 -- 172.21.15.53:0/2537824770 >> v1:172.21.15.87:6789/0 conn(0x7f0bb40cbb60 legacy=0x7f0bb406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.468+0000 7f0bb9380640 1 -- 172.21.15.53:0/2537824770 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40b2580 con 0x7f0bb4158ba0 2024-09-13T18:34:02.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 --2- 172.21.15.53:0/2537824770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb4158ba0 0x7f0bb406b390 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009870 tx=0x7f0bb001d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5b3a3e6b30a795 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0babfff640 1 -- 172.21.15.53:0/2537824770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00ab670 con 0x7f0bb4158ba0 2024-09-13T18:34:02.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0babfff640 1 -- 172.21.15.53:0/2537824770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb00ab7d0 con 0x7f0bb4158ba0 2024-09-13T18:34:02.473 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0babfff640 1 -- 172.21.15.53:0/2537824770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00abb60 con 0x7f0bb4158ba0 2024-09-13T18:34:02.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/2537824770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb4158ba0 msgr2=0x7f0bb406b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/2537824770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb4158ba0 0x7f0bb406b390 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009870 tx=0x7f0bb001d520 comp rx=0 tx=0).stop 2024-09-13T18:34:02.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/2537824770 shutdown_connections 2024-09-13T18:34:02.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/2537824770 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb406fa80 0x7f0bb40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/2537824770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb4158ba0 0x7f0bb406b390 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/2537824770 >> 172.21.15.53:0/2537824770 conn(0x7f0bb4065c80 msgr2=0x7f0bb4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:02.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/2537824770 shutdown_connections 2024-09-13T18:34:02.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/2537824770 wait complete. 2024-09-13T18:34:02.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 Processor -- start 2024-09-13T18:34:02.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- start start 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb406fa80 0x7f0bb4157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb40cbb60 0x7f0bb414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb4158ba0 0x7f0bb40a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40a98a0 con 0x7f0bb406fa80 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb414eed0 con 0x7f0bb40cbb60 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40a8a10 con 0x7f0bb4158ba0 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb406fa80 0x7f0bb4157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb406fa80 0x7f0bb4157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50664/0 (socket says 172.21.15.53:50664) 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 -- 172.21.15.53:0/3744288354 learned_addr learned my addr 172.21.15.53:0/3744288354 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9b81640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb4158ba0 0x7f0bb40a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb8b7f640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb40cbb60 0x7f0bb414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 -- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb4158ba0 msgr2=0x7f0bb40a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb4158ba0 0x7f0bb40a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 -- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb40cbb60 msgr2=0x7f0bb414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb40cbb60 0x7f0bb414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 -- 172.21.15.53:0/3744288354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00094d0 con 0x7f0bb406fa80 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb8b7f640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb40cbb60 0x7f0bb414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9b81640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb4158ba0 0x7f0bb40a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bb9380640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb406fa80 0x7f0bb4157320 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f0bb001b150 tx=0x7f0bb001a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0ba9ffb640 1 -- 172.21.15.53:0/3744288354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00b4620 con 0x7f0bb406fa80 2024-09-13T18:34:02.478 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0ba9ffb640 1 -- 172.21.15.53:0/3744288354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb00b4780 con 0x7f0bb406fa80 2024-09-13T18:34:02.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0ba9ffb640 1 -- 172.21.15.53:0/3744288354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00b4b10 con 0x7f0bb406fa80 2024-09-13T18:34:02.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb40a8c90 con 0x7f0bb406fa80 2024-09-13T18:34:02.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.472+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb40a9250 con 0x7f0bb406fa80 2024-09-13T18:34:02.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.476+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb4067400 con 0x7f0bb406fa80 2024-09-13T18:34:02.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.476+0000 7f0ba9ffb640 1 -- 172.21.15.53:0/3744288354 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f0bb00c0460 con 0x7f0bb406fa80 2024-09-13T18:34:02.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.476+0000 7f0ba9ffb640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b98066ea0 0x7f0b98069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.476+0000 7f0ba9ffb640 1 -- 172.21.15.53:0/3744288354 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bb011d020 con 0x7f0bb406fa80 2024-09-13T18:34:02.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.476+0000 7f0bb8b7f640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b98066ea0 0x7f0b98069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.480 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.476+0000 7f0bb8b7f640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b98066ea0 0x7f0b98069360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0bb41f6430 tx=0x7f0ba4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.480+0000 7f0ba9ffb640 1 -- 172.21.15.53:0/3744288354 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0bb00ec0b0 con 0x7f0bb406fa80 2024-09-13T18:34:02.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.636+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bb40b1e00 con 0x7f0b98066ea0 2024-09-13T18:34:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.648+0000 7f0ba9ffb640 1 -- 172.21.15.53:0/3744288354 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277456 (secure 0 0 0) 0x7f0bb40b1e00 con 0x7f0b98066ea0 2024-09-13T18:34:02.655 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:34:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b98066ea0 msgr2=0x7f0b98069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b98066ea0 0x7f0b98069360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0bb41f6430 tx=0x7f0ba4009040 comp rx=0 tx=0).stop 2024-09-13T18:34:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb406fa80 msgr2=0x7f0bb4157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb406fa80 0x7f0bb4157320 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f0bb001b150 tx=0x7f0bb001a2c0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 shutdown_connections 2024-09-13T18:34:02.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0b98066ea0 0x7f0b98069360 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bb4158ba0 0x7f0bb40a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bb40cbb60 0x7f0bb414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 --2- 172.21.15.53:0/3744288354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0bb406fa80 0x7f0bb4157320 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 >> 172.21.15.53:0/3744288354 conn(0x7f0bb4065c80 msgr2=0x7f0bb40af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:02.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 shutdown_connections 2024-09-13T18:34:02.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.652+0000 7f0bbb5e4640 1 -- 172.21.15.53:0/3744288354 wait complete. 2024-09-13T18:34:02.674 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-13T18:34:01.890751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294408,"kb_used_data":16784,"kb_used_omap":12,"kb_used_meta":277491,"kb_avail":754680312,"statfs":{"total":773094113280,"available":772792639488,"internally_reserved":0,"allocated":17186816,"data_stored":8237046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":284151352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.646154"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.252457+0000","last_change":"2024-09-13T18:33:57.252457+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.252457+0000","last_undegraded":"2024-09-13T18:33:57.252457+0000","last_fullsized":"2024-09-13T18:33:57.252457+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:32.035961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256433+0000","last_change":"2024-09-13T18:33:57.256433+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256433+0000","last_undegraded":"2024-09-13T18:33:57.256433+0000","last_fullsized":"2024-09-13T18:33:57.256433+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250379+0000","last_change":"2024-09-13T18:33:57.250379+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250379+0000","last_undegraded":"2024-09-13T18:33:57.250379+0000","last_fullsized":"2024-09-13T18:33:57.250379+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256504+0000","last_change":"2024-09-13T18:33:57.256504+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256504+0000","last_undegraded":"2024-09-13T18:33:57.256504+0000","last_fullsized":"2024-09-13T18:33:57.256504+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251769+0000","last_change":"2024-09-13T18:33:57.251769+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251769+0000","last_undegraded":"2024-09-13T18:33:57.251769+0000","last_fullsized":"2024-09-13T18:33:57.251769+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:36.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254889+0000","last_change":"2024-09-13T18:33:57.254889+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254889+0000","last_undegraded":"2024-09-13T18:33:57.254889+0000","last_fullsized":"2024-09-13T18:33:57.254889+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.263607+0000","last_change":"2024-09-13T18:33:57.263607+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.263607+0000","last_undegraded":"2024-09-13T18:33:57.263607+0000","last_fullsized":"2024-09-13T18:33:57.263607+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251118+0000","last_change":"2024-09-13T18:33:57.251118+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251118+0000","last_undegraded":"2024-09-13T18:33:57.251118+0000","last_fullsized":"2024-09-13T18:33:57.251118+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:47.405098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251753+0000","last_change":"2024-09-13T18:33:57.251753+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251753+0000","last_undegraded":"2024-09-13T18:33:57.251753+0000","last_fullsized":"2024-09-13T18:33:57.251753+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:19.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.252312+0000","last_change":"2024-09-13T18:33:57.252312+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.252312+0000","last_undegraded":"2024-09-13T18:33:57.252312+0000","last_fullsized":"2024-09-13T18:33:57.252312+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:24.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250403+0000","last_change":"2024-09-13T18:33:57.250403+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250403+0000","last_undegraded":"2024-09-13T18:33:57.250403+0000","last_fullsized":"2024-09-13T18:33:57.250403+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.262477+0000","last_change":"2024-09-13T18:33:57.262477+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.262477+0000","last_undegraded":"2024-09-13T18:33:57.262477+0000","last_fullsized":"2024-09-13T18:33:57.262477+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:06.070476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247328+0000","last_change":"2024-09-13T18:33:57.247328+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247328+0000","last_undegraded":"2024-09-13T18:33:57.247328+0000","last_fullsized":"2024-09-13T18:33:57.247328+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.296108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254774+0000","last_change":"2024-09-13T18:33:57.254774+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254774+0000","last_undegraded":"2024-09-13T18:33:57.254774+0000","last_fullsized":"2024-09-13T18:33:57.254774+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:40.901722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261584+0000","last_change":"2024-09-13T18:33:57.261584+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261584+0000","last_undegraded":"2024-09-13T18:33:57.261584+0000","last_fullsized":"2024-09-13T18:33:57.261584+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:47.459960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251788+0000","last_change":"2024-09-13T18:33:57.251788+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251788+0000","last_undegraded":"2024-09-13T18:33:57.251788+0000","last_fullsized":"2024-09-13T18:33:57.251788+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:40.804040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255363+0000","last_change":"2024-09-13T18:33:57.255363+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255363+0000","last_undegraded":"2024-09-13T18:33:57.255363+0000","last_fullsized":"2024-09-13T18:33:57.255363+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:15.548105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261629+0000","last_change":"2024-09-13T18:33:57.261629+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261629+0000","last_undegraded":"2024-09-13T18:33:57.261629+0000","last_fullsized":"2024-09-13T18:33:57.261629+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:03.791063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251054+0000","last_change":"2024-09-13T18:33:57.251054+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251054+0000","last_undegraded":"2024-09-13T18:33:57.251054+0000","last_fullsized":"2024-09-13T18:33:57.251054+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:26.507476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250847+0000","last_change":"2024-09-13T18:33:57.250847+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250847+0000","last_undegraded":"2024-09-13T18:33:57.250847+0000","last_fullsized":"2024-09-13T18:33:57.250847+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:30.625317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251705+0000","last_change":"2024-09-13T18:33:57.251705+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251705+0000","last_undegraded":"2024-09-13T18:33:57.251705+0000","last_fullsized":"2024-09-13T18:33:57.251705+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:19.538884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250258+0000","last_change":"2024-09-13T18:33:57.250258+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250258+0000","last_undegraded":"2024-09-13T18:33:57.250258+0000","last_fullsized":"2024-09-13T18:33:57.250258+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255472+0000","last_change":"2024-09-13T18:33:57.255472+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255472+0000","last_undegraded":"2024-09-13T18:33:57.255472+0000","last_fullsized":"2024-09-13T18:33:57.255472+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261821+0000","last_change":"2024-09-13T18:33:57.261821+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261821+0000","last_undegraded":"2024-09-13T18:33:57.261821+0000","last_fullsized":"2024-09-13T18:33:57.261821+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:41.543952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247224+0000","last_change":"2024-09-13T18:33:57.247224+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247224+0000","last_undegraded":"2024-09-13T18:33:57.247224+0000","last_fullsized":"2024-09-13T18:33:57.247224+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:13.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247103+0000","last_change":"2024-09-13T18:33:57.247103+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247103+0000","last_undegraded":"2024-09-13T18:33:57.247103+0000","last_fullsized":"2024-09-13T18:33:57.247103+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:11.134787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254869+0000","last_change":"2024-09-13T18:33:57.254869+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254869+0000","last_undegraded":"2024-09-13T18:33:57.254869+0000","last_fullsized":"2024-09-13T18:33:57.254869+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.574702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255603+0000","last_change":"2024-09-13T18:33:57.255603+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255603+0000","last_undegraded":"2024-09-13T18:33:57.255603+0000","last_fullsized":"2024-09-13T18:33:57.255603+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255523+0000","last_change":"2024-09-13T18:33:57.255523+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255523+0000","last_undegraded":"2024-09-13T18:33:57.255523+0000","last_fullsized":"2024-09-13T18:33:57.255523+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256639+0000","last_change":"2024-09-13T18:33:57.256639+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256639+0000","last_undegraded":"2024-09-13T18:33:57.256639+0000","last_fullsized":"2024-09-13T18:33:57.256639+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250879+0000","last_change":"2024-09-13T18:33:57.250879+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250879+0000","last_undegraded":"2024-09-13T18:33:57.250879+0000","last_fullsized":"2024-09-13T18:33:57.250879+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261569+0000","last_change":"2024-09-13T18:33:57.261569+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261569+0000","last_undegraded":"2024-09-13T18:33:57.261569+0000","last_fullsized":"2024-09-13T18:33:57.261569+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:29.530975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":319,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-13T18:33:56.552211+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:33:56.552211+0000","last_peered":"2024-09-13T18:33:56.552211+0000","last_clean":"2024-09-13T18:33:56.552211+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:33:56.552211+0000","last_undegraded":"2024-09-13T18:33:56.552211+0000","last_fullsized":"2024-09-13T18:33:56.552211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2596864,"data_stored":1473861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.6439999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93300000000000005,"15min":0.90000000000000002},"min":{"1min":0.57499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":1.333,"15min":1.4410000000000001},"last":0.99199999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.218,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":1.048},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.93200000000000005},"min":{"1min":0.54400000000000004,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.2490000000000001,"5min":1.4890000000000001,"15min":1.6060000000000001},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80900000000000005,"15min":0.80400000000000005},"min":{"1min":0.53700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":1.276,"15min":1.276},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.165,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1339999999999999,"5min":1.349,"15min":1.448},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.238,"5min":1.395,"15min":1.397},"last":1.1220000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.873,"15min":0.88800000000000001},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.218,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.93999999999999995},"min":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95499999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.877},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.70299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":1.409,"15min":1.409},"last":1.296}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.85499999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":1.476,"15min":1.476},"last":1.24},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.02,"15min":1.006},"min":{"1min":0.65000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2689999999999999,"5min":1.361,"15min":1.506},"last":1.268}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1990656,"data_stored":877676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.82699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.0820000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.443},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.3480000000000001,"15min":1.577},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":0.91600000000000004},"min":{"1min":0.71899999999999997,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.069,"5min":1.218,"15min":1.464},"last":1.0920000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.95799999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.319,"5min":1.673,"15min":2.4220000000000002},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.516,"15min":1.516},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.61899999999999999,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.2669999999999999,"15min":1.306},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.97099999999999997},"min":{"1min":0.72799999999999998,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.2350000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.014},"min":{"1min":0.79200000000000004,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.2589999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1419999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.69399999999999995,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.01,"5min":1.024,"15min":1.0800000000000001},"min":{"1min":0.67200000000000004,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":2.762},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.0369999999999999},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.22,"5min":1.5,"15min":1.9299999999999999},"last":1.02},{"interface":"front","average":{"1min":1.024,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.2470000000000001,"5min":1.357,"15min":1.72},"last":1.0449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":0.83899999999999997},"min":{"1min":0.47899999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.88700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.437},"max":{"1min":1.089,"5min":1.264,"15min":2.1840000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1719999999999999,"5min":1.603,"15min":1.603},"last":0.629},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.167},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92800000000000005,"15min":0.95099999999999996},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.21,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.64800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95299999999999996,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.46,"5min":3.46,"15min":3.46},"last":1.218},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.306,"5min":1.492,"15min":1.5049999999999999},"last":1.4790000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0109999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.376,"15min":0.376},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.97499999999999998,"15min":1.014},"min":{"1min":0.63100000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.125}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.0960000000000001},"min":{"1min":0.65800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.246},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.76000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":1.3140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93200000000000005,"15min":0.84499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2649999999999999,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.159},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.91000000000000003,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.242,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.216,"5min":1.536,"15min":1.536},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.89200000000000002},"min":{"1min":0.52600000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3660000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.94899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.367,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.874}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.92300000000000004,"15min":0.90500000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4490000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.117},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":10.44,"15min":10.44},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.286,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":0.97199999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.363,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1259999999999999,"15min":1.0309999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.222,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.504,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.1819999999999999,"15min":1.091},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.573,"5min":15.593,"15min":15.593},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.077},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4119999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.052}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37172,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334668,"statfs":{"total":96636764160,"available":96598700032,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98699999999999999,"5min":1.444,"15min":2.113},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.89300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.34100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.33700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96699999999999997,"5min":1.4850000000000001,"15min":1.742},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.74099999999999999},"min":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":1.222,"15min":1.399},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95699999999999996,"15min":1.0640000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":1.54}]},{"osd":5,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":0.99199999999999999},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1279999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.349,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95899999999999996,"15min":1.0369999999999999},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.99099999999999999,"15min":1.034},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.454,"5min":1.6890000000000001,"15min":1.96},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.02,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.413,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97399999999999998,"15min":1.0009999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.504,"5min":1.504,"15min":2.9220000000000002},"last":1.504}]}]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41264,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330576,"statfs":{"total":96636764160,"available":96594509824,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.024,"5min":1.024,"15min":1.0309999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67600000000000005,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.01,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65700000000000003,"15min":0.70499999999999996},"min":{"1min":0.32000000000000001,"5min":0.318,"15min":0.307},"max":{"1min":0.98599999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.71199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.71899999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0760000000000001,"5min":1.161,"15min":1.1859999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.264,"5min":1.405,"15min":1.405},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90900000000000003,"15min":0.91400000000000003},"min":{"1min":0.61899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.339,"5min":1.367,"15min":1.611},"last":1.093},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88600000000000001,"15min":0.91200000000000003},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2649999999999999,"5min":1.587,"15min":1.587},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.72399999999999998,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.9179999999999999},"last":1.304},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.456,"5min":1.552,"15min":1.702},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":0.95799999999999996},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.3819999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.034},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.58799999999999997},"max":{"1min":1.5409999999999999,"5min":1.645,"15min":1.645},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.70199999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.3009999999999999,"5min":1.843,"15min":1.843},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0369999999999999,"15min":1.0740000000000001},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4219999999999999,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":1.4039999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41268,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330572,"statfs":{"total":96636764160,"available":96594505728,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89600000000000002,"5min":1.077,"15min":1.077},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":1.042,"15min":1.177},"last":1.407}]},{"osd":2,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":1.077,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.70699999999999996},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.27800000000000002},"max":{"1min":1.048,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.274}]},{"osd":3,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.317},"max":{"1min":1.125,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":1.423,"15min":1.423},"last":1.1100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92300000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.42899999999999999},"max":{"1min":1.1499999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2589999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.159},{"interface":"front","average":{"1min":0.995,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.484,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1930000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98499999999999999,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1859999999999999,"5min":1.5900000000000001,"15min":1.653},"last":1.306},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":0.98799999999999999},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.262,"5min":1.425,"15min":1.5740000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.52500000000000002},"max":{"1min":1.5329999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.458},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.0209999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.4850000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41832,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330008,"statfs":{"total":96636764160,"available":96593928192,"internally_reserved":0,"allocated":2584576,"data_stored":1468044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.018,"5min":1.244,"15min":1.4359999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94499999999999995,"5min":1.333,"15min":1.333},"last":0.253},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0920000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.311}]},{"osd":3,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.002,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.171,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.87,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.3879999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.294,"5min":1.5069999999999999,"15min":1.986},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4379999999999999,"5min":1.8799999999999999,"15min":2.641},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58499999999999996},"max":{"1min":1.395,"5min":1.395,"15min":1.6699999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.60499999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.333,"5min":1.466,"15min":1.891},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.0229999999999999},"min":{"1min":0.63400000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.363,"5min":1.669,"15min":2.2949999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0980000000000001},"min":{"1min":0.68000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4530000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:34:02.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:34:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.832+0000 7f88b33c5640 1 Processor -- start 2024-09-13T18:34:02.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.832+0000 7f88b33c5640 1 -- start start 2024-09-13T18:34:02.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f88ac0b4bf0 0x7f88ac0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88ac06dbf0 0x7f88ac0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac06ce80 con 0x7f88ac0cee80 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac15baa0 con 0x7f88ac06dbf0 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac0cf650 con 0x7f88ac0b4bf0 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88ac06dbf0 0x7f88ac0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88ac06dbf0 0x7f88ac0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50666/0 (socket says 172.21.15.53:50666) 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 -- 172.21.15.53:0/2556605228 learned_addr learned my addr 172.21.15.53:0/2556605228 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 -- 172.21.15.53:0/2556605228 >> v2:172.21.15.87:3300/0 conn(0x7f88ac0b4bf0 msgr2=0x7f88ac0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b1161640 1 --2- 172.21.15.53:0/2556605228 >> v2:172.21.15.87:3300/0 conn(0x7f88ac0b4bf0 0x7f88ac0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 --2- 172.21.15.53:0/2556605228 >> v2:172.21.15.87:3300/0 conn(0x7f88ac0b4bf0 0x7f88ac0b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 -- 172.21.15.53:0/2556605228 >> v1:172.21.15.87:6789/0 conn(0x7f88ac0cee80 legacy=0x7f88ac065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:02.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 -- 172.21.15.53:0/2556605228 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0b5510 con 0x7f88ac06dbf0 2024-09-13T18:34:02.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b0960640 1 --2- 172.21.15.53:0/2556605228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0ce940 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f88ac070850 tx=0x7f889c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9125e0665a4a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88abfff640 1 -- 172.21.15.53:0/2556605228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0a57b0 con 0x7f88ac06dbf0 2024-09-13T18:34:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88abfff640 1 -- 172.21.15.53:0/2556605228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c0a5910 con 0x7f88ac06dbf0 2024-09-13T18:34:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88abfff640 1 -- 172.21.15.53:0/2556605228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0a5ca0 con 0x7f88ac06dbf0 2024-09-13T18:34:02.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- 172.21.15.53:0/2556605228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 msgr2=0x7f88ac0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 --2- 172.21.15.53:0/2556605228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0ce940 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f88ac070850 tx=0x7f889c01c8f0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- 172.21.15.53:0/2556605228 shutdown_connections 2024-09-13T18:34:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 --2- 172.21.15.53:0/2556605228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0ce940 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 --2- 172.21.15.53:0/2556605228 >> v2:172.21.15.87:3300/0 conn(0x7f88ac0b4bf0 0x7f88ac0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- 172.21.15.53:0/2556605228 >> 172.21.15.53:0/2556605228 conn(0x7f88ac069f50 msgr2=0x7f88ac06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- 172.21.15.53:0/2556605228 shutdown_connections 2024-09-13T18:34:02.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.836+0000 7f88b33c5640 1 -- 172.21.15.53:0/2556605228 wait complete. 2024-09-13T18:34:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 Processor -- start 2024-09-13T18:34:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 -- start start 2024-09-13T18:34:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88ac0b4bf0 0x7f88ac1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88ac0cee80 0x7f88ac144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b49f0 con 0x7f88ac06dbf0 2024-09-13T18:34:02.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b2a80 con 0x7f88ac0cee80 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b2d60 con 0x7f88ac0b4bf0 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50682/0 (socket says 172.21.15.53:50682) 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 -- 172.21.15.53:0/3185921833 learned_addr learned my addr 172.21.15.53:0/3185921833 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b0960640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88ac0b4bf0 0x7f88ac1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 -- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88ac0b4bf0 msgr2=0x7f88ac1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1962640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88ac0cee80 0x7f88ac144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88ac0b4bf0 0x7f88ac1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 -- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88ac0cee80 msgr2=0x7f88ac144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88ac0cee80 0x7f88ac144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 -- 172.21.15.53:0/3185921833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009b30 con 0x7f88ac06dbf0 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1962640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88ac0cee80 0x7f88ac144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b1161640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0b44b0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c7f0 tx=0x7f88a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88a9ffb640 1 -- 172.21.15.53:0/3185921833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0004220 con 0x7f88ac06dbf0 2024-09-13T18:34:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88a9ffb640 1 -- 172.21.15.53:0/3185921833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a00043a0 con 0x7f88ac06dbf0 2024-09-13T18:34:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac0b3040 con 0x7f88ac06dbf0 2024-09-13T18:34:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88a9ffb640 1 -- 172.21.15.53:0/3185921833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0004510 con 0x7f88ac06dbf0 2024-09-13T18:34:02.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac0b3600 con 0x7f88ac06dbf0 2024-09-13T18:34:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac0ce940 con 0x7f88ac06dbf0 2024-09-13T18:34:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.840+0000 7f88a9ffb640 1 -- 172.21.15.53:0/3185921833 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f88a0003a70 con 0x7f88ac06dbf0 2024-09-13T18:34:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.844+0000 7f88a9ffb640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8898066e70 0x7f8898069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.844+0000 7f88a9ffb640 1 -- 172.21.15.53:0/3185921833 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88a0082840 con 0x7f88ac06dbf0 2024-09-13T18:34:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.844+0000 7f88b0960640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8898066e70 0x7f8898069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.844+0000 7f88b0960640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8898066e70 0x7f8898069330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f889c0ae000 tx=0x7f889c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.848+0000 7f88a9ffb640 1 -- 172.21.15.53:0/3185921833 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88a00517b0 con 0x7f88ac06dbf0 2024-09-13T18:34:02.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:02.996+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88ac1643d0 con 0x7f8898066e70 2024-09-13T18:34:03.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.004+0000 7f88a9ffb640 1 -- 172.21.15.53:0/3185921833 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277456 (secure 0 0 0) 0x7f88ac1643d0 con 0x7f8898066e70 2024-09-13T18:34:03.009 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:03.011 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8898066e70 msgr2=0x7f8898069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8898066e70 0x7f8898069330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f889c0ae000 tx=0x7f889c0a7070 comp rx=0 tx=0).stop 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 msgr2=0x7f88ac0b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0b44b0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c7f0 tx=0x7f88a000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 shutdown_connections 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8898066e70 0x7f8898069330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88ac0b4bf0 0x7f88ac1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88ac0cee80 0x7f88ac144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 --2- 172.21.15.53:0/3185921833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88ac06dbf0 0x7f88ac0b44b0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 >> 172.21.15.53:0/3185921833 conn(0x7f88ac069f50 msgr2=0x7f88ac152a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 shutdown_connections 2024-09-13T18:34:03.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.008+0000 7f88b33c5640 1 -- 172.21.15.53:0/3185921833 wait complete. 2024-09-13T18:34:03.026 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-13T18:34:01.890751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294408,"kb_used_data":16784,"kb_used_omap":12,"kb_used_meta":277491,"kb_avail":754680312,"statfs":{"total":773094113280,"available":772792639488,"internally_reserved":0,"allocated":17186816,"data_stored":8237046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":284151352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.646154"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.252457+0000","last_change":"2024-09-13T18:33:57.252457+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.252457+0000","last_undegraded":"2024-09-13T18:33:57.252457+0000","last_fullsized":"2024-09-13T18:33:57.252457+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:32.035961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256433+0000","last_change":"2024-09-13T18:33:57.256433+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256433+0000","last_undegraded":"2024-09-13T18:33:57.256433+0000","last_fullsized":"2024-09-13T18:33:57.256433+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250379+0000","last_change":"2024-09-13T18:33:57.250379+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250379+0000","last_undegraded":"2024-09-13T18:33:57.250379+0000","last_fullsized":"2024-09-13T18:33:57.250379+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256504+0000","last_change":"2024-09-13T18:33:57.256504+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256504+0000","last_undegraded":"2024-09-13T18:33:57.256504+0000","last_fullsized":"2024-09-13T18:33:57.256504+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251769+0000","last_change":"2024-09-13T18:33:57.251769+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251769+0000","last_undegraded":"2024-09-13T18:33:57.251769+0000","last_fullsized":"2024-09-13T18:33:57.251769+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:36.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254889+0000","last_change":"2024-09-13T18:33:57.254889+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254889+0000","last_undegraded":"2024-09-13T18:33:57.254889+0000","last_fullsized":"2024-09-13T18:33:57.254889+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.263607+0000","last_change":"2024-09-13T18:33:57.263607+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.263607+0000","last_undegraded":"2024-09-13T18:33:57.263607+0000","last_fullsized":"2024-09-13T18:33:57.263607+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251118+0000","last_change":"2024-09-13T18:33:57.251118+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251118+0000","last_undegraded":"2024-09-13T18:33:57.251118+0000","last_fullsized":"2024-09-13T18:33:57.251118+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:47.405098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251753+0000","last_change":"2024-09-13T18:33:57.251753+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251753+0000","last_undegraded":"2024-09-13T18:33:57.251753+0000","last_fullsized":"2024-09-13T18:33:57.251753+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:19.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.252312+0000","last_change":"2024-09-13T18:33:57.252312+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.252312+0000","last_undegraded":"2024-09-13T18:33:57.252312+0000","last_fullsized":"2024-09-13T18:33:57.252312+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:24.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250403+0000","last_change":"2024-09-13T18:33:57.250403+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250403+0000","last_undegraded":"2024-09-13T18:33:57.250403+0000","last_fullsized":"2024-09-13T18:33:57.250403+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.262477+0000","last_change":"2024-09-13T18:33:57.262477+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.262477+0000","last_undegraded":"2024-09-13T18:33:57.262477+0000","last_fullsized":"2024-09-13T18:33:57.262477+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:06.070476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247328+0000","last_change":"2024-09-13T18:33:57.247328+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247328+0000","last_undegraded":"2024-09-13T18:33:57.247328+0000","last_fullsized":"2024-09-13T18:33:57.247328+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.296108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254774+0000","last_change":"2024-09-13T18:33:57.254774+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254774+0000","last_undegraded":"2024-09-13T18:33:57.254774+0000","last_fullsized":"2024-09-13T18:33:57.254774+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:40.901722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261584+0000","last_change":"2024-09-13T18:33:57.261584+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261584+0000","last_undegraded":"2024-09-13T18:33:57.261584+0000","last_fullsized":"2024-09-13T18:33:57.261584+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:47.459960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251788+0000","last_change":"2024-09-13T18:33:57.251788+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251788+0000","last_undegraded":"2024-09-13T18:33:57.251788+0000","last_fullsized":"2024-09-13T18:33:57.251788+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:40.804040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255363+0000","last_change":"2024-09-13T18:33:57.255363+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255363+0000","last_undegraded":"2024-09-13T18:33:57.255363+0000","last_fullsized":"2024-09-13T18:33:57.255363+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:15.548105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261629+0000","last_change":"2024-09-13T18:33:57.261629+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261629+0000","last_undegraded":"2024-09-13T18:33:57.261629+0000","last_fullsized":"2024-09-13T18:33:57.261629+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:03.791063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251054+0000","last_change":"2024-09-13T18:33:57.251054+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251054+0000","last_undegraded":"2024-09-13T18:33:57.251054+0000","last_fullsized":"2024-09-13T18:33:57.251054+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:26.507476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250847+0000","last_change":"2024-09-13T18:33:57.250847+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250847+0000","last_undegraded":"2024-09-13T18:33:57.250847+0000","last_fullsized":"2024-09-13T18:33:57.250847+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:30.625317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251705+0000","last_change":"2024-09-13T18:33:57.251705+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251705+0000","last_undegraded":"2024-09-13T18:33:57.251705+0000","last_fullsized":"2024-09-13T18:33:57.251705+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:19.538884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250258+0000","last_change":"2024-09-13T18:33:57.250258+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250258+0000","last_undegraded":"2024-09-13T18:33:57.250258+0000","last_fullsized":"2024-09-13T18:33:57.250258+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255472+0000","last_change":"2024-09-13T18:33:57.255472+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255472+0000","last_undegraded":"2024-09-13T18:33:57.255472+0000","last_fullsized":"2024-09-13T18:33:57.255472+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261821+0000","last_change":"2024-09-13T18:33:57.261821+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261821+0000","last_undegraded":"2024-09-13T18:33:57.261821+0000","last_fullsized":"2024-09-13T18:33:57.261821+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:41.543952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247224+0000","last_change":"2024-09-13T18:33:57.247224+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247224+0000","last_undegraded":"2024-09-13T18:33:57.247224+0000","last_fullsized":"2024-09-13T18:33:57.247224+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:13.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247103+0000","last_change":"2024-09-13T18:33:57.247103+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247103+0000","last_undegraded":"2024-09-13T18:33:57.247103+0000","last_fullsized":"2024-09-13T18:33:57.247103+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:11.134787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254869+0000","last_change":"2024-09-13T18:33:57.254869+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254869+0000","last_undegraded":"2024-09-13T18:33:57.254869+0000","last_fullsized":"2024-09-13T18:33:57.254869+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.574702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255603+0000","last_change":"2024-09-13T18:33:57.255603+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255603+0000","last_undegraded":"2024-09-13T18:33:57.255603+0000","last_fullsized":"2024-09-13T18:33:57.255603+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255523+0000","last_change":"2024-09-13T18:33:57.255523+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255523+0000","last_undegraded":"2024-09-13T18:33:57.255523+0000","last_fullsized":"2024-09-13T18:33:57.255523+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256639+0000","last_change":"2024-09-13T18:33:57.256639+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256639+0000","last_undegraded":"2024-09-13T18:33:57.256639+0000","last_fullsized":"2024-09-13T18:33:57.256639+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250879+0000","last_change":"2024-09-13T18:33:57.250879+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250879+0000","last_undegraded":"2024-09-13T18:33:57.250879+0000","last_fullsized":"2024-09-13T18:33:57.250879+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261569+0000","last_change":"2024-09-13T18:33:57.261569+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261569+0000","last_undegraded":"2024-09-13T18:33:57.261569+0000","last_fullsized":"2024-09-13T18:33:57.261569+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:29.530975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":319,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-13T18:33:56.552211+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:33:56.552211+0000","last_peered":"2024-09-13T18:33:56.552211+0000","last_clean":"2024-09-13T18:33:56.552211+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:33:56.552211+0000","last_undegraded":"2024-09-13T18:33:56.552211+0000","last_fullsized":"2024-09-13T18:33:56.552211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2596864,"data_stored":1473861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.6439999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93300000000000005,"15min":0.90000000000000002},"min":{"1min":0.57499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":1.333,"15min":1.4410000000000001},"last":0.99199999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.218,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":1.048},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.93200000000000005},"min":{"1min":0.54400000000000004,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.2490000000000001,"5min":1.4890000000000001,"15min":1.6060000000000001},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80900000000000005,"15min":0.80400000000000005},"min":{"1min":0.53700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":1.276,"15min":1.276},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.165,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1339999999999999,"5min":1.349,"15min":1.448},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.238,"5min":1.395,"15min":1.397},"last":1.1220000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.873,"15min":0.88800000000000001},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.218,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.93999999999999995},"min":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95499999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.877},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.70299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":1.409,"15min":1.409},"last":1.296}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.85499999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":1.476,"15min":1.476},"last":1.24},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.02,"15min":1.006},"min":{"1min":0.65000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2689999999999999,"5min":1.361,"15min":1.506},"last":1.268}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1990656,"data_stored":877676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.82699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.0820000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.443},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.3480000000000001,"15min":1.577},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":0.91600000000000004},"min":{"1min":0.71899999999999997,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.069,"5min":1.218,"15min":1.464},"last":1.0920000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.95799999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.319,"5min":1.673,"15min":2.4220000000000002},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.516,"15min":1.516},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.61899999999999999,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.2669999999999999,"15min":1.306},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.97099999999999997},"min":{"1min":0.72799999999999998,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.2350000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.014},"min":{"1min":0.79200000000000004,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.2589999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1419999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.69399999999999995,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.01,"5min":1.024,"15min":1.0800000000000001},"min":{"1min":0.67200000000000004,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":2.762},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.0369999999999999},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.22,"5min":1.5,"15min":1.9299999999999999},"last":1.02},{"interface":"front","average":{"1min":1.024,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.2470000000000001,"5min":1.357,"15min":1.72},"last":1.0449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":0.83899999999999997},"min":{"1min":0.47899999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.88700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.437},"max":{"1min":1.089,"5min":1.264,"15min":2.1840000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1719999999999999,"5min":1.603,"15min":1.603},"last":0.629},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.167},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92800000000000005,"15min":0.95099999999999996},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.21,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.64800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95299999999999996,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.46,"5min":3.46,"15min":3.46},"last":1.218},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.306,"5min":1.492,"15min":1.5049999999999999},"last":1.4790000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0109999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.376,"15min":0.376},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.97499999999999998,"15min":1.014},"min":{"1min":0.63100000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.125}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.0960000000000001},"min":{"1min":0.65800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.246},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.76000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":1.3140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93200000000000005,"15min":0.84499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2649999999999999,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.159},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.91000000000000003,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.242,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.216,"5min":1.536,"15min":1.536},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.89200000000000002},"min":{"1min":0.52600000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3660000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.94899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.367,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.874}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.92300000000000004,"15min":0.90500000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4490000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.117},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":10.44,"15min":10.44},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.286,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":0.97199999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.363,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1259999999999999,"15min":1.0309999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.222,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.504,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.1819999999999999,"15min":1.091},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.573,"5min":15.593,"15min":15.593},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.077},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4119999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.052}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37172,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334668,"statfs":{"total":96636764160,"available":96598700032,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98699999999999999,"5min":1.444,"15min":2.113},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.89300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.34100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.33700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96699999999999997,"5min":1.4850000000000001,"15min":1.742},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.74099999999999999},"min":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":1.222,"15min":1.399},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95699999999999996,"15min":1.0640000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":1.54}]},{"osd":5,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":0.99199999999999999},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1279999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.349,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95899999999999996,"15min":1.0369999999999999},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.99099999999999999,"15min":1.034},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.454,"5min":1.6890000000000001,"15min":1.96},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.02,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.413,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97399999999999998,"15min":1.0009999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.504,"5min":1.504,"15min":2.9220000000000002},"last":1.504}]}]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41264,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330576,"statfs":{"total":96636764160,"available":96594509824,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.024,"5min":1.024,"15min":1.0309999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67600000000000005,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.01,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65700000000000003,"15min":0.70499999999999996},"min":{"1min":0.32000000000000001,"5min":0.318,"15min":0.307},"max":{"1min":0.98599999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.71199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.71899999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0760000000000001,"5min":1.161,"15min":1.1859999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.264,"5min":1.405,"15min":1.405},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90900000000000003,"15min":0.91400000000000003},"min":{"1min":0.61899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.339,"5min":1.367,"15min":1.611},"last":1.093},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88600000000000001,"15min":0.91200000000000003},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2649999999999999,"5min":1.587,"15min":1.587},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.72399999999999998,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.9179999999999999},"last":1.304},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.456,"5min":1.552,"15min":1.702},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":0.95799999999999996},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.3819999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.034},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.58799999999999997},"max":{"1min":1.5409999999999999,"5min":1.645,"15min":1.645},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.70199999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.3009999999999999,"5min":1.843,"15min":1.843},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0369999999999999,"15min":1.0740000000000001},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4219999999999999,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":1.4039999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41268,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330572,"statfs":{"total":96636764160,"available":96594505728,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89600000000000002,"5min":1.077,"15min":1.077},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":1.042,"15min":1.177},"last":1.407}]},{"osd":2,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":1.077,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.70699999999999996},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.27800000000000002},"max":{"1min":1.048,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.274}]},{"osd":3,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.317},"max":{"1min":1.125,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":1.423,"15min":1.423},"last":1.1100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92300000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.42899999999999999},"max":{"1min":1.1499999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2589999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.159},{"interface":"front","average":{"1min":0.995,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.484,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1930000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98499999999999999,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1859999999999999,"5min":1.5900000000000001,"15min":1.653},"last":1.306},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":0.98799999999999999},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.262,"5min":1.425,"15min":1.5740000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.52500000000000002},"max":{"1min":1.5329999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.458},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.0209999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.4850000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41832,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330008,"statfs":{"total":96636764160,"available":96593928192,"internally_reserved":0,"allocated":2584576,"data_stored":1468044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.018,"5min":1.244,"15min":1.4359999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94499999999999995,"5min":1.333,"15min":1.333},"last":0.253},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0920000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.311}]},{"osd":3,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.002,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.171,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.87,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.3879999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.294,"5min":1.5069999999999999,"15min":1.986},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4379999999999999,"5min":1.8799999999999999,"15min":2.641},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58499999999999996},"max":{"1min":1.395,"5min":1.395,"15min":1.6699999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.60499999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.333,"5min":1.466,"15min":1.891},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.0229999999999999},"min":{"1min":0.63400000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.363,"5min":1.669,"15min":2.2949999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0980000000000001},"min":{"1min":0.68000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4530000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:34:03.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:34:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229ee8d640 1 Processor -- start 2024-09-13T18:34:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229ee8d640 1 -- start start 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229ee8d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22980af5e0 0x7f2298165320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229ee8d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980b0b90 con 0x7f229815db40 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229ee8d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980ad530 con 0x7f22980b1960 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229ee8d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22980ae1b0 con 0x7f22980af5e0 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229cc29640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f229815db40 0x7f22980afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50534/0 (socket says 172.21.15.53:50534) 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229cc29640 1 -- 172.21.15.53:0/1938051279 learned_addr learned my addr 172.21.15.53:0/1938051279 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229d42a640 1 --2- 172.21.15.53:0/1938051279 >> v2:172.21.15.53:3300/0 conn(0x7f22980af5e0 0x7f2298165320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f22977fe640 1 -- 172.21.15.53:0/1938051279 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704506641 0 0) 0x7f22980b0b90 con 0x7f229815db40 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f22977fe640 1 -- 172.21.15.53:0/1938051279 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2280003530 con 0x7f229815db40 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229d42a640 1 -- 172.21.15.53:0/1938051279 >> v1:172.21.15.87:6789/0 conn(0x7f22980b1960 legacy=0x7f22980b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229d42a640 1 -- 172.21.15.53:0/1938051279 >> v1:172.21.15.53:6789/0 conn(0x7f229815db40 legacy=0x7f22980afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.184+0000 7f229d42a640 1 -- 172.21.15.53:0/1938051279 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22980ad810 con 0x7f22980af5e0 2024-09-13T18:34:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229d42a640 1 --2- 172.21.15.53:0/1938051279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298165320 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f22900097c0 tx=0x7f229001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e8091733b9bab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f22977fe640 1 -- 172.21.15.53:0/1938051279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22900ac640 con 0x7f22980af5e0 2024-09-13T18:34:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f22977fe640 1 -- 172.21.15.53:0/1938051279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22900ac7a0 con 0x7f22980af5e0 2024-09-13T18:34:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f22977fe640 1 -- 172.21.15.53:0/1938051279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22900acb30 con 0x7f22980af5e0 2024-09-13T18:34:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- 172.21.15.53:0/1938051279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 msgr2=0x7f2298165320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1938051279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298165320 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f22900097c0 tx=0x7f229001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- 172.21.15.53:0/1938051279 shutdown_connections 2024-09-13T18:34:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1938051279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298165320 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- 172.21.15.53:0/1938051279 >> 172.21.15.53:0/1938051279 conn(0x7f22980b20d0 msgr2=0x7f22980b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- 172.21.15.53:0/1938051279 shutdown_connections 2024-09-13T18:34:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- 172.21.15.53:0/1938051279 wait complete. 2024-09-13T18:34:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 Processor -- start 2024-09-13T18:34:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- start start 2024-09-13T18:34:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22980b1960 0x7f2298153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f229815db40 0x7f229815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298155250 con 0x7f22980af5e0 2024-09-13T18:34:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22981566c0 con 0x7f22980b1960 2024-09-13T18:34:03.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229ee8d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2298157090 con 0x7f229815db40 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50706/0 (socket says 172.21.15.53:50706) 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 -- 172.21.15.53:0/1262893462 learned_addr learned my addr 172.21.15.53:0/1262893462 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 -- 172.21.15.53:0/1262893462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f229815db40 msgr2=0x7f229815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f229815db40 0x7f229815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 -- 172.21.15.53:0/1262893462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22980b1960 msgr2=0x7f2298153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f2297fff640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22980b1960 0x7f2298153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22980b1960 0x7f2298153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.188+0000 7f229cc29640 1 -- 172.21.15.53:0/1262893462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290009420 con 0x7f22980af5e0 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f229cc29640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298156b50 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f228800cbc0 tx=0x7f228800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f22957fa640 1 -- 172.21.15.53:0/1262893462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228800ad40 con 0x7f22980af5e0 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f22957fa640 1 -- 172.21.15.53:0/1262893462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288012400 con 0x7f22980af5e0 2024-09-13T18:34:03.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f22957fa640 1 -- 172.21.15.53:0/1262893462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228800aea0 con 0x7f22980af5e0 2024-09-13T18:34:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2298155d90 con 0x7f22980af5e0 2024-09-13T18:34:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2298156350 con 0x7f22980af5e0 2024-09-13T18:34:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2298156510 con 0x7f22980af5e0 2024-09-13T18:34:03.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f22957fa640 1 -- 172.21.15.53:0/1262893462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f2288007070 con 0x7f22980af5e0 2024-09-13T18:34:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f22957fa640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2284066e70 0x7f2284069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f2297fff640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2284066e70 0x7f2284069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f22957fa640 1 -- 172.21.15.53:0/1262893462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2288082840 con 0x7f22980af5e0 2024-09-13T18:34:03.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.192+0000 7f2297fff640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2284066e70 0x7f2284069330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f22980b65e0 tx=0x7f228c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.196+0000 7f22957fa640 1 -- 172.21.15.53:0/1262893462 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22880517b0 con 0x7f22980af5e0 2024-09-13T18:34:03.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.348+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2298168490 con 0x7f2284066e70 2024-09-13T18:34:03.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.356+0000 7f22957fa640 1 -- 172.21.15.53:0/1262893462 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277456 (secure 0 0 0) 0x7f228c0050d0 con 0x7f2284066e70 2024-09-13T18:34:03.360 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:03.361 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2284066e70 msgr2=0x7f2284069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2284066e70 0x7f2284069330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f22980b65e0 tx=0x7f228c009040 comp rx=0 tx=0).stop 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 msgr2=0x7f2298156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298156b50 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f228800cbc0 tx=0x7f228800a430 comp rx=0 tx=0).stop 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 shutdown_connections 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2284066e70 0x7f2284069330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f229815db40 0x7f229815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22980b1960 0x7f2298153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 --2- 172.21.15.53:0/1262893462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22980af5e0 0x7f2298156b50 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 >> 172.21.15.53:0/1262893462 conn(0x7f22980b20d0 msgr2=0x7f229806e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:03.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 shutdown_connections 2024-09-13T18:34:03.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.360+0000 7f229ee8d640 1 -- 172.21.15.53:0/1262893462 wait complete. 2024-09-13T18:34:03.377 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-09-13T18:34:01.890751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294408,"kb_used_data":16784,"kb_used_omap":12,"kb_used_meta":277491,"kb_avail":754680312,"statfs":{"total":773094113280,"available":772792639488,"internally_reserved":0,"allocated":17186816,"data_stored":8237046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":284151352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.646154"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.252457+0000","last_change":"2024-09-13T18:33:57.252457+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.252457+0000","last_undegraded":"2024-09-13T18:33:57.252457+0000","last_fullsized":"2024-09-13T18:33:57.252457+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:32.035961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256433+0000","last_change":"2024-09-13T18:33:57.256433+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256433+0000","last_undegraded":"2024-09-13T18:33:57.256433+0000","last_fullsized":"2024-09-13T18:33:57.256433+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250379+0000","last_change":"2024-09-13T18:33:57.250379+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250379+0000","last_undegraded":"2024-09-13T18:33:57.250379+0000","last_fullsized":"2024-09-13T18:33:57.250379+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256504+0000","last_change":"2024-09-13T18:33:57.256504+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256504+0000","last_undegraded":"2024-09-13T18:33:57.256504+0000","last_fullsized":"2024-09-13T18:33:57.256504+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251769+0000","last_change":"2024-09-13T18:33:57.251769+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251769+0000","last_undegraded":"2024-09-13T18:33:57.251769+0000","last_fullsized":"2024-09-13T18:33:57.251769+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:36.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254889+0000","last_change":"2024-09-13T18:33:57.254889+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254889+0000","last_undegraded":"2024-09-13T18:33:57.254889+0000","last_fullsized":"2024-09-13T18:33:57.254889+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.263607+0000","last_change":"2024-09-13T18:33:57.263607+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.263607+0000","last_undegraded":"2024-09-13T18:33:57.263607+0000","last_fullsized":"2024-09-13T18:33:57.263607+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251118+0000","last_change":"2024-09-13T18:33:57.251118+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251118+0000","last_undegraded":"2024-09-13T18:33:57.251118+0000","last_fullsized":"2024-09-13T18:33:57.251118+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:47.405098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251753+0000","last_change":"2024-09-13T18:33:57.251753+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251753+0000","last_undegraded":"2024-09-13T18:33:57.251753+0000","last_fullsized":"2024-09-13T18:33:57.251753+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:19.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.252312+0000","last_change":"2024-09-13T18:33:57.252312+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.252312+0000","last_undegraded":"2024-09-13T18:33:57.252312+0000","last_fullsized":"2024-09-13T18:33:57.252312+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:24.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250403+0000","last_change":"2024-09-13T18:33:57.250403+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250403+0000","last_undegraded":"2024-09-13T18:33:57.250403+0000","last_fullsized":"2024-09-13T18:33:57.250403+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.262477+0000","last_change":"2024-09-13T18:33:57.262477+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.262477+0000","last_undegraded":"2024-09-13T18:33:57.262477+0000","last_fullsized":"2024-09-13T18:33:57.262477+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:06.070476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247328+0000","last_change":"2024-09-13T18:33:57.247328+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247328+0000","last_undegraded":"2024-09-13T18:33:57.247328+0000","last_fullsized":"2024-09-13T18:33:57.247328+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.296108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254774+0000","last_change":"2024-09-13T18:33:57.254774+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254774+0000","last_undegraded":"2024-09-13T18:33:57.254774+0000","last_fullsized":"2024-09-13T18:33:57.254774+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:40.901722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261584+0000","last_change":"2024-09-13T18:33:57.261584+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261584+0000","last_undegraded":"2024-09-13T18:33:57.261584+0000","last_fullsized":"2024-09-13T18:33:57.261584+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:47.459960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251788+0000","last_change":"2024-09-13T18:33:57.251788+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251788+0000","last_undegraded":"2024-09-13T18:33:57.251788+0000","last_fullsized":"2024-09-13T18:33:57.251788+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:40.804040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255363+0000","last_change":"2024-09-13T18:33:57.255363+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255363+0000","last_undegraded":"2024-09-13T18:33:57.255363+0000","last_fullsized":"2024-09-13T18:33:57.255363+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:15.548105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261629+0000","last_change":"2024-09-13T18:33:57.261629+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261629+0000","last_undegraded":"2024-09-13T18:33:57.261629+0000","last_fullsized":"2024-09-13T18:33:57.261629+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:03.791063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251054+0000","last_change":"2024-09-13T18:33:57.251054+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251054+0000","last_undegraded":"2024-09-13T18:33:57.251054+0000","last_fullsized":"2024-09-13T18:33:57.251054+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:26.507476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250847+0000","last_change":"2024-09-13T18:33:57.250847+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250847+0000","last_undegraded":"2024-09-13T18:33:57.250847+0000","last_fullsized":"2024-09-13T18:33:57.250847+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:30.625317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.251705+0000","last_change":"2024-09-13T18:33:57.251705+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.251705+0000","last_undegraded":"2024-09-13T18:33:57.251705+0000","last_fullsized":"2024-09-13T18:33:57.251705+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:19.538884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250258+0000","last_change":"2024-09-13T18:33:57.250258+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250258+0000","last_undegraded":"2024-09-13T18:33:57.250258+0000","last_fullsized":"2024-09-13T18:33:57.250258+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255472+0000","last_change":"2024-09-13T18:33:57.255472+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255472+0000","last_undegraded":"2024-09-13T18:33:57.255472+0000","last_fullsized":"2024-09-13T18:33:57.255472+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261821+0000","last_change":"2024-09-13T18:33:57.261821+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261821+0000","last_undegraded":"2024-09-13T18:33:57.261821+0000","last_fullsized":"2024-09-13T18:33:57.261821+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:41.543952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247224+0000","last_change":"2024-09-13T18:33:57.247224+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247224+0000","last_undegraded":"2024-09-13T18:33:57.247224+0000","last_fullsized":"2024-09-13T18:33:57.247224+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:13.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.247103+0000","last_change":"2024-09-13T18:33:57.247103+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.247103+0000","last_undegraded":"2024-09-13T18:33:57.247103+0000","last_fullsized":"2024-09-13T18:33:57.247103+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:11.134787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.254869+0000","last_change":"2024-09-13T18:33:57.254869+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.254869+0000","last_undegraded":"2024-09-13T18:33:57.254869+0000","last_fullsized":"2024-09-13T18:33:57.254869+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.574702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255603+0000","last_change":"2024-09-13T18:33:57.255603+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255603+0000","last_undegraded":"2024-09-13T18:33:57.255603+0000","last_fullsized":"2024-09-13T18:33:57.255603+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.255523+0000","last_change":"2024-09-13T18:33:57.255523+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.255523+0000","last_undegraded":"2024-09-13T18:33:57.255523+0000","last_fullsized":"2024-09-13T18:33:57.255523+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.256639+0000","last_change":"2024-09-13T18:33:57.256639+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.256639+0000","last_undegraded":"2024-09-13T18:33:57.256639+0000","last_fullsized":"2024-09-13T18:33:57.256639+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.250879+0000","last_change":"2024-09-13T18:33:57.250879+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.250879+0000","last_undegraded":"2024-09-13T18:33:57.250879+0000","last_fullsized":"2024-09-13T18:33:57.250879+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:33:58.242226+0000","last_change":"2024-09-13T18:33:58.242226+0000","last_active":"2024-09-13T18:33:58.242226+0000","last_peered":"2024-09-13T18:33:58.242226+0000","last_clean":"2024-09-13T18:33:58.242226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:58.242226+0000","last_undegraded":"2024-09-13T18:33:58.242226+0000","last_fullsized":"2024-09-13T18:33:58.242226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":159,"state":"creating+peering","last_fresh":"2024-09-13T18:33:57.261569+0000","last_change":"2024-09-13T18:33:57.261569+0000","last_active":"2024-09-13T18:33:57.230911+0000","last_peered":"2024-09-13T18:33:57.230911+0000","last_clean":"2024-09-13T18:33:57.230911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:33:57.261569+0000","last_undegraded":"2024-09-13T18:33:57.261569+0000","last_fullsized":"2024-09-13T18:33:57.261569+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:29.530975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":319,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-13T18:33:56.552211+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:33:56.552211+0000","last_peered":"2024-09-13T18:33:56.552211+0000","last_clean":"2024-09-13T18:33:56.552211+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:33:56.552211+0000","last_undegraded":"2024-09-13T18:33:56.552211+0000","last_fullsized":"2024-09-13T18:33:56.552211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2596864,"data_stored":1473861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.6439999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93300000000000005,"15min":0.90000000000000002},"min":{"1min":0.57499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":1.333,"15min":1.4410000000000001},"last":0.99199999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.218,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":1.048},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.93200000000000005},"min":{"1min":0.54400000000000004,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.2490000000000001,"5min":1.4890000000000001,"15min":1.6060000000000001},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80900000000000005,"15min":0.80400000000000005},"min":{"1min":0.53700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":1.276,"15min":1.276},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.165,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1339999999999999,"5min":1.349,"15min":1.448},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.238,"5min":1.395,"15min":1.397},"last":1.1220000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.873,"15min":0.88800000000000001},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.218,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.93999999999999995},"min":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95499999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.877},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.70299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":1.409,"15min":1.409},"last":1.296}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.85499999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":1.476,"15min":1.476},"last":1.24},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.02,"15min":1.006},"min":{"1min":0.65000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2689999999999999,"5min":1.361,"15min":1.506},"last":1.268}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1990656,"data_stored":877676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.82699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.0820000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.443},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.3480000000000001,"15min":1.577},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":0.91600000000000004},"min":{"1min":0.71899999999999997,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.069,"5min":1.218,"15min":1.464},"last":1.0920000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.95799999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.319,"5min":1.673,"15min":2.4220000000000002},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.516,"15min":1.516},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.61899999999999999,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.2669999999999999,"15min":1.306},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.97099999999999997},"min":{"1min":0.72799999999999998,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.2350000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.014},"min":{"1min":0.79200000000000004,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.2589999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1419999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.69399999999999995,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.01,"5min":1.024,"15min":1.0800000000000001},"min":{"1min":0.67200000000000004,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":2.762},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.0369999999999999},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.22,"5min":1.5,"15min":1.9299999999999999},"last":1.02},{"interface":"front","average":{"1min":1.024,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.2470000000000001,"5min":1.357,"15min":1.72},"last":1.0449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":0.83899999999999997},"min":{"1min":0.47899999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.88700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.437},"max":{"1min":1.089,"5min":1.264,"15min":2.1840000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1719999999999999,"5min":1.603,"15min":1.603},"last":0.629},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.167},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92800000000000005,"15min":0.95099999999999996},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.21,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.64800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95299999999999996,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.46,"5min":3.46,"15min":3.46},"last":1.218},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.306,"5min":1.492,"15min":1.5049999999999999},"last":1.4790000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0109999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.376,"15min":0.376},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.97499999999999998,"15min":1.014},"min":{"1min":0.63100000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.125}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.0960000000000001},"min":{"1min":0.65800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.246},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.76000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":1.3140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93200000000000005,"15min":0.84499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2649999999999999,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.159},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.91000000000000003,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.242,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.216,"5min":1.536,"15min":1.536},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.89200000000000002},"min":{"1min":0.52600000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3660000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.94899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.367,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.874}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.92300000000000004,"15min":0.90500000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4490000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.117},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":10.44,"15min":10.44},"last":0.92000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.286,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":0.97199999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.363,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1259999999999999,"15min":1.0309999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.022,"5min":1.222,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.504,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.1819999999999999,"15min":1.091},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.573,"5min":15.593,"15min":15.593},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.077},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4119999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.052}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37172,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334668,"statfs":{"total":96636764160,"available":96598700032,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98699999999999999,"5min":1.444,"15min":2.113},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.89300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.34100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.376}]},{"osd":2,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.33700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96699999999999997,"5min":1.4850000000000001,"15min":1.742},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.74099999999999999},"min":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":1.222,"15min":1.399},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95699999999999996,"15min":1.0640000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":1.54}]},{"osd":5,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":0.99199999999999999},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1279999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.349,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":1.008}]},{"osd":6,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95899999999999996,"15min":1.0369999999999999},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.99099999999999999,"15min":1.034},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.454,"5min":1.6890000000000001,"15min":1.96},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.02,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.413,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97399999999999998,"15min":1.0009999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.504,"5min":1.504,"15min":2.9220000000000002},"last":1.504}]}]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41264,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330576,"statfs":{"total":96636764160,"available":96594509824,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.024,"5min":1.024,"15min":1.0309999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.67600000000000005,"15min":0.65900000000000003},"min":{"1min":0.39700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.751}]},{"osd":1,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40100000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.01,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65700000000000003,"15min":0.70499999999999996},"min":{"1min":0.32000000000000001,"5min":0.318,"15min":0.307},"max":{"1min":0.98599999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.71199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69799999999999995,"15min":0.71899999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0760000000000001,"5min":1.161,"15min":1.1859999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.264,"5min":1.405,"15min":1.405},"last":0.91000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.90900000000000003,"15min":0.91400000000000003},"min":{"1min":0.61899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.339,"5min":1.367,"15min":1.611},"last":1.093},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.88600000000000001,"15min":0.91200000000000003},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.2649999999999999,"5min":1.587,"15min":1.587},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.72399999999999998,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.548,"5min":1.548,"15min":1.9179999999999999},"last":1.304},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96699999999999997,"15min":0.97299999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.456,"5min":1.552,"15min":1.702},"last":1.143}]},{"osd":6,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":0.95799999999999996},"min":{"1min":0.63200000000000001,"5min":0.52100000000000002,"15min":0.5},"max":{"1min":1.3819999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.034},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.58799999999999997},"max":{"1min":1.5409999999999999,"5min":1.645,"15min":1.645},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.70199999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.3009999999999999,"5min":1.843,"15min":1.843},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0369999999999999,"15min":1.0740000000000001},"min":{"1min":0.59799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4219999999999999,"5min":1.4850000000000001,"15min":1.8089999999999999},"last":1.4039999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41268,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330572,"statfs":{"total":96636764160,"available":96594505728,"internally_reserved":0,"allocated":2002944,"data_stored":883493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89600000000000002,"5min":1.077,"15min":1.077},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.61699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.80500000000000005,"5min":1.042,"15min":1.177},"last":1.407}]},{"osd":2,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":1.077,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.70699999999999996},"min":{"1min":0.36799999999999999,"5min":0.35399999999999998,"15min":0.27800000000000002},"max":{"1min":1.048,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.274}]},{"osd":3,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.42199999999999999,"5min":0.40200000000000002,"15min":0.317},"max":{"1min":1.125,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.749,"15min":0.73099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":1.423,"15min":1.423},"last":1.1100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90100000000000002,"15min":0.90500000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.254,"5min":1.3600000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.92400000000000004,"15min":0.92300000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.42899999999999999},"max":{"1min":1.1499999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2589999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.159},{"interface":"front","average":{"1min":0.995,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.484,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1930000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98499999999999999,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1859999999999999,"5min":1.5900000000000001,"15min":1.653},"last":1.306},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":0.98799999999999999},"min":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.262,"5min":1.425,"15min":1.5740000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.52500000000000002},"max":{"1min":1.5329999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.458},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.0209999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.4850000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41832,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330008,"statfs":{"total":96636764160,"available":96593928192,"internally_reserved":0,"allocated":2584576,"data_stored":1468044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.018,"5min":1.244,"15min":1.4359999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94499999999999995,"5min":1.333,"15min":1.333},"last":0.253},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0920000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.311}]},{"osd":3,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.002,"5min":1.3160000000000001,"15min":1.7589999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.171,"5min":1.2769999999999999,"15min":1.5129999999999999},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.87,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.438,"15min":0.438},"max":{"1min":1.3879999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.94999999999999996,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.294,"5min":1.5069999999999999,"15min":1.986},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1},"min":{"1min":0.58799999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4379999999999999,"5min":1.8799999999999999,"15min":2.641},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58499999999999996},"max":{"1min":1.395,"5min":1.395,"15min":1.6699999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.024,"15min":1.0609999999999999},"min":{"1min":0.60499999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.333,"5min":1.466,"15min":1.891},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.99399999999999999,"15min":1.018},"min":{"1min":0.70699999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3049999999999999,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:32:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.01,"15min":1.0229999999999999},"min":{"1min":0.63400000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.363,"5min":1.669,"15min":2.2949999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.075,"15min":1.0980000000000001},"min":{"1min":0.68000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4530000000000001,"5min":1.724,"15min":2.2480000000000002},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:34:03.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2024-09-13T18:34:03.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2024-09-13T18:34:03.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2024-09-13T18:34:03.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2024-09-13T18:34:03.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2024-09-13T18:34:03.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2024-09-13T18:34:03.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.252457+0000', 'last_change': '2024-09-13T18:33:57.252457+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.252457+0000', 'last_undegraded': '2024-09-13T18:33:57.252457+0000', 'last_fullsized': '2024-09-13T18:33:57.252457+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:20:32.035961+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:34:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.256433+0000', 'last_change': '2024-09-13T18:33:57.256433+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.256433+0000', 'last_undegraded': '2024-09-13T18:33:57.256433+0000', 'last_fullsized': '2024-09-13T18:33:57.256433+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.250379+0000', 'last_change': '2024-09-13T18:33:57.250379+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.250379+0000', 'last_undegraded': '2024-09-13T18:33:57.250379+0000', 'last_fullsized': '2024-09-13T18:33:57.250379+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.256504+0000', 'last_change': '2024-09-13T18:33:57.256504+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.256504+0000', 'last_undegraded': '2024-09-13T18:33:57.256504+0000', 'last_fullsized': '2024-09-13T18:33:57.256504+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.251769+0000', 'last_change': '2024-09-13T18:33:57.251769+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.251769+0000', 'last_undegraded': '2024-09-13T18:33:57.251769+0000', 'last_fullsized': '2024-09-13T18:33:57.251769+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:02:36.756704+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.254889+0000', 'last_change': '2024-09-13T18:33:57.254889+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.254889+0000', 'last_undegraded': '2024-09-13T18:33:57.254889+0000', 'last_fullsized': '2024-09-13T18:33:57.254889+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2024-09-13T18:34:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.263607+0000', 'last_change': '2024-09-13T18:33:57.263607+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.263607+0000', 'last_undegraded': '2024-09-13T18:33:57.263607+0000', 'last_fullsized': '2024-09-13T18:33:57.263607+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.251118+0000', 'last_change': '2024-09-13T18:33:57.251118+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.251118+0000', 'last_undegraded': '2024-09-13T18:33:57.251118+0000', 'last_fullsized': '2024-09-13T18:33:57.251118+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:33:47.405098+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2024-09-13T18:34:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.251753+0000', 'last_change': '2024-09-13T18:33:57.251753+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.251753+0000', 'last_undegraded': '2024-09-13T18:33:57.251753+0000', 'last_fullsized': '2024-09-13T18:33:57.251753+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:00:19.069689+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.252312+0000', 'last_change': '2024-09-13T18:33:57.252312+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.252312+0000', 'last_undegraded': '2024-09-13T18:33:57.252312+0000', 'last_fullsized': '2024-09-13T18:33:57.252312+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:43:24.221112+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.250403+0000', 'last_change': '2024-09-13T18:33:57.250403+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.250403+0000', 'last_undegraded': '2024-09-13T18:33:57.250403+0000', 'last_fullsized': '2024-09-13T18:33:57.250403+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.262477+0000', 'last_change': '2024-09-13T18:33:57.262477+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.262477+0000', 'last_undegraded': '2024-09-13T18:33:57.262477+0000', 'last_fullsized': '2024-09-13T18:33:57.262477+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:01:06.070476+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.247328+0000', 'last_change': '2024-09-13T18:33:57.247328+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.247328+0000', 'last_undegraded': '2024-09-13T18:33:57.247328+0000', 'last_fullsized': '2024-09-13T18:33:57.247328+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:50:14.296108+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.254774+0000', 'last_change': '2024-09-13T18:33:57.254774+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.254774+0000', 'last_undegraded': '2024-09-13T18:33:57.254774+0000', 'last_fullsized': '2024-09-13T18:33:57.254774+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:16:40.901722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2024-09-13T18:34:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.261584+0000', 'last_change': '2024-09-13T18:33:57.261584+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.261584+0000', 'last_undegraded': '2024-09-13T18:33:57.261584+0000', 'last_fullsized': '2024-09-13T18:33:57.261584+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:05:47.459960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.251788+0000', 'last_change': '2024-09-13T18:33:57.251788+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.251788+0000', 'last_undegraded': '2024-09-13T18:33:57.251788+0000', 'last_fullsized': '2024-09-13T18:33:57.251788+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:37:40.804040+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.255363+0000', 'last_change': '2024-09-13T18:33:57.255363+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.255363+0000', 'last_undegraded': '2024-09-13T18:33:57.255363+0000', 'last_fullsized': '2024-09-13T18:33:57.255363+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:46:15.548105+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:34:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.261629+0000', 'last_change': '2024-09-13T18:33:57.261629+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.261629+0000', 'last_undegraded': '2024-09-13T18:33:57.261629+0000', 'last_fullsized': '2024-09-13T18:33:57.261629+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:00:03.791063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.251054+0000', 'last_change': '2024-09-13T18:33:57.251054+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.251054+0000', 'last_undegraded': '2024-09-13T18:33:57.251054+0000', 'last_fullsized': '2024-09-13T18:33:57.251054+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:43:26.507476+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.250847+0000', 'last_change': '2024-09-13T18:33:57.250847+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.250847+0000', 'last_undegraded': '2024-09-13T18:33:57.250847+0000', 'last_fullsized': '2024-09-13T18:33:57.250847+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:07:30.625317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.251705+0000', 'last_change': '2024-09-13T18:33:57.251705+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.251705+0000', 'last_undegraded': '2024-09-13T18:33:57.251705+0000', 'last_fullsized': '2024-09-13T18:33:57.251705+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:09:19.538884+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.250258+0000', 'last_change': '2024-09-13T18:33:57.250258+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.250258+0000', 'last_undegraded': '2024-09-13T18:33:57.250258+0000', 'last_fullsized': '2024-09-13T18:33:57.250258+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2024-09-13T18:34:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.255472+0000', 'last_change': '2024-09-13T18:33:57.255472+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.255472+0000', 'last_undegraded': '2024-09-13T18:33:57.255472+0000', 'last_fullsized': '2024-09-13T18:33:57.255472+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.261821+0000', 'last_change': '2024-09-13T18:33:57.261821+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.261821+0000', 'last_undegraded': '2024-09-13T18:33:57.261821+0000', 'last_fullsized': '2024-09-13T18:33:57.261821+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:30:41.543952+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2024-09-13T18:34:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.247224+0000', 'last_change': '2024-09-13T18:33:57.247224+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.247224+0000', 'last_undegraded': '2024-09-13T18:33:57.247224+0000', 'last_fullsized': '2024-09-13T18:33:57.247224+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:22:13.361082+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.247103+0000', 'last_change': '2024-09-13T18:33:57.247103+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.247103+0000', 'last_undegraded': '2024-09-13T18:33:57.247103+0000', 'last_fullsized': '2024-09-13T18:33:57.247103+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:11:11.134787+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.254869+0000', 'last_change': '2024-09-13T18:33:57.254869+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.254869+0000', 'last_undegraded': '2024-09-13T18:33:57.254869+0000', 'last_fullsized': '2024-09-13T18:33:57.254869+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T06:10:13.574702+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.255603+0000', 'last_change': '2024-09-13T18:33:57.255603+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.255603+0000', 'last_undegraded': '2024-09-13T18:33:57.255603+0000', 'last_fullsized': '2024-09-13T18:33:57.255603+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.255523+0000', 'last_change': '2024-09-13T18:33:57.255523+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.255523+0000', 'last_undegraded': '2024-09-13T18:33:57.255523+0000', 'last_fullsized': '2024-09-13T18:33:57.255523+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.256639+0000', 'last_change': '2024-09-13T18:33:57.256639+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.256639+0000', 'last_undegraded': '2024-09-13T18:33:57.256639+0000', 'last_fullsized': '2024-09-13T18:33:57.256639+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2024-09-13T18:34:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2024-09-13T18:34:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.250879+0000', 'last_change': '2024-09-13T18:33:57.250879+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.250879+0000', 'last_undegraded': '2024-09-13T18:33:57.250879+0000', 'last_fullsized': '2024-09-13T18:33:57.250879+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:34:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2024-09-13T18:34:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:33:58.242226+0000', 'last_change': '2024-09-13T18:33:58.242226+0000', 'last_active': '2024-09-13T18:33:58.242226+0000', 'last_peered': '2024-09-13T18:33:58.242226+0000', 'last_clean': '2024-09-13T18:33:58.242226+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:58.242226+0000', 'last_undegraded': '2024-09-13T18:33:58.242226+0000', 'last_fullsized': '2024-09-13T18:33:58.242226+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:58.242226+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:34:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2024-09-13T18:34:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 159, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:33:57.261569+0000', 'last_change': '2024-09-13T18:33:57.261569+0000', 'last_active': '2024-09-13T18:33:57.230911+0000', 'last_peered': '2024-09-13T18:33:57.230911+0000', 'last_clean': '2024-09-13T18:33:57.230911+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:33:57.261569+0000', 'last_undegraded': '2024-09-13T18:33:57.261569+0000', 'last_fullsized': '2024-09-13T18:33:57.261569+0000', 'mapping_epoch': 159, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 159, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'last_clean_scrub_stamp': '2024-09-13T18:33:57.230911+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:39:29.530975+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:34:03.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:34:03.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 Processor -- start 2024-09-13T18:34:03.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 -- start start 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03081582a0 0x7f030806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f030815b7c0 0x7f030806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0308070c90 0x7f0308071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030815aaf0 con 0x7f0308070c90 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030806d760 con 0x7f03081582a0 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030e505640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0308071650 con 0x7f030815b7c0 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0308070c90 0x7f0308071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0308070c90 0x7f0308071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50716/0 (socket says 172.21.15.53:50716) 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 -- 172.21.15.53:0/3086429556 learned_addr learned my addr 172.21.15.53:0/3086429556 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f0307fff640 1 --2- 172.21.15.53:0/3086429556 >> v2:172.21.15.87:3300/0 conn(0x7f03081582a0 0x7f030806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f03077fe640 1 --2- 172.21.15.53:0/3086429556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f030815b7c0 0x7f030806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 -- 172.21.15.53:0/3086429556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f030815b7c0 msgr2=0x7f030806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 --2- 172.21.15.53:0/3086429556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f030815b7c0 0x7f030806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 -- 172.21.15.53:0/3086429556 >> v2:172.21.15.87:3300/0 conn(0x7f03081582a0 msgr2=0x7f030806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 --2- 172.21.15.53:0/3086429556 >> v2:172.21.15.87:3300/0 conn(0x7f03081582a0 0x7f030806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.540+0000 7f030caa2640 1 -- 172.21.15.53:0/3086429556 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030806d480 con 0x7f0308070c90 2024-09-13T18:34:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030caa2640 1 --2- 172.21.15.53:0/3086429556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f0308071110 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f0308069f50 tx=0x7f030001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670c0436efa30ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f0306ffd640 1 -- 172.21.15.53:0/3086429556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03000a5840 con 0x7f0308070c90 2024-09-13T18:34:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f0306ffd640 1 -- 172.21.15.53:0/3086429556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000a59a0 con 0x7f0308070c90 2024-09-13T18:34:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f0306ffd640 1 -- 172.21.15.53:0/3086429556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03000a5d30 con 0x7f0308070c90 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 -- 172.21.15.53:0/3086429556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 msgr2=0x7f0308071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 --2- 172.21.15.53:0/3086429556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f0308071110 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f0308069f50 tx=0x7f030001c9c0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 -- 172.21.15.53:0/3086429556 shutdown_connections 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 --2- 172.21.15.53:0/3086429556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f030815b7c0 0x7f030806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 --2- 172.21.15.53:0/3086429556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f0308071110 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 --2- 172.21.15.53:0/3086429556 >> v2:172.21.15.87:3300/0 conn(0x7f03081582a0 0x7f030806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 -- 172.21.15.53:0/3086429556 >> 172.21.15.53:0/3086429556 conn(0x7f0308065c80 msgr2=0x7f0308066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 -- 172.21.15.53:0/3086429556 shutdown_connections 2024-09-13T18:34:03.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.544+0000 7f030e505640 1 -- 172.21.15.53:0/3086429556 wait complete. 2024-09-13T18:34:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 Processor -- start 2024-09-13T18:34:03.549 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 -- start start 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f030813b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03081582a0 0x7f030814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030815b7c0 0x7f030813aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030814f780 con 0x7f0308070c90 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030813db70 con 0x7f030815b7c0 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030813de50 con 0x7f03081582a0 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f030813b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f030813b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50730/0 (socket says 172.21.15.53:50730) 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 -- 172.21.15.53:0/337044182 learned_addr learned my addr 172.21.15.53:0/337044182 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030caa2640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030815b7c0 0x7f030813aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f03077fe640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03081582a0 0x7f030814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 -- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03081582a0 msgr2=0x7f030814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03081582a0 0x7f030814f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 -- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030815b7c0 msgr2=0x7f030813aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030815b7c0 0x7f030813aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 -- 172.21.15.53:0/337044182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300009b30 con 0x7f0308070c90 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030caa2640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030815b7c0 0x7f030813aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f03077fe640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03081582a0 0x7f030814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0307fff640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f030813b790 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f02f800d800 tx=0x7f02f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0304ff9640 1 -- 172.21.15.53:0/337044182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80096a0 con 0x7f0308070c90 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0304ff9640 1 -- 172.21.15.53:0/337044182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f8009800 con 0x7f0308070c90 2024-09-13T18:34:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030813e130 con 0x7f0308070c90 2024-09-13T18:34:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0304ff9640 1 -- 172.21.15.53:0/337044182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8009b70 con 0x7f0308070c90 2024-09-13T18:34:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030813e6f0 con 0x7f0308070c90 2024-09-13T18:34:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0308067400 con 0x7f0308070c90 2024-09-13T18:34:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0304ff9640 1 -- 172.21.15.53:0/337044182 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f02f8009cd0 con 0x7f0308070c90 2024-09-13T18:34:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0304ff9640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f02f4066e70 0x7f02f4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f0304ff9640 1 -- 172.21.15.53:0/337044182 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02f8082f90 con 0x7f0308070c90 2024-09-13T18:34:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.548+0000 7f03077fe640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f02f4066e70 0x7f02f4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.552+0000 7f03077fe640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f02f4066e70 0x7f02f4069330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f03080cb3c0 tx=0x7f02fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.552+0000 7f0304ff9640 1 -- 172.21.15.53:0/337044182 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02f8051f00 con 0x7f0308070c90 2024-09-13T18:34:03.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.776+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0308070130 con 0x7f0308070c90 2024-09-13T18:34:03.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.776+0000 7f0304ff9640 1 -- 172.21.15.53:0/337044182 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1532 (secure 0 0 0) 0x7f02f8055520 con 0x7f0308070c90 2024-09-13T18:34:03.779 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:03.779 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":569,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":162,"num_osds":8,"num_up_osds":8,"osd_up_since":1726251884,"num_in_osds":8,"osd_in_since":1726251876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":301473792,"bytes_avail":772792639488,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":96,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"c","status":"up:active","gid":10023}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-13T18:33:05.874667+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:34:03.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f02f4066e70 msgr2=0x7f02f4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f02f4066e70 0x7f02f4069330 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f03080cb3c0 tx=0x7f02fc008040 comp rx=0 tx=0).stop 2024-09-13T18:34:03.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 msgr2=0x7f030813b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f030813b790 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f02f800d800 tx=0x7f02f800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 shutdown_connections 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f02f4066e70 0x7f02f4069330 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f03081582a0 0x7f030814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f030815b7c0 0x7f030813aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 --2- 172.21.15.53:0/337044182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0308070c90 0x7f030813b790 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 >> 172.21.15.53:0/337044182 conn(0x7f0308065c80 msgr2=0x7f03080cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 shutdown_connections 2024-09-13T18:34:03.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.780+0000 7f030e505640 1 -- 172.21.15.53:0/337044182 wait complete. 2024-09-13T18:34:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:34:03.799 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:34:03.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.924+0000 7f7d0b9af640 1 Processor -- start 2024-09-13T18:34:03.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.924+0000 7f7d0b9af640 1 -- start start 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d040713a0 0x7f7d0406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0406d480 con 0x7f7d0415b7c0 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0415aaf0 con 0x7f7d040713a0 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0406d760 con 0x7f7d041582a0 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d040713a0 0x7f7d0406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d040713a0 0x7f7d0406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50738/0 (socket says 172.21.15.53:50738) 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 -- 172.21.15.53:0/1926533931 learned_addr learned my addr 172.21.15.53:0/1926533931 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0974b640 1 --2- 172.21.15.53:0/1926533931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 -- 172.21.15.53:0/1926533931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 msgr2=0x7f7d0406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 --2- 172.21.15.53:0/1926533931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0406c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 -- 172.21.15.53:0/1926533931 >> v1:172.21.15.87:6789/0 conn(0x7f7d0415b7c0 legacy=0x7f7d04070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:03.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 -- 172.21.15.53:0/1926533931 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0415ace0 con 0x7f7d040713a0 2024-09-13T18:34:03.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d09f4c640 1 --2- 172.21.15.53:0/1926533931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d0406ce40 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009870 tx=0x7f7cfc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e00eaffa4bbabf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7cfbfff640 1 -- 172.21.15.53:0/1926533931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0aa610 con 0x7f7d040713a0 2024-09-13T18:34:03.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7cfbfff640 1 -- 172.21.15.53:0/1926533931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0a6040 con 0x7f7d040713a0 2024-09-13T18:34:03.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7cfbfff640 1 -- 172.21.15.53:0/1926533931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0aa990 con 0x7f7d040713a0 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- 172.21.15.53:0/1926533931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 msgr2=0x7f7d0406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/1926533931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d0406ce40 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009870 tx=0x7f7cfc01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- 172.21.15.53:0/1926533931 shutdown_connections 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/1926533931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d0406ce40 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/1926533931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0406c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- 172.21.15.53:0/1926533931 >> 172.21.15.53:0/1926533931 conn(0x7f7d04065c80 msgr2=0x7f7d04066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- 172.21.15.53:0/1926533931 shutdown_connections 2024-09-13T18:34:03.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.928+0000 7f7d0b9af640 1 -- 172.21.15.53:0/1926533931 wait complete. 2024-09-13T18:34:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 Processor -- start 2024-09-13T18:34:03.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 -- start start 2024-09-13T18:34:03.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d04154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0413ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0415b7c0 0x7f7d04159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041f5340 con 0x7f7d040713a0 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04155420 con 0x7f7d0415b7c0 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0413b370 con 0x7f7d041582a0 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d04154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d04154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50750/0 (socket says 172.21.15.53:50750) 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 -- 172.21.15.53:0/3157458046 learned_addr learned my addr 172.21.15.53:0/3157458046 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d09f4c640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0415b7c0 0x7f7d04159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d08f4a640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0413ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 -- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 msgr2=0x7f7d0413ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0413ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 -- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0415b7c0 msgr2=0x7f7d04159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0415b7c0 0x7f7d04159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 -- 172.21.15.53:0/3157458046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0094d0 con 0x7f7d040713a0 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0974b640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d04154510 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000ce10 tx=0x7f7d0000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7cf9ffb640 1 -- 172.21.15.53:0/3157458046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00003ba0 con 0x7f7d040713a0 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7cf9ffb640 1 -- 172.21.15.53:0/3157458046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00003d00 con 0x7f7d040713a0 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d04154b80 con 0x7f7d040713a0 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7cf9ffb640 1 -- 172.21.15.53:0/3157458046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00004240 con 0x7f7d040713a0 2024-09-13T18:34:03.937 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d04155140 con 0x7f7d040713a0 2024-09-13T18:34:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.932+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d04067400 con 0x7f7d040713a0 2024-09-13T18:34:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.936+0000 7f7cf9ffb640 1 -- 172.21.15.53:0/3157458046 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f7d000043a0 con 0x7f7d040713a0 2024-09-13T18:34:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.936+0000 7f7cf9ffb640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce8066e70 0x7f7ce8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.936+0000 7f7cf9ffb640 1 -- 172.21.15.53:0/3157458046 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d00012070 con 0x7f7d040713a0 2024-09-13T18:34:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.936+0000 7f7d08f4a640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce8066e70 0x7f7ce8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.936+0000 7f7d08f4a640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce8066e70 0x7f7ce8069330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7d040caa80 tx=0x7f7cf4009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:03.940+0000 7f7cf9ffb640 1 -- 172.21.15.53:0/3157458046 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d00052170 con 0x7f7d040713a0 2024-09-13T18:34:04.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.088+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d0406dc80 con 0x7f7ce8066e70 2024-09-13T18:34:04.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.096+0000 7f7cf9ffb640 1 -- 172.21.15.53:0/3157458046 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288588 (secure 0 0 0) 0x7f7d0406dc80 con 0x7f7ce8066e70 2024-09-13T18:34:04.101 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:04.105 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:34:04.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce8066e70 msgr2=0x7f7ce8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce8066e70 0x7f7ce8069330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7d040caa80 tx=0x7f7cf4009060 comp rx=0 tx=0).stop 2024-09-13T18:34:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 msgr2=0x7f7d04154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d04154510 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000ce10 tx=0x7f7d0000a660 comp rx=0 tx=0).stop 2024-09-13T18:34:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 shutdown_connections 2024-09-13T18:34:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7ce8066e70 0x7f7ce8069330 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:04.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d041582a0 0x7f7d0413ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0415b7c0 0x7f7d04159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 --2- 172.21.15.53:0/3157458046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d040713a0 0x7f7d04154510 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 >> 172.21.15.53:0/3157458046 conn(0x7f7d04065c80 msgr2=0x7f7d040adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 shutdown_connections 2024-09-13T18:34:04.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:04.100+0000 7f7d0b9af640 1 -- 172.21.15.53:0/3157458046 wait complete. 2024-09-13T18:34:04.120 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-13T18:34:03.891363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294776,"kb_used_data":17160,"kb_used_omap":12,"kb_used_meta":277491,"kb_avail":754679944,"statfs":{"total":773094113280,"available":772792262656,"internally_reserved":0,"allocated":17571840,"data_stored":8408204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":284151352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001828"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.868028+0000","last_change":"2024-09-13T18:33:58.684390+0000","last_active":"2024-09-13T18:33:59.868028+0000","last_peered":"2024-09-13T18:33:59.868028+0000","last_clean":"2024-09-13T18:33:59.868028+0000","last_became_active":"2024-09-13T18:33:58.682710+0000","last_became_peered":"2024-09-13T18:33:58.682710+0000","last_unstale":"2024-09-13T18:33:59.868028+0000","last_undegraded":"2024-09-13T18:33:59.868028+0000","last_fullsized":"2024-09-13T18:33:59.868028+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:18.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064766+0000","last_change":"2024-09-13T18:33:58.692411+0000","last_active":"2024-09-13T18:34:00.064766+0000","last_peered":"2024-09-13T18:34:00.064766+0000","last_clean":"2024-09-13T18:34:00.064766+0000","last_became_active":"2024-09-13T18:33:58.691825+0000","last_became_peered":"2024-09-13T18:33:58.691825+0000","last_unstale":"2024-09-13T18:34:00.064766+0000","last_undegraded":"2024-09-13T18:34:00.064766+0000","last_fullsized":"2024-09-13T18:34:00.064766+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:27.518791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166260+0000","last_change":"2024-09-13T18:33:58.704360+0000","last_active":"2024-09-13T18:34:01.166260+0000","last_peered":"2024-09-13T18:34:01.166260+0000","last_clean":"2024-09-13T18:34:01.166260+0000","last_became_active":"2024-09-13T18:33:58.704068+0000","last_became_peered":"2024-09-13T18:33:58.704068+0000","last_unstale":"2024-09-13T18:34:01.166260+0000","last_undegraded":"2024-09-13T18:34:01.166260+0000","last_fullsized":"2024-09-13T18:34:01.166260+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:27.518791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064787+0000","last_change":"2024-09-13T18:33:58.691871+0000","last_active":"2024-09-13T18:34:00.064787+0000","last_peered":"2024-09-13T18:34:00.064787+0000","last_clean":"2024-09-13T18:34:00.064787+0000","last_became_active":"2024-09-13T18:33:58.691344+0000","last_became_peered":"2024-09-13T18:33:58.691344+0000","last_unstale":"2024-09-13T18:34:00.064787+0000","last_undegraded":"2024-09-13T18:34:00.064787+0000","last_fullsized":"2024-09-13T18:34:00.064787+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:31.989521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.164952+0000","last_change":"2024-09-13T18:33:58.688616+0000","last_active":"2024-09-13T18:34:01.164952+0000","last_peered":"2024-09-13T18:34:01.164952+0000","last_clean":"2024-09-13T18:34:01.164952+0000","last_became_active":"2024-09-13T18:33:58.688315+0000","last_became_peered":"2024-09-13T18:33:58.688315+0000","last_unstale":"2024-09-13T18:34:01.164952+0000","last_undegraded":"2024-09-13T18:34:01.164952+0000","last_fullsized":"2024-09-13T18:34:01.164952+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:31.237970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167400+0000","last_change":"2024-09-13T18:33:58.680422+0000","last_active":"2024-09-13T18:34:01.167400+0000","last_peered":"2024-09-13T18:34:01.167400+0000","last_clean":"2024-09-13T18:34:01.167400+0000","last_became_active":"2024-09-13T18:33:58.680155+0000","last_became_peered":"2024-09-13T18:33:58.680155+0000","last_unstale":"2024-09-13T18:34:01.167400+0000","last_undegraded":"2024-09-13T18:34:01.167400+0000","last_fullsized":"2024-09-13T18:34:01.167400+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:33.898483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.653854+0000","last_change":"2024-09-13T18:33:58.667614+0000","last_active":"2024-09-13T18:33:59.653854+0000","last_peered":"2024-09-13T18:33:59.653854+0000","last_clean":"2024-09-13T18:33:59.653854+0000","last_became_active":"2024-09-13T18:33:58.663899+0000","last_became_peered":"2024-09-13T18:33:58.663899+0000","last_unstale":"2024-09-13T18:33:59.653854+0000","last_undegraded":"2024-09-13T18:33:59.653854+0000","last_fullsized":"2024-09-13T18:33:59.653854+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:16.559420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166070+0000","last_change":"2024-09-13T18:33:58.657339+0000","last_active":"2024-09-13T18:34:01.166070+0000","last_peered":"2024-09-13T18:34:01.166070+0000","last_clean":"2024-09-13T18:34:01.166070+0000","last_became_active":"2024-09-13T18:33:58.657055+0000","last_became_peered":"2024-09-13T18:33:58.657055+0000","last_unstale":"2024-09-13T18:34:01.166070+0000","last_undegraded":"2024-09-13T18:34:01.166070+0000","last_fullsized":"2024-09-13T18:34:01.166070+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:42.519688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165897+0000","last_change":"2024-09-13T18:33:58.703740+0000","last_active":"2024-09-13T18:34:01.165897+0000","last_peered":"2024-09-13T18:34:01.165897+0000","last_clean":"2024-09-13T18:34:01.165897+0000","last_became_active":"2024-09-13T18:33:58.703040+0000","last_became_peered":"2024-09-13T18:33:58.703040+0000","last_unstale":"2024-09-13T18:34:01.165897+0000","last_undegraded":"2024-09-13T18:34:01.165897+0000","last_fullsized":"2024-09-13T18:34:01.165897+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:31.989521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.650910+0000","last_change":"2024-09-13T18:33:58.668131+0000","last_active":"2024-09-13T18:33:59.650910+0000","last_peered":"2024-09-13T18:33:59.650910+0000","last_clean":"2024-09-13T18:33:59.650910+0000","last_became_active":"2024-09-13T18:33:58.667878+0000","last_became_peered":"2024-09-13T18:33:58.667878+0000","last_unstale":"2024-09-13T18:33:59.650910+0000","last_undegraded":"2024-09-13T18:33:59.650910+0000","last_fullsized":"2024-09-13T18:33:59.650910+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:56.970157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654415+0000","last_change":"2024-09-13T18:33:58.674238+0000","last_active":"2024-09-13T18:33:59.654415+0000","last_peered":"2024-09-13T18:33:59.654415+0000","last_clean":"2024-09-13T18:33:59.654415+0000","last_became_active":"2024-09-13T18:33:58.673528+0000","last_became_peered":"2024-09-13T18:33:58.673528+0000","last_unstale":"2024-09-13T18:33:59.654415+0000","last_undegraded":"2024-09-13T18:33:59.654415+0000","last_fullsized":"2024-09-13T18:33:59.654415+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:14.372397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064835+0000","last_change":"2024-09-13T18:33:58.694376+0000","last_active":"2024-09-13T18:34:00.064835+0000","last_peered":"2024-09-13T18:34:00.064835+0000","last_clean":"2024-09-13T18:34:00.064835+0000","last_became_active":"2024-09-13T18:33:58.693830+0000","last_became_peered":"2024-09-13T18:33:58.693830+0000","last_unstale":"2024-09-13T18:34:00.064835+0000","last_undegraded":"2024-09-13T18:34:00.064835+0000","last_fullsized":"2024-09-13T18:34:00.064835+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.542290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064547+0000","last_change":"2024-09-13T18:33:58.682943+0000","last_active":"2024-09-13T18:34:00.064547+0000","last_peered":"2024-09-13T18:34:00.064547+0000","last_clean":"2024-09-13T18:34:00.064547+0000","last_became_active":"2024-09-13T18:33:58.681789+0000","last_became_peered":"2024-09-13T18:33:58.681789+0000","last_unstale":"2024-09-13T18:34:00.064547+0000","last_undegraded":"2024-09-13T18:34:00.064547+0000","last_fullsized":"2024-09-13T18:34:00.064547+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.416413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165302+0000","last_change":"2024-09-13T18:33:58.697320+0000","last_active":"2024-09-13T18:34:01.165302+0000","last_peered":"2024-09-13T18:34:01.165302+0000","last_clean":"2024-09-13T18:34:01.165302+0000","last_became_active":"2024-09-13T18:33:58.689233+0000","last_became_peered":"2024-09-13T18:33:58.689233+0000","last_unstale":"2024-09-13T18:34:01.165302+0000","last_undegraded":"2024-09-13T18:34:01.165302+0000","last_fullsized":"2024-09-13T18:34:01.165302+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:22.174500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064905+0000","last_change":"2024-09-13T18:33:58.693418+0000","last_active":"2024-09-13T18:34:00.064905+0000","last_peered":"2024-09-13T18:34:00.064905+0000","last_clean":"2024-09-13T18:34:00.064905+0000","last_became_active":"2024-09-13T18:33:58.692975+0000","last_became_peered":"2024-09-13T18:33:58.692975+0000","last_unstale":"2024-09-13T18:34:00.064905+0000","last_undegraded":"2024-09-13T18:34:00.064905+0000","last_fullsized":"2024-09-13T18:34:00.064905+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:34.034744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166308+0000","last_change":"2024-09-13T18:33:58.688849+0000","last_active":"2024-09-13T18:34:01.166308+0000","last_peered":"2024-09-13T18:34:01.166308+0000","last_clean":"2024-09-13T18:34:01.166308+0000","last_became_active":"2024-09-13T18:33:58.688547+0000","last_became_peered":"2024-09-13T18:33:58.688547+0000","last_unstale":"2024-09-13T18:34:01.166308+0000","last_undegraded":"2024-09-13T18:34:01.166308+0000","last_fullsized":"2024-09-13T18:34:01.166308+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:13.352509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167719+0000","last_change":"2024-09-13T18:33:58.681402+0000","last_active":"2024-09-13T18:34:01.167719+0000","last_peered":"2024-09-13T18:34:01.167719+0000","last_clean":"2024-09-13T18:34:01.167719+0000","last_became_active":"2024-09-13T18:33:58.681062+0000","last_became_peered":"2024-09-13T18:33:58.681062+0000","last_unstale":"2024-09-13T18:34:01.167719+0000","last_undegraded":"2024-09-13T18:34:01.167719+0000","last_fullsized":"2024-09-13T18:34:01.167719+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:47.051217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.867757+0000","last_change":"2024-09-13T18:33:58.703328+0000","last_active":"2024-09-13T18:33:59.867757+0000","last_peered":"2024-09-13T18:33:59.867757+0000","last_clean":"2024-09-13T18:33:59.867757+0000","last_became_active":"2024-09-13T18:33:58.702834+0000","last_became_peered":"2024-09-13T18:33:58.702834+0000","last_unstale":"2024-09-13T18:33:59.867757+0000","last_undegraded":"2024-09-13T18:33:59.867757+0000","last_fullsized":"2024-09-13T18:33:59.867757+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:52.269197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651373+0000","last_change":"2024-09-13T18:33:58.704853+0000","last_active":"2024-09-13T18:33:59.651373+0000","last_peered":"2024-09-13T18:33:59.651373+0000","last_clean":"2024-09-13T18:33:59.651373+0000","last_became_active":"2024-09-13T18:33:58.704536+0000","last_became_peered":"2024-09-13T18:33:58.704536+0000","last_unstale":"2024-09-13T18:33:59.651373+0000","last_undegraded":"2024-09-13T18:33:59.651373+0000","last_fullsized":"2024-09-13T18:33:59.651373+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:43.617048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166105+0000","last_change":"2024-09-13T18:33:58.681211+0000","last_active":"2024-09-13T18:34:01.166105+0000","last_peered":"2024-09-13T18:34:01.166105+0000","last_clean":"2024-09-13T18:34:01.166105+0000","last_became_active":"2024-09-13T18:33:58.680896+0000","last_became_peered":"2024-09-13T18:33:58.680896+0000","last_unstale":"2024-09-13T18:34:01.166105+0000","last_undegraded":"2024-09-13T18:34:01.166105+0000","last_fullsized":"2024-09-13T18:34:01.166105+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:10.682110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165203+0000","last_change":"2024-09-13T18:33:58.688169+0000","last_active":"2024-09-13T18:34:01.165203+0000","last_peered":"2024-09-13T18:34:01.165203+0000","last_clean":"2024-09-13T18:34:01.165203+0000","last_became_active":"2024-09-13T18:33:58.687821+0000","last_became_peered":"2024-09-13T18:33:58.687821+0000","last_unstale":"2024-09-13T18:34:01.165203+0000","last_undegraded":"2024-09-13T18:34:01.165203+0000","last_fullsized":"2024-09-13T18:34:01.165203+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:31.636632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.650999+0000","last_change":"2024-09-13T18:33:58.669494+0000","last_active":"2024-09-13T18:33:59.650999+0000","last_peered":"2024-09-13T18:33:59.650999+0000","last_clean":"2024-09-13T18:33:59.650999+0000","last_became_active":"2024-09-13T18:33:58.669061+0000","last_became_peered":"2024-09-13T18:33:58.669061+0000","last_unstale":"2024-09-13T18:33:59.650999+0000","last_undegraded":"2024-09-13T18:33:59.650999+0000","last_fullsized":"2024-09-13T18:33:59.650999+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:09.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.164685+0000","last_change":"2024-09-13T18:33:58.664391+0000","last_active":"2024-09-13T18:34:01.164685+0000","last_peered":"2024-09-13T18:34:01.164685+0000","last_clean":"2024-09-13T18:34:01.164685+0000","last_became_active":"2024-09-13T18:33:58.664106+0000","last_became_peered":"2024-09-13T18:33:58.664106+0000","last_unstale":"2024-09-13T18:34:01.164685+0000","last_undegraded":"2024-09-13T18:34:01.164685+0000","last_fullsized":"2024-09-13T18:34:01.164685+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.416413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166542+0000","last_change":"2024-09-13T18:33:58.655339+0000","last_active":"2024-09-13T18:34:01.166542+0000","last_peered":"2024-09-13T18:34:01.166542+0000","last_clean":"2024-09-13T18:34:01.166542+0000","last_became_active":"2024-09-13T18:33:58.655079+0000","last_became_peered":"2024-09-13T18:33:58.655079+0000","last_unstale":"2024-09-13T18:34:01.166542+0000","last_undegraded":"2024-09-13T18:34:01.166542+0000","last_fullsized":"2024-09-13T18:34:01.166542+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:49.431047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.065258+0000","last_change":"2024-09-13T18:33:58.681736+0000","last_active":"2024-09-13T18:34:00.065258+0000","last_peered":"2024-09-13T18:34:00.065258+0000","last_clean":"2024-09-13T18:34:00.065258+0000","last_became_active":"2024-09-13T18:33:58.680958+0000","last_became_peered":"2024-09-13T18:33:58.680958+0000","last_unstale":"2024-09-13T18:34:00.065258+0000","last_undegraded":"2024-09-13T18:34:00.065258+0000","last_fullsized":"2024-09-13T18:34:00.065258+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:33.898483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654346+0000","last_change":"2024-09-13T18:33:58.665608+0000","last_active":"2024-09-13T18:33:59.654346+0000","last_peered":"2024-09-13T18:33:59.654346+0000","last_clean":"2024-09-13T18:33:59.654346+0000","last_became_active":"2024-09-13T18:33:58.664929+0000","last_became_peered":"2024-09-13T18:33:58.664929+0000","last_unstale":"2024-09-13T18:33:59.654346+0000","last_undegraded":"2024-09-13T18:33:59.654346+0000","last_fullsized":"2024-09-13T18:33:59.654346+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.542290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166320+0000","last_change":"2024-09-13T18:33:58.680465+0000","last_active":"2024-09-13T18:34:01.166320+0000","last_peered":"2024-09-13T18:34:01.166320+0000","last_clean":"2024-09-13T18:34:01.166320+0000","last_became_active":"2024-09-13T18:33:58.680105+0000","last_became_peered":"2024-09-13T18:33:58.680105+0000","last_unstale":"2024-09-13T18:34:01.166320+0000","last_undegraded":"2024-09-13T18:34:01.166320+0000","last_fullsized":"2024-09-13T18:34:01.166320+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:07.044563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166343+0000","last_change":"2024-09-13T18:33:58.665844+0000","last_active":"2024-09-13T18:34:01.166343+0000","last_peered":"2024-09-13T18:34:01.166343+0000","last_clean":"2024-09-13T18:34:01.166343+0000","last_became_active":"2024-09-13T18:33:58.665176+0000","last_became_peered":"2024-09-13T18:33:58.665176+0000","last_unstale":"2024-09-13T18:34:01.166343+0000","last_undegraded":"2024-09-13T18:34:01.166343+0000","last_fullsized":"2024-09-13T18:34:01.166343+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:03.143303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064650+0000","last_change":"2024-09-13T18:33:58.693621+0000","last_active":"2024-09-13T18:34:00.064650+0000","last_peered":"2024-09-13T18:34:00.064650+0000","last_clean":"2024-09-13T18:34:00.064650+0000","last_became_active":"2024-09-13T18:33:58.692862+0000","last_became_peered":"2024-09-13T18:33:58.692862+0000","last_unstale":"2024-09-13T18:34:00.064650+0000","last_undegraded":"2024-09-13T18:34:00.064650+0000","last_fullsized":"2024-09-13T18:34:00.064650+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:54.297494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165280+0000","last_change":"2024-09-13T18:33:58.701954+0000","last_active":"2024-09-13T18:34:01.165280+0000","last_peered":"2024-09-13T18:34:01.165280+0000","last_clean":"2024-09-13T18:34:01.165280+0000","last_became_active":"2024-09-13T18:33:58.696553+0000","last_became_peered":"2024-09-13T18:33:58.696553+0000","last_unstale":"2024-09-13T18:34:01.165280+0000","last_undegraded":"2024-09-13T18:34:01.165280+0000","last_fullsized":"2024-09-13T18:34:01.165280+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.416413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166580+0000","last_change":"2024-09-13T18:33:58.672416+0000","last_active":"2024-09-13T18:34:01.166580+0000","last_peered":"2024-09-13T18:34:01.166580+0000","last_clean":"2024-09-13T18:34:01.166580+0000","last_became_active":"2024-09-13T18:33:58.672126+0000","last_became_peered":"2024-09-13T18:33:58.672126+0000","last_unstale":"2024-09-13T18:34:01.166580+0000","last_undegraded":"2024-09-13T18:34:01.166580+0000","last_fullsized":"2024-09-13T18:34:01.166580+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:31.989521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165001+0000","last_change":"2024-09-13T18:33:58.671970+0000","last_active":"2024-09-13T18:34:01.165001+0000","last_peered":"2024-09-13T18:34:01.165001+0000","last_clean":"2024-09-13T18:34:01.165001+0000","last_became_active":"2024-09-13T18:33:58.671724+0000","last_became_peered":"2024-09-13T18:33:58.671724+0000","last_unstale":"2024-09-13T18:34:01.165001+0000","last_undegraded":"2024-09-13T18:34:01.165001+0000","last_fullsized":"2024-09-13T18:34:01.165001+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:53.828928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165407+0000","last_change":"2024-09-13T18:33:58.668967+0000","last_active":"2024-09-13T18:34:01.165407+0000","last_peered":"2024-09-13T18:34:01.165407+0000","last_clean":"2024-09-13T18:34:01.165407+0000","last_became_active":"2024-09-13T18:33:58.668709+0000","last_became_peered":"2024-09-13T18:33:58.668709+0000","last_unstale":"2024-09-13T18:34:01.165407+0000","last_undegraded":"2024-09-13T18:34:01.165407+0000","last_fullsized":"2024-09-13T18:34:01.165407+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:51.322025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"161'4","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.678510+0000","last_change":"2024-09-13T18:33:58.284121+0000","last_active":"2024-09-13T18:33:58.678510+0000","last_peered":"2024-09-13T18:33:58.678510+0000","last_clean":"2024-09-13T18:33:58.678510+0000","last_became_active":"2024-09-13T18:33:58.275062+0000","last_became_peered":"2024-09-13T18:33:58.275062+0000","last_unstale":"2024-09-13T18:33:58.678510+0000","last_undegraded":"2024-09-13T18:33:58.678510+0000","last_fullsized":"2024-09-13T18:33:58.678510+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:32.035961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.652476+0000","last_change":"2024-09-13T18:33:58.671884+0000","last_active":"2024-09-13T18:33:59.652476+0000","last_peered":"2024-09-13T18:33:59.652476+0000","last_clean":"2024-09-13T18:33:59.652476+0000","last_became_active":"2024-09-13T18:33:58.671596+0000","last_became_peered":"2024-09-13T18:33:58.671596+0000","last_unstale":"2024-09-13T18:33:59.652476+0000","last_undegraded":"2024-09-13T18:33:59.652476+0000","last_fullsized":"2024-09-13T18:33:59.652476+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:17.987715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.705138+0000","last_change":"2024-09-13T18:33:58.295647+0000","last_active":"2024-09-13T18:33:58.705138+0000","last_peered":"2024-09-13T18:33:58.705138+0000","last_clean":"2024-09-13T18:33:58.705138+0000","last_became_active":"2024-09-13T18:33:58.294942+0000","last_became_peered":"2024-09-13T18:33:58.294942+0000","last_unstale":"2024-09-13T18:33:58.705138+0000","last_undegraded":"2024-09-13T18:33:58.705138+0000","last_fullsized":"2024-09-13T18:33:58.705138+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654740+0000","last_change":"2024-09-13T18:33:58.658294+0000","last_active":"2024-09-13T18:33:59.654740+0000","last_peered":"2024-09-13T18:33:59.654740+0000","last_clean":"2024-09-13T18:33:59.654740+0000","last_became_active":"2024-09-13T18:33:58.657444+0000","last_became_peered":"2024-09-13T18:33:58.657444+0000","last_unstale":"2024-09-13T18:33:59.654740+0000","last_undegraded":"2024-09-13T18:33:59.654740+0000","last_fullsized":"2024-09-13T18:33:59.654740+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:07.081791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.670086+0000","last_change":"2024-09-13T18:33:58.285300+0000","last_active":"2024-09-13T18:33:58.670086+0000","last_peered":"2024-09-13T18:33:58.670086+0000","last_clean":"2024-09-13T18:33:58.670086+0000","last_became_active":"2024-09-13T18:33:58.279076+0000","last_became_peered":"2024-09-13T18:33:58.279076+0000","last_unstale":"2024-09-13T18:33:58.670086+0000","last_undegraded":"2024-09-13T18:33:58.670086+0000","last_fullsized":"2024-09-13T18:33:58.670086+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166051+0000","last_change":"2024-09-13T18:33:58.697066+0000","last_active":"2024-09-13T18:34:01.166051+0000","last_peered":"2024-09-13T18:34:01.166051+0000","last_clean":"2024-09-13T18:34:01.166051+0000","last_became_active":"2024-09-13T18:33:58.695441+0000","last_became_peered":"2024-09-13T18:33:58.695441+0000","last_unstale":"2024-09-13T18:34:01.166051+0000","last_undegraded":"2024-09-13T18:34:01.166051+0000","last_fullsized":"2024-09-13T18:34:01.166051+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:34.098992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.698353+0000","last_change":"2024-09-13T18:33:58.296866+0000","last_active":"2024-09-13T18:33:58.698353+0000","last_peered":"2024-09-13T18:33:58.698353+0000","last_clean":"2024-09-13T18:33:58.698353+0000","last_became_active":"2024-09-13T18:33:58.296249+0000","last_became_peered":"2024-09-13T18:33:58.296249+0000","last_unstale":"2024-09-13T18:33:58.698353+0000","last_undegraded":"2024-09-13T18:33:58.698353+0000","last_fullsized":"2024-09-13T18:33:58.698353+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651260+0000","last_change":"2024-09-13T18:33:58.669416+0000","last_active":"2024-09-13T18:33:59.651260+0000","last_peered":"2024-09-13T18:33:59.651260+0000","last_clean":"2024-09-13T18:33:59.651260+0000","last_became_active":"2024-09-13T18:33:58.669029+0000","last_became_peered":"2024-09-13T18:33:58.669029+0000","last_unstale":"2024-09-13T18:33:59.651260+0000","last_undegraded":"2024-09-13T18:33:59.651260+0000","last_fullsized":"2024-09-13T18:33:59.651260+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:27.114542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665161+0000","last_change":"2024-09-13T18:33:58.289753+0000","last_active":"2024-09-13T18:33:58.665161+0000","last_peered":"2024-09-13T18:33:58.665161+0000","last_clean":"2024-09-13T18:33:58.665161+0000","last_became_active":"2024-09-13T18:33:58.288502+0000","last_became_peered":"2024-09-13T18:33:58.288502+0000","last_unstale":"2024-09-13T18:33:58.665161+0000","last_undegraded":"2024-09-13T18:33:58.665161+0000","last_fullsized":"2024-09-13T18:33:58.665161+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:36.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167534+0000","last_change":"2024-09-13T18:33:58.671258+0000","last_active":"2024-09-13T18:34:01.167534+0000","last_peered":"2024-09-13T18:34:01.167534+0000","last_clean":"2024-09-13T18:34:01.167534+0000","last_became_active":"2024-09-13T18:33:58.671001+0000","last_became_peered":"2024-09-13T18:33:58.671001+0000","last_unstale":"2024-09-13T18:34:01.167534+0000","last_undegraded":"2024-09-13T18:34:01.167534+0000","last_fullsized":"2024-09-13T18:34:01.167534+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:33.155762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.664780+0000","last_change":"2024-09-13T18:33:58.278135+0000","last_active":"2024-09-13T18:33:58.664780+0000","last_peered":"2024-09-13T18:33:58.664780+0000","last_clean":"2024-09-13T18:33:58.664780+0000","last_became_active":"2024-09-13T18:33:58.277796+0000","last_became_peered":"2024-09-13T18:33:58.277796+0000","last_unstale":"2024-09-13T18:33:58.664780+0000","last_undegraded":"2024-09-13T18:33:58.664780+0000","last_fullsized":"2024-09-13T18:33:58.664780+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654024+0000","last_change":"2024-09-13T18:33:58.679586+0000","last_active":"2024-09-13T18:33:59.654024+0000","last_peered":"2024-09-13T18:33:59.654024+0000","last_clean":"2024-09-13T18:33:59.654024+0000","last_became_active":"2024-09-13T18:33:58.678929+0000","last_became_peered":"2024-09-13T18:33:58.678929+0000","last_unstale":"2024-09-13T18:33:59.654024+0000","last_undegraded":"2024-09-13T18:33:59.654024+0000","last_fullsized":"2024-09-13T18:33:59.654024+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:20.607872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665253+0000","last_change":"2024-09-13T18:33:58.287397+0000","last_active":"2024-09-13T18:33:58.665253+0000","last_peered":"2024-09-13T18:33:58.665253+0000","last_clean":"2024-09-13T18:33:58.665253+0000","last_became_active":"2024-09-13T18:33:58.286704+0000","last_became_peered":"2024-09-13T18:33:58.286704+0000","last_unstale":"2024-09-13T18:33:58.665253+0000","last_undegraded":"2024-09-13T18:33:58.665253+0000","last_fullsized":"2024-09-13T18:33:58.665253+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167071+0000","last_change":"2024-09-13T18:33:58.665624+0000","last_active":"2024-09-13T18:34:01.167071+0000","last_peered":"2024-09-13T18:34:01.167071+0000","last_clean":"2024-09-13T18:34:01.167071+0000","last_became_active":"2024-09-13T18:33:58.665375+0000","last_became_peered":"2024-09-13T18:33:58.665375+0000","last_unstale":"2024-09-13T18:34:01.167071+0000","last_undegraded":"2024-09-13T18:34:01.167071+0000","last_fullsized":"2024-09-13T18:34:01.167071+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:34.098992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.655947+0000","last_change":"2024-09-13T18:33:58.284398+0000","last_active":"2024-09-13T18:33:58.655947+0000","last_peered":"2024-09-13T18:33:58.655947+0000","last_clean":"2024-09-13T18:33:58.655947+0000","last_became_active":"2024-09-13T18:33:58.283698+0000","last_became_peered":"2024-09-13T18:33:58.283698+0000","last_unstale":"2024-09-13T18:33:58.655947+0000","last_undegraded":"2024-09-13T18:33:58.655947+0000","last_fullsized":"2024-09-13T18:33:58.655947+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:47.405098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165082+0000","last_change":"2024-09-13T18:33:58.664442+0000","last_active":"2024-09-13T18:34:01.165082+0000","last_peered":"2024-09-13T18:34:01.165082+0000","last_clean":"2024-09-13T18:34:01.165082+0000","last_became_active":"2024-09-13T18:33:58.664196+0000","last_became_peered":"2024-09-13T18:33:58.664196+0000","last_unstale":"2024-09-13T18:34:01.165082+0000","last_undegraded":"2024-09-13T18:34:01.165082+0000","last_fullsized":"2024-09-13T18:34:01.165082+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:57.499505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.652650+0000","last_change":"2024-09-13T18:33:58.293164+0000","last_active":"2024-09-13T18:33:58.652650+0000","last_peered":"2024-09-13T18:33:58.652650+0000","last_clean":"2024-09-13T18:33:58.652650+0000","last_became_active":"2024-09-13T18:33:58.291115+0000","last_became_peered":"2024-09-13T18:33:58.291115+0000","last_unstale":"2024-09-13T18:33:58.652650+0000","last_undegraded":"2024-09-13T18:33:58.652650+0000","last_fullsized":"2024-09-13T18:33:58.652650+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:19.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654965+0000","last_change":"2024-09-13T18:33:58.703258+0000","last_active":"2024-09-13T18:33:59.654965+0000","last_peered":"2024-09-13T18:33:59.654965+0000","last_clean":"2024-09-13T18:33:59.654965+0000","last_became_active":"2024-09-13T18:33:58.702366+0000","last_became_peered":"2024-09-13T18:33:58.702366+0000","last_unstale":"2024-09-13T18:33:59.654965+0000","last_undegraded":"2024-09-13T18:33:59.654965+0000","last_fullsized":"2024-09-13T18:33:59.654965+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:14.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"161'3","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665519+0000","last_change":"2024-09-13T18:33:58.270397+0000","last_active":"2024-09-13T18:33:58.665519+0000","last_peered":"2024-09-13T18:33:58.665519+0000","last_clean":"2024-09-13T18:33:58.665519+0000","last_became_active":"2024-09-13T18:33:58.270025+0000","last_became_peered":"2024-09-13T18:33:58.270025+0000","last_unstale":"2024-09-13T18:33:58.665519+0000","last_undegraded":"2024-09-13T18:33:58.665519+0000","last_fullsized":"2024-09-13T18:33:58.665519+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:24.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651604+0000","last_change":"2024-09-13T18:33:58.667849+0000","last_active":"2024-09-13T18:33:59.651604+0000","last_peered":"2024-09-13T18:33:59.651604+0000","last_clean":"2024-09-13T18:33:59.651604+0000","last_became_active":"2024-09-13T18:33:58.666181+0000","last_became_peered":"2024-09-13T18:33:58.666181+0000","last_unstale":"2024-09-13T18:33:59.651604+0000","last_undegraded":"2024-09-13T18:33:59.651604+0000","last_fullsized":"2024-09-13T18:33:59.651604+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:15.917112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"161'6","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.687874+0000","last_change":"2024-09-13T18:33:58.278091+0000","last_active":"2024-09-13T18:33:58.687874+0000","last_peered":"2024-09-13T18:33:58.687874+0000","last_clean":"2024-09-13T18:33:58.687874+0000","last_became_active":"2024-09-13T18:33:58.277399+0000","last_became_peered":"2024-09-13T18:33:58.277399+0000","last_unstale":"2024-09-13T18:33:58.687874+0000","last_undegraded":"2024-09-13T18:33:58.687874+0000","last_fullsized":"2024-09-13T18:33:58.687874+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165939+0000","last_change":"2024-09-13T18:33:58.664385+0000","last_active":"2024-09-13T18:34:01.165939+0000","last_peered":"2024-09-13T18:34:01.165939+0000","last_clean":"2024-09-13T18:34:01.165939+0000","last_became_active":"2024-09-13T18:33:58.664117+0000","last_became_peered":"2024-09-13T18:33:58.664117+0000","last_unstale":"2024-09-13T18:34:01.165939+0000","last_undegraded":"2024-09-13T18:34:01.165939+0000","last_fullsized":"2024-09-13T18:34:01.165939+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:51.032671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.689060+0000","last_change":"2024-09-13T18:33:58.292193+0000","last_active":"2024-09-13T18:33:58.689060+0000","last_peered":"2024-09-13T18:33:58.689060+0000","last_clean":"2024-09-13T18:33:58.689060+0000","last_became_active":"2024-09-13T18:33:58.291422+0000","last_became_peered":"2024-09-13T18:33:58.291422+0000","last_unstale":"2024-09-13T18:33:58.689060+0000","last_undegraded":"2024-09-13T18:33:58.689060+0000","last_fullsized":"2024-09-13T18:33:58.689060+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:06.070476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654150+0000","last_change":"2024-09-13T18:33:58.664589+0000","last_active":"2024-09-13T18:33:59.654150+0000","last_peered":"2024-09-13T18:33:59.654150+0000","last_clean":"2024-09-13T18:33:59.654150+0000","last_became_active":"2024-09-13T18:33:58.663635+0000","last_became_peered":"2024-09-13T18:33:58.663635+0000","last_unstale":"2024-09-13T18:33:59.654150+0000","last_undegraded":"2024-09-13T18:33:59.654150+0000","last_fullsized":"2024-09-13T18:33:59.654150+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:41.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.666164+0000","last_change":"2024-09-13T18:33:58.272096+0000","last_active":"2024-09-13T18:33:58.666164+0000","last_peered":"2024-09-13T18:33:58.666164+0000","last_clean":"2024-09-13T18:33:58.666164+0000","last_became_active":"2024-09-13T18:33:58.271808+0000","last_became_peered":"2024-09-13T18:33:58.271808+0000","last_unstale":"2024-09-13T18:33:58.666164+0000","last_undegraded":"2024-09-13T18:33:58.666164+0000","last_fullsized":"2024-09-13T18:33:58.666164+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.296108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165252+0000","last_change":"2024-09-13T18:33:58.694839+0000","last_active":"2024-09-13T18:34:01.165252+0000","last_peered":"2024-09-13T18:34:01.165252+0000","last_clean":"2024-09-13T18:34:01.165252+0000","last_became_active":"2024-09-13T18:33:58.688952+0000","last_became_peered":"2024-09-13T18:33:58.688952+0000","last_unstale":"2024-09-13T18:34:01.165252+0000","last_undegraded":"2024-09-13T18:34:01.165252+0000","last_fullsized":"2024-09-13T18:34:01.165252+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:51.032671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.647927+0000","last_change":"2024-09-13T18:33:58.291518+0000","last_active":"2024-09-13T18:33:58.647927+0000","last_peered":"2024-09-13T18:33:58.647927+0000","last_clean":"2024-09-13T18:33:58.647927+0000","last_became_active":"2024-09-13T18:33:58.291208+0000","last_became_peered":"2024-09-13T18:33:58.291208+0000","last_unstale":"2024-09-13T18:33:58.647927+0000","last_undegraded":"2024-09-13T18:33:58.647927+0000","last_fullsized":"2024-09-13T18:33:58.647927+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:40.901722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651016+0000","last_change":"2024-09-13T18:33:58.674083+0000","last_active":"2024-09-13T18:33:59.651016+0000","last_peered":"2024-09-13T18:33:59.651016+0000","last_clean":"2024-09-13T18:33:59.651016+0000","last_became_active":"2024-09-13T18:33:58.673861+0000","last_became_peered":"2024-09-13T18:33:58.673861+0000","last_unstale":"2024-09-13T18:33:59.651016+0000","last_undegraded":"2024-09-13T18:33:59.651016+0000","last_fullsized":"2024-09-13T18:33:59.651016+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:42.519688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"161'8","reported_seq":19,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.693755+0000","last_change":"2024-09-13T18:33:58.293820+0000","last_active":"2024-09-13T18:33:58.693755+0000","last_peered":"2024-09-13T18:33:58.693755+0000","last_clean":"2024-09-13T18:33:58.693755+0000","last_became_active":"2024-09-13T18:33:58.293138+0000","last_became_peered":"2024-09-13T18:33:58.293138+0000","last_unstale":"2024-09-13T18:33:58.693755+0000","last_undegraded":"2024-09-13T18:33:58.693755+0000","last_fullsized":"2024-09-13T18:33:58.693755+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:47.459960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.652053+0000","last_change":"2024-09-13T18:33:58.676465+0000","last_active":"2024-09-13T18:33:59.652053+0000","last_peered":"2024-09-13T18:33:59.652053+0000","last_clean":"2024-09-13T18:33:59.652053+0000","last_became_active":"2024-09-13T18:33:58.676157+0000","last_became_peered":"2024-09-13T18:33:58.676157+0000","last_unstale":"2024-09-13T18:33:59.652053+0000","last_undegraded":"2024-09-13T18:33:59.652053+0000","last_fullsized":"2024-09-13T18:33:59.652053+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:13.352509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.672557+0000","last_change":"2024-09-13T18:33:58.289330+0000","last_active":"2024-09-13T18:33:58.672557+0000","last_peered":"2024-09-13T18:33:58.672557+0000","last_clean":"2024-09-13T18:33:58.672557+0000","last_became_active":"2024-09-13T18:33:58.288827+0000","last_became_peered":"2024-09-13T18:33:58.288827+0000","last_unstale":"2024-09-13T18:33:58.672557+0000","last_undegraded":"2024-09-13T18:33:58.672557+0000","last_fullsized":"2024-09-13T18:33:58.672557+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:40.804040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166019+0000","last_change":"2024-09-13T18:33:58.694815+0000","last_active":"2024-09-13T18:34:01.166019+0000","last_peered":"2024-09-13T18:34:01.166019+0000","last_clean":"2024-09-13T18:34:01.166019+0000","last_became_active":"2024-09-13T18:33:58.688047+0000","last_became_peered":"2024-09-13T18:33:58.688047+0000","last_unstale":"2024-09-13T18:34:01.166019+0000","last_undegraded":"2024-09-13T18:34:01.166019+0000","last_fullsized":"2024-09-13T18:34:01.166019+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:27.518791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.679620+0000","last_change":"2024-09-13T18:33:58.276022+0000","last_active":"2024-09-13T18:33:58.679620+0000","last_peered":"2024-09-13T18:33:58.679620+0000","last_clean":"2024-09-13T18:33:58.679620+0000","last_became_active":"2024-09-13T18:33:58.275726+0000","last_became_peered":"2024-09-13T18:33:58.275726+0000","last_unstale":"2024-09-13T18:33:58.679620+0000","last_undegraded":"2024-09-13T18:33:58.679620+0000","last_fullsized":"2024-09-13T18:33:58.679620+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:15.548105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165753+0000","last_change":"2024-09-13T18:33:58.701192+0000","last_active":"2024-09-13T18:34:01.165753+0000","last_peered":"2024-09-13T18:34:01.165753+0000","last_clean":"2024-09-13T18:34:01.165753+0000","last_became_active":"2024-09-13T18:33:58.695825+0000","last_became_peered":"2024-09-13T18:33:58.695825+0000","last_unstale":"2024-09-13T18:34:01.165753+0000","last_undegraded":"2024-09-13T18:34:01.165753+0000","last_fullsized":"2024-09-13T18:34:01.165753+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:33.898483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.688655+0000","last_change":"2024-09-13T18:33:58.290557+0000","last_active":"2024-09-13T18:33:58.688655+0000","last_peered":"2024-09-13T18:33:58.688655+0000","last_clean":"2024-09-13T18:33:58.688655+0000","last_became_active":"2024-09-13T18:33:58.289847+0000","last_became_peered":"2024-09-13T18:33:58.289847+0000","last_unstale":"2024-09-13T18:33:58.688655+0000","last_undegraded":"2024-09-13T18:33:58.688655+0000","last_fullsized":"2024-09-13T18:33:58.688655+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:03.791063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064792+0000","last_change":"2024-09-13T18:33:58.684507+0000","last_active":"2024-09-13T18:34:00.064792+0000","last_peered":"2024-09-13T18:34:00.064792+0000","last_clean":"2024-09-13T18:34:00.064792+0000","last_became_active":"2024-09-13T18:33:58.683723+0000","last_became_peered":"2024-09-13T18:33:58.683723+0000","last_unstale":"2024-09-13T18:34:00.064792+0000","last_undegraded":"2024-09-13T18:34:00.064792+0000","last_fullsized":"2024-09-13T18:34:00.064792+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:51.032671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.654987+0000","last_change":"2024-09-13T18:33:58.289101+0000","last_active":"2024-09-13T18:33:58.654987+0000","last_peered":"2024-09-13T18:33:58.654987+0000","last_clean":"2024-09-13T18:33:58.654987+0000","last_became_active":"2024-09-13T18:33:58.287584+0000","last_became_peered":"2024-09-13T18:33:58.287584+0000","last_unstale":"2024-09-13T18:33:58.654987+0000","last_undegraded":"2024-09-13T18:33:58.654987+0000","last_fullsized":"2024-09-13T18:33:58.654987+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:26.507476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651451+0000","last_change":"2024-09-13T18:33:58.669585+0000","last_active":"2024-09-13T18:33:59.651451+0000","last_peered":"2024-09-13T18:33:59.651451+0000","last_clean":"2024-09-13T18:33:59.651451+0000","last_became_active":"2024-09-13T18:33:58.669350+0000","last_became_peered":"2024-09-13T18:33:58.669350+0000","last_unstale":"2024-09-13T18:33:59.651451+0000","last_undegraded":"2024-09-13T18:33:59.651451+0000","last_fullsized":"2024-09-13T18:33:59.651451+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:06.146160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.666560+0000","last_change":"2024-09-13T18:33:58.277427+0000","last_active":"2024-09-13T18:33:58.666560+0000","last_peered":"2024-09-13T18:33:58.666560+0000","last_clean":"2024-09-13T18:33:58.666560+0000","last_became_active":"2024-09-13T18:33:58.277146+0000","last_became_peered":"2024-09-13T18:33:58.277146+0000","last_unstale":"2024-09-13T18:33:58.666560+0000","last_undegraded":"2024-09-13T18:33:58.666560+0000","last_fullsized":"2024-09-13T18:33:58.666560+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:30.625317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654178+0000","last_change":"2024-09-13T18:33:58.662427+0000","last_active":"2024-09-13T18:33:59.654178+0000","last_peered":"2024-09-13T18:33:59.654178+0000","last_clean":"2024-09-13T18:33:59.654178+0000","last_became_active":"2024-09-13T18:33:58.661710+0000","last_became_peered":"2024-09-13T18:33:58.661710+0000","last_unstale":"2024-09-13T18:33:59.654178+0000","last_undegraded":"2024-09-13T18:33:59.654178+0000","last_fullsized":"2024-09-13T18:33:59.654178+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:04.802378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.652153+0000","last_change":"2024-09-13T18:33:58.293498+0000","last_active":"2024-09-13T18:33:58.652153+0000","last_peered":"2024-09-13T18:33:58.652153+0000","last_clean":"2024-09-13T18:33:58.652153+0000","last_became_active":"2024-09-13T18:33:58.293110+0000","last_became_peered":"2024-09-13T18:33:58.293110+0000","last_unstale":"2024-09-13T18:33:58.652153+0000","last_undegraded":"2024-09-13T18:33:58.652153+0000","last_fullsized":"2024-09-13T18:33:58.652153+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:19.538884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064248+0000","last_change":"2024-09-13T18:33:58.699146+0000","last_active":"2024-09-13T18:34:00.064248+0000","last_peered":"2024-09-13T18:34:00.064248+0000","last_clean":"2024-09-13T18:34:00.064248+0000","last_became_active":"2024-09-13T18:33:58.697950+0000","last_became_peered":"2024-09-13T18:33:58.697950+0000","last_unstale":"2024-09-13T18:34:00.064248+0000","last_undegraded":"2024-09-13T18:34:00.064248+0000","last_fullsized":"2024-09-13T18:34:00.064248+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:08.703513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.653724+0000","last_change":"2024-09-13T18:33:58.278050+0000","last_active":"2024-09-13T18:33:58.653724+0000","last_peered":"2024-09-13T18:33:58.653724+0000","last_clean":"2024-09-13T18:33:58.653724+0000","last_became_active":"2024-09-13T18:33:58.277708+0000","last_became_peered":"2024-09-13T18:33:58.277708+0000","last_unstale":"2024-09-13T18:33:58.653724+0000","last_undegraded":"2024-09-13T18:33:58.653724+0000","last_fullsized":"2024-09-13T18:33:58.653724+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.164991+0000","last_change":"2024-09-13T18:33:58.656133+0000","last_active":"2024-09-13T18:34:01.164991+0000","last_peered":"2024-09-13T18:34:01.164991+0000","last_clean":"2024-09-13T18:34:01.164991+0000","last_became_active":"2024-09-13T18:33:58.655876+0000","last_became_peered":"2024-09-13T18:33:58.655876+0000","last_unstale":"2024-09-13T18:34:01.164991+0000","last_undegraded":"2024-09-13T18:34:01.164991+0000","last_fullsized":"2024-09-13T18:34:01.164991+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:19.624626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.695273+0000","last_change":"2024-09-13T18:33:58.294980+0000","last_active":"2024-09-13T18:33:58.695273+0000","last_peered":"2024-09-13T18:33:58.695273+0000","last_clean":"2024-09-13T18:33:58.695273+0000","last_became_active":"2024-09-13T18:33:58.294069+0000","last_became_peered":"2024-09-13T18:33:58.294069+0000","last_unstale":"2024-09-13T18:33:58.695273+0000","last_undegraded":"2024-09-13T18:33:58.695273+0000","last_fullsized":"2024-09-13T18:33:58.695273+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165441+0000","last_change":"2024-09-13T18:33:58.665839+0000","last_active":"2024-09-13T18:34:01.165441+0000","last_peered":"2024-09-13T18:34:01.165441+0000","last_clean":"2024-09-13T18:34:01.165441+0000","last_became_active":"2024-09-13T18:33:58.665553+0000","last_became_peered":"2024-09-13T18:33:58.665553+0000","last_unstale":"2024-09-13T18:34:01.165441+0000","last_undegraded":"2024-09-13T18:34:01.165441+0000","last_fullsized":"2024-09-13T18:34:01.165441+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:04.158107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.682922+0000","last_change":"2024-09-13T18:33:58.298315+0000","last_active":"2024-09-13T18:33:58.682922+0000","last_peered":"2024-09-13T18:33:58.682922+0000","last_clean":"2024-09-13T18:33:58.682922+0000","last_became_active":"2024-09-13T18:33:58.297612+0000","last_became_peered":"2024-09-13T18:33:58.297612+0000","last_unstale":"2024-09-13T18:33:58.682922+0000","last_undegraded":"2024-09-13T18:33:58.682922+0000","last_fullsized":"2024-09-13T18:33:58.682922+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:41.543952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.652171+0000","last_change":"2024-09-13T18:33:58.677117+0000","last_active":"2024-09-13T18:33:59.652171+0000","last_peered":"2024-09-13T18:33:59.652171+0000","last_clean":"2024-09-13T18:33:59.652171+0000","last_became_active":"2024-09-13T18:33:58.676855+0000","last_became_peered":"2024-09-13T18:33:58.676855+0000","last_unstale":"2024-09-13T18:33:59.652171+0000","last_undegraded":"2024-09-13T18:33:59.652171+0000","last_fullsized":"2024-09-13T18:33:59.652171+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:57.499505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.183165+0000","last_change":"2024-09-13T18:33:58.279582+0000","last_active":"2024-09-13T18:33:59.183165+0000","last_peered":"2024-09-13T18:33:59.183165+0000","last_clean":"2024-09-13T18:33:59.183165+0000","last_became_active":"2024-09-13T18:33:58.279166+0000","last_became_peered":"2024-09-13T18:33:58.279166+0000","last_unstale":"2024-09-13T18:33:59.183165+0000","last_undegraded":"2024-09-13T18:33:59.183165+0000","last_fullsized":"2024-09-13T18:33:59.183165+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:13.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165854+0000","last_change":"2024-09-13T18:33:58.657029+0000","last_active":"2024-09-13T18:34:01.165854+0000","last_peered":"2024-09-13T18:34:01.165854+0000","last_clean":"2024-09-13T18:34:01.165854+0000","last_became_active":"2024-09-13T18:33:58.656682+0000","last_became_peered":"2024-09-13T18:33:58.656682+0000","last_unstale":"2024-09-13T18:34:01.165854+0000","last_undegraded":"2024-09-13T18:34:01.165854+0000","last_fullsized":"2024-09-13T18:34:01.165854+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:04.709060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.667787+0000","last_change":"2024-09-13T18:33:58.286163+0000","last_active":"2024-09-13T18:33:58.667787+0000","last_peered":"2024-09-13T18:33:58.667787+0000","last_clean":"2024-09-13T18:33:58.667787+0000","last_became_active":"2024-09-13T18:33:58.285914+0000","last_became_peered":"2024-09-13T18:33:58.285914+0000","last_unstale":"2024-09-13T18:33:58.667787+0000","last_undegraded":"2024-09-13T18:33:58.667787+0000","last_fullsized":"2024-09-13T18:33:58.667787+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:11.134787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166736+0000","last_change":"2024-09-13T18:33:58.701340+0000","last_active":"2024-09-13T18:34:01.166736+0000","last_peered":"2024-09-13T18:34:01.166736+0000","last_clean":"2024-09-13T18:34:01.166736+0000","last_became_active":"2024-09-13T18:33:58.701065+0000","last_became_peered":"2024-09-13T18:33:58.701065+0000","last_unstale":"2024-09-13T18:34:01.166736+0000","last_undegraded":"2024-09-13T18:34:01.166736+0000","last_fullsized":"2024-09-13T18:34:01.166736+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.605214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.648663+0000","last_change":"2024-09-13T18:33:58.274092+0000","last_active":"2024-09-13T18:33:58.648663+0000","last_peered":"2024-09-13T18:33:58.648663+0000","last_clean":"2024-09-13T18:33:58.648663+0000","last_became_active":"2024-09-13T18:33:58.273806+0000","last_became_peered":"2024-09-13T18:33:58.273806+0000","last_unstale":"2024-09-13T18:33:58.648663+0000","last_undegraded":"2024-09-13T18:33:58.648663+0000","last_fullsized":"2024-09-13T18:33:58.648663+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.574702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.867713+0000","last_change":"2024-09-13T18:33:58.687765+0000","last_active":"2024-09-13T18:33:59.867713+0000","last_peered":"2024-09-13T18:33:59.867713+0000","last_clean":"2024-09-13T18:33:59.867713+0000","last_became_active":"2024-09-13T18:33:58.687017+0000","last_became_peered":"2024-09-13T18:33:58.687017+0000","last_unstale":"2024-09-13T18:33:59.867713+0000","last_undegraded":"2024-09-13T18:33:59.867713+0000","last_fullsized":"2024-09-13T18:33:59.867713+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:36.689802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.696728+0000","last_change":"2024-09-13T18:33:58.282999+0000","last_active":"2024-09-13T18:33:58.696728+0000","last_peered":"2024-09-13T18:33:58.696728+0000","last_clean":"2024-09-13T18:33:58.696728+0000","last_became_active":"2024-09-13T18:33:58.282305+0000","last_became_peered":"2024-09-13T18:33:58.282305+0000","last_unstale":"2024-09-13T18:33:58.696728+0000","last_undegraded":"2024-09-13T18:33:58.696728+0000","last_fullsized":"2024-09-13T18:33:58.696728+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.867936+0000","last_change":"2024-09-13T18:33:58.682843+0000","last_active":"2024-09-13T18:33:59.867936+0000","last_peered":"2024-09-13T18:33:59.867936+0000","last_clean":"2024-09-13T18:33:59.867936+0000","last_became_active":"2024-09-13T18:33:58.682125+0000","last_became_peered":"2024-09-13T18:33:58.682125+0000","last_unstale":"2024-09-13T18:33:59.867936+0000","last_undegraded":"2024-09-13T18:33:59.867936+0000","last_fullsized":"2024-09-13T18:33:59.867936+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:19.273453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.695630+0000","last_change":"2024-09-13T18:33:58.281968+0000","last_active":"2024-09-13T18:33:58.695630+0000","last_peered":"2024-09-13T18:33:58.695630+0000","last_clean":"2024-09-13T18:33:58.695630+0000","last_became_active":"2024-09-13T18:33:58.280874+0000","last_became_peered":"2024-09-13T18:33:58.280874+0000","last_unstale":"2024-09-13T18:33:58.695630+0000","last_undegraded":"2024-09-13T18:33:58.695630+0000","last_fullsized":"2024-09-13T18:33:58.695630+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064506+0000","last_change":"2024-09-13T18:33:58.673313+0000","last_active":"2024-09-13T18:34:00.064506+0000","last_peered":"2024-09-13T18:34:00.064506+0000","last_clean":"2024-09-13T18:34:00.064506+0000","last_became_active":"2024-09-13T18:33:58.672652+0000","last_became_peered":"2024-09-13T18:33:58.672652+0000","last_unstale":"2024-09-13T18:34:00.064506+0000","last_undegraded":"2024-09-13T18:34:00.064506+0000","last_fullsized":"2024-09-13T18:34:00.064506+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:07.044563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665786+0000","last_change":"2024-09-13T18:33:58.294855+0000","last_active":"2024-09-13T18:33:58.665786+0000","last_peered":"2024-09-13T18:33:58.665786+0000","last_clean":"2024-09-13T18:33:58.665786+0000","last_became_active":"2024-09-13T18:33:58.294167+0000","last_became_peered":"2024-09-13T18:33:58.294167+0000","last_unstale":"2024-09-13T18:33:58.665786+0000","last_undegraded":"2024-09-13T18:33:58.665786+0000","last_fullsized":"2024-09-13T18:33:58.665786+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165280+0000","last_change":"2024-09-13T18:33:58.681124+0000","last_active":"2024-09-13T18:34:01.165280+0000","last_peered":"2024-09-13T18:34:01.165280+0000","last_clean":"2024-09-13T18:34:01.165280+0000","last_became_active":"2024-09-13T18:33:58.680833+0000","last_became_peered":"2024-09-13T18:33:58.680833+0000","last_unstale":"2024-09-13T18:34:01.165280+0000","last_undegraded":"2024-09-13T18:34:01.165280+0000","last_fullsized":"2024-09-13T18:34:01.165280+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:17.566641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.653581+0000","last_change":"2024-09-13T18:33:58.279050+0000","last_active":"2024-09-13T18:33:58.653581+0000","last_peered":"2024-09-13T18:33:58.653581+0000","last_clean":"2024-09-13T18:33:58.653581+0000","last_became_active":"2024-09-13T18:33:58.278575+0000","last_became_peered":"2024-09-13T18:33:58.278575+0000","last_unstale":"2024-09-13T18:33:58.653581+0000","last_undegraded":"2024-09-13T18:33:58.653581+0000","last_fullsized":"2024-09-13T18:33:58.653581+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.650593+0000","last_change":"2024-09-13T18:33:58.683185+0000","last_active":"2024-09-13T18:33:59.650593+0000","last_peered":"2024-09-13T18:33:59.650593+0000","last_clean":"2024-09-13T18:33:59.650593+0000","last_became_active":"2024-09-13T18:33:58.682800+0000","last_became_peered":"2024-09-13T18:33:58.682800+0000","last_unstale":"2024-09-13T18:33:59.650593+0000","last_undegraded":"2024-09-13T18:33:59.650593+0000","last_fullsized":"2024-09-13T18:33:59.650593+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:11.427563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665734+0000","last_change":"2024-09-13T18:33:58.300578+0000","last_active":"2024-09-13T18:33:58.665734+0000","last_peered":"2024-09-13T18:33:58.665734+0000","last_clean":"2024-09-13T18:33:58.665734+0000","last_became_active":"2024-09-13T18:33:58.299788+0000","last_became_peered":"2024-09-13T18:33:58.299788+0000","last_unstale":"2024-09-13T18:33:58.665734+0000","last_undegraded":"2024-09-13T18:33:58.665734+0000","last_fullsized":"2024-09-13T18:33:58.665734+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:29.530975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":322,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665945+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:33:58.665945+0000","last_peered":"2024-09-13T18:33:58.665945+0000","last_clean":"2024-09-13T18:33:58.665945+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:33:58.665945+0000","last_undegraded":"2024-09-13T18:33:58.665945+0000","last_fullsized":"2024-09-13T18:33:58.665945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":2580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":2641920,"data_stored":1493315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.6439999999999999},"last":1.399},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93300000000000005,"15min":0.90000000000000002},"min":{"1min":0.57499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":1.333,"15min":1.4410000000000001},"last":1.042}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.218,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.93200000000000005},"min":{"1min":0.54400000000000004,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.2490000000000001,"5min":1.4890000000000001,"15min":1.6060000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80900000000000005,"15min":0.80400000000000005},"min":{"1min":0.53700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":1.276,"15min":1.276},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.165,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":1.129}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1339999999999999,"5min":1.349,"15min":1.448},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.238,"5min":1.395,"15min":1.397},"last":1.333}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.873,"15min":0.88800000000000001},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.218,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.93999999999999995},"min":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.92400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95499999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.877},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.70299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":1.409,"15min":1.409},"last":0.876}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.85499999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":1.476,"15min":1.476},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.02,"15min":1.006},"min":{"1min":0.65000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2689999999999999,"5min":1.361,"15min":1.506},"last":0.996}]}]},{"osd":6,"up_from":13,"seq":55834574963,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2039808,"data_stored":902843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.82699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.0820000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":1.1779999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.3480000000000001,"15min":1.577},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":0.91600000000000004},"min":{"1min":0.71899999999999997,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.069,"5min":1.218,"15min":1.464},"last":0.86899999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.026},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.95799999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.319,"5min":1.673,"15min":2.4220000000000002},"last":1.147}]},{"osd":3,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.516,"15min":1.516},"last":1.28},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.61899999999999999,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.2669999999999999,"15min":1.306},"last":0.75600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.97099999999999997},"min":{"1min":0.72799999999999998,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.2350000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.014},"min":{"1min":0.79200000000000004,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.2589999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.103}]},{"osd":5,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.69399999999999995,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.01,"5min":1.024,"15min":1.0800000000000001},"min":{"1min":0.67200000000000004,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":2.762},"last":1.371}]},{"osd":7,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.0369999999999999},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.22,"5min":1.5,"15min":1.9299999999999999},"last":1.389},{"interface":"front","average":{"1min":1.024,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.2470000000000001,"5min":1.357,"15min":1.72},"last":1.3300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2039808,"data_stored":902843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":0.83899999999999997},"min":{"1min":0.47899999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.88700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.437},"max":{"1min":1.089,"5min":1.264,"15min":2.1840000000000002},"last":1.105}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1719999999999999,"5min":1.603,"15min":1.603},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92800000000000005,"15min":0.95099999999999996},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.21,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.64800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95299999999999996,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.46,"5min":3.46,"15min":3.46},"last":1.202},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.306,"5min":1.492,"15min":1.5049999999999999},"last":1.238}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0109999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.376,"15min":0.376},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.077},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.97499999999999998,"15min":1.014},"min":{"1min":0.63100000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.0960000000000001},"min":{"1min":0.65800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.246},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.76000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":1.2709999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33124,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338716,"statfs":{"total":96636764160,"available":96602845184,"internally_reserved":0,"allocated":2056192,"data_stored":904989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93200000000000005,"15min":0.84499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2649999999999999,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.91000000000000003,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.242,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.216,"5min":1.536,"15min":1.536},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.89200000000000002},"min":{"1min":0.52600000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3660000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.367,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.92300000000000004,"15min":0.90500000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4490000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":10.44,"15min":10.44},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.286,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":0.97199999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.363,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1259999999999999,"15min":1.0309999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.222,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.504,"5min":19.434000000000001,"15min":19.434000000000001},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.1819999999999999,"15min":1.091},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.573,"5min":15.593,"15min":15.593},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.077},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4119999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.876}]}]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37220,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334620,"statfs":{"total":96636764160,"available":96598650880,"internally_reserved":0,"allocated":2052096,"data_stored":903037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98699999999999999,"5min":1.444,"15min":2.113},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.89300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.34100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.33700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96699999999999997,"5min":1.4850000000000001,"15min":1.742},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.74099999999999999},"min":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":1.222,"15min":1.399},"last":0.62}]},{"osd":4,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95699999999999996,"15min":1.0640000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":1.0069999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":0.99199999999999999},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1279999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.349,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95899999999999996,"15min":1.0369999999999999},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.99099999999999999,"15min":1.034},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.454,"5min":1.6890000000000001,"15min":1.96},"last":0.98499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.02,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.413,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97399999999999998,"15min":1.0009999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.504,"5min":1.504,"15min":2.9220000000000002},"last":1.079}]}]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41312,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330528,"statfs":{"total":96636764160,"available":96594460672,"internally_reserved":0,"allocated":2052096,"data_stored":903537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60599999999999998,"15min":0.58799999999999997},"min":{"1min":0.29799999999999999,"5min":0.246,"15min":0.246},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.98599999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64800000000000002,"15min":0.69599999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.307},"max":{"1min":1.0529999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.39100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.92500000000000004,"15min":0.91800000000000004},"min":{"1min":0.61699999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.611},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89200000000000002,"15min":0.91000000000000003},"min":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.248,"5min":1.587,"15min":1.587},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96999999999999997,"15min":0.99299999999999999},"min":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.3500000000000001,"5min":1.548,"15min":1.9179999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.58599999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.589,"5min":1.589,"15min":1.702},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.5},"max":{"1min":1.258,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.036},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.3600000000000001,"5min":1.645,"15min":1.645},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.843,"15min":1.843},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.036,"15min":1.071},"min":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":0.93400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41312,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330528,"statfs":{"total":96636764160,"available":96594460672,"internally_reserved":0,"allocated":2052096,"data_stored":904407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64300000000000002,"15min":0.623},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.436}]},{"osd":2,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.314,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.91300000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.2430000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1100000000000001,"5min":1.423,"15min":1.423},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88900000000000001,"15min":0.90400000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.77600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.367,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.02},"min":{"1min":0.60599999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64000000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.335,"5min":1.5900000000000001,"15min":1.653},"last":0.878},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.61699999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.028,"15min":1.0229999999999999},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.649,"15min":1.649},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41888,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329952,"statfs":{"total":96636764160,"available":96593870848,"internally_reserved":0,"allocated":2637824,"data_stored":1493233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.64400000000000002},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86399999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.4359999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.93899999999999995,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65000000000000002,"15min":0.68600000000000005},"min":{"1min":0.38200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.7589999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.5129999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.92000000000000004},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93700000000000006,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.458,"5min":1.5069999999999999,"15min":1.986},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96199999999999997,"15min":0.997},"min":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.583,"5min":1.583,"15min":2.641},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96899999999999997,"15min":1.024},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.6699999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.002,"15min":1.0580000000000001},"min":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.891},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.016},"min":{"1min":0.69099999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3700000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.427,"5min":1.669,"15min":2.2949999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.536,"5min":1.6930000000000001,"15min":2.2480000000000002},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:34:07.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:34:07.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff030ef0640 1 Processor -- start 2024-09-13T18:34:07.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff030ef0640 1 -- start start 2024-09-13T18:34:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff030ef0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff02c15b7c0 0x7ff02c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff030ef0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c06d480 con 0x7ff02c1582a0 2024-09-13T18:34:07.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff030ef0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c15ace0 con 0x7ff02c0711d0 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff030ef0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c071680 con 0x7ff02c15b7c0 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff029d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff02c15b7c0 0x7ff02c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff02a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff02c1582a0 0x7ff02c06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52778/0 (socket says 172.21.15.53:52778) 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff02a59c640 1 -- 172.21.15.53:0/2905704094 learned_addr learned my addr 172.21.15.53:0/2905704094 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff029d9b640 1 --2- 172.21.15.53:0/2905704094 >> v2:172.21.15.53:3300/0 conn(0x7ff02c15b7c0 0x7ff02c070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60678/0 (socket says 172.21.15.53:60678) 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff029d9b640 1 -- 172.21.15.53:0/2905704094 >> v1:172.21.15.87:6789/0 conn(0x7ff02c0711d0 legacy=0x7ff02c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff029d9b640 1 -- 172.21.15.53:0/2905704094 >> v1:172.21.15.53:6789/0 conn(0x7ff02c1582a0 legacy=0x7ff02c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff02959a640 1 -- 172.21.15.53:0/2905704094 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608030597 0 0) 0x7ff02c06d480 con 0x7ff02c1582a0 2024-09-13T18:34:07.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.260+0000 7ff029d9b640 1 -- 172.21.15.53:0/2905704094 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c15afc0 con 0x7ff02c15b7c0 2024-09-13T18:34:07.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff029d9b640 1 --2- 172.21.15.53:0/2905704094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c15b7c0 0x7ff02c070c90 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7ff0200097c0 tx=0x7ff02001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2463057f32ce76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff02959a640 1 -- 172.21.15.53:0/2905704094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200ab600 con 0x7ff02c15b7c0 2024-09-13T18:34:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff02959a640 1 -- 172.21.15.53:0/2905704094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0200a7050 con 0x7ff02c15b7c0 2024-09-13T18:34:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff02959a640 1 -- 172.21.15.53:0/2905704094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200ab980 con 0x7ff02c15b7c0 2024-09-13T18:34:07.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- 172.21.15.53:0/2905704094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c15b7c0 msgr2=0x7ff02c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 --2- 172.21.15.53:0/2905704094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c15b7c0 0x7ff02c070c90 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7ff0200097c0 tx=0x7ff02001c460 comp rx=0 tx=0).stop 2024-09-13T18:34:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- 172.21.15.53:0/2905704094 shutdown_connections 2024-09-13T18:34:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 --2- 172.21.15.53:0/2905704094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c15b7c0 0x7ff02c070c90 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- 172.21.15.53:0/2905704094 >> 172.21.15.53:0/2905704094 conn(0x7ff02c065c80 msgr2=0x7ff02c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- 172.21.15.53:0/2905704094 shutdown_connections 2024-09-13T18:34:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- 172.21.15.53:0/2905704094 wait complete. 2024-09-13T18:34:07.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 Processor -- start 2024-09-13T18:34:07.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- start start 2024-09-13T18:34:07.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff02c0711d0 0x7ff02c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c1582a0 0x7ff02c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff02c15b7c0 0x7ff02c13dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c15a7d0 con 0x7ff02c1582a0 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0b1a20 con 0x7ff02c0711d0 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff030ef0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0b1d00 con 0x7ff02c15b7c0 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.264+0000 7ff029d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c1582a0 0x7ff02c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c1582a0 0x7ff02c15a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60686/0 (socket says 172.21.15.53:60686) 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 -- 172.21.15.53:0/1276129044 learned_addr learned my addr 172.21.15.53:0/1276129044 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff02a59c640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff02c0711d0 0x7ff02c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff02ad9d640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff02c15b7c0 0x7ff02c13dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 -- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff02c15b7c0 msgr2=0x7ff02c13dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff02c15b7c0 0x7ff02c13dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 -- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff02c0711d0 msgr2=0x7ff02c0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff02c0711d0 0x7ff02c0b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 -- 172.21.15.53:0/1276129044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff020009420 con 0x7ff02c1582a0 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff02a59c640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff02c0711d0 0x7ff02c0b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff029d9b640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c1582a0 0x7ff02c15a290 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7ff020019070 tx=0x7ff02001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff01affd640 1 -- 172.21.15.53:0/1276129044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200b7650 con 0x7ff02c1582a0 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff01affd640 1 -- 172.21.15.53:0/1276129044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0200abe90 con 0x7ff02c1582a0 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c0b1fe0 con 0x7ff02c1582a0 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff01affd640 1 -- 172.21.15.53:0/1276129044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200b7a10 con 0x7ff02c1582a0 2024-09-13T18:34:07.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c0b25a0 con 0x7ff02c1582a0 2024-09-13T18:34:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c067400 con 0x7ff02c1582a0 2024-09-13T18:34:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff01affd640 1 -- 172.21.15.53:0/1276129044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7ff0200b7b70 con 0x7ff02c1582a0 2024-09-13T18:34:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff01affd640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff00c066e70 0x7ff00c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff01affd640 1 -- 172.21.15.53:0/1276129044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff02011d1a0 con 0x7ff02c1582a0 2024-09-13T18:34:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff02a59c640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff00c066e70 0x7ff00c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.268+0000 7ff02a59c640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff00c066e70 0x7ff00c069330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff01c007fd0 tx=0x7ff01c007c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.272+0000 7ff01affd640 1 -- 172.21.15.53:0/1276129044 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0200ec230 con 0x7ff02c1582a0 2024-09-13T18:34:07.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.428+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff02c06d220 con 0x7ff00c066e70 2024-09-13T18:34:07.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.452+0000 7ff01affd640 1 -- 172.21.15.53:0/1276129044 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288588 (secure 0 0 0) 0x7ff01c005c90 con 0x7ff00c066e70 2024-09-13T18:34:07.458 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:07.460 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:34:07.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff00c066e70 msgr2=0x7ff00c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff00c066e70 0x7ff00c069330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff01c007fd0 tx=0x7ff01c007c20 comp rx=0 tx=0).stop 2024-09-13T18:34:07.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c1582a0 msgr2=0x7ff02c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c1582a0 0x7ff02c15a290 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7ff020019070 tx=0x7ff02001aca0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 shutdown_connections 2024-09-13T18:34:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff00c066e70 0x7ff00c069330 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff02c15b7c0 0x7ff02c13dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff02c1582a0 0x7ff02c15a290 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 --2- 172.21.15.53:0/1276129044 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff02c0711d0 0x7ff02c0b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 >> 172.21.15.53:0/1276129044 conn(0x7ff02c065c80 msgr2=0x7ff02c06fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 shutdown_connections 2024-09-13T18:34:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.456+0000 7ff030ef0640 1 -- 172.21.15.53:0/1276129044 wait complete. 2024-09-13T18:34:07.480 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-09-13T18:34:05.891952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294776,"kb_used_data":17160,"kb_used_omap":12,"kb_used_meta":277491,"kb_avail":754679944,"statfs":{"total":773094113280,"available":772792262656,"internally_reserved":0,"allocated":17571840,"data_stored":8408204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":284151352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.633222"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.868028+0000","last_change":"2024-09-13T18:33:58.684390+0000","last_active":"2024-09-13T18:33:59.868028+0000","last_peered":"2024-09-13T18:33:59.868028+0000","last_clean":"2024-09-13T18:33:59.868028+0000","last_became_active":"2024-09-13T18:33:58.682710+0000","last_became_peered":"2024-09-13T18:33:58.682710+0000","last_unstale":"2024-09-13T18:33:59.868028+0000","last_undegraded":"2024-09-13T18:33:59.868028+0000","last_fullsized":"2024-09-13T18:33:59.868028+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:18.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064766+0000","last_change":"2024-09-13T18:33:58.692411+0000","last_active":"2024-09-13T18:34:00.064766+0000","last_peered":"2024-09-13T18:34:00.064766+0000","last_clean":"2024-09-13T18:34:00.064766+0000","last_became_active":"2024-09-13T18:33:58.691825+0000","last_became_peered":"2024-09-13T18:33:58.691825+0000","last_unstale":"2024-09-13T18:34:00.064766+0000","last_undegraded":"2024-09-13T18:34:00.064766+0000","last_fullsized":"2024-09-13T18:34:00.064766+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:27.518791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166260+0000","last_change":"2024-09-13T18:33:58.704360+0000","last_active":"2024-09-13T18:34:01.166260+0000","last_peered":"2024-09-13T18:34:01.166260+0000","last_clean":"2024-09-13T18:34:01.166260+0000","last_became_active":"2024-09-13T18:33:58.704068+0000","last_became_peered":"2024-09-13T18:33:58.704068+0000","last_unstale":"2024-09-13T18:34:01.166260+0000","last_undegraded":"2024-09-13T18:34:01.166260+0000","last_fullsized":"2024-09-13T18:34:01.166260+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:27.518791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064787+0000","last_change":"2024-09-13T18:33:58.691871+0000","last_active":"2024-09-13T18:34:00.064787+0000","last_peered":"2024-09-13T18:34:00.064787+0000","last_clean":"2024-09-13T18:34:00.064787+0000","last_became_active":"2024-09-13T18:33:58.691344+0000","last_became_peered":"2024-09-13T18:33:58.691344+0000","last_unstale":"2024-09-13T18:34:00.064787+0000","last_undegraded":"2024-09-13T18:34:00.064787+0000","last_fullsized":"2024-09-13T18:34:00.064787+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:31.989521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.164952+0000","last_change":"2024-09-13T18:33:58.688616+0000","last_active":"2024-09-13T18:34:01.164952+0000","last_peered":"2024-09-13T18:34:01.164952+0000","last_clean":"2024-09-13T18:34:01.164952+0000","last_became_active":"2024-09-13T18:33:58.688315+0000","last_became_peered":"2024-09-13T18:33:58.688315+0000","last_unstale":"2024-09-13T18:34:01.164952+0000","last_undegraded":"2024-09-13T18:34:01.164952+0000","last_fullsized":"2024-09-13T18:34:01.164952+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:31.237970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167400+0000","last_change":"2024-09-13T18:33:58.680422+0000","last_active":"2024-09-13T18:34:01.167400+0000","last_peered":"2024-09-13T18:34:01.167400+0000","last_clean":"2024-09-13T18:34:01.167400+0000","last_became_active":"2024-09-13T18:33:58.680155+0000","last_became_peered":"2024-09-13T18:33:58.680155+0000","last_unstale":"2024-09-13T18:34:01.167400+0000","last_undegraded":"2024-09-13T18:34:01.167400+0000","last_fullsized":"2024-09-13T18:34:01.167400+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:33.898483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.653854+0000","last_change":"2024-09-13T18:33:58.667614+0000","last_active":"2024-09-13T18:33:59.653854+0000","last_peered":"2024-09-13T18:33:59.653854+0000","last_clean":"2024-09-13T18:33:59.653854+0000","last_became_active":"2024-09-13T18:33:58.663899+0000","last_became_peered":"2024-09-13T18:33:58.663899+0000","last_unstale":"2024-09-13T18:33:59.653854+0000","last_undegraded":"2024-09-13T18:33:59.653854+0000","last_fullsized":"2024-09-13T18:33:59.653854+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:16.559420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166070+0000","last_change":"2024-09-13T18:33:58.657339+0000","last_active":"2024-09-13T18:34:01.166070+0000","last_peered":"2024-09-13T18:34:01.166070+0000","last_clean":"2024-09-13T18:34:01.166070+0000","last_became_active":"2024-09-13T18:33:58.657055+0000","last_became_peered":"2024-09-13T18:33:58.657055+0000","last_unstale":"2024-09-13T18:34:01.166070+0000","last_undegraded":"2024-09-13T18:34:01.166070+0000","last_fullsized":"2024-09-13T18:34:01.166070+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:42.519688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165897+0000","last_change":"2024-09-13T18:33:58.703740+0000","last_active":"2024-09-13T18:34:01.165897+0000","last_peered":"2024-09-13T18:34:01.165897+0000","last_clean":"2024-09-13T18:34:01.165897+0000","last_became_active":"2024-09-13T18:33:58.703040+0000","last_became_peered":"2024-09-13T18:33:58.703040+0000","last_unstale":"2024-09-13T18:34:01.165897+0000","last_undegraded":"2024-09-13T18:34:01.165897+0000","last_fullsized":"2024-09-13T18:34:01.165897+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:31.989521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.650910+0000","last_change":"2024-09-13T18:33:58.668131+0000","last_active":"2024-09-13T18:33:59.650910+0000","last_peered":"2024-09-13T18:33:59.650910+0000","last_clean":"2024-09-13T18:33:59.650910+0000","last_became_active":"2024-09-13T18:33:58.667878+0000","last_became_peered":"2024-09-13T18:33:58.667878+0000","last_unstale":"2024-09-13T18:33:59.650910+0000","last_undegraded":"2024-09-13T18:33:59.650910+0000","last_fullsized":"2024-09-13T18:33:59.650910+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:56.970157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654415+0000","last_change":"2024-09-13T18:33:58.674238+0000","last_active":"2024-09-13T18:33:59.654415+0000","last_peered":"2024-09-13T18:33:59.654415+0000","last_clean":"2024-09-13T18:33:59.654415+0000","last_became_active":"2024-09-13T18:33:58.673528+0000","last_became_peered":"2024-09-13T18:33:58.673528+0000","last_unstale":"2024-09-13T18:33:59.654415+0000","last_undegraded":"2024-09-13T18:33:59.654415+0000","last_fullsized":"2024-09-13T18:33:59.654415+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:14.372397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064835+0000","last_change":"2024-09-13T18:33:58.694376+0000","last_active":"2024-09-13T18:34:00.064835+0000","last_peered":"2024-09-13T18:34:00.064835+0000","last_clean":"2024-09-13T18:34:00.064835+0000","last_became_active":"2024-09-13T18:33:58.693830+0000","last_became_peered":"2024-09-13T18:33:58.693830+0000","last_unstale":"2024-09-13T18:34:00.064835+0000","last_undegraded":"2024-09-13T18:34:00.064835+0000","last_fullsized":"2024-09-13T18:34:00.064835+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.542290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064547+0000","last_change":"2024-09-13T18:33:58.682943+0000","last_active":"2024-09-13T18:34:00.064547+0000","last_peered":"2024-09-13T18:34:00.064547+0000","last_clean":"2024-09-13T18:34:00.064547+0000","last_became_active":"2024-09-13T18:33:58.681789+0000","last_became_peered":"2024-09-13T18:33:58.681789+0000","last_unstale":"2024-09-13T18:34:00.064547+0000","last_undegraded":"2024-09-13T18:34:00.064547+0000","last_fullsized":"2024-09-13T18:34:00.064547+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.416413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165302+0000","last_change":"2024-09-13T18:33:58.697320+0000","last_active":"2024-09-13T18:34:01.165302+0000","last_peered":"2024-09-13T18:34:01.165302+0000","last_clean":"2024-09-13T18:34:01.165302+0000","last_became_active":"2024-09-13T18:33:58.689233+0000","last_became_peered":"2024-09-13T18:33:58.689233+0000","last_unstale":"2024-09-13T18:34:01.165302+0000","last_undegraded":"2024-09-13T18:34:01.165302+0000","last_fullsized":"2024-09-13T18:34:01.165302+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:22.174500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064905+0000","last_change":"2024-09-13T18:33:58.693418+0000","last_active":"2024-09-13T18:34:00.064905+0000","last_peered":"2024-09-13T18:34:00.064905+0000","last_clean":"2024-09-13T18:34:00.064905+0000","last_became_active":"2024-09-13T18:33:58.692975+0000","last_became_peered":"2024-09-13T18:33:58.692975+0000","last_unstale":"2024-09-13T18:34:00.064905+0000","last_undegraded":"2024-09-13T18:34:00.064905+0000","last_fullsized":"2024-09-13T18:34:00.064905+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:34.034744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166308+0000","last_change":"2024-09-13T18:33:58.688849+0000","last_active":"2024-09-13T18:34:01.166308+0000","last_peered":"2024-09-13T18:34:01.166308+0000","last_clean":"2024-09-13T18:34:01.166308+0000","last_became_active":"2024-09-13T18:33:58.688547+0000","last_became_peered":"2024-09-13T18:33:58.688547+0000","last_unstale":"2024-09-13T18:34:01.166308+0000","last_undegraded":"2024-09-13T18:34:01.166308+0000","last_fullsized":"2024-09-13T18:34:01.166308+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:13.352509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167719+0000","last_change":"2024-09-13T18:33:58.681402+0000","last_active":"2024-09-13T18:34:01.167719+0000","last_peered":"2024-09-13T18:34:01.167719+0000","last_clean":"2024-09-13T18:34:01.167719+0000","last_became_active":"2024-09-13T18:33:58.681062+0000","last_became_peered":"2024-09-13T18:33:58.681062+0000","last_unstale":"2024-09-13T18:34:01.167719+0000","last_undegraded":"2024-09-13T18:34:01.167719+0000","last_fullsized":"2024-09-13T18:34:01.167719+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:47.051217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.867757+0000","last_change":"2024-09-13T18:33:58.703328+0000","last_active":"2024-09-13T18:33:59.867757+0000","last_peered":"2024-09-13T18:33:59.867757+0000","last_clean":"2024-09-13T18:33:59.867757+0000","last_became_active":"2024-09-13T18:33:58.702834+0000","last_became_peered":"2024-09-13T18:33:58.702834+0000","last_unstale":"2024-09-13T18:33:59.867757+0000","last_undegraded":"2024-09-13T18:33:59.867757+0000","last_fullsized":"2024-09-13T18:33:59.867757+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:52.269197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651373+0000","last_change":"2024-09-13T18:33:58.704853+0000","last_active":"2024-09-13T18:33:59.651373+0000","last_peered":"2024-09-13T18:33:59.651373+0000","last_clean":"2024-09-13T18:33:59.651373+0000","last_became_active":"2024-09-13T18:33:58.704536+0000","last_became_peered":"2024-09-13T18:33:58.704536+0000","last_unstale":"2024-09-13T18:33:59.651373+0000","last_undegraded":"2024-09-13T18:33:59.651373+0000","last_fullsized":"2024-09-13T18:33:59.651373+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:43.617048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166105+0000","last_change":"2024-09-13T18:33:58.681211+0000","last_active":"2024-09-13T18:34:01.166105+0000","last_peered":"2024-09-13T18:34:01.166105+0000","last_clean":"2024-09-13T18:34:01.166105+0000","last_became_active":"2024-09-13T18:33:58.680896+0000","last_became_peered":"2024-09-13T18:33:58.680896+0000","last_unstale":"2024-09-13T18:34:01.166105+0000","last_undegraded":"2024-09-13T18:34:01.166105+0000","last_fullsized":"2024-09-13T18:34:01.166105+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:10.682110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165203+0000","last_change":"2024-09-13T18:33:58.688169+0000","last_active":"2024-09-13T18:34:01.165203+0000","last_peered":"2024-09-13T18:34:01.165203+0000","last_clean":"2024-09-13T18:34:01.165203+0000","last_became_active":"2024-09-13T18:33:58.687821+0000","last_became_peered":"2024-09-13T18:33:58.687821+0000","last_unstale":"2024-09-13T18:34:01.165203+0000","last_undegraded":"2024-09-13T18:34:01.165203+0000","last_fullsized":"2024-09-13T18:34:01.165203+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:31.636632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.650999+0000","last_change":"2024-09-13T18:33:58.669494+0000","last_active":"2024-09-13T18:33:59.650999+0000","last_peered":"2024-09-13T18:33:59.650999+0000","last_clean":"2024-09-13T18:33:59.650999+0000","last_became_active":"2024-09-13T18:33:58.669061+0000","last_became_peered":"2024-09-13T18:33:58.669061+0000","last_unstale":"2024-09-13T18:33:59.650999+0000","last_undegraded":"2024-09-13T18:33:59.650999+0000","last_fullsized":"2024-09-13T18:33:59.650999+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:24:09.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.164685+0000","last_change":"2024-09-13T18:33:58.664391+0000","last_active":"2024-09-13T18:34:01.164685+0000","last_peered":"2024-09-13T18:34:01.164685+0000","last_clean":"2024-09-13T18:34:01.164685+0000","last_became_active":"2024-09-13T18:33:58.664106+0000","last_became_peered":"2024-09-13T18:33:58.664106+0000","last_unstale":"2024-09-13T18:34:01.164685+0000","last_undegraded":"2024-09-13T18:34:01.164685+0000","last_fullsized":"2024-09-13T18:34:01.164685+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.416413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166542+0000","last_change":"2024-09-13T18:33:58.655339+0000","last_active":"2024-09-13T18:34:01.166542+0000","last_peered":"2024-09-13T18:34:01.166542+0000","last_clean":"2024-09-13T18:34:01.166542+0000","last_became_active":"2024-09-13T18:33:58.655079+0000","last_became_peered":"2024-09-13T18:33:58.655079+0000","last_unstale":"2024-09-13T18:34:01.166542+0000","last_undegraded":"2024-09-13T18:34:01.166542+0000","last_fullsized":"2024-09-13T18:34:01.166542+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:49.431047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.065258+0000","last_change":"2024-09-13T18:33:58.681736+0000","last_active":"2024-09-13T18:34:00.065258+0000","last_peered":"2024-09-13T18:34:00.065258+0000","last_clean":"2024-09-13T18:34:00.065258+0000","last_became_active":"2024-09-13T18:33:58.680958+0000","last_became_peered":"2024-09-13T18:33:58.680958+0000","last_unstale":"2024-09-13T18:34:00.065258+0000","last_undegraded":"2024-09-13T18:34:00.065258+0000","last_fullsized":"2024-09-13T18:34:00.065258+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:33.898483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654346+0000","last_change":"2024-09-13T18:33:58.665608+0000","last_active":"2024-09-13T18:33:59.654346+0000","last_peered":"2024-09-13T18:33:59.654346+0000","last_clean":"2024-09-13T18:33:59.654346+0000","last_became_active":"2024-09-13T18:33:58.664929+0000","last_became_peered":"2024-09-13T18:33:58.664929+0000","last_unstale":"2024-09-13T18:33:59.654346+0000","last_undegraded":"2024-09-13T18:33:59.654346+0000","last_fullsized":"2024-09-13T18:33:59.654346+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:30.542290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166320+0000","last_change":"2024-09-13T18:33:58.680465+0000","last_active":"2024-09-13T18:34:01.166320+0000","last_peered":"2024-09-13T18:34:01.166320+0000","last_clean":"2024-09-13T18:34:01.166320+0000","last_became_active":"2024-09-13T18:33:58.680105+0000","last_became_peered":"2024-09-13T18:33:58.680105+0000","last_unstale":"2024-09-13T18:34:01.166320+0000","last_undegraded":"2024-09-13T18:34:01.166320+0000","last_fullsized":"2024-09-13T18:34:01.166320+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:07.044563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166343+0000","last_change":"2024-09-13T18:33:58.665844+0000","last_active":"2024-09-13T18:34:01.166343+0000","last_peered":"2024-09-13T18:34:01.166343+0000","last_clean":"2024-09-13T18:34:01.166343+0000","last_became_active":"2024-09-13T18:33:58.665176+0000","last_became_peered":"2024-09-13T18:33:58.665176+0000","last_unstale":"2024-09-13T18:34:01.166343+0000","last_undegraded":"2024-09-13T18:34:01.166343+0000","last_fullsized":"2024-09-13T18:34:01.166343+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:03.143303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064650+0000","last_change":"2024-09-13T18:33:58.693621+0000","last_active":"2024-09-13T18:34:00.064650+0000","last_peered":"2024-09-13T18:34:00.064650+0000","last_clean":"2024-09-13T18:34:00.064650+0000","last_became_active":"2024-09-13T18:33:58.692862+0000","last_became_peered":"2024-09-13T18:33:58.692862+0000","last_unstale":"2024-09-13T18:34:00.064650+0000","last_undegraded":"2024-09-13T18:34:00.064650+0000","last_fullsized":"2024-09-13T18:34:00.064650+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:54.297494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165280+0000","last_change":"2024-09-13T18:33:58.701954+0000","last_active":"2024-09-13T18:34:01.165280+0000","last_peered":"2024-09-13T18:34:01.165280+0000","last_clean":"2024-09-13T18:34:01.165280+0000","last_became_active":"2024-09-13T18:33:58.696553+0000","last_became_peered":"2024-09-13T18:33:58.696553+0000","last_unstale":"2024-09-13T18:34:01.165280+0000","last_undegraded":"2024-09-13T18:34:01.165280+0000","last_fullsized":"2024-09-13T18:34:01.165280+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.416413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166580+0000","last_change":"2024-09-13T18:33:58.672416+0000","last_active":"2024-09-13T18:34:01.166580+0000","last_peered":"2024-09-13T18:34:01.166580+0000","last_clean":"2024-09-13T18:34:01.166580+0000","last_became_active":"2024-09-13T18:33:58.672126+0000","last_became_peered":"2024-09-13T18:33:58.672126+0000","last_unstale":"2024-09-13T18:34:01.166580+0000","last_undegraded":"2024-09-13T18:34:01.166580+0000","last_fullsized":"2024-09-13T18:34:01.166580+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:31.989521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165001+0000","last_change":"2024-09-13T18:33:58.671970+0000","last_active":"2024-09-13T18:34:01.165001+0000","last_peered":"2024-09-13T18:34:01.165001+0000","last_clean":"2024-09-13T18:34:01.165001+0000","last_became_active":"2024-09-13T18:33:58.671724+0000","last_became_peered":"2024-09-13T18:33:58.671724+0000","last_unstale":"2024-09-13T18:34:01.165001+0000","last_undegraded":"2024-09-13T18:34:01.165001+0000","last_fullsized":"2024-09-13T18:34:01.165001+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:53.828928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165407+0000","last_change":"2024-09-13T18:33:58.668967+0000","last_active":"2024-09-13T18:34:01.165407+0000","last_peered":"2024-09-13T18:34:01.165407+0000","last_clean":"2024-09-13T18:34:01.165407+0000","last_became_active":"2024-09-13T18:33:58.668709+0000","last_became_peered":"2024-09-13T18:33:58.668709+0000","last_unstale":"2024-09-13T18:34:01.165407+0000","last_undegraded":"2024-09-13T18:34:01.165407+0000","last_fullsized":"2024-09-13T18:34:01.165407+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:51.322025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"161'4","reported_seq":15,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.678510+0000","last_change":"2024-09-13T18:33:58.284121+0000","last_active":"2024-09-13T18:33:58.678510+0000","last_peered":"2024-09-13T18:33:58.678510+0000","last_clean":"2024-09-13T18:33:58.678510+0000","last_became_active":"2024-09-13T18:33:58.275062+0000","last_became_peered":"2024-09-13T18:33:58.275062+0000","last_unstale":"2024-09-13T18:33:58.678510+0000","last_undegraded":"2024-09-13T18:33:58.678510+0000","last_fullsized":"2024-09-13T18:33:58.678510+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:32.035961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.652476+0000","last_change":"2024-09-13T18:33:58.671884+0000","last_active":"2024-09-13T18:33:59.652476+0000","last_peered":"2024-09-13T18:33:59.652476+0000","last_clean":"2024-09-13T18:33:59.652476+0000","last_became_active":"2024-09-13T18:33:58.671596+0000","last_became_peered":"2024-09-13T18:33:58.671596+0000","last_unstale":"2024-09-13T18:33:59.652476+0000","last_undegraded":"2024-09-13T18:33:59.652476+0000","last_fullsized":"2024-09-13T18:33:59.652476+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:17.987715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.705138+0000","last_change":"2024-09-13T18:33:58.295647+0000","last_active":"2024-09-13T18:33:58.705138+0000","last_peered":"2024-09-13T18:33:58.705138+0000","last_clean":"2024-09-13T18:33:58.705138+0000","last_became_active":"2024-09-13T18:33:58.294942+0000","last_became_peered":"2024-09-13T18:33:58.294942+0000","last_unstale":"2024-09-13T18:33:58.705138+0000","last_undegraded":"2024-09-13T18:33:58.705138+0000","last_fullsized":"2024-09-13T18:33:58.705138+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654740+0000","last_change":"2024-09-13T18:33:58.658294+0000","last_active":"2024-09-13T18:33:59.654740+0000","last_peered":"2024-09-13T18:33:59.654740+0000","last_clean":"2024-09-13T18:33:59.654740+0000","last_became_active":"2024-09-13T18:33:58.657444+0000","last_became_peered":"2024-09-13T18:33:58.657444+0000","last_unstale":"2024-09-13T18:33:59.654740+0000","last_undegraded":"2024-09-13T18:33:59.654740+0000","last_fullsized":"2024-09-13T18:33:59.654740+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:07.081791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.670086+0000","last_change":"2024-09-13T18:33:58.285300+0000","last_active":"2024-09-13T18:33:58.670086+0000","last_peered":"2024-09-13T18:33:58.670086+0000","last_clean":"2024-09-13T18:33:58.670086+0000","last_became_active":"2024-09-13T18:33:58.279076+0000","last_became_peered":"2024-09-13T18:33:58.279076+0000","last_unstale":"2024-09-13T18:33:58.670086+0000","last_undegraded":"2024-09-13T18:33:58.670086+0000","last_fullsized":"2024-09-13T18:33:58.670086+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166051+0000","last_change":"2024-09-13T18:33:58.697066+0000","last_active":"2024-09-13T18:34:01.166051+0000","last_peered":"2024-09-13T18:34:01.166051+0000","last_clean":"2024-09-13T18:34:01.166051+0000","last_became_active":"2024-09-13T18:33:58.695441+0000","last_became_peered":"2024-09-13T18:33:58.695441+0000","last_unstale":"2024-09-13T18:34:01.166051+0000","last_undegraded":"2024-09-13T18:34:01.166051+0000","last_fullsized":"2024-09-13T18:34:01.166051+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:34.098992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.698353+0000","last_change":"2024-09-13T18:33:58.296866+0000","last_active":"2024-09-13T18:33:58.698353+0000","last_peered":"2024-09-13T18:33:58.698353+0000","last_clean":"2024-09-13T18:33:58.698353+0000","last_became_active":"2024-09-13T18:33:58.296249+0000","last_became_peered":"2024-09-13T18:33:58.296249+0000","last_unstale":"2024-09-13T18:33:58.698353+0000","last_undegraded":"2024-09-13T18:33:58.698353+0000","last_fullsized":"2024-09-13T18:33:58.698353+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651260+0000","last_change":"2024-09-13T18:33:58.669416+0000","last_active":"2024-09-13T18:33:59.651260+0000","last_peered":"2024-09-13T18:33:59.651260+0000","last_clean":"2024-09-13T18:33:59.651260+0000","last_became_active":"2024-09-13T18:33:58.669029+0000","last_became_peered":"2024-09-13T18:33:58.669029+0000","last_unstale":"2024-09-13T18:33:59.651260+0000","last_undegraded":"2024-09-13T18:33:59.651260+0000","last_fullsized":"2024-09-13T18:33:59.651260+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:27.114542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665161+0000","last_change":"2024-09-13T18:33:58.289753+0000","last_active":"2024-09-13T18:33:58.665161+0000","last_peered":"2024-09-13T18:33:58.665161+0000","last_clean":"2024-09-13T18:33:58.665161+0000","last_became_active":"2024-09-13T18:33:58.288502+0000","last_became_peered":"2024-09-13T18:33:58.288502+0000","last_unstale":"2024-09-13T18:33:58.665161+0000","last_undegraded":"2024-09-13T18:33:58.665161+0000","last_fullsized":"2024-09-13T18:33:58.665161+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:36.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167534+0000","last_change":"2024-09-13T18:33:58.671258+0000","last_active":"2024-09-13T18:34:01.167534+0000","last_peered":"2024-09-13T18:34:01.167534+0000","last_clean":"2024-09-13T18:34:01.167534+0000","last_became_active":"2024-09-13T18:33:58.671001+0000","last_became_peered":"2024-09-13T18:33:58.671001+0000","last_unstale":"2024-09-13T18:34:01.167534+0000","last_undegraded":"2024-09-13T18:34:01.167534+0000","last_fullsized":"2024-09-13T18:34:01.167534+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:33.155762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.664780+0000","last_change":"2024-09-13T18:33:58.278135+0000","last_active":"2024-09-13T18:33:58.664780+0000","last_peered":"2024-09-13T18:33:58.664780+0000","last_clean":"2024-09-13T18:33:58.664780+0000","last_became_active":"2024-09-13T18:33:58.277796+0000","last_became_peered":"2024-09-13T18:33:58.277796+0000","last_unstale":"2024-09-13T18:33:58.664780+0000","last_undegraded":"2024-09-13T18:33:58.664780+0000","last_fullsized":"2024-09-13T18:33:58.664780+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654024+0000","last_change":"2024-09-13T18:33:58.679586+0000","last_active":"2024-09-13T18:33:59.654024+0000","last_peered":"2024-09-13T18:33:59.654024+0000","last_clean":"2024-09-13T18:33:59.654024+0000","last_became_active":"2024-09-13T18:33:58.678929+0000","last_became_peered":"2024-09-13T18:33:58.678929+0000","last_unstale":"2024-09-13T18:33:59.654024+0000","last_undegraded":"2024-09-13T18:33:59.654024+0000","last_fullsized":"2024-09-13T18:33:59.654024+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:20.607872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665253+0000","last_change":"2024-09-13T18:33:58.287397+0000","last_active":"2024-09-13T18:33:58.665253+0000","last_peered":"2024-09-13T18:33:58.665253+0000","last_clean":"2024-09-13T18:33:58.665253+0000","last_became_active":"2024-09-13T18:33:58.286704+0000","last_became_peered":"2024-09-13T18:33:58.286704+0000","last_unstale":"2024-09-13T18:33:58.665253+0000","last_undegraded":"2024-09-13T18:33:58.665253+0000","last_fullsized":"2024-09-13T18:33:58.665253+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:19.596557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.167071+0000","last_change":"2024-09-13T18:33:58.665624+0000","last_active":"2024-09-13T18:34:01.167071+0000","last_peered":"2024-09-13T18:34:01.167071+0000","last_clean":"2024-09-13T18:34:01.167071+0000","last_became_active":"2024-09-13T18:33:58.665375+0000","last_became_peered":"2024-09-13T18:33:58.665375+0000","last_unstale":"2024-09-13T18:34:01.167071+0000","last_undegraded":"2024-09-13T18:34:01.167071+0000","last_fullsized":"2024-09-13T18:34:01.167071+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:34.098992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.655947+0000","last_change":"2024-09-13T18:33:58.284398+0000","last_active":"2024-09-13T18:33:58.655947+0000","last_peered":"2024-09-13T18:33:58.655947+0000","last_clean":"2024-09-13T18:33:58.655947+0000","last_became_active":"2024-09-13T18:33:58.283698+0000","last_became_peered":"2024-09-13T18:33:58.283698+0000","last_unstale":"2024-09-13T18:33:58.655947+0000","last_undegraded":"2024-09-13T18:33:58.655947+0000","last_fullsized":"2024-09-13T18:33:58.655947+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:47.405098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165082+0000","last_change":"2024-09-13T18:33:58.664442+0000","last_active":"2024-09-13T18:34:01.165082+0000","last_peered":"2024-09-13T18:34:01.165082+0000","last_clean":"2024-09-13T18:34:01.165082+0000","last_became_active":"2024-09-13T18:33:58.664196+0000","last_became_peered":"2024-09-13T18:33:58.664196+0000","last_unstale":"2024-09-13T18:34:01.165082+0000","last_undegraded":"2024-09-13T18:34:01.165082+0000","last_fullsized":"2024-09-13T18:34:01.165082+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:57.499505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.652650+0000","last_change":"2024-09-13T18:33:58.293164+0000","last_active":"2024-09-13T18:33:58.652650+0000","last_peered":"2024-09-13T18:33:58.652650+0000","last_clean":"2024-09-13T18:33:58.652650+0000","last_became_active":"2024-09-13T18:33:58.291115+0000","last_became_peered":"2024-09-13T18:33:58.291115+0000","last_unstale":"2024-09-13T18:33:58.652650+0000","last_undegraded":"2024-09-13T18:33:58.652650+0000","last_fullsized":"2024-09-13T18:33:58.652650+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:19.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654965+0000","last_change":"2024-09-13T18:33:58.703258+0000","last_active":"2024-09-13T18:33:59.654965+0000","last_peered":"2024-09-13T18:33:59.654965+0000","last_clean":"2024-09-13T18:33:59.654965+0000","last_became_active":"2024-09-13T18:33:58.702366+0000","last_became_peered":"2024-09-13T18:33:58.702366+0000","last_unstale":"2024-09-13T18:33:59.654965+0000","last_undegraded":"2024-09-13T18:33:59.654965+0000","last_fullsized":"2024-09-13T18:33:59.654965+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:14.586017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"161'3","reported_seq":14,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665519+0000","last_change":"2024-09-13T18:33:58.270397+0000","last_active":"2024-09-13T18:33:58.665519+0000","last_peered":"2024-09-13T18:33:58.665519+0000","last_clean":"2024-09-13T18:33:58.665519+0000","last_became_active":"2024-09-13T18:33:58.270025+0000","last_became_peered":"2024-09-13T18:33:58.270025+0000","last_unstale":"2024-09-13T18:33:58.665519+0000","last_undegraded":"2024-09-13T18:33:58.665519+0000","last_fullsized":"2024-09-13T18:33:58.665519+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:24.221112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651604+0000","last_change":"2024-09-13T18:33:58.667849+0000","last_active":"2024-09-13T18:33:59.651604+0000","last_peered":"2024-09-13T18:33:59.651604+0000","last_clean":"2024-09-13T18:33:59.651604+0000","last_became_active":"2024-09-13T18:33:58.666181+0000","last_became_peered":"2024-09-13T18:33:58.666181+0000","last_unstale":"2024-09-13T18:33:59.651604+0000","last_undegraded":"2024-09-13T18:33:59.651604+0000","last_fullsized":"2024-09-13T18:33:59.651604+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:15.917112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"161'6","reported_seq":17,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.687874+0000","last_change":"2024-09-13T18:33:58.278091+0000","last_active":"2024-09-13T18:33:58.687874+0000","last_peered":"2024-09-13T18:33:58.687874+0000","last_clean":"2024-09-13T18:33:58.687874+0000","last_became_active":"2024-09-13T18:33:58.277399+0000","last_became_peered":"2024-09-13T18:33:58.277399+0000","last_unstale":"2024-09-13T18:33:58.687874+0000","last_undegraded":"2024-09-13T18:33:58.687874+0000","last_fullsized":"2024-09-13T18:33:58.687874+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165939+0000","last_change":"2024-09-13T18:33:58.664385+0000","last_active":"2024-09-13T18:34:01.165939+0000","last_peered":"2024-09-13T18:34:01.165939+0000","last_clean":"2024-09-13T18:34:01.165939+0000","last_became_active":"2024-09-13T18:33:58.664117+0000","last_became_peered":"2024-09-13T18:33:58.664117+0000","last_unstale":"2024-09-13T18:34:01.165939+0000","last_undegraded":"2024-09-13T18:34:01.165939+0000","last_fullsized":"2024-09-13T18:34:01.165939+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:51.032671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.689060+0000","last_change":"2024-09-13T18:33:58.292193+0000","last_active":"2024-09-13T18:33:58.689060+0000","last_peered":"2024-09-13T18:33:58.689060+0000","last_clean":"2024-09-13T18:33:58.689060+0000","last_became_active":"2024-09-13T18:33:58.291422+0000","last_became_peered":"2024-09-13T18:33:58.291422+0000","last_unstale":"2024-09-13T18:33:58.689060+0000","last_undegraded":"2024-09-13T18:33:58.689060+0000","last_fullsized":"2024-09-13T18:33:58.689060+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:06.070476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654150+0000","last_change":"2024-09-13T18:33:58.664589+0000","last_active":"2024-09-13T18:33:59.654150+0000","last_peered":"2024-09-13T18:33:59.654150+0000","last_clean":"2024-09-13T18:33:59.654150+0000","last_became_active":"2024-09-13T18:33:58.663635+0000","last_became_peered":"2024-09-13T18:33:58.663635+0000","last_unstale":"2024-09-13T18:33:59.654150+0000","last_undegraded":"2024-09-13T18:33:59.654150+0000","last_fullsized":"2024-09-13T18:33:59.654150+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:41.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.666164+0000","last_change":"2024-09-13T18:33:58.272096+0000","last_active":"2024-09-13T18:33:58.666164+0000","last_peered":"2024-09-13T18:33:58.666164+0000","last_clean":"2024-09-13T18:33:58.666164+0000","last_became_active":"2024-09-13T18:33:58.271808+0000","last_became_peered":"2024-09-13T18:33:58.271808+0000","last_unstale":"2024-09-13T18:33:58.666164+0000","last_undegraded":"2024-09-13T18:33:58.666164+0000","last_fullsized":"2024-09-13T18:33:58.666164+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.296108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165252+0000","last_change":"2024-09-13T18:33:58.694839+0000","last_active":"2024-09-13T18:34:01.165252+0000","last_peered":"2024-09-13T18:34:01.165252+0000","last_clean":"2024-09-13T18:34:01.165252+0000","last_became_active":"2024-09-13T18:33:58.688952+0000","last_became_peered":"2024-09-13T18:33:58.688952+0000","last_unstale":"2024-09-13T18:34:01.165252+0000","last_undegraded":"2024-09-13T18:34:01.165252+0000","last_fullsized":"2024-09-13T18:34:01.165252+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:51.032671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.647927+0000","last_change":"2024-09-13T18:33:58.291518+0000","last_active":"2024-09-13T18:33:58.647927+0000","last_peered":"2024-09-13T18:33:58.647927+0000","last_clean":"2024-09-13T18:33:58.647927+0000","last_became_active":"2024-09-13T18:33:58.291208+0000","last_became_peered":"2024-09-13T18:33:58.291208+0000","last_unstale":"2024-09-13T18:33:58.647927+0000","last_undegraded":"2024-09-13T18:33:58.647927+0000","last_fullsized":"2024-09-13T18:33:58.647927+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:40.901722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651016+0000","last_change":"2024-09-13T18:33:58.674083+0000","last_active":"2024-09-13T18:33:59.651016+0000","last_peered":"2024-09-13T18:33:59.651016+0000","last_clean":"2024-09-13T18:33:59.651016+0000","last_became_active":"2024-09-13T18:33:58.673861+0000","last_became_peered":"2024-09-13T18:33:58.673861+0000","last_unstale":"2024-09-13T18:33:59.651016+0000","last_undegraded":"2024-09-13T18:33:59.651016+0000","last_fullsized":"2024-09-13T18:33:59.651016+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:42.519688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"161'8","reported_seq":19,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.693755+0000","last_change":"2024-09-13T18:33:58.293820+0000","last_active":"2024-09-13T18:33:58.693755+0000","last_peered":"2024-09-13T18:33:58.693755+0000","last_clean":"2024-09-13T18:33:58.693755+0000","last_became_active":"2024-09-13T18:33:58.293138+0000","last_became_peered":"2024-09-13T18:33:58.293138+0000","last_unstale":"2024-09-13T18:33:58.693755+0000","last_undegraded":"2024-09-13T18:33:58.693755+0000","last_fullsized":"2024-09-13T18:33:58.693755+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:47.459960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.652053+0000","last_change":"2024-09-13T18:33:58.676465+0000","last_active":"2024-09-13T18:33:59.652053+0000","last_peered":"2024-09-13T18:33:59.652053+0000","last_clean":"2024-09-13T18:33:59.652053+0000","last_became_active":"2024-09-13T18:33:58.676157+0000","last_became_peered":"2024-09-13T18:33:58.676157+0000","last_unstale":"2024-09-13T18:33:59.652053+0000","last_undegraded":"2024-09-13T18:33:59.652053+0000","last_fullsized":"2024-09-13T18:33:59.652053+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:13.352509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.672557+0000","last_change":"2024-09-13T18:33:58.289330+0000","last_active":"2024-09-13T18:33:58.672557+0000","last_peered":"2024-09-13T18:33:58.672557+0000","last_clean":"2024-09-13T18:33:58.672557+0000","last_became_active":"2024-09-13T18:33:58.288827+0000","last_became_peered":"2024-09-13T18:33:58.288827+0000","last_unstale":"2024-09-13T18:33:58.672557+0000","last_undegraded":"2024-09-13T18:33:58.672557+0000","last_fullsized":"2024-09-13T18:33:58.672557+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:40.804040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166019+0000","last_change":"2024-09-13T18:33:58.694815+0000","last_active":"2024-09-13T18:34:01.166019+0000","last_peered":"2024-09-13T18:34:01.166019+0000","last_clean":"2024-09-13T18:34:01.166019+0000","last_became_active":"2024-09-13T18:33:58.688047+0000","last_became_peered":"2024-09-13T18:33:58.688047+0000","last_unstale":"2024-09-13T18:34:01.166019+0000","last_undegraded":"2024-09-13T18:34:01.166019+0000","last_fullsized":"2024-09-13T18:34:01.166019+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:27.518791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.679620+0000","last_change":"2024-09-13T18:33:58.276022+0000","last_active":"2024-09-13T18:33:58.679620+0000","last_peered":"2024-09-13T18:33:58.679620+0000","last_clean":"2024-09-13T18:33:58.679620+0000","last_became_active":"2024-09-13T18:33:58.275726+0000","last_became_peered":"2024-09-13T18:33:58.275726+0000","last_unstale":"2024-09-13T18:33:58.679620+0000","last_undegraded":"2024-09-13T18:33:58.679620+0000","last_fullsized":"2024-09-13T18:33:58.679620+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:15.548105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165753+0000","last_change":"2024-09-13T18:33:58.701192+0000","last_active":"2024-09-13T18:34:01.165753+0000","last_peered":"2024-09-13T18:34:01.165753+0000","last_clean":"2024-09-13T18:34:01.165753+0000","last_became_active":"2024-09-13T18:33:58.695825+0000","last_became_peered":"2024-09-13T18:33:58.695825+0000","last_unstale":"2024-09-13T18:34:01.165753+0000","last_undegraded":"2024-09-13T18:34:01.165753+0000","last_fullsized":"2024-09-13T18:34:01.165753+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:33.898483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.688655+0000","last_change":"2024-09-13T18:33:58.290557+0000","last_active":"2024-09-13T18:33:58.688655+0000","last_peered":"2024-09-13T18:33:58.688655+0000","last_clean":"2024-09-13T18:33:58.688655+0000","last_became_active":"2024-09-13T18:33:58.289847+0000","last_became_peered":"2024-09-13T18:33:58.289847+0000","last_unstale":"2024-09-13T18:33:58.688655+0000","last_undegraded":"2024-09-13T18:33:58.688655+0000","last_fullsized":"2024-09-13T18:33:58.688655+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:03.791063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064792+0000","last_change":"2024-09-13T18:33:58.684507+0000","last_active":"2024-09-13T18:34:00.064792+0000","last_peered":"2024-09-13T18:34:00.064792+0000","last_clean":"2024-09-13T18:34:00.064792+0000","last_became_active":"2024-09-13T18:33:58.683723+0000","last_became_peered":"2024-09-13T18:33:58.683723+0000","last_unstale":"2024-09-13T18:34:00.064792+0000","last_undegraded":"2024-09-13T18:34:00.064792+0000","last_fullsized":"2024-09-13T18:34:00.064792+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:51.032671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.654987+0000","last_change":"2024-09-13T18:33:58.289101+0000","last_active":"2024-09-13T18:33:58.654987+0000","last_peered":"2024-09-13T18:33:58.654987+0000","last_clean":"2024-09-13T18:33:58.654987+0000","last_became_active":"2024-09-13T18:33:58.287584+0000","last_became_peered":"2024-09-13T18:33:58.287584+0000","last_unstale":"2024-09-13T18:33:58.654987+0000","last_undegraded":"2024-09-13T18:33:58.654987+0000","last_fullsized":"2024-09-13T18:33:58.654987+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:26.507476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.651451+0000","last_change":"2024-09-13T18:33:58.669585+0000","last_active":"2024-09-13T18:33:59.651451+0000","last_peered":"2024-09-13T18:33:59.651451+0000","last_clean":"2024-09-13T18:33:59.651451+0000","last_became_active":"2024-09-13T18:33:58.669350+0000","last_became_peered":"2024-09-13T18:33:58.669350+0000","last_unstale":"2024-09-13T18:33:59.651451+0000","last_undegraded":"2024-09-13T18:33:59.651451+0000","last_fullsized":"2024-09-13T18:33:59.651451+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:06.146160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.666560+0000","last_change":"2024-09-13T18:33:58.277427+0000","last_active":"2024-09-13T18:33:58.666560+0000","last_peered":"2024-09-13T18:33:58.666560+0000","last_clean":"2024-09-13T18:33:58.666560+0000","last_became_active":"2024-09-13T18:33:58.277146+0000","last_became_peered":"2024-09-13T18:33:58.277146+0000","last_unstale":"2024-09-13T18:33:58.666560+0000","last_undegraded":"2024-09-13T18:33:58.666560+0000","last_fullsized":"2024-09-13T18:33:58.666560+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:30.625317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.654178+0000","last_change":"2024-09-13T18:33:58.662427+0000","last_active":"2024-09-13T18:33:59.654178+0000","last_peered":"2024-09-13T18:33:59.654178+0000","last_clean":"2024-09-13T18:33:59.654178+0000","last_became_active":"2024-09-13T18:33:58.661710+0000","last_became_peered":"2024-09-13T18:33:58.661710+0000","last_unstale":"2024-09-13T18:33:59.654178+0000","last_undegraded":"2024-09-13T18:33:59.654178+0000","last_fullsized":"2024-09-13T18:33:59.654178+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:04.802378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.652153+0000","last_change":"2024-09-13T18:33:58.293498+0000","last_active":"2024-09-13T18:33:58.652153+0000","last_peered":"2024-09-13T18:33:58.652153+0000","last_clean":"2024-09-13T18:33:58.652153+0000","last_became_active":"2024-09-13T18:33:58.293110+0000","last_became_peered":"2024-09-13T18:33:58.293110+0000","last_unstale":"2024-09-13T18:33:58.652153+0000","last_undegraded":"2024-09-13T18:33:58.652153+0000","last_fullsized":"2024-09-13T18:33:58.652153+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:19.538884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064248+0000","last_change":"2024-09-13T18:33:58.699146+0000","last_active":"2024-09-13T18:34:00.064248+0000","last_peered":"2024-09-13T18:34:00.064248+0000","last_clean":"2024-09-13T18:34:00.064248+0000","last_became_active":"2024-09-13T18:33:58.697950+0000","last_became_peered":"2024-09-13T18:33:58.697950+0000","last_unstale":"2024-09-13T18:34:00.064248+0000","last_undegraded":"2024-09-13T18:34:00.064248+0000","last_fullsized":"2024-09-13T18:34:00.064248+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:08.703513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.653724+0000","last_change":"2024-09-13T18:33:58.278050+0000","last_active":"2024-09-13T18:33:58.653724+0000","last_peered":"2024-09-13T18:33:58.653724+0000","last_clean":"2024-09-13T18:33:58.653724+0000","last_became_active":"2024-09-13T18:33:58.277708+0000","last_became_peered":"2024-09-13T18:33:58.277708+0000","last_unstale":"2024-09-13T18:33:58.653724+0000","last_undegraded":"2024-09-13T18:33:58.653724+0000","last_fullsized":"2024-09-13T18:33:58.653724+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.164991+0000","last_change":"2024-09-13T18:33:58.656133+0000","last_active":"2024-09-13T18:34:01.164991+0000","last_peered":"2024-09-13T18:34:01.164991+0000","last_clean":"2024-09-13T18:34:01.164991+0000","last_became_active":"2024-09-13T18:33:58.655876+0000","last_became_peered":"2024-09-13T18:33:58.655876+0000","last_unstale":"2024-09-13T18:34:01.164991+0000","last_undegraded":"2024-09-13T18:34:01.164991+0000","last_fullsized":"2024-09-13T18:34:01.164991+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:19.624626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.695273+0000","last_change":"2024-09-13T18:33:58.294980+0000","last_active":"2024-09-13T18:33:58.695273+0000","last_peered":"2024-09-13T18:33:58.695273+0000","last_clean":"2024-09-13T18:33:58.695273+0000","last_became_active":"2024-09-13T18:33:58.294069+0000","last_became_peered":"2024-09-13T18:33:58.294069+0000","last_unstale":"2024-09-13T18:33:58.695273+0000","last_undegraded":"2024-09-13T18:33:58.695273+0000","last_fullsized":"2024-09-13T18:33:58.695273+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:57.017271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165441+0000","last_change":"2024-09-13T18:33:58.665839+0000","last_active":"2024-09-13T18:34:01.165441+0000","last_peered":"2024-09-13T18:34:01.165441+0000","last_clean":"2024-09-13T18:34:01.165441+0000","last_became_active":"2024-09-13T18:33:58.665553+0000","last_became_peered":"2024-09-13T18:33:58.665553+0000","last_unstale":"2024-09-13T18:34:01.165441+0000","last_undegraded":"2024-09-13T18:34:01.165441+0000","last_fullsized":"2024-09-13T18:34:01.165441+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:04.158107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"161'2","reported_seq":13,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.682922+0000","last_change":"2024-09-13T18:33:58.298315+0000","last_active":"2024-09-13T18:33:58.682922+0000","last_peered":"2024-09-13T18:33:58.682922+0000","last_clean":"2024-09-13T18:33:58.682922+0000","last_became_active":"2024-09-13T18:33:58.297612+0000","last_became_peered":"2024-09-13T18:33:58.297612+0000","last_unstale":"2024-09-13T18:33:58.682922+0000","last_undegraded":"2024-09-13T18:33:58.682922+0000","last_fullsized":"2024-09-13T18:33:58.682922+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:41.543952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.652171+0000","last_change":"2024-09-13T18:33:58.677117+0000","last_active":"2024-09-13T18:33:59.652171+0000","last_peered":"2024-09-13T18:33:59.652171+0000","last_clean":"2024-09-13T18:33:59.652171+0000","last_became_active":"2024-09-13T18:33:58.676855+0000","last_became_peered":"2024-09-13T18:33:58.676855+0000","last_unstale":"2024-09-13T18:33:59.652171+0000","last_undegraded":"2024-09-13T18:33:59.652171+0000","last_fullsized":"2024-09-13T18:33:59.652171+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:38:57.499505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"161'1","reported_seq":12,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.183165+0000","last_change":"2024-09-13T18:33:58.279582+0000","last_active":"2024-09-13T18:33:59.183165+0000","last_peered":"2024-09-13T18:33:59.183165+0000","last_clean":"2024-09-13T18:33:59.183165+0000","last_became_active":"2024-09-13T18:33:58.279166+0000","last_became_peered":"2024-09-13T18:33:58.279166+0000","last_unstale":"2024-09-13T18:33:59.183165+0000","last_undegraded":"2024-09-13T18:33:59.183165+0000","last_fullsized":"2024-09-13T18:33:59.183165+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:13.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165854+0000","last_change":"2024-09-13T18:33:58.657029+0000","last_active":"2024-09-13T18:34:01.165854+0000","last_peered":"2024-09-13T18:34:01.165854+0000","last_clean":"2024-09-13T18:34:01.165854+0000","last_became_active":"2024-09-13T18:33:58.656682+0000","last_became_peered":"2024-09-13T18:33:58.656682+0000","last_unstale":"2024-09-13T18:34:01.165854+0000","last_undegraded":"2024-09-13T18:34:01.165854+0000","last_fullsized":"2024-09-13T18:34:01.165854+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:04.709060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.667787+0000","last_change":"2024-09-13T18:33:58.286163+0000","last_active":"2024-09-13T18:33:58.667787+0000","last_peered":"2024-09-13T18:33:58.667787+0000","last_clean":"2024-09-13T18:33:58.667787+0000","last_became_active":"2024-09-13T18:33:58.285914+0000","last_became_peered":"2024-09-13T18:33:58.285914+0000","last_unstale":"2024-09-13T18:33:58.667787+0000","last_undegraded":"2024-09-13T18:33:58.667787+0000","last_fullsized":"2024-09-13T18:33:58.667787+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:11.134787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.166736+0000","last_change":"2024-09-13T18:33:58.701340+0000","last_active":"2024-09-13T18:34:01.166736+0000","last_peered":"2024-09-13T18:34:01.166736+0000","last_clean":"2024-09-13T18:34:01.166736+0000","last_became_active":"2024-09-13T18:33:58.701065+0000","last_became_peered":"2024-09-13T18:33:58.701065+0000","last_unstale":"2024-09-13T18:34:01.166736+0000","last_undegraded":"2024-09-13T18:34:01.166736+0000","last_fullsized":"2024-09-13T18:34:01.166736+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.605214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.648663+0000","last_change":"2024-09-13T18:33:58.274092+0000","last_active":"2024-09-13T18:33:58.648663+0000","last_peered":"2024-09-13T18:33:58.648663+0000","last_clean":"2024-09-13T18:33:58.648663+0000","last_became_active":"2024-09-13T18:33:58.273806+0000","last_became_peered":"2024-09-13T18:33:58.273806+0000","last_unstale":"2024-09-13T18:33:58.648663+0000","last_undegraded":"2024-09-13T18:33:58.648663+0000","last_fullsized":"2024-09-13T18:33:58.648663+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.574702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.867713+0000","last_change":"2024-09-13T18:33:58.687765+0000","last_active":"2024-09-13T18:33:59.867713+0000","last_peered":"2024-09-13T18:33:59.867713+0000","last_clean":"2024-09-13T18:33:59.867713+0000","last_became_active":"2024-09-13T18:33:58.687017+0000","last_became_peered":"2024-09-13T18:33:58.687017+0000","last_unstale":"2024-09-13T18:33:59.867713+0000","last_undegraded":"2024-09-13T18:33:59.867713+0000","last_fullsized":"2024-09-13T18:33:59.867713+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:36.689802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.696728+0000","last_change":"2024-09-13T18:33:58.282999+0000","last_active":"2024-09-13T18:33:58.696728+0000","last_peered":"2024-09-13T18:33:58.696728+0000","last_clean":"2024-09-13T18:33:58.696728+0000","last_became_active":"2024-09-13T18:33:58.282305+0000","last_became_peered":"2024-09-13T18:33:58.282305+0000","last_unstale":"2024-09-13T18:33:58.696728+0000","last_undegraded":"2024-09-13T18:33:58.696728+0000","last_fullsized":"2024-09-13T18:33:58.696728+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:06.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.867936+0000","last_change":"2024-09-13T18:33:58.682843+0000","last_active":"2024-09-13T18:33:59.867936+0000","last_peered":"2024-09-13T18:33:59.867936+0000","last_clean":"2024-09-13T18:33:59.867936+0000","last_became_active":"2024-09-13T18:33:58.682125+0000","last_became_peered":"2024-09-13T18:33:58.682125+0000","last_unstale":"2024-09-13T18:33:59.867936+0000","last_undegraded":"2024-09-13T18:33:59.867936+0000","last_fullsized":"2024-09-13T18:33:59.867936+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:19.273453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.695630+0000","last_change":"2024-09-13T18:33:58.281968+0000","last_active":"2024-09-13T18:33:58.695630+0000","last_peered":"2024-09-13T18:33:58.695630+0000","last_clean":"2024-09-13T18:33:58.695630+0000","last_became_active":"2024-09-13T18:33:58.280874+0000","last_became_peered":"2024-09-13T18:33:58.280874+0000","last_unstale":"2024-09-13T18:33:58.695630+0000","last_undegraded":"2024-09-13T18:33:58.695630+0000","last_fullsized":"2024-09-13T18:33:58.695630+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:00.064506+0000","last_change":"2024-09-13T18:33:58.673313+0000","last_active":"2024-09-13T18:34:00.064506+0000","last_peered":"2024-09-13T18:34:00.064506+0000","last_clean":"2024-09-13T18:34:00.064506+0000","last_became_active":"2024-09-13T18:33:58.672652+0000","last_became_peered":"2024-09-13T18:33:58.672652+0000","last_unstale":"2024-09-13T18:34:00.064506+0000","last_undegraded":"2024-09-13T18:34:00.064506+0000","last_fullsized":"2024-09-13T18:34:00.064506+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:07.044563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665786+0000","last_change":"2024-09-13T18:33:58.294855+0000","last_active":"2024-09-13T18:33:58.665786+0000","last_peered":"2024-09-13T18:33:58.665786+0000","last_clean":"2024-09-13T18:33:58.665786+0000","last_became_active":"2024-09-13T18:33:58.294167+0000","last_became_peered":"2024-09-13T18:33:58.294167+0000","last_unstale":"2024-09-13T18:33:58.665786+0000","last_undegraded":"2024-09-13T18:33:58.665786+0000","last_fullsized":"2024-09-13T18:33:58.665786+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:37:18.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:34:01.165280+0000","last_change":"2024-09-13T18:33:58.681124+0000","last_active":"2024-09-13T18:34:01.165280+0000","last_peered":"2024-09-13T18:34:01.165280+0000","last_clean":"2024-09-13T18:34:01.165280+0000","last_became_active":"2024-09-13T18:33:58.680833+0000","last_became_peered":"2024-09-13T18:33:58.680833+0000","last_unstale":"2024-09-13T18:34:01.165280+0000","last_undegraded":"2024-09-13T18:34:01.165280+0000","last_fullsized":"2024-09-13T18:34:01.165280+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:17.566641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.653581+0000","last_change":"2024-09-13T18:33:58.279050+0000","last_active":"2024-09-13T18:33:58.653581+0000","last_peered":"2024-09-13T18:33:58.653581+0000","last_clean":"2024-09-13T18:33:58.653581+0000","last_became_active":"2024-09-13T18:33:58.278575+0000","last_became_peered":"2024-09-13T18:33:58.278575+0000","last_unstale":"2024-09-13T18:33:58.653581+0000","last_undegraded":"2024-09-13T18:33:58.653581+0000","last_fullsized":"2024-09-13T18:33:58.653581+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:52.817613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-13T18:33:59.650593+0000","last_change":"2024-09-13T18:33:58.683185+0000","last_active":"2024-09-13T18:33:59.650593+0000","last_peered":"2024-09-13T18:33:59.650593+0000","last_clean":"2024-09-13T18:33:59.650593+0000","last_became_active":"2024-09-13T18:33:58.682800+0000","last_became_peered":"2024-09-13T18:33:58.682800+0000","last_unstale":"2024-09-13T18:33:59.650593+0000","last_undegraded":"2024-09-13T18:33:59.650593+0000","last_fullsized":"2024-09-13T18:33:59.650593+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:58.242226+0000","last_clean_scrub_stamp":"2024-09-13T18:33:58.242226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:11.427563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665734+0000","last_change":"2024-09-13T18:33:58.300578+0000","last_active":"2024-09-13T18:33:58.665734+0000","last_peered":"2024-09-13T18:33:58.665734+0000","last_clean":"2024-09-13T18:33:58.665734+0000","last_became_active":"2024-09-13T18:33:58.299788+0000","last_became_peered":"2024-09-13T18:33:58.299788+0000","last_unstale":"2024-09-13T18:33:58.665734+0000","last_undegraded":"2024-09-13T18:33:58.665734+0000","last_fullsized":"2024-09-13T18:33:58.665734+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:33:57.230911+0000","last_clean_scrub_stamp":"2024-09-13T18:33:57.230911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:29.530975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":322,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-13T18:33:58.665945+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:33:58.665945+0000","last_peered":"2024-09-13T18:33:58.665945+0000","last_clean":"2024-09-13T18:33:58.665945+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:33:58.665945+0000","last_undegraded":"2024-09-13T18:33:58.665945+0000","last_fullsized":"2024-09-13T18:33:58.665945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33704,"kb_used_data":2580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338136,"statfs":{"total":96636764160,"available":96602251264,"internally_reserved":0,"allocated":2641920,"data_stored":1493315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.2050000000000001,"5min":1.3080000000000001,"15min":1.6439999999999999},"last":1.399},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.93300000000000005,"15min":0.90000000000000002},"min":{"1min":0.57499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1850000000000001,"5min":1.333,"15min":1.4410000000000001},"last":1.042}]},{"osd":1,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.49099999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.218,"5min":1.4179999999999999,"15min":1.7270000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.95599999999999996,"15min":0.93200000000000005},"min":{"1min":0.54400000000000004,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.2490000000000001,"5min":1.4890000000000001,"15min":1.6060000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80900000000000005,"15min":0.80400000000000005},"min":{"1min":0.53700000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.99099999999999999,"5min":1.276,"15min":1.276},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.165,"5min":1.5309999999999999,"15min":1.9830000000000001},"last":1.129}]},{"osd":3,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.624,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1339999999999999,"5min":1.349,"15min":1.448},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.238,"5min":1.395,"15min":1.397},"last":1.333}]},{"osd":4,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.873,"15min":0.88800000000000001},"min":{"1min":0.68300000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.218,"5min":1.2809999999999999,"15min":1.3620000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92400000000000004,"15min":0.93999999999999995},"min":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.92400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95499999999999996,"15min":1.022},"min":{"1min":0.58099999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.877},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.70299999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.351,"5min":1.409,"15min":1.409},"last":0.876}]},{"osd":6,"last update":"Fri Sep 13 18:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.85499999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":1.476,"15min":1.476},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.02,"15min":1.006},"min":{"1min":0.65000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2689999999999999,"5min":1.361,"15min":1.506},"last":0.996}]}]},{"osd":6,"up_from":13,"seq":55834574963,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2039808,"data_stored":902843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81100000000000005,"15min":0.82699999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.0820000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":1.1779999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92100000000000004,"15min":0.89700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.3480000000000001,"15min":1.577},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":0.91600000000000004},"min":{"1min":0.71899999999999997,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.069,"5min":1.218,"15min":1.464},"last":0.86899999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.113,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.026},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91600000000000004,"15min":0.95799999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.319,"5min":1.673,"15min":2.4220000000000002},"last":1.147}]},{"osd":3,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90000000000000002,"15min":0.88500000000000001},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.516,"15min":1.516},"last":1.28},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.61899999999999999,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.2669999999999999,"15min":1.306},"last":0.75600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.94399999999999995,"15min":0.97099999999999997},"min":{"1min":0.72799999999999998,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.2350000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.054,"5min":1.0449999999999999,"15min":1.014},"min":{"1min":0.79200000000000004,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.2589999999999999,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.103}]},{"osd":5,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.69399999999999995,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.01,"5min":1.024,"15min":1.0800000000000001},"min":{"1min":0.67200000000000004,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":2.762},"last":1.371}]},{"osd":7,"last update":"Fri Sep 13 18:33:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.0369999999999999},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.22,"5min":1.5,"15min":1.9299999999999999},"last":1.389},{"interface":"front","average":{"1min":1.024,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.2470000000000001,"5min":1.357,"15min":1.72},"last":1.3300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2039808,"data_stored":902843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":0.83899999999999997},"min":{"1min":0.47899999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.83199999999999996,"15min":0.88700000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.437},"max":{"1min":1.089,"5min":1.264,"15min":2.1840000000000002},"last":1.105}]},{"osd":1,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86199999999999999,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1719999999999999,"5min":1.603,"15min":1.603},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.875},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.115,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90300000000000002,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92800000000000005,"15min":0.95099999999999996},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.21,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.64800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.5569999999999999,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95299999999999996,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.46,"5min":3.46,"15min":3.46},"last":1.202},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.306,"5min":1.492,"15min":1.5049999999999999},"last":1.238}]},{"osd":6,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0109999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.376,"15min":0.376},"max":{"1min":3.6099999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.077},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.97499999999999998,"15min":1.014},"min":{"1min":0.63100000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.0960000000000001},"min":{"1min":0.65800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.246},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0780000000000001,"15min":1.123},"min":{"1min":0.76000000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":1.2709999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33124,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338716,"statfs":{"total":96636764160,"available":96602845184,"internally_reserved":0,"allocated":2056192,"data_stored":904989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93200000000000005,"15min":0.84499999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2649999999999999,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.91000000000000003,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.242,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.47699999999999998,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.216,"5min":1.536,"15min":1.536},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.89200000000000002},"min":{"1min":0.52600000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3660000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.49199999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.367,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.92300000000000004,"15min":0.90500000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4490000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.1060000000000001,"5min":10.44,"15min":10.44},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97199999999999998,"15min":0.95699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.286,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":0.97199999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.363,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1259999999999999,"15min":1.0309999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.222,"15min":1.0880000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.504,"5min":19.434000000000001,"15min":19.434000000000001},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.1819999999999999,"15min":1.091},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.573,"5min":15.593,"15min":15.593},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.077},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.4119999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.876}]}]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37220,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334620,"statfs":{"total":96636764160,"available":96598650880,"internally_reserved":0,"allocated":2052096,"data_stored":903037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98699999999999999,"5min":1.444,"15min":2.113},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.89300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.34100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.33700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96699999999999997,"5min":1.4850000000000001,"15min":1.742},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.74099999999999999},"min":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":1.222,"15min":1.399},"last":0.62}]},{"osd":4,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95699999999999996,"15min":1.0640000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":1.0069999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":0.99199999999999999},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1279999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.349,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95899999999999996,"15min":1.0369999999999999},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.99099999999999999,"15min":1.034},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.454,"5min":1.6890000000000001,"15min":1.96},"last":0.98499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.02,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.413,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97399999999999998,"15min":1.0009999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.504,"5min":1.504,"15min":2.9220000000000002},"last":1.079}]}]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41312,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330528,"statfs":{"total":96636764160,"available":96594460672,"internally_reserved":0,"allocated":2052096,"data_stored":903537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60599999999999998,"15min":0.58799999999999997},"min":{"1min":0.29799999999999999,"5min":0.246,"15min":0.246},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.98599999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64800000000000002,"15min":0.69599999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.307},"max":{"1min":1.0529999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.39100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.92500000000000004,"15min":0.91800000000000004},"min":{"1min":0.61699999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.611},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89200000000000002,"15min":0.91000000000000003},"min":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.248,"5min":1.587,"15min":1.587},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96999999999999997,"15min":0.99299999999999999},"min":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.3500000000000001,"5min":1.548,"15min":1.9179999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.58599999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.589,"5min":1.589,"15min":1.702},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.5},"max":{"1min":1.258,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.036},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.3600000000000001,"5min":1.645,"15min":1.645},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.843,"15min":1.843},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.036,"15min":1.071},"min":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":0.93400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41312,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330528,"statfs":{"total":96636764160,"available":96594460672,"internally_reserved":0,"allocated":2052096,"data_stored":904407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64300000000000002,"15min":0.623},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.436}]},{"osd":2,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.314,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.91300000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.2430000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1100000000000001,"5min":1.423,"15min":1.423},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88900000000000001,"15min":0.90400000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.77600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.367,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.02},"min":{"1min":0.60599999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64000000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.335,"5min":1.5900000000000001,"15min":1.653},"last":0.878},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.61699999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.028,"15min":1.0229999999999999},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.649,"15min":1.649},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41888,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329952,"statfs":{"total":96636764160,"available":96593870848,"internally_reserved":0,"allocated":2637824,"data_stored":1493233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.64400000000000002},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86399999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.4359999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.93899999999999995,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65000000000000002,"15min":0.68600000000000005},"min":{"1min":0.38200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.7589999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.5129999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.92000000000000004},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93700000000000006,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.458,"5min":1.5069999999999999,"15min":1.986},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96199999999999997,"15min":0.997},"min":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.583,"5min":1.583,"15min":2.641},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96899999999999997,"15min":1.024},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.6699999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.002,"15min":1.0580000000000001},"min":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.891},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.016},"min":{"1min":0.69099999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3700000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.427,"5min":1.669,"15min":2.2949999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.536,"5min":1.6930000000000001,"15min":2.2480000000000002},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:34:07.485 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:34:07.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:34:07.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80c1522640 1 Processor -- start 2024-09-13T18:34:07.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80c1522640 1 -- start start 2024-09-13T18:34:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80c1522640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80bc15c830 0x7f80bc0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80c1522640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0d3390 0x7f80bc0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80c1522640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc0b7db0 con 0x7f80bc0ccd10 2024-09-13T18:34:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80c1522640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0d0650 con 0x7f80bc15c830 2024-09-13T18:34:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80c1522640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0d0c10 con 0x7f80bc0d3390 2024-09-13T18:34:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80bc15c830 0x7f80bc0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80bc15c830 0x7f80bc0d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60702/0 (socket says 172.21.15.53:60702) 2024-09-13T18:34:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 -- 172.21.15.53:0/1084397168 learned_addr learned my addr 172.21.15.53:0/1084397168 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80bb7fe640 1 --2- 172.21.15.53:0/1084397168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0d3390 0x7f80bc0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 -- 172.21.15.53:0/1084397168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0d3390 msgr2=0x7f80bc0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 --2- 172.21.15.53:0/1084397168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0d3390 0x7f80bc0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 -- 172.21.15.53:0/1084397168 >> v1:172.21.15.87:6789/0 conn(0x7f80bc0ccd10 legacy=0x7f80bc0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 -- 172.21.15.53:0/1084397168 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0cd7d0 con 0x7f80bc15c830 2024-09-13T18:34:07.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80baffd640 1 --2- 172.21.15.53:0/1084397168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc15c830 0x7f80bc0d10a0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009870 tx=0x7f80ac01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8402243e412c86df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.652+0000 7f80ba7fc640 1 -- 172.21.15.53:0/1084397168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0ab650 con 0x7f80bc15c830 2024-09-13T18:34:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80ba7fc640 1 -- 172.21.15.53:0/1084397168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac0ab7b0 con 0x7f80bc15c830 2024-09-13T18:34:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80ba7fc640 1 -- 172.21.15.53:0/1084397168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0abb40 con 0x7f80bc15c830 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- 172.21.15.53:0/1084397168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc15c830 msgr2=0x7f80bc0d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 --2- 172.21.15.53:0/1084397168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc15c830 0x7f80bc0d10a0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009870 tx=0x7f80ac01c560 comp rx=0 tx=0).stop 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- 172.21.15.53:0/1084397168 shutdown_connections 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 --2- 172.21.15.53:0/1084397168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0d3390 0x7f80bc0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 --2- 172.21.15.53:0/1084397168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc15c830 0x7f80bc0d10a0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- 172.21.15.53:0/1084397168 >> 172.21.15.53:0/1084397168 conn(0x7f80bc070970 msgr2=0x7f80bc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- 172.21.15.53:0/1084397168 shutdown_connections 2024-09-13T18:34:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- 172.21.15.53:0/1084397168 wait complete. 2024-09-13T18:34:07.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 Processor -- start 2024-09-13T18:34:07.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- start start 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0ccd10 0x7f80bc0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc0d3390 0x7f80bc15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80bc15d260 0x7f80bc0b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc15fe20 con 0x7f80bc0d3390 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0c9c70 con 0x7f80bc15d260 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc15f860 con 0x7f80bc0ccd10 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc0d3390 0x7f80bc15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc0d3390 0x7f80bc15cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60712/0 (socket says 172.21.15.53:60712) 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 -- 172.21.15.53:0/2105370726 learned_addr learned my addr 172.21.15.53:0/2105370726 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80bb7fe640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80bc15d260 0x7f80bc0b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80baffd640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0ccd10 0x7f80bc0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 -- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0ccd10 msgr2=0x7f80bc0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0ccd10 0x7f80bc0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 -- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80bc15d260 msgr2=0x7f80bc0b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80bc15d260 0x7f80bc0b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 -- 172.21.15.53:0/2105370726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac0094d0 con 0x7f80bc0d3390 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b3fff640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc0d3390 0x7f80bc15cd20 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c420 tx=0x7f80a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b37fe640 1 -- 172.21.15.53:0/2105370726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40052d0 con 0x7f80bc0d3390 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b37fe640 1 -- 172.21.15.53:0/2105370726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4005430 con 0x7f80bc0d3390 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80b37fe640 1 -- 172.21.15.53:0/2105370726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4007260 con 0x7f80bc0d3390 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc15fb40 con 0x7f80bc0d3390 2024-09-13T18:34:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.656+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc15f550 con 0x7f80bc0d3390 2024-09-13T18:34:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.660+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc0ca0e0 con 0x7f80bc0d3390 2024-09-13T18:34:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.660+0000 7f80b37fe640 1 -- 172.21.15.53:0/2105370726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f80a40073c0 con 0x7f80bc0d3390 2024-09-13T18:34:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.660+0000 7f80b37fe640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f809c066ea0 0x7f809c069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.660+0000 7f80b37fe640 1 -- 172.21.15.53:0/2105370726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80a40824c0 con 0x7f80bc0d3390 2024-09-13T18:34:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.660+0000 7f80baffd640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f809c066ea0 0x7f809c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.660+0000 7f80baffd640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f809c066ea0 0x7f809c069360 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0af000 tx=0x7f80ac0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.664+0000 7f80b37fe640 1 -- 172.21.15.53:0/2105370726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f80a4051430 con 0x7f80bc0d3390 2024-09-13T18:34:07.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.884+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f80bc0d1080 con 0x7f80bc0d3390 2024-09-13T18:34:07.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.888+0000 7f80b37fe640 1 -- 172.21.15.53:0/2105370726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) v1 ==== 190+0+0 (secure 0 0 0) 0x7f80a40200e0 con 0x7f80bc0d3390 2024-09-13T18:34:07.892 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f809c066ea0 msgr2=0x7f809c069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f809c066ea0 0x7f809c069360 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0af000 tx=0x7f80ac0a7000 comp rx=0 tx=0).stop 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc0d3390 msgr2=0x7f80bc15cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc0d3390 0x7f80bc15cd20 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c420 tx=0x7f80a400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 shutdown_connections 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f809c066ea0 0x7f809c069360 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80bc15d260 0x7f80bc0b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80bc0d3390 0x7f80bc15cd20 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 --2- 172.21.15.53:0/2105370726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f80bc0ccd10 0x7f80bc0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 >> 172.21.15.53:0/2105370726 conn(0x7f80bc070970 msgr2=0x7f80bc0d2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 shutdown_connections 2024-09-13T18:34:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:07.892+0000 7f80c1522640 1 -- 172.21.15.53:0/2105370726 wait complete. 2024-09-13T18:34:07.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:08.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa81990640 1 Processor -- start 2024-09-13T18:34:08.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa81990640 1 -- start start 2024-09-13T18:34:08.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa81990640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 0x7ffa7c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa81990640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa7c0711d0 0x7ffa7c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa81990640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c06d480 con 0x7ffa7c1582a0 2024-09-13T18:34:08.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa81990640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c15aaf0 con 0x7ffa7c0711d0 2024-09-13T18:34:08.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa81990640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c06d760 con 0x7ffa7c15b7c0 2024-09-13T18:34:08.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffa7c1582a0 0x7ffa7c06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52782/0 (socket says 172.21.15.53:52782) 2024-09-13T18:34:08.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 -- 172.21.15.53:0/3931077256 learned_addr learned my addr 172.21.15.53:0/3931077256 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa73fff640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 0x7ffa7c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7b7fe640 1 --2- 172.21.15.53:0/3931077256 >> v2:172.21.15.87:3300/0 conn(0x7ffa7c0711d0 0x7ffa7c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540837948 0 0) 0x7ffa7c06d480 con 0x7ffa7c1582a0 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa5c003530 con 0x7ffa7c1582a0 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1090718233 0 0) 0x7ffa5c003530 con 0x7ffa7c1582a0 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 msgr2=0x7ffa7c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 0x7ffa7c070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 >> v2:172.21.15.87:3300/0 conn(0x7ffa7c0711d0 msgr2=0x7ffa7c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 --2- 172.21.15.53:0/3931077256 >> v2:172.21.15.87:3300/0 conn(0x7ffa7c0711d0 0x7ffa7c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c15ace0 con 0x7ffa7c1582a0 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7ffa6c001680 con 0x7ffa7c1582a0 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 >> v1:172.21.15.53:6789/0 conn(0x7ffa7c1582a0 legacy=0x7ffa7c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c0047d0 0x7ffa5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 0x7ffa5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c00b990 con 0x7ffa5c003980 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c00bad0 con 0x7ffa5c0047d0 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c00bc10 con 0x7ffa7c15b7c0 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa73fff640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c0047d0 0x7ffa5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7b7fe640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 0x7ffa5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 -- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 msgr2=0x7ffa5c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c15b7c0 0x7ffa5c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 -- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c0047d0 msgr2=0x7ffa5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c0047d0 0x7ffa5c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa7affd640 1 -- 172.21.15.53:0/3931077256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c003530 con 0x7ffa5c003980 2024-09-13T18:34:08.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.028+0000 7ffa73fff640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa5c0047d0 0x7ffa5c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa7affd640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c0e0 tx=0x7ffa6c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca712675eb66e041 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0058e0 con 0x7ffa5c003980 2024-09-13T18:34:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c005a40 con 0x7ffa5c003980 2024-09-13T18:34:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa7a7fc640 1 -- 172.21.15.53:0/3931077256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c005df0 con 0x7ffa5c003980 2024-09-13T18:34:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 -- 172.21.15.53:0/3931077256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 msgr2=0x7ffa5c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 --2- 172.21.15.53:0/3931077256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c0e0 tx=0x7ffa6c01cb80 comp rx=0 tx=0).stop 2024-09-13T18:34:08.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa7b7fe640 1 -- 172.21.15.53:0/3931077256 reap_dead start 2024-09-13T18:34:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 -- 172.21.15.53:0/3931077256 shutdown_connections 2024-09-13T18:34:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 -- 172.21.15.53:0/3931077256 >> 172.21.15.53:0/3931077256 conn(0x7ffa7c065c80 msgr2=0x7ffa7c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 -- 172.21.15.53:0/3931077256 shutdown_connections 2024-09-13T18:34:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 -- 172.21.15.53:0/3931077256 wait complete. 2024-09-13T18:34:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 Processor -- start 2024-09-13T18:34:08.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.032+0000 7ffa81990640 1 -- start start 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa7c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa7c0b2620 0x7ffa7c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c0b1730 0x7ffa7c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1510f0 con 0x7ffa5c003980 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1512d0 con 0x7ffa7c0b2620 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1515b0 con 0x7ffa7c0b1730 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa7c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa7c14a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60720/0 (socket says 172.21.15.53:60720) 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 -- 172.21.15.53:0/701435064 learned_addr learned my addr 172.21.15.53:0/701435064 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa73fff640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa7c0b2620 0x7ffa7c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7b7fe640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c0b1730 0x7ffa7c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 -- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c0b1730 msgr2=0x7ffa7c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c0b1730 0x7ffa7c0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 -- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa7c0b2620 msgr2=0x7ffa7c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa7c0b2620 0x7ffa7c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 -- 172.21.15.53:0/701435064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c151890 con 0x7ffa5c003980 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa7affd640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa7c14a0b0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c0e0 tx=0x7ffa5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa78ff9640 1 -- 172.21.15.53:0/701435064 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0047f0 con 0x7ffa5c003980 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa78ff9640 1 -- 172.21.15.53:0/701435064 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c004950 con 0x7ffa5c003980 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa78ff9640 1 -- 172.21.15.53:0/701435064 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c004cc0 con 0x7ffa5c003980 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c151b70 con 0x7ffa5c003980 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c152130 con 0x7ffa5c003980 2024-09-13T18:34:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c067400 con 0x7ffa5c003980 2024-09-13T18:34:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa78ff9640 1 -- 172.21.15.53:0/701435064 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7ffa6c0070d0 con 0x7ffa5c003980 2024-09-13T18:34:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa78ff9640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffa60066ea0 0x7ffa60069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa78ff9640 1 -- 172.21.15.53:0/701435064 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa6c11bc10 con 0x7ffa5c003980 2024-09-13T18:34:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa73fff640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffa60066ea0 0x7ffa60069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.036+0000 7ffa73fff640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffa60066ea0 0x7ffa60069360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0b2a20 tx=0x7ffa64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.040+0000 7ffa78ff9640 1 -- 172.21.15.53:0/701435064 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa6c0eab80 con 0x7ffa5c003980 2024-09-13T18:34:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.236+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa7c157a80 con 0x7ffa5c003980 2024-09-13T18:34:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.236+0000 7ffa78ff9640 1 -- 172.21.15.53:0/701435064 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4742 (secure 0 0 0) 0x7ffa6c0ee1a0 con 0x7ffa5c003980 2024-09-13T18:34:08.239 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:08.239 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3371404154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3371404154},{"type":"v1","addr":"172.21.15.87:6833","nonce":3371404154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8665,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1374144604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1374144604},{"type":"v1","addr":"172.21.15.87:6835","nonce":1374144604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2656917860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656917860},{"type":"v1","addr":"172.21.15.53:6834","nonce":2656917860}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:58.642385+0000","modified":"2024-09-13T18:34:01.656052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10023},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10023":{"gid":10023,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3514602173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3514602173},{"type":"v1","addr":"172.21.15.53:6835","nonce":3514602173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2024-09-13T18:34:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2024-09-13T18:34:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffa60066ea0 msgr2=0x7ffa60069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffa60066ea0 0x7ffa60069360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0b2a20 tx=0x7ffa64008040 comp rx=0 tx=0).stop 2024-09-13T18:34:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 msgr2=0x7ffa7c14a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa7c14a0b0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c0e0 tx=0x7ffa5c005800 comp rx=0 tx=0).stop 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 shutdown_connections 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ffa60066ea0 0x7ffa60069360 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffa7c0b1730 0x7ffa7c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa7c0b2620 0x7ffa7c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 --2- 172.21.15.53:0/701435064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa5c003980 0x7ffa7c14a0b0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 >> 172.21.15.53:0/701435064 conn(0x7ffa7c065c80 msgr2=0x7ffa7c0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 shutdown_connections 2024-09-13T18:34:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.240+0000 7ffa81990640 1 -- 172.21.15.53:0/701435064 wait complete. 2024-09-13T18:34:08.660 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:33:58.642385+0000', 'modified': '2024-09-13T18:34:01.656052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10023}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10023': {'gid': 10023, 'name': 'c', 'rank': 0, 'incarnation': 93, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3514602173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6833', 'nonce': 3514602173}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3514602173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:34:08.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:34:08.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:34:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eb13aa640 1 Processor -- start 2024-09-13T18:34:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eb13aa640 1 -- start start 2024-09-13T18:34:08.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eb13aa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac15cab0 0x7f2eac0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eb13aa640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2eac0cd6c0 0x7f2eac0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eb13aa640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0d2400 con 0x7f2eac0cdb00 2024-09-13T18:34:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eb13aa640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac0d1530 con 0x7f2eac0cd6c0 2024-09-13T18:34:08.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eb13aa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0d0920 con 0x7f2eac15cab0 2024-09-13T18:34:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eaaffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac15cab0 0x7f2eac0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eaa7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2eac0cd6c0 0x7f2eac0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eaaffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac15cab0 0x7f2eac0d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:40104/0 (socket says 172.21.15.53:40104) 2024-09-13T18:34:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eaaffd640 1 -- 172.21.15.53:0/3300708972 learned_addr learned my addr 172.21.15.53:0/3300708972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.792+0000 7f2eab7fe640 1 --1- 172.21.15.53:0/3300708972 >> v1:172.21.15.87:6789/0 conn(0x7f2eac0cdb00 0x7f2eac0b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:47004/0 (socket says 172.21.15.53:47004) 2024-09-13T18:34:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2eaaffd640 1 -- 172.21.15.53:0/3300708972 >> v2:172.21.15.87:3300/0 conn(0x7f2eac0cd6c0 msgr2=0x7f2eac0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3300708972 >> v2:172.21.15.87:3300/0 conn(0x7f2eac0cd6c0 0x7f2eac0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2eaaffd640 1 -- 172.21.15.53:0/3300708972 >> v1:172.21.15.87:6789/0 conn(0x7f2eac0cdb00 legacy=0x7f2eac0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2eaaffd640 1 -- 172.21.15.53:0/3300708972 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0d0c00 con 0x7f2eac15cab0 2024-09-13T18:34:08.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3300708972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac15cab0 0x7f2eac0d19c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009870 tx=0x7f2e9c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1052bca90eaaeed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2ea9ffb640 1 -- 172.21.15.53:0/3300708972 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0ab640 con 0x7f2eac15cab0 2024-09-13T18:34:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2ea9ffb640 1 -- 172.21.15.53:0/3300708972 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0a7070 con 0x7f2eac15cab0 2024-09-13T18:34:08.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.796+0000 7f2ea9ffb640 1 -- 172.21.15.53:0/3300708972 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0ab9c0 con 0x7f2eac15cab0 2024-09-13T18:34:08.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3300708972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac15cab0 msgr2=0x7f2eac0d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3300708972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac15cab0 0x7f2eac0d19c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009870 tx=0x7f2e9c01c530 comp rx=0 tx=0).stop 2024-09-13T18:34:08.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3300708972 shutdown_connections 2024-09-13T18:34:08.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3300708972 >> v2:172.21.15.87:3300/0 conn(0x7f2eac0cd6c0 0x7f2eac0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3300708972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac15cab0 0x7f2eac0d19c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3300708972 >> 172.21.15.53:0/3300708972 conn(0x7f2eac065c80 msgr2=0x7f2eac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3300708972 shutdown_connections 2024-09-13T18:34:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3300708972 wait complete. 2024-09-13T18:34:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 Processor -- start 2024-09-13T18:34:08.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- start start 2024-09-13T18:34:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac0cd6c0 0x7f2eac156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eac0cdb00 0x7f2eac0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eac15cab0 0x7f2eac152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0cc7a0 con 0x7f2eac15cab0 2024-09-13T18:34:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac156ab0 con 0x7f2eac0cdb00 2024-09-13T18:34:08.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac156d90 con 0x7f2eac0cd6c0 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eac15cab0 0x7f2eac152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eac15cab0 0x7f2eac152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60736/0 (socket says 172.21.15.53:60736) 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3659405958 learned_addr learned my addr 172.21.15.53:0/3659405958 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eac0cdb00 0x7f2eac0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac0cd6c0 0x7f2eac156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac0cd6c0 msgr2=0x7f2eac156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac0cd6c0 0x7f2eac156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eac0cdb00 msgr2=0x7f2eac0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eac0cdb00 0x7f2eac0cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3659405958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0094d0 con 0x7f2eac15cab0 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eac0cdb00 0x7f2eac0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eac15cab0 0x7f2eac152680 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c6c0 tx=0x7f2ea400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2e937fe640 1 -- 172.21.15.53:0/3659405958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4004d70 con 0x7f2eac15cab0 2024-09-13T18:34:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2e937fe640 1 -- 172.21.15.53:0/3659405958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea400a640 con 0x7f2eac15cab0 2024-09-13T18:34:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2e937fe640 1 -- 172.21.15.53:0/3659405958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400a9f0 con 0x7f2eac15cab0 2024-09-13T18:34:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac157070 con 0x7f2eac15cab0 2024-09-13T18:34:08.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.800+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac157630 con 0x7f2eac15cab0 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2e937fe640 1 -- 172.21.15.53:0/3659405958 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f2ea400ab50 con 0x7f2eac15cab0 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2e937fe640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e98066e70 0x7f2e98069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2e937fe640 1 -- 172.21.15.53:0/3659405958 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea4081c00 con 0x7f2eac15cab0 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e98066e70 0x7f2e98069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e98066e70 0x7f2e98069330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0af000 tx=0x7f2e9c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 Processor -- start 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 -- start start 2024-09-13T18:34:08.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307ccd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c83200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307c83740 0x563307c83b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563307b4be80 con 0x563307c83740 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563307ad9af0 con 0x563307ccdb10 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563307ad70c0 con 0x563307ccd1f0 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307c83740 0x563307c83b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307c83740 0x563307c83b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60752/0 (socket says 172.21.15.53:60752) 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 -- 172.21.15.53:0/992278283 learned_addr learned my addr 172.21.15.53:0/992278283 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c83200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 -- 172.21.15.53:0/992278283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 msgr2=0x563307ccd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307ccd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 -- 172.21.15.53:0/992278283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 msgr2=0x563307c83200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c83200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 -- 172.21.15.53:0/992278283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633077ce890 con 0x563307c83740 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307c83740 0x563307c83b20 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f2ea405c670 tx=0x7f2ea4054860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342a0238934b9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2e90ff9640 1 -- 172.21.15.53:0/992278283 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea406c170 con 0x563307c83740 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2e90ff9640 1 -- 172.21.15.53:0/992278283 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4052c00 con 0x563307c83740 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.804+0000 7f2e90ff9640 1 -- 172.21.15.53:0/992278283 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4058170 con 0x563307c83740 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/992278283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307c83740 msgr2=0x563307c83b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307c83740 0x563307c83b20 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f2ea405c670 tx=0x7f2ea4054860 comp rx=0 tx=0).stop 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/992278283 shutdown_connections 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307c83740 0x563307c83b20 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c83200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/992278283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307ccd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/992278283 >> 172.21.15.53:0/992278283 conn(0x563307c89fb0 msgr2=0x563307c8a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/992278283 shutdown_connections 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/992278283 wait complete. 2024-09-13T18:34:08.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- start start 2024-09-13T18:34:08.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 Processor -- start 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307c8efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307c8f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307c8fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563307ad29b0 con 0x563307ccdb10 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563307a71c00 con 0x563307c83740 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563307a90070 con 0x563307ccd1f0 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 10 client.0 _ll_register_callbacks cb 0x563307c6fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307c8fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307c8fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60758/0 (socket says 172.21.15.53:60758) 2024-09-13T18:34:08.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3149356492 learned_addr learned my addr 172.21.15.53:0/3149356492 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307c8efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 msgr2=0x563307c8f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307c8f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307c8f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 msgr2=0x563307c8efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307c8efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 -- 172.21.15.53:0/3149356492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac157630 con 0x563307ccdb10 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307c8efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307c8fa30 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4054560 tx=0x7f2ea4001410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fa83d873e2a4da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2e89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2e89ffb640 1 -- 172.21.15.53:0/3149356492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea406c170 con 0x563307ccdb10 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2e89ffb640 1 -- 172.21.15.53:0/3149356492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea4071100 con 0x563307ccdb10 2024-09-13T18:34:08.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563307a8f5f0 con 0x563307ccdb10 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2e89ffb640 1 -- 172.21.15.53:0/3149356492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ea4053d50 con 0x563307ccdb10 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 10 client.10179 fetch_fsmap learned FSMap version 96 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x563307a97ab0 con 0x563307ccdb10 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2e89ffb640 1 -- 172.21.15.53:0/3149356492 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563307a8f5f0 con 0x563307ccdb10 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2e89ffb640 1 -- 172.21.15.53:0/3149356492 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2ea405c710 con 0x563307ccdb10 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 10 client.10179 fetch_fsmap finished waiting for FSMap version 96 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 10 client.10179 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 20 client.10179 populate_metadata read hostname 'smithi053' 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307c90440 0x563307cdf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 4 client.10179 mds_command: new command op to 10023 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 --> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563307acf790 con 0x563307c90440 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307c90440 0x563307cdf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2e89ffb640 10 client.10179 ms_handle_connect on v2:172.21.15.53:6833/3514602173 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.808+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307c90440 0x563307cdf2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a615dd61329d5897 server_cookie=dbe7dd043722a2dc in_seq=0 out_seq=0 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2e89ffb640 1 -- 172.21.15.53:0/3149356492 <== mds.0 v2:172.21.15.53:6833/3514602173 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563307acf790 con 0x563307c90440 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2e89ffb640 10 client.10179 handle_command_reply: tid=0 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 client.10179 shutdown 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 msgr2=0x563307c8fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307c8fa30 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4054560 tx=0x7f2ea4001410 comp rx=0 tx=0).stop 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 shutdown_connections 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307c90440 0x563307cdf2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307c8f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307c8fa30 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3149356492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307c8efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 >> 172.21.15.53:0/3149356492 conn(0x563307c89fb0 msgr2=0x563307c821f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2e89ffb640 0 client.10179 ms_handle_reset on v2:172.21.15.53:6833/3514602173 2024-09-13T18:34:08.818 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 shutdown_connections 2024-09-13T18:34:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3149356492 wait complete. 2024-09-13T18:34:08.819 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.812+0000 7f2eb44f3000 20 client.10179 trim_cache size 0 max 16384 2024-09-13T18:34:08.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 Processor -- start 2024-09-13T18:34:08.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- start start 2024-09-13T18:34:08.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307c83740 0x563307c82b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccd1f0 0x563307c89230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c89770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56330778f940 con 0x563307ccd1f0 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563307c86360 con 0x563307ccdb10 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563307a0a9f0 con 0x563307c83740 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccd1f0 0x563307c89230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccd1f0 0x563307c89230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60770/0 (socket says 172.21.15.53:60770) 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 -- 172.21.15.53:0/3865120554 learned_addr learned my addr 172.21.15.53:0/3865120554 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307c83740 0x563307c82b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 -- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307c83740 msgr2=0x563307c82b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c89770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307c83740 0x563307c82b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 -- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 msgr2=0x563307c89770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c89770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 -- 172.21.15.53:0/3865120554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563307a7dc00 con 0x563307ccd1f0 2024-09-13T18:34:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccd1f0 0x563307c89230 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009940 tx=0x7f2ea0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae6f97a58712d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2e917fa640 1 -- 172.21.15.53:0/3865120554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0009490 con 0x563307ccd1f0 2024-09-13T18:34:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2e917fa640 1 -- 172.21.15.53:0/3865120554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0013d30 con 0x563307ccd1f0 2024-09-13T18:34:08.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2e917fa640 1 -- 172.21.15.53:0/3865120554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea001e6a0 con 0x563307ccd1f0 2024-09-13T18:34:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3865120554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccd1f0 msgr2=0x563307c89230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccd1f0 0x563307c89230 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009940 tx=0x7f2ea0009190 comp rx=0 tx=0).stop 2024-09-13T18:34:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3865120554 shutdown_connections 2024-09-13T18:34:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307ccdb10 0x563307c89770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccd1f0 0x563307c89230 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/3865120554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307c83740 0x563307c82b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3865120554 >> 172.21.15.53:0/3865120554 conn(0x563307c89fb0 msgr2=0x563307c821f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3865120554 shutdown_connections 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- 172.21.15.53:0/3865120554 wait complete. 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 -- start start 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.828+0000 7f2eb44f3000 1 Processor -- start 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307d2e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307ce0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307ce1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563307ad69b0 con 0x563307ccdb10 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x563307a99c60 con 0x563307c83740 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x563307c8f1e0 con 0x563307ccd1f0 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 10 client.0 _ll_register_callbacks cb 0x7f2ea4050ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:34:08.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307ce1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307ce1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60786/0 (socket says 172.21.15.53:60786) 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 -- 172.21.15.53:0/2563527450 learned_addr learned my addr 172.21.15.53:0/2563527450 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307d2e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eaa7fc640 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307ce0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 -- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 msgr2=0x563307ce0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307ce0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 -- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 msgr2=0x563307d2e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307d2e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 -- 172.21.15.53:0/2563527450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea00095f0 con 0x563307ccdb10 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eab7fe640 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307ce1440 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40587a0 tx=0x7f2ea4050c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc9209467d2cc00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 1 -- 172.21.15.53:0/2563527450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4081ff0 con 0x563307ccdb10 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563307aa2460 con 0x563307ccdb10 2024-09-13T18:34:08.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 1 -- 172.21.15.53:0/2563527450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea4071100 con 0x563307ccdb10 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 1 -- 172.21.15.53:0/2563527450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ea4081dc0 con 0x563307ccdb10 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 10 client.10185 fetch_fsmap learned FSMap version 96 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x5633077cecc0 con 0x563307ccdb10 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 1 -- 172.21.15.53:0/2563527450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563307aa2460 con 0x563307ccdb10 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 1 -- 172.21.15.53:0/2563527450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2ea4050860 con 0x563307ccdb10 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 10 client.10185 fetch_fsmap finished waiting for FSMap version 96 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 10 client.10185 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 20 client.10185 populate_metadata read hostname 'smithi053' 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307d2e600 0x563307ce9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 4 client.10185 mds_command: new command op to 10023 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 --> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563307a9b9c0 con 0x563307d2e600 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307d2e600 0x563307ce9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eaaffd640 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307d2e600 0x563307ce9d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19fa40329130c265 server_cookie=2800b346ebf1d3db in_seq=0 out_seq=0 2024-09-13T18:34:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 10 client.10185 ms_handle_connect on v2:172.21.15.53:6833/3514602173 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 1 -- 172.21.15.53:0/2563527450 <== mds.0 v2:172.21.15.53:6833/3514602173 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x563307a9b9c0 con 0x563307d2e600 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 10 client.10185 handle_command_reply: tid=0 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 client.10185 shutdown 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 msgr2=0x563307ce1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307ce1440 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40587a0 tx=0x7f2ea4050c50 comp rx=0 tx=0).stop 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 shutdown_connections 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:6833/3514602173,v1:172.21.15.53:6835/3514602173] conn(0x563307d2e600 0x563307ce9d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x563307ccd1f0 0x563307ce0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563307ccdb10 0x563307ce1440 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 --2- 172.21.15.53:0/2563527450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x563307c83740 0x563307d2e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 >> 172.21.15.53:0/2563527450 conn(0x563307c89fb0 msgr2=0x563307c828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2e89ffb640 0 client.10185 ms_handle_reset on v2:172.21.15.53:6833/3514602173 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 shutdown_connections 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 1 -- 172.21.15.53:0/2563527450 wait complete. 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb44f3000 20 client.10185 trim_cache size 0 max 16384 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10023, 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:34:08.841 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:34:08.842 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.192160989, 2024-09-13T18:34:08.842 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 96, 2024-09-13T18:34:08.842 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 162, 2024-09-13T18:34:08.842 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 162, 2024-09-13T18:34:08.842 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 14.659434149000001 2024-09-13T18:34:08.842 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e98066e70 msgr2=0x7f2e98069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e98066e70 0x7f2e98069330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0af000 tx=0x7f2e9c0a7000 comp rx=0 tx=0).stop 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eac15cab0 msgr2=0x7f2eac152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eac15cab0 0x7f2eac152680 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c6c0 tx=0x7f2ea400cb80 comp rx=0 tx=0).stop 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 shutdown_connections 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e98066e70 0x7f2e98069330 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eac15cab0 0x7f2eac152680 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2eac0cdb00 0x7f2eac0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 --2- 172.21.15.53:0/3659405958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2eac0cd6c0 0x7f2eac156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 >> 172.21.15.53:0/3659405958 conn(0x7f2eac065c80 msgr2=0x7f2eac15a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 shutdown_connections 2024-09-13T18:34:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.832+0000 7f2eb13aa640 1 -- 172.21.15.53:0/3659405958 wait complete. 2024-09-13T18:34:08.852 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:34:08.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8c336640 1 Processor -- start 2024-09-13T18:34:08.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8c336640 1 -- start start 2024-09-13T18:34:08.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8c336640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e841582a0 0x7f2e8406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8c336640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2e840713a0 0x7f2e8406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8c336640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8406d480 con 0x7f2e8415b7c0 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8c336640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8415aaf0 con 0x7f2e841582a0 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8c336640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8406d760 con 0x7f2e840713a0 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a0d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e841582a0 0x7f2e8406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a0d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e841582a0 0x7f2e8406c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60796/0 (socket says 172.21.15.53:60796) 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e898d1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2e8415b7c0 0x7f2e84070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52792/0 (socket says 172.21.15.53:52792) 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a0d2640 1 -- 172.21.15.53:0/2607595844 learned_addr learned my addr 172.21.15.53:0/2607595844 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a8d3640 1 --2- 172.21.15.53:0/2607595844 >> v2:172.21.15.87:3300/0 conn(0x7f2e840713a0 0x7f2e8406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a0d2640 1 -- 172.21.15.53:0/2607595844 >> v2:172.21.15.87:3300/0 conn(0x7f2e840713a0 msgr2=0x7f2e8406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a0d2640 1 --2- 172.21.15.53:0/2607595844 >> v2:172.21.15.87:3300/0 conn(0x7f2e840713a0 0x7f2e8406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a0d2640 1 -- 172.21.15.53:0/2607595844 >> v1:172.21.15.53:6789/0 conn(0x7f2e8415b7c0 legacy=0x7f2e84070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a0d2640 1 -- 172.21.15.53:0/2607595844 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8415ace0 con 0x7f2e841582a0 2024-09-13T18:34:08.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.972+0000 7f2e8a8d3640 1 --2- 172.21.15.53:0/2607595844 >> v2:172.21.15.87:3300/0 conn(0x7f2e840713a0 0x7f2e8406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8a0d2640 1 --2- 172.21.15.53:0/2607595844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e8406c900 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f2e84158680 tx=0x7f2e8001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c1de3c56c69aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e890d0640 1 -- 172.21.15.53:0/2607595844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800aa650 con 0x7f2e841582a0 2024-09-13T18:34:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e890d0640 1 -- 172.21.15.53:0/2607595844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e800aa7b0 con 0x7f2e841582a0 2024-09-13T18:34:08.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e890d0640 1 -- 172.21.15.53:0/2607595844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800aab40 con 0x7f2e841582a0 2024-09-13T18:34:08.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- 172.21.15.53:0/2607595844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 msgr2=0x7f2e8406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2607595844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e8406c900 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f2e84158680 tx=0x7f2e8001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- 172.21.15.53:0/2607595844 shutdown_connections 2024-09-13T18:34:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2607595844 >> v2:172.21.15.87:3300/0 conn(0x7f2e840713a0 0x7f2e8406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2607595844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e8406c900 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- 172.21.15.53:0/2607595844 >> 172.21.15.53:0/2607595844 conn(0x7f2e84065c80 msgr2=0x7f2e84066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- 172.21.15.53:0/2607595844 shutdown_connections 2024-09-13T18:34:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- 172.21.15.53:0/2607595844 wait complete. 2024-09-13T18:34:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 Processor -- start 2024-09-13T18:34:08.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- start start 2024-09-13T18:34:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e840713a0 0x7f2e84144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e84144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8415b7c0 0x7f2e8414d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84144da0 con 0x7f2e841582a0 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84156910 con 0x7f2e8415b7c0 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8c336640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84146180 con 0x7f2e840713a0 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e898d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e84144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e898d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e84144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60798/0 (socket says 172.21.15.53:60798) 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e898d1640 1 -- 172.21.15.53:0/2800310914 learned_addr learned my addr 172.21.15.53:0/2800310914 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8a8d3640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8415b7c0 0x7f2e8414d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.976+0000 7f2e8a0d2640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e840713a0 0x7f2e84144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e898d1640 1 -- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e840713a0 msgr2=0x7f2e84144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e898d1640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e840713a0 0x7f2e84144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e898d1640 1 -- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8415b7c0 msgr2=0x7f2e8414d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e898d1640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8415b7c0 0x7f2e8414d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e898d1640 1 -- 172.21.15.53:0/2800310914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800094d0 con 0x7f2e841582a0 2024-09-13T18:34:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e898d1640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e84144860 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c490 tx=0x7f2e7400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e7affd640 1 -- 172.21.15.53:0/2800310914 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74007480 con 0x7f2e841582a0 2024-09-13T18:34:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e7affd640 1 -- 172.21.15.53:0/2800310914 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740075e0 con 0x7f2e841582a0 2024-09-13T18:34:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8414da30 con 0x7f2e841582a0 2024-09-13T18:34:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e7affd640 1 -- 172.21.15.53:0/2800310914 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74004a10 con 0x7f2e841582a0 2024-09-13T18:34:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e84145850 con 0x7f2e841582a0 2024-09-13T18:34:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e84067400 con 0x7f2e841582a0 2024-09-13T18:34:08.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e7affd640 1 -- 172.21.15.53:0/2800310914 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f2e74004b70 con 0x7f2e841582a0 2024-09-13T18:34:08.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e7affd640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e68066e70 0x7f2e68069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e7affd640 1 -- 172.21.15.53:0/2800310914 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e740816d0 con 0x7f2e841582a0 2024-09-13T18:34:08.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e8a0d2640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e68066e70 0x7f2e68069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.980+0000 7f2e8a0d2640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e68066e70 0x7f2e68069330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2e800ae000 tx=0x7f2e800a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:08.984+0000 7f2e7affd640 1 -- 172.21.15.53:0/2800310914 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e74050640 con 0x7f2e841582a0 2024-09-13T18:34:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.176+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e8414da30 con 0x7f2e841582a0 2024-09-13T18:34:09.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.176+0000 7f2e7affd640 1 -- 172.21.15.53:0/2800310914 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2e8414da30 con 0x7f2e841582a0 2024-09-13T18:34:09.179 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:34:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e68066e70 msgr2=0x7f2e68069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e68066e70 0x7f2e68069330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2e800ae000 tx=0x7f2e800a7000 comp rx=0 tx=0).stop 2024-09-13T18:34:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 msgr2=0x7f2e84144860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e84144860 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c490 tx=0x7f2e7400c950 comp rx=0 tx=0).stop 2024-09-13T18:34:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 shutdown_connections 2024-09-13T18:34:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2e68066e70 0x7f2e68069330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e8415b7c0 0x7f2e8414d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e841582a0 0x7f2e84144860 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 --2- 172.21.15.53:0/2800310914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e840713a0 0x7f2e84144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 >> 172.21.15.53:0/2800310914 conn(0x7f2e84065c80 msgr2=0x7f2e840adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 shutdown_connections 2024-09-13T18:34:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:09.180+0000 7f2e8c336640 1 -- 172.21.15.53:0/2800310914 wait complete. 2024-09-13T18:34:09.197 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:34:09.197 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:34:09.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:34:09.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:34:09.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:09.201 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:34:09.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:34:09.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:34:09.201 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:34:09.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.201 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:34:09.207 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:34:09.207 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:34:09.208 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41947sec preferred_lft 41947sec 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:34:09.209 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.210 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:34:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:34:09.211 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:09.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.211 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:34:09.260 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:34:09.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.261 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:34:09.310 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:34:09.311 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:34:09.311 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:34:09.311 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:34:09.311 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:34:09.311 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:34:09.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.311 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:34:09.311 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:34:09.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:34:09.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:34:09.312 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:34:09.312 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:34:09.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.385 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:34:09.433 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:34:09.434 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:34:09.434 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:34:09.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:34:09.490 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:34:09.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:09.490 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:09.538 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:34:09.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:09.538 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:09.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:34:09.647 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:09.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:09.702 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:09.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.702 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:34:09.751 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:34:09.751 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:34:09.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:34:09.811 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:09.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:09.865 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:09.866 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:09.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:09.866 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:34:09.879 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:34:09.876+0000 7ff6523c1580 -1 init, newargv = 0x55597167a3e0 newargc=15 2024-09-13T18:34:09.879 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[57975]: starting ceph client 2024-09-13T18:34:09.885 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[57975]: starting fuse 2024-09-13T18:34:10.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:34:11.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:11.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:11.058 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:11.059 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:11.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:11.060 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:34:11.106 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:34:11.106 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:34:11.106 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:34:11.106 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:34:11.106 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:34:11.106 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:34:11.106 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:34:11.106 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:34:11.107 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:34:11.108 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:34:11.108 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:34:11.108 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:11.108 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:34:11.108 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:34:11.230 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.57975.asok 2024-09-13T18:34:11.411 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57975.asok 2024-09-13T18:34:11.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:11.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57975.asok status 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "57975", 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:11.573 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10203, 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10203 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3935490231 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:11.574 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3935490231 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10203 192.168.0.1:0/3935490231", 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3935490231", 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 96, 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 162, 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:34:11.575 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:34:11.576 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:34:11.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:11.587 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:34:11.587 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:11.593 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:34:11.593 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:11.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:11.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:11.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:34:11.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13897d0640 1 Processor -- start 2024-09-13T18:34:11.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13897d0640 1 -- start start 2024-09-13T18:34:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13897d0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 0x7f13840d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13897d0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13840d2400 con 0x7f13840cf7d0 2024-09-13T18:34:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13897d0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13840d1530 con 0x7f13840cd6c0 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13897d0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840d0920 con 0x7f138415cab0 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13837fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f13840cf7d0 0x7f13840b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52798/0 (socket says 172.21.15.53:52798) 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13837fe640 1 -- 172.21.15.53:0/1652637081 learned_addr learned my addr 172.21.15.53:0/1652637081 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822974260 0 0) 0x7f13840d2400 con 0x7f13840cf7d0 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 0x7f13840d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1370003530 con 0x7f13840cf7d0 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687233500 0 0) 0x7f1370003530 con 0x7f13840cf7d0 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 msgr2=0x7f13840d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 0x7f13840d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 >> v1:172.21.15.87:6789/0 conn(0x7f13840cd6c0 legacy=0x7f13840cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840d0c00 con 0x7f13840cf7d0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f137c001a00 con 0x7f13840cf7d0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 0x7f13840d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 >> v1:172.21.15.53:6789/0 conn(0x7f13840cf7d0 legacy=0x7f13840b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13700039b0 0x7f1370003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13700047d0 0x7f1370004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 0x7f1370005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13840d0920 con 0x7f13700039b0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137000ba90 con 0x7f13700047d0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137000bc50 con 0x7f138415cab0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13700039b0 0x7f1370003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f137bfff640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13700047d0 0x7f1370004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f13837fe640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 0x7f1370005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 -- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 msgr2=0x7f1370005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138415cab0 0x7f1370005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 -- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13700047d0 msgr2=0x7f1370004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13700047d0 0x7f1370004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f1382ffd640 1 -- 172.21.15.53:0/1652637081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370003530 con 0x7f13700039b0 2024-09-13T18:34:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.820+0000 7f137bfff640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f13700047d0 0x7f1370004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f1382ffd640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13700039b0 0x7f1370003dd0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f13740098d0 tx=0x7f137401c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d975ffc2be0026eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740aa650 con 0x7f13700039b0 2024-09-13T18:34:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740aa7b0 con 0x7f13700039b0 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13827fc640 1 -- 172.21.15.53:0/1652637081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740aab20 con 0x7f13700039b0 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- 172.21.15.53:0/1652637081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13700039b0 msgr2=0x7f1370003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 --2- 172.21.15.53:0/1652637081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13700039b0 0x7f1370003dd0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f13740098d0 tx=0x7f137401c5a0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13837fe640 1 -- 172.21.15.53:0/1652637081 reap_dead start 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- 172.21.15.53:0/1652637081 shutdown_connections 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- 172.21.15.53:0/1652637081 >> 172.21.15.53:0/1652637081 conn(0x7f1384065c80 msgr2=0x7f1384066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- 172.21.15.53:0/1652637081 shutdown_connections 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- 172.21.15.53:0/1652637081 wait complete. 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 Processor -- start 2024-09-13T18:34:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- start start 2024-09-13T18:34:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13700039b0 0x7f1384163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138415a800 0x7f138415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138415e420 0x7f1384165b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384164780 con 0x7f138415a800 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384160db0 con 0x7f138415e420 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13897d0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13841644a0 con 0x7f13700039b0 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f137bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138415a800 0x7f138415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f137bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138415a800 0x7f138415dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60820/0 (socket says 172.21.15.53:60820) 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f137bfff640 1 -- 172.21.15.53:0/3326996737 learned_addr learned my addr 172.21.15.53:0/3326996737 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f1382ffd640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13700039b0 0x7f1384163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f13837fe640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138415e420 0x7f1384165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f137bfff640 1 -- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13700039b0 msgr2=0x7f1384163ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.824+0000 7f137bfff640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13700039b0 0x7f1384163ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137bfff640 1 -- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138415e420 msgr2=0x7f1384165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137bfff640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138415e420 0x7f1384165b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137bfff640 1 -- 172.21.15.53:0/3326996737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13841650b0 con 0x7f138415a800 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137bfff640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138415a800 0x7f138415dee0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f136c00e580 tx=0x7f136c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137b7fe640 1 -- 172.21.15.53:0/3326996737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0052e0 con 0x7f138415a800 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137b7fe640 1 -- 172.21.15.53:0/3326996737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c005440 con 0x7f138415a800 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1384165390 con 0x7f138415a800 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137b7fe640 1 -- 172.21.15.53:0/3326996737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c003840 con 0x7f138415a800 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138415ac60 con 0x7f138415a800 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138415ae80 con 0x7f138415a800 2024-09-13T18:34:11.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137b7fe640 1 -- 172.21.15.53:0/3326996737 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f136c0039a0 con 0x7f138415a800 2024-09-13T18:34:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137b7fe640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1364066ea0 0x7f1364069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f137b7fe640 1 -- 172.21.15.53:0/3326996737 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f136c082740 con 0x7f138415a800 2024-09-13T18:34:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f1382ffd640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1364066ea0 0x7f1364069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.828+0000 7f1382ffd640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1364066ea0 0x7f1364069360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f13740ae000 tx=0x7f13740b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:11.835 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:11.832+0000 7f137b7fe640 1 -- 172.21.15.53:0/3326996737 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f136c051630 con 0x7f138415a800 2024-09-13T18:34:12.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.028+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f13840cf0c0 con 0x7f138415a800 2024-09-13T18:34:12.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.028+0000 7f137b7fe640 1 -- 172.21.15.53:0/3326996737 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f136c054c50 con 0x7f138415a800 2024-09-13T18:34:12.032 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:34:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1364066ea0 msgr2=0x7f1364069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1364066ea0 0x7f1364069360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f13740ae000 tx=0x7f13740b5040 comp rx=0 tx=0).stop 2024-09-13T18:34:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138415a800 msgr2=0x7f138415dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138415a800 0x7f138415dee0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f136c00e580 tx=0x7f136c00ea40 comp rx=0 tx=0).stop 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 shutdown_connections 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1364066ea0 0x7f1364069360 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138415e420 0x7f1384165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138415a800 0x7f138415dee0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 --2- 172.21.15.53:0/3326996737 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f13700039b0 0x7f1384163ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 >> 172.21.15.53:0/3326996737 conn(0x7f1384065c80 msgr2=0x7f13840b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 shutdown_connections 2024-09-13T18:34:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:12.032+0000 7f13897d0640 1 -- 172.21.15.53:0/3326996737 wait complete. 2024-09-13T18:34:12.051 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:34:12.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:34:12.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:34:12.051 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:34:12.051 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:12.052 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:34:12.052 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:34:12.052 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:34:12.052 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:34:12.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.053 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:34:12.064 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:34:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:34:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:34:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:34:12.065 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:34:12.066 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:12.066 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:34:12.067 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:12.067 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:34:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:34:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 41951sec preferred_lft 41951sec 2024-09-13T18:34:12.067 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:34:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.068 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:34:12.068 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.069 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:12.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.071 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:34:12.116 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:34:12.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.118 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:34:12.169 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:34:12.170 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:34:12.170 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:34:12.170 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:34:12.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.170 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:34:12.170 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:34:12.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:34:12.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:34:12.171 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:34:12.171 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:34:12.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.249 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:34:12.297 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:34:12.297 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:34:12.298 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:34:12.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:34:12.357 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:34:12.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:12.358 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:12.405 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:34:12.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:12.405 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:12.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:34:12.515 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:12.515 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:12.567 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:12.568 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:12.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.569 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:34:12.617 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:34:12.617 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:34:12.662 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:34:12.678 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:12.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:12.730 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:12.731 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:12.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:12.732 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:34:12.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:34:12.743+0000 7fa4eebae580 -1 init, newargv = 0x565047202350 newargc=15 2024-09-13T18:34:12.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36691]: starting ceph client 2024-09-13T18:34:12.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36691]: starting fuse 2024-09-13T18:34:13.849 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:34:13.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:13.866 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:13.920 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:13.921 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:13.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:13.922 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:34:13.971 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:34:13.971 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:34:13.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:34:13.971 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:34:13.971 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:34:13.971 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:34:13.971 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:34:13.971 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:34:13.972 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:34:13.973 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:34:13.973 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:34:13.973 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:34:13.973 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:13.973 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:34:13.973 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:34:14.090 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.36691.asok 2024-09-13T18:34:14.274 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.36691.asok 2024-09-13T18:34:14.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:14.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.36691.asok status 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "36691", 2024-09-13T18:34:14.433 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 8815, 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 8815 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 505010554 2024-09-13T18:34:14.434 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 505010554 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.8815 192.168.0.1:0/505010554", 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/505010554", 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 96, 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 162, 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:34:14.435 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:34:14.436 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:34:14.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:14.446 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:34:14.447 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:14.452 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:34:14.452 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:14.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:14.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:14.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:34:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.648+0000 7f576720a640 1 Processor -- start 2024-09-13T18:34:14.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.648+0000 7f576720a640 1 -- start start 2024-09-13T18:34:14.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f576720a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576015a410 0x7f57600cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:14.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f576720a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:14.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f576720a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57600cbe80 con 0x7f576015a7f0 2024-09-13T18:34:14.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f576720a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57600b33d0 con 0x7f576015a410 2024-09-13T18:34:14.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f576720a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57600cc160 con 0x7f57600b4b10 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576015a410 0x7f57600cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576015a410 0x7f57600cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60834/0 (socket says 172.21.15.53:60834) 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 -- 172.21.15.53:0/2267641233 learned_addr learned my addr 172.21.15.53:0/2267641233 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f57657a7640 1 --2- 172.21.15.53:0/2267641233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 -- 172.21.15.53:0/2267641233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 msgr2=0x7f57600ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 --2- 172.21.15.53:0/2267641233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 -- 172.21.15.53:0/2267641233 >> v1:172.21.15.87:6789/0 conn(0x7f576015a7f0 legacy=0x7f57600ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 -- 172.21.15.53:0/2267641233 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57600cc440 con 0x7f576015a410 2024-09-13T18:34:14.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f57657a7640 1 --2- 172.21.15.53:0/2267641233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f5764fa6640 1 --2- 172.21.15.53:0/2267641233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a410 0x7f57600cca00 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f5754009870 tx=0x7f575401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8156b377c0e85741 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f575f7fe640 1 -- 172.21.15.53:0/2267641233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540a89d0 con 0x7f576015a410 2024-09-13T18:34:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f575f7fe640 1 -- 172.21.15.53:0/2267641233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57540a8b30 con 0x7f576015a410 2024-09-13T18:34:14.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.652+0000 7f575f7fe640 1 -- 172.21.15.53:0/2267641233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540b0440 con 0x7f576015a410 2024-09-13T18:34:14.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- 172.21.15.53:0/2267641233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a410 msgr2=0x7f57600cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:14.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 --2- 172.21.15.53:0/2267641233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a410 0x7f57600cca00 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f5754009870 tx=0x7f575401ed10 comp rx=0 tx=0).stop 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- 172.21.15.53:0/2267641233 shutdown_connections 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 --2- 172.21.15.53:0/2267641233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 --2- 172.21.15.53:0/2267641233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a410 0x7f57600cca00 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- 172.21.15.53:0/2267641233 >> 172.21.15.53:0/2267641233 conn(0x7f57600b20d0 msgr2=0x7f57600b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- 172.21.15.53:0/2267641233 shutdown_connections 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- 172.21.15.53:0/2267641233 wait complete. 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 Processor -- start 2024-09-13T18:34:14.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- start start 2024-09-13T18:34:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:14.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f576015a410 0x7f57601502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a7f0 0x7f576015c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57600c5790 con 0x7f576015a7f0 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57600c5a70 con 0x7f576015a410 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57600c4b10 con 0x7f57600b4b10 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a7f0 0x7f576015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a7f0 0x7f576015c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60844/0 (socket says 172.21.15.53:60844) 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 -- 172.21.15.53:0/3626227623 learned_addr learned my addr 172.21.15.53:0/3626227623 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f5764fa6640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:14.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f575ffff640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f576015a410 0x7f57601502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 -- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 msgr2=0x7f57600c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 -- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f576015a410 msgr2=0x7f57601502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f576015a410 0x7f57601502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 -- 172.21.15.53:0/3626227623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540094d0 con 0x7f576015a7f0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f57657a7640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a7f0 0x7f576015c560 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f575800cef0 tx=0x7f575800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f575d7fa640 1 -- 172.21.15.53:0/3626227623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800d840 con 0x7f576015a7f0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f575d7fa640 1 -- 172.21.15.53:0/3626227623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800d9c0 con 0x7f576015a7f0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57600c4df0 con 0x7f576015a7f0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f575d7fa640 1 -- 172.21.15.53:0/3626227623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800dd70 con 0x7f576015a7f0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.656+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57600c53b0 con 0x7f576015a7f0 2024-09-13T18:34:14.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.660+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57600c58d0 con 0x7f576015a7f0 2024-09-13T18:34:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.660+0000 7f575d7fa640 1 -- 172.21.15.53:0/3626227623 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f575801e3b0 con 0x7f576015a7f0 2024-09-13T18:34:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.660+0000 7f575d7fa640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5744066ea0 0x7f5744069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.660+0000 7f575d7fa640 1 -- 172.21.15.53:0/3626227623 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57580832e0 con 0x7f576015a7f0 2024-09-13T18:34:14.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.660+0000 7f5764fa6640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5744066ea0 0x7f5744069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:14.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.660+0000 7f5764fa6640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5744066ea0 0x7f5744069360 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f57540b2000 tx=0x7f5754008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:14.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.664+0000 7f575d7fa640 1 -- 172.21.15.53:0/3626227623 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f57600c58d0 con 0x7f576015a7f0 2024-09-13T18:34:14.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.860+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f57600c58d0 con 0x7f576015a7f0 2024-09-13T18:34:14.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.968+0000 7f575d7fa640 1 -- 172.21.15.53:0/3626227623 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v97) v1 ==== 136+0+0 (secure 0 0 0) 0x7f57600c58d0 con 0x7f576015a7f0 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5744066ea0 msgr2=0x7f5744069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5744066ea0 0x7f5744069360 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f57540b2000 tx=0x7f5754008040 comp rx=0 tx=0).stop 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a7f0 msgr2=0x7f576015c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a7f0 0x7f576015c560 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f575800cef0 tx=0x7f575800a710 comp rx=0 tx=0).stop 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 shutdown_connections 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5744066ea0 0x7f5744069360 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576015a7f0 0x7f576015c560 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f576015a410 0x7f57601502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 --2- 172.21.15.53:0/3626227623 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f57600b4b10 0x7f57600c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 >> 172.21.15.53:0/3626227623 conn(0x7f57600b20d0 msgr2=0x7f57600b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 shutdown_connections 2024-09-13T18:34:14.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:14.972+0000 7f576720a640 1 -- 172.21.15.53:0/3626227623 wait complete. 2024-09-13T18:34:14.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:34:15.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f7407640 1 Processor -- start 2024-09-13T18:34:15.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f7407640 1 -- start start 2024-09-13T18:34:15.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f7407640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18f01582a0 0x7f18f006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f7407640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f006d480 con 0x7f18f00713a0 2024-09-13T18:34:15.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f7407640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f015ace0 con 0x7f18f015b7c0 2024-09-13T18:34:15.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f7407640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f015aaf0 con 0x7f18f01582a0 2024-09-13T18:34:15.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f59a4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f18f00713a0 0x7f18f01640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52810/0 (socket says 172.21.15.53:52810) 2024-09-13T18:34:15.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f59a4640 1 -- 172.21.15.53:0/486561759 learned_addr learned my addr 172.21.15.53:0/486561759 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:15.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f51a3640 1 --2- 172.21.15.53:0/486561759 >> v2:172.21.15.87:3300/0 conn(0x7f18f01582a0 0x7f18f006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687402541 0 0) 0x7f18f006d480 con 0x7f18f00713a0 2024-09-13T18:34:15.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18dc003530 con 0x7f18f00713a0 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529628854 0 0) 0x7f18dc003530 con 0x7f18f00713a0 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 >> v2:172.21.15.87:3300/0 conn(0x7f18f01582a0 msgr2=0x7f18f006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 --2- 172.21.15.53:0/486561759 >> v2:172.21.15.87:3300/0 conn(0x7f18f01582a0 0x7f18f006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 >> v1:172.21.15.87:6789/0 conn(0x7f18f015b7c0 legacy=0x7f18f0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f015afc0 con 0x7f18f00713a0 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f18e8001a00 con 0x7f18f00713a0 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 >> v1:172.21.15.53:6789/0 conn(0x7f18f00713a0 legacy=0x7f18f01640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc003980 0x7f18dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0047d0 0x7f18dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc005190 0x7f18dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc00c000 con 0x7f18dc0047d0 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc00c170 con 0x7f18dc005190 2024-09-13T18:34:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc00c330 con 0x7f18dc003980 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f49a2640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0047d0 0x7f18dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f51a3640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc003980 0x7f18dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f59a4640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc005190 0x7f18dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f49a2640 1 -- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc003980 msgr2=0x7f18dc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f49a2640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc003980 0x7f18dc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f49a2640 1 -- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc005190 msgr2=0x7f18dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f49a2640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc005190 0x7f18dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f49a2640 1 -- 172.21.15.53:0/486561759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc003530 con 0x7f18dc0047d0 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f51a3640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc003980 0x7f18dc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f59a4640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18dc005190 0x7f18dc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.164+0000 7f18f59a4640 1 -- 172.21.15.53:0/486561759 reap_dead start 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f49a2640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0047d0 0x7f18dc004c50 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f18e0001780 tx=0x7f18e001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be44d80a3a82b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00052d0 con 0x7f18dc0047d0 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e00a7050 con 0x7f18dc0047d0 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18e7fff640 1 -- 172.21.15.53:0/486561759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0003600 con 0x7f18dc0047d0 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f7407640 1 -- 172.21.15.53:0/486561759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0047d0 msgr2=0x7f18dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f7407640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0047d0 0x7f18dc004c50 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f18e0001780 tx=0x7f18e001c400 comp rx=0 tx=0).stop 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f7407640 1 -- 172.21.15.53:0/486561759 shutdown_connections 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f7407640 1 --2- 172.21.15.53:0/486561759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18dc0047d0 0x7f18dc004c50 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f7407640 1 -- 172.21.15.53:0/486561759 >> 172.21.15.53:0/486561759 conn(0x7f18f0065c80 msgr2=0x7f18f0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f7407640 1 -- 172.21.15.53:0/486561759 shutdown_connections 2024-09-13T18:34:15.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.168+0000 7f18f7407640 1 -- 172.21.15.53:0/486561759 wait complete. 2024-09-13T18:34:15.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 Processor -- start 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 -- start start 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0047d0 0x7f18f0155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f01ed540 0x7f18f01f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f0155290 0x7f18f0152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0154ad0 con 0x7f18f0155290 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01f0900 con 0x7f18f01ed540 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01f0be0 con 0x7f18dc0047d0 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f0155290 0x7f18f0152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f0155290 0x7f18f0152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60858/0 (socket says 172.21.15.53:60858) 2024-09-13T18:34:15.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 -- 172.21.15.53:0/230427562 learned_addr learned my addr 172.21.15.53:0/230427562 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f51a3640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0047d0 0x7f18f0155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f49a2640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f01ed540 0x7f18f01f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 -- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0047d0 msgr2=0x7f18f0155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0047d0 0x7f18f0155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 -- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f01ed540 msgr2=0x7f18f01f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f01ed540 0x7f18f01f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 -- 172.21.15.53:0/230427562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f01f0ec0 con 0x7f18f0155290 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f59a4640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f0155290 0x7f18f0152ab0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f18e8000f90 tx=0x7f18e8010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18e5ffb640 1 -- 172.21.15.53:0/230427562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800e8b0 con 0x7f18f0155290 2024-09-13T18:34:15.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18e5ffb640 1 -- 172.21.15.53:0/230427562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e800ea10 con 0x7f18f0155290 2024-09-13T18:34:15.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f0154d70 con 0x7f18f0155290 2024-09-13T18:34:15.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18e5ffb640 1 -- 172.21.15.53:0/230427562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800ed80 con 0x7f18f0155290 2024-09-13T18:34:15.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f01f0580 con 0x7f18f0155290 2024-09-13T18:34:15.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.172+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f0067400 con 0x7f18f0155290 2024-09-13T18:34:15.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.176+0000 7f18e5ffb640 1 -- 172.21.15.53:0/230427562 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f18e8015400 con 0x7f18f0155290 2024-09-13T18:34:15.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.176+0000 7f18e5ffb640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d4066ea0 0x7f18d4069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.176+0000 7f18e5ffb640 1 -- 172.21.15.53:0/230427562 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18e8085150 con 0x7f18f0155290 2024-09-13T18:34:15.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.176+0000 7f18f51a3640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d4066ea0 0x7f18d4069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.176+0000 7f18f51a3640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d4066ea0 0x7f18d4069360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18f015aa80 tx=0x7f18ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:15.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.180+0000 7f18e5ffb640 1 -- 172.21.15.53:0/230427562 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18e8054170 con 0x7f18f0155290 2024-09-13T18:34:15.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.360+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f00cde10 con 0x7f18d4066ea0 2024-09-13T18:34:15.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18e5ffb640 1 -- 172.21.15.53:0/230427562 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f18f00cde10 con 0x7f18d4066ea0 2024-09-13T18:34:15.365 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:34:15.366 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:15.366 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:34:15.366 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:15.366 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:34:15.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d4066ea0 msgr2=0x7f18d4069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d4066ea0 0x7f18d4069360 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f18f015aa80 tx=0x7f18ec008040 comp rx=0 tx=0).stop 2024-09-13T18:34:15.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f0155290 msgr2=0x7f18f0152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f0155290 0x7f18f0152ab0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f18e8000f90 tx=0x7f18e8010bb0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 shutdown_connections 2024-09-13T18:34:15.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d4066ea0 0x7f18d4069360 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f0155290 0x7f18f0152ab0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f01ed540 0x7f18f01f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 --2- 172.21.15.53:0/230427562 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18dc0047d0 0x7f18f0155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 >> 172.21.15.53:0/230427562 conn(0x7f18f0065c80 msgr2=0x7f18f006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:15.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 shutdown_connections 2024-09-13T18:34:15.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.364+0000 7f18f7407640 1 -- 172.21.15.53:0/230427562 wait complete. 2024-09-13T18:34:15.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:34:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36f1112640 1 Processor -- start 2024-09-13T18:34:15.502 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36f1112640 1 -- start start 2024-09-13T18:34:15.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36f1112640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36ec0b1d80 0x7f36ec06a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36f1112640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36f1112640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ec15cd20 con 0x7f36ec15c940 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36f1112640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec0c9be0 con 0x7f36ec0b1d80 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36f1112640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0c9ec0 con 0x7f36ec0b2d00 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36ea59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36ec0b1d80 0x7f36ec06a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36ead9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f36ec15c940 0x7f36ec0cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52816/0 (socket says 172.21.15.53:52816) 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36ead9d640 1 -- 172.21.15.53:0/39231309 learned_addr learned my addr 172.21.15.53:0/39231309 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36eb59e640 1 --2- 172.21.15.53:0/39231309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36ea59c640 1 -- 172.21.15.53:0/39231309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 msgr2=0x7f36ec06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36ea59c640 1 --2- 172.21.15.53:0/39231309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec06a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36ea59c640 1 -- 172.21.15.53:0/39231309 >> v1:172.21.15.53:6789/0 conn(0x7f36ec15c940 legacy=0x7f36ec0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36e9d9b640 1 -- 172.21.15.53:0/39231309 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430032224 0 0) 0x7f36ec15cd20 con 0x7f36ec15c940 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36ea59c640 1 -- 172.21.15.53:0/39231309 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0ca1a0 con 0x7f36ec0b1d80 2024-09-13T18:34:15.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.500+0000 7f36eb59e640 1 --2- 172.21.15.53:0/39231309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec06a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:15.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36ea59c640 1 --2- 172.21.15.53:0/39231309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec0b1d80 0x7f36ec06a090 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f36e00097c0 tx=0x7f36e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ad22fd08f55308 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:15.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36e9d9b640 1 -- 172.21.15.53:0/39231309 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00ad680 con 0x7f36ec0b1d80 2024-09-13T18:34:15.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36e9d9b640 1 -- 172.21.15.53:0/39231309 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e00ad7e0 con 0x7f36ec0b1d80 2024-09-13T18:34:15.506 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36e9d9b640 1 -- 172.21.15.53:0/39231309 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00adb70 con 0x7f36ec0b1d80 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 -- 172.21.15.53:0/39231309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec0b1d80 msgr2=0x7f36ec06a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 --2- 172.21.15.53:0/39231309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec0b1d80 0x7f36ec06a090 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f36e00097c0 tx=0x7f36e001c470 comp rx=0 tx=0).stop 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 -- 172.21.15.53:0/39231309 shutdown_connections 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 --2- 172.21.15.53:0/39231309 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec06a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 --2- 172.21.15.53:0/39231309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec0b1d80 0x7f36ec06a090 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 -- 172.21.15.53:0/39231309 >> 172.21.15.53:0/39231309 conn(0x7f36ec0b21e0 msgr2=0x7f36ec0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 -- 172.21.15.53:0/39231309 shutdown_connections 2024-09-13T18:34:15.507 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 -- 172.21.15.53:0/39231309 wait complete. 2024-09-13T18:34:15.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 Processor -- start 2024-09-13T18:34:15.508 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.504+0000 7f36f1112640 1 -- start start 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36ec15c940 0x7f36ec145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec154360 0x7f36ec146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec157c70 con 0x7f36ec154360 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1561b0 con 0x7f36ec15c940 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec156470 con 0x7f36ec0b2d00 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec154360 0x7f36ec146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec154360 0x7f36ec146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60890/0 (socket says 172.21.15.53:60890) 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 -- 172.21.15.53:0/212711052 learned_addr learned my addr 172.21.15.53:0/212711052 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36ead9d640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36ea59c640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36ec15c940 0x7f36ec145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 -- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 msgr2=0x7f36ec157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 -- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36ec15c940 msgr2=0x7f36ec145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36ec15c940 0x7f36ec145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 -- 172.21.15.53:0/212711052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0009420 con 0x7f36ec154360 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36ea59c640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36ec15c940 0x7f36ec145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36eb59e640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec154360 0x7f36ec146480 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f36e400cef0 tx=0x7f36e400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36d37fe640 1 -- 172.21.15.53:0/212711052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400d840 con 0x7f36ec154360 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36d37fe640 1 -- 172.21.15.53:0/212711052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e400d9c0 con 0x7f36ec154360 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec156750 con 0x7f36ec154360 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36d37fe640 1 -- 172.21.15.53:0/212711052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400dd70 con 0x7f36ec154360 2024-09-13T18:34:15.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec146180 con 0x7f36ec154360 2024-09-13T18:34:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec1579d0 con 0x7f36ec154360 2024-09-13T18:34:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36d37fe640 1 -- 172.21.15.53:0/212711052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f36e401e3b0 con 0x7f36ec154360 2024-09-13T18:34:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36d37fe640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36d8066ea0 0x7f36d8069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:15.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36d37fe640 1 -- 172.21.15.53:0/212711052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36e4083600 con 0x7f36ec154360 2024-09-13T18:34:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36ead9d640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36d8066ea0 0x7f36d8069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:15.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.508+0000 7f36ead9d640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36d8066ea0 0x7f36d8069360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000f70 tx=0x7f36dc007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:15.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.512+0000 7f36d37fe640 1 -- 172.21.15.53:0/212711052 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36e4052630 con 0x7f36ec154360 2024-09-13T18:34:15.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.664+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f36ec1579d0 con 0x7f36ec154360 2024-09-13T18:34:15.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36d37fe640 1 -- 172.21.15.53:0/212711052 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36ec1579d0 con 0x7f36ec154360 2024-09-13T18:34:15.671 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36d8066ea0 msgr2=0x7f36d8069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36d8066ea0 0x7f36d8069360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000f70 tx=0x7f36dc007c10 comp rx=0 tx=0).stop 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec154360 msgr2=0x7f36ec146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec154360 0x7f36ec146480 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f36e400cef0 tx=0x7f36e400a710 comp rx=0 tx=0).stop 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 shutdown_connections 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f36d8066ea0 0x7f36d8069360 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36ec154360 0x7f36ec146480 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36ec15c940 0x7f36ec145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 --2- 172.21.15.53:0/212711052 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36ec0b2d00 0x7f36ec157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 >> 172.21.15.53:0/212711052 conn(0x7f36ec0b21e0 msgr2=0x7f36ec154940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 shutdown_connections 2024-09-13T18:34:15.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:15.668+0000 7f36f1112640 1 -- 172.21.15.53:0/212711052 wait complete. 2024-09-13T18:34:15.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:15.687 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol20500/d19cd1ce-dcf4-40ab-a2bd-22682cb7878c) 2024-09-13T18:34:15.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:15.711 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:34:15.760 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:34:15.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:15.760 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol20500/d19cd1ce-dcf4-40ab-a2bd-22682cb7878c) 2024-09-13T18:34:15.820 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:34:15.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol20500/.meta 2024-09-13T18:34:15.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:15.883 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp62670/subvol53981/d407a5bf-a3c9-48c5-8dd4-c53babebb339) 2024-09-13T18:34:15.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:15.945 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:34:16.000 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:34:16.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:16.001 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp62670/subvol53981/d407a5bf-a3c9-48c5-8dd4-c53babebb339) 2024-09-13T18:34:16.067 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:34:16.067 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp62670/subvol53981/.meta 2024-09-13T18:34:16.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol20500 2024-09-13T18:34:16.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55aff8b640 1 Processor -- start 2024-09-13T18:34:16.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55aff8b640 1 -- start start 2024-09-13T18:34:16.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55aff8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55a80caee0 0x7f55a80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55aff8b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a806f7a0 con 0x7f55a80cd320 2024-09-13T18:34:16.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55aff8b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a806fd60 con 0x7f55a8143e80 2024-09-13T18:34:16.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55aff8b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a806baa0 con 0x7f55a80caee0 2024-09-13T18:34:16.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55ae528640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f55a80cd320 0x7f55a80cd780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52826/0 (socket says 172.21.15.53:52826) 2024-09-13T18:34:16.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55ae528640 1 -- 172.21.15.53:0/996837720 learned_addr learned my addr 172.21.15.53:0/996837720 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:16.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55ad526640 1 --2- 172.21.15.53:0/996837720 >> v2:172.21.15.53:3300/0 conn(0x7f55a80caee0 0x7f55a80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55acd25640 1 -- 172.21.15.53:0/996837720 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867356394 0 0) 0x7f55a806f7a0 con 0x7f55a80cd320 2024-09-13T18:34:16.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55acd25640 1 -- 172.21.15.53:0/996837720 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5594003530 con 0x7f55a80cd320 2024-09-13T18:34:16.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55ad526640 1 -- 172.21.15.53:0/996837720 >> v1:172.21.15.87:6789/0 conn(0x7f55a8143e80 legacy=0x7f55a806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55ad526640 1 -- 172.21.15.53:0/996837720 >> v1:172.21.15.53:6789/0 conn(0x7f55a80cd320 legacy=0x7f55a80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.300+0000 7f55ad526640 1 -- 172.21.15.53:0/996837720 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a80cb960 con 0x7f55a80caee0 2024-09-13T18:34:16.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 --2- 172.21.15.53:0/996837720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80caee0 0x7f55a80cb350 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f55980097f0 tx=0x7f559801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66da6f6a82296608 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:16.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55acd25640 1 -- 172.21.15.53:0/996837720 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980ac640 con 0x7f55a80caee0 2024-09-13T18:34:16.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55acd25640 1 -- 172.21.15.53:0/996837720 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55980ac7a0 con 0x7f55a80caee0 2024-09-13T18:34:16.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55acd25640 1 -- 172.21.15.53:0/996837720 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980acb10 con 0x7f55a80caee0 2024-09-13T18:34:16.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- 172.21.15.53:0/996837720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80caee0 msgr2=0x7f55a80cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 --2- 172.21.15.53:0/996837720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80caee0 0x7f55a80cb350 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f55980097f0 tx=0x7f559801c3e0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- 172.21.15.53:0/996837720 shutdown_connections 2024-09-13T18:34:16.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 --2- 172.21.15.53:0/996837720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80caee0 0x7f55a80cb350 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- 172.21.15.53:0/996837720 >> 172.21.15.53:0/996837720 conn(0x7f55a8065c80 msgr2=0x7f55a8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:16.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- 172.21.15.53:0/996837720 shutdown_connections 2024-09-13T18:34:16.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- 172.21.15.53:0/996837720 wait complete. 2024-09-13T18:34:16.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 Processor -- start 2024-09-13T18:34:16.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- start start 2024-09-13T18:34:16.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a80caee0 0x7f55a8137390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80cd320 0x7f55a81378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a8143e80 0x7f55a81386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8139670 con 0x7f55a80cd320 2024-09-13T18:34:16.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a80b0980 con 0x7f55a8143e80 2024-09-13T18:34:16.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55aff8b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a80afbc0 con 0x7f55a80caee0 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80cd320 0x7f55a81378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80cd320 0x7f55a81378d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60910/0 (socket says 172.21.15.53:60910) 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 -- 172.21.15.53:0/2856038043 learned_addr learned my addr 172.21.15.53:0/2856038043 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55add27640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a80caee0 0x7f55a8137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ae528640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a8143e80 0x7f55a81386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 -- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a80caee0 msgr2=0x7f55a8137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a80caee0 0x7f55a8137390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 -- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a8143e80 msgr2=0x7f55a81386f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a8143e80 0x7f55a81386f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.304+0000 7f55ad526640 1 -- 172.21.15.53:0/2856038043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598009420 con 0x7f55a80cd320 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f55ad526640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80cd320 0x7f55a81378d0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f5598009740 tx=0x7f559801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f559e7fc640 1 -- 172.21.15.53:0/2856038043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598004230 con 0x7f55a80cd320 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f559e7fc640 1 -- 172.21.15.53:0/2856038043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598004390 con 0x7f55a80cd320 2024-09-13T18:34:16.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a80afea0 con 0x7f55a80cd320 2024-09-13T18:34:16.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f559e7fc640 1 -- 172.21.15.53:0/2856038043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598003820 con 0x7f55a80cd320 2024-09-13T18:34:16.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a80b0460 con 0x7f55a80cd320 2024-09-13T18:34:16.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a81393f0 con 0x7f55a80cd320 2024-09-13T18:34:16.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f559e7fc640 1 -- 172.21.15.53:0/2856038043 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f5598003980 con 0x7f55a80cd320 2024-09-13T18:34:16.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f559e7fc640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f558c066ea0 0x7f558c069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f559e7fc640 1 -- 172.21.15.53:0/2856038043 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f559811d1e0 con 0x7f55a80cd320 2024-09-13T18:34:16.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f55add27640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f558c066ea0 0x7f558c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.308+0000 7f55add27640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f558c066ea0 0x7f558c069360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f55a40015b0 tx=0x7f55a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:16.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.312+0000 7f559e7fc640 1 -- 172.21.15.53:0/2856038043 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55980ec150 con 0x7f55a80cd320 2024-09-13T18:34:16.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.496+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol20500", "target": ["mon-mgr", ""]}) v1 -- 0x7f55a80ce160 con 0x7f558c066ea0 2024-09-13T18:34:16.507 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:16.504+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:16.507 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:16.504+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:16.507 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:16.504+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:16.507 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:16.504+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:16.507 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:16.504+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:16.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f559e7fc640 1 -- 172.21.15.53:0/2856038043 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f55a4001210 con 0x7f558c066ea0 2024-09-13T18:34:16.558 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/_nogroup/subvol20500/d19cd1ce-dcf4-40ab-a2bd-22682cb7878c 2024-09-13T18:34:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f558c066ea0 msgr2=0x7f558c069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f558c066ea0 0x7f558c069360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f55a40015b0 tx=0x7f55a4009040 comp rx=0 tx=0).stop 2024-09-13T18:34:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80cd320 msgr2=0x7f55a81378d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80cd320 0x7f55a81378d0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f5598009740 tx=0x7f559801ac20 comp rx=0 tx=0).stop 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 shutdown_connections 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f558c066ea0 0x7f558c069360 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a8143e80 0x7f55a81386f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55a80cd320 0x7f55a81378d0 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 --2- 172.21.15.53:0/2856038043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a80caee0 0x7f55a8137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 >> 172.21.15.53:0/2856038043 conn(0x7f55a8065c80 msgr2=0x7f55a8155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 shutdown_connections 2024-09-13T18:34:16.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.556+0000 7f55aff8b640 1 -- 172.21.15.53:0/2856038043 wait complete. 2024-09-13T18:34:16.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol53981 subvol_grp62670 2024-09-13T18:34:16.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.696+0000 7f76c205c640 1 Processor -- start 2024-09-13T18:34:16.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.696+0000 7f76c205c640 1 -- start start 2024-09-13T18:34:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76c205c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76bc06ccc0 0x7f76bc06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76c205c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc070fb0 con 0x7f76bc15c5e0 2024-09-13T18:34:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76c205c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc06d620 con 0x7f76bc0cc800 2024-09-13T18:34:16.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76c205c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc070a10 con 0x7f76bc06ccc0 2024-09-13T18:34:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76b3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76bc06ccc0 0x7f76bc06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76bb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f76bc15c5e0 0x7f76bc15d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35028/0 (socket says 172.21.15.53:35028) 2024-09-13T18:34:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76bb7fe640 1 -- 172.21.15.53:0/2061627071 learned_addr learned my addr 172.21.15.53:0/2061627071 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76b3fff640 1 -- 172.21.15.53:0/2061627071 >> v1:172.21.15.87:6789/0 conn(0x7f76bc0cc800 legacy=0x7f76bc0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76b3fff640 1 -- 172.21.15.53:0/2061627071 >> v1:172.21.15.53:6789/0 conn(0x7f76bc15c5e0 legacy=0x7f76bc15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76baffd640 1 -- 172.21.15.53:0/2061627071 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215519495 0 0) 0x7f76bc070fb0 con 0x7f76bc15c5e0 2024-09-13T18:34:16.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76b3fff640 1 -- 172.21.15.53:0/2061627071 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0711e0 con 0x7f76bc06ccc0 2024-09-13T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76b3fff640 1 --2- 172.21.15.53:0/2061627071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc06d0e0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097c0 tx=0x7f76a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7643412f99cde7c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:16.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76baffd640 1 -- 172.21.15.53:0/2061627071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40ab600 con 0x7f76bc06ccc0 2024-09-13T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76baffd640 1 -- 172.21.15.53:0/2061627071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a40a7050 con 0x7f76bc06ccc0 2024-09-13T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.700+0000 7f76baffd640 1 -- 172.21.15.53:0/2061627071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40ab980 con 0x7f76bc06ccc0 2024-09-13T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- 172.21.15.53:0/2061627071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 msgr2=0x7f76bc06d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 --2- 172.21.15.53:0/2061627071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc06d0e0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097c0 tx=0x7f76a401c430 comp rx=0 tx=0).stop 2024-09-13T18:34:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- 172.21.15.53:0/2061627071 shutdown_connections 2024-09-13T18:34:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 --2- 172.21.15.53:0/2061627071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc06d0e0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- 172.21.15.53:0/2061627071 >> 172.21.15.53:0/2061627071 conn(0x7f76bc073330 msgr2=0x7f76bc065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- 172.21.15.53:0/2061627071 shutdown_connections 2024-09-13T18:34:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- 172.21.15.53:0/2061627071 wait complete. 2024-09-13T18:34:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 Processor -- start 2024-09-13T18:34:16.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- start start 2024-09-13T18:34:16.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76bc0cc800 0x7f76bc14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15c5e0 0x7f76bc1492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc14ca00 con 0x7f76bc06ccc0 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc14bd60 con 0x7f76bc15c5e0 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc14c3d0 con 0x7f76bc0cc800 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc14b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33352/0 (socket says 172.21.15.53:33352) 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 -- 172.21.15.53:0/4165517824 learned_addr learned my addr 172.21.15.53:0/4165517824 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76b3fff640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76bc0cc800 0x7f76bc14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bbfff640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15c5e0 0x7f76bc1492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 -- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76bc0cc800 msgr2=0x7f76bc14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76bc0cc800 0x7f76bc14f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 -- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15c5e0 msgr2=0x7f76bc1492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:16.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15c5e0 0x7f76bc1492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 -- 172.21.15.53:0/4165517824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009420 con 0x7f76bc06ccc0 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bbfff640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15c5e0 0x7f76bc1492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76bb7fe640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc14b0e0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c480 tx=0x7f76ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0074e0 con 0x7f76bc06ccc0 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac007660 con 0x7f76bc06ccc0 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc14b7a0 con 0x7f76bc06ccc0 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac004a30 con 0x7f76bc06ccc0 2024-09-13T18:34:16.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.704+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc14c620 con 0x7f76bc06ccc0 2024-09-13T18:34:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.708+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc15c9c0 con 0x7f76bc06ccc0 2024-09-13T18:34:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.708+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 24) v1 ==== 86806+0+0 (secure 0 0 0) 0x7f76ac004b90 con 0x7f76bc06ccc0 2024-09-13T18:34:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.708+0000 7f76b8ff9640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f769c066e70 0x7f769c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:16.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.708+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76ac081a20 con 0x7f76bc06ccc0 2024-09-13T18:34:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.708+0000 7f76b3fff640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f769c066e70 0x7f769c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:16.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.708+0000 7f76b3fff640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f769c066e70 0x7f769c069330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76bc066920 tx=0x7f76a40a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:16.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.712+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f76ac054420 con 0x7f76bc06ccc0 2024-09-13T18:34:16.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.900+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol53981", "group_name": "subvol_grp62670", "target": ["mon-mgr", ""]}) v1 -- 0x7f76bc065c80 con 0x7f769c066e70 2024-09-13T18:34:16.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.992+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f76bc065c80 con 0x7f769c066e70 2024-09-13T18:34:16.997 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp62670/subvol53981/d407a5bf-a3c9-48c5-8dd4-c53babebb339 2024-09-13T18:34:16.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76b8ff9640 1 -- 172.21.15.53:0/4165517824 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 25) v1 ==== 86857+0+0 (secure 0 0 0) 0x7f76ac050d60 con 0x7f76bc06ccc0 2024-09-13T18:34:17.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f769c066e70 msgr2=0x7f769c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.000 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f769c066e70 0x7f769c069330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76bc066920 tx=0x7f76a40a6000 comp rx=0 tx=0).stop 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 msgr2=0x7f76bc14b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc14b0e0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c480 tx=0x7f76ac00c940 comp rx=0 tx=0).stop 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 shutdown_connections 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f769c066e70 0x7f769c069330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f76bc0cc800 0x7f76bc14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76bc15c5e0 0x7f76bc1492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 --2- 172.21.15.53:0/4165517824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76bc06ccc0 0x7f76bc14b0e0 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 >> 172.21.15.53:0/4165517824 conn(0x7f76bc073330 msgr2=0x7f76bc0adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:17.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 shutdown_connections 2024-09-13T18:34:17.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:16.996+0000 7f76c205c640 1 -- 172.21.15.53:0/4165517824 wait complete. 2024-09-13T18:34:17.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:17.022 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol20500/.meta) 2024-09-13T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stdout:version = 2 2024-09-13T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:34:17.040 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/_nogroup/subvol20500/d19cd1ce-dcf4-40ab-a2bd-22682cb7878c 2024-09-13T18:34:17.041 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:34:17.041 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:17.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:17.042 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp62670/subvol53981/.meta) 2024-09-13T18:34:17.100 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:34:17.100 INFO:teuthology.orchestra.run.smithi053.stdout:version = 2 2024-09-13T18:34:17.100 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:34:17.101 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/subvol_grp62670/subvol53981/d407a5bf-a3c9-48c5-8dd4-c53babebb339 2024-09-13T18:34:17.101 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:34:17.101 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:17.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol20500 2024-09-13T18:34:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbec3f640 1 Processor -- start 2024-09-13T18:34:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbec3f640 1 -- start start 2024-09-13T18:34:17.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbec3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4bb8156c40 0x7f4bb8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbec3f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4bb8157020 0x7f4bb806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbec3f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb806d6e0 con 0x7f4bb806d270 2024-09-13T18:34:17.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbec3f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb8070340 con 0x7f4bb8156c40 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbec3f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb80b15a0 con 0x7f4bb8157020 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbc9db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4bb8156c40 0x7f4bb8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbc9db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4bb8156c40 0x7f4bb8070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33368/0 (socket says 172.21.15.53:33368) 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbc9db640 1 -- 172.21.15.53:0/1865232458 learned_addr learned my addr 172.21.15.53:0/1865232458 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bb7fff640 1 --2- 172.21.15.53:0/1865232458 >> v2:172.21.15.87:3300/0 conn(0x7f4bb8157020 0x7f4bb806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbc9db640 1 -- 172.21.15.53:0/1865232458 >> v2:172.21.15.87:3300/0 conn(0x7f4bb8157020 msgr2=0x7f4bb806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbc9db640 1 --2- 172.21.15.53:0/1865232458 >> v2:172.21.15.87:3300/0 conn(0x7f4bb8157020 0x7f4bb806cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbc9db640 1 -- 172.21.15.53:0/1865232458 >> v1:172.21.15.87:6789/0 conn(0x7f4bb806d270 legacy=0x7f4bb815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.280+0000 7f4bbc9db640 1 -- 172.21.15.53:0/1865232458 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80b1880 con 0x7f4bb8156c40 2024-09-13T18:34:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbc9db640 1 --2- 172.21.15.53:0/1865232458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb8156c40 0x7f4bb8070ee0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80cae90 tx=0x7f4bac01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6ab356649e81f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bb77fe640 1 -- 172.21.15.53:0/1865232458 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0a7b70 con 0x7f4bb8156c40 2024-09-13T18:34:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bb77fe640 1 -- 172.21.15.53:0/1865232458 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0a7cd0 con 0x7f4bb8156c40 2024-09-13T18:34:17.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bb77fe640 1 -- 172.21.15.53:0/1865232458 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0af660 con 0x7f4bb8156c40 2024-09-13T18:34:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- 172.21.15.53:0/1865232458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb8156c40 msgr2=0x7f4bb8070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/1865232458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb8156c40 0x7f4bb8070ee0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80cae90 tx=0x7f4bac01eb80 comp rx=0 tx=0).stop 2024-09-13T18:34:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- 172.21.15.53:0/1865232458 shutdown_connections 2024-09-13T18:34:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/1865232458 >> v2:172.21.15.87:3300/0 conn(0x7f4bb8157020 0x7f4bb806cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/1865232458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb8156c40 0x7f4bb8070ee0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- 172.21.15.53:0/1865232458 >> 172.21.15.53:0/1865232458 conn(0x7f4bb8065c80 msgr2=0x7f4bb8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- 172.21.15.53:0/1865232458 shutdown_connections 2024-09-13T18:34:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- 172.21.15.53:0/1865232458 wait complete. 2024-09-13T18:34:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 Processor -- start 2024-09-13T18:34:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- start start 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb806d270 0x7f4bb81408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bb8156c40 0x7f4bb81f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb815b880 0x7f4bb80ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80cacc0 con 0x7f4bb806d270 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb81f6030 con 0x7f4bb815b880 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbec3f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb815bd00 con 0x7f4bb8156c40 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbc9db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb806d270 0x7f4bb81408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbc9db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb806d270 0x7f4bb81408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33370/0 (socket says 172.21.15.53:33370) 2024-09-13T18:34:17.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbc9db640 1 -- 172.21.15.53:0/2279863030 learned_addr learned my addr 172.21.15.53:0/2279863030 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bb7fff640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bb8156c40 0x7f4bb81f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.284+0000 7f4bbd1dc640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb815b880 0x7f4bb80ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbc9db640 1 -- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bb8156c40 msgr2=0x7f4bb81f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbc9db640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bb8156c40 0x7f4bb81f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbc9db640 1 -- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb815b880 msgr2=0x7f4bb80ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbc9db640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb815b880 0x7f4bb80ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbc9db640 1 -- 172.21.15.53:0/2279863030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac00b770 con 0x7f4bb806d270 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbc9db640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb806d270 0x7f4bb81408e0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b2c0 tx=0x7f4bac01b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb57fa640 1 -- 172.21.15.53:0/2279863030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0a7b70 con 0x7f4bb806d270 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb57fa640 1 -- 172.21.15.53:0/2279863030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0ba440 con 0x7f4bb806d270 2024-09-13T18:34:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb815aac0 con 0x7f4bb806d270 2024-09-13T18:34:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb57fa640 1 -- 172.21.15.53:0/2279863030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0ba7d0 con 0x7f4bb806d270 2024-09-13T18:34:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb815b080 con 0x7f4bb806d270 2024-09-13T18:34:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb80b0000 con 0x7f4bb806d270 2024-09-13T18:34:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb57fa640 1 -- 172.21.15.53:0/2279863030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 86857+0+0 (secure 0 0 0) 0x7f4bac0b93e0 con 0x7f4bb806d270 2024-09-13T18:34:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb57fa640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4ba4066f00 0x7f4ba40693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb57fa640 1 -- 172.21.15.53:0/2279863030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bac0a7e40 con 0x7f4bb806d270 2024-09-13T18:34:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb7fff640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4ba4066f00 0x7f4ba40693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.288+0000 7f4bb7fff640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4ba4066f00 0x7f4ba40693c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80cdd80 tx=0x7f4ba8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:17.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.292+0000 7f4bb57fa640 1 -- 172.21.15.53:0/2279863030 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bac0ec370 con 0x7f4bb806d270 2024-09-13T18:34:17.479 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.476+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol20500", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb80b26c0 con 0x7f4ba4066f00 2024-09-13T18:34:17.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.492+0000 7f4bb57fa640 1 -- 172.21.15.53:0/2279863030 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4ba800be80 con 0x7f4ba4066f00 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4ba4066f00 msgr2=0x7f4ba40693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4ba4066f00 0x7f4ba40693c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80cdd80 tx=0x7f4ba8008040 comp rx=0 tx=0).stop 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb806d270 msgr2=0x7f4bb81408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb806d270 0x7f4bb81408e0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b2c0 tx=0x7f4bac01b920 comp rx=0 tx=0).stop 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 shutdown_connections 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4ba4066f00 0x7f4ba40693c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bb8156c40 0x7f4bb81f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4bb815b880 0x7f4bb80ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 --2- 172.21.15.53:0/2279863030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bb806d270 0x7f4bb81408e0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 >> 172.21.15.53:0/2279863030 conn(0x7f4bb8065c80 msgr2=0x7f4bb80cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 shutdown_connections 2024-09-13T18:34:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.496+0000 7f4bbec3f640 1 -- 172.21.15.53:0/2279863030 wait complete. 2024-09-13T18:34:17.501 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.500+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.501 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.500+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.501 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.500+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.501 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.500+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.501 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.500+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.517 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.516+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.517 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.516+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.517 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.516+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.517 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.516+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.517 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:17.516+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:17.519 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol53981 subvol_grp62670 2024-09-13T18:34:17.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb83af07640 1 Processor -- start 2024-09-13T18:34:17.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb83af07640 1 -- start start 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb83af07640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8340cd6f0 0x7fb8340b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb83af07640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb8340cdad0 0x7fb834143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb83af07640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340b3020 con 0x7fb834143d50 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb83af07640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340b1f80 con 0x7fb8340cd6f0 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb83af07640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340b2260 con 0x7fb8340cdad0 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb838ca3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8340cd6f0 0x7fb8340b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb838ca3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8340cd6f0 0x7fb8340b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33412/0 (socket says 172.21.15.53:33412) 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb838ca3640 1 -- 172.21.15.53:0/87142658 learned_addr learned my addr 172.21.15.53:0/87142658 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb833fff640 1 --2- 172.21.15.53:0/87142658 >> v2:172.21.15.87:3300/0 conn(0x7fb8340cdad0 0x7fb834143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb838ca3640 1 -- 172.21.15.53:0/87142658 >> v2:172.21.15.87:3300/0 conn(0x7fb8340cdad0 msgr2=0x7fb834143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:17.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb838ca3640 1 --2- 172.21.15.53:0/87142658 >> v2:172.21.15.87:3300/0 conn(0x7fb8340cdad0 0x7fb834143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb838ca3640 1 -- 172.21.15.53:0/87142658 >> v1:172.21.15.87:6789/0 conn(0x7fb834143d50 legacy=0x7fb83415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:17.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.636+0000 7fb838ca3640 1 -- 172.21.15.53:0/87142658 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340b2540 con 0x7fb8340cd6f0 2024-09-13T18:34:17.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb838ca3640 1 --2- 172.21.15.53:0/87142658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cd6f0 0x7fb8340b1490 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fb8340adae0 tx=0x7fb82401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e64628227765a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:17.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb8337fe640 1 -- 172.21.15.53:0/87142658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240ac630 con 0x7fb8340cd6f0 2024-09-13T18:34:17.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb8337fe640 1 -- 172.21.15.53:0/87142658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8240ac790 con 0x7fb8340cd6f0 2024-09-13T18:34:17.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb8337fe640 1 -- 172.21.15.53:0/87142658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240acb20 con 0x7fb8340cd6f0 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 -- 172.21.15.53:0/87142658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cd6f0 msgr2=0x7fb8340b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 --2- 172.21.15.53:0/87142658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cd6f0 0x7fb8340b1490 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fb8340adae0 tx=0x7fb82401c4b0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 -- 172.21.15.53:0/87142658 shutdown_connections 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 --2- 172.21.15.53:0/87142658 >> v2:172.21.15.87:3300/0 conn(0x7fb8340cdad0 0x7fb834143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 --2- 172.21.15.53:0/87142658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cd6f0 0x7fb8340b1490 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 -- 172.21.15.53:0/87142658 >> 172.21.15.53:0/87142658 conn(0x7fb834073330 msgr2=0x7fb834065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 -- 172.21.15.53:0/87142658 shutdown_connections 2024-09-13T18:34:17.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.640+0000 7fb83af07640 1 -- 172.21.15.53:0/87142658 wait complete. 2024-09-13T18:34:17.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 Processor -- start 2024-09-13T18:34:17.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 -- start start 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8340cd6f0 0x7fb8341411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cdad0 0x7fb8340a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb834143d50 0x7fb8340ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340a93d0 con 0x7fb8340cdad0 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341418c0 con 0x7fb834143d50 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb834141ba0 con 0x7fb8340cd6f0 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cdad0 0x7fb8340a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cdad0 0x7fb8340a8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33416/0 (socket says 172.21.15.53:33416) 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 -- 172.21.15.53:0/3000023883 learned_addr learned my addr 172.21.15.53:0/3000023883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb838ca3640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8340cd6f0 0x7fb8341411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb8394a4640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb834143d50 0x7fb8340ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 -- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8340cd6f0 msgr2=0x7fb8341411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8340cd6f0 0x7fb8341411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 -- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb834143d50 msgr2=0x7fb8340ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb834143d50 0x7fb8340ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 -- 172.21.15.53:0/3000023883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240094d0 con 0x7fb8340cdad0 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb8394a4640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb834143d50 0x7fb8340ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb838ca3640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8340cd6f0 0x7fb8341411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb833fff640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cdad0 0x7fb8340a8e90 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00d800 tx=0x7fb81c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00b6c0 con 0x7fb8340cdad0 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00b820 con 0x7fb8340cdad0 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834141e80 con 0x7fb8340cdad0 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00bb90 con 0x7fb8340cdad0 2024-09-13T18:34:17.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb834142440 con 0x7fb8340cdad0 2024-09-13T18:34:17.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb834142600 con 0x7fb8340cdad0 2024-09-13T18:34:17.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.644+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 25) v1 ==== 86857+0+0 (secure 0 0 0) 0x7fb81c00bcf0 con 0x7fb8340cdad0 2024-09-13T18:34:17.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.648+0000 7fb8317fa640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb814066f30 0x7fb8140693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:17.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.648+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb81c083c70 con 0x7fb8340cdad0 2024-09-13T18:34:17.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.648+0000 7fb838ca3640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb814066f30 0x7fb8140693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:17.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.648+0000 7fb838ca3640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb814066f30 0x7fb8140693f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ae000 tx=0x7fb824008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:17.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.648+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb81c052860 con 0x7fb8340cdad0 2024-09-13T18:34:17.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:17.836+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol53981", "group_name": "subvol_grp62670", "target": ["mon-mgr", ""]}) v1 -- 0x7fb83406c330 con 0x7fb814066f30 2024-09-13T18:34:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:19.028+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fb81c052c30 con 0x7fb8340cdad0 2024-09-13T18:34:24.210 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.208+0000 7fb8317fa640 1 -- 172.21.15.53:0/3000023883 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb8240ac900 con 0x7fb814066f30 2024-09-13T18:34:24.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb814066f30 msgr2=0x7fb8140693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb814066f30 0x7fb8140693f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ae000 tx=0x7fb824008040 comp rx=0 tx=0).stop 2024-09-13T18:34:24.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cdad0 msgr2=0x7fb8340a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cdad0 0x7fb8340a8e90 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00d800 tx=0x7fb81c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 shutdown_connections 2024-09-13T18:34:24.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb814066f30 0x7fb8140693f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb834143d50 0x7fb8340ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8340cdad0 0x7fb8340a8e90 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 --2- 172.21.15.53:0/3000023883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8340cd6f0 0x7fb8341411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 >> 172.21.15.53:0/3000023883 conn(0x7fb834073330 msgr2=0x7fb8340b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:24.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 shutdown_connections 2024-09-13T18:34:24.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.212+0000 7fb83af07640 1 -- 172.21.15.53:0/3000023883 wait complete. 2024-09-13T18:34:24.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:24.236 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:34:24.250 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-09-13T18:34:24.251 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:34:24.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:34:24.378 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:34:24.454 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:34:24.454 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:34:24.454 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:24.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:24.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7de15f640 1 Processor -- start 2024-09-13T18:34:24.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7de15f640 1 -- start start 2024-09-13T18:34:24.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7de15f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa7d815cdc0 0x7fa7d815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7de15f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d806d980 con 0x7fa7d815d760 2024-09-13T18:34:24.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7de15f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d806d650 con 0x7fa7d815a3b0 2024-09-13T18:34:24.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7de15f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d80d1560 con 0x7fa7d815cdc0 2024-09-13T18:34:24.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa7d815d760 0x7fa7d806de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35036/0 (socket says 172.21.15.53:35036) 2024-09-13T18:34:24.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 -- 172.21.15.53:0/1660176186 learned_addr learned my addr 172.21.15.53:0/1660176186 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:24.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d6ffd640 1 --2- 172.21.15.53:0/1660176186 >> v2:172.21.15.87:3300/0 conn(0x7fa7d815cdc0 0x7fa7d815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396224152 0 0) 0x7fa7d806d980 con 0x7fa7d815d760 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c0003530 con 0x7fa7d815d760 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287228270 0 0) 0x7fa7c0003530 con 0x7fa7d815d760 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 >> v2:172.21.15.87:3300/0 conn(0x7fa7d815cdc0 msgr2=0x7fa7d815d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 --2- 172.21.15.53:0/1660176186 >> v2:172.21.15.87:3300/0 conn(0x7fa7d815cdc0 0x7fa7d815d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 >> v1:172.21.15.87:6789/0 conn(0x7fa7d815a3b0 legacy=0x7fa7d80b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80b53e0 con 0x7fa7d815d760 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fa7c8001680 con 0x7fa7d815d760 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 >> v1:172.21.15.53:6789/0 conn(0x7fa7d815d760 legacy=0x7fa7d806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7c0003980 0x7fa7c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c00047d0 0x7fa7c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c0005190 0x7fa7c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80d1560 con 0x7fa7c0005190 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c000c030 con 0x7fa7c00047d0 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c000c1f0 con 0x7fa7c0003980 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c0005190 0x7fa7c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d77fe640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7c0003980 0x7fa7c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d6ffd640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c00047d0 0x7fa7c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 -- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7c0003980 msgr2=0x7fa7c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7c0003980 0x7fa7c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 -- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c00047d0 msgr2=0x7fa7c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:24.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c00047d0 0x7fa7c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d7fff640 1 -- 172.21.15.53:0/1660176186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0003530 con 0x7fa7c0005190 2024-09-13T18:34:24.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.636+0000 7fa7d77fe640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7c0003980 0x7fa7c0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7d7fff640 1 -- 172.21.15.53:0/1660176186 reap_dead start 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7d7fff640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c0005190 0x7fa7c000b990 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c240 tx=0x7fa7c801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8b444ece3898fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a5b60 con 0x7fa7c0005190 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80a5ce0 con 0x7fa7c0005190 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7d67fc640 1 -- 172.21.15.53:0/1660176186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8005b20 con 0x7fa7c0005190 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 -- 172.21.15.53:0/1660176186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c0005190 msgr2=0x7fa7c000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c0005190 0x7fa7c000b990 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c240 tx=0x7fa7c801cc60 comp rx=0 tx=0).stop 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 -- 172.21.15.53:0/1660176186 shutdown_connections 2024-09-13T18:34:24.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 --2- 172.21.15.53:0/1660176186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c0005190 0x7fa7c000b990 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 -- 172.21.15.53:0/1660176186 >> 172.21.15.53:0/1660176186 conn(0x7fa7d8071a50 msgr2=0x7fa7d8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:24.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 -- 172.21.15.53:0/1660176186 shutdown_connections 2024-09-13T18:34:24.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 -- 172.21.15.53:0/1660176186 wait complete. 2024-09-13T18:34:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 Processor -- start 2024-09-13T18:34:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.640+0000 7fa7de15f640 1 -- start start 2024-09-13T18:34:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c0005190 0x7fa7d8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7d80b2c00 0x7fa7d8154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d80b11b0 0x7fa7d80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81550e0 con 0x7fa7d80b11b0 2024-09-13T18:34:24.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8154b20 con 0x7fa7c0005190 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8154e00 con 0x7fa7d80b2c00 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d80b11b0 0x7fa7d80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d80b11b0 0x7fa7d80b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33424/0 (socket says 172.21.15.53:33424) 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 -- 172.21.15.53:0/3460439834 learned_addr learned my addr 172.21.15.53:0/3460439834 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d6ffd640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7d80b2c00 0x7fa7d8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d77fe640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c0005190 0x7fa7d8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 -- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7d80b2c00 msgr2=0x7fa7d8154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7d80b2c00 0x7fa7d8154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 -- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c0005190 msgr2=0x7fa7d8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c0005190 0x7fa7d8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 -- 172.21.15.53:0/3460439834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80b0cb0 con 0x7fa7d80b11b0 2024-09-13T18:34:24.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d6ffd640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7d80b2c00 0x7fa7d8154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d7fff640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d80b11b0 0x7fa7d80b1660 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fa7c801ca90 tx=0x7fa7c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7bffff640 1 -- 172.21.15.53:0/3460439834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8001640 con 0x7fa7d80b11b0 2024-09-13T18:34:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7bffff640 1 -- 172.21.15.53:0/3460439834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80a5b70 con 0x7fa7d80b11b0 2024-09-13T18:34:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d81e5c90 con 0x7fa7d80b11b0 2024-09-13T18:34:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7bffff640 1 -- 172.21.15.53:0/3460439834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80072d0 con 0x7fa7d80b11b0 2024-09-13T18:34:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d81e6140 con 0x7fa7d80b11b0 2024-09-13T18:34:24.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d80ad470 con 0x7fa7d80b11b0 2024-09-13T18:34:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7bffff640 1 -- 172.21.15.53:0/3460439834 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fa7c80b4020 con 0x7fa7d80b11b0 2024-09-13T18:34:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7bffff640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa7c4067050 0x7fa7c4069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7d77fe640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa7c4067050 0x7fa7c4069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.644+0000 7fa7bffff640 1 -- 172.21.15.53:0/3460439834 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c811c6e0 con 0x7fa7d80b11b0 2024-09-13T18:34:24.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.648+0000 7fa7d77fe640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa7c4067050 0x7fa7c4069510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa7d815fcc0 tx=0x7fa7d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:24.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.652+0000 7fa7bffff640 1 -- 172.21.15.53:0/3460439834 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7c80eb3b0 con 0x7fa7d80b11b0 2024-09-13T18:34:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.812+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7d806f090 con 0x7fa7d80b11b0 2024-09-13T18:34:24.817 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7bffff640 1 -- 172.21.15.53:0/3460439834 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16519 (secure 0 0 0) 0x7fa7c80ee9d0 con 0x7fa7d80b11b0 2024-09-13T18:34:24.818 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:24.818 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":162,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:59.644771+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa7c4067050 msgr2=0x7fa7c4069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa7c4067050 0x7fa7c4069510 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa7d815fcc0 tx=0x7fa7d0009040 comp rx=0 tx=0).stop 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d80b11b0 msgr2=0x7fa7d80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d80b11b0 0x7fa7d80b1660 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fa7c801ca90 tx=0x7fa7c0005800 comp rx=0 tx=0).stop 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 shutdown_connections 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa7c4067050 0x7fa7c4069510 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa7d80b2c00 0x7fa7d8154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7d80b11b0 0x7fa7d80b1660 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 --2- 172.21.15.53:0/3460439834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7c0005190 0x7fa7d8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 >> 172.21.15.53:0/3460439834 conn(0x7fa7d8071a50 msgr2=0x7fa7d8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:24.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 shutdown_connections 2024-09-13T18:34:24.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.816+0000 7fa7de15f640 1 -- 172.21.15.53:0/3460439834 wait complete. 2024-09-13T18:34:24.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:56.968030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:57.623731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:34:24.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:34:24.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 Processor -- start 2024-09-13T18:34:24.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 -- start start 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef74159630 0x7fef740ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef74159a10 0x7fef740cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef740b3dd0 0x7fef740cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740b3940 con 0x7fef74159a10 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef74073490 con 0x7fef740b3dd0 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef792c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef740b3610 con 0x7fef74159630 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef74159a10 0x7fef740cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef74159a10 0x7fef740cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33430/0 (socket says 172.21.15.53:33430) 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 -- 172.21.15.53:0/2140990420 learned_addr learned my addr 172.21.15.53:0/2140990420 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef737fe640 1 --2- 172.21.15.53:0/2140990420 >> v2:172.21.15.87:3300/0 conn(0x7fef740b3dd0 0x7fef740cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef72ffd640 1 --2- 172.21.15.53:0/2140990420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef74159630 0x7fef740ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 -- 172.21.15.53:0/2140990420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef74159630 msgr2=0x7fef740ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:24.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 --2- 172.21.15.53:0/2140990420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef74159630 0x7fef740ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 -- 172.21.15.53:0/2140990420 >> v2:172.21.15.87:3300/0 conn(0x7fef740b3dd0 msgr2=0x7fef740cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:24.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 --2- 172.21.15.53:0/2140990420 >> v2:172.21.15.87:3300/0 conn(0x7fef740b3dd0 0x7fef740cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef727fc640 1 -- 172.21.15.53:0/2140990420 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740adfd0 con 0x7fef74159a10 2024-09-13T18:34:24.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.960+0000 7fef737fe640 1 --2- 172.21.15.53:0/2140990420 >> v2:172.21.15.87:3300/0 conn(0x7fef740b3dd0 0x7fef740cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:24.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef727fc640 1 --2- 172.21.15.53:0/2140990420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef740cd0c0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fef7406fbe0 tx=0x7fef6801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d5eb71bf52cfe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:24.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef71ffb640 1 -- 172.21.15.53:0/2140990420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680a7bf0 con 0x7fef74159a10 2024-09-13T18:34:24.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef71ffb640 1 -- 172.21.15.53:0/2140990420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef680a7d50 con 0x7fef74159a10 2024-09-13T18:34:24.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef71ffb640 1 -- 172.21.15.53:0/2140990420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680af660 con 0x7fef74159a10 2024-09-13T18:34:24.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 -- 172.21.15.53:0/2140990420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 msgr2=0x7fef740cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 --2- 172.21.15.53:0/2140990420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef740cd0c0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fef7406fbe0 tx=0x7fef6801eb60 comp rx=0 tx=0).stop 2024-09-13T18:34:24.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 -- 172.21.15.53:0/2140990420 shutdown_connections 2024-09-13T18:34:24.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 --2- 172.21.15.53:0/2140990420 >> v2:172.21.15.87:3300/0 conn(0x7fef740b3dd0 0x7fef740cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 --2- 172.21.15.53:0/2140990420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef740cd0c0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 --2- 172.21.15.53:0/2140990420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef74159630 0x7fef740ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 -- 172.21.15.53:0/2140990420 >> 172.21.15.53:0/2140990420 conn(0x7fef740b0a30 msgr2=0x7fef740b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:24.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 -- 172.21.15.53:0/2140990420 shutdown_connections 2024-09-13T18:34:24.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.964+0000 7fef792c8640 1 -- 172.21.15.53:0/2140990420 wait complete. 2024-09-13T18:34:24.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 Processor -- start 2024-09-13T18:34:24.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 -- start start 2024-09-13T18:34:24.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef740b3dd0 0x7fef7414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef74159630 0x7fef7415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef7415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef741548f0 con 0x7fef74159a10 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7415c0b0 con 0x7fef74159630 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7415cd40 con 0x7fef740b3dd0 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef7415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef7415b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33444/0 (socket says 172.21.15.53:33444) 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 -- 172.21.15.53:0/3456093331 learned_addr learned my addr 172.21.15.53:0/3456093331 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef72ffd640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef740b3dd0 0x7fef7414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef727fc640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef74159630 0x7fef7415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 -- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef740b3dd0 msgr2=0x7fef7414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef740b3dd0 0x7fef7414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 -- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef74159630 msgr2=0x7fef7415c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef74159630 0x7fef7415c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 -- 172.21.15.53:0/3456093331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6800b770 con 0x7fef74159a10 2024-09-13T18:34:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef737fe640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef7415b060 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00e5e0 tx=0x7fef6c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef5b7fe640 1 -- 172.21.15.53:0/3456093331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c004230 con 0x7fef74159a10 2024-09-13T18:34:24.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef5b7fe640 1 -- 172.21.15.53:0/3456093331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c004390 con 0x7fef74159a10 2024-09-13T18:34:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef5b7fe640 1 -- 172.21.15.53:0/3456093331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c003860 con 0x7fef74159a10 2024-09-13T18:34:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef74154610 con 0x7fef74159a10 2024-09-13T18:34:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7415bd40 con 0x7fef74159a10 2024-09-13T18:34:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef740ccb80 con 0x7fef74159a10 2024-09-13T18:34:24.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.968+0000 7fef5b7fe640 1 -- 172.21.15.53:0/3456093331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fef6c0039c0 con 0x7fef74159a10 2024-09-13T18:34:24.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.972+0000 7fef5b7fe640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fef60067020 0x7fef600694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:24.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.972+0000 7fef72ffd640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fef60067020 0x7fef600694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:24.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.972+0000 7fef5b7fe640 1 -- 172.21.15.53:0/3456093331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef6c082720 con 0x7fef74159a10 2024-09-13T18:34:24.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.972+0000 7fef72ffd640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fef60067020 0x7fef600694e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fef64003fd0 tx=0x7fef640039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:24.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:24.976+0000 7fef5b7fe640 1 -- 172.21.15.53:0/3456093331 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef6c051340 con 0x7fef74159a10 2024-09-13T18:34:25.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef74152470 con 0x7fef74159a10 2024-09-13T18:34:25.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef5b7fe640 1 -- 172.21.15.53:0/3456093331 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef6c054960 con 0x7fef74159a10 2024-09-13T18:34:25.138 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:34:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fef60067020 msgr2=0x7fef600694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fef60067020 0x7fef600694e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fef64003fd0 tx=0x7fef640039a0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 msgr2=0x7fef7415b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef7415b060 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00e5e0 tx=0x7fef6c00eaa0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 shutdown_connections 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fef60067020 0x7fef600694e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef74159a10 0x7fef7415b060 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef74159630 0x7fef7415c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 --2- 172.21.15.53:0/3456093331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef740b3dd0 0x7fef7414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 >> 172.21.15.53:0/3456093331 conn(0x7fef740b0a30 msgr2=0x7fef740ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 shutdown_connections 2024-09-13T18:34:25.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.136+0000 7fef792c8640 1 -- 172.21.15.53:0/3456093331 wait complete. 2024-09-13T18:34:25.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:34:25.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9f731640 1 Processor -- start 2024-09-13T18:34:25.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9f731640 1 -- start start 2024-09-13T18:34:25.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9f731640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e9815c830 0x7f7e980d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9f731640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980ccd10 0x7f7e980cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9f731640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980b7db0 con 0x7f7e980d2c80 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9f731640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980d0650 con 0x7f7e9815c830 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9f731640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980d0c10 con 0x7f7e980ccd10 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9dcce640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7e980d2c80 0x7f7e980b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35050/0 (socket says 172.21.15.53:35050) 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9dcce640 1 -- 172.21.15.53:0/1926477738 learned_addr learned my addr 172.21.15.53:0/1926477738 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9d4cd640 1 --2- 172.21.15.53:0/1926477738 >> v2:172.21.15.53:3300/0 conn(0x7f7e9815c830 0x7f7e980d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9cccc640 1 --2- 172.21.15.53:0/1926477738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980ccd10 0x7f7e980cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e8ffff640 1 -- 172.21.15.53:0/1926477738 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721751325 0 0) 0x7f7e980b7db0 con 0x7f7e980d2c80 2024-09-13T18:34:25.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e8ffff640 1 -- 172.21.15.53:0/1926477738 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e84003530 con 0x7f7e980d2c80 2024-09-13T18:34:25.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9d4cd640 1 -- 172.21.15.53:0/1926477738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980ccd10 msgr2=0x7f7e980cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9d4cd640 1 --2- 172.21.15.53:0/1926477738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980ccd10 0x7f7e980cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9d4cd640 1 -- 172.21.15.53:0/1926477738 >> v1:172.21.15.53:6789/0 conn(0x7f7e980d2c80 legacy=0x7f7e980b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.276+0000 7f7e9d4cd640 1 -- 172.21.15.53:0/1926477738 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980cd7d0 con 0x7f7e9815c830 2024-09-13T18:34:25.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9d4cd640 1 --2- 172.21.15.53:0/1926477738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e9815c830 0x7f7e980d10a0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f7e880097c0 tx=0x7f7e8801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811e7b446be5bda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e8ffff640 1 -- 172.21.15.53:0/1926477738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880ab600 con 0x7f7e9815c830 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e8ffff640 1 -- 172.21.15.53:0/1926477738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e880a7050 con 0x7f7e9815c830 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e8ffff640 1 -- 172.21.15.53:0/1926477738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880ab980 con 0x7f7e9815c830 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- 172.21.15.53:0/1926477738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e9815c830 msgr2=0x7f7e980d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 --2- 172.21.15.53:0/1926477738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e9815c830 0x7f7e980d10a0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f7e880097c0 tx=0x7f7e8801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- 172.21.15.53:0/1926477738 shutdown_connections 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 --2- 172.21.15.53:0/1926477738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980ccd10 0x7f7e980cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 --2- 172.21.15.53:0/1926477738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e9815c830 0x7f7e980d10a0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- 172.21.15.53:0/1926477738 >> 172.21.15.53:0/1926477738 conn(0x7f7e98070970 msgr2=0x7f7e98070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- 172.21.15.53:0/1926477738 shutdown_connections 2024-09-13T18:34:25.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- 172.21.15.53:0/1926477738 wait complete. 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 Processor -- start 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- start start 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980ccd10 0x7f7e98152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980d2c80 0x7f7e98151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9815c830 0x7f7e981547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9815cd20 con 0x7f7e980ccd10 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9815d5c0 con 0x7f7e9815c830 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.280+0000 7f7e9f731640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9815bca0 con 0x7f7e980d2c80 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980ccd10 0x7f7e98152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980ccd10 0x7f7e98152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33462/0 (socket says 172.21.15.53:33462) 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 -- 172.21.15.53:0/836266380 learned_addr learned my addr 172.21.15.53:0/836266380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:25.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9cccc640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980d2c80 0x7f7e98151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9dcce640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9815c830 0x7f7e981547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 -- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980d2c80 msgr2=0x7f7e98151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980d2c80 0x7f7e98151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 -- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9815c830 msgr2=0x7f7e981547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9815c830 0x7f7e981547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 -- 172.21.15.53:0/836266380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88009420 con 0x7f7e980ccd10 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9dcce640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9815c830 0x7f7e981547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9cccc640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980d2c80 0x7f7e98151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9d4cd640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980ccd10 0x7f7e98152e50 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f7e8801a0d0 tx=0x7f7e8801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e8dffb640 1 -- 172.21.15.53:0/836266380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880b7450 con 0x7f7e980ccd10 2024-09-13T18:34:25.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e8dffb640 1 -- 172.21.15.53:0/836266380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e880b75b0 con 0x7f7e980ccd10 2024-09-13T18:34:25.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9815cf70 con 0x7f7e980ccd10 2024-09-13T18:34:25.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e8dffb640 1 -- 172.21.15.53:0/836266380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880b7960 con 0x7f7e980ccd10 2024-09-13T18:34:25.288 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e98151650 con 0x7f7e980ccd10 2024-09-13T18:34:25.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e980d10a0 con 0x7f7e980ccd10 2024-09-13T18:34:25.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e8dffb640 1 -- 172.21.15.53:0/836266380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f7e880b7ac0 con 0x7f7e980ccd10 2024-09-13T18:34:25.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e8dffb640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e7c067020 0x7f7e7c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e8dffb640 1 -- 172.21.15.53:0/836266380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e8811d490 con 0x7f7e980ccd10 2024-09-13T18:34:25.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9cccc640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e7c067020 0x7f7e7c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.289 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.284+0000 7f7e9cccc640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e7c067020 0x7f7e7c0694e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b3500 tx=0x7f7e94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.288+0000 7f7e8dffb640 1 -- 172.21.15.53:0/836266380 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e880ec0b0 con 0x7f7e980ccd10 2024-09-13T18:34:25.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.448+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e980b2250 con 0x7f7e980ccd10 2024-09-13T18:34:25.453 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e8dffb640 1 -- 172.21.15.53:0/836266380 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e880bb0a0 con 0x7f7e980ccd10 2024-09-13T18:34:25.453 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:34:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e7c067020 msgr2=0x7f7e7c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e7c067020 0x7f7e7c0694e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b3500 tx=0x7f7e94008040 comp rx=0 tx=0).stop 2024-09-13T18:34:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980ccd10 msgr2=0x7f7e98152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980ccd10 0x7f7e98152e50 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f7e8801a0d0 tx=0x7f7e8801ace0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 shutdown_connections 2024-09-13T18:34:25.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7e7c067020 0x7f7e7c0694e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e980d2c80 0x7f7e98151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e9815c830 0x7f7e981547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 --2- 172.21.15.53:0/836266380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980ccd10 0x7f7e98152e50 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 >> 172.21.15.53:0/836266380 conn(0x7f7e98070970 msgr2=0x7f7e980b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 shutdown_connections 2024-09-13T18:34:25.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.452+0000 7f7e9f731640 1 -- 172.21.15.53:0/836266380 wait complete. 2024-09-13T18:34:25.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:34:25.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.584+0000 7f0739525640 1 Processor -- start 2024-09-13T18:34:25.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.584+0000 7f0739525640 1 -- start start 2024-09-13T18:34:25.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0739525640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0734070ce0 0x7f0734071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0739525640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f073406b390 0x7f073406b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0739525640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0734146180 con 0x7f07341457c0 2024-09-13T18:34:25.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0739525640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07340702d0 con 0x7f073406b390 2024-09-13T18:34:25.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0739525640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073406c4c0 con 0x7f0734070ce0 2024-09-13T18:34:25.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0732ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f07341457c0 0x7f07340b1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35066/0 (socket says 172.21.15.53:35066) 2024-09-13T18:34:25.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0732ffd640 1 -- 172.21.15.53:0/3015159509 learned_addr learned my addr 172.21.15.53:0/3015159509 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:25.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07337fe640 1 --2- 172.21.15.53:0/3015159509 >> v2:172.21.15.87:3300/0 conn(0x7f073406b390 0x7f073406b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07327fc640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0734070ce0 0x7f0734071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607878603 0 0) 0x7f0734146180 con 0x7f07341457c0 2024-09-13T18:34:25.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c003530 con 0x7f07341457c0 2024-09-13T18:34:25.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141783282 0 0) 0x7f071c003530 con 0x7f07341457c0 2024-09-13T18:34:25.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0734070ce0 msgr2=0x7f0734071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0734070ce0 0x7f0734071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 >> v2:172.21.15.87:3300/0 conn(0x7f073406b390 msgr2=0x7f073406b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 --2- 172.21.15.53:0/3015159509 >> v2:172.21.15.87:3300/0 conn(0x7f073406b390 0x7f073406b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073406bf00 con 0x7f07341457c0 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0724001680 con 0x7f07341457c0 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 >> v1:172.21.15.53:6789/0 conn(0x7f07341457c0 legacy=0x7f07340b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f071c003980 0x7f071c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f071c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0734070ce0 0x7f071c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07340702d0 con 0x7f071c0047d0 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073406c4c0 con 0x7f071c003980 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c00b990 con 0x7f0734070ce0 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07327fc640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f071c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07327fc640 1 -- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0734070ce0 msgr2=0x7f071c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07327fc640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0734070ce0 0x7f071c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07327fc640 1 -- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f071c003980 msgr2=0x7f071c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07327fc640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f071c003980 0x7f071c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.588+0000 7f07327fc640 1 -- 172.21.15.53:0/3015159509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c003530 con 0x7f071c0047d0 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f07327fc640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f071c004c50 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f0728009ae0 tx=0x7f072801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76123851f417ff0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280a55c0 con 0x7f071c0047d0 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07280a5720 con 0x7f071c0047d0 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0731ffb640 1 -- 172.21.15.53:0/3015159509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280a5ad0 con 0x7f071c0047d0 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- 172.21.15.53:0/3015159509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 msgr2=0x7f071c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 --2- 172.21.15.53:0/3015159509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f071c004c50 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f0728009ae0 tx=0x7f072801cab0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f07337fe640 1 -- 172.21.15.53:0/3015159509 reap_dead start 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- 172.21.15.53:0/3015159509 shutdown_connections 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- 172.21.15.53:0/3015159509 >> 172.21.15.53:0/3015159509 conn(0x7f0734065c80 msgr2=0x7f0734066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- 172.21.15.53:0/3015159509 shutdown_connections 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- 172.21.15.53:0/3015159509 wait complete. 2024-09-13T18:34:25.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 Processor -- start 2024-09-13T18:34:25.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- start start 2024-09-13T18:34:25.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f0734144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0734141ad0 0x7f0734142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07341f2680 0x7f073414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073413b710 con 0x7f071c0047d0 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073413ab00 con 0x7f0734141ad0 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073413ade0 con 0x7f07341f2680 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f0734144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f0734144a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33482/0 (socket says 172.21.15.53:33482) 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 -- 172.21.15.53:0/1935802120 learned_addr learned my addr 172.21.15.53:0/1935802120 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f07327fc640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0734141ad0 0x7f0734142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f07337fe640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07341f2680 0x7f073414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 -- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07341f2680 msgr2=0x7f073414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07341f2680 0x7f073414e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 -- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0734141ad0 msgr2=0x7f0734142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0734141ad0 0x7f0734142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 -- 172.21.15.53:0/1935802120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073413b0c0 con 0x7f071c0047d0 2024-09-13T18:34:25.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0732ffd640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f0734144a40 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f072400f730 tx=0x7f072400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f071b7fe640 1 -- 172.21.15.53:0/1935802120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724007af0 con 0x7f071c0047d0 2024-09-13T18:34:25.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f071b7fe640 1 -- 172.21.15.53:0/1935802120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0724007c90 con 0x7f071c0047d0 2024-09-13T18:34:25.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073413b3a0 con 0x7f071c0047d0 2024-09-13T18:34:25.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f071b7fe640 1 -- 172.21.15.53:0/1935802120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400a0d0 con 0x7f071c0047d0 2024-09-13T18:34:25.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.592+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07341431c0 con 0x7f071c0047d0 2024-09-13T18:34:25.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.596+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07340b0040 con 0x7f071c0047d0 2024-09-13T18:34:25.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.596+0000 7f071b7fe640 1 -- 172.21.15.53:0/1935802120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f072400a230 con 0x7f071c0047d0 2024-09-13T18:34:25.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.596+0000 7f071b7fe640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0720067050 0x7f0720069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.596+0000 7f071b7fe640 1 -- 172.21.15.53:0/1935802120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0724085690 con 0x7f071c0047d0 2024-09-13T18:34:25.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.596+0000 7f07327fc640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0720067050 0x7f0720069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.596+0000 7f07327fc640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0720067050 0x7f0720069510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f07280af000 tx=0x7f07280046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.600+0000 7f071b7fe640 1 -- 172.21.15.53:0/1935802120 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0724054290 con 0x7f071c0047d0 2024-09-13T18:34:25.761 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0734145ba0 con 0x7f071c0047d0 2024-09-13T18:34:25.762 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f071b7fe640 1 -- 172.21.15.53:0/1935802120 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7f072401b020 con 0x7f071c0047d0 2024-09-13T18:34:25.762 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0720067050 msgr2=0x7f0720069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0720067050 0x7f0720069510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f07280af000 tx=0x7f07280046d0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 msgr2=0x7f0734144a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f0734144a40 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f072400f730 tx=0x7f072400fbf0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 shutdown_connections 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0720067050 0x7f0720069510 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07341f2680 0x7f073414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0734141ad0 0x7f0734142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 --2- 172.21.15.53:0/1935802120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f071c0047d0 0x7f0734144a40 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 >> 172.21.15.53:0/1935802120 conn(0x7f0734065c80 msgr2=0x7f07340b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 shutdown_connections 2024-09-13T18:34:25.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.760+0000 7f0739525640 1 -- 172.21.15.53:0/1935802120 wait complete. 2024-09-13T18:34:25.781 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:34:25.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e13399640 1 Processor -- start 2024-09-13T18:34:25.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e13399640 1 -- start start 2024-09-13T18:34:25.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e13399640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9e0c1582a0 0x7f9e0c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e13399640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 0x7f9e0c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e13399640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c06d480 con 0x7f9e0c070c90 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e13399640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c15aaf0 con 0x7f9e0c1582a0 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e13399640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c06d760 con 0x7f9e0c15b7c0 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9e0c070c90 0x7f9e0c06f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35078/0 (socket says 172.21.15.53:35078) 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 -- 172.21.15.53:0/976595801 learned_addr learned my addr 172.21.15.53:0/976595801 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11135640 1 --2- 172.21.15.53:0/976595801 >> v2:172.21.15.87:3300/0 conn(0x7f9e0c1582a0 0x7f9e0c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e10934640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 0x7f9e0c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338504774 0 0) 0x7f9e0c06d480 con 0x7f9e0c070c90 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df8003530 con 0x7f9e0c070c90 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 582921995 0 0) 0x7f9df8003530 con 0x7f9e0c070c90 2024-09-13T18:34:25.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 msgr2=0x7f9e0c06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 0x7f9e0c06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 >> v2:172.21.15.87:3300/0 conn(0x7f9e0c1582a0 msgr2=0x7f9e0c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 --2- 172.21.15.53:0/976595801 >> v2:172.21.15.87:3300/0 conn(0x7f9e0c1582a0 0x7f9e0c06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c15ace0 con 0x7f9e0c070c90 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f9e04001a00 con 0x7f9e0c070c90 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 >> v1:172.21.15.53:6789/0 conn(0x7f9e0c070c90 legacy=0x7f9e0c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8003980 0x7f9df8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 0x7f9df80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df8004d10 0x7f9df8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df800b990 con 0x7f9df8004d10 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df800bad0 con 0x7f9df8003980 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df800bc10 con 0x7f9e0c15b7c0 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df8004d10 0x7f9df8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e10934640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 0x7f9df80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 -- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 msgr2=0x7f9df80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c15b7c0 0x7f9df80047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 -- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8003980 msgr2=0x7f9df8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11135640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8003980 0x7f9df8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8003980 0x7f9df8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11936640 1 -- 172.21.15.53:0/976595801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8003530 con 0x7f9df8004d10 2024-09-13T18:34:25.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.900+0000 7f9e11135640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8003980 0x7f9df8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e11936640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df8004d10 0x7f9df8005190 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400a830 tx=0x7f9e0401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f8f67e2e5267c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040ad630 con 0x7f9df8004d10 2024-09-13T18:34:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e040a8070 con 0x7f9df8004d10 2024-09-13T18:34:25.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e03fff640 1 -- 172.21.15.53:0/976595801 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040ad9f0 con 0x7f9df8004d10 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 -- 172.21.15.53:0/976595801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df8004d10 msgr2=0x7f9df8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 --2- 172.21.15.53:0/976595801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df8004d10 0x7f9df8005190 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400a830 tx=0x7f9e0401d380 comp rx=0 tx=0).stop 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e11936640 1 -- 172.21.15.53:0/976595801 reap_dead start 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 -- 172.21.15.53:0/976595801 shutdown_connections 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 -- 172.21.15.53:0/976595801 >> 172.21.15.53:0/976595801 conn(0x7f9e0c065c80 msgr2=0x7f9e0c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 -- 172.21.15.53:0/976595801 shutdown_connections 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 -- 172.21.15.53:0/976595801 wait complete. 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 Processor -- start 2024-09-13T18:34:25.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.904+0000 7f9e13399640 1 -- start start 2024-09-13T18:34:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8004d10 0x7f9e0c0a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e0c1ef720 0x7f9e0c1f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c155050 0x7f9e0c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c155a10 con 0x7f9e0c1ef720 2024-09-13T18:34:25.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1f0d20 con 0x7f9df8004d10 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1f1280 con 0x7f9e0c155050 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e0c1ef720 0x7f9e0c1f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e0c1ef720 0x7f9e0c1f07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33496/0 (socket says 172.21.15.53:33496) 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 -- 172.21.15.53:0/720028988 learned_addr learned my addr 172.21.15.53:0/720028988 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e11135640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8004d10 0x7f9e0c0a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e11936640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c155050 0x7f9e0c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 -- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c155050 msgr2=0x7f9e0c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c155050 0x7f9e0c1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 -- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8004d10 msgr2=0x7f9e0c0a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8004d10 0x7f9e0c0a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 -- 172.21.15.53:0/720028988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c1f1560 con 0x7f9e0c1ef720 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e11135640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8004d10 0x7f9e0c0a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:25.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e10934640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e0c1ef720 0x7f9e0c1f07e0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc010890 tx=0x7f9dfc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e01ffb640 1 -- 172.21.15.53:0/720028988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc009630 con 0x7f9e0c1ef720 2024-09-13T18:34:25.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e01ffb640 1 -- 172.21.15.53:0/720028988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc00eb60 con 0x7f9e0c1ef720 2024-09-13T18:34:25.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c1f1840 con 0x7f9e0c1ef720 2024-09-13T18:34:25.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e01ffb640 1 -- 172.21.15.53:0/720028988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc01c400 con 0x7f9e0c1ef720 2024-09-13T18:34:25.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c1f1e00 con 0x7f9e0c1ef720 2024-09-13T18:34:25.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c067400 con 0x7f9e0c1ef720 2024-09-13T18:34:25.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e01ffb640 1 -- 172.21.15.53:0/720028988 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f9dfc01c560 con 0x7f9e0c1ef720 2024-09-13T18:34:25.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e01ffb640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9df0067050 0x7f9df0069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:25.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e01ffb640 1 -- 172.21.15.53:0/720028988 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dfc083160 con 0x7f9e0c1ef720 2024-09-13T18:34:25.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e11135640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9df0067050 0x7f9df0069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:25.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.908+0000 7f9e11135640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9df0067050 0x7f9df0069510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009aa0 tx=0x7f9e08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:25.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:25.912+0000 7f9e01ffb640 1 -- 172.21.15.53:0/720028988 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9dfc051d80 con 0x7f9e0c1ef720 2024-09-13T18:34:25.974 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:34:25.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:34:26.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.088+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9e0c06d480 con 0x7f9e0c1ef720 2024-09-13T18:34:26.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.088+0000 7f9e01ffb640 1 -- 172.21.15.53:0/720028988 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v162) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9dfc0553a0 con 0x7f9e0c1ef720 2024-09-13T18:34:26.090 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:34:26.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.088+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9df0067050 msgr2=0x7f9df0069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.088+0000 7f9e13399640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9df0067050 0x7f9df0069510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009aa0 tx=0x7f9e08008040 comp rx=0 tx=0).stop 2024-09-13T18:34:26.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.088+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e0c1ef720 msgr2=0x7f9e0c1f07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.088+0000 7f9e13399640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e0c1ef720 0x7f9e0c1f07e0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc010890 tx=0x7f9dfc010d50 comp rx=0 tx=0).stop 2024-09-13T18:34:26.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 shutdown_connections 2024-09-13T18:34:26.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9df0067050 0x7f9df0069510 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9e0c155050 0x7f9e0c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e0c1ef720 0x7f9e0c1f07e0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 --2- 172.21.15.53:0/720028988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9df8004d10 0x7f9e0c0a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 >> 172.21.15.53:0/720028988 conn(0x7f9e0c065c80 msgr2=0x7f9e0c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:26.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 shutdown_connections 2024-09-13T18:34:26.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.092+0000 7f9e13399640 1 -- 172.21.15.53:0/720028988 wait complete. 2024-09-13T18:34:26.108 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:34:26.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:26.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:26.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[57975]: fuse finished with error 0 and tester_r 0 2024-09-13T18:34:26.122 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:34:26.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:26.122 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:34:26.287 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:34:26.287 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:26.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:26.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.456+0000 7f621f025640 1 Processor -- start 2024-09-13T18:34:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.456+0000 7f621f025640 1 -- start start 2024-09-13T18:34:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621f025640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62181582a0 0x7f621806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621f025640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f62180713a0 0x7f621806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621f025640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621806d480 con 0x7f621815b7c0 2024-09-13T18:34:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621f025640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621815aaf0 con 0x7f62180713a0 2024-09-13T18:34:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621f025640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621806d760 con 0x7f62181582a0 2024-09-13T18:34:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f6217fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f621815b7c0 0x7f6218070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35080/0 (socket says 172.21.15.53:35080) 2024-09-13T18:34:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f6217fff640 1 -- 172.21.15.53:0/3735504927 learned_addr learned my addr 172.21.15.53:0/3735504927 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621d5c2640 1 --2- 172.21.15.53:0/3735504927 >> v2:172.21.15.53:3300/0 conn(0x7f62180713a0 0x7f621806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621cdc1640 1 --2- 172.21.15.53:0/3735504927 >> v2:172.21.15.87:3300/0 conn(0x7f62181582a0 0x7f621806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621d5c2640 1 -- 172.21.15.53:0/3735504927 >> v2:172.21.15.87:3300/0 conn(0x7f62181582a0 msgr2=0x7f621806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621d5c2640 1 --2- 172.21.15.53:0/3735504927 >> v2:172.21.15.87:3300/0 conn(0x7f62181582a0 0x7f621806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621d5c2640 1 -- 172.21.15.53:0/3735504927 >> v1:172.21.15.53:6789/0 conn(0x7f621815b7c0 legacy=0x7f6218070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f62177fe640 1 -- 172.21.15.53:0/3735504927 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316126692 0 0) 0x7f621806d480 con 0x7f621815b7c0 2024-09-13T18:34:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.460+0000 7f621d5c2640 1 -- 172.21.15.53:0/3735504927 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621815ace0 con 0x7f62180713a0 2024-09-13T18:34:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621d5c2640 1 --2- 172.21.15.53:0/3735504927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f621806ce40 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f6218069f50 tx=0x7f620801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d660e5f48db20290 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f62177fe640 1 -- 172.21.15.53:0/3735504927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080a59c0 con 0x7f62180713a0 2024-09-13T18:34:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f62177fe640 1 -- 172.21.15.53:0/3735504927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080a5b20 con 0x7f62180713a0 2024-09-13T18:34:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f62177fe640 1 -- 172.21.15.53:0/3735504927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080ad440 con 0x7f62180713a0 2024-09-13T18:34:26.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- 172.21.15.53:0/3735504927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 msgr2=0x7f621806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 --2- 172.21.15.53:0/3735504927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f621806ce40 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f6218069f50 tx=0x7f620801c900 comp rx=0 tx=0).stop 2024-09-13T18:34:26.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- 172.21.15.53:0/3735504927 shutdown_connections 2024-09-13T18:34:26.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 --2- 172.21.15.53:0/3735504927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f621806ce40 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 --2- 172.21.15.53:0/3735504927 >> v2:172.21.15.87:3300/0 conn(0x7f62181582a0 0x7f621806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- 172.21.15.53:0/3735504927 >> 172.21.15.53:0/3735504927 conn(0x7f6218065c80 msgr2=0x7f6218066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- 172.21.15.53:0/3735504927 shutdown_connections 2024-09-13T18:34:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- 172.21.15.53:0/3735504927 wait complete. 2024-09-13T18:34:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 Processor -- start 2024-09-13T18:34:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- start start 2024-09-13T18:34:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f62181469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62181582a0 0x7f6218155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f621815b7c0 0x7f6218148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218147230 con 0x7f62180713a0 2024-09-13T18:34:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62181563a0 con 0x7f62181582a0 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621f025640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6218156680 con 0x7f621815b7c0 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f62181469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f62181469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33518/0 (socket says 172.21.15.53:33518) 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 -- 172.21.15.53:0/1846202891 learned_addr learned my addr 172.21.15.53:0/1846202891 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621d5c2640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f621815b7c0 0x7f6218148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f6217fff640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62181582a0 0x7f6218155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 -- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f621815b7c0 msgr2=0x7f6218148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f621815b7c0 0x7f6218148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 -- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62181582a0 msgr2=0x7f6218155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62181582a0 0x7f6218155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 -- 172.21.15.53:0/1846202891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208009a70 con 0x7f62180713a0 2024-09-13T18:34:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.464+0000 7f621cdc1640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f62181469c0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f621000d800 tx=0x7f621000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f62157fa640 1 -- 172.21.15.53:0/1846202891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000b6c0 con 0x7f62180713a0 2024-09-13T18:34:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f62157fa640 1 -- 172.21.15.53:0/1846202891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621000b860 con 0x7f62180713a0 2024-09-13T18:34:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6218156960 con 0x7f62180713a0 2024-09-13T18:34:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f62157fa640 1 -- 172.21.15.53:0/1846202891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000bc10 con 0x7f62180713a0 2024-09-13T18:34:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621814aaa0 con 0x7f62180713a0 2024-09-13T18:34:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6218067400 con 0x7f62180713a0 2024-09-13T18:34:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f62157fa640 1 -- 172.21.15.53:0/1846202891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f621001e460 con 0x7f62180713a0 2024-09-13T18:34:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f62157fa640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61f8067020 0x7f61f80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f6217fff640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61f8067020 0x7f61f80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f62157fa640 1 -- 172.21.15.53:0/1846202891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6210083280 con 0x7f62180713a0 2024-09-13T18:34:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.468+0000 7f6217fff640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61f8067020 0x7f61f80694e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6218066160 tx=0x7f6200009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:26.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.472+0000 7f62157fa640 1 -- 172.21.15.53:0/1846202891 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6210051ea0 con 0x7f62180713a0 2024-09-13T18:34:26.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.636+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f621814a620 con 0x7f62180713a0 2024-09-13T18:34:26.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.636+0000 7f62157fa640 1 -- 172.21.15.53:0/1846202891 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f621814a620 con 0x7f62180713a0 2024-09-13T18:34:26.640 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:26.641 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":162,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:59.644771+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61f8067020 msgr2=0x7f61f80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61f8067020 0x7f61f80694e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6218066160 tx=0x7f6200009040 comp rx=0 tx=0).stop 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 msgr2=0x7f62181469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f62181469c0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f621000d800 tx=0x7f621000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 shutdown_connections 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61f8067020 0x7f61f80694e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f621815b7c0 0x7f6218148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62181582a0 0x7f6218155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 --2- 172.21.15.53:0/1846202891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62180713a0 0x7f62181469c0 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 >> 172.21.15.53:0/1846202891 conn(0x7f6218065c80 msgr2=0x7f62180ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:26.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 shutdown_connections 2024-09-13T18:34:26.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.640+0000 7f621f025640 1 -- 172.21.15.53:0/1846202891 wait complete. 2024-09-13T18:34:26.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:56.968030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:57.623731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:34:26.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:34:26.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fc52a9640 1 Processor -- start 2024-09-13T18:34:26.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fc52a9640 1 -- start start 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fc52a9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc0156c40 0x7f8fc0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fc52a9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8fc006d440 0x7f8fc006f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fc52a9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00b15a0 con 0x7f8fc0157020 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fc52a9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00b1880 con 0x7f8fc006d440 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fc52a9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b1b60 con 0x7f8fc0156c40 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbf7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8fc006d440 0x7f8fc006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbf7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8fc006d440 0x7f8fc006f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48992/0 (socket says 172.21.15.53:48992) 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbf7fe640 1 -- 172.21.15.53:0/3768704270 learned_addr learned my addr 172.21.15.53:0/3768704270 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:26.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbeffd640 1 --2- 172.21.15.53:0/3768704270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc0156c40 0x7f8fc0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbf7fe640 1 -- 172.21.15.53:0/3768704270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc0156c40 msgr2=0x7f8fc0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:26.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbf7fe640 1 --2- 172.21.15.53:0/3768704270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc0156c40 0x7f8fc0070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbf7fe640 1 -- 172.21.15.53:0/3768704270 >> v1:172.21.15.87:6789/0 conn(0x7f8fc0157020 legacy=0x7f8fc006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.788+0000 7f8fbf7fe640 1 -- 172.21.15.53:0/3768704270 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00b1e40 con 0x7f8fc006d440 2024-09-13T18:34:26.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbf7fe640 1 --2- 172.21.15.53:0/3768704270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc006f330 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800d150 tx=0x7f8fb801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6ebf06afc4de53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:26.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbdffb640 1 -- 172.21.15.53:0/3768704270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80a7cf0 con 0x7f8fc006d440 2024-09-13T18:34:26.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbdffb640 1 -- 172.21.15.53:0/3768704270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb80a7e50 con 0x7f8fc006d440 2024-09-13T18:34:26.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbdffb640 1 -- 172.21.15.53:0/3768704270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800b2f0 con 0x7f8fc006d440 2024-09-13T18:34:26.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- 172.21.15.53:0/3768704270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 msgr2=0x7f8fc006f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/3768704270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc006f330 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800d150 tx=0x7f8fb801ec00 comp rx=0 tx=0).stop 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- 172.21.15.53:0/3768704270 shutdown_connections 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/3768704270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc006f330 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/3768704270 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc0156c40 0x7f8fc0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- 172.21.15.53:0/3768704270 >> 172.21.15.53:0/3768704270 conn(0x7f8fc0065c80 msgr2=0x7f8fc0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- 172.21.15.53:0/3768704270 shutdown_connections 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- 172.21.15.53:0/3768704270 wait complete. 2024-09-13T18:34:26.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 Processor -- start 2024-09-13T18:34:26.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- start start 2024-09-13T18:34:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc0156c40 0x7f8fc013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc015ba30 0x7f8fc00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0157ee0 con 0x7f8fc006d440 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc015c920 con 0x7f8fc0156c40 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fc52a9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0157540 con 0x7f8fc015ba30 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc015bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48996/0 (socket says 172.21.15.53:48996) 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 -- 172.21.15.53:0/266038074 learned_addr learned my addr 172.21.15.53:0/266038074 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbf7fe640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc015ba30 0x7f8fc00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbe7fc640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc0156c40 0x7f8fc013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 -- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc015ba30 msgr2=0x7f8fc00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc015ba30 0x7f8fc00ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 -- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc0156c40 msgr2=0x7f8fc013fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc0156c40 0x7f8fc013fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbeffd640 1 -- 172.21.15.53:0/266038074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb800bd40 con 0x7f8fc006d440 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbf7fe640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc015ba30 0x7f8fc00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.792+0000 7f8fbe7fc640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc0156c40 0x7f8fc013fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fbeffd640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc015bff0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000d830 tx=0x7f8fb000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fa77fe640 1 -- 172.21.15.53:0/266038074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000b6c0 con 0x7f8fc006d440 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fa77fe640 1 -- 172.21.15.53:0/266038074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb000b820 con 0x7f8fc006d440 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc0157820 con 0x7f8fc006d440 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fa77fe640 1 -- 172.21.15.53:0/266038074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000bb90 con 0x7f8fc006d440 2024-09-13T18:34:26.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc015c530 con 0x7f8fc006d440 2024-09-13T18:34:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc006f330 con 0x7f8fc006d440 2024-09-13T18:34:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fa77fe640 1 -- 172.21.15.53:0/266038074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f8fb001e460 con 0x7f8fc006d440 2024-09-13T18:34:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fa77fe640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fac067020 0x7f8fac0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:26.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fa77fe640 1 -- 172.21.15.53:0/266038074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fb00833d0 con 0x7f8fc006d440 2024-09-13T18:34:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fbe7fc640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fac067020 0x7f8fac0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:26.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.796+0000 7f8fbe7fc640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fac067020 0x7f8fac0694e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0143b50 tx=0x7f8fb4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:26.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.800+0000 7f8fa77fe640 1 -- 172.21.15.53:0/266038074 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fb0051ff0 con 0x7f8fc006d440 2024-09-13T18:34:26.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.960+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fc0149d40 con 0x7f8fc006d440 2024-09-13T18:34:26.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.960+0000 7f8fa77fe640 1 -- 172.21.15.53:0/266038074 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fb0055610 con 0x7f8fc006d440 2024-09-13T18:34:26.963 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:34:26.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fac067020 msgr2=0x7f8fac0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fac067020 0x7f8fac0694e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0143b50 tx=0x7f8fb4009040 comp rx=0 tx=0).stop 2024-09-13T18:34:26.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 msgr2=0x7f8fc015bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:26.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc015bff0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000d830 tx=0x7f8fb000dcf0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 shutdown_connections 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8fac067020 0x7f8fac0694e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8fc015ba30 0x7f8fc00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8fc0156c40 0x7f8fc013fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 --2- 172.21.15.53:0/266038074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc006d440 0x7f8fc015bff0 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 >> 172.21.15.53:0/266038074 conn(0x7f8fc0065c80 msgr2=0x7f8fc0067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 shutdown_connections 2024-09-13T18:34:26.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:26.964+0000 7f8fc52a9640 1 -- 172.21.15.53:0/266038074 wait complete. 2024-09-13T18:34:26.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:34:27.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.108+0000 7f88e7c3f640 1 Processor -- start 2024-09-13T18:34:27.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.108+0000 7f88e7c3f640 1 -- start start 2024-09-13T18:34:27.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e7c3f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 0x7f88e0158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e7c3f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e00b3830 con 0x7f88e006b390 2024-09-13T18:34:27.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e7c3f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e00b2340 con 0x7f88e00cb9d0 2024-09-13T18:34:27.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e7c3f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e006c530 con 0x7f88e00b1dd0 2024-09-13T18:34:27.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e61dc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f88e006b390 0x7f88e006ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58972/0 (socket says 172.21.15.53:58972) 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e61dc640 1 -- 172.21.15.53:0/3785577150 learned_addr learned my addr 172.21.15.53:0/3785577150 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e59db640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 0x7f88e0158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618465020 0 0) 0x7f88d80014a0 con 0x7f88e006b390 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88cc003530 con 0x7f88e006b390 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176486350 0 0) 0x7f88cc003530 con 0x7f88e006b390 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 msgr2=0x7f88e0158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 0x7f88e0158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 >> v1:172.21.15.87:6789/0 conn(0x7f88e00cb9d0 legacy=0x7f88e00b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e006be70 con 0x7f88e006b390 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f88d8001b90 con 0x7f88e006b390 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 >> v1:172.21.15.53:6789/0 conn(0x7f88e006b390 legacy=0x7f88e006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 0x7f88cc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88cc003f30 0x7f88cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc004d10 0x7f88cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e006c530 con 0x7f88cc003f30 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc00bbd0 con 0x7f88cc004d10 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc00bd90 con 0x7f88e00b1dd0 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e51da640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88cc003f30 0x7f88cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e61dc640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc004d10 0x7f88cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e59db640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 0x7f88cc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e51da640 1 -- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 msgr2=0x7f88cc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e51da640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e00b1dd0 0x7f88cc0039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e51da640 1 -- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc004d10 msgr2=0x7f88cc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e51da640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc004d10 0x7f88cc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e51da640 1 -- 172.21.15.53:0/3785577150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc003530 con 0x7f88cc003f30 2024-09-13T18:34:27.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.112+0000 7f88e61dc640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc004d10 0x7f88cc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:27.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88cc003f30 0x7f88cc0047d0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f88d0001780 tx=0x7f88d001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c6c81c41de83ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00052d0 con 0x7f88cc003f30 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d00a7050 con 0x7f88cc003f30 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e49d9640 1 -- 172.21.15.53:0/3785577150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0003600 con 0x7f88cc003f30 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3785577150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88cc003f30 msgr2=0x7f88cc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 --2- 172.21.15.53:0/3785577150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88cc003f30 0x7f88cc0047d0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f88d0001780 tx=0x7f88d001c3f0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e61dc640 1 -- 172.21.15.53:0/3785577150 reap_dead start 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3785577150 shutdown_connections 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3785577150 >> 172.21.15.53:0/3785577150 conn(0x7f88e0065c80 msgr2=0x7f88e0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3785577150 shutdown_connections 2024-09-13T18:34:27.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3785577150 wait complete. 2024-09-13T18:34:27.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 Processor -- start 2024-09-13T18:34:27.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- start start 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc003f30 0x7f88e0168d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e0169270 0x7f88e00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e01f5960 0x7f88e00ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0169a60 con 0x7f88e0169270 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e01f4c60 con 0x7f88cc003f30 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e7c3f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e01f4ec0 con 0x7f88e01f5960 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e0169270 0x7f88e00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e0169270 0x7f88e00ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49022/0 (socket says 172.21.15.53:49022) 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 -- 172.21.15.53:0/3835031707 learned_addr learned my addr 172.21.15.53:0/3835031707 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e59db640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc003f30 0x7f88e0168d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e61dc640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e01f5960 0x7f88e00ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 -- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e01f5960 msgr2=0x7f88e00ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e01f5960 0x7f88e00ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 -- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc003f30 msgr2=0x7f88e0168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc003f30 0x7f88e0168d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 -- 172.21.15.53:0/3835031707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0169780 con 0x7f88e0169270 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e61dc640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e01f5960 0x7f88e00ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.116+0000 7f88e51da640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e0169270 0x7f88e00ac8e0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f88d0005040 tx=0x7f88cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88d67fc640 1 -- 172.21.15.53:0/3835031707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0007310 con 0x7f88e0169270 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88d67fc640 1 -- 172.21.15.53:0/3835031707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d0007470 con 0x7f88e0169270 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e01f5160 con 0x7f88e0169270 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88d67fc640 1 -- 172.21.15.53:0/3835031707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00067e0 con 0x7f88e0169270 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e0153300 con 0x7f88e0169270 2024-09-13T18:34:27.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e006d160 con 0x7f88e0169270 2024-09-13T18:34:27.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88d67fc640 1 -- 172.21.15.53:0/3835031707 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f88d0006940 con 0x7f88e0169270 2024-09-13T18:34:27.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88d67fc640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88c4067020 0x7f88c40694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88d67fc640 1 -- 172.21.15.53:0/3835031707 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88d011cff0 con 0x7f88e0169270 2024-09-13T18:34:27.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88e59db640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88c4067020 0x7f88c40694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.120+0000 7f88e59db640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88c4067020 0x7f88c40694e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f88e0153910 tx=0x7f88dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.124+0000 7f88d67fc640 1 -- 172.21.15.53:0/3835031707 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88d00ebc10 con 0x7f88e0169270 2024-09-13T18:34:27.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.276+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88e00ade50 con 0x7f88e0169270 2024-09-13T18:34:27.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88d67fc640 1 -- 172.21.15.53:0/3835031707 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88d00ef230 con 0x7f88e0169270 2024-09-13T18:34:27.281 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88c4067020 msgr2=0x7f88c40694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88c4067020 0x7f88c40694e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f88e0153910 tx=0x7f88dc008040 comp rx=0 tx=0).stop 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e0169270 msgr2=0x7f88e00ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e0169270 0x7f88e00ac8e0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f88d0005040 tx=0x7f88cc005800 comp rx=0 tx=0).stop 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 shutdown_connections 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88c4067020 0x7f88c40694e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f88e01f5960 0x7f88e00ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e0169270 0x7f88e00ac8e0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 --2- 172.21.15.53:0/3835031707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88cc003f30 0x7f88e0168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 >> 172.21.15.53:0/3835031707 conn(0x7f88e0065c80 msgr2=0x7f88e00ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:27.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 shutdown_connections 2024-09-13T18:34:27.285 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.280+0000 7f88e7c3f640 1 -- 172.21.15.53:0/3835031707 wait complete. 2024-09-13T18:34:27.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:34:27.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3dbcee640 1 Processor -- start 2024-09-13T18:34:27.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3dbcee640 1 -- start start 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3dbcee640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3d4156c40 0x7fe3d4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3dbcee640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4157020 0x7fe3d406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3dbcee640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d406d6e0 con 0x7fe3d406d270 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3dbcee640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d4070340 con 0x7fe3d4156c40 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3dbcee640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40b15a0 con 0x7fe3d4157020 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3da28b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe3d406d270 0x7fe3d415cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58976/0 (socket says 172.21.15.53:58976) 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3da28b640 1 -- 172.21.15.53:0/540349321 learned_addr learned my addr 172.21.15.53:0/540349321 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d9a8a640 1 --2- 172.21.15.53:0/540349321 >> v2:172.21.15.87:3300/0 conn(0x7fe3d4156c40 0x7fe3d4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d9289640 1 --2- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4157020 0x7fe3d406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d8a88640 1 -- 172.21.15.53:0/540349321 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162243293 0 0) 0x7fe3d406d6e0 con 0x7fe3d406d270 2024-09-13T18:34:27.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d8a88640 1 -- 172.21.15.53:0/540349321 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c0003530 con 0x7fe3d406d270 2024-09-13T18:34:27.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d8a88640 1 -- 172.21.15.53:0/540349321 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303526211 0 0) 0x7fe3c0003530 con 0x7fe3d406d270 2024-09-13T18:34:27.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d9a8a640 1 -- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4157020 msgr2=0x7fe3d406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:27.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d9a8a640 1 --2- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4157020 0x7fe3d406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d9a8a640 1 -- 172.21.15.53:0/540349321 >> v1:172.21.15.53:6789/0 conn(0x7fe3d406d270 legacy=0x7fe3d415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.412+0000 7fe3d9a8a640 1 -- 172.21.15.53:0/540349321 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40b1880 con 0x7fe3d4156c40 2024-09-13T18:34:27.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3d9a8a640 1 --2- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d4156c40 0x7fe3d4070ee0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00097c0 tx=0x7fe3d001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b49e16c81b5db445 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3d8a88640 1 -- 172.21.15.53:0/540349321 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc001a00 con 0x7fe3d4156c40 2024-09-13T18:34:27.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3d8a88640 1 -- 172.21.15.53:0/540349321 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d00a7050 con 0x7fe3d4156c40 2024-09-13T18:34:27.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3d8a88640 1 -- 172.21.15.53:0/540349321 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00ab600 con 0x7fe3d4156c40 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d4156c40 msgr2=0x7fe3d4070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d4156c40 0x7fe3d4070ee0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00097c0 tx=0x7fe3d001c390 comp rx=0 tx=0).stop 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- 172.21.15.53:0/540349321 shutdown_connections 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4157020 0x7fe3d406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/540349321 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d4156c40 0x7fe3d4070ee0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- 172.21.15.53:0/540349321 >> 172.21.15.53:0/540349321 conn(0x7fe3d4065c80 msgr2=0x7fe3d4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- 172.21.15.53:0/540349321 shutdown_connections 2024-09-13T18:34:27.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- 172.21.15.53:0/540349321 wait complete. 2024-09-13T18:34:27.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 Processor -- start 2024-09-13T18:34:27.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- start start 2024-09-13T18:34:27.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d406d270 0x7fe3d4143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d4156c40 0x7fe3d4158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4158540 0x7fe3d4150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41592a0 con 0x7fe3d4156c40 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4158a00 con 0x7fe3d406d270 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.416+0000 7fe3dbcee640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4158ce0 con 0x7fe3d4158540 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d4156c40 0x7fe3d4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d4156c40 0x7fe3d4158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49034/0 (socket says 172.21.15.53:49034) 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 -- 172.21.15.53:0/2225796188 learned_addr learned my addr 172.21.15.53:0/2225796188 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3da28b640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4158540 0x7fe3d4150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9a8a640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d406d270 0x7fe3d4143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 -- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4158540 msgr2=0x7fe3d4150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4158540 0x7fe3d4150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 -- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d406d270 msgr2=0x7fe3d4143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d406d270 0x7fe3d4143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 -- 172.21.15.53:0/2225796188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009420 con 0x7fe3d4156c40 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9a8a640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d406d270 0x7fe3d4143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9289640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d4156c40 0x7fe3d4158000 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400e870 tx=0x7fe3c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3ca7fc640 1 -- 172.21.15.53:0/2225796188 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4009510 con 0x7fe3d4156c40 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3ca7fc640 1 -- 172.21.15.53:0/2225796188 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c400eec0 con 0x7fe3d4156c40 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3ca7fc640 1 -- 172.21.15.53:0/2225796188 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c400cb40 con 0x7fe3d4156c40 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d4158fc0 con 0x7fe3d4156c40 2024-09-13T18:34:27.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d4143990 con 0x7fe3d4156c40 2024-09-13T18:34:27.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d406cd30 con 0x7fe3d4156c40 2024-09-13T18:34:27.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3ca7fc640 1 -- 172.21.15.53:0/2225796188 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fe3c400cca0 con 0x7fe3d4156c40 2024-09-13T18:34:27.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3ca7fc640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe3b8067020 0x7fe3b80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3ca7fc640 1 -- 172.21.15.53:0/2225796188 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3c4082e30 con 0x7fe3d4156c40 2024-09-13T18:34:27.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9a8a640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe3b8067020 0x7fe3b80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.420+0000 7fe3d9a8a640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe3b8067020 0x7fe3b80694e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00ad000 tx=0x7fe3d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.424+0000 7fe3ca7fc640 1 -- 172.21.15.53:0/2225796188 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3c40519d0 con 0x7fe3d4156c40 2024-09-13T18:34:27.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3d414dca0 con 0x7fe3d4156c40 2024-09-13T18:34:27.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3ca7fc640 1 -- 172.21.15.53:0/2225796188 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3c4054ff0 con 0x7fe3d4156c40 2024-09-13T18:34:27.583 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe3b8067020 msgr2=0x7fe3b80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe3b8067020 0x7fe3b80694e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00ad000 tx=0x7fe3d0008040 comp rx=0 tx=0).stop 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d4156c40 msgr2=0x7fe3d4158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d4156c40 0x7fe3d4158000 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400e870 tx=0x7fe3c400ec70 comp rx=0 tx=0).stop 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 shutdown_connections 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe3b8067020 0x7fe3b80694e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3d4158540 0x7fe3d4150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3d4156c40 0x7fe3d4158000 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 --2- 172.21.15.53:0/2225796188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3d406d270 0x7fe3d4143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 >> 172.21.15.53:0/2225796188 conn(0x7fe3d4065c80 msgr2=0x7fe3d40ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 shutdown_connections 2024-09-13T18:34:27.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.580+0000 7fe3dbcee640 1 -- 172.21.15.53:0/2225796188 wait complete. 2024-09-13T18:34:27.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:34:27.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f3254d22640 1 Processor -- start 2024-09-13T18:34:27.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f3254d22640 1 -- start start 2024-09-13T18:34:27.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f3254d22640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32500d19c0 0x7f32500cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f3254d22640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32500cf600 0x7f32500b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f3254d22640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500d2400 con 0x7f325015cab0 2024-09-13T18:34:27.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f3254d22640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32500cfa90 con 0x7f32500d19c0 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f3254d22640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500d1530 con 0x7f32500cf600 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32500d19c0 0x7f32500cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32500d19c0 0x7f32500cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49048/0 (socket says 172.21.15.53:49048) 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324dd9b640 1 -- 172.21.15.53:0/2765900588 learned_addr learned my addr 172.21.15.53:0/2765900588 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324e59c640 1 --1- 172.21.15.53:0/2765900588 >> v1:172.21.15.53:6789/0 conn(0x7f325015cab0 0x7f32500cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58988/0 (socket says 172.21.15.53:58988) 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324ed9d640 1 --2- 172.21.15.53:0/2765900588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32500cf600 0x7f32500b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324dd9b640 1 -- 172.21.15.53:0/2765900588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32500cf600 msgr2=0x7f32500b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324dd9b640 1 --2- 172.21.15.53:0/2765900588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32500cf600 0x7f32500b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324dd9b640 1 -- 172.21.15.53:0/2765900588 >> v1:172.21.15.53:6789/0 conn(0x7f325015cab0 legacy=0x7f32500cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.720+0000 7f324dd9b640 1 -- 172.21.15.53:0/2765900588 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500cddd0 con 0x7f32500d19c0 2024-09-13T18:34:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f324dd9b640 1 --2- 172.21.15.53:0/2765900588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500d19c0 0x7f32500cf0c0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f3244009870 tx=0x7f324401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15662d17789c66e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f324d59a640 1 -- 172.21.15.53:0/2765900588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32440ab650 con 0x7f32500d19c0 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f324d59a640 1 -- 172.21.15.53:0/2765900588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32440ab7b0 con 0x7f32500d19c0 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f324d59a640 1 -- 172.21.15.53:0/2765900588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32440abb40 con 0x7f32500d19c0 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 -- 172.21.15.53:0/2765900588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500d19c0 msgr2=0x7f32500cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 --2- 172.21.15.53:0/2765900588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500d19c0 0x7f32500cf0c0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f3244009870 tx=0x7f324401c560 comp rx=0 tx=0).stop 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 -- 172.21.15.53:0/2765900588 shutdown_connections 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 --2- 172.21.15.53:0/2765900588 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f32500cf600 0x7f32500b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 --2- 172.21.15.53:0/2765900588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500d19c0 0x7f32500cf0c0 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 -- 172.21.15.53:0/2765900588 >> 172.21.15.53:0/2765900588 conn(0x7f3250065c80 msgr2=0x7f3250066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 -- 172.21.15.53:0/2765900588 shutdown_connections 2024-09-13T18:34:27.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 -- 172.21.15.53:0/2765900588 wait complete. 2024-09-13T18:34:27.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 Processor -- start 2024-09-13T18:34:27.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.724+0000 7f3254d22640 1 -- start start 2024-09-13T18:34:27.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500cf600 0x7f32500c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32500d19c0 0x7f32500cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f325015cab0 0x7f32500cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3250150230 con 0x7f32500cf600 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500c82f0 con 0x7f32500d19c0 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500cccd0 con 0x7f325015cab0 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500cf600 0x7f32500c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500cf600 0x7f32500c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49056/0 (socket says 172.21.15.53:49056) 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 -- 172.21.15.53:0/808951397 learned_addr learned my addr 172.21.15.53:0/808951397 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 -- 172.21.15.53:0/808951397 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f325015cab0 msgr2=0x7f32500cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f325015cab0 0x7f32500cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 -- 172.21.15.53:0/808951397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32500d19c0 msgr2=0x7f32500cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32500d19c0 0x7f32500cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 -- 172.21.15.53:0/808951397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32440094d0 con 0x7f32500cf600 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324e59c640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500cf600 0x7f32500c7db0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f324000c430 tx=0x7f324000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f323effd640 1 -- 172.21.15.53:0/808951397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400074e0 con 0x7f32500cf600 2024-09-13T18:34:27.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f323effd640 1 -- 172.21.15.53:0/808951397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240007640 con 0x7f32500cf600 2024-09-13T18:34:27.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32500ccfb0 con 0x7f32500cf600 2024-09-13T18:34:27.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f323effd640 1 -- 172.21.15.53:0/808951397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240004a10 con 0x7f32500cf600 2024-09-13T18:34:27.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32500cd570 con 0x7f32500cf600 2024-09-13T18:34:27.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32500b5870 con 0x7f32500cf600 2024-09-13T18:34:27.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f323effd640 1 -- 172.21.15.53:0/808951397 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f3240004b70 con 0x7f32500cf600 2024-09-13T18:34:27.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f323effd640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3230067020 0x7f32300694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:27.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f323effd640 1 -- 172.21.15.53:0/808951397 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3240082e30 con 0x7f32500cf600 2024-09-13T18:34:27.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.728+0000 7f324dd9b640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3230067020 0x7f32300694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:27.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.732+0000 7f324dd9b640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3230067020 0x7f32300694e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f32440af000 tx=0x7f3244008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:27.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.732+0000 7f323effd640 1 -- 172.21.15.53:0/808951397 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32400519f0 con 0x7f32500cf600 2024-09-13T18:34:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.896+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f325015c2e0 con 0x7f32500cf600 2024-09-13T18:34:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.896+0000 7f323effd640 1 -- 172.21.15.53:0/808951397 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v162) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3240055010 con 0x7f32500cf600 2024-09-13T18:34:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3230067020 msgr2=0x7f32300694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3230067020 0x7f32300694e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f32440af000 tx=0x7f3244008040 comp rx=0 tx=0).stop 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500cf600 msgr2=0x7f32500c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500cf600 0x7f32500c7db0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f324000c430 tx=0x7f324000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 shutdown_connections 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3230067020 0x7f32300694e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f325015cab0 0x7f32500cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f32500d19c0 0x7f32500cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 --2- 172.21.15.53:0/808951397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32500cf600 0x7f32500c7db0 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 >> 172.21.15.53:0/808951397 conn(0x7f3250065c80 msgr2=0x7f32500661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 shutdown_connections 2024-09-13T18:34:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:27.900+0000 7f3254d22640 1 -- 172.21.15.53:0/808951397 wait complete. 2024-09-13T18:34:27.919 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:34:27.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:27.919 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:27.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36691]: fuse finished with error 0 and tester_r 0 2024-09-13T18:34:27.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:34:27.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:27.935 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:34:28.104 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:34:28.104 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:28.110 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:34:28.110 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:34:28.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:28.111 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:34:28.157 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:34:28.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:34:28.158 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:34:28.158 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:28.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:34:28.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:34:28.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:28.164 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:34:28.213 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:34:28.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:34:28.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:28.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f3191656640 1 Processor -- start 2024-09-13T18:34:28.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f3191656640 1 -- start start 2024-09-13T18:34:28.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f3191656640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f318c1582a0 0x7f318c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f3191656640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c0713a0 0x7f318c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f3191656640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c06d480 con 0x7f318c15b7c0 2024-09-13T18:34:28.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f3191656640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c15aaf0 con 0x7f318c1582a0 2024-09-13T18:34:28.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f3191656640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c06d760 con 0x7f318c0713a0 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f318c1582a0 0x7f318c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f318c1582a0 0x7f318c06c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49062/0 (socket says 172.21.15.53:49062) 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318affd640 1 -- 172.21.15.53:0/2356258367 learned_addr learned my addr 172.21.15.53:0/2356258367 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318b7fe640 1 --2- 172.21.15.53:0/2356258367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c0713a0 0x7f318c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318affd640 1 -- 172.21.15.53:0/2356258367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c0713a0 msgr2=0x7f318c06ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318affd640 1 --2- 172.21.15.53:0/2356258367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c0713a0 0x7f318c06ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318affd640 1 -- 172.21.15.53:0/2356258367 >> v1:172.21.15.87:6789/0 conn(0x7f318c15b7c0 legacy=0x7f318c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.344+0000 7f318affd640 1 -- 172.21.15.53:0/2356258367 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c15ace0 con 0x7f318c1582a0 2024-09-13T18:34:28.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f318affd640 1 --2- 172.21.15.53:0/2356258367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c1582a0 0x7f318c06c900 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f318401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129fe20c32e3d039 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:28.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3189ffb640 1 -- 172.21.15.53:0/2356258367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840a95f0 con 0x7f318c1582a0 2024-09-13T18:34:28.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3189ffb640 1 -- 172.21.15.53:0/2356258367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840a9750 con 0x7f318c1582a0 2024-09-13T18:34:28.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3189ffb640 1 -- 172.21.15.53:0/2356258367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840a9ae0 con 0x7f318c1582a0 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 -- 172.21.15.53:0/2356258367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c1582a0 msgr2=0x7f318c06c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 --2- 172.21.15.53:0/2356258367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c1582a0 0x7f318c06c900 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f318401c530 comp rx=0 tx=0).stop 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 -- 172.21.15.53:0/2356258367 shutdown_connections 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 --2- 172.21.15.53:0/2356258367 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c0713a0 0x7f318c06ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 --2- 172.21.15.53:0/2356258367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c1582a0 0x7f318c06c900 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 -- 172.21.15.53:0/2356258367 >> 172.21.15.53:0/2356258367 conn(0x7f318c065c80 msgr2=0x7f318c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 -- 172.21.15.53:0/2356258367 shutdown_connections 2024-09-13T18:34:28.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 -- 172.21.15.53:0/2356258367 wait complete. 2024-09-13T18:34:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 Processor -- start 2024-09-13T18:34:28.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.348+0000 7f3191656640 1 -- start start 2024-09-13T18:34:28.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c0713a0 0x7f318c14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f318c1582a0 0x7f318c150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c15b7c0 0x7f318c156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c14feb0 con 0x7f318c0713a0 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c14bbb0 con 0x7f318c1582a0 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c14b2c0 con 0x7f318c15b7c0 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c0713a0 0x7f318c14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c0713a0 0x7f318c14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49072/0 (socket says 172.21.15.53:49072) 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 -- 172.21.15.53:0/2754234958 learned_addr learned my addr 172.21.15.53:0/2754234958 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318b7fe640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c15b7c0 0x7f318c156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318a7fc640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f318c1582a0 0x7f318c150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 -- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c15b7c0 msgr2=0x7f318c156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c15b7c0 0x7f318c156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 -- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f318c1582a0 msgr2=0x7f318c150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f318c1582a0 0x7f318c150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 -- 172.21.15.53:0/2754234958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840094d0 con 0x7f318c0713a0 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318a7fc640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f318c1582a0 0x7f318c150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:28.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318affd640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c0713a0 0x7f318c14ad80 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f31840ab040 tx=0x7f318401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f31737fe640 1 -- 172.21.15.53:0/2754234958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840b1800 con 0x7f318c0713a0 2024-09-13T18:34:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f31737fe640 1 -- 172.21.15.53:0/2754234958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840b1980 con 0x7f318c0713a0 2024-09-13T18:34:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f31737fe640 1 -- 172.21.15.53:0/2754234958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840b1d30 con 0x7f318c0713a0 2024-09-13T18:34:28.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c14f2a0 con 0x7f318c0713a0 2024-09-13T18:34:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c14f860 con 0x7f318c0713a0 2024-09-13T18:34:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c067400 con 0x7f318c0713a0 2024-09-13T18:34:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f31737fe640 1 -- 172.21.15.53:0/2754234958 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f31840a8350 con 0x7f318c0713a0 2024-09-13T18:34:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f31737fe640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3178067050 0x7f3178069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f31737fe640 1 -- 172.21.15.53:0/2754234958 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f318411d5b0 con 0x7f318c0713a0 2024-09-13T18:34:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.352+0000 7f318a7fc640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3178067050 0x7f3178069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.356+0000 7f318a7fc640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3178067050 0x7f3178069510 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f318c0ca6e0 tx=0x7f3180009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:28.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.360+0000 7f31737fe640 1 -- 172.21.15.53:0/2754234958 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f31840ec170 con 0x7f318c0713a0 2024-09-13T18:34:28.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.552+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f318c14d160 con 0x7f318c0713a0 2024-09-13T18:34:28.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.552+0000 7f31737fe640 1 -- 172.21.15.53:0/2754234958 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f31840ef790 con 0x7f318c0713a0 2024-09-13T18:34:28.555 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:28.556 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3371404154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3371404154},{"type":"v1","addr":"172.21.15.87:6833","nonce":3371404154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8665,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1374144604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1374144604},{"type":"v1","addr":"172.21.15.87:6835","nonce":1374144604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2656917860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656917860},{"type":"v1","addr":"172.21.15.53:6834","nonce":2656917860}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:58.642385+0000","modified":"2024-09-13T18:34:01.656052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10023},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10023":{"gid":10023,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3514602173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3514602173},{"type":"v1","addr":"172.21.15.53:6835","nonce":3514602173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2024-09-13T18:34:28.556 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 97 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3178067050 msgr2=0x7f3178069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3178067050 0x7f3178069510 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f318c0ca6e0 tx=0x7f3180009040 comp rx=0 tx=0).stop 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c0713a0 msgr2=0x7f318c14ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c0713a0 0x7f318c14ad80 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f31840ab040 tx=0x7f318401ad70 comp rx=0 tx=0).stop 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 shutdown_connections 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3178067050 0x7f3178069510 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f318c15b7c0 0x7f318c156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f318c1582a0 0x7f318c150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 --2- 172.21.15.53:0/2754234958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f318c0713a0 0x7f318c14ad80 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 >> 172.21.15.53:0/2754234958 conn(0x7f318c065c80 msgr2=0x7f318c06f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:28.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 shutdown_connections 2024-09-13T18:34:28.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.556+0000 7f3191656640 1 -- 172.21.15.53:0/2754234958 wait complete. 2024-09-13T18:34:28.576 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:28.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0ccc52f640 1 Processor -- start 2024-09-13T18:34:28.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0ccc52f640 1 -- start start 2024-09-13T18:34:28.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0ccc52f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cc40d19c0 0x7f0cc40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0ccc52f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc40d2400 con 0x7f0cc415cab0 2024-09-13T18:34:28.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0ccc52f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc40d1530 con 0x7f0cc40cf600 2024-09-13T18:34:28.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0ccc52f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc40cfa90 con 0x7f0cc40d19c0 2024-09-13T18:34:28.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cca2cb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0cc415cab0 0x7f0cc40cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59002/0 (socket says 172.21.15.53:59002) 2024-09-13T18:34:28.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cca2cb640 1 -- 172.21.15.53:0/751905080 learned_addr learned my addr 172.21.15.53:0/751905080 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:28.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cc9aca640 1 --2- 172.21.15.53:0/751905080 >> v2:172.21.15.53:3300/0 conn(0x7f0cc40d19c0 0x7f0cc40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cc92c9640 1 -- 172.21.15.53:0/751905080 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417025779 0 0) 0x7f0cc40d2400 con 0x7f0cc415cab0 2024-09-13T18:34:28.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cc92c9640 1 -- 172.21.15.53:0/751905080 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb0003530 con 0x7f0cc415cab0 2024-09-13T18:34:28.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cc9aca640 1 -- 172.21.15.53:0/751905080 >> v1:172.21.15.87:6789/0 conn(0x7f0cc40cf600 legacy=0x7f0cc40b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cc9aca640 1 -- 172.21.15.53:0/751905080 >> v1:172.21.15.53:6789/0 conn(0x7f0cc415cab0 legacy=0x7f0cc40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cc92c9640 1 -- 172.21.15.53:0/751905080 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1418272981 0 0) 0x7f0cb0003530 con 0x7f0cc415cab0 2024-09-13T18:34:28.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.700+0000 7f0cc9aca640 1 -- 172.21.15.53:0/751905080 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40cddd0 con 0x7f0cc40d19c0 2024-09-13T18:34:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0cc9aca640 1 --2- 172.21.15.53:0/751905080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40d19c0 0x7f0cc40cf0c0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097c0 tx=0x7f0cb401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62e5a9b41c63974 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0cc92c9640 1 -- 172.21.15.53:0/751905080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0001680 con 0x7f0cc40d19c0 2024-09-13T18:34:28.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0cc92c9640 1 -- 172.21.15.53:0/751905080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb40a7050 con 0x7f0cc40d19c0 2024-09-13T18:34:28.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0cc92c9640 1 -- 172.21.15.53:0/751905080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40ab620 con 0x7f0cc40d19c0 2024-09-13T18:34:28.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0ccc52f640 1 -- 172.21.15.53:0/751905080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40d19c0 msgr2=0x7f0cc40cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/751905080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40d19c0 0x7f0cc40cf0c0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097c0 tx=0x7f0cb401c3c0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0ccc52f640 1 -- 172.21.15.53:0/751905080 shutdown_connections 2024-09-13T18:34:28.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/751905080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40d19c0 0x7f0cc40cf0c0 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0ccc52f640 1 -- 172.21.15.53:0/751905080 >> 172.21.15.53:0/751905080 conn(0x7f0cc4065c80 msgr2=0x7f0cc4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:28.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0ccc52f640 1 -- 172.21.15.53:0/751905080 shutdown_connections 2024-09-13T18:34:28.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.704+0000 7f0ccc52f640 1 -- 172.21.15.53:0/751905080 wait complete. 2024-09-13T18:34:28.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 Processor -- start 2024-09-13T18:34:28.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 -- start start 2024-09-13T18:34:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40cf600 0x7f0cc4152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc40d19c0 0x7f0cc4158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc415cab0 0x7f0cc414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc41553f0 con 0x7f0cc40cf600 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4152f50 con 0x7f0cc40d19c0 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4153230 con 0x7f0cc415cab0 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40cf600 0x7f0cc4152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40cf600 0x7f0cc4152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49094/0 (socket says 172.21.15.53:49094) 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 -- 172.21.15.53:0/734014224 learned_addr learned my addr 172.21.15.53:0/734014224 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cc9aca640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc40d19c0 0x7f0cc4158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccaacc640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc415cab0 0x7f0cc414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 -- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc415cab0 msgr2=0x7f0cc414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc415cab0 0x7f0cc414c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 -- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc40d19c0 msgr2=0x7f0cc4158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc40d19c0 0x7f0cc4158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 -- 172.21.15.53:0/734014224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4009420 con 0x7f0cc40cf600 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cc9aca640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc40d19c0 0x7f0cc4158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccaacc640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc415cab0 0x7f0cc414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cca2cb640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40cf600 0x7f0cc4152700 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c750 tx=0x7f0cc000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cbaffd640 1 -- 172.21.15.53:0/734014224 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0005ae0 con 0x7f0cc40cf600 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cbaffd640 1 -- 172.21.15.53:0/734014224 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc0005c40 con 0x7f0cc40cf600 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc4153510 con 0x7f0cc40cf600 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cbaffd640 1 -- 172.21.15.53:0/734014224 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00072b0 con 0x7f0cc40cf600 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc4152c40 con 0x7f0cc40cf600 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc40cf0c0 con 0x7f0cc40cf600 2024-09-13T18:34:28.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.708+0000 7f0cbaffd640 1 -- 172.21.15.53:0/734014224 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f0cc0007410 con 0x7f0cc40cf600 2024-09-13T18:34:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.712+0000 7f0cbaffd640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ca8067020 0x7f0ca80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.712+0000 7f0cbaffd640 1 -- 172.21.15.53:0/734014224 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cc0082390 con 0x7f0cc40cf600 2024-09-13T18:34:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.712+0000 7f0cc9aca640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ca8067020 0x7f0ca80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.712+0000 7f0cc9aca640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ca8067020 0x7f0ca80694e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40ad000 tx=0x7f0cb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.716+0000 7f0cbaffd640 1 -- 172.21.15.53:0/734014224 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cc0050fe0 con 0x7f0cc40cf600 2024-09-13T18:34:28.874 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.872+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cc415d0a0 con 0x7f0cc40cf600 2024-09-13T18:34:28.876 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.872+0000 7f0cbaffd640 1 -- 172.21.15.53:0/734014224 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f0cc0017070 con 0x7f0cc40cf600 2024-09-13T18:34:28.877 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:28.877 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":162,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:59.644771+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:28.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ca8067020 msgr2=0x7f0ca80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ca8067020 0x7f0ca80694e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40ad000 tx=0x7f0cb4008040 comp rx=0 tx=0).stop 2024-09-13T18:34:28.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40cf600 msgr2=0x7f0cc4152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:28.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40cf600 0x7f0cc4152700 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c750 tx=0x7f0cc000cc10 comp rx=0 tx=0).stop 2024-09-13T18:34:28.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 shutdown_connections 2024-09-13T18:34:28.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0ca8067020 0x7f0ca80694e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0cc415cab0 0x7f0cc414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0cc40d19c0 0x7f0cc4158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 --2- 172.21.15.53:0/734014224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cc40cf600 0x7f0cc4152700 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:28.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 >> 172.21.15.53:0/734014224 conn(0x7f0cc4065c80 msgr2=0x7f0cc40ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:28.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 shutdown_connections 2024-09-13T18:34:28.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:28.876+0000 7f0ccc52f640 1 -- 172.21.15.53:0/734014224 wait complete. 2024-09-13T18:34:28.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:33:56.968030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:33:57.623731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:34:28.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:34:29.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.016+0000 7f44c0086640 1 Processor -- start 2024-09-13T18:34:29.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.016+0000 7f44c0086640 1 -- start start 2024-09-13T18:34:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44c0086640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f44b815fd60 0x7f44b80cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44c0086640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44c0086640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b8160ca0 con 0x7f44b80cd580 2024-09-13T18:34:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44c0086640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80cd9a0 con 0x7f44b815fd60 2024-09-13T18:34:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44c0086640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8161130 con 0x7f44b80cf7b0 2024-09-13T18:34:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44bd621640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f44b80cd580 0x7f44b80cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59010/0 (socket says 172.21.15.53:59010) 2024-09-13T18:34:29.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44bd621640 1 -- 172.21.15.53:0/1866469858 learned_addr learned my addr 172.21.15.53:0/1866469858 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44bde22640 1 --2- 172.21.15.53:0/1866469858 >> v2:172.21.15.87:3300/0 conn(0x7f44b815fd60 0x7f44b80cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44be623640 1 --2- 172.21.15.53:0/1866469858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44bce20640 1 -- 172.21.15.53:0/1866469858 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099670609 0 0) 0x7f44b8160ca0 con 0x7f44b80cd580 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44bce20640 1 -- 172.21.15.53:0/1866469858 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a4003530 con 0x7f44b80cd580 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44be623640 1 -- 172.21.15.53:0/1866469858 >> v2:172.21.15.87:3300/0 conn(0x7f44b815fd60 msgr2=0x7f44b80cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44be623640 1 --2- 172.21.15.53:0/1866469858 >> v2:172.21.15.87:3300/0 conn(0x7f44b815fd60 0x7f44b80cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44be623640 1 -- 172.21.15.53:0/1866469858 >> v1:172.21.15.53:6789/0 conn(0x7f44b80cd580 legacy=0x7f44b80cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.020+0000 7f44be623640 1 -- 172.21.15.53:0/1866469858 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b8160370 con 0x7f44b80cf7b0 2024-09-13T18:34:29.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44be623640 1 --2- 172.21.15.53:0/1866469858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80d09e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009d90 tx=0x7f44b001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=328e7cdc8715a465 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bce20640 1 -- 172.21.15.53:0/1866469858 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b00af600 con 0x7f44b80cf7b0 2024-09-13T18:34:29.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bce20640 1 -- 172.21.15.53:0/1866469858 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b00ab050 con 0x7f44b80cf7b0 2024-09-13T18:34:29.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bce20640 1 -- 172.21.15.53:0/1866469858 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b00af960 con 0x7f44b80cf7b0 2024-09-13T18:34:29.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- 172.21.15.53:0/1866469858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 msgr2=0x7f44b80d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 --2- 172.21.15.53:0/1866469858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80d09e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009d90 tx=0x7f44b001f150 comp rx=0 tx=0).stop 2024-09-13T18:34:29.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- 172.21.15.53:0/1866469858 shutdown_connections 2024-09-13T18:34:29.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 --2- 172.21.15.53:0/1866469858 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80d09e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 --2- 172.21.15.53:0/1866469858 >> v2:172.21.15.87:3300/0 conn(0x7f44b815fd60 0x7f44b80cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- 172.21.15.53:0/1866469858 >> 172.21.15.53:0/1866469858 conn(0x7f44b8070970 msgr2=0x7f44b8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:29.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- 172.21.15.53:0/1866469858 shutdown_connections 2024-09-13T18:34:29.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- 172.21.15.53:0/1866469858 wait complete. 2024-09-13T18:34:29.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 Processor -- start 2024-09-13T18:34:29.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- start start 2024-09-13T18:34:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b80cd580 0x7f44b81f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44b815fd60 0x7f44b80c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81f62a0 con 0x7f44b80cd580 2024-09-13T18:34:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81f3120 con 0x7f44b815fd60 2024-09-13T18:34:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44c0086640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81f5620 con 0x7f44b80cf7b0 2024-09-13T18:34:29.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b80cd580 0x7f44b81f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b80cd580 0x7f44b81f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49098/0 (socket says 172.21.15.53:49098) 2024-09-13T18:34:29.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 -- 172.21.15.53:0/1954633771 learned_addr learned my addr 172.21.15.53:0/1954633771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:29.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bd621640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44be623640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44b815fd60 0x7f44b80c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 -- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 msgr2=0x7f44b80b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 -- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44b815fd60 msgr2=0x7f44b80c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44b815fd60 0x7f44b80c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bde22640 1 -- 172.21.15.53:0/1954633771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009a70 con 0x7f44b80cd580 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44bd621640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.024+0000 7f44be623640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44b815fd60 0x7f44b80c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44bde22640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b80cd580 0x7f44b81f2be0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f44b400e960 tx=0x7f44b400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44ae7fc640 1 -- 172.21.15.53:0/1954633771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4009690 con 0x7f44b80cd580 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44ae7fc640 1 -- 172.21.15.53:0/1954633771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b400ca00 con 0x7f44b80cd580 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b81f5900 con 0x7f44b80cd580 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44ae7fc640 1 -- 172.21.15.53:0/1954633771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400cd70 con 0x7f44b80cd580 2024-09-13T18:34:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b81f5ec0 con 0x7f44b80cd580 2024-09-13T18:34:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b80c8cf0 con 0x7f44b80cd580 2024-09-13T18:34:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44ae7fc640 1 -- 172.21.15.53:0/1954633771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f44b4013470 con 0x7f44b80cd580 2024-09-13T18:34:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44ae7fc640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f449c067020 0x7f449c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44ae7fc640 1 -- 172.21.15.53:0/1954633771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44b4082f10 con 0x7f44b80cd580 2024-09-13T18:34:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44bd621640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f449c067020 0x7f449c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.028+0000 7f44bd621640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f449c067020 0x7f449c0694e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44b80b2990 tx=0x7f44a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.032+0000 7f44ae7fc640 1 -- 172.21.15.53:0/1954633771 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f44b4051ad0 con 0x7f44b80cd580 2024-09-13T18:34:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44b80d15b0 con 0x7f44b80cd580 2024-09-13T18:34:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44ae7fc640 1 -- 172.21.15.53:0/1954633771 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44b40550f0 con 0x7f44b80cd580 2024-09-13T18:34:29.198 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:34:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f449c067020 msgr2=0x7f449c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f449c067020 0x7f449c0694e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44b80b2990 tx=0x7f44a8009040 comp rx=0 tx=0).stop 2024-09-13T18:34:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b80cd580 msgr2=0x7f44b81f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b80cd580 0x7f44b81f2be0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f44b400e960 tx=0x7f44b400ee20 comp rx=0 tx=0).stop 2024-09-13T18:34:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 shutdown_connections 2024-09-13T18:34:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f449c067020 0x7f449c0694e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f44b80cf7b0 0x7f44b80b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44b815fd60 0x7f44b80c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 --2- 172.21.15.53:0/1954633771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44b80cd580 0x7f44b81f2be0 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 >> 172.21.15.53:0/1954633771 conn(0x7f44b8070970 msgr2=0x7f44b815e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:29.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 shutdown_connections 2024-09-13T18:34:29.201 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.196+0000 7f44c0086640 1 -- 172.21.15.53:0/1954633771 wait complete. 2024-09-13T18:34:29.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:34:29.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bff5b4640 1 Processor -- start 2024-09-13T18:34:29.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bff5b4640 1 -- start start 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bff5b4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4bf815c830 0x7f4bf80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bff5b4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80b7db0 con 0x7f4bf80ccd10 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bff5b4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80d0650 con 0x7f4bf80d3390 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bff5b4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80d0c10 con 0x7f4bf815c830 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfcb4f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4bf80ccd10 0x7f4bf80d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59012/0 (socket says 172.21.15.53:59012) 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfcb4f640 1 -- 172.21.15.53:0/450942485 learned_addr learned my addr 172.21.15.53:0/450942485 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfd350640 1 --2- 172.21.15.53:0/450942485 >> v2:172.21.15.87:3300/0 conn(0x7f4bf815c830 0x7f4bf80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374070282 0 0) 0x7f4bf80b7db0 con 0x7f4bf80ccd10 2024-09-13T18:34:29.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be4003530 con 0x7f4bf80ccd10 2024-09-13T18:34:29.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2116281359 0 0) 0x7f4be4003530 con 0x7f4bf80ccd10 2024-09-13T18:34:29.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 >> v2:172.21.15.87:3300/0 conn(0x7f4bf815c830 msgr2=0x7f4bf80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 --2- 172.21.15.53:0/450942485 >> v2:172.21.15.87:3300/0 conn(0x7f4bf815c830 0x7f4bf80d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 >> v1:172.21.15.87:6789/0 conn(0x7f4bf80d3390 legacy=0x7f4bf80b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80cd7d0 con 0x7f4bf80ccd10 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f4be8001680 con 0x7f4bf80ccd10 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 >> v1:172.21.15.53:6789/0 conn(0x7f4bf80ccd10 legacy=0x7f4bf80d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4be4003980 0x7f4be4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be40047d0 0x7f4be4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4be4005190 0x7f4be400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80d0c10 con 0x7f4be4003980 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be400c030 con 0x7f4be40047d0 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be400c1f0 con 0x7f4be4005190 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfd350640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4be4003980 0x7f4be4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfcb4f640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be40047d0 0x7f4be4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfdb51640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4be4005190 0x7f4be400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfd350640 1 -- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4be4005190 msgr2=0x7f4be400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfd350640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4be4005190 0x7f4be400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfd350640 1 -- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be40047d0 msgr2=0x7f4be4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfd350640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be40047d0 0x7f4be4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfdb51640 1 -- 172.21.15.53:0/450942485 reap_dead start 2024-09-13T18:34:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfd350640 1 -- 172.21.15.53:0/450942485 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4003530 con 0x7f4be4003980 2024-09-13T18:34:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.340+0000 7f4bfcb4f640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be40047d0 0x7f4be4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bfd350640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4be4003980 0x7f4be4003da0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009ae0 tx=0x7f4bf401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35a3176df64a480 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40a5550 con 0x7f4be4003980 2024-09-13T18:34:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf40a56b0 con 0x7f4be4003980 2024-09-13T18:34:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4beffff640 1 -- 172.21.15.53:0/450942485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40a5a60 con 0x7f4be4003980 2024-09-13T18:34:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bff5b4640 1 -- 172.21.15.53:0/450942485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4be4003980 msgr2=0x7f4be4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4be4003980 0x7f4be4003da0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009ae0 tx=0x7f4bf401ca90 comp rx=0 tx=0).stop 2024-09-13T18:34:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bff5b4640 1 -- 172.21.15.53:0/450942485 shutdown_connections 2024-09-13T18:34:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/450942485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4be4003980 0x7f4be4003da0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bff5b4640 1 -- 172.21.15.53:0/450942485 >> 172.21.15.53:0/450942485 conn(0x7f4bf8070970 msgr2=0x7f4bf8070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bff5b4640 1 -- 172.21.15.53:0/450942485 shutdown_connections 2024-09-13T18:34:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.344+0000 7f4bff5b4640 1 -- 172.21.15.53:0/450942485 wait complete. 2024-09-13T18:34:29.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 Processor -- start 2024-09-13T18:34:29.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 -- start start 2024-09-13T18:34:29.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be4003980 0x7f4bf815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bf81f5220 0x7f4bf80ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf80cae00 0x7f4bf80b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80cb330 con 0x7f4bf80cae00 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80c6ca0 con 0x7f4be4003980 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80c6f80 con 0x7f4bf81f5220 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf80cae00 0x7f4bf80b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf80cae00 0x7f4bf80b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49118/0 (socket says 172.21.15.53:49118) 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 -- 172.21.15.53:0/340683892 learned_addr learned my addr 172.21.15.53:0/340683892 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfd350640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be4003980 0x7f4bf815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfcb4f640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bf81f5220 0x7f4bf80ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 -- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bf81f5220 msgr2=0x7f4bf80ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bf81f5220 0x7f4bf80ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 -- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be4003980 msgr2=0x7f4bf815b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be4003980 0x7f4bf815b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 -- 172.21.15.53:0/340683892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80c7260 con 0x7f4bf80cae00 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfd350640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be4003980 0x7f4bf815b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bfdb51640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf80cae00 0x7f4bf80b32f0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f4bf808bb90 tx=0x7f4bf000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bedffb640 1 -- 172.21.15.53:0/340683892 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0003b80 con 0x7f4bf80cae00 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bedffb640 1 -- 172.21.15.53:0/340683892 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf0003ce0 con 0x7f4bf80cae00 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bedffb640 1 -- 172.21.15.53:0/340683892 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0005270 con 0x7f4bf80cae00 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf81f56a0 con 0x7f4bf80cae00 2024-09-13T18:34:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf80c7540 con 0x7f4bf80cae00 2024-09-13T18:34:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.348+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf80b56a0 con 0x7f4bf80cae00 2024-09-13T18:34:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.352+0000 7f4bedffb640 1 -- 172.21.15.53:0/340683892 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f4bf00053d0 con 0x7f4bf80cae00 2024-09-13T18:34:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.352+0000 7f4bedffb640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4bdc067020 0x7f4bdc0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.352+0000 7f4bedffb640 1 -- 172.21.15.53:0/340683892 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bf00824b0 con 0x7f4bf80cae00 2024-09-13T18:34:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.352+0000 7f4bfd350640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4bdc067020 0x7f4bdc0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.352+0000 7f4bfd350640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4bdc067020 0x7f4bdc0694e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40af000 tx=0x7f4bf4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.356+0000 7f4bedffb640 1 -- 172.21.15.53:0/340683892 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bf0051180 con 0x7f4bf80cae00 2024-09-13T18:34:29.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.516+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bf80cb470 con 0x7f4bf80cae00 2024-09-13T18:34:29.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.516+0000 7f4bedffb640 1 -- 172.21.15.53:0/340683892 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bf00180a0 con 0x7f4bf80cae00 2024-09-13T18:34:29.519 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4bdc067020 msgr2=0x7f4bdc0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4bdc067020 0x7f4bdc0694e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40af000 tx=0x7f4bf4008040 comp rx=0 tx=0).stop 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf80cae00 msgr2=0x7f4bf80b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf80cae00 0x7f4bf80b32f0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f4bf808bb90 tx=0x7f4bf000dc00 comp rx=0 tx=0).stop 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 shutdown_connections 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4bdc067020 0x7f4bdc0694e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4bf81f5220 0x7f4bf80ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bf80cae00 0x7f4bf80b32f0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 --2- 172.21.15.53:0/340683892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4be4003980 0x7f4bf815b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 >> 172.21.15.53:0/340683892 conn(0x7f4bf8070970 msgr2=0x7f4bf81601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 shutdown_connections 2024-09-13T18:34:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.520+0000 7f4bff5b4640 1 -- 172.21.15.53:0/340683892 wait complete. 2024-09-13T18:34:29.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:34:29.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fe1ba7640 1 Processor -- start 2024-09-13T18:34:29.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fe1ba7640 1 -- start start 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fe1ba7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7fdc160300 0x7f7fdc1606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fe1ba7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc0aff30 con 0x7f7fdc0cf6a0 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fe1ba7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc06ac90 con 0x7f7fdc15c9e0 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fe1ba7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0cfb10 con 0x7f7fdc160300 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7fdc0cf6a0 0x7f7fdc0b0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59020/0 (socket says 172.21.15.53:59020) 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 -- 172.21.15.53:0/175407418 learned_addr learned my addr 172.21.15.53:0/175407418 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdb7fe640 1 --2- 172.21.15.53:0/175407418 >> v2:172.21.15.87:3300/0 conn(0x7f7fdc160300 0x7f7fdc1606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925373892 0 0) 0x7f7fdc0aff30 con 0x7f7fdc0cf6a0 2024-09-13T18:34:29.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc8003530 con 0x7f7fdc0cf6a0 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3825238582 0 0) 0x7f7fc8003530 con 0x7f7fdc0cf6a0 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 >> v2:172.21.15.87:3300/0 conn(0x7f7fdc160300 msgr2=0x7f7fdc1606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 --2- 172.21.15.53:0/175407418 >> v2:172.21.15.87:3300/0 conn(0x7f7fdc160300 0x7f7fdc1606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 >> v1:172.21.15.87:6789/0 conn(0x7f7fdc15c9e0 legacy=0x7f7fdc0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc06af70 con 0x7f7fdc0cf6a0 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7fd4001a00 con 0x7f7fdc0cf6a0 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 >> v1:172.21.15.53:6789/0 conn(0x7f7fdc0cf6a0 legacy=0x7f7fdc0b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8003980 0x7f7fc8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80047d0 0x7f7fc8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc8005190 0x7f7fc800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc800c000 con 0x7f7fc8005190 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc800c170 con 0x7f7fc80047d0 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc800c330 con 0x7f7fc8003980 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc8005190 0x7f7fc800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdaffd640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80047d0 0x7f7fc8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdb7fe640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8003980 0x7f7fc8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 -- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8003980 msgr2=0x7f7fc8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8003980 0x7f7fc8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 -- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80047d0 msgr2=0x7f7fc8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fc80047d0 0x7f7fc8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdbfff640 1 -- 172.21.15.53:0/175407418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8003530 con 0x7f7fc8005190 2024-09-13T18:34:29.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.652+0000 7f7fdb7fe640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8003980 0x7f7fc8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:29.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fdbfff640 1 -- 172.21.15.53:0/175407418 reap_dead start 2024-09-13T18:34:29.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fdbfff640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc8005190 0x7f7fc800b990 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400a830 tx=0x7f7fd401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd49e209260954aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40072d0 con 0x7f7fc8005190 2024-09-13T18:34:29.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd40a8070 con 0x7f7fc8005190 2024-09-13T18:34:29.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fda7fc640 1 -- 172.21.15.53:0/175407418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4007690 con 0x7f7fc8005190 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/175407418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc8005190 msgr2=0x7f7fc800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc8005190 0x7f7fc800b990 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400a830 tx=0x7f7fd401d360 comp rx=0 tx=0).stop 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/175407418 shutdown_connections 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/175407418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fc8005190 0x7f7fc800b990 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/175407418 >> 172.21.15.53:0/175407418 conn(0x7f7fdc0b20d0 msgr2=0x7f7fdc0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/175407418 shutdown_connections 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/175407418 wait complete. 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 Processor -- start 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- start start 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8005190 0x7f7fdc151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fdc15cdc0 0x7f7fdc157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fdc1584c0 0x7f7fdc156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc158940 con 0x7f7fdc1584c0 2024-09-13T18:34:29.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc151e70 con 0x7f7fdc15cdc0 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.656+0000 7f7fe1ba7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc15f520 con 0x7f7fc8005190 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fdc1584c0 0x7f7fdc156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fdc1584c0 0x7f7fdc156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49136/0 (socket says 172.21.15.53:49136) 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 -- 172.21.15.53:0/2179297245 learned_addr learned my addr 172.21.15.53:0/2179297245 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdaffd640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fdc15cdc0 0x7f7fdc157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdb7fe640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8005190 0x7f7fdc151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 -- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8005190 msgr2=0x7f7fdc151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8005190 0x7f7fdc151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 -- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fdc15cdc0 msgr2=0x7f7fdc157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fdc15cdc0 0x7f7fdc157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 -- 172.21.15.53:0/2179297245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc15f800 con 0x7f7fdc1584c0 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdb7fe640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8005190 0x7f7fdc151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdbfff640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fdc1584c0 0x7f7fdc156100 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4007040 tx=0x7f7fc8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2179297245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4004d70 con 0x7f7fdc1584c0 2024-09-13T18:34:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2179297245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd40070d0 con 0x7f7fdc1584c0 2024-09-13T18:34:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc15fae0 con 0x7f7fdc1584c0 2024-09-13T18:34:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2179297245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4007460 con 0x7f7fdc1584c0 2024-09-13T18:34:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc1600a0 con 0x7f7fdc1584c0 2024-09-13T18:34:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc1606e0 con 0x7f7fdc1584c0 2024-09-13T18:34:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2179297245 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f7fd40aa070 con 0x7f7fdc1584c0 2024-09-13T18:34:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fd3fff640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7fbc067020 0x7f7fbc0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2179297245 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fd411c350 con 0x7f7fdc1584c0 2024-09-13T18:34:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdb7fe640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7fbc067020 0x7f7fbc0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.660+0000 7f7fdb7fe640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7fbc067020 0x7f7fbc0694e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009ac0 tx=0x7f7fcc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.664+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2179297245 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fd40eaf40 con 0x7f7fdc1584c0 2024-09-13T18:34:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.820+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fdc0b4420 con 0x7f7fdc1584c0 2024-09-13T18:34:29.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.820+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2179297245 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fd40ee560 con 0x7f7fdc1584c0 2024-09-13T18:34:29.825 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:34:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7fbc067020 msgr2=0x7f7fbc0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7fbc067020 0x7f7fbc0694e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009ac0 tx=0x7f7fcc008040 comp rx=0 tx=0).stop 2024-09-13T18:34:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fdc1584c0 msgr2=0x7f7fdc156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fdc1584c0 0x7f7fdc156100 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4007040 tx=0x7f7fc8005800 comp rx=0 tx=0).stop 2024-09-13T18:34:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 shutdown_connections 2024-09-13T18:34:29.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7fbc067020 0x7f7fbc0694e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fdc1584c0 0x7f7fdc156100 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fdc15cdc0 0x7f7fdc157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 --2- 172.21.15.53:0/2179297245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7fc8005190 0x7f7fdc151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 >> 172.21.15.53:0/2179297245 conn(0x7f7fdc0b20d0 msgr2=0x7f7fdc0ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 shutdown_connections 2024-09-13T18:34:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.824+0000 7f7fe1ba7640 1 -- 172.21.15.53:0/2179297245 wait complete. 2024-09-13T18:34:29.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:29.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc35df640 1 Processor -- start 2024-09-13T18:34:29.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc35df640 1 -- start start 2024-09-13T18:34:29.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc35df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cbc15cab0 0x7f1cbc0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc35df640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0d2400 con 0x7f1cbc0cf7d0 2024-09-13T18:34:29.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc35df640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0d1530 con 0x7f1cbc0cd6c0 2024-09-13T18:34:29.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc35df640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc0d0920 con 0x7f1cbc15cab0 2024-09-13T18:34:29.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc137b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cbc15cab0 0x7f1cbc0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc137b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cbc15cab0 0x7f1cbc0d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49142/0 (socket says 172.21.15.53:49142) 2024-09-13T18:34:29.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc137b640 1 -- 172.21.15.53:0/2368408422 learned_addr learned my addr 172.21.15.53:0/2368408422 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:29.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc137b640 1 -- 172.21.15.53:0/2368408422 >> v1:172.21.15.87:6789/0 conn(0x7f1cbc0cd6c0 legacy=0x7f1cbc0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:29.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc137b640 1 -- 172.21.15.53:0/2368408422 >> v1:172.21.15.53:6789/0 conn(0x7f1cbc0cf7d0 legacy=0x7f1cbc0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc137b640 1 -- 172.21.15.53:0/2368408422 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0d0c00 con 0x7f1cbc15cab0 2024-09-13T18:34:29.971 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.960+0000 7f1cc137b640 1 --2- 172.21.15.53:0/2368408422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0d19c0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009870 tx=0x7f1cac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf8c9c9af2d11c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cb3fff640 1 -- 172.21.15.53:0/2368408422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0aa650 con 0x7f1cbc15cab0 2024-09-13T18:34:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cb3fff640 1 -- 172.21.15.53:0/2368408422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac0aa7b0 con 0x7f1cbc15cab0 2024-09-13T18:34:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cb3fff640 1 -- 172.21.15.53:0/2368408422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0aab40 con 0x7f1cbc15cab0 2024-09-13T18:34:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- 172.21.15.53:0/2368408422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 msgr2=0x7f1cbc0d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2368408422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0d19c0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009870 tx=0x7f1cac01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- 172.21.15.53:0/2368408422 shutdown_connections 2024-09-13T18:34:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2368408422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0d19c0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- 172.21.15.53:0/2368408422 >> 172.21.15.53:0/2368408422 conn(0x7f1cbc065c80 msgr2=0x7f1cbc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- 172.21.15.53:0/2368408422 shutdown_connections 2024-09-13T18:34:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- 172.21.15.53:0/2368408422 wait complete. 2024-09-13T18:34:29.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 Processor -- start 2024-09-13T18:34:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- start start 2024-09-13T18:34:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc0cd6c0 0x7f1cbc0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cbc0cf7d0 0x7f1cbc154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0ca840 con 0x7f1cbc15cab0 2024-09-13T18:34:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc154ac0 con 0x7f1cbc0cd6c0 2024-09-13T18:34:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0cbbb0 con 0x7f1cbc0cf7d0 2024-09-13T18:34:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49152/0 (socket says 172.21.15.53:49152) 2024-09-13T18:34:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 -- 172.21.15.53:0/2756358792 learned_addr learned my addr 172.21.15.53:0/2756358792 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc137b640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc0cd6c0 0x7f1cbc0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 -- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cbc0cf7d0 msgr2=0x7f1cbc154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc0b7a640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cbc0cf7d0 0x7f1cbc154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cbc0cf7d0 0x7f1cbc154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 -- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc0cd6c0 msgr2=0x7f1cbc0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc0cd6c0 0x7f1cbc0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 -- 172.21.15.53:0/2756358792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0094d0 con 0x7f1cbc15cab0 2024-09-13T18:34:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc137b640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc0cd6c0 0x7f1cbc0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc1b7c640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0cb2b0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400c700 tx=0x7f1cb400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cb1ffb640 1 -- 172.21.15.53:0/2756358792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4003b80 con 0x7f1cbc15cab0 2024-09-13T18:34:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cb1ffb640 1 -- 172.21.15.53:0/2756358792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4003ce0 con 0x7f1cbc15cab0 2024-09-13T18:34:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc0c9820 con 0x7f1cbc15cab0 2024-09-13T18:34:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cb1ffb640 1 -- 172.21.15.53:0/2756358792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400aa90 con 0x7f1cbc15cab0 2024-09-13T18:34:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.964+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc0c9de0 con 0x7f1cbc15cab0 2024-09-13T18:34:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.968+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc0c9fd0 con 0x7f1cbc15cab0 2024-09-13T18:34:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.968+0000 7f1cb1ffb640 1 -- 172.21.15.53:0/2756358792 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f1cb400abf0 con 0x7f1cbc15cab0 2024-09-13T18:34:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.968+0000 7f1cb1ffb640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ca0067050 0x7f1ca0069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.968+0000 7f1cb1ffb640 1 -- 172.21.15.53:0/2756358792 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cb4082a00 con 0x7f1cbc15cab0 2024-09-13T18:34:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.968+0000 7f1cc137b640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ca0067050 0x7f1ca0069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.968+0000 7f1cc137b640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ca0067050 0x7f1ca0069510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0ae000 tx=0x7f1cac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:29.972+0000 7f1cb1ffb640 1 -- 172.21.15.53:0/2756358792 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1cb4051620 con 0x7f1cbc15cab0 2024-09-13T18:34:30.171 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.168+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cbc0d19a0 con 0x7f1cbc15cab0 2024-09-13T18:34:30.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.168+0000 7f1cb1ffb640 1 -- 172.21.15.53:0/2756358792 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f1cb4054c40 con 0x7f1cbc15cab0 2024-09-13T18:34:30.172 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:30.172 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3371404154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3371404154},{"type":"v1","addr":"172.21.15.87:6833","nonce":3371404154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8665,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1374144604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1374144604},{"type":"v1","addr":"172.21.15.87:6835","nonce":1374144604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2656917860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656917860},{"type":"v1","addr":"172.21.15.53:6834","nonce":2656917860}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:58.642385+0000","modified":"2024-09-13T18:34:01.656052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10023},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10023":{"gid":10023,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3514602173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3514602173},{"type":"v1","addr":"172.21.15.53:6835","nonce":3514602173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2024-09-13T18:34:30.172 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 97 2024-09-13T18:34:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ca0067050 msgr2=0x7f1ca0069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ca0067050 0x7f1ca0069510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0ae000 tx=0x7f1cac008040 comp rx=0 tx=0).stop 2024-09-13T18:34:30.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 msgr2=0x7f1cbc0cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0cb2b0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400c700 tx=0x7f1cb400cbc0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 shutdown_connections 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1ca0067050 0x7f1ca0069510 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1cbc0cf7d0 0x7f1cbc154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc15cab0 0x7f1cbc0cb2b0 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 --2- 172.21.15.53:0/2756358792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1cbc0cd6c0 0x7f1cbc0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 >> 172.21.15.53:0/2756358792 conn(0x7f1cbc065c80 msgr2=0x7f1cbc0b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 shutdown_connections 2024-09-13T18:34:30.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.172+0000 7f1cc35df640 1 -- 172.21.15.53:0/2756358792 wait complete. 2024-09-13T18:34:30.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:30.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 Processor -- start 2024-09-13T18:34:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 -- start start 2024-09-13T18:34:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fea9c15c980 0x7fea9c06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea9c06d550 0x7fea9c069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c06d1a0 con 0x7fea9c06d550 2024-09-13T18:34:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c15cd60 con 0x7fea9c15c980 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7feaa1816640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c06a8e0 con 0x7fea9c06a490 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea9c06d550 0x7fea9c069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea9c06d550 0x7fea9c069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49154/0 (socket says 172.21.15.53:49154) 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 -- 172.21.15.53:0/1922287980 learned_addr learned my addr 172.21.15.53:0/1922287980 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9affd640 1 --2- 172.21.15.53:0/1922287980 >> v2:172.21.15.87:3300/0 conn(0x7fea9c15c980 0x7fea9c06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9b7fe640 1 --2- 172.21.15.53:0/1922287980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 -- 172.21.15.53:0/1922287980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 msgr2=0x7fea9c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 --2- 172.21.15.53:0/1922287980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c0cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 -- 172.21.15.53:0/1922287980 >> v2:172.21.15.87:3300/0 conn(0x7fea9c15c980 msgr2=0x7fea9c06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 --2- 172.21.15.53:0/1922287980 >> v2:172.21.15.87:3300/0 conn(0x7fea9c15c980 0x7fea9c06cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9a7fc640 1 -- 172.21.15.53:0/1922287980 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0cccd0 con 0x7fea9c06d550 2024-09-13T18:34:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.308+0000 7fea9affd640 1 --2- 172.21.15.53:0/1922287980 >> v2:172.21.15.87:3300/0 conn(0x7fea9c15c980 0x7fea9c06cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7fea9a7fc640 1 --2- 172.21.15.53:0/1922287980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c06d550 0x7fea9c069f50 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fea9c06aa50 tx=0x7fea9001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8feaa6b4ad51086 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7fea99ffb640 1 -- 172.21.15.53:0/1922287980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900a57b0 con 0x7fea9c06d550 2024-09-13T18:34:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7fea99ffb640 1 -- 172.21.15.53:0/1922287980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea900a5910 con 0x7fea9c06d550 2024-09-13T18:34:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7fea99ffb640 1 -- 172.21.15.53:0/1922287980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900a5ca0 con 0x7fea9c06d550 2024-09-13T18:34:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 -- 172.21.15.53:0/1922287980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c06d550 msgr2=0x7fea9c069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 --2- 172.21.15.53:0/1922287980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c06d550 0x7fea9c069f50 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fea9c06aa50 tx=0x7fea9001c910 comp rx=0 tx=0).stop 2024-09-13T18:34:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 -- 172.21.15.53:0/1922287980 shutdown_connections 2024-09-13T18:34:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 --2- 172.21.15.53:0/1922287980 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 --2- 172.21.15.53:0/1922287980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c06d550 0x7fea9c069f50 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 --2- 172.21.15.53:0/1922287980 >> v2:172.21.15.87:3300/0 conn(0x7fea9c15c980 0x7fea9c06cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 -- 172.21.15.53:0/1922287980 >> 172.21.15.53:0/1922287980 conn(0x7fea9c0b0a30 msgr2=0x7fea9c0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 -- 172.21.15.53:0/1922287980 shutdown_connections 2024-09-13T18:34:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 -- 172.21.15.53:0/1922287980 wait complete. 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 Processor -- start 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.312+0000 7feaa1816640 1 -- start start 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9c06d550 0x7fea9c099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c15c980 0x7fea9c139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ac7e0 con 0x7fea9c15c980 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ac190 con 0x7fea9c06d550 2024-09-13T18:34:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c159c50 con 0x7fea9c06a490 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c15c980 0x7fea9c139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c15c980 0x7fea9c139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49170/0 (socket says 172.21.15.53:49170) 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 -- 172.21.15.53:0/1983171876 learned_addr learned my addr 172.21.15.53:0/1983171876 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9a7fc640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9c06d550 0x7fea9c099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9affd640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 -- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 msgr2=0x7fea9c159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 -- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9c06d550 msgr2=0x7fea9c099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9c06d550 0x7fea9c099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 -- 172.21.15.53:0/1983171876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009b30 con 0x7fea9c15c980 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9affd640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9b7fe640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c15c980 0x7fea9c139fb0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c5f0 tx=0x7fea9400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea83fff640 1 -- 172.21.15.53:0/1983171876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94004220 con 0x7fea9c15c980 2024-09-13T18:34:30.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea83fff640 1 -- 172.21.15.53:0/1983171876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94004380 con 0x7fea9c15c980 2024-09-13T18:34:30.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c0ae030 con 0x7fea9c15c980 2024-09-13T18:34:30.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea83fff640 1 -- 172.21.15.53:0/1983171876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94003840 con 0x7fea9c15c980 2024-09-13T18:34:30.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c099fb0 con 0x7fea9c15c980 2024-09-13T18:34:30.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c157ec0 con 0x7fea9c15c980 2024-09-13T18:34:30.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea83fff640 1 -- 172.21.15.53:0/1983171876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fea940039a0 con 0x7fea9c15c980 2024-09-13T18:34:30.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea83fff640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea88067050 0x7fea88069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea83fff640 1 -- 172.21.15.53:0/1983171876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea940828d0 con 0x7fea9c15c980 2024-09-13T18:34:30.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9affd640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea88067050 0x7fea88069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.316+0000 7fea9affd640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea88067050 0x7fea88069510 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fea9c071c20 tx=0x7fea8c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.320+0000 7fea83fff640 1 -- 172.21.15.53:0/1983171876 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea940514f0 con 0x7fea9c15c980 2024-09-13T18:34:30.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.484+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea9c073000 con 0x7fea9c15c980 2024-09-13T18:34:30.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.484+0000 7fea83fff640 1 -- 172.21.15.53:0/1983171876 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16519 (secure 0 0 0) 0x7fea94054b10 con 0x7fea9c15c980 2024-09-13T18:34:30.488 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:30.488 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":162,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:59.644771+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:30.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea88067050 msgr2=0x7fea88069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea88067050 0x7fea88069510 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fea9c071c20 tx=0x7fea8c008040 comp rx=0 tx=0).stop 2024-09-13T18:34:30.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c15c980 msgr2=0x7fea9c139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c15c980 0x7fea9c139fb0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c5f0 tx=0x7fea9400cab0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 shutdown_connections 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fea88067050 0x7fea88069510 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea9c15c980 0x7fea9c139fb0 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea9c06d550 0x7fea9c099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 --2- 172.21.15.53:0/1983171876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fea9c06a490 0x7fea9c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 >> 172.21.15.53:0/1983171876 conn(0x7fea9c0b0a30 msgr2=0x7fea9c13b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 shutdown_connections 2024-09-13T18:34:30.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.488+0000 7feaa1816640 1 -- 172.21.15.53:0/1983171876 wait complete. 2024-09-13T18:34:30.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:34:30.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f246b114640 1 Processor -- start 2024-09-13T18:34:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f246b114640 1 -- start start 2024-09-13T18:34:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f246b114640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24640cc270 0x7f246415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f246b114640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24640b1c10 0x7f24640b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f246b114640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246406f550 con 0x7f246415a470 2024-09-13T18:34:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f246b114640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246406f880 con 0x7f24640b1c10 2024-09-13T18:34:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f246b114640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b2600 con 0x7f24640cc270 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f2463fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24640cc270 0x7f246415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f24696b1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24640b1c10 0x7f24640b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f2468eb0640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f246415a470 0x7f2464071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:39686/0 (socket says 172.21.15.53:39686) 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f2468eb0640 1 -- 172.21.15.53:0/3777745820 learned_addr learned my addr 172.21.15.53:0/3777745820 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f2463fff640 1 -- 172.21.15.53:0/3777745820 >> v2:172.21.15.87:3300/0 conn(0x7f24640b1c10 msgr2=0x7f24640b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f2463fff640 1 --2- 172.21.15.53:0/3777745820 >> v2:172.21.15.87:3300/0 conn(0x7f24640b1c10 0x7f24640b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f2463fff640 1 -- 172.21.15.53:0/3777745820 >> v1:172.21.15.87:6789/0 conn(0x7f246415a470 legacy=0x7f2464071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f2463fff640 1 -- 172.21.15.53:0/3777745820 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246415dc40 con 0x7f24640cc270 2024-09-13T18:34:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.628+0000 7f24696b1640 1 --2- 172.21.15.53:0/3777745820 >> v2:172.21.15.87:3300/0 conn(0x7f24640b1c10 0x7f24640b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f2463fff640 1 --2- 172.21.15.53:0/3777745820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24640cc270 0x7f246415cc60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f244c0097c0 tx=0x7f244c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3937fa1baf2b5e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f24637fe640 1 -- 172.21.15.53:0/3777745820 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0ab600 con 0x7f24640cc270 2024-09-13T18:34:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f24637fe640 1 -- 172.21.15.53:0/3777745820 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c0a7050 con 0x7f24640cc270 2024-09-13T18:34:30.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f24637fe640 1 -- 172.21.15.53:0/3777745820 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0ab980 con 0x7f24640cc270 2024-09-13T18:34:30.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 -- 172.21.15.53:0/3777745820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24640cc270 msgr2=0x7f246415cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 --2- 172.21.15.53:0/3777745820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24640cc270 0x7f246415cc60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f244c0097c0 tx=0x7f244c01c4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 -- 172.21.15.53:0/3777745820 shutdown_connections 2024-09-13T18:34:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 --2- 172.21.15.53:0/3777745820 >> v2:172.21.15.87:3300/0 conn(0x7f24640b1c10 0x7f24640b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 --2- 172.21.15.53:0/3777745820 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24640cc270 0x7f246415cc60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 -- 172.21.15.53:0/3777745820 >> 172.21.15.53:0/3777745820 conn(0x7f2464065c80 msgr2=0x7f2464066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 -- 172.21.15.53:0/3777745820 shutdown_connections 2024-09-13T18:34:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.632+0000 7f246b114640 1 -- 172.21.15.53:0/3777745820 wait complete. 2024-09-13T18:34:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 Processor -- start 2024-09-13T18:34:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 -- start start 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24640b1c10 0x7f24641513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24640cc270 0x7f24640c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246415a470 0x7f24640c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640c5b30 con 0x7f24640b1c10 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464154b70 con 0x7f24640cc270 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2464154e50 con 0x7f246415a470 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24640b1c10 0x7f24641513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24640b1c10 0x7f24641513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49186/0 (socket says 172.21.15.53:49186) 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 -- 172.21.15.53:0/2534849881 learned_addr learned my addr 172.21.15.53:0/2534849881 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f24696b1640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246415a470 0x7f24640c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2463fff640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24640cc270 0x7f24640c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 -- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246415a470 msgr2=0x7f24640c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246415a470 0x7f24640c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 -- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24640cc270 msgr2=0x7f24640c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24640cc270 0x7f24640c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 -- 172.21.15.53:0/2534849881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c009a70 con 0x7f24640b1c10 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f2468eb0640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24640b1c10 0x7f24641513c0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f245400c3a0 tx=0x7f245400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f24617fa640 1 -- 172.21.15.53:0/2534849881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454005cf0 con 0x7f24640b1c10 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f24617fa640 1 -- 172.21.15.53:0/2534849881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454005e50 con 0x7f24640b1c10 2024-09-13T18:34:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f24617fa640 1 -- 172.21.15.53:0/2534849881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540072f0 con 0x7f24640b1c10 2024-09-13T18:34:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c009420 con 0x7f24640b1c10 2024-09-13T18:34:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2464153420 con 0x7f24640b1c10 2024-09-13T18:34:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.636+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2464067400 con 0x7f24640b1c10 2024-09-13T18:34:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.640+0000 7f24617fa640 1 -- 172.21.15.53:0/2534849881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f2454007450 con 0x7f24640b1c10 2024-09-13T18:34:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.640+0000 7f24617fa640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2444067020 0x7f24440694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.640+0000 7f24617fa640 1 -- 172.21.15.53:0/2534849881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24540820b0 con 0x7f24640b1c10 2024-09-13T18:34:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.640+0000 7f2463fff640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2444067020 0x7f24440694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.640+0000 7f2463fff640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2444067020 0x7f24440694e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f244c0ad000 tx=0x7f244c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.644+0000 7f24617fa640 1 -- 172.21.15.53:0/2534849881 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2454050d20 con 0x7f24640b1c10 2024-09-13T18:34:30.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.836+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24640b20c0 con 0x7f24640b1c10 2024-09-13T18:34:30.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f24617fa640 1 -- 172.21.15.53:0/2534849881 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f2454017020 con 0x7f24640b1c10 2024-09-13T18:34:30.842 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:30.842 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3371404154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3371404154},{"type":"v1","addr":"172.21.15.87:6833","nonce":3371404154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8665,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1374144604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1374144604},{"type":"v1","addr":"172.21.15.87:6835","nonce":1374144604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2656917860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656917860},{"type":"v1","addr":"172.21.15.53:6834","nonce":2656917860}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:58.642385+0000","modified":"2024-09-13T18:34:01.656052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10023},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10023":{"gid":10023,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3514602173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3514602173},{"type":"v1","addr":"172.21.15.53:6835","nonce":3514602173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2024-09-13T18:34:30.842 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 97 2024-09-13T18:34:30.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2444067020 msgr2=0x7f24440694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2444067020 0x7f24440694e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f244c0ad000 tx=0x7f244c0a6000 comp rx=0 tx=0).stop 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24640b1c10 msgr2=0x7f24641513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24640b1c10 0x7f24641513c0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f245400c3a0 tx=0x7f245400c7a0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 shutdown_connections 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2444067020 0x7f24440694e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f246415a470 0x7f24640c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24640cc270 0x7f24640c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 --2- 172.21.15.53:0/2534849881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24640b1c10 0x7f24641513c0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 >> 172.21.15.53:0/2534849881 conn(0x7f2464065c80 msgr2=0x7f246406cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 shutdown_connections 2024-09-13T18:34:30.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.840+0000 7f246b114640 1 -- 172.21.15.53:0/2534849881 wait complete. 2024-09-13T18:34:30.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:30.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c70d2640 1 Processor -- start 2024-09-13T18:34:30.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c70d2640 1 -- start start 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c70d2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50c015db40 0x7f50c00afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c70d2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 0x7f50c00b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c70d2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00ad530 con 0x7f50c00b07f0 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c70d2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c00ae1b0 con 0x7f50c015db40 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c70d2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b0c40 con 0x7f50c00b1960 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c566f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f50c00b07f0 0x7f50c00ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59036/0 (socket says 172.21.15.53:59036) 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c566f640 1 -- 172.21.15.53:0/1026828701 learned_addr learned my addr 172.21.15.53:0/1026828701 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/1026828701 >> v2:172.21.15.87:3300/0 conn(0x7f50c015db40 0x7f50c00afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381263863 0 0) 0x7f50c00ad530 con 0x7f50c00b07f0 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a8003530 con 0x7f50c00b07f0 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bffff640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 0x7f50c00b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982650511 0 0) 0x7f50a8003530 con 0x7f50c00b07f0 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 msgr2=0x7f50c00b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 0x7f50c00b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 >> v2:172.21.15.87:3300/0 conn(0x7f50c015db40 msgr2=0x7f50c00afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 --2- 172.21.15.53:0/1026828701 >> v2:172.21.15.87:3300/0 conn(0x7f50c015db40 0x7f50c00afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00ad810 con 0x7f50c00b07f0 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f50b8001a00 con 0x7f50c00b07f0 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 >> v1:172.21.15.53:6789/0 conn(0x7f50c00b07f0 legacy=0x7f50c00ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8003980 0x7f50a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a80047d0 0x7f50a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 0x7f50a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00ae1b0 con 0x7f50a8003980 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b0c40 con 0x7f50a80047d0 2024-09-13T18:34:30.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a800ba70 con 0x7f50c00b1960 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8003980 0x7f50a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50bffff640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a80047d0 0x7f50a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c566f640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 0x7f50a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c4e6e640 1 -- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 msgr2=0x7f50a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b1960 0x7f50a8005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c4e6e640 1 -- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a80047d0 msgr2=0x7f50a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a80047d0 0x7f50a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.980+0000 7f50c4e6e640 1 -- 172.21.15.53:0/1026828701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8003530 con 0x7f50a8003980 2024-09-13T18:34:30.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8003980 0x7f50a8003da0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009ab0 tx=0x7f50b001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b76951c3e9bc8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00a5550 con 0x7f50a8003980 2024-09-13T18:34:30.988 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00a56b0 con 0x7f50a8003980 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50bf7fe640 1 -- 172.21.15.53:0/1026828701 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00a5a60 con 0x7f50a8003980 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 -- 172.21.15.53:0/1026828701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8003980 msgr2=0x7f50a8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 --2- 172.21.15.53:0/1026828701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50a8003980 0x7f50a8003da0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009ab0 tx=0x7f50b001c980 comp rx=0 tx=0).stop 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c566f640 1 -- 172.21.15.53:0/1026828701 reap_dead start 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 -- 172.21.15.53:0/1026828701 shutdown_connections 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 -- 172.21.15.53:0/1026828701 >> 172.21.15.53:0/1026828701 conn(0x7f50c00b20d0 msgr2=0x7f50c00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 -- 172.21.15.53:0/1026828701 shutdown_connections 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 -- 172.21.15.53:0/1026828701 wait complete. 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 Processor -- start 2024-09-13T18:34:30.989 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.984+0000 7f50c70d2640 1 -- start start 2024-09-13T18:34:30.991 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a8003980 0x7f50c014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b4ee0 0x7f50c00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c01590e0 0x7f50c0159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b5360 con 0x7f50c01590e0 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0159aa0 con 0x7f50a8003980 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b6160 con 0x7f50c00b4ee0 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c01590e0 0x7f50c0159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c01590e0 0x7f50c0159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49198/0 (socket says 172.21.15.53:49198) 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 -- 172.21.15.53:0/4084855824 learned_addr learned my addr 172.21.15.53:0/4084855824 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a8003980 0x7f50c014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50bffff640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b4ee0 0x7f50c00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 -- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b4ee0 msgr2=0x7f50c00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b4ee0 0x7f50c00ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.992 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 -- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a8003980 msgr2=0x7f50c014fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a8003980 0x7f50c014fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 -- 172.21.15.53:0/4084855824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00cd150 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a8003980 0x7f50c014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c566f640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c01590e0 0x7f50c0159560 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f50c00d1530 tx=0x7f50b800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50bd7fa640 1 -- 172.21.15.53:0/4084855824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8004d70 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50bd7fa640 1 -- 172.21.15.53:0/4084855824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b800bb20 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c00b5550 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50bd7fa640 1 -- 172.21.15.53:0/4084855824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800bed0 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c00b5b10 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c015e250 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50bd7fa640 1 -- 172.21.15.53:0/4084855824 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f50b8007070 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50bd7fa640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f50ac067020 0x7f50ac0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50bd7fa640 1 -- 172.21.15.53:0/4084855824 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50b8083000 con 0x7f50c01590e0 2024-09-13T18:34:30.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f50ac067020 0x7f50ac0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:30.994 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.988+0000 7f50c4e6e640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f50ac067020 0x7f50ac0694e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f50b00af000 tx=0x7f50b00046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:30.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:30.992+0000 7f50bd7fa640 1 -- 172.21.15.53:0/4084855824 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50b8051c20 con 0x7f50c01590e0 2024-09-13T18:34:31.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.188+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50c00afd70 con 0x7f50c01590e0 2024-09-13T18:34:31.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50bd7fa640 1 -- 172.21.15.53:0/4084855824 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f50b8055240 con 0x7f50c01590e0 2024-09-13T18:34:31.194 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:31.194 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":97,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3371404154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3371404154},{"type":"v1","addr":"172.21.15.87:6833","nonce":3371404154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8665,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1374144604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1374144604},{"type":"v1","addr":"172.21.15.87:6835","nonce":1374144604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2656917860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656917860},{"type":"v1","addr":"172.21.15.53:6834","nonce":2656917860}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:33:58.642385+0000","modified":"2024-09-13T18:34:01.656052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10023},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10023":{"gid":10023,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3514602173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3514602173},{"type":"v1","addr":"172.21.15.53:6835","nonce":3514602173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2024-09-13T18:34:31.194 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 97 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f50ac067020 msgr2=0x7f50ac0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f50ac067020 0x7f50ac0694e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f50b00af000 tx=0x7f50b00046d0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c01590e0 msgr2=0x7f50c0159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c01590e0 0x7f50c0159560 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f50c00d1530 tx=0x7f50b800b4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 shutdown_connections 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f50ac067020 0x7f50ac0694e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50c00b4ee0 0x7f50c00ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c01590e0 0x7f50c0159560 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 --2- 172.21.15.53:0/4084855824 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50a8003980 0x7f50c014fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 >> 172.21.15.53:0/4084855824 conn(0x7f50c00b20d0 msgr2=0x7f50c006e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 shutdown_connections 2024-09-13T18:34:31.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.192+0000 7f50c70d2640 1 -- 172.21.15.53:0/4084855824 wait complete. 2024-09-13T18:34:31.213 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:31.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.336+0000 7f4700b45640 1 Processor -- start 2024-09-13T18:34:31.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.336+0000 7f4700b45640 1 -- start start 2024-09-13T18:34:31.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f4700b45640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc1582a0 0x7f46fc06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f4700b45640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46fc15b7c0 0x7f46fc06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f4700b45640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f46fc070c90 0x7f46fc071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f4700b45640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc15aaf0 con 0x7f46fc15b7c0 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f4700b45640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc06d760 con 0x7f46fc070c90 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f4700b45640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc071640 con 0x7f46fc1582a0 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46fc15b7c0 0x7f46fc06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46fc15b7c0 0x7f46fc06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49204/0 (socket says 172.21.15.53:49204) 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 -- 172.21.15.53:0/2559449876 learned_addr learned my addr 172.21.15.53:0/2559449876 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46fa59c640 1 --2- 172.21.15.53:0/2559449876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc1582a0 0x7f46fc06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46fad9d640 1 --2- 172.21.15.53:0/2559449876 >> v2:172.21.15.87:3300/0 conn(0x7f46fc070c90 0x7f46fc071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 -- 172.21.15.53:0/2559449876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc1582a0 msgr2=0x7f46fc06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 --2- 172.21.15.53:0/2559449876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc1582a0 0x7f46fc06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 -- 172.21.15.53:0/2559449876 >> v2:172.21.15.87:3300/0 conn(0x7f46fc070c90 msgr2=0x7f46fc071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:31.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 --2- 172.21.15.53:0/2559449876 >> v2:172.21.15.87:3300/0 conn(0x7f46fc070c90 0x7f46fc071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 -- 172.21.15.53:0/2559449876 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc06d480 con 0x7f46fc15b7c0 2024-09-13T18:34:31.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f9d9b640 1 --2- 172.21.15.53:0/2559449876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc06ce40 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f46fc066c30 tx=0x7f46f001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da58c61a8b2d585 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:31.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f959a640 1 -- 172.21.15.53:0/2559449876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f00aa610 con 0x7f46fc15b7c0 2024-09-13T18:34:31.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f959a640 1 -- 172.21.15.53:0/2559449876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f00a6040 con 0x7f46fc15b7c0 2024-09-13T18:34:31.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.340+0000 7f46f959a640 1 -- 172.21.15.53:0/2559449876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f00aa990 con 0x7f46fc15b7c0 2024-09-13T18:34:31.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- 172.21.15.53:0/2559449876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 msgr2=0x7f46fc06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 --2- 172.21.15.53:0/2559449876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc06ce40 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f46fc066c30 tx=0x7f46f001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- 172.21.15.53:0/2559449876 shutdown_connections 2024-09-13T18:34:31.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 --2- 172.21.15.53:0/2559449876 >> v2:172.21.15.87:3300/0 conn(0x7f46fc070c90 0x7f46fc071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 --2- 172.21.15.53:0/2559449876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc06ce40 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 --2- 172.21.15.53:0/2559449876 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc1582a0 0x7f46fc06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- 172.21.15.53:0/2559449876 >> 172.21.15.53:0/2559449876 conn(0x7f46fc065c80 msgr2=0x7f46fc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:31.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- 172.21.15.53:0/2559449876 shutdown_connections 2024-09-13T18:34:31.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- 172.21.15.53:0/2559449876 wait complete. 2024-09-13T18:34:31.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 Processor -- start 2024-09-13T18:34:31.348 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- start start 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc070c90 0x7f46fc14b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc1582a0 0x7f46fc14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc150600 con 0x7f46fc15b7c0 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14ca00 con 0x7f46fc1582a0 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1500f0 con 0x7f46fc070c90 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc0ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49218/0 (socket says 172.21.15.53:49218) 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 -- 172.21.15.53:0/1430019249 learned_addr learned my addr 172.21.15.53:0/1430019249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fa59c640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc070c90 0x7f46fc14b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46f9d9b640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc1582a0 0x7f46fc14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 -- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc070c90 msgr2=0x7f46fc14b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc070c90 0x7f46fc14b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 -- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc1582a0 msgr2=0x7f46fc14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc1582a0 0x7f46fc14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 -- 172.21.15.53:0/1430019249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00094d0 con 0x7f46fc15b7c0 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46fad9d640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc0ac8e0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007e60 tx=0x7f46f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46eaffd640 1 -- 172.21.15.53:0/1430019249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4014620 con 0x7f46fc15b7c0 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46eaffd640 1 -- 172.21.15.53:0/1430019249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f400ee90 con 0x7f46fc15b7c0 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc150850 con 0x7f46fc15b7c0 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f46eaffd640 1 -- 172.21.15.53:0/1430019249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f40149e0 con 0x7f46fc15b7c0 2024-09-13T18:34:31.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.344+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc14b450 con 0x7f46fc15b7c0 2024-09-13T18:34:31.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.348+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc067400 con 0x7f46fc15b7c0 2024-09-13T18:34:31.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.348+0000 7f46eaffd640 1 -- 172.21.15.53:0/1430019249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f46f4014b40 con 0x7f46fc15b7c0 2024-09-13T18:34:31.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.348+0000 7f46eaffd640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f46dc067020 0x7f46dc0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.348+0000 7f46eaffd640 1 -- 172.21.15.53:0/1430019249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46f40835a0 con 0x7f46fc15b7c0 2024-09-13T18:34:31.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.348+0000 7f46fa59c640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f46dc067020 0x7f46dc0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.348+0000 7f46fa59c640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f46dc067020 0x7f46dc0694e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f46fc071200 tx=0x7f46ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:31.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.352+0000 7f46eaffd640 1 -- 172.21.15.53:0/1430019249 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f46f40521c0 con 0x7f46fc15b7c0 2024-09-13T18:34:31.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.508+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46fc0700e0 con 0x7f46fc15b7c0 2024-09-13T18:34:31.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f46eaffd640 1 -- 172.21.15.53:0/1430019249 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16519 (secure 0 0 0) 0x7f46f40557e0 con 0x7f46fc15b7c0 2024-09-13T18:34:31.513 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:31.513 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":162,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:33:59.644771+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:33:56.968030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-13T18:33:57.623731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f46dc067020 msgr2=0x7f46dc0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f46dc067020 0x7f46dc0694e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f46fc071200 tx=0x7f46ec008040 comp rx=0 tx=0).stop 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 msgr2=0x7f46fc0ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc0ac8e0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007e60 tx=0x7f46f400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 shutdown_connections 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f46dc067020 0x7f46dc0694e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc15b7c0 0x7f46fc0ac8e0 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46fc1582a0 0x7f46fc14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 --2- 172.21.15.53:0/1430019249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46fc070c90 0x7f46fc14b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 >> 172.21.15.53:0/1430019249 conn(0x7f46fc065c80 msgr2=0x7f46fc0af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:31.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 shutdown_connections 2024-09-13T18:34:31.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.512+0000 7f4700b45640 1 -- 172.21.15.53:0/1430019249 wait complete. 2024-09-13T18:34:31.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:34:31.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafe608e640 1 Processor -- start 2024-09-13T18:34:31.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafe608e640 1 -- start start 2024-09-13T18:34:31.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafe608e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fafe00cb980 0x7fafe00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafe608e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cbd60 0x7fafe00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafe608e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe00b1ac0 con 0x7fafe006b850 2024-09-13T18:34:31.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafe608e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe00b3010 con 0x7fafe00cb980 2024-09-13T18:34:31.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafe608e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0159ac0 con 0x7fafe00cbd60 2024-09-13T18:34:31.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cbd60 0x7fafe00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fafe00cb980 0x7fafe00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdeffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fafe006b850 0x7fafe006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:39698/0 (socket says 172.21.15.53:39698) 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cbd60 0x7fafe00cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:38266/0 (socket says 172.21.15.53:38266) 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdeffd640 1 -- 172.21.15.53:0/2361186187 learned_addr learned my addr 172.21.15.53:0/2361186187 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdffff640 1 -- 172.21.15.53:0/2361186187 >> v2:172.21.15.87:3300/0 conn(0x7fafe00cb980 msgr2=0x7fafe00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdffff640 1 --2- 172.21.15.53:0/2361186187 >> v2:172.21.15.87:3300/0 conn(0x7fafe00cb980 0x7fafe00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdffff640 1 -- 172.21.15.53:0/2361186187 >> v1:172.21.15.87:6789/0 conn(0x7fafe006b850 legacy=0x7fafe006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdffff640 1 -- 172.21.15.53:0/2361186187 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0159da0 con 0x7fafe00cbd60 2024-09-13T18:34:31.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.640+0000 7fafdf7fe640 1 --2- 172.21.15.53:0/2361186187 >> v2:172.21.15.87:3300/0 conn(0x7fafe00cb980 0x7fafe00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:31.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafdffff640 1 --2- 172.21.15.53:0/2361186187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cbd60 0x7fafe00cdd40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009d90 tx=0x7fafd801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6cc6f2473fa96bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:31.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafde7fc640 1 -- 172.21.15.53:0/2361186187 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80a5880 con 0x7fafe00cbd60 2024-09-13T18:34:31.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafde7fc640 1 -- 172.21.15.53:0/2361186187 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd80a59e0 con 0x7fafe00cbd60 2024-09-13T18:34:31.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafde7fc640 1 -- 172.21.15.53:0/2361186187 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80a5d70 con 0x7fafe00cbd60 2024-09-13T18:34:31.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 -- 172.21.15.53:0/2361186187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cbd60 msgr2=0x7fafe00cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 --2- 172.21.15.53:0/2361186187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cbd60 0x7fafe00cdd40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009d90 tx=0x7fafd801c8b0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 -- 172.21.15.53:0/2361186187 shutdown_connections 2024-09-13T18:34:31.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 --2- 172.21.15.53:0/2361186187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cbd60 0x7fafe00cdd40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 --2- 172.21.15.53:0/2361186187 >> v2:172.21.15.87:3300/0 conn(0x7fafe00cb980 0x7fafe00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 -- 172.21.15.53:0/2361186187 >> 172.21.15.53:0/2361186187 conn(0x7fafe0065c80 msgr2=0x7fafe0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 -- 172.21.15.53:0/2361186187 shutdown_connections 2024-09-13T18:34:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.644+0000 7fafe608e640 1 -- 172.21.15.53:0/2361186187 wait complete. 2024-09-13T18:34:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 Processor -- start 2024-09-13T18:34:31.650 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 -- start start 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafe006b850 0x7fafe0149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cb980 0x7fafe014a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00cbd60 0x7fafe0152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe014e7d0 con 0x7fafe006b850 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe014e1e0 con 0x7fafe00cbd60 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01537c0 con 0x7fafe00cb980 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafe006b850 0x7fafe0149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.652 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafe006b850 0x7fafe0149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49234/0 (socket says 172.21.15.53:49234) 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 -- 172.21.15.53:0/1714183984 learned_addr learned my addr 172.21.15.53:0/1714183984 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 -- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cb980 msgr2=0x7fafe014a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cb980 0x7fafe014a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 -- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00cbd60 msgr2=0x7fafe0152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdffff640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00cbd60 0x7fafe0152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00cbd60 0x7fafe0152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 -- 172.21.15.53:0/1714183984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0009420 con 0x7fafe006b850 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdffff640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00cbd60 0x7fafe0152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafdf7fe640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafe006b850 0x7fafe0149ac0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fafd000ebe0 tx=0x7fafd000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafc7fff640 1 -- 172.21.15.53:0/1714183984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd000eee0 con 0x7fafe006b850 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafc7fff640 1 -- 172.21.15.53:0/1714183984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd000cc30 con 0x7fafe006b850 2024-09-13T18:34:31.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd8009a70 con 0x7fafe006b850 2024-09-13T18:34:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafc7fff640 1 -- 172.21.15.53:0/1714183984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0013470 con 0x7fafe006b850 2024-09-13T18:34:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe014e3f0 con 0x7fafe006b850 2024-09-13T18:34:31.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0067400 con 0x7fafe006b850 2024-09-13T18:34:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.648+0000 7fafc7fff640 1 -- 172.21.15.53:0/1714183984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fafd00135d0 con 0x7fafe006b850 2024-09-13T18:34:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.652+0000 7fafc7fff640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafcc067020 0x7fafcc0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.652+0000 7fafc7fff640 1 -- 172.21.15.53:0/1714183984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafd0082f30 con 0x7fafe006b850 2024-09-13T18:34:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.652+0000 7fafdeffd640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafcc067020 0x7fafcc0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:31.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.652+0000 7fafdeffd640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafcc067020 0x7fafcc0694e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fafd4000f70 tx=0x7fafd4007a90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:31.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.656+0000 7fafc7fff640 1 -- 172.21.15.53:0/1714183984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafd0051b50 con 0x7fafe006b850 2024-09-13T18:34:31.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.844+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fafe00b2bf0 con 0x7fafe006b850 2024-09-13T18:34:31.848 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:34:31.844+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:34:31.862 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafc7fff640 1 -- 172.21.15.53:0/1714183984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v98) v1 ==== 161+0+0 (secure 0 0 0) 0x7fafd0055170 con 0x7fafe006b850 2024-09-13T18:34:31.862 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:34:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafcc067020 msgr2=0x7fafcc0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafcc067020 0x7fafcc0694e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fafd4000f70 tx=0x7fafd4007a90 comp rx=0 tx=0).stop 2024-09-13T18:34:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafe006b850 msgr2=0x7fafe0149ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafe006b850 0x7fafe0149ac0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fafd000ebe0 tx=0x7fafd000c520 comp rx=0 tx=0).stop 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 shutdown_connections 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fafcc067020 0x7fafcc0694e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fafe00cb980 0x7fafe014a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafe00cbd60 0x7fafe0152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 --2- 172.21.15.53:0/1714183984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fafe006b850 0x7fafe0149ac0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 >> 172.21.15.53:0/1714183984 conn(0x7fafe0065c80 msgr2=0x7fafe015ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 shutdown_connections 2024-09-13T18:34:31.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:31.860+0000 7fafe608e640 1 -- 172.21.15.53:0/1714183984 wait complete. 2024-09-13T18:34:31.886 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:34:31.908 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:34:32.003 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.000+0000 7f8af274a640 1 Processor -- start 2024-09-13T18:34:32.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.000+0000 7f8af274a640 1 -- start start 2024-09-13T18:34:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.000+0000 7f8af274a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8aec0ce860 0x7f8aec0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.000+0000 7f8af274a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8aec0b4060 0x7f8aec0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.000+0000 7f8af274a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec0b3bd0 con 0x7f8aec15a700 2024-09-13T18:34:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.000+0000 7f8af274a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec0cf1c0 con 0x7f8aec0b4060 2024-09-13T18:34:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.000+0000 7f8af274a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec15aae0 con 0x7f8aec0ce860 2024-09-13T18:34:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af0ce7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8aec0b4060 0x7f8aec0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8aebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8aec15a700 0x7f8aec0cd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59044/0 (socket says 172.21.15.53:59044) 2024-09-13T18:34:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8aebfff640 1 -- 172.21.15.53:0/3981907239 learned_addr learned my addr 172.21.15.53:0/3981907239 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8aeb7fe640 1 --2- 172.21.15.53:0/3981907239 >> v2:172.21.15.87:3300/0 conn(0x7f8aec0ce860 0x7f8aec0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af0ce7640 1 -- 172.21.15.53:0/3981907239 >> v2:172.21.15.87:3300/0 conn(0x7f8aec0ce860 msgr2=0x7f8aec0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af0ce7640 1 --2- 172.21.15.53:0/3981907239 >> v2:172.21.15.87:3300/0 conn(0x7f8aec0ce860 0x7f8aec0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af0ce7640 1 -- 172.21.15.53:0/3981907239 >> v1:172.21.15.53:6789/0 conn(0x7f8aec15a700 legacy=0x7f8aec0cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8aeaffd640 1 -- 172.21.15.53:0/3981907239 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193174781 0 0) 0x7f8aec0b3bd0 con 0x7f8aec15a700 2024-09-13T18:34:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af0ce7640 1 -- 172.21.15.53:0/3981907239 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0cdba0 con 0x7f8aec0b4060 2024-09-13T18:34:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af0ce7640 1 --2- 172.21.15.53:0/3981907239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec0b44f0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0cfca0 tx=0x7f8ae401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603e3a0229ad758b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8aeaffd640 1 -- 172.21.15.53:0/3981907239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40af600 con 0x7f8aec0b4060 2024-09-13T18:34:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8aeaffd640 1 -- 172.21.15.53:0/3981907239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae40ab050 con 0x7f8aec0b4060 2024-09-13T18:34:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8aeaffd640 1 -- 172.21.15.53:0/3981907239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40af980 con 0x7f8aec0b4060 2024-09-13T18:34:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 -- 172.21.15.53:0/3981907239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 msgr2=0x7f8aec0b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 --2- 172.21.15.53:0/3981907239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec0b44f0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0cfca0 tx=0x7f8ae401f110 comp rx=0 tx=0).stop 2024-09-13T18:34:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 -- 172.21.15.53:0/3981907239 shutdown_connections 2024-09-13T18:34:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 --2- 172.21.15.53:0/3981907239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec0b44f0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 --2- 172.21.15.53:0/3981907239 >> v2:172.21.15.87:3300/0 conn(0x7f8aec0ce860 0x7f8aec0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 -- 172.21.15.53:0/3981907239 >> 172.21.15.53:0/3981907239 conn(0x7f8aec0b21e0 msgr2=0x7f8aec0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 -- 172.21.15.53:0/3981907239 shutdown_connections 2024-09-13T18:34:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.004+0000 7f8af274a640 1 -- 172.21.15.53:0/3981907239 wait complete. 2024-09-13T18:34:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 Processor -- start 2024-09-13T18:34:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 -- start start 2024-09-13T18:34:32.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aec0ce860 0x7f8aec15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aec15a700 0x7f8aec0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec15c2a0 con 0x7f8aec0b4060 2024-09-13T18:34:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec152f00 con 0x7f8aec15a700 2024-09-13T18:34:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec15b720 con 0x7f8aec0ce860 2024-09-13T18:34:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49280/0 (socket says 172.21.15.53:49280) 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 -- 172.21.15.53:0/2021319736 learned_addr learned my addr 172.21.15.53:0/2021319736 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af0ce7640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aec15a700 0x7f8aec0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 -- 172.21.15.53:0/2021319736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aec0ce860 msgr2=0x7f8aec15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aec0ce860 0x7f8aec15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 -- 172.21.15.53:0/2021319736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aec15a700 msgr2=0x7f8aec0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aec15a700 0x7f8aec0cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 -- 172.21.15.53:0/2021319736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae4009a70 con 0x7f8aec0b4060 2024-09-13T18:34:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8aebfff640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec151220 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c520 tx=0x7f8adc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8ae8ff9640 1 -- 172.21.15.53:0/2021319736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0074e0 con 0x7f8aec0b4060 2024-09-13T18:34:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8ae8ff9640 1 -- 172.21.15.53:0/2021319736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc007640 con 0x7f8aec0b4060 2024-09-13T18:34:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec15ba00 con 0x7f8aec0b4060 2024-09-13T18:34:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8ae8ff9640 1 -- 172.21.15.53:0/2021319736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0049f0 con 0x7f8aec0b4060 2024-09-13T18:34:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec15bfc0 con 0x7f8aec0b4060 2024-09-13T18:34:32.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec0cec80 con 0x7f8aec0b4060 2024-09-13T18:34:32.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.008+0000 7f8ae8ff9640 1 -- 172.21.15.53:0/2021319736 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f8adc004b50 con 0x7f8aec0b4060 2024-09-13T18:34:32.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.012+0000 7f8ae8ff9640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ad8067020 0x7f8ad80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:32.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.012+0000 7f8ae8ff9640 1 -- 172.21.15.53:0/2021319736 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8adc0822a0 con 0x7f8aec0b4060 2024-09-13T18:34:32.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.012+0000 7f8aeb7fe640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ad8067020 0x7f8ad80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:32.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.012+0000 7f8aeb7fe640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ad8067020 0x7f8ad80694e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00098f0 tx=0x7f8ae0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:32.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.016+0000 7f8ae8ff9640 1 -- 172.21.15.53:0/2021319736 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8adc050ec0 con 0x7f8aec0b4060 2024-09-13T18:34:32.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.212+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8aec06e5d0 con 0x7f8aec0b4060 2024-09-13T18:34:32.873 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.872+0000 7f8ae8ff9640 1 -- 172.21.15.53:0/2021319736 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v99) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8adc0180a0 con 0x7f8aec0b4060 2024-09-13T18:34:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ad8067020 msgr2=0x7f8ad80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ad8067020 0x7f8ad80694e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00098f0 tx=0x7f8ae0008040 comp rx=0 tx=0).stop 2024-09-13T18:34:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 msgr2=0x7f8aec151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec151220 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c520 tx=0x7f8adc00c9e0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 shutdown_connections 2024-09-13T18:34:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8ad8067020 0x7f8ad80694e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8aec0ce860 0x7f8aec15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8aec15a700 0x7f8aec0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 --2- 172.21.15.53:0/2021319736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aec0b4060 0x7f8aec151220 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 >> 172.21.15.53:0/2021319736 conn(0x7f8aec0b21e0 msgr2=0x7f8aec0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 shutdown_connections 2024-09-13T18:34:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:32.876+0000 7f8af274a640 1 -- 172.21.15.53:0/2021319736 wait complete. 2024-09-13T18:34:32.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:34:33.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.080+0000 7f140cf31640 1 Processor -- start 2024-09-13T18:34:33.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.080+0000 7f140cf31640 1 -- start start 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140cf31640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1408140930 0x7f140806d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140cf31640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f140806e2f0 0x7f140806d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140cf31640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1408140d10 con 0x7f1408143be0 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140cf31640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1408143a50 con 0x7f1408140930 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140cf31640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080cddc0 con 0x7f140806e2f0 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1408140930 0x7f140806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1408140930 0x7f140806d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49294/0 (socket says 172.21.15.53:49294) 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 -- 172.21.15.53:0/3252877556 learned_addr learned my addr 172.21.15.53:0/3252877556 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f1405d9b640 1 --2- 172.21.15.53:0/3252877556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f140806e2f0 0x7f140806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:33.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 -- 172.21.15.53:0/3252877556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f140806e2f0 msgr2=0x7f140806d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 --2- 172.21.15.53:0/3252877556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f140806e2f0 0x7f140806d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 -- 172.21.15.53:0/3252877556 >> v1:172.21.15.87:6789/0 conn(0x7f1408143be0 legacy=0x7f140815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:33.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 -- 172.21.15.53:0/3252877556 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080ce060 con 0x7f1408140930 2024-09-13T18:34:33.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.084+0000 7f140659c640 1 --2- 172.21.15.53:0/3252877556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408140930 0x7f140806d240 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009870 tx=0x7f13f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a1842be753108f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:33.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140559a640 1 -- 172.21.15.53:0/3252877556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80a6040 con 0x7f1408140930 2024-09-13T18:34:33.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140559a640 1 -- 172.21.15.53:0/3252877556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80aa600 con 0x7f1408140930 2024-09-13T18:34:33.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140559a640 1 -- 172.21.15.53:0/3252877556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80aa990 con 0x7f1408140930 2024-09-13T18:34:33.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- 172.21.15.53:0/3252877556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408140930 msgr2=0x7f140806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 --2- 172.21.15.53:0/3252877556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408140930 0x7f140806d240 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009870 tx=0x7f13f801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- 172.21.15.53:0/3252877556 shutdown_connections 2024-09-13T18:34:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 --2- 172.21.15.53:0/3252877556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f140806e2f0 0x7f140806d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 --2- 172.21.15.53:0/3252877556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408140930 0x7f140806d240 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- 172.21.15.53:0/3252877556 >> 172.21.15.53:0/3252877556 conn(0x7f140806a550 msgr2=0x7f14080b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- 172.21.15.53:0/3252877556 shutdown_connections 2024-09-13T18:34:33.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- 172.21.15.53:0/3252877556 wait complete. 2024-09-13T18:34:33.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 Processor -- start 2024-09-13T18:34:33.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- start start 2024-09-13T18:34:33.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140806e2f0 0x7f1408159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:33.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1408140930 0x7f140813bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:33.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1408143be0 0x7f140813f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:33.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140813c6a0 con 0x7f140806e2f0 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140813c980 con 0x7f1408143be0 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140cf31640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140813cc60 con 0x7f1408140930 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140806e2f0 0x7f1408159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140806e2f0 0x7f1408159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49306/0 (socket says 172.21.15.53:49306) 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 -- 172.21.15.53:0/1540883218 learned_addr learned my addr 172.21.15.53:0/1540883218 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f1405d9b640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1408140930 0x7f140813bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 -- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1408140930 msgr2=0x7f140813bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1408140930 0x7f140813bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f1406d9d640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1408143be0 0x7f140813f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:33.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 -- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1408143be0 msgr2=0x7f140813f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1408143be0 0x7f140813f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f140659c640 1 -- 172.21.15.53:0/1540883218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f80094d0 con 0x7f140806e2f0 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f1405d9b640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1408140930 0x7f140813bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.088+0000 7f1406d9d640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1408143be0 0x7f140813f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f140659c640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140806e2f0 0x7f1408159ad0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f13f801a0d0 tx=0x7f13f801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f13f6ffd640 1 -- 172.21.15.53:0/1540883218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80b3800 con 0x7f140806e2f0 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f13f6ffd640 1 -- 172.21.15.53:0/1540883218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80b3960 con 0x7f140806e2f0 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140813cf40 con 0x7f140806e2f0 2024-09-13T18:34:33.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f13f6ffd640 1 -- 172.21.15.53:0/1540883218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80b3cd0 con 0x7f140806e2f0 2024-09-13T18:34:33.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140813c170 con 0x7f140806e2f0 2024-09-13T18:34:33.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140813d180 con 0x7f140806e2f0 2024-09-13T18:34:33.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f13f6ffd640 1 -- 172.21.15.53:0/1540883218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f13f80bd3f0 con 0x7f140806e2f0 2024-09-13T18:34:33.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f13f6ffd640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f13e8067020 0x7f13e80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:33.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f13f6ffd640 1 -- 172.21.15.53:0/1540883218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f13f811d510 con 0x7f140806e2f0 2024-09-13T18:34:33.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f1405d9b640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f13e8067020 0x7f13e80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:33.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.092+0000 7f1405d9b640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f13e8067020 0x7f13e80694e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1408141670 tx=0x7f13fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:33.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.096+0000 7f13f6ffd640 1 -- 172.21.15.53:0/1540883218 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f140813d180 con 0x7f140806e2f0 2024-09-13T18:34:33.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:33.260+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f140813d180 con 0x7f140806e2f0 2024-09-13T18:34:34.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.087+0000 7f13f6ffd640 1 -- 172.21.15.53:0/1540883218 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v164) v1 ==== 181+0+0 (secure 0 0 0) 0x7f140813d180 con 0x7f140806e2f0 2024-09-13T18:34:34.093 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:34:34.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f13e8067020 msgr2=0x7f13e80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:34.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f13e8067020 0x7f13e80694e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1408141670 tx=0x7f13fc008040 comp rx=0 tx=0).stop 2024-09-13T18:34:34.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140806e2f0 msgr2=0x7f1408159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:34.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140806e2f0 0x7f1408159ad0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f13f801a0d0 tx=0x7f13f801ace0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 shutdown_connections 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f13e8067020 0x7f13e80694e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1408140930 0x7f140813bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1408143be0 0x7f140813f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 --2- 172.21.15.53:0/1540883218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f140806e2f0 0x7f1408159ad0 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 >> 172.21.15.53:0/1540883218 conn(0x7f140806a550 msgr2=0x7f1408139e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 shutdown_connections 2024-09-13T18:34:34.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.091+0000 7f140cf31640 1 -- 172.21.15.53:0/1540883218 wait complete. 2024-09-13T18:34:34.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:34:34.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.247+0000 7f4165508640 1 Processor -- start 2024-09-13T18:34:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.247+0000 7f4165508640 1 -- start start 2024-09-13T18:34:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.247+0000 7f4165508640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41600cdad0 0x7f4160143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.247+0000 7f4165508640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600b1ba0 con 0x7f4160143d50 2024-09-13T18:34:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.247+0000 7f4165508640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600b3020 con 0x7f41600cd6f0 2024-09-13T18:34:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.247+0000 7f4165508640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41600b1f80 con 0x7f41600cdad0 2024-09-13T18:34:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4160143d50 0x7f416006b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59048/0 (socket says 172.21.15.53:59048) 2024-09-13T18:34:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415f7fe640 1 -- 172.21.15.53:0/3502904618 learned_addr learned my addr 172.21.15.53:0/3502904618 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415e7fc640 1 --2- 172.21.15.53:0/3502904618 >> v2:172.21.15.87:3300/0 conn(0x7f41600cdad0 0x7f4160143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905502603 0 0) 0x7f41600b1ba0 con 0x7f4160143d50 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414c003530 con 0x7f4160143d50 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532691015 0 0) 0x7f414c003530 con 0x7f4160143d50 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 >> v2:172.21.15.87:3300/0 conn(0x7f41600cdad0 msgr2=0x7f4160143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 --2- 172.21.15.53:0/3502904618 >> v2:172.21.15.87:3300/0 conn(0x7f41600cdad0 0x7f4160143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 >> v1:172.21.15.87:6789/0 conn(0x7f41600cd6f0 legacy=0x7f41600b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600b2260 con 0x7f4160143d50 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f4158001a00 con 0x7f4160143d50 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 >> v1:172.21.15.53:6789/0 conn(0x7f4160143d50 legacy=0x7f416006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c003980 0x7f414c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c0047d0 0x7f414c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c005190 0x7f414c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600b1f80 con 0x7f414c003980 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c00c030 con 0x7f414c005190 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c00c1f0 con 0x7f414c0047d0 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415effd640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c003980 0x7f414c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415f7fe640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c005190 0x7f414c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415e7fc640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c0047d0 0x7f414c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415effd640 1 -- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c0047d0 msgr2=0x7f414c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415effd640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f414c0047d0 0x7f414c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415effd640 1 -- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c005190 msgr2=0x7f414c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415effd640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c005190 0x7f414c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415f7fe640 1 -- 172.21.15.53:0/3502904618 reap_dead start 2024-09-13T18:34:34.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415effd640 1 -- 172.21.15.53:0/3502904618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c003530 con 0x7f414c003980 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415effd640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c003980 0x7f414c003da0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f4148001780 tx=0x7f414801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea6c75f143d9c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480052d0 con 0x7f414c003980 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41480a7050 con 0x7f414c003980 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.251+0000 7f415dffb640 1 -- 172.21.15.53:0/3502904618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148003600 con 0x7f414c003980 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- 172.21.15.53:0/3502904618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c003980 msgr2=0x7f414c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c003980 0x7f414c003da0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f4148001780 tx=0x7f414801c3d0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- 172.21.15.53:0/3502904618 shutdown_connections 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 --2- 172.21.15.53:0/3502904618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c003980 0x7f414c003da0 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- 172.21.15.53:0/3502904618 >> 172.21.15.53:0/3502904618 conn(0x7f4160073330 msgr2=0x7f4160065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- 172.21.15.53:0/3502904618 shutdown_connections 2024-09-13T18:34:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- 172.21.15.53:0/3502904618 wait complete. 2024-09-13T18:34:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 Processor -- start 2024-09-13T18:34:34.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- start start 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c003980 0x7f4160159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f416013c090 0x7f416013e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f416013d790 0x7f416013dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416013e180 con 0x7f416013c090 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ab530 con 0x7f414c003980 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416013d0d0 con 0x7f416013d790 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f416013c090 0x7f416013e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f416013c090 0x7f416013e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49324/0 (socket says 172.21.15.53:49324) 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 -- 172.21.15.53:0/4131512187 learned_addr learned my addr 172.21.15.53:0/4131512187 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415effd640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c003980 0x7f4160159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415f7fe640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f416013d790 0x7f416013dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 -- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f416013d790 msgr2=0x7f416013dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f416013d790 0x7f416013dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 -- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c003980 msgr2=0x7f4160159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c003980 0x7f4160159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 -- 172.21.15.53:0/4131512187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416013c550 con 0x7f416013c090 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415f7fe640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f416013d790 0x7f416013dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f415e7fc640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f416013c090 0x7f416013e330 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f4150011490 tx=0x7f4150011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f41577fe640 1 -- 172.21.15.53:0/4131512187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150015870 con 0x7f416013c090 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f41577fe640 1 -- 172.21.15.53:0/4131512187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41500159d0 con 0x7f416013c090 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f41577fe640 1 -- 172.21.15.53:0/4131512187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150015d40 con 0x7f416013c090 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416013c830 con 0x7f416013c090 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.255+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416013cdf0 con 0x7f416013c090 2024-09-13T18:34:34.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.259+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416015e6f0 con 0x7f416013c090 2024-09-13T18:34:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.259+0000 7f41577fe640 1 -- 172.21.15.53:0/4131512187 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f4150013400 con 0x7f416013c090 2024-09-13T18:34:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.259+0000 7f41577fe640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4140067020 0x7f41400694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:34.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.259+0000 7f41577fe640 1 -- 172.21.15.53:0/4131512187 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4150082e90 con 0x7f416013c090 2024-09-13T18:34:34.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.259+0000 7f415effd640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4140067020 0x7f41400694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:34.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.259+0000 7f415effd640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4140067020 0x7f41400694e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4148001750 tx=0x7f41480011a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:34.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.263+0000 7f41577fe640 1 -- 172.21.15.53:0/4131512187 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4150051ab0 con 0x7f416013c090 2024-09-13T18:34:34.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:34.423+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f41600cae50 con 0x7f416013c090 2024-09-13T18:34:35.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.091+0000 7f41577fe640 1 -- 172.21.15.53:0/4131512187 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v165) v1 ==== 169+0+0 (secure 0 0 0) 0x7f41500550d0 con 0x7f416013c090 2024-09-13T18:34:35.099 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:34:35.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4140067020 msgr2=0x7f41400694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4140067020 0x7f41400694e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4148001750 tx=0x7f41480011a0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f416013c090 msgr2=0x7f416013e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f416013c090 0x7f416013e330 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f4150011490 tx=0x7f4150011950 comp rx=0 tx=0).stop 2024-09-13T18:34:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 shutdown_connections 2024-09-13T18:34:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4140067020 0x7f41400694e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f416013d790 0x7f416013dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f416013c090 0x7f416013e330 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 --2- 172.21.15.53:0/4131512187 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f414c003980 0x7f4160159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 >> 172.21.15.53:0/4131512187 conn(0x7f4160073330 msgr2=0x7f416015ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:35.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.099+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 shutdown_connections 2024-09-13T18:34:35.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.103+0000 7f4165508640 1 -- 172.21.15.53:0/4131512187 wait complete. 2024-09-13T18:34:35.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:34:35.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.247+0000 7fb8b2bf0640 1 Processor -- start 2024-09-13T18:34:35.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.247+0000 7fb8b2bf0640 1 -- start start 2024-09-13T18:34:35.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b2bf0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8ac143e80 0x7fb8ac06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b2bf0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac0caee0 0x7fb8ac0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b2bf0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac06f7a0 con 0x7fb8ac0cd320 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b2bf0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac06fd60 con 0x7fb8ac143e80 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b2bf0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cb960 con 0x7fb8ac0caee0 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8ac143e80 0x7fb8ac06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8ac143e80 0x7fb8ac06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49340/0 (socket says 172.21.15.53:49340) 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 -- 172.21.15.53:0/1349854542 learned_addr learned my addr 172.21.15.53:0/1349854542 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8abfff640 1 --2- 172.21.15.53:0/1349854542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac0caee0 0x7fb8ac0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 -- 172.21.15.53:0/1349854542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac0caee0 msgr2=0x7fb8ac0cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 --2- 172.21.15.53:0/1349854542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac0caee0 0x7fb8ac0cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 -- 172.21.15.53:0/1349854542 >> v1:172.21.15.87:6789/0 conn(0x7fb8ac0cd320 legacy=0x7fb8ac0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 -- 172.21.15.53:0/1349854542 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0cbc40 con 0x7fb8ac143e80 2024-09-13T18:34:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8abfff640 1 --2- 172.21.15.53:0/1349854542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac0caee0 0x7fb8ac0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:35.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.251+0000 7fb8b098c640 1 --2- 172.21.15.53:0/1349854542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac143e80 0x7fb8ac06b390 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009870 tx=0x7fb8a001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d77d51496c5f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8ab7fe640 1 -- 172.21.15.53:0/1349854542 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00ab600 con 0x7fb8ac143e80 2024-09-13T18:34:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8ab7fe640 1 -- 172.21.15.53:0/1349854542 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a00ab760 con 0x7fb8ac143e80 2024-09-13T18:34:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8ab7fe640 1 -- 172.21.15.53:0/1349854542 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00abaf0 con 0x7fb8ac143e80 2024-09-13T18:34:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1349854542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac143e80 msgr2=0x7fb8ac06b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1349854542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac143e80 0x7fb8ac06b390 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009870 tx=0x7fb8a001c460 comp rx=0 tx=0).stop 2024-09-13T18:34:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1349854542 shutdown_connections 2024-09-13T18:34:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1349854542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac0caee0 0x7fb8ac0cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1349854542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac143e80 0x7fb8ac06b390 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1349854542 >> 172.21.15.53:0/1349854542 conn(0x7fb8ac065c80 msgr2=0x7fb8ac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1349854542 shutdown_connections 2024-09-13T18:34:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1349854542 wait complete. 2024-09-13T18:34:35.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 Processor -- start 2024-09-13T18:34:35.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- start start 2024-09-13T18:34:35.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac0caee0 0x7fb8ac0a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8ac0cd320 0x7fb8ac0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac143e80 0x7fb8ac0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac13c850 con 0x7fb8ac0caee0 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0a8a50 con 0x7fb8ac0cd320 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac13bec0 con 0x7fb8ac143e80 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac0caee0 0x7fb8ac0a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac0caee0 0x7fb8ac0a8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49356/0 (socket says 172.21.15.53:49356) 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 -- 172.21.15.53:0/1793367379 learned_addr learned my addr 172.21.15.53:0/1793367379 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8abfff640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8ac0cd320 0x7fb8ac0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 -- 172.21.15.53:0/1793367379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac143e80 msgr2=0x7fb8ac0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac143e80 0x7fb8ac0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 -- 172.21.15.53:0/1793367379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8ac0cd320 msgr2=0x7fb8ac0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8ac0cd320 0x7fb8ac0ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 -- 172.21.15.53:0/1793367379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00094d0 con 0x7fb8ac0caee0 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b098c640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac0caee0 0x7fb8ac0a8510 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ad040 tx=0x7fb8a001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1793367379 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00b4800 con 0x7fb8ac0caee0 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1793367379 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a00b4960 con 0x7fb8ac0caee0 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac13c1a0 con 0x7fb8ac0caee0 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.255+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1793367379 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00b4d10 con 0x7fb8ac0caee0 2024-09-13T18:34:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.259+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac0aa5e0 con 0x7fb8ac0caee0 2024-09-13T18:34:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.259+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac0cb320 con 0x7fb8ac0caee0 2024-09-13T18:34:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.259+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1793367379 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fb8a00b3380 con 0x7fb8ac0caee0 2024-09-13T18:34:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.259+0000 7fb8a97fa640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb890067020 0x7fb8900694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.259+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1793367379 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8a011d330 con 0x7fb8ac0caee0 2024-09-13T18:34:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.259+0000 7fb8abfff640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb890067020 0x7fb8900694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.259+0000 7fb8abfff640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb890067020 0x7fb8900694e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb898006fd0 tx=0x7fb898008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.263+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1793367379 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8a00ec000 con 0x7fb8ac0caee0 2024-09-13T18:34:35.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.423+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb8ac1425f0 con 0x7fb8ac0caee0 2024-09-13T18:34:35.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8a97fa640 1 -- 172.21.15.53:0/1793367379 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb8a00ef620 con 0x7fb8ac0caee0 2024-09-13T18:34:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb890067020 msgr2=0x7fb8900694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb890067020 0x7fb8900694e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb898006fd0 tx=0x7fb898008040 comp rx=0 tx=0).stop 2024-09-13T18:34:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac0caee0 msgr2=0x7fb8ac0a8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac0caee0 0x7fb8ac0a8510 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00ad040 tx=0x7fb8a001aca0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 shutdown_connections 2024-09-13T18:34:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb890067020 0x7fb8900694e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8ac143e80 0x7fb8ac0b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8ac0cd320 0x7fb8ac0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 --2- 172.21.15.53:0/1793367379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8ac0caee0 0x7fb8ac0a8510 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 >> 172.21.15.53:0/1793367379 conn(0x7fb8ac065c80 msgr2=0x7fb8ac0ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 shutdown_connections 2024-09-13T18:34:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.431+0000 7fb8b2bf0640 1 -- 172.21.15.53:0/1793367379 wait complete. 2024-09-13T18:34:35.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-13T18:34:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.579+0000 7f451f458640 1 Processor -- start 2024-09-13T18:34:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.579+0000 7f451f458640 1 -- start start 2024-09-13T18:34:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451f458640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45180d19c0 0x7f45180cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451f458640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45180d2400 con 0x7f451815cab0 2024-09-13T18:34:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451f458640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45180d1530 con 0x7f45180cf600 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451f458640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45180cfa90 con 0x7f45180d19c0 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451c9f3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45180d19c0 0x7f45180cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451c9f3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45180d19c0 0x7f45180cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49368/0 (socket says 172.21.15.53:49368) 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451c9f3640 1 -- 172.21.15.53:0/1297831624 learned_addr learned my addr 172.21.15.53:0/1297831624 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451c9f3640 1 -- 172.21.15.53:0/1297831624 >> v1:172.21.15.87:6789/0 conn(0x7f45180cf600 legacy=0x7f45180b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451c9f3640 1 -- 172.21.15.53:0/1297831624 >> v1:172.21.15.53:6789/0 conn(0x7f451815cab0 legacy=0x7f45180cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f450ffff640 1 -- 172.21.15.53:0/1297831624 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529185288 0 0) 0x7f45180d2400 con 0x7f451815cab0 2024-09-13T18:34:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451c9f3640 1 -- 172.21.15.53:0/1297831624 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45180cddd0 con 0x7f45180d19c0 2024-09-13T18:34:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.583+0000 7f451c9f3640 1 --2- 172.21.15.53:0/1297831624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f45180cf0c0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f4508009870 tx=0x7f450801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72c969543f5d764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f450ffff640 1 -- 172.21.15.53:0/1297831624 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45080ab650 con 0x7f45180d19c0 2024-09-13T18:34:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f450ffff640 1 -- 172.21.15.53:0/1297831624 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080ab7b0 con 0x7f45180d19c0 2024-09-13T18:34:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f450ffff640 1 -- 172.21.15.53:0/1297831624 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45080abb40 con 0x7f45180d19c0 2024-09-13T18:34:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- 172.21.15.53:0/1297831624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 msgr2=0x7f45180cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 --2- 172.21.15.53:0/1297831624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f45180cf0c0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f4508009870 tx=0x7f450801c560 comp rx=0 tx=0).stop 2024-09-13T18:34:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- 172.21.15.53:0/1297831624 shutdown_connections 2024-09-13T18:34:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 --2- 172.21.15.53:0/1297831624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f45180cf0c0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- 172.21.15.53:0/1297831624 >> 172.21.15.53:0/1297831624 conn(0x7f4518065c80 msgr2=0x7f4518066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- 172.21.15.53:0/1297831624 shutdown_connections 2024-09-13T18:34:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- 172.21.15.53:0/1297831624 wait complete. 2024-09-13T18:34:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 Processor -- start 2024-09-13T18:34:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- start start 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45180cf600 0x7f45180b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f4518159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451815cab0 0x7f45180c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180cd200 con 0x7f45180d19c0 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180cd620 con 0x7f451815cab0 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45180cc580 con 0x7f45180cf600 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f4518159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f4518159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49376/0 (socket says 172.21.15.53:49376) 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 -- 172.21.15.53:0/4023936149 learned_addr learned my addr 172.21.15.53:0/4023936149 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451d1f4640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45180cf600 0x7f45180b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451d9f5640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451815cab0 0x7f45180c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 -- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45180cf600 msgr2=0x7f45180b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45180cf600 0x7f45180b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 -- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451815cab0 msgr2=0x7f45180c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451815cab0 0x7f45180c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 -- 172.21.15.53:0/4023936149 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080094d0 con 0x7f45180d19c0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451c9f3640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f4518159690 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f45080ad040 tx=0x7f450801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f450dffb640 1 -- 172.21.15.53:0/4023936149 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45080b4800 con 0x7f45180d19c0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f450dffb640 1 -- 172.21.15.53:0/4023936149 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080b4980 con 0x7f45180d19c0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45180cc860 con 0x7f45180d19c0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.587+0000 7f450dffb640 1 -- 172.21.15.53:0/4023936149 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45080b4d30 con 0x7f45180d19c0 2024-09-13T18:34:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.591+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45180cce20 con 0x7f45180d19c0 2024-09-13T18:34:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.591+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45180cd340 con 0x7f45180d19c0 2024-09-13T18:34:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.591+0000 7f450dffb640 1 -- 172.21.15.53:0/4023936149 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f45080c7390 con 0x7f45180d19c0 2024-09-13T18:34:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.591+0000 7f450dffb640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f44fc067020 0x7f44fc0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.591+0000 7f450dffb640 1 -- 172.21.15.53:0/4023936149 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f450811da50 con 0x7f45180d19c0 2024-09-13T18:34:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.591+0000 7f451d1f4640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f44fc067020 0x7f44fc0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.591+0000 7f451d1f4640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f44fc067020 0x7f44fc0694e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f45180b4740 tx=0x7f4514009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.595+0000 7f450dffb640 1 -- 172.21.15.53:0/4023936149 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45180cd340 con 0x7f45180d19c0 2024-09-13T18:34:35.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:35.811+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) v1 -- 0x7f45180cd340 con 0x7f45180d19c0 2024-09-13T18:34:36.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.107+0000 7f450dffb640 1 -- 172.21.15.53:0/4023936149 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v521) v1 ==== 145+0+0 (secure 0 0 0) 0x7f45180cd340 con 0x7f45180d19c0 2024-09-13T18:34:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f44fc067020 msgr2=0x7f44fc0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f44fc067020 0x7f44fc0694e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f45180b4740 tx=0x7f4514009040 comp rx=0 tx=0).stop 2024-09-13T18:34:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 msgr2=0x7f4518159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f4518159690 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f45080ad040 tx=0x7f450801ada0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 shutdown_connections 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f44fc067020 0x7f44fc0694e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f451815cab0 0x7f45180c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45180d19c0 0x7f4518159690 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 --2- 172.21.15.53:0/4023936149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f45180cf600 0x7f45180b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 >> 172.21.15.53:0/4023936149 conn(0x7f4518065c80 msgr2=0x7f45180b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 shutdown_connections 2024-09-13T18:34:36.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.111+0000 7f451f458640 1 -- 172.21.15.53:0/4023936149 wait complete. 2024-09-13T18:34:36.135 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-13T18:34:36.135 INFO:tasks.cephfs_test_runner:Starting test: test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate unparseable text .meta file on legacy subvol root doesn't break the system 2024-09-13T18:34:36.136 INFO:tasks.cephfs_test_runner:test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-13T18:34:36.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c6431640 1 Processor -- start 2024-09-13T18:34:36.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c6431640 1 -- start start 2024-09-13T18:34:36.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c6431640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c0145b90 0x7ff5c006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c6431640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff5c00acff0 0x7ff5c006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c6431640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c00b3380 con 0x7ff5c006d260 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c6431640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c00b3810 con 0x7ff5c00acff0 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c6431640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00b2770 con 0x7ff5c0145b90 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c49ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff5c00acff0 0x7ff5c006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c49ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff5c00acff0 0x7ff5c006f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49380/0 (socket says 172.21.15.53:49380) 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c49ce640 1 -- 172.21.15.53:0/33281173 learned_addr learned my addr 172.21.15.53:0/33281173 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5bffff640 1 --2- 172.21.15.53:0/33281173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c0145b90 0x7ff5c006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c49ce640 1 -- 172.21.15.53:0/33281173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c0145b90 msgr2=0x7ff5c006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c49ce640 1 --2- 172.21.15.53:0/33281173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c0145b90 0x7ff5c006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c49ce640 1 -- 172.21.15.53:0/33281173 >> v1:172.21.15.87:6789/0 conn(0x7ff5c006d260 legacy=0x7ff5c00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5c49ce640 1 -- 172.21.15.53:0/33281173 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00b2a50 con 0x7ff5c00acff0 2024-09-13T18:34:36.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.263+0000 7ff5bffff640 1 --2- 172.21.15.53:0/33281173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c0145b90 0x7ff5c006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:36.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 --2- 172.21.15.53:0/33281173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c00acff0 0x7ff5c006f300 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009e50 tx=0x7ff5b801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331d971feae3c6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5bf7fe640 1 -- 172.21.15.53:0/33281173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80a57b0 con 0x7ff5c00acff0 2024-09-13T18:34:36.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5bf7fe640 1 -- 172.21.15.53:0/33281173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b80a5910 con 0x7ff5c00acff0 2024-09-13T18:34:36.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5bf7fe640 1 -- 172.21.15.53:0/33281173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80a5ca0 con 0x7ff5c00acff0 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- 172.21.15.53:0/33281173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c00acff0 msgr2=0x7ff5c006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 --2- 172.21.15.53:0/33281173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c00acff0 0x7ff5c006f300 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009e50 tx=0x7ff5b801c930 comp rx=0 tx=0).stop 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- 172.21.15.53:0/33281173 shutdown_connections 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 --2- 172.21.15.53:0/33281173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c00acff0 0x7ff5c006f300 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 --2- 172.21.15.53:0/33281173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c0145b90 0x7ff5c006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- 172.21.15.53:0/33281173 >> 172.21.15.53:0/33281173 conn(0x7ff5c0073130 msgr2=0x7ff5c0065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- 172.21.15.53:0/33281173 shutdown_connections 2024-09-13T18:34:36.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- 172.21.15.53:0/33281173 wait complete. 2024-09-13T18:34:36.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 Processor -- start 2024-09-13T18:34:36.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- start start 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5c006d260 0x7ff5c015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c00acff0 0x7ff5c01f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c0145b90 0x7ff5c013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c013fe90 con 0x7ff5c0145b90 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c01f8d90 con 0x7ff5c006d260 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c6431640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c013f280 con 0x7ff5c00acff0 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c0145b90 0x7ff5c013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c0145b90 0x7ff5c013ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49388/0 (socket says 172.21.15.53:49388) 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 -- 172.21.15.53:0/4151537493 learned_addr learned my addr 172.21.15.53:0/4151537493 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5bffff640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5c006d260 0x7ff5c015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5b7fff640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c00acff0 0x7ff5c01f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 -- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c00acff0 msgr2=0x7ff5c01f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c00acff0 0x7ff5c01f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 -- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5c006d260 msgr2=0x7ff5c015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5c006d260 0x7ff5c015e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 -- 172.21.15.53:0/4151537493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8009b30 con 0x7ff5c0145b90 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.267+0000 7ff5c49ce640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c0145b90 0x7ff5c013ea30 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80af040 tx=0x7ff5b80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bd7fa640 1 -- 172.21.15.53:0/4151537493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80b8670 con 0x7ff5c0145b90 2024-09-13T18:34:36.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bd7fa640 1 -- 172.21.15.53:0/4151537493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b80b87d0 con 0x7ff5c0145b90 2024-09-13T18:34:36.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c013f560 con 0x7ff5c0145b90 2024-09-13T18:34:36.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bd7fa640 1 -- 172.21.15.53:0/4151537493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80b8b80 con 0x7ff5c0145b90 2024-09-13T18:34:36.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c013fb20 con 0x7ff5c0145b90 2024-09-13T18:34:36.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c013fcb0 con 0x7ff5c0145b90 2024-09-13T18:34:36.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bd7fa640 1 -- 172.21.15.53:0/4151537493 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7ff5b80b8ce0 con 0x7ff5c0145b90 2024-09-13T18:34:36.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bd7fa640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5a0067020 0x7ff5a00694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bd7fa640 1 -- 172.21.15.53:0/4151537493 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff5b811e630 con 0x7ff5c0145b90 2024-09-13T18:34:36.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bffff640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5a0067020 0x7ff5a00694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.271+0000 7ff5bffff640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5a0067020 0x7ff5a00694e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006fd0 tx=0x7ff5b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.275+0000 7ff5bd7fa640 1 -- 172.21.15.53:0/4151537493 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5b80ed310 con 0x7ff5c0145b90 2024-09-13T18:34:36.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.431+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5c006f300 con 0x7ff5c0145b90 2024-09-13T18:34:36.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5bd7fa640 1 -- 172.21.15.53:0/4151537493 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+12936 (secure 0 0 0) 0x7ff5b80f0930 con 0x7ff5c0145b90 2024-09-13T18:34:36.438 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:36.438 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":165,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:35.090656+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/3514602173":"2024-09-14T18:34:31.851055+0000","172.21.15.53:6833/3514602173":"2024-09-14T18:34:31.851055+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:36.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5a0067020 msgr2=0x7ff5a00694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5a0067020 0x7ff5a00694e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0006fd0 tx=0x7ff5b0008040 comp rx=0 tx=0).stop 2024-09-13T18:34:36.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c0145b90 msgr2=0x7ff5c013ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c0145b90 0x7ff5c013ea30 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80af040 tx=0x7ff5b80196d0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 shutdown_connections 2024-09-13T18:34:36.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7ff5a0067020 0x7ff5a00694e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff5c00acff0 0x7ff5c01f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c0145b90 0x7ff5c013ea30 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 --2- 172.21.15.53:0/4151537493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff5c006d260 0x7ff5c015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 >> 172.21.15.53:0/4151537493 conn(0x7ff5c0073130 msgr2=0x7ff5c00aee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:36.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 shutdown_connections 2024-09-13T18:34:36.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.435+0000 7ff5c6431640 1 -- 172.21.15.53:0/4151537493 wait complete. 2024-09-13T18:34:36.455 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:34:36.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:34:36.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 Processor -- start 2024-09-13T18:34:36.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 -- start start 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8df8158ba0 0x7f8df80cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8df80b1dd0 0x7f8df80b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df806ff40 0x7f8df8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df806c530 con 0x7f8df80b1dd0 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df806bc20 con 0x7f8df8158ba0 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8dfcc2f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80708b0 con 0x7f8df806ff40 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8df80b1dd0 0x7f8df80b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8df80b1dd0 0x7f8df80b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57532/0 (socket says 172.21.15.53:57532) 2024-09-13T18:34:36.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 -- 172.21.15.53:0/2534796128 learned_addr learned my addr 172.21.15.53:0/2534796128 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df6d9d640 1 --2- 172.21.15.53:0/2534796128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df806ff40 0x7f8df8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df659c640 1 --2- 172.21.15.53:0/2534796128 >> v2:172.21.15.87:3300/0 conn(0x7f8df8158ba0 0x7f8df80cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 -- 172.21.15.53:0/2534796128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df806ff40 msgr2=0x7f8df8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 --2- 172.21.15.53:0/2534796128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df806ff40 0x7f8df8070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 -- 172.21.15.53:0/2534796128 >> v2:172.21.15.87:3300/0 conn(0x7f8df8158ba0 msgr2=0x7f8df80cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 --2- 172.21.15.53:0/2534796128 >> v2:172.21.15.87:3300/0 conn(0x7f8df8158ba0 0x7f8df80cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df5d9b640 1 -- 172.21.15.53:0/2534796128 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df8158f80 con 0x7f8df80b1dd0 2024-09-13T18:34:36.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.579+0000 7f8df659c640 1 --2- 172.21.15.53:0/2534796128 >> v2:172.21.15.87:3300/0 conn(0x7f8df8158ba0 0x7f8df80cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8df5d9b640 1 --2- 172.21.15.53:0/2534796128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80b3120 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f8df806d7c0 tx=0x7f8de001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baa49da230693e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8df559a640 1 -- 172.21.15.53:0/2534796128 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00ab600 con 0x7f8df80b1dd0 2024-09-13T18:34:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8df559a640 1 -- 172.21.15.53:0/2534796128 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00a7050 con 0x7f8df80b1dd0 2024-09-13T18:34:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8df559a640 1 -- 172.21.15.53:0/2534796128 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00ab980 con 0x7f8df80b1dd0 2024-09-13T18:34:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/2534796128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 msgr2=0x7f8df80b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/2534796128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80b3120 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f8df806d7c0 tx=0x7f8de001c3d0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/2534796128 shutdown_connections 2024-09-13T18:34:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/2534796128 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df806ff40 0x7f8df8070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/2534796128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80b3120 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/2534796128 >> v2:172.21.15.87:3300/0 conn(0x7f8df8158ba0 0x7f8df80cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/2534796128 >> 172.21.15.53:0/2534796128 conn(0x7f8df8065c80 msgr2=0x7f8df8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/2534796128 shutdown_connections 2024-09-13T18:34:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/2534796128 wait complete. 2024-09-13T18:34:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 Processor -- start 2024-09-13T18:34:36.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.583+0000 7f8dfcc2f640 1 -- start start 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df806ff40 0x7f8df814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df8158ba0 0x7f8df80b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df814b880 con 0x7f8df80b1dd0 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80aeaa0 con 0x7f8df806ff40 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80aed80 con 0x7f8df8158ba0 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57542/0 (socket says 172.21.15.53:57542) 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 -- 172.21.15.53:0/3569295755 learned_addr learned my addr 172.21.15.53:0/3569295755 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df659c640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df806ff40 0x7f8df814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df6d9d640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df8158ba0 0x7f8df80b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 -- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df8158ba0 msgr2=0x7f8df80b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df8158ba0 0x7f8df80b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 -- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df806ff40 msgr2=0x7f8df814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df806ff40 0x7f8df814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 -- 172.21.15.53:0/3569295755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00094d0 con 0x7f8df80b1dd0 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df659c640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df806ff40 0x7f8df814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df6d9d640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df8158ba0 0x7f8df80b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df5d9b640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80ae070 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f8de001aa80 tx=0x7f8de0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8deeffd640 1 -- 172.21.15.53:0/3569295755 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b4440 con 0x7f8df80b1dd0 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8deeffd640 1 -- 172.21.15.53:0/3569295755 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00b45a0 con 0x7f8df80b1dd0 2024-09-13T18:34:36.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df80af060 con 0x7f8df80b1dd0 2024-09-13T18:34:36.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8deeffd640 1 -- 172.21.15.53:0/3569295755 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b4930 con 0x7f8df80b1dd0 2024-09-13T18:34:36.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df80af620 con 0x7f8df80b1dd0 2024-09-13T18:34:36.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df80af810 con 0x7f8df80b1dd0 2024-09-13T18:34:36.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8deeffd640 1 -- 172.21.15.53:0/3569295755 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f8de00b2070 con 0x7f8df80b1dd0 2024-09-13T18:34:36.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8deeffd640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8dd8067020 0x7f8dd80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8deeffd640 1 -- 172.21.15.53:0/3569295755 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8de011ca50 con 0x7f8df80b1dd0 2024-09-13T18:34:36.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df659c640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8dd8067020 0x7f8dd80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.587+0000 7f8df659c640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8dd8067020 0x7f8dd80694e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8de80097a0 tx=0x7f8de8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.591+0000 7f8deeffd640 1 -- 172.21.15.53:0/3569295755 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8de00eb790 con 0x7f8df80b1dd0 2024-09-13T18:34:36.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8df80b3120 con 0x7f8df80b1dd0 2024-09-13T18:34:36.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8deeffd640 1 -- 172.21.15.53:0/3569295755 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8de00eedb0 con 0x7f8df80b1dd0 2024-09-13T18:34:36.753 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8dd8067020 msgr2=0x7f8dd80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8dd8067020 0x7f8dd80694e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8de80097a0 tx=0x7f8de8008040 comp rx=0 tx=0).stop 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 msgr2=0x7f8df80ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80ae070 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f8de001aa80 tx=0x7f8de0019170 comp rx=0 tx=0).stop 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 shutdown_connections 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8dd8067020 0x7f8dd80694e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8df8158ba0 0x7f8df80b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8df80b1dd0 0x7f8df80ae070 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 --2- 172.21.15.53:0/3569295755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8df806ff40 0x7f8df814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 >> 172.21.15.53:0/3569295755 conn(0x7f8df8065c80 msgr2=0x7f8df806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 shutdown_connections 2024-09-13T18:34:36.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.751+0000 7f8dfcc2f640 1 -- 172.21.15.53:0/3569295755 wait complete. 2024-09-13T18:34:36.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-13T18:34:36.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.895+0000 7f789e704640 1 Processor -- start 2024-09-13T18:34:36.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.895+0000 7f789e704640 1 -- start start 2024-09-13T18:34:36.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f789e704640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815cab0 0x7f78980d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f789e704640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f78980cf7d0 0x7f78980b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f789e704640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78980d2400 con 0x7f78980cd6c0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f789e704640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78980d1530 con 0x7f78980cf7d0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f789e704640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78980d0920 con 0x7f789815cab0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f788ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f78980cd6c0 0x7f78980cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40898/0 (socket says 172.21.15.53:40898) 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f788ffff640 1 -- 172.21.15.53:0/3122458808 learned_addr learned my addr 172.21.15.53:0/3122458808 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150868799 0 0) 0x7f78980d2400 con 0x7f78980cd6c0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815cab0 0x7f78980d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f789cca1640 1 --2- 172.21.15.53:0/3122458808 >> v2:172.21.15.87:3300/0 conn(0x7f78980cf7d0 0x7f78980b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7884003530 con 0x7f78980cd6c0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811529112 0 0) 0x7f7884003530 con 0x7f78980cd6c0 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815cab0 msgr2=0x7f78980d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815cab0 0x7f78980d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 >> v2:172.21.15.87:3300/0 conn(0x7f78980cf7d0 msgr2=0x7f78980b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 --2- 172.21.15.53:0/3122458808 >> v2:172.21.15.87:3300/0 conn(0x7f78980cf7d0 0x7f78980b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980d0c00 con 0x7f78980cd6c0 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7880001680 con 0x7f78980cd6c0 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 >> v1:172.21.15.53:6789/0 conn(0x7f78980cd6c0 legacy=0x7f78980cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f7884003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78840047d0 0x7f7884004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815cab0 0x7f7884005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78980d1530 con 0x7f7884003980 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78980d0920 con 0x7f78840047d0 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788400b990 con 0x7f789815cab0 2024-09-13T18:34:36.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f7884003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 -- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815cab0 msgr2=0x7f7884005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815cab0 0x7f7884005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 -- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78840047d0 msgr2=0x7f7884004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:36.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f788ffff640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78840047d0 0x7f7884004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78840047d0 0x7f7884004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 -- 172.21.15.53:0/3122458808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884003530 con 0x7f7884003980 2024-09-13T18:34:36.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f788ffff640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78840047d0 0x7f7884004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:36.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.899+0000 7f7897fff640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f7884003da0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f7888009ae0 tx=0x7f788801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1fffe50d35e97c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880a5570 con 0x7f7884003980 2024-09-13T18:34:36.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78880a56d0 con 0x7f7884003980 2024-09-13T18:34:36.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f78977fe640 1 -- 172.21.15.53:0/3122458808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880a5a80 con 0x7f7884003980 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- 172.21.15.53:0/3122458808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 msgr2=0x7f7884003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 --2- 172.21.15.53:0/3122458808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f7884003da0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f7888009ae0 tx=0x7f788801ca80 comp rx=0 tx=0).stop 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789cca1640 1 -- 172.21.15.53:0/3122458808 reap_dead start 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- 172.21.15.53:0/3122458808 shutdown_connections 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- 172.21.15.53:0/3122458808 >> 172.21.15.53:0/3122458808 conn(0x7f7898065c80 msgr2=0x7f7898066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- 172.21.15.53:0/3122458808 shutdown_connections 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- 172.21.15.53:0/3122458808 wait complete. 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 Processor -- start 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- start start 2024-09-13T18:34:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f78980a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815b780 0x7f78980cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78980cbd50 0x7f78981f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78980ca520 con 0x7f7884003980 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78980ca770 con 0x7f78980cbd50 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78980caa50 con 0x7f789815b780 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f78980a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f78980a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57550/0 (socket says 172.21.15.53:57550) 2024-09-13T18:34:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 -- 172.21.15.53:0/1368243677 learned_addr learned my addr 172.21.15.53:0/1368243677 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789cca1640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78980cbd50 0x7f78981f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f788ffff640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815b780 0x7f78980cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 -- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815b780 msgr2=0x7f78980cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815b780 0x7f78980cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 -- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78980cbd50 msgr2=0x7f78981f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78980cbd50 0x7f78981f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 -- 172.21.15.53:0/1368243677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980cad30 con 0x7f7884003980 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f7897fff640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f78980a9400 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f78880b0040 tx=0x7f7884005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f78957fa640 1 -- 172.21.15.53:0/1368243677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788800f000 con 0x7f7884003980 2024-09-13T18:34:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f78957fa640 1 -- 172.21.15.53:0/1368243677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888004020 con 0x7f7884003980 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78980cb010 con 0x7f7884003980 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f78957fa640 1 -- 172.21.15.53:0/1368243677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880043b0 con 0x7f7884003980 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.903+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78980a9940 con 0x7f7884003980 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.907+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78980b5870 con 0x7f7884003980 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.907+0000 7f78957fa640 1 -- 172.21.15.53:0/1368243677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f78880b4040 con 0x7f7884003980 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.907+0000 7f78957fa640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7878067020 0x7f78780694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.907+0000 7f788ffff640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7878067020 0x7f78780694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.907+0000 7f78957fa640 1 -- 172.21.15.53:0/1368243677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f788811cdb0 con 0x7f7884003980 2024-09-13T18:34:36.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.907+0000 7f788ffff640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7878067020 0x7f78780694e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7880001830 tx=0x7f7880009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:36.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:36.911+0000 7f78957fa640 1 -- 172.21.15.53:0/1368243677 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f78880ebba0 con 0x7f7884003980 2024-09-13T18:34:37.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:37.127+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f78980ca520 con 0x7f7884003980 2024-09-13T18:34:38.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.115+0000 7f78957fa640 1 -- 172.21.15.53:0/1368243677 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v523) v1 ==== 166+0+0 (secure 0 0 0) 0x7f78880ef1c0 con 0x7f7884003980 2024-09-13T18:34:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7878067020 msgr2=0x7f78780694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7878067020 0x7f78780694e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7880001830 tx=0x7f7880009040 comp rx=0 tx=0).stop 2024-09-13T18:34:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 msgr2=0x7f78980a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f78980a9400 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f78880b0040 tx=0x7f7884005800 comp rx=0 tx=0).stop 2024-09-13T18:34:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 shutdown_connections 2024-09-13T18:34:38.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7878067020 0x7f78780694e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f789815b780 0x7f78980cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78980cbd50 0x7f78981f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 --2- 172.21.15.53:0/1368243677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7884003980 0x7f78980a9400 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 >> 172.21.15.53:0/1368243677 conn(0x7f7898065c80 msgr2=0x7f789815ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 shutdown_connections 2024-09-13T18:34:38.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.119+0000 7f789e704640 1 -- 172.21.15.53:0/1368243677 wait complete. 2024-09-13T18:34:38.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:34:38.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.263+0000 7fcaa3acf640 1 Processor -- start 2024-09-13T18:34:38.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.263+0000 7fcaa3acf640 1 -- start start 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa3acf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fca9c156c40 0x7fca9c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa3acf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca9c157020 0x7fca9c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa3acf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c06d270 0x7fca9c15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa3acf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c06d6e0 con 0x7fca9c157020 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa3acf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0b15a0 con 0x7fca9c156c40 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa3acf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b1880 con 0x7fca9c06d270 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca9c157020 0x7fca9c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca9c157020 0x7fca9c06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57552/0 (socket says 172.21.15.53:57552) 2024-09-13T18:34:38.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 -- 172.21.15.53:0/2175012305 learned_addr learned my addr 172.21.15.53:0/2175012305 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa186b640 1 --2- 172.21.15.53:0/2175012305 >> v2:172.21.15.87:3300/0 conn(0x7fca9c156c40 0x7fca9c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa206c640 1 --2- 172.21.15.53:0/2175012305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c06d270 0x7fca9c15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 -- 172.21.15.53:0/2175012305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c06d270 msgr2=0x7fca9c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 --2- 172.21.15.53:0/2175012305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c06d270 0x7fca9c15cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 -- 172.21.15.53:0/2175012305 >> v2:172.21.15.87:3300/0 conn(0x7fca9c156c40 msgr2=0x7fca9c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 --2- 172.21.15.53:0/2175012305 >> v2:172.21.15.87:3300/0 conn(0x7fca9c156c40 0x7fca9c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 -- 172.21.15.53:0/2175012305 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0b1b60 con 0x7fca9c157020 2024-09-13T18:34:38.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa206c640 1 --2- 172.21.15.53:0/2175012305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c06d270 0x7fca9c15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:38.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa106a640 1 --2- 172.21.15.53:0/2175012305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c157020 0x7fca9c06cd30 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fca9c067650 tx=0x7fca8c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7112ac4bbd926e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa0869640 1 -- 172.21.15.53:0/2175012305 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0ab600 con 0x7fca9c157020 2024-09-13T18:34:38.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa0869640 1 -- 172.21.15.53:0/2175012305 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c0a7050 con 0x7fca9c157020 2024-09-13T18:34:38.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.267+0000 7fcaa0869640 1 -- 172.21.15.53:0/2175012305 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0ab980 con 0x7fca9c157020 2024-09-13T18:34:38.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- 172.21.15.53:0/2175012305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c157020 msgr2=0x7fca9c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/2175012305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c157020 0x7fca9c06cd30 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fca9c067650 tx=0x7fca8c01c230 comp rx=0 tx=0).stop 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- 172.21.15.53:0/2175012305 shutdown_connections 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/2175012305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c06d270 0x7fca9c15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/2175012305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c157020 0x7fca9c06cd30 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/2175012305 >> v2:172.21.15.87:3300/0 conn(0x7fca9c156c40 0x7fca9c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- 172.21.15.53:0/2175012305 >> 172.21.15.53:0/2175012305 conn(0x7fca9c065c80 msgr2=0x7fca9c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- 172.21.15.53:0/2175012305 shutdown_connections 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- 172.21.15.53:0/2175012305 wait complete. 2024-09-13T18:34:38.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 Processor -- start 2024-09-13T18:34:38.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- start start 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c06d270 0x7fca9c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c156c40 0x7fca9c15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c14d1d0 0x7fca9c0cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1516c0 con 0x7fca9c156c40 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1f5290 con 0x7fca9c06d270 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa3acf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c150d60 con 0x7fca9c14d1d0 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c156c40 0x7fca9c15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c156c40 0x7fca9c15bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57556/0 (socket says 172.21.15.53:57556) 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 -- 172.21.15.53:0/1973993536 learned_addr learned my addr 172.21.15.53:0/1973993536 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa206c640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c14d1d0 0x7fca9c0cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa186b640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c06d270 0x7fca9c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 -- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c14d1d0 msgr2=0x7fca9c0cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c14d1d0 0x7fca9c0cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 -- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c06d270 msgr2=0x7fca9c14bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c06d270 0x7fca9c14bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 -- 172.21.15.53:0/1973993536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0094d0 con 0x7fca9c156c40 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.271+0000 7fcaa106a640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c156c40 0x7fca9c15bf70 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fca8c01a8e0 tx=0x7fca8c018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fca927fc640 1 -- 172.21.15.53:0/1973993536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0b4420 con 0x7fca9c156c40 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fca927fc640 1 -- 172.21.15.53:0/1973993536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c0b4580 con 0x7fca9c156c40 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c151000 con 0x7fca9c156c40 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fca927fc640 1 -- 172.21.15.53:0/1973993536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0b48f0 con 0x7fca9c156c40 2024-09-13T18:34:38.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c15c8c0 con 0x7fca9c156c40 2024-09-13T18:34:38.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c151800 con 0x7fca9c156c40 2024-09-13T18:34:38.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fca927fc640 1 -- 172.21.15.53:0/1973993536 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fca8c0b2070 con 0x7fca9c156c40 2024-09-13T18:34:38.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fca927fc640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fca80067020 0x7fca800694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fca927fc640 1 -- 172.21.15.53:0/1973993536 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca8c11c2d0 con 0x7fca9c156c40 2024-09-13T18:34:38.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fcaa186b640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fca80067020 0x7fca800694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.275+0000 7fcaa186b640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fca80067020 0x7fca800694e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fca98009a70 tx=0x7fca98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.279+0000 7fca927fc640 1 -- 172.21.15.53:0/1973993536 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca8c0eaf80 con 0x7fca9c156c40 2024-09-13T18:34:38.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.431+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fca9c152c60 con 0x7fca9c156c40 2024-09-13T18:34:38.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.439+0000 7fca927fc640 1 -- 172.21.15.53:0/1973993536 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca8c0ba0c0 con 0x7fca9c156c40 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fca80067020 msgr2=0x7fca800694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fca80067020 0x7fca800694e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fca98009a70 tx=0x7fca98008040 comp rx=0 tx=0).stop 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c156c40 msgr2=0x7fca9c15bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c156c40 0x7fca9c15bf70 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fca8c01a8e0 tx=0x7fca8c018fd0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 shutdown_connections 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fca80067020 0x7fca800694e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fca9c14d1d0 0x7fca9c0cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c156c40 0x7fca9c15bf70 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 --2- 172.21.15.53:0/1973993536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca9c06d270 0x7fca9c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.447 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 >> 172.21.15.53:0/1973993536 conn(0x7fca9c065c80 msgr2=0x7fca9c0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:38.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 shutdown_connections 2024-09-13T18:34:38.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.443+0000 7fcaa3acf640 1 -- 172.21.15.53:0/1973993536 wait complete. 2024-09-13T18:34:38.462 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:34:38.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:34:38.530 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:34:38.614 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:34:38.614 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:34:38.615 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:38.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:34:38.621 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:34:38.621 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:38.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:34:38.628 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:34:38.628 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:38.670 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:34:38.671 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:34:38.671 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:34:38.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:34:38.678 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:34:38.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:38.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72f31f640 1 Processor -- start 2024-09-13T18:34:38.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72f31f640 1 -- start start 2024-09-13T18:34:38.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72f31f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd7280cf7d0 0x7fd7280b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72f31f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280d2400 con 0x7fd7280d19c0 2024-09-13T18:34:38.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72f31f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280d1530 con 0x7fd72815cab0 2024-09-13T18:34:38.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72f31f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7280cddd0 con 0x7fd7280cf7d0 2024-09-13T18:34:38.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd7280d19c0 0x7fd7280cf0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40900/0 (socket says 172.21.15.53:40900) 2024-09-13T18:34:38.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 -- 172.21.15.53:0/1849916751 learned_addr learned my addr 172.21.15.53:0/1849916751 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:38.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72d8bc640 1 --2- 172.21.15.53:0/1849916751 >> v2:172.21.15.87:3300/0 conn(0x7fd7280cf7d0 0x7fd7280b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358876364 0 0) 0x7fd7280d2400 con 0x7fd7280d19c0 2024-09-13T18:34:38.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd714003530 con 0x7fd7280d19c0 2024-09-13T18:34:38.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 145220926 0 0) 0x7fd714003530 con 0x7fd7280d19c0 2024-09-13T18:34:38.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 >> v2:172.21.15.87:3300/0 conn(0x7fd7280cf7d0 msgr2=0x7fd7280b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:38.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 --2- 172.21.15.53:0/1849916751 >> v2:172.21.15.87:3300/0 conn(0x7fd7280cf7d0 0x7fd7280b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 >> v1:172.21.15.87:6789/0 conn(0x7fd72815cab0 legacy=0x7fd7280cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7280d1e30 con 0x7fd7280d19c0 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd718001680 con 0x7fd7280d19c0 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 >> v1:172.21.15.53:6789/0 conn(0x7fd7280d19c0 legacy=0x7fd7280cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd714003980 0x7fd714003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140047d0 0x7fd714004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd714005190 0x7fd71400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7280cddd0 con 0x7fd7140047d0 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71400c030 con 0x7fd714003980 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71400c1f0 con 0x7fd714005190 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140047d0 0x7fd714004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72d0bb640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd714003980 0x7fd714003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72d8bc640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd714005190 0x7fd71400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 -- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd714005190 msgr2=0x7fd71400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:38.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd714005190 0x7fd71400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 -- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd714003980 msgr2=0x7fd714003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:38.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd714003980 0x7fd714003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72c8ba640 1 -- 172.21.15.53:0/1849916751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd714003530 con 0x7fd7140047d0 2024-09-13T18:34:38.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.839+0000 7fd72d8bc640 1 -- 172.21.15.53:0/1849916751 reap_dead start 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72c8ba640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140047d0 0x7fd714004c50 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c240 tx=0x7fd71801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807d591548d3ce69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718005ae0 con 0x7fd7140047d0 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7180ab070 con 0x7fd7140047d0 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd71ffff640 1 -- 172.21.15.53:0/1849916751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718005ea0 con 0x7fd7140047d0 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72f31f640 1 -- 172.21.15.53:0/1849916751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140047d0 msgr2=0x7fd714004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72f31f640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140047d0 0x7fd714004c50 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c240 tx=0x7fd71801f350 comp rx=0 tx=0).stop 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72f31f640 1 -- 172.21.15.53:0/1849916751 shutdown_connections 2024-09-13T18:34:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72f31f640 1 --2- 172.21.15.53:0/1849916751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140047d0 0x7fd714004c50 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72f31f640 1 -- 172.21.15.53:0/1849916751 >> 172.21.15.53:0/1849916751 conn(0x7fd728065c80 msgr2=0x7fd728066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72f31f640 1 -- 172.21.15.53:0/1849916751 shutdown_connections 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.843+0000 7fd72f31f640 1 -- 172.21.15.53:0/1849916751 wait complete. 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 Processor -- start 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 -- start start 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7140047d0 0x7fd72814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72814de40 0x7fd72814e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72814bdb0 0x7fd72814c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72814e800 con 0x7fd72814de40 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7280cc4a0 con 0x7fd72814bdb0 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72814c770 con 0x7fd7140047d0 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72814de40 0x7fd72814e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72814de40 0x7fd72814e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57578/0 (socket says 172.21.15.53:57578) 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 -- 172.21.15.53:0/2876048034 learned_addr learned my addr 172.21.15.53:0/2876048034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72d0bb640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7140047d0 0x7fd72814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72d8bc640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72814bdb0 0x7fd72814c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 -- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7140047d0 msgr2=0x7fd72814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7140047d0 0x7fd72814b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 -- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72814bdb0 msgr2=0x7fd72814c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72814bdb0 0x7fd72814c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 -- 172.21.15.53:0/2876048034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72814ca00 con 0x7fd72814de40 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72d8bc640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72814bdb0 0x7fd72814c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72c8ba640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72814de40 0x7fd72814e2c0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fd718001940 tx=0x7fd714005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd71dffb640 1 -- 172.21.15.53:0/2876048034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718001680 con 0x7fd72814de40 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd71dffb640 1 -- 172.21.15.53:0/2876048034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718007070 con 0x7fd72814de40 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72814cce0 con 0x7fd72814de40 2024-09-13T18:34:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd71dffb640 1 -- 172.21.15.53:0/2876048034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718007400 con 0x7fd72814de40 2024-09-13T18:34:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72814d2a0 con 0x7fd72814de40 2024-09-13T18:34:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7280d05b0 con 0x7fd72814de40 2024-09-13T18:34:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd71dffb640 1 -- 172.21.15.53:0/2876048034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fd7180b9030 con 0x7fd72814de40 2024-09-13T18:34:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd71dffb640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd70c067020 0x7fd70c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.847+0000 7fd71dffb640 1 -- 172.21.15.53:0/2876048034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd7180b7070 con 0x7fd72814de40 2024-09-13T18:34:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.851+0000 7fd72d0bb640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd70c067020 0x7fd70c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.851+0000 7fd72d0bb640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd70c067020 0x7fd70c0694e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd724000c10 tx=0x7fd724009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:38.851+0000 7fd71dffb640 1 -- 172.21.15.53:0/2876048034 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7180eeac0 con 0x7fd72814de40 2024-09-13T18:34:39.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7280b78a0 con 0x7fd72814de40 2024-09-13T18:34:39.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd71dffb640 1 -- 172.21.15.53:0/2876048034 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+3531 (secure 0 0 0) 0x7fd7180c1020 con 0x7fd72814de40 2024-09-13T18:34:39.050 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:39.051 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":99,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3371404154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3371404154},{"type":"v1","addr":"172.21.15.87:6833","nonce":3371404154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8665,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/1374144604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":1374144604},{"type":"v1","addr":"172.21.15.87:6835","nonce":1374144604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10020,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/2656917860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2656917860},{"type":"v1","addr":"172.21.15.53:6834","nonce":2656917860}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3756423154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":3756423154},{"type":"v1","addr":"172.21.15.53:6835","nonce":3756423154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[]} 2024-09-13T18:34:39.051 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 99 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd70c067020 msgr2=0x7fd70c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd70c067020 0x7fd70c0694e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd724000c10 tx=0x7fd724009040 comp rx=0 tx=0).stop 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72814de40 msgr2=0x7fd72814e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72814de40 0x7fd72814e2c0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fd718001940 tx=0x7fd714005800 comp rx=0 tx=0).stop 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 shutdown_connections 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd70c067020 0x7fd70c0694e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd72814bdb0 0x7fd72814c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd72814de40 0x7fd72814e2c0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 --2- 172.21.15.53:0/2876048034 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd7140047d0 0x7fd72814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.047+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 >> 172.21.15.53:0/2876048034 conn(0x7fd728065c80 msgr2=0x7fd7280cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.051+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 shutdown_connections 2024-09-13T18:34:39.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.051+0000 7fd72f31f640 1 -- 172.21.15.53:0/2876048034 wait complete. 2024-09-13T18:34:39.070 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:34:39.070 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:34:39.070 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:34:39.070 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:34:39.070 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:34:39.070 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:34:39.071 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:34:39.071 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:34:39.071 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:34:39.071 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:34:39.071 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:34:39.071 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:34:39.071 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:34:39.071 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:34:39.072 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:34:39.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:34:39.079 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:34:39.080 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:34:39.081 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:34:39.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:34:39.087 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:34:39.087 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:34:39.092 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:34:39.092 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:34:39.130 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:34:39.130 DEBUG:teuthology.parallel:result is None 2024-09-13T18:34:39.131 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:34:39.131 DEBUG:teuthology.parallel:result is None 2024-09-13T18:34:39.137 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:34:39.138 DEBUG:teuthology.parallel:result is None 2024-09-13T18:34:39.139 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:34:39.139 DEBUG:teuthology.parallel:result is None 2024-09-13T18:34:39.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:34:39.195 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2024-09-13T18:34:39.197 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:34:39.207 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-09-13T18:34:39.212 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-09-13T18:34:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f914ad24640 1 Processor -- start 2024-09-13T18:34:39.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f914ad24640 1 -- start start 2024-09-13T18:34:39.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f914ad24640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f914415db40 0x7f91440afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f914ad24640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91440b1960 0x7f91440b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f914ad24640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91440ad530 con 0x7f91440b07f0 2024-09-13T18:34:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f914ad24640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440ae1b0 con 0x7f91440b1960 2024-09-13T18:34:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f914ad24640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91440b0c20 con 0x7f914415db40 2024-09-13T18:34:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f913bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91440b1960 0x7f91440b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f91492c1640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f91440b07f0 0x7f91440ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:59172/0 (socket says 172.21.15.53:59172) 2024-09-13T18:34:39.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f9148ac0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f914415db40 0x7f91440afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f91492c1640 1 -- 172.21.15.53:0/231550511 learned_addr learned my addr 172.21.15.53:0/231550511 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:39.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f913b7fe640 1 -- 172.21.15.53:0/231550511 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910681458 0 0) 0x7f91440ad530 con 0x7f91440b07f0 2024-09-13T18:34:39.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f913b7fe640 1 -- 172.21.15.53:0/231550511 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f912c003530 con 0x7f91440b07f0 2024-09-13T18:34:39.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f913bfff640 1 -- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f914415db40 msgr2=0x7f91440afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:39.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f913bfff640 1 --2- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f914415db40 0x7f91440afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f913bfff640 1 -- 172.21.15.53:0/231550511 >> v1:172.21.15.87:6789/0 conn(0x7f91440b07f0 legacy=0x7f91440ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f913bfff640 1 -- 172.21.15.53:0/231550511 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440ad810 con 0x7f91440b1960 2024-09-13T18:34:39.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.247+0000 7f9148ac0640 1 --2- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f914415db40 0x7f91440afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:39.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f913bfff640 1 --2- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91440b1960 0x7f91440b02b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f91340097c0 tx=0x7f913401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed3596697d793c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f913b7fe640 1 -- 172.21.15.53:0/231550511 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340ac640 con 0x7f91440b1960 2024-09-13T18:34:39.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f913b7fe640 1 -- 172.21.15.53:0/231550511 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91340ac7a0 con 0x7f91440b1960 2024-09-13T18:34:39.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f913b7fe640 1 -- 172.21.15.53:0/231550511 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340acb10 con 0x7f91440b1960 2024-09-13T18:34:39.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91440b1960 msgr2=0x7f91440b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.259 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91440b1960 0x7f91440b02b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f91340097c0 tx=0x7f913401c3e0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- 172.21.15.53:0/231550511 shutdown_connections 2024-09-13T18:34:39.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91440b1960 0x7f91440b02b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/231550511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f914415db40 0x7f91440afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- 172.21.15.53:0/231550511 >> 172.21.15.53:0/231550511 conn(0x7f91440b20d0 msgr2=0x7f91440b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- 172.21.15.53:0/231550511 shutdown_connections 2024-09-13T18:34:39.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- 172.21.15.53:0/231550511 wait complete. 2024-09-13T18:34:39.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 Processor -- start 2024-09-13T18:34:39.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- start start 2024-09-13T18:34:39.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91440b07f0 0x7f91441f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91440b1960 0x7f914406b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f914415db40 0x7f9144157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914406be90 con 0x7f91440b07f0 2024-09-13T18:34:39.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144155300 con 0x7f914415db40 2024-09-13T18:34:39.266 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f914ad24640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914406a960 con 0x7f91440b1960 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91440b07f0 0x7f91441f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91440b07f0 0x7f91441f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57610/0 (socket says 172.21.15.53:57610) 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 -- 172.21.15.53:0/3534136176 learned_addr learned my addr 172.21.15.53:0/3534136176 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f91492c1640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f914415db40 0x7f9144157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f913bfff640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91440b1960 0x7f914406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 -- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91440b1960 msgr2=0x7f914406b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91440b1960 0x7f914406b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 -- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f914415db40 msgr2=0x7f9144157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f914415db40 0x7f9144157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 -- 172.21.15.53:0/3534136176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140009420 con 0x7f91440b07f0 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.251+0000 7f9148ac0640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91440b07f0 0x7f91441f4d20 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f914000e980 tx=0x7f914000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f91397fa640 1 -- 172.21.15.53:0/3534136176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914000c9a0 con 0x7f91440b07f0 2024-09-13T18:34:39.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f91397fa640 1 -- 172.21.15.53:0/3534136176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914000cb00 con 0x7f91440b07f0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9134009420 con 0x7f91440b07f0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f91397fa640 1 -- 172.21.15.53:0/3534136176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914000ce90 con 0x7f91440b07f0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914406af20 con 0x7f91440b07f0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144073a10 con 0x7f91440b07f0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f91397fa640 1 -- 172.21.15.53:0/3534136176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f9140013470 con 0x7f91440b07f0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f91397fa640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9130067050 0x7f9130069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f91397fa640 1 -- 172.21.15.53:0/3534136176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f91400831f0 con 0x7f91440b07f0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f913bfff640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9130067050 0x7f9130069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.255+0000 7f913bfff640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9130067050 0x7f9130069510 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f91340ae000 tx=0x7f91340a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.259+0000 7f91397fa640 1 -- 172.21.15.53:0/3534136176 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9140051e10 con 0x7f91440b07f0 2024-09-13T18:34:39.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:39.423+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f91440ce2c0 con 0x7f91440b07f0 2024-09-13T18:34:40.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.247+0000 7f91397fa640 1 -- 172.21.15.53:0/3534136176 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v170) v1 ==== 97+0+0 (secure 0 0 0) 0x7f91440ce2c0 con 0x7f91440b07f0 2024-09-13T18:34:40.251 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2024-09-13T18:34:40.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9130067050 msgr2=0x7f9130069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9130067050 0x7f9130069510 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f91340ae000 tx=0x7f91340a7000 comp rx=0 tx=0).stop 2024-09-13T18:34:40.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91440b07f0 msgr2=0x7f91441f4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91440b07f0 0x7f91441f4d20 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f914000e980 tx=0x7f914000ee40 comp rx=0 tx=0).stop 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 shutdown_connections 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9130067050 0x7f9130069510 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91440b1960 0x7f914406b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f914415db40 0x7f9144157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 --2- 172.21.15.53:0/3534136176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f91440b07f0 0x7f91441f4d20 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 >> 172.21.15.53:0/3534136176 conn(0x7f91440b20d0 msgr2=0x7f91440d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 shutdown_connections 2024-09-13T18:34:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.251+0000 7f914ad24640 1 -- 172.21.15.53:0/3534136176 wait complete. 2024-09-13T18:34:40.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:34:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.391+0000 7f9246586640 1 Processor -- start 2024-09-13T18:34:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.391+0000 7f9246586640 1 -- start start 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9246586640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f92400cb980 0x7f92400b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9246586640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f92400cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9246586640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92400b1ac0 con 0x7f924006b850 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9246586640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400b3010 con 0x7f92400cb980 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9246586640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9240159ac0 con 0x7f92400cbd60 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9244b23640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f92400cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f923ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f92400cb980 0x7f92400b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9244b23640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f92400cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:56152/0 (socket says 172.21.15.53:56152) 2024-09-13T18:34:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9244b23640 1 -- 172.21.15.53:0/1960080080 learned_addr learned my addr 172.21.15.53:0/1960080080 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f923f7fe640 1 --1- 172.21.15.53:0/1960080080 >> v1:172.21.15.87:6789/0 conn(0x7f924006b850 0x7f924006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:59182/0 (socket says 172.21.15.53:59182) 2024-09-13T18:34:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f923ffff640 1 -- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 msgr2=0x7f92400cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f923ffff640 1 --2- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f92400cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f923ffff640 1 -- 172.21.15.53:0/1960080080 >> v1:172.21.15.87:6789/0 conn(0x7f924006b850 legacy=0x7f924006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f923ffff640 1 -- 172.21.15.53:0/1960080080 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240159da0 con 0x7f92400cb980 2024-09-13T18:34:40.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.395+0000 7f9244b23640 1 --2- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f92400cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f923ffff640 1 --2- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92400cb980 0x7f92400b33b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f92300097c0 tx=0x7f923001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af35fd88465ae3df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f923effd640 1 -- 172.21.15.53:0/1960080080 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300ac640 con 0x7f92400cb980 2024-09-13T18:34:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f923effd640 1 -- 172.21.15.53:0/1960080080 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300ac7a0 con 0x7f92400cb980 2024-09-13T18:34:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f923effd640 1 -- 172.21.15.53:0/1960080080 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300acb30 con 0x7f92400cb980 2024-09-13T18:34:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92400cb980 msgr2=0x7f92400b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 --2- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92400cb980 0x7f92400b33b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f92300097c0 tx=0x7f923001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- 172.21.15.53:0/1960080080 shutdown_connections 2024-09-13T18:34:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 --2- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f92400cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 --2- 172.21.15.53:0/1960080080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92400cb980 0x7f92400b33b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- 172.21.15.53:0/1960080080 >> 172.21.15.53:0/1960080080 conn(0x7f9240065c80 msgr2=0x7f9240066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- 172.21.15.53:0/1960080080 shutdown_connections 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- 172.21.15.53:0/1960080080 wait complete. 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 Processor -- start 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- start start 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f924006b850 0x7f9240147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92400cb980 0x7f9240158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f924014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240148ae0 con 0x7f92400cb980 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240147860 con 0x7f924006b850 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f9246586640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924014c6f0 con 0x7f92400cbd60 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.399+0000 7f923ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f924006b850 0x7f9240147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f9244b23640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f924014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92400cb980 0x7f9240158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f924006b850 0x7f9240147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.53:40504/0 (socket says 172.21.15.53:40504) 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923ffff640 1 -- 172.21.15.53:0/1761824113 learned_addr learned my addr 172.21.15.53:0/1761824113 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923f7fe640 1 -- 172.21.15.53:0/1761824113 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 msgr2=0x7f924014bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923f7fe640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f924014bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923f7fe640 1 -- 172.21.15.53:0/1761824113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f924006b850 msgr2=0x7f9240147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923f7fe640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f924006b850 0x7f9240147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923f7fe640 1 -- 172.21.15.53:0/1761824113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238009b30 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923f7fe640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92400cb980 0x7f9240158b80 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f923400c3c0 tx=0x7f923400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923cff9640 1 -- 172.21.15.53:0/1761824113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92340074e0 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923cff9640 1 -- 172.21.15.53:0/1761824113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234007640 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9230009420 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923cff9640 1 -- 172.21.15.53:0/1761824113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234004a10 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924014ccb0 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9240067400 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923cff9640 1 -- 172.21.15.53:0/1761824113 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f9234004b70 con 0x7f92400cb980 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.403+0000 7f923cff9640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f922c067020 0x7f922c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.407+0000 7f923cff9640 1 -- 172.21.15.53:0/1761824113 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9234082c80 con 0x7f92400cb980 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.407+0000 7f923ffff640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f922c067020 0x7f922c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.407+0000 7f923ffff640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f922c067020 0x7f922c0694e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9230000c10 tx=0x7f9230008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.407+0000 7f923cff9640 1 -- 172.21.15.53:0/1761824113 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92340518b0 con 0x7f92400cb980 2024-09-13T18:34:40.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.627+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f92400b2ba0 con 0x7f92400cb980 2024-09-13T18:34:40.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.627+0000 7f923cff9640 1 -- 172.21.15.53:0/1761824113 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9234054ed0 con 0x7f92400cb980 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmVNIZGRAAki7P0+Q3vD+Yw2YLdfPwsA==", 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:34:40.632 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmxmqnJxAAzrQ02D5t4lw9MTolvncyRw==", 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.633 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4Y+qIRAAxihJNeDK29tYi9FbXeDlqA==", 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmKLwFMBAAgqs5LXBUinKFKHJElgTGqg==", 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.634 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+g+Rmd3qlERAA5cUaNL37YQcsmWvCUodJsg==", 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.635 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBBg+RmNz8fFxAAYWivJJ6iOdobpqqr42GOtw==", 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2024-09-13T18:34:40.636 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBEg+RmWCkMHhAADi2hX80TBVKkTmcLl2ACXg==", 2024-09-13T18:34:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.637 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2024-09-13T18:34:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBHg+RmnqG7JBAAePyuqst6HNOZ3+Kl8CgBzA==", 2024-09-13T18:34:40.638 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBNg+RmeoxZJxAA1byOK4J/JqvSroBuiwxbqg==", 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.639 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBQg+RmSs/oLBAA1W/kfOK7OveQm2xIGbZxXA==", 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2024-09-13T18:34:40.640 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBTg+RmqzgvMxAAiRfwsufUVzEK3m/e+nNb5Q==", 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBWg+RmqB1DOhAATHiP3E61K45eD4YOELqtXg==", 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2024-09-13T18:34:40.641 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmqhA6NhAA18IzBESbR46U/ZMw1Cdh2A==", 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2024-09-13T18:34:40.642 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm0pxeAhAA2d+zmrOuvwP8CIp/AEaU/Q==", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmPzJtOxAAwrHXC1Qhxak1YH65XdJL0A==", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:34:40.643 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA9g+Rm3LdHBxAA0ymTUaJG9Pz+onm4FfCe+A==", 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.644 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmWbibARAAMe3onFsLS2kQEFuRLVlMpw==", 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+RmrbOFFRAA478dNF1H+yV+TQTsLcIflw==", 2024-09-13T18:34:40.645 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:34:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:34:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:40.646 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA8g+Rm4jrrEhAA4dktfJbU1o8W9QTmnqu9rw==", 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-13T18:34:40.647 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:34:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f922c067020 msgr2=0x7f922c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f922c067020 0x7f922c0694e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9230000c10 tx=0x7f9230008040 comp rx=0 tx=0).stop 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92400cb980 msgr2=0x7f9240158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92400cb980 0x7f9240158b80 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f923400c3c0 tx=0x7f923400c880 comp rx=0 tx=0).stop 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 shutdown_connections 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f922c067020 0x7f922c0694e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92400cbd60 0x7f924014bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92400cb980 0x7f9240158b80 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 --2- 172.21.15.53:0/1761824113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f924006b850 0x7f9240147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 >> 172.21.15.53:0/1761824113 conn(0x7f9240065c80 msgr2=0x7f924006c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 shutdown_connections 2024-09-13T18:34:40.649 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.631+0000 7f9246586640 1 -- 172.21.15.53:0/1761824113 wait complete. 2024-09-13T18:34:40.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.767+0000 7fcd671a2640 1 Processor -- start 2024-09-13T18:34:40.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.767+0000 7fcd671a2640 1 -- start start 2024-09-13T18:34:40.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd600b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd600cbd60 0x7fcd600cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd600b1ac0 con 0x7fcd6006b850 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600b3010 con 0x7fcd600cbd60 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60159ac0 con 0x7fcd600cb980 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd600cbd60 0x7fcd600cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd600cbd60 0x7fcd600cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57634/0 (socket says 172.21.15.53:57634) 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 -- 172.21.15.53:0/289092620 learned_addr learned my addr 172.21.15.53:0/289092620 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd64f3e640 1 --2- 172.21.15.53:0/289092620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd600b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 -- 172.21.15.53:0/289092620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 msgr2=0x7fcd600b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 --2- 172.21.15.53:0/289092620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd600b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 -- 172.21.15.53:0/289092620 >> v1:172.21.15.87:6789/0 conn(0x7fcd6006b850 legacy=0x7fcd6006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:40.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 -- 172.21.15.53:0/289092620 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60159da0 con 0x7fcd600cbd60 2024-09-13T18:34:40.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd6573f640 1 --2- 172.21.15.53:0/289092620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600cbd60 0x7fcd600cdd40 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009e80 tx=0x7fcd5001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8c617c3678596e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd5f7fe640 1 -- 172.21.15.53:0/289092620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500a5790 con 0x7fcd600cbd60 2024-09-13T18:34:40.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd5f7fe640 1 -- 172.21.15.53:0/289092620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500a58f0 con 0x7fcd600cbd60 2024-09-13T18:34:40.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd5f7fe640 1 -- 172.21.15.53:0/289092620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500a5c80 con 0x7fcd600cbd60 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- 172.21.15.53:0/289092620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600cbd60 msgr2=0x7fcd600cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 --2- 172.21.15.53:0/289092620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600cbd60 0x7fcd600cdd40 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009e80 tx=0x7fcd5001c910 comp rx=0 tx=0).stop 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- 172.21.15.53:0/289092620 shutdown_connections 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 --2- 172.21.15.53:0/289092620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd600cbd60 0x7fcd600cdd40 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 --2- 172.21.15.53:0/289092620 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd600b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- 172.21.15.53:0/289092620 >> 172.21.15.53:0/289092620 conn(0x7fcd60065c80 msgr2=0x7fcd60066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- 172.21.15.53:0/289092620 shutdown_connections 2024-09-13T18:34:40.777 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.771+0000 7fcd671a2640 1 -- 172.21.15.53:0/289092620 wait complete. 2024-09-13T18:34:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 Processor -- start 2024-09-13T18:34:40.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 -- start start 2024-09-13T18:34:40.779 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd6006b850 0x7fcd601f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd601536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd600cbd60 0x7fcd6014c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60149be0 con 0x7fcd6006b850 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd601528f0 con 0x7fcd600cbd60 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60152bd0 con 0x7fcd600cb980 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd6006b850 0x7fcd601f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd6006b850 0x7fcd601f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57644/0 (socket says 172.21.15.53:57644) 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 -- 172.21.15.53:0/4225491409 learned_addr learned my addr 172.21.15.53:0/4225491409 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd5ffff640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd601536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd6573f640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd600cbd60 0x7fcd6014c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 -- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 msgr2=0x7fcd601536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd601536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.780 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 -- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd600cbd60 msgr2=0x7fcd6014c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd600cbd60 0x7fcd6014c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 -- 172.21.15.53:0/4225491409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009b30 con 0x7fcd6006b850 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd6573f640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd600cbd60 0x7fcd6014c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd64f3e640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd6006b850 0x7fcd601f3160 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800d800 tx=0x7fcd5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd5d7fa640 1 -- 172.21.15.53:0/4225491409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800b6c0 con 0x7fcd6006b850 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd5d7fa640 1 -- 172.21.15.53:0/4225491409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5800b820 con 0x7fcd6006b850 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd60152eb0 con 0x7fcd6006b850 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd5d7fa640 1 -- 172.21.15.53:0/4225491409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800bb90 con 0x7fcd6006b850 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd60152530 con 0x7fcd6006b850 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.775+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60067400 con 0x7fcd6006b850 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.779+0000 7fcd5d7fa640 1 -- 172.21.15.53:0/4225491409 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fcd5800bcf0 con 0x7fcd6006b850 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.779+0000 7fcd5d7fa640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd4c067050 0x7fcd4c069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.779+0000 7fcd5d7fa640 1 -- 172.21.15.53:0/4225491409 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd58083240 con 0x7fcd6006b850 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.779+0000 7fcd5ffff640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd4c067050 0x7fcd4c069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.779+0000 7fcd5ffff640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd4c067050 0x7fcd4c069510 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcd60153f90 tx=0x7fcd54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.785 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.783+0000 7fcd5d7fa640 1 -- 172.21.15.53:0/4225491409 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd58051e00 con 0x7fcd6006b850 2024-09-13T18:34:40.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.935+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd600b2bf0 con 0x7fcd6006b850 2024-09-13T18:34:40.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.935+0000 7fcd5d7fa640 1 -- 172.21.15.53:0/4225491409 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+12807 (secure 0 0 0) 0x7fcd58055420 con 0x7fcd6006b850 2024-09-13T18:34:40.941 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:40.941 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":170,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:40.247040+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd4c067050 msgr2=0x7fcd4c069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd4c067050 0x7fcd4c069510 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcd60153f90 tx=0x7fcd54008040 comp rx=0 tx=0).stop 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd6006b850 msgr2=0x7fcd601f3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd6006b850 0x7fcd601f3160 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800d800 tx=0x7fcd5800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 shutdown_connections 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fcd4c067050 0x7fcd4c069510 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcd600cb980 0x7fcd601536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcd600cbd60 0x7fcd6014c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 --2- 172.21.15.53:0/4225491409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd6006b850 0x7fcd601f3160 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 >> 172.21.15.53:0/4225491409 conn(0x7fcd60065c80 msgr2=0x7fcd600adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 shutdown_connections 2024-09-13T18:34:40.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:40.939+0000 7fcd671a2640 1 -- 172.21.15.53:0/4225491409 wait complete. 2024-09-13T18:34:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:34:40.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:34:41.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8bfaf640 1 Processor -- start 2024-09-13T18:34:41.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8bfaf640 1 -- start start 2024-09-13T18:34:41.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8bfaf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe8415c830 0x7fbe840d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8bfaf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe840ccd10 0x7fbe840cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8bfaf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840b7db0 con 0x7fbe840d2c80 2024-09-13T18:34:41.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8bfaf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe840d0650 con 0x7fbe840ccd10 2024-09-13T18:34:41.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8bfaf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840d0c10 con 0x7fbe8415c830 2024-09-13T18:34:41.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8954a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe840ccd10 0x7fbe840cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8954a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbe840ccd10 0x7fbe840cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57648/0 (socket says 172.21.15.53:57648) 2024-09-13T18:34:41.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8954a640 1 -- 172.21.15.53:0/495115624 learned_addr learned my addr 172.21.15.53:0/495115624 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:41.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe89d4b640 1 --2- 172.21.15.53:0/495115624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe8415c830 0x7fbe840d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8954a640 1 -- 172.21.15.53:0/495115624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe8415c830 msgr2=0x7fbe840d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:41.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8954a640 1 --2- 172.21.15.53:0/495115624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe8415c830 0x7fbe840d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8954a640 1 -- 172.21.15.53:0/495115624 >> v1:172.21.15.87:6789/0 conn(0x7fbe840d2c80 legacy=0x7fbe840b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.083+0000 7fbe8954a640 1 -- 172.21.15.53:0/495115624 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840cd7d0 con 0x7fbe840ccd10 2024-09-13T18:34:41.089 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8954a640 1 --2- 172.21.15.53:0/495115624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840ccd10 0x7fbe840cd150 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009870 tx=0x7fbe7401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1fa8110829011e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe88d49640 1 -- 172.21.15.53:0/495115624 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740ad660 con 0x7fbe840ccd10 2024-09-13T18:34:41.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe88d49640 1 -- 172.21.15.53:0/495115624 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740ad7c0 con 0x7fbe840ccd10 2024-09-13T18:34:41.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe88d49640 1 -- 172.21.15.53:0/495115624 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740adb50 con 0x7fbe840ccd10 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/495115624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840ccd10 msgr2=0x7fbe840cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/495115624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840ccd10 0x7fbe840cd150 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009870 tx=0x7fbe7401c560 comp rx=0 tx=0).stop 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/495115624 shutdown_connections 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/495115624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840ccd10 0x7fbe840cd150 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/495115624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe8415c830 0x7fbe840d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/495115624 >> 172.21.15.53:0/495115624 conn(0x7fbe84070970 msgr2=0x7fbe84070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/495115624 shutdown_connections 2024-09-13T18:34:41.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/495115624 wait complete. 2024-09-13T18:34:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 Processor -- start 2024-09-13T18:34:41.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.087+0000 7fbe8bfaf640 1 -- start start 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe840ccd10 0x7fbe8414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840d2c80 0x7fbe84158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe8415c830 0x7fbe84158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415e410 con 0x7fbe840d2c80 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840ca490 con 0x7fbe8415c830 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8415e660 con 0x7fbe840ccd10 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840d2c80 0x7fbe84158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840d2c80 0x7fbe84158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57660/0 (socket says 172.21.15.53:57660) 2024-09-13T18:34:41.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 -- 172.21.15.53:0/86461356 learned_addr learned my addr 172.21.15.53:0/86461356 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe89d4b640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe840ccd10 0x7fbe8414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8a54c640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe8415c830 0x7fbe84158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 -- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe840ccd10 msgr2=0x7fbe8414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe840ccd10 0x7fbe8414dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 -- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe8415c830 msgr2=0x7fbe84158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe8415c830 0x7fbe84158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 -- 172.21.15.53:0/86461356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740094d0 con 0x7fbe840d2c80 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8954a640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840d2c80 0x7fbe84158110 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fbe740b0040 tx=0x7fbe7401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe7a7fc640 1 -- 172.21.15.53:0/86461356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740b8830 con 0x7fbe840d2c80 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe7a7fc640 1 -- 172.21.15.53:0/86461356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740b8990 con 0x7fbe840d2c80 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8415e940 con 0x7fbe840d2c80 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe7a7fc640 1 -- 172.21.15.53:0/86461356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740b8d20 con 0x7fbe840d2c80 2024-09-13T18:34:41.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8415ef00 con 0x7fbe840d2c80 2024-09-13T18:34:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe840ca2f0 con 0x7fbe840d2c80 2024-09-13T18:34:41.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe7a7fc640 1 -- 172.21.15.53:0/86461356 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fbe740b4040 con 0x7fbe840d2c80 2024-09-13T18:34:41.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe7a7fc640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbe68067020 0x7fbe680694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe7a7fc640 1 -- 172.21.15.53:0/86461356 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe7411d260 con 0x7fbe840d2c80 2024-09-13T18:34:41.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe89d4b640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbe68067020 0x7fbe680694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.091+0000 7fbe89d4b640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbe68067020 0x7fbe680694e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbe80003fd0 tx=0x7fbe800039a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.095+0000 7fbe7a7fc640 1 -- 172.21.15.53:0/86461356 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbe840ca2f0 con 0x7fbe840d2c80 2024-09-13T18:34:41.260 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.255+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe840ca2f0 con 0x7fbe840d2c80 2024-09-13T18:34:41.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe7a7fc640 1 -- 172.21.15.53:0/86461356 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe840ca2f0 con 0x7fbe840d2c80 2024-09-13T18:34:41.261 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:34:41.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbe68067020 msgr2=0x7fbe680694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbe68067020 0x7fbe680694e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbe80003fd0 tx=0x7fbe800039a0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840d2c80 msgr2=0x7fbe84158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840d2c80 0x7fbe84158110 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fbe740b0040 tx=0x7fbe7401ada0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 shutdown_connections 2024-09-13T18:34:41.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fbe68067020 0x7fbe680694e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe8415c830 0x7fbe84158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe840d2c80 0x7fbe84158110 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 --2- 172.21.15.53:0/86461356 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe840ccd10 0x7fbe8414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 >> 172.21.15.53:0/86461356 conn(0x7fbe84070970 msgr2=0x7fbe840d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:41.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 shutdown_connections 2024-09-13T18:34:41.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.259+0000 7fbe8bfaf640 1 -- 172.21.15.53:0/86461356 wait complete. 2024-09-13T18:34:41.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:34:41.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.399+0000 7fb9bcc80640 1 Processor -- start 2024-09-13T18:34:41.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9bcc80640 1 -- start start 2024-09-13T18:34:41.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9bcc80640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb9b806b850 0x7fb9b80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9bcc80640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b80b1ac0 con 0x7fb9b80cbd60 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9bcc80640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b8159ac0 con 0x7fb9b80cb980 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9bcc80640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b8159da0 con 0x7fb9b806b850 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb9b80cbd60 0x7fb9b80b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40912/0 (socket says 172.21.15.53:40912) 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/2571810456 learned_addr learned my addr 172.21.15.53:0/2571810456 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b5d9b640 1 --2- 172.21.15.53:0/2571810456 >> v2:172.21.15.87:3300/0 conn(0x7fb9b806b850 0x7fb9b80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671947482 0 0) 0x7fb9b80b1ac0 con 0x7fb9b80cbd60 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a0003530 con 0x7fb9b80cbd60 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1685669708 0 0) 0x7fb9a0003530 con 0x7fb9b80cbd60 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 >> v2:172.21.15.87:3300/0 conn(0x7fb9b806b850 msgr2=0x7fb9b80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 --2- 172.21.15.53:0/2571810456 >> v2:172.21.15.87:3300/0 conn(0x7fb9b806b850 0x7fb9b80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 >> v1:172.21.15.87:6789/0 conn(0x7fb9b80cb980 legacy=0x7fb9b806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b815a080 con 0x7fb9b80cbd60 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fb9b0001a20 con 0x7fb9b80cbd60 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 >> v1:172.21.15.53:6789/0 conn(0x7fb9b80cbd60 legacy=0x7fb9b80b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9a00039d0 0x7fb9a0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00047d0 0x7fb9a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9a00052b0 0x7fb9a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8159da0 con 0x7fb9a00052b0 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a000c1b0 con 0x7fb9a00047d0 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a000c370 con 0x7fb9a00039d0 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9a00052b0 0x7fb9a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b5d9b640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00047d0 0x7fb9a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b659c640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9a00039d0 0x7fb9a0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9a00039d0 msgr2=0x7fb9a0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9a00039d0 0x7fb9a0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00047d0 msgr2=0x7fb9a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00047d0 0x7fb9a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.403+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/2571810456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0003530 con 0x7fb9a00052b0 2024-09-13T18:34:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/2571810456 reap_dead start 2024-09-13T18:34:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9b6d9d640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9a00052b0 0x7fb9a000b990 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000a740 tx=0x7fb9b001d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfdc604a7b03d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00ad630 con 0x7fb9a00052b0 2024-09-13T18:34:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b00a8070 con 0x7fb9a00052b0 2024-09-13T18:34:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9b559a640 1 -- 172.21.15.53:0/2571810456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00ad9d0 con 0x7fb9a00052b0 2024-09-13T18:34:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 -- 172.21.15.53:0/2571810456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9a00052b0 msgr2=0x7fb9a000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9a00052b0 0x7fb9a000b990 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000a740 tx=0x7fb9b001d210 comp rx=0 tx=0).stop 2024-09-13T18:34:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 -- 172.21.15.53:0/2571810456 shutdown_connections 2024-09-13T18:34:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/2571810456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9a00052b0 0x7fb9a000b990 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 -- 172.21.15.53:0/2571810456 >> 172.21.15.53:0/2571810456 conn(0x7fb9b8065c80 msgr2=0x7fb9b8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 -- 172.21.15.53:0/2571810456 shutdown_connections 2024-09-13T18:34:41.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 -- 172.21.15.53:0/2571810456 wait complete. 2024-09-13T18:34:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 Processor -- start 2024-09-13T18:34:41.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 -- start start 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00052b0 0x7fb9b814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.407+0000 7fb9bcc80640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b8149a70 0x7fb9b80ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9bcc80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b8147c50 0x7fb9b814a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9bcc80640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80ad830 con 0x7fb9b8147c50 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9bcc80640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8163e00 con 0x7fb9a00052b0 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9bcc80640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80ac810 con 0x7fb9b8149a70 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b8147c50 0x7fb9b814a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b8147c50 0x7fb9b814a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57666/0 (socket says 172.21.15.53:57666) 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/1496373891 learned_addr learned my addr 172.21.15.53:0/1496373891 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b659c640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00052b0 0x7fb9b814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b5d9b640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b8149a70 0x7fb9b80ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b8149a70 msgr2=0x7fb9b80ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b8149a70 0x7fb9b80ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00052b0 msgr2=0x7fb9b814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00052b0 0x7fb9b814fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 -- 172.21.15.53:0/1496373891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80acaf0 con 0x7fb9b8147c50 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b6d9d640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b8147c50 0x7fb9b814a4a0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fb9b001dab0 tx=0x7fb9a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9a6ffd640 1 -- 172.21.15.53:0/1496373891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0001a20 con 0x7fb9b8147c50 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9a6ffd640 1 -- 172.21.15.53:0/1496373891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b00b3040 con 0x7fb9b8147c50 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b80acdd0 con 0x7fb9b8147c50 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9a6ffd640 1 -- 172.21.15.53:0/1496373891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0004db0 con 0x7fb9b8147c50 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b80ac4c0 con 0x7fb9b8147c50 2024-09-13T18:34:41.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b8067400 con 0x7fb9b8147c50 2024-09-13T18:34:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9a6ffd640 1 -- 172.21.15.53:0/1496373891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fb9b00aa030 con 0x7fb9b8147c50 2024-09-13T18:34:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9a6ffd640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb998067050 0x7fb998069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9a6ffd640 1 -- 172.21.15.53:0/1496373891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9b011c680 con 0x7fb9b8147c50 2024-09-13T18:34:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.411+0000 7fb9b659c640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb998067050 0x7fb998069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.415+0000 7fb9b659c640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb998067050 0x7fb998069510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8005490 tx=0x7fb9a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.415+0000 7fb9a6ffd640 1 -- 172.21.15.53:0/1496373891 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb9b00eb2a0 con 0x7fb9b8147c50 2024-09-13T18:34:41.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.575+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb9b80cdd40 con 0x7fb9b8147c50 2024-09-13T18:34:41.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.575+0000 7fb9a6ffd640 1 -- 172.21.15.53:0/1496373891 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v170) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb9b00ee8c0 con 0x7fb9b8147c50 2024-09-13T18:34:41.580 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:41.581 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:34:41.581 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:41.581 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2024-09-13T18:34:41.581 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2024-09-13T18:34:41.581 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:41.581 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb998067050 msgr2=0x7fb998069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb998067050 0x7fb998069510 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8005490 tx=0x7fb9a8009040 comp rx=0 tx=0).stop 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b8147c50 msgr2=0x7fb9b814a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b8147c50 0x7fb9b814a4a0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fb9b001dab0 tx=0x7fb9a0005800 comp rx=0 tx=0).stop 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 shutdown_connections 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb998067050 0x7fb998069510 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b8149a70 0x7fb9b80ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b8147c50 0x7fb9b814a4a0 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 --2- 172.21.15.53:0/1496373891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9a00052b0 0x7fb9b814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 >> 172.21.15.53:0/1496373891 conn(0x7fb9b8065c80 msgr2=0x7fb9b806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:41.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 shutdown_connections 2024-09-13T18:34:41.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.579+0000 7fb9bcc80640 1 -- 172.21.15.53:0/1496373891 wait complete. 2024-09-13T18:34:41.599 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:34:41.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:34:41.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec738f9640 1 Processor -- start 2024-09-13T18:34:41.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec738f9640 1 -- start start 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec738f9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec6c159580 0x7fec6c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec738f9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c070fd0 0x7fec6c070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec738f9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c06d630 con 0x7fec6c06dac0 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec738f9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c06cd40 con 0x7fec6c159580 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec738f9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c071490 con 0x7fec6c070fd0 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec71695640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec6c159580 0x7fec6c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec71695640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec6c159580 0x7fec6c0b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57678/0 (socket says 172.21.15.53:57678) 2024-09-13T18:34:41.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec71695640 1 -- 172.21.15.53:0/4030352009 learned_addr learned my addr 172.21.15.53:0/4030352009 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:41.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec70e94640 1 --2- 172.21.15.53:0/4030352009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c070fd0 0x7fec6c070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec71695640 1 -- 172.21.15.53:0/4030352009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c070fd0 msgr2=0x7fec6c070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:41.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec71695640 1 --2- 172.21.15.53:0/4030352009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c070fd0 0x7fec6c070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec71695640 1 -- 172.21.15.53:0/4030352009 >> v1:172.21.15.87:6789/0 conn(0x7fec6c06dac0 legacy=0x7fec6c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec71695640 1 -- 172.21.15.53:0/4030352009 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c06cfe0 con 0x7fec6c159580 2024-09-13T18:34:41.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.719+0000 7fec70e94640 1 --2- 172.21.15.53:0/4030352009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c070fd0 0x7fec6c070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:41.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec71695640 1 --2- 172.21.15.53:0/4030352009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c159580 0x7fec6c0b3a60 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fec68009870 tx=0x7fec6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5021bf2e6ec341a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec63fff640 1 -- 172.21.15.53:0/4030352009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680ab600 con 0x7fec6c159580 2024-09-13T18:34:41.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec63fff640 1 -- 172.21.15.53:0/4030352009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680a7050 con 0x7fec6c159580 2024-09-13T18:34:41.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec63fff640 1 -- 172.21.15.53:0/4030352009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680ab980 con 0x7fec6c159580 2024-09-13T18:34:41.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- 172.21.15.53:0/4030352009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c159580 msgr2=0x7fec6c0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 --2- 172.21.15.53:0/4030352009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c159580 0x7fec6c0b3a60 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fec68009870 tx=0x7fec6801c4d0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- 172.21.15.53:0/4030352009 shutdown_connections 2024-09-13T18:34:41.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 --2- 172.21.15.53:0/4030352009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c070fd0 0x7fec6c070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 --2- 172.21.15.53:0/4030352009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c159580 0x7fec6c0b3a60 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- 172.21.15.53:0/4030352009 >> 172.21.15.53:0/4030352009 conn(0x7fec6c0b11a0 msgr2=0x7fec6c0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:41.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- 172.21.15.53:0/4030352009 shutdown_connections 2024-09-13T18:34:41.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- 172.21.15.53:0/4030352009 wait complete. 2024-09-13T18:34:41.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 Processor -- start 2024-09-13T18:34:41.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- start start 2024-09-13T18:34:41.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c06dac0 0x7fec6c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c070fd0 0x7fec6c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c159580 0x7fec6c15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c156dd0 con 0x7fec6c070fd0 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c15e320 con 0x7fec6c06dac0 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec738f9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c156150 con 0x7fec6c159580 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c070fd0 0x7fec6c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c070fd0 0x7fec6c1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57692/0 (socket says 172.21.15.53:57692) 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 -- 172.21.15.53:0/494263340 learned_addr learned my addr 172.21.15.53:0/494263340 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec71e96640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c159580 0x7fec6c15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec71695640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c06dac0 0x7fec6c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 -- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c159580 msgr2=0x7fec6c15dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c159580 0x7fec6c15dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 -- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c06dac0 msgr2=0x7fec6c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c06dac0 0x7fec6c155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec70e94640 1 -- 172.21.15.53:0/494263340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680094d0 con 0x7fec6c070fd0 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.723+0000 7fec71695640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c06dac0 0x7fec6c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec70e94640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c070fd0 0x7fec6c1571f0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00e840 tx=0x7fec5c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec61ffb640 1 -- 172.21.15.53:0/494263340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00c6d0 con 0x7fec6c070fd0 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec61ffb640 1 -- 172.21.15.53:0/494263340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00c830 con 0x7fec6c070fd0 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c156430 con 0x7fec6c070fd0 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec61ffb640 1 -- 172.21.15.53:0/494263340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00cbe0 con 0x7fec6c070fd0 2024-09-13T18:34:41.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c1569f0 con 0x7fec6c070fd0 2024-09-13T18:34:41.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c070380 con 0x7fec6c070fd0 2024-09-13T18:34:41.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec61ffb640 1 -- 172.21.15.53:0/494263340 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fec5c00cd40 con 0x7fec6c070fd0 2024-09-13T18:34:41.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec61ffb640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec50067050 0x7fec50069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:41.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec61ffb640 1 -- 172.21.15.53:0/494263340 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fec5c0828a0 con 0x7fec6c070fd0 2024-09-13T18:34:41.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec71695640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec50067050 0x7fec50069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:41.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.727+0000 7fec71695640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec50067050 0x7fec50069510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec680ad000 tx=0x7fec68008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:41.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.731+0000 7fec61ffb640 1 -- 172.21.15.53:0/494263340 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec5c051570 con 0x7fec6c070fd0 2024-09-13T18:34:41.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:41.883+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fec6c06cb20 con 0x7fec6c070fd0 2024-09-13T18:34:42.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.139+0000 7fec61ffb640 1 -- 172.21.15.53:0/494263340 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v171) v1 ==== 138+0+0 (secure 0 0 0) 0x7fec5c054b90 con 0x7fec6c070fd0 2024-09-13T18:34:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2024-09-13T18:34:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec50067050 msgr2=0x7fec50069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec50067050 0x7fec50069510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec680ad000 tx=0x7fec68008040 comp rx=0 tx=0).stop 2024-09-13T18:34:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c070fd0 msgr2=0x7fec6c1571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c070fd0 0x7fec6c1571f0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00e840 tx=0x7fec5c00ed00 comp rx=0 tx=0).stop 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 shutdown_connections 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fec50067050 0x7fec50069510 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fec6c159580 0x7fec6c15dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec6c070fd0 0x7fec6c1571f0 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 --2- 172.21.15.53:0/494263340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec6c06dac0 0x7fec6c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 >> 172.21.15.53:0/494263340 conn(0x7fec6c0b11a0 msgr2=0x7fec6c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.143+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 shutdown_connections 2024-09-13T18:34:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.147+0000 7fec738f9640 1 -- 172.21.15.53:0/494263340 wait complete. 2024-09-13T18:34:42.172 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:34:42.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3fa55ae640 1 Processor -- start 2024-09-13T18:34:42.302 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3fa55ae640 1 -- start start 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3fa55ae640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fa0070ce0 0x7f3fa0071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3fa55ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fa006b390 0x7f3fa006b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3fa55ae640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa0146180 con 0x7f3fa01457c0 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3fa55ae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa006bd00 con 0x7f3fa006b390 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3fa55ae640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa00702d0 con 0x7f3fa0070ce0 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fa006b390 0x7f3fa006b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fa006b390 0x7f3fa006b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57700/0 (socket says 172.21.15.53:57700) 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9f7fe640 1 -- 172.21.15.53:0/3764498093 learned_addr learned my addr 172.21.15.53:0/3764498093 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:42.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9e7fc640 1 --2- 172.21.15.53:0/3764498093 >> v2:172.21.15.87:3300/0 conn(0x7f3fa0070ce0 0x7f3fa0071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:42.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9f7fe640 1 -- 172.21.15.53:0/3764498093 >> v2:172.21.15.87:3300/0 conn(0x7f3fa0070ce0 msgr2=0x7f3fa0071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:42.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9f7fe640 1 --2- 172.21.15.53:0/3764498093 >> v2:172.21.15.87:3300/0 conn(0x7f3fa0070ce0 0x7f3fa0071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9f7fe640 1 -- 172.21.15.53:0/3764498093 >> v1:172.21.15.87:6789/0 conn(0x7f3fa01457c0 legacy=0x7f3fa00b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:42.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.299+0000 7f3f9f7fe640 1 -- 172.21.15.53:0/3764498093 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa006c4c0 con 0x7f3fa006b390 2024-09-13T18:34:42.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3f9f7fe640 1 --2- 172.21.15.53:0/3764498093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa006b390 0x7f3fa006b7c0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00b31a0 tx=0x7f3f9801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983b39174f57eefd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:42.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3f9dffb640 1 -- 172.21.15.53:0/3764498093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980aa610 con 0x7f3fa006b390 2024-09-13T18:34:42.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3f9dffb640 1 -- 172.21.15.53:0/3764498093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f980a6040 con 0x7f3fa006b390 2024-09-13T18:34:42.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3f9dffb640 1 -- 172.21.15.53:0/3764498093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980aa990 con 0x7f3fa006b390 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 -- 172.21.15.53:0/3764498093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa006b390 msgr2=0x7f3fa006b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/3764498093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa006b390 0x7f3fa006b7c0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00b31a0 tx=0x7f3f9801c4b0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 -- 172.21.15.53:0/3764498093 shutdown_connections 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/3764498093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa006b390 0x7f3fa006b7c0 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/3764498093 >> v2:172.21.15.87:3300/0 conn(0x7f3fa0070ce0 0x7f3fa0071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 -- 172.21.15.53:0/3764498093 >> 172.21.15.53:0/3764498093 conn(0x7f3fa0065c80 msgr2=0x7f3fa0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 -- 172.21.15.53:0/3764498093 shutdown_connections 2024-09-13T18:34:42.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 -- 172.21.15.53:0/3764498093 wait complete. 2024-09-13T18:34:42.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 Processor -- start 2024-09-13T18:34:42.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.303+0000 7f3fa55ae640 1 -- start start 2024-09-13T18:34:42.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fa006b390 0x7f3fa013b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:42.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa0070ce0 0x7f3fa013beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:42.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa01457c0 0x7f3fa013c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:42.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0140d80 con 0x7f3fa0070ce0 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015df20 con 0x7f3fa01457c0 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015e200 con 0x7f3fa006b390 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa0070ce0 0x7f3fa013beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa0070ce0 0x7f3fa013beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57710/0 (socket says 172.21.15.53:57710) 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 -- 172.21.15.53:0/2474319098 learned_addr learned my addr 172.21.15.53:0/2474319098 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9effd640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fa006b390 0x7f3fa013b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9f7fe640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa01457c0 0x7f3fa013c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 -- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fa006b390 msgr2=0x7f3fa013b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fa006b390 0x7f3fa013b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 -- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa01457c0 msgr2=0x7f3fa013c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa01457c0 0x7f3fa013c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 -- 172.21.15.53:0/2474319098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980094d0 con 0x7f3fa0070ce0 2024-09-13T18:34:42.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9e7fc640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa0070ce0 0x7f3fa013beb0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400d800 tx=0x7f3f9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:42.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f877fe640 1 -- 172.21.15.53:0/2474319098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400b6c0 con 0x7f3fa0070ce0 2024-09-13T18:34:42.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f877fe640 1 -- 172.21.15.53:0/2474319098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400b820 con 0x7f3fa0070ce0 2024-09-13T18:34:42.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa015e4e0 con 0x7f3fa0070ce0 2024-09-13T18:34:42.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f877fe640 1 -- 172.21.15.53:0/2474319098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400bb90 con 0x7f3fa0070ce0 2024-09-13T18:34:42.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa013caa0 con 0x7f3fa0070ce0 2024-09-13T18:34:42.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa006b7c0 con 0x7f3fa0070ce0 2024-09-13T18:34:42.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f877fe640 1 -- 172.21.15.53:0/2474319098 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f3f9400bcf0 con 0x7f3fa0070ce0 2024-09-13T18:34:42.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f877fe640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f8c067020 0x7f3f8c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:42.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f877fe640 1 -- 172.21.15.53:0/2474319098 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3f94083260 con 0x7f3fa0070ce0 2024-09-13T18:34:42.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.307+0000 7f3f9effd640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f8c067020 0x7f3f8c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:42.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.311+0000 7f3f9effd640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f8c067020 0x7f3f8c0694e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009f20 tx=0x7f3f900094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:42.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.315+0000 7f3f877fe640 1 -- 172.21.15.53:0/2474319098 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f94051e80 con 0x7f3fa0070ce0 2024-09-13T18:34:42.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:42.467+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3fa015fe50 con 0x7f3fa0070ce0 2024-09-13T18:34:43.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.147+0000 7f3f877fe640 1 -- 172.21.15.53:0/2474319098 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v172) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3f940554a0 con 0x7f3fa0070ce0 2024-09-13T18:34:43.153 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2024-09-13T18:34:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f8c067020 msgr2=0x7f3f8c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f8c067020 0x7f3f8c0694e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009f20 tx=0x7f3f900094d0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa0070ce0 msgr2=0x7f3fa013beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa0070ce0 0x7f3fa013beb0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400d800 tx=0x7f3f9400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 shutdown_connections 2024-09-13T18:34:43.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3f8c067020 0x7f3f8c0694e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fa01457c0 0x7f3fa013c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa0070ce0 0x7f3fa013beb0 secure :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400d800 tx=0x7f3f9400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 --2- 172.21.15.53:0/2474319098 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3fa006b390 0x7f3fa013b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.155+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 >> 172.21.15.53:0/2474319098 conn(0x7f3fa0065c80 msgr2=0x7f3fa00af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:43.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.159+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 shutdown_connections 2024-09-13T18:34:43.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.159+0000 7f3fa55ae640 1 -- 172.21.15.53:0/2474319098 wait complete. 2024-09-13T18:34:43.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:34:43.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef2049f640 1 Processor -- start 2024-09-13T18:34:43.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef2049f640 1 -- start start 2024-09-13T18:34:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef2049f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef18143e80 0x7fef1806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef2049f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef180cda30 0x7fef180cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef2049f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1806f7a0 con 0x7fef180caee0 2024-09-13T18:34:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef2049f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1806fd60 con 0x7fef180cda30 2024-09-13T18:34:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef2049f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180cb960 con 0x7fef18143e80 2024-09-13T18:34:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1ea3c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef180cda30 0x7fef180cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1ea3c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef180cda30 0x7fef180cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57712/0 (socket says 172.21.15.53:57712) 2024-09-13T18:34:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1ea3c640 1 -- 172.21.15.53:0/1448796447 learned_addr learned my addr 172.21.15.53:0/1448796447 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1e23b640 1 --2- 172.21.15.53:0/1448796447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef18143e80 0x7fef1806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1ea3c640 1 -- 172.21.15.53:0/1448796447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef18143e80 msgr2=0x7fef1806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1ea3c640 1 --2- 172.21.15.53:0/1448796447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef18143e80 0x7fef1806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1ea3c640 1 -- 172.21.15.53:0/1448796447 >> v1:172.21.15.87:6789/0 conn(0x7fef180caee0 legacy=0x7fef180cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.315+0000 7fef1ea3c640 1 -- 172.21.15.53:0/1448796447 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180cbc40 con 0x7fef180cda30 2024-09-13T18:34:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1ea3c640 1 --2- 172.21.15.53:0/1448796447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef180cda30 0x7fef180cb320 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef1001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38352771f28d79e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1d239640 1 -- 172.21.15.53:0/1448796447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100a5810 con 0x7fef180cda30 2024-09-13T18:34:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1d239640 1 -- 172.21.15.53:0/1448796447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef100a5970 con 0x7fef180cda30 2024-09-13T18:34:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1d239640 1 -- 172.21.15.53:0/1448796447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100a5d00 con 0x7fef180cda30 2024-09-13T18:34:43.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- 172.21.15.53:0/1448796447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef180cda30 msgr2=0x7fef180cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 --2- 172.21.15.53:0/1448796447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef180cda30 0x7fef180cb320 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef1001c970 comp rx=0 tx=0).stop 2024-09-13T18:34:43.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- 172.21.15.53:0/1448796447 shutdown_connections 2024-09-13T18:34:43.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 --2- 172.21.15.53:0/1448796447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef180cda30 0x7fef180cb320 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 --2- 172.21.15.53:0/1448796447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef18143e80 0x7fef1806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- 172.21.15.53:0/1448796447 >> 172.21.15.53:0/1448796447 conn(0x7fef18065c80 msgr2=0x7fef18066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- 172.21.15.53:0/1448796447 shutdown_connections 2024-09-13T18:34:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- 172.21.15.53:0/1448796447 wait complete. 2024-09-13T18:34:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 Processor -- start 2024-09-13T18:34:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- start start 2024-09-13T18:34:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef180caee0 0x7fef181406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef180cda30 0x7fef1813f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef18143e80 0x7fef18156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18140e60 con 0x7fef18143e80 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18140500 con 0x7fef180caee0 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef2049f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1813f6c0 con 0x7fef180cda30 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1ea3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef18143e80 0x7fef18156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1ea3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef18143e80 0x7fef18156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57724/0 (socket says 172.21.15.53:57724) 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1ea3c640 1 -- 172.21.15.53:0/3541732427 learned_addr learned my addr 172.21.15.53:0/3541732427 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1e23b640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef180caee0 0x7fef181406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.319+0000 7fef1da3a640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef180cda30 0x7fef1813f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1ea3c640 1 -- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef180cda30 msgr2=0x7fef1813f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1ea3c640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef180cda30 0x7fef1813f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1ea3c640 1 -- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef180caee0 msgr2=0x7fef181406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1ea3c640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef180caee0 0x7fef181406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1ea3c640 1 -- 172.21.15.53:0/3541732427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10009b30 con 0x7fef18143e80 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1ea3c640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef18143e80 0x7fef18156fd0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef10019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef0effd640 1 -- 172.21.15.53:0/3541732427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100b8670 con 0x7fef18143e80 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef0effd640 1 -- 172.21.15.53:0/3541732427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef100b87d0 con 0x7fef18143e80 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1813f8f0 con 0x7fef18143e80 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef0effd640 1 -- 172.21.15.53:0/3541732427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100b8b40 con 0x7fef18143e80 2024-09-13T18:34:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1813feb0 con 0x7fef18143e80 2024-09-13T18:34:43.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef18159290 con 0x7fef18143e80 2024-09-13T18:34:43.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef0effd640 1 -- 172.21.15.53:0/3541732427 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fef100b8ca0 con 0x7fef18143e80 2024-09-13T18:34:43.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef0effd640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feefc067020 0x7feefc0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef0effd640 1 -- 172.21.15.53:0/3541732427 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fef1011e5f0 con 0x7fef18143e80 2024-09-13T18:34:43.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1e23b640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feefc067020 0x7feefc0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.323+0000 7fef1e23b640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feefc067020 0x7feefc0694e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fef08009a50 tx=0x7fef08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:43.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.327+0000 7fef0effd640 1 -- 172.21.15.53:0/3541732427 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef100ed310 con 0x7fef18143e80 2024-09-13T18:34:43.529 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.527+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fef18159290 con 0x7fef18143e80 2024-09-13T18:34:43.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.535+0000 7fef0effd640 1 -- 172.21.15.53:0/3541732427 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v101) v1 ==== 174+0+0 (secure 0 0 0) 0x7fef18159290 con 0x7fef18143e80 2024-09-13T18:34:43.538 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 26 and data pool 27 2024-09-13T18:34:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feefc067020 msgr2=0x7feefc0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feefc067020 0x7feefc0694e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fef08009a50 tx=0x7fef08008040 comp rx=0 tx=0).stop 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef18143e80 msgr2=0x7fef18156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef18143e80 0x7fef18156fd0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef10019710 comp rx=0 tx=0).stop 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 shutdown_connections 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feefc067020 0x7feefc0694e0 secure :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fef08009a50 tx=0x7fef08008040 comp rx=0 tx=0).stop 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef180cda30 0x7fef1813f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef18143e80 0x7fef18156fd0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 --2- 172.21.15.53:0/3541732427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef180caee0 0x7fef181406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 >> 172.21.15.53:0/3541732427 conn(0x7fef18065c80 msgr2=0x7fef180a8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 shutdown_connections 2024-09-13T18:34:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.539+0000 7fef2049f640 1 -- 172.21.15.53:0/3541732427 wait complete. 2024-09-13T18:34:43.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:43.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.683+0000 7fc0680f2640 1 Processor -- start 2024-09-13T18:34:43.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.683+0000 7fc0680f2640 1 -- start start 2024-09-13T18:34:43.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc0680f2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc06015a470 0x7fc0600cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc0680f2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06006f550 con 0x7fc0600b1c10 2024-09-13T18:34:43.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc0680f2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06015dc40 con 0x7fc06015cc60 2024-09-13T18:34:43.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc0680f2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06006f880 con 0x7fc06015a470 2024-09-13T18:34:43.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc06668f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0600b1c10 0x7fc06006fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40920/0 (socket says 172.21.15.53:40920) 2024-09-13T18:34:43.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc06668f640 1 -- 172.21.15.53:0/1940651326 learned_addr learned my addr 172.21.15.53:0/1940651326 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:43.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 --2- 172.21.15.53:0/1940651326 >> v2:172.21.15.87:3300/0 conn(0x7fc06015a470 0x7fc0600cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235395966 0 0) 0x7fc06006f550 con 0x7fc0600b1c10 2024-09-13T18:34:43.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc04c003530 con 0x7fc0600b1c10 2024-09-13T18:34:43.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 467586908 0 0) 0x7fc04c003530 con 0x7fc0600b1c10 2024-09-13T18:34:43.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 >> v2:172.21.15.87:3300/0 conn(0x7fc06015a470 msgr2=0x7fc0600cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:43.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 --2- 172.21.15.53:0/1940651326 >> v2:172.21.15.87:3300/0 conn(0x7fc06015a470 0x7fc0600cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 >> v1:172.21.15.87:6789/0 conn(0x7fc06015cc60 legacy=0x7fc060071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06015d3a0 con 0x7fc0600b1c10 2024-09-13T18:34:43.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc05c001680 con 0x7fc0600b1c10 2024-09-13T18:34:43.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 >> v1:172.21.15.53:6789/0 conn(0x7fc0600b1c10 legacy=0x7fc06006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c003980 0x7fc04c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc04c0047d0 0x7fc04c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c005190 0x7fc04c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06006f880 con 0x7fc04c003980 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c00c030 con 0x7fc04c005190 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c00c1f0 con 0x7fc04c0047d0 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c003980 0x7fc04c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc06668f640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c005190 0x7fc04c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 -- 172.21.15.53:0/1940651326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc04c0047d0 msgr2=0x7fc04c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc04c0047d0 0x7fc04c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 -- 172.21.15.53:0/1940651326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c005190 msgr2=0x7fc04c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c005190 0x7fc04c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 -- 172.21.15.53:0/1940651326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c003530 con 0x7fc04c003980 2024-09-13T18:34:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc06668f640 1 -- 172.21.15.53:0/1940651326 reap_dead start 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc065e8e640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c003980 0x7fc04c003da0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fc058009fc0 tx=0x7fc05801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaff75aa2710bdbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580a5c40 con 0x7fc04c003980 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05800f040 con 0x7fc04c003980 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.687+0000 7fc064e8c640 1 -- 172.21.15.53:0/1940651326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580ad440 con 0x7fc04c003980 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- 172.21.15.53:0/1940651326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c003980 msgr2=0x7fc04c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c003980 0x7fc04c003da0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fc058009fc0 tx=0x7fc05801cc50 comp rx=0 tx=0).stop 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- 172.21.15.53:0/1940651326 shutdown_connections 2024-09-13T18:34:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 --2- 172.21.15.53:0/1940651326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c003980 0x7fc04c003da0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- 172.21.15.53:0/1940651326 >> 172.21.15.53:0/1940651326 conn(0x7fc060065c80 msgr2=0x7fc060066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- 172.21.15.53:0/1940651326 shutdown_connections 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- 172.21.15.53:0/1940651326 wait complete. 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 Processor -- start 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- start start 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c003980 0x7fc0601f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc06015ddd0 0x7fc060155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc060156930 0x7fc06014d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0601f6a10 con 0x7fc060156930 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06014e530 con 0x7fc04c003980 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc060154710 con 0x7fc06015ddd0 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc060156930 0x7fc06014d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc060156930 0x7fc06014d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57730/0 (socket says 172.21.15.53:57730) 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 -- 172.21.15.53:0/4020033453 learned_addr learned my addr 172.21.15.53:0/4020033453 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc065e8e640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c003980 0x7fc0601f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06568d640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc06015ddd0 0x7fc060155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 -- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc06015ddd0 msgr2=0x7fc060155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc06015ddd0 0x7fc060155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 -- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c003980 msgr2=0x7fc0601f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c003980 0x7fc0601f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 -- 172.21.15.53:0/4020033453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0601549d0 con 0x7fc060156930 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06568d640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc06015ddd0 0x7fc060155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc06668f640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc060156930 0x7fc06014d460 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fc060066be0 tx=0x7fc05c00d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0567fc640 1 -- 172.21.15.53:0/4020033453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c007440 con 0x7fc060156930 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc060154cb0 con 0x7fc060156930 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0567fc640 1 -- 172.21.15.53:0/4020033453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c0075a0 con 0x7fc060156930 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0567fc640 1 -- 172.21.15.53:0/4020033453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004a30 con 0x7fc060156930 2024-09-13T18:34:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.691+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc060155270 con 0x7fc060156930 2024-09-13T18:34:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.695+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc060067400 con 0x7fc060156930 2024-09-13T18:34:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.695+0000 7fc0567fc640 1 -- 172.21.15.53:0/4020033453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fc05c004b90 con 0x7fc060156930 2024-09-13T18:34:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.695+0000 7fc0567fc640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc044067050 0x7fc044069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.695+0000 7fc0567fc640 1 -- 172.21.15.53:0/4020033453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc05c0825e0 con 0x7fc060156930 2024-09-13T18:34:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.695+0000 7fc065e8e640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc044067050 0x7fc044069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.695+0000 7fc065e8e640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc044067050 0x7fc044069510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc0580af000 tx=0x7fc058004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.699+0000 7fc0567fc640 1 -- 172.21.15.53:0/4020033453 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc05c0512f0 con 0x7fc060156930 2024-09-13T18:34:43.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.855+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc060155490 con 0x7fc060156930 2024-09-13T18:34:43.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.855+0000 7fc0567fc640 1 -- 172.21.15.53:0/4020033453 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16536 (secure 0 0 0) 0x7fc05c054910 con 0x7fc060156930 2024-09-13T18:34:43.861 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:43.861 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":173,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:43.532695+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:43.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc044067050 msgr2=0x7fc044069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc044067050 0x7fc044069510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc0580af000 tx=0x7fc058004ac0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc060156930 msgr2=0x7fc06014d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc060156930 0x7fc06014d460 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fc060066be0 tx=0x7fc05c00d900 comp rx=0 tx=0).stop 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 shutdown_connections 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc044067050 0x7fc044069510 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc06015ddd0 0x7fc060155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc060156930 0x7fc06014d460 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 --2- 172.21.15.53:0/4020033453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c003980 0x7fc0601f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 >> 172.21.15.53:0/4020033453 conn(0x7fc060065c80 msgr2=0x7fc0600cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 shutdown_connections 2024-09-13T18:34:43.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.859+0000 7fc0680f2640 1 -- 172.21.15.53:0/4020033453 wait complete. 2024-09-13T18:34:43.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:44.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.999+0000 7f8f31bb5640 1 Processor -- start 2024-09-13T18:34:44.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:43.999+0000 7f8f31bb5640 1 -- start start 2024-09-13T18:34:44.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f31bb5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f2c15cab0 0x7f8f2c0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f31bb5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f2c0cd6c0 0x7f8f2c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f31bb5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cdb30 0x7f8f2c0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f31bb5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c0d2400 con 0x7f8f2c0cd6c0 2024-09-13T18:34:44.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f31bb5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c0d1530 con 0x7f8f2c15cab0 2024-09-13T18:34:44.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f31bb5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0d0920 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f2c0cd6c0 0x7f8f2c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f2c0cd6c0 0x7f8f2c0cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57734/0 (socket says 172.21.15.53:57734) 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 -- 172.21.15.53:0/1358471680 learned_addr learned my addr 172.21.15.53:0/1358471680 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2bfff640 1 --2- 172.21.15.53:0/1358471680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cdb30 0x7f8f2c0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2b7fe640 1 --2- 172.21.15.53:0/1358471680 >> v2:172.21.15.87:3300/0 conn(0x7f8f2c15cab0 0x7f8f2c0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 -- 172.21.15.53:0/1358471680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cdb30 msgr2=0x7f8f2c0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 --2- 172.21.15.53:0/1358471680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cdb30 0x7f8f2c0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 -- 172.21.15.53:0/1358471680 >> v2:172.21.15.87:3300/0 conn(0x7f8f2c15cab0 msgr2=0x7f8f2c0d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 --2- 172.21.15.53:0/1358471680 >> v2:172.21.15.87:3300/0 conn(0x7f8f2c15cab0 0x7f8f2c0d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.008 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 -- 172.21.15.53:0/1358471680 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0d0c00 con 0x7f8f2c0cd6c0 2024-09-13T18:34:44.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2affd640 1 --2- 172.21.15.53:0/1358471680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cd6c0 0x7f8f2c0cf0c0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c066930 tx=0x7f8f2001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76771c0531fe0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:44.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2a7fc640 1 -- 172.21.15.53:0/1358471680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200aa610 con 0x7f8f2c0cd6c0 2024-09-13T18:34:44.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2a7fc640 1 -- 172.21.15.53:0/1358471680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f200a6040 con 0x7f8f2c0cd6c0 2024-09-13T18:34:44.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.003+0000 7f8f2a7fc640 1 -- 172.21.15.53:0/1358471680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200aa990 con 0x7f8f2c0cd6c0 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- 172.21.15.53:0/1358471680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cd6c0 msgr2=0x7f8f2c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/1358471680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cd6c0 0x7f8f2c0cf0c0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c066930 tx=0x7f8f2001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- 172.21.15.53:0/1358471680 shutdown_connections 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/1358471680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cdb30 0x7f8f2c0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/1358471680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cd6c0 0x7f8f2c0cf0c0 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/1358471680 >> v2:172.21.15.87:3300/0 conn(0x7f8f2c15cab0 0x7f8f2c0d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- 172.21.15.53:0/1358471680 >> 172.21.15.53:0/1358471680 conn(0x7f8f2c065c80 msgr2=0x7f8f2c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- 172.21.15.53:0/1358471680 shutdown_connections 2024-09-13T18:34:44.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- 172.21.15.53:0/1358471680 wait complete. 2024-09-13T18:34:44.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 Processor -- start 2024-09-13T18:34:44.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- start start 2024-09-13T18:34:44.016 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cd6c0 0x7f8f2c1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cdb30 0x7f8f2c1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c15cab0 0x7f8f2c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1559c0 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15b550 con 0x7f8f2c15cab0 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15b830 con 0x7f8f2c0cd6c0 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cdb30 0x7f8f2c1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cdb30 0x7f8f2c1552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57748/0 (socket says 172.21.15.53:57748) 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 -- 172.21.15.53:0/4087036883 learned_addr learned my addr 172.21.15.53:0/4087036883 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2b7fe640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cd6c0 0x7f8f2c1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2bfff640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c15cab0 0x7f8f2c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 -- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cd6c0 msgr2=0x7f8f2c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cd6c0 0x7f8f2c1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 -- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c15cab0 msgr2=0x7f8f2c15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c15cab0 0x7f8f2c15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 -- 172.21.15.53:0/4087036883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200094d0 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2bfff640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c15cab0 0x7f8f2c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f2affd640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cdb30 0x7f8f2c1552c0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f8f2001aba0 tx=0x7f8f2001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f13fff640 1 -- 172.21.15.53:0/4087036883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200bd5f0 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f13fff640 1 -- 172.21.15.53:0/4087036883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f200bd750 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c15bb10 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f13fff640 1 -- 172.21.15.53:0/4087036883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200bdb00 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.007+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c15aab0 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.011+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0d19c0 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.018 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.011+0000 7f8f13fff640 1 -- 172.21.15.53:0/4087036883 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f8f200b33f0 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.011+0000 7f8f13fff640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f18067020 0x7f8f180694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.011+0000 7f8f13fff640 1 -- 172.21.15.53:0/4087036883 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f2011d940 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.011+0000 7f8f2b7fe640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f18067020 0x7f8f180694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.011+0000 7f8f2b7fe640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f18067020 0x7f8f180694e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00b9d0 tx=0x7f8f1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:44.019 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.015+0000 7f8f13fff640 1 -- 172.21.15.53:0/4087036883 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f200ec560 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.175+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f2c067910 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.175+0000 7f8f13fff640 1 -- 172.21.15.53:0/4087036883 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16536 (secure 0 0 0) 0x7f8f2c067910 con 0x7f8f2c0cdb30 2024-09-13T18:34:44.181 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:44.181 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":173,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:43.532695+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f18067020 msgr2=0x7f8f180694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f18067020 0x7f8f180694e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00b9d0 tx=0x7f8f1c008040 comp rx=0 tx=0).stop 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cdb30 msgr2=0x7f8f2c1552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cdb30 0x7f8f2c1552c0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f8f2001aba0 tx=0x7f8f2001ad30 comp rx=0 tx=0).stop 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 shutdown_connections 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8f18067020 0x7f8f180694e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f2c15cab0 0x7f8f2c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f2c0cdb30 0x7f8f2c1552c0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 --2- 172.21.15.53:0/4087036883 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8f2c0cd6c0 0x7f8f2c1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 >> 172.21.15.53:0/4087036883 conn(0x7f8f2c065c80 msgr2=0x7f8f2c0b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 shutdown_connections 2024-09-13T18:34:44.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.179+0000 7f8f31bb5640 1 -- 172.21.15.53:0/4087036883 wait complete. 2024-09-13T18:34:44.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:34:44.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.323+0000 7fc7884be640 1 Processor -- start 2024-09-13T18:34:44.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.323+0000 7fc7884be640 1 -- start start 2024-09-13T18:34:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc7884be640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 0x7fc7800660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc7884be640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc780070480 con 0x7fc780145f10 2024-09-13T18:34:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc7884be640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc780070760 con 0x7fc7800acb00 2024-09-13T18:34:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc7884be640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc780066630 con 0x7fc780065c80 2024-09-13T18:34:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc780145f10 0x7fc7800aeb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40936/0 (socket says 172.21.15.53:40936) 2024-09-13T18:34:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 -- 172.21.15.53:0/1677880344 learned_addr learned my addr 172.21.15.53:0/1677880344 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:44.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785a59640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 0x7fc7800660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136415756 0 0) 0x7fc780070480 con 0x7fc780145f10 2024-09-13T18:34:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc76c003530 con 0x7fc780145f10 2024-09-13T18:34:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257352704 0 0) 0x7fc780070760 con 0x7fc7800acb00 2024-09-13T18:34:44.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc780070480 con 0x7fc7800acb00 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 631383765 0 0) 0x7fc76c003530 con 0x7fc780145f10 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 msgr2=0x7fc7800660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 0x7fc7800660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 >> v1:172.21.15.87:6789/0 conn(0x7fc7800acb00 legacy=0x7fc7800acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780070a40 con 0x7fc780145f10 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc77c001680 con 0x7fc780145f10 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 >> v1:172.21.15.53:6789/0 conn(0x7fc780145f10 legacy=0x7fc7800aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc76c003b40 0x7fc76c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 0x7fc76c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76c004d10 0x7fc76c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780066630 con 0x7fc76c003b40 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c00ba40 con 0x7fc76c004d10 2024-09-13T18:34:44.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c00bc00 con 0x7fc780065c80 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc76c003b40 0x7fc76c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785a59640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 0x7fc76c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc786a5b640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76c004d10 0x7fc76c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 -- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 msgr2=0x7fc76c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc780065c80 0x7fc76c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 -- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76c004d10 msgr2=0x7fc76c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76c004d10 0x7fc76c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 -- 172.21.15.53:0/1677880344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c003530 con 0x7fc76c003b40 2024-09-13T18:34:44.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc786a5b640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc76c004d10 0x7fc76c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:44.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc78625a640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc76c003b40 0x7fc76c003f40 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c160 tx=0x7fc77c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc6838810eefd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0058e0 con 0x7fc76c003b40 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7800ade60 con 0x7fc76c003b40 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.327+0000 7fc785258640 1 -- 172.21.15.53:0/1677880344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c005ca0 con 0x7fc76c003b40 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- 172.21.15.53:0/1677880344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc76c003b40 msgr2=0x7fc76c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 --2- 172.21.15.53:0/1677880344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc76c003b40 0x7fc76c003f40 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00c160 tx=0x7fc77c01cbd0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 -- 172.21.15.53:0/1677880344 reap_dead start 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- 172.21.15.53:0/1677880344 shutdown_connections 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- 172.21.15.53:0/1677880344 >> 172.21.15.53:0/1677880344 conn(0x7fc780069f50 msgr2=0x7fc78006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- 172.21.15.53:0/1677880344 shutdown_connections 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- 172.21.15.53:0/1677880344 wait complete. 2024-09-13T18:34:44.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 Processor -- start 2024-09-13T18:34:44.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- start start 2024-09-13T18:34:44.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc76c003b40 0x7fc78006d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc78015cc50 0x7fc78015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc78015e2d0 0x7fc78015e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78015ec90 con 0x7fc78015e2d0 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78013a8b0 con 0x7fc78015cc50 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78015dfd0 con 0x7fc76c003b40 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc78015e2d0 0x7fc78015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc78015e2d0 0x7fc78015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57776/0 (socket says 172.21.15.53:57776) 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 -- 172.21.15.53:0/3577744750 learned_addr learned my addr 172.21.15.53:0/3577744750 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc78625a640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc76c003b40 0x7fc78006d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc785a59640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc78015cc50 0x7fc78015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 -- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc76c003b40 msgr2=0x7fc78006d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc76c003b40 0x7fc78006d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 -- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc78015cc50 msgr2=0x7fc78015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc78015cc50 0x7fc78015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 -- 172.21.15.53:0/3577744750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78015d3c0 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc786a5b640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc78015e2d0 0x7fc78015e750 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fc7800cd300 tx=0x7fc77800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc776ffd640 1 -- 172.21.15.53:0/3577744750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778003b80 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc776ffd640 1 -- 172.21.15.53:0/3577744750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778003ce0 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78015d6a0 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc776ffd640 1 -- 172.21.15.53:0/3577744750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780052b0 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.331+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78015dc60 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.335+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc780070760 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.335+0000 7fc776ffd640 1 -- 172.21.15.53:0/3577744750 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fc778006b60 con 0x7fc78015e2d0 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.335+0000 7fc776ffd640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc764067020 0x7fc7640694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:44.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.335+0000 7fc776ffd640 1 -- 172.21.15.53:0/3577744750 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc778082280 con 0x7fc78015e2d0 2024-09-13T18:34:44.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.335+0000 7fc78625a640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc764067020 0x7fc7640694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:44.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.335+0000 7fc78625a640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc764067020 0x7fc7640694e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0aa000 tx=0x7fc77c001a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:44.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.339+0000 7fc776ffd640 1 -- 172.21.15.53:0/3577744750 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc778050ef0 con 0x7fc78015e2d0 2024-09-13T18:34:44.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:44.539+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc7800b4960 con 0x7fc78015e2d0 2024-09-13T18:34:45.138 INFO:tasks.ceph.mds.c.smithi053.stderr:2024-09-13T18:34:45.135+0000 7fa27d67b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:34:45.546 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.543+0000 7fc776ffd640 1 -- 172.21.15.53:0/3577744750 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v103) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc778018070 con 0x7fc78015e2d0 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc764067020 msgr2=0x7fc7640694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc764067020 0x7fc7640694e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0aa000 tx=0x7fc77c001a00 comp rx=0 tx=0).stop 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc78015e2d0 msgr2=0x7fc78015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc78015e2d0 0x7fc78015e750 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fc7800cd300 tx=0x7fc77800dc00 comp rx=0 tx=0).stop 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 shutdown_connections 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc764067020 0x7fc7640694e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc78015e2d0 0x7fc78015e750 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc78015cc50 0x7fc78015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 --2- 172.21.15.53:0/3577744750 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc76c003b40 0x7fc78006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 >> 172.21.15.53:0/3577744750 conn(0x7fc780069f50 msgr2=0x7fc7800cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 shutdown_connections 2024-09-13T18:34:45.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.547+0000 7fc7884be640 1 -- 172.21.15.53:0/3577744750 wait complete. 2024-09-13T18:34:45.571 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:34:45.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:34:45.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07afdcf640 1 Processor -- start 2024-09-13T18:34:45.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07afdcf640 1 -- start start 2024-09-13T18:34:45.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07afdcf640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f07a80b4580 0x7f07a80af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07afdcf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80aef40 con 0x7f07a80afa50 2024-09-13T18:34:45.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07afdcf640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80ae330 con 0x7f07a815a290 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07afdcf640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80ae130 con 0x7f07a80b4580 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f07a80afa50 0x7f07a80b3e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40942/0 (socket says 172.21.15.53:40942) 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 -- 172.21.15.53:0/1606438612 learned_addr learned my addr 172.21.15.53:0/1606438612 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ae36c640 1 --2- 172.21.15.53:0/1606438612 >> v2:172.21.15.87:3300/0 conn(0x7f07a80b4580 0x7f07a80af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477835617 0 0) 0x7f07a80aef40 con 0x7f07a80afa50 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0794003530 con 0x7f07a80afa50 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207488911 0 0) 0x7f0794003530 con 0x7f07a80afa50 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 >> v2:172.21.15.87:3300/0 conn(0x7f07a80b4580 msgr2=0x7f07a80af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 --2- 172.21.15.53:0/1606438612 >> v2:172.21.15.87:3300/0 conn(0x7f07a80b4580 0x7f07a80af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 >> v1:172.21.15.87:6789/0 conn(0x7f07a815a290 legacy=0x7f07a80ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80ae610 con 0x7f07a80afa50 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0798001680 con 0x7f07a80afa50 2024-09-13T18:34:45.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 >> v1:172.21.15.53:6789/0 conn(0x7f07a80afa50 legacy=0x7f07a80b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07940039d0 0x7f0794003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f0794004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0794005190 0x7f079400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80ae130 con 0x7f07940047d0 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079400c090 con 0x7f0794005190 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079400c250 con 0x7f07940039d0 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f0794004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07adb6b640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07940039d0 0x7f0794003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ae36c640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0794005190 0x7f079400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 -- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07940039d0 msgr2=0x7f0794003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07940039d0 0x7f0794003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 -- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0794005190 msgr2=0x7f079400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:45.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0794005190 0x7f079400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ad36a640 1 -- 172.21.15.53:0/1606438612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794003530 con 0x7f07940047d0 2024-09-13T18:34:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ae36c640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0794005190 0x7f079400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:45.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.703+0000 7f07ae36c640 1 -- 172.21.15.53:0/1606438612 reap_dead start 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07ad36a640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f0794004c50 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f079800c0e0 tx=0x7f079801f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919e9e6742eb2155 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798005ae0 con 0x7f07940047d0 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07980ab070 con 0x7f07940047d0 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07acb69640 1 -- 172.21.15.53:0/1606438612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798007070 con 0x7f07940047d0 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 -- 172.21.15.53:0/1606438612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 msgr2=0x7f0794004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f0794004c50 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f079800c0e0 tx=0x7f079801f2f0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 -- 172.21.15.53:0/1606438612 shutdown_connections 2024-09-13T18:34:45.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 --2- 172.21.15.53:0/1606438612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f0794004c50 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 -- 172.21.15.53:0/1606438612 >> 172.21.15.53:0/1606438612 conn(0x7f07a80b58f0 msgr2=0x7f07a80b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 -- 172.21.15.53:0/1606438612 shutdown_connections 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 -- 172.21.15.53:0/1606438612 wait complete. 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 Processor -- start 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.707+0000 7f07afdcf640 1 -- start start 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f07a80cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07a809e0a0 0x7f07a80ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07a80cfb50 0x7f07a80cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80d0520 con 0x7f07940047d0 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80d1320 con 0x7f07a809e0a0 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81f0260 con 0x7f07a80cfb50 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f07a80cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f07a80cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57782/0 (socket says 172.21.15.53:57782) 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 -- 172.21.15.53:0/2686924349 learned_addr learned my addr 172.21.15.53:0/2686924349 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07ad36a640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07a809e0a0 0x7f07a80ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 -- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07a80cfb50 msgr2=0x7f07a80cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07ae36c640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07a80cfb50 0x7f07a80cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07a80cfb50 0x7f07a80cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 -- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07a809e0a0 msgr2=0x7f07a80ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07a809e0a0 0x7f07a80ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 -- 172.21.15.53:0/2686924349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80d07a0 con 0x7f07940047d0 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07ad36a640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07a809e0a0 0x7f07a80ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07adb6b640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f07a80cdb00 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e480 tx=0x7f07a400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f079e7fc640 1 -- 172.21.15.53:0/2686924349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40052e0 con 0x7f07940047d0 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f079e7fc640 1 -- 172.21.15.53:0/2686924349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4005440 con 0x7f07940047d0 2024-09-13T18:34:45.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a80d0a80 con 0x7f07940047d0 2024-09-13T18:34:45.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f079e7fc640 1 -- 172.21.15.53:0/2686924349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4003800 con 0x7f07940047d0 2024-09-13T18:34:45.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a80d1040 con 0x7f07940047d0 2024-09-13T18:34:45.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a80af3d0 con 0x7f07940047d0 2024-09-13T18:34:45.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f079e7fc640 1 -- 172.21.15.53:0/2686924349 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f07a4003960 con 0x7f07940047d0 2024-09-13T18:34:45.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f079e7fc640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f078c067020 0x7f078c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f079e7fc640 1 -- 172.21.15.53:0/2686924349 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07a40829f0 con 0x7f07940047d0 2024-09-13T18:34:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.711+0000 7f07ad36a640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f078c067020 0x7f078c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:45.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.715+0000 7f07ad36a640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f078c067020 0x7f078c0694e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f07980af000 tx=0x7f07980aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:45.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.715+0000 7f079e7fc640 1 -- 172.21.15.53:0/2686924349 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07a4051610 con 0x7f07940047d0 2024-09-13T18:34:45.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:45.915+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f07a80670d0 con 0x7f07940047d0 2024-09-13T18:34:46.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.547+0000 7f079e7fc640 1 -- 172.21.15.53:0/2686924349 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v104) v1 ==== 122+0+0 (secure 0 0 0) 0x7f07a4054c30 con 0x7f07940047d0 2024-09-13T18:34:46.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f078c067020 msgr2=0x7f078c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f078c067020 0x7f078c0694e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f07980af000 tx=0x7f07980aa000 comp rx=0 tx=0).stop 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 msgr2=0x7f07a80cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f07a80cdb00 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e480 tx=0x7f07a400e940 comp rx=0 tx=0).stop 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 shutdown_connections 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f078c067020 0x7f078c0694e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f07a80cfb50 0x7f07a80cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07a809e0a0 0x7f07a80ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 --2- 172.21.15.53:0/2686924349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940047d0 0x7f07a80cdb00 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 >> 172.21.15.53:0/2686924349 conn(0x7f07a80b58f0 msgr2=0x7f07a815d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 shutdown_connections 2024-09-13T18:34:46.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.551+0000 7f07afdcf640 1 -- 172.21.15.53:0/2686924349 wait complete. 2024-09-13T18:34:46.577 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:34:46.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:46.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f50732d8640 1 Processor -- start 2024-09-13T18:34:46.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f50732d8640 1 -- start start 2024-09-13T18:34:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f50732d8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 0x7f506c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.707 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f50732d8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c06d480 con 0x7f506c0711d0 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f50732d8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c15ace0 con 0x7f506c1582a0 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f50732d8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c15aaf0 con 0x7f506c15b7c0 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071875640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f506c0711d0 0x7f506c1640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51870/0 (socket says 172.21.15.53:51870) 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071875640 1 -- 172.21.15.53:0/1901999919 learned_addr learned my addr 172.21.15.53:0/1901999919 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5070873640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 0x7f506c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983811397 0 0) 0x7f506c06d480 con 0x7f506c0711d0 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5058003530 con 0x7f506c0711d0 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3421516519 0 0) 0x7f5058003530 con 0x7f506c0711d0 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 msgr2=0x7f506c070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 0x7f506c070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 >> v1:172.21.15.87:6789/0 conn(0x7f506c1582a0 legacy=0x7f506c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c15afc0 con 0x7f506c0711d0 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f5064001680 con 0x7f506c0711d0 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 >> v1:172.21.15.53:6789/0 conn(0x7f506c0711d0 legacy=0x7f506c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 0x7f50580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058004d10 0x7f5058005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505800ba40 con 0x7f50580039b0 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505800bbb0 con 0x7f5058004d10 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505800bd70 con 0x7f506c15b7c0 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071074640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071875640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058004d10 0x7f5058005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5070873640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 0x7f50580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071074640 1 -- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 msgr2=0x7f50580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071074640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f506c15b7c0 0x7f50580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071074640 1 -- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058004d10 msgr2=0x7f5058005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:46.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071074640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5058004d10 0x7f5058005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.703+0000 7f5071074640 1 -- 172.21.15.53:0/1901999919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058003530 con 0x7f50580039b0 2024-09-13T18:34:46.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5071074640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f5068001e40 tx=0x7f506801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519a8a74ab86fd7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:46.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068003b80 con 0x7f50580039b0 2024-09-13T18:34:46.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068003ce0 con 0x7f50580039b0 2024-09-13T18:34:46.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5063fff640 1 -- 172.21.15.53:0/1901999919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068005310 con 0x7f50580039b0 2024-09-13T18:34:46.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- 172.21.15.53:0/1901999919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580039b0 msgr2=0x7f5058003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 --2- 172.21.15.53:0/1901999919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580039b0 0x7f5058003dd0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f5068001e40 tx=0x7f506801c760 comp rx=0 tx=0).stop 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5071875640 1 -- 172.21.15.53:0/1901999919 reap_dead start 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- 172.21.15.53:0/1901999919 shutdown_connections 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- 172.21.15.53:0/1901999919 >> 172.21.15.53:0/1901999919 conn(0x7f506c065c80 msgr2=0x7f506c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- 172.21.15.53:0/1901999919 shutdown_connections 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- 172.21.15.53:0/1901999919 wait complete. 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 Processor -- start 2024-09-13T18:34:46.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- start start 2024-09-13T18:34:46.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50580039b0 0x7f506c141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c1620e0 0x7f506c0af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c151040 0x7f506c0af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0adf00 con 0x7f506c151040 2024-09-13T18:34:46.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0aed60 con 0x7f506c1620e0 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f50732d8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0b3500 con 0x7f50580039b0 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5071875640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c151040 0x7f506c0af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5071875640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c151040 0x7f506c0af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55790/0 (socket says 172.21.15.53:55790) 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5071875640 1 -- 172.21.15.53:0/594514244 learned_addr learned my addr 172.21.15.53:0/594514244 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.707+0000 7f5070873640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c1620e0 0x7f506c0af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071074640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50580039b0 0x7f506c141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071875640 1 -- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50580039b0 msgr2=0x7f506c141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071875640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50580039b0 0x7f506c141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071875640 1 -- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c1620e0 msgr2=0x7f506c0af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071875640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c1620e0 0x7f506c0af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071875640 1 -- 172.21.15.53:0/594514244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c0ae150 con 0x7f506c151040 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071074640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50580039b0 0x7f506c141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:46.716 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071875640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c151040 0x7f506c0af5e0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f506c0cbf70 tx=0x7f506400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5061ffb640 1 -- 172.21.15.53:0/594514244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400eed0 con 0x7f506c151040 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5061ffb640 1 -- 172.21.15.53:0/594514244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400c690 con 0x7f506c151040 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c0ae430 con 0x7f506c151040 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5061ffb640 1 -- 172.21.15.53:0/594514244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400ca20 con 0x7f506c151040 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0ae9f0 con 0x7f506c151040 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c0aebb0 con 0x7f506c151040 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5061ffb640 1 -- 172.21.15.53:0/594514244 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f506400cb80 con 0x7f506c151040 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5061ffb640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5050067020 0x7f50500694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071074640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5050067020 0x7f50500694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:46.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5061ffb640 1 -- 172.21.15.53:0/594514244 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50640828b0 con 0x7f506c151040 2024-09-13T18:34:46.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.711+0000 7f5071074640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5050067020 0x7f50500694e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f50680ad000 tx=0x7f5068001520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:46.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.715+0000 7f5061ffb640 1 -- 172.21.15.53:0/594514244 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50640514d0 con 0x7f506c151040 2024-09-13T18:34:46.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.907+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f506c0aeed0 con 0x7f506c151040 2024-09-13T18:34:46.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.907+0000 7f5061ffb640 1 -- 172.21.15.53:0/594514244 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4745 (secure 0 0 0) 0x7f5064054af0 con 0x7f506c151040 2024-09-13T18:34:46.911 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:46.912 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/481869316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":481869316},{"type":"v1","addr":"172.21.15.87:6833","nonce":481869316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4120395616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4120395616},{"type":"v1","addr":"172.21.15.87:6835","nonce":4120395616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1960885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1960885675},{"type":"v1","addr":"172.21.15.53:6833","nonce":1960885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:34:43.533426+0000","modified":"2024-09-13T18:34:46.545788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1295090105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1295090105},{"type":"v1","addr":"172.21.15.53:6835","nonce":1295090105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":13}]} 2024-09-13T18:34:46.912 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5050067020 msgr2=0x7f50500694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5050067020 0x7f50500694e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f50680ad000 tx=0x7f5068001520 comp rx=0 tx=0).stop 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c151040 msgr2=0x7f506c0af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c151040 0x7f506c0af5e0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f506c0cbf70 tx=0x7f506400eb90 comp rx=0 tx=0).stop 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 shutdown_connections 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5050067020 0x7f50500694e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506c151040 0x7f506c0af5e0 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f506c1620e0 0x7f506c0af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 --2- 172.21.15.53:0/594514244 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50580039b0 0x7f506c141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:46.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 >> 172.21.15.53:0/594514244 conn(0x7f506c065c80 msgr2=0x7f506c151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:46.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 shutdown_connections 2024-09-13T18:34:46.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:46.911+0000 7f50732d8640 1 -- 172.21.15.53:0/594514244 wait complete. 2024-09-13T18:34:46.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:34:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.047+0000 7f29cba90640 1 Processor -- start 2024-09-13T18:34:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.047+0000 7f29cba90640 1 -- start start 2024-09-13T18:34:47.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.047+0000 7f29cba90640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29c406b850 0x7f29c40b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.047+0000 7f29cba90640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29c40cbd60 0x7f29c40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.047+0000 7f29cba90640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c40b1ac0 con 0x7f29c40cb980 2024-09-13T18:34:47.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.047+0000 7f29cba90640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c40b3010 con 0x7f29c406b850 2024-09-13T18:34:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.047+0000 7f29cba90640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c4159ac0 con 0x7f29c40cbd60 2024-09-13T18:34:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29c406b850 0x7f29c40b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f29c406b850 0x7f29c40b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55796/0 (socket says 172.21.15.53:55796) 2024-09-13T18:34:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 -- 172.21.15.53:0/3054057489 learned_addr learned my addr 172.21.15.53:0/3054057489 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29ca02d640 1 --2- 172.21.15.53:0/3054057489 >> v2:172.21.15.87:3300/0 conn(0x7f29c40cbd60 0x7f29c40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 -- 172.21.15.53:0/3054057489 >> v2:172.21.15.87:3300/0 conn(0x7f29c40cbd60 msgr2=0x7f29c40cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 --2- 172.21.15.53:0/3054057489 >> v2:172.21.15.87:3300/0 conn(0x7f29c40cbd60 0x7f29c40cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 -- 172.21.15.53:0/3054057489 >> v1:172.21.15.87:6789/0 conn(0x7f29c40cb980 legacy=0x7f29c406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 -- 172.21.15.53:0/3054057489 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4159da0 con 0x7f29c406b850 2024-09-13T18:34:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29ca02d640 1 --2- 172.21.15.53:0/3054057489 >> v2:172.21.15.87:3300/0 conn(0x7f29c40cbd60 0x7f29c40cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c902b640 1 --2- 172.21.15.53:0/3054057489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c406b850 0x7f29c40b33b0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f29c4070c80 tx=0x7f29b401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5097428ab4cd35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c882a640 1 -- 172.21.15.53:0/3054057489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40ac630 con 0x7f29c406b850 2024-09-13T18:34:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c882a640 1 -- 172.21.15.53:0/3054057489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40ac790 con 0x7f29c406b850 2024-09-13T18:34:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29c882a640 1 -- 172.21.15.53:0/3054057489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40acb20 con 0x7f29c406b850 2024-09-13T18:34:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 -- 172.21.15.53:0/3054057489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c406b850 msgr2=0x7f29c40b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 --2- 172.21.15.53:0/3054057489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c406b850 0x7f29c40b33b0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f29c4070c80 tx=0x7f29b401c3d0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 -- 172.21.15.53:0/3054057489 shutdown_connections 2024-09-13T18:34:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 --2- 172.21.15.53:0/3054057489 >> v2:172.21.15.87:3300/0 conn(0x7f29c40cbd60 0x7f29c40cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 --2- 172.21.15.53:0/3054057489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c406b850 0x7f29c40b33b0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 -- 172.21.15.53:0/3054057489 >> 172.21.15.53:0/3054057489 conn(0x7f29c4065c80 msgr2=0x7f29c4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 -- 172.21.15.53:0/3054057489 shutdown_connections 2024-09-13T18:34:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.051+0000 7f29cba90640 1 -- 172.21.15.53:0/3054057489 wait complete. 2024-09-13T18:34:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 Processor -- start 2024-09-13T18:34:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 -- start start 2024-09-13T18:34:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c406b850 0x7f29c414b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29c40cb980 0x7f29c41510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c40cbd60 0x7f29c4149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4151630 con 0x7f29c40cbd60 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c41f8680 con 0x7f29c406b850 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c41f8960 con 0x7f29c40cb980 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c40cbd60 0x7f29c4149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c40cbd60 0x7f29c4149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55800/0 (socket says 172.21.15.53:55800) 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 -- 172.21.15.53:0/3101754973 learned_addr learned my addr 172.21.15.53:0/3101754973 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29c902b640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29c40cb980 0x7f29c41510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29c982c640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c406b850 0x7f29c414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 -- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29c40cb980 msgr2=0x7f29c41510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29c40cb980 0x7f29c41510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 -- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c406b850 msgr2=0x7f29c414b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c406b850 0x7f29c414b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 -- 172.21.15.53:0/3101754973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094d0 con 0x7f29c40cbd60 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ca02d640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c40cbd60 0x7f29c4149680 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009fa0 tx=0x7f29bc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ba7fc640 1 -- 172.21.15.53:0/3101754973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc003ba0 con 0x7f29c40cbd60 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ba7fc640 1 -- 172.21.15.53:0/3101754973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00f040 con 0x7f29c40cbd60 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c41f8c40 con 0x7f29c40cbd60 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29ba7fc640 1 -- 172.21.15.53:0/3101754973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc004030 con 0x7f29c40cbd60 2024-09-13T18:34:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c41f8310 con 0x7f29c40cbd60 2024-09-13T18:34:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.055+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c4067400 con 0x7f29c40cbd60 2024-09-13T18:34:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.059+0000 7f29ba7fc640 1 -- 172.21.15.53:0/3101754973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f29bc004190 con 0x7f29c40cbd60 2024-09-13T18:34:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.059+0000 7f29ba7fc640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29a8067020 0x7f29a80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.059+0000 7f29ba7fc640 1 -- 172.21.15.53:0/3101754973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29bc083000 con 0x7f29c40cbd60 2024-09-13T18:34:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.059+0000 7f29c982c640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29a8067020 0x7f29a80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.059+0000 7f29c982c640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29a8067020 0x7f29a80694e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f29c0000f70 tx=0x7f29c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.063+0000 7f29ba7fc640 1 -- 172.21.15.53:0/3101754973 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29bc051c20 con 0x7f29c40cbd60 2024-09-13T18:34:47.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.223+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c406cfb0 con 0x7f29c40cbd60 2024-09-13T18:34:47.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.223+0000 7f29ba7fc640 1 -- 172.21.15.53:0/3101754973 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f29bc01a090 con 0x7f29c40cbd60 2024-09-13T18:34:47.229 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:47.229 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":174,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:44.536440+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29a8067020 msgr2=0x7f29a80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29a8067020 0x7f29a80694e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f29c0000f70 tx=0x7f29c0009040 comp rx=0 tx=0).stop 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c40cbd60 msgr2=0x7f29c4149680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c40cbd60 0x7f29c4149680 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009fa0 tx=0x7f29bc00d560 comp rx=0 tx=0).stop 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 shutdown_connections 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f29a8067020 0x7f29a80694e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f29c40cb980 0x7f29c41510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29c40cbd60 0x7f29c4149680 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 --2- 172.21.15.53:0/3101754973 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c406b850 0x7f29c414b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 >> 172.21.15.53:0/3101754973 conn(0x7f29c4065c80 msgr2=0x7f29c40cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:47.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 shutdown_connections 2024-09-13T18:34:47.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.227+0000 7f29cba90640 1 -- 172.21.15.53:0/3101754973 wait complete. 2024-09-13T18:34:47.248 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:34:47.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:34:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.363+0000 7f2677695640 1 Processor -- start 2024-09-13T18:34:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2677695640 1 -- start start 2024-09-13T18:34:47.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2677695640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26700cef70 0x7f26700adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2677695640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f26700660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2677695640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26700b4880 con 0x7f267015d840 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2677695640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26700cf350 con 0x7f26700cef70 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2677695640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26700665e0 con 0x7f2670065c80 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26700cef70 0x7f26700adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26700cef70 0x7f26700adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55814/0 (socket says 172.21.15.53:55814) 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2674c30640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f267015d840 0x7f26700b4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51880/0 (socket says 172.21.15.53:51880) 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 -- 172.21.15.53:0/2946825359 learned_addr learned my addr 172.21.15.53:0/2946825359 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675c32640 1 --2- 172.21.15.53:0/2946825359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f26700660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 -- 172.21.15.53:0/2946825359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 msgr2=0x7f26700660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 --2- 172.21.15.53:0/2946825359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f26700660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 -- 172.21.15.53:0/2946825359 >> v1:172.21.15.53:6789/0 conn(0x7f267015d840 legacy=0x7f26700b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 -- 172.21.15.53:0/2946825359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700b30d0 con 0x7f26700cef70 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f266ffff640 1 -- 172.21.15.53:0/2946825359 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537686087 0 0) 0x7f26700b4880 con 0x7f267015d840 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675c32640 1 --2- 172.21.15.53:0/2946825359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f26700660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:47.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.367+0000 7f2675431640 1 --2- 172.21.15.53:0/2946825359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26700cef70 0x7f26700adb70 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f2668009e50 tx=0x7f266801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ce7116278c4ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f266ffff640 1 -- 172.21.15.53:0/2946825359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680a58d0 con 0x7f26700cef70 2024-09-13T18:34:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f266ffff640 1 -- 172.21.15.53:0/2946825359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680a5a30 con 0x7f26700cef70 2024-09-13T18:34:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f266ffff640 1 -- 172.21.15.53:0/2946825359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680a5dc0 con 0x7f26700cef70 2024-09-13T18:34:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- 172.21.15.53:0/2946825359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26700cef70 msgr2=0x7f26700adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 --2- 172.21.15.53:0/2946825359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26700cef70 0x7f26700adb70 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f2668009e50 tx=0x7f266801ca00 comp rx=0 tx=0).stop 2024-09-13T18:34:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- 172.21.15.53:0/2946825359 shutdown_connections 2024-09-13T18:34:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 --2- 172.21.15.53:0/2946825359 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f26700660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 --2- 172.21.15.53:0/2946825359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26700cef70 0x7f26700adb70 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- 172.21.15.53:0/2946825359 >> 172.21.15.53:0/2946825359 conn(0x7f26700b1680 msgr2=0x7f26700b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- 172.21.15.53:0/2946825359 shutdown_connections 2024-09-13T18:34:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- 172.21.15.53:0/2946825359 wait complete. 2024-09-13T18:34:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 Processor -- start 2024-09-13T18:34:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- start start 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f267014b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26700cef70 0x7f2670146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f267015d840 0x7f2670148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670147460 con 0x7f267015d840 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670153240 con 0x7f26700cef70 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2670148b50 con 0x7f2670065c80 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f267015d840 0x7f2670148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f267015d840 0x7f2670148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55822/0 (socket says 172.21.15.53:55822) 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 -- 172.21.15.53:0/3403803073 learned_addr learned my addr 172.21.15.53:0/3403803073 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2674c30640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26700cef70 0x7f2670146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675431640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f267014b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 -- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 msgr2=0x7f267014b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f267014b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 -- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26700cef70 msgr2=0x7f2670146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26700cef70 0x7f2670146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 -- 172.21.15.53:0/3403803073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668009b30 con 0x7f267015d840 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675431640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f267014b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2675c32640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f267015d840 0x7f2670148190 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f266000c7f0 tx=0x7f266000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f266dffb640 1 -- 172.21.15.53:0/3403803073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660007820 con 0x7f267015d840 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f266dffb640 1 -- 172.21.15.53:0/3403803073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26600079c0 con 0x7f267015d840 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2670148e30 con 0x7f267015d840 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f266dffb640 1 -- 172.21.15.53:0/3403803073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660007d70 con 0x7f267015d840 2024-09-13T18:34:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.371+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2670152ed0 con 0x7f267015d840 2024-09-13T18:34:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.375+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26700660a0 con 0x7f267015d840 2024-09-13T18:34:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.375+0000 7f266dffb640 1 -- 172.21.15.53:0/3403803073 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f26600113f0 con 0x7f267015d840 2024-09-13T18:34:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.375+0000 7f266dffb640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f265c067020 0x7f265c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.375+0000 7f266dffb640 1 -- 172.21.15.53:0/3403803073 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2660083000 con 0x7f267015d840 2024-09-13T18:34:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.375+0000 7f2675431640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f265c067020 0x7f265c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.380 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.375+0000 7f2675431640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f265c067020 0x7f265c0694e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f26680ae000 tx=0x7f26680a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.379+0000 7f266dffb640 1 -- 172.21.15.53:0/3403803073 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2660051c20 con 0x7f267015d840 2024-09-13T18:34:47.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.531+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26700b3c50 con 0x7f265c067020 2024-09-13T18:34:47.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.543+0000 7f266dffb640 1 -- 172.21.15.53:0/3403803073 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277445 (secure 0 0 0) 0x7f2668009510 con 0x7f265c067020 2024-09-13T18:34:47.550 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:47.552 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:34:47.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f265c067020 msgr2=0x7f265c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f265c067020 0x7f265c0694e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f26680ae000 tx=0x7f26680a7070 comp rx=0 tx=0).stop 2024-09-13T18:34:47.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f267015d840 msgr2=0x7f2670148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f267015d840 0x7f2670148190 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f266000c7f0 tx=0x7f266000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 shutdown_connections 2024-09-13T18:34:47.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f265c067020 0x7f265c0694e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.553 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f267015d840 0x7f2670148190 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26700cef70 0x7f2670146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 --2- 172.21.15.53:0/3403803073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2670065c80 0x7f267014b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 >> 172.21.15.53:0/3403803073 conn(0x7f26700b1680 msgr2=0x7f26701546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:47.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 shutdown_connections 2024-09-13T18:34:47.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.547+0000 7f2677695640 1 -- 172.21.15.53:0/3403803073 wait complete. 2024-09-13T18:34:47.569 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-13T18:34:45.903743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295636,"kb_used_data":18024,"kb_used_omap":12,"kb_used_meta":277491,"kb_avail":754679084,"statfs":{"total":773094113280,"available":772791382016,"internally_reserved":0,"allocated":18456576,"data_stored":8796800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":284151352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000750"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.150597+0000","last_change":"2024-09-13T18:34:42.150597+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.150597+0000","last_undegraded":"2024-09-13T18:34:42.150597+0000","last_fullsized":"2024-09-13T18:34:42.150597+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.153145+0000","last_change":"2024-09-13T18:34:42.153145+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.153145+0000","last_undegraded":"2024-09-13T18:34:42.153145+0000","last_fullsized":"2024-09-13T18:34:42.153145+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:30.046030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.152113+0000","last_change":"2024-09-13T18:34:42.152113+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.152113+0000","last_undegraded":"2024-09-13T18:34:42.152113+0000","last_fullsized":"2024-09-13T18:34:42.152113+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:10.029285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.159075+0000","last_change":"2024-09-13T18:34:42.159075+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.159075+0000","last_undegraded":"2024-09-13T18:34:42.159075+0000","last_fullsized":"2024-09-13T18:34:42.159075+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:17.625818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.149650+0000","last_change":"2024-09-13T18:34:42.149650+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.149650+0000","last_undegraded":"2024-09-13T18:34:42.149650+0000","last_fullsized":"2024-09-13T18:34:42.149650+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:55.298996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.148469+0000","last_change":"2024-09-13T18:34:42.148469+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.148469+0000","last_undegraded":"2024-09-13T18:34:42.148469+0000","last_fullsized":"2024-09-13T18:34:42.148469+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:15.420852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.146054+0000","last_change":"2024-09-13T18:34:42.146054+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.146054+0000","last_undegraded":"2024-09-13T18:34:42.146054+0000","last_fullsized":"2024-09-13T18:34:42.146054+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:43.353153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.149777+0000","last_change":"2024-09-13T18:34:42.149777+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.149777+0000","last_undegraded":"2024-09-13T18:34:42.149777+0000","last_fullsized":"2024-09-13T18:34:42.149777+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:40.999672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.147007+0000","last_change":"2024-09-13T18:34:42.147007+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.147007+0000","last_undegraded":"2024-09-13T18:34:42.147007+0000","last_fullsized":"2024-09-13T18:34:42.147007+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:29.244927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.147840+0000","last_change":"2024-09-13T18:34:42.147840+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.147840+0000","last_undegraded":"2024-09-13T18:34:42.147840+0000","last_fullsized":"2024-09-13T18:34:42.147840+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:10.874792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.157895+0000","last_change":"2024-09-13T18:34:42.157895+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.157895+0000","last_undegraded":"2024-09-13T18:34:42.157895+0000","last_fullsized":"2024-09-13T18:34:42.157895+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:07.997319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.146161+0000","last_change":"2024-09-13T18:34:42.146161+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.146161+0000","last_undegraded":"2024-09-13T18:34:42.146161+0000","last_fullsized":"2024-09-13T18:34:42.146161+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:56.215129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.147620+0000","last_change":"2024-09-13T18:34:42.147620+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.147620+0000","last_undegraded":"2024-09-13T18:34:42.147620+0000","last_fullsized":"2024-09-13T18:34:42.147620+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:56.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.146745+0000","last_change":"2024-09-13T18:34:42.146745+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.146745+0000","last_undegraded":"2024-09-13T18:34:42.146745+0000","last_fullsized":"2024-09-13T18:34:42.146745+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:51.832792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.152574+0000","last_change":"2024-09-13T18:34:42.152574+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.152574+0000","last_undegraded":"2024-09-13T18:34:42.152574+0000","last_fullsized":"2024-09-13T18:34:42.152574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:35.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.149219+0000","last_change":"2024-09-13T18:34:42.149219+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.149219+0000","last_undegraded":"2024-09-13T18:34:42.149219+0000","last_fullsized":"2024-09-13T18:34:42.149219+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:17.668065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.151808+0000","last_change":"2024-09-13T18:34:42.151808+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.151808+0000","last_undegraded":"2024-09-13T18:34:42.151808+0000","last_fullsized":"2024-09-13T18:34:42.151808+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:51.392253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.146881+0000","last_change":"2024-09-13T18:34:42.146881+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.146881+0000","last_undegraded":"2024-09-13T18:34:42.146881+0000","last_fullsized":"2024-09-13T18:34:42.146881+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:43.909572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.152083+0000","last_change":"2024-09-13T18:34:42.152083+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.152083+0000","last_undegraded":"2024-09-13T18:34:42.152083+0000","last_fullsized":"2024-09-13T18:34:42.152083+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.883206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.146745+0000","last_change":"2024-09-13T18:34:42.146745+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.146745+0000","last_undegraded":"2024-09-13T18:34:42.146745+0000","last_fullsized":"2024-09-13T18:34:42.146745+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:19.446824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.150874+0000","last_change":"2024-09-13T18:34:42.150874+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.150874+0000","last_undegraded":"2024-09-13T18:34:42.150874+0000","last_fullsized":"2024-09-13T18:34:42.150874+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:10.874792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.150942+0000","last_change":"2024-09-13T18:34:42.150942+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.150942+0000","last_undegraded":"2024-09-13T18:34:42.150942+0000","last_fullsized":"2024-09-13T18:34:42.150942+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:51.832792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.148565+0000","last_change":"2024-09-13T18:34:42.148565+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.148565+0000","last_undegraded":"2024-09-13T18:34:42.148565+0000","last_fullsized":"2024-09-13T18:34:42.148565+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:33.095738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.152394+0000","last_change":"2024-09-13T18:34:42.152394+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.152394+0000","last_undegraded":"2024-09-13T18:34:42.152394+0000","last_fullsized":"2024-09-13T18:34:42.152394+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:55.875216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.158896+0000","last_change":"2024-09-13T18:34:42.158896+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.158896+0000","last_undegraded":"2024-09-13T18:34:42.158896+0000","last_fullsized":"2024-09-13T18:34:42.158896+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:42.377882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.148605+0000","last_change":"2024-09-13T18:34:42.148605+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.148605+0000","last_undegraded":"2024-09-13T18:34:42.148605+0000","last_fullsized":"2024-09-13T18:34:42.148605+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:16.395996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.150443+0000","last_change":"2024-09-13T18:34:42.150443+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.150443+0000","last_undegraded":"2024-09-13T18:34:42.150443+0000","last_fullsized":"2024-09-13T18:34:42.150443+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:18.840444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.158752+0000","last_change":"2024-09-13T18:34:42.158752+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.158752+0000","last_undegraded":"2024-09-13T18:34:42.158752+0000","last_fullsized":"2024-09-13T18:34:42.158752+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:03.881377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.149220+0000","last_change":"2024-09-13T18:34:42.149220+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.149220+0000","last_undegraded":"2024-09-13T18:34:42.149220+0000","last_fullsized":"2024-09-13T18:34:42.149220+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.146218+0000","last_change":"2024-09-13T18:34:42.146218+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.146218+0000","last_undegraded":"2024-09-13T18:34:42.146218+0000","last_fullsized":"2024-09-13T18:34:42.146218+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:29.636666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.150525+0000","last_change":"2024-09-13T18:34:42.150525+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.150525+0000","last_undegraded":"2024-09-13T18:34:42.150525+0000","last_fullsized":"2024-09-13T18:34:42.150525+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:15.420852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:34:43.139688+0000","last_change":"2024-09-13T18:34:43.139688+0000","last_active":"2024-09-13T18:34:43.139688+0000","last_peered":"2024-09-13T18:34:43.139688+0000","last_clean":"2024-09-13T18:34:43.139688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:43.139688+0000","last_undegraded":"2024-09-13T18:34:43.139688+0000","last_fullsized":"2024-09-13T18:34:43.139688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-13T18:34:42.150594+0000","last_change":"2024-09-13T18:34:42.150594+0000","last_active":"2024-09-13T18:34:42.130794+0000","last_peered":"2024-09-13T18:34:42.130794+0000","last_clean":"2024-09-13T18:34:42.130794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:34:42.150594+0000","last_undegraded":"2024-09-13T18:34:42.150594+0000","last_fullsized":"2024-09-13T18:34:42.150594+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:06.502535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":329,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-13T18:34:40.274614+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:34:40.274614+0000","last_peered":"2024-09-13T18:34:40.274614+0000","last_clean":"2024-09-13T18:34:40.274614+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:34:40.274614+0000","last_undegraded":"2024-09-13T18:34:40.274614+0000","last_fullsized":"2024-09-13T18:34:40.274614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":2688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2752512,"data_stored":1542376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.876,"15min":0.88600000000000001},"min":{"1min":0.49399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.399,"5min":1.399,"15min":1.6439999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.90500000000000003},"min":{"1min":0.63600000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.214,"5min":1.333,"15min":1.4410000000000001},"last":0.93600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89500000000000002,"15min":0.92100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2729999999999999,"5min":1.278,"15min":1.7270000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.93600000000000005},"min":{"1min":0.63800000000000001,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.6060000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81299999999999994,"15min":0.80800000000000005},"min":{"1min":0.66400000000000003,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.2210000000000001,"5min":1.276,"15min":1.276},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.61899999999999999,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.1519999999999999,"5min":1.296,"15min":1.9830000000000001},"last":0.749}]},{"osd":3,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86199999999999999,"15min":0.877},"min":{"1min":0.57699999999999996,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0980000000000001,"5min":1.2070000000000001,"15min":1.448},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.333,"5min":1.395,"15min":1.397},"last":1.109}]},{"osd":4,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89700000000000002,"15min":0.88900000000000001},"min":{"1min":0.59099999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1850000000000001,"5min":1.2569999999999999,"15min":1.3620000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93899999999999995,"15min":0.94099999999999995},"min":{"1min":0.70299999999999996,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.1919999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.97599999999999998,"15min":1.0209999999999999},"min":{"1min":0.76400000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2310000000000001,"5min":1.3320000000000001,"15min":1.877},"last":1.159},{"interface":"front","average":{"1min":1.077,"5min":0.997,"15min":0.98799999999999999},"min":{"1min":0.75,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.409,"15min":1.409},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0529999999999999,"15min":1.0600000000000001},"min":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.413,"5min":1.476,"15min":1.476},"last":1.089},{"interface":"front","average":{"1min":1.077,"5min":1.0309999999999999,"15min":1.0129999999999999},"min":{"1min":0.76900000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.341,"5min":1.361,"15min":1.506},"last":1.0700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574971,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2158592,"data_stored":952008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.26,"5min":1.47,"15min":2.9990000000000001},"last":1.002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80100000000000005,"15min":0.79700000000000004},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.1779999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.577},"last":1.075},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.208,"5min":1.218,"15min":1.464},"last":0.84799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.60099999999999998,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.673,"15min":2.4220000000000002},"last":1.2450000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90200000000000002,"15min":0.88700000000000001},"min":{"1min":0.59899999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.28,"5min":1.516,"15min":1.516},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89600000000000002,"15min":0.88700000000000001},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.23,"5min":1.2669999999999999,"15min":1.306},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.96499999999999997},"min":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.1639999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.0549999999999999,"15min":1.0209999999999999},"min":{"1min":0.84399999999999997,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.224,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2010000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.0269999999999999,"15min":1.0740000000000001},"min":{"1min":0.71699999999999997,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.371,"5min":1.4490000000000001,"15min":2.762},"last":1.1799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.0369999999999999},"min":{"1min":0.81200000000000006,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.389,"5min":1.5,"15min":1.9299999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.04,"15min":1.0389999999999999},"min":{"1min":0.76800000000000002,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.3300000000000001,"5min":1.357,"15min":1.72},"last":1.1060000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2158592,"data_stored":952008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79300000000000004,"15min":0.83699999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1659999999999999,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82899999999999996,"15min":0.88100000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.437},"max":{"1min":1.1759999999999999,"5min":1.264,"15min":2.1840000000000002},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.54400000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.603,"15min":1.603},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.83599999999999997,"15min":0.83299999999999996},"min":{"1min":0.51700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3169999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.627}]},{"osd":2,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.874},"min":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.872},{"interface":"front","average":{"1min":0.879,"5min":0.89800000000000002,"15min":0.94599999999999995},"min":{"1min":0.624,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.244,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93400000000000005,"15min":0.94999999999999996},"min":{"1min":0.56100000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3260000000000001,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1870000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.79300000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.96699999999999997,"15min":0.94699999999999995},"min":{"1min":0.77000000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.218,"5min":3.46,"15min":3.46},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.014,"15min":1.0309999999999999},"min":{"1min":0.76700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.4790000000000001,"5min":1.492,"15min":1.5049999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.71999999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.1919999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.998,"5min":0.97999999999999998,"15min":1.01},"min":{"1min":0.64800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.25,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0489999999999999,"15min":1.0900000000000001},"min":{"1min":0.70199999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4139999999999999,"5min":2.1600000000000001,"15min":2.246},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.137,"5min":1.0980000000000001,"15min":1.121},"min":{"1min":0.89600000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.357,"5min":3.649,"15min":3.649},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2158592,"data_stored":952008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.92600000000000005,"15min":0.84599999999999997},"min":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.159,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.91400000000000003,"15min":0.88700000000000001},"min":{"1min":0.61199999999999999,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.222,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.83499999999999996},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.1819999999999999,"5min":1.2589999999999999,"15min":1.536},"last":0.746},{"interface":"front","average":{"1min":0.877,"5min":0.92000000000000004,"15min":0.89200000000000002},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.1779999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.96899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91000000000000003,"15min":0.88},"min":{"1min":0.56599999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.159,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.89100000000000001,"15min":0.89700000000000002},"min":{"1min":0.63,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.226,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.032}]},{"osd":3,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.64300000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2989999999999999,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.94899999999999995},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.0900000000000001,"5min":10.44,"15min":10.44},"last":0.84699999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.96899999999999997,"15min":0.95099999999999996},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.194,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.167},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.002,"15min":0.97399999999999998},"min":{"1min":0.71699999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3009999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.137}]},{"osd":6,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.1220000000000001,"15min":1.022},"min":{"1min":0.504,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1830000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.052,"5min":1.2390000000000001,"15min":1.089},"min":{"1min":0.80300000000000005,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.085}]},{"osd":7,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.2010000000000001,"15min":1.0940000000000001},"min":{"1min":0.84999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.23,"5min":15.593,"15min":15.593},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.079,"15min":1.0720000000000001},"min":{"1min":0.77700000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.2729999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.0009999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":2158592,"data_stored":952008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98699999999999999,"5min":1.444,"15min":2.113},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.89300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.34100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.33700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96699999999999997,"5min":1.4850000000000001,"15min":1.742},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.74099999999999999},"min":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":1.222,"15min":1.399},"last":0.82999999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95699999999999996,"15min":1.0640000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":0.91500000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":0.99199999999999999},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1279999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.103},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.349,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":0.98399999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95899999999999996,"15min":1.0369999999999999},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.99099999999999999,"15min":1.034},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.454,"5min":1.6890000000000001,"15min":1.96},"last":1.1839999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.02,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.413,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97399999999999998,"15min":1.0009999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.504,"5min":1.504,"15min":2.9220000000000002},"last":1.0820000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41416,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330424,"statfs":{"total":96636764160,"available":96594354176,"internally_reserved":0,"allocated":2158592,"data_stored":952008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60599999999999998,"15min":0.58799999999999997},"min":{"1min":0.29799999999999999,"5min":0.246,"15min":0.246},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.98599999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":1.119},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64800000000000002,"15min":0.69599999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.307},"max":{"1min":1.0529999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.39100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.2250000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1930000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.92500000000000004,"15min":0.91800000000000004},"min":{"1min":0.61699999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.611},"last":1.484},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89200000000000002,"15min":0.91000000000000003},"min":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.248,"5min":1.587,"15min":1.587},"last":1.754}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96999999999999997,"15min":0.99299999999999999},"min":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.3500000000000001,"5min":1.548,"15min":1.9179999999999999},"last":1.446},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.58599999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.589,"5min":1.589,"15min":1.702},"last":1.2749999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.5},"max":{"1min":1.258,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.401},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.036},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.3600000000000001,"5min":1.645,"15min":1.645},"last":1.353}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.843,"15min":1.843},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.036,"15min":1.071},"min":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":1.522}]}]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41416,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330424,"statfs":{"total":96636764160,"available":96594354176,"internally_reserved":0,"allocated":2158592,"data_stored":952008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64300000000000002,"15min":0.623},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.314,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.91300000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.2430000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1100000000000001,"5min":1.423,"15min":1.423},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88900000000000001,"15min":0.90400000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.367,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.02},"min":{"1min":0.60599999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64000000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.335,"5min":1.5900000000000001,"15min":1.653},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.61699999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.028,"15min":1.0229999999999999},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.649,"15min":1.649},"last":0.82799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41996,"kb_used_data":2688,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329844,"statfs":{"total":96636764160,"available":96593760256,"internally_reserved":0,"allocated":2752512,"data_stored":1542376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.64400000000000002},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86399999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.4359999999999999},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.93899999999999995,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65000000000000002,"15min":0.68600000000000005},"min":{"1min":0.38200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.7589999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.5129999999999999},"last":0.99299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.92000000000000004},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93700000000000006,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.458,"5min":1.5069999999999999,"15min":1.986},"last":1.1120000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96199999999999997,"15min":0.997},"min":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.583,"5min":1.583,"15min":2.641},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96899999999999997,"15min":1.024},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.6699999999999999},"last":1.165}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.002,"15min":1.0580000000000001},"min":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.891},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.016},"min":{"1min":0.69099999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3700000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.1359999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.427,"5min":1.669,"15min":2.2949999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.536,"5min":1.6930000000000001,"15min":2.2480000000000002},"last":1.0600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:34:47.574 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:34:47.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b65cea640 1 Processor -- start 2024-09-13T18:34:47.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b65cea640 1 -- start start 2024-09-13T18:34:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b65cea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b600713a0 0x7f1b60165100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b65cea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6006d480 con 0x7f1b601582a0 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b65cea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6015ace0 con 0x7f1b6015b7c0 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b65cea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6015aaf0 con 0x7f1b600713a0 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b5ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b600713a0 0x7f1b60165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b5f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1b601582a0 0x7f1b6006c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51892/0 (socket says 172.21.15.53:51892) 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b5f7fe640 1 -- 172.21.15.53:0/1432401772 learned_addr learned my addr 172.21.15.53:0/1432401772 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b5ffff640 1 -- 172.21.15.53:0/1432401772 >> v1:172.21.15.87:6789/0 conn(0x7f1b6015b7c0 legacy=0x7f1b60070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b5ffff640 1 -- 172.21.15.53:0/1432401772 >> v1:172.21.15.53:6789/0 conn(0x7f1b601582a0 legacy=0x7f1b6006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b5ffff640 1 -- 172.21.15.53:0/1432401772 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6015afc0 con 0x7f1b600713a0 2024-09-13T18:34:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.731+0000 7f1b5effd640 1 -- 172.21.15.53:0/1432401772 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078541764 0 0) 0x7f1b6006d480 con 0x7f1b601582a0 2024-09-13T18:34:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5ffff640 1 --2- 172.21.15.53:0/1432401772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60165100 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009d90 tx=0x7f1b5801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9905f7eac9995370 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5effd640 1 -- 172.21.15.53:0/1432401772 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580a5940 con 0x7f1b600713a0 2024-09-13T18:34:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5effd640 1 -- 172.21.15.53:0/1432401772 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b580a5aa0 con 0x7f1b600713a0 2024-09-13T18:34:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5effd640 1 -- 172.21.15.53:0/1432401772 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580a5e30 con 0x7f1b600713a0 2024-09-13T18:34:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- 172.21.15.53:0/1432401772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 msgr2=0x7f1b60165100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1432401772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60165100 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009d90 tx=0x7f1b5801c970 comp rx=0 tx=0).stop 2024-09-13T18:34:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- 172.21.15.53:0/1432401772 shutdown_connections 2024-09-13T18:34:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1432401772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60165100 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- 172.21.15.53:0/1432401772 >> 172.21.15.53:0/1432401772 conn(0x7f1b60065c80 msgr2=0x7f1b60066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- 172.21.15.53:0/1432401772 shutdown_connections 2024-09-13T18:34:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- 172.21.15.53:0/1432401772 wait complete. 2024-09-13T18:34:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 Processor -- start 2024-09-13T18:34:47.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- start start 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b601582a0 0x7f1b6006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b6015b7c0 0x7f1b60155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6006ff30 con 0x7f1b600713a0 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60151380 con 0x7f1b6015b7c0 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60151640 con 0x7f1b601582a0 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55846/0 (socket says 172.21.15.53:55846) 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 -- 172.21.15.53:0/1431877492 learned_addr learned my addr 172.21.15.53:0/1431877492 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b56ffd640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b601582a0 0x7f1b6006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 -- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b601582a0 msgr2=0x7f1b6006f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b601582a0 0x7f1b6006f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 -- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b6015b7c0 msgr2=0x7f1b60155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5ffff640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b6015b7c0 0x7f1b60155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b6015b7c0 0x7f1b60155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 -- 172.21.15.53:0/1431877492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58009a70 con 0x7f1b600713a0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5f7fe640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60152400 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000c4a0 tx=0x7f1b5000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5cff9640 1 -- 172.21.15.53:0/1431877492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500074e0 con 0x7f1b600713a0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5cff9640 1 -- 172.21.15.53:0/1431877492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50007640 con 0x7f1b600713a0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b60151920 con 0x7f1b600713a0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.735+0000 7f1b5cff9640 1 -- 172.21.15.53:0/1431877492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50004a30 con 0x7f1b600713a0 2024-09-13T18:34:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.739+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b60151ee0 con 0x7f1b600713a0 2024-09-13T18:34:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.739+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60152940 con 0x7f1b600713a0 2024-09-13T18:34:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.739+0000 7f1b5cff9640 1 -- 172.21.15.53:0/1431877492 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f1b50004b90 con 0x7f1b600713a0 2024-09-13T18:34:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.739+0000 7f1b5cff9640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1b40067050 0x7f1b40069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.739+0000 7f1b5cff9640 1 -- 172.21.15.53:0/1431877492 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b500820d0 con 0x7f1b600713a0 2024-09-13T18:34:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.739+0000 7f1b56ffd640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1b40067050 0x7f1b40069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:47.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.739+0000 7f1b56ffd640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1b40067050 0x7f1b40069510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1b6014ddb0 tx=0x7f1b48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:47.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.743+0000 7f1b5cff9640 1 -- 172.21.15.53:0/1431877492 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b50050cf0 con 0x7f1b600713a0 2024-09-13T18:34:47.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.903+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b60067400 con 0x7f1b40067050 2024-09-13T18:34:47.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.923+0000 7f1b5cff9640 1 -- 172.21.15.53:0/1431877492 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288406 (secure 0 0 0) 0x7f1b60067400 con 0x7f1b40067050 2024-09-13T18:34:47.929 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:47.931 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:34:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1b40067050 msgr2=0x7f1b40069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1b40067050 0x7f1b40069510 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1b6014ddb0 tx=0x7f1b48009040 comp rx=0 tx=0).stop 2024-09-13T18:34:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 msgr2=0x7f1b60152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60152400 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000c4a0 tx=0x7f1b5000c960 comp rx=0 tx=0).stop 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 shutdown_connections 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1b40067050 0x7f1b40069510 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b601582a0 0x7f1b6006f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b6015b7c0 0x7f1b60155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 --2- 172.21.15.53:0/1431877492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b600713a0 0x7f1b60152400 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 >> 172.21.15.53:0/1431877492 conn(0x7f1b60065c80 msgr2=0x7f1b60070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 shutdown_connections 2024-09-13T18:34:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:47.927+0000 7f1b65cea640 1 -- 172.21.15.53:0/1431877492 wait complete. 2024-09-13T18:34:47.950 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-09-13T18:34:47.904225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300092,"kb_used_data":18376,"kb_used_omap":12,"kb_used_meta":281587,"kb_avail":754674628,"statfs":{"total":773094113280,"available":772786819072,"internally_reserved":0,"allocated":18817024,"data_stored":8956324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":288345656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762475"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547386+0000","last_change":"2024-09-13T18:34:43.589856+0000","last_active":"2024-09-13T18:34:44.547386+0000","last_peered":"2024-09-13T18:34:44.547386+0000","last_clean":"2024-09-13T18:34:44.547386+0000","last_became_active":"2024-09-13T18:34:43.589396+0000","last_became_peered":"2024-09-13T18:34:43.589396+0000","last_unstale":"2024-09-13T18:34:44.547386+0000","last_undegraded":"2024-09-13T18:34:44.547386+0000","last_fullsized":"2024-09-13T18:34:44.547386+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:08.406171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175403+0000","last_change":"2024-09-13T18:34:43.601005+0000","last_active":"2024-09-13T18:34:47.175403+0000","last_peered":"2024-09-13T18:34:47.175403+0000","last_clean":"2024-09-13T18:34:47.175403+0000","last_became_active":"2024-09-13T18:34:43.600336+0000","last_became_peered":"2024-09-13T18:34:43.600336+0000","last_unstale":"2024-09-13T18:34:47.175403+0000","last_undegraded":"2024-09-13T18:34:47.175403+0000","last_fullsized":"2024-09-13T18:34:47.175403+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:06.677125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.173611+0000","last_change":"2024-09-13T18:34:43.589430+0000","last_active":"2024-09-13T18:34:47.173611+0000","last_peered":"2024-09-13T18:34:47.173611+0000","last_clean":"2024-09-13T18:34:47.173611+0000","last_became_active":"2024-09-13T18:34:43.589137+0000","last_became_peered":"2024-09-13T18:34:43.589137+0000","last_unstale":"2024-09-13T18:34:47.173611+0000","last_undegraded":"2024-09-13T18:34:47.173611+0000","last_fullsized":"2024-09-13T18:34:47.173611+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:52.142637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.474601+0000","last_change":"2024-09-13T18:34:43.595552+0000","last_active":"2024-09-13T18:34:45.474601+0000","last_peered":"2024-09-13T18:34:45.474601+0000","last_clean":"2024-09-13T18:34:45.474601+0000","last_became_active":"2024-09-13T18:34:43.592583+0000","last_became_peered":"2024-09-13T18:34:43.592583+0000","last_unstale":"2024-09-13T18:34:45.474601+0000","last_undegraded":"2024-09-13T18:34:45.474601+0000","last_fullsized":"2024-09-13T18:34:45.474601+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:43.806630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.739110+0000","last_change":"2024-09-13T18:34:43.550287+0000","last_active":"2024-09-13T18:34:45.739110+0000","last_peered":"2024-09-13T18:34:45.739110+0000","last_clean":"2024-09-13T18:34:45.739110+0000","last_became_active":"2024-09-13T18:34:43.549827+0000","last_became_peered":"2024-09-13T18:34:43.549827+0000","last_unstale":"2024-09-13T18:34:45.739110+0000","last_undegraded":"2024-09-13T18:34:45.739110+0000","last_fullsized":"2024-09-13T18:34:45.739110+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:57.224022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.738960+0000","last_change":"2024-09-13T18:34:43.575379+0000","last_active":"2024-09-13T18:34:45.738960+0000","last_peered":"2024-09-13T18:34:45.738960+0000","last_clean":"2024-09-13T18:34:45.738960+0000","last_became_active":"2024-09-13T18:34:43.575028+0000","last_became_peered":"2024-09-13T18:34:43.575028+0000","last_unstale":"2024-09-13T18:34:45.738960+0000","last_undegraded":"2024-09-13T18:34:45.738960+0000","last_fullsized":"2024-09-13T18:34:45.738960+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:06.677125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547083+0000","last_change":"2024-09-13T18:34:43.554994+0000","last_active":"2024-09-13T18:34:44.547083+0000","last_peered":"2024-09-13T18:34:44.547083+0000","last_clean":"2024-09-13T18:34:44.547083+0000","last_became_active":"2024-09-13T18:34:43.554695+0000","last_became_peered":"2024-09-13T18:34:43.554695+0000","last_unstale":"2024-09-13T18:34:44.547083+0000","last_undegraded":"2024-09-13T18:34:44.547083+0000","last_fullsized":"2024-09-13T18:34:44.547083+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:02.027915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.738811+0000","last_change":"2024-09-13T18:34:43.554059+0000","last_active":"2024-09-13T18:34:45.738811+0000","last_peered":"2024-09-13T18:34:45.738811+0000","last_clean":"2024-09-13T18:34:45.738811+0000","last_became_active":"2024-09-13T18:34:43.553812+0000","last_became_peered":"2024-09-13T18:34:43.553812+0000","last_unstale":"2024-09-13T18:34:45.738811+0000","last_undegraded":"2024-09-13T18:34:45.738811+0000","last_fullsized":"2024-09-13T18:34:45.738811+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:30.253821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.176159+0000","last_change":"2024-09-13T18:34:43.592773+0000","last_active":"2024-09-13T18:34:47.176159+0000","last_peered":"2024-09-13T18:34:47.176159+0000","last_clean":"2024-09-13T18:34:47.176159+0000","last_became_active":"2024-09-13T18:34:43.591644+0000","last_became_peered":"2024-09-13T18:34:43.591644+0000","last_unstale":"2024-09-13T18:34:47.176159+0000","last_undegraded":"2024-09-13T18:34:47.176159+0000","last_fullsized":"2024-09-13T18:34:47.176159+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:26.218476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672331+0000","last_change":"2024-09-13T18:34:43.553091+0000","last_active":"2024-09-13T18:34:45.672331+0000","last_peered":"2024-09-13T18:34:45.672331+0000","last_clean":"2024-09-13T18:34:45.672331+0000","last_became_active":"2024-09-13T18:34:43.552833+0000","last_became_peered":"2024-09-13T18:34:43.552833+0000","last_unstale":"2024-09-13T18:34:45.672331+0000","last_undegraded":"2024-09-13T18:34:45.672331+0000","last_fullsized":"2024-09-13T18:34:45.672331+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:32.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.173721+0000","last_change":"2024-09-13T18:34:43.578510+0000","last_active":"2024-09-13T18:34:47.173721+0000","last_peered":"2024-09-13T18:34:47.173721+0000","last_clean":"2024-09-13T18:34:47.173721+0000","last_became_active":"2024-09-13T18:34:43.578230+0000","last_became_peered":"2024-09-13T18:34:43.578230+0000","last_unstale":"2024-09-13T18:34:47.173721+0000","last_undegraded":"2024-09-13T18:34:47.173721+0000","last_fullsized":"2024-09-13T18:34:47.173721+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:42.008566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672976+0000","last_change":"2024-09-13T18:34:43.575098+0000","last_active":"2024-09-13T18:34:45.672976+0000","last_peered":"2024-09-13T18:34:45.672976+0000","last_clean":"2024-09-13T18:34:45.672976+0000","last_became_active":"2024-09-13T18:34:43.574416+0000","last_became_peered":"2024-09-13T18:34:43.574416+0000","last_unstale":"2024-09-13T18:34:45.672976+0000","last_undegraded":"2024-09-13T18:34:45.672976+0000","last_fullsized":"2024-09-13T18:34:45.672976+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:44.362046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.673070+0000","last_change":"2024-09-13T18:34:43.580941+0000","last_active":"2024-09-13T18:34:45.673070+0000","last_peered":"2024-09-13T18:34:45.673070+0000","last_clean":"2024-09-13T18:34:45.673070+0000","last_became_active":"2024-09-13T18:34:43.579367+0000","last_became_peered":"2024-09-13T18:34:43.579367+0000","last_unstale":"2024-09-13T18:34:45.673070+0000","last_undegraded":"2024-09-13T18:34:45.673070+0000","last_fullsized":"2024-09-13T18:34:45.673070+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:57.224022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547134+0000","last_change":"2024-09-13T18:34:43.578004+0000","last_active":"2024-09-13T18:34:44.547134+0000","last_peered":"2024-09-13T18:34:44.547134+0000","last_clean":"2024-09-13T18:34:44.547134+0000","last_became_active":"2024-09-13T18:34:43.577751+0000","last_became_peered":"2024-09-13T18:34:43.577751+0000","last_unstale":"2024-09-13T18:34:44.547134+0000","last_undegraded":"2024-09-13T18:34:44.547134+0000","last_fullsized":"2024-09-13T18:34:44.547134+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:32.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547210+0000","last_change":"2024-09-13T18:34:43.550534+0000","last_active":"2024-09-13T18:34:44.547210+0000","last_peered":"2024-09-13T18:34:44.547210+0000","last_clean":"2024-09-13T18:34:44.547210+0000","last_became_active":"2024-09-13T18:34:43.550278+0000","last_became_peered":"2024-09-13T18:34:43.550278+0000","last_unstale":"2024-09-13T18:34:44.547210+0000","last_undegraded":"2024-09-13T18:34:44.547210+0000","last_fullsized":"2024-09-13T18:34:44.547210+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:38.314170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.671496+0000","last_change":"2024-09-13T18:34:43.579331+0000","last_active":"2024-09-13T18:34:45.671496+0000","last_peered":"2024-09-13T18:34:45.671496+0000","last_clean":"2024-09-13T18:34:45.671496+0000","last_became_active":"2024-09-13T18:34:43.579111+0000","last_became_peered":"2024-09-13T18:34:43.579111+0000","last_unstale":"2024-09-13T18:34:45.671496+0000","last_undegraded":"2024-09-13T18:34:45.671496+0000","last_fullsized":"2024-09-13T18:34:45.671496+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:32.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547456+0000","last_change":"2024-09-13T18:34:43.589739+0000","last_active":"2024-09-13T18:34:44.547456+0000","last_peered":"2024-09-13T18:34:44.547456+0000","last_clean":"2024-09-13T18:34:44.547456+0000","last_became_active":"2024-09-13T18:34:43.589015+0000","last_became_peered":"2024-09-13T18:34:43.589015+0000","last_unstale":"2024-09-13T18:34:44.547456+0000","last_undegraded":"2024-09-13T18:34:44.547456+0000","last_fullsized":"2024-09-13T18:34:44.547456+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:35:00.907133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672291+0000","last_change":"2024-09-13T18:34:43.550391+0000","last_active":"2024-09-13T18:34:45.672291+0000","last_peered":"2024-09-13T18:34:45.672291+0000","last_clean":"2024-09-13T18:34:45.672291+0000","last_became_active":"2024-09-13T18:34:43.550096+0000","last_became_peered":"2024-09-13T18:34:43.550096+0000","last_unstale":"2024-09-13T18:34:45.672291+0000","last_undegraded":"2024-09-13T18:34:45.672291+0000","last_fullsized":"2024-09-13T18:34:45.672291+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:18.890951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672440+0000","last_change":"2024-09-13T18:34:43.553060+0000","last_active":"2024-09-13T18:34:45.672440+0000","last_peered":"2024-09-13T18:34:45.672440+0000","last_clean":"2024-09-13T18:34:45.672440+0000","last_became_active":"2024-09-13T18:34:43.552775+0000","last_became_peered":"2024-09-13T18:34:43.552775+0000","last_unstale":"2024-09-13T18:34:45.672440+0000","last_undegraded":"2024-09-13T18:34:45.672440+0000","last_fullsized":"2024-09-13T18:34:45.672440+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:44.414463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.739218+0000","last_change":"2024-09-13T18:34:43.549091+0000","last_active":"2024-09-13T18:34:45.739218+0000","last_peered":"2024-09-13T18:34:45.739218+0000","last_clean":"2024-09-13T18:34:45.739218+0000","last_became_active":"2024-09-13T18:34:43.548818+0000","last_became_peered":"2024-09-13T18:34:43.548818+0000","last_unstale":"2024-09-13T18:34:45.739218+0000","last_undegraded":"2024-09-13T18:34:45.739218+0000","last_fullsized":"2024-09-13T18:34:45.739218+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:57.612683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.474490+0000","last_change":"2024-09-13T18:34:43.590166+0000","last_active":"2024-09-13T18:34:45.474490+0000","last_peered":"2024-09-13T18:34:45.474490+0000","last_clean":"2024-09-13T18:34:45.474490+0000","last_became_active":"2024-09-13T18:34:43.589468+0000","last_became_peered":"2024-09-13T18:34:43.589468+0000","last_unstale":"2024-09-13T18:34:45.474490+0000","last_undegraded":"2024-09-13T18:34:45.474490+0000","last_fullsized":"2024-09-13T18:34:45.474490+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:20.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.549273+0000","last_change":"2024-09-13T18:34:43.556291+0000","last_active":"2024-09-13T18:34:44.549273+0000","last_peered":"2024-09-13T18:34:44.549273+0000","last_clean":"2024-09-13T18:34:44.549273+0000","last_became_active":"2024-09-13T18:34:43.553663+0000","last_became_peered":"2024-09-13T18:34:43.553663+0000","last_unstale":"2024-09-13T18:34:44.549273+0000","last_undegraded":"2024-09-13T18:34:44.549273+0000","last_fullsized":"2024-09-13T18:34:44.549273+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:11.285246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.549223+0000","last_change":"2024-09-13T18:34:43.562413+0000","last_active":"2024-09-13T18:34:44.549223+0000","last_peered":"2024-09-13T18:34:44.549223+0000","last_clean":"2024-09-13T18:34:44.549223+0000","last_became_active":"2024-09-13T18:34:43.558132+0000","last_became_peered":"2024-09-13T18:34:43.558132+0000","last_unstale":"2024-09-13T18:34:44.549223+0000","last_undegraded":"2024-09-13T18:34:44.549223+0000","last_fullsized":"2024-09-13T18:34:44.549223+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:20.546725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.474685+0000","last_change":"2024-09-13T18:34:43.593445+0000","last_active":"2024-09-13T18:34:45.474685+0000","last_peered":"2024-09-13T18:34:45.474685+0000","last_clean":"2024-09-13T18:34:45.474685+0000","last_became_active":"2024-09-13T18:34:43.591105+0000","last_became_peered":"2024-09-13T18:34:43.591105+0000","last_unstale":"2024-09-13T18:34:45.474685+0000","last_undegraded":"2024-09-13T18:34:45.474685+0000","last_fullsized":"2024-09-13T18:34:45.474685+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:25.051887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175961+0000","last_change":"2024-09-13T18:34:43.587705+0000","last_active":"2024-09-13T18:34:47.175961+0000","last_peered":"2024-09-13T18:34:47.175961+0000","last_clean":"2024-09-13T18:34:47.175961+0000","last_became_active":"2024-09-13T18:34:43.586611+0000","last_became_peered":"2024-09-13T18:34:43.586611+0000","last_unstale":"2024-09-13T18:34:47.175961+0000","last_undegraded":"2024-09-13T18:34:47.175961+0000","last_fullsized":"2024-09-13T18:34:47.175961+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:57.224022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547514+0000","last_change":"2024-09-13T18:34:43.550777+0000","last_active":"2024-09-13T18:34:44.547514+0000","last_peered":"2024-09-13T18:34:44.547514+0000","last_clean":"2024-09-13T18:34:44.547514+0000","last_became_active":"2024-09-13T18:34:43.550522+0000","last_became_peered":"2024-09-13T18:34:43.550522+0000","last_unstale":"2024-09-13T18:34:44.547514+0000","last_undegraded":"2024-09-13T18:34:44.547514+0000","last_fullsized":"2024-09-13T18:34:44.547514+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:19.909467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.673215+0000","last_change":"2024-09-13T18:34:43.582896+0000","last_active":"2024-09-13T18:34:45.673215+0000","last_peered":"2024-09-13T18:34:45.673215+0000","last_clean":"2024-09-13T18:34:45.673215+0000","last_became_active":"2024-09-13T18:34:43.581545+0000","last_became_peered":"2024-09-13T18:34:43.581545+0000","last_unstale":"2024-09-13T18:34:45.673215+0000","last_undegraded":"2024-09-13T18:34:45.673215+0000","last_fullsized":"2024-09-13T18:34:45.673215+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:50.857035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.173446+0000","last_change":"2024-09-13T18:34:43.552272+0000","last_active":"2024-09-13T18:34:47.173446+0000","last_peered":"2024-09-13T18:34:47.173446+0000","last_clean":"2024-09-13T18:34:47.173446+0000","last_became_active":"2024-09-13T18:34:43.551720+0000","last_became_peered":"2024-09-13T18:34:43.551720+0000","last_unstale":"2024-09-13T18:34:47.173446+0000","last_undegraded":"2024-09-13T18:34:47.173446+0000","last_fullsized":"2024-09-13T18:34:47.173446+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:24.972366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672797+0000","last_change":"2024-09-13T18:34:43.583041+0000","last_active":"2024-09-13T18:34:45.672797+0000","last_peered":"2024-09-13T18:34:45.672797+0000","last_clean":"2024-09-13T18:34:45.672797+0000","last_became_active":"2024-09-13T18:34:43.581718+0000","last_became_peered":"2024-09-13T18:34:43.581718+0000","last_unstale":"2024-09-13T18:34:45.672797+0000","last_undegraded":"2024-09-13T18:34:45.672797+0000","last_fullsized":"2024-09-13T18:34:45.672797+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:30.645560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175175+0000","last_change":"2024-09-13T18:34:43.574433+0000","last_active":"2024-09-13T18:34:47.175175+0000","last_peered":"2024-09-13T18:34:47.175175+0000","last_clean":"2024-09-13T18:34:47.175175+0000","last_became_active":"2024-09-13T18:34:43.567904+0000","last_became_peered":"2024-09-13T18:34:43.567904+0000","last_unstale":"2024-09-13T18:34:47.175175+0000","last_undegraded":"2024-09-13T18:34:47.175175+0000","last_fullsized":"2024-09-13T18:34:47.175175+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:44.362046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.671556+0000","last_change":"2024-09-13T18:34:43.588630+0000","last_active":"2024-09-13T18:34:45.671556+0000","last_peered":"2024-09-13T18:34:45.671556+0000","last_clean":"2024-09-13T18:34:45.671556+0000","last_became_active":"2024-09-13T18:34:43.588314+0000","last_became_peered":"2024-09-13T18:34:43.588314+0000","last_unstale":"2024-09-13T18:34:45.671556+0000","last_undegraded":"2024-09-13T18:34:45.671556+0000","last_fullsized":"2024-09-13T18:34:45.671556+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:31.776797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547138+0000","last_change":"2024-09-13T18:34:43.551291+0000","last_active":"2024-09-13T18:34:44.547138+0000","last_peered":"2024-09-13T18:34:44.547138+0000","last_clean":"2024-09-13T18:34:44.547138+0000","last_became_active":"2024-09-13T18:34:43.551026+0000","last_became_peered":"2024-09-13T18:34:43.551026+0000","last_unstale":"2024-09-13T18:34:44.547138+0000","last_undegraded":"2024-09-13T18:34:44.547138+0000","last_fullsized":"2024-09-13T18:34:44.547138+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:44.757476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175616+0000","last_change":"2024-09-13T18:34:43.592368+0000","last_active":"2024-09-13T18:34:47.175616+0000","last_peered":"2024-09-13T18:34:47.175616+0000","last_clean":"2024-09-13T18:34:47.175616+0000","last_became_active":"2024-09-13T18:34:43.590857+0000","last_became_peered":"2024-09-13T18:34:43.590857+0000","last_unstale":"2024-09-13T18:34:47.175616+0000","last_undegraded":"2024-09-13T18:34:47.175616+0000","last_fullsized":"2024-09-13T18:34:47.175616+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:57.612683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"173'4","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.600544+0000","last_change":"2024-09-13T18:34:43.181621+0000","last_active":"2024-09-13T18:34:43.600544+0000","last_peered":"2024-09-13T18:34:43.600544+0000","last_clean":"2024-09-13T18:34:43.600544+0000","last_became_active":"2024-09-13T18:34:43.180964+0000","last_became_peered":"2024-09-13T18:34:43.180964+0000","last_unstale":"2024-09-13T18:34:43.600544+0000","last_undegraded":"2024-09-13T18:34:43.600544+0000","last_fullsized":"2024-09-13T18:34:43.600544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.550136+0000","last_change":"2024-09-13T18:34:43.582356+0000","last_active":"2024-09-13T18:34:44.550136+0000","last_peered":"2024-09-13T18:34:44.550136+0000","last_clean":"2024-09-13T18:34:44.550136+0000","last_became_active":"2024-09-13T18:34:43.581633+0000","last_became_peered":"2024-09-13T18:34:43.581633+0000","last_unstale":"2024-09-13T18:34:44.550136+0000","last_undegraded":"2024-09-13T18:34:44.550136+0000","last_fullsized":"2024-09-13T18:34:44.550136+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:31.636392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.602552+0000","last_change":"2024-09-13T18:34:43.186736+0000","last_active":"2024-09-13T18:34:43.602552+0000","last_peered":"2024-09-13T18:34:43.602552+0000","last_clean":"2024-09-13T18:34:43.602552+0000","last_became_active":"2024-09-13T18:34:43.185006+0000","last_became_peered":"2024-09-13T18:34:43.185006+0000","last_unstale":"2024-09-13T18:34:43.602552+0000","last_undegraded":"2024-09-13T18:34:43.602552+0000","last_fullsized":"2024-09-13T18:34:43.602552+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:30.046030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547816+0000","last_change":"2024-09-13T18:34:43.550325+0000","last_active":"2024-09-13T18:34:44.547816+0000","last_peered":"2024-09-13T18:34:44.547816+0000","last_clean":"2024-09-13T18:34:44.547816+0000","last_became_active":"2024-09-13T18:34:43.550118+0000","last_became_peered":"2024-09-13T18:34:43.550118+0000","last_unstale":"2024-09-13T18:34:44.547816+0000","last_undegraded":"2024-09-13T18:34:44.547816+0000","last_fullsized":"2024-09-13T18:34:44.547816+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:04.377330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.589167+0000","last_change":"2024-09-13T18:34:43.180737+0000","last_active":"2024-09-13T18:34:43.589167+0000","last_peered":"2024-09-13T18:34:43.589167+0000","last_clean":"2024-09-13T18:34:43.589167+0000","last_became_active":"2024-09-13T18:34:43.180464+0000","last_became_peered":"2024-09-13T18:34:43.180464+0000","last_unstale":"2024-09-13T18:34:43.589167+0000","last_undegraded":"2024-09-13T18:34:43.589167+0000","last_fullsized":"2024-09-13T18:34:43.589167+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:10.029285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672200+0000","last_change":"2024-09-13T18:34:43.552595+0000","last_active":"2024-09-13T18:34:45.672200+0000","last_peered":"2024-09-13T18:34:45.672200+0000","last_clean":"2024-09-13T18:34:45.672200+0000","last_became_active":"2024-09-13T18:34:43.552319+0000","last_became_peered":"2024-09-13T18:34:43.552319+0000","last_unstale":"2024-09-13T18:34:45.672200+0000","last_undegraded":"2024-09-13T18:34:45.672200+0000","last_fullsized":"2024-09-13T18:34:45.672200+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:22.663881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.591158+0000","last_change":"2024-09-13T18:34:43.186209+0000","last_active":"2024-09-13T18:34:43.591158+0000","last_peered":"2024-09-13T18:34:43.591158+0000","last_clean":"2024-09-13T18:34:43.591158+0000","last_became_active":"2024-09-13T18:34:43.185483+0000","last_became_peered":"2024-09-13T18:34:43.185483+0000","last_unstale":"2024-09-13T18:34:43.591158+0000","last_undegraded":"2024-09-13T18:34:43.591158+0000","last_fullsized":"2024-09-13T18:34:43.591158+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:17.625818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.474553+0000","last_change":"2024-09-13T18:34:43.591510+0000","last_active":"2024-09-13T18:34:45.474553+0000","last_peered":"2024-09-13T18:34:45.474553+0000","last_clean":"2024-09-13T18:34:45.474553+0000","last_became_active":"2024-09-13T18:34:43.590752+0000","last_became_peered":"2024-09-13T18:34:43.590752+0000","last_unstale":"2024-09-13T18:34:45.474553+0000","last_undegraded":"2024-09-13T18:34:45.474553+0000","last_fullsized":"2024-09-13T18:34:45.474553+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:11.883685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.569165+0000","last_change":"2024-09-13T18:34:43.183765+0000","last_active":"2024-09-13T18:34:43.569165+0000","last_peered":"2024-09-13T18:34:43.569165+0000","last_clean":"2024-09-13T18:34:43.569165+0000","last_became_active":"2024-09-13T18:34:43.181990+0000","last_became_peered":"2024-09-13T18:34:43.181990+0000","last_unstale":"2024-09-13T18:34:43.569165+0000","last_undegraded":"2024-09-13T18:34:43.569165+0000","last_fullsized":"2024-09-13T18:34:43.569165+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:55.298996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.738897+0000","last_change":"2024-09-13T18:34:43.588306+0000","last_active":"2024-09-13T18:34:45.738897+0000","last_peered":"2024-09-13T18:34:45.738897+0000","last_clean":"2024-09-13T18:34:45.738897+0000","last_became_active":"2024-09-13T18:34:43.588013+0000","last_became_peered":"2024-09-13T18:34:43.588013+0000","last_unstale":"2024-09-13T18:34:45.738897+0000","last_undegraded":"2024-09-13T18:34:45.738897+0000","last_fullsized":"2024-09-13T18:34:45.738897+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:04.890270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.543979+0000","last_change":"2024-09-13T18:34:43.175908+0000","last_active":"2024-09-13T18:34:43.543979+0000","last_peered":"2024-09-13T18:34:43.543979+0000","last_clean":"2024-09-13T18:34:43.543979+0000","last_became_active":"2024-09-13T18:34:43.175595+0000","last_became_peered":"2024-09-13T18:34:43.175595+0000","last_unstale":"2024-09-13T18:34:43.543979+0000","last_undegraded":"2024-09-13T18:34:43.543979+0000","last_fullsized":"2024-09-13T18:34:43.543979+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:15.420852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.474475+0000","last_change":"2024-09-13T18:34:43.590338+0000","last_active":"2024-09-13T18:34:45.474475+0000","last_peered":"2024-09-13T18:34:45.474475+0000","last_clean":"2024-09-13T18:34:45.474475+0000","last_became_active":"2024-09-13T18:34:43.589580+0000","last_became_peered":"2024-09-13T18:34:43.589580+0000","last_unstale":"2024-09-13T18:34:45.474475+0000","last_undegraded":"2024-09-13T18:34:45.474475+0000","last_fullsized":"2024-09-13T18:34:45.474475+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:52.841686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.544764+0000","last_change":"2024-09-13T18:34:43.157443+0000","last_active":"2024-09-13T18:34:43.544764+0000","last_peered":"2024-09-13T18:34:43.544764+0000","last_clean":"2024-09-13T18:34:43.544764+0000","last_became_active":"2024-09-13T18:34:43.156735+0000","last_became_peered":"2024-09-13T18:34:43.156735+0000","last_unstale":"2024-09-13T18:34:43.544764+0000","last_undegraded":"2024-09-13T18:34:43.544764+0000","last_fullsized":"2024-09-13T18:34:43.544764+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:43.353153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.475310+0000","last_change":"2024-09-13T18:34:43.601535+0000","last_active":"2024-09-13T18:34:45.475310+0000","last_peered":"2024-09-13T18:34:45.475310+0000","last_clean":"2024-09-13T18:34:45.475310+0000","last_became_active":"2024-09-13T18:34:43.601050+0000","last_became_peered":"2024-09-13T18:34:43.601050+0000","last_unstale":"2024-09-13T18:34:45.475310+0000","last_undegraded":"2024-09-13T18:34:45.475310+0000","last_fullsized":"2024-09-13T18:34:45.475310+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:42.675508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.543909+0000","last_change":"2024-09-13T18:34:43.188703+0000","last_active":"2024-09-13T18:34:43.543909+0000","last_peered":"2024-09-13T18:34:43.543909+0000","last_clean":"2024-09-13T18:34:43.543909+0000","last_became_active":"2024-09-13T18:34:43.188058+0000","last_became_peered":"2024-09-13T18:34:43.188058+0000","last_unstale":"2024-09-13T18:34:43.543909+0000","last_undegraded":"2024-09-13T18:34:43.543909+0000","last_fullsized":"2024-09-13T18:34:43.543909+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:40.999672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.173409+0000","last_change":"2024-09-13T18:34:43.578493+0000","last_active":"2024-09-13T18:34:47.173409+0000","last_peered":"2024-09-13T18:34:47.173409+0000","last_clean":"2024-09-13T18:34:47.173409+0000","last_became_active":"2024-09-13T18:34:43.578274+0000","last_became_peered":"2024-09-13T18:34:43.578274+0000","last_unstale":"2024-09-13T18:34:47.173409+0000","last_undegraded":"2024-09-13T18:34:47.173409+0000","last_fullsized":"2024-09-13T18:34:47.173409+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:56.307889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.547758+0000","last_change":"2024-09-13T18:34:43.186925+0000","last_active":"2024-09-13T18:34:43.547758+0000","last_peered":"2024-09-13T18:34:43.547758+0000","last_clean":"2024-09-13T18:34:43.547758+0000","last_became_active":"2024-09-13T18:34:43.186111+0000","last_became_peered":"2024-09-13T18:34:43.186111+0000","last_unstale":"2024-09-13T18:34:43.547758+0000","last_undegraded":"2024-09-13T18:34:43.547758+0000","last_fullsized":"2024-09-13T18:34:43.547758+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:29.244927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.474577+0000","last_change":"2024-09-13T18:34:43.595964+0000","last_active":"2024-09-13T18:34:45.474577+0000","last_peered":"2024-09-13T18:34:45.474577+0000","last_clean":"2024-09-13T18:34:45.474577+0000","last_became_active":"2024-09-13T18:34:43.594614+0000","last_became_peered":"2024-09-13T18:34:43.594614+0000","last_unstale":"2024-09-13T18:34:45.474577+0000","last_undegraded":"2024-09-13T18:34:45.474577+0000","last_fullsized":"2024-09-13T18:34:45.474577+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:54.720920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"173'3","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.560223+0000","last_change":"2024-09-13T18:34:43.180973+0000","last_active":"2024-09-13T18:34:43.560223+0000","last_peered":"2024-09-13T18:34:43.560223+0000","last_clean":"2024-09-13T18:34:43.560223+0000","last_became_active":"2024-09-13T18:34:43.180225+0000","last_became_peered":"2024-09-13T18:34:43.180225+0000","last_unstale":"2024-09-13T18:34:43.560223+0000","last_undegraded":"2024-09-13T18:34:43.560223+0000","last_fullsized":"2024-09-13T18:34:43.560223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:10.874792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547589+0000","last_change":"2024-09-13T18:34:43.551332+0000","last_active":"2024-09-13T18:34:44.547589+0000","last_peered":"2024-09-13T18:34:44.547589+0000","last_clean":"2024-09-13T18:34:44.547589+0000","last_became_active":"2024-09-13T18:34:43.551080+0000","last_became_peered":"2024-09-13T18:34:43.551080+0000","last_unstale":"2024-09-13T18:34:44.547589+0000","last_undegraded":"2024-09-13T18:34:44.547589+0000","last_fullsized":"2024-09-13T18:34:44.547589+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:44.818131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"173'6","reported_seq":17,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.602293+0000","last_change":"2024-09-13T18:34:43.184839+0000","last_active":"2024-09-13T18:34:43.602293+0000","last_peered":"2024-09-13T18:34:43.602293+0000","last_clean":"2024-09-13T18:34:43.602293+0000","last_became_active":"2024-09-13T18:34:43.184037+0000","last_became_peered":"2024-09-13T18:34:43.184037+0000","last_unstale":"2024-09-13T18:34:43.602293+0000","last_undegraded":"2024-09-13T18:34:43.602293+0000","last_fullsized":"2024-09-13T18:34:43.602293+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:07.997319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.739024+0000","last_change":"2024-09-13T18:34:43.553923+0000","last_active":"2024-09-13T18:34:45.739024+0000","last_peered":"2024-09-13T18:34:45.739024+0000","last_clean":"2024-09-13T18:34:45.739024+0000","last_became_active":"2024-09-13T18:34:43.553453+0000","last_became_peered":"2024-09-13T18:34:43.553453+0000","last_unstale":"2024-09-13T18:34:45.739024+0000","last_undegraded":"2024-09-13T18:34:45.739024+0000","last_fullsized":"2024-09-13T18:34:45.739024+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:30.645560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.568365+0000","last_change":"2024-09-13T18:34:43.170801+0000","last_active":"2024-09-13T18:34:43.568365+0000","last_peered":"2024-09-13T18:34:43.568365+0000","last_clean":"2024-09-13T18:34:43.568365+0000","last_became_active":"2024-09-13T18:34:43.170072+0000","last_became_peered":"2024-09-13T18:34:43.170072+0000","last_unstale":"2024-09-13T18:34:43.568365+0000","last_undegraded":"2024-09-13T18:34:43.568365+0000","last_fullsized":"2024-09-13T18:34:43.568365+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:56.215129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672309+0000","last_change":"2024-09-13T18:34:43.576626+0000","last_active":"2024-09-13T18:34:45.672309+0000","last_peered":"2024-09-13T18:34:45.672309+0000","last_clean":"2024-09-13T18:34:45.672309+0000","last_became_active":"2024-09-13T18:34:43.576385+0000","last_became_peered":"2024-09-13T18:34:43.576385+0000","last_unstale":"2024-09-13T18:34:45.672309+0000","last_undegraded":"2024-09-13T18:34:45.672309+0000","last_fullsized":"2024-09-13T18:34:45.672309+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:44.757476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.548660+0000","last_change":"2024-09-13T18:34:43.180165+0000","last_active":"2024-09-13T18:34:43.548660+0000","last_peered":"2024-09-13T18:34:43.548660+0000","last_clean":"2024-09-13T18:34:43.548660+0000","last_became_active":"2024-09-13T18:34:43.179386+0000","last_became_peered":"2024-09-13T18:34:43.179386+0000","last_unstale":"2024-09-13T18:34:43.548660+0000","last_undegraded":"2024-09-13T18:34:43.548660+0000","last_fullsized":"2024-09-13T18:34:43.548660+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:56.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.172931+0000","last_change":"2024-09-13T18:34:43.572802+0000","last_active":"2024-09-13T18:34:47.172931+0000","last_peered":"2024-09-13T18:34:47.172931+0000","last_clean":"2024-09-13T18:34:47.172931+0000","last_became_active":"2024-09-13T18:34:43.572586+0000","last_became_peered":"2024-09-13T18:34:43.572586+0000","last_unstale":"2024-09-13T18:34:47.172931+0000","last_undegraded":"2024-09-13T18:34:47.172931+0000","last_fullsized":"2024-09-13T18:34:47.172931+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:17.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.543846+0000","last_change":"2024-09-13T18:34:43.175974+0000","last_active":"2024-09-13T18:34:43.543846+0000","last_peered":"2024-09-13T18:34:43.543846+0000","last_clean":"2024-09-13T18:34:43.543846+0000","last_became_active":"2024-09-13T18:34:43.175227+0000","last_became_peered":"2024-09-13T18:34:43.175227+0000","last_unstale":"2024-09-13T18:34:43.543846+0000","last_undegraded":"2024-09-13T18:34:43.543846+0000","last_fullsized":"2024-09-13T18:34:43.543846+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:51.832792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547702+0000","last_change":"2024-09-13T18:34:43.575009+0000","last_active":"2024-09-13T18:34:44.547702+0000","last_peered":"2024-09-13T18:34:44.547702+0000","last_clean":"2024-09-13T18:34:44.547702+0000","last_became_active":"2024-09-13T18:34:43.574732+0000","last_became_peered":"2024-09-13T18:34:43.574732+0000","last_unstale":"2024-09-13T18:34:44.547702+0000","last_undegraded":"2024-09-13T18:34:44.547702+0000","last_fullsized":"2024-09-13T18:34:44.547702+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:22.663881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"173'8","reported_seq":19,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.590564+0000","last_change":"2024-09-13T18:34:43.180473+0000","last_active":"2024-09-13T18:34:43.590564+0000","last_peered":"2024-09-13T18:34:43.590564+0000","last_clean":"2024-09-13T18:34:43.590564+0000","last_became_active":"2024-09-13T18:34:43.180202+0000","last_became_peered":"2024-09-13T18:34:43.180202+0000","last_unstale":"2024-09-13T18:34:43.590564+0000","last_undegraded":"2024-09-13T18:34:43.590564+0000","last_fullsized":"2024-09-13T18:34:43.590564+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:35.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175673+0000","last_change":"2024-09-13T18:34:43.593780+0000","last_active":"2024-09-13T18:34:47.175673+0000","last_peered":"2024-09-13T18:34:47.175673+0000","last_clean":"2024-09-13T18:34:47.175673+0000","last_became_active":"2024-09-13T18:34:43.591754+0000","last_became_peered":"2024-09-13T18:34:43.591754+0000","last_unstale":"2024-09-13T18:34:47.175673+0000","last_undegraded":"2024-09-13T18:34:47.175673+0000","last_fullsized":"2024-09-13T18:34:47.175673+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:30.253821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.559433+0000","last_change":"2024-09-13T18:34:43.176692+0000","last_active":"2024-09-13T18:34:43.559433+0000","last_peered":"2024-09-13T18:34:43.559433+0000","last_clean":"2024-09-13T18:34:43.559433+0000","last_became_active":"2024-09-13T18:34:43.176376+0000","last_became_peered":"2024-09-13T18:34:43.176376+0000","last_unstale":"2024-09-13T18:34:43.559433+0000","last_undegraded":"2024-09-13T18:34:43.559433+0000","last_fullsized":"2024-09-13T18:34:43.559433+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:34:17.668065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175968+0000","last_change":"2024-09-13T18:34:43.589239+0000","last_active":"2024-09-13T18:34:47.175968+0000","last_peered":"2024-09-13T18:34:47.175968+0000","last_clean":"2024-09-13T18:34:47.175968+0000","last_became_active":"2024-09-13T18:34:43.588502+0000","last_became_peered":"2024-09-13T18:34:43.588502+0000","last_unstale":"2024-09-13T18:34:47.175968+0000","last_undegraded":"2024-09-13T18:34:47.175968+0000","last_fullsized":"2024-09-13T18:34:47.175968+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:30.645560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.601538+0000","last_change":"2024-09-13T18:34:43.187208+0000","last_active":"2024-09-13T18:34:43.601538+0000","last_peered":"2024-09-13T18:34:43.601538+0000","last_clean":"2024-09-13T18:34:43.601538+0000","last_became_active":"2024-09-13T18:34:43.185960+0000","last_became_peered":"2024-09-13T18:34:43.185960+0000","last_unstale":"2024-09-13T18:34:43.601538+0000","last_undegraded":"2024-09-13T18:34:43.601538+0000","last_fullsized":"2024-09-13T18:34:43.601538+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:51.392253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.173357+0000","last_change":"2024-09-13T18:34:43.577491+0000","last_active":"2024-09-13T18:34:47.173357+0000","last_peered":"2024-09-13T18:34:47.173357+0000","last_clean":"2024-09-13T18:34:47.173357+0000","last_became_active":"2024-09-13T18:34:43.577240+0000","last_became_peered":"2024-09-13T18:34:43.577240+0000","last_unstale":"2024-09-13T18:34:47.173357+0000","last_undegraded":"2024-09-13T18:34:47.173357+0000","last_fullsized":"2024-09-13T18:34:47.173357+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:16.053358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.570848+0000","last_change":"2024-09-13T18:34:43.167388+0000","last_active":"2024-09-13T18:34:43.570848+0000","last_peered":"2024-09-13T18:34:43.570848+0000","last_clean":"2024-09-13T18:34:43.570848+0000","last_became_active":"2024-09-13T18:34:43.164918+0000","last_became_peered":"2024-09-13T18:34:43.164918+0000","last_unstale":"2024-09-13T18:34:43.570848+0000","last_undegraded":"2024-09-13T18:34:43.570848+0000","last_fullsized":"2024-09-13T18:34:43.570848+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:43.909572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672275+0000","last_change":"2024-09-13T18:34:43.589645+0000","last_active":"2024-09-13T18:34:45.672275+0000","last_peered":"2024-09-13T18:34:45.672275+0000","last_clean":"2024-09-13T18:34:45.672275+0000","last_became_active":"2024-09-13T18:34:43.589369+0000","last_became_peered":"2024-09-13T18:34:43.589369+0000","last_unstale":"2024-09-13T18:34:45.672275+0000","last_undegraded":"2024-09-13T18:34:45.672275+0000","last_fullsized":"2024-09-13T18:34:45.672275+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:08.190885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.543523+0000","last_change":"2024-09-13T18:34:43.173582+0000","last_active":"2024-09-13T18:34:43.543523+0000","last_peered":"2024-09-13T18:34:43.543523+0000","last_clean":"2024-09-13T18:34:43.543523+0000","last_became_active":"2024-09-13T18:34:43.172932+0000","last_became_peered":"2024-09-13T18:34:43.172932+0000","last_unstale":"2024-09-13T18:34:43.543523+0000","last_undegraded":"2024-09-13T18:34:43.543523+0000","last_fullsized":"2024-09-13T18:34:43.543523+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.883206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.671999+0000","last_change":"2024-09-13T18:34:43.552581+0000","last_active":"2024-09-13T18:34:45.671999+0000","last_peered":"2024-09-13T18:34:45.671999+0000","last_clean":"2024-09-13T18:34:45.671999+0000","last_became_active":"2024-09-13T18:34:43.552304+0000","last_became_peered":"2024-09-13T18:34:43.552304+0000","last_unstale":"2024-09-13T18:34:45.671999+0000","last_undegraded":"2024-09-13T18:34:45.671999+0000","last_fullsized":"2024-09-13T18:34:45.671999+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:08.977049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.560377+0000","last_change":"2024-09-13T18:34:43.174503+0000","last_active":"2024-09-13T18:34:43.560377+0000","last_peered":"2024-09-13T18:34:43.560377+0000","last_clean":"2024-09-13T18:34:43.560377+0000","last_became_active":"2024-09-13T18:34:43.174087+0000","last_became_peered":"2024-09-13T18:34:43.174087+0000","last_unstale":"2024-09-13T18:34:43.560377+0000","last_undegraded":"2024-09-13T18:34:43.560377+0000","last_fullsized":"2024-09-13T18:34:43.560377+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:19.446824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.173255+0000","last_change":"2024-09-13T18:34:43.551173+0000","last_active":"2024-09-13T18:34:47.173255+0000","last_peered":"2024-09-13T18:34:47.173255+0000","last_clean":"2024-09-13T18:34:47.173255+0000","last_became_active":"2024-09-13T18:34:43.550973+0000","last_became_peered":"2024-09-13T18:34:43.550973+0000","last_unstale":"2024-09-13T18:34:47.173255+0000","last_undegraded":"2024-09-13T18:34:47.173255+0000","last_fullsized":"2024-09-13T18:34:47.173255+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:12.278126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.539344+0000","last_change":"2024-09-13T18:34:43.175354+0000","last_active":"2024-09-13T18:34:43.539344+0000","last_peered":"2024-09-13T18:34:43.539344+0000","last_clean":"2024-09-13T18:34:43.539344+0000","last_became_active":"2024-09-13T18:34:43.175085+0000","last_became_peered":"2024-09-13T18:34:43.175085+0000","last_unstale":"2024-09-13T18:34:43.539344+0000","last_undegraded":"2024-09-13T18:34:43.539344+0000","last_fullsized":"2024-09-13T18:34:43.539344+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:10.874792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175071+0000","last_change":"2024-09-13T18:34:43.576089+0000","last_active":"2024-09-13T18:34:47.175071+0000","last_peered":"2024-09-13T18:34:47.175071+0000","last_clean":"2024-09-13T18:34:47.175071+0000","last_became_active":"2024-09-13T18:34:43.575117+0000","last_became_peered":"2024-09-13T18:34:43.575117+0000","last_unstale":"2024-09-13T18:34:47.175071+0000","last_undegraded":"2024-09-13T18:34:47.175071+0000","last_fullsized":"2024-09-13T18:34:47.175071+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:42.008566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.538978+0000","last_change":"2024-09-13T18:34:43.178703+0000","last_active":"2024-09-13T18:34:43.538978+0000","last_peered":"2024-09-13T18:34:43.538978+0000","last_clean":"2024-09-13T18:34:43.538978+0000","last_became_active":"2024-09-13T18:34:43.178310+0000","last_became_peered":"2024-09-13T18:34:43.178310+0000","last_unstale":"2024-09-13T18:34:43.538978+0000","last_undegraded":"2024-09-13T18:34:43.538978+0000","last_fullsized":"2024-09-13T18:34:43.538978+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:51.832792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.549390+0000","last_change":"2024-09-13T18:34:43.579944+0000","last_active":"2024-09-13T18:34:44.549390+0000","last_peered":"2024-09-13T18:34:44.549390+0000","last_clean":"2024-09-13T18:34:44.549390+0000","last_became_active":"2024-09-13T18:34:43.579210+0000","last_became_peered":"2024-09-13T18:34:43.579210+0000","last_unstale":"2024-09-13T18:34:44.549390+0000","last_undegraded":"2024-09-13T18:34:44.549390+0000","last_fullsized":"2024-09-13T18:34:44.549390+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:40.790292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.546669+0000","last_change":"2024-09-13T18:34:43.177377+0000","last_active":"2024-09-13T18:34:43.546669+0000","last_peered":"2024-09-13T18:34:43.546669+0000","last_clean":"2024-09-13T18:34:43.546669+0000","last_became_active":"2024-09-13T18:34:43.176547+0000","last_became_peered":"2024-09-13T18:34:43.176547+0000","last_unstale":"2024-09-13T18:34:43.546669+0000","last_undegraded":"2024-09-13T18:34:43.546669+0000","last_fullsized":"2024-09-13T18:34:43.546669+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:33.095738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.673200+0000","last_change":"2024-09-13T18:34:43.583327+0000","last_active":"2024-09-13T18:34:45.673200+0000","last_peered":"2024-09-13T18:34:45.673200+0000","last_clean":"2024-09-13T18:34:45.673200+0000","last_became_active":"2024-09-13T18:34:43.581759+0000","last_became_peered":"2024-09-13T18:34:43.581759+0000","last_unstale":"2024-09-13T18:34:45.673200+0000","last_undegraded":"2024-09-13T18:34:45.673200+0000","last_fullsized":"2024-09-13T18:34:45.673200+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:52.142637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.585573+0000","last_change":"2024-09-13T18:34:43.184093+0000","last_active":"2024-09-13T18:34:43.585573+0000","last_peered":"2024-09-13T18:34:43.585573+0000","last_clean":"2024-09-13T18:34:43.585573+0000","last_became_active":"2024-09-13T18:34:43.183840+0000","last_became_peered":"2024-09-13T18:34:43.183840+0000","last_unstale":"2024-09-13T18:34:43.585573+0000","last_undegraded":"2024-09-13T18:34:43.585573+0000","last_fullsized":"2024-09-13T18:34:43.585573+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:55.875216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547487+0000","last_change":"2024-09-13T18:34:43.579212+0000","last_active":"2024-09-13T18:34:44.547487+0000","last_peered":"2024-09-13T18:34:44.547487+0000","last_clean":"2024-09-13T18:34:44.547487+0000","last_became_active":"2024-09-13T18:34:43.578916+0000","last_became_peered":"2024-09-13T18:34:43.578916+0000","last_unstale":"2024-09-13T18:34:44.547487+0000","last_undegraded":"2024-09-13T18:34:44.547487+0000","last_fullsized":"2024-09-13T18:34:44.547487+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:32.761554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.207408+0000","last_change":"2024-09-13T18:34:43.191702+0000","last_active":"2024-09-13T18:34:44.207408+0000","last_peered":"2024-09-13T18:34:44.207408+0000","last_clean":"2024-09-13T18:34:44.207408+0000","last_became_active":"2024-09-13T18:34:43.191020+0000","last_became_peered":"2024-09-13T18:34:43.191020+0000","last_unstale":"2024-09-13T18:34:44.207408+0000","last_undegraded":"2024-09-13T18:34:44.207408+0000","last_fullsized":"2024-09-13T18:34:44.207408+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:42.377882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175678+0000","last_change":"2024-09-13T18:34:43.576741+0000","last_active":"2024-09-13T18:34:47.175678+0000","last_peered":"2024-09-13T18:34:47.175678+0000","last_clean":"2024-09-13T18:34:47.175678+0000","last_became_active":"2024-09-13T18:34:43.575856+0000","last_became_peered":"2024-09-13T18:34:43.575856+0000","last_unstale":"2024-09-13T18:34:47.175678+0000","last_undegraded":"2024-09-13T18:34:47.175678+0000","last_fullsized":"2024-09-13T18:34:47.175678+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:50.857035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.543889+0000","last_change":"2024-09-13T18:34:43.176367+0000","last_active":"2024-09-13T18:34:43.543889+0000","last_peered":"2024-09-13T18:34:43.543889+0000","last_clean":"2024-09-13T18:34:43.543889+0000","last_became_active":"2024-09-13T18:34:43.175690+0000","last_became_peered":"2024-09-13T18:34:43.175690+0000","last_unstale":"2024-09-13T18:34:43.543889+0000","last_undegraded":"2024-09-13T18:34:43.543889+0000","last_fullsized":"2024-09-13T18:34:43.543889+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:16.395996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.549741+0000","last_change":"2024-09-13T18:34:43.559187+0000","last_active":"2024-09-13T18:34:44.549741+0000","last_peered":"2024-09-13T18:34:44.549741+0000","last_clean":"2024-09-13T18:34:44.549741+0000","last_became_active":"2024-09-13T18:34:43.558535+0000","last_became_peered":"2024-09-13T18:34:43.558535+0000","last_unstale":"2024-09-13T18:34:44.549741+0000","last_undegraded":"2024-09-13T18:34:44.549741+0000","last_fullsized":"2024-09-13T18:34:44.549741+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:19.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.543616+0000","last_change":"2024-09-13T18:34:43.173141+0000","last_active":"2024-09-13T18:34:43.543616+0000","last_peered":"2024-09-13T18:34:43.543616+0000","last_clean":"2024-09-13T18:34:43.543616+0000","last_became_active":"2024-09-13T18:34:43.172794+0000","last_became_peered":"2024-09-13T18:34:43.172794+0000","last_unstale":"2024-09-13T18:34:43.543616+0000","last_undegraded":"2024-09-13T18:34:43.543616+0000","last_fullsized":"2024-09-13T18:34:43.543616+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:18.840444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547270+0000","last_change":"2024-09-13T18:34:43.553361+0000","last_active":"2024-09-13T18:34:44.547270+0000","last_peered":"2024-09-13T18:34:44.547270+0000","last_clean":"2024-09-13T18:34:44.547270+0000","last_became_active":"2024-09-13T18:34:43.553100+0000","last_became_peered":"2024-09-13T18:34:43.553100+0000","last_unstale":"2024-09-13T18:34:44.547270+0000","last_undegraded":"2024-09-13T18:34:44.547270+0000","last_fullsized":"2024-09-13T18:34:44.547270+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:44.414463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.563561+0000","last_change":"2024-09-13T18:34:43.188680+0000","last_active":"2024-09-13T18:34:43.563561+0000","last_peered":"2024-09-13T18:34:43.563561+0000","last_clean":"2024-09-13T18:34:43.563561+0000","last_became_active":"2024-09-13T18:34:43.187899+0000","last_became_peered":"2024-09-13T18:34:43.187899+0000","last_unstale":"2024-09-13T18:34:43.563561+0000","last_undegraded":"2024-09-13T18:34:43.563561+0000","last_fullsized":"2024-09-13T18:34:43.563561+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:03.881377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:45.672891+0000","last_change":"2024-09-13T18:34:43.579191+0000","last_active":"2024-09-13T18:34:45.672891+0000","last_peered":"2024-09-13T18:34:45.672891+0000","last_clean":"2024-09-13T18:34:45.672891+0000","last_became_active":"2024-09-13T18:34:43.569219+0000","last_became_peered":"2024-09-13T18:34:43.569219+0000","last_unstale":"2024-09-13T18:34:45.672891+0000","last_undegraded":"2024-09-13T18:34:45.672891+0000","last_fullsized":"2024-09-13T18:34:45.672891+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:26.218476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.545634+0000","last_change":"2024-09-13T18:34:43.177039+0000","last_active":"2024-09-13T18:34:43.545634+0000","last_peered":"2024-09-13T18:34:43.545634+0000","last_clean":"2024-09-13T18:34:43.545634+0000","last_became_active":"2024-09-13T18:34:43.176601+0000","last_became_peered":"2024-09-13T18:34:43.176601+0000","last_unstale":"2024-09-13T18:34:43.545634+0000","last_undegraded":"2024-09-13T18:34:43.545634+0000","last_fullsized":"2024-09-13T18:34:43.545634+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.172916+0000","last_change":"2024-09-13T18:34:43.573062+0000","last_active":"2024-09-13T18:34:47.172916+0000","last_peered":"2024-09-13T18:34:47.172916+0000","last_clean":"2024-09-13T18:34:47.172916+0000","last_became_active":"2024-09-13T18:34:43.572711+0000","last_became_peered":"2024-09-13T18:34:43.572711+0000","last_unstale":"2024-09-13T18:34:47.172916+0000","last_undegraded":"2024-09-13T18:34:47.172916+0000","last_fullsized":"2024-09-13T18:34:47.172916+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:34.104632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.549239+0000","last_change":"2024-09-13T18:34:43.170176+0000","last_active":"2024-09-13T18:34:43.549239+0000","last_peered":"2024-09-13T18:34:43.549239+0000","last_clean":"2024-09-13T18:34:43.549239+0000","last_became_active":"2024-09-13T18:34:43.169456+0000","last_became_peered":"2024-09-13T18:34:43.169456+0000","last_unstale":"2024-09-13T18:34:43.549239+0000","last_undegraded":"2024-09-13T18:34:43.549239+0000","last_fullsized":"2024-09-13T18:34:43.549239+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:29.636666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:47.175170+0000","last_change":"2024-09-13T18:34:43.587500+0000","last_active":"2024-09-13T18:34:47.175170+0000","last_peered":"2024-09-13T18:34:47.175170+0000","last_clean":"2024-09-13T18:34:47.175170+0000","last_became_active":"2024-09-13T18:34:43.586938+0000","last_became_peered":"2024-09-13T18:34:43.586938+0000","last_unstale":"2024-09-13T18:34:47.175170+0000","last_undegraded":"2024-09-13T18:34:47.175170+0000","last_fullsized":"2024-09-13T18:34:47.175170+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:17.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.560225+0000","last_change":"2024-09-13T18:34:43.182322+0000","last_active":"2024-09-13T18:34:43.560225+0000","last_peered":"2024-09-13T18:34:43.560225+0000","last_clean":"2024-09-13T18:34:43.560225+0000","last_became_active":"2024-09-13T18:34:43.181590+0000","last_became_peered":"2024-09-13T18:34:43.181590+0000","last_unstale":"2024-09-13T18:34:43.560225+0000","last_undegraded":"2024-09-13T18:34:43.560225+0000","last_fullsized":"2024-09-13T18:34:43.560225+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:15.420852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:44.547224+0000","last_change":"2024-09-13T18:34:43.549670+0000","last_active":"2024-09-13T18:34:44.547224+0000","last_peered":"2024-09-13T18:34:44.547224+0000","last_clean":"2024-09-13T18:34:44.547224+0000","last_became_active":"2024-09-13T18:34:43.549428+0000","last_became_peered":"2024-09-13T18:34:43.549428+0000","last_unstale":"2024-09-13T18:34:44.547224+0000","last_undegraded":"2024-09-13T18:34:44.547224+0000","last_fullsized":"2024-09-13T18:34:44.547224+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:43.139688+0000","last_clean_scrub_stamp":"2024-09-13T18:34:43.139688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:30.789068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.579423+0000","last_change":"2024-09-13T18:34:43.179799+0000","last_active":"2024-09-13T18:34:43.579423+0000","last_peered":"2024-09-13T18:34:43.579423+0000","last_clean":"2024-09-13T18:34:43.579423+0000","last_became_active":"2024-09-13T18:34:43.179041+0000","last_became_peered":"2024-09-13T18:34:43.179041+0000","last_unstale":"2024-09-13T18:34:43.579423+0000","last_undegraded":"2024-09-13T18:34:43.579423+0000","last_fullsized":"2024-09-13T18:34:43.579423+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:34:42.130794+0000","last_clean_scrub_stamp":"2024-09-13T18:34:42.130794+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:06.502535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"75'128","reported_seq":332,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-09-13T18:34:43.564374+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:34:43.564374+0000","last_peered":"2024-09-13T18:34:43.564374+0000","last_clean":"2024-09-13T18:34:43.564374+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:34:43.564374+0000","last_undegraded":"2024-09-13T18:34:43.564374+0000","last_fullsized":"2024-09-13T18:34:43.564374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33860,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337980,"statfs":{"total":96636764160,"available":96602091520,"internally_reserved":0,"allocated":2801664,"data_stored":1563290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.876,"15min":0.88600000000000001},"min":{"1min":0.49399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.399,"5min":1.399,"15min":1.6439999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.90500000000000003},"min":{"1min":0.63600000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.214,"5min":1.333,"15min":1.4410000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89500000000000002,"15min":0.92100000000000004},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2729999999999999,"5min":1.278,"15min":1.7270000000000001},"last":1.196},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96299999999999997,"15min":0.93600000000000005},"min":{"1min":0.63800000000000001,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.6060000000000001},"last":1.3380000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81299999999999994,"15min":0.80800000000000005},"min":{"1min":0.66400000000000003,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.2210000000000001,"5min":1.276,"15min":1.276},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.61899999999999999,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.1519999999999999,"5min":1.296,"15min":1.9830000000000001},"last":1.2969999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86199999999999999,"15min":0.877},"min":{"1min":0.57699999999999996,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0980000000000001,"5min":1.2070000000000001,"15min":1.448},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.65300000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.333,"5min":1.395,"15min":1.397},"last":1.1299999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89700000000000002,"15min":0.88900000000000001},"min":{"1min":0.59099999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1850000000000001,"5min":1.2569999999999999,"15min":1.3620000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93899999999999995,"15min":0.94099999999999995},"min":{"1min":0.70299999999999996,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.1919999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0960000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.97599999999999998,"15min":1.0209999999999999},"min":{"1min":0.76400000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2310000000000001,"5min":1.3320000000000001,"15min":1.877},"last":1.367},{"interface":"front","average":{"1min":1.077,"5min":0.997,"15min":0.98799999999999999},"min":{"1min":0.75,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.409,"15min":1.409},"last":0.89100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:34:05 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0529999999999999,"15min":1.0600000000000001},"min":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.56899999999999995},"max":{"1min":1.413,"5min":1.476,"15min":1.476},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0309999999999999,"15min":1.0129999999999999},"min":{"1min":0.76900000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.341,"5min":1.361,"15min":1.506},"last":1.014}]}]},{"osd":6,"up_from":13,"seq":55834574972,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2199552,"data_stored":971940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.26,"5min":1.47,"15min":2.9990000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80100000000000005,"15min":0.79700000000000004},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.1779999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.577},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.208,"5min":1.218,"15min":1.464},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.60099999999999998,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.673,"15min":2.4220000000000002},"last":1.05}]},{"osd":3,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90200000000000002,"15min":0.88700000000000001},"min":{"1min":0.59899999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.28,"5min":1.516,"15min":1.516},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89600000000000002,"15min":0.88700000000000001},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.23,"5min":1.2669999999999999,"15min":1.306},"last":0.92200000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.96499999999999997},"min":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.1639999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.0549999999999999,"15min":1.0209999999999999},"min":{"1min":0.84399999999999997,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.224,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.202}]},{"osd":5,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2010000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.006},{"interface":"front","average":{"1min":1.036,"5min":1.0269999999999999,"15min":1.0740000000000001},"min":{"1min":0.71699999999999997,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.371,"5min":1.4490000000000001,"15min":2.762},"last":1.446}]},{"osd":7,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.0369999999999999},"min":{"1min":0.81200000000000006,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.389,"5min":1.5,"15min":1.9299999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.04,"15min":1.0389999999999999},"min":{"1min":0.76800000000000002,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.3300000000000001,"5min":1.357,"15min":1.72},"last":1.1359999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574973,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2199552,"data_stored":971940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79300000000000004,"15min":0.83699999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1659999999999999,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82899999999999996,"15min":0.88100000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.437},"max":{"1min":1.1759999999999999,"5min":1.264,"15min":2.1840000000000002},"last":1.153}]},{"osd":1,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85299999999999998,"15min":0.84099999999999997},"min":{"1min":0.54400000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.603,"15min":1.603},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.83599999999999997,"15min":0.83299999999999996},"min":{"1min":0.51700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3169999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.874},"min":{"1min":0.55400000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.89800000000000002,"15min":0.94599999999999995},"min":{"1min":0.624,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.244,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93400000000000005,"15min":0.94999999999999996},"min":{"1min":0.56100000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3260000000000001,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.93999999999999995,"15min":0.96599999999999997},"min":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1870000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.087}]},{"osd":4,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.96699999999999997,"15min":0.94699999999999995},"min":{"1min":0.77000000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.218,"5min":3.46,"15min":3.46},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.014,"15min":1.0309999999999999},"min":{"1min":0.76700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.4790000000000001,"5min":1.492,"15min":1.5049999999999999},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.71999999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.1919999999999999,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.998,"5min":0.97999999999999998,"15min":1.01},"min":{"1min":0.64800000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.25,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0489999999999999,"15min":1.0900000000000001},"min":{"1min":0.70199999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4139999999999999,"5min":2.1600000000000001,"15min":2.246},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.0980000000000001,"15min":1.121},"min":{"1min":0.89600000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.357,"5min":3.649,"15min":3.649},"last":1.028}]}]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2215936,"data_stored":973026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.92600000000000005,"15min":0.84599999999999997},"min":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.159,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.141},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.91400000000000003,"15min":0.88700000000000001},"min":{"1min":0.61199999999999999,"5min":0.51300000000000001,"15min":0.41699999999999998},"max":{"1min":1.222,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.83499999999999996},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":1.1819999999999999,"5min":1.2589999999999999,"15min":1.536},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.877,"5min":0.92000000000000004,"15min":0.89200000000000002},"min":{"1min":0.54200000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.1779999999999999,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.93700000000000006}]},{"osd":2,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91000000000000003,"15min":0.88},"min":{"1min":0.56599999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.159,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.89100000000000001,"15min":0.89700000000000002},"min":{"1min":0.63,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.226,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91700000000000004,"15min":0.90500000000000003},"min":{"1min":0.64300000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2989999999999999,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.026},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.94899999999999995},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.0900000000000001,"5min":10.44,"15min":10.44},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.96899999999999997,"15min":0.95099999999999996},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.194,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.002,"15min":0.97399999999999998},"min":{"1min":0.71699999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3009999999999999,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1180000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.1220000000000001,"15min":1.022},"min":{"1min":0.504,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1830000000000001,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.2390000000000001,"15min":1.089},"min":{"1min":0.80300000000000005,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.252,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.2150000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.2010000000000001,"15min":1.0940000000000001},"min":{"1min":0.84999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.23,"5min":15.593,"15min":15.593},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.079,"15min":1.0720000000000001},"min":{"1min":0.77700000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.2729999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.1000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574973,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41464,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330376,"statfs":{"total":96636764160,"available":96594305024,"internally_reserved":0,"allocated":2207744,"data_stored":971540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.28100000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.98699999999999999,"5min":1.444,"15min":2.113},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71499999999999997,"15min":0.72399999999999998},"min":{"1min":0.315,"5min":0.313,"15min":0.313},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.65700000000000003,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.89300000000000002,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.496},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.34100000000000003,"5min":0.222,"15min":0.222},"max":{"1min":1.04,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64500000000000002,"15min":0.68700000000000006},"min":{"1min":0.33700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96699999999999997,"5min":1.4850000000000001,"15min":1.742},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.74099999999999999},"min":{"1min":0.39400000000000002,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":1.222,"15min":1.399},"last":1.02}]},{"osd":4,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.95699999999999996,"15min":1.0640000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.54,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":1.1859999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":0.99199999999999999},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1279999999999999,"5min":1.5920000000000001,"15min":1.8919999999999999},"last":1.224},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89600000000000002,"15min":0.93000000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.349,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":1.0529999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.95899999999999996,"15min":1.0369999999999999},"min":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.202,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.99099999999999999,"15min":1.034},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.454,"5min":1.6890000000000001,"15min":1.96},"last":1.349}]},{"osd":7,"last update":"Fri Sep 13 18:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":1.02,"15min":1.0760000000000001},"min":{"1min":0.65300000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.413,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":1.268},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97399999999999998,"15min":1.0009999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.504,"5min":1.504,"15min":2.9220000000000002},"last":0.95299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41452,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330388,"statfs":{"total":96636764160,"available":96594317312,"internally_reserved":0,"allocated":2195456,"data_stored":971358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60599999999999998,"15min":0.58799999999999997},"min":{"1min":0.29799999999999999,"5min":0.246,"15min":0.246},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.98599999999999999,"5min":1.1619999999999999,"15min":1.335},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28299999999999997},"max":{"1min":0.98699999999999999,"5min":1.0329999999999999,"15min":1.1579999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64800000000000002,"15min":0.69599999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.307},"max":{"1min":1.0529999999999999,"5min":1.2190000000000001,"15min":1.423},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.39100000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.92500000000000004,"15min":0.91800000000000004},"min":{"1min":0.61699999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.611},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89200000000000002,"15min":0.91000000000000003},"min":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.248,"5min":1.587,"15min":1.587},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.96999999999999997,"15min":0.99299999999999999},"min":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.3500000000000001,"5min":1.548,"15min":1.9179999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.97099999999999997,"15min":0.97399999999999998},"min":{"1min":0.58599999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.589,"5min":1.589,"15min":1.702},"last":0.878}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.95699999999999996},"min":{"1min":0.55600000000000005,"5min":0.55400000000000005,"15min":0.5},"max":{"1min":1.258,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.036},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.3600000000000001,"5min":1.645,"15min":1.645},"last":0.753}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"max":{"1min":1.2649999999999999,"5min":1.843,"15min":1.843},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.05,"5min":1.036,"15min":1.071},"min":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":0.82799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41460,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330380,"statfs":{"total":96636764160,"available":96594309120,"internally_reserved":0,"allocated":2203648,"data_stored":971414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.64300000000000002,"15min":0.623},"min":{"1min":0.32900000000000001,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.502}]},{"osd":2,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.314,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.91300000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.436}]},{"osd":3,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.2430000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73499999999999999,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1100000000000001,"5min":1.423,"15min":1.423},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88900000000000001,"15min":0.90400000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.367,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.02},"min":{"1min":0.60599999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64000000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.335,"5min":1.5900000000000001,"15min":1.653},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97399999999999998,"15min":0.98499999999999999},"min":{"1min":0.61699999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.89800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:33:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0600000000000001,"15min":1.0489999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.028,"15min":1.0229999999999999},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.546,"5min":1.649,"15min":1.649},"last":0.83499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574972,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42036,"kb_used_data":2728,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329804,"statfs":{"total":96636764160,"available":96593719296,"internally_reserved":0,"allocated":2793472,"data_stored":1561816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.64400000000000002},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86399999999999999,"5min":1.0329999999999999,"15min":1.147},"last":0.755},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.755},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.4359999999999999},"last":3.4220000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":8.7729999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.93899999999999995,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":4.883}]},{"osd":3,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65000000000000002,"15min":0.68600000000000005},"min":{"1min":0.38200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.7589999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.5129999999999999},"last":5.2759999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85399999999999998,"15min":0.92000000000000004},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4710000000000001,"15min":2.4510000000000001},"last":3.238},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93700000000000006,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.458,"5min":1.5069999999999999,"15min":1.986},"last":3.8109999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96199999999999997,"15min":0.997},"min":{"1min":0.51000000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.583,"5min":1.583,"15min":2.641},"last":5.242},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96899999999999997,"15min":1.024},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.6699999999999999},"last":6.0330000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.002,"15min":1.0580000000000001},"min":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.891},"last":3.3599999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.99099999999999999,"15min":1.016},"min":{"1min":0.69099999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3700000000000001,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Sep 13 18:34:02 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.427,"5min":1.669,"15min":2.2949999999999999},"last":2.25},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.536,"5min":1.6930000000000001,"15min":2.2480000000000002},"last":4.7080000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:34:47.955 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:34:47.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:34:48.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e798e640 1 Processor -- start 2024-09-13T18:34:48.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e798e640 1 -- start start 2024-09-13T18:34:48.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e798e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00e00b1dd0 0x7f00e00b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e798e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e006bc20 con 0x7f00e0158ba0 2024-09-13T18:34:48.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e798e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e0158f80 con 0x7f00e006ff40 2024-09-13T18:34:48.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e798e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e006c530 con 0x7f00e00b1dd0 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e4f29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00e00b1dd0 0x7f00e00b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e4f29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f00e00b1dd0 0x7f00e00b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55848/0 (socket says 172.21.15.53:55848) 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e572a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f00e0158ba0 0x7f00e00cb9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51898/0 (socket says 172.21.15.53:51898) 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e4f29640 1 -- 172.21.15.53:0/3701734713 learned_addr learned my addr 172.21.15.53:0/3701734713 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.127+0000 7f00e4f29640 1 -- 172.21.15.53:0/3701734713 >> v1:172.21.15.87:6789/0 conn(0x7f00e006ff40 legacy=0x7f00e0070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00e4f29640 1 -- 172.21.15.53:0/3701734713 >> v1:172.21.15.53:6789/0 conn(0x7f00e0158ba0 legacy=0x7f00e00cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00e4f29640 1 -- 172.21.15.53:0/3701734713 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00b2340 con 0x7f00e00b1dd0 2024-09-13T18:34:48.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00d7fff640 1 -- 172.21.15.53:0/3701734713 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913584721 0 0) 0x7f00e006bc20 con 0x7f00e0158ba0 2024-09-13T18:34:48.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00e4f29640 1 --2- 172.21.15.53:0/3701734713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e00b1dd0 0x7f00e00b3120 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009870 tx=0x7f00d001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9272749266bf0b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:48.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00d7fff640 1 -- 172.21.15.53:0/3701734713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00a8050 con 0x7f00e00b1dd0 2024-09-13T18:34:48.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00d7fff640 1 -- 172.21.15.53:0/3701734713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d00ac5f0 con 0x7f00e00b1dd0 2024-09-13T18:34:48.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00d7fff640 1 -- 172.21.15.53:0/3701734713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00ac980 con 0x7f00e00b1dd0 2024-09-13T18:34:48.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00e798e640 1 -- 172.21.15.53:0/3701734713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e00b1dd0 msgr2=0x7f00e00b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.131+0000 7f00e798e640 1 --2- 172.21.15.53:0/3701734713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e00b1dd0 0x7f00e00b3120 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009870 tx=0x7f00d001c410 comp rx=0 tx=0).stop 2024-09-13T18:34:48.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- 172.21.15.53:0/3701734713 shutdown_connections 2024-09-13T18:34:48.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 --2- 172.21.15.53:0/3701734713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e00b1dd0 0x7f00e00b3120 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- 172.21.15.53:0/3701734713 >> 172.21.15.53:0/3701734713 conn(0x7f00e0065c80 msgr2=0x7f00e0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:48.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- 172.21.15.53:0/3701734713 shutdown_connections 2024-09-13T18:34:48.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- 172.21.15.53:0/3701734713 wait complete. 2024-09-13T18:34:48.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 Processor -- start 2024-09-13T18:34:48.138 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- start start 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e006ff40 0x7f00e0153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e00b1dd0 0x7f00e0157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00e0158ba0 0x7f00e00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0154330 con 0x7f00e006ff40 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0166be0 con 0x7f00e00b1dd0 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0166ec0 con 0x7f00e0158ba0 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e006ff40 0x7f00e0153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e006ff40 0x7f00e0153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55854/0 (socket says 172.21.15.53:55854) 2024-09-13T18:34:48.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 -- 172.21.15.53:0/2593444280 learned_addr learned my addr 172.21.15.53:0/2593444280 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e4f29640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e00b1dd0 0x7f00e0157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e5f2b640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00e0158ba0 0x7f00e00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 -- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00e0158ba0 msgr2=0x7f00e00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00e0158ba0 0x7f00e00cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 -- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e00b1dd0 msgr2=0x7f00e0157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e00b1dd0 0x7f00e0157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 -- 172.21.15.53:0/2593444280 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00094d0 con 0x7f00e006ff40 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e572a640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e006ff40 0x7f00e0153df0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c410 tx=0x7f00dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00d5ffb640 1 -- 172.21.15.53:0/2593444280 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0074e0 con 0x7f00e006ff40 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00d5ffb640 1 -- 172.21.15.53:0/2593444280 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc007640 con 0x7f00e006ff40 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e01671a0 con 0x7f00e006ff40 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00d5ffb640 1 -- 172.21.15.53:0/2593444280 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc004a30 con 0x7f00e006ff40 2024-09-13T18:34:48.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.135+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e0157b50 con 0x7f00e006ff40 2024-09-13T18:34:48.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.139+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e00b3120 con 0x7f00e006ff40 2024-09-13T18:34:48.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.139+0000 7f00d5ffb640 1 -- 172.21.15.53:0/2593444280 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f00dc004b90 con 0x7f00e006ff40 2024-09-13T18:34:48.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.139+0000 7f00d5ffb640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00c4067020 0x7f00c40694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.139+0000 7f00d5ffb640 1 -- 172.21.15.53:0/2593444280 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00dc082a20 con 0x7f00e006ff40 2024-09-13T18:34:48.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.139+0000 7f00e4f29640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00c4067020 0x7f00c40694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.139+0000 7f00e4f29640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00c4067020 0x7f00c40694e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f00d00ae000 tx=0x7f00d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:48.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.143+0000 7f00d5ffb640 1 -- 172.21.15.53:0/2593444280 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00dc051640 con 0x7f00e006ff40 2024-09-13T18:34:48.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.363+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f00e00ade50 con 0x7f00e006ff40 2024-09-13T18:34:48.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00d5ffb640 1 -- 172.21.15.53:0/2593444280 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) v1 ==== 190+0+0 (secure 0 0 0) 0x7f00dc054c60 con 0x7f00e006ff40 2024-09-13T18:34:48.373 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00c4067020 msgr2=0x7f00c40694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00c4067020 0x7f00c40694e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f00d00ae000 tx=0x7f00d0008040 comp rx=0 tx=0).stop 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e006ff40 msgr2=0x7f00e0153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e006ff40 0x7f00e0153df0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c410 tx=0x7f00dc00c8d0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 shutdown_connections 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f00c4067020 0x7f00c40694e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f00e0158ba0 0x7f00e00cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f00e00b1dd0 0x7f00e0157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 --2- 172.21.15.53:0/2593444280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00e006ff40 0x7f00e0153df0 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 >> 172.21.15.53:0/2593444280 conn(0x7f00e0065c80 msgr2=0x7f00e0159ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:48.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 shutdown_connections 2024-09-13T18:34:48.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.371+0000 7f00e798e640 1 -- 172.21.15.53:0/2593444280 wait complete. 2024-09-13T18:34:48.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:34:48.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.515+0000 7faccdfe4640 1 Processor -- start 2024-09-13T18:34:48.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7faccdfe4640 1 -- start start 2024-09-13T18:34:48.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7faccdfe4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7faccdfe4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7facc80cbd60 0x7facc80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7faccdfe4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80b1ac0 con 0x7facc80cb980 2024-09-13T18:34:48.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7faccdfe4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80b3010 con 0x7facc80cbd60 2024-09-13T18:34:48.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7faccdfe4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc8159ac0 con 0x7facc806b850 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7facc80cbd60 0x7facc80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc6ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc77fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7facc80cb980 0x7facc806fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:45730/0 (socket says 172.21.15.53:45730) 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc77fe640 1 -- 172.21.15.53:0/1882907691 learned_addr learned my addr 172.21.15.53:0/1882907691 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc7fff640 1 -- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 msgr2=0x7facc80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc7fff640 1 --2- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc7fff640 1 -- 172.21.15.53:0/1882907691 >> v1:172.21.15.87:6789/0 conn(0x7facc80cb980 legacy=0x7facc806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc7fff640 1 -- 172.21.15.53:0/1882907691 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8159da0 con 0x7facc80cbd60 2024-09-13T18:34:48.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.519+0000 7facc6ffd640 1 --2- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:48.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7facc7fff640 1 --2- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc80cdd40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7facc00097c0 tx=0x7facc001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b07edd49eff7e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:48.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7facc67fc640 1 -- 172.21.15.53:0/1882907691 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00ac640 con 0x7facc80cbd60 2024-09-13T18:34:48.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7facc67fc640 1 -- 172.21.15.53:0/1882907691 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc00ac7a0 con 0x7facc80cbd60 2024-09-13T18:34:48.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7facc67fc640 1 -- 172.21.15.53:0/1882907691 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00acb30 con 0x7facc80cbd60 2024-09-13T18:34:48.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 msgr2=0x7facc80cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 --2- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc80cdd40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7facc00097c0 tx=0x7facc001c3e0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- 172.21.15.53:0/1882907691 shutdown_connections 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 --2- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc80cdd40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 --2- 172.21.15.53:0/1882907691 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- 172.21.15.53:0/1882907691 >> 172.21.15.53:0/1882907691 conn(0x7facc8065c80 msgr2=0x7facc8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- 172.21.15.53:0/1882907691 shutdown_connections 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- 172.21.15.53:0/1882907691 wait complete. 2024-09-13T18:34:48.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 Processor -- start 2024-09-13T18:34:48.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- start start 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc8148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facc80cb980 0x7facc81f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc81f8cf0 con 0x7facc80cb980 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8148950 con 0x7facc80cbd60 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7faccdfe4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc81f96c0 con 0x7facc806b850 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7facc6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facc80cb980 0x7facc81f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.523+0000 7facc6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facc80cb980 0x7facc81f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55866/0 (socket says 172.21.15.53:55866) 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc6ffd640 1 -- 172.21.15.53:0/2073412316 learned_addr learned my addr 172.21.15.53:0/2073412316 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:48.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc7fff640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc77fe640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc8148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc6ffd640 1 -- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 msgr2=0x7facc8148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc6ffd640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc8148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc6ffd640 1 -- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 msgr2=0x7facc81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc6ffd640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc81583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc6ffd640 1 -- 172.21.15.53:0/2073412316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009a70 con 0x7facc80cb980 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc7fff640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc77fe640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc8148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc6ffd640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facc80cb980 0x7facc81f9180 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7facb000efc0 tx=0x7facb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facbffff640 1 -- 172.21.15.53:0/2073412316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0009cd0 con 0x7facc80cb980 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facbffff640 1 -- 172.21.15.53:0/2073412316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb000f040 con 0x7facc80cb980 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc0009420 con 0x7facc80cb980 2024-09-13T18:34:48.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facbffff640 1 -- 172.21.15.53:0/2073412316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00148c0 con 0x7facc80cb980 2024-09-13T18:34:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc814e210 con 0x7facc80cb980 2024-09-13T18:34:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc8067400 con 0x7facc80cb980 2024-09-13T18:34:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facbffff640 1 -- 172.21.15.53:0/2073412316 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7facb0014a20 con 0x7facc80cb980 2024-09-13T18:34:48.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facbffff640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7facac067020 0x7facac0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:48.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facbffff640 1 -- 172.21.15.53:0/2073412316 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb00838b0 con 0x7facc80cb980 2024-09-13T18:34:48.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc77fe640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7facac067020 0x7facac0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:48.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.527+0000 7facc77fe640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7facac067020 0x7facac0694e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7facb8005890 tx=0x7facb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:48.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.531+0000 7facbffff640 1 -- 172.21.15.53:0/2073412316 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7facb00524d0 con 0x7facc80cb980 2024-09-13T18:34:48.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facc81f8e30 con 0x7facc80cb980 2024-09-13T18:34:48.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7facbffff640 1 -- 172.21.15.53:0/2073412316 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4745 (secure 0 0 0) 0x7facb0055af0 con 0x7facc80cb980 2024-09-13T18:34:48.734 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:48.734 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/481869316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":481869316},{"type":"v1","addr":"172.21.15.87:6833","nonce":481869316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4120395616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4120395616},{"type":"v1","addr":"172.21.15.87:6835","nonce":4120395616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1960885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1960885675},{"type":"v1","addr":"172.21.15.53:6833","nonce":1960885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:34:43.533426+0000","modified":"2024-09-13T18:34:46.545788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1295090105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1295090105},{"type":"v1","addr":"172.21.15.53:6835","nonce":1295090105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":13}]} 2024-09-13T18:34:48.734 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2024-09-13T18:34:48.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7facac067020 msgr2=0x7facac0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7facac067020 0x7facac0694e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7facb8005890 tx=0x7facb8009040 comp rx=0 tx=0).stop 2024-09-13T18:34:48.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facc80cb980 msgr2=0x7facc81f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:48.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facc80cb980 0x7facc81f9180 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7facb000efc0 tx=0x7facb000c490 comp rx=0 tx=0).stop 2024-09-13T18:34:48.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 shutdown_connections 2024-09-13T18:34:48.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7facac067020 0x7facac0694e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7facc80cbd60 0x7facc81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7facc80cb980 0x7facc81f9180 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 --2- 172.21.15.53:0/2073412316 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7facc806b850 0x7facc8148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 >> 172.21.15.53:0/2073412316 conn(0x7facc8065c80 msgr2=0x7facc80cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 shutdown_connections 2024-09-13T18:34:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:48.731+0000 7faccdfe4640 1 -- 172.21.15.53:0/2073412316 wait complete. 2024-09-13T18:34:49.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:34:43.533426+0000', 'modified': '2024-09-13T18:34:46.545788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10503}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10503': {'gid': 10503, 'name': 'c', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/1295090105', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 1295090105}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 1295090105}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:34:49.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:34:49.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:34:49.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 Processor -- start 2024-09-13T18:34:49.290 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 -- start start 2024-09-13T18:34:49.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f68e415a610 0x7f68e40cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.291 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68e40b2210 0x7f68e40abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4069f50 0x7f68e406a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e406a900 con 0x7f68e40b2210 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40b2780 con 0x7f68e415a610 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e9020640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40b2a60 con 0x7f68e4069f50 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68e40b2210 0x7f68e40abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68e40b2210 0x7f68e40abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55870/0 (socket says 172.21.15.53:55870) 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 -- 172.21.15.53:0/737198407 learned_addr learned my addr 172.21.15.53:0/737198407 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/737198407 >> v2:172.21.15.87:3300/0 conn(0x7f68e415a610 0x7f68e40cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e359e640 1 --2- 172.21.15.53:0/737198407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4069f50 0x7f68e406a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 -- 172.21.15.53:0/737198407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4069f50 msgr2=0x7f68e406a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 --2- 172.21.15.53:0/737198407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4069f50 0x7f68e406a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 -- 172.21.15.53:0/737198407 >> v2:172.21.15.87:3300/0 conn(0x7f68e415a610 msgr2=0x7f68e40cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 --2- 172.21.15.53:0/737198407 >> v2:172.21.15.87:3300/0 conn(0x7f68e415a610 0x7f68e40cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.293 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.287+0000 7f68e259c640 1 -- 172.21.15.53:0/737198407 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e40b2d40 con 0x7f68e40b2210 2024-09-13T18:34:49.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e259c640 1 --2- 172.21.15.53:0/737198407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e40b2210 0x7f68e40abda0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f68e4071eb0 tx=0x7f68cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba0749098094980 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e1d9b640 1 -- 172.21.15.53:0/737198407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc0aa610 con 0x7f68e40b2210 2024-09-13T18:34:49.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e1d9b640 1 -- 172.21.15.53:0/737198407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc0a6040 con 0x7f68e40b2210 2024-09-13T18:34:49.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e1d9b640 1 -- 172.21.15.53:0/737198407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc0aa990 con 0x7f68e40b2210 2024-09-13T18:34:49.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 -- 172.21.15.53:0/737198407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e40b2210 msgr2=0x7f68e40abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 --2- 172.21.15.53:0/737198407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e40b2210 0x7f68e40abda0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f68e4071eb0 tx=0x7f68cc01c4f0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 -- 172.21.15.53:0/737198407 shutdown_connections 2024-09-13T18:34:49.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 --2- 172.21.15.53:0/737198407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e4069f50 0x7f68e406a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 --2- 172.21.15.53:0/737198407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e40b2210 0x7f68e40abda0 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 --2- 172.21.15.53:0/737198407 >> v2:172.21.15.87:3300/0 conn(0x7f68e415a610 0x7f68e40cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 -- 172.21.15.53:0/737198407 >> 172.21.15.53:0/737198407 conn(0x7f68e40b0a30 msgr2=0x7f68e40b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 -- 172.21.15.53:0/737198407 shutdown_connections 2024-09-13T18:34:49.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 -- 172.21.15.53:0/737198407 wait complete. 2024-09-13T18:34:49.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 Processor -- start 2024-09-13T18:34:49.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.291+0000 7f68e9020640 1 -- start start 2024-09-13T18:34:49.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e4069f50 0x7f68e4070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b2210 0x7f68e4070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e415a610 0x7f68e4070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e414e830 con 0x7f68e4069f50 2024-09-13T18:34:49.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4150b80 con 0x7f68e415a610 2024-09-13T18:34:49.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4150e60 con 0x7f68e40b2210 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e4069f50 0x7f68e4070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e4069f50 0x7f68e4070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55886/0 (socket says 172.21.15.53:55886) 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 -- 172.21.15.53:0/2763482927 learned_addr learned my addr 172.21.15.53:0/2763482927 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e359e640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e415a610 0x7f68e4070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e259c640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b2210 0x7f68e4070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 -- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b2210 msgr2=0x7f68e4070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b2210 0x7f68e4070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 -- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e415a610 msgr2=0x7f68e4070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e415a610 0x7f68e4070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 -- 172.21.15.53:0/2763482927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc009480 con 0x7f68e4069f50 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e4069f50 0x7f68e4070330 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f68dc007ef0 tx=0x7f68dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68db7fe640 1 -- 172.21.15.53:0/2763482927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc014620 con 0x7f68e4069f50 2024-09-13T18:34:49.299 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68db7fe640 1 -- 172.21.15.53:0/2763482927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc014780 con 0x7f68e4069f50 2024-09-13T18:34:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e4151140 con 0x7f68e4069f50 2024-09-13T18:34:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68db7fe640 1 -- 172.21.15.53:0/2763482927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc014b30 con 0x7f68e4069f50 2024-09-13T18:34:49.300 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e4151700 con 0x7f68e4069f50 2024-09-13T18:34:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68db7fe640 1 -- 172.21.15.53:0/2763482927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f68dc014c90 con 0x7f68e4069f50 2024-09-13T18:34:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68db7fe640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68c4067020 0x7f68c40694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68db7fe640 1 -- 172.21.15.53:0/2763482927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68dc083610 con 0x7f68e4069f50 2024-09-13T18:34:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.295+0000 7f68e259c640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68c4067020 0x7f68c40694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e259c640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68c4067020 0x7f68c40694e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0ae000 tx=0x7f68cc0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 Processor -- start 2024-09-13T18:34:49.301 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- start start 2024-09-13T18:34:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d31f0 0x55591c0d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d3b10 0x55591c089200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c089b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591bf51e80 con 0x55591c089740 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591bedfaf0 con 0x55591c0d31f0 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55591bedd0c0 con 0x55591c0d3b10 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c089b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c089b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55900/0 (socket says 172.21.15.53:55900) 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 -- 172.21.15.53:0/728951089 learned_addr learned my addr 172.21.15.53:0/728951089 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d31f0 0x55591c0d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e259c640 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d3b10 0x55591c089200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 -- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d3b10 msgr2=0x55591c089200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d3b10 0x55591c089200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 -- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d31f0 msgr2=0x55591c0d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d31f0 0x55591c0d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 -- 172.21.15.53:0/728951089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55591bbd4890 con 0x55591c089740 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d31f0 0x55591c0d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68e359e640 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c089b20 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f68d400b8c0 tx=0x7f68d400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ac9d4b2c647adb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68d8ff9640 1 -- 172.21.15.53:0/728951089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d400f9c0 con 0x55591c089740 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68d8ff9640 1 -- 172.21.15.53:0/728951089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d400fb20 con 0x55591c089740 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68d8ff9640 1 -- 172.21.15.53:0/728951089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d400fed0 con 0x55591c089740 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- 172.21.15.53:0/728951089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 msgr2=0x55591c089b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c089b20 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f68d400b8c0 tx=0x7f68d400bd80 comp rx=0 tx=0).stop 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- 172.21.15.53:0/728951089 shutdown_connections 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d3b10 0x55591c089200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c089b20 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 --2- 172.21.15.53:0/728951089 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d31f0 0x55591c0d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- 172.21.15.53:0/728951089 >> 172.21.15.53:0/728951089 conn(0x55591c08ffb0 msgr2=0x55591c090390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- 172.21.15.53:0/728951089 shutdown_connections 2024-09-13T18:34:49.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- 172.21.15.53:0/728951089 wait complete. 2024-09-13T18:34:49.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 -- start start 2024-09-13T18:34:49.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.299+0000 7f68ec169000 1 Processor -- start 2024-09-13T18:34:49.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c094fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c0954f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c095a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591bed89b0 con 0x55591c089740 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591be77c00 con 0x55591c0d3b10 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55591be96070 con 0x55591c0d31f0 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 10 client.0 _ll_register_callbacks cb 0x55591c075ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c094fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c094fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55908/0 (socket says 172.21.15.53:55908) 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 -- 172.21.15.53:0/4154593618 learned_addr learned my addr 172.21.15.53:0/4154593618 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e259c640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c0954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e359e640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c095a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 -- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 msgr2=0x55591c0954f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c0954f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 -- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 msgr2=0x55591c095a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c095a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 -- 172.21.15.53:0/4154593618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d400e040 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e259c640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c0954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e359e640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c095a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c094fb0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00e9b0 tx=0x7f68dc0566b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a20bca34e11884 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 1 -- 172.21.15.53:0/4154593618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc059d20 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 1 -- 172.21.15.53:0/4154593618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68dc05e2e0 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55591be955f0 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 1 -- 172.21.15.53:0/4154593618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68dc083080 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 10 client.10635 fetch_fsmap learned FSMap version 104 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55591be9dab0 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 1 -- 172.21.15.53:0/4154593618 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc071070 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 1 -- 172.21.15.53:0/4154593618 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 104) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68dc005d20 con 0x55591c089740 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 10 client.10635 fetch_fsmap finished waiting for FSMap version 104 2024-09-13T18:34:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 10 client.10635 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 20 client.10635 populate_metadata read hostname 'smithi053' 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c096440 0x55591c0e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 4 client.10635 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 --> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55591bed5790 con 0x55591c096440 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e259c640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c096440 0x55591c0e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 10 client.10635 ms_handle_connect on v2:172.21.15.53:6834/1295090105 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68e259c640 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c096440 0x55591c0e52a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33a6672a14e5086b server_cookie=81320ab5f3f44907 in_seq=0 out_seq=0 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 1 -- 172.21.15.53:0/4154593618 <== mds.0 v2:172.21.15.53:6834/1295090105 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55591bed5790 con 0x55591c096440 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 10 client.10635 handle_command_reply: tid=0 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 client.10635 shutdown 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 msgr2=0x55591c094fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.312 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c094fb0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00e9b0 tx=0x7f68dc0566b0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 shutdown_connections 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c096440 0x55591c0e52a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c0954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c095a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 --2- 172.21.15.53:0/4154593618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c094fb0 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68c1ffb640 0 client.10635 ms_handle_reset on v2:172.21.15.53:6834/1295090105 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 >> 172.21.15.53:0/4154593618 conn(0x55591c08ffb0 msgr2=0x55591c0881f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 shutdown_connections 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 1 -- 172.21.15.53:0/4154593618 wait complete. 2024-09-13T18:34:49.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.303+0000 7f68ec169000 20 client.10635 trim_cache size 0 max 16384 2024-09-13T18:34:49.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 Processor -- start 2024-09-13T18:34:49.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 -- start start 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c089740 0x55591c12f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c12f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c0d3b10 0x55591c12fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591bb95940 con 0x55591c0d3b10 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591becd4d0 con 0x55591c089740 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55591c0951e0 con 0x55591c0d31f0 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c0d3b10 0x55591c12fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c0d3b10 0x55591c12fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55922/0 (socket says 172.21.15.53:55922) 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 -- 172.21.15.53:0/14302786 learned_addr learned my addr 172.21.15.53:0/14302786 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:49.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c089740 0x55591c12f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 -- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 msgr2=0x55591c12f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e259c640 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c12f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c12f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 -- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c089740 msgr2=0x55591c12f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c089740 0x55591c12f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 -- 172.21.15.53:0/14302786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55591be83c00 con 0x55591c0d3b10 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e259c640 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c12f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c089740 0x55591c12f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.319+0000 7f68e359e640 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c0d3b10 0x55591c12fdb0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f68d4017040 tx=0x7f68d4009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d257e5d9c8d918 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68d97fa640 1 -- 172.21.15.53:0/14302786 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4022070 con 0x55591c0d3b10 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68d97fa640 1 -- 172.21.15.53:0/14302786 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d400f7c0 con 0x55591c0d3b10 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68d97fa640 1 -- 172.21.15.53:0/14302786 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d400fb70 con 0x55591c0d3b10 2024-09-13T18:34:49.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/14302786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c0d3b10 msgr2=0x55591c12fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c0d3b10 0x55591c12fdb0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f68d4017040 tx=0x7f68d4009000 comp rx=0 tx=0).stop 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/14302786 shutdown_connections 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c12f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c0d3b10 0x55591c12fdb0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- 172.21.15.53:0/14302786 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c089740 0x55591c12f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/14302786 >> 172.21.15.53:0/14302786 conn(0x55591c08ffb0 msgr2=0x55591c0879d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/14302786 shutdown_connections 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/14302786 wait complete. 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- start start 2024-09-13T18:34:49.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 Processor -- start 2024-09-13T18:34:49.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c1184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c119110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c119650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591bef7180 con 0x55591c089740 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x55591bed61c0 con 0x55591c0d3b10 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x55591bf1b5f0 con 0x55591c0d31f0 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 10 client.0 _ll_register_callbacks cb 0x7f68d400b2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c1184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c1184b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55924/0 (socket says 172.21.15.53:55924) 2024-09-13T18:34:49.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 -- 172.21.15.53:0/1530309670 learned_addr learned my addr 172.21.15.53:0/1530309670 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e359e640 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c119650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 -- 172.21.15.53:0/1530309670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 msgr2=0x55591c119110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c119110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 -- 172.21.15.53:0/1530309670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 msgr2=0x55591c119650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c119650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 -- 172.21.15.53:0/1530309670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55591bbd4890 con 0x55591c089740 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e2d9d640 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c1184b0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0566f0 tx=0x7f68dc016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8c5364e53e80c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68c1ffb640 1 -- 172.21.15.53:0/1530309670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc055850 con 0x55591c089740 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55591bea8460 con 0x55591c089740 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68c1ffb640 1 -- 172.21.15.53:0/1530309670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68dc05e2e0 con 0x55591c089740 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68c1ffb640 1 -- 172.21.15.53:0/1530309670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68dc059d20 con 0x55591c089740 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 10 client.10641 fetch_fsmap learned FSMap version 104 2024-09-13T18:34:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55591bbd4cc0 con 0x55591c089740 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68c1ffb640 1 -- 172.21.15.53:0/1530309670 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55591bea8460 con 0x55591c089740 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68c1ffb640 1 -- 172.21.15.53:0/1530309670 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 104) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68dc005d20 con 0x55591c089740 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 10 client.10641 fetch_fsmap finished waiting for FSMap version 104 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 10 client.10641 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 20 client.10641 populate_metadata read hostname 'smithi053' 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c1189f0 0x55591c119b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 4 client.10641 mds_command: new command op to 10503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 --> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55591bea19c0 con 0x55591c1189f0 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e259c640 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c1189f0 0x55591c119b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68e259c640 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c1189f0 0x55591c119b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c22427929ebc222 server_cookie=4e7d4edb4f94750f in_seq=0 out_seq=0 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.323+0000 7f68c1ffb640 10 client.10641 ms_handle_connect on v2:172.21.15.53:6834/1295090105 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68c1ffb640 1 -- 172.21.15.53:0/1530309670 <== mds.0 v2:172.21.15.53:6834/1295090105 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55591bea19c0 con 0x55591c1189f0 2024-09-13T18:34:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68c1ffb640 10 client.10641 handle_command_reply: tid=0 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 client.10641 shutdown 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 msgr2=0x55591c1184b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c1184b0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f68dc0566f0 tx=0x7f68dc016070 comp rx=0 tx=0).stop 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 shutdown_connections 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:6834/1295090105,v1:172.21.15.53:6835/1295090105] conn(0x55591c1189f0 0x55591c119b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55591c0d31f0 0x55591c119110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55591c0d3b10 0x55591c119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68c1ffb640 0 client.10641 ms_handle_reset on v2:172.21.15.53:6834/1295090105 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 --2- 172.21.15.53:0/1530309670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55591c089740 0x55591c1184b0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 >> 172.21.15.53:0/1530309670 conn(0x55591c08ffb0 msgr2=0x55591c0881f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 shutdown_connections 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 1 -- 172.21.15.53:0/1530309670 wait complete. 2024-09-13T18:34:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68ec169000 20 client.10641 trim_cache size 0 max 16384 2024-09-13T18:34:49.337 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:34:49.337 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "21cb0879-c92b-403a-9019-7dc078f2eb89", 2024-09-13T18:34:49.337 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2024-09-13T18:34:49.337 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10503, 2024-09-13T18:34:49.337 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2024-09-13T18:34:49.337 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2024-09-13T18:34:49.337 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2024-09-13T18:34:49.338 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 5.7951408649999996, 2024-09-13T18:34:49.338 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 104, 2024-09-13T18:34:49.338 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 174, 2024-09-13T18:34:49.338 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 174, 2024-09-13T18:34:49.338 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 10.129960618 2024-09-13T18:34:49.338 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68c4067020 msgr2=0x7f68c40694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68c4067020 0x7f68c40694e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0ae000 tx=0x7f68cc0a7000 comp rx=0 tx=0).stop 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e4069f50 msgr2=0x7f68e4070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e4069f50 0x7f68e4070330 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f68dc007ef0 tx=0x7f68dc00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 shutdown_connections 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68c4067020 0x7f68c40694e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68e40b2210 0x7f68e4070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68e415a610 0x7f68e4070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 --2- 172.21.15.53:0/2763482927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68e4069f50 0x7f68e4070330 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 >> 172.21.15.53:0/2763482927 conn(0x7f68e40b0a30 msgr2=0x7f68e414f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 shutdown_connections 2024-09-13T18:34:49.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.327+0000 7f68e9020640 1 -- 172.21.15.53:0/2763482927 wait complete. 2024-09-13T18:34:49.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:34:49.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded6913640 1 Processor -- start 2024-09-13T18:34:49.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded6913640 1 -- start start 2024-09-13T18:34:49.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded6913640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 0x7fded0065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded6913640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fded00661c0 0x7fded00ad380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded6913640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded0066600 con 0x7fded00ad8c0 2024-09-13T18:34:49.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded6913640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded00b3790 con 0x7fded00661c0 2024-09-13T18:34:49.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded6913640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded00ae100 con 0x7fded0146300 2024-09-13T18:34:49.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded4eb0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fded00ad8c0 0x7fded0070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51906/0 (socket says 172.21.15.53:51906) 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded4eb0640 1 -- 172.21.15.53:0/425133649 learned_addr learned my addr 172.21.15.53:0/425133649 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecf7fe640 1 --2- 172.21.15.53:0/425133649 >> v2:172.21.15.87:3300/0 conn(0x7fded00661c0 0x7fded00ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecffff640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 0x7fded0065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898957821 0 0) 0x7fded0066600 con 0x7fded00ad8c0 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdebc003530 con 0x7fded00ad8c0 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 386088994 0 0) 0x7fdebc003530 con 0x7fded00ad8c0 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 msgr2=0x7fded0065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 0x7fded0065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 >> v2:172.21.15.87:3300/0 conn(0x7fded00661c0 msgr2=0x7fded00ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 --2- 172.21.15.53:0/425133649 >> v2:172.21.15.87:3300/0 conn(0x7fded00661c0 0x7fded00ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00ae3e0 con 0x7fded00ad8c0 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdec0001680 con 0x7fded00ad8c0 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 >> v1:172.21.15.53:6789/0 conn(0x7fded00ad8c0 legacy=0x7fded0070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fdebc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdebc0047d0 0x7fdebc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 0x7fdebc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00b3790 con 0x7fdebc003980 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00ae100 con 0x7fdebc0047d0 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc00b990 con 0x7fded0146300 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecffff640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fdebc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecf7fe640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdebc0047d0 0x7fdebc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded4eb0640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 0x7fdebc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecffff640 1 -- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 msgr2=0x7fdebc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecffff640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 0x7fdebc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecffff640 1 -- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdebc0047d0 msgr2=0x7fdebc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecffff640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdebc0047d0 0x7fdebc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecffff640 1 -- 172.21.15.53:0/425133649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc003530 con 0x7fdebc003980 2024-09-13T18:34:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fdecf7fe640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdebc0047d0 0x7fdebc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.455+0000 7fded4eb0640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0146300 0x7fdebc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:49.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fdecffff640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fdebc003da0 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e170 tx=0x7fdec801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca4f87792d64e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80a5b60 con 0x7fdebc003980 2024-09-13T18:34:49.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec800f040 con 0x7fdebc003980 2024-09-13T18:34:49.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fdeceffd640 1 -- 172.21.15.53:0/425133649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80ad440 con 0x7fdebc003980 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 -- 172.21.15.53:0/425133649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 msgr2=0x7fdebc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 --2- 172.21.15.53:0/425133649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fdebc003da0 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e170 tx=0x7fdec801cc30 comp rx=0 tx=0).stop 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded4eb0640 1 -- 172.21.15.53:0/425133649 reap_dead start 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 -- 172.21.15.53:0/425133649 shutdown_connections 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 -- 172.21.15.53:0/425133649 >> 172.21.15.53:0/425133649 conn(0x7fded0069f50 msgr2=0x7fded006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 -- 172.21.15.53:0/425133649 shutdown_connections 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 -- 172.21.15.53:0/425133649 wait complete. 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 Processor -- start 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.459+0000 7fded6913640 1 -- start start 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fded01431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0141a20 0x7fded01f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0160300 0x7fded0160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded0160cd0 con 0x7fdebc003980 2024-09-13T18:34:49.468 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded0166860 con 0x7fded0141a20 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded01436e0 con 0x7fded0160300 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fded01431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fded01431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55944/0 (socket says 172.21.15.53:55944) 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 -- 172.21.15.53:0/156744505 learned_addr learned my addr 172.21.15.53:0/156744505 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecf7fe640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0141a20 0x7fded01f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded4eb0640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0160300 0x7fded0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 -- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0160300 msgr2=0x7fded0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0160300 0x7fded0160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 -- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0141a20 msgr2=0x7fded01f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0141a20 0x7fded01f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 -- 172.21.15.53:0/156744505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0166580 con 0x7fdebc003980 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded4eb0640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0160300 0x7fded0160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:49.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecffff640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fded01431a0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fdec80b0040 tx=0x7fdec8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdeccff9640 1 -- 172.21.15.53:0/156744505 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80ad700 con 0x7fdebc003980 2024-09-13T18:34:49.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdeccff9640 1 -- 172.21.15.53:0/156744505 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec80ad880 con 0x7fdebc003980 2024-09-13T18:34:49.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded015ea70 con 0x7fdebc003980 2024-09-13T18:34:49.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdeccff9640 1 -- 172.21.15.53:0/156744505 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80adc30 con 0x7fdebc003980 2024-09-13T18:34:49.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded015f030 con 0x7fdebc003980 2024-09-13T18:34:49.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded00b2f40 con 0x7fdebc003980 2024-09-13T18:34:49.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdeccff9640 1 -- 172.21.15.53:0/156744505 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7fdec80b4040 con 0x7fdebc003980 2024-09-13T18:34:49.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdeccff9640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdeb0067020 0x7fdeb00694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:49.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdeccff9640 1 -- 172.21.15.53:0/156744505 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdec811db70 con 0x7fdebc003980 2024-09-13T18:34:49.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.463+0000 7fdecf7fe640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdeb0067020 0x7fdeb00694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:49.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.467+0000 7fdecf7fe640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdeb0067020 0x7fdeb00694e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009980 tx=0x7fdeb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:49.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.467+0000 7fdeccff9640 1 -- 172.21.15.53:0/156744505 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdec80ec770 con 0x7fdebc003980 2024-09-13T18:34:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fded006af60 con 0x7fdebc003980 2024-09-13T18:34:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fdeccff9640 1 -- 172.21.15.53:0/156744505 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdec80b2070 con 0x7fdebc003980 2024-09-13T18:34:49.670 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:34:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdeb0067020 msgr2=0x7fdeb00694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdeb0067020 0x7fdeb00694e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009980 tx=0x7fdeb8008040 comp rx=0 tx=0).stop 2024-09-13T18:34:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 msgr2=0x7fded01431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fded01431a0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fdec80b0040 tx=0x7fdec8009750 comp rx=0 tx=0).stop 2024-09-13T18:34:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 shutdown_connections 2024-09-13T18:34:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fdeb0067020 0x7fdeb00694e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fded0160300 0x7fded0160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fded0141a20 0x7fded01f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 --2- 172.21.15.53:0/156744505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdebc003980 0x7fded01431a0 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 >> 172.21.15.53:0/156744505 conn(0x7fded0069f50 msgr2=0x7fded006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 shutdown_connections 2024-09-13T18:34:49.673 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:49.667+0000 7fded6913640 1 -- 172.21.15.53:0/156744505 wait complete. 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:34:49.688 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:34:49.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:49.689 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2024-09-13T18:34:49.694 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:34:49.694 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:34:49.694 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:34:49.694 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.694 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41907sec preferred_lft 41907sec 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:49.695 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:53:24:83:26 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:34:49.696 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:49.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:49.697 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:34:49.745 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-13T18:34:49.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:49.746 DEBUG:teuthology.orchestra.run.smithi053:> route 2024-09-13T18:34:49.795 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2024-09-13T18:34:49.795 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:34:49.795 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T18:34:49.795 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:34:49.795 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T18:34:49.795 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:34:49.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:49.796 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2024-09-13T18:34:49.796 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2024-09-13T18:34:49.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:34:49.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:34:49.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:34:49.796 DEBUG:teuthology.orchestra.run.smithi053:> ') 2024-09-13T18:34:49.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:49.869 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:34:49.917 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:34:49.918 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:34:49.918 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:34:49.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:49.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2024-09-13T18:34:49.974 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:34:49.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:49.974 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:50.022 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:34:50.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:50.022 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:50.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:34:50.127 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:50.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:50.180 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:50.181 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:50.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:50.182 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:34:50.230 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:34:50.230 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:34:50.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:34:50.289 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:50.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:50.348 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:50.349 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:50.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:50.350 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:34:50.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2024-09-13T18:34:50.355+0000 7fa10ae1f580 -1 init, newargv = 0x55b7e2315d80 newargc=15 2024-09-13T18:34:50.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[59783]: starting ceph client 2024-09-13T18:34:50.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[59783]: starting fuse 2024-09-13T18:34:51.465 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2024-09-13T18:34:51.482 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:51.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:51.536 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:51.537 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:51.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:51.538 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2024-09-13T18:34:51.591 INFO:teuthology.orchestra.run.smithi053.stdout:45 2024-09-13T18:34:51.592 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> import re 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> import os 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2024-09-13T18:34:51.592 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:34:51.593 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2024-09-13T18:34:51.594 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2024-09-13T18:34:51.594 DEBUG:teuthology.orchestra.run.smithi053:> return f 2024-09-13T18:34:51.594 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:34:51.594 DEBUG:teuthology.orchestra.run.smithi053:> 2024-09-13T18:34:51.594 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2024-09-13T18:34:51.594 DEBUG:teuthology.orchestra.run.smithi053:> ' 2024-09-13T18:34:51.718 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.59783.asok 2024-09-13T18:34:51.899 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59783.asok 2024-09-13T18:34:51.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:51.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59783.asok status 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "59783", 2024-09-13T18:34:52.059 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10653, 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10653 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:52.060 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3026669896 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3026669896 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10653 192.168.0.1:0/3026669896", 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3026669896", 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 104, 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 174, 2024-09-13T18:34:52.061 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:34:52.062 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2024-09-13T18:34:52.062 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2024-09-13T18:34:52.062 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:34:52.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.073 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2024-09-13T18:34:52.073 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:52.078 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2024-09-13T18:34:52.079 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:52.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:34:52.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:34:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f1685241640 1 Processor -- start 2024-09-13T18:34:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f1685241640 1 -- start start 2024-09-13T18:34:52.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f1685241640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168015b7c0 0x7f1680070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:52.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f1685241640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16800711d0 0x7f16801640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:52.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f1685241640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168006d480 con 0x7f16801582a0 2024-09-13T18:34:52.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f1685241640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168015aaf0 con 0x7f16800711d0 2024-09-13T18:34:52.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f1685241640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168006d760 con 0x7f168015b7c0 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16800711d0 0x7f16801640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16800711d0 0x7f16801640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55948/0 (socket says 172.21.15.53:55948) 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167f59e640 1 -- 172.21.15.53:0/3188140717 learned_addr learned my addr 172.21.15.53:0/3188140717 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167659c640 1 --2- 172.21.15.53:0/3188140717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168015b7c0 0x7f1680070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167f59e640 1 -- 172.21.15.53:0/3188140717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168015b7c0 msgr2=0x7f1680070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167f59e640 1 --2- 172.21.15.53:0/3188140717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168015b7c0 0x7f1680070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167f59e640 1 -- 172.21.15.53:0/3188140717 >> v1:172.21.15.87:6789/0 conn(0x7f16801582a0 legacy=0x7f168006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.311+0000 7f167f59e640 1 -- 172.21.15.53:0/3188140717 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168015ace0 con 0x7f16800711d0 2024-09-13T18:34:52.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167f59e640 1 --2- 172.21.15.53:0/3188140717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16800711d0 0x7f16801640f0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f1678009e50 tx=0x7f167801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f18421006d1fc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:52.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167e59c640 1 -- 172.21.15.53:0/3188140717 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780a57f0 con 0x7f16800711d0 2024-09-13T18:34:52.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167e59c640 1 -- 172.21.15.53:0/3188140717 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16780a5950 con 0x7f16800711d0 2024-09-13T18:34:52.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167e59c640 1 -- 172.21.15.53:0/3188140717 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780a5ce0 con 0x7f16800711d0 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- 172.21.15.53:0/3188140717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16800711d0 msgr2=0x7f16801640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 --2- 172.21.15.53:0/3188140717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16800711d0 0x7f16801640f0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f1678009e50 tx=0x7f167801ca30 comp rx=0 tx=0).stop 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- 172.21.15.53:0/3188140717 shutdown_connections 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 --2- 172.21.15.53:0/3188140717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16800711d0 0x7f16801640f0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 --2- 172.21.15.53:0/3188140717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f168015b7c0 0x7f1680070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- 172.21.15.53:0/3188140717 >> 172.21.15.53:0/3188140717 conn(0x7f1680065c80 msgr2=0x7f1680066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- 172.21.15.53:0/3188140717 shutdown_connections 2024-09-13T18:34:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- 172.21.15.53:0/3188140717 wait complete. 2024-09-13T18:34:52.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 Processor -- start 2024-09-13T18:34:52.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- start start 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16800711d0 0x7f1680148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16801582a0 0x7f16801486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168015b7c0 0x7f16800ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800b3510 con 0x7f16801582a0 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16801571b0 con 0x7f168015b7c0 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f1685241640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800b3230 con 0x7f16800711d0 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16801582a0 0x7f16801486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16801582a0 0x7f16801486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55954/0 (socket says 172.21.15.53:55954) 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 -- 172.21.15.53:0/2492538328 learned_addr learned my addr 172.21.15.53:0/2492538328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167f59e640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168015b7c0 0x7f16800ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167ed9d640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16800711d0 0x7f1680148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 -- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16800711d0 msgr2=0x7f1680148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16800711d0 0x7f1680148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 -- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168015b7c0 msgr2=0x7f16800ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168015b7c0 0x7f16800ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167659c640 1 -- 172.21.15.53:0/2492538328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678009b30 con 0x7f16801582a0 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167f59e640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168015b7c0 0x7f16800ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.315+0000 7f167ed9d640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16800711d0 0x7f1680148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f167659c640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16801582a0 0x7f16801486f0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f166800d800 tx=0x7f166800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1677fff640 1 -- 172.21.15.53:0/2492538328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800b6c0 con 0x7f16801582a0 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1677fff640 1 -- 172.21.15.53:0/2492538328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166800b820 con 0x7f16801582a0 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1677fff640 1 -- 172.21.15.53:0/2492538328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800bb90 con 0x7f16801582a0 2024-09-13T18:34:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16801566d0 con 0x7f16801582a0 2024-09-13T18:34:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1680156c90 con 0x7f16801582a0 2024-09-13T18:34:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1680067400 con 0x7f16801582a0 2024-09-13T18:34:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1677fff640 1 -- 172.21.15.53:0/2492538328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f166800bcf0 con 0x7f16801582a0 2024-09-13T18:34:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1677fff640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1660067020 0x7f16600694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f1677fff640 1 -- 172.21.15.53:0/2492538328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1668083ce0 con 0x7f16801582a0 2024-09-13T18:34:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f167ed9d640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1660067020 0x7f16600694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:52.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.319+0000 7f167ed9d640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1660067020 0x7f16600694e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1680152760 tx=0x7f1670009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.323+0000 7f1677fff640 1 -- 172.21.15.53:0/2492538328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16680528e0 con 0x7f16801582a0 2024-09-13T18:34:52.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.519+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1680070520 con 0x7f16801582a0 2024-09-13T18:34:52.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.519+0000 7f1677fff640 1 -- 172.21.15.53:0/2492538328 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1668055f00 con 0x7f16801582a0 2024-09-13T18:34:52.524 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1660067020 msgr2=0x7f16600694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1660067020 0x7f16600694e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1680152760 tx=0x7f1670009040 comp rx=0 tx=0).stop 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16801582a0 msgr2=0x7f16801486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16801582a0 0x7f16801486f0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f166800d800 tx=0x7f166800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 shutdown_connections 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f1660067020 0x7f16600694e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f168015b7c0 0x7f16800ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16801582a0 0x7f16801486f0 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 --2- 172.21.15.53:0/2492538328 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f16800711d0 0x7f1680148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:52.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 >> 172.21.15.53:0/2492538328 conn(0x7f1680065c80 msgr2=0x7f1680155190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 shutdown_connections 2024-09-13T18:34:52.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:52.523+0000 7f1685241640 1 -- 172.21.15.53:0/2492538328 wait complete. 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:34:52.544 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:34:52.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.545 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-09-13T18:34:52.552 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:34:52.552 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:34:52.552 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:34:52.552 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.552 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-09-13T18:34:52.552 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 41910sec preferred_lft 41910sec 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-09-13T18:34:52.553 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:93:8f:ed:38 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:34:52.554 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T18:34:52.555 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.555 INFO:teuthology.orchestra.run.smithi087.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:34:52.555 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:34:52.555 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T18:34:52.555 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:34:52.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.555 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:34:52.610 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-09-13T18:34:52.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.612 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-09-13T18:34:52.665 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-09-13T18:34:52.665 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:34:52.665 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:34:52.665 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:34:52.665 INFO:teuthology.orchestra.run.smithi087.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T18:34:52.666 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:34:52.666 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:34:52.666 INFO:teuthology.orchestra.run.smithi087.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:34:52.666 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:34:52.666 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:34:52.666 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:34:52.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.666 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2024-09-13T18:34:52.666 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-09-13T18:34:52.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:34:52.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:34:52.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:34:52.667 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-09-13T18:34:52.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.743 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:34:52.789 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:34:52.789 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:34:52.789 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:34:52.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:52.790 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-09-13T18:34:52.844 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T18:34:52.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:52.845 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:52.893 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:34:52.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:34:52.894 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:52.940 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:34:52.999 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:52.999 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:53.052 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:53.053 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:53.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:53.053 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:34:53.100 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:34:53.101 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T18:34:53.150 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:34:53.162 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:53.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:53.215 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:53.215 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:53.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:53.216 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:34:53.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-09-13T18:34:53.227+0000 7fd186e8c580 -1 init, newargv = 0x55a68726e360 newargc=15 2024-09-13T18:34:53.225 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36842]: starting ceph client 2024-09-13T18:34:53.231 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36842]: starting fuse 2024-09-13T18:34:54.331 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-09-13T18:34:54.347 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:34:54.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:34:54.401 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:34:54.402 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:34:54.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:54.402 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-09-13T18:34:54.449 INFO:teuthology.orchestra.run.smithi087.stdout:45 2024-09-13T18:34:54.449 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T18:34:54.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-09-13T18:34:54.453 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-09-13T18:34:54.454 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-09-13T18:34:54.569 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.36842.asok 2024-09-13T18:34:54.752 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.36842.asok 2024-09-13T18:34:54.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:54.752 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.36842.asok status 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "36842", 2024-09-13T18:34:54.913 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 9139, 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 9139 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2218609348 2024-09-13T18:34:54.914 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2218609348 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.9139 192.168.0.1:0/2218609348", 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/2218609348", 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 104, 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 174, 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:34:54.915 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-09-13T18:34:54.916 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-09-13T18:34:54.916 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-09-13T18:34:54.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:54.926 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-09-13T18:34:54.926 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:54.932 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-09-13T18:34:54.932 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:54.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:54.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:34:54.988 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-13T18:34:55.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 Processor -- start 2024-09-13T18:34:55.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- start start 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cd6f0 0x7f9f500b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f500cdad0 0x7f9f50143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500b3020 con 0x7f9f50143d50 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500b1f80 con 0x7f9f500cdad0 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b2260 con 0x7f9f500cd6f0 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9f50143d50 0x7f9f5015dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51908/0 (socket says 172.21.15.53:51908) 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4f7fe640 1 -- 172.21.15.53:0/2768583211 learned_addr learned my addr 172.21.15.53:0/2768583211 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:55.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4e7fc640 1 --2- 172.21.15.53:0/2768583211 >> v2:172.21.15.53:3300/0 conn(0x7f9f500cdad0 0x7f9f50143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4effd640 1 --2- 172.21.15.53:0/2768583211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cd6f0 0x7f9f500b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4dffb640 1 -- 172.21.15.53:0/2768583211 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521533502 0 0) 0x7f9f500b3020 con 0x7f9f50143d50 2024-09-13T18:34:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4dffb640 1 -- 172.21.15.53:0/2768583211 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f38003530 con 0x7f9f50143d50 2024-09-13T18:34:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4e7fc640 1 -- 172.21.15.53:0/2768583211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cd6f0 msgr2=0x7f9f500b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4e7fc640 1 --2- 172.21.15.53:0/2768583211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cd6f0 0x7f9f500b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:55.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4e7fc640 1 -- 172.21.15.53:0/2768583211 >> v1:172.21.15.53:6789/0 conn(0x7f9f50143d50 legacy=0x7f9f5015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4e7fc640 1 -- 172.21.15.53:0/2768583211 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500b2540 con 0x7f9f500cdad0 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4effd640 1 --2- 172.21.15.53:0/2768583211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cd6f0 0x7f9f500b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4e7fc640 1 --2- 172.21.15.53:0/2768583211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cdad0 0x7f9f50143810 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f9f400097c0 tx=0x7f9f4001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814f447270f26f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4dffb640 1 -- 172.21.15.53:0/2768583211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400ad640 con 0x7f9f500cdad0 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4dffb640 1 -- 172.21.15.53:0/2768583211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f400ad7a0 con 0x7f9f500cdad0 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f4dffb640 1 -- 172.21.15.53:0/2768583211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400adb30 con 0x7f9f500cdad0 2024-09-13T18:34:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- 172.21.15.53:0/2768583211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cdad0 msgr2=0x7f9f50143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 --2- 172.21.15.53:0/2768583211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cdad0 0x7f9f50143810 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f9f400097c0 tx=0x7f9f4001c470 comp rx=0 tx=0).stop 2024-09-13T18:34:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- 172.21.15.53:0/2768583211 shutdown_connections 2024-09-13T18:34:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 --2- 172.21.15.53:0/2768583211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cdad0 0x7f9f50143810 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 --2- 172.21.15.53:0/2768583211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cd6f0 0x7f9f500b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:55.135 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- 172.21.15.53:0/2768583211 >> 172.21.15.53:0/2768583211 conn(0x7f9f50073330 msgr2=0x7f9f50065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- 172.21.15.53:0/2768583211 shutdown_connections 2024-09-13T18:34:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.131+0000 7f9f552c9640 1 -- 172.21.15.53:0/2768583211 wait complete. 2024-09-13T18:34:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 Processor -- start 2024-09-13T18:34:55.137 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 -- start start 2024-09-13T18:34:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cd6f0 0x7f9f500af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cdad0 0x7f9f50141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f50143d50 0x7f9f5015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b0dd0 con 0x7f9f500cd6f0 2024-09-13T18:34:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b01c0 con 0x7f9f50143d50 2024-09-13T18:34:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b04a0 con 0x7f9f500cdad0 2024-09-13T18:34:55.139 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cd6f0 0x7f9f500af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cd6f0 0x7f9f500af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55970/0 (socket says 172.21.15.53:55970) 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 -- 172.21.15.53:0/1942610905 learned_addr learned my addr 172.21.15.53:0/1942610905 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4e7fc640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cdad0 0x7f9f50141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4f7fe640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f50143d50 0x7f9f5015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 -- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cdad0 msgr2=0x7f9f50141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cdad0 0x7f9f50141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 -- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f50143d50 msgr2=0x7f9f5015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f50143d50 0x7f9f5015cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 -- 172.21.15.53:0/1942610905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40009420 con 0x7f9f500cd6f0 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f4effd640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cd6f0 0x7f9f500af8c0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400c7f0 tx=0x7f9f4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f377fe640 1 -- 172.21.15.53:0/1942610905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44007820 con 0x7f9f500cd6f0 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f377fe640 1 -- 172.21.15.53:0/1942610905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f44007980 con 0x7f9f500cd6f0 2024-09-13T18:34:55.140 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f500b0780 con 0x7f9f500cd6f0 2024-09-13T18:34:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f377fe640 1 -- 172.21.15.53:0/1942610905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44007d30 con 0x7f9f500cd6f0 2024-09-13T18:34:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500afe00 con 0x7f9f500cd6f0 2024-09-13T18:34:55.141 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f500b1490 con 0x7f9f500cd6f0 2024-09-13T18:34:55.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.135+0000 7f9f377fe640 1 -- 172.21.15.53:0/1942610905 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f9f440113f0 con 0x7f9f500cd6f0 2024-09-13T18:34:55.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.139+0000 7f9f377fe640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9f3c067050 0x7f9f3c069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:55.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.139+0000 7f9f377fe640 1 -- 172.21.15.53:0/1942610905 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f44083020 con 0x7f9f500cd6f0 2024-09-13T18:34:55.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.139+0000 7f9f4e7fc640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9f3c067050 0x7f9f3c069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:55.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.139+0000 7f9f4e7fc640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9f3c067050 0x7f9f3c069510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9f400af000 tx=0x7f9f40008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:55.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.143+0000 7f9f377fe640 1 -- 172.21.15.53:0/1942610905 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f44051bb0 con 0x7f9f500cd6f0 2024-09-13T18:34:55.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.339+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9f5006a350 con 0x7f9f500cd6f0 2024-09-13T18:34:55.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.971+0000 7f9f377fe640 1 -- 172.21.15.53:0/1942610905 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v105) v1 ==== 136+0+0 (secure 0 0 0) 0x7f9f440551d0 con 0x7f9f500cd6f0 2024-09-13T18:34:56.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9f3c067050 msgr2=0x7f9f3c069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9f3c067050 0x7f9f3c069510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9f400af000 tx=0x7f9f40008040 comp rx=0 tx=0).stop 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cd6f0 msgr2=0x7f9f500af8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cd6f0 0x7f9f500af8c0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400c7f0 tx=0x7f9f4400ccb0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 shutdown_connections 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f9f3c067050 0x7f9f3c069510 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9f500cdad0 0x7f9f50141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f50143d50 0x7f9f5015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 --2- 172.21.15.53:0/1942610905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f500cd6f0 0x7f9f500af8c0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 >> 172.21.15.53:0/1942610905 conn(0x7f9f50073330 msgr2=0x7f9f500ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 shutdown_connections 2024-09-13T18:34:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:55.975+0000 7f9f552c9640 1 -- 172.21.15.53:0/1942610905 wait complete. 2024-09-13T18:34:56.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-13T18:34:56.614 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:34:56.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a174a7640 1 Processor -- start 2024-09-13T18:34:56.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a174a7640 1 -- start start 2024-09-13T18:34:56.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a174a7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a1015cab0 0x7f1a100d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:56.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a174a7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cd6c0 0x7f1a100cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:56.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a174a7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a100d2400 con 0x7f1a100cdb00 2024-09-13T18:34:56.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a174a7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a100d1530 con 0x7f1a1015cab0 2024-09-13T18:34:56.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a174a7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100d0920 con 0x7f1a100cd6c0 2024-09-13T18:34:56.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a14a42640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cd6c0 0x7f1a100cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a15243640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a1015cab0 0x7f1a100d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a15a44640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1a100cdb00 0x7f1a100b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:45538/0 (socket says 172.21.15.53:45538) 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.743+0000 7f1a15a44640 1 -- 172.21.15.53:0/3346653299 learned_addr learned my addr 172.21.15.53:0/3346653299 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a14a42640 1 -- 172.21.15.53:0/3346653299 >> v2:172.21.15.87:3300/0 conn(0x7f1a1015cab0 msgr2=0x7f1a100d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a14a42640 1 --2- 172.21.15.53:0/3346653299 >> v2:172.21.15.87:3300/0 conn(0x7f1a1015cab0 0x7f1a100d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a14a42640 1 -- 172.21.15.53:0/3346653299 >> v1:172.21.15.87:6789/0 conn(0x7f1a100cdb00 legacy=0x7f1a100b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a14a42640 1 -- 172.21.15.53:0/3346653299 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100d0c00 con 0x7f1a100cd6c0 2024-09-13T18:34:56.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a15243640 1 --2- 172.21.15.53:0/3346653299 >> v2:172.21.15.87:3300/0 conn(0x7f1a1015cab0 0x7f1a100d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:34:56.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a14a42640 1 --2- 172.21.15.53:0/3346653299 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cd6c0 0x7f1a100cf0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a000097c0 tx=0x7f1a0001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a01dc4a387858e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:56.748 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a07fff640 1 -- 172.21.15.53:0/3346653299 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000ad680 con 0x7f1a100cd6c0 2024-09-13T18:34:56.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a07fff640 1 -- 172.21.15.53:0/3346653299 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000ad7e0 con 0x7f1a100cd6c0 2024-09-13T18:34:56.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.747+0000 7f1a07fff640 1 -- 172.21.15.53:0/3346653299 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000adb70 con 0x7f1a100cd6c0 2024-09-13T18:34:56.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- 172.21.15.53:0/3346653299 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cd6c0 msgr2=0x7f1a100cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 --2- 172.21.15.53:0/3346653299 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cd6c0 0x7f1a100cf0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a000097c0 tx=0x7f1a0001c470 comp rx=0 tx=0).stop 2024-09-13T18:34:56.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- 172.21.15.53:0/3346653299 shutdown_connections 2024-09-13T18:34:56.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 --2- 172.21.15.53:0/3346653299 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cd6c0 0x7f1a100cf0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 --2- 172.21.15.53:0/3346653299 >> v2:172.21.15.87:3300/0 conn(0x7f1a1015cab0 0x7f1a100d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- 172.21.15.53:0/3346653299 >> 172.21.15.53:0/3346653299 conn(0x7f1a10065c80 msgr2=0x7f1a10066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:56.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- 172.21.15.53:0/3346653299 shutdown_connections 2024-09-13T18:34:56.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- 172.21.15.53:0/3346653299 wait complete. 2024-09-13T18:34:56.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 Processor -- start 2024-09-13T18:34:56.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- start start 2024-09-13T18:34:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a100cd6c0 0x7f1a100c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cdb00 0x7f1a10166ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1015cab0 0x7f1a10164a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1015b870 con 0x7f1a1015cab0 2024-09-13T18:34:56.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1015b2b0 con 0x7f1a100cd6c0 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1015b590 con 0x7f1a100cdb00 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1015cab0 0x7f1a10164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1015cab0 0x7f1a10164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44186/0 (socket says 172.21.15.53:44186) 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 -- 172.21.15.53:0/474858662 learned_addr learned my addr 172.21.15.53:0/474858662 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a14a42640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cdb00 0x7f1a10166ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15243640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a100cd6c0 0x7f1a100c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 -- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cdb00 msgr2=0x7f1a10166ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cdb00 0x7f1a10166ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 -- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a100cd6c0 msgr2=0x7f1a100c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a100cd6c0 0x7f1a100c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 -- 172.21.15.53:0/474858662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009420 con 0x7f1a1015cab0 2024-09-13T18:34:56.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a15a44640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1015cab0 0x7f1a10164a40 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800caf0 tx=0x7f1a0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a05ffb640 1 -- 172.21.15.53:0/474858662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800aca0 con 0x7f1a1015cab0 2024-09-13T18:34:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a05ffb640 1 -- 172.21.15.53:0/474858662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800ae00 con 0x7f1a1015cab0 2024-09-13T18:34:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a00009420 con 0x7f1a1015cab0 2024-09-13T18:34:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a05ffb640 1 -- 172.21.15.53:0/474858662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08012600 con 0x7f1a1015cab0 2024-09-13T18:34:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.751+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1015fb00 con 0x7f1a1015cab0 2024-09-13T18:34:56.755 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.755+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1015fcf0 con 0x7f1a1015cab0 2024-09-13T18:34:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.755+0000 7f1a05ffb640 1 -- 172.21.15.53:0/474858662 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f1a08007070 con 0x7f1a1015cab0 2024-09-13T18:34:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.755+0000 7f1a05ffb640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19f4067020 0x7f19f40694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.755+0000 7f1a05ffb640 1 -- 172.21.15.53:0/474858662 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a08082ac0 con 0x7f1a1015cab0 2024-09-13T18:34:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.755+0000 7f1a15243640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19f4067020 0x7f19f40694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:56.756 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.755+0000 7f1a15243640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19f4067020 0x7f19f40694e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009cf0 tx=0x7f1a0c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:56.758 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.759+0000 7f1a05ffb640 1 -- 172.21.15.53:0/474858662 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1a08051790 con 0x7f1a1015cab0 2024-09-13T18:34:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.939+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a10169cf0 con 0x7f19f4067020 2024-09-13T18:34:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.943+0000 7f1a05ffb640 1 -- 172.21.15.53:0/474858662 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1a0c009940 con 0x7f19f4067020 2024-09-13T18:34:56.942 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2024-09-13T18:34:56.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2024-09-13T18:34:56.943 INFO:teuthology.orchestra.run.smithi053.stdout: "name": "cephfs" 2024-09-13T18:34:56.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2024-09-13T18:34:56.943 INFO:teuthology.orchestra.run.smithi053.stdout:] 2024-09-13T18:34:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19f4067020 msgr2=0x7f19f40694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19f4067020 0x7f19f40694e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009cf0 tx=0x7f1a0c009190 comp rx=0 tx=0).stop 2024-09-13T18:34:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1015cab0 msgr2=0x7f1a10164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1015cab0 0x7f1a10164a40 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800caf0 tx=0x7f1a0800a060 comp rx=0 tx=0).stop 2024-09-13T18:34:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 shutdown_connections 2024-09-13T18:34:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f19f4067020 0x7f19f40694e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1a100cdb00 0x7f1a10166ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1015cab0 0x7f1a10164a40 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 --2- 172.21.15.53:0/474858662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a100cd6c0 0x7f1a100c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 >> 172.21.15.53:0/474858662 conn(0x7f1a10065c80 msgr2=0x7f1a100d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 shutdown_connections 2024-09-13T18:34:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:56.947+0000 7f1a174a7640 1 -- 172.21.15.53:0/474858662 wait complete. 2024-09-13T18:34:56.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:34:57.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f65650a1640 1 Processor -- start 2024-09-13T18:34:57.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f65650a1640 1 -- start start 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f65650a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f656015b470 0x7f65600abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f65650a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f65600b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f65650a1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656006c980 con 0x7f6560154a50 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f65650a1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65600ac770 con 0x7f656015b470 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f65650a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656006bd70 con 0x7f65600ac2e0 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f656015b470 0x7f65600abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f656015b470 0x7f65600abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44190/0 (socket says 172.21.15.53:44190) 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655e59c640 1 -- 172.21.15.53:0/2157522626 learned_addr learned my addr 172.21.15.53:0/2157522626 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655f59e640 1 --2- 172.21.15.53:0/2157522626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f65600b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655e59c640 1 -- 172.21.15.53:0/2157522626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 msgr2=0x7f65600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655e59c640 1 --2- 172.21.15.53:0/2157522626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f65600b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655e59c640 1 -- 172.21.15.53:0/2157522626 >> v1:172.21.15.87:6789/0 conn(0x7f6560154a50 legacy=0x7f656006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655e59c640 1 -- 172.21.15.53:0/2157522626 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656006c050 con 0x7f656015b470 2024-09-13T18:34:57.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.095+0000 7f655f59e640 1 --2- 172.21.15.53:0/2157522626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f65600b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:57.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f655e59c640 1 --2- 172.21.15.53:0/2157522626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656015b470 0x7f65600abda0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f6554009870 tx=0x7f655401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30c27b3d9d80f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:57.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f655dd9b640 1 -- 172.21.15.53:0/2157522626 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540aa650 con 0x7f656015b470 2024-09-13T18:34:57.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f655dd9b640 1 -- 172.21.15.53:0/2157522626 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65540aa7b0 con 0x7f656015b470 2024-09-13T18:34:57.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f655dd9b640 1 -- 172.21.15.53:0/2157522626 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540aab40 con 0x7f656015b470 2024-09-13T18:34:57.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- 172.21.15.53:0/2157522626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656015b470 msgr2=0x7f65600abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 --2- 172.21.15.53:0/2157522626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656015b470 0x7f65600abda0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f6554009870 tx=0x7f655401c530 comp rx=0 tx=0).stop 2024-09-13T18:34:57.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- 172.21.15.53:0/2157522626 shutdown_connections 2024-09-13T18:34:57.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 --2- 172.21.15.53:0/2157522626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f65600b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 --2- 172.21.15.53:0/2157522626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f656015b470 0x7f65600abda0 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- 172.21.15.53:0/2157522626 >> 172.21.15.53:0/2157522626 conn(0x7f6560069f50 msgr2=0x7f656006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:57.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- 172.21.15.53:0/2157522626 shutdown_connections 2024-09-13T18:34:57.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- 172.21.15.53:0/2157522626 wait complete. 2024-09-13T18:34:57.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 Processor -- start 2024-09-13T18:34:57.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- start start 2024-09-13T18:34:57.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f6560150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560154a50 0x7f656009a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656015b470 0x7f6560151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6560151480 con 0x7f6560154a50 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65600ce700 con 0x7f656015b470 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.099+0000 7f65650a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656009bab0 con 0x7f65600ac2e0 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560154a50 0x7f656009a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560154a50 0x7f656009a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44196/0 (socket says 172.21.15.53:44196) 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 -- 172.21.15.53:0/919492889 learned_addr learned my addr 172.21.15.53:0/919492889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:57.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655ed9d640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f6560150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655f59e640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656015b470 0x7f6560151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 -- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 msgr2=0x7f6560150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f6560150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 -- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656015b470 msgr2=0x7f6560151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656015b470 0x7f6560151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 -- 172.21.15.53:0/919492889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65540094d0 con 0x7f6560154a50 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655e59c640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560154a50 0x7f656009a480 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f65540ac040 tx=0x7f65540192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65477fe640 1 -- 172.21.15.53:0/919492889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540b4810 con 0x7f6560154a50 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65477fe640 1 -- 172.21.15.53:0/919492889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65540b49b0 con 0x7f6560154a50 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656009a9c0 con 0x7f6560154a50 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65477fe640 1 -- 172.21.15.53:0/919492889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540b4d60 con 0x7f6560154a50 2024-09-13T18:34:57.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656009b460 con 0x7f6560154a50 2024-09-13T18:34:57.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656009b2c0 con 0x7f6560154a50 2024-09-13T18:34:57.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65477fe640 1 -- 172.21.15.53:0/919492889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f65540b3390 con 0x7f6560154a50 2024-09-13T18:34:57.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65477fe640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f654c067020 0x7f654c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f65477fe640 1 -- 172.21.15.53:0/919492889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f655411d850 con 0x7f6560154a50 2024-09-13T18:34:57.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655ed9d640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f654c067020 0x7f654c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.103+0000 7f655ed9d640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f654c067020 0x7f654c0694e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6550000f70 tx=0x7f6550009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:57.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.107+0000 7f65477fe640 1 -- 172.21.15.53:0/919492889 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f656009b2c0 con 0x7f6560154a50 2024-09-13T18:34:57.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.267+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f656009b2c0 con 0x7f6560154a50 2024-09-13T18:34:57.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.267+0000 7f65477fe640 1 -- 172.21.15.53:0/919492889 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f656009b2c0 con 0x7f6560154a50 2024-09-13T18:34:57.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f654c067020 msgr2=0x7f654c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f654c067020 0x7f654c0694e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6550000f70 tx=0x7f6550009040 comp rx=0 tx=0).stop 2024-09-13T18:34:57.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560154a50 msgr2=0x7f656009a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560154a50 0x7f656009a480 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f65540ac040 tx=0x7f65540192d0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 shutdown_connections 2024-09-13T18:34:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f654c067020 0x7f654c0694e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f656015b470 0x7f6560151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560154a50 0x7f656009a480 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 --2- 172.21.15.53:0/919492889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65600ac2e0 0x7f6560150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 >> 172.21.15.53:0/919492889 conn(0x7f6560069f50 msgr2=0x7f6560159520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 shutdown_connections 2024-09-13T18:34:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.271+0000 7f65650a1640 1 -- 172.21.15.53:0/919492889 wait complete. 2024-09-13T18:34:57.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:57.286 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp30980/subvol87550) 2024-09-13T18:34:57.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:57.309 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-13T18:34:57.360 INFO:teuthology.orchestra.run.smithi053.stdout:cephfs_data 2024-09-13T18:34:57.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:57.360 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp30980/subvol87550) 2024-09-13T18:34:57.420 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:34:57.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp30980/subvol87550/.meta 2024-09-13T18:34:57.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol87550 subvol_grp30980 2024-09-13T18:34:57.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.655+0000 7f2fe3003640 1 Processor -- start 2024-09-13T18:34:57.656 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.655+0000 7f2fe3003640 1 -- start start 2024-09-13T18:34:57.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe3003640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe3003640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2fdc15d150 0x7f2fdc14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe3003640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc14fe10 con 0x7f2fdc071130 2024-09-13T18:34:57.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe3003640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b1c60 con 0x7f2fdc15d150 2024-09-13T18:34:57.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe3003640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b1f40 con 0x7f2fdc14f4f0 2024-09-13T18:34:57.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fdbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2fdc15d150 0x7f2fdc14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc0b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:47440/0 (socket says 172.21.15.53:47440) 2024-09-13T18:34:57.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 -- 172.21.15.53:0/1516564614 learned_addr learned my addr 172.21.15.53:0/1516564614 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:57.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe15a0640 1 --1- 172.21.15.53:0/1516564614 >> v1:172.21.15.87:6789/0 conn(0x7f2fdc071130 0x7f2fdc15c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.53:45544/0 (socket says 172.21.15.53:45544) 2024-09-13T18:34:57.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 -- 172.21.15.53:0/1516564614 >> v2:172.21.15.87:3300/0 conn(0x7f2fdc15d150 msgr2=0x7f2fdc14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:57.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 --2- 172.21.15.53:0/1516564614 >> v2:172.21.15.87:3300/0 conn(0x7f2fdc15d150 0x7f2fdc14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 -- 172.21.15.53:0/1516564614 >> v1:172.21.15.87:6789/0 conn(0x7f2fdc071130 legacy=0x7f2fdc15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.659 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 -- 172.21.15.53:0/1516564614 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0b2220 con 0x7f2fdc14f4f0 2024-09-13T18:34:57.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fe0d9f640 1 --2- 172.21.15.53:0/1516564614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc0b2d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00bb10 tx=0x7f2fcc01ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d186ad117b8162f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:57.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fdb7fe640 1 -- 172.21.15.53:0/1516564614 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0a7cd0 con 0x7f2fdc14f4f0 2024-09-13T18:34:57.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fdb7fe640 1 -- 172.21.15.53:0/1516564614 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc0a7e30 con 0x7f2fdc14f4f0 2024-09-13T18:34:57.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.659+0000 7f2fdb7fe640 1 -- 172.21.15.53:0/1516564614 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0af660 con 0x7f2fdc14f4f0 2024-09-13T18:34:57.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- 172.21.15.53:0/1516564614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 msgr2=0x7f2fdc0b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 --2- 172.21.15.53:0/1516564614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc0b2d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00bb10 tx=0x7f2fcc01ec00 comp rx=0 tx=0).stop 2024-09-13T18:34:57.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- 172.21.15.53:0/1516564614 shutdown_connections 2024-09-13T18:34:57.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 --2- 172.21.15.53:0/1516564614 >> v2:172.21.15.87:3300/0 conn(0x7f2fdc15d150 0x7f2fdc14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 --2- 172.21.15.53:0/1516564614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc0b2d00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- 172.21.15.53:0/1516564614 >> 172.21.15.53:0/1516564614 conn(0x7f2fdc073330 msgr2=0x7f2fdc065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:57.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- 172.21.15.53:0/1516564614 shutdown_connections 2024-09-13T18:34:57.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- 172.21.15.53:0/1516564614 wait complete. 2024-09-13T18:34:57.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 Processor -- start 2024-09-13T18:34:57.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- start start 2024-09-13T18:34:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fdc071130 0x7f2fdc0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fdc15d150 0x7f2fdc0ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0b0700 con 0x7f2fdc15d150 2024-09-13T18:34:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0af120 con 0x7f2fdc071130 2024-09-13T18:34:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe3003640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0af400 con 0x7f2fdc14f4f0 2024-09-13T18:34:57.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe15a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fdc15d150 0x7f2fdc0ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe15a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fdc15d150 0x7f2fdc0ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44198/0 (socket says 172.21.15.53:44198) 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe15a0640 1 -- 172.21.15.53:0/2079165787 learned_addr learned my addr 172.21.15.53:0/2079165787 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fdbfff640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.663+0000 7f2fe0d9f640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fdc071130 0x7f2fdc0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe15a0640 1 -- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 msgr2=0x7f2fdc150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe15a0640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe15a0640 1 -- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fdc071130 msgr2=0x7f2fdc0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe15a0640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fdc071130 0x7f2fdc0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe15a0640 1 -- 172.21.15.53:0/2079165787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc00b770 con 0x7f2fdc15d150 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fdbfff640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe0d9f640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fdc071130 0x7f2fdc0b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe15a0640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fdc15d150 0x7f2fdc0ae6d0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c700 tx=0x7f2fd400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fd97fa640 1 -- 172.21.15.53:0/2079165787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400ce10 con 0x7f2fdc15d150 2024-09-13T18:34:57.666 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fd97fa640 1 -- 172.21.15.53:0/2079165787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd400a640 con 0x7f2fdc15d150 2024-09-13T18:34:57.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc0af6e0 con 0x7f2fdc15d150 2024-09-13T18:34:57.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fd97fa640 1 -- 172.21.15.53:0/2079165787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400a9b0 con 0x7f2fdc15d150 2024-09-13T18:34:57.667 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc0afca0 con 0x7f2fdc15d150 2024-09-13T18:34:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc0afe90 con 0x7f2fdc15d150 2024-09-13T18:34:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fd97fa640 1 -- 172.21.15.53:0/2079165787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f2fd400ab10 con 0x7f2fdc15d150 2024-09-13T18:34:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fd97fa640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2fc8067020 0x7f2fc80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fd97fa640 1 -- 172.21.15.53:0/2079165787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fd40823d0 con 0x7f2fdc15d150 2024-09-13T18:34:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe0d9f640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2fc8067020 0x7f2fc80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:57.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.667+0000 7f2fe0d9f640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2fc8067020 0x7f2fc80694e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0b1000 tx=0x7f2fcc0a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:57.672 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.671+0000 7f2fd97fa640 1 -- 172.21.15.53:0/2079165787 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2fd408a020 con 0x7f2fdc15d150 2024-09-13T18:34:57.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.859+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol87550", "group_name": "subvol_grp30980", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fdc164e50 con 0x7f2fc8067020 2024-09-13T18:34:57.865 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:57.867+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:57.865 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:57.867+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:57.865 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:57.867+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:57.865 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:57.867+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:57.865 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:57.867+0000 7f2616ead640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:57.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.907+0000 7f2fd97fa640 1 -- 172.21.15.53:0/2079165787 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2fcc0af4c0 con 0x7f2fc8067020 2024-09-13T18:34:57.909 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp30980/subvol87550 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2fc8067020 msgr2=0x7f2fc80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2fc8067020 0x7f2fc80694e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0b1000 tx=0x7f2fcc0a9070 comp rx=0 tx=0).stop 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fdc15d150 msgr2=0x7f2fdc0ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fdc15d150 0x7f2fdc0ae6d0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c700 tx=0x7f2fd400cbc0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 shutdown_connections 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f2fc8067020 0x7f2fc80694e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fdc14f4f0 0x7f2fdc150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fdc15d150 0x7f2fdc0ae6d0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 --2- 172.21.15.53:0/2079165787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fdc071130 0x7f2fdc0b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:57.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 >> 172.21.15.53:0/2079165787 conn(0x7f2fdc073330 msgr2=0x7f2fdc0cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:57.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 shutdown_connections 2024-09-13T18:34:57.912 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:57.911+0000 7f2fe3003640 1 -- 172.21.15.53:0/2079165787 wait complete. 2024-09-13T18:34:57.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol87550 subvol_grp30980 2024-09-13T18:34:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.055+0000 7febc7ec3640 1 Processor -- start 2024-09-13T18:34:58.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.055+0000 7febc7ec3640 1 -- start start 2024-09-13T18:34:58.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.055+0000 7febc7ec3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc015c5e0 0x7febc015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:58.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febc00cc800 0x7febc00cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:58.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc0070fb0 con 0x7febc006ccc0 2024-09-13T18:34:58.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc015dd30 con 0x7febc00cc800 2024-09-13T18:34:58.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc0070a10 con 0x7febc015c5e0 2024-09-13T18:34:58.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febc00cc800 0x7febc00cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:58.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7febc00cc800 0x7febc00cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44238/0 (socket says 172.21.15.53:44238) 2024-09-13T18:34:58.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 -- 172.21.15.53:0/620433387 learned_addr learned my addr 172.21.15.53:0/620433387 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:58.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc5c5f640 1 --2- 172.21.15.53:0/620433387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc015c5e0 0x7febc015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:58.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 -- 172.21.15.53:0/620433387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc015c5e0 msgr2=0x7febc015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:58.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 --2- 172.21.15.53:0/620433387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc015c5e0 0x7febc015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 -- 172.21.15.53:0/620433387 >> v1:172.21.15.53:6789/0 conn(0x7febc006ccc0 legacy=0x7febc006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:58.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 -- 172.21.15.53:0/620433387 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00711e0 con 0x7febc00cc800 2024-09-13T18:34:58.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc6460640 1 --2- 172.21.15.53:0/620433387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc00cccb0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc26ef64effa9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:58.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc4c5d640 1 -- 172.21.15.53:0/620433387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80a5870 con 0x7febc00cc800 2024-09-13T18:34:58.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc4c5d640 1 -- 172.21.15.53:0/620433387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb80a59d0 con 0x7febc00cc800 2024-09-13T18:34:58.060 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc4c5d640 1 -- 172.21.15.53:0/620433387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80a5d60 con 0x7febc00cc800 2024-09-13T18:34:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- 172.21.15.53:0/620433387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 msgr2=0x7febc00cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 --2- 172.21.15.53:0/620433387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc00cccb0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e50 tx=0x7febb801ca00 comp rx=0 tx=0).stop 2024-09-13T18:34:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- 172.21.15.53:0/620433387 shutdown_connections 2024-09-13T18:34:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 --2- 172.21.15.53:0/620433387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc00cccb0 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 --2- 172.21.15.53:0/620433387 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc015c5e0 0x7febc015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- 172.21.15.53:0/620433387 >> 172.21.15.53:0/620433387 conn(0x7febc0073330 msgr2=0x7febc0065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- 172.21.15.53:0/620433387 shutdown_connections 2024-09-13T18:34:58.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.059+0000 7febc7ec3640 1 -- 172.21.15.53:0/620433387 wait complete. 2024-09-13T18:34:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 Processor -- start 2024-09-13T18:34:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 -- start start 2024-09-13T18:34:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc006ccc0 0x7febc013a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc01508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febc015c5e0 0x7febc00a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc0151ed0 con 0x7febc00cc800 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01512c0 con 0x7febc015c5e0 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc01515a0 con 0x7febc006ccc0 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc01508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc01508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44254/0 (socket says 172.21.15.53:44254) 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 -- 172.21.15.53:0/3283685932 learned_addr learned my addr 172.21.15.53:0/3283685932 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc5c5f640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc006ccc0 0x7febc013a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc6460640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febc015c5e0 0x7febc00a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 -- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc006ccc0 msgr2=0x7febc013a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc006ccc0 0x7febc013a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 -- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febc015c5e0 msgr2=0x7febc00a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febc015c5e0 0x7febc00a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 -- 172.21.15.53:0/3283685932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8009b30 con 0x7febc00cc800 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc545e640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc01508e0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7febb000c4d0 tx=0x7febb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febb67fc640 1 -- 172.21.15.53:0/3283685932 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00052d0 con 0x7febc00cc800 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febb67fc640 1 -- 172.21.15.53:0/3283685932 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0005430 con 0x7febc00cc800 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc0151880 con 0x7febc00cc800 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febb67fc640 1 -- 172.21.15.53:0/3283685932 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0012830 con 0x7febc00cc800 2024-09-13T18:34:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc014f150 con 0x7febc00cc800 2024-09-13T18:34:58.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.063+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc00cd600 con 0x7febc00cc800 2024-09-13T18:34:58.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.067+0000 7febb67fc640 1 -- 172.21.15.53:0/3283685932 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7febb0012990 con 0x7febc00cc800 2024-09-13T18:34:58.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.067+0000 7febb67fc640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feba4067020 0x7feba40694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.067+0000 7febb67fc640 1 -- 172.21.15.53:0/3283685932 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febb0082770 con 0x7febc00cc800 2024-09-13T18:34:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.067+0000 7febc5c5f640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feba4067020 0x7feba40694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:58.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.067+0000 7febc5c5f640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feba4067020 0x7feba40694e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7febbc00b930 tx=0x7febbc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:58.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.071+0000 7febb67fc640 1 -- 172.21.15.53:0/3283685932 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7febb0051390 con 0x7febc00cc800 2024-09-13T18:34:58.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.255+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol87550", "group_name": "subvol_grp30980", "target": ["mon-mgr", ""]}) v1 -- 0x7febc014f370 con 0x7feba4067020 2024-09-13T18:34:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.263+0000 7febb67fc640 1 -- 172.21.15.53:0/3283685932 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7febc014f370 con 0x7feba4067020 2024-09-13T18:34:58.264 INFO:teuthology.orchestra.run.smithi053.stdout:/volumes/subvol_grp30980/subvol87550 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feba4067020 msgr2=0x7feba40694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feba4067020 0x7feba40694e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7febbc00b930 tx=0x7febbc008040 comp rx=0 tx=0).stop 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 msgr2=0x7febc01508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc01508e0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7febb000c4d0 tx=0x7febb000c990 comp rx=0 tx=0).stop 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 shutdown_connections 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7feba4067020 0x7feba40694e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7febc015c5e0 0x7febc00a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7febc00cc800 0x7febc01508e0 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 --2- 172.21.15.53:0/3283685932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7febc006ccc0 0x7febc013a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 >> 172.21.15.53:0/3283685932 conn(0x7febc0073330 msgr2=0x7febc015a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 shutdown_connections 2024-09-13T18:34:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:58.267+0000 7febc7ec3640 1 -- 172.21.15.53:0/3283685932 wait complete. 2024-09-13T18:34:58.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:58.284 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/d51dfcde72f6371e00631013a5805ed0.meta) 2024-09-13T18:34:59.210 INFO:teuthology.orchestra.run.smithi053.stdout:[GLOBAL] 2024-09-13T18:34:59.210 INFO:teuthology.orchestra.run.smithi053.stdout:version = 1 2024-09-13T18:34:59.210 INFO:teuthology.orchestra.run.smithi053.stdout:type = subvolume 2024-09-13T18:34:59.210 INFO:teuthology.orchestra.run.smithi053.stdout:path = /volumes/subvol_grp30980/subvol87550 2024-09-13T18:34:59.210 INFO:teuthology.orchestra.run.smithi053.stdout:state = complete 2024-09-13T18:34:59.211 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:34:59.213 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol87550 subvol_grp30980 2024-09-13T18:34:59.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21fa6e6640 1 Processor -- start 2024-09-13T18:34:59.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21fa6e6640 1 -- start start 2024-09-13T18:34:59.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21fa6e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21f40cdb70 0x7f21f40cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:59.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21fa6e6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f40b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:59.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21fa6e6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40cfa90 con 0x7f21f415c860 2024-09-13T18:34:59.352 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21fa6e6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f40d1b20 con 0x7f21f40cdb70 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21fa6e6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40d1d10 con 0x7f21f40cf620 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f21f415c860 0x7f21f40d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60692/0 (socket says 172.21.15.53:60692) 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21f40cdb70 0x7f21f40cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f3fff640 1 -- 172.21.15.53:0/510530338 learned_addr learned my addr 172.21.15.53:0/510530338 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f37fe640 1 -- 172.21.15.53:0/510530338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 msgr2=0x7f21f40b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f8c83640 1 --2- 172.21.15.53:0/510530338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f40b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f37fe640 1 --2- 172.21.15.53:0/510530338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f40b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f37fe640 1 -- 172.21.15.53:0/510530338 >> v1:172.21.15.53:6789/0 conn(0x7f21f415c860 legacy=0x7f21f40d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.351+0000 7f21f37fe640 1 -- 172.21.15.53:0/510530338 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40d1ff0 con 0x7f21f40cdb70 2024-09-13T18:34:59.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21f37fe640 1 --2- 172.21.15.53:0/510530338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40cdb70 0x7f21f40cf0e0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f21e80097c0 tx=0x7f21e801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f7e97c4e27fdd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:59.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21f2ffd640 1 -- 172.21.15.53:0/510530338 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80ab600 con 0x7f21f40cdb70 2024-09-13T18:34:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21f2ffd640 1 -- 172.21.15.53:0/510530338 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80a7050 con 0x7f21f40cdb70 2024-09-13T18:34:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21f2ffd640 1 -- 172.21.15.53:0/510530338 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80ab980 con 0x7f21f40cdb70 2024-09-13T18:34:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 -- 172.21.15.53:0/510530338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40cdb70 msgr2=0x7f21f40cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/510530338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40cdb70 0x7f21f40cf0e0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f21e80097c0 tx=0x7f21e801c3c0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 -- 172.21.15.53:0/510530338 shutdown_connections 2024-09-13T18:34:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/510530338 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f40b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/510530338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40cdb70 0x7f21f40cf0e0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 -- 172.21.15.53:0/510530338 >> 172.21.15.53:0/510530338 conn(0x7f21f4065c80 msgr2=0x7f21f4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 -- 172.21.15.53:0/510530338 shutdown_connections 2024-09-13T18:34:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.355+0000 7f21fa6e6640 1 -- 172.21.15.53:0/510530338 wait complete. 2024-09-13T18:34:59.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 Processor -- start 2024-09-13T18:34:59.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 -- start start 2024-09-13T18:34:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21f40cdb70 0x7f21f41f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f415c860 0x7f21f40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f41f3260 con 0x7f21f415c860 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4155eb0 con 0x7f21f40cdb70 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4156190 con 0x7f21f40cf620 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f415c860 0x7f21f40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f415c860 0x7f21f40cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44278/0 (socket says 172.21.15.53:44278) 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 -- 172.21.15.53:0/2674888368 learned_addr learned my addr 172.21.15.53:0/2674888368 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f37fe640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f3fff640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21f40cdb70 0x7f21f41f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 -- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 msgr2=0x7f21f414a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f414a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 -- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21f40cdb70 msgr2=0x7f21f41f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21f40cdb70 0x7f21f41f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 -- 172.21.15.53:0/2674888368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009420 con 0x7f21f415c860 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f3fff640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21f40cdb70 0x7f21f41f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f8c83640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f415c860 0x7f21f40cb5f0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00cd70 tx=0x7f21ec00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f0ff9640 1 -- 172.21.15.53:0/2674888368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec003ba0 con 0x7f21f415c860 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f0ff9640 1 -- 172.21.15.53:0/2674888368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec003d00 con 0x7f21f415c860 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f4156470 con 0x7f21f415c860 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21f0ff9640 1 -- 172.21.15.53:0/2674888368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec004240 con 0x7f21f415c860 2024-09-13T18:34:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f4156a30 con 0x7f21f415c860 2024-09-13T18:34:59.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.359+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f40cf0e0 con 0x7f21f415c860 2024-09-13T18:34:59.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.363+0000 7f21f0ff9640 1 -- 172.21.15.53:0/2674888368 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 26) v1 ==== 86959+0+0 (secure 0 0 0) 0x7f21ec0043a0 con 0x7f21f415c860 2024-09-13T18:34:59.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.363+0000 7f21f0ff9640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21e0067020 0x7f21e00694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:59.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.363+0000 7f21f0ff9640 1 -- 172.21.15.53:0/2674888368 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21ec012070 con 0x7f21f415c860 2024-09-13T18:34:59.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.363+0000 7f21f3fff640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21e0067020 0x7f21e00694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:59.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.363+0000 7f21f3fff640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21e0067020 0x7f21e00694e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f21e4004880 tx=0x7f21e400c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:59.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.367+0000 7f21f0ff9640 1 -- 172.21.15.53:0/2674888368 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21ec052760 con 0x7f21f415c860 2024-09-13T18:34:59.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.551+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol87550", "group_name": "subvol_grp30980", "target": ["mon-mgr", ""]}) v1 -- 0x7f21f415cc40 con 0x7f21e0067020 2024-09-13T18:34:59.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.575+0000 7f21f0ff9640 1 -- 172.21.15.53:0/2674888368 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f21e4010c30 con 0x7f21e0067020 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21e0067020 msgr2=0x7f21e00694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21e0067020 0x7f21e00694e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f21e4004880 tx=0x7f21e400c040 comp rx=0 tx=0).stop 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f415c860 msgr2=0x7f21f40cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f415c860 0x7f21f40cb5f0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00cd70 tx=0x7f21ec00a660 comp rx=0 tx=0).stop 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 shutdown_connections 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f21e0067020 0x7f21e00694e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f21f40cf620 0x7f21f414a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f415c860 0x7f21f40cb5f0 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 --2- 172.21.15.53:0/2674888368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f21f40cdb70 0x7f21f41f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:59.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 >> 172.21.15.53:0/2674888368 conn(0x7f21f4065c80 msgr2=0x7f21f40d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:59.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 shutdown_connections 2024-09-13T18:34:59.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:34:59.579+0000 7f21fa6e6640 1 -- 172.21.15.53:0/2674888368 wait complete. 2024-09-13T18:34:59.584 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.583+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.584 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.583+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.584 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.583+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.584 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.583+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.584 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.583+0000 7f2619eb3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:34:59.599 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-13T18:34:59.601 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.603+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.602 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.603+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.602 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.603+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.602 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.603+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:34:59.602 INFO:tasks.ceph.mgr.y.smithi053.stderr:2024-09-13T18:34:59.603+0000 7f2618eb1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:35:04.211 INFO:teuthology.orchestra.run.smithi053.stdout:2 2024-09-13T18:35:04.213 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp30980 2024-09-13T18:35:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c3e8d640 1 Processor -- start 2024-09-13T18:35:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c3e8d640 1 -- start start 2024-09-13T18:35:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c3e8d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5bc0ccd10 0x7fc5bc0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c3e8d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc0b7db0 con 0x7fc5bc0d2c80 2024-09-13T18:35:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c3e8d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc0d0650 con 0x7fc5bc15c830 2024-09-13T18:35:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c3e8d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc0d0c10 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c1428640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc5bc0ccd10 0x7fc5bc0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c242a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc5bc0d2c80 0x7fc5bc0b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60694/0 (socket says 172.21.15.53:60694) 2024-09-13T18:35:04.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c242a640 1 -- 172.21.15.53:0/4177832706 learned_addr learned my addr 172.21.15.53:0/4177832706 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c1428640 1 -- 172.21.15.53:0/4177832706 >> v1:172.21.15.87:6789/0 conn(0x7fc5bc15c830 legacy=0x7fc5bc0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c1428640 1 -- 172.21.15.53:0/4177832706 >> v1:172.21.15.53:6789/0 conn(0x7fc5bc0d2c80 legacy=0x7fc5bc0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.395+0000 7fc5c1428640 1 -- 172.21.15.53:0/4177832706 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0d17b0 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c1428640 1 --2- 172.21.15.53:0/4177832706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc0cd180 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00097c0 tx=0x7fc5b001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3041a4810a284516 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c0c27640 1 -- 172.21.15.53:0/4177832706 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00ab600 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c0c27640 1 -- 172.21.15.53:0/4177832706 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b00a7050 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c0c27640 1 -- 172.21.15.53:0/4177832706 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00ab980 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/4177832706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 msgr2=0x7fc5bc0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/4177832706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc0cd180 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00097c0 tx=0x7fc5b001c4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/4177832706 shutdown_connections 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/4177832706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc0cd180 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/4177832706 >> 172.21.15.53:0/4177832706 conn(0x7fc5bc070970 msgr2=0x7fc5bc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/4177832706 shutdown_connections 2024-09-13T18:35:04.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/4177832706 wait complete. 2024-09-13T18:35:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 Processor -- start 2024-09-13T18:35:04.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 -- start start 2024-09-13T18:35:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.399+0000 7fc5c3e8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5bc0d2c80 0x7fc5bc15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c3e8d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5bc15c830 0x7fc5bc157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c3e8d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc157890 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c3e8d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc14edd0 con 0x7fc5bc15c830 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c3e8d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc156c80 con 0x7fc5bc0d2c80 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc14e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44354/0 (socket says 172.21.15.53:44354) 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 -- 172.21.15.53:0/1871867532 learned_addr learned my addr 172.21.15.53:0/1871867532 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c242a640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5bc15c830 0x7fc5bc157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1428640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5bc0d2c80 0x7fc5bc15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 -- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5bc0d2c80 msgr2=0x7fc5bc15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5bc0d2c80 0x7fc5bc15b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 -- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5bc15c830 msgr2=0x7fc5bc157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5bc15c830 0x7fc5bc157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 -- 172.21.15.53:0/1871867532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0009420 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1428640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5bc0d2c80 0x7fc5bc15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1c29640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc14e270 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c7d0 tx=0x7fc5b400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5ba7fc640 1 -- 172.21.15.53:0/1871867532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4003b80 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5ba7fc640 1 -- 172.21.15.53:0/1871867532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4003ce0 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc156f60 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5ba7fc640 1 -- 172.21.15.53:0/1871867532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b400aa90 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc157520 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc0cd180 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5ba7fc640 1 -- 172.21.15.53:0/1871867532 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fc5b400abf0 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5ba7fc640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5a80671d0 0x7fc5a8069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5ba7fc640 1 -- 172.21.15.53:0/1871867532 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5b40836c0 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1428640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5a80671d0 0x7fc5a8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.403+0000 7fc5c1428640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5a80671d0 0x7fc5a8069690 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00ad000 tx=0x7fc5b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:04.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.407+0000 7fc5ba7fc640 1 -- 172.21.15.53:0/1871867532 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5b4052230 con 0x7fc5bc0ccd10 2024-09-13T18:35:04.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.591+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp30980", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5bc0b50c0 con 0x7fc5a80671d0 2024-09-13T18:35:04.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.599+0000 7fc5ba7fc640 1 -- 172.21.15.53:0/1871867532 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc5bc0b50c0 con 0x7fc5a80671d0 2024-09-13T18:35:04.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.599+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5a80671d0 msgr2=0x7fc5a8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.599+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5a80671d0 0x7fc5a8069690 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00ad000 tx=0x7fc5b0008040 comp rx=0 tx=0).stop 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.599+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 msgr2=0x7fc5bc14e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.599+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc14e270 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c7d0 tx=0x7fc5b400cc90 comp rx=0 tx=0).stop 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 shutdown_connections 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc5a80671d0 0x7fc5a8069690 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5bc0d2c80 0x7fc5bc15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5bc15c830 0x7fc5bc157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 --2- 172.21.15.53:0/1871867532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5bc0ccd10 0x7fc5bc14e270 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 >> 172.21.15.53:0/1871867532 conn(0x7fc5bc070970 msgr2=0x7fc5bc0b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 shutdown_connections 2024-09-13T18:35:04.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.603+0000 7fc5c3e8d640 1 -- 172.21.15.53:0/1871867532 wait complete. 2024-09-13T18:35:04.618 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:35:04.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:35:04.686 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:35:04.765 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:35:04.766 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:35:04.766 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:04.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f8809607640 1 Processor -- start 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f8809607640 1 -- start start 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f8809607640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f8804070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f8809607640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88040711d0 0x7f88041640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f8809607640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880406d480 con 0x7f88041582a0 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f8809607640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880415aaf0 con 0x7f88040711d0 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f8809607640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880406d760 con 0x7f880415b7c0 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88040711d0 0x7f88041640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88040711d0 0x7f88041640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44358/0 (socket says 172.21.15.53:44358) 2024-09-13T18:35:04.952 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88037fe640 1 -- 172.21.15.53:0/3487968935 learned_addr learned my addr 172.21.15.53:0/3487968935 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:04.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88027fc640 1 --2- 172.21.15.53:0/3487968935 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f8804070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88037fe640 1 -- 172.21.15.53:0/3487968935 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 msgr2=0x7f8804070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:04.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88037fe640 1 --2- 172.21.15.53:0/3487968935 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f8804070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88037fe640 1 -- 172.21.15.53:0/3487968935 >> v1:172.21.15.87:6789/0 conn(0x7f88041582a0 legacy=0x7f880406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:04.953 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.951+0000 7f88037fe640 1 -- 172.21.15.53:0/3487968935 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880415ace0 con 0x7f88040711d0 2024-09-13T18:35:04.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f88037fe640 1 --2- 172.21.15.53:0/3487968935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f88041640f0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009e50 tx=0x7f87fc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4147054a363daef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:04.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8801ffb640 1 -- 172.21.15.53:0/3487968935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0a5760 con 0x7f88040711d0 2024-09-13T18:35:04.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8801ffb640 1 -- 172.21.15.53:0/3487968935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc0a58c0 con 0x7f88040711d0 2024-09-13T18:35:04.955 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8801ffb640 1 -- 172.21.15.53:0/3487968935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0a5c50 con 0x7f88040711d0 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 -- 172.21.15.53:0/3487968935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 msgr2=0x7f88041640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 --2- 172.21.15.53:0/3487968935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f88041640f0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009e50 tx=0x7f87fc01c9f0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 -- 172.21.15.53:0/3487968935 shutdown_connections 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 --2- 172.21.15.53:0/3487968935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f88041640f0 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 --2- 172.21.15.53:0/3487968935 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f8804070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 -- 172.21.15.53:0/3487968935 >> 172.21.15.53:0/3487968935 conn(0x7f8804065c80 msgr2=0x7f8804066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 -- 172.21.15.53:0/3487968935 shutdown_connections 2024-09-13T18:35:04.956 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.955+0000 7f8809607640 1 -- 172.21.15.53:0/3487968935 wait complete. 2024-09-13T18:35:04.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 Processor -- start 2024-09-13T18:35:04.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 -- start start 2024-09-13T18:35:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f880415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88041582a0 0x7f8804148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f880414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88041586f0 con 0x7f88040711d0 2024-09-13T18:35:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880414d7a0 con 0x7f88041582a0 2024-09-13T18:35:04.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880414da80 con 0x7f880415b7c0 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f880415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f880415a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44362/0 (socket says 172.21.15.53:44362) 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 -- 172.21.15.53:0/3490269461 learned_addr learned my addr 172.21.15.53:0/3490269461 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f88037fe640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f880414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f88027fc640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88041582a0 0x7f8804148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 -- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 msgr2=0x7f880414f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f880414f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 -- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88041582a0 msgr2=0x7f8804148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88041582a0 0x7f8804148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 -- 172.21.15.53:0/3490269461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc009b30 con 0x7f88040711d0 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f88037fe640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f880414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:04.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f88027fc640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88041582a0 0x7f8804148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8802ffd640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f880415a430 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c450 tx=0x7f87f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f87fb7fe640 1 -- 172.21.15.53:0/3490269461 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4012830 con 0x7f88040711d0 2024-09-13T18:35:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f87fb7fe640 1 -- 172.21.15.53:0/3490269461 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f40129b0 con 0x7f88040711d0 2024-09-13T18:35:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8804158940 con 0x7f88040711d0 2024-09-13T18:35:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f87fb7fe640 1 -- 172.21.15.53:0/3490269461 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4012d60 con 0x7f88040711d0 2024-09-13T18:35:04.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8804148f70 con 0x7f88040711d0 2024-09-13T18:35:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8804067400 con 0x7f88040711d0 2024-09-13T18:35:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.959+0000 7f87fb7fe640 1 -- 172.21.15.53:0/3490269461 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f87f401c460 con 0x7f88040711d0 2024-09-13T18:35:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.963+0000 7f87fb7fe640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87e40671d0 0x7f87e4069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.963+0000 7f87fb7fe640 1 -- 172.21.15.53:0/3490269461 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87f4082a50 con 0x7f88040711d0 2024-09-13T18:35:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.963+0000 7f88027fc640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87e40671d0 0x7f87e4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:04.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.963+0000 7f88027fc640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87e40671d0 0x7f87e4069690 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f880415a300 tx=0x7f87ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:04.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:04.967+0000 7f87fb7fe640 1 -- 172.21.15.53:0/3490269461 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87f40517d0 con 0x7f88040711d0 2024-09-13T18:35:05.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.127+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8804158e60 con 0x7f88040711d0 2024-09-13T18:35:05.130 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.131+0000 7f87fb7fe640 1 -- 172.21.15.53:0/3490269461 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f87f4054df0 con 0x7f88040711d0 2024-09-13T18:35:05.131 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:05.131 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":174,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:44.536440+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87e40671d0 msgr2=0x7f87e4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87e40671d0 0x7f87e4069690 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f880415a300 tx=0x7f87ec008040 comp rx=0 tx=0).stop 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 msgr2=0x7f880415a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f880415a430 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c450 tx=0x7f87f400c910 comp rx=0 tx=0).stop 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 shutdown_connections 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87e40671d0 0x7f87e4069690 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f880415b7c0 0x7f880414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88041582a0 0x7f8804148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 --2- 172.21.15.53:0/3490269461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88040711d0 0x7f880415a430 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 >> 172.21.15.53:0/3490269461 conn(0x7f8804065c80 msgr2=0x7f880406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:05.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 shutdown_connections 2024-09-13T18:35:05.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.135+0000 7f8809607640 1 -- 172.21.15.53:0/3490269461 wait complete. 2024-09-13T18:35:05.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:34:41.929723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:34:42.513600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:05.150 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:05.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7ff2d6640 1 Processor -- start 2024-09-13T18:35:05.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7ff2d6640 1 -- start start 2024-09-13T18:35:05.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7ff2d6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f8157020 0x7fe7f806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7ff2d6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f806d6e0 con 0x7fe7f8156c40 2024-09-13T18:35:05.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7ff2d6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f80715f0 con 0x7fe7f806d270 2024-09-13T18:35:05.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7ff2d6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80b15a0 con 0x7fe7f8157020 2024-09-13T18:35:05.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd072640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe7f8156c40 0x7fe7f8070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60696/0 (socket says 172.21.15.53:60696) 2024-09-13T18:35:05.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd072640 1 -- 172.21.15.53:0/1676557765 learned_addr learned my addr 172.21.15.53:0/1676557765 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:05.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fc871640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f8157020 0x7fe7f806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777656170 0 0) 0x7fe7f806d6e0 con 0x7fe7f8156c40 2024-09-13T18:35:05.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e4003530 con 0x7fe7f8156c40 2024-09-13T18:35:05.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838947570 0 0) 0x7fe7e4003530 con 0x7fe7f8156c40 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f8157020 msgr2=0x7fe7f806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f8157020 0x7fe7f806cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 >> v1:172.21.15.87:6789/0 conn(0x7fe7f806d270 legacy=0x7fe7f806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80b1880 con 0x7fe7f8156c40 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe7f4001680 con 0x7fe7f8156c40 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 >> v1:172.21.15.53:6789/0 conn(0x7fe7f8156c40 legacy=0x7fe7f8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7e40039b0 0x7fe7e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7e40047d0 0x7fe7e4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7e4005150 0x7fe7e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80b15a0 con 0x7fe7e4005150 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e400bed0 con 0x7fe7e40039b0 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e400c010 con 0x7fe7e40047d0 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd873640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7e4005150 0x7fe7e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd072640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7e40039b0 0x7fe7e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd873640 1 -- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7e40047d0 msgr2=0x7fe7e4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fc871640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7e40047d0 0x7fe7e4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd873640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7e40047d0 0x7fe7e4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd873640 1 -- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7e40039b0 msgr2=0x7fe7e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd873640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7e40039b0 0x7fe7e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fd873640 1 -- 172.21.15.53:0/1676557765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4003530 con 0x7fe7e4005150 2024-09-13T18:35:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.271+0000 7fe7fc871640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7e40047d0 0x7fe7e4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7fd873640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7e4005150 0x7fe7e400b990 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0001e70 tx=0x7fe7f001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1a9ca349db6bca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0003b80 con 0x7fe7e4005150 2024-09-13T18:35:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f0003ce0 con 0x7fe7e4005150 2024-09-13T18:35:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7effff640 1 -- 172.21.15.53:0/1676557765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00052c0 con 0x7fe7e4005150 2024-09-13T18:35:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1676557765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7e4005150 msgr2=0x7fe7e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 --2- 172.21.15.53:0/1676557765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7e4005150 0x7fe7e400b990 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0001e70 tx=0x7fe7f001c780 comp rx=0 tx=0).stop 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7fd873640 1 -- 172.21.15.53:0/1676557765 reap_dead start 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1676557765 shutdown_connections 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1676557765 >> 172.21.15.53:0/1676557765 conn(0x7fe7f8065c80 msgr2=0x7fe7f8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1676557765 shutdown_connections 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1676557765 wait complete. 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 Processor -- start 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- start start 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7f8143ea0 0x7fe7f815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7f815c040 0x7fe7f8151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f81517d0 0x7fe7f814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f815c4c0 con 0x7fe7f815c040 2024-09-13T18:35:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f8159a20 con 0x7fe7f8143ea0 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7ff2d6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f8151c80 con 0x7fe7f81517d0 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7fc871640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7f815c040 0x7fe7f8151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7fc871640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7f815c040 0x7fe7f8151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44392/0 (socket says 172.21.15.53:44392) 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.275+0000 7fe7fc871640 1 -- 172.21.15.53:0/1910726286 learned_addr learned my addr 172.21.15.53:0/1910726286 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fd072640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7f8143ea0 0x7fe7f815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fd873640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f81517d0 0x7fe7f814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fc871640 1 -- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f81517d0 msgr2=0x7fe7f814eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fc871640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f81517d0 0x7fe7f814eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fc871640 1 -- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7f8143ea0 msgr2=0x7fe7f815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fc871640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7f8143ea0 0x7fe7f815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fc871640 1 -- 172.21.15.53:0/1910726286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f81527a0 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fc871640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7f815c040 0x7fe7f8151290 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8010900 tx=0x7fe7e8010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7edffb640 1 -- 172.21.15.53:0/1910726286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8004220 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7edffb640 1 -- 172.21.15.53:0/1910726286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e8004380 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f8144280 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7edffb640 1 -- 172.21.15.53:0/1910726286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800ec00 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f81521e0 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f8159bb0 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7edffb640 1 -- 172.21.15.53:0/1910726286 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fe7e800ed60 con 0x7fe7f815c040 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7edffb640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe7dc067200 0x7fe7dc0696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7edffb640 1 -- 172.21.15.53:0/1910726286 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7e8082d10 con 0x7fe7f815c040 2024-09-13T18:35:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fd072640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe7dc067200 0x7fe7dc0696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.279+0000 7fe7fd072640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe7dc067200 0x7fe7dc0696c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe7f806b540 tx=0x7fe7f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.283+0000 7fe7edffb640 1 -- 172.21.15.53:0/1910726286 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7e80518e0 con 0x7fe7f815c040 2024-09-13T18:35:05.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7f8070870 con 0x7fe7f815c040 2024-09-13T18:35:05.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7edffb640 1 -- 172.21.15.53:0/1910726286 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7e8054f00 con 0x7fe7f815c040 2024-09-13T18:35:05.441 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:35:05.443 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe7dc067200 msgr2=0x7fe7dc0696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe7dc067200 0x7fe7dc0696c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe7f806b540 tx=0x7fe7f4009040 comp rx=0 tx=0).stop 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7f815c040 msgr2=0x7fe7f8151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7f815c040 0x7fe7f8151290 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8010900 tx=0x7fe7e8010dc0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 shutdown_connections 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe7dc067200 0x7fe7dc0696c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe7f81517d0 0x7fe7f814eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7f815c040 0x7fe7f8151290 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 --2- 172.21.15.53:0/1910726286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7f8143ea0 0x7fe7f815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 >> 172.21.15.53:0/1910726286 conn(0x7fe7f8065c80 msgr2=0x7fe7f806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 shutdown_connections 2024-09-13T18:35:05.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.443+0000 7fe7ff2d6640 1 -- 172.21.15.53:0/1910726286 wait complete. 2024-09-13T18:35:05.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:05.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4179be3640 1 Processor -- start 2024-09-13T18:35:05.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4179be3640 1 -- start start 2024-09-13T18:35:05.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4179be3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41740caee0 0x7f41740cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4179be3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41740cd320 0x7f41740cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4179be3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417406f7a0 con 0x7f4174143e80 2024-09-13T18:35:05.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4179be3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417406baa0 con 0x7f41740cd320 2024-09-13T18:35:05.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4179be3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417406fd60 con 0x7f41740caee0 2024-09-13T18:35:05.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4173fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41740cd320 0x7f41740cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4173fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41740cd320 0x7f41740cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44402/0 (socket says 172.21.15.53:44402) 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4173fff640 1 -- 172.21.15.53:0/4217714514 learned_addr learned my addr 172.21.15.53:0/4217714514 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f416bfff640 1 --2- 172.21.15.53:0/4217714514 >> v2:172.21.15.87:3300/0 conn(0x7f41740caee0 0x7f41740cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4173fff640 1 -- 172.21.15.53:0/4217714514 >> v2:172.21.15.87:3300/0 conn(0x7f41740caee0 msgr2=0x7f41740cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4173fff640 1 --2- 172.21.15.53:0/4217714514 >> v2:172.21.15.87:3300/0 conn(0x7f41740caee0 0x7f41740cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4173fff640 1 -- 172.21.15.53:0/4217714514 >> v1:172.21.15.87:6789/0 conn(0x7f4174143e80 legacy=0x7f417406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:05.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.583+0000 7f4173fff640 1 -- 172.21.15.53:0/4217714514 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41740cb960 con 0x7f41740cd320 2024-09-13T18:35:05.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4173fff640 1 --2- 172.21.15.53:0/4217714514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41740cd320 0x7f41740cd780 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f416c009e50 tx=0x7f416c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b7f96635cff146 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4172ffd640 1 -- 172.21.15.53:0/4217714514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0a57b0 con 0x7f41740cd320 2024-09-13T18:35:05.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4172ffd640 1 -- 172.21.15.53:0/4217714514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c0a5910 con 0x7f41740cd320 2024-09-13T18:35:05.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4172ffd640 1 -- 172.21.15.53:0/4217714514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0a5ca0 con 0x7f41740cd320 2024-09-13T18:35:05.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 -- 172.21.15.53:0/4217714514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41740cd320 msgr2=0x7f41740cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 --2- 172.21.15.53:0/4217714514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41740cd320 0x7f41740cd780 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f416c009e50 tx=0x7f416c01c8f0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 -- 172.21.15.53:0/4217714514 shutdown_connections 2024-09-13T18:35:05.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 --2- 172.21.15.53:0/4217714514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41740cd320 0x7f41740cd780 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 --2- 172.21.15.53:0/4217714514 >> v2:172.21.15.87:3300/0 conn(0x7f41740caee0 0x7f41740cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 -- 172.21.15.53:0/4217714514 >> 172.21.15.53:0/4217714514 conn(0x7f4174065c80 msgr2=0x7f4174066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:05.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 -- 172.21.15.53:0/4217714514 shutdown_connections 2024-09-13T18:35:05.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.587+0000 7f4179be3640 1 -- 172.21.15.53:0/4217714514 wait complete. 2024-09-13T18:35:05.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 Processor -- start 2024-09-13T18:35:05.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 -- start start 2024-09-13T18:35:05.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41740caee0 0x7f41740adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41740cd320 0x7f417415c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4174143e80 0x7f417415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417415c360 con 0x7f4174143e80 2024-09-13T18:35:05.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417413d9c0 con 0x7f41740caee0 2024-09-13T18:35:05.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417415bca0 con 0x7f41740cd320 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4174143e80 0x7f417415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4174143e80 0x7f417415ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44416/0 (socket says 172.21.15.53:44416) 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 -- 172.21.15.53:0/2074425047 learned_addr learned my addr 172.21.15.53:0/2074425047 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f416bfff640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41740cd320 0x7f417415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f41737fe640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41740caee0 0x7f41740adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 -- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41740cd320 msgr2=0x7f417415c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41740cd320 0x7f417415c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 -- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41740caee0 msgr2=0x7f41740adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41740caee0 0x7f41740adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 -- 172.21.15.53:0/2074425047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c009b30 con 0x7f4174143e80 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4173fff640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4174143e80 0x7f417415ccc0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f416c0af040 tx=0x7f416c019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4170ff9640 1 -- 172.21.15.53:0/2074425047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0b8670 con 0x7f4174143e80 2024-09-13T18:35:05.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4170ff9640 1 -- 172.21.15.53:0/2074425047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c0b87d0 con 0x7f4174143e80 2024-09-13T18:35:05.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4170ff9640 1 -- 172.21.15.53:0/2074425047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0b8b60 con 0x7f4174143e80 2024-09-13T18:35:05.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417415bf80 con 0x7f4174143e80 2024-09-13T18:35:05.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4174154690 con 0x7f4174143e80 2024-09-13T18:35:05.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417415c4a0 con 0x7f4174143e80 2024-09-13T18:35:05.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.591+0000 7f4170ff9640 1 -- 172.21.15.53:0/2074425047 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f416c0b8cc0 con 0x7f4174143e80 2024-09-13T18:35:05.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.595+0000 7f4170ff9640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41540671d0 0x7f4154069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.595+0000 7f41737fe640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41540671d0 0x7f4154069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.595+0000 7f4170ff9640 1 -- 172.21.15.53:0/2074425047 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f416c11e630 con 0x7f4174143e80 2024-09-13T18:35:05.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.595+0000 7f41737fe640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41540671d0 0x7f4154069690 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f41740ad660 tx=0x7f4164008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.599+0000 7f4170ff9640 1 -- 172.21.15.53:0/2074425047 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f416c0ed550 con 0x7f4174143e80 2024-09-13T18:35:05.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.751+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f417415c4a0 con 0x7f4174143e80 2024-09-13T18:35:05.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.751+0000 7f4170ff9640 1 -- 172.21.15.53:0/2074425047 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v174) v1 ==== 104+0+11 (secure 0 0 0) 0x7f417415c4a0 con 0x7f4174143e80 2024-09-13T18:35:05.752 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:35:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41540671d0 msgr2=0x7f4154069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41540671d0 0x7f4154069690 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f41740ad660 tx=0x7f4164008040 comp rx=0 tx=0).stop 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4174143e80 msgr2=0x7f417415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4174143e80 0x7f417415ccc0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f416c0af040 tx=0x7f416c019690 comp rx=0 tx=0).stop 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 shutdown_connections 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f41540671d0 0x7f4154069690 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41740cd320 0x7f417415c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4174143e80 0x7f417415ccc0 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 --2- 172.21.15.53:0/2074425047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41740caee0 0x7f41740adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 >> 172.21.15.53:0/2074425047 conn(0x7f4174065c80 msgr2=0x7f417406b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 shutdown_connections 2024-09-13T18:35:05.754 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.755+0000 7f4179be3640 1 -- 172.21.15.53:0/2074425047 wait complete. 2024-09-13T18:35:05.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:05.898 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b8056640 1 Processor -- start 2024-09-13T18:35:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b8056640 1 -- start start 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b8056640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd6b01457c0 0x7fd6b00b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b8056640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6b00b1a40 0x7fd6b0070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b8056640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b0146180 con 0x7fd6b0071220 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b8056640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b0071630 con 0x7fd6b00b1a40 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b8056640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b00702d0 con 0x7fd6b01457c0 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b55f1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6b00b1a40 0x7fd6b0070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b55f1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6b00b1a40 0x7fd6b0070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44422/0 (socket says 172.21.15.53:44422) 2024-09-13T18:35:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b55f1640 1 -- 172.21.15.53:0/2227083032 learned_addr learned my addr 172.21.15.53:0/2227083032 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b5df2640 1 --2- 172.21.15.53:0/2227083032 >> v2:172.21.15.87:3300/0 conn(0x7fd6b01457c0 0x7fd6b00b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b55f1640 1 -- 172.21.15.53:0/2227083032 >> v2:172.21.15.87:3300/0 conn(0x7fd6b01457c0 msgr2=0x7fd6b00b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b55f1640 1 --2- 172.21.15.53:0/2227083032 >> v2:172.21.15.87:3300/0 conn(0x7fd6b01457c0 0x7fd6b00b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b55f1640 1 -- 172.21.15.53:0/2227083032 >> v1:172.21.15.87:6789/0 conn(0x7fd6b0071220 legacy=0x7fd6b006b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.899+0000 7fd6b55f1640 1 -- 172.21.15.53:0/2227083032 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b006c4c0 con 0x7fd6b00b1a40 2024-09-13T18:35:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b55f1640 1 --2- 172.21.15.53:0/2227083032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b00b1a40 0x7fd6b0070ce0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fd6b006f000 tx=0x7fd6a001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd99315cd28e3f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b4df0640 1 -- 172.21.15.53:0/2227083032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00aa650 con 0x7fd6b00b1a40 2024-09-13T18:35:05.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b4df0640 1 -- 172.21.15.53:0/2227083032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a00aa7b0 con 0x7fd6b00b1a40 2024-09-13T18:35:05.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b4df0640 1 -- 172.21.15.53:0/2227083032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00aab40 con 0x7fd6b00b1a40 2024-09-13T18:35:05.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 -- 172.21.15.53:0/2227083032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b00b1a40 msgr2=0x7fd6b0070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.904 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 --2- 172.21.15.53:0/2227083032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b00b1a40 0x7fd6b0070ce0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fd6b006f000 tx=0x7fd6a001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 -- 172.21.15.53:0/2227083032 shutdown_connections 2024-09-13T18:35:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 --2- 172.21.15.53:0/2227083032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b00b1a40 0x7fd6b0070ce0 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 --2- 172.21.15.53:0/2227083032 >> v2:172.21.15.87:3300/0 conn(0x7fd6b01457c0 0x7fd6b00b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 -- 172.21.15.53:0/2227083032 >> 172.21.15.53:0/2227083032 conn(0x7fd6b0065c80 msgr2=0x7fd6b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 -- 172.21.15.53:0/2227083032 shutdown_connections 2024-09-13T18:35:05.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.903+0000 7fd6b8056640 1 -- 172.21.15.53:0/2227083032 wait complete. 2024-09-13T18:35:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 Processor -- start 2024-09-13T18:35:05.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 -- start start 2024-09-13T18:35:05.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6b0071220 0x7fd6b015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b00b1a40 0x7fd6b00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b01457c0 0x7fd6b015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c3470 con 0x7fd6b01457c0 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c42d0 con 0x7fd6b00b1a40 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b00c36c0 con 0x7fd6b0071220 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b01457c0 0x7fd6b015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b01457c0 0x7fd6b015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44426/0 (socket says 172.21.15.53:44426) 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 -- 172.21.15.53:0/817382076 learned_addr learned my addr 172.21.15.53:0/817382076 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b55f1640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b00b1a40 0x7fd6b00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b5df2640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6b0071220 0x7fd6b015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 -- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6b0071220 msgr2=0x7fd6b015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6b0071220 0x7fd6b015b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 -- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b00b1a40 msgr2=0x7fd6b00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:05.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b00b1a40 0x7fd6b00c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:05.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 -- 172.21.15.53:0/817382076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00094d0 con 0x7fd6b01457c0 2024-09-13T18:35:05.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b5df2640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6b0071220 0x7fd6b015b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:05.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b65f3640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b01457c0 0x7fd6b015be00 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c460 tx=0x7fd6a800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6a67fc640 1 -- 172.21.15.53:0/817382076 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8005220 con 0x7fd6b01457c0 2024-09-13T18:35:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6a67fc640 1 -- 172.21.15.53:0/817382076 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8005380 con 0x7fd6b01457c0 2024-09-13T18:35:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b00c39a0 con 0x7fd6b01457c0 2024-09-13T18:35:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6a67fc640 1 -- 172.21.15.53:0/817382076 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8007270 con 0x7fd6b01457c0 2024-09-13T18:35:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.907+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b00c3f60 con 0x7fd6b01457c0 2024-09-13T18:35:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.911+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b006bbc0 con 0x7fd6b01457c0 2024-09-13T18:35:05.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.911+0000 7fd6a67fc640 1 -- 172.21.15.53:0/817382076 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fd6a80073d0 con 0x7fd6b01457c0 2024-09-13T18:35:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.911+0000 7fd6a67fc640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd6940671d0 0x7fd694069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.911+0000 7fd6b5df2640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd6940671d0 0x7fd694069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.911+0000 7fd6a67fc640 1 -- 172.21.15.53:0/817382076 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6a8082590 con 0x7fd6b01457c0 2024-09-13T18:35:05.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.911+0000 7fd6b5df2640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd6940671d0 0x7fd694069690 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac003fd0 tx=0x7fd6ac0039e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:05.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:05.915+0000 7fd6a67fc640 1 -- 172.21.15.53:0/817382076 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd6a8051100 con 0x7fd6b01457c0 2024-09-13T18:35:06.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.075+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6b00c4410 con 0x7fd6b01457c0 2024-09-13T18:35:06.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.075+0000 7fd6a67fc640 1 -- 172.21.15.53:0/817382076 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v174) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6a8054720 con 0x7fd6b01457c0 2024-09-13T18:35:06.076 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:35:06.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd6940671d0 msgr2=0x7fd694069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd6940671d0 0x7fd694069690 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac003fd0 tx=0x7fd6ac0039e0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b01457c0 msgr2=0x7fd6b015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b01457c0 0x7fd6b015be00 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c460 tx=0x7fd6a800c920 comp rx=0 tx=0).stop 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 shutdown_connections 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd6940671d0 0x7fd694069690 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6b01457c0 0x7fd6b015be00 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6b00b1a40 0x7fd6b00c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 --2- 172.21.15.53:0/817382076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6b0071220 0x7fd6b015b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.079 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 >> 172.21.15.53:0/817382076 conn(0x7fd6b0065c80 msgr2=0x7fd6b013fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 shutdown_connections 2024-09-13T18:35:06.080 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.079+0000 7fd6b8056640 1 -- 172.21.15.53:0/817382076 wait complete. 2024-09-13T18:35:06.095 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:35:06.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f631552f640 1 Processor -- start 2024-09-13T18:35:06.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f631552f640 1 -- start start 2024-09-13T18:35:06.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f631552f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 0x7f63100cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f631552f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63101611c0 con 0x7f63100cd720 2024-09-13T18:35:06.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f631552f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63100d0be0 con 0x7f631015c8c0 2024-09-13T18:35:06.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f631552f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63100d0ec0 con 0x7f6310160cc0 2024-09-13T18:35:06.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f63100cd720 0x7f63100d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60702/0 (socket says 172.21.15.53:60702) 2024-09-13T18:35:06.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630f7fe640 1 -- 172.21.15.53:0/3809476950 learned_addr learned my addr 172.21.15.53:0/3809476950 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:06.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630e7fc640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 0x7f63100cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994863132 0 0) 0x7f63101611c0 con 0x7f63100cd720 2024-09-13T18:35:06.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f8003530 con 0x7f63100cd720 2024-09-13T18:35:06.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261562462 0 0) 0x7f62f8003530 con 0x7f63100cd720 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 msgr2=0x7f63100cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 0x7f63100cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 >> v1:172.21.15.87:6789/0 conn(0x7f631015c8c0 legacy=0x7f63100b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63100d11a0 con 0x7f63100cd720 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f6308001a00 con 0x7f63100cd720 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 >> v1:172.21.15.53:6789/0 conn(0x7f63100cd720 legacy=0x7f63100d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 0x7f62f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62f8003ef0 0x7f62f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62f8004d10 0x7f62f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63100d0ec0 con 0x7f62f8003ef0 2024-09-13T18:35:06.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f800b9f0 con 0x7f62f8004d10 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f800bbb0 con 0x7f6310160cc0 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630e7fc640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62f8003ef0 0x7f62f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630f7fe640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62f8004d10 0x7f62f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630effd640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 0x7f62f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630e7fc640 1 -- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 msgr2=0x7f62f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630e7fc640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6310160cc0 0x7f62f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630e7fc640 1 -- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62f8004d10 msgr2=0x7f62f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630e7fc640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62f8004d10 0x7f62f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.227+0000 7f630e7fc640 1 -- 172.21.15.53:0/3809476950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8003530 con 0x7f62f8003ef0 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f630e7fc640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62f8003ef0 0x7f62f80047d0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f6300009ae0 tx=0x7f630001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b095acb9a2d0d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000a55a0 con 0x7f62f8003ef0 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63000a5700 con 0x7f62f8003ef0 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f630dffb640 1 -- 172.21.15.53:0/3809476950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000a5ab0 con 0x7f62f8003ef0 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f631552f640 1 -- 172.21.15.53:0/3809476950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62f8003ef0 msgr2=0x7f62f80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f631552f640 1 --2- 172.21.15.53:0/3809476950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62f8003ef0 0x7f62f80047d0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f6300009ae0 tx=0x7f630001c9b0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f630f7fe640 1 -- 172.21.15.53:0/3809476950 reap_dead start 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f631552f640 1 -- 172.21.15.53:0/3809476950 shutdown_connections 2024-09-13T18:35:06.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f631552f640 1 -- 172.21.15.53:0/3809476950 >> 172.21.15.53:0/3809476950 conn(0x7f6310065c80 msgr2=0x7f6310066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:06.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f631552f640 1 -- 172.21.15.53:0/3809476950 shutdown_connections 2024-09-13T18:35:06.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.231+0000 7f631552f640 1 -- 172.21.15.53:0/3809476950 wait complete. 2024-09-13T18:35:06.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 Processor -- start 2024-09-13T18:35:06.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 -- start start 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62f8003ef0 0x7f6310158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f631015cca0 0x7f631015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63100b2220 0x7f63100b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63100b2bf0 con 0x7f631015cca0 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631015e420 con 0x7f63100b2220 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631015f460 con 0x7f62f8003ef0 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f631015cca0 0x7f631015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f631015cca0 0x7f631015d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44442/0 (socket says 172.21.15.53:44442) 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 -- 172.21.15.53:0/1533999601 learned_addr learned my addr 172.21.15.53:0/1533999601 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630f7fe640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63100b2220 0x7f63100b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630effd640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62f8003ef0 0x7f6310158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 -- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62f8003ef0 msgr2=0x7f6310158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62f8003ef0 0x7f6310158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 -- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63100b2220 msgr2=0x7f63100b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63100b2220 0x7f63100b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 -- 172.21.15.53:0/1533999601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631015d810 con 0x7f631015cca0 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630f7fe640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63100b2220 0x7f63100b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f630e7fc640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f631015cca0 0x7f631015d120 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f6300009ae0 tx=0x7f62f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:06.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f62f77fe640 1 -- 172.21.15.53:0/1533999601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000a55a0 con 0x7f631015cca0 2024-09-13T18:35:06.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f62f77fe640 1 -- 172.21.15.53:0/1533999601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300004220 con 0x7f631015cca0 2024-09-13T18:35:06.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f62f77fe640 1 -- 172.21.15.53:0/1533999601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300003620 con 0x7f631015cca0 2024-09-13T18:35:06.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631015daf0 con 0x7f631015cca0 2024-09-13T18:35:06.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.235+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631015e0b0 con 0x7f631015cca0 2024-09-13T18:35:06.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.239+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631015e590 con 0x7f631015cca0 2024-09-13T18:35:06.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.239+0000 7f62f77fe640 1 -- 172.21.15.53:0/1533999601 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f63000b4040 con 0x7f631015cca0 2024-09-13T18:35:06.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.239+0000 7f62f77fe640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62fc0671d0 0x7f62fc069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.239+0000 7f62f77fe640 1 -- 172.21.15.53:0/1533999601 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f630011d150 con 0x7f631015cca0 2024-09-13T18:35:06.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.239+0000 7f630effd640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62fc0671d0 0x7f62fc069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.239+0000 7f630effd640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62fc0671d0 0x7f62fc069690 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f63040124b0 tx=0x7f630400a9b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:06.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.243+0000 7f62f77fe640 1 -- 172.21.15.53:0/1533999601 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63000ebd20 con 0x7f631015cca0 2024-09-13T18:35:06.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.415+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63100b5750 con 0x7f631015cca0 2024-09-13T18:35:06.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.415+0000 7f62f77fe640 1 -- 172.21.15.53:0/1533999601 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v174) v1 ==== 80+0+0 (secure 0 0 0) 0x7f63000ef340 con 0x7f631015cca0 2024-09-13T18:35:06.415 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62fc0671d0 msgr2=0x7f62fc069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62fc0671d0 0x7f62fc069690 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f63040124b0 tx=0x7f630400a9b0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f631015cca0 msgr2=0x7f631015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f631015cca0 0x7f631015d120 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f6300009ae0 tx=0x7f62f8005800 comp rx=0 tx=0).stop 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 shutdown_connections 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62fc0671d0 0x7f62fc069690 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63100b2220 0x7f63100b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f631015cca0 0x7f631015d120 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 --2- 172.21.15.53:0/1533999601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62f8003ef0 0x7f6310158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 >> 172.21.15.53:0/1533999601 conn(0x7f6310065c80 msgr2=0x7f63100b8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:06.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 shutdown_connections 2024-09-13T18:35:06.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.419+0000 7f631552f640 1 -- 172.21.15.53:0/1533999601 wait complete. 2024-09-13T18:35:06.435 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:06.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:35:06.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[59783]: fuse finished with error 0 and tester_r 0 2024-09-13T18:35:06.450 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:35:06.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:06.450 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:35:06.565 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:35:06.565 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:06.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:06.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dda66f640 1 Processor -- start 2024-09-13T18:35:06.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dda66f640 1 -- start start 2024-09-13T18:35:06.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dda66f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5dd41582a0 0x7f5dd406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dda66f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5dd40713a0 0x7f5dd406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dda66f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd406d480 con 0x7f5dd415b7c0 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dda66f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd415aaf0 con 0x7f5dd41582a0 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dda66f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd406d760 con 0x7f5dd40713a0 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5dd41582a0 0x7f5dd406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dcbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5dd415b7c0 0x7f5dd4070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42260/0 (socket says 172.21.15.53:42260) 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dcbfff640 1 -- 172.21.15.53:0/1734483151 learned_addr learned my addr 172.21.15.53:0/1734483151 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd8c0c640 1 --2- 172.21.15.53:0/1734483151 >> v2:172.21.15.87:3300/0 conn(0x7f5dd40713a0 0x7f5dd406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd3fff640 1 -- 172.21.15.53:0/1734483151 >> v2:172.21.15.87:3300/0 conn(0x7f5dd40713a0 msgr2=0x7f5dd406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd3fff640 1 --2- 172.21.15.53:0/1734483151 >> v2:172.21.15.87:3300/0 conn(0x7f5dd40713a0 0x7f5dd406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd3fff640 1 -- 172.21.15.53:0/1734483151 >> v1:172.21.15.53:6789/0 conn(0x7f5dd415b7c0 legacy=0x7f5dd4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd37fe640 1 -- 172.21.15.53:0/1734483151 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772141337 0 0) 0x7f5dd406d480 con 0x7f5dd415b7c0 2024-09-13T18:35:06.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd3fff640 1 -- 172.21.15.53:0/1734483151 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd415ace0 con 0x7f5dd41582a0 2024-09-13T18:35:06.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.691+0000 7f5dd8c0c640 1 --2- 172.21.15.53:0/1734483151 >> v2:172.21.15.87:3300/0 conn(0x7f5dd40713a0 0x7f5dd406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd3fff640 1 --2- 172.21.15.53:0/1734483151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd41582a0 0x7f5dd406c900 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4158680 tx=0x7f5dbc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d556f3fb29ff62e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd37fe640 1 -- 172.21.15.53:0/1734483151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0a7070 con 0x7f5dd41582a0 2024-09-13T18:35:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd37fe640 1 -- 172.21.15.53:0/1734483151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc0ab430 con 0x7f5dd41582a0 2024-09-13T18:35:06.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd37fe640 1 -- 172.21.15.53:0/1734483151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0ab7c0 con 0x7f5dd41582a0 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- 172.21.15.53:0/1734483151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd41582a0 msgr2=0x7f5dd406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 --2- 172.21.15.53:0/1734483151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd41582a0 0x7f5dd406c900 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4158680 tx=0x7f5dbc01c430 comp rx=0 tx=0).stop 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- 172.21.15.53:0/1734483151 shutdown_connections 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 --2- 172.21.15.53:0/1734483151 >> v2:172.21.15.87:3300/0 conn(0x7f5dd40713a0 0x7f5dd406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 --2- 172.21.15.53:0/1734483151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd41582a0 0x7f5dd406c900 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- 172.21.15.53:0/1734483151 >> 172.21.15.53:0/1734483151 conn(0x7f5dd4065c80 msgr2=0x7f5dd4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- 172.21.15.53:0/1734483151 shutdown_connections 2024-09-13T18:35:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- 172.21.15.53:0/1734483151 wait complete. 2024-09-13T18:35:06.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 Processor -- start 2024-09-13T18:35:06.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- start start 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5dd40713a0 0x7f5dd41525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dd415b7c0 0x7f5dd4138b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd4150cd0 0x7f5dd414a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd414b910 con 0x7f5dd4150cd0 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd41390c0 con 0x7f5dd415b7c0 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dda66f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4146e90 con 0x7f5dd40713a0 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd4150cd0 0x7f5dd414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd4150cd0 0x7f5dd414a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54810/0 (socket says 172.21.15.53:54810) 2024-09-13T18:35:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 -- 172.21.15.53:0/3906555455 learned_addr learned my addr 172.21.15.53:0/3906555455 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dcbfff640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dd415b7c0 0x7f5dd4138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd3fff640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5dd40713a0 0x7f5dd41525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 -- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5dd40713a0 msgr2=0x7f5dd41525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5dd40713a0 0x7f5dd41525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 -- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dd415b7c0 msgr2=0x7f5dd4138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dd415b7c0 0x7f5dd4138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 -- 172.21.15.53:0/3906555455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc009420 con 0x7f5dd4150cd0 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dcbfff640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dd415b7c0 0x7f5dd4138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.695+0000 7f5dd8c0c640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd4150cd0 0x7f5dd414a670 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00ceb0 tx=0x7f5dcc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd17fa640 1 -- 172.21.15.53:0/3906555455 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00d840 con 0x7f5dd4150cd0 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd17fa640 1 -- 172.21.15.53:0/3906555455 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00d9a0 con 0x7f5dd4150cd0 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd414b070 con 0x7f5dd4150cd0 2024-09-13T18:35:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd17fa640 1 -- 172.21.15.53:0/3906555455 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00dd50 con 0x7f5dd4150cd0 2024-09-13T18:35:06.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd414b630 con 0x7f5dd4150cd0 2024-09-13T18:35:06.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd4067400 con 0x7f5dd4150cd0 2024-09-13T18:35:06.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd17fa640 1 -- 172.21.15.53:0/3906555455 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f5dcc01f440 con 0x7f5dd4150cd0 2024-09-13T18:35:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd17fa640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5db40671d0 0x7f5db4069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd17fa640 1 -- 172.21.15.53:0/3906555455 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dcc083610 con 0x7f5dd4150cd0 2024-09-13T18:35:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd3fff640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5db40671d0 0x7f5db4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.699+0000 7f5dd3fff640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5db40671d0 0x7f5db4069690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0af000 tx=0x7f5dbc0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:06.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.703+0000 7f5dd17fa640 1 -- 172.21.15.53:0/3906555455 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5dcc052340 con 0x7f5dd4150cd0 2024-09-13T18:35:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.863+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dd4146cf0 con 0x7f5dd4150cd0 2024-09-13T18:35:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dd17fa640 1 -- 172.21.15.53:0/3906555455 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f5dd4146cf0 con 0x7f5dd4150cd0 2024-09-13T18:35:06.865 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:06.865 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":174,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:44.536440+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5db40671d0 msgr2=0x7f5db4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5db40671d0 0x7f5db4069690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0af000 tx=0x7f5dbc0a7000 comp rx=0 tx=0).stop 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd4150cd0 msgr2=0x7f5dd414a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd4150cd0 0x7f5dd414a670 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00ceb0 tx=0x7f5dcc00a710 comp rx=0 tx=0).stop 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 shutdown_connections 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f5db40671d0 0x7f5db4069690 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5dd4150cd0 0x7f5dd414a670 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dd415b7c0 0x7f5dd4138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 --2- 172.21.15.53:0/3906555455 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5dd40713a0 0x7f5dd41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:06.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 >> 172.21.15.53:0/3906555455 conn(0x7f5dd4065c80 msgr2=0x7f5dd40cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:06.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 shutdown_connections 2024-09-13T18:35:06.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:06.867+0000 7f5dda66f640 1 -- 172.21.15.53:0/3906555455 wait complete. 2024-09-13T18:35:06.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:34:41.929723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:34:42.513600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:06.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:07.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7546be4640 1 Processor -- start 2024-09-13T18:35:07.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7546be4640 1 -- start start 2024-09-13T18:35:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7546be4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f75400b2bf0 0x7f75400cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7546be4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400ccd60 con 0x7f75400ccf10 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7546be4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75400cc190 con 0x7f75400ced50 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7546be4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75400ce270 con 0x7f75400b2bf0 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f75400ccf10 0x7f75400cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42276/0 (socket says 172.21.15.53:42276) 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 -- 172.21.15.53:0/3415745078 learned_addr learned my addr 172.21.15.53:0/3415745078 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753ffff640 1 --2- 172.21.15.53:0/3415745078 >> v2:172.21.15.87:3300/0 conn(0x7f75400b2bf0 0x7f75400cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133404382 0 0) 0x7f75400ccd60 con 0x7f75400ccf10 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7528003530 con 0x7f75400ccf10 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005714451 0 0) 0x7f7528003530 con 0x7f75400ccf10 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 >> v2:172.21.15.87:3300/0 conn(0x7f75400b2bf0 msgr2=0x7f75400cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 --2- 172.21.15.53:0/3415745078 >> v2:172.21.15.87:3300/0 conn(0x7f75400b2bf0 0x7f75400cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 >> v1:172.21.15.87:6789/0 conn(0x7f75400ced50 legacy=0x7f75400b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400ce550 con 0x7f75400ccf10 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7530001680 con 0x7f75400ccf10 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 >> v1:172.21.15.53:6789/0 conn(0x7f75400ccf10 legacy=0x7f75400cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7528003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75280047d0 0x7f7528004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528005190 0x7f752800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400ce270 con 0x7f7528003980 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752800c130 con 0x7f7528005190 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752800c2f0 con 0x7f75280047d0 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7528003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 -- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75280047d0 msgr2=0x7f7528004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75280047d0 0x7f7528004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7545181640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528005190 0x7f752800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 -- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528005190 msgr2=0x7f752800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528005190 0x7f752800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7544980640 1 -- 172.21.15.53:0/3415745078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528003530 con 0x7f7528003980 2024-09-13T18:35:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7545181640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7528005190 0x7f752800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.003+0000 7f7545181640 1 -- 172.21.15.53:0/3415745078 reap_dead start 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7544980640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7528003da0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f753000c240 tx=0x7f753001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccff77e27c34f1bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530005ae0 con 0x7f7528003980 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530005c40 con 0x7f7528003980 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f753f7fe640 1 -- 172.21.15.53:0/3415745078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300a5ab0 con 0x7f7528003980 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 -- 172.21.15.53:0/3415745078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 msgr2=0x7f7528003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7528003da0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f753000c240 tx=0x7f753001cc30 comp rx=0 tx=0).stop 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 -- 172.21.15.53:0/3415745078 shutdown_connections 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 --2- 172.21.15.53:0/3415745078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7528003da0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 -- 172.21.15.53:0/3415745078 >> 172.21.15.53:0/3415745078 conn(0x7f75400b20d0 msgr2=0x7f75400b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 -- 172.21.15.53:0/3415745078 shutdown_connections 2024-09-13T18:35:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 -- 172.21.15.53:0/3415745078 wait complete. 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 Processor -- start 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.007+0000 7f7546be4640 1 -- start start 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7540158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7540158910 0x7f754009db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f754009aed0 0x7f75400c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7540159190 con 0x7f7528003980 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7540158740 con 0x7f754009aed0 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754009ca80 con 0x7f7540158910 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7540158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7540158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54828/0 (socket says 172.21.15.53:54828) 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 -- 172.21.15.53:0/1973034776 learned_addr learned my addr 172.21.15.53:0/1973034776 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753ffff640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7540158910 0x7f754009db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7545181640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f754009aed0 0x7f75400c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 -- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7540158910 msgr2=0x7f754009db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7540158910 0x7f754009db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 -- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f754009aed0 msgr2=0x7f75400c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f754009aed0 0x7f75400c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 -- 172.21.15.53:0/1973034776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754009cd60 con 0x7f7528003980 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7544980640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7540158200 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f753000c240 tx=0x7f7528005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753d7fa640 1 -- 172.21.15.53:0/1973034776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300b4070 con 0x7f7528003980 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753d7fa640 1 -- 172.21.15.53:0/1973034776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530001500 con 0x7f7528003980 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754009d040 con 0x7f7528003980 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753d7fa640 1 -- 172.21.15.53:0/1973034776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300a5870 con 0x7f7528003980 2024-09-13T18:35:07.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754009d600 con 0x7f7528003980 2024-09-13T18:35:07.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75400cd680 con 0x7f7528003980 2024-09-13T18:35:07.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753d7fa640 1 -- 172.21.15.53:0/1973034776 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f75300a59d0 con 0x7f7528003980 2024-09-13T18:35:07.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753d7fa640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f752c0671d0 0x7f752c069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.013 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753ffff640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f752c0671d0 0x7f752c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753d7fa640 1 -- 172.21.15.53:0/1973034776 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f753011c7d0 con 0x7f7528003980 2024-09-13T18:35:07.014 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.011+0000 7f753ffff640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f752c0671d0 0x7f752c069690 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f75400cff30 tx=0x7f7534008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.015 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.015+0000 7f753d7fa640 1 -- 172.21.15.53:0/1973034776 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75300eb5f0 con 0x7f7528003980 2024-09-13T18:35:07.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.175+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f754015ef50 con 0x7f7528003980 2024-09-13T18:35:07.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f753d7fa640 1 -- 172.21.15.53:0/1973034776 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75300eec10 con 0x7f7528003980 2024-09-13T18:35:07.177 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:35:07.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f752c0671d0 msgr2=0x7f752c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f752c0671d0 0x7f752c069690 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f75400cff30 tx=0x7f7534008040 comp rx=0 tx=0).stop 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 msgr2=0x7f7540158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7540158200 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f753000c240 tx=0x7f7528005800 comp rx=0 tx=0).stop 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 shutdown_connections 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f752c0671d0 0x7f752c069690 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7540158910 0x7f754009db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f754009aed0 0x7f75400c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 --2- 172.21.15.53:0/1973034776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7528003980 0x7f7540158200 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 >> 172.21.15.53:0/1973034776 conn(0x7f75400b20d0 msgr2=0x7f7540159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 shutdown_connections 2024-09-13T18:35:07.180 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.179+0000 7f7546be4640 1 -- 172.21.15.53:0/1973034776 wait complete. 2024-09-13T18:35:07.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb33e091640 1 Processor -- start 2024-09-13T18:35:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb33e091640 1 -- start start 2024-09-13T18:35:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb33e091640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb338156c40 0x7fb338070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb33e091640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb338157020 0x7fb33806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb33e091640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33806d6e0 con 0x7fb33806d270 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb33e091640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb338070340 con 0x7fb338157020 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb33e091640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3380b15a0 con 0x7fb338156c40 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb336ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb338157020 0x7fb33806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb337fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb33806d270 0x7fb33815cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42280/0 (socket says 172.21.15.53:42280) 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb337fff640 1 -- 172.21.15.53:0/1002357205 learned_addr learned my addr 172.21.15.53:0/1002357205 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb336ffd640 1 --2- 172.21.15.53:0/1002357205 >> v2:172.21.15.53:3300/0 conn(0x7fb338157020 0x7fb33806cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54834/0 (socket says 172.21.15.53:54834) 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb3377fe640 1 --2- 172.21.15.53:0/1002357205 >> v2:172.21.15.87:3300/0 conn(0x7fb338156c40 0x7fb338070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb336ffd640 1 -- 172.21.15.53:0/1002357205 >> v2:172.21.15.87:3300/0 conn(0x7fb338156c40 msgr2=0x7fb338070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb336ffd640 1 --2- 172.21.15.53:0/1002357205 >> v2:172.21.15.87:3300/0 conn(0x7fb338156c40 0x7fb338070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb336ffd640 1 -- 172.21.15.53:0/1002357205 >> v1:172.21.15.53:6789/0 conn(0x7fb33806d270 legacy=0x7fb33815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb336ffd640 1 -- 172.21.15.53:0/1002357205 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380b1880 con 0x7fb338157020 2024-09-13T18:35:07.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.327+0000 7fb336ffd640 1 --2- 172.21.15.53:0/1002357205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338157020 0x7fb33806cd30 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7fb338067650 tx=0x7fb32801e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f1fbe68c00833 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb3367fc640 1 -- 172.21.15.53:0/1002357205 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280ab650 con 0x7fb338157020 2024-09-13T18:35:07.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb3367fc640 1 -- 172.21.15.53:0/1002357205 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3280ab7b0 con 0x7fb338157020 2024-09-13T18:35:07.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb3367fc640 1 -- 172.21.15.53:0/1002357205 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280abb40 con 0x7fb338157020 2024-09-13T18:35:07.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- 172.21.15.53:0/1002357205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338157020 msgr2=0x7fb33806cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 --2- 172.21.15.53:0/1002357205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338157020 0x7fb33806cd30 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7fb338067650 tx=0x7fb32801e660 comp rx=0 tx=0).stop 2024-09-13T18:35:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- 172.21.15.53:0/1002357205 shutdown_connections 2024-09-13T18:35:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 --2- 172.21.15.53:0/1002357205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338157020 0x7fb33806cd30 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 --2- 172.21.15.53:0/1002357205 >> v2:172.21.15.87:3300/0 conn(0x7fb338156c40 0x7fb338070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- 172.21.15.53:0/1002357205 >> 172.21.15.53:0/1002357205 conn(0x7fb338065c80 msgr2=0x7fb338066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- 172.21.15.53:0/1002357205 shutdown_connections 2024-09-13T18:35:07.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- 172.21.15.53:0/1002357205 wait complete. 2024-09-13T18:35:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 Processor -- start 2024-09-13T18:35:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- start start 2024-09-13T18:35:07.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb33806d270 0x7fb338152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb338156c40 0x7fb33815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338142b40 0x7fb3380af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33815b1e0 con 0x7fb338142b40 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33815c930 con 0x7fb338156c40 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380aec70 con 0x7fb33806d270 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338142b40 0x7fb3380af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338142b40 0x7fb3380af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54838/0 (socket says 172.21.15.53:54838) 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 -- 172.21.15.53:0/2802264378 learned_addr learned my addr 172.21.15.53:0/2802264378 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb336ffd640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb338156c40 0x7fb33815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb3377fe640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb33806d270 0x7fb338152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 -- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb33806d270 msgr2=0x7fb338152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb33806d270 0x7fb338152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 -- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb338156c40 msgr2=0x7fb33815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb338156c40 0x7fb33815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 -- 172.21.15.53:0/2802264378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328009420 con 0x7fb338142b40 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb337fff640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338142b40 0x7fb3380af100 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c400 tx=0x7fb32000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb32ffff640 1 -- 172.21.15.53:0/2802264378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320005cf0 con 0x7fb338142b40 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb32ffff640 1 -- 172.21.15.53:0/2802264378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb320005e50 con 0x7fb338142b40 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb32ffff640 1 -- 172.21.15.53:0/2802264378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200072d0 con 0x7fb338142b40 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33815c370 con 0x7fb338142b40 2024-09-13T18:35:07.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.331+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb338142fd0 con 0x7fb338142b40 2024-09-13T18:35:07.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.335+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3380aea40 con 0x7fb338142b40 2024-09-13T18:35:07.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.335+0000 7fb32ffff640 1 -- 172.21.15.53:0/2802264378 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fb320007430 con 0x7fb338142b40 2024-09-13T18:35:07.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.335+0000 7fb32ffff640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb318067200 0x7fb3180696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.335+0000 7fb32ffff640 1 -- 172.21.15.53:0/2802264378 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb320082190 con 0x7fb338142b40 2024-09-13T18:35:07.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.335+0000 7fb3377fe640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb318067200 0x7fb3180696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.335+0000 7fb3377fe640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb318067200 0x7fb3180696c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb3300070b0 tx=0x7fb330007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.339+0000 7fb32ffff640 1 -- 172.21.15.53:0/2802264378 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3380aea40 con 0x7fb338142b40 2024-09-13T18:35:07.500 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.499+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3380aea40 con 0x7fb338142b40 2024-09-13T18:35:07.501 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb32ffff640 1 -- 172.21.15.53:0/2802264378 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v174) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3380aea40 con 0x7fb338142b40 2024-09-13T18:35:07.501 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:35:07.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb318067200 msgr2=0x7fb3180696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb318067200 0x7fb3180696c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb3300070b0 tx=0x7fb330007040 comp rx=0 tx=0).stop 2024-09-13T18:35:07.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338142b40 msgr2=0x7fb3380af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338142b40 0x7fb3380af100 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c400 tx=0x7fb32000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 shutdown_connections 2024-09-13T18:35:07.503 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb318067200 0x7fb3180696c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb338142b40 0x7fb3380af100 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb338156c40 0x7fb33815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 --2- 172.21.15.53:0/2802264378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb33806d270 0x7fb338152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 >> 172.21.15.53:0/2802264378 conn(0x7fb338065c80 msgr2=0x7fb3381530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:07.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 shutdown_connections 2024-09-13T18:35:07.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.503+0000 7fb33e091640 1 -- 172.21.15.53:0/2802264378 wait complete. 2024-09-13T18:35:07.520 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:07.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc0413d3640 1 Processor -- start 2024-09-13T18:35:07.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc0413d3640 1 -- start start 2024-09-13T18:35:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc0413d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 0x7fc03c0d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc0413d3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03c0b7db0 con 0x7fc03c0d3390 2024-09-13T18:35:07.654 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc0413d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03c0d0650 con 0x7fc03c0ccd10 2024-09-13T18:35:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc0413d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c0d0c10 con 0x7fc03c15c830 2024-09-13T18:35:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc03c0d3390 0x7fc03c0b56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42286/0 (socket says 172.21.15.53:42286) 2024-09-13T18:35:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03b7fe640 1 -- 172.21.15.53:0/444239014 learned_addr learned my addr 172.21.15.53:0/444239014 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:07.655 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03affd640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 0x7fc03c0d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093404640 0 0) 0x7fc03c0b7db0 con 0x7fc03c0d3390 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc024003530 con 0x7fc03c0d3390 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058368632 0 0) 0x7fc03c0d0650 con 0x7fc03c0ccd10 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc03c0b7db0 con 0x7fc03c0ccd10 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 563339164 0 0) 0x7fc024003530 con 0x7fc03c0d3390 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 msgr2=0x7fc03c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 0x7fc03c0d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 >> v1:172.21.15.87:6789/0 conn(0x7fc03c0ccd10 legacy=0x7fc03c0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c0cd7d0 con 0x7fc03c0d3390 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc034001a00 con 0x7fc03c0d3390 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 >> v1:172.21.15.53:6789/0 conn(0x7fc03c0d3390 legacy=0x7fc03c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.657 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 0x7fc024003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc0240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc024004d10 0x7fc024005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c0d0c10 con 0x7fc0240040a0 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02400ba70 con 0x7fc024004d10 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02400bc30 con 0x7fc03c15c830 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03a7fc640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc0240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03b7fe640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc024004d10 0x7fc024005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03affd640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 0x7fc024003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03a7fc640 1 -- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 msgr2=0x7fc024003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03a7fc640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c15c830 0x7fc024003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03a7fc640 1 -- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc024004d10 msgr2=0x7fc024005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03a7fc640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc024004d10 0x7fc024005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.655+0000 7fc03a7fc640 1 -- 172.21.15.53:0/444239014 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024003530 con 0x7fc0240040a0 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc03a7fc640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc0240047d0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0b43f0 tx=0x7fc03001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e86fd5c66e41c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300052d0 con 0x7fc0240040a0 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030005450 con 0x7fc0240040a0 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc039ffb640 1 -- 172.21.15.53:0/444239014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300a8930 con 0x7fc0240040a0 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 -- 172.21.15.53:0/444239014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 msgr2=0x7fc0240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 --2- 172.21.15.53:0/444239014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc0240047d0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0b43f0 tx=0x7fc03001ecd0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc03b7fe640 1 -- 172.21.15.53:0/444239014 reap_dead start 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 -- 172.21.15.53:0/444239014 shutdown_connections 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 -- 172.21.15.53:0/444239014 >> 172.21.15.53:0/444239014 conn(0x7fc03c070970 msgr2=0x7fc03c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 -- 172.21.15.53:0/444239014 shutdown_connections 2024-09-13T18:35:07.660 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 -- 172.21.15.53:0/444239014 wait complete. 2024-09-13T18:35:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 Processor -- start 2024-09-13T18:35:07.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.659+0000 7fc0413d3640 1 -- start start 2024-09-13T18:35:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc03c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c0c8490 0x7fc03c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc03c1f5310 0x7fc03c1f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c0c8e30 con 0x7fc0240040a0 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c1f6080 con 0x7fc03c1f5310 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c1f2ac0 con 0x7fc03c0c8490 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc03c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc03c0cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54858/0 (socket says 172.21.15.53:54858) 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 -- 172.21.15.53:0/1704808319 learned_addr learned my addr 172.21.15.53:0/1704808319 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03a7fc640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c0c8490 0x7fc03c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03b7fe640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc03c1f5310 0x7fc03c1f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 -- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c0c8490 msgr2=0x7fc03c0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c0c8490 0x7fc03c0c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 -- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc03c1f5310 msgr2=0x7fc03c1f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc03c1f5310 0x7fc03c1f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 -- 172.21.15.53:0/1704808319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c1f1d00 con 0x7fc0240040a0 2024-09-13T18:35:07.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc03affd640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc03c0cb7b0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0115e0 tx=0x7fc02c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0237fe640 1 -- 172.21.15.53:0/1704808319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00f8f0 con 0x7fc0240040a0 2024-09-13T18:35:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0237fe640 1 -- 172.21.15.53:0/1704808319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c00fa50 con 0x7fc0240040a0 2024-09-13T18:35:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0237fe640 1 -- 172.21.15.53:0/1704808319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00fdc0 con 0x7fc0240040a0 2024-09-13T18:35:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c1f1fe0 con 0x7fc0240040a0 2024-09-13T18:35:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03c1f25a0 con 0x7fc0240040a0 2024-09-13T18:35:07.664 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03c0b5e40 con 0x7fc0240040a0 2024-09-13T18:35:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.663+0000 7fc0237fe640 1 -- 172.21.15.53:0/1704808319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fc02c015460 con 0x7fc0240040a0 2024-09-13T18:35:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.667+0000 7fc0237fe640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.667+0000 7fc0237fe640 1 -- 172.21.15.53:0/1704808319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc02c083530 con 0x7fc0240040a0 2024-09-13T18:35:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.667+0000 7fc03a7fc640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.665 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.667+0000 7fc03a7fc640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc0300b0000 tx=0x7fc0300aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.668 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.667+0000 7fc0237fe640 1 -- 172.21.15.53:0/1704808319 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc02c0520e0 con 0x7fc0240040a0 2024-09-13T18:35:07.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc03c0c9210 con 0x7fc0240040a0 2024-09-13T18:35:07.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0237fe640 1 -- 172.21.15.53:0/1704808319 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v174) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc02c055700 con 0x7fc0240040a0 2024-09-13T18:35:07.822 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 msgr2=0x7fc0280696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc0300b0000 tx=0x7fc0300aa070 comp rx=0 tx=0).stop 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 msgr2=0x7fc03c0cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc03c0cb7b0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0115e0 tx=0x7fc02c011aa0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 shutdown_connections 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc03c0c8490 0x7fc03c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc03c1f5310 0x7fc03c1f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 --2- 172.21.15.53:0/1704808319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0240040a0 0x7fc03c0cb7b0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 >> 172.21.15.53:0/1704808319 conn(0x7fc03c070970 msgr2=0x7fc03c0b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:07.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 shutdown_connections 2024-09-13T18:35:07.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.823+0000 7fc0413d3640 1 -- 172.21.15.53:0/1704808319 wait complete. 2024-09-13T18:35:07.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:35:07.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 Processor -- start 2024-09-13T18:35:07.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 -- start start 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77a01582a0 0x7f77a006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a015b7c0 0x7f77a006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77a0070c90 0x7f77a0071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a015aaf0 con 0x7f77a0070c90 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a006d760 con 0x7f77a01582a0 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f77a4d99640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0071650 con 0x7f77a015b7c0 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77a0070c90 0x7f77a0071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77a0070c90 0x7f77a0071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54860/0 (socket says 172.21.15.53:54860) 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 -- 172.21.15.53:0/908409233 learned_addr learned my addr 172.21.15.53:0/908409233 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779e59c640 1 --2- 172.21.15.53:0/908409233 >> v2:172.21.15.87:3300/0 conn(0x7f77a01582a0 0x7f77a006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 -- 172.21.15.53:0/908409233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a015b7c0 msgr2=0x7f77a006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779dd9b640 1 --2- 172.21.15.53:0/908409233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a015b7c0 0x7f77a006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 --2- 172.21.15.53:0/908409233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a015b7c0 0x7f77a006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 -- 172.21.15.53:0/908409233 >> v2:172.21.15.87:3300/0 conn(0x7f77a01582a0 msgr2=0x7f77a006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 --2- 172.21.15.53:0/908409233 >> v2:172.21.15.87:3300/0 conn(0x7f77a01582a0 0x7f77a006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779ed9d640 1 -- 172.21.15.53:0/908409233 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a006d480 con 0x7f77a0070c90 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779e59c640 1 --2- 172.21.15.53:0/908409233 >> v2:172.21.15.87:3300/0 conn(0x7f77a01582a0 0x7f77a006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:07.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.959+0000 7f779dd9b640 1 --2- 172.21.15.53:0/908409233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a015b7c0 0x7f77a006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:07.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 --2- 172.21.15.53:0/908409233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a0070c90 0x7f77a0071110 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f77a0069f50 tx=0x7f779801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4977c6a68747f196 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779d59a640 1 -- 172.21.15.53:0/908409233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980a5840 con 0x7f77a0070c90 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779d59a640 1 -- 172.21.15.53:0/908409233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77980a59a0 con 0x7f77a0070c90 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779d59a640 1 -- 172.21.15.53:0/908409233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980a5d30 con 0x7f77a0070c90 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- 172.21.15.53:0/908409233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a0070c90 msgr2=0x7f77a0071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 --2- 172.21.15.53:0/908409233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a0070c90 0x7f77a0071110 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f77a0069f50 tx=0x7f779801c9c0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- 172.21.15.53:0/908409233 shutdown_connections 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 --2- 172.21.15.53:0/908409233 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a015b7c0 0x7f77a006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 --2- 172.21.15.53:0/908409233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a0070c90 0x7f77a0071110 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 --2- 172.21.15.53:0/908409233 >> v2:172.21.15.87:3300/0 conn(0x7f77a01582a0 0x7f77a006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- 172.21.15.53:0/908409233 >> 172.21.15.53:0/908409233 conn(0x7f77a0065c80 msgr2=0x7f77a0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- 172.21.15.53:0/908409233 shutdown_connections 2024-09-13T18:35:07.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- 172.21.15.53:0/908409233 wait complete. 2024-09-13T18:35:07.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 Processor -- start 2024-09-13T18:35:07.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- start start 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a0070c90 0x7f77a01543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a01582a0 0x7f77a0159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a015b7c0 0x7f77a0144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00b1520 con 0x7f77a015b7c0 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0154a20 con 0x7f77a01582a0 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f77a4d99640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0154d00 con 0x7f77a0070c90 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a015b7c0 0x7f77a0144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a015b7c0 0x7f77a0144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54876/0 (socket says 172.21.15.53:54876) 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 -- 172.21.15.53:0/3596385219 learned_addr learned my addr 172.21.15.53:0/3596385219 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779e59c640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a0070c90 0x7f77a01543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779dd9b640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a01582a0 0x7f77a0159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 -- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a0070c90 msgr2=0x7f77a01543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a0070c90 0x7f77a01543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 -- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a01582a0 msgr2=0x7f77a0159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a01582a0 0x7f77a0159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 -- 172.21.15.53:0/3596385219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798009b30 con 0x7f77a015b7c0 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779dd9b640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a01582a0 0x7f77a0159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.963+0000 7f779ed9d640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a015b7c0 0x7f77a0144d40 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f77980af040 tx=0x7f7798019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f778effd640 1 -- 172.21.15.53:0/3596385219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980b8670 con 0x7f77a015b7c0 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f778effd640 1 -- 172.21.15.53:0/3596385219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77980b8810 con 0x7f77a015b7c0 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a0154fe0 con 0x7f77a015b7c0 2024-09-13T18:35:07.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f778effd640 1 -- 172.21.15.53:0/3596385219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980b8bc0 con 0x7f77a015b7c0 2024-09-13T18:35:07.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a0159e80 con 0x7f77a015b7c0 2024-09-13T18:35:07.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a0067400 con 0x7f77a015b7c0 2024-09-13T18:35:07.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f778effd640 1 -- 172.21.15.53:0/3596385219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f77980b8d20 con 0x7f77a015b7c0 2024-09-13T18:35:07.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f778effd640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7780067200 0x7f77800696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:07.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f778effd640 1 -- 172.21.15.53:0/3596385219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f779811e1f0 con 0x7f77a015b7c0 2024-09-13T18:35:07.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f779e59c640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7780067200 0x7f77800696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:07.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.967+0000 7f779e59c640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7780067200 0x7f77800696c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7794006b20 tx=0x7f7794008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:07.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:07.971+0000 7f778effd640 1 -- 172.21.15.53:0/3596385219 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f77980ed2a0 con 0x7f77a015b7c0 2024-09-13T18:35:08.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.143+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f77a00700e0 con 0x7f77a015b7c0 2024-09-13T18:35:08.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f778effd640 1 -- 172.21.15.53:0/3596385219 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v174) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77980f08c0 con 0x7f77a015b7c0 2024-09-13T18:35:08.145 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2024-09-13T18:35:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7780067200 msgr2=0x7f77800696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7780067200 0x7f77800696c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7794006b20 tx=0x7f7794008040 comp rx=0 tx=0).stop 2024-09-13T18:35:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a015b7c0 msgr2=0x7f77a0144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a015b7c0 0x7f77a0144d40 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f77980af040 tx=0x7f7798019760 comp rx=0 tx=0).stop 2024-09-13T18:35:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 shutdown_connections 2024-09-13T18:35:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7780067200 0x7f77800696c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77a015b7c0 0x7f77a0144d40 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77a01582a0 0x7f77a0159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 --2- 172.21.15.53:0/3596385219 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f77a0070c90 0x7f77a01543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 >> 172.21.15.53:0/3596385219 conn(0x7f77a0065c80 msgr2=0x7f77a006b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 shutdown_connections 2024-09-13T18:35:08.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.147+0000 7f77a4d99640 1 -- 172.21.15.53:0/3596385219 wait complete. 2024-09-13T18:35:08.164 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-09-13T18:35:08.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:08.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T18:35:08.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[36842]: fuse finished with error 0 and tester_r 0 2024-09-13T18:35:08.179 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:35:08.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:08.180 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:35:08.240 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:35:08.240 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:08.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:35:08.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:35:08.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:08.247 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:35:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-13T18:35:08.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:08.294 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:35:08.294 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:08.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:35:08.300 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:35:08.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:08.301 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:35:08.348 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-13T18:35:08.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:35:08.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:08.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.483+0000 7fa63451a640 1 Processor -- start 2024-09-13T18:35:08.484 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.483+0000 7fa63451a640 1 -- start start 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa63451a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa63451a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa62c06fa80 0x7fa62c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa63451a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0b2340 con 0x7fa62c0cbb60 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa63451a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c0b2860 con 0x7fa62c06fa80 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa63451a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c158f80 con 0x7fa62c158ba0 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa62c06fa80 0x7fa62c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa62c06fa80 0x7fa62c0b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54884/0 (socket says 172.21.15.53:54884) 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 -- 172.21.15.53:0/1755906283 learned_addr learned my addr 172.21.15.53:0/1755906283 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa6322b6640 1 --2- 172.21.15.53:0/1755906283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 -- 172.21.15.53:0/1755906283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 msgr2=0x7fa62c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 --2- 172.21.15.53:0/1755906283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 -- 172.21.15.53:0/1755906283 >> v1:172.21.15.53:6789/0 conn(0x7fa62c0cbb60 legacy=0x7fa62c06f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa6312b4640 1 -- 172.21.15.53:0/1755906283 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851754691 0 0) 0x7fa61c001120 con 0x7fa62c0cbb60 2024-09-13T18:35:08.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 -- 172.21.15.53:0/1755906283 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0b2580 con 0x7fa62c06fa80 2024-09-13T18:35:08.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa632ab7640 1 --2- 172.21.15.53:0/1755906283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c0b1e00 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fa624009e50 tx=0x7fa62401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb5c1b258ac2b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:08.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa6312b4640 1 -- 172.21.15.53:0/1755906283 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240a57e0 con 0x7fa62c06fa80 2024-09-13T18:35:08.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa6312b4640 1 -- 172.21.15.53:0/1755906283 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6240a5940 con 0x7fa62c06fa80 2024-09-13T18:35:08.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.487+0000 7fa6312b4640 1 -- 172.21.15.53:0/1755906283 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240a5cd0 con 0x7fa62c06fa80 2024-09-13T18:35:08.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- 172.21.15.53:0/1755906283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 msgr2=0x7fa62c0b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 --2- 172.21.15.53:0/1755906283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c0b1e00 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fa624009e50 tx=0x7fa62401c9a0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- 172.21.15.53:0/1755906283 shutdown_connections 2024-09-13T18:35:08.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 --2- 172.21.15.53:0/1755906283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c0b1e00 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 --2- 172.21.15.53:0/1755906283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- 172.21.15.53:0/1755906283 >> 172.21.15.53:0/1755906283 conn(0x7fa62c065c80 msgr2=0x7fa62c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:08.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- 172.21.15.53:0/1755906283 shutdown_connections 2024-09-13T18:35:08.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- 172.21.15.53:0/1755906283 wait complete. 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 Processor -- start 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- start start 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa62c0cbb60 0x7fa62c161f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c162470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c14f5f0 con 0x7fa62c06fa80 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15a210 con 0x7fa62c0cbb60 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c14f800 con 0x7fa62c158ba0 2024-09-13T18:35:08.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54894/0 (socket says 172.21.15.53:54894) 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 -- 172.21.15.53:0/3003985285 learned_addr learned my addr 172.21.15.53:0/3003985285 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa631ab5640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa62c0cbb60 0x7fa62c161f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa632ab7640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c162470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 -- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 msgr2=0x7fa62c162470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c162470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 -- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa62c0cbb60 msgr2=0x7fa62c161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa62c0cbb60 0x7fa62c161f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 -- 172.21.15.53:0/3003985285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624009b30 con 0x7fa62c06fa80 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa6322b6640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c159cd0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fa62800d5f0 tx=0x7fa62800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa622ffd640 1 -- 172.21.15.53:0/3003985285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6280125f0 con 0x7fa62c06fa80 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa622ffd640 1 -- 172.21.15.53:0/3003985285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa628012750 con 0x7fa62c06fa80 2024-09-13T18:35:08.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c14fae0 con 0x7fa62c06fa80 2024-09-13T18:35:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa622ffd640 1 -- 172.21.15.53:0/3003985285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628012ae0 con 0x7fa62c06fa80 2024-09-13T18:35:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.491+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c1500a0 con 0x7fa62c06fa80 2024-09-13T18:35:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.495+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c150260 con 0x7fa62c06fa80 2024-09-13T18:35:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.495+0000 7fa622ffd640 1 -- 172.21.15.53:0/3003985285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fa628012c40 con 0x7fa62c06fa80 2024-09-13T18:35:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.495+0000 7fa622ffd640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa6100671d0 0x7fa610069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.495+0000 7fa622ffd640 1 -- 172.21.15.53:0/3003985285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa628083020 con 0x7fa62c06fa80 2024-09-13T18:35:08.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.495+0000 7fa631ab5640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa6100671d0 0x7fa610069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.495+0000 7fa631ab5640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa6100671d0 0x7fa610069690 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa62c157ec0 tx=0x7fa61c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:08.498 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.499+0000 7fa622ffd640 1 -- 172.21.15.53:0/3003985285 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa628051de0 con 0x7fa62c06fa80 2024-09-13T18:35:08.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.695+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa62c067400 con 0x7fa62c06fa80 2024-09-13T18:35:08.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.695+0000 7fa622ffd640 1 -- 172.21.15.53:0/3003985285 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4745 (secure 0 0 0) 0x7fa628055400 con 0x7fa62c06fa80 2024-09-13T18:35:08.695 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:08.695 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":105,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/481869316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":481869316},{"type":"v1","addr":"172.21.15.87:6833","nonce":481869316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4120395616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4120395616},{"type":"v1","addr":"172.21.15.87:6835","nonce":4120395616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1960885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1960885675},{"type":"v1","addr":"172.21.15.53:6833","nonce":1960885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:34:43.533426+0000","modified":"2024-09-13T18:34:46.545788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1295090105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1295090105},{"type":"v1","addr":"172.21.15.53:6835","nonce":1295090105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":13}]} 2024-09-13T18:35:08.695 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 105 2024-09-13T18:35:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa6100671d0 msgr2=0x7fa610069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa6100671d0 0x7fa610069690 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa62c157ec0 tx=0x7fa61c009040 comp rx=0 tx=0).stop 2024-09-13T18:35:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 msgr2=0x7fa62c159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c159cd0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fa62800d5f0 tx=0x7fa62800dab0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 shutdown_connections 2024-09-13T18:35:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fa6100671d0 0x7fa610069690 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa62c158ba0 0x7fa62c162470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa62c0cbb60 0x7fa62c161f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 --2- 172.21.15.53:0/3003985285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa62c06fa80 0x7fa62c159cd0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 >> 172.21.15.53:0/3003985285 conn(0x7fa62c065c80 msgr2=0x7fa62c152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:08.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 shutdown_connections 2024-09-13T18:35:08.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.699+0000 7fa63451a640 1 -- 172.21.15.53:0/3003985285 wait complete. 2024-09-13T18:35:08.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c2fdc640 1 Processor -- start 2024-09-13T18:35:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c2fdc640 1 -- start start 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c2fdc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 0x7f40bc070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c2fdc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f40bc0711d0 0x7f40bc1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c2fdc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc06d480 con 0x7f40bc1582a0 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c2fdc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc15aaf0 con 0x7f40bc0711d0 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c2fdc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc06d760 con 0x7f40bc15b7c0 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f40bc1582a0 0x7f40bc06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42302/0 (socket says 172.21.15.53:42302) 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 -- 172.21.15.53:0/2296307564 learned_addr learned my addr 172.21.15.53:0/2296307564 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c1579640 1 --2- 172.21.15.53:0/2296307564 >> v2:172.21.15.87:3300/0 conn(0x7f40bc0711d0 0x7f40bc1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bbfff640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 0x7f40bc070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642688778 0 0) 0x7f40bc06d480 con 0x7f40bc1582a0 2024-09-13T18:35:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40ac003530 con 0x7f40bc1582a0 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459586127 0 0) 0x7f40ac003530 con 0x7f40bc1582a0 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 msgr2=0x7f40bc070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 0x7f40bc070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 >> v2:172.21.15.87:3300/0 conn(0x7f40bc0711d0 msgr2=0x7f40bc1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 --2- 172.21.15.53:0/2296307564 >> v2:172.21.15.87:3300/0 conn(0x7f40bc0711d0 0x7f40bc1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc15ace0 con 0x7f40bc1582a0 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f40b0001680 con 0x7f40bc1582a0 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 >> v1:172.21.15.53:6789/0 conn(0x7f40bc1582a0 legacy=0x7f40bc06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40ac003980 0x7f40ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 0x7f40ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac004d10 0x7f40ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac00b990 con 0x7f40ac003980 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac00bad0 con 0x7f40ac004d10 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac00bc10 con 0x7f40bc15b7c0 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40ac003980 0x7f40ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40bbfff640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 0x7f40ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c1579640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac004d10 0x7f40ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 -- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 msgr2=0x7f40ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc15b7c0 0x7f40ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 -- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac004d10 msgr2=0x7f40ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac004d10 0x7f40ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c0d78640 1 -- 172.21.15.53:0/2296307564 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac003530 con 0x7f40ac003980 2024-09-13T18:35:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.847+0000 7f40c1579640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac004d10 0x7f40ac005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c0d78640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40ac003980 0x7f40ac003da0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c210 tx=0x7f40b001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f19a89b7eb3a72f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00058e0 con 0x7f40ac003980 2024-09-13T18:35:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b0005a40 con 0x7f40ac003980 2024-09-13T18:35:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40bb7fe640 1 -- 172.21.15.53:0/2296307564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0005e30 con 0x7f40ac003980 2024-09-13T18:35:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 -- 172.21.15.53:0/2296307564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40ac003980 msgr2=0x7f40ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 --2- 172.21.15.53:0/2296307564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40ac003980 0x7f40ac003da0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c210 tx=0x7f40b001cc80 comp rx=0 tx=0).stop 2024-09-13T18:35:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c1579640 1 -- 172.21.15.53:0/2296307564 reap_dead start 2024-09-13T18:35:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 -- 172.21.15.53:0/2296307564 shutdown_connections 2024-09-13T18:35:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 -- 172.21.15.53:0/2296307564 >> 172.21.15.53:0/2296307564 conn(0x7f40bc065c80 msgr2=0x7f40bc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 -- 172.21.15.53:0/2296307564 shutdown_connections 2024-09-13T18:35:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 -- 172.21.15.53:0/2296307564 wait complete. 2024-09-13T18:35:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 Processor -- start 2024-09-13T18:35:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.851+0000 7f40c2fdc640 1 -- start start 2024-09-13T18:35:08.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac003980 0x7f40bc159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc158680 0x7f40bc140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40bc14d330 0x7f40bc14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc158c40 con 0x7f40bc14d330 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc158f20 con 0x7f40ac003980 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc159200 con 0x7f40bc158680 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40bc14d330 0x7f40bc14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40bc14d330 0x7f40bc14d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54908/0 (socket says 172.21.15.53:54908) 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 -- 172.21.15.53:0/1985014804 learned_addr learned my addr 172.21.15.53:0/1985014804 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c0d78640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac003980 0x7f40bc159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40bbfff640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc158680 0x7f40bc140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 -- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc158680 msgr2=0x7f40bc140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc158680 0x7f40bc140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 -- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac003980 msgr2=0x7f40bc159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac003980 0x7f40bc159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 -- 172.21.15.53:0/1985014804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc1594e0 con 0x7f40bc14d330 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c1579640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40bc14d330 0x7f40bc14d7e0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f40bc15bba0 tx=0x7f40b400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40b97fa640 1 -- 172.21.15.53:0/1985014804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4017400 con 0x7f40bc14d330 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40b97fa640 1 -- 172.21.15.53:0/1985014804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4011040 con 0x7f40bc14d330 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc1597c0 con 0x7f40bc14d330 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40b97fa640 1 -- 172.21.15.53:0/1985014804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4017780 con 0x7f40bc14d330 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc140f80 con 0x7f40bc14d330 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc067400 con 0x7f40bc14d330 2024-09-13T18:35:08.857 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40b97fa640 1 -- 172.21.15.53:0/1985014804 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f40b40203b0 con 0x7f40bc14d330 2024-09-13T18:35:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40b97fa640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a00671d0 0x7f40a0069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40b97fa640 1 -- 172.21.15.53:0/1985014804 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b4082d70 con 0x7f40bc14d330 2024-09-13T18:35:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c0d78640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a00671d0 0x7f40a0069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:08.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.855+0000 7f40c0d78640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a00671d0 0x7f40a0069690 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f40b00aa000 tx=0x7f40b0001a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:08.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:08.859+0000 7f40b97fa640 1 -- 172.21.15.53:0/1985014804 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40b4051b00 con 0x7f40bc14d330 2024-09-13T18:35:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.023+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40bc06c900 con 0x7f40bc14d330 2024-09-13T18:35:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40b97fa640 1 -- 172.21.15.53:0/1985014804 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f40b401c090 con 0x7f40bc14d330 2024-09-13T18:35:09.025 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:09.025 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":174,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:44.536440+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:09.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a00671d0 msgr2=0x7f40a0069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a00671d0 0x7f40a0069690 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f40b00aa000 tx=0x7f40b0001a10 comp rx=0 tx=0).stop 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40bc14d330 msgr2=0x7f40bc14d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40bc14d330 0x7f40bc14d7e0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f40bc15bba0 tx=0x7f40b400f4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 shutdown_connections 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f40a00671d0 0x7f40a0069690 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f40bc158680 0x7f40bc140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40bc14d330 0x7f40bc14d7e0 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 --2- 172.21.15.53:0/1985014804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f40ac003980 0x7f40bc159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 >> 172.21.15.53:0/1985014804 conn(0x7f40bc065c80 msgr2=0x7f40bc0cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 shutdown_connections 2024-09-13T18:35:09.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.027+0000 7f40c2fdc640 1 -- 172.21.15.53:0/1985014804 wait complete. 2024-09-13T18:35:09.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:24:44.982186+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:34:41.929723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:34:42.513600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:09.047 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e9144640 1 Processor -- start 2024-09-13T18:35:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e9144640 1 -- start start 2024-09-13T18:35:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e9144640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87e41457c0 0x7f87e40b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e9144640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87e40b1a40 0x7f87e4070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e9144640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e4146180 con 0x7f87e4071220 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e9144640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e4071630 con 0x7f87e40b1a40 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e9144640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e40702d0 con 0x7f87e41457c0 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87e40b1a40 0x7f87e4070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e359e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f87e4071220 0x7f87e406b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42314/0 (socket says 172.21.15.53:42314) 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e359e640 1 -- 172.21.15.53:0/1921847513 learned_addr learned my addr 172.21.15.53:0/1921847513 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e2d9d640 1 --2- 172.21.15.53:0/1921847513 >> v2:172.21.15.87:3300/0 conn(0x7f87e41457c0 0x7f87e40b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87dbfff640 1 -- 172.21.15.53:0/1921847513 >> v2:172.21.15.87:3300/0 conn(0x7f87e41457c0 msgr2=0x7f87e40b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87dbfff640 1 --2- 172.21.15.53:0/1921847513 >> v2:172.21.15.87:3300/0 conn(0x7f87e41457c0 0x7f87e40b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87dbfff640 1 -- 172.21.15.53:0/1921847513 >> v1:172.21.15.53:6789/0 conn(0x7f87e4071220 legacy=0x7f87e406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87dbfff640 1 -- 172.21.15.53:0/1921847513 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e406c4c0 con 0x7f87e40b1a40 2024-09-13T18:35:09.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.175+0000 7f87e259c640 1 -- 172.21.15.53:0/1921847513 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204378328 0 0) 0x7f87e4146180 con 0x7f87e4071220 2024-09-13T18:35:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87dbfff640 1 --2- 172.21.15.53:0/1921847513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e40b1a40 0x7f87e4070ce0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f87e406f000 tx=0x7f87cc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c262ff64d951986e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e259c640 1 -- 172.21.15.53:0/1921847513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0ab650 con 0x7f87e40b1a40 2024-09-13T18:35:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e259c640 1 -- 172.21.15.53:0/1921847513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc0ab7b0 con 0x7f87e40b1a40 2024-09-13T18:35:09.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e259c640 1 -- 172.21.15.53:0/1921847513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0abb40 con 0x7f87e40b1a40 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- 172.21.15.53:0/1921847513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e40b1a40 msgr2=0x7f87e4070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 --2- 172.21.15.53:0/1921847513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e40b1a40 0x7f87e4070ce0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f87e406f000 tx=0x7f87cc01c450 comp rx=0 tx=0).stop 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- 172.21.15.53:0/1921847513 shutdown_connections 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 --2- 172.21.15.53:0/1921847513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e40b1a40 0x7f87e4070ce0 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 --2- 172.21.15.53:0/1921847513 >> v2:172.21.15.87:3300/0 conn(0x7f87e41457c0 0x7f87e40b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- 172.21.15.53:0/1921847513 >> 172.21.15.53:0/1921847513 conn(0x7f87e4065c80 msgr2=0x7f87e4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- 172.21.15.53:0/1921847513 shutdown_connections 2024-09-13T18:35:09.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- 172.21.15.53:0/1921847513 wait complete. 2024-09-13T18:35:09.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 Processor -- start 2024-09-13T18:35:09.179 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- start start 2024-09-13T18:35:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e4071220 0x7f87e415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e40b1a40 0x7f87e4139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e41457c0 0x7f87e4139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4137800 con 0x7f87e41457c0 2024-09-13T18:35:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e413a720 con 0x7f87e4071220 2024-09-13T18:35:09.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e9144640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4136ed0 con 0x7f87e40b1a40 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e41457c0 0x7f87e4139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e41457c0 0x7f87e4139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54936/0 (socket says 172.21.15.53:54936) 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 -- 172.21.15.53:0/1485229330 learned_addr learned my addr 172.21.15.53:0/1485229330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e2d9d640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e4071220 0x7f87e415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87dbfff640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e40b1a40 0x7f87e4139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 -- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e40b1a40 msgr2=0x7f87e4139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e40b1a40 0x7f87e4139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 -- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e4071220 msgr2=0x7f87e415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e4071220 0x7f87e415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 -- 172.21.15.53:0/1485229330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc009420 con 0x7f87e41457c0 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87e359e640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e41457c0 0x7f87e4139db0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001570 tx=0x7f87dc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.179+0000 7f87db7fe640 1 -- 172.21.15.53:0/1485229330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00a640 con 0x7f87e41457c0 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87db7fe640 1 -- 172.21.15.53:0/1485229330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc00a7c0 con 0x7f87e41457c0 2024-09-13T18:35:09.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e41371b0 con 0x7f87e41457c0 2024-09-13T18:35:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87db7fe640 1 -- 172.21.15.53:0/1485229330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00ab70 con 0x7f87e41457c0 2024-09-13T18:35:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e415ba20 con 0x7f87e41457c0 2024-09-13T18:35:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e4137970 con 0x7f87e41457c0 2024-09-13T18:35:09.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87db7fe640 1 -- 172.21.15.53:0/1485229330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f87dc00acd0 con 0x7f87e41457c0 2024-09-13T18:35:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87db7fe640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87c40671d0 0x7f87c4069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87db7fe640 1 -- 172.21.15.53:0/1485229330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87dc082590 con 0x7f87e41457c0 2024-09-13T18:35:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87e2d9d640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87c40671d0 0x7f87c4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.183+0000 7f87e2d9d640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87c40671d0 0x7f87c4069690 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87e40afff0 tx=0x7f87d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.187+0000 7f87db7fe640 1 -- 172.21.15.53:0/1485229330 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87dc051160 con 0x7f87e41457c0 2024-09-13T18:35:09.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.347+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87e406bbc0 con 0x7f87e41457c0 2024-09-13T18:35:09.347 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.347+0000 7f87db7fe640 1 -- 172.21.15.53:0/1485229330 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87dc054780 con 0x7f87e41457c0 2024-09-13T18:35:09.347 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-13T18:35:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87c40671d0 msgr2=0x7f87c4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87c40671d0 0x7f87c4069690 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87e40afff0 tx=0x7f87d4008040 comp rx=0 tx=0).stop 2024-09-13T18:35:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e41457c0 msgr2=0x7f87e4139db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e41457c0 0x7f87e4139db0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001570 tx=0x7f87dc00cca0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 shutdown_connections 2024-09-13T18:35:09.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f87c40671d0 0x7f87c4069690 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87e40b1a40 0x7f87e4139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87e41457c0 0x7f87e4139db0 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 --2- 172.21.15.53:0/1485229330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87e4071220 0x7f87e415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 >> 172.21.15.53:0/1485229330 conn(0x7f87e4065c80 msgr2=0x7f87e406b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:09.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 shutdown_connections 2024-09-13T18:35:09.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.351+0000 7f87e9144640 1 -- 172.21.15.53:0/1485229330 wait complete. 2024-09-13T18:35:09.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:09.487 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 Processor -- start 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 -- start start 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe8500c34f0 0x7fe8500b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe850160db0 0x7fe8500c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500b2bf0 0x7fe8500ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85006bee0 con 0x7fe850160db0 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500aff40 con 0x7fe8500c34f0 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe855e1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500c3e10 con 0x7fe8500b2bf0 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe850160db0 0x7fe8500c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe850160db0 0x7fe8500c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54938/0 (socket says 172.21.15.53:54938) 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 -- 172.21.15.53:0/3959738893 learned_addr learned my addr 172.21.15.53:0/3959738893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84f7fe640 1 --2- 172.21.15.53:0/3959738893 >> v2:172.21.15.87:3300/0 conn(0x7fe8500c34f0 0x7fe8500b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84ffff640 1 --2- 172.21.15.53:0/3959738893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500b2bf0 0x7fe8500ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.488 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 -- 172.21.15.53:0/3959738893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500b2bf0 msgr2=0x7fe8500ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:09.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 --2- 172.21.15.53:0/3959738893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500b2bf0 0x7fe8500ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 -- 172.21.15.53:0/3959738893 >> v2:172.21.15.87:3300/0 conn(0x7fe8500c34f0 msgr2=0x7fe8500b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:09.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 --2- 172.21.15.53:0/3959738893 >> v2:172.21.15.87:3300/0 conn(0x7fe8500c34f0 0x7fe8500b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84effd640 1 -- 172.21.15.53:0/3959738893 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85006a2c0 con 0x7fe850160db0 2024-09-13T18:35:09.489 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.487+0000 7fe84f7fe640 1 --2- 172.21.15.53:0/3959738893 >> v2:172.21.15.87:3300/0 conn(0x7fe8500c34f0 0x7fe8500b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:09.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe84effd640 1 --2- 172.21.15.53:0/3959738893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe850160db0 0x7fe8500c38d0 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7fe850066c60 tx=0x7fe84001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582c59632e91224e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe84e7fc640 1 -- 172.21.15.53:0/3959738893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500cee20 con 0x7fe850160db0 2024-09-13T18:35:09.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe84e7fc640 1 -- 172.21.15.53:0/3959738893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8400a5840 con 0x7fe850160db0 2024-09-13T18:35:09.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe84e7fc640 1 -- 172.21.15.53:0/3959738893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8400a5bd0 con 0x7fe850160db0 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- 172.21.15.53:0/3959738893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe850160db0 msgr2=0x7fe8500c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 --2- 172.21.15.53:0/3959738893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe850160db0 0x7fe8500c38d0 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7fe850066c60 tx=0x7fe84001c9c0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- 172.21.15.53:0/3959738893 shutdown_connections 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 --2- 172.21.15.53:0/3959738893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500b2bf0 0x7fe8500ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 --2- 172.21.15.53:0/3959738893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe850160db0 0x7fe8500c38d0 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 --2- 172.21.15.53:0/3959738893 >> v2:172.21.15.87:3300/0 conn(0x7fe8500c34f0 0x7fe8500b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- 172.21.15.53:0/3959738893 >> 172.21.15.53:0/3959738893 conn(0x7fe8500b20d0 msgr2=0x7fe8500b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- 172.21.15.53:0/3959738893 shutdown_connections 2024-09-13T18:35:09.491 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- 172.21.15.53:0/3959738893 wait complete. 2024-09-13T18:35:09.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 Processor -- start 2024-09-13T18:35:09.492 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- start start 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8500b2bf0 0x7fe850155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500c34f0 0x7fe850154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe850160db0 0x7fe8500b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b33d0 con 0x7fe8500b2bf0 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b36b0 con 0x7fe850160db0 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.491+0000 7fe855e1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500ceed0 con 0x7fe8500c34f0 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8500b2bf0 0x7fe850155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8500b2bf0 0x7fe850155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54954/0 (socket says 172.21.15.53:54954) 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 -- 172.21.15.53:0/800700738 learned_addr learned my addr 172.21.15.53:0/800700738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84ffff640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe850160db0 0x7fe8500b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84effd640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500c34f0 0x7fe850154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.494 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 -- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500c34f0 msgr2=0x7fe850154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500c34f0 0x7fe850154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 -- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe850160db0 msgr2=0x7fe8500b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe850160db0 0x7fe8500b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 -- 172.21.15.53:0/800700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840009b30 con 0x7fe8500b2bf0 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84f7fe640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8500b2bf0 0x7fe850155b80 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7fe83800e840 tx=0x7fe83800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe847fff640 1 -- 172.21.15.53:0/800700738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800c8d0 con 0x7fe8500b2bf0 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe847fff640 1 -- 172.21.15.53:0/800700738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800ca30 con 0x7fe8500b2bf0 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8500cf120 con 0x7fe8500b2bf0 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe847fff640 1 -- 172.21.15.53:0/800700738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800cdc0 con 0x7fe8500b2bf0 2024-09-13T18:35:09.495 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8501553f0 con 0x7fe8500b2bf0 2024-09-13T18:35:09.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8500b3920 con 0x7fe8500b2bf0 2024-09-13T18:35:09.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe847fff640 1 -- 172.21.15.53:0/800700738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fe838013410 con 0x7fe8500b2bf0 2024-09-13T18:35:09.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe847fff640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe8340671d0 0x7fe834069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe847fff640 1 -- 172.21.15.53:0/800700738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe838082b20 con 0x7fe8500b2bf0 2024-09-13T18:35:09.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84effd640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe8340671d0 0x7fe834069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.495+0000 7fe84effd640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe8340671d0 0x7fe834069690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe8400ae000 tx=0x7fe8400a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.499 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.499+0000 7fe847fff640 1 -- 172.21.15.53:0/800700738 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8380516f0 con 0x7fe8500b2bf0 2024-09-13T18:35:09.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.659+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8500cf640 con 0x7fe8500b2bf0 2024-09-13T18:35:09.658 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.659+0000 7fe847fff640 1 -- 172.21.15.53:0/800700738 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v174) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8500cf640 con 0x7fe8500b2bf0 2024-09-13T18:35:09.659 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2024-09-13T18:35:09.661 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe8340671d0 msgr2=0x7fe834069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe8340671d0 0x7fe834069690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe8400ae000 tx=0x7fe8400a7070 comp rx=0 tx=0).stop 2024-09-13T18:35:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8500b2bf0 msgr2=0x7fe850155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8500b2bf0 0x7fe850155b80 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7fe83800e840 tx=0x7fe83800ed00 comp rx=0 tx=0).stop 2024-09-13T18:35:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 shutdown_connections 2024-09-13T18:35:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe8340671d0 0x7fe834069690 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.662 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8500c34f0 0x7fe850154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe850160db0 0x7fe8500b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 --2- 172.21.15.53:0/800700738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8500b2bf0 0x7fe850155b80 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 >> 172.21.15.53:0/800700738 conn(0x7fe8500b20d0 msgr2=0x7fe85015be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 shutdown_connections 2024-09-13T18:35:09.663 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.663+0000 7fe855e1b640 1 -- 172.21.15.53:0/800700738 wait complete. 2024-09-13T18:35:09.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:09.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36ab45f640 1 Processor -- start 2024-09-13T18:35:09.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36ab45f640 1 -- start start 2024-09-13T18:35:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36ab45f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36a40caee0 0x7f36a40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36ab45f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36a40cd320 0x7f36a40cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36ab45f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a406f7a0 con 0x7f36a4143e80 2024-09-13T18:35:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36ab45f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a406baa0 con 0x7f36a40caee0 2024-09-13T18:35:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36ab45f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a406fd60 con 0x7f36a40cd320 2024-09-13T18:35:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a91fb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f36a4143e80 0x7f36a406b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42318/0 (socket says 172.21.15.53:42318) 2024-09-13T18:35:09.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a91fb640 1 -- 172.21.15.53:0/3999173127 learned_addr learned my addr 172.21.15.53:0/3999173127 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a89fa640 1 --2- 172.21.15.53:0/3999173127 >> v2:172.21.15.53:3300/0 conn(0x7f36a40caee0 0x7f36a40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a99fc640 1 --2- 172.21.15.53:0/3999173127 >> v2:172.21.15.87:3300/0 conn(0x7f36a40cd320 0x7f36a40cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a89fa640 1 -- 172.21.15.53:0/3999173127 >> v2:172.21.15.87:3300/0 conn(0x7f36a40cd320 msgr2=0x7f36a40cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a89fa640 1 --2- 172.21.15.53:0/3999173127 >> v2:172.21.15.87:3300/0 conn(0x7f36a40cd320 0x7f36a40cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a89fa640 1 -- 172.21.15.53:0/3999173127 >> v1:172.21.15.53:6789/0 conn(0x7f36a4143e80 legacy=0x7f36a406b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f369bfff640 1 -- 172.21.15.53:0/3999173127 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503866357 0 0) 0x7f36a406f7a0 con 0x7f36a4143e80 2024-09-13T18:35:09.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.795+0000 7f36a89fa640 1 -- 172.21.15.53:0/3999173127 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a40cb960 con 0x7f36a40caee0 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36a89fa640 1 --2- 172.21.15.53:0/3999173127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40caee0 0x7f36a40cb350 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f36940097c0 tx=0x7f369401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9031f9314122475 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f369bfff640 1 -- 172.21.15.53:0/3999173127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940ac600 con 0x7f36a40caee0 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f369bfff640 1 -- 172.21.15.53:0/3999173127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36940a8050 con 0x7f36a40caee0 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f369bfff640 1 -- 172.21.15.53:0/3999173127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940ac980 con 0x7f36a40caee0 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- 172.21.15.53:0/3999173127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40caee0 msgr2=0x7f36a40cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 --2- 172.21.15.53:0/3999173127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40caee0 0x7f36a40cb350 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f36940097c0 tx=0x7f369401c3a0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- 172.21.15.53:0/3999173127 shutdown_connections 2024-09-13T18:35:09.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 --2- 172.21.15.53:0/3999173127 >> v2:172.21.15.87:3300/0 conn(0x7f36a40cd320 0x7f36a40cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 --2- 172.21.15.53:0/3999173127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40caee0 0x7f36a40cb350 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- 172.21.15.53:0/3999173127 >> 172.21.15.53:0/3999173127 conn(0x7f36a4065c80 msgr2=0x7f36a4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- 172.21.15.53:0/3999173127 shutdown_connections 2024-09-13T18:35:09.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- 172.21.15.53:0/3999173127 wait complete. 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 Processor -- start 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- start start 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36a40caee0 0x7f36a415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36a40cd320 0x7f36a40aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a4143e80 0x7f36a4142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a40aac60 con 0x7f36a4143e80 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a40aaf40 con 0x7f36a40caee0 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.799+0000 7f36ab45f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a40ab220 con 0x7f36a40cd320 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a4143e80 0x7f36a4142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a4143e80 0x7f36a4142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54972/0 (socket says 172.21.15.53:54972) 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 -- 172.21.15.53:0/1780038440 learned_addr learned my addr 172.21.15.53:0/1780038440 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a91fb640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36a40caee0 0x7f36a415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 -- 172.21.15.53:0/1780038440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36a40cd320 msgr2=0x7f36a40aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36a40cd320 0x7f36a40aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 -- 172.21.15.53:0/1780038440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36a40caee0 msgr2=0x7f36a415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36a40caee0 0x7f36a415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 -- 172.21.15.53:0/1780038440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009420 con 0x7f36a4143e80 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a99fc640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a4143e80 0x7f36a4142370 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f369c007e40 tx=0x7f369c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f3699ffb640 1 -- 172.21.15.53:0/1780038440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c014620 con 0x7f36a4143e80 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f3699ffb640 1 -- 172.21.15.53:0/1780038440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c00ee90 con 0x7f36a4143e80 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a40ab500 con 0x7f36a4143e80 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f3699ffb640 1 -- 172.21.15.53:0/1780038440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0149e0 con 0x7f36a4143e80 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a4143110 con 0x7f36a4143e80 2024-09-13T18:35:09.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a40cb350 con 0x7f36a4143e80 2024-09-13T18:35:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f3699ffb640 1 -- 172.21.15.53:0/1780038440 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f369c014b40 con 0x7f36a4143e80 2024-09-13T18:35:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f3699ffb640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3688067200 0x7f36880696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a91fb640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3688067200 0x7f36880696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f3699ffb640 1 -- 172.21.15.53:0/1780038440 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f369c083490 con 0x7f36a4143e80 2024-09-13T18:35:09.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.803+0000 7f36a91fb640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3688067200 0x7f36880696c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f36a0000f70 tx=0x7f36a0007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:09.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.807+0000 7f3699ffb640 1 -- 172.21.15.53:0/1780038440 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f369c0522b0 con 0x7f36a4143e80 2024-09-13T18:35:09.958 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.959+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36a40ab9b0 con 0x7f36a4143e80 2024-09-13T18:35:09.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.959+0000 7f3699ffb640 1 -- 172.21.15.53:0/1780038440 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v174) v1 ==== 100+0+11 (secure 0 0 0) 0x7f369c0558d0 con 0x7f36a4143e80 2024-09-13T18:35:09.959 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2024-09-13T18:35:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3688067200 msgr2=0x7f36880696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3688067200 0x7f36880696c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f36a0000f70 tx=0x7f36a0007c10 comp rx=0 tx=0).stop 2024-09-13T18:35:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a4143e80 msgr2=0x7f36a4142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a4143e80 0x7f36a4142370 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f369c007e40 tx=0x7f369c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 shutdown_connections 2024-09-13T18:35:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3688067200 0x7f36880696c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36a40cd320 0x7f36a40aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a4143e80 0x7f36a4142370 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 --2- 172.21.15.53:0/1780038440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36a40caee0 0x7f36a415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 >> 172.21.15.53:0/1780038440 conn(0x7f36a4065c80 msgr2=0x7f36a4155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 shutdown_connections 2024-09-13T18:35:09.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:09.963+0000 7f36ab45f640 1 -- 172.21.15.53:0/1780038440 wait complete. 2024-09-13T18:35:09.977 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:10.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.087+0000 7f0fcf9a4640 1 Processor -- start 2024-09-13T18:35:10.088 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.087+0000 7f0fcf9a4640 1 -- start start 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcf9a4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fc80cb980 0x7f0fc80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcf9a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc806b850 0x7f0fc80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcf9a4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc80b1ac0 con 0x7f0fc80cbd60 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcf9a4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc80b3010 con 0x7f0fc80cb980 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcf9a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8159ac0 con 0x7f0fc806b850 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcd740640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fc80cb980 0x7f0fc80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcd740640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fc80cb980 0x7f0fc80b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54976/0 (socket says 172.21.15.53:54976) 2024-09-13T18:35:10.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcd740640 1 -- 172.21.15.53:0/2619100753 learned_addr learned my addr 172.21.15.53:0/2619100753 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fccf3f640 1 --2- 172.21.15.53:0/2619100753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc806b850 0x7f0fc80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcd740640 1 -- 172.21.15.53:0/2619100753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc806b850 msgr2=0x7f0fc80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcd740640 1 --2- 172.21.15.53:0/2619100753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc806b850 0x7f0fc80cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcd740640 1 -- 172.21.15.53:0/2619100753 >> v1:172.21.15.87:6789/0 conn(0x7f0fc80cbd60 legacy=0x7f0fc806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.091+0000 7f0fcd740640 1 -- 172.21.15.53:0/2619100753 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8159da0 con 0x7f0fc80cb980 2024-09-13T18:35:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 --2- 172.21.15.53:0/2619100753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc80cb980 0x7f0fc80b33b0 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40098a0 tx=0x7f0fc401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da41e53ccf682cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fbbfff640 1 -- 172.21.15.53:0/2619100753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40ab680 con 0x7f0fc80cb980 2024-09-13T18:35:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fbbfff640 1 -- 172.21.15.53:0/2619100753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40ab7e0 con 0x7f0fc80cb980 2024-09-13T18:35:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fbbfff640 1 -- 172.21.15.53:0/2619100753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40abb70 con 0x7f0fc80cb980 2024-09-13T18:35:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/2619100753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc80cb980 msgr2=0x7f0fc80b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/2619100753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc80cb980 0x7f0fc80b33b0 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40098a0 tx=0x7f0fc401c480 comp rx=0 tx=0).stop 2024-09-13T18:35:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/2619100753 shutdown_connections 2024-09-13T18:35:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/2619100753 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc806b850 0x7f0fc80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/2619100753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc80cb980 0x7f0fc80b33b0 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/2619100753 >> 172.21.15.53:0/2619100753 conn(0x7f0fc8065c80 msgr2=0x7f0fc8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/2619100753 shutdown_connections 2024-09-13T18:35:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/2619100753 wait complete. 2024-09-13T18:35:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 Processor -- start 2024-09-13T18:35:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- start start 2024-09-13T18:35:10.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc806b850 0x7f0fc8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fc80cb980 0x7f0fc814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc80cbd60 0x7f0fc81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc814b180 con 0x7f0fc806b850 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc814a8e0 con 0x7f0fc80cb980 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc814abc0 con 0x7f0fc80cbd60 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc806b850 0x7f0fc8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc806b850 0x7f0fc8145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54992/0 (socket says 172.21.15.53:54992) 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 -- 172.21.15.53:0/1714093985 learned_addr learned my addr 172.21.15.53:0/1714093985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fccf3f640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fc80cb980 0x7f0fc814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcdf41640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc80cbd60 0x7f0fc81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 -- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc80cbd60 msgr2=0x7f0fc81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc80cbd60 0x7f0fc81583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 -- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fc80cb980 msgr2=0x7f0fc814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fc80cb980 0x7f0fc814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 -- 172.21.15.53:0/1714093985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40094d0 con 0x7f0fc806b850 2024-09-13T18:35:10.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcd740640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc806b850 0x7f0fc8145a50 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40ad040 tx=0x7f0fc401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fb9ffb640 1 -- 172.21.15.53:0/1714093985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40b4800 con 0x7f0fc806b850 2024-09-13T18:35:10.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fb9ffb640 1 -- 172.21.15.53:0/1714093985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40b4980 con 0x7f0fc806b850 2024-09-13T18:35:10.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc814aea0 con 0x7f0fc806b850 2024-09-13T18:35:10.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fb9ffb640 1 -- 172.21.15.53:0/1714093985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40b4d30 con 0x7f0fc806b850 2024-09-13T18:35:10.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.095+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc814c970 con 0x7f0fc806b850 2024-09-13T18:35:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.099+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc8067400 con 0x7f0fc806b850 2024-09-13T18:35:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.099+0000 7f0fb9ffb640 1 -- 172.21.15.53:0/1714093985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f0fc40b3380 con 0x7f0fc806b850 2024-09-13T18:35:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.099+0000 7f0fb9ffb640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0fac0671d0 0x7f0fac069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.099+0000 7f0fb9ffb640 1 -- 172.21.15.53:0/1714093985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fc411d530 con 0x7f0fc806b850 2024-09-13T18:35:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.099+0000 7f0fccf3f640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0fac0671d0 0x7f0fac069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.099+0000 7f0fccf3f640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0fac0671d0 0x7f0fac069690 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0fc81485f0 tx=0x7f0fbc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.103+0000 7f0fb9ffb640 1 -- 172.21.15.53:0/1714093985 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0fc40ec400 con 0x7f0fc806b850 2024-09-13T18:35:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.295+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fc814ad00 con 0x7f0fc806b850 2024-09-13T18:35:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.295+0000 7f0fb9ffb640 1 -- 172.21.15.53:0/1714093985 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4745 (secure 0 0 0) 0x7f0fc814ad00 con 0x7f0fc806b850 2024-09-13T18:35:10.295 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:10.295 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":105,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/481869316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":481869316},{"type":"v1","addr":"172.21.15.87:6833","nonce":481869316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4120395616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4120395616},{"type":"v1","addr":"172.21.15.87:6835","nonce":4120395616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1960885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1960885675},{"type":"v1","addr":"172.21.15.53:6833","nonce":1960885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:34:43.533426+0000","modified":"2024-09-13T18:34:46.545788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1295090105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1295090105},{"type":"v1","addr":"172.21.15.53:6835","nonce":1295090105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":13}]} 2024-09-13T18:35:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 105 2024-09-13T18:35:10.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0fac0671d0 msgr2=0x7f0fac069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0fac0671d0 0x7f0fac069690 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0fc81485f0 tx=0x7f0fbc008040 comp rx=0 tx=0).stop 2024-09-13T18:35:10.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc806b850 msgr2=0x7f0fc8145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc806b850 0x7f0fc8145a50 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40ad040 tx=0x7f0fc401acc0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 shutdown_connections 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0fac0671d0 0x7f0fac069690 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0fc80cbd60 0x7f0fc81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0fc80cb980 0x7f0fc814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 --2- 172.21.15.53:0/1714093985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fc806b850 0x7f0fc8145a50 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 >> 172.21.15.53:0/1714093985 conn(0x7f0fc8065c80 msgr2=0x7f0fc80ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 shutdown_connections 2024-09-13T18:35:10.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.299+0000 7f0fcf9a4640 1 -- 172.21.15.53:0/1714093985 wait complete. 2024-09-13T18:35:10.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:10.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8894121640 1 Processor -- start 2024-09-13T18:35:10.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8894121640 1 -- start start 2024-09-13T18:35:10.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8894121640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 0x7f888c1675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8894121640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c160a70 con 0x7f888c0b1650 2024-09-13T18:35:10.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8894121640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c160d50 con 0x7f888c15c840 2024-09-13T18:35:10.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8894121640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0cdd80 con 0x7f888c0b4e50 2024-09-13T18:35:10.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f888c0b1650 0x7f888c0b4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42322/0 (socket says 172.21.15.53:42322) 2024-09-13T18:35:10.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 -- 172.21.15.53:0/1495919595 learned_addr learned my addr 172.21.15.53:0/1495919595 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:10.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674440689 0 0) 0x7f888c160a70 con 0x7f888c0b1650 2024-09-13T18:35:10.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88926be640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 0x7f888c1675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8878003530 con 0x7f888c0b1650 2024-09-13T18:35:10.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1911566921 0 0) 0x7f8878003530 con 0x7f888c0b1650 2024-09-13T18:35:10.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 msgr2=0x7f888c1675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:10.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 0x7f888c1675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 >> v1:172.21.15.87:6789/0 conn(0x7f888c15c840 legacy=0x7f888c160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c161030 con 0x7f888c0b1650 2024-09-13T18:35:10.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f887c001680 con 0x7f888c0b1650 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 >> v1:172.21.15.53:6789/0 conn(0x7f888c0b1650 legacy=0x7f888c0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780039b0 0x7f8878003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 0x7f88780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0cdd80 con 0x7f88780047d0 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887800baf0 con 0x7f88780039b0 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887800bcb0 con 0x7f888c0b4e50 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8891ebd640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780039b0 0x7f8878003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88926be640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 0x7f88780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 -- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 msgr2=0x7f88780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:10.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0b4e50 0x7f88780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 -- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780039b0 msgr2=0x7f8878003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:10.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780039b0 0x7f8878003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f88916bc640 1 -- 172.21.15.53:0/1495919595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878003530 con 0x7f88780047d0 2024-09-13T18:35:10.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.435+0000 7f8891ebd640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780039b0 0x7f8878003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:10.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f88916bc640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88780047d0 0x7f8878004c50 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c240 tx=0x7f887c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523d5f38ad78cac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c005ae0 con 0x7f88780047d0 2024-09-13T18:35:10.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c0ab070 con 0x7f88780047d0 2024-09-13T18:35:10.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8890ebb640 1 -- 172.21.15.53:0/1495919595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c005e80 con 0x7f88780047d0 2024-09-13T18:35:10.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 -- 172.21.15.53:0/1495919595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88780047d0 msgr2=0x7f8878004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 --2- 172.21.15.53:0/1495919595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88780047d0 0x7f8878004c50 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c240 tx=0x7f887c01f3d0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f88926be640 1 -- 172.21.15.53:0/1495919595 reap_dead start 2024-09-13T18:35:10.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 -- 172.21.15.53:0/1495919595 shutdown_connections 2024-09-13T18:35:10.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 -- 172.21.15.53:0/1495919595 >> 172.21.15.53:0/1495919595 conn(0x7f888c066080 msgr2=0x7f888c066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:10.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 -- 172.21.15.53:0/1495919595 shutdown_connections 2024-09-13T18:35:10.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 -- 172.21.15.53:0/1495919595 wait complete. 2024-09-13T18:35:10.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 Processor -- start 2024-09-13T18:35:10.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.439+0000 7f8894121640 1 -- start start 2024-09-13T18:35:10.457 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780047d0 0x7f888c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0cc060 0x7f888c0cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c147b70 0x7f888c147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c15f630 con 0x7f888c147b70 2024-09-13T18:35:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c148510 con 0x7f88780047d0 2024-09-13T18:35:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c15e050 con 0x7f888c0cc060 2024-09-13T18:35:10.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c147b70 0x7f888c147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c147b70 0x7f888c147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55006/0 (socket says 172.21.15.53:55006) 2024-09-13T18:35:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 -- 172.21.15.53:0/2769202440 learned_addr learned my addr 172.21.15.53:0/2769202440 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8891ebd640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780047d0 0x7f888c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88916bc640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0cc060 0x7f888c0cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 -- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0cc060 msgr2=0x7f888c0cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0cc060 0x7f888c0cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 -- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780047d0 msgr2=0x7f888c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780047d0 0x7f888c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 -- 172.21.15.53:0/2769202440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c15e330 con 0x7f888c147b70 2024-09-13T18:35:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8891ebd640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780047d0 0x7f888c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:10.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88926be640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c147b70 0x7f888c147fd0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f888c070830 tx=0x7f8884009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88827fc640 1 -- 172.21.15.53:0/2769202440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884007cf0 con 0x7f888c147b70 2024-09-13T18:35:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88827fc640 1 -- 172.21.15.53:0/2769202440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888400f050 con 0x7f888c147b70 2024-09-13T18:35:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c15e610 con 0x7f888c147b70 2024-09-13T18:35:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88827fc640 1 -- 172.21.15.53:0/2769202440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884014650 con 0x7f888c147b70 2024-09-13T18:35:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c15ebd0 con 0x7f888c147b70 2024-09-13T18:35:10.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c160a70 con 0x7f888c147b70 2024-09-13T18:35:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88827fc640 1 -- 172.21.15.53:0/2769202440 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f88840147b0 con 0x7f888c147b70 2024-09-13T18:35:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88827fc640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88700671d0 0x7f8870069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f88827fc640 1 -- 172.21.15.53:0/2769202440 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8884083050 con 0x7f888c147b70 2024-09-13T18:35:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8891ebd640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88700671d0 0x7f8870069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.443+0000 7f8891ebd640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88700671d0 0x7f8870069690 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8888003600 tx=0x7f8888009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.462 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.447+0000 7f88827fc640 1 -- 172.21.15.53:0/2769202440 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8884051e10 con 0x7f888c147b70 2024-09-13T18:35:10.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.599+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f888c0b86e0 con 0x7f888c147b70 2024-09-13T18:35:10.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.603+0000 7f88827fc640 1 -- 172.21.15.53:0/2769202440 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f8884055430 con 0x7f888c147b70 2024-09-13T18:35:10.603 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:10.604 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":174,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:44.536440+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88700671d0 msgr2=0x7f8870069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88700671d0 0x7f8870069690 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8888003600 tx=0x7f8888009040 comp rx=0 tx=0).stop 2024-09-13T18:35:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c147b70 msgr2=0x7f888c147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c147b70 0x7f888c147fd0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f888c070830 tx=0x7f8884009d40 comp rx=0 tx=0).stop 2024-09-13T18:35:10.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 shutdown_connections 2024-09-13T18:35:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f88700671d0 0x7f8870069690 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f888c0cc060 0x7f888c0cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c147b70 0x7f888c147fd0 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 --2- 172.21.15.53:0/2769202440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f88780047d0 0x7f888c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 >> 172.21.15.53:0/2769202440 conn(0x7f888c066080 msgr2=0x7f888c0b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 shutdown_connections 2024-09-13T18:35:10.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.607+0000 7f8894121640 1 -- 172.21.15.53:0/2769202440 wait complete. 2024-09-13T18:35:10.621 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:35:10.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.731+0000 7f317af7a640 1 Processor -- start 2024-09-13T18:35:10.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.731+0000 7f317af7a640 1 -- start start 2024-09-13T18:35:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f317415b7c0 0x7f3174070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317406d480 con 0x7f31740711d0 2024-09-13T18:35:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317415ace0 con 0x7f31741582a0 2024-09-13T18:35:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3174071680 con 0x7f317415b7c0 2024-09-13T18:35:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f3173fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f317415b7c0 0x7f3174070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f3179517640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f31740711d0 0x7f31741640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42326/0 (socket says 172.21.15.53:42326) 2024-09-13T18:35:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f3179517640 1 -- 172.21.15.53:0/2618711719 learned_addr learned my addr 172.21.15.53:0/2618711719 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f3173fff640 1 -- 172.21.15.53:0/2618711719 >> v1:172.21.15.87:6789/0 conn(0x7f31741582a0 legacy=0x7f317406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f3173fff640 1 -- 172.21.15.53:0/2618711719 >> v1:172.21.15.53:6789/0 conn(0x7f31740711d0 legacy=0x7f31741640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f3173fff640 1 -- 172.21.15.53:0/2618711719 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317415afc0 con 0x7f317415b7c0 2024-09-13T18:35:10.734 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f31737fe640 1 -- 172.21.15.53:0/2618711719 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718339055 0 0) 0x7f317406d480 con 0x7f31740711d0 2024-09-13T18:35:10.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f3173fff640 1 --2- 172.21.15.53:0/2618711719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f3174070c90 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f31680097c0 tx=0x7f316801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee14e9c105ad1b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f31737fe640 1 -- 172.21.15.53:0/2618711719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680ab600 con 0x7f317415b7c0 2024-09-13T18:35:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f31737fe640 1 -- 172.21.15.53:0/2618711719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31680a7050 con 0x7f317415b7c0 2024-09-13T18:35:10.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f31737fe640 1 -- 172.21.15.53:0/2618711719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31680ab980 con 0x7f317415b7c0 2024-09-13T18:35:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- 172.21.15.53:0/2618711719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 msgr2=0x7f3174070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 --2- 172.21.15.53:0/2618711719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f3174070c90 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f31680097c0 tx=0x7f316801c4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- 172.21.15.53:0/2618711719 shutdown_connections 2024-09-13T18:35:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 --2- 172.21.15.53:0/2618711719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f3174070c90 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- 172.21.15.53:0/2618711719 >> 172.21.15.53:0/2618711719 conn(0x7f3174065c80 msgr2=0x7f3174066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- 172.21.15.53:0/2618711719 shutdown_connections 2024-09-13T18:35:10.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.735+0000 7f317af7a640 1 -- 172.21.15.53:0/2618711719 wait complete. 2024-09-13T18:35:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 Processor -- start 2024-09-13T18:35:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 -- start start 2024-09-13T18:35:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31740711d0 0x7f3174139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31741582a0 0x7f31741506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f31740cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174150bf0 con 0x7f317415b7c0 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174137750 con 0x7f31741582a0 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317413a9a0 con 0x7f31740711d0 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f31740cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f31740cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55014/0 (socket says 172.21.15.53:55014) 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 -- 172.21.15.53:0/1845216249 learned_addr learned my addr 172.21.15.53:0/1845216249 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3173fff640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31741582a0 0x7f31741506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3178d16640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31740711d0 0x7f3174139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 -- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31740711d0 msgr2=0x7f3174139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31740711d0 0x7f3174139a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 -- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31741582a0 msgr2=0x7f31741506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31741582a0 0x7f31741506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 -- 172.21.15.53:0/1845216249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3168009420 con 0x7f317415b7c0 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f3179517640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f31740cc650 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c7d0 tx=0x7f316c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f31717fa640 1 -- 172.21.15.53:0/1845216249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00a640 con 0x7f317415b7c0 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f31717fa640 1 -- 172.21.15.53:0/1845216249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c00a7a0 con 0x7f317415b7c0 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f31717fa640 1 -- 172.21.15.53:0/1845216249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00ab90 con 0x7f317415b7c0 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3174137ba0 con 0x7f317415b7c0 2024-09-13T18:35:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317413a3e0 con 0x7f317415b7c0 2024-09-13T18:35:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3174067400 con 0x7f317415b7c0 2024-09-13T18:35:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.739+0000 7f31717fa640 1 -- 172.21.15.53:0/1845216249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f316c00acf0 con 0x7f317415b7c0 2024-09-13T18:35:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.743+0000 7f31717fa640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3160067200 0x7f31600696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.743+0000 7f31717fa640 1 -- 172.21.15.53:0/1845216249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f316c082180 con 0x7f317415b7c0 2024-09-13T18:35:10.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.743+0000 7f3178d16640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3160067200 0x7f31600696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:10.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.743+0000 7f3178d16640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3160067200 0x7f31600696c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3164000f70 tx=0x7f3164009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:10.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.747+0000 7f31717fa640 1 -- 172.21.15.53:0/1845216249 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f316c050d50 con 0x7f317415b7c0 2024-09-13T18:35:10.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.931+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3174137d30 con 0x7f317415b7c0 2024-09-13T18:35:10.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.931+0000 7f31717fa640 1 -- 172.21.15.53:0/1845216249 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4745 (secure 0 0 0) 0x7f316c018020 con 0x7f317415b7c0 2024-09-13T18:35:10.932 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:10.932 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":105,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/481869316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":481869316},{"type":"v1","addr":"172.21.15.87:6833","nonce":481869316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4120395616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4120395616},{"type":"v1","addr":"172.21.15.87:6835","nonce":4120395616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1960885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1960885675},{"type":"v1","addr":"172.21.15.53:6833","nonce":1960885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:34:43.533426+0000","modified":"2024-09-13T18:34:46.545788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1295090105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1295090105},{"type":"v1","addr":"172.21.15.53:6835","nonce":1295090105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":13}]} 2024-09-13T18:35:10.932 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 105 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3160067200 msgr2=0x7f31600696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3160067200 0x7f31600696c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3164000f70 tx=0x7f3164009040 comp rx=0 tx=0).stop 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 msgr2=0x7f31740cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f31740cc650 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c7d0 tx=0x7f316c00cc90 comp rx=0 tx=0).stop 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 shutdown_connections 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f3160067200 0x7f31600696c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317415b7c0 0x7f31740cc650 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31741582a0 0x7f31741506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 --2- 172.21.15.53:0/1845216249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31740711d0 0x7f3174139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:10.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 >> 172.21.15.53:0/1845216249 conn(0x7f3174065c80 msgr2=0x7f3174066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:10.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 shutdown_connections 2024-09-13T18:35:10.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:10.935+0000 7f317af7a640 1 -- 172.21.15.53:0/1845216249 wait complete. 2024-09-13T18:35:10.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:11.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.063+0000 7f7d142b0640 1 Processor -- start 2024-09-13T18:35:11.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.063+0000 7f7d142b0640 1 -- start start 2024-09-13T18:35:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d142b0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d142b0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d0c0cbd60 0x7f7d0c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d142b0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0b1ac0 con 0x7f7d0c06b850 2024-09-13T18:35:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d142b0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0b3010 con 0x7f7d0c0cbd60 2024-09-13T18:35:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d142b0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c159ac0 con 0x7f7d0c0cb980 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1204c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1204c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:44150/0 (socket says 172.21.15.53:44150) 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1204c640 1 -- 172.21.15.53:0/3844469442 learned_addr learned my addr 172.21.15.53:0/3844469442 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1284d640 1 --2- 172.21.15.53:0/3844469442 >> v2:172.21.15.87:3300/0 conn(0x7f7d0c0cbd60 0x7f7d0c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1204c640 1 -- 172.21.15.53:0/3844469442 >> v2:172.21.15.87:3300/0 conn(0x7f7d0c0cbd60 msgr2=0x7f7d0c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1204c640 1 --2- 172.21.15.53:0/3844469442 >> v2:172.21.15.87:3300/0 conn(0x7f7d0c0cbd60 0x7f7d0c0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1204c640 1 -- 172.21.15.53:0/3844469442 >> v1:172.21.15.87:6789/0 conn(0x7f7d0c06b850 legacy=0x7f7d0c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.067+0000 7f7d1204c640 1 -- 172.21.15.53:0/3844469442 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c159da0 con 0x7f7d0c0cb980 2024-09-13T18:35:11.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 --2- 172.21.15.53:0/3844469442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c0b33b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d080098a0 tx=0x7f7d0801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8cb17df584890 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1104a640 1 -- 172.21.15.53:0/3844469442 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080ab680 con 0x7f7d0c0cb980 2024-09-13T18:35:11.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1104a640 1 -- 172.21.15.53:0/3844469442 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d080ab7e0 con 0x7f7d0c0cb980 2024-09-13T18:35:11.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1104a640 1 -- 172.21.15.53:0/3844469442 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080abb70 con 0x7f7d0c0cb980 2024-09-13T18:35:11.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- 172.21.15.53:0/3844469442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 msgr2=0x7f7d0c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3844469442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c0b33b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d080098a0 tx=0x7f7d0801c480 comp rx=0 tx=0).stop 2024-09-13T18:35:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- 172.21.15.53:0/3844469442 shutdown_connections 2024-09-13T18:35:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3844469442 >> v2:172.21.15.87:3300/0 conn(0x7f7d0c0cbd60 0x7f7d0c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3844469442 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c0b33b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- 172.21.15.53:0/3844469442 >> 172.21.15.53:0/3844469442 conn(0x7f7d0c065c80 msgr2=0x7f7d0c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- 172.21.15.53:0/3844469442 shutdown_connections 2024-09-13T18:35:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- 172.21.15.53:0/3844469442 wait complete. 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 Processor -- start 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- start start 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d0c06b850 0x7f7d0c1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c0cbd60 0x7f7d0c15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1501b0 con 0x7f7d0c06b850 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1f5c40 con 0x7f7d0c0cbd60 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d142b0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c14f5a0 con 0x7f7d0c0cb980 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d0c06b850 0x7f7d0c1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d0c06b850 0x7f7d0c1f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55020/0 (socket says 172.21.15.53:55020) 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 -- 172.21.15.53:0/3581371004 learned_addr learned my addr 172.21.15.53:0/3581371004 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1184b640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1284d640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c0cbd60 0x7f7d0c15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 -- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 msgr2=0x7f7d0c14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 -- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c0cbd60 msgr2=0x7f7d0c15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c0cbd60 0x7f7d0c15b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 -- 172.21.15.53:0/3581371004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080094d0 con 0x7f7d0c06b850 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1184b640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d1204c640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d0c06b850 0x7f7d0c1f5700 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f7d080ad040 tx=0x7f7d0801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d02ffd640 1 -- 172.21.15.53:0/3581371004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080be5f0 con 0x7f7d0c06b850 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d02ffd640 1 -- 172.21.15.53:0/3581371004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d080be750 con 0x7f7d0c06b850 2024-09-13T18:35:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.071+0000 7f7d02ffd640 1 -- 172.21.15.53:0/3581371004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080beb00 con 0x7f7d0c06b850 2024-09-13T18:35:11.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c14f880 con 0x7f7d0c06b850 2024-09-13T18:35:11.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c14fe40 con 0x7f7d0c06b850 2024-09-13T18:35:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c067400 con 0x7f7d0c06b850 2024-09-13T18:35:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d02ffd640 1 -- 172.21.15.53:0/3581371004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f7d080b43f0 con 0x7f7d0c06b850 2024-09-13T18:35:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d02ffd640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cf00671d0 0x7f7cf0069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d02ffd640 1 -- 172.21.15.53:0/3581371004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d0811e500 con 0x7f7d0c06b850 2024-09-13T18:35:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d1184b640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cf00671d0 0x7f7cf0069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.075+0000 7f7d1184b640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cf00671d0 0x7f7cf0069690 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c15c410 tx=0x7f7cfc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.079+0000 7f7d02ffd640 1 -- 172.21.15.53:0/3581371004 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d080ed300 con 0x7f7d0c06b850 2024-09-13T18:35:11.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d0c0b2ba0 con 0x7f7d0c06b850 2024-09-13T18:35:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d02ffd640 1 -- 172.21.15.53:0/3581371004 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4745 (secure 0 0 0) 0x7f7d080f0920 con 0x7f7d0c06b850 2024-09-13T18:35:11.270 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:11.270 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":105,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/481869316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":481869316},{"type":"v1","addr":"172.21.15.87:6833","nonce":481869316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4120395616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4120395616},{"type":"v1","addr":"172.21.15.87:6835","nonce":4120395616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1960885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1960885675},{"type":"v1","addr":"172.21.15.53:6833","nonce":1960885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:34:43.533426+0000","modified":"2024-09-13T18:34:46.545788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10503":{"gid":10503,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1295090105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1295090105},{"type":"v1","addr":"172.21.15.53:6835","nonce":1295090105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":13}]} 2024-09-13T18:35:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 105 2024-09-13T18:35:11.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cf00671d0 msgr2=0x7f7cf0069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cf00671d0 0x7f7cf0069690 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c15c410 tx=0x7f7cfc009040 comp rx=0 tx=0).stop 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d0c06b850 msgr2=0x7f7d0c1f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d0c06b850 0x7f7d0c1f5700 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f7d080ad040 tx=0x7f7d0801acc0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 shutdown_connections 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f7cf00671d0 0x7f7cf0069690 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d0c0cb980 0x7f7d0c14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d0c0cbd60 0x7f7d0c15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 --2- 172.21.15.53:0/3581371004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d0c06b850 0x7f7d0c1f5700 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 >> 172.21.15.53:0/3581371004 conn(0x7f7d0c065c80 msgr2=0x7f7d0c0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 shutdown_connections 2024-09-13T18:35:11.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.271+0000 7f7d142b0640 1 -- 172.21.15.53:0/3581371004 wait complete. 2024-09-13T18:35:11.288 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:11.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.415+0000 7f1102cdc640 1 Processor -- start 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.415+0000 7f1102cdc640 1 -- start start 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10fc0713a0 0x7f10fc06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc06d480 con 0x7f10fc15b7c0 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc15aaf0 con 0x7f10fc0713a0 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc06d760 con 0x7f10fc1582a0 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1101279640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10fc0713a0 0x7f10fc06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f10fbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f10fc15b7c0 0x7f10fc070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42332/0 (socket says 172.21.15.53:42332) 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f10fbfff640 1 -- 172.21.15.53:0/2744725236 learned_addr learned my addr 172.21.15.53:0/2744725236 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1100a78640 1 --2- 172.21.15.53:0/2744725236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1101279640 1 -- 172.21.15.53:0/2744725236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 msgr2=0x7f10fc06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1101279640 1 --2- 172.21.15.53:0/2744725236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1101279640 1 -- 172.21.15.53:0/2744725236 >> v1:172.21.15.53:6789/0 conn(0x7f10fc15b7c0 legacy=0x7f10fc070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1101279640 1 -- 172.21.15.53:0/2744725236 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc15ace0 con 0x7f10fc0713a0 2024-09-13T18:35:11.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1101279640 1 --2- 172.21.15.53:0/2744725236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc0713a0 0x7f10fc06ce40 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009d90 tx=0x7f10f401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18fcf672ab71038 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f10fb7fe640 1 -- 172.21.15.53:0/2744725236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40a5a00 con 0x7f10fc0713a0 2024-09-13T18:35:11.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f10fb7fe640 1 -- 172.21.15.53:0/2744725236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f40a5b60 con 0x7f10fc0713a0 2024-09-13T18:35:11.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f10fb7fe640 1 -- 172.21.15.53:0/2744725236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40ad440 con 0x7f10fc0713a0 2024-09-13T18:35:11.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- 172.21.15.53:0/2744725236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc0713a0 msgr2=0x7f10fc06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 --2- 172.21.15.53:0/2744725236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc0713a0 0x7f10fc06ce40 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009d90 tx=0x7f10f401c940 comp rx=0 tx=0).stop 2024-09-13T18:35:11.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- 172.21.15.53:0/2744725236 shutdown_connections 2024-09-13T18:35:11.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 --2- 172.21.15.53:0/2744725236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc0713a0 0x7f10fc06ce40 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 --2- 172.21.15.53:0/2744725236 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- 172.21.15.53:0/2744725236 >> 172.21.15.53:0/2744725236 conn(0x7f10fc065c80 msgr2=0x7f10fc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- 172.21.15.53:0/2744725236 shutdown_connections 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.419+0000 7f1102cdc640 1 -- 172.21.15.53:0/2744725236 wait complete. 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 Processor -- start 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 -- start start 2024-09-13T18:35:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10fc0713a0 0x7f10fc14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc15b7c0 0x7f10fc0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0b2fb0 con 0x7f10fc15b7c0 2024-09-13T18:35:11.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc150770 con 0x7f10fc0713a0 2024-09-13T18:35:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc150a50 con 0x7f10fc1582a0 2024-09-13T18:35:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc15b7c0 0x7f10fc0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc15b7c0 0x7f10fc0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55032/0 (socket says 172.21.15.53:55032) 2024-09-13T18:35:11.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 -- 172.21.15.53:0/4236899487 learned_addr learned my addr 172.21.15.53:0/4236899487 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f10fbfff640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1100a78640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10fc0713a0 0x7f10fc14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 -- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 msgr2=0x7f10fc1518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc1518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 -- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10fc0713a0 msgr2=0x7f10fc14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10fc0713a0 0x7f10fc14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 -- 172.21.15.53:0/4236899487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4009a70 con 0x7f10fc15b7c0 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1101279640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc15b7c0 0x7f10fc0cc270 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f10f40b0040 tx=0x7f10f40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f10f97fa640 1 -- 172.21.15.53:0/4236899487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40ade40 con 0x7f10fc15b7c0 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f10f97fa640 1 -- 172.21.15.53:0/4236899487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4009450 con 0x7f10fc15b7c0 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc150d30 con 0x7f10fc15b7c0 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f10f97fa640 1 -- 172.21.15.53:0/4236899487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40b9690 con 0x7f10fc15b7c0 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc150440 con 0x7f10fc15b7c0 2024-09-13T18:35:11.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.423+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc067400 con 0x7f10fc15b7c0 2024-09-13T18:35:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.427+0000 7f10f97fa640 1 -- 172.21.15.53:0/4236899487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f10f40b97f0 con 0x7f10fc15b7c0 2024-09-13T18:35:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.427+0000 7f10f97fa640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10e80671d0 0x7f10e8069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.427+0000 7f10f97fa640 1 -- 172.21.15.53:0/4236899487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10f411e3f0 con 0x7f10fc15b7c0 2024-09-13T18:35:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.427+0000 7f1100a78640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10e80671d0 0x7f10e8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.427+0000 7f1100a78640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10e80671d0 0x7f10e8069690 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0ae290 tx=0x7f10ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.431+0000 7f10f97fa640 1 -- 172.21.15.53:0/4236899487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10f40ed1b0 con 0x7f10fc15b7c0 2024-09-13T18:35:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.587+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10fc06b910 con 0x7f10fc15b7c0 2024-09-13T18:35:11.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.587+0000 7f10f97fa640 1 -- 172.21.15.53:0/4236899487 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f10f40f07d0 con 0x7f10fc15b7c0 2024-09-13T18:35:11.587 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:11.587 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":174,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:34:44.536440+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:34:41.929723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-13T18:34:42.513600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:11.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10e80671d0 msgr2=0x7f10e8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10e80671d0 0x7f10e8069690 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0ae290 tx=0x7f10ec008040 comp rx=0 tx=0).stop 2024-09-13T18:35:11.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc15b7c0 msgr2=0x7f10fc0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc15b7c0 0x7f10fc0cc270 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f10f40b0040 tx=0x7f10f40196e0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 shutdown_connections 2024-09-13T18:35:11.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f10e80671d0 0x7f10e8069690 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10fc1582a0 0x7f10fc1518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10fc15b7c0 0x7f10fc0cc270 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 --2- 172.21.15.53:0/4236899487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10fc0713a0 0x7f10fc14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 >> 172.21.15.53:0/4236899487 conn(0x7f10fc065c80 msgr2=0x7f10fc066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 shutdown_connections 2024-09-13T18:35:11.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.591+0000 7f1102cdc640 1 -- 172.21.15.53:0/4236899487 wait complete. 2024-09-13T18:35:11.606 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:35:11.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a458a640 1 Processor -- start 2024-09-13T18:35:11.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a458a640 1 -- start start 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a458a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f629c0cb980 0x7f629c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a458a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0b1ac0 con 0x7f629c06b850 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a458a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c159ac0 con 0x7f629c0cbd60 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a458a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c159da0 con 0x7f629c0cb980 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a2326640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f629c0cb980 0x7f629c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a1b25640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f629c06b850 0x7f629c06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42336/0 (socket says 172.21.15.53:42336) 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a2326640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f629c0cb980 0x7f629c0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55040/0 (socket says 172.21.15.53:55040) 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a1b25640 1 -- 172.21.15.53:0/2348389399 learned_addr learned my addr 172.21.15.53:0/2348389399 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a2326640 1 -- 172.21.15.53:0/2348389399 >> v1:172.21.15.87:6789/0 conn(0x7f629c0cbd60 legacy=0x7f629c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:11.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a2326640 1 -- 172.21.15.53:0/2348389399 >> v1:172.21.15.53:6789/0 conn(0x7f629c06b850 legacy=0x7f629c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a1324640 1 -- 172.21.15.53:0/2348389399 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000260771 0 0) 0x7f629c0b1ac0 con 0x7f629c06b850 2024-09-13T18:35:11.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.719+0000 7f62a2326640 1 -- 172.21.15.53:0/2348389399 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c15a080 con 0x7f629c0cb980 2024-09-13T18:35:11.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a2326640 1 --2- 172.21.15.53:0/2348389399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c0b33b0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f62980097c0 tx=0x7f629801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45d7827f785005b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a1324640 1 -- 172.21.15.53:0/2348389399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62980ac600 con 0x7f629c0cb980 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a1324640 1 -- 172.21.15.53:0/2348389399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62980a8050 con 0x7f629c0cb980 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a1324640 1 -- 172.21.15.53:0/2348389399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62980ac980 con 0x7f629c0cb980 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 -- 172.21.15.53:0/2348389399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 msgr2=0x7f629c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 --2- 172.21.15.53:0/2348389399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c0b33b0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f62980097c0 tx=0x7f629801c3a0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 -- 172.21.15.53:0/2348389399 shutdown_connections 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 --2- 172.21.15.53:0/2348389399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c0b33b0 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 -- 172.21.15.53:0/2348389399 >> 172.21.15.53:0/2348389399 conn(0x7f629c065c80 msgr2=0x7f629c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 -- 172.21.15.53:0/2348389399 shutdown_connections 2024-09-13T18:35:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 -- 172.21.15.53:0/2348389399 wait complete. 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 Processor -- start 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.723+0000 7f62a458a640 1 -- start start 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f629c06b850 0x7f629c146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f629c0cbd60 0x7f629c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c145d40 con 0x7f629c0cb980 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c1453c0 con 0x7f629c0cbd60 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c14ab90 con 0x7f629c06b850 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55042/0 (socket says 172.21.15.53:55042) 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 -- 172.21.15.53:0/3182024953 learned_addr learned my addr 172.21.15.53:0/3182024953 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a2b27640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f629c0cbd60 0x7f629c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 -- 172.21.15.53:0/3182024953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f629c06b850 msgr2=0x7f629c146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f629c06b850 0x7f629c146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 -- 172.21.15.53:0/3182024953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f629c0cbd60 msgr2=0x7f629c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f629c0cbd60 0x7f629c0ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 -- 172.21.15.53:0/3182024953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298009420 con 0x7f629c0cb980 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a1b25640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c144860 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c4b0 tx=0x7f628c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f6292ffd640 1 -- 172.21.15.53:0/3182024953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0074e0 con 0x7f629c0cb980 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f6292ffd640 1 -- 172.21.15.53:0/3182024953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c007660 con 0x7f629c0cb980 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c14a8b0 con 0x7f629c0cb980 2024-09-13T18:35:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f6292ffd640 1 -- 172.21.15.53:0/3182024953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c004a30 con 0x7f629c0cb980 2024-09-13T18:35:11.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c145960 con 0x7f629c0cb980 2024-09-13T18:35:11.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c067400 con 0x7f629c0cb980 2024-09-13T18:35:11.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f6292ffd640 1 -- 172.21.15.53:0/3182024953 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f628c004b90 con 0x7f629c0cb980 2024-09-13T18:35:11.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f6292ffd640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62800671d0 0x7f6280069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f6292ffd640 1 -- 172.21.15.53:0/3182024953 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f628c0821b0 con 0x7f629c0cb980 2024-09-13T18:35:11.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a2326640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62800671d0 0x7f6280069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.727+0000 7f62a2326640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62800671d0 0x7f6280069690 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f62980ae000 tx=0x7f6298008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.731+0000 7f6292ffd640 1 -- 172.21.15.53:0/3182024953 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f628c054810 con 0x7f629c0cb980 2024-09-13T18:35:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.919+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f629c145e80 con 0x7f629c0cb980 2024-09-13T18:35:11.918 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-09-13T18:35:11.919+0000 7f5e3cbcf640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:35:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f6292ffd640 1 -- 172.21.15.53:0/3182024953 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v106) v1 ==== 161+0+0 (secure 0 0 0) 0x7f629c145e80 con 0x7f629c0cb980 2024-09-13T18:35:11.933 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62800671d0 msgr2=0x7f6280069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62800671d0 0x7f6280069690 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f62980ae000 tx=0x7f6298008040 comp rx=0 tx=0).stop 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 msgr2=0x7f629c144860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c144860 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c4b0 tx=0x7f628c00c970 comp rx=0 tx=0).stop 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 shutdown_connections 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62800671d0 0x7f6280069690 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f629c0cbd60 0x7f629c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f629c0cb980 0x7f629c144860 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 --2- 172.21.15.53:0/3182024953 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f629c06b850 0x7f629c146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 >> 172.21.15.53:0/3182024953 conn(0x7f629c065c80 msgr2=0x7f629c0cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 shutdown_connections 2024-09-13T18:35:11.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:11.935+0000 7f62a458a640 1 -- 172.21.15.53:0/3182024953 wait complete. 2024-09-13T18:35:11.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:35:12.014 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2024-09-13T18:35:12.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d8e35640 1 Processor -- start 2024-09-13T18:35:12.063 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d8e35640 1 -- start start 2024-09-13T18:35:12.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d8e35640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f33d406a4f0 0x7f33d415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d8e35640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f33d415dbe0 0x7f33d4166520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d8e35640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d40d0320 con 0x7f33d406aa60 2024-09-13T18:35:12.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d8e35640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d406b830 con 0x7f33d415dbe0 2024-09-13T18:35:12.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d8e35640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d40d13c0 con 0x7f33d406a4f0 2024-09-13T18:35:12.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f33d406aa60 0x7f33d406ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42366/0 (socket says 172.21.15.53:42366) 2024-09-13T18:35:12.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d259c640 1 -- 172.21.15.53:0/3525839864 learned_addr learned my addr 172.21.15.53:0/3525839864 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:12.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d2d9d640 1 --2- 172.21.15.53:0/3525839864 >> v2:172.21.15.53:3300/0 conn(0x7f33d415dbe0 0x7f33d4166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d159a640 1 -- 172.21.15.53:0/3525839864 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875889024 0 0) 0x7f33d40d0320 con 0x7f33d406aa60 2024-09-13T18:35:12.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d159a640 1 -- 172.21.15.53:0/3525839864 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33bc003530 con 0x7f33d406aa60 2024-09-13T18:35:12.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d1d9b640 1 --2- 172.21.15.53:0/3525839864 >> v2:172.21.15.87:3300/0 conn(0x7f33d406a4f0 0x7f33d415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d159a640 1 -- 172.21.15.53:0/3525839864 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2557970691 0 0) 0x7f33bc003530 con 0x7f33d406aa60 2024-09-13T18:35:12.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d2d9d640 1 -- 172.21.15.53:0/3525839864 >> v2:172.21.15.87:3300/0 conn(0x7f33d406a4f0 msgr2=0x7f33d415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:12.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d2d9d640 1 --2- 172.21.15.53:0/3525839864 >> v2:172.21.15.87:3300/0 conn(0x7f33d406a4f0 0x7f33d415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d2d9d640 1 -- 172.21.15.53:0/3525839864 >> v1:172.21.15.53:6789/0 conn(0x7f33d406aa60 legacy=0x7f33d406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.063+0000 7f33d2d9d640 1 -- 172.21.15.53:0/3525839864 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d40d0600 con 0x7f33d415dbe0 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d2d9d640 1 --2- 172.21.15.53:0/3525839864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d415dbe0 0x7f33d4166520 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f33d40b2220 tx=0x7f33cc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd19459b37f5fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d159a640 1 -- 172.21.15.53:0/3525839864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4001680 con 0x7f33d415dbe0 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d159a640 1 -- 172.21.15.53:0/3525839864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc0a8430 con 0x7f33d415dbe0 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d159a640 1 -- 172.21.15.53:0/3525839864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0a87a0 con 0x7f33d415dbe0 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- 172.21.15.53:0/3525839864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d415dbe0 msgr2=0x7f33d4166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 --2- 172.21.15.53:0/3525839864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d415dbe0 0x7f33d4166520 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f33d40b2220 tx=0x7f33cc01c850 comp rx=0 tx=0).stop 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- 172.21.15.53:0/3525839864 shutdown_connections 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 --2- 172.21.15.53:0/3525839864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d415dbe0 0x7f33d4166520 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 --2- 172.21.15.53:0/3525839864 >> v2:172.21.15.87:3300/0 conn(0x7f33d406a4f0 0x7f33d415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- 172.21.15.53:0/3525839864 >> 172.21.15.53:0/3525839864 conn(0x7f33d4071a70 msgr2=0x7f33d4099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- 172.21.15.53:0/3525839864 shutdown_connections 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- 172.21.15.53:0/3525839864 wait complete. 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 Processor -- start 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- start start 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33d406a4f0 0x7f33d4149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d406aa60 0x7f33d4150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33d415dbe0 0x7f33d41598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d414a450 con 0x7f33d406aa60 2024-09-13T18:35:12.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4154320 con 0x7f33d415dbe0 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.067+0000 7f33d8e35640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4154600 con 0x7f33d406a4f0 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d406aa60 0x7f33d4150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d406aa60 0x7f33d4150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55072/0 (socket says 172.21.15.53:55072) 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 -- 172.21.15.53:0/384391348 learned_addr learned my addr 172.21.15.53:0/384391348 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d2d9d640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33d415dbe0 0x7f33d41598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 -- 172.21.15.53:0/384391348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33d406a4f0 msgr2=0x7f33d4149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33d406a4f0 0x7f33d4149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 -- 172.21.15.53:0/384391348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33d415dbe0 msgr2=0x7f33d41598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33d415dbe0 0x7f33d41598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 -- 172.21.15.53:0/384391348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc009a70 con 0x7f33d406aa60 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d1d9b640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d406aa60 0x7f33d4150c20 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f33c800e930 tx=0x7f33c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33c2ffd640 1 -- 172.21.15.53:0/384391348 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8009690 con 0x7f33d406aa60 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33c2ffd640 1 -- 172.21.15.53:0/384391348 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c800ca00 con 0x7f33d406aa60 2024-09-13T18:35:12.075 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d41548e0 con 0x7f33d406aa60 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33c2ffd640 1 -- 172.21.15.53:0/384391348 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800cd70 con 0x7f33d406aa60 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d4154ea0 con 0x7f33d406aa60 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d409a180 con 0x7f33d406aa60 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33c2ffd640 1 -- 172.21.15.53:0/384391348 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f33c8013470 con 0x7f33d406aa60 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33c2ffd640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f33b40671d0 0x7f33b4069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33c2ffd640 1 -- 172.21.15.53:0/384391348 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f33c80837e0 con 0x7f33d406aa60 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d259c640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f33b40671d0 0x7f33b4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.071+0000 7f33d259c640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f33b40671d0 0x7f33b4069690 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f33c40011f0 tx=0x7f33c4001a10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.075+0000 7f33c2ffd640 1 -- 172.21.15.53:0/384391348 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33c8052450 con 0x7f33d406aa60 2024-09-13T18:35:12.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.263+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33d40d1500 con 0x7f33d406aa60 2024-09-13T18:35:12.936 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.935+0000 7f33c2ffd640 1 -- 172.21.15.53:0/384391348 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v107) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33c805ae60 con 0x7f33d406aa60 2024-09-13T18:35:12.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f33b40671d0 msgr2=0x7f33b4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f33b40671d0 0x7f33b4069690 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f33c40011f0 tx=0x7f33c4001a10 comp rx=0 tx=0).stop 2024-09-13T18:35:12.939 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d406aa60 msgr2=0x7f33d4150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d406aa60 0x7f33d4150c20 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f33c800e930 tx=0x7f33c800edf0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 shutdown_connections 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f33b40671d0 0x7f33b4069690 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33d415dbe0 0x7f33d41598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33d406aa60 0x7f33d4150c20 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 --2- 172.21.15.53:0/384391348 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f33d406a4f0 0x7f33d4149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 >> 172.21.15.53:0/384391348 conn(0x7f33d4071a70 msgr2=0x7f33d406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 shutdown_connections 2024-09-13T18:35:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:12.939+0000 7f33d8e35640 1 -- 172.21.15.53:0/384391348 wait complete. 2024-09-13T18:35:12.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:35:13.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe1850eb640 1 Processor -- start 2024-09-13T18:35:13.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe1850eb640 1 -- start start 2024-09-13T18:35:13.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe1850eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe1800b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe1850eb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe180071130 0x7fe18015c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe1850eb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1800b1c60 con 0x7fe18014f4f0 2024-09-13T18:35:13.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe1850eb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800b1f40 con 0x7fe180071130 2024-09-13T18:35:13.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe1850eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800b2220 con 0x7fe18015d150 2024-09-13T18:35:13.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe180071130 0x7fe18015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.092 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17f59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe180071130 0x7fe18015c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55084/0 (socket says 172.21.15.53:55084) 2024-09-13T18:35:13.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17f59e640 1 -- 172.21.15.53:0/297220086 learned_addr learned my addr 172.21.15.53:0/297220086 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:13.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17e59c640 1 --2- 172.21.15.53:0/297220086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe1800b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17f59e640 1 -- 172.21.15.53:0/297220086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 msgr2=0x7fe1800b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:13.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17f59e640 1 --2- 172.21.15.53:0/297220086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe1800b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17f59e640 1 -- 172.21.15.53:0/297220086 >> v1:172.21.15.87:6789/0 conn(0x7fe18014f4f0 legacy=0x7fe18014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.091+0000 7fe17f59e640 1 -- 172.21.15.53:0/297220086 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800b2500 con 0x7fe180071130 2024-09-13T18:35:13.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe17f59e640 1 --2- 172.21.15.53:0/297220086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe180071130 0x7fe18015c540 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fe17800d150 tx=0x7fe17801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a80070c4c9ee2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:13.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe17dd9b640 1 -- 172.21.15.53:0/297220086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800b2d0 con 0x7fe180071130 2024-09-13T18:35:13.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe17dd9b640 1 -- 172.21.15.53:0/297220086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17800b430 con 0x7fe180071130 2024-09-13T18:35:13.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe17dd9b640 1 -- 172.21.15.53:0/297220086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780a7c00 con 0x7fe180071130 2024-09-13T18:35:13.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 -- 172.21.15.53:0/297220086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe180071130 msgr2=0x7fe18015c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 --2- 172.21.15.53:0/297220086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe180071130 0x7fe18015c540 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fe17800d150 tx=0x7fe17801ec00 comp rx=0 tx=0).stop 2024-09-13T18:35:13.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 -- 172.21.15.53:0/297220086 shutdown_connections 2024-09-13T18:35:13.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 --2- 172.21.15.53:0/297220086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe180071130 0x7fe18015c540 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 --2- 172.21.15.53:0/297220086 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe1800b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 -- 172.21.15.53:0/297220086 >> 172.21.15.53:0/297220086 conn(0x7fe180073330 msgr2=0x7fe180065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:13.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 -- 172.21.15.53:0/297220086 shutdown_connections 2024-09-13T18:35:13.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 -- 172.21.15.53:0/297220086 wait complete. 2024-09-13T18:35:13.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 Processor -- start 2024-09-13T18:35:13.096 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.095+0000 7fe1850eb640 1 -- start start 2024-09-13T18:35:13.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe180071130 0x7fe18014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe18014f4f0 0x7fe18014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe18014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801f23f0 con 0x7fe18014f4f0 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180152440 con 0x7fe180071130 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801f2690 con 0x7fe18015d150 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe18014f4f0 0x7fe18014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe18014f4f0 0x7fe18014d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55096/0 (socket says 172.21.15.53:55096) 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 -- 172.21.15.53:0/1986473771 learned_addr learned my addr 172.21.15.53:0/1986473771 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17f59e640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe18014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17ed9d640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe180071130 0x7fe18014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 -- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 msgr2=0x7fe18014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.100 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe18014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 -- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe180071130 msgr2=0x7fe18014ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe180071130 0x7fe18014ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 -- 172.21.15.53:0/1986473771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17800bd40 con 0x7fe18014f4f0 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17ed9d640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe180071130 0x7fe18014ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17e59c640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe18014f4f0 0x7fe18014d6b0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fe17400d800 tx=0x7fe17400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1677fe640 1 -- 172.21.15.53:0/1986473771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400b6c0 con 0x7fe18014f4f0 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1677fe640 1 -- 172.21.15.53:0/1986473771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400b860 con 0x7fe18014f4f0 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1677fe640 1 -- 172.21.15.53:0/1986473771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400bc10 con 0x7fe18014f4f0 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1801f2970 con 0x7fe18014f4f0 2024-09-13T18:35:13.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe180152720 con 0x7fe18014f4f0 2024-09-13T18:35:13.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18015c540 con 0x7fe18014f4f0 2024-09-13T18:35:13.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1677fe640 1 -- 172.21.15.53:0/1986473771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fe17401e460 con 0x7fe18014f4f0 2024-09-13T18:35:13.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1677fe640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe16c0671d0 0x7fe16c069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:13.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe1677fe640 1 -- 172.21.15.53:0/1986473771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe174083040 con 0x7fe18014f4f0 2024-09-13T18:35:13.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.099+0000 7fe17ed9d640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe16c0671d0 0x7fe16c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:13.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.103+0000 7fe17ed9d640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe16c0671d0 0x7fe16c069690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe1800ae440 tx=0x7fe170009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:13.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.107+0000 7fe1677fe640 1 -- 172.21.15.53:0/1986473771 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe174051e60 con 0x7fe18014f4f0 2024-09-13T18:35:13.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:13.263+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe1801f2e20 con 0x7fe18014f4f0 2024-09-13T18:35:14.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.063+0000 7fe1677fe640 1 -- 172.21.15.53:0/1986473771 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v176) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe174055480 con 0x7fe18014f4f0 2024-09-13T18:35:14.063 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:35:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe16c0671d0 msgr2=0x7fe16c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe16c0671d0 0x7fe16c069690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe1800ae440 tx=0x7fe170009040 comp rx=0 tx=0).stop 2024-09-13T18:35:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe18014f4f0 msgr2=0x7fe18014d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe18014f4f0 0x7fe18014d6b0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fe17400d800 tx=0x7fe17400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 shutdown_connections 2024-09-13T18:35:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe16c0671d0 0x7fe16c069690 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe18015d150 0x7fe18014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe18014f4f0 0x7fe18014d6b0 secure :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fe17400d800 tx=0x7fe17400dcc0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 --2- 172.21.15.53:0/1986473771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe180071130 0x7fe18014ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 >> 172.21.15.53:0/1986473771 conn(0x7fe180073330 msgr2=0x7fe1801518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 shutdown_connections 2024-09-13T18:35:14.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.067+0000 7fe1850eb640 1 -- 172.21.15.53:0/1986473771 wait complete. 2024-09-13T18:35:14.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:35:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.219+0000 7f4690db3640 1 Processor -- start 2024-09-13T18:35:14.219 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.219+0000 7f4690db3640 1 -- start start 2024-09-13T18:35:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.219+0000 7f4690db3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f468c0cdb70 0x7f468c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.219+0000 7f4690db3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.219+0000 7f4690db3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c0cfa90 con 0x7f468c15c860 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.219+0000 7f4690db3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c0d1b20 con 0x7f468c0cdb70 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.219+0000 7f4690db3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0d1d10 con 0x7f468c0cf620 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f468c0cdb70 0x7f468c0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f468c0cdb70 0x7f468c0cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55098/0 (socket says 172.21.15.53:55098) 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 -- 172.21.15.53:0/4167559822 learned_addr learned my addr 172.21.15.53:0/4167559822 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f468ad9d640 1 --2- 172.21.15.53:0/4167559822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 -- 172.21.15.53:0/4167559822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 msgr2=0x7f468c0b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 --2- 172.21.15.53:0/4167559822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 -- 172.21.15.53:0/4167559822 >> v1:172.21.15.87:6789/0 conn(0x7f468c15c860 legacy=0x7f468c0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 -- 172.21.15.53:0/4167559822 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0d1ff0 con 0x7f468c0cdb70 2024-09-13T18:35:14.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4689d9b640 1 --2- 172.21.15.53:0/4167559822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c0cdb70 0x7f468c0cf0e0 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f4680009870 tx=0x7f468001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa94c93571fb4621 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f468959a640 1 -- 172.21.15.53:0/4167559822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46800a8a50 con 0x7f468c0cdb70 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f468959a640 1 -- 172.21.15.53:0/4167559822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46800a8bb0 con 0x7f468c0cdb70 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f468959a640 1 -- 172.21.15.53:0/4167559822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46800b0440 con 0x7f468c0cdb70 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4690db3640 1 -- 172.21.15.53:0/4167559822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c0cdb70 msgr2=0x7f468c0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.223+0000 7f4690db3640 1 --2- 172.21.15.53:0/4167559822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c0cdb70 0x7f468c0cf0e0 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f4680009870 tx=0x7f468001ed50 comp rx=0 tx=0).stop 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- 172.21.15.53:0/4167559822 shutdown_connections 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 --2- 172.21.15.53:0/4167559822 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 --2- 172.21.15.53:0/4167559822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c0cdb70 0x7f468c0cf0e0 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- 172.21.15.53:0/4167559822 >> 172.21.15.53:0/4167559822 conn(0x7f468c065c80 msgr2=0x7f468c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- 172.21.15.53:0/4167559822 shutdown_connections 2024-09-13T18:35:14.226 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- 172.21.15.53:0/4167559822 wait complete. 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 Processor -- start 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- start start 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f468c0cdb70 0x7f468c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c15c860 0x7f468c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c158f40 con 0x7f468c15c860 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0c60e0 con 0x7f468c0cdb70 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0b45e0 con 0x7f468c0cf620 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c15c860 0x7f468c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.227 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c15c860 0x7f468c0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55110/0 (socket says 172.21.15.53:55110) 2024-09-13T18:35:14.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 -- 172.21.15.53:0/3822838873 learned_addr learned my addr 172.21.15.53:0/3822838873 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:14.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4689d9b640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468a59c640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f468c0cdb70 0x7f468c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 -- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 msgr2=0x7f468c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 -- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f468c0cdb70 msgr2=0x7f468c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f468c0cdb70 0x7f468c158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 -- 172.21.15.53:0/3822838873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800094d0 con 0x7f468c15c860 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468a59c640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f468c0cdb70 0x7f468c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f468ad9d640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c15c860 0x7f468c0ca360 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f4684007e40 tx=0x7f468400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f467affd640 1 -- 172.21.15.53:0/3822838873 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684014620 con 0x7f468c15c860 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f467affd640 1 -- 172.21.15.53:0/3822838873 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468400ee90 con 0x7f468c15c860 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c0b48c0 con 0x7f468c15c860 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f467affd640 1 -- 172.21.15.53:0/3822838873 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840149e0 con 0x7f468c15c860 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.227+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c0b4e80 con 0x7f468c15c860 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.231+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c0c6250 con 0x7f468c15c860 2024-09-13T18:35:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.231+0000 7f467affd640 1 -- 172.21.15.53:0/3822838873 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f4684014b40 con 0x7f468c15c860 2024-09-13T18:35:14.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.231+0000 7f467affd640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f466c0671d0 0x7f466c069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:14.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.231+0000 7f467affd640 1 -- 172.21.15.53:0/3822838873 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4684083440 con 0x7f468c15c860 2024-09-13T18:35:14.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.231+0000 7f468a59c640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f466c0671d0 0x7f466c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:14.231 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.231+0000 7f468a59c640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f466c0671d0 0x7f466c069690 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f467c000f70 tx=0x7f467c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:14.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.235+0000 7f467affd640 1 -- 172.21.15.53:0/3822838873 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4684052260 con 0x7f468c15c860 2024-09-13T18:35:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:14.403+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f468c0cf0e0 con 0x7f468c15c860 2024-09-13T18:35:15.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.071+0000 7f467affd640 1 -- 172.21.15.53:0/3822838873 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v177) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4684055880 con 0x7f468c15c860 2024-09-13T18:35:15.072 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2024-09-13T18:35:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f466c0671d0 msgr2=0x7f466c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f466c0671d0 0x7f466c069690 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f467c000f70 tx=0x7f467c009040 comp rx=0 tx=0).stop 2024-09-13T18:35:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c15c860 msgr2=0x7f468c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c15c860 0x7f468c0ca360 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f4684007e40 tx=0x7f468400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 shutdown_connections 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f466c0671d0 0x7f466c069690 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f468c0cf620 0x7f468c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468c15c860 0x7f468c0ca360 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 --2- 172.21.15.53:0/3822838873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f468c0cdb70 0x7f468c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.075+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 >> 172.21.15.53:0/3822838873 conn(0x7f468c065c80 msgr2=0x7f468c0b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.079+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 shutdown_connections 2024-09-13T18:35:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.079+0000 7f4690db3640 1 -- 172.21.15.53:0/3822838873 wait complete. 2024-09-13T18:35:15.100 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:35:15.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.227+0000 7f8a6878b640 1 Processor -- start 2024-09-13T18:35:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a6878b640 1 -- start start 2024-09-13T18:35:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a6878b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 0x7f8a600b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a6878b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6006d600 con 0x7f8a60066390 2024-09-13T18:35:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a6878b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6006d8e0 con 0x7f8a6006d080 2024-09-13T18:35:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a6878b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6006dbc0 con 0x7f8a601460d0 2024-09-13T18:35:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66d28640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8a60066390 0x7f8a600ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42372/0 (socket says 172.21.15.53:42372) 2024-09-13T18:35:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66d28640 1 -- 172.21.15.53:0/3620016129 learned_addr learned my addr 172.21.15.53:0/3620016129 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66527640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 0x7f8a600b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086224869 0 0) 0x7f8a6006d600 con 0x7f8a60066390 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a4c003530 con 0x7f8a60066390 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3691097837 0 0) 0x7f8a4c003530 con 0x7f8a60066390 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 msgr2=0x7f8a600b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 0x7f8a600b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 >> v1:172.21.15.87:6789/0 conn(0x7f8a6006d080 legacy=0x7f8a60065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6006dea0 con 0x7f8a60066390 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f8a58001a00 con 0x7f8a60066390 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 >> v1:172.21.15.53:6789/0 conn(0x7f8a60066390 legacy=0x7f8a600ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a4c0039b0 0x7f8a4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c004360 0x7f8a4c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 0x7f8a4c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6006dbc0 con 0x7f8a4c0039b0 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c00ba40 con 0x7f8a4c004360 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c00bc00 con 0x7f8a601460d0 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66527640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a4c0039b0 0x7f8a4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66d28640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 0x7f8a4c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a65d26640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c004360 0x7f8a4c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66527640 1 -- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 msgr2=0x7f8a4c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66527640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a601460d0 0x7f8a4c005130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66527640 1 -- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c004360 msgr2=0x7f8a4c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66527640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c004360 0x7f8a4c004830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.231+0000 7f8a66527640 1 -- 172.21.15.53:0/3620016129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c003530 con 0x7f8a4c0039b0 2024-09-13T18:35:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a66527640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a4c0039b0 0x7f8a4c003d90 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009ae0 tx=0x7f8a5c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a2bcd751af42da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0a5640 con 0x7f8a4c0039b0 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0a57a0 con 0x7f8a4c0039b0 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a65525640 1 -- 172.21.15.53:0/3620016129 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0a5b50 con 0x7f8a4c0039b0 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- 172.21.15.53:0/3620016129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a4c0039b0 msgr2=0x7f8a4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 --2- 172.21.15.53:0/3620016129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a4c0039b0 0x7f8a4c003d90 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009ae0 tx=0x7f8a5c01c9f0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a66d28640 1 -- 172.21.15.53:0/3620016129 reap_dead start 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- 172.21.15.53:0/3620016129 shutdown_connections 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- 172.21.15.53:0/3620016129 >> 172.21.15.53:0/3620016129 conn(0x7f8a60069f50 msgr2=0x7f8a6006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- 172.21.15.53:0/3620016129 shutdown_connections 2024-09-13T18:35:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- 172.21.15.53:0/3620016129 wait complete. 2024-09-13T18:35:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 Processor -- start 2024-09-13T18:35:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- start start 2024-09-13T18:35:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0039b0 0x7f8a6015f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600ce470 0x7f8a600ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600c8df0 0x7f8a600c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600cee30 con 0x7f8a600ce470 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a601f5c90 con 0x7f8a4c0039b0 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a6878b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600cad60 con 0x7f8a600c8df0 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a65d26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600ce470 0x7f8a600ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a65d26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600ce470 0x7f8a600ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55134/0 (socket says 172.21.15.53:55134) 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.235+0000 7f8a65d26640 1 -- 172.21.15.53:0/2236857521 learned_addr learned my addr 172.21.15.53:0/2236857521 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a66527640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0039b0 0x7f8a6015f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a66d28640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600c8df0 0x7f8a600c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a65d26640 1 -- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600c8df0 msgr2=0x7f8a600c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a65d26640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600c8df0 0x7f8a600c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a65d26640 1 -- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0039b0 msgr2=0x7f8a6015f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a65d26640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0039b0 0x7f8a6015f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a65d26640 1 -- 172.21.15.53:0/2236857521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600cafe0 con 0x7f8a600ce470 2024-09-13T18:35:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a65d26640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600ce470 0x7f8a600ce8f0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000d7f0 tx=0x7f8a5000dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a56ffd640 1 -- 172.21.15.53:0/2236857521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50005270 con 0x7f8a600ce470 2024-09-13T18:35:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a56ffd640 1 -- 172.21.15.53:0/2236857521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a500053d0 con 0x7f8a600ce470 2024-09-13T18:35:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600cb2c0 con 0x7f8a600ce470 2024-09-13T18:35:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a56ffd640 1 -- 172.21.15.53:0/2236857521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000b8b0 con 0x7f8a600ce470 2024-09-13T18:35:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a600cb880 con 0x7f8a600ce470 2024-09-13T18:35:15.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6006aee0 con 0x7f8a600ce470 2024-09-13T18:35:15.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a56ffd640 1 -- 172.21.15.53:0/2236857521 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f8a5000bc20 con 0x7f8a600ce470 2024-09-13T18:35:15.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a56ffd640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8a44067200 0x7f8a440696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a56ffd640 1 -- 172.21.15.53:0/2236857521 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8a50082cf0 con 0x7f8a600ce470 2024-09-13T18:35:15.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a66527640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8a44067200 0x7f8a440696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.239+0000 7f8a66527640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8a44067200 0x7f8a440696c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0af000 tx=0x7f8a5c0046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.243+0000 7f8a56ffd640 1 -- 172.21.15.53:0/2236857521 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a50051b10 con 0x7f8a600ce470 2024-09-13T18:35:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.411+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8a600ae340 con 0x7f8a600ce470 2024-09-13T18:35:15.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a56ffd640 1 -- 172.21.15.53:0/2236857521 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8a50055130 con 0x7f8a600ce470 2024-09-13T18:35:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8a44067200 msgr2=0x7f8a440696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8a44067200 0x7f8a440696c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0af000 tx=0x7f8a5c0046d0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600ce470 msgr2=0x7f8a600ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600ce470 0x7f8a600ce8f0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000d7f0 tx=0x7f8a5000dcb0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 shutdown_connections 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f8a44067200 0x7f8a440696c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a600c8df0 0x7f8a600c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a600ce470 0x7f8a600ce8f0 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 --2- 172.21.15.53:0/2236857521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0039b0 0x7f8a6015f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 >> 172.21.15.53:0/2236857521 conn(0x7f8a60069f50 msgr2=0x7f8a60065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 shutdown_connections 2024-09-13T18:35:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.415+0000 7f8a6878b640 1 -- 172.21.15.53:0/2236857521 wait complete. 2024-09-13T18:35:15.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-13T18:35:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.559+0000 7f791f4f6640 1 Processor -- start 2024-09-13T18:35:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.559+0000 7f791f4f6640 1 -- start start 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791f4f6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 0x7f791806b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791f4f6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180b2860 con 0x7f7918158ba0 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791f4f6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7918158f80 con 0x7f791806fa80 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791f4f6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180b2580 con 0x7f79180cbb60 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791d292640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7918158ba0 0x7f791806f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42378/0 (socket says 172.21.15.53:42378) 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791d292640 1 -- 172.21.15.53:0/4068663886 learned_addr learned my addr 172.21.15.53:0/4068663886 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932528775 0 0) 0x7f79180b2860 con 0x7f7918158ba0 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791da93640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 0x7f791806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7904003530 con 0x7f7918158ba0 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 597261764 0 0) 0x7f7904003530 con 0x7f7918158ba0 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 msgr2=0x7f791806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 0x7f791806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 >> v1:172.21.15.87:6789/0 conn(0x7f791806fa80 legacy=0x7f79180cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180cc3a0 con 0x7f7918158ba0 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f7914001680 con 0x7f7918158ba0 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 >> v1:172.21.15.53:6789/0 conn(0x7f7918158ba0 legacy=0x7f791806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 0x7f79040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7904003f30 0x7f79040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7904004d10 0x7f7904005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180b2580 con 0x7f7904003f30 2024-09-13T18:35:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790400bb20 con 0x7f7904004d10 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790400bce0 con 0x7f79180cbb60 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791ca91640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7904003f30 0x7f79040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791d292640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 0x7f79040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791da93640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7904004d10 0x7f7904005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791ca91640 1 -- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 msgr2=0x7f79040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791ca91640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79180cbb60 0x7f79040039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791ca91640 1 -- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7904004d10 msgr2=0x7f7904005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791ca91640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7904004d10 0x7f7904005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.563+0000 7f791ca91640 1 -- 172.21.15.53:0/4068663886 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904003530 con 0x7f7904003f30 2024-09-13T18:35:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7904003f30 0x7f79040047d0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f7908001780 tx=0x7f790801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307fc6066745466d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080052d0 con 0x7f7904003f30 2024-09-13T18:35:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080a7050 con 0x7f7904003f30 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f790ffff640 1 -- 172.21.15.53:0/4068663886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908003600 con 0x7f7904003f30 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- 172.21.15.53:0/4068663886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7904003f30 msgr2=0x7f79040047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 --2- 172.21.15.53:0/4068663886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7904003f30 0x7f79040047d0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f7908001780 tx=0x7f790801c420 comp rx=0 tx=0).stop 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791da93640 1 -- 172.21.15.53:0/4068663886 reap_dead start 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- 172.21.15.53:0/4068663886 shutdown_connections 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- 172.21.15.53:0/4068663886 >> 172.21.15.53:0/4068663886 conn(0x7f7918065c80 msgr2=0x7f7918066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- 172.21.15.53:0/4068663886 shutdown_connections 2024-09-13T18:35:15.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- 172.21.15.53:0/4068663886 wait complete. 2024-09-13T18:35:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 Processor -- start 2024-09-13T18:35:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- start start 2024-09-13T18:35:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7904003f30 0x7f7918154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918066090 0x7f791814b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f791815a1a0 0x7f791815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791815ab70 con 0x7f7918066090 2024-09-13T18:35:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180664f0 con 0x7f791815a1a0 2024-09-13T18:35:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791f4f6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791814bfe0 con 0x7f7904003f30 2024-09-13T18:35:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918066090 0x7f791814b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918066090 0x7f791814b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55156/0 (socket says 172.21.15.53:55156) 2024-09-13T18:35:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 -- 172.21.15.53:0/418949762 learned_addr learned my addr 172.21.15.53:0/418949762 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791d292640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7904003f30 0x7f7918154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791da93640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f791815a1a0 0x7f791815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 -- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7904003f30 msgr2=0x7f7918154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7904003f30 0x7f7918154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 -- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f791815a1a0 msgr2=0x7f791815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f791815a1a0 0x7f791815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.567+0000 7f791ca91640 1 -- 172.21.15.53:0/418949762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918153110 con 0x7f7918066090 2024-09-13T18:35:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f791ca91640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918066090 0x7f791814b4f0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f7908001780 tx=0x7f7904005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f790dffb640 1 -- 172.21.15.53:0/418949762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080070c0 con 0x7f7918066090 2024-09-13T18:35:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f790dffb640 1 -- 172.21.15.53:0/418949762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908007220 con 0x7f7918066090 2024-09-13T18:35:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79181533f0 con 0x7f7918066090 2024-09-13T18:35:15.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f790dffb640 1 -- 172.21.15.53:0/418949762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080075b0 con 0x7f7918066090 2024-09-13T18:35:15.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79181539b0 con 0x7f7918066090 2024-09-13T18:35:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918067400 con 0x7f7918066090 2024-09-13T18:35:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f790dffb640 1 -- 172.21.15.53:0/418949762 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f79080067e0 con 0x7f7918066090 2024-09-13T18:35:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f790dffb640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f78fc0671d0 0x7f78fc069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f790dffb640 1 -- 172.21.15.53:0/418949762 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f790811d020 con 0x7f7918066090 2024-09-13T18:35:15.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f791d292640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f78fc0671d0 0x7f78fc069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:15.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.571+0000 7f791d292640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f78fc0671d0 0x7f78fc069690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7914001ca0 tx=0x7f7914009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:15.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.575+0000 7f790dffb640 1 -- 172.21.15.53:0/418949762 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79080ebc90 con 0x7f7918066090 2024-09-13T18:35:15.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:15.795+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f79180cce80 con 0x7f7918066090 2024-09-13T18:35:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.071+0000 7f790dffb640 1 -- 172.21.15.53:0/418949762 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v555) v1 ==== 163+0+0 (secure 0 0 0) 0x7f79080c40e0 con 0x7f7918066090 2024-09-13T18:35:16.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.083+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f78fc0671d0 msgr2=0x7f78fc069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.084 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.083+0000 7f791f4f6640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f78fc0671d0 0x7f78fc069690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7914001ca0 tx=0x7f7914009040 comp rx=0 tx=0).stop 2024-09-13T18:35:16.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.083+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918066090 msgr2=0x7f791814b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:16.085 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.083+0000 7f791f4f6640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918066090 0x7f791814b4f0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f7908001780 tx=0x7f7904005800 comp rx=0 tx=0).stop 2024-09-13T18:35:16.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.087+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 shutdown_connections 2024-09-13T18:35:16.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.087+0000 7f791f4f6640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f78fc0671d0 0x7f78fc069690 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.087+0000 7f791f4f6640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f791815a1a0 0x7f791815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.087+0000 7f791f4f6640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7918066090 0x7f791814b4f0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.087+0000 7f791f4f6640 1 --2- 172.21.15.53:0/418949762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7904003f30 0x7f7918154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:16.087 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.087+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 >> 172.21.15.53:0/418949762 conn(0x7f7918065c80 msgr2=0x7f79180ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:16.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.091+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 shutdown_connections 2024-09-13T18:35:16.090 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:16.091+0000 7f791f4f6640 1 -- 172.21.15.53:0/418949762 wait complete. 2024-09-13T18:35:16.115 INFO:tasks.cephfs_test_runner:Validate unparseable text .meta file on legacy subvol root doesn't break the system ... ok 2024-09-13T18:35:16.116 INFO:tasks.cephfs_test_runner: 2024-09-13T18:35:16.116 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T18:35:16.116 INFO:tasks.cephfs_test_runner:Ran 11 tests in 587.358s 2024-09-13T18:35:16.116 INFO:tasks.cephfs_test_runner: 2024-09-13T18:35:16.116 INFO:tasks.cephfs_test_runner:OK 2024-09-13T18:35:16.116 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T18:35:16.126 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:35:16.233 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:35:16.233 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:35:16.233 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:16.240 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:35:16.240 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-13T18:35:16.241 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:16.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20801 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:35:16.291 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:35:16.291 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:16.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:35:16.299 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-09-13T18:35:16.299 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:35:16.345 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16091 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:35:16.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.345 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2024-09-13T18:35:16.352 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:35:16.352 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:35:16.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:35:16.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:35:16.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2024-09-13T18:35:16.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.639 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-09-13T18:35:16.647 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:35:16.647 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:35:16.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.647 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:35:16.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:35:16.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:35:16.785 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-09-13T18:35:16.965 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:35:16.974 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:35:16.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0c6108640 1 Processor -- start 2024-09-13T18:35:17.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0c6108640 1 -- start start 2024-09-13T18:35:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0c6108640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 0x7fd0c00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0c6108640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c00b1ac0 con 0x7fd0c00cb980 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0c6108640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c0159ac0 con 0x7fd0c00cbd60 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0c6108640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0159da0 con 0x7fd0c006b850 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bf7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd0c00cb980 0x7fd0c006fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43582/0 (socket says 172.21.15.53:43582) 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bf7fe640 1 -- 172.21.15.53:0/1064763603 learned_addr learned my addr 172.21.15.53:0/1064763603 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0beffd640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 0x7fd0c00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645308958 0 0) 0x7fd0c00b1ac0 con 0x7fd0c00cb980 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0ac003530 con 0x7fd0c00cb980 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540071377 0 0) 0x7fd0ac003530 con 0x7fd0c00cb980 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 msgr2=0x7fd0c00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 0x7fd0c00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 >> v1:172.21.15.87:6789/0 conn(0x7fd0c00cbd60 legacy=0x7fd0c00b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c015a080 con 0x7fd0c00cb980 2024-09-13T18:35:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fd0b0001680 con 0x7fd0c00cb980 2024-09-13T18:35:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 >> v1:172.21.15.53:6789/0 conn(0x7fd0c00cb980 legacy=0x7fd0c006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 0x7fd0ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac003f30 0x7fd0ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0ac004d10 0x7fd0ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0159da0 con 0x7fd0ac004d10 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac00bb20 con 0x7fd0ac003f30 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac00bce0 con 0x7fd0c006b850 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bffff640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0ac004d10 0x7fd0ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0beffd640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac003f30 0x7fd0ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bf7fe640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 0x7fd0ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bffff640 1 -- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 msgr2=0x7fd0ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bffff640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c006b850 0x7fd0ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bffff640 1 -- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac003f30 msgr2=0x7fd0ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bffff640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac003f30 0x7fd0ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.111+0000 7fd0bffff640 1 -- 172.21.15.53:0/1064763603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac003530 con 0x7fd0ac004d10 2024-09-13T18:35:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0bffff640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0ac004d10 0x7fd0ac005190 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8001e70 tx=0x7fd0b801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b008d71168a54a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8003b80 con 0x7fd0ac004d10 2024-09-13T18:35:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8003ce0 con 0x7fd0ac004d10 2024-09-13T18:35:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0be7fc640 1 -- 172.21.15.53:0/1064763603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80052c0 con 0x7fd0ac004d10 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- 172.21.15.53:0/1064763603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0ac004d10 msgr2=0x7fd0ac005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 --2- 172.21.15.53:0/1064763603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0ac004d10 0x7fd0ac005190 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8001e70 tx=0x7fd0b801c780 comp rx=0 tx=0).stop 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0bffff640 1 -- 172.21.15.53:0/1064763603 reap_dead start 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- 172.21.15.53:0/1064763603 shutdown_connections 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- 172.21.15.53:0/1064763603 >> 172.21.15.53:0/1064763603 conn(0x7fd0c0065c80 msgr2=0x7fd0c0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- 172.21.15.53:0/1064763603 shutdown_connections 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- 172.21.15.53:0/1064763603 wait complete. 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 Processor -- start 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- start start 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac004d10 0x7fd0c013e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c0146af0 0x7fd0c00a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c0144be0 0x7fd0c0145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01455a0 con 0x7fd0c0146af0 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c013eae0 con 0x7fd0ac004d10 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0c6108640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00ad360 con 0x7fd0c0144be0 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0beffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c0146af0 0x7fd0c00a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0beffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c0146af0 0x7fd0c00a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41196/0 (socket says 172.21.15.53:41196) 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0beffd640 1 -- 172.21.15.53:0/1038287428 learned_addr learned my addr 172.21.15.53:0/1038287428 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0bf7fe640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac004d10 0x7fd0c013e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.115+0000 7fd0bffff640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c0144be0 0x7fd0c0145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0beffd640 1 -- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c0144be0 msgr2=0x7fd0c0145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0beffd640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c0144be0 0x7fd0c0145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0beffd640 1 -- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac004d10 msgr2=0x7fd0c013e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0beffd640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac004d10 0x7fd0c013e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0beffd640 1 -- 172.21.15.53:0/1038287428 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00a8d00 con 0x7fd0c0146af0 2024-09-13T18:35:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0bf7fe640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac004d10 0x7fd0c013e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0beffd640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c0146af0 0x7fd0c00a84d0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8011940 tx=0x7fd0a8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0b7fff640 1 -- 172.21.15.53:0/1038287428 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8004240 con 0x7fd0c0146af0 2024-09-13T18:35:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0b7fff640 1 -- 172.21.15.53:0/1038287428 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a80043a0 con 0x7fd0c0146af0 2024-09-13T18:35:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c00a8fe0 con 0x7fd0c0146af0 2024-09-13T18:35:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0b7fff640 1 -- 172.21.15.53:0/1038287428 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800faa0 con 0x7fd0c0146af0 2024-09-13T18:35:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c00a95a0 con 0x7fd0c0146af0 2024-09-13T18:35:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0067400 con 0x7fd0c0146af0 2024-09-13T18:35:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0b7fff640 1 -- 172.21.15.53:0/1038287428 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fd0a800fc00 con 0x7fd0c0146af0 2024-09-13T18:35:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0b7fff640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a00671d0 0x7fd0a0069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0bf7fe640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a00671d0 0x7fd0a0069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0b7fff640 1 -- 172.21.15.53:0/1038287428 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd0a8083430 con 0x7fd0c0146af0 2024-09-13T18:35:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.119+0000 7fd0bf7fe640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a00671d0 0x7fd0a0069690 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0001060 tx=0x7fd0b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.125 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.123+0000 7fd0b7fff640 1 -- 172.21.15.53:0/1038287428 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd0a8052000 con 0x7fd0c0146af0 2024-09-13T18:35:17.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.283+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0c00b33b0 con 0x7fd0a00671d0 2024-09-13T18:35:17.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.283+0000 7fd0b7fff640 1 -- 172.21.15.53:0/1038287428 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49431 (secure 0 0 0) 0x7fd0c00b33b0 con 0x7fd0a00671d0 2024-09-13T18:35:17.284 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:17.284 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:35:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a00671d0 msgr2=0x7fd0a0069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a00671d0 0x7fd0a0069690 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0001060 tx=0x7fd0b0009040 comp rx=0 tx=0).stop 2024-09-13T18:35:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c0146af0 msgr2=0x7fd0c00a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c0146af0 0x7fd0c00a84d0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8011940 tx=0x7fd0a8011e00 comp rx=0 tx=0).stop 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 shutdown_connections 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fd0a00671d0 0x7fd0a0069690 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd0c0144be0 0x7fd0c0145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0c0146af0 0x7fd0c00a84d0 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 --2- 172.21.15.53:0/1038287428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd0ac004d10 0x7fd0c013e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 >> 172.21.15.53:0/1038287428 conn(0x7fd0c0065c80 msgr2=0x7fd0c00b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 shutdown_connections 2024-09-13T18:35:17.287 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.287+0000 7fd0c6108640 1 -- 172.21.15.53:0/1038287428 wait complete. 2024-09-13T18:35:17.304 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-09-13T18:35:15.913454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300224,"kb_used_data":18548,"kb_used_omap":12,"kb_used_meta":281587,"kb_avail":754674496,"statfs":{"total":773094113280,"available":772786683904,"internally_reserved":0,"allocated":18993152,"data_stored":9105445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":288345656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62469,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-81,"num_write_kb":-93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002078"},"pg_stats":[{"pgid":"1.0","version":"75'128","reported_seq":334,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:52.849992+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:34:52.849992+0000","last_peered":"2024-09-13T18:34:52.849992+0000","last_clean":"2024-09-13T18:34:52.849992+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:34:52.849992+0000","last_undegraded":"2024-09-13T18:34:52.849992+0000","last_fullsized":"2024-09-13T18:34:52.849992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":2867200,"data_stored":1628426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89100000000000001,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.3140000000000001,"5min":1.399,"15min":1.6439999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.92900000000000005,"15min":0.91300000000000003},"min":{"1min":0.70499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2589999999999999,"5min":1.333,"15min":1.4410000000000001},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.91300000000000003,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.7270000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.63300000000000001,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.3380000000000001,"5min":1.347,"15min":1.6060000000000001},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.52800000000000002,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.077,"5min":1.276,"15min":1.276},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.874,"15min":0.88100000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.9830000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.86099999999999999,"15min":0.878},"min":{"1min":0.71999999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.448},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93700000000000006,"15min":0.93000000000000005},"min":{"1min":0.69799999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.397},"last":0.875}]},{"osd":4,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.626,"5min":0.59099999999999997,"15min":0.47599999999999998},"max":{"1min":1.1799999999999999,"5min":1.2569999999999999,"15min":1.3620000000000001},"last":1.085},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.61299999999999999,"15min":0.55800000000000005},"max":{"1min":1.2809999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.755}]},{"osd":5,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.70999999999999996,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.367,"5min":1.367,"15min":1.877},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.79500000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3109999999999999,"5min":1.409,"15min":1.409},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.042,"15min":1.0549999999999999},"min":{"1min":0.75800000000000001,"5min":0.69399999999999995,"15min":0.56899999999999995},"max":{"1min":1.25,"5min":1.476,"15min":1.476},"last":1.238},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0309999999999999,"15min":1.018},"min":{"1min":0.86099999999999999,"5min":0.65000000000000002,"15min":0.503},"max":{"1min":1.2490000000000001,"5min":1.361,"15min":1.506},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2203648,"data_stored":972243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.26,"5min":1.47,"15min":2.9990000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80100000000000005,"15min":0.79700000000000004},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.1779999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.577},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.208,"5min":1.218,"15min":1.464},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.60099999999999998,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.673,"15min":2.4220000000000002},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90200000000000002,"15min":0.88700000000000001},"min":{"1min":0.59899999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.28,"5min":1.516,"15min":1.516},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89600000000000002,"15min":0.88700000000000001},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.23,"5min":1.2669999999999999,"15min":1.306},"last":0.87}]},{"osd":4,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.96499999999999997},"min":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.1639999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.089,"5min":1.0549999999999999,"15min":1.0209999999999999},"min":{"1min":0.84399999999999997,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.224,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0960000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2010000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.0269999999999999,"15min":1.0740000000000001},"min":{"1min":0.71699999999999997,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.371,"5min":1.4490000000000001,"15min":2.762},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.0369999999999999},"min":{"1min":0.81200000000000006,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.389,"5min":1.5,"15min":1.9299999999999999},"last":1.254},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.04,"15min":1.0389999999999999},"min":{"1min":0.76800000000000002,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.3300000000000001,"5min":1.357,"15min":1.72},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2199552,"data_stored":971940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.23,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.437},"max":{"1min":1.153,"5min":1.264,"15min":2.1840000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.84199999999999997},"min":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.137,"5min":1.603,"15min":1.603},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2150000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.48599999999999999},"max":{"1min":1.1950000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.89500000000000002,"15min":0.93799999999999994},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1519999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1890000000000001,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.92900000000000005,"15min":0.95799999999999996},"min":{"1min":0.63700000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1060000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.88700000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.52500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2210000000000001,"5min":3.46,"15min":3.46},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.99099999999999999,"15min":1.0189999999999999},"min":{"1min":0.58499999999999996,"5min":0.441,"15min":0.441},"max":{"1min":1.1830000000000001,"5min":1.492,"15min":1.5049999999999999},"last":1.03}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.115,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.98499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.044,"15min":1.0800000000000001},"min":{"1min":0.63700000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2509999999999999,"5min":2.1600000000000001,"15min":2.246},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.075,"15min":1.107},"min":{"1min":0.58199999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1950000000000001,"5min":3.649,"15min":3.649},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2297856,"data_stored":1044546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.92100000000000004,"15min":0.84999999999999998},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4630000000000001,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.4630000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.88500000000000001,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1279999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.2589999999999999,"15min":1.536},"last":0.754},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.91800000000000004,"15min":0.89700000000000002},"min":{"1min":0.65900000000000003,"5min":0.502,"15min":0.499},"max":{"1min":1.3540000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.3540000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90300000000000002,"15min":0.88},"min":{"1min":0.68600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.123,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5049999999999999,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.5049999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93100000000000005,"15min":0.90900000000000003},"min":{"1min":0.72999999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2649999999999999,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":0.95199999999999996},"min":{"1min":0.74399999999999999,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3400000000000001,"5min":10.44,"15min":10.44},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96999999999999997,"15min":0.94999999999999996},"min":{"1min":0.69499999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2370000000000001,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":0.97599999999999998},"min":{"1min":0.69299999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.278,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.127,"15min":1.02},"min":{"1min":0.66300000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.403,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.298},{"interface":"front","average":{"1min":1.036,"5min":1.2350000000000001,"15min":1.0900000000000001},"min":{"1min":0.72599999999999998,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.6359999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.6359999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.22,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6279999999999999,"5min":15.593,"15min":15.593},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.77200000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.5389999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.5389999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41460,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330380,"statfs":{"total":96636764160,"available":96594309120,"internally_reserved":0,"allocated":2207744,"data_stored":971540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.32000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95099999999999996,"5min":1.444,"15min":2.113},"last":0.746},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.313,"15min":0.313},"max":{"1min":1.071,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.34599999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.022,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.623,"15min":0.63},"min":{"1min":0.312,"5min":0.222,"15min":0.222},"max":{"1min":1.0269999999999999,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1830000000000001,"5min":1.4850000000000001,"15min":1.742},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.137,"5min":1.222,"15min":1.399},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.94499999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.27,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.97499999999999998,"15min":1.0549999999999999},"min":{"1min":0.67700000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.266,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.93400000000000005,"15min":0.995},"min":{"1min":0.71299999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.8919999999999999},"last":1.05},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89500000000000002,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1259999999999999,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":1.0309999999999999},"min":{"1min":0.71399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.335,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.879},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.746,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.96},"last":0.98399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.042,"15min":1.075},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.357,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.04,"5min":0.98199999999999998,"15min":1.004},"min":{"1min":0.69499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2729999999999999,"5min":1.504,"15min":2.9220000000000002},"last":0.93400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41448,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330392,"statfs":{"total":96636764160,"available":96594321408,"internally_reserved":0,"allocated":2195456,"data_stored":971358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.308,"5min":0.246,"15min":0.246},"max":{"1min":0.98699999999999999,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.89800000000000002,"5min":1.1619999999999999,"15min":1.335},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.1579999999999999},"last":0.495},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.2190000000000001,"15min":1.423},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2250000000000001,"5min":1.46,"15min":1.46},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.1930000000000001,"5min":1.53,"15min":1.53},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.484,"5min":1.5309999999999999,"15min":1.611},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.90800000000000003},"min":{"1min":0.65800000000000003,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":1.1140000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.97599999999999998,"15min":0.98999999999999999},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.446,"5min":1.548,"15min":1.9179999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.98799999999999999,"15min":0.97599999999999998},"min":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4179999999999999,"5min":1.589,"15min":1.702},"last":0.96199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97299999999999998,"15min":0.95999999999999996},"min":{"1min":0.71799999999999997,"5min":0.55600000000000005,"15min":0.5},"max":{"1min":1.401,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1},{"interface":"front","average":{"1min":0.995,"5min":1.0149999999999999,"15min":1.032},"min":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.353,"5min":1.645,"15min":1.645},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.6240000000000001,"5min":1.843,"15min":1.843},"last":1.071},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":1.069},"min":{"1min":0.75700000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.522,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2215936,"data_stored":977495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.997,"5min":1.085,"15min":1.085},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.84599999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.0580000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.274,"5min":1.274,"15min":1.3680000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.423},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.60299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.05,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91100000000000003,"15min":0.91900000000000004},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.2410000000000001,"5min":1.393,"15min":1.393},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.262,"5min":1.367,"15min":1.4590000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.68999999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.359,"5min":1.71,"15min":1.71},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.242,"5min":1.335,"15min":1.653},"last":1.099},{"interface":"front","average":{"1min":1.01,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.323,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0169999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0329999999999999,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.4610000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.73699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.278,"5min":1.649,"15min":1.649},"last":1.1399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42048,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329792,"statfs":{"total":96636764160,"available":96593707008,"internally_reserved":0,"allocated":2805760,"data_stored":1567897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.147},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.755,"15min":0.76600000000000001},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":0.77200000000000002,"15min":0.68999999999999995},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":8.7729999999999997,"5min":8.7729999999999997,"15min":8.7729999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.7589999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.80100000000000005,"15min":0.76500000000000001},"min":{"1min":0.33900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88900000000000001,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.60899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":1.014}]},{"osd":5,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.58399999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.044,"15min":1.044},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0369999999999999,"15min":1.0629999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.97699999999999998,"15min":1.008},"min":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.139,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.071}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0209999999999999,"15min":1.0249999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.25,"5min":2.25,"15min":2.2949999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1120000000000001,"15min":1.1080000000000001},"min":{"1min":0.747,"5min":0.55800000000000005,"15min":0.49199999999999999},"max":{"1min":4.7080000000000002,"5min":4.7080000000000002,"15min":4.7080000000000002},"last":1.05}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:17.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:17.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.423+0000 7f484e26c640 1 Processor -- start 2024-09-13T18:35:17.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.423+0000 7f484e26c640 1 -- start start 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f484e26c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48480cb980 0x7f48480b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f484e26c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f484806b850 0x7f48480cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f484e26c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48480b1ac0 con 0x7f48480cbd60 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f484e26c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48480b3010 con 0x7f484806b850 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f484e26c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4848159ac0 con 0x7f48480cb980 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f484806b850 0x7f48480cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f484806b850 0x7f48480cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41204/0 (socket says 172.21.15.53:41204) 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 -- 172.21.15.53:0/2878222657 learned_addr learned my addr 172.21.15.53:0/2878222657 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f4847fff640 1 --2- 172.21.15.53:0/2878222657 >> v2:172.21.15.87:3300/0 conn(0x7f48480cb980 0x7f48480b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 -- 172.21.15.53:0/2878222657 >> v2:172.21.15.87:3300/0 conn(0x7f48480cb980 msgr2=0x7f48480b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 --2- 172.21.15.53:0/2878222657 >> v2:172.21.15.87:3300/0 conn(0x7f48480cb980 0x7f48480b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 -- 172.21.15.53:0/2878222657 >> v1:172.21.15.87:6789/0 conn(0x7f48480cbd60 legacy=0x7f484806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 -- 172.21.15.53:0/2878222657 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848159da0 con 0x7f484806b850 2024-09-13T18:35:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f48477fe640 1 --2- 172.21.15.53:0/2878222657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f484806b850 0x7f48480cdd40 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f4848071820 tx=0x7f483c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b44e915053272e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f4846ffd640 1 -- 172.21.15.53:0/2878222657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c0ab620 con 0x7f484806b850 2024-09-13T18:35:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f4846ffd640 1 -- 172.21.15.53:0/2878222657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c0ab780 con 0x7f484806b850 2024-09-13T18:35:17.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.427+0000 7f4846ffd640 1 -- 172.21.15.53:0/2878222657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c0abb10 con 0x7f484806b850 2024-09-13T18:35:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- 172.21.15.53:0/2878222657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f484806b850 msgr2=0x7f48480cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 --2- 172.21.15.53:0/2878222657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f484806b850 0x7f48480cdd40 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f4848071820 tx=0x7f483c01c420 comp rx=0 tx=0).stop 2024-09-13T18:35:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- 172.21.15.53:0/2878222657 shutdown_connections 2024-09-13T18:35:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 --2- 172.21.15.53:0/2878222657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f484806b850 0x7f48480cdd40 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 --2- 172.21.15.53:0/2878222657 >> v2:172.21.15.87:3300/0 conn(0x7f48480cb980 0x7f48480b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- 172.21.15.53:0/2878222657 >> 172.21.15.53:0/2878222657 conn(0x7f4848065c80 msgr2=0x7f4848066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:17.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- 172.21.15.53:0/2878222657 shutdown_connections 2024-09-13T18:35:17.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- 172.21.15.53:0/2878222657 wait complete. 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 Processor -- start 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- start start 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484806b850 0x7f4848149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48480cb980 0x7f484814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48480cbd60 0x7f48481f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848150fc0 con 0x7f48480cb980 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848151860 con 0x7f484806b850 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484814de10 con 0x7f48480cbd60 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48480cb980 0x7f484814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48480cb980 0x7f484814c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41218/0 (socket says 172.21.15.53:41218) 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 -- 172.21.15.53:0/1246225497 learned_addr learned my addr 172.21.15.53:0/1246225497 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f4847fff640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484806b850 0x7f4848149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484c809640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48480cbd60 0x7f48481f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 -- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48480cbd60 msgr2=0x7f48481f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48480cbd60 0x7f48481f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 -- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484806b850 msgr2=0x7f4848149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484806b850 0x7f4848149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 -- 172.21.15.53:0/1246225497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0094d0 con 0x7f48480cb980 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484c809640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48480cbd60 0x7f48481f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f48477fe640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48480cb980 0x7f484814c200 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f483c01a050 tx=0x7f483c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f4844ff9640 1 -- 172.21.15.53:0/1246225497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c0be3f0 con 0x7f48480cb980 2024-09-13T18:35:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f4844ff9640 1 -- 172.21.15.53:0/1246225497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c0be570 con 0x7f48480cb980 2024-09-13T18:35:17.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4848151210 con 0x7f48480cb980 2024-09-13T18:35:17.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f4844ff9640 1 -- 172.21.15.53:0/1246225497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c0be920 con 0x7f48480cb980 2024-09-13T18:35:17.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.431+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484814dac0 con 0x7f48480cb980 2024-09-13T18:35:17.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.435+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4848067400 con 0x7f48480cb980 2024-09-13T18:35:17.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.435+0000 7f4844ff9640 1 -- 172.21.15.53:0/1246225497 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f483c0b43f0 con 0x7f48480cb980 2024-09-13T18:35:17.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.435+0000 7f4844ff9640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f48340671d0 0x7f4834069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.435+0000 7f4844ff9640 1 -- 172.21.15.53:0/1246225497 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f483c11d1f0 con 0x7f48480cb980 2024-09-13T18:35:17.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.435+0000 7f4847fff640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f48340671d0 0x7f4834069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.435+0000 7f4847fff640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f48340671d0 0x7f4834069690 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f484806d570 tx=0x7f4838008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.438 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.439+0000 7f4844ff9640 1 -- 172.21.15.53:0/1246225497 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f483c0ec0c0 con 0x7f48480cb980 2024-09-13T18:35:17.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.595+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4848153420 con 0x7f48340671d0 2024-09-13T18:35:17.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f4844ff9640 1 -- 172.21.15.53:0/1246225497 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49431 (secure 0 0 0) 0x7f4848153420 con 0x7f48340671d0 2024-09-13T18:35:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:17.603 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:35:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f48340671d0 msgr2=0x7f4834069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f48340671d0 0x7f4834069690 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f484806d570 tx=0x7f4838008040 comp rx=0 tx=0).stop 2024-09-13T18:35:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48480cb980 msgr2=0x7f484814c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48480cb980 0x7f484814c200 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f483c01a050 tx=0x7f483c01ac60 comp rx=0 tx=0).stop 2024-09-13T18:35:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 shutdown_connections 2024-09-13T18:35:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f48340671d0 0x7f4834069690 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f48480cbd60 0x7f48481f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48480cb980 0x7f484814c200 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 --2- 172.21.15.53:0/1246225497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f484806b850 0x7f4848149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 >> 172.21.15.53:0/1246225497 conn(0x7f4848065c80 msgr2=0x7f484814a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 shutdown_connections 2024-09-13T18:35:17.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.603+0000 7f484e26c640 1 -- 172.21.15.53:0/1246225497 wait complete. 2024-09-13T18:35:17.620 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-09-13T18:35:15.913454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300224,"kb_used_data":18548,"kb_used_omap":12,"kb_used_meta":281587,"kb_avail":754674496,"statfs":{"total":773094113280,"available":772786683904,"internally_reserved":0,"allocated":18993152,"data_stored":9105445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":288345656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62469,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-81,"num_write_kb":-93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002078"},"pg_stats":[{"pgid":"1.0","version":"75'128","reported_seq":334,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:52.849992+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:34:52.849992+0000","last_peered":"2024-09-13T18:34:52.849992+0000","last_clean":"2024-09-13T18:34:52.849992+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:34:52.849992+0000","last_undegraded":"2024-09-13T18:34:52.849992+0000","last_fullsized":"2024-09-13T18:34:52.849992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":2867200,"data_stored":1628426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89100000000000001,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.3140000000000001,"5min":1.399,"15min":1.6439999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.92900000000000005,"15min":0.91300000000000003},"min":{"1min":0.70499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2589999999999999,"5min":1.333,"15min":1.4410000000000001},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.91300000000000003,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.7270000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.63300000000000001,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.3380000000000001,"5min":1.347,"15min":1.6060000000000001},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.52800000000000002,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.077,"5min":1.276,"15min":1.276},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.874,"15min":0.88100000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.9830000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.86099999999999999,"15min":0.878},"min":{"1min":0.71999999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.448},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93700000000000006,"15min":0.93000000000000005},"min":{"1min":0.69799999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.397},"last":0.875}]},{"osd":4,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.626,"5min":0.59099999999999997,"15min":0.47599999999999998},"max":{"1min":1.1799999999999999,"5min":1.2569999999999999,"15min":1.3620000000000001},"last":1.085},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.61299999999999999,"15min":0.55800000000000005},"max":{"1min":1.2809999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.755}]},{"osd":5,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.70999999999999996,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.367,"5min":1.367,"15min":1.877},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.79500000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3109999999999999,"5min":1.409,"15min":1.409},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.042,"15min":1.0549999999999999},"min":{"1min":0.75800000000000001,"5min":0.69399999999999995,"15min":0.56899999999999995},"max":{"1min":1.25,"5min":1.476,"15min":1.476},"last":1.238},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0309999999999999,"15min":1.018},"min":{"1min":0.86099999999999999,"5min":0.65000000000000002,"15min":0.503},"max":{"1min":1.2490000000000001,"5min":1.361,"15min":1.506},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2203648,"data_stored":972243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.26,"5min":1.47,"15min":2.9990000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80100000000000005,"15min":0.79700000000000004},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.1779999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.577},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.208,"5min":1.218,"15min":1.464},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.60099999999999998,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.673,"15min":2.4220000000000002},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90200000000000002,"15min":0.88700000000000001},"min":{"1min":0.59899999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.28,"5min":1.516,"15min":1.516},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89600000000000002,"15min":0.88700000000000001},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.23,"5min":1.2669999999999999,"15min":1.306},"last":0.87}]},{"osd":4,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.96499999999999997},"min":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.1639999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.089,"5min":1.0549999999999999,"15min":1.0209999999999999},"min":{"1min":0.84399999999999997,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.224,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0960000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2010000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.0269999999999999,"15min":1.0740000000000001},"min":{"1min":0.71699999999999997,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.371,"5min":1.4490000000000001,"15min":2.762},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.0369999999999999},"min":{"1min":0.81200000000000006,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.389,"5min":1.5,"15min":1.9299999999999999},"last":1.254},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.04,"15min":1.0389999999999999},"min":{"1min":0.76800000000000002,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.3300000000000001,"5min":1.357,"15min":1.72},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2199552,"data_stored":971940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.23,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.437},"max":{"1min":1.153,"5min":1.264,"15min":2.1840000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.84199999999999997},"min":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.137,"5min":1.603,"15min":1.603},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2150000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.48599999999999999},"max":{"1min":1.1950000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.89500000000000002,"15min":0.93799999999999994},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1519999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1890000000000001,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.92900000000000005,"15min":0.95799999999999996},"min":{"1min":0.63700000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1060000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.88700000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.52500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2210000000000001,"5min":3.46,"15min":3.46},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.99099999999999999,"15min":1.0189999999999999},"min":{"1min":0.58499999999999996,"5min":0.441,"15min":0.441},"max":{"1min":1.1830000000000001,"5min":1.492,"15min":1.5049999999999999},"last":1.03}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.115,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.98499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.044,"15min":1.0800000000000001},"min":{"1min":0.63700000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2509999999999999,"5min":2.1600000000000001,"15min":2.246},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.075,"15min":1.107},"min":{"1min":0.58199999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1950000000000001,"5min":3.649,"15min":3.649},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2297856,"data_stored":1044546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.92100000000000004,"15min":0.84999999999999998},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4630000000000001,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.4630000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.88500000000000001,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1279999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.2589999999999999,"15min":1.536},"last":0.754},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.91800000000000004,"15min":0.89700000000000002},"min":{"1min":0.65900000000000003,"5min":0.502,"15min":0.499},"max":{"1min":1.3540000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.3540000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90300000000000002,"15min":0.88},"min":{"1min":0.68600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.123,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5049999999999999,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.5049999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93100000000000005,"15min":0.90900000000000003},"min":{"1min":0.72999999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2649999999999999,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":0.95199999999999996},"min":{"1min":0.74399999999999999,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3400000000000001,"5min":10.44,"15min":10.44},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96999999999999997,"15min":0.94999999999999996},"min":{"1min":0.69499999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2370000000000001,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":0.97599999999999998},"min":{"1min":0.69299999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.278,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.127,"15min":1.02},"min":{"1min":0.66300000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.403,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.298},{"interface":"front","average":{"1min":1.036,"5min":1.2350000000000001,"15min":1.0900000000000001},"min":{"1min":0.72599999999999998,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.6359999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.6359999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.22,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6279999999999999,"5min":15.593,"15min":15.593},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.77200000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.5389999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.5389999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41460,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330380,"statfs":{"total":96636764160,"available":96594309120,"internally_reserved":0,"allocated":2207744,"data_stored":971540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.32000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95099999999999996,"5min":1.444,"15min":2.113},"last":0.746},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.313,"15min":0.313},"max":{"1min":1.071,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.34599999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.022,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.623,"15min":0.63},"min":{"1min":0.312,"5min":0.222,"15min":0.222},"max":{"1min":1.0269999999999999,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1830000000000001,"5min":1.4850000000000001,"15min":1.742},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.137,"5min":1.222,"15min":1.399},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.94499999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.27,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.97499999999999998,"15min":1.0549999999999999},"min":{"1min":0.67700000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.266,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.93400000000000005,"15min":0.995},"min":{"1min":0.71299999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.8919999999999999},"last":1.05},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89500000000000002,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1259999999999999,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":1.0309999999999999},"min":{"1min":0.71399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.335,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.879},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.746,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.96},"last":0.98399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.042,"15min":1.075},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.357,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.04,"5min":0.98199999999999998,"15min":1.004},"min":{"1min":0.69499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2729999999999999,"5min":1.504,"15min":2.9220000000000002},"last":0.93400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41448,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330392,"statfs":{"total":96636764160,"available":96594321408,"internally_reserved":0,"allocated":2195456,"data_stored":971358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.308,"5min":0.246,"15min":0.246},"max":{"1min":0.98699999999999999,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.89800000000000002,"5min":1.1619999999999999,"15min":1.335},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.1579999999999999},"last":0.495},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.2190000000000001,"15min":1.423},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2250000000000001,"5min":1.46,"15min":1.46},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.1930000000000001,"5min":1.53,"15min":1.53},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.484,"5min":1.5309999999999999,"15min":1.611},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.90800000000000003},"min":{"1min":0.65800000000000003,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":1.1140000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.97599999999999998,"15min":0.98999999999999999},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.446,"5min":1.548,"15min":1.9179999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.98799999999999999,"15min":0.97599999999999998},"min":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4179999999999999,"5min":1.589,"15min":1.702},"last":0.96199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97299999999999998,"15min":0.95999999999999996},"min":{"1min":0.71799999999999997,"5min":0.55600000000000005,"15min":0.5},"max":{"1min":1.401,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1},{"interface":"front","average":{"1min":0.995,"5min":1.0149999999999999,"15min":1.032},"min":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.353,"5min":1.645,"15min":1.645},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.6240000000000001,"5min":1.843,"15min":1.843},"last":1.071},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":1.069},"min":{"1min":0.75700000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.522,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2215936,"data_stored":977495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.997,"5min":1.085,"15min":1.085},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.84599999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.0580000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.274,"5min":1.274,"15min":1.3680000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.423},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.60299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.05,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91100000000000003,"15min":0.91900000000000004},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.2410000000000001,"5min":1.393,"15min":1.393},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.262,"5min":1.367,"15min":1.4590000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.68999999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.359,"5min":1.71,"15min":1.71},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.242,"5min":1.335,"15min":1.653},"last":1.099},{"interface":"front","average":{"1min":1.01,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.323,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0169999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0329999999999999,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.4610000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.73699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.278,"5min":1.649,"15min":1.649},"last":1.1399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42048,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329792,"statfs":{"total":96636764160,"available":96593707008,"internally_reserved":0,"allocated":2805760,"data_stored":1567897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.147},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.755,"15min":0.76600000000000001},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":0.77200000000000002,"15min":0.68999999999999995},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":8.7729999999999997,"5min":8.7729999999999997,"15min":8.7729999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.7589999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.80100000000000005,"15min":0.76500000000000001},"min":{"1min":0.33900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88900000000000001,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.60899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":1.014}]},{"osd":5,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.58399999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.044,"15min":1.044},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0369999999999999,"15min":1.0629999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.97699999999999998,"15min":1.008},"min":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.139,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.071}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0209999999999999,"15min":1.0249999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.25,"5min":2.25,"15min":2.2949999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1120000000000001,"15min":1.1080000000000001},"min":{"1min":0.747,"5min":0.55800000000000005,"15min":0.49199999999999999},"max":{"1min":4.7080000000000002,"5min":4.7080000000000002,"15min":4.7080000000000002},"last":1.05}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:17.621 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:35:17.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.735+0000 7f4e27fea640 1 Processor -- start 2024-09-13T18:35:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e27fea640 1 -- start start 2024-09-13T18:35:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e27fea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e200cb980 0x7f4e200b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e27fea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e2006b850 0x7f4e200cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e27fea640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e200b1ac0 con 0x7f4e200cbd60 2024-09-13T18:35:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e27fea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200b3010 con 0x7f4e2006b850 2024-09-13T18:35:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e27fea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e20159ac0 con 0x7f4e200cb980 2024-09-13T18:35:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25585640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e2006b850 0x7f4e200cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25585640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e2006b850 0x7f4e200cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41220/0 (socket says 172.21.15.53:41220) 2024-09-13T18:35:17.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25585640 1 -- 172.21.15.53:0/970584272 learned_addr learned my addr 172.21.15.53:0/970584272 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:17.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25d86640 1 --2- 172.21.15.53:0/970584272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e200cb980 0x7f4e200b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25585640 1 -- 172.21.15.53:0/970584272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e200cb980 msgr2=0x7f4e200b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:17.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25585640 1 --2- 172.21.15.53:0/970584272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e200cb980 0x7f4e200b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25585640 1 -- 172.21.15.53:0/970584272 >> v1:172.21.15.87:6789/0 conn(0x7f4e200cbd60 legacy=0x7f4e2006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.739+0000 7f4e25585640 1 -- 172.21.15.53:0/970584272 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e20159da0 con 0x7f4e2006b850 2024-09-13T18:35:17.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e25585640 1 --2- 172.21.15.53:0/970584272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e2006b850 0x7f4e200cdd40 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098a0 tx=0x7f4e1401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef33fad4be7883c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e24d84640 1 -- 172.21.15.53:0/970584272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140ab680 con 0x7f4e2006b850 2024-09-13T18:35:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e24d84640 1 -- 172.21.15.53:0/970584272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140ab7e0 con 0x7f4e2006b850 2024-09-13T18:35:17.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e24d84640 1 -- 172.21.15.53:0/970584272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140abb70 con 0x7f4e2006b850 2024-09-13T18:35:17.743 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- 172.21.15.53:0/970584272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e2006b850 msgr2=0x7f4e200cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 --2- 172.21.15.53:0/970584272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e2006b850 0x7f4e200cdd40 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f4e140098a0 tx=0x7f4e1401c480 comp rx=0 tx=0).stop 2024-09-13T18:35:17.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- 172.21.15.53:0/970584272 shutdown_connections 2024-09-13T18:35:17.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 --2- 172.21.15.53:0/970584272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e2006b850 0x7f4e200cdd40 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 --2- 172.21.15.53:0/970584272 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e200cb980 0x7f4e200b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- 172.21.15.53:0/970584272 >> 172.21.15.53:0/970584272 conn(0x7f4e20065c80 msgr2=0x7f4e20066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:17.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- 172.21.15.53:0/970584272 shutdown_connections 2024-09-13T18:35:17.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- 172.21.15.53:0/970584272 wait complete. 2024-09-13T18:35:17.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 Processor -- start 2024-09-13T18:35:17.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- start start 2024-09-13T18:35:17.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e2006b850 0x7f4e2014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e200cb980 0x7f4e201f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e200cbd60 0x7f4e201583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2015af70 con 0x7f4e200cb980 2024-09-13T18:35:17.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2015b250 con 0x7f4e200cbd60 2024-09-13T18:35:17.749 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e27fea640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2015b530 con 0x7f4e2006b850 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e25585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e200cb980 0x7f4e201f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e25585640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e200cb980 0x7f4e201f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41222/0 (socket says 172.21.15.53:41222) 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.743+0000 7f4e25585640 1 -- 172.21.15.53:0/4259570878 learned_addr learned my addr 172.21.15.53:0/4259570878 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25d86640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e2006b850 0x7f4e2014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e26587640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e200cbd60 0x7f4e201583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25585640 1 -- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e2006b850 msgr2=0x7f4e2014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25585640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e2006b850 0x7f4e2014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.750 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25585640 1 -- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e200cbd60 msgr2=0x7f4e201583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25585640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e200cbd60 0x7f4e201583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25585640 1 -- 172.21.15.53:0/4259570878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140094d0 con 0x7f4e200cb980 2024-09-13T18:35:17.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25585640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e200cb980 0x7f4e201f5260 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f4e140ad040 tx=0x7f4e1401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e127fc640 1 -- 172.21.15.53:0/4259570878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140b4800 con 0x7f4e200cb980 2024-09-13T18:35:17.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e127fc640 1 -- 172.21.15.53:0/4259570878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140b4980 con 0x7f4e200cb980 2024-09-13T18:35:17.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2015b810 con 0x7f4e200cb980 2024-09-13T18:35:17.751 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e127fc640 1 -- 172.21.15.53:0/4259570878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140b4d30 con 0x7f4e200cb980 2024-09-13T18:35:17.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2014b3e0 con 0x7f4e200cb980 2024-09-13T18:35:17.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e20067400 con 0x7f4e200cb980 2024-09-13T18:35:17.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e127fc640 1 -- 172.21.15.53:0/4259570878 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f4e140be3f0 con 0x7f4e200cb980 2024-09-13T18:35:17.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e127fc640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e040671d0 0x7f4e04069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:17.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e127fc640 1 -- 172.21.15.53:0/4259570878 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e1411d7a0 con 0x7f4e200cb980 2024-09-13T18:35:17.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25d86640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e040671d0 0x7f4e04069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:17.752 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.747+0000 7f4e25d86640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e040671d0 0x7f4e04069690 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c007a60 tx=0x7f4e1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:17.753 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.751+0000 7f4e127fc640 1 -- 172.21.15.53:0/4259570878 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e140ec670 con 0x7f4e200cb980 2024-09-13T18:35:17.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.911+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e200b2810 con 0x7f4e040671d0 2024-09-13T18:35:17.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.915+0000 7f4e127fc640 1 -- 172.21.15.53:0/4259570878 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49431 (secure 0 0 0) 0x7f4e1c010990 con 0x7f4e040671d0 2024-09-13T18:35:17.916 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:17.916 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:35:17.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e040671d0 msgr2=0x7f4e04069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e040671d0 0x7f4e04069690 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c007a60 tx=0x7f4e1c008040 comp rx=0 tx=0).stop 2024-09-13T18:35:17.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e200cb980 msgr2=0x7f4e201f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e200cb980 0x7f4e201f5260 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f4e140ad040 tx=0x7f4e1401acc0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 shutdown_connections 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4e040671d0 0x7f4e04069690 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e200cbd60 0x7f4e201583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e200cb980 0x7f4e201f5260 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 --2- 172.21.15.53:0/4259570878 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e2006b850 0x7f4e2014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 >> 172.21.15.53:0/4259570878 conn(0x7f4e20065c80 msgr2=0x7f4e20066060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 shutdown_connections 2024-09-13T18:35:17.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:17.919+0000 7f4e27fea640 1 -- 172.21.15.53:0/4259570878 wait complete. 2024-09-13T18:35:17.934 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-09-13T18:35:15.913454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300224,"kb_used_data":18548,"kb_used_omap":12,"kb_used_meta":281587,"kb_avail":754674496,"statfs":{"total":773094113280,"available":772786683904,"internally_reserved":0,"allocated":18993152,"data_stored":9105445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":288345656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62469,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-4,"num_read_kb":-4,"num_write":-81,"num_write_kb":-93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002078"},"pg_stats":[{"pgid":"1.0","version":"75'128","reported_seq":334,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-13T18:34:52.849992+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:34:52.849992+0000","last_peered":"2024-09-13T18:34:52.849992+0000","last_clean":"2024-09-13T18:34:52.849992+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:34:52.849992+0000","last_undegraded":"2024-09-13T18:34:52.849992+0000","last_fullsized":"2024-09-13T18:34:52.849992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33912,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337928,"statfs":{"total":96636764160,"available":96602038272,"internally_reserved":0,"allocated":2867200,"data_stored":1628426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89100000000000001,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.3140000000000001,"5min":1.399,"15min":1.6439999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.92900000000000005,"15min":0.91300000000000003},"min":{"1min":0.70499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2589999999999999,"5min":1.333,"15min":1.4410000000000001},"last":1.1679999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.91300000000000003,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.7270000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.63300000000000001,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.3380000000000001,"5min":1.347,"15min":1.6060000000000001},"last":0.97099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.52800000000000002,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.077,"5min":1.276,"15min":1.276},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.874,"15min":0.88100000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.9830000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.86099999999999999,"15min":0.878},"min":{"1min":0.71999999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.448},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93700000000000006,"15min":0.93000000000000005},"min":{"1min":0.69799999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.397},"last":0.875}]},{"osd":4,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.626,"5min":0.59099999999999997,"15min":0.47599999999999998},"max":{"1min":1.1799999999999999,"5min":1.2569999999999999,"15min":1.3620000000000001},"last":1.085},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.61299999999999999,"15min":0.55800000000000005},"max":{"1min":1.2809999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.755}]},{"osd":5,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.70999999999999996,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.367,"5min":1.367,"15min":1.877},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.79500000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3109999999999999,"5min":1.409,"15min":1.409},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.042,"15min":1.0549999999999999},"min":{"1min":0.75800000000000001,"5min":0.69399999999999995,"15min":0.56899999999999995},"max":{"1min":1.25,"5min":1.476,"15min":1.476},"last":1.238},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0309999999999999,"15min":1.018},"min":{"1min":0.86099999999999999,"5min":0.65000000000000002,"15min":0.503},"max":{"1min":1.2490000000000001,"5min":1.361,"15min":1.506},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2203648,"data_stored":972243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.443,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.26,"5min":1.47,"15min":2.9990000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.80100000000000005,"15min":0.79700000000000004},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.1779999999999999,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.94699999999999995,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.577},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.92400000000000004},"min":{"1min":0.66500000000000004,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.208,"5min":1.218,"15min":1.464},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.60099999999999998,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.129,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.58199999999999996,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.25,"5min":1.673,"15min":2.4220000000000002},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90200000000000002,"15min":0.88700000000000001},"min":{"1min":0.59899999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.28,"5min":1.516,"15min":1.516},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89600000000000002,"15min":0.88700000000000001},"min":{"1min":0.72699999999999998,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.23,"5min":1.2669999999999999,"15min":1.306},"last":0.87}]},{"osd":4,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.94299999999999995,"15min":0.96499999999999997},"min":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":0.39000000000000001},"max":{"1min":1.1639999999999999,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.089,"5min":1.0549999999999999,"15min":1.0209999999999999},"min":{"1min":0.84399999999999997,"5min":0.68100000000000005,"15min":0.52800000000000002},"max":{"1min":1.224,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0960000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.92500000000000004,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.57699999999999996,"15min":0.439},"max":{"1min":1.2010000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.0269999999999999,"15min":1.0740000000000001},"min":{"1min":0.71699999999999997,"5min":0.60499999999999998,"15min":0.42099999999999999},"max":{"1min":1.371,"5min":1.4490000000000001,"15min":2.762},"last":0.99399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.0369999999999999},"min":{"1min":0.81200000000000006,"5min":0.59099999999999997,"15min":0.53300000000000003},"max":{"1min":1.389,"5min":1.5,"15min":1.9299999999999999},"last":1.254},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.04,"15min":1.0389999999999999},"min":{"1min":0.76800000000000002,"5min":0.63100000000000001,"15min":0.52400000000000002},"max":{"1min":1.3300000000000001,"5min":1.357,"15min":1.72},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2199552,"data_stored":971940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.23,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.437},"max":{"1min":1.153,"5min":1.264,"15min":2.1840000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.84199999999999997},"min":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.137,"5min":1.603,"15min":1.603},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2150000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.48599999999999999},"max":{"1min":1.1950000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.89500000000000002,"15min":0.93799999999999994},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1519999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1890000000000001,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.92900000000000005,"15min":0.95799999999999996},"min":{"1min":0.63700000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1060000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.88700000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.52500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2210000000000001,"5min":3.46,"15min":3.46},"last":1.3120000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.99099999999999999,"15min":1.0189999999999999},"min":{"1min":0.58499999999999996,"5min":0.441,"15min":0.441},"max":{"1min":1.1830000000000001,"5min":1.492,"15min":1.5049999999999999},"last":1.03}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.115,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.98499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.044,"15min":1.0800000000000001},"min":{"1min":0.63700000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2509999999999999,"5min":2.1600000000000001,"15min":2.246},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.075,"15min":1.107},"min":{"1min":0.58199999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1950000000000001,"5min":3.649,"15min":3.649},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2297856,"data_stored":1044546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.92100000000000004,"15min":0.84999999999999998},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4630000000000001,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.4630000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.88500000000000001,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1279999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.2589999999999999,"15min":1.536},"last":0.754},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.91800000000000004,"15min":0.89700000000000002},"min":{"1min":0.65900000000000003,"5min":0.502,"15min":0.499},"max":{"1min":1.3540000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":1.3540000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90300000000000002,"15min":0.88},"min":{"1min":0.68600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.123,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5049999999999999,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.5049999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93100000000000005,"15min":0.90900000000000003},"min":{"1min":0.72999999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2649999999999999,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":0.95199999999999996},"min":{"1min":0.74399999999999999,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3400000000000001,"5min":10.44,"15min":10.44},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96999999999999997,"15min":0.94999999999999996},"min":{"1min":0.69499999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2370000000000001,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":0.97599999999999998},"min":{"1min":0.69299999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.278,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.127,"15min":1.02},"min":{"1min":0.66300000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.403,"5min":19.254000000000001,"15min":19.254000000000001},"last":1.298},{"interface":"front","average":{"1min":1.036,"5min":1.2350000000000001,"15min":1.0900000000000001},"min":{"1min":0.72599999999999998,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.6359999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.6359999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.22,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6279999999999999,"5min":15.593,"15min":15.593},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.77200000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.5389999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.5389999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41460,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330380,"statfs":{"total":96636764160,"available":96594309120,"internally_reserved":0,"allocated":2207744,"data_stored":971540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.32000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95099999999999996,"5min":1.444,"15min":2.113},"last":0.746},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.313,"15min":0.313},"max":{"1min":1.071,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.34599999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.022,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.623,"15min":0.63},"min":{"1min":0.312,"5min":0.222,"15min":0.222},"max":{"1min":1.0269999999999999,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1830000000000001,"5min":1.4850000000000001,"15min":1.742},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.137,"5min":1.222,"15min":1.399},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.94499999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.27,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.97499999999999998,"15min":1.0549999999999999},"min":{"1min":0.67700000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.266,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.93400000000000005,"15min":0.995},"min":{"1min":0.71299999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.8919999999999999},"last":1.05},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89500000000000002,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1259999999999999,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":1.0309999999999999},"min":{"1min":0.71399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.335,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.879},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.746,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.96},"last":0.98399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.042,"15min":1.075},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.357,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.04,"5min":0.98199999999999998,"15min":1.004},"min":{"1min":0.69499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2729999999999999,"5min":1.504,"15min":2.9220000000000002},"last":0.93400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41448,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330392,"statfs":{"total":96636764160,"available":96594321408,"internally_reserved":0,"allocated":2195456,"data_stored":971358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.308,"5min":0.246,"15min":0.246},"max":{"1min":0.98699999999999999,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.89800000000000002,"5min":1.1619999999999999,"15min":1.335},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.1579999999999999},"last":0.495},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.2190000000000001,"15min":1.423},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2250000000000001,"5min":1.46,"15min":1.46},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.1930000000000001,"5min":1.53,"15min":1.53},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.484,"5min":1.5309999999999999,"15min":1.611},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.90800000000000003},"min":{"1min":0.65800000000000003,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":1.1140000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.97599999999999998,"15min":0.98999999999999999},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.446,"5min":1.548,"15min":1.9179999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.98799999999999999,"15min":0.97599999999999998},"min":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4179999999999999,"5min":1.589,"15min":1.702},"last":0.96199999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97299999999999998,"15min":0.95999999999999996},"min":{"1min":0.71799999999999997,"5min":0.55600000000000005,"15min":0.5},"max":{"1min":1.401,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1},{"interface":"front","average":{"1min":0.995,"5min":1.0149999999999999,"15min":1.032},"min":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.353,"5min":1.645,"15min":1.645},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.6240000000000001,"5min":1.843,"15min":1.843},"last":1.071},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":1.069},"min":{"1min":0.75700000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.522,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":0.80500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41472,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330368,"statfs":{"total":96636764160,"available":96594296832,"internally_reserved":0,"allocated":2215936,"data_stored":977495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.997,"5min":1.085,"15min":1.085},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.84599999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.0580000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.274,"5min":1.274,"15min":1.3680000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.423},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.60299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.05,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91100000000000003,"15min":0.91900000000000004},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.2410000000000001,"5min":1.393,"15min":1.393},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.262,"5min":1.367,"15min":1.4590000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.68999999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.359,"5min":1.71,"15min":1.71},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.242,"5min":1.335,"15min":1.653},"last":1.099},{"interface":"front","average":{"1min":1.01,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.323,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0169999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0329999999999999,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.4610000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.73699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.278,"5min":1.649,"15min":1.649},"last":1.1399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42048,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329792,"statfs":{"total":96636764160,"available":96593707008,"internally_reserved":0,"allocated":2805760,"data_stored":1567897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.147},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.755,"15min":0.76600000000000001},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":0.77200000000000002,"15min":0.68999999999999995},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":8.7729999999999997,"5min":8.7729999999999997,"15min":8.7729999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.54800000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.7589999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.80100000000000005,"15min":0.76500000000000001},"min":{"1min":0.33900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88900000000000001,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.60899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":1.014}]},{"osd":5,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.58399999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.044,"15min":1.044},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0369999999999999,"15min":1.0629999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.97699999999999998,"15min":1.008},"min":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.139,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.071}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0209999999999999,"15min":1.0249999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.25,"5min":2.25,"15min":2.2949999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1120000000000001,"15min":1.1080000000000001},"min":{"1min":0.747,"5min":0.55800000000000005,"15min":0.49199999999999999},"max":{"1min":4.7080000000000002,"5min":4.7080000000000002,"15min":4.7080000000000002},"last":1.05}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:17.936 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:18.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18fcc9b640 1 Processor -- start 2024-09-13T18:35:18.062 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18fcc9b640 1 -- start start 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18fcc9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18f81582a0 0x7f18f806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18fcc9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18f815b7c0 0x7f18f806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18fcc9b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f806d480 con 0x7f18f8070c90 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18fcc9b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f815aaf0 con 0x7f18f81582a0 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18fcc9b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f806d760 con 0x7f18f815b7c0 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18f659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18f81582a0 0x7f18f806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18f659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f18f81582a0 0x7f18f806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41226/0 (socket says 172.21.15.53:41226) 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18f659c640 1 -- 172.21.15.53:0/2716102462 learned_addr learned my addr 172.21.15.53:0/2716102462 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:18.064 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18edd9b640 1 --2- 172.21.15.53:0/2716102462 >> v2:172.21.15.87:3300/0 conn(0x7f18f815b7c0 0x7f18f806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18f659c640 1 -- 172.21.15.53:0/2716102462 >> v2:172.21.15.87:3300/0 conn(0x7f18f815b7c0 msgr2=0x7f18f806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18f659c640 1 --2- 172.21.15.53:0/2716102462 >> v2:172.21.15.87:3300/0 conn(0x7f18f815b7c0 0x7f18f806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18f659c640 1 -- 172.21.15.53:0/2716102462 >> v1:172.21.15.87:6789/0 conn(0x7f18f8070c90 legacy=0x7f18f806f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.065 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.063+0000 7f18f659c640 1 -- 172.21.15.53:0/2716102462 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f815ace0 con 0x7f18f81582a0 2024-09-13T18:35:18.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18f659c640 1 --2- 172.21.15.53:0/2716102462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f806c900 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f18f80ce220 tx=0x7f18e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df21b5d43fcdc24b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18f5d9b640 1 -- 172.21.15.53:0/2716102462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80ab5f0 con 0x7f18f81582a0 2024-09-13T18:35:18.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18f5d9b640 1 -- 172.21.15.53:0/2716102462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e80ab750 con 0x7f18f81582a0 2024-09-13T18:35:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18f5d9b640 1 -- 172.21.15.53:0/2716102462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80abae0 con 0x7f18f81582a0 2024-09-13T18:35:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 -- 172.21.15.53:0/2716102462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 msgr2=0x7f18f806c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/2716102462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f806c900 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f18f80ce220 tx=0x7f18e801c4f0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.067 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 -- 172.21.15.53:0/2716102462 shutdown_connections 2024-09-13T18:35:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/2716102462 >> v2:172.21.15.87:3300/0 conn(0x7f18f815b7c0 0x7f18f806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/2716102462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f806c900 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 -- 172.21.15.53:0/2716102462 >> 172.21.15.53:0/2716102462 conn(0x7f18f8065c80 msgr2=0x7f18f8066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 -- 172.21.15.53:0/2716102462 shutdown_connections 2024-09-13T18:35:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.067+0000 7f18fcc9b640 1 -- 172.21.15.53:0/2716102462 wait complete. 2024-09-13T18:35:18.068 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 Processor -- start 2024-09-13T18:35:18.069 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 -- start start 2024-09-13T18:35:18.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f8070c90 0x7f18f814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f814c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18f815b7c0 0x7f18f814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.070 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f814abb0 con 0x7f18f81582a0 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f814ceb0 con 0x7f18f8070c90 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8154350 con 0x7f18f815b7c0 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f814c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f814c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41240/0 (socket says 172.21.15.53:41240) 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 -- 172.21.15.53:0/3393353073 learned_addr learned my addr 172.21.15.53:0/3393353073 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18f659c640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f8070c90 0x7f18f814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18f6d9d640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18f815b7c0 0x7f18f814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 -- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18f815b7c0 msgr2=0x7f18f814e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18f815b7c0 0x7f18f814e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 -- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f8070c90 msgr2=0x7f18f814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f8070c90 0x7f18f814a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 -- 172.21.15.53:0/3393353073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e80094d0 con 0x7f18f81582a0 2024-09-13T18:35:18.071 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18edd9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f814c970 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e8a0 tx=0x7f18e000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18ef7fe640 1 -- 172.21.15.53:0/3393353073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0009530 con 0x7f18f81582a0 2024-09-13T18:35:18.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18ef7fe640 1 -- 172.21.15.53:0/3393353073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000c940 con 0x7f18f81582a0 2024-09-13T18:35:18.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f814eae0 con 0x7f18f81582a0 2024-09-13T18:35:18.072 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18ef7fe640 1 -- 172.21.15.53:0/3393353073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000ccd0 con 0x7f18f81582a0 2024-09-13T18:35:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.071+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f8153d00 con 0x7f18f81582a0 2024-09-13T18:35:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.075+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8067400 con 0x7f18f81582a0 2024-09-13T18:35:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.075+0000 7f18ef7fe640 1 -- 172.21.15.53:0/3393353073 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f18e0013470 con 0x7f18f81582a0 2024-09-13T18:35:18.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.075+0000 7f18ef7fe640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d80671d0 0x7f18d8069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:18.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.075+0000 7f18ef7fe640 1 -- 172.21.15.53:0/3393353073 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f18e0082ef0 con 0x7f18f81582a0 2024-09-13T18:35:18.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.075+0000 7f18f659c640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d80671d0 0x7f18d8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:18.074 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.075+0000 7f18f659c640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d80671d0 0x7f18d8069690 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f18e80af000 tx=0x7f18e80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.079+0000 7f18ef7fe640 1 -- 172.21.15.53:0/3393353073 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18e00519e0 con 0x7f18f81582a0 2024-09-13T18:35:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.239+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18f806f370 con 0x7f18f81582a0 2024-09-13T18:35:18.240 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.239+0000 7f18ef7fe640 1 -- 172.21.15.53:0/3393353073 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+12936 (secure 0 0 0) 0x7f18e0055000 con 0x7f18f81582a0 2024-09-13T18:35:18.240 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":177,"fsid":"21cb0879-c92b-403a-9019-7dc078f2eb89","created":"2024-09-13T18:24:34.176721+0000","modified":"2024-09-13T18:35:15.058474+0000","last_up_change":"2024-09-13T18:24:44.810114+0000","last_in_change":"2024-09-13T18:24:36.352339+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:24:44.982186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39241a34-8dad-4376-91ca-3af581f83ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6818","nonce":4131236486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6822","nonce":4131236486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6830","nonce":4131236486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":4131236486},{"type":"v1","addr":"172.21.15.53:6826","nonce":4131236486}]},"public_addr":"172.21.15.53:6818/4131236486","cluster_addr":"172.21.15.53:6822/4131236486","heartbeat_back_addr":"172.21.15.53:6830/4131236486","heartbeat_front_addr":"172.21.15.53:6826/4131236486","state":["exists","up"]},{"osd":1,"uuid":"fd62939e-f82f-4f73-8db2-2c4710fd424f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6801","nonce":3812387586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6803","nonce":3812387586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6807","nonce":3812387586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3812387586},{"type":"v1","addr":"172.21.15.53:6805","nonce":3812387586}]},"public_addr":"172.21.15.53:6801/3812387586","cluster_addr":"172.21.15.53:6803/3812387586","heartbeat_back_addr":"172.21.15.53:6807/3812387586","heartbeat_front_addr":"172.21.15.53:6805/3812387586","state":["exists","up"]},{"osd":2,"uuid":"f642b9a8-64f4-4099-beac-c89a8f61e876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6817","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6819","nonce":483943031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6821","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6823","nonce":483943031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6829","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6831","nonce":483943031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6825","nonce":483943031},{"type":"v1","addr":"172.21.15.53:6827","nonce":483943031}]},"public_addr":"172.21.15.53:6819/483943031","cluster_addr":"172.21.15.53:6823/483943031","heartbeat_back_addr":"172.21.15.53:6831/483943031","heartbeat_front_addr":"172.21.15.53:6827/483943031","state":["exists","up"]},{"osd":3,"uuid":"1e31b766-00e6-4bc7-84a5-213d85588afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6809","nonce":205095619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6811","nonce":205095619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6815","nonce":205095619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":205095619},{"type":"v1","addr":"172.21.15.53:6813","nonce":205095619}]},"public_addr":"172.21.15.53:6809/205095619","cluster_addr":"172.21.15.53:6811/205095619","heartbeat_back_addr":"172.21.15.53:6815/205095619","heartbeat_front_addr":"172.21.15.53:6813/205095619","state":["exists","up"]},{"osd":4,"uuid":"fa6d18b2-7162-473a-bc00-a4afa0ec5d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6817","nonce":2745365769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6819","nonce":2745365769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6823","nonce":2745365769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2745365769},{"type":"v1","addr":"172.21.15.87:6821","nonce":2745365769}]},"public_addr":"172.21.15.87:6817/2745365769","cluster_addr":"172.21.15.87:6819/2745365769","heartbeat_back_addr":"172.21.15.87:6823/2745365769","heartbeat_front_addr":"172.21.15.87:6821/2745365769","state":["exists","up"]},{"osd":5,"uuid":"9580adcc-abf7-47c1-96f8-e75a689d958d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6809","nonce":4170330072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6811","nonce":4170330072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6815","nonce":4170330072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":4170330072},{"type":"v1","addr":"172.21.15.87:6813","nonce":4170330072}]},"public_addr":"172.21.15.87:6809/4170330072","cluster_addr":"172.21.15.87:6811/4170330072","heartbeat_back_addr":"172.21.15.87:6815/4170330072","heartbeat_front_addr":"172.21.15.87:6813/4170330072","state":["exists","up"]},{"osd":6,"uuid":"78e61f4b-6f58-4b3a-af88-3e81bc0ff09f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6825","nonce":2962233579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6827","nonce":2962233579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6831","nonce":2962233579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2962233579},{"type":"v1","addr":"172.21.15.87:6829","nonce":2962233579}]},"public_addr":"172.21.15.87:6825/2962233579","cluster_addr":"172.21.15.87:6827/2962233579","heartbeat_back_addr":"172.21.15.87:6831/2962233579","heartbeat_front_addr":"172.21.15.87:6829/2962233579","state":["exists","up"]},{"osd":7,"uuid":"c798335c-3ff3-4bdb-afbb-13d9c08bf549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6801","nonce":3723126663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6803","nonce":3723126663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6807","nonce":3723126663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":3723126663},{"type":"v1","addr":"172.21.15.87:6805","nonce":3723126663}]},"public_addr":"172.21.15.87:6801/3723126663","cluster_addr":"172.21.15.87:6803/3723126663","heartbeat_back_addr":"172.21.15.87:6807/3723126663","heartbeat_front_addr":"172.21.15.87:6805/3723126663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.846029+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.758512+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811191+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.880996+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.869710+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.841774+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.977274+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.811468+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1295090105":"2024-09-14T18:35:11.920784+0000","172.21.15.53:6834/1295090105":"2024-09-14T18:35:11.920784+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d80671d0 msgr2=0x7f18d8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d80671d0 0x7f18d8069690 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f18e80af000 tx=0x7f18e80a7000 comp rx=0 tx=0).stop 2024-09-13T18:35:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 msgr2=0x7f18f814c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f814c970 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e8a0 tx=0x7f18e000ed60 comp rx=0 tx=0).stop 2024-09-13T18:35:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 shutdown_connections 2024-09-13T18:35:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f18d80671d0 0x7f18d8069690 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f18f815b7c0 0x7f18f814e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18f81582a0 0x7f18f814c970 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 --2- 172.21.15.53:0/3393353073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18f8070c90 0x7f18f814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 >> 172.21.15.53:0/3393353073 conn(0x7f18f8065c80 msgr2=0x7f18f80af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 shutdown_connections 2024-09-13T18:35:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:18.243+0000 7f18fcc9b640 1 -- 172.21.15.53:0/3393353073 wait complete. 2024-09-13T18:35:19.260 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:35:19.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:19.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.403+0000 7f0f48054640 1 Processor -- start 2024-09-13T18:35:19.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.403+0000 7f0f48054640 1 -- start start 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.403+0000 7f0f48054640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 0x7f0f40165060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.403+0000 7f0f48054640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f400b1ba0 con 0x7f0f400cdad0 2024-09-13T18:35:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.403+0000 7f0f48054640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f400b3020 con 0x7f0f400cd6f0 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f48054640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400b1f80 con 0x7f0f40143f20 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f455ef640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0f400cdad0 0x7f0f40143810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43592/0 (socket says 172.21.15.53:43592) 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f455ef640 1 -- 172.21.15.53:0/2844005952 learned_addr learned my addr 172.21.15.53:0/2844005952 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f465f1640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 0x7f0f40165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903998700 0 0) 0x7f0f400b1ba0 con 0x7f0f400cdad0 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f2c003530 con 0x7f0f400cdad0 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 291240537 0 0) 0x7f0f2c003530 con 0x7f0f400cdad0 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 msgr2=0x7f0f40165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 0x7f0f40165060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 >> v1:172.21.15.87:6789/0 conn(0x7f0f400cd6f0 legacy=0x7f0f400b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f400b2260 con 0x7f0f400cdad0 2024-09-13T18:35:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f0f300016a0 con 0x7f0f400cdad0 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 >> v1:172.21.15.53:6789/0 conn(0x7f0f400cdad0 legacy=0x7f0f40143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f2c0047d0 0x7f0f2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 0x7f0f2c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400b1f80 con 0x7f0f2c0039b0 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c00baf0 con 0x7f0f2c0047d0 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c00bcb0 con 0x7f0f40143f20 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f45df0640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f455ef640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f2c0047d0 0x7f0f2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f465f1640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 0x7f0f2c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f45df0640 1 -- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 msgr2=0x7f0f2c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f45df0640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f40143f20 0x7f0f2c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f45df0640 1 -- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f2c0047d0 msgr2=0x7f0f2c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f45df0640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f2c0047d0 0x7f0f2c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f45df0640 1 -- 172.21.15.53:0/2844005952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c003530 con 0x7f0f2c0039b0 2024-09-13T18:35:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f45df0640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c001780 tx=0x7f0f3c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcef383706ee3a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0052d0 con 0x7f0f2c0039b0 2024-09-13T18:35:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c005450 con 0x7f0f2c0039b0 2024-09-13T18:35:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.407+0000 7f0f44dee640 1 -- 172.21.15.53:0/2844005952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c003840 con 0x7f0f2c0039b0 2024-09-13T18:35:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- 172.21.15.53:0/2844005952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2c0039b0 msgr2=0x7f0f2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 --2- 172.21.15.53:0/2844005952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c001780 tx=0x7f0f3c01c3f0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 -- 172.21.15.53:0/2844005952 reap_dead start 2024-09-13T18:35:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- 172.21.15.53:0/2844005952 shutdown_connections 2024-09-13T18:35:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- 172.21.15.53:0/2844005952 >> 172.21.15.53:0/2844005952 conn(0x7f0f40073330 msgr2=0x7f0f40065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- 172.21.15.53:0/2844005952 shutdown_connections 2024-09-13T18:35:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- 172.21.15.53:0/2844005952 wait complete. 2024-09-13T18:35:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 Processor -- start 2024-09-13T18:35:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- start start 2024-09-13T18:35:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f2c0039b0 0x7f0f4015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f4015f2a0 0x7f0f4015f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f4015fc40 0x7f0f401600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400a9250 con 0x7f0f4015fc40 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40162310 con 0x7f0f4015f2a0 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400a85f0 con 0x7f0f2c0039b0 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f4015fc40 0x7f0f401600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f4015fc40 0x7f0f401600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41254/0 (socket says 172.21.15.53:41254) 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 -- 172.21.15.53:0/2473729948 learned_addr learned my addr 172.21.15.53:0/2473729948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f455ef640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f4015f2a0 0x7f0f4015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f45df0640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f2c0039b0 0x7f0f4015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 -- 172.21.15.53:0/2473729948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f2c0039b0 msgr2=0x7f0f4015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0f2c0039b0 0x7f0f4015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 -- 172.21.15.53:0/2473729948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f4015f2a0 msgr2=0x7f0f4015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f4015f2a0 0x7f0f4015f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 -- 172.21.15.53:0/2473729948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f400a88b0 con 0x7f0f4015fc40 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f455ef640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f4015f2a0 0x7f0f4015f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f465f1640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f4015fc40 0x7f0f401600c0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f0f400cae20 tx=0x7f0f380115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800e070 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f38011ed0 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f400a8b90 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380039a0 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.411+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4015d430 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f4006c330 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f0f38003b00 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f367fc640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f24067200 0x7f0f240696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0f38083ec0 con 0x7f0f4015fc40 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f45df0640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f24067200 0x7f0f240696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f367fc640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f0f2406d060 0x7f0f2406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 --> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f2406fb30 con 0x7f0f2406d060 2024-09-13T18:35:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f38086600 con 0x7f0f4015fc40 2024-09-13T18:35:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f455ef640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f0f2406d060 0x7f0f2406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f45df0640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f24067200 0x7f0f240696c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c001750 tx=0x7f0f3c0011a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f455ef640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f0f2406d060 0x7f0f2406f480 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.415+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== osd.0 v2:172.21.15.53:6816/4131236486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f2406fb30 con 0x7f0f2406d060 2024-09-13T18:35:19.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 --> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0f400cbdd0 con 0x7f0f2406d060 2024-09-13T18:35:19.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f367fc640 1 -- 172.21.15.53:0/2473729948 <== osd.0 v2:172.21.15.53:6816/4131236486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0f30001680 con 0x7f0f2406d060 2024-09-13T18:35:19.428 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:19.428 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:19.429 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:19.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f0f2406d060 msgr2=0x7f0f2406f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6816/4131236486,v1:172.21.15.53:6818/4131236486] conn(0x7f0f2406d060 0x7f0f2406f480 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f24067200 msgr2=0x7f0f240696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0f24067200 0x7f0f240696c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c001750 tx=0x7f0f3c0011a0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f4015fc40 msgr2=0x7f0f401600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 --2- 172.21.15.53:0/2473729948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f4015fc40 0x7f0f401600c0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f0f400cae20 tx=0x7f0f380115a0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f465f1640 1 -- 172.21.15.53:0/2473729948 reap_dead start 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.427+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 shutdown_connections 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.431+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 >> 172.21.15.53:0/2473729948 conn(0x7f0f40073330 msgr2=0x7f0f400b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.431+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 shutdown_connections 2024-09-13T18:35:19.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.431+0000 7f0f48054640 1 -- 172.21.15.53:0/2473729948 wait complete. 2024-09-13T18:35:19.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:35:19.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe845727640 1 Processor -- start 2024-09-13T18:35:19.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe845727640 1 -- start start 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe845727640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 0x7fe8400cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe845727640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8400d2400 con 0x7fe8400cf600 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe845727640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8400d1530 con 0x7fe84015cab0 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe845727640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400cfab0 con 0x7fe8400d19c0 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe8400cf600 0x7fe8400b5870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43594/0 (socket says 172.21.15.53:43594) 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83f7fe640 1 -- 172.21.15.53:0/4033427596 learned_addr learned my addr 172.21.15.53:0/4033427596 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83e7fc640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 0x7fe8400cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620070553 0 0) 0x7fe8400d2400 con 0x7fe8400cf600 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe828003530 con 0x7fe8400cf600 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 409925424 0 0) 0x7fe828003530 con 0x7fe8400cf600 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 msgr2=0x7fe8400cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 0x7fe8400cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 >> v1:172.21.15.87:6789/0 conn(0x7fe84015cab0 legacy=0x7fe8400cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400cddd0 con 0x7fe8400cf600 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fe834001680 con 0x7fe8400cf600 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 >> v1:172.21.15.53:6789/0 conn(0x7fe8400cf600 legacy=0x7fe8400b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8280039b0 0x7fe828003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828004360 0x7fe828004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 0x7fe828005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400cfab0 con 0x7fe8280039b0 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82800b9c0 con 0x7fe828004360 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82800bb80 con 0x7fe8400d19c0 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83effd640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8280039b0 0x7fe828003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83e7fc640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828004360 0x7fe828004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83f7fe640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 0x7fe828005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83effd640 1 -- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 msgr2=0x7fe828005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83effd640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8400d19c0 0x7fe828005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83effd640 1 -- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828004360 msgr2=0x7fe828004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83effd640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828004360 0x7fe828004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83effd640 1 -- 172.21.15.53:0/4033427596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828003530 con 0x7fe8280039b0 2024-09-13T18:35:19.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.563+0000 7fe83e7fc640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828004360 0x7fe828004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe83effd640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8280039b0 0x7fe828003d90 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7fe830001860 tx=0x7fe83001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eade77fbbbb7a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8300ab600 con 0x7fe8280039b0 2024-09-13T18:35:19.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8300a7050 con 0x7fe8280039b0 2024-09-13T18:35:19.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe83dffb640 1 -- 172.21.15.53:0/4033427596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8300ab9a0 con 0x7fe8280039b0 2024-09-13T18:35:19.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- 172.21.15.53:0/4033427596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8280039b0 msgr2=0x7fe828003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 --2- 172.21.15.53:0/4033427596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8280039b0 0x7fe828003d90 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7fe830001860 tx=0x7fe83001c520 comp rx=0 tx=0).stop 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe83f7fe640 1 -- 172.21.15.53:0/4033427596 reap_dead start 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- 172.21.15.53:0/4033427596 shutdown_connections 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- 172.21.15.53:0/4033427596 >> 172.21.15.53:0/4033427596 conn(0x7fe840065c80 msgr2=0x7fe840066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- 172.21.15.53:0/4033427596 shutdown_connections 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- 172.21.15.53:0/4033427596 wait complete. 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 Processor -- start 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- start start 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8280039b0 0x7fe8400c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe840149d90 0x7fe8400b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe840156460 0x7fe8400b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84014fa90 con 0x7fe840149d90 2024-09-13T18:35:19.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe840155fd0 con 0x7fe840156460 2024-09-13T18:35:19.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.567+0000 7fe845727640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84014f4d0 con 0x7fe8280039b0 2024-09-13T18:35:19.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe840149d90 0x7fe8400b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe840149d90 0x7fe8400b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41258/0 (socket says 172.21.15.53:41258) 2024-09-13T18:35:19.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 -- 172.21.15.53:0/1534823032 learned_addr learned my addr 172.21.15.53:0/1534823032 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:19.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83f7fe640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe840156460 0x7fe8400b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83effd640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8280039b0 0x7fe8400c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 -- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8280039b0 msgr2=0x7fe8400c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8280039b0 0x7fe8400c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 -- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe840156460 msgr2=0x7fe8400b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe840156460 0x7fe8400b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 -- 172.21.15.53:0/1534823032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84014f7b0 con 0x7fe840149d90 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83f7fe640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe840156460 0x7fe8400b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83e7fc640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe840149d90 0x7fe8400b6ec0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7fe838007f60 tx=0x7fe838007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe8277fe640 1 -- 172.21.15.53:0/1534823032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800e030 con 0x7fe840149d90 2024-09-13T18:35:19.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe8277fe640 1 -- 172.21.15.53:0/1534823032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838016470 con 0x7fe840149d90 2024-09-13T18:35:19.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe840155c60 con 0x7fe840149d90 2024-09-13T18:35:19.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe8277fe640 1 -- 172.21.15.53:0/1534823032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838016820 con 0x7fe840149d90 2024-09-13T18:35:19.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe840165670 con 0x7fe840149d90 2024-09-13T18:35:19.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe840165860 con 0x7fe840149d90 2024-09-13T18:35:19.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe8277fe640 1 -- 172.21.15.53:0/1534823032 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fe838016980 con 0x7fe840149d90 2024-09-13T18:35:19.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe8277fe640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe82c067200 0x7fe82c0696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83effd640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe82c067200 0x7fe82c0696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe8277fe640 1 -- 172.21.15.53:0/1534823032 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe83800f070 con 0x7fe840149d90 2024-09-13T18:35:19.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.571+0000 7fe83effd640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe82c067200 0x7fe82c0696c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe8300ad000 tx=0x7fe8300a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.575+0000 7fe8277fe640 1 -- 172.21.15.53:0/1534823032 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8380527d0 con 0x7fe840149d90 2024-09-13T18:35:19.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8400d05b0 con 0x7fe82c067200 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe8277fe640 1 -- 172.21.15.53:0/1534823032 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe830006a20 con 0x7fe82c067200 2024-09-13T18:35:19.738 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe82c067200 msgr2=0x7fe82c0696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe82c067200 0x7fe82c0696c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe8300ad000 tx=0x7fe8300a6000 comp rx=0 tx=0).stop 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe840149d90 msgr2=0x7fe8400b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe840149d90 0x7fe8400b6ec0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7fe838007f60 tx=0x7fe838007f90 comp rx=0 tx=0).stop 2024-09-13T18:35:19.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 shutdown_connections 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fe82c067200 0x7fe82c0696c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe840156460 0x7fe8400b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe840149d90 0x7fe8400b6ec0 unknown :-1 s=CLOSED pgs=2477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 --2- 172.21.15.53:0/1534823032 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8280039b0 0x7fe8400c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 >> 172.21.15.53:0/1534823032 conn(0x7fe840065c80 msgr2=0x7fe84015b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 shutdown_connections 2024-09-13T18:35:19.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.739+0000 7fe845727640 1 -- 172.21.15.53:0/1534823032 wait complete. 2024-09-13T18:35:19.757 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:35:19.757 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a89211640 1 Processor -- start 2024-09-13T18:35:19.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a89211640 1 -- start start 2024-09-13T18:35:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a89211640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 0x7f4a840ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a89211640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840706a0 con 0x7f4a84145900 2024-09-13T18:35:19.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a89211640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a84070190 con 0x7f4a84145e50 2024-09-13T18:35:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a89211640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840b26d0 con 0x7f4a84145400 2024-09-13T18:35:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a8259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4a84145900 0x7f4a8406f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43610/0 (socket says 172.21.15.53:43610) 2024-09-13T18:35:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a8259c640 1 -- 172.21.15.53:0/4044566129 learned_addr learned my addr 172.21.15.53:0/4044566129 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 0x7f4a840ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524740567 0 0) 0x7f4a78001120 con 0x7f4a84145900 2024-09-13T18:35:19.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c003530 con 0x7f4a84145900 2024-09-13T18:35:19.885 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199824696 0 0) 0x7f4a6c003530 con 0x7f4a84145900 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 msgr2=0x7f4a840ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 0x7f4a840ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 >> v1:172.21.15.87:6789/0 conn(0x7f4a84145e50 legacy=0x7f4a8406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840b3920 con 0x7f4a84145900 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f4a78001810 con 0x7f4a84145900 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 >> v1:172.21.15.53:6789/0 conn(0x7f4a84145900 legacy=0x7f4a8406f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c0039b0 0x7f4a6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a6c0047d0 0x7f4a6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.886 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 0x7f4a6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840b26d0 con 0x7f4a6c0039b0 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00ba70 con 0x7f4a6c0047d0 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c00bc30 con 0x7f4a84145400 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c0039b0 0x7f4a6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a8259c640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a6c0047d0 0x7f4a6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.883+0000 7f4a8359e640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 0x7f4a6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a82d9d640 1 -- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 msgr2=0x7f4a6c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a84145400 0x7f4a6c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a82d9d640 1 -- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a6c0047d0 msgr2=0x7f4a6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a6c0047d0 0x7f4a6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a82d9d640 1 -- 172.21.15.53:0/4044566129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c003530 con 0x7f4a6c0039b0 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c0039b0 0x7f4a6c003dd0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009ab0 tx=0x7f4a7401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76900db3fca8d3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740a55f0 con 0x7f4a6c0039b0 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a740a5750 con 0x7f4a6c0039b0 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a81d9b640 1 -- 172.21.15.53:0/4044566129 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740a5b00 con 0x7f4a6c0039b0 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a89211640 1 -- 172.21.15.53:0/4044566129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c0039b0 msgr2=0x7f4a6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a89211640 1 --2- 172.21.15.53:0/4044566129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c0039b0 0x7f4a6c003dd0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009ab0 tx=0x7f4a7401ca00 comp rx=0 tx=0).stop 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a8359e640 1 -- 172.21.15.53:0/4044566129 reap_dead start 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a89211640 1 -- 172.21.15.53:0/4044566129 shutdown_connections 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a89211640 1 -- 172.21.15.53:0/4044566129 >> 172.21.15.53:0/4044566129 conn(0x7f4a84073330 msgr2=0x7f4a84065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a89211640 1 -- 172.21.15.53:0/4044566129 shutdown_connections 2024-09-13T18:35:19.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.887+0000 7f4a89211640 1 -- 172.21.15.53:0/4044566129 wait complete. 2024-09-13T18:35:19.891 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 Processor -- start 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 -- start start 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a841447f0 0x7f4a840cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a840cb950 0x7f4a840cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a84142b60 0x7f4a84142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84142740 con 0x7f4a84142b60 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8413b7f0 con 0x7f4a840cb950 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841389f0 con 0x7f4a841447f0 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a84142b60 0x7f4a84142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a84142b60 0x7f4a84142fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41272/0 (socket says 172.21.15.53:41272) 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 -- 172.21.15.53:0/1140212201 learned_addr learned my addr 172.21.15.53:0/1140212201 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8259c640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a840cb950 0x7f4a840cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a841447f0 0x7f4a840cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 -- 172.21.15.53:0/1140212201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a841447f0 msgr2=0x7f4a840cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4a841447f0 0x7f4a840cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 -- 172.21.15.53:0/1140212201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a840cb950 msgr2=0x7f4a840cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a840cb950 0x7f4a840cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 -- 172.21.15.53:0/1140212201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a84141da0 con 0x7f4a84142b60 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a8359e640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a84142b60 0x7f4a84142fe0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00e780 tx=0x7f4a7c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00eec0 con 0x7f4a84142b60 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c003980 con 0x7f4a84142b60 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a84142080 con 0x7f4a84142b60 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c003d10 con 0x7f4a84142b60 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a84143520 con 0x7f4a84142b60 2024-09-13T18:35:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.891+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a84138510 con 0x7f4a84142b60 2024-09-13T18:35:19.894 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f4a7c0050d0 con 0x7f4a84142b60 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a6b7fe640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a70067200 0x7f4a700696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4a7c083010 con 0x7f4a84142b60 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a70067200 0x7f4a700696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a6b7fe640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f4a7006d060 0x7f4a7006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 --> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a7006fb30 con 0x7f4a7006d060 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a7c085af0 con 0x7f4a84142b60 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a8259c640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f4a7006d060 0x7f4a7006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a8259c640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f4a7006d060 0x7f4a7006f480 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a82d9d640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a70067200 0x7f4a700696c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4a740af000 tx=0x7f4a740046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.895+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== osd.1 v2:172.21.15.53:6800/3812387586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4a7006fb30 con 0x7f4a7006d060 2024-09-13T18:35:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 --> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a84160f90 con 0x7f4a7006d060 2024-09-13T18:35:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a6b7fe640 1 -- 172.21.15.53:0/1140212201 <== osd.1 v2:172.21.15.53:6800/3812387586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4a78005b90 con 0x7f4a7006d060 2024-09-13T18:35:19.908 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:19.908 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:19.908 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f4a7006d060 msgr2=0x7f4a7006f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6800/3812387586,v1:172.21.15.53:6801/3812387586] conn(0x7f4a7006d060 0x7f4a7006f480 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a70067200 msgr2=0x7f4a700696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f4a70067200 0x7f4a700696c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4a740af000 tx=0x7f4a740046d0 comp rx=0 tx=0).stop 2024-09-13T18:35:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a84142b60 msgr2=0x7f4a84142fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 --2- 172.21.15.53:0/1140212201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a84142b60 0x7f4a84142fe0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00e780 tx=0x7f4a7c00eb80 comp rx=0 tx=0).stop 2024-09-13T18:35:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a8359e640 1 -- 172.21.15.53:0/1140212201 reap_dead start 2024-09-13T18:35:19.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 shutdown_connections 2024-09-13T18:35:19.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 >> 172.21.15.53:0/1140212201 conn(0x7f4a84073330 msgr2=0x7f4a840b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:19.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 shutdown_connections 2024-09-13T18:35:19.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:19.907+0000 7f4a89211640 1 -- 172.21.15.53:0/1140212201 wait complete. 2024-09-13T18:35:19.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:35:20.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e71a7640 1 Processor -- start 2024-09-13T18:35:20.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e71a7640 1 -- start start 2024-09-13T18:35:20.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e71a7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61e0146270 0x7f61e0160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e71a7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e00ac8e0 0x7f61e00ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e71a7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00adcd0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e71a7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e00ad0c0 con 0x7f61e0146270 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e71a7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00ad3a0 con 0x7f61e00ac8e0 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e4f43640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61e0146270 0x7f61e0160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e4f43640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f61e0146270 0x7f61e0160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41280/0 (socket says 172.21.15.53:41280) 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e4f43640 1 -- 172.21.15.53:0/3746614856 learned_addr learned my addr 172.21.15.53:0/3746614856 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e4f43640 1 -- 172.21.15.53:0/3746614856 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e00ac8e0 msgr2=0x7f61e00ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e4f43640 1 --2- 172.21.15.53:0/3746614856 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e00ac8e0 0x7f61e00ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e4f43640 1 -- 172.21.15.53:0/3746614856 >> v1:172.21.15.87:6789/0 conn(0x7f61e00ae6a0 legacy=0x7f61e00b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.043+0000 7f61e4f43640 1 -- 172.21.15.53:0/3746614856 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00ad680 con 0x7f61e0146270 2024-09-13T18:35:20.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e4f43640 1 --2- 172.21.15.53:0/3746614856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0146270 0x7f61e0160f10 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c405a9a78f894f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61df7fe640 1 -- 172.21.15.53:0/3746614856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00aa5f0 con 0x7f61e0146270 2024-09-13T18:35:20.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61df7fe640 1 -- 172.21.15.53:0/3746614856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00aa750 con 0x7f61e0146270 2024-09-13T18:35:20.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61df7fe640 1 -- 172.21.15.53:0/3746614856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00aaae0 con 0x7f61e0146270 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- 172.21.15.53:0/3746614856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0146270 msgr2=0x7f61e0160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 --2- 172.21.15.53:0/3746614856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0146270 0x7f61e0160f10 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009870 tx=0x7f61d001c4f0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- 172.21.15.53:0/3746614856 shutdown_connections 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 --2- 172.21.15.53:0/3746614856 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e00ac8e0 0x7f61e00ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 --2- 172.21.15.53:0/3746614856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e0146270 0x7f61e0160f10 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- 172.21.15.53:0/3746614856 >> 172.21.15.53:0/3746614856 conn(0x7f61e0069f50 msgr2=0x7f61e006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- 172.21.15.53:0/3746614856 shutdown_connections 2024-09-13T18:35:20.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- 172.21.15.53:0/3746614856 wait complete. 2024-09-13T18:35:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 Processor -- start 2024-09-13T18:35:20.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- start start 2024-09-13T18:35:20.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e00ac8e0 0x7f61e0144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e00ae6a0 0x7f61e015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e0146270 0x7f61e013f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e015cdc0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e015d010 con 0x7f61e00ac8e0 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e71a7640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e015d2f0 con 0x7f61e0146270 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e00ae6a0 0x7f61e015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e00ae6a0 0x7f61e015b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41296/0 (socket says 172.21.15.53:41296) 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 -- 172.21.15.53:0/2307467297 learned_addr learned my addr 172.21.15.53:0/2307467297 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e4f43640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e00ac8e0 0x7f61e0144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61e5744640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e0146270 0x7f61e013f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 -- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e0146270 msgr2=0x7f61e013f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e0146270 0x7f61e013f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 -- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e00ac8e0 msgr2=0x7f61e0144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e00ac8e0 0x7f61e0144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 -- 172.21.15.53:0/2307467297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00094d0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.047+0000 7f61dffff640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e00ae6a0 0x7f61e015b9f0 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b480 tx=0x7f61d400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61dd7fa640 1 -- 172.21.15.53:0/2307467297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4010870 con 0x7f61e00ae6a0 2024-09-13T18:35:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61dd7fa640 1 -- 172.21.15.53:0/2307467297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d40109f0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e015d5d0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61dd7fa640 1 -- 172.21.15.53:0/2307467297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4010da0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e01450a0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e015daf0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61dd7fa640 1 -- 172.21.15.53:0/2307467297 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f61d400f3c0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61dd7fa640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61cc0671d0 0x7f61cc069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61dd7fa640 1 -- 172.21.15.53:0/2307467297 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f61d4082d80 con 0x7f61e00ae6a0 2024-09-13T18:35:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61e4f43640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61cc0671d0 0x7f61cc069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.051+0000 7f61e4f43640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61cc0671d0 0x7f61cc069690 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f61d00ae000 tx=0x7f61d00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.055 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.055+0000 7f61dd7fa640 1 -- 172.21.15.53:0/2307467297 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61e015daf0 con 0x7f61e00ae6a0 2024-09-13T18:35:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f61e015daf0 con 0x7f61cc0671d0 2024-09-13T18:35:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61dd7fa640 1 -- 172.21.15.53:0/2307467297 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f61e015daf0 con 0x7f61cc0671d0 2024-09-13T18:35:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:35:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61cc0671d0 msgr2=0x7f61cc069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61cc0671d0 0x7f61cc069690 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f61d00ae000 tx=0x7f61d00a7000 comp rx=0 tx=0).stop 2024-09-13T18:35:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e00ae6a0 msgr2=0x7f61e015b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e00ae6a0 0x7f61e015b9f0 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b480 tx=0x7f61d400b940 comp rx=0 tx=0).stop 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 shutdown_connections 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f61cc0671d0 0x7f61cc069690 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f61e0146270 0x7f61e013f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61e00ae6a0 0x7f61e015b9f0 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 --2- 172.21.15.53:0/2307467297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61e00ac8e0 0x7f61e0144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 >> 172.21.15.53:0/2307467297 conn(0x7f61e0069f50 msgr2=0x7f61e00704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 shutdown_connections 2024-09-13T18:35:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.215+0000 7f61e71a7640 1 -- 172.21.15.53:0/2307467297 wait complete. 2024-09-13T18:35:20.232 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:35:20.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:20.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a405e9640 1 Processor -- start 2024-09-13T18:35:20.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a405e9640 1 -- start start 2024-09-13T18:35:20.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a405e9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a3806d620 0x7f6a3815e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a405e9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3806dfa0 con 0x7f6a3806da30 2024-09-13T18:35:20.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a405e9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3806e240 con 0x7f6a38151540 2024-09-13T18:35:20.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a405e9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3806f710 con 0x7f6a3806d620 2024-09-13T18:35:20.360 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a3db84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a3806d620 0x7f6a3815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a3eb86640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6a3806da30 0x7f6a380adcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43616/0 (socket says 172.21.15.53:43616) 2024-09-13T18:35:20.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a3db84640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a3806d620 0x7f6a3815e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41304/0 (socket says 172.21.15.53:41304) 2024-09-13T18:35:20.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a3eb86640 1 -- 172.21.15.53:0/2360387409 learned_addr learned my addr 172.21.15.53:0/2360387409 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:20.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a3db84640 1 -- 172.21.15.53:0/2360387409 >> v1:172.21.15.87:6789/0 conn(0x7f6a38151540 legacy=0x7f6a3806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a3db84640 1 -- 172.21.15.53:0/2360387409 >> v1:172.21.15.53:6789/0 conn(0x7f6a3806da30 legacy=0x7f6a380adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.359+0000 7f6a3d383640 1 -- 172.21.15.53:0/2360387409 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143869225 0 0) 0x7f6a3806dfa0 con 0x7f6a3806da30 2024-09-13T18:35:20.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a3db84640 1 -- 172.21.15.53:0/2360387409 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3806e520 con 0x7f6a3806d620 2024-09-13T18:35:20.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a3db84640 1 --2- 172.21.15.53:0/2360387409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3815e120 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f6a280097c0 tx=0x7f6a2801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74667920959c6489 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a3d383640 1 -- 172.21.15.53:0/2360387409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a280ad680 con 0x7f6a3806d620 2024-09-13T18:35:20.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a3d383640 1 -- 172.21.15.53:0/2360387409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a280ad7e0 con 0x7f6a3806d620 2024-09-13T18:35:20.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a3d383640 1 -- 172.21.15.53:0/2360387409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a280adb70 con 0x7f6a3806d620 2024-09-13T18:35:20.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a405e9640 1 -- 172.21.15.53:0/2360387409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 msgr2=0x7f6a3815e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a405e9640 1 --2- 172.21.15.53:0/2360387409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3815e120 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f6a280097c0 tx=0x7f6a2801c470 comp rx=0 tx=0).stop 2024-09-13T18:35:20.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a405e9640 1 -- 172.21.15.53:0/2360387409 shutdown_connections 2024-09-13T18:35:20.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a405e9640 1 --2- 172.21.15.53:0/2360387409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3815e120 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a405e9640 1 -- 172.21.15.53:0/2360387409 >> 172.21.15.53:0/2360387409 conn(0x7f6a38071ac0 msgr2=0x7f6a38099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a405e9640 1 -- 172.21.15.53:0/2360387409 shutdown_connections 2024-09-13T18:35:20.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.363+0000 7f6a405e9640 1 -- 172.21.15.53:0/2360387409 wait complete. 2024-09-13T18:35:20.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 Processor -- start 2024-09-13T18:35:20.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 -- start start 2024-09-13T18:35:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3814c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3806da30 0x7f6a3814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a38151540 0x7f6a381432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38145d00 con 0x7f6a3806d620 2024-09-13T18:35:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a381488e0 con 0x7f6a3806da30 2024-09-13T18:35:20.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38148bc0 con 0x7f6a38151540 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3814c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3814c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41318/0 (socket says 172.21.15.53:41318) 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 -- 172.21.15.53:0/3468789123 learned_addr learned my addr 172.21.15.53:0/3468789123 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3db84640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3806da30 0x7f6a3814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3eb86640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a38151540 0x7f6a381432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 -- 172.21.15.53:0/3468789123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a38151540 msgr2=0x7f6a381432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a38151540 0x7f6a381432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 -- 172.21.15.53:0/3468789123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3806da30 msgr2=0x7f6a3814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3806da30 0x7f6a3814cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 -- 172.21.15.53:0/3468789123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28009420 con 0x7f6a3806d620 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3db84640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3806da30 0x7f6a3814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a3e385640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3814c610 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c3c0 tx=0x7f6a3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340052d0 con 0x7f6a3806d620 2024-09-13T18:35:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34005430 con 0x7f6a3806d620 2024-09-13T18:35:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a38148ea0 con 0x7f6a3806d620 2024-09-13T18:35:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34003840 con 0x7f6a3806d620 2024-09-13T18:35:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3814b1f0 con 0x7f6a3806d620 2024-09-13T18:35:20.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a38151920 con 0x7f6a3806d620 2024-09-13T18:35:20.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.367+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f6a340039a0 con 0x7f6a3806d620 2024-09-13T18:35:20.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a2effd640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6a1c0671d0 0x7f6a1c069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6a340826a0 con 0x7f6a3806d620 2024-09-13T18:35:20.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a3db84640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6a1c0671d0 0x7f6a1c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a2effd640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f6a1c06d030 0x7f6a1c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 --> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a1c06fb00 con 0x7f6a1c06d030 2024-09-13T18:35:20.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a34085180 con 0x7f6a3806d620 2024-09-13T18:35:20.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a3eb86640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f6a1c06d030 0x7f6a1c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a3db84640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6a1c0671d0 0x7f6a1c069690 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6a280af000 tx=0x7f6a28008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a3eb86640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f6a1c06d030 0x7f6a1c06f450 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.371+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== osd.2 v2:172.21.15.53:6817/483943031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6a1c06fb00 con 0x7f6a1c06d030 2024-09-13T18:35:20.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 --> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a3809a180 con 0x7f6a1c06d030 2024-09-13T18:35:20.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a2effd640 1 -- 172.21.15.53:0/3468789123 <== osd.2 v2:172.21.15.53:6817/483943031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6a3809a180 con 0x7f6a1c06d030 2024-09-13T18:35:20.383 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:20.383 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:20.383 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f6a1c06d030 msgr2=0x7f6a1c06f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6817/483943031,v1:172.21.15.53:6819/483943031] conn(0x7f6a1c06d030 0x7f6a1c06f450 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6a1c0671d0 msgr2=0x7f6a1c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f6a1c0671d0 0x7f6a1c069690 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6a280af000 tx=0x7f6a28008040 comp rx=0 tx=0).stop 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 msgr2=0x7f6a3814c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 --2- 172.21.15.53:0/3468789123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a3806d620 0x7f6a3814c610 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c3c0 tx=0x7f6a3400c880 comp rx=0 tx=0).stop 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a3eb86640 1 -- 172.21.15.53:0/3468789123 reap_dead start 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 shutdown_connections 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 >> 172.21.15.53:0/3468789123 conn(0x7f6a38071ac0 msgr2=0x7f6a380adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 shutdown_connections 2024-09-13T18:35:20.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.383+0000 7f6a405e9640 1 -- 172.21.15.53:0/3468789123 wait complete. 2024-09-13T18:35:20.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:35:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d26cd640 1 Processor -- start 2024-09-13T18:35:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d26cd640 1 -- start start 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d26cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc1582a0 0x7f92cc06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d26cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92cc0713a0 0x7f92cc06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d26cd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc06d480 con 0x7f92cc15b7c0 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d26cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc15aaf0 con 0x7f92cc0713a0 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d26cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc06d760 con 0x7f92cc1582a0 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d0c6a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92cc0713a0 0x7f92cc06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d0c6a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92cc0713a0 0x7f92cc06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41322/0 (socket says 172.21.15.53:41322) 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d0c6a640 1 -- 172.21.15.53:0/1812164802 learned_addr learned my addr 172.21.15.53:0/1812164802 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92cbfff640 1 --2- 172.21.15.53:0/1812164802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc1582a0 0x7f92cc06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d0c6a640 1 -- 172.21.15.53:0/1812164802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc1582a0 msgr2=0x7f92cc06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d0c6a640 1 --2- 172.21.15.53:0/1812164802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc1582a0 0x7f92cc06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d0c6a640 1 -- 172.21.15.53:0/1812164802 >> v1:172.21.15.87:6789/0 conn(0x7f92cc15b7c0 legacy=0x7f92cc070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.511+0000 7f92d0c6a640 1 -- 172.21.15.53:0/1812164802 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc15ace0 con 0x7f92cc0713a0 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d0c6a640 1 --2- 172.21.15.53:0/1812164802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc0713a0 0x7f92cc06ce40 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009e50 tx=0x7f92c401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc09ae4bcf36b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92caffd640 1 -- 172.21.15.53:0/1812164802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40a58d0 con 0x7f92cc0713a0 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92caffd640 1 -- 172.21.15.53:0/1812164802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c40a5a30 con 0x7f92cc0713a0 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92caffd640 1 -- 172.21.15.53:0/1812164802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40a5dc0 con 0x7f92cc0713a0 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- 172.21.15.53:0/1812164802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc0713a0 msgr2=0x7f92cc06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 --2- 172.21.15.53:0/1812164802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc0713a0 0x7f92cc06ce40 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009e50 tx=0x7f92c401ca00 comp rx=0 tx=0).stop 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- 172.21.15.53:0/1812164802 shutdown_connections 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 --2- 172.21.15.53:0/1812164802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc0713a0 0x7f92cc06ce40 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 --2- 172.21.15.53:0/1812164802 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc1582a0 0x7f92cc06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- 172.21.15.53:0/1812164802 >> 172.21.15.53:0/1812164802 conn(0x7f92cc065c80 msgr2=0x7f92cc066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- 172.21.15.53:0/1812164802 shutdown_connections 2024-09-13T18:35:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- 172.21.15.53:0/1812164802 wait complete. 2024-09-13T18:35:20.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 Processor -- start 2024-09-13T18:35:20.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- start start 2024-09-13T18:35:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc0713a0 0x7f92cc150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc1582a0 0x7f92cc138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92cc15b7c0 0x7f92cc135090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc151e70 con 0x7f92cc1582a0 2024-09-13T18:35:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc1388c0 con 0x7f92cc15b7c0 2024-09-13T18:35:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d26cd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc1355d0 con 0x7f92cc0713a0 2024-09-13T18:35:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc1582a0 0x7f92cc138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc1582a0 0x7f92cc138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41328/0 (socket says 172.21.15.53:41328) 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 -- 172.21.15.53:0/3333059254 learned_addr learned my addr 172.21.15.53:0/3333059254 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92d0c6a640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92cc15b7c0 0x7f92cc135090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cbfff640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc0713a0 0x7f92cc150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 -- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc0713a0 msgr2=0x7f92cc150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc0713a0 0x7f92cc150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 -- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92cc15b7c0 msgr2=0x7f92cc135090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92cc15b7c0 0x7f92cc135090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.515+0000 7f92cb7fe640 1 -- 172.21.15.53:0/3333059254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4009b30 con 0x7f92cc1582a0 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92cb7fe640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc1582a0 0x7f92cc138380 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f92c000c3f0 tx=0x7f92c000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92c8ff9640 1 -- 172.21.15.53:0/3333059254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c00052d0 con 0x7f92cc1582a0 2024-09-13T18:35:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92c8ff9640 1 -- 172.21.15.53:0/3333059254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c0005430 con 0x7f92cc1582a0 2024-09-13T18:35:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92c8ff9640 1 -- 172.21.15.53:0/3333059254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0003840 con 0x7f92cc1582a0 2024-09-13T18:35:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc151260 con 0x7f92cc1582a0 2024-09-13T18:35:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc151820 con 0x7f92cc1582a0 2024-09-13T18:35:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc067400 con 0x7f92cc1582a0 2024-09-13T18:35:20.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92c8ff9640 1 -- 172.21.15.53:0/3333059254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f92c00039a0 con 0x7f92cc1582a0 2024-09-13T18:35:20.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92c8ff9640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f92b80671d0 0x7f92b8069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92c8ff9640 1 -- 172.21.15.53:0/3333059254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f92c0082730 con 0x7f92cc1582a0 2024-09-13T18:35:20.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92cbfff640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f92b80671d0 0x7f92b8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.520 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.519+0000 7f92cbfff640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f92b80671d0 0x7f92b8069690 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009b60 tx=0x7f92bc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.523+0000 7f92c8ff9640 1 -- 172.21.15.53:0/3333059254 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92c0051300 con 0x7f92cc1582a0 2024-09-13T18:35:20.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.679+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f92cc155540 con 0x7f92b80671d0 2024-09-13T18:35:20.680 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.679+0000 7f92c8ff9640 1 -- 172.21.15.53:0/3333059254 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92cc155540 con 0x7f92b80671d0 2024-09-13T18:35:20.681 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:35:20.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f92b80671d0 msgr2=0x7f92b8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.682 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f92b80671d0 0x7f92b8069690 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009b60 tx=0x7f92bc009190 comp rx=0 tx=0).stop 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc1582a0 msgr2=0x7f92cc138380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc1582a0 0x7f92cc138380 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f92c000c3f0 tx=0x7f92c000c8b0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 shutdown_connections 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f92b80671d0 0x7f92b8069690 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92cc15b7c0 0x7f92cc135090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92cc1582a0 0x7f92cc138380 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 --2- 172.21.15.53:0/3333059254 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92cc0713a0 0x7f92cc150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 >> 172.21.15.53:0/3333059254 conn(0x7f92cc065c80 msgr2=0x7f92cc156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 shutdown_connections 2024-09-13T18:35:20.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.683+0000 7f92d26cd640 1 -- 172.21.15.53:0/3333059254 wait complete. 2024-09-13T18:35:20.698 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:35:20.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:20.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.823+0000 7f93f3070640 1 Processor -- start 2024-09-13T18:35:20.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.823+0000 7f93f3070640 1 -- start start 2024-09-13T18:35:20.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93f3070640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0cdad0 0x7f93ec143810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93f3070640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93ec143d50 0x7f93ec06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93f3070640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ec0b1ba0 con 0x7f93ec0cd6f0 2024-09-13T18:35:20.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93f3070640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0b3020 con 0x7f93ec143d50 2024-09-13T18:35:20.827 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93f3070640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0b1f80 con 0x7f93ec0cdad0 2024-09-13T18:35:20.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0cdad0 0x7f93ec143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0cdad0 0x7f93ec143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.53:55410/0 (socket says 172.21.15.53:55410) 2024-09-13T18:35:20.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 -- 172.21.15.53:0/23961702 learned_addr learned my addr 172.21.15.53:0/23961702 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93f160d640 1 --2- 172.21.15.53:0/23961702 >> v2:172.21.15.87:3300/0 conn(0x7f93ec143d50 0x7f93ec06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 -- 172.21.15.53:0/23961702 >> v2:172.21.15.87:3300/0 conn(0x7f93ec143d50 msgr2=0x7f93ec06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 --2- 172.21.15.53:0/23961702 >> v2:172.21.15.87:3300/0 conn(0x7f93ec143d50 0x7f93ec06b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 -- 172.21.15.53:0/23961702 >> v1:172.21.15.87:6789/0 conn(0x7f93ec0cd6f0 legacy=0x7f93ec0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 -- 172.21.15.53:0/23961702 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0b2260 con 0x7f93ec0cdad0 2024-09-13T18:35:20.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.827+0000 7f93ebfff640 1 --2- 172.21.15.53:0/23961702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0cdad0 0x7f93ec143810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009870 tx=0x7f93e001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=485fd457755d78a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93eb7fe640 1 -- 172.21.15.53:0/23961702 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00a95f0 con 0x7f93ec0cdad0 2024-09-13T18:35:20.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93eb7fe640 1 -- 172.21.15.53:0/23961702 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e00a9750 con 0x7f93ec0cdad0 2024-09-13T18:35:20.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93eb7fe640 1 -- 172.21.15.53:0/23961702 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00a9ae0 con 0x7f93ec0cdad0 2024-09-13T18:35:20.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- 172.21.15.53:0/23961702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0cdad0 msgr2=0x7f93ec143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 --2- 172.21.15.53:0/23961702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0cdad0 0x7f93ec143810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009870 tx=0x7f93e001c530 comp rx=0 tx=0).stop 2024-09-13T18:35:20.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- 172.21.15.53:0/23961702 shutdown_connections 2024-09-13T18:35:20.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 --2- 172.21.15.53:0/23961702 >> v2:172.21.15.87:3300/0 conn(0x7f93ec143d50 0x7f93ec06b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 --2- 172.21.15.53:0/23961702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0cdad0 0x7f93ec143810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- 172.21.15.53:0/23961702 >> 172.21.15.53:0/23961702 conn(0x7f93ec073330 msgr2=0x7f93ec065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- 172.21.15.53:0/23961702 shutdown_connections 2024-09-13T18:35:20.840 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- 172.21.15.53:0/23961702 wait complete. 2024-09-13T18:35:20.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 Processor -- start 2024-09-13T18:35:20.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- start start 2024-09-13T18:35:20.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec0cd6f0 0x7f93ec142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0cdad0 0x7f93ec1f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec143d50 0x7f93ec1f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec163f90 con 0x7f93ec0cdad0 2024-09-13T18:35:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0aa1d0 con 0x7f93ec0cd6f0 2024-09-13T18:35:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f3070640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0b0990 con 0x7f93ec143d50 2024-09-13T18:35:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0cdad0 0x7f93ec1f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0cdad0 0x7f93ec1f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41344/0 (socket says 172.21.15.53:41344) 2024-09-13T18:35:20.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 -- 172.21.15.53:0/3778719685 learned_addr learned my addr 172.21.15.53:0/3778719685 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f0e0c640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec0cd6f0 0x7f93ec142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f160d640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec143d50 0x7f93ec1f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 -- 172.21.15.53:0/3778719685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec143d50 msgr2=0x7f93ec1f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec143d50 0x7f93ec1f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 -- 172.21.15.53:0/3778719685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec0cd6f0 msgr2=0x7f93ec142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec0cd6f0 0x7f93ec142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 -- 172.21.15.53:0/3778719685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00094d0 con 0x7f93ec0cdad0 2024-09-13T18:35:20.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93f0e0c640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec0cd6f0 0x7f93ec142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93ebfff640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0cdad0 0x7f93ec1f60e0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f93e001a160 tx=0x7f93e001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00b1800 con 0x7f93ec0cdad0 2024-09-13T18:35:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e00b1960 con 0x7f93ec0cdad0 2024-09-13T18:35:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.831+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00b1d10 con 0x7f93ec0cdad0 2024-09-13T18:35:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec0ca3b0 con 0x7f93ec0cdad0 2024-09-13T18:35:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec0b0ec0 con 0x7f93ec0cdad0 2024-09-13T18:35:20.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93ec144160 con 0x7f93ec0cdad0 2024-09-13T18:35:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f93e00bc450 con 0x7f93ec0cdad0 2024-09-13T18:35:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93e97fa640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f93d80671d0 0x7f93d8069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f93e011da40 con 0x7f93ec0cdad0 2024-09-13T18:35:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93f0e0c640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f93d80671d0 0x7f93d8069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93e97fa640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f93d806d030 0x7f93d806f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 --> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93d806fb00 con 0x7f93d806d030 2024-09-13T18:35:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93e0120180 con 0x7f93ec0cdad0 2024-09-13T18:35:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93f160d640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f93d806d030 0x7f93d806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93f0e0c640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f93d80671d0 0x7f93d8069690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0a8af0 tx=0x7f93dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93f160d640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f93d806d030 0x7f93d806f450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.835+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== osd.3 v2:172.21.15.53:6808/205095619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f93d806fb00 con 0x7f93d806d030 2024-09-13T18:35:20.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.847+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 --> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93ec0cbdd0 con 0x7f93d806d030 2024-09-13T18:35:20.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.847+0000 7f93e97fa640 1 -- 172.21.15.53:0/3778719685 <== osd.3 v2:172.21.15.53:6808/205095619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f93e400f040 con 0x7f93d806d030 2024-09-13T18:35:20.849 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:20.849 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:20.850 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:20.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f93d806d030 msgr2=0x7f93d806f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6808/205095619,v1:172.21.15.53:6809/205095619] conn(0x7f93d806d030 0x7f93d806f450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f93d80671d0 msgr2=0x7f93d8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f93d80671d0 0x7f93d8069690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0a8af0 tx=0x7f93dc009040 comp rx=0 tx=0).stop 2024-09-13T18:35:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0cdad0 msgr2=0x7f93ec1f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 --2- 172.21.15.53:0/3778719685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0cdad0 0x7f93ec1f60e0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f93e001a160 tx=0x7f93e001ad70 comp rx=0 tx=0).stop 2024-09-13T18:35:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f160d640 1 -- 172.21.15.53:0/3778719685 reap_dead start 2024-09-13T18:35:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 shutdown_connections 2024-09-13T18:35:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 >> 172.21.15.53:0/3778719685 conn(0x7f93ec073330 msgr2=0x7f93ec140740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 shutdown_connections 2024-09-13T18:35:20.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.851+0000 7f93f3070640 1 -- 172.21.15.53:0/3778719685 wait complete. 2024-09-13T18:35:20.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:35:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f746d84f640 1 Processor -- start 2024-09-13T18:35:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f746d84f640 1 -- start start 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f746d84f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cb980 0x7f74680b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f746d84f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f746806b850 0x7f74680cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f746d84f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74680b1ac0 con 0x7f74680cbd60 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f746d84f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74680b3010 con 0x7f746806b850 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f746d84f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7468159ac0 con 0x7f74680cb980 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f74667fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f746806b850 0x7f74680cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f74667fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f746806b850 0x7f74680cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41354/0 (socket says 172.21.15.53:41354) 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f74667fc640 1 -- 172.21.15.53:0/294587183 learned_addr learned my addr 172.21.15.53:0/294587183 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f7466ffd640 1 --2- 172.21.15.53:0/294587183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cb980 0x7f74680b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f74667fc640 1 -- 172.21.15.53:0/294587183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cb980 msgr2=0x7f74680b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f74667fc640 1 --2- 172.21.15.53:0/294587183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cb980 0x7f74680b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f74667fc640 1 -- 172.21.15.53:0/294587183 >> v1:172.21.15.87:6789/0 conn(0x7f74680cbd60 legacy=0x7f746806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f74667fc640 1 -- 172.21.15.53:0/294587183 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468159da0 con 0x7f746806b850 2024-09-13T18:35:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.975+0000 7f7466ffd640 1 --2- 172.21.15.53:0/294587183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cb980 0x7f74680b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f74667fc640 1 --2- 172.21.15.53:0/294587183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806b850 0x7f74680cdd40 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f74500098a0 tx=0x7f745001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6980cc3ee7c0fbad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f7465ffb640 1 -- 172.21.15.53:0/294587183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500ab600 con 0x7f746806b850 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f7465ffb640 1 -- 172.21.15.53:0/294587183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74500ab760 con 0x7f746806b850 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f7465ffb640 1 -- 172.21.15.53:0/294587183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500abaf0 con 0x7f746806b850 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 -- 172.21.15.53:0/294587183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806b850 msgr2=0x7f74680cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 --2- 172.21.15.53:0/294587183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806b850 0x7f74680cdd40 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f74500098a0 tx=0x7f745001c440 comp rx=0 tx=0).stop 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 -- 172.21.15.53:0/294587183 shutdown_connections 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 --2- 172.21.15.53:0/294587183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f746806b850 0x7f74680cdd40 unknown :-1 s=CLOSED pgs=2489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 --2- 172.21.15.53:0/294587183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cb980 0x7f74680b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 -- 172.21.15.53:0/294587183 >> 172.21.15.53:0/294587183 conn(0x7f7468065c80 msgr2=0x7f7468066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 -- 172.21.15.53:0/294587183 shutdown_connections 2024-09-13T18:35:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 -- 172.21.15.53:0/294587183 wait complete. 2024-09-13T18:35:20.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 Processor -- start 2024-09-13T18:35:20.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.979+0000 7f746d84f640 1 -- start start 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f746806b850 0x7f74681f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74680cb980 0x7f74681f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cbd60 0x7f74681f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74681f5880 con 0x7f74680cb980 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746814e4a0 con 0x7f746806b850 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746814e780 con 0x7f74680cbd60 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74680cb980 0x7f74681f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74680cb980 0x7f74681f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41360/0 (socket says 172.21.15.53:41360) 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 -- 172.21.15.53:0/1175136567 learned_addr learned my addr 172.21.15.53:0/1175136567 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f746806b850 0x7f74681f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 -- 172.21.15.53:0/1175136567 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cbd60 msgr2=0x7f74681f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cbd60 0x7f74681f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 -- 172.21.15.53:0/1175136567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f746806b850 msgr2=0x7f74681f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f746806b850 0x7f74681f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 -- 172.21.15.53:0/1175136567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500094d0 con 0x7f74680cb980 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f74667fc640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74680cb980 0x7f74681f5340 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f745001aaf0 tx=0x7f745001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f745ffff640 1 -- 172.21.15.53:0/1175136567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500b4800 con 0x7f74680cb980 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f745ffff640 1 -- 172.21.15.53:0/1175136567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74500b4980 con 0x7f74680cb980 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746814ea60 con 0x7f74680cb980 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f745ffff640 1 -- 172.21.15.53:0/1175136567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500b4d30 con 0x7f74680cb980 2024-09-13T18:35:20.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74681f7ba0 con 0x7f74680cb980 2024-09-13T18:35:20.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7468067400 con 0x7f74680cb980 2024-09-13T18:35:20.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f745ffff640 1 -- 172.21.15.53:0/1175136567 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f74500c7390 con 0x7f74680cb980 2024-09-13T18:35:20.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f745ffff640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f74480671d0 0x7f7448069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:20.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f745ffff640 1 -- 172.21.15.53:0/1175136567 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f745011d510 con 0x7f74680cb980 2024-09-13T18:35:20.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f74480671d0 0x7f7448069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:20.985 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.983+0000 7f7466ffd640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f74480671d0 0x7f7448069690 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7458008f80 tx=0x7f74580084d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:20.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:20.987+0000 7f745ffff640 1 -- 172.21.15.53:0/1175136567 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74500ec330 con 0x7f74680cb980 2024-09-13T18:35:21.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.147+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f746814e8c0 con 0x7f74480671d0 2024-09-13T18:35:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.147+0000 7f745ffff640 1 -- 172.21.15.53:0/1175136567 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f746814e8c0 con 0x7f74480671d0 2024-09-13T18:35:21.147 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:35:21.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f74480671d0 msgr2=0x7f7448069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f74480671d0 0x7f7448069690 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7458008f80 tx=0x7f74580084d0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74680cb980 msgr2=0x7f74681f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74680cb980 0x7f74681f5340 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f745001aaf0 tx=0x7f745001ac80 comp rx=0 tx=0).stop 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 shutdown_connections 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f74480671d0 0x7f7448069690 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f74680cbd60 0x7f74681f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74680cb980 0x7f74681f5340 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 --2- 172.21.15.53:0/1175136567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f746806b850 0x7f74681f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 >> 172.21.15.53:0/1175136567 conn(0x7f7468065c80 msgr2=0x7f74680ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 shutdown_connections 2024-09-13T18:35:21.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.151+0000 7f746d84f640 1 -- 172.21.15.53:0/1175136567 wait complete. 2024-09-13T18:35:21.167 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:35:21.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66fd320640 1 Processor -- start 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66fd320640 1 -- start start 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66fd320640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66f806ccc0 0x7f66f806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66fd320640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 0x7f66f80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66fd320640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f8070fb0 con 0x7f66f815c5e0 2024-09-13T18:35:21.294 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66fd320640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f806d620 con 0x7f66f806ccc0 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66fd320640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8070a10 con 0x7f66f80cc800 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66f6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f66f815c5e0 0x7f66f815d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43618/0 (socket says 172.21.15.53:43618) 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.291+0000 7f66f6ffd640 1 -- 172.21.15.53:0/1178659368 learned_addr learned my addr 172.21.15.53:0/1178659368 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1178659368 >> v2:172.21.15.87:3300/0 conn(0x7f66f806ccc0 0x7f66f806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f77fe640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 0x7f66f80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511869955 0 0) 0x7f66f8070fb0 con 0x7f66f815c5e0 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e4003530 con 0x7f66f815c5e0 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1378409347 0 0) 0x7f66e4003530 con 0x7f66f815c5e0 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 msgr2=0x7f66f80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 0x7f66f80ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 >> v2:172.21.15.87:3300/0 conn(0x7f66f806ccc0 msgr2=0x7f66f806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 --2- 172.21.15.53:0/1178659368 >> v2:172.21.15.87:3300/0 conn(0x7f66f806ccc0 0x7f66f806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80711e0 con 0x7f66f815c5e0 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f66e8001680 con 0x7f66f815c5e0 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 >> v1:172.21.15.53:6789/0 conn(0x7f66f815c5e0 legacy=0x7f66f815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4003980 0x7f66e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 0x7f66e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f806d620 con 0x7f66e40047d0 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8070a10 con 0x7f66e4003980 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e400b990 con 0x7f66f80cc800 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f6ffd640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4003980 0x7f66e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f77fe640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 0x7f66e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 -- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 msgr2=0x7f66e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f80cc800 0x7f66e4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 -- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4003980 msgr2=0x7f66e4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e4003980 0x7f66e4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.298 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 -- 172.21.15.53:0/1178659368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4003530 con 0x7f66e40047d0 2024-09-13T18:35:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009ae0 tx=0x7f66e001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b252765b3e69cd0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00a64c0 con 0x7f66e40047d0 2024-09-13T18:35:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e00a6620 con 0x7f66e40047d0 2024-09-13T18:35:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.295+0000 7f66f67fc640 1 -- 172.21.15.53:0/1178659368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e00a69d0 con 0x7f66e40047d0 2024-09-13T18:35:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- 172.21.15.53:0/1178659368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e40047d0 msgr2=0x7f66e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 --2- 172.21.15.53:0/1178659368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66e40047d0 0x7f66e4004c50 secure :-1 s=READY pgs=2492 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009ae0 tx=0x7f66e001cab0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 -- 172.21.15.53:0/1178659368 reap_dead start 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- 172.21.15.53:0/1178659368 shutdown_connections 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- 172.21.15.53:0/1178659368 >> 172.21.15.53:0/1178659368 conn(0x7f66f8073330 msgr2=0x7f66f8065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- 172.21.15.53:0/1178659368 shutdown_connections 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- 172.21.15.53:0/1178659368 wait complete. 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 Processor -- start 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- start start 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e40047d0 0x7f66f8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f814f7e0 0x7f66f80c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f8153910 0x7f66f8142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8152870 con 0x7f66f8153910 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8152b50 con 0x7f66e40047d0 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8152e30 con 0x7f66f814f7e0 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f8153910 0x7f66f8142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f8153910 0x7f66f8142970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41376/0 (socket says 172.21.15.53:41376) 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 -- 172.21.15.53:0/1488131121 learned_addr learned my addr 172.21.15.53:0/1488131121 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f6ffd640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e40047d0 0x7f66f8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f814f7e0 0x7f66f80c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 -- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f814f7e0 msgr2=0x7f66f80c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66f814f7e0 0x7f66f80c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.305 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 -- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e40047d0 msgr2=0x7f66f8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66e40047d0 0x7f66f8151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 -- 172.21.15.53:0/1488131121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f8153110 con 0x7f66f8153910 2024-09-13T18:35:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66f77fe640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f8153910 0x7f66f8142970 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7f66f80b3b80 tx=0x7f66f000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0017400 con 0x7f66f8153910 2024-09-13T18:35:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0011040 con 0x7f66f8153910 2024-09-13T18:35:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f81533f0 con 0x7f66f8153910 2024-09-13T18:35:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f00177c0 con 0x7f66f8153910 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.299+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f80c94a0 con 0x7f66f8153910 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66f80cdc40 con 0x7f66f8153910 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f66f0017920 con 0x7f66f8153910 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66effff640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66d8067190 0x7f66d8069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f66f0083b10 con 0x7f66f8153910 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66f6ffd640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66d8067190 0x7f66d8069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66effff640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f66d806cff0 0x7f66d806f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 --> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66d806fac0 con 0x7f66d806cff0 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f0086790 con 0x7f66f8153910 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f66d806cff0 0x7f66d806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66f6ffd640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66d8067190 0x7f66d8069650 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001ec0 tx=0x7f66e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.307 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.303+0000 7f66ee7fc640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f66d806cff0 0x7f66d806f410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.308 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.307+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== osd.4 v2:172.21.15.87:6816/2745365769 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f66d806fac0 con 0x7f66d806cff0 2024-09-13T18:35:21.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 --> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66f80cc290 con 0x7f66d806cff0 2024-09-13T18:35:21.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66effff640 1 -- 172.21.15.53:0/1488131121 <== osd.4 v2:172.21.15.87:6816/2745365769 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f66e0004040 con 0x7f66d806cff0 2024-09-13T18:35:21.318 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:21.318 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:21.318 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:21.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f66d806cff0 msgr2=0x7f66d806f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.87:6816/2745365769,v1:172.21.15.87:6817/2745365769] conn(0x7f66d806cff0 0x7f66d806f410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66d8067190 msgr2=0x7f66d8069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f66d8067190 0x7f66d8069650 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001ec0 tx=0x7f66e8009040 comp rx=0 tx=0).stop 2024-09-13T18:35:21.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f8153910 msgr2=0x7f66f8142970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 --2- 172.21.15.53:0/1488131121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66f8153910 0x7f66f8142970 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7f66f80b3b80 tx=0x7f66f000f4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66f77fe640 1 -- 172.21.15.53:0/1488131121 reap_dead start 2024-09-13T18:35:21.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 shutdown_connections 2024-09-13T18:35:21.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 >> 172.21.15.53:0/1488131121 conn(0x7f66f8073330 msgr2=0x7f66f8159590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 shutdown_connections 2024-09-13T18:35:21.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.319+0000 7f66fd320640 1 -- 172.21.15.53:0/1488131121 wait complete. 2024-09-13T18:35:21.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:35:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b7c32640 1 Processor -- start 2024-09-13T18:35:21.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b7c32640 1 -- start start 2024-09-13T18:35:21.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b7c32640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b015b7c0 0x7f68b0070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b7c32640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b01640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b7c32640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b006d480 con 0x7f68b01582a0 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b7c32640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b015aaf0 con 0x7f68b015b7c0 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b7c32640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b006d760 con 0x7f68b00711d0 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b51cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b015b7c0 0x7f68b0070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b51cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68b015b7c0 0x7f68b0070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41390/0 (socket says 172.21.15.53:41390) 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b51cd640 1 -- 172.21.15.53:0/3908692423 learned_addr learned my addr 172.21.15.53:0/3908692423 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b61cf640 1 --2- 172.21.15.53:0/3908692423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b01640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b51cd640 1 -- 172.21.15.53:0/3908692423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 msgr2=0x7f68b01640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b51cd640 1 --2- 172.21.15.53:0/3908692423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b01640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b51cd640 1 -- 172.21.15.53:0/3908692423 >> v1:172.21.15.87:6789/0 conn(0x7f68b01582a0 legacy=0x7f68b006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.452 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.451+0000 7f68b51cd640 1 -- 172.21.15.53:0/3908692423 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b015ace0 con 0x7f68b015b7c0 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b51cd640 1 --2- 172.21.15.53:0/3908692423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b015b7c0 0x7f68b0070c90 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009870 tx=0x7f68a001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9ba567d4a4c755 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b49cc640 1 -- 172.21.15.53:0/3908692423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00ab650 con 0x7f68b015b7c0 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b49cc640 1 -- 172.21.15.53:0/3908692423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a00ab7b0 con 0x7f68b015b7c0 2024-09-13T18:35:21.454 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b49cc640 1 -- 172.21.15.53:0/3908692423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00abb40 con 0x7f68b015b7c0 2024-09-13T18:35:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 -- 172.21.15.53:0/3908692423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b015b7c0 msgr2=0x7f68b0070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 --2- 172.21.15.53:0/3908692423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b015b7c0 0x7f68b0070c90 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009870 tx=0x7f68a001c560 comp rx=0 tx=0).stop 2024-09-13T18:35:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 -- 172.21.15.53:0/3908692423 shutdown_connections 2024-09-13T18:35:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 --2- 172.21.15.53:0/3908692423 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b01640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 --2- 172.21.15.53:0/3908692423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b015b7c0 0x7f68b0070c90 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.455 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 -- 172.21.15.53:0/3908692423 >> 172.21.15.53:0/3908692423 conn(0x7f68b0065c80 msgr2=0x7f68b0066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 -- 172.21.15.53:0/3908692423 shutdown_connections 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 -- 172.21.15.53:0/3908692423 wait complete. 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 Processor -- start 2024-09-13T18:35:21.456 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.455+0000 7f68b7c32640 1 -- start start 2024-09-13T18:35:21.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b0145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.458 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b01582a0 0x7f68b0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b015b7c0 0x7f68b00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b014d210 con 0x7f68b01582a0 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00b3570 con 0x7f68b015b7c0 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00b1520 con 0x7f68b00711d0 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b01582a0 0x7f68b0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b01582a0 0x7f68b0152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41392/0 (socket says 172.21.15.53:41392) 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 -- 172.21.15.53:0/1186516827 learned_addr learned my addr 172.21.15.53:0/1186516827 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b61cf640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b015b7c0 0x7f68b00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b59ce640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b0145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 -- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 msgr2=0x7f68b0145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b0145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.459 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 -- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b015b7c0 msgr2=0x7f68b00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b015b7c0 0x7f68b00ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 -- 172.21.15.53:0/1186516827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00094d0 con 0x7f68b01582a0 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b61cf640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b015b7c0 0x7f68b00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b59ce640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b0145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b51cd640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b01582a0 0x7f68b0152280 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f68a001a190 tx=0x7f68a001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68a67fc640 1 -- 172.21.15.53:0/1186516827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00b4800 con 0x7f68b01582a0 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68a67fc640 1 -- 172.21.15.53:0/1186516827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a00b4980 con 0x7f68b01582a0 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68a67fc640 1 -- 172.21.15.53:0/1186516827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00b4d30 con 0x7f68b01582a0 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b0150930 con 0x7f68b01582a0 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b014d460 con 0x7f68b01582a0 2024-09-13T18:35:21.460 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b0067400 con 0x7f68b01582a0 2024-09-13T18:35:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68a67fc640 1 -- 172.21.15.53:0/1186516827 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f68a00c83a0 con 0x7f68b01582a0 2024-09-13T18:35:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68a67fc640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68940671d0 0x7f6894069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68a67fc640 1 -- 172.21.15.53:0/1186516827 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f68a011d4c0 con 0x7f68b01582a0 2024-09-13T18:35:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.459+0000 7f68b59ce640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68940671d0 0x7f6894069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.461 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.463+0000 7f68b59ce640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68940671d0 0x7f6894069690 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f68ac007fd0 tx=0x7f68ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.463+0000 7f68a67fc640 1 -- 172.21.15.53:0/1186516827 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68a00ec390 con 0x7f68b01582a0 2024-09-13T18:35:21.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f68b00cb710 con 0x7f68940671d0 2024-09-13T18:35:21.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68a67fc640 1 -- 172.21.15.53:0/1186516827 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f68b00cb710 con 0x7f68940671d0 2024-09-13T18:35:21.622 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:35:21.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68940671d0 msgr2=0x7f6894069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68b7c32640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68940671d0 0x7f6894069690 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f68ac007fd0 tx=0x7f68ac009040 comp rx=0 tx=0).stop 2024-09-13T18:35:21.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b01582a0 msgr2=0x7f68b0152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68b7c32640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b01582a0 0x7f68b0152280 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f68a001a190 tx=0x7f68a001ada0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 shutdown_connections 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.623+0000 7f68b7c32640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f68940671d0 0x7f6894069690 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.627+0000 7f68b7c32640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68b015b7c0 0x7f68b00ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.627+0000 7f68b7c32640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68b01582a0 0x7f68b0152280 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.627+0000 7f68b7c32640 1 --2- 172.21.15.53:0/1186516827 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68b00711d0 0x7f68b0145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.627+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 >> 172.21.15.53:0/1186516827 conn(0x7f68b0065c80 msgr2=0x7f68b006f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.627+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 shutdown_connections 2024-09-13T18:35:21.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.627+0000 7f68b7c32640 1 -- 172.21.15.53:0/1186516827 wait complete. 2024-09-13T18:35:21.640 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:35:21.641 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:21.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28da3ed640 1 Processor -- start 2024-09-13T18:35:21.763 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28da3ed640 1 -- start start 2024-09-13T18:35:21.764 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28da3ed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28d415c5e0 0x7f28d415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28da3ed640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 0x7f28d406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28da3ed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d4070fb0 con 0x7f28d406f370 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28da3ed640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d406d620 con 0x7f28d415c5e0 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28da3ed640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d415dd30 con 0x7f28d406ccc0 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28d3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28d415c5e0 0x7f28d415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28d898a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f28d406f370 0x7f28d406f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43632/0 (socket says 172.21.15.53:43632) 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28d898a640 1 -- 172.21.15.53:0/4257851143 learned_addr learned my addr 172.21.15.53:0/4257851143 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28d3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28d415c5e0 0x7f28d415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41394/0 (socket says 172.21.15.53:41394) 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.763+0000 7f28cbfff640 1 --2- 172.21.15.53:0/4257851143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 0x7f28d406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d3fff640 1 -- 172.21.15.53:0/4257851143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 msgr2=0x7f28d406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d3fff640 1 --2- 172.21.15.53:0/4257851143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 0x7f28d406d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d3fff640 1 -- 172.21.15.53:0/4257851143 >> v1:172.21.15.53:6789/0 conn(0x7f28d406f370 legacy=0x7f28d406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.765 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d37fe640 1 -- 172.21.15.53:0/4257851143 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407107430 0 0) 0x7f28d4070fb0 con 0x7f28d406f370 2024-09-13T18:35:21.766 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d3fff640 1 -- 172.21.15.53:0/4257851143 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40cd810 con 0x7f28d415c5e0 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d3fff640 1 --2- 172.21.15.53:0/4257851143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d415d7f0 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097c0 tx=0x7f28c401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ae386e1f3d45cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d37fe640 1 -- 172.21.15.53:0/4257851143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40ab670 con 0x7f28d415c5e0 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d37fe640 1 -- 172.21.15.53:0/4257851143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c40ab7d0 con 0x7f28d415c5e0 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28d37fe640 1 -- 172.21.15.53:0/4257851143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40abb60 con 0x7f28d415c5e0 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 -- 172.21.15.53:0/4257851143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 msgr2=0x7f28d415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 --2- 172.21.15.53:0/4257851143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d415d7f0 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097c0 tx=0x7f28c401c470 comp rx=0 tx=0).stop 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 -- 172.21.15.53:0/4257851143 shutdown_connections 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 --2- 172.21.15.53:0/4257851143 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 0x7f28d406d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 --2- 172.21.15.53:0/4257851143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d415d7f0 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 -- 172.21.15.53:0/4257851143 >> 172.21.15.53:0/4257851143 conn(0x7f28d4073330 msgr2=0x7f28d4065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 -- 172.21.15.53:0/4257851143 shutdown_connections 2024-09-13T18:35:21.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.767+0000 7f28da3ed640 1 -- 172.21.15.53:0/4257851143 wait complete. 2024-09-13T18:35:21.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 Processor -- start 2024-09-13T18:35:21.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 -- start start 2024-09-13T18:35:21.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 0x7f28d40b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.771 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28d406f370 0x7f28d414bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b1740 con 0x7f28d415c5e0 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b1a20 con 0x7f28d406f370 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b1d00 con 0x7f28d406ccc0 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d414adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41410/0 (socket says 172.21.15.53:41410) 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 -- 172.21.15.53:0/1450239402 learned_addr learned my addr 172.21.15.53:0/1450239402 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 -- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 msgr2=0x7f28d40b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28d406ccc0 0x7f28d40b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 -- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28d406f370 msgr2=0x7f28d414bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28d406f370 0x7f28d414bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 -- 172.21.15.53:0/1450239402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4009420 con 0x7f28d415c5e0 2024-09-13T18:35:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d898a640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d414adf0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f28cc001570 tx=0x7f28cc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00a640 con 0x7f28d415c5e0 2024-09-13T18:35:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00a7c0 con 0x7f28d415c5e0 2024-09-13T18:35:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00ab70 con 0x7f28d415c5e0 2024-09-13T18:35:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d40b1fe0 con 0x7f28d415c5e0 2024-09-13T18:35:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d40b0fb0 con 0x7f28d415c5e0 2024-09-13T18:35:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28d40cdc40 con 0x7f28d415c5e0 2024-09-13T18:35:21.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f28cc00acd0 con 0x7f28d415c5e0 2024-09-13T18:35:21.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28b40671d0 0x7f28b4069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f28cc082aa0 con 0x7f28d415c5e0 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d3fff640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28b40671d0 0x7f28b4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f28b406d030 0x7f28b406f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 --> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28b406fb00 con 0x7f28b406d030 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.771+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28cc0854d0 con 0x7f28d415c5e0 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.775+0000 7f28d3fff640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28b40671d0 0x7f28b4069690 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f28c40af000 tx=0x7f28c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.775+0000 7f28cbfff640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f28b406d030 0x7f28b406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.775+0000 7f28cbfff640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f28b406d030 0x7f28b406f450 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.775+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== osd.5 v2:172.21.15.87:6808/4170330072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f28b406fb00 con 0x7f28b406d030 2024-09-13T18:35:21.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 --> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f28d40cc290 con 0x7f28b406d030 2024-09-13T18:35:21.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28d17fa640 1 -- 172.21.15.53:0/1450239402 <== osd.5 v2:172.21.15.87:6808/4170330072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f28bc009a40 con 0x7f28b406d030 2024-09-13T18:35:21.788 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:21.788 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:21.788 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f28b406d030 msgr2=0x7f28b406f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.87:6808/4170330072,v1:172.21.15.87:6809/4170330072] conn(0x7f28b406d030 0x7f28b406f450 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28b40671d0 msgr2=0x7f28b4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f28b40671d0 0x7f28b4069690 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f28c40af000 tx=0x7f28c4008040 comp rx=0 tx=0).stop 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 msgr2=0x7f28d414adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 --2- 172.21.15.53:0/1450239402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28d415c5e0 0x7f28d414adf0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f28cc001570 tx=0x7f28cc00cca0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28d898a640 1 -- 172.21.15.53:0/1450239402 reap_dead start 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 shutdown_connections 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 >> 172.21.15.53:0/1450239402 conn(0x7f28d4073330 msgr2=0x7f28d406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 shutdown_connections 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.787+0000 7f28da3ed640 1 -- 172.21.15.53:0/1450239402 wait complete. 2024-09-13T18:35:21.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:35:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.919+0000 7f064d55e640 1 Processor -- start 2024-09-13T18:35:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.919+0000 7f064d55e640 1 -- start start 2024-09-13T18:35:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.919+0000 7f064d55e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f064815c770 0x7f0648065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.919+0000 7f064d55e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06480b36a0 0x7f06480661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.919+0000 7f064d55e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06480af0d0 con 0x7f06480ade00 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.919+0000 7f064d55e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06480ad9e0 con 0x7f06480b36a0 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.919+0000 7f064d55e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064815cb50 con 0x7f064815c770 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06480b36a0 0x7f06480661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06480b36a0 0x7f06480661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41420/0 (socket says 172.21.15.53:41420) 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 -- 172.21.15.53:0/947517034 learned_addr learned my addr 172.21.15.53:0/947517034 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f0646ffd640 1 --2- 172.21.15.53:0/947517034 >> v2:172.21.15.87:3300/0 conn(0x7f064815c770 0x7f0648065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 -- 172.21.15.53:0/947517034 >> v2:172.21.15.87:3300/0 conn(0x7f064815c770 msgr2=0x7f0648065c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 --2- 172.21.15.53:0/947517034 >> v2:172.21.15.87:3300/0 conn(0x7f064815c770 0x7f0648065c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f0645ffb640 1 -- 172.21.15.53:0/947517034 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321672295 0 0) 0x7f06480af0d0 con 0x7f06480ade00 2024-09-13T18:35:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 -- 172.21.15.53:0/947517034 >> v1:172.21.15.53:6789/0 conn(0x7f06480ade00 legacy=0x7f06480b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 -- 172.21.15.53:0/947517034 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480acd60 con 0x7f06480b36a0 2024-09-13T18:35:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f06477fe640 1 --2- 172.21.15.53:0/947517034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06480b36a0 0x7f06480661c0 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f0648067b30 tx=0x7f063801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4c8642ead68ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f0645ffb640 1 -- 172.21.15.53:0/947517034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380ab660 con 0x7f06480b36a0 2024-09-13T18:35:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f0645ffb640 1 -- 172.21.15.53:0/947517034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380ab7c0 con 0x7f06480b36a0 2024-09-13T18:35:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f0645ffb640 1 -- 172.21.15.53:0/947517034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380abb50 con 0x7f06480b36a0 2024-09-13T18:35:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 -- 172.21.15.53:0/947517034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06480b36a0 msgr2=0x7f06480661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 --2- 172.21.15.53:0/947517034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06480b36a0 0x7f06480661c0 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f0648067b30 tx=0x7f063801c460 comp rx=0 tx=0).stop 2024-09-13T18:35:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 -- 172.21.15.53:0/947517034 shutdown_connections 2024-09-13T18:35:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 --2- 172.21.15.53:0/947517034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06480b36a0 0x7f06480661c0 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 --2- 172.21.15.53:0/947517034 >> v2:172.21.15.87:3300/0 conn(0x7f064815c770 0x7f0648065c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 -- 172.21.15.53:0/947517034 >> 172.21.15.53:0/947517034 conn(0x7f06480b1310 msgr2=0x7f06480b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 -- 172.21.15.53:0/947517034 shutdown_connections 2024-09-13T18:35:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.923+0000 7f064d55e640 1 -- 172.21.15.53:0/947517034 wait complete. 2024-09-13T18:35:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 Processor -- start 2024-09-13T18:35:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 -- start start 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06480ade00 0x7f064814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06480b36a0 0x7f064815e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f064815c770 0x7f064814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064814fad0 con 0x7f064815c770 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064815ecc0 con 0x7f06480b36a0 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064814eec0 con 0x7f06480ade00 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f064815c770 0x7f064814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f064815c770 0x7f064814dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41422/0 (socket says 172.21.15.53:41422) 2024-09-13T18:35:21.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 -- 172.21.15.53:0/2587286223 learned_addr learned my addr 172.21.15.53:0/2587286223 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06467fc640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06480b36a0 0x7f064815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 -- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06480ade00 msgr2=0x7f064814e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f0646ffd640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06480ade00 0x7f064814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06480ade00 0x7f064814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 -- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06480b36a0 msgr2=0x7f064815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06480b36a0 0x7f064815e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 -- 172.21.15.53:0/2587286223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380094d0 con 0x7f064815c770 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06467fc640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06480b36a0 0x7f064815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f06477fe640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f064815c770 0x7f064814dfb0 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f06380ad040 tx=0x7f063801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f063f7fe640 1 -- 172.21.15.53:0/2587286223 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380be5f0 con 0x7f064815c770 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f063f7fe640 1 -- 172.21.15.53:0/2587286223 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380be750 con 0x7f064815c770 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064814f1a0 con 0x7f064815c770 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f063f7fe640 1 -- 172.21.15.53:0/2587286223 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380beb00 con 0x7f064815c770 2024-09-13T18:35:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064814f760 con 0x7f064815c770 2024-09-13T18:35:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.927+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06480716a0 con 0x7f064815c770 2024-09-13T18:35:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.931+0000 7f063f7fe640 1 -- 172.21.15.53:0/2587286223 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f06380a9070 con 0x7f064815c770 2024-09-13T18:35:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.931+0000 7f063f7fe640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0628067200 0x7f06280696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.931+0000 7f063f7fe640 1 -- 172.21.15.53:0/2587286223 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f063811ce50 con 0x7f064815c770 2024-09-13T18:35:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.931+0000 7f0646ffd640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0628067200 0x7f06280696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.931+0000 7f0646ffd640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0628067200 0x7f06280696c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0640007380 tx=0x7f064000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:21.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:21.935+0000 7f063f7fe640 1 -- 172.21.15.53:0/2587286223 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06380ebc50 con 0x7f064815c770 2024-09-13T18:35:22.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.095+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f06480b3410 con 0x7f0628067200 2024-09-13T18:35:22.095 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.095+0000 7f063f7fe640 1 -- 172.21.15.53:0/2587286223 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06480b3410 con 0x7f0628067200 2024-09-13T18:35:22.095 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:35:22.097 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0628067200 msgr2=0x7f06280696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0628067200 0x7f06280696c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0640007380 tx=0x7f064000b040 comp rx=0 tx=0).stop 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f064815c770 msgr2=0x7f064814dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f064815c770 0x7f064814dfb0 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f06380ad040 tx=0x7f063801aca0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 shutdown_connections 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f0628067200 0x7f06280696c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f064815c770 0x7f064814dfb0 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f06480b36a0 0x7f064815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 --2- 172.21.15.53:0/2587286223 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06480ade00 0x7f064814e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 >> 172.21.15.53:0/2587286223 conn(0x7f06480b1310 msgr2=0x7f06480b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 shutdown_connections 2024-09-13T18:35:22.098 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.099+0000 7f064d55e640 1 -- 172.21.15.53:0/2587286223 wait complete. 2024-09-13T18:35:22.114 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:35:22.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:22.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.243+0000 7f495fbd4640 1 Processor -- start 2024-09-13T18:35:22.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.243+0000 7f495fbd4640 1 -- start start 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.243+0000 7f495fbd4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f495815c5e0 0x7f495815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.243+0000 7f495fbd4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f49580cc800 0x7f49580ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.243+0000 7f495fbd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4958070fb0 con 0x7f495806ccc0 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495815dd30 con 0x7f495815c5e0 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4958070a10 con 0x7f49580cc800 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f495815c5e0 0x7f495815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f495815c5e0 0x7f495815d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41434/0 (socket says 172.21.15.53:41434) 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 -- 172.21.15.53:0/4037888511 learned_addr learned my addr 172.21.15.53:0/4037888511 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 -- 172.21.15.53:0/4037888511 >> v2:172.21.15.87:3300/0 conn(0x7f49580cc800 msgr2=0x7f49580ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 --2- 172.21.15.53:0/4037888511 >> v2:172.21.15.87:3300/0 conn(0x7f49580cc800 0x7f49580ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 -- 172.21.15.53:0/4037888511 >> v1:172.21.15.87:6789/0 conn(0x7f495806ccc0 legacy=0x7f495806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 -- 172.21.15.53:0/4037888511 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580711e0 con 0x7f495815c5e0 2024-09-13T18:35:22.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495d970640 1 --2- 172.21.15.53:0/4037888511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495815d7f0 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f49580cdf40 tx=0x7f495401e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa84f204724e305 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495c96e640 1 -- 172.21.15.53:0/4037888511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540ab630 con 0x7f495815c5e0 2024-09-13T18:35:22.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495c96e640 1 -- 172.21.15.53:0/4037888511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49540ab790 con 0x7f495815c5e0 2024-09-13T18:35:22.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495c96e640 1 -- 172.21.15.53:0/4037888511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540abb20 con 0x7f495815c5e0 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 -- 172.21.15.53:0/4037888511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 msgr2=0x7f495815d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 --2- 172.21.15.53:0/4037888511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495815d7f0 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f49580cdf40 tx=0x7f495401e6c0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 -- 172.21.15.53:0/4037888511 shutdown_connections 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 --2- 172.21.15.53:0/4037888511 >> v2:172.21.15.87:3300/0 conn(0x7f49580cc800 0x7f49580ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 --2- 172.21.15.53:0/4037888511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495815d7f0 unknown :-1 s=CLOSED pgs=2502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 -- 172.21.15.53:0/4037888511 >> 172.21.15.53:0/4037888511 conn(0x7f4958073330 msgr2=0x7f4958065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 -- 172.21.15.53:0/4037888511 shutdown_connections 2024-09-13T18:35:22.248 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.247+0000 7f495fbd4640 1 -- 172.21.15.53:0/4037888511 wait complete. 2024-09-13T18:35:22.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 Processor -- start 2024-09-13T18:35:22.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 -- start start 2024-09-13T18:35:22.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f495806ccc0 0x7f4958147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49580cc800 0x7f495814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495814d700 con 0x7f495815c5e0 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495814c660 con 0x7f495806ccc0 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495814c940 con 0x7f49580cc800 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495814ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41444/0 (socket says 172.21.15.53:41444) 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 -- 172.21.15.53:0/16531636 learned_addr learned my addr 172.21.15.53:0/16531636 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495d970640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f495806ccc0 0x7f4958147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495d16f640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49580cc800 0x7f495814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 -- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49580cc800 msgr2=0x7f495814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49580cc800 0x7f495814a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 -- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f495806ccc0 msgr2=0x7f4958147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f495806ccc0 0x7f4958147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 -- 172.21.15.53:0/16531636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49540094d0 con 0x7f495815c5e0 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495d970640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f495806ccc0 0x7f4958147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495e171640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495814ff40 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7f495000b970 tx=0x7f495000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495000cb40 con 0x7f495815c5e0 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495000ccc0 con 0x7f495815c5e0 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950014680 con 0x7f495815c5e0 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495814cc20 con 0x7f495815c5e0 2024-09-13T18:35:22.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495814d1e0 con 0x7f495815c5e0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.251+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f495806b3e0 con 0x7f495815c5e0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f495001d3b0 con 0x7f495815c5e0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f494e7fc640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f493c067200 0x7f493c0696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f49500833a0 con 0x7f495815c5e0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f495d970640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f493c067200 0x7f493c0696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f494e7fc640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7f493c06d060 0x7f493c06f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 --> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f493c06fb30 con 0x7f493c06d060 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4950085f10 con 0x7f495815c5e0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f495d970640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f493c067200 0x7f493c0696c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f49540b0000 tx=0x7f49540b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f495d16f640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7f493c06d060 0x7f493c06f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f495d16f640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7f493c06d060 0x7f493c06f480 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.255+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== osd.6 v2:172.21.15.87:6824/2962233579 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f493c06fb30 con 0x7f493c06d060 2024-09-13T18:35:22.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 --> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f49580b1490 con 0x7f493c06d060 2024-09-13T18:35:22.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f494e7fc640 1 -- 172.21.15.53:0/16531636 <== osd.6 v2:172.21.15.87:6824/2962233579 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f49480012d0 con 0x7f493c06d060 2024-09-13T18:35:22.270 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:22.270 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:22.270 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:22.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7f493c06d060 msgr2=0x7f493c06f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.87:6824/2962233579,v1:172.21.15.87:6825/2962233579] conn(0x7f493c06d060 0x7f493c06f480 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f493c067200 msgr2=0x7f493c0696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f493c067200 0x7f493c0696c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f49540b0000 tx=0x7f49540b5040 comp rx=0 tx=0).stop 2024-09-13T18:35:22.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 msgr2=0x7f495814ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 --2- 172.21.15.53:0/16531636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f495815c5e0 0x7f495814ff40 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7f495000b970 tx=0x7f495000be30 comp rx=0 tx=0).stop 2024-09-13T18:35:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495e171640 1 -- 172.21.15.53:0/16531636 reap_dead start 2024-09-13T18:35:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 shutdown_connections 2024-09-13T18:35:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 >> 172.21.15.53:0/16531636 conn(0x7f4958073330 msgr2=0x7f495815af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 shutdown_connections 2024-09-13T18:35:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.271+0000 7f495fbd4640 1 -- 172.21.15.53:0/16531636 wait complete. 2024-09-13T18:35:22.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:35:22.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3159fae640 1 Processor -- start 2024-09-13T18:35:22.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3159fae640 1 -- start start 2024-09-13T18:35:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3159fae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 0x7f3154160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3159fae640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3154160d70 0x7f31540d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3159fae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31541603a0 con 0x7f31540cd720 2024-09-13T18:35:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3159fae640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315415db20 con 0x7f3154160d70 2024-09-13T18:35:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3159fae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315415d280 con 0x7f315415cb80 2024-09-13T18:35:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31537fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f31540cd720 0x7f31540b18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43664/0 (socket says 172.21.15.53:43664) 2024-09-13T18:35:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31537fe640 1 -- 172.21.15.53:0/2647425208 learned_addr learned my addr 172.21.15.53:0/2647425208 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3152ffd640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 0x7f3154160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3153fff640 1 --2- 172.21.15.53:0/2647425208 >> v2:172.21.15.87:3300/0 conn(0x7f3154160d70 0x7f31540d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928894844 0 0) 0x7f31541603a0 con 0x7f31540cd720 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f313c003530 con 0x7f31540cd720 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2698956501 0 0) 0x7f313c003530 con 0x7f31540cd720 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 msgr2=0x7f3154160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 0x7f3154160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 >> v2:172.21.15.87:3300/0 conn(0x7f3154160d70 msgr2=0x7f31540d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 --2- 172.21.15.53:0/2647425208 >> v2:172.21.15.87:3300/0 conn(0x7f3154160d70 0x7f31540d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315415d560 con 0x7f31540cd720 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7f3144001680 con 0x7f31540cd720 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 >> v1:172.21.15.53:6789/0 conn(0x7f31540cd720 legacy=0x7f31540b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f313c003980 0x7f313c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0047d0 0x7f313c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 0x7f313c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315415db20 con 0x7f313c003980 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315415d280 con 0x7f313c0047d0 2024-09-13T18:35:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c00b9c0 con 0x7f315415cb80 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31537fe640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f313c003980 0x7f313c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3152ffd640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0047d0 0x7f313c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f3153fff640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 0x7f313c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31537fe640 1 -- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 msgr2=0x7f313c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31537fe640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f315415cb80 0x7f313c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31537fe640 1 -- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0047d0 msgr2=0x7f313c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.403+0000 7f31537fe640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f313c0047d0 0x7f313c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f31537fe640 1 -- 172.21.15.53:0/2647425208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c003530 con 0x7f313c003980 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f31537fe640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f313c003980 0x7f313c003da0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f314400c210 tx=0x7f314401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bcf2ba64d4f5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31440a8ce0 con 0x7f313c003980 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31440a8e40 con 0x7f313c003980 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f31527fc640 1 -- 172.21.15.53:0/2647425208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144005b20 con 0x7f313c003980 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f3159fae640 1 -- 172.21.15.53:0/2647425208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f313c003980 msgr2=0x7f313c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f3159fae640 1 --2- 172.21.15.53:0/2647425208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f313c003980 0x7f313c003da0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f314400c210 tx=0x7f314401f3b0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f3153fff640 1 -- 172.21.15.53:0/2647425208 reap_dead start 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f3159fae640 1 -- 172.21.15.53:0/2647425208 shutdown_connections 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f3159fae640 1 -- 172.21.15.53:0/2647425208 >> 172.21.15.53:0/2647425208 conn(0x7f3154070970 msgr2=0x7f3154070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f3159fae640 1 -- 172.21.15.53:0/2647425208 shutdown_connections 2024-09-13T18:35:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.407+0000 7f3159fae640 1 -- 172.21.15.53:0/2647425208 wait complete. 2024-09-13T18:35:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 Processor -- start 2024-09-13T18:35:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 -- start start 2024-09-13T18:35:22.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31541485b0 0x7f3154158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31541589a0 0x7f3154156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3154148990 0x7f3154156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c8d30 con 0x7f31541589a0 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31541596e0 con 0x7f31541485b0 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3154158e40 con 0x7f3154148990 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31541589a0 0x7f3154156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31541589a0 0x7f3154156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41460/0 (socket says 172.21.15.53:41460) 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 -- 172.21.15.53:0/3794350675 learned_addr learned my addr 172.21.15.53:0/3794350675 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f31537fe640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31541485b0 0x7f3154158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3153fff640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3154148990 0x7f3154156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 -- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3154148990 msgr2=0x7f3154156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3154148990 0x7f3154156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 -- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31541485b0 msgr2=0x7f3154158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31541485b0 0x7f3154158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 -- 172.21.15.53:0/3794350675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154159120 con 0x7f31541589a0 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f31537fe640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31541485b0 0x7f3154158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3152ffd640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31541589a0 0x7f3154156400 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f3148011510 tx=0x7f31480119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f313bfff640 1 -- 172.21.15.53:0/3794350675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148015930 con 0x7f31541589a0 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f313bfff640 1 -- 172.21.15.53:0/3794350675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3148015a90 con 0x7f31541589a0 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3154159400 con 0x7f31541589a0 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f313bfff640 1 -- 172.21.15.53:0/3794350675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148015e40 con 0x7f31541589a0 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31541f5d10 con 0x7f31541589a0 2024-09-13T18:35:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3154160830 con 0x7f31541589a0 2024-09-13T18:35:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.411+0000 7f313bfff640 1 -- 172.21.15.53:0/3794350675 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f314801d400 con 0x7f31541589a0 2024-09-13T18:35:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.415+0000 7f313bfff640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31400671d0 0x7f3140069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.415+0000 7f313bfff640 1 -- 172.21.15.53:0/3794350675 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3148083540 con 0x7f31541589a0 2024-09-13T18:35:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.415+0000 7f31537fe640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31400671d0 0x7f3140069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.415+0000 7f31537fe640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31400671d0 0x7f3140069690 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f31440ad000 tx=0x7f3144000ff0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.419+0000 7f313bfff640 1 -- 172.21.15.53:0/3794350675 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3148052110 con 0x7f31541589a0 2024-09-13T18:35:22.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.575+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f315415cf80 con 0x7f31400671d0 2024-09-13T18:35:22.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.575+0000 7f313bfff640 1 -- 172.21.15.53:0/3794350675 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3144001640 con 0x7f31400671d0 2024-09-13T18:35:22.576 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:35:22.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31400671d0 msgr2=0x7f3140069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31400671d0 0x7f3140069690 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f31440ad000 tx=0x7f3144000ff0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31541589a0 msgr2=0x7f3154156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31541589a0 0x7f3154156400 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f3148011510 tx=0x7f31480119d0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 shutdown_connections 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f31400671d0 0x7f3140069690 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3154148990 0x7f3154156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31541589a0 0x7f3154156400 unknown :-1 s=CLOSED pgs=2506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 --2- 172.21.15.53:0/3794350675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31541485b0 0x7f3154158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 >> 172.21.15.53:0/3794350675 conn(0x7f3154070970 msgr2=0x7f315415ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 shutdown_connections 2024-09-13T18:35:22.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.579+0000 7f3159fae640 1 -- 172.21.15.53:0/3794350675 wait complete. 2024-09-13T18:35:22.596 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:35:22.596 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:35:22.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4ea9b640 1 Processor -- start 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4ea9b640 1 -- start start 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4ea9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fac4815c860 0x7fac480cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4ea9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac480cf970 0x7fac480b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4ea9b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac480b5bc0 con 0x7fac480d3220 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4ea9b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4815cc40 con 0x7fac480cf970 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4ea9b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac480ccd40 con 0x7fac4815c860 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4d038640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac480cf970 0x7fac480b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4d038640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac480cf970 0x7fac480b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41472/0 (socket says 172.21.15.53:41472) 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4d038640 1 -- 172.21.15.53:0/3716741862 learned_addr learned my addr 172.21.15.53:0/3716741862 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:22.722 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.719+0000 7fac4c837640 1 --2- 172.21.15.53:0/3716741862 >> v2:172.21.15.87:3300/0 conn(0x7fac4815c860 0x7fac480cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4d038640 1 -- 172.21.15.53:0/3716741862 >> v2:172.21.15.87:3300/0 conn(0x7fac4815c860 msgr2=0x7fac480cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4d038640 1 --2- 172.21.15.53:0/3716741862 >> v2:172.21.15.87:3300/0 conn(0x7fac4815c860 0x7fac480cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4d038640 1 -- 172.21.15.53:0/3716741862 >> v1:172.21.15.87:6789/0 conn(0x7fac480d3220 legacy=0x7fac480cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4d038640 1 -- 172.21.15.53:0/3716741862 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac480cd000 con 0x7fac480cf970 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4d038640 1 --2- 172.21.15.53:0/3716741862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480cf970 0x7fac480b6050 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fac480d3760 tx=0x7fac4001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90861dc068007aef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac477fe640 1 -- 172.21.15.53:0/3716741862 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac400af400 con 0x7fac480cf970 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac477fe640 1 -- 172.21.15.53:0/3716741862 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400ab050 con 0x7fac480cf970 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac477fe640 1 -- 172.21.15.53:0/3716741862 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac400af780 con 0x7fac480cf970 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 -- 172.21.15.53:0/3716741862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480cf970 msgr2=0x7fac480b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 --2- 172.21.15.53:0/3716741862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480cf970 0x7fac480b6050 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fac480d3760 tx=0x7fac4001f1e0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 -- 172.21.15.53:0/3716741862 shutdown_connections 2024-09-13T18:35:22.724 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 --2- 172.21.15.53:0/3716741862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480cf970 0x7fac480b6050 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 --2- 172.21.15.53:0/3716741862 >> v2:172.21.15.87:3300/0 conn(0x7fac4815c860 0x7fac480cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.725 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 -- 172.21.15.53:0/3716741862 >> 172.21.15.53:0/3716741862 conn(0x7fac48070570 msgr2=0x7fac48070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 -- 172.21.15.53:0/3716741862 shutdown_connections 2024-09-13T18:35:22.726 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.723+0000 7fac4ea9b640 1 -- 172.21.15.53:0/3716741862 wait complete. 2024-09-13T18:35:22.727 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 Processor -- start 2024-09-13T18:35:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 -- start start 2024-09-13T18:35:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac480cf970 0x7fac480a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480d3220 0x7fac4814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4815c860 0x7fac480cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac480cba00 con 0x7fac480d3220 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac480cadf0 con 0x7fac4815c860 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac480cb0d0 con 0x7fac480cf970 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480d3220 0x7fac4814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480d3220 0x7fac4814f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41478/0 (socket says 172.21.15.53:41478) 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 -- 172.21.15.53:0/2340215220 learned_addr learned my addr 172.21.15.53:0/2340215220 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4d038640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4815c860 0x7fac480cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4c837640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac480cf970 0x7fac480a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 -- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac480cf970 msgr2=0x7fac480a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fac480cf970 0x7fac480a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 -- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4815c860 msgr2=0x7fac480cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.729 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fac4815c860 0x7fac480cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 -- 172.21.15.53:0/2340215220 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009b30 con 0x7fac480d3220 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac47fff640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480d3220 0x7fac4814f990 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fac3400c500 tx=0x7fac3400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34005220 con 0x7fac480d3220 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34005380 con 0x7fac480d3220 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac480cb3b0 con 0x7fac480d3220 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34007270 con 0x7fac480d3220 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac480a96e0 con 0x7fac480d3220 2024-09-13T18:35:22.730 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac480cdc20 con 0x7fac480d3220 2024-09-13T18:35:22.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.727+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fac340073d0 con 0x7fac480d3220 2024-09-13T18:35:22.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac457fa640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac2c0671d0 0x7fac2c069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac34083300 con 0x7fac480d3220 2024-09-13T18:35:22.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac4c837640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac2c0671d0 0x7fac2c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac457fa640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fac2c06d030 0x7fac2c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 --> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac2c06fb00 con 0x7fac2c06d030 2024-09-13T18:35:22.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=177) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac340859d0 con 0x7fac480d3220 2024-09-13T18:35:22.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac4c837640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac2c0671d0 0x7fac2c069690 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0079c0 tx=0x7fac3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac4d038640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fac2c06d030 0x7fac2c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac4d038640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fac2c06d030 0x7fac2c06f450 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.731+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== osd.7 v2:172.21.15.87:6800/3723126663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fac2c06fb00 con 0x7fac2c06d030 2024-09-13T18:35:22.744 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.743+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 --> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fac480b5820 con 0x7fac2c06d030 2024-09-13T18:35:22.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac457fa640 1 -- 172.21.15.53:0/2340215220 <== osd.7 v2:172.21.15.87:6800/3723126663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fac40009270 con 0x7fac2c06d030 2024-09-13T18:35:22.745 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-13T18:35:22.745 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:35:22.745 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-13T18:35:22.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fac2c06d030 msgr2=0x7fac2c06f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.87:6800/3723126663,v1:172.21.15.87:6801/3723126663] conn(0x7fac2c06d030 0x7fac2c06f450 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac2c0671d0 msgr2=0x7fac2c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fac2c0671d0 0x7fac2c069690 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0079c0 tx=0x7fac3c008040 comp rx=0 tx=0).stop 2024-09-13T18:35:22.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480d3220 msgr2=0x7fac4814f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.746 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 --2- 172.21.15.53:0/2340215220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac480d3220 0x7fac4814f990 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fac3400c500 tx=0x7fac3400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4d038640 1 -- 172.21.15.53:0/2340215220 reap_dead start 2024-09-13T18:35:22.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 shutdown_connections 2024-09-13T18:35:22.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 >> 172.21.15.53:0/2340215220 conn(0x7fac48070570 msgr2=0x7fac480b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 shutdown_connections 2024-09-13T18:35:22.747 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.747+0000 7fac4ea9b640 1 -- 172.21.15.53:0/2340215220 wait complete. 2024-09-13T18:35:22.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:35:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b8cd0640 1 Processor -- start 2024-09-13T18:35:22.878 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b8cd0640 1 -- start start 2024-09-13T18:35:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b8cd0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f62b40acbc0 0x7f62b4065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.879 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b8cd0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b40ad000 con 0x7f62b415c750 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b8cd0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b40ad230 con 0x7f62b40661c0 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b8cd0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b4066630 con 0x7f62b40acbc0 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62a9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f62b40acbc0 0x7f62b4065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62a9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f62b40acbc0 0x7f62b4065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41492/0 (socket says 172.21.15.53:41492) 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62a9d9b640 1 -- 172.21.15.53:0/4175126558 learned_addr learned my addr 172.21.15.53:0/4175126558 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b259c640 1 --1- 172.21.15.53:0/4175126558 >> v1:172.21.15.53:6789/0 conn(0x7f62b415c750 0x7f62b40ae980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43672/0 (socket says 172.21.15.53:43672) 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62a9d9b640 1 -- 172.21.15.53:0/4175126558 >> v1:172.21.15.87:6789/0 conn(0x7f62b40661c0 legacy=0x7f62b406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62a9d9b640 1 -- 172.21.15.53:0/4175126558 >> v1:172.21.15.53:6789/0 conn(0x7f62b415c750 legacy=0x7f62b40ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62a9d9b640 1 -- 172.21.15.53:0/4175126558 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40ad510 con 0x7f62b40acbc0 2024-09-13T18:35:22.880 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.879+0000 7f62b1d9b640 1 -- 172.21.15.53:0/4175126558 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357199990 0 0) 0x7f62b40ad000 con 0x7f62b415c750 2024-09-13T18:35:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62a9d9b640 1 --2- 172.21.15.53:0/4175126558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b40acbc0 0x7f62b4065c80 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f629c009870 tx=0x7f629c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad10721f71542a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b1d9b640 1 -- 172.21.15.53:0/4175126558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0a9620 con 0x7f62b40acbc0 2024-09-13T18:35:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b1d9b640 1 -- 172.21.15.53:0/4175126558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c0a9780 con 0x7f62b40acbc0 2024-09-13T18:35:22.882 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b1d9b640 1 -- 172.21.15.53:0/4175126558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0a9b10 con 0x7f62b40acbc0 2024-09-13T18:35:22.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4175126558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b40acbc0 msgr2=0x7f62b4065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4175126558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b40acbc0 0x7f62b4065c80 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f629c009870 tx=0x7f629c01c560 comp rx=0 tx=0).stop 2024-09-13T18:35:22.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4175126558 shutdown_connections 2024-09-13T18:35:22.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4175126558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b40acbc0 0x7f62b4065c80 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4175126558 >> 172.21.15.53:0/4175126558 conn(0x7f62b40b1310 msgr2=0x7f62b40b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4175126558 shutdown_connections 2024-09-13T18:35:22.883 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.883+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4175126558 wait complete. 2024-09-13T18:35:22.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 Processor -- start 2024-09-13T18:35:22.884 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 -- start start 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62b40661c0 0x7f62b4148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b40acbc0 0x7f62b41462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b415c750 0x7f62b4156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4155b30 con 0x7f62b415c750 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4155e10 con 0x7f62b40acbc0 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41560f0 con 0x7f62b40661c0 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b415c750 0x7f62b4156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b415c750 0x7f62b4156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41500/0 (socket says 172.21.15.53:41500) 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 -- 172.21.15.53:0/4236866972 learned_addr learned my addr 172.21.15.53:0/4236866972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62a9d9b640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b40acbc0 0x7f62b41462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.887 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b259c640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62b40661c0 0x7f62b4148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 -- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62b40661c0 msgr2=0x7f62b4148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62b40661c0 0x7f62b4148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 -- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b40acbc0 msgr2=0x7f62b41462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b40acbc0 0x7f62b41462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 -- 172.21.15.53:0/4236866972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0094d0 con 0x7f62b415c750 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b2d9d640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b415c750 0x7f62b4156bd0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c730 tx=0x7f62ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62ab7fe640 1 -- 172.21.15.53:0/4236866972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac003b80 con 0x7f62b415c750 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62ab7fe640 1 -- 172.21.15.53:0/4236866972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac003ce0 con 0x7f62b415c750 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b41563d0 con 0x7f62b415c750 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62ab7fe640 1 -- 172.21.15.53:0/4236866972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00aa30 con 0x7f62b415c750 2024-09-13T18:35:22.888 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b4146800 con 0x7f62b415c750 2024-09-13T18:35:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b41568f0 con 0x7f62b415c750 2024-09-13T18:35:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.887+0000 7f62ab7fe640 1 -- 172.21.15.53:0/4236866972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f62ac00ab90 con 0x7f62b415c750 2024-09-13T18:35:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.891+0000 7f62ab7fe640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62940671d0 0x7f6294069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.889 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.891+0000 7f62ab7fe640 1 -- 172.21.15.53:0/4236866972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f62ac082af0 con 0x7f62b415c750 2024-09-13T18:35:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.891+0000 7f62b259c640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62940671d0 0x7f6294069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.890 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.891+0000 7f62b259c640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62940671d0 0x7f6294069690 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000f70 tx=0x7f62a4007bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.893 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:22.895+0000 7f62ab7fe640 1 -- 172.21.15.53:0/4236866972 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62b41568f0 con 0x7f62b415c750 2024-09-13T18:35:23.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.047+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f62b40af240 con 0x7f62940671d0 2024-09-13T18:35:23.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62ab7fe640 1 -- 172.21.15.53:0/4236866972 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62b40af240 con 0x7f62940671d0 2024-09-13T18:35:23.049 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62940671d0 msgr2=0x7f6294069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62940671d0 0x7f6294069690 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f62a4000f70 tx=0x7f62a4007bc0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b415c750 msgr2=0x7f62b4156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b415c750 0x7f62b4156bd0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c730 tx=0x7f62ac00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 shutdown_connections 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f62940671d0 0x7f6294069690 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b415c750 0x7f62b4156bd0 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62b40acbc0 0x7f62b41462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 --2- 172.21.15.53:0/4236866972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62b40661c0 0x7f62b4148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 >> 172.21.15.53:0/4236866972 conn(0x7f62b40b1310 msgr2=0x7f62b406c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 shutdown_connections 2024-09-13T18:35:23.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.051+0000 7f62b8cd0640 1 -- 172.21.15.53:0/4236866972 wait complete. 2024-09-13T18:35:23.067 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:23.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.183+0000 7fdeacefc640 1 Processor -- start 2024-09-13T18:35:23.184 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.183+0000 7fdeacefc640 1 -- start start 2024-09-13T18:35:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdeacefc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 0x7fdea80b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdeacefc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80ad530 con 0x7fdea80ae5d0 2024-09-13T18:35:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdeacefc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80ad810 con 0x7fdea815db40 2024-09-13T18:35:23.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdeacefc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80ae1b0 con 0x7fdea80b1960 2024-09-13T18:35:23.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea6d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdea80ae5d0 0x7fdea80aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43684/0 (socket says 172.21.15.53:43684) 2024-09-13T18:35:23.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea6d9d640 1 -- 172.21.15.53:0/4235259407 learned_addr learned my addr 172.21.15.53:0/4235259407 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:23.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 0x7fdea80b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519755725 0 0) 0x7fdea80ad530 con 0x7fdea80ae5d0 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde90003530 con 0x7fdea80ae5d0 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122667713 0 0) 0x7fde90003530 con 0x7fdea80ae5d0 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 msgr2=0x7fdea80b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 0x7fdea80b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 >> v1:172.21.15.87:6789/0 conn(0x7fdea815db40 legacy=0x7fdea80afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80adaf0 con 0x7fdea80ae5d0 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fdea0001a00 con 0x7fdea80ae5d0 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 >> v1:172.21.15.53:6789/0 conn(0x7fdea80ae5d0 legacy=0x7fdea80aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900039b0 0x7fde90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900047d0 0x7fde90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 0x7fde900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80ae1b0 con 0x7fde900047d0 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9000baf0 con 0x7fde900039b0 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9000bcb0 con 0x7fdea80b1960 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900047d0 0x7fde90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea659c640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900039b0 0x7fde90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea6d9d640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 0x7fde900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea5d9b640 1 -- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 msgr2=0x7fde900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 0x7fde900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea5d9b640 1 -- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900039b0 msgr2=0x7fde90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900039b0 0x7fde90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea5d9b640 1 -- 172.21.15.53:0/4235259407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90003530 con 0x7fde900047d0 2024-09-13T18:35:23.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.187+0000 7fdea6d9d640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea80b1960 0x7fde900051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900047d0 0x7fde90004c50 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009ae0 tx=0x7fde9c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fffcb5364fe4c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0a5510 con 0x7fde900047d0 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c0a5670 con 0x7fde900047d0 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea559a640 1 -- 172.21.15.53:0/4235259407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0a5a20 con 0x7fde900047d0 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- 172.21.15.53:0/4235259407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900047d0 msgr2=0x7fde90004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 --2- 172.21.15.53:0/4235259407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde900047d0 0x7fde90004c50 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009ae0 tx=0x7fde9c01ca40 comp rx=0 tx=0).stop 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea6d9d640 1 -- 172.21.15.53:0/4235259407 reap_dead start 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- 172.21.15.53:0/4235259407 shutdown_connections 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- 172.21.15.53:0/4235259407 >> 172.21.15.53:0/4235259407 conn(0x7fdea80b20d0 msgr2=0x7fdea80b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- 172.21.15.53:0/4235259407 shutdown_connections 2024-09-13T18:35:23.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- 172.21.15.53:0/4235259407 wait complete. 2024-09-13T18:35:23.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 Processor -- start 2024-09-13T18:35:23.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- start start 2024-09-13T18:35:23.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900047d0 0x7fdea8150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea806e5b0 0x7fdea806ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea806b560 0x7fdea806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea806ad00 con 0x7fdea806e5b0 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea806ef70 con 0x7fde900047d0 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdeacefc640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8150d80 con 0x7fdea806b560 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea806e5b0 0x7fdea806ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea806e5b0 0x7fdea806ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41530/0 (socket says 172.21.15.53:41530) 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 -- 172.21.15.53:0/3304900892 learned_addr learned my addr 172.21.15.53:0/3304900892 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea659c640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900047d0 0x7fdea8150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 -- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea806b560 msgr2=0x7fdea806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea6d9d640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea806b560 0x7fdea806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea806b560 0x7fdea806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 -- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900047d0 msgr2=0x7fdea8150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900047d0 0x7fdea8150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea5d9b640 1 -- 172.21.15.53:0/3304900892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea806a080 con 0x7fdea806e5b0 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea659c640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900047d0 0x7fdea8150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.191+0000 7fdea6d9d640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea806b560 0x7fdea806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fdea5d9b640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea806e5b0 0x7fdea806ea30 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009ae0 tx=0x7fde90005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fde96ffd640 1 -- 172.21.15.53:0/3304900892 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0a5e60 con 0x7fdea806e5b0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fde96ffd640 1 -- 172.21.15.53:0/3304900892 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c004020 con 0x7fdea806e5b0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fde96ffd640 1 -- 172.21.15.53:0/3304900892 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c004390 con 0x7fdea806e5b0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea806a360 con 0x7fdea806e5b0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea806a920 con 0x7fdea806e5b0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea80ad530 con 0x7fdea806e5b0 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fde96ffd640 1 -- 172.21.15.53:0/3304900892 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fde9c0b4040 con 0x7fdea806e5b0 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fde96ffd640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde88067200 0x7fde880696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fde96ffd640 1 -- 172.21.15.53:0/3304900892 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fde9c11ced0 con 0x7fdea806e5b0 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fdea659c640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde88067200 0x7fde880696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.195+0000 7fdea659c640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde88067200 0x7fde880696c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fde98005630 tx=0x7fde98009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.199+0000 7fde96ffd640 1 -- 172.21.15.53:0/3304900892 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde9c0ebab0 con 0x7fdea806e5b0 2024-09-13T18:35:23.354 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.355+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdea8066a70 con 0x7fde88067200 2024-09-13T18:35:23.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.359+0000 7fde96ffd640 1 -- 172.21.15.53:0/3304900892 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49419 (secure 0 0 0) 0x7fdea8066a70 con 0x7fde88067200 2024-09-13T18:35:23.360 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:23.360 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde88067200 msgr2=0x7fde880696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde88067200 0x7fde880696c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fde98005630 tx=0x7fde98009040 comp rx=0 tx=0).stop 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea806e5b0 msgr2=0x7fdea806ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea806e5b0 0x7fdea806ea30 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009ae0 tx=0x7fde90005800 comp rx=0 tx=0).stop 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 shutdown_connections 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fde88067200 0x7fde880696c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdea806b560 0x7fdea806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdea806e5b0 0x7fdea806ea30 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 --2- 172.21.15.53:0/3304900892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde900047d0 0x7fdea8150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 >> 172.21.15.53:0/3304900892 conn(0x7fdea80b20d0 msgr2=0x7fdea8067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 shutdown_connections 2024-09-13T18:35:23.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:23.363+0000 7fdeacefc640 1 -- 172.21.15.53:0/3304900892 wait complete. 2024-09-13T18:35:23.378 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-09-13T18:35:21.918479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":300372,"kb_used_data":18664,"kb_used_omap":12,"kb_used_meta":281587,"kb_avail":754674348,"statfs":{"total":773094113280,"available":772786532352,"internally_reserved":0,"allocated":19111936,"data_stored":9092792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":288345656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67801,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-5,"num_read_kb":-5,"num_write":-89,"num_write_kb":-102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.006001"},"pg_stats":[{"pgid":"1.0","version":"75'128","reported_seq":336,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-13T18:35:15.180382+0000","last_change":"2024-09-13T18:24:46.959419+0000","last_active":"2024-09-13T18:35:15.180382+0000","last_peered":"2024-09-13T18:35:15.180382+0000","last_clean":"2024-09-13T18:35:15.180382+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:35:15.180382+0000","last_undegraded":"2024-09-13T18:35:15.180382+0000","last_fullsized":"2024-09-13T18:35:15.180382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:24:45.813163+0000","last_clean_scrub_stamp":"2024-09-13T18:24:45.813163+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:48.609465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33888,"kb_used_data":2768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337952,"statfs":{"total":96636764160,"available":96602062848,"internally_reserved":0,"allocated":2834432,"data_stored":1579375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89100000000000001,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.3140000000000001,"5min":1.399,"15min":1.6439999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.92900000000000005,"15min":0.91300000000000003},"min":{"1min":0.70499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2589999999999999,"5min":1.333,"15min":1.4410000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.91300000000000003,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.7270000000000001},"last":0.621},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.63300000000000001,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.3380000000000001,"5min":1.347,"15min":1.6060000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.52800000000000002,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.077,"5min":1.276,"15min":1.276},"last":1.321},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.874,"15min":0.88100000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.9830000000000001},"last":1.278}]},{"osd":3,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.86099999999999999,"15min":0.878},"min":{"1min":0.71999999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.448},"last":1.121},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93700000000000006,"15min":0.93000000000000005},"min":{"1min":0.69799999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.397},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.626,"5min":0.59099999999999997,"15min":0.47599999999999998},"max":{"1min":1.1799999999999999,"5min":1.2569999999999999,"15min":1.3620000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.61299999999999999,"15min":0.55800000000000005},"max":{"1min":1.2809999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.2430000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.70999999999999996,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.367,"5min":1.367,"15min":1.877},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.79500000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3109999999999999,"5min":1.409,"15min":1.409},"last":0.98799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.042,"15min":1.0549999999999999},"min":{"1min":0.75800000000000001,"5min":0.69399999999999995,"15min":0.56899999999999995},"max":{"1min":1.25,"5min":1.476,"15min":1.476},"last":1.212},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0309999999999999,"15min":1.018},"min":{"1min":0.86099999999999999,"5min":0.65000000000000002,"15min":0.503},"max":{"1min":1.2490000000000001,"5min":1.361,"15min":1.506},"last":1.403}]}]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.3680000000000001,"5min":1.47,"15min":2.9990000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.0720000000000001,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":1.0720000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.94099999999999995,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.2350000000000001,"5min":1.393,"15min":1.577},"last":1.135},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96199999999999997,"15min":0.93100000000000005},"min":{"1min":0.70599999999999996,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.464},"last":1.4159999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.169,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.92200000000000004,"15min":0.94699999999999995},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.2450000000000001,"5min":1.673,"15min":2.4220000000000002},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91700000000000004,"15min":0.89100000000000001},"min":{"1min":0.65600000000000003,"5min":0.54700000000000004,"15min":0.47499999999999998},"max":{"1min":1.3200000000000001,"5min":1.516,"15min":1.516},"last":1.3200000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.90400000000000003,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1599999999999999,"5min":1.2669999999999999,"15min":1.306},"last":0.98099999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.39000000000000001},"max":{"1min":1.2450000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.073,"15min":1.026},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.52800000000000002},"max":{"1min":1.5,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.5}]},{"osd":5,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93999999999999995,"15min":0.93400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.439},"max":{"1min":1.2090000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.048,"15min":1.0700000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.42099999999999999},"max":{"1min":1.446,"5min":1.4490000000000001,"15min":2.762},"last":1.2789999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0660000000000001,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.64700000000000002,"15min":0.53300000000000003},"max":{"1min":1.571,"5min":1.571,"15min":1.9299999999999999},"last":1.571},{"interface":"front","average":{"1min":1.101,"5min":1.0620000000000001,"15min":1.042},"min":{"1min":0.92000000000000004,"5min":0.68600000000000005,"15min":0.52400000000000002},"max":{"1min":1.264,"5min":1.357,"15min":1.72},"last":1.228}]}]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.23,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.437},"max":{"1min":1.153,"5min":1.264,"15min":2.1840000000000002},"last":0.88800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.84199999999999997},"min":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.137,"5min":1.603,"15min":1.603},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2150000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.48599999999999999},"max":{"1min":1.1950000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.89500000000000002,"15min":0.93799999999999994},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1519999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1890000000000001,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.92900000000000005,"15min":0.95799999999999996},"min":{"1min":0.63700000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1060000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.52500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2210000000000001,"5min":3.46,"15min":3.46},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.99099999999999999,"15min":1.0189999999999999},"min":{"1min":0.58499999999999996,"5min":0.441,"15min":0.441},"max":{"1min":1.1830000000000001,"5min":1.492,"15min":1.5049999999999999},"last":1.159}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.115,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.044,"15min":1.0800000000000001},"min":{"1min":0.63700000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2509999999999999,"5min":2.1600000000000001,"15min":2.246},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.075,"15min":1.107},"min":{"1min":0.58199999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1950000000000001,"5min":3.649,"15min":3.649},"last":1.181}]}]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.92100000000000004,"15min":0.84999999999999998},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4630000000000001,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.079},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.88500000000000001,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1279999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.2589999999999999,"15min":1.536},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.91800000000000004,"15min":0.89700000000000002},"min":{"1min":0.65900000000000003,"5min":0.502,"15min":0.499},"max":{"1min":1.3540000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90300000000000002,"15min":0.88},"min":{"1min":0.68600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.123,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5049999999999999,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.1839999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93100000000000005,"15min":0.90900000000000003},"min":{"1min":0.72999999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2649999999999999,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":0.95199999999999996},"min":{"1min":0.74399999999999999,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3400000000000001,"5min":10.44,"15min":10.44},"last":0.876}]},{"osd":5,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96999999999999997,"15min":0.94999999999999996},"min":{"1min":0.69499999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2370000000000001,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":0.97599999999999998},"min":{"1min":0.69299999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.278,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.109}]},{"osd":6,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.127,"15min":1.02},"min":{"1min":0.66300000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.403,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.036,"5min":1.2350000000000001,"15min":1.0900000000000001},"min":{"1min":0.72599999999999998,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.6359999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.036}]},{"osd":7,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.22,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6279999999999999,"5min":15.593,"15min":15.593},"last":1.012},{"interface":"front","average":{"1min":1.05,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.77200000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.5389999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.80000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41500,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330340,"statfs":{"total":96636764160,"available":96594268160,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.32000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95099999999999996,"5min":1.444,"15min":2.113},"last":0.373},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.313,"15min":0.313},"max":{"1min":1.071,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.34599999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.022,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.311},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.623,"15min":0.63},"min":{"1min":0.312,"5min":0.222,"15min":0.222},"max":{"1min":1.0269999999999999,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1830000000000001,"5min":1.4850000000000001,"15min":1.742},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.137,"5min":1.222,"15min":1.399},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.94499999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.27,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.014,"5min":0.97499999999999998,"15min":1.0549999999999999},"min":{"1min":0.67700000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.266,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.93400000000000005,"15min":0.995},"min":{"1min":0.71299999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.8919999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89500000000000002,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1259999999999999,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":1.0309999999999999},"min":{"1min":0.71399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.335,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.746,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.96},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.042,"15min":1.075},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.357,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.04,"5min":0.98199999999999998,"15min":1.004},"min":{"1min":0.69499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2729999999999999,"5min":1.504,"15min":2.9220000000000002},"last":0.77500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41496,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.308,"5min":0.246,"15min":0.246},"max":{"1min":0.98699999999999999,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.37},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.89800000000000002,"5min":1.1619999999999999,"15min":1.335},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.1579999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.2190000000000001,"15min":1.423},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2250000000000001,"5min":1.46,"15min":1.46},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.1930000000000001,"5min":1.53,"15min":1.53},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.484,"5min":1.5309999999999999,"15min":1.611},"last":0.75},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.90800000000000003},"min":{"1min":0.65800000000000003,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.97599999999999998,"15min":0.98999999999999999},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.446,"5min":1.548,"15min":1.9179999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.995,"5min":0.98799999999999999,"15min":0.97599999999999998},"min":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4179999999999999,"5min":1.589,"15min":1.702},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97299999999999998,"15min":0.95999999999999996},"min":{"1min":0.71799999999999997,"5min":0.55600000000000005,"15min":0.5},"max":{"1min":1.401,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.0149999999999999,"15min":1.032},"min":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.353,"5min":1.645,"15min":1.645},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.6240000000000001,"5min":1.843,"15min":1.843},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":1.069},"min":{"1min":0.75700000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.522,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":0.85899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41496,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.997,"5min":1.085,"15min":1.085},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.84599999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.0580000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.274,"5min":1.274,"15min":1.3680000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.423},"last":0.97299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.60299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.05,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.145},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91100000000000003,"15min":0.91900000000000004},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.2410000000000001,"5min":1.393,"15min":1.393},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.262,"5min":1.367,"15min":1.4590000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.68999999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.359,"5min":1.71,"15min":1.71},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.242,"5min":1.335,"15min":1.653},"last":1.194},{"interface":"front","average":{"1min":1.01,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.323,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.093}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0329999999999999,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.4610000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.02},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.73699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.278,"5min":1.649,"15min":1.649},"last":0.89100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42080,"kb_used_data":2768,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329760,"statfs":{"total":96636764160,"available":96593674240,"internally_reserved":0,"allocated":2834432,"data_stored":1579375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.147},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.755,"15min":0.76600000000000001},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.439}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":0.77200000000000002,"15min":0.68999999999999995},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":8.7729999999999997,"5min":8.7729999999999997,"15min":8.7729999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.7589999999999999},"last":0.372},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.80100000000000005,"15min":0.76500000000000001},"min":{"1min":0.33900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88900000000000001,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.60899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.58399999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":0.621},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.044,"15min":1.044},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0369999999999999,"15min":1.0629999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.97699999999999998,"15min":1.008},"min":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.139,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0209999999999999,"15min":1.0249999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.25,"5min":2.25,"15min":2.2949999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1120000000000001,"15min":1.1080000000000001},"min":{"1min":0.747,"5min":0.55800000000000005,"15min":0.49199999999999999},"max":{"1min":4.7080000000000002,"5min":4.7080000000000002,"15min":4.7080000000000002},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:23.383 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:24:45.813163+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=24, tm_sec=45, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=35, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:35:23.383 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:35:26.664 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:26.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:43.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:43.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 Processor -- start 2024-09-13T18:35:43.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 -- start start 2024-09-13T18:35:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f22200d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22200cd6c0 0x7f22200cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22200cdb00 0x7f22200cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200d2400 con 0x7f22200cd6c0 2024-09-13T18:35:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200d1530 con 0x7f22200cdb00 2024-09-13T18:35:43.523 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f22255b2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200d0920 con 0x7f222015cab0 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22200cd6c0 0x7f22200cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22200cd6c0 0x7f22200cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58034/0 (socket says 172.21.15.53:58034) 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 -- 172.21.15.53:0/1312224174 learned_addr learned my addr 172.21.15.53:0/1312224174 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221effd640 1 --2- 172.21.15.53:0/1312224174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f22200d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221f7fe640 1 --2- 172.21.15.53:0/1312224174 >> v2:172.21.15.87:3300/0 conn(0x7f22200cdb00 0x7f22200cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 -- 172.21.15.53:0/1312224174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 msgr2=0x7f22200d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 --2- 172.21.15.53:0/1312224174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f22200d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 -- 172.21.15.53:0/1312224174 >> v2:172.21.15.87:3300/0 conn(0x7f22200cdb00 msgr2=0x7f22200cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 --2- 172.21.15.53:0/1312224174 >> v2:172.21.15.87:3300/0 conn(0x7f22200cdb00 0x7f22200cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221e7fc640 1 -- 172.21.15.53:0/1312224174 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200d0c00 con 0x7f22200cd6c0 2024-09-13T18:35:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.522+0000 7f221f7fe640 1 --2- 172.21.15.53:0/1312224174 >> v2:172.21.15.87:3300/0 conn(0x7f22200cdb00 0x7f22200cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:43.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f221e7fc640 1 --2- 172.21.15.53:0/1312224174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cd6c0 0x7f22200cf0c0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f22200b7fe0 tx=0x7f221401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8ec3028d0ffe6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f221dffb640 1 -- 172.21.15.53:0/1312224174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140aa610 con 0x7f22200cd6c0 2024-09-13T18:35:43.526 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f221dffb640 1 -- 172.21.15.53:0/1312224174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22140a6040 con 0x7f22200cd6c0 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f221dffb640 1 -- 172.21.15.53:0/1312224174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140aa990 con 0x7f22200cd6c0 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 -- 172.21.15.53:0/1312224174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cd6c0 msgr2=0x7f22200cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 --2- 172.21.15.53:0/1312224174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cd6c0 0x7f22200cf0c0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f22200b7fe0 tx=0x7f221401c4f0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 -- 172.21.15.53:0/1312224174 shutdown_connections 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 --2- 172.21.15.53:0/1312224174 >> v2:172.21.15.87:3300/0 conn(0x7f22200cdb00 0x7f22200cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 --2- 172.21.15.53:0/1312224174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cd6c0 0x7f22200cf0c0 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 --2- 172.21.15.53:0/1312224174 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f22200d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 -- 172.21.15.53:0/1312224174 >> 172.21.15.53:0/1312224174 conn(0x7f2220065c80 msgr2=0x7f2220066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 -- 172.21.15.53:0/1312224174 shutdown_connections 2024-09-13T18:35:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 -- 172.21.15.53:0/1312224174 wait complete. 2024-09-13T18:35:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 Processor -- start 2024-09-13T18:35:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.526+0000 7f22255b2640 1 -- start start 2024-09-13T18:35:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22200cd6c0 0x7f22201525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cdb00 0x7f222015e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f222015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220159350 con 0x7f22200cdb00 2024-09-13T18:35:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200b2870 con 0x7f22200cd6c0 2024-09-13T18:35:43.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200b2b50 con 0x7f222015cab0 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cdb00 0x7f222015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cdb00 0x7f222015e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58038/0 (socket says 172.21.15.53:58038) 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 -- 172.21.15.53:0/544922724 learned_addr learned my addr 172.21.15.53:0/544922724 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221f7fe640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f222015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 -- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 msgr2=0x7f222015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f222015edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 -- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22200cd6c0 msgr2=0x7f22201525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221effd640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22200cd6c0 0x7f22201525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22200cd6c0 0x7f22201525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 -- 172.21.15.53:0/544922724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140094d0 con 0x7f22200cdb00 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221effd640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22200cd6c0 0x7f22201525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221e7fc640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cdb00 0x7f222015e880 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f221401aba0 tx=0x7f221401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22077fe640 1 -- 172.21.15.53:0/544922724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140bd5f0 con 0x7f22200cdb00 2024-09-13T18:35:43.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22077fe640 1 -- 172.21.15.53:0/544922724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22140bd750 con 0x7f22200cdb00 2024-09-13T18:35:43.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22077fe640 1 -- 172.21.15.53:0/544922724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140bdb00 con 0x7f22200cdb00 2024-09-13T18:35:43.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22200b2e30 con 0x7f22200cdb00 2024-09-13T18:35:43.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2220158640 con 0x7f22200cdb00 2024-09-13T18:35:43.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200664c0 con 0x7f22200cdb00 2024-09-13T18:35:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22077fe640 1 -- 172.21.15.53:0/544922724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7f22140b33f0 con 0x7f22200cdb00 2024-09-13T18:35:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22077fe640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f220c067200 0x7f220c0696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f22077fe640 1 -- 172.21.15.53:0/544922724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f221411d6a0 con 0x7f22200cdb00 2024-09-13T18:35:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.530+0000 7f221effd640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f220c067200 0x7f220c0696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.534+0000 7f221effd640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f220c067200 0x7f220c0696c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f222015a470 tx=0x7f2210008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.534+0000 7f22077fe640 1 -- 172.21.15.53:0/544922724 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22140ec570 con 0x7f22200cdb00 2024-09-13T18:35:43.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.694+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 --> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2220067910 con 0x7f220c067200 2024-09-13T18:35:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.698+0000 7f22077fe640 1 -- 172.21.15.53:0/544922724 <== mgr.4098 v2:172.21.15.53:6836/1347918254 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49372 (secure 0 0 0) 0x7f2220067910 con 0x7f220c067200 2024-09-13T18:35:43.699 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f220c067200 msgr2=0x7f220c0696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f220c067200 0x7f220c0696c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f222015a470 tx=0x7f2210008040 comp rx=0 tx=0).stop 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cdb00 msgr2=0x7f222015e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cdb00 0x7f222015e880 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f221401aba0 tx=0x7f221401ad30 comp rx=0 tx=0).stop 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 shutdown_connections 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7f220c067200 0x7f220c0696c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f222015cab0 0x7f222015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22200cdb00 0x7f222015e880 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 --2- 172.21.15.53:0/544922724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22200cd6c0 0x7f22201525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 >> 172.21.15.53:0/544922724 conn(0x7f2220065c80 msgr2=0x7f22200b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 shutdown_connections 2024-09-13T18:35:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.702+0000 7f22255b2640 1 -- 172.21.15.53:0/544922724 wait complete. 2024-09-13T18:35:43.718 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-09-13T18:35:41.923651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":300356,"kb_used_data":18664,"kb_used_omap":12,"kb_used_meta":281587,"kb_avail":754674364,"statfs":{"total":773094113280,"available":772786548736,"internally_reserved":0,"allocated":19111936,"data_stored":9092792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":288345656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003012"},"pg_stats":[{"pgid":"1.0","version":"177'130","reported_seq":350,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-13T18:35:27.546096+0000","last_change":"2024-09-13T18:35:27.546339+0000","last_active":"2024-09-13T18:35:27.546096+0000","last_peered":"2024-09-13T18:35:27.546096+0000","last_clean":"2024-09-13T18:35:27.546096+0000","last_became_active":"2024-09-13T18:24:46.957252+0000","last_became_peered":"2024-09-13T18:24:46.957252+0000","last_unstale":"2024-09-13T18:35:27.546096+0000","last_undegraded":"2024-09-13T18:35:27.546096+0000","last_fullsized":"2024-09-13T18:35:27.546096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"177'130","last_scrub_stamp":"2024-09-13T18:35:27.546041+0000","last_deep_scrub":"177'130","last_deep_scrub_stamp":"2024-09-13T18:35:27.546041+0000","last_clean_scrub_stamp":"2024-09-13T18:35:27.546041+0000","objects_scrubbed":2,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:37.499007+0000","scrub_duration":0.0088689359999999991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":2768,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":2834432,"data_stored":1579375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89100000000000001,"15min":0.88800000000000001},"min":{"1min":0.503,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.3140000000000001,"5min":1.399,"15min":1.6439999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.92900000000000005,"15min":0.91300000000000003},"min":{"1min":0.70499999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2589999999999999,"5min":1.333,"15min":1.4410000000000001},"last":1.129}]},{"osd":1,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.91300000000000003,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.7270000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.96399999999999997,"15min":0.94099999999999995},"min":{"1min":0.63300000000000001,"5min":0.48199999999999998,"15min":0.46100000000000002},"max":{"1min":1.3380000000000001,"5min":1.347,"15min":1.6060000000000001},"last":1.042}]},{"osd":2,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.52800000000000002,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.077,"5min":1.276,"15min":1.276},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.874,"15min":0.88100000000000001},"min":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.47799999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.9830000000000001},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.86099999999999999,"15min":0.878},"min":{"1min":0.71999999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1830000000000001,"5min":1.2070000000000001,"15min":1.448},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.93700000000000006,"15min":0.93000000000000005},"min":{"1min":0.69799999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3919999999999999,"5min":1.395,"15min":1.397},"last":0.93899999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88100000000000001,"15min":0.88700000000000001},"min":{"1min":0.626,"5min":0.59099999999999997,"15min":0.47599999999999998},"max":{"1min":1.1799999999999999,"5min":1.2569999999999999,"15min":1.3620000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.61299999999999999,"15min":0.55800000000000005},"max":{"1min":1.2809999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.96899999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98499999999999999,"15min":1.0169999999999999},"min":{"1min":0.70999999999999996,"5min":0.58099999999999996,"15min":0.52800000000000002},"max":{"1min":1.367,"5min":1.367,"15min":1.877},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.79500000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3109999999999999,"5min":1.409,"15min":1.409},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:09 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.042,"15min":1.0549999999999999},"min":{"1min":0.75800000000000001,"5min":0.69399999999999995,"15min":0.56899999999999995},"max":{"1min":1.25,"5min":1.476,"15min":1.476},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0309999999999999,"15min":1.018},"min":{"1min":0.86099999999999999,"5min":0.65000000000000002,"15min":0.503},"max":{"1min":1.2490000000000001,"5min":1.361,"15min":1.506},"last":1.091}]}]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.48099999999999998,"5min":0.41899999999999998,"15min":0.312},"max":{"1min":1.3680000000000001,"5min":1.47,"15min":2.9990000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.46600000000000003},"max":{"1min":1.0720000000000001,"5min":1.2829999999999999,"15min":1.3879999999999999},"last":1.135}]},{"osd":1,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.94099999999999995,"15min":0.90900000000000003},"min":{"1min":0.60999999999999999,"5min":0.54600000000000004,"15min":0.34899999999999998},"max":{"1min":1.2350000000000001,"5min":1.393,"15min":1.577},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96199999999999997,"15min":0.93100000000000005},"min":{"1min":0.70599999999999996,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.464},"last":0.91600000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.48899999999999999},"max":{"1min":1.169,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.92200000000000004,"15min":0.94699999999999995},"min":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.47499999999999998},"max":{"1min":1.2450000000000001,"5min":1.673,"15min":2.4220000000000002},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91700000000000004,"15min":0.89100000000000001},"min":{"1min":0.65600000000000003,"5min":0.54700000000000004,"15min":0.47499999999999998},"max":{"1min":1.3200000000000001,"5min":1.516,"15min":1.516},"last":1.03},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.90400000000000003,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.52300000000000002,"15min":0.40699999999999997},"max":{"1min":1.1599999999999999,"5min":1.2669999999999999,"15min":1.306},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.39000000000000001},"max":{"1min":1.2450000000000001,"5min":1.4379999999999999,"15min":2.9140000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.073,"15min":1.026},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.52800000000000002},"max":{"1min":1.5,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93999999999999995,"15min":0.93400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.439},"max":{"1min":1.2090000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.048,"15min":1.0700000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.42099999999999999},"max":{"1min":1.446,"5min":1.4490000000000001,"15min":2.762},"last":1.165}]},{"osd":7,"last update":"Fri Sep 13 18:35:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0660000000000001,"15min":1.04},"min":{"1min":0.70499999999999996,"5min":0.64700000000000002,"15min":0.53300000000000003},"max":{"1min":1.571,"5min":1.571,"15min":1.9299999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.0620000000000001,"15min":1.042},"min":{"1min":0.92000000000000004,"5min":0.68600000000000005,"15min":0.52400000000000002},"max":{"1min":1.264,"5min":1.357,"15min":1.72},"last":1.0940000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79500000000000004,"15min":0.83299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.23,"5min":1.5840000000000001,"15min":2.0209999999999999},"last":0.879},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82899999999999996,"15min":0.876},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.437},"max":{"1min":1.153,"5min":1.264,"15min":2.1840000000000002},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.84199999999999997},"min":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.137,"5min":1.603,"15min":1.603},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.627,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2150000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.58399999999999996,"5min":0.51700000000000002,"15min":0.48599999999999999},"max":{"1min":1.1950000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.89500000000000002,"15min":0.93799999999999994},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1519999999999999,"5min":1.6279999999999999,"15min":2.2589999999999999},"last":1.018}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1890000000000001,"5min":1.6419999999999999,"15min":2.0840000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.92900000000000005,"15min":0.95799999999999996},"min":{"1min":0.63700000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1060000000000001,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.52500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2210000000000001,"5min":3.46,"15min":3.46},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.99099999999999999,"15min":1.0189999999999999},"min":{"1min":0.58499999999999996,"5min":0.441,"15min":0.441},"max":{"1min":1.1830000000000001,"5min":1.492,"15min":1.5049999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.56699999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":3.6099999999999999,"15min":3.6099999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.97699999999999998,"15min":0.999},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.115,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.044,"15min":1.0800000000000001},"min":{"1min":0.63700000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2509999999999999,"5min":2.1600000000000001,"15min":2.246},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.075,"15min":1.107},"min":{"1min":0.58199999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1950000000000001,"5min":3.649,"15min":3.649},"last":0.81799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33304,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.92100000000000004,"15min":0.84999999999999998},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4630000000000001,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":1.087},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.88500000000000001,"15min":0.879},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1279999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.83099999999999996},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":1.046,"5min":1.2589999999999999,"15min":1.536},"last":1.04},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.91800000000000004,"15min":0.89700000000000002},"min":{"1min":0.65900000000000003,"5min":0.502,"15min":0.499},"max":{"1min":1.3540000000000001,"5min":4.4509999999999996,"15min":4.4509999999999996},"last":0.83499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.90300000000000002,"15min":0.88},"min":{"1min":0.68600000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.123,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91600000000000004,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5049999999999999,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.0580000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.93100000000000005,"15min":0.90900000000000003},"min":{"1min":0.72999999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2649999999999999,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":0.95199999999999996},"min":{"1min":0.74399999999999999,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3400000000000001,"5min":10.44,"15min":10.44},"last":0.90000000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96999999999999997,"15min":0.94999999999999996},"min":{"1min":0.69499999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2370000000000001,"5min":4.3280000000000003,"15min":4.3280000000000003},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.002,"5min":1.0089999999999999,"15min":0.97599999999999998},"min":{"1min":0.69299999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.278,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":1.127,"15min":1.02},"min":{"1min":0.66300000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.403,"5min":19.254000000000001,"15min":19.254000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.036,"5min":1.2350000000000001,"15min":1.0900000000000001},"min":{"1min":0.72599999999999998,"5min":0.58399999999999996,"15min":0.54100000000000004},"max":{"1min":1.6359999999999999,"5min":19.434000000000001,"15min":19.434000000000001},"last":1.016}]},{"osd":7,"last update":"Fri Sep 13 18:35:12 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.22,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6279999999999999,"5min":15.593,"15min":15.593},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.05,"5min":1.0800000000000001,"15min":1.069},"min":{"1min":0.77200000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.5389999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.94999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41500,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330340,"statfs":{"total":96636764160,"available":96594268160,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.63700000000000001},"min":{"1min":0.32000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.95099999999999996,"5min":1.444,"15min":2.113},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.313,"15min":0.313},"max":{"1min":1.071,"5min":1.3169999999999999,"15min":2.0089999999999999},"last":1.0129999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66100000000000003,"15min":0.67200000000000004},"min":{"1min":0.34599999999999997,"5min":0.246,"15min":0.246},"max":{"1min":1.022,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.623,"15min":0.63},"min":{"1min":0.312,"5min":0.222,"15min":0.222},"max":{"1min":1.0269999999999999,"5min":1.1879999999999999,"15min":2.6360000000000001},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.41899999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1830000000000001,"5min":1.4850000000000001,"15min":1.742},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.45200000000000001,"5min":0.35999999999999999,"15min":0.308},"max":{"1min":1.137,"5min":1.222,"15min":1.399},"last":1.1259999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.94499999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.27,"5min":1.5860000000000001,"15min":2.7450000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.97499999999999998,"15min":1.0549999999999999},"min":{"1min":0.67700000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.266,"5min":1.5820000000000001,"15min":2.8740000000000001},"last":1.0740000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.93400000000000005,"15min":0.995},"min":{"1min":0.71299999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.8919999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89500000000000002,"15min":0.93200000000000005},"min":{"1min":0.66800000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1259999999999999,"5min":1.7669999999999999,"15min":2.8340000000000001},"last":1.107}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.96899999999999997,"15min":1.0309999999999999},"min":{"1min":0.71399999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.335,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":1.165},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.746,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3779999999999999,"5min":1.502,"15min":1.96},"last":1.1930000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.042,"15min":1.075},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55100000000000005},"max":{"1min":1.357,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.04,"5min":0.98199999999999998,"15min":1.004},"min":{"1min":0.69499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2729999999999999,"5min":1.504,"15min":2.9220000000000002},"last":1.149}]}]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41496,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.308,"5min":0.246,"15min":0.246},"max":{"1min":0.98699999999999999,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.89800000000000002,"5min":1.1619999999999999,"15min":1.335},"last":0.94699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28299999999999997},"max":{"1min":1.119,"5min":1.119,"15min":1.1579999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.2190000000000001,"15min":1.423},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.2250000000000001,"5min":1.46,"15min":1.46},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.1930000000000001,"5min":1.53,"15min":1.53},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.91800000000000004},"min":{"1min":0.56599999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.484,"5min":1.5309999999999999,"15min":1.611},"last":1.044},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.90800000000000003},"min":{"1min":0.65800000000000003,"5min":0.55500000000000005,"15min":0.498},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":1.0660000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.97599999999999998,"15min":0.98999999999999999},"min":{"1min":0.69099999999999995,"5min":0.58999999999999997,"15min":0.53800000000000003},"max":{"1min":1.446,"5min":1.548,"15min":1.9179999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.98799999999999999,"15min":0.97599999999999998},"min":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4179999999999999,"5min":1.589,"15min":1.702},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.97299999999999998,"15min":0.95999999999999996},"min":{"1min":0.71799999999999997,"5min":0.55600000000000005,"15min":0.5},"max":{"1min":1.401,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.016},{"interface":"front","average":{"1min":0.995,"5min":1.0149999999999999,"15min":1.032},"min":{"1min":0.627,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":1.353,"5min":1.645,"15min":1.645},"last":1.101}]},{"osd":7,"last update":"Fri Sep 13 18:35:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.56699999999999995},"max":{"1min":1.6240000000000001,"5min":1.843,"15min":1.843},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.048,"15min":1.069},"min":{"1min":0.75700000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.522,"5min":1.5820000000000001,"15min":1.8089999999999999},"last":1.1919999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41496,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":2240512,"data_stored":989007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.997,"5min":1.085,"15min":1.085},"last":0.751},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.27400000000000002},"max":{"1min":0.84599999999999997,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.32100000000000001,"5min":0.307,"15min":0.28199999999999997},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.39200000000000002,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":1.0580000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.39700000000000002,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.274,"5min":1.274,"15min":1.3680000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.423},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.88700000000000001,"15min":0.90400000000000003},"min":{"1min":0.60299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.05,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.099},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91100000000000003,"15min":0.91900000000000004},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.42899999999999999},"max":{"1min":1.2410000000000001,"5min":1.393,"15min":1.393},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.262,"5min":1.367,"15min":1.4590000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.68999999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.359,"5min":1.71,"15min":1.71},"last":1.3999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97799999999999998,"15min":0.996},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.242,"5min":1.335,"15min":1.653},"last":1.208},{"interface":"front","average":{"1min":1.01,"5min":0.97299999999999998,"15min":0.98699999999999999},"min":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.323,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.149}]},{"osd":7,"last update":"Fri Sep 13 18:34:59 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0329999999999999,"15min":1.046},"min":{"1min":0.72799999999999998,"5min":0.58299999999999996,"15min":0.52500000000000002},"max":{"1min":1.4610000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.46},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.73699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.278,"5min":1.649,"15min":1.649},"last":1.2609999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42072,"kb_used_data":2768,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329768,"statfs":{"total":96636764160,"available":96593682432,"internally_reserved":0,"allocated":2834432,"data_stored":1579375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.147},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.755,"15min":0.76600000000000001},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.27000000000000002},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.99199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":0.77200000000000002,"15min":0.68999999999999995},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":8.7729999999999997,"5min":8.7729999999999997,"15min":8.7729999999999997},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.7589999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.80100000000000005,"15min":0.76500000000000001},"min":{"1min":0.33900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88900000000000001,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.438},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.96799999999999997,"15min":0.98599999999999999},"min":{"1min":0.60899999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.8109999999999999,"5min":3.8109999999999999,"15min":3.8109999999999999},"last":0.872}]},{"osd":5,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.0089999999999999,"15min":1.0109999999999999},"min":{"1min":0.58399999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.044,"15min":1.044},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":6.0330000000000004,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0369999999999999,"15min":1.0629999999999999},"min":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.51100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.97699999999999998,"15min":1.008},"min":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.139,"5min":1.5720000000000001,"15min":2.5590000000000002},"last":1.032}]},{"osd":7,"last update":"Fri Sep 13 18:35:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0209999999999999,"15min":1.0249999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.25,"5min":2.25,"15min":2.2949999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1120000000000001,"15min":1.1080000000000001},"min":{"1min":0.747,"5min":0.55800000000000005,"15min":0.49199999999999999},"max":{"1min":4.7080000000000002,"5min":4.7080000000000002,"15min":4.7080000000000002},"last":1.0609999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:35:43.721 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:35:43.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04e555640 1 Processor -- start 2024-09-13T18:35:43.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04e555640 1 -- start start 2024-09-13T18:35:43.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04e555640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc048157020 0x7fc04806cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04e555640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04806d6e0 con 0x7fc048156c40 2024-09-13T18:35:43.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04e555640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480715f0 con 0x7fc04806d270 2024-09-13T18:35:43.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04e555640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0480b15a0 con 0x7fc048157020 2024-09-13T18:35:43.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc047fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc048156c40 0x7fc048070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44758/0 (socket says 172.21.15.53:44758) 2024-09-13T18:35:43.842 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc047fff640 1 -- 172.21.15.53:0/2165393349 learned_addr learned my addr 172.21.15.53:0/2165393349 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:43.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc03ffff640 1 --2- 172.21.15.53:0/2165393349 >> v2:172.21.15.87:3300/0 conn(0x7fc048157020 0x7fc04806cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638533767 0 0) 0x7fc04806d6e0 con 0x7fc048156c40 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc034003530 con 0x7fc048156c40 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438355771 0 0) 0x7fc034003530 con 0x7fc048156c40 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 >> v2:172.21.15.87:3300/0 conn(0x7fc048157020 msgr2=0x7fc04806cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 --2- 172.21.15.53:0/2165393349 >> v2:172.21.15.87:3300/0 conn(0x7fc048157020 0x7fc04806cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 >> v1:172.21.15.87:6789/0 conn(0x7fc04806d270 legacy=0x7fc04806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480b1880 con 0x7fc048156c40 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3454789541 0 0) 0x7fc038001680 con 0x7fc048156c40 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 >> v1:172.21.15.53:6789/0 conn(0x7fc048156c40 legacy=0x7fc048070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc034003980 0x7fc034003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc034004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc034005190 0x7fc03400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480b15a0 con 0x7fc0340047d0 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03400c030 con 0x7fc034003980 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03400c1f0 con 0x7fc034005190 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc03ffff640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc034004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc047fff640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc034003980 0x7fc034003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc03ffff640 1 -- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc034005190 msgr2=0x7fc03400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04caf2640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc034005190 0x7fc03400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc03ffff640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc034005190 0x7fc03400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc03ffff640 1 -- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc034003980 msgr2=0x7fc034003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc03ffff640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc034003980 0x7fc034003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc03ffff640 1 -- 172.21.15.53:0/2165393349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034003530 con 0x7fc0340047d0 2024-09-13T18:35:43.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04caf2640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc034005190 0x7fc03400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:43.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.842+0000 7fc04caf2640 1 -- 172.21.15.53:0/2165393349 reap_dead start 2024-09-13T18:35:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc03ffff640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc034004c50 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7fc030009ae0 tx=0x7fc03001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9029637ad9e111f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300a5550 con 0x7fc0340047d0 2024-09-13T18:35:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0300a56b0 con 0x7fc0340047d0 2024-09-13T18:35:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc0477fe640 1 -- 172.21.15.53:0/2165393349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300a5a60 con 0x7fc0340047d0 2024-09-13T18:35:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- 172.21.15.53:0/2165393349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 msgr2=0x7fc034004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc034004c50 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7fc030009ae0 tx=0x7fc03001ca70 comp rx=0 tx=0).stop 2024-09-13T18:35:43.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- 172.21.15.53:0/2165393349 shutdown_connections 2024-09-13T18:35:43.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 --2- 172.21.15.53:0/2165393349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc034004c50 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- 172.21.15.53:0/2165393349 >> 172.21.15.53:0/2165393349 conn(0x7fc048065c80 msgr2=0x7fc048066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- 172.21.15.53:0/2165393349 shutdown_connections 2024-09-13T18:35:43.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- 172.21.15.53:0/2165393349 wait complete. 2024-09-13T18:35:43.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 Processor -- start 2024-09-13T18:35:43.851 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- start start 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc04806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0481406d0 0x7fc04806c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc048142ea0 0x7fc048143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04814d0c0 con 0x7fc0340047d0 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc048143c00 con 0x7fc048142ea0 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.846+0000 7fc04e555640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc048140d20 con 0x7fc0481406d0 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc04806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc04806bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58046/0 (socket says 172.21.15.53:58046) 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 -- 172.21.15.53:0/3003215488 learned_addr learned my addr 172.21.15.53:0/3003215488 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc03ffff640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0481406d0 0x7fc04806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc04caf2640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc048142ea0 0x7fc048143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 -- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0481406d0 msgr2=0x7fc04806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0481406d0 0x7fc04806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 -- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc048142ea0 msgr2=0x7fc048143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc048142ea0 0x7fc048143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 -- 172.21.15.53:0/3003215488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc048141000 con 0x7fc0340047d0 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc04caf2640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc048142ea0 0x7fc048143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc047fff640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc04806bc20 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7fc0380118e0 tx=0x7fc038011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800fb60 con 0x7fc0340047d0 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800fcc0 con 0x7fc0340047d0 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038015650 con 0x7fc0340047d0 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0481412e0 con 0x7fc0340047d0 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc048143860 con 0x7fc0340047d0 2024-09-13T18:35:43.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc048070870 con 0x7fc0340047d0 2024-09-13T18:35:43.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fc0380157b0 con 0x7fc0340047d0 2024-09-13T18:35:43.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc0457fa640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc038085fc0 con 0x7fc0340047d0 2024-09-13T18:35:43.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc03ffff640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.850+0000 7fc03ffff640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc0300af000 tx=0x7fc030008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:43.854+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc038058810 con 0x7fc0340047d0 2024-09-13T18:35:44.012 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.010+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc04806ff20 con 0x7fc0340047d0 2024-09-13T18:35:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc038058810 con 0x7fc0340047d0 2024-09-13T18:35:44.017 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc0457fa640 1 -- 172.21.15.53:0/3003215488 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v32)=0 v32) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc0380583a0 con 0x7fc0340047d0 2024-09-13T18:35:44.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 msgr2=0x7fc0280696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc0300af000 tx=0x7fc030008040 comp rx=0 tx=0).stop 2024-09-13T18:35:44.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 msgr2=0x7fc04806bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc04806bc20 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7fc0380118e0 tx=0x7fc038011da0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.020 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 shutdown_connections 2024-09-13T18:35:44.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fc028067200 0x7fc0280696c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc0481406d0 0x7fc04806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc048142ea0 0x7fc048143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 --2- 172.21.15.53:0/3003215488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0340047d0 0x7fc04806bc20 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 >> 172.21.15.53:0/3003215488 conn(0x7fc048065c80 msgr2=0x7fc0480ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 shutdown_connections 2024-09-13T18:35:44.021 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.018+0000 7fc04e555640 1 -- 172.21.15.53:0/3003215488 wait complete. 2024-09-13T18:35:44.037 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:35:44.038 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:44.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94d1d1640 1 Processor -- start 2024-09-13T18:35:44.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94d1d1640 1 -- start start 2024-09-13T18:35:44.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94d1d1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb9480afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94d1d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9480ae5d0 0x7fb9480aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94d1d1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480ad530 con 0x7fb9480b1960 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94d1d1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9480ae1b0 con 0x7fb9480ae5d0 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94d1d1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480ad810 con 0x7fb94815db40 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb9480b1960 0x7fb9480b02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:44772/0 (socket says 172.21.15.53:44772) 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94659c640 1 -- 172.21.15.53:0/2391824853 learned_addr learned my addr 172.21.15.53:0/2391824853 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94759e640 1 --2- 172.21.15.53:0/2391824853 >> v2:172.21.15.53:3300/0 conn(0x7fb9480ae5d0 0x7fb9480aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb946d9d640 1 --2- 172.21.15.53:0/2391824853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb9480afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94759e640 1 -- 172.21.15.53:0/2391824853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 msgr2=0x7fb9480afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94759e640 1 --2- 172.21.15.53:0/2391824853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb9480afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb945d9b640 1 -- 172.21.15.53:0/2391824853 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184278900 0 0) 0x7fb9480ad530 con 0x7fb9480b1960 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94759e640 1 -- 172.21.15.53:0/2391824853 >> v1:172.21.15.53:6789/0 conn(0x7fb9480b1960 legacy=0x7fb9480b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.158+0000 7fb94759e640 1 -- 172.21.15.53:0/2391824853 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480adaf0 con 0x7fb9480ae5d0 2024-09-13T18:35:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94759e640 1 --2- 172.21.15.53:0/2391824853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480ae5d0 0x7fb9480aea00 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7fb940009d90 tx=0x7fb94001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb860f19ee7e0cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb945d9b640 1 -- 172.21.15.53:0/2391824853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400a5950 con 0x7fb9480ae5d0 2024-09-13T18:35:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb945d9b640 1 -- 172.21.15.53:0/2391824853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb9400a5ab0 con 0x7fb9480ae5d0 2024-09-13T18:35:44.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb945d9b640 1 -- 172.21.15.53:0/2391824853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400a5e60 con 0x7fb9480ae5d0 2024-09-13T18:35:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2391824853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480ae5d0 msgr2=0x7fb9480aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2391824853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480ae5d0 0x7fb9480aea00 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7fb940009d90 tx=0x7fb94001c8b0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2391824853 shutdown_connections 2024-09-13T18:35:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2391824853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480ae5d0 0x7fb9480aea00 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2391824853 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb9480afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2391824853 >> 172.21.15.53:0/2391824853 conn(0x7fb9480b20d0 msgr2=0x7fb9480b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2391824853 shutdown_connections 2024-09-13T18:35:44.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2391824853 wait complete. 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 Processor -- start 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- start start 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9480ae5d0 0x7fb9481642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480b1960 0x7fb94806b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb94806e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948165150 con 0x7fb9480b1960 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948152370 con 0x7fb9480ae5d0 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94d1d1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481648b0 con 0x7fb94815db40 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480b1960 0x7fb94806b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480b1960 0x7fb94806b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58062/0 (socket says 172.21.15.53:58062) 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 -- 172.21.15.53:0/2376573930 learned_addr learned my addr 172.21.15.53:0/2376573930 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb946d9d640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9480ae5d0 0x7fb9481642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94759e640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb94806e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 -- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 msgr2=0x7fb94806e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb94806e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 -- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9480ae5d0 msgr2=0x7fb9481642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9480ae5d0 0x7fb9481642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb94659c640 1 -- 172.21.15.53:0/2376573930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940009a70 con 0x7fb9480b1960 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.162+0000 7fb946d9d640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9480ae5d0 0x7fb9481642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb94659c640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480b1960 0x7fb94806b910 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0011f0 tx=0x7fb93c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2376573930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0074e0 con 0x7fb9480b1960 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2376573930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb93c007640 con 0x7fb9480b1960 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb948164b90 con 0x7fb9480b1960 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2376573930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c004a30 con 0x7fb9480b1960 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94806be50 con 0x7fb9480b1960 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb948073a10 con 0x7fb9480b1960 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2376573930 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 28) v1 ==== 87112+0+0 (secure 0 0 0) 0x7fb93c004b90 con 0x7fb9480b1960 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb92f7fe640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9340671d0 0x7fb934069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2376573930 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb93c0823a0 con 0x7fb9480b1960 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb946d9d640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9340671d0 0x7fb934069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.166+0000 7fb946d9d640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9340671d0 0x7fb934069690 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb938009a40 tx=0x7fb938008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.170+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2376573930 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb93c050ee0 con 0x7fb9480b1960 2024-09-13T18:35:44.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.366+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9480aea00 con 0x7fb9480b1960 2024-09-13T18:35:44.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.366+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2376573930 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+3533 (secure 0 0 0) 0x7fb93c018070 con 0x7fb9480b1960 2024-09-13T18:35:44.367 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-13T18:35:44.368 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":107,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7781,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/481869316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":481869316},{"type":"v1","addr":"172.21.15.87:6833","nonce":481869316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9001,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/4120395616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":4120395616},{"type":"v1","addr":"172.21.15.87:6835","nonce":4120395616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1960885675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1960885675},{"type":"v1","addr":"172.21.15.53:6833","nonce":1960885675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":10881,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3838876246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3838876246},{"type":"v1","addr":"172.21.15.53:6835","nonce":3838876246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[]} 2024-09-13T18:35:44.368 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 107 2024-09-13T18:35:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9340671d0 msgr2=0x7fb934069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9340671d0 0x7fb934069690 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb938009a40 tx=0x7fb938008040 comp rx=0 tx=0).stop 2024-09-13T18:35:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480b1960 msgr2=0x7fb94806b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480b1960 0x7fb94806b910 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0011f0 tx=0x7fb93c00c9b0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 shutdown_connections 2024-09-13T18:35:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:6836/1347918254,v1:172.21.15.53:6837/1347918254] conn(0x7fb9340671d0 0x7fb934069690 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb94815db40 0x7fb94806e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9480b1960 0x7fb94806b910 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 --2- 172.21.15.53:0/2376573930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9480ae5d0 0x7fb9481642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 >> 172.21.15.53:0/2376573930 conn(0x7fb9480b20d0 msgr2=0x7fb9480b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 shutdown_connections 2024-09-13T18:35:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-09-13T18:35:44.370+0000 7fb94d1d1640 1 -- 172.21.15.53:0/2376573930 wait complete. 2024-09-13T18:35:44.387 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T18:35:44.387 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:35:44.387 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:35:44.387 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:44.398 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:35:44.399 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:35:44.399 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:44.449 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:35:44.450 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:35:44.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:44.463 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:35:44.464 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:44.521 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:35:44.521 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:35:44.521 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:35:44.521 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:44.588 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:35:44.588 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:35:44.588 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:44.667 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:35:44.668 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:35:44.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:44.764 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:35:44.764 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:35:44.764 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:48.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T18:35:50.866 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:35:50.866 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:50.939 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:35:50.939 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:35:50.939 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.020 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:35:51.020 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:35:51.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.092 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:35:51.092 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:35:51.092 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.184 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:35:51.184 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:35:51.185 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:35:51.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.216 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:35:51.217 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:35:51.217 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.247 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:35:51.247 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:35:51.247 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:35:51.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.277 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:35:51.278 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:35:51.278 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.305 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:35:51.306 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:35:51.306 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:35:51.363 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:35:51.363 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:35:51.364 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-13T18:35:51.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:35:51.386 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:35:51.718 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:35:51.718 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:35:51.969 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:35:51.969 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:35:52.293 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:35:52.294 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:35:52.486 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:35:52.486 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:52.865 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:35:52.865 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:53.063 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:35:53.063 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:35:53.230 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:35:53.231 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:35:53.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T18:35:53.423 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:35:53.424 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/data/mon.a.tgz 2024-09-13T18:35:53.425 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-13T18:35:53.430 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.q3CPg5pUnH 2024-09-13T18:35:53.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.q3CPg5pUnH 2024-09-13T18:35:53.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.q3CPg5pUnH 2024-09-13T18:35:53.753 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.q3CPg5pUnH is 1MB 2024-09-13T18:35:53.833 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.q3CPg5pUnH 2024-09-13T18:35:53.839 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/data/mon.b.tgz 2024-09-13T18:35:53.839 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-13T18:35:53.845 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.Hungesej36 2024-09-13T18:35:53.845 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Hungesej36 2024-09-13T18:35:54.127 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.Hungesej36 2024-09-13T18:35:54.192 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.Hungesej36 is 1MB 2024-09-13T18:35:54.266 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.Hungesej36 2024-09-13T18:35:54.272 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/data/mon.c.tgz 2024-09-13T18:35:54.272 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-09-13T18:35:54.320 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.hZY7Uz69KT 2024-09-13T18:35:54.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.hZY7Uz69KT 2024-09-13T18:35:54.585 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.hZY7Uz69KT 2024-09-13T18:35:54.648 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.hZY7Uz69KT is 1MB 2024-09-13T18:35:54.718 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.hZY7Uz69KT 2024-09-13T18:35:54.723 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:35:54.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:35:54.726 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:35:54.783 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:35:54.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:35:54.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:35:54.806 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:35:54.852 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:35:54.856 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:35:54.858 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/remote/smithi053/crash 2024-09-13T18:35:54.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:35:54.872 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/remote/smithi087/crash 2024-09-13T18:35:54.873 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:35:54.909 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:35:54.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:54.918 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:54.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:55.013 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:55.048 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:35:55.048 DEBUG:teuthology.orchestra.run.smithi053:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:35:55.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:36:01.015 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:36:01.015 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/remote/smithi053/log 2024-09-13T18:36:01.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:36:02.389 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/remote/smithi087/log 2024-09-13T18:36:02.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:36:02.792 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:36:02.801 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:36:02.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:36:02.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:36:02.906 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:36:02.916 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:36:02.916 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:36:02.918 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:36:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:36:02.929 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-09-13T18:36:02.929 INFO:teuthology.orchestra.run.smithi053.stdout:+hv01.front.sepi 67.205.162.81 3 u 30 64 377 0.093 -2.093 1.556 2024-09-13T18:36:02.929 INFO:teuthology.orchestra.run.smithi053.stdout:+hv02.front.sepi 63.231.80.2 3 u 28 64 377 0.086 -3.129 2.903 2024-09-13T18:36:02.929 INFO:teuthology.orchestra.run.smithi053.stdout:*hv03.front.sepi 74.6.168.72 3 u 32 64 377 0.082 -2.516 1.961 2024-09-13T18:36:02.929 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-13T18:36:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:36:02.931 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2024-09-13T18:36:02.931 INFO:teuthology.orchestra.run.smithi087.stdout:*hv01.front.sepi 67.205.162.81 3 u 35 64 377 0.104 -1.195 1.921 2024-09-13T18:36:02.931 INFO:teuthology.orchestra.run.smithi087.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 377 0.101 -4.071 2.668 2024-09-13T18:36:02.931 INFO:teuthology.orchestra.run.smithi087.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.082 -0.193 2.442 2024-09-13T18:36:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-13T18:36:02.931 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:36:02.941 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:36:02.941 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:36:02.949 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:36:02.957 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:36:02.966 INFO:teuthology.task.internal:Duration was 1344.776592 seconds 2024-09-13T18:36:02.966 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:36:02.975 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:36:02.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:36:02.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:36:03.014 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:36:03.014 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-09-13T18:36:03.015 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:36:03.065 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-09-13T18:36:03.066 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:36:03.076 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:36:03.076 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:36:03.110 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:36:03.151 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:36:03.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:36:03.186 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:36:03.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:36:03.280 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:36:03.280 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:36:03.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:36:03.307 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:36:03.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:36:03.338 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:36:03.347 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-09-13T18:36:03.363 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-09-13T18:36:03.376 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:36:03.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:03.408 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:36:03.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:03.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:36:03.433 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:36:03.434 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/remote/smithi053 2024-09-13T18:36:03.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:36:03.474 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903972/remote/smithi087 2024-09-13T18:36:03.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:36:03.496 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:36:03.496 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:36:03.518 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:36:03.540 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:36:03.550 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:36:03.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:36:03.559 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:36:03.559 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:36:03.566 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:36:03.569 INFO:teuthology.orchestra.run.smithi053.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:36 /home/ubuntu/cephtest 2024-09-13T18:36:03.589 INFO:teuthology.orchestra.run.smithi087.stdout: 658643 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:36 /home/ubuntu/cephtest 2024-09-13T18:36:03.590 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:36:03.600 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:36:03.623 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} duration: 1344.7765917778015 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:36:03.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:36:03.716 INFO:teuthology.run:pass